2024-04-23T14:14:34.567 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-23T14:14:34.567 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_rishabh@teuthology --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} --verbose --name rishabh-2024-04-23_14:04:26-fs-wip-rishabh-testing-20240416.193735-3-testing-default-smithi --archive /home/teuthworker/archive/rishabh-2024-04-23_14:04:26-fs-wip-rishabh-testing-20240416.193735-3-testing-default-smithi/7669570 -- /home/teuthworker/archive/rishabh-2024-04-23_14:04:26-fs-wip-rishabh-testing-20240416.193735-3-testing-default-smithi/7669570/orig.config.yaml 2024-04-23T14:14:34.618 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-23T14:14:34.727 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-04-23_14:04:26-fs-wip-rishabh-testing-20240416.193735-3-testing-default-smithi/7669570 branch: wip-rishabh-testing-20240416.193735-3 description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: null first_in_suite: false job_id: '7669570' kernel: flavor: default kdb: true sha1: 806ec36b21129f113ce356c007dd59694d340b37 last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: rishabh-2024-04-23_14:04:26-fs-wip-rishabh-testing-20240416.193735-3-testing-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240416.193735-3 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: d44fddd910b5e94da0f2357af4be37d7bd495ae0 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d44fddd910b5e94da0f2357af4be37d7bd495ae0 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240416.193735-3 sha1: d44fddd910b5e94da0f2357af4be37d7bd495ae0 owner: scheduled_rishabh@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 7954 sha1: d44fddd910b5e94da0f2357af4be37d7bd495ae0 sleep_before_teardown: 0 subset: 364/512 suite: fs suite_branch: wip-rishabh-testing-20240416.193735-3 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d44fddd910b5e94da0f2357af4be37d7bd495ae0/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d44fddd910b5e94da0f2357af4be37d7bd495ae0 targets: smithi081.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEsurG/xnoOFgQ92UrBI8nwEuk7iALERgMj/cuLmOFnFx5rsT8t1Bsz8+CRMelnaTmlK+UemFkQdpFPAgv3HEN0= smithi156.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNkLo+TiY5zhG0VAx81H4W4/5q7PmGOaj3offMHjsopioFI1hMesdjWFHDP99wuFQNmPEY/acDHSMem4mWmmBL0= tasks: - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: - /cephfs/home/rishabh/src/git.ceph.com_ceph-c_wip-rishabh-testing-20240416.193735-3/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml meta: {} postmerge: [] variables: fail_fs: false teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-23_14:04:26 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs false || true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-04-23T14:14:34.727 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d44fddd910b5e94da0f2357af4be37d7bd495ae0/qa; will attempt to use it 2024-04-23T14:14:34.728 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d44fddd910b5e94da0f2357af4be37d7bd495ae0/qa/tasks 2024-04-23T14:14:34.728 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-23T14:14:34.730 INFO:teuthology.task.internal:Checking packages... 2024-04-23T14:14:34.754 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd44fddd910b5e94da0f2357af4be37d7bd495ae0' 2024-04-23T14:14:34.755 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-23T14:14:34.755 INFO:teuthology.packaging:ref: None 2024-04-23T14:14:34.755 INFO:teuthology.packaging:tag: None 2024-04-23T14:14:34.755 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240416.193735-3 2024-04-23T14:14:34.755 INFO:teuthology.packaging:sha1: d44fddd910b5e94da0f2357af4be37d7bd495ae0 2024-04-23T14:14:34.755 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240416.193735-3 2024-04-23T14:14:34.973 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3126.gd44fddd9 2024-04-23T14:14:34.975 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-23T14:14:34.981 INFO:teuthology.task.internal:no buildpackages task found 2024-04-23T14:14:34.981 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-23T14:14:34.989 INFO:teuthology.task.internal:Saving configuration 2024-04-23T14:14:35.008 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-23T14:14:35.013 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-23T14:14:35.036 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-23_14:04:26-fs-wip-rishabh-testing-20240416.193735-3-testing-default-smithi/7669570', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-23 14:05:36.093390', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEsurG/xnoOFgQ92UrBI8nwEuk7iALERgMj/cuLmOFnFx5rsT8t1Bsz8+CRMelnaTmlK+UemFkQdpFPAgv3HEN0='} 2024-04-23T14:14:35.059 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-23_14:04:26-fs-wip-rishabh-testing-20240416.193735-3-testing-default-smithi/7669570', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-23 14:05:36.095859', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNkLo+TiY5zhG0VAx81H4W4/5q7PmGOaj3offMHjsopioFI1hMesdjWFHDP99wuFQNmPEY/acDHSMem4mWmmBL0='} 2024-04-23T14:14:35.059 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-23T14:14:35.065 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-04-23T14:14:35.065 INFO:teuthology.task.internal:roles: ubuntu@smithi156.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-04-23T14:14:35.065 INFO:teuthology.run_tasks:Running task console_log... 2024-04-23T14:14:35.141 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc4b4fbe160>, signals=[15]) 2024-04-23T14:14:35.141 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-23T14:14:35.147 INFO:teuthology.task.internal:Opening connections... 2024-04-23T14:14:35.148 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi081.front.sepia.ceph.com 2024-04-23T14:14:35.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T14:14:35.229 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi156.front.sepia.ceph.com 2024-04-23T14:14:35.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T14:14:35.304 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-23T14:14:35.312 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2024-04-23T14:14:35.329 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2024-04-23T14:14:35.329 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2024-04-23T14:14:35.386 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream" 2024-04-23T14:14:35.386 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="9" 2024-04-23T14:14:35.387 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos" 2024-04-23T14:14:35.387 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora" 2024-04-23T14:14:35.387 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="9" 2024-04-23T14:14:35.387 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el9" 2024-04-23T14:14:35.387 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-23T14:14:35.387 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2024-04-23T14:14:35.387 INFO:teuthology.orchestra.run.smithi081.stdout:LOGO="fedora-logo-icon" 2024-04-23T14:14:35.387 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-23T14:14:35.387 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/" 2024-04-23T14:14:35.387 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-23T14:14:35.387 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-23T14:14:35.387 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-23T14:14:35.388 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2024-04-23T14:14:35.416 DEBUG:teuthology.orchestra.run.smithi156:> uname -m 2024-04-23T14:14:35.434 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2024-04-23T14:14:35.434 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2024-04-23T14:14:35.491 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream" 2024-04-23T14:14:35.491 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="9" 2024-04-23T14:14:35.491 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos" 2024-04-23T14:14:35.491 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora" 2024-04-23T14:14:35.491 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="9" 2024-04-23T14:14:35.491 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el9" 2024-04-23T14:14:35.491 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-23T14:14:35.491 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2024-04-23T14:14:35.491 INFO:teuthology.orchestra.run.smithi156.stdout:LOGO="fedora-logo-icon" 2024-04-23T14:14:35.492 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-23T14:14:35.492 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/" 2024-04-23T14:14:35.492 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-23T14:14:35.492 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-23T14:14:35.492 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-23T14:14:35.492 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2024-04-23T14:14:35.515 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-23T14:14:35.523 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-23T14:14:35.558 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-23T14:14:35.558 DEBUG:teuthology.orchestra.run.smithi081:> test '!' -e /home/ubuntu/cephtest 2024-04-23T14:14:35.561 DEBUG:teuthology.orchestra.run.smithi156:> test '!' -e /home/ubuntu/cephtest 2024-04-23T14:14:35.577 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-23T14:14:35.584 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-23T14:14:35.584 DEBUG:teuthology.orchestra.run.smithi081:> test -z $(ls -A /var/lib/ceph) 2024-04-23T14:14:35.619 DEBUG:teuthology.orchestra.run.smithi156:> test -z $(ls -A /var/lib/ceph) 2024-04-23T14:14:35.709 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-23T14:14:35.758 INFO:teuthology.run_tasks:Running task kernel... 2024-04-23T14:14:35.773 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'} 2024-04-23T14:14:35.773 INFO:teuthology.task.kernel:config {'host.a': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'host.b': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}}, timeout 300 2024-04-23T14:14:35.774 DEBUG:teuthology.orchestra.run.smithi081:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-23T14:14:35.774 DEBUG:teuthology.orchestra.run.smithi156:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-23T14:14:35.790 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T14:14:35.791 DEBUG:teuthology.task.kernel:sha1 for host.a is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-23T14:14:35.791 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-23T14:14:35.791 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-04-23T14:14:35.791 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T14:14:35.792 DEBUG:teuthology.task.kernel:sha1 for host.b is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-23T14:14:35.792 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-23T14:14:35.792 DEBUG:teuthology.orchestra.run.smithi156:> uname -r 2024-04-23T14:14:35.847 INFO:teuthology.orchestra.run.smithi081.stdout:5.14.0-437.el9.x86_64 2024-04-23T14:14:35.848 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-23T14:14:35.848 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-23T14:14:35.848 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-23T14:14:35.852 INFO:teuthology.orchestra.run.smithi156.stdout:5.14.0-437.el9.x86_64 2024-04-23T14:14:35.852 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-23T14:14:35.852 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-23T14:14:35.852 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-23T14:14:35.985 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum upgrade -y linux-firmware 2024-04-23T14:14:35.998 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum upgrade -y linux-firmware 2024-04-23T14:14:38.840 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - BaseOS 6.7 MB/s | 8.0 MB 00:01 2024-04-23T14:14:40.275 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - BaseOS 3.1 MB/s | 8.0 MB 00:02 2024-04-23T14:14:40.949 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - AppStream 18 MB/s | 19 MB 00:01 2024-04-23T14:14:44.784 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - AppStream 5.6 MB/s | 19 MB 00:03 2024-04-23T14:14:50.218 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 6.2 MB 00:01 2024-04-23T14:14:52.395 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - Extras packages 23 kB/s | 16 kB 00:00 2024-04-23T14:14:54.066 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - CRB 665 kB/s | 6.2 MB 00:09 2024-04-23T14:14:54.845 INFO:teuthology.orchestra.run.smithi156.stdout:Extra Packages for Enterprise Linux 9.0 MB/s | 21 MB 00:02 2024-04-23T14:14:55.625 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 16 kB 00:00 2024-04-23T14:14:56.610 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 24 MB/s | 21 MB 00:00 2024-04-23T14:14:59.895 INFO:teuthology.orchestra.run.smithi156.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2024-04-23T14:15:01.735 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-04-23T14:15:01.891 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2024-04-23T14:15:01.892 INFO:teuthology.orchestra.run.smithi156.stdout:Nothing to do. 2024-04-23T14:15:01.892 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2024-04-23T14:15:02.008 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on host.b... 2024-04-23T14:15:02.008 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-23T14:15:02.162 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-04-23T14:15:02.163 DEBUG:teuthology.orchestra.run.smithi156:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-23T14:15:02.165 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi156.front.sepia.ceph.com to complete... 2024-04-23T14:15:03.709 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-04-23T14:15:03.709 INFO:teuthology.orchestra.run.smithi081.stdout:Nothing to do. 2024-04-23T14:15:03.710 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-04-23T14:15:03.831 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on host.a... 2024-04-23T14:15:03.832 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-23T14:15:03.969 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-04-23T14:15:03.969 DEBUG:teuthology.orchestra.run.smithi081:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-23T14:15:03.972 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi081.front.sepia.ceph.com to complete... 2024-04-23T14:22:16.484 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23 14:22:16 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-23T14:22:16.484 INFO:teuthology.orchestra.run.smithi156.stderr:FINISHED --2024-04-23 14:22:16-- 2024-04-23T14:22:16.484 INFO:teuthology.orchestra.run.smithi156.stderr:Total wall clock time: 7m 14s 2024-04-23T14:22:16.484 INFO:teuthology.orchestra.run.smithi156.stderr:Downloaded: 1 files, 341M in 7m 14s (805 KB/s) 2024-04-23T14:22:16.487 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on host.b... 2024-04-23T14:22:16.488 DEBUG:teuthology.orchestra.run.smithi156:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-23T14:22:18.637 INFO:teuthology.orchestra.run.smithi156.stdout:Verifying... ######################################## 2024-04-23T14:22:18.863 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing... ######################################## 2024-04-23T14:22:18.985 INFO:teuthology.orchestra.run.smithi156.stdout:Updating / installing... 2024-04-23T14:22:27.022 INFO:teuthology.orchestra.run.smithi156.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-04-23T14:22:40.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23 14:22:40 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-23T14:22:40.119 INFO:teuthology.orchestra.run.smithi081.stderr:FINISHED --2024-04-23 14:22:40-- 2024-04-23T14:22:40.119 INFO:teuthology.orchestra.run.smithi081.stderr:Total wall clock time: 7m 36s 2024-04-23T14:22:40.120 INFO:teuthology.orchestra.run.smithi081.stderr:Downloaded: 1 files, 341M in 7m 35s (767 KB/s) 2024-04-23T14:22:40.123 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on host.a... 2024-04-23T14:22:40.123 DEBUG:teuthology.orchestra.run.smithi081:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-23T14:22:42.213 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying... ######################################## 2024-04-23T14:22:42.391 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing... ######################################## 2024-04-23T14:22:42.501 INFO:teuthology.orchestra.run.smithi081.stdout:Updating / installing... 2024-04-23T14:22:50.418 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-04-23T14:23:04.718 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi156.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-23T14:23:04.719 DEBUG:teuthology.orchestra.run.smithi156:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-23T14:23:04.805 INFO:teuthology.orchestra.run.smithi156.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-23T14:23:04.806 INFO:teuthology.orchestra.run.smithi156.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-04-23T14:23:04.806 INFO:teuthology.orchestra.run.smithi156.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-23T14:23:04.806 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-04-23T14:23:04.807 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-04-23T14:23:04.807 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-04-23T14:23:04.807 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-04-23T14:23:04.807 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-04-23T14:23:04.807 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-04-23T14:23:04.807 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-23T14:23:04.808 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-23T14:23:04.808 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-23T14:23:04.808 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-23T14:23:04.808 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-23T14:23:04.808 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-23T14:23:04.808 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-23T14:23:04.808 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-23T14:23:04.809 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-23T14:23:04.809 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-23T14:23:04.809 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-23T14:23:04.809 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-23T14:23:04.809 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-23T14:23:04.809 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-23T14:23:04.810 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-23T14:23:04.810 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-23T14:23:04.810 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-23T14:23:04.810 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-23T14:23:04.810 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-23T14:23:04.810 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-23T14:23:04.811 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-04-23T14:23:04.811 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-04-23T14:23:04.811 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-04-23T14:23:04.811 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-23T14:23:04.811 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-04-23T14:23:04.811 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-23T14:23:04.811 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-23T14:23:04.812 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-23T14:23:04.812 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-04-23T14:23:04.812 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-23T14:23:04.812 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-23T14:23:04.812 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-23T14:23:04.812 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-04-23T14:23:04.813 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-23T14:23:04.813 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-23T14:23:04.813 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-23T14:23:04.813 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-23T14:23:04.813 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-23T14:23:04.813 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-23T14:23:04.814 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-23T14:23:04.814 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-23T14:23:04.814 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-23T14:23:04.814 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-23T14:23:04.814 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-23T14:23:04.815 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-23T14:23:04.815 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-23T14:23:04.815 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-23T14:23:04.815 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-23T14:23:04.815 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-23T14:23:04.815 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-23T14:23:04.815 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-23T14:23:04.816 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-23T14:23:04.816 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-23T14:23:04.816 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-23T14:23:04.816 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-23T14:23:04.816 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-23T14:23:04.816 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-23T14:23:04.817 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-23T14:23:04.817 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-23T14:23:04.817 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-23T14:23:04.817 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-23T14:23:04.817 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-23T14:23:04.817 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-23T14:23:04.817 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-23T14:23:04.818 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-23T14:23:04.818 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-23T14:23:04.818 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-23T14:23:04.818 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-23T14:23:04.818 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-23T14:23:04.818 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-23T14:23:04.819 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-23T14:23:04.819 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-23T14:23:04.819 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-23T14:23:04.819 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-23T14:23:04.819 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-23T14:23:04.819 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-23T14:23:04.820 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-23T14:23:04.820 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-23T14:23:04.820 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-04-23T14:23:04.820 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-04-23T14:23:04.820 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-23T14:23:04.820 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-23T14:23:04.820 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-23T14:23:04.821 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-23T14:23:04.821 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-23T14:23:04.821 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-23T14:23:04.821 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-23T14:23:04.821 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-04-23T14:23:04.821 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-23T14:23:04.822 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-23T14:23:04.822 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-04-23T14:23:04.822 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-23T14:23:04.822 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-23T14:23:04.822 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-23T14:23:04.822 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-23T14:23:04.823 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-23T14:23:04.823 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-23T14:23:04.823 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-23T14:23:04.823 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-23T14:23:04.823 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-23T14:23:04.823 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-23T14:23:04.823 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-23T14:23:04.824 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-23T14:23:04.824 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-23T14:23:04.824 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-23T14:23:04.824 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-23T14:23:04.824 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-23T14:23:04.824 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-23T14:23:04.825 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-23T14:23:04.825 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-23T14:23:04.825 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-23T14:23:04.825 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-23T14:23:04.825 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-23T14:23:04.825 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-23T14:23:04.826 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-23T14:23:04.826 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-23T14:23:04.826 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-23T14:23:04.826 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-23T14:23:04.826 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-23T14:23:04.826 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-23T14:23:04.827 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-23T14:23:04.827 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-23T14:23:04.827 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-23T14:23:04.827 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-23T14:23:04.827 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-23T14:23:04.827 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-23T14:23:04.828 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-04-23T14:23:04.828 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-23T14:23:04.828 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-23T14:23:04.828 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-23T14:23:04.828 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-23T14:23:04.828 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-23T14:23:04.829 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-23T14:23:04.829 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-23T14:23:04.829 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-23T14:23:04.829 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-23T14:23:04.829 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-23T14:23:04.829 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-23T14:23:04.830 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-23T14:23:04.830 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-23T14:23:04.830 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-23T14:23:04.830 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-23T14:23:04.830 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-23T14:23:04.830 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-23T14:23:04.831 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-04-23T14:23:04.831 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-23T14:23:04.831 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-04-23T14:23:04.831 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-04-23T14:23:04.831 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-23T14:23:04.831 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-23T14:23:04.832 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-04-23T14:23:04.832 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-23T14:23:04.832 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-04-23T14:23:04.832 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-04-23T14:23:04.832 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-23T14:23:04.832 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-04-23T14:23:04.832 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-04-23T14:23:04.833 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-23T14:23:04.833 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-23T14:23:04.833 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-04-23T14:23:04.833 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-04-23T14:23:04.833 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-23T14:23:04.833 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-23T14:23:04.834 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-04-23T14:23:04.834 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-23T14:23:04.834 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-23T14:23:04.834 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-23T14:23:04.834 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-04-23T14:23:04.834 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-04-23T14:23:04.835 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-23T14:23:04.835 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-04-23T14:23:04.835 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-04-23T14:23:04.835 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-23T14:23:04.835 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-04-23T14:23:04.835 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-23T14:23:04.836 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-04-23T14:23:04.836 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-23T14:23:04.836 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-23T14:23:04.836 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-23T14:23:04.836 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-23T14:23:04.836 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-23T14:23:04.837 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-04-23T14:23:04.837 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-23T14:23:04.837 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-23T14:23:04.837 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-23T14:23:04.837 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-23T14:23:04.837 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-23T14:23:04.838 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-23T14:23:04.838 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-23T14:23:04.838 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-04-23T14:23:04.838 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-23T14:23:04.838 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-23T14:23:04.838 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-23T14:23:04.839 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-04-23T14:23:04.839 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-04-23T14:23:04.839 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-23T14:23:04.839 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-23T14:23:04.839 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-23T14:23:04.839 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-23T14:23:04.839 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-23T14:23:04.839 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-04-23T14:23:04.839 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-04-23T14:23:04.840 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-04-23T14:23:04.840 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-23T14:23:04.840 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-23T14:23:04.840 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-23T14:23:04.840 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-23T14:23:04.840 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-23T14:23:04.840 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-23T14:23:04.840 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-04-23T14:23:04.840 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-04-23T14:23:04.841 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-23T14:23:04.841 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-23T14:23:04.841 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-04-23T14:23:04.841 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-04-23T14:23:04.841 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-04-23T14:23:04.841 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-23T14:23:04.841 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-23T14:23:04.841 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-23T14:23:04.842 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-23T14:23:04.842 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-23T14:23:04.842 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-04-23T14:23:04.842 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-23T14:23:04.842 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-04-23T14:23:04.842 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-23T14:23:04.842 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-04-23T14:23:04.842 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-23T14:23:04.842 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-04-23T14:23:04.843 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-04-23T14:23:04.843 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-23T14:23:04.843 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-04-23T14:23:04.843 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-23T14:23:04.843 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-04-23T14:23:04.843 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-23T14:23:04.843 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-23T14:23:04.843 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-23T14:23:04.844 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-23T14:23:04.844 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-23T14:23:04.844 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-23T14:23:04.844 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-23T14:23:04.844 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-23T14:23:04.844 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-23T14:23:04.844 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-23T14:23:04.844 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-23T14:23:04.845 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-23T14:23:04.845 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-23T14:23:04.845 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-04-23T14:23:04.845 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-04-23T14:23:04.845 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-23T14:23:04.845 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-04-23T14:23:04.845 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-23T14:23:04.845 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-23T14:23:04.845 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-04-23T14:23:04.845 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-23T14:23:04.845 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-23T14:23:04.845 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-23T14:23:04.846 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-23T14:23:04.846 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-23T14:23:04.846 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-23T14:23:04.846 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-23T14:23:04.846 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-23T14:23:04.846 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-23T14:23:04.846 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-23T14:23:04.846 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-23T14:23:04.846 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-23T14:23:04.846 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-23T14:23:04.846 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-23T14:23:04.846 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-23T14:23:04.846 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-23T14:23:04.847 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-23T14:23:04.847 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-23T14:23:04.847 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-23T14:23:04.847 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-23T14:23:04.847 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-23T14:23:04.847 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-23T14:23:04.847 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-23T14:23:04.847 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-23T14:23:04.847 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-23T14:23:04.847 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-23T14:23:04.847 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-23T14:23:04.848 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-23T14:23:04.848 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-23T14:23:04.848 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-23T14:23:04.848 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-23T14:23:04.848 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-23T14:23:04.848 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-23T14:23:04.848 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-23T14:23:04.849 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-23T14:23:04.849 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-23T14:23:04.849 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-23T14:23:04.849 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-23T14:23:04.849 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-23T14:23:04.849 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-23T14:23:04.850 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-23T14:23:04.850 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-23T14:23:04.850 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-23T14:23:04.850 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-23T14:23:04.850 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-23T14:23:04.850 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-23T14:23:04.851 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-23T14:23:04.851 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-23T14:23:04.851 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-23T14:23:04.851 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-23T14:23:04.851 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-23T14:23:04.851 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-23T14:23:04.852 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-23T14:23:04.852 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-23T14:23:04.852 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-23T14:23:04.852 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-23T14:23:04.852 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-23T14:23:04.852 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-23T14:23:04.852 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-23T14:23:04.853 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-23T14:23:04.853 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-23T14:23:04.853 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-23T14:23:04.853 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-23T14:23:04.853 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-23T14:23:04.853 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-04-23T14:23:04.854 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-23T14:23:04.854 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-23T14:23:04.854 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-23T14:23:04.854 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-04-23T14:23:04.854 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-23T14:23:04.854 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-23T14:23:04.854 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-23T14:23:04.855 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-23T14:23:04.855 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-23T14:23:04.855 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-23T14:23:04.855 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-23T14:23:04.855 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-23T14:23:04.855 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-23T14:23:04.855 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-23T14:23:04.855 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-23T14:23:04.855 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-23T14:23:04.855 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-23T14:23:04.855 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-23T14:23:04.856 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-23T14:23:04.856 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-23T14:23:04.856 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-23T14:23:04.856 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-23T14:23:04.856 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-23T14:23:04.856 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-23T14:23:04.856 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-23T14:23:04.856 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-23T14:23:04.856 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-23T14:23:04.856 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-23T14:23:04.856 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-23T14:23:04.856 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-23T14:23:04.856 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-23T14:23:04.856 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-23T14:23:04.857 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-23T14:23:04.857 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-23T14:23:04.857 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-23T14:23:04.857 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-23T14:23:04.857 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-23T14:23:04.857 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-23T14:23:04.857 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-23T14:23:04.857 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-23T14:23:04.857 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-23T14:23:04.857 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-23T14:23:04.857 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-23T14:23:04.857 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-23T14:23:04.857 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-23T14:23:04.857 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-23T14:23:04.858 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-23T14:23:04.858 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-23T14:23:04.858 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-23T14:23:04.858 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-23T14:23:04.858 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-23T14:23:04.858 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-23T14:23:04.858 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-23T14:23:04.858 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-23T14:23:04.858 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-23T14:23:04.858 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-23T14:23:04.858 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-23T14:23:04.858 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-23T14:23:04.858 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-23T14:23:04.858 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-23T14:23:04.858 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-23T14:23:04.859 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-23T14:23:04.859 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-23T14:23:04.859 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-23T14:23:04.859 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-23T14:23:04.859 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-23T14:23:04.859 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-23T14:23:04.859 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-23T14:23:04.859 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-23T14:23:04.859 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-23T14:23:04.859 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-23T14:23:04.859 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-23T14:23:04.859 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-23T14:23:04.859 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-23T14:23:04.859 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-23T14:23:04.860 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-23T14:23:04.860 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-23T14:23:04.860 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-23T14:23:04.860 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-23T14:23:04.860 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-23T14:23:04.860 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-23T14:23:04.860 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-23T14:23:04.860 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-23T14:23:04.860 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-23T14:23:04.860 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-23T14:23:04.860 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-23T14:23:04.860 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-23T14:23:04.860 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-23T14:23:04.860 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-23T14:23:04.860 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-23T14:23:04.861 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-23T14:23:04.861 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-23T14:23:04.861 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-04-23T14:23:04.861 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-23T14:23:04.861 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-23T14:23:04.861 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-23T14:23:04.861 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-23T14:23:04.861 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-23T14:23:04.861 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-23T14:23:04.861 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-23T14:23:04.861 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-23T14:23:04.861 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-23T14:23:04.861 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-23T14:23:04.861 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-23T14:23:04.861 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-23T14:23:04.862 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-23T14:23:04.862 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-23T14:23:04.862 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-23T14:23:04.862 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-23T14:23:04.862 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-23T14:23:04.862 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-23T14:23:04.862 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-23T14:23:04.862 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-23T14:23:04.862 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-23T14:23:04.862 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-23T14:23:04.862 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-23T14:23:04.862 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-23T14:23:04.862 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-23T14:23:04.862 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-23T14:23:04.863 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-23T14:23:04.863 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-23T14:23:04.863 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-23T14:23:04.863 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-23T14:23:04.863 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-23T14:23:04.863 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-23T14:23:04.863 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-23T14:23:04.863 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-23T14:23:04.863 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-23T14:23:04.863 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-23T14:23:04.863 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-23T14:23:04.863 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-23T14:23:04.863 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-23T14:23:04.863 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-23T14:23:04.863 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-23T14:23:04.864 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-04-23T14:23:04.864 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-04-23T14:23:04.864 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-23T14:23:04.864 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-23T14:23:04.864 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-04-23T14:23:04.864 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-23T14:23:04.864 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-23T14:23:04.864 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-23T14:23:04.864 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-23T14:23:04.864 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-23T14:23:04.864 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-23T14:23:04.864 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-23T14:23:04.864 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-23T14:23:04.865 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-23T14:23:04.865 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-23T14:23:04.865 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-23T14:23:04.865 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-23T14:23:04.865 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-23T14:23:04.865 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-23T14:23:04.865 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-23T14:23:04.865 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-23T14:23:04.865 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-23T14:23:04.865 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-23T14:23:04.865 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-23T14:23:04.865 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-23T14:23:04.865 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-23T14:23:04.865 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-23T14:23:04.866 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-23T14:23:04.866 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-04-23T14:23:04.866 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-23T14:23:04.866 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-23T14:23:04.866 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-23T14:23:04.866 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-23T14:23:04.866 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-04-23T14:23:04.866 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-04-23T14:23:04.866 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-23T14:23:04.866 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-23T14:23:04.866 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-23T14:23:04.866 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-23T14:23:04.866 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-23T14:23:04.866 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-23T14:23:04.867 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-23T14:23:04.867 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-04-23T14:23:04.867 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-04-23T14:23:04.867 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-23T14:23:04.867 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-04-23T14:23:04.867 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-23T14:23:04.867 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-04-23T14:23:04.867 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-23T14:23:04.867 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-04-23T14:23:04.867 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-23T14:23:04.867 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-04-23T14:23:04.867 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-04-23T14:23:04.867 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-23T14:23:04.867 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-04-23T14:23:04.867 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-23T14:23:04.868 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-04-23T14:23:04.868 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-23T14:23:04.868 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-04-23T14:23:04.868 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-23T14:23:04.868 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-04-23T14:23:04.868 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-23T14:23:04.868 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-04-23T14:23:04.868 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-04-23T14:23:04.868 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-23T14:23:04.868 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-23T14:23:04.868 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-23T14:23:04.868 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-23T14:23:04.868 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-04-23T14:23:04.868 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-23T14:23:04.869 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-04-23T14:23:04.869 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-23T14:23:04.869 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-23T14:23:04.869 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-23T14:23:04.869 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-23T14:23:04.869 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-23T14:23:04.869 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-23T14:23:04.869 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-23T14:23:04.869 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-23T14:23:04.869 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-04-23T14:23:04.869 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-23T14:23:04.869 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-04-23T14:23:04.869 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-23T14:23:04.869 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-23T14:23:04.870 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-23T14:23:04.870 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-23T14:23:04.870 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-23T14:23:04.870 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-04-23T14:23:04.870 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-23T14:23:04.870 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-23T14:23:04.870 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-23T14:23:04.870 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-23T14:23:04.870 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-04-23T14:23:04.870 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-23T14:23:04.870 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-23T14:23:04.870 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-23T14:23:04.870 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-23T14:23:04.870 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-23T14:23:04.870 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-23T14:23:04.871 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-23T14:23:04.871 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-23T14:23:04.871 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-23T14:23:04.871 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-04-23T14:23:04.871 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-04-23T14:23:04.871 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-23T14:23:04.871 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-23T14:23:04.871 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-23T14:23:04.871 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-23T14:23:04.871 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-23T14:23:04.871 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-23T14:23:04.871 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-23T14:23:04.871 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-23T14:23:04.871 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-23T14:23:04.872 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-23T14:23:04.872 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-23T14:23:04.872 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-23T14:23:04.872 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-23T14:23:04.872 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-23T14:23:04.872 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-23T14:23:04.872 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-23T14:23:04.872 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-04-23T14:23:04.872 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-23T14:23:04.872 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-23T14:23:04.872 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-23T14:23:04.872 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-23T14:23:04.872 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-23T14:23:04.872 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-04-23T14:23:04.873 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-04-23T14:23:04.873 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-23T14:23:04.873 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-23T14:23:04.873 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-23T14:23:04.873 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-23T14:23:04.873 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-23T14:23:04.873 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-23T14:23:04.873 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-23T14:23:04.873 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-04-23T14:23:04.873 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-23T14:23:04.873 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-23T14:23:04.873 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-04-23T14:23:04.873 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-23T14:23:04.873 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-23T14:23:04.874 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-23T14:23:04.874 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-23T14:23:04.874 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-04-23T14:23:04.874 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-04-23T14:23:04.874 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-23T14:23:04.874 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-23T14:23:04.874 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-23T14:23:04.874 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-23T14:23:04.874 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-04-23T14:23:04.874 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-23T14:23:04.874 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-04-23T14:23:04.874 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-23T14:23:04.874 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-23T14:23:04.874 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-23T14:23:04.874 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-23T14:23:04.875 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-23T14:23:04.875 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-23T14:23:04.875 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-23T14:23:04.875 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-04-23T14:23:04.875 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-23T14:23:04.875 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-23T14:23:04.875 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-04-23T14:23:04.875 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-23T14:23:04.875 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-23T14:23:04.875 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-23T14:23:04.875 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-04-23T14:23:04.875 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-23T14:23:04.875 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-04-23T14:23:04.875 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-23T14:23:04.875 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-23T14:23:04.876 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-23T14:23:04.876 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-23T14:23:04.876 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-23T14:23:04.876 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-23T14:23:04.876 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-23T14:23:04.876 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-04-23T14:23:04.876 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-23T14:23:04.876 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-04-23T14:23:04.876 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-04-23T14:23:04.876 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-23T14:23:04.876 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-04-23T14:23:04.876 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-04-23T14:23:04.876 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-23T14:23:04.876 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-23T14:23:04.877 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-23T14:23:04.877 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-04-23T14:23:04.877 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-23T14:23:04.877 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-23T14:23:04.877 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-23T14:23:04.877 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-04-23T14:23:04.877 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-04-23T14:23:04.877 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-23T14:23:04.877 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-23T14:23:04.877 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-23T14:23:04.877 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-23T14:23:04.877 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-04-23T14:23:04.877 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-23T14:23:04.877 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-23T14:23:04.878 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-23T14:23:04.878 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-23T14:23:04.878 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-04-23T14:23:04.878 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-23T14:23:04.878 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-04-23T14:23:04.878 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-23T14:23:04.878 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-04-23T14:23:04.878 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-23T14:23:04.878 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-04-23T14:23:04.878 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-23T14:23:04.878 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-04-23T14:23:04.878 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-23T14:23:04.878 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-23T14:23:04.878 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-23T14:23:04.879 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-04-23T14:23:04.879 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-04-23T14:23:04.879 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-23T14:23:04.879 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-23T14:23:04.879 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-23T14:23:04.879 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-23T14:23:04.879 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-23T14:23:04.879 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-04-23T14:23:04.879 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-23T14:23:04.879 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-23T14:23:04.879 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-04-23T14:23:04.879 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-23T14:23:04.879 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-23T14:23:04.879 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-23T14:23:04.879 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-23T14:23:04.880 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-23T14:23:04.880 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-04-23T14:23:04.880 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-23T14:23:04.880 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-23T14:23:04.880 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-04-23T14:23:04.880 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-04-23T14:23:04.880 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-23T14:23:04.880 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-04-23T14:23:04.880 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-23T14:23:04.880 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-23T14:23:04.880 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-23T14:23:04.880 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-23T14:23:04.880 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-23T14:23:04.880 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-23T14:23:04.881 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-23T14:23:04.881 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-23T14:23:04.881 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-23T14:23:04.881 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-23T14:23:04.881 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-04-23T14:23:04.881 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-04-23T14:23:04.881 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-23T14:23:04.881 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-04-23T14:23:04.881 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-04-23T14:23:04.881 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-23T14:23:04.881 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-23T14:23:04.881 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-23T14:23:04.881 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-23T14:23:04.881 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-23T14:23:04.882 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-23T14:23:04.882 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-04-23T14:23:04.882 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-23T14:23:04.882 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-23T14:23:04.882 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-23T14:23:04.882 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-04-23T14:23:04.882 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-04-23T14:23:04.882 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-23T14:23:04.882 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-23T14:23:04.882 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-23T14:23:04.882 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-04-23T14:23:04.882 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-23T14:23:04.882 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-04-23T14:23:04.883 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-23T14:23:04.883 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-04-23T14:23:04.883 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-23T14:23:04.883 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-04-23T14:23:04.883 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-23T14:23:04.883 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-04-23T14:23:04.883 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-23T14:23:04.883 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-04-23T14:23:04.883 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-23T14:23:04.883 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-04-23T14:23:04.883 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-23T14:23:04.883 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-04-23T14:23:04.883 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-23T14:23:04.883 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-23T14:23:04.884 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-23T14:23:04.884 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-23T14:23:04.884 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-23T14:23:04.884 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-23T14:23:04.884 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-04-23T14:23:04.884 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-23T14:23:04.884 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-23T14:23:04.884 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-23T14:23:04.884 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-04-23T14:23:04.884 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-23T14:23:04.884 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-23T14:23:04.884 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-23T14:23:04.884 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-23T14:23:04.884 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-23T14:23:04.885 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-23T14:23:04.885 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-04-23T14:23:04.885 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-23T14:23:04.885 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-04-23T14:23:04.885 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-23T14:23:04.885 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-23T14:23:04.885 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-04-23T14:23:04.885 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-23T14:23:04.885 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-23T14:23:04.885 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-04-23T14:23:04.885 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-23T14:23:04.885 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-04-23T14:23:04.885 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-23T14:23:04.885 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-04-23T14:23:04.885 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-23T14:23:04.886 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-23T14:23:04.886 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-04-23T14:23:04.886 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-23T14:23:04.886 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-23T14:23:04.886 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-23T14:23:04.886 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-23T14:23:04.886 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-23T14:23:04.886 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-04-23T14:23:04.886 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-23T14:23:04.886 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-04-23T14:23:04.886 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-23T14:23:04.886 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-23T14:23:04.886 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-23T14:23:04.886 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-23T14:23:04.887 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-04-23T14:23:04.887 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-23T14:23:04.887 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-04-23T14:23:04.887 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-23T14:23:04.887 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-04-23T14:23:04.887 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-23T14:23:04.887 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-04-23T14:23:04.887 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-23T14:23:04.887 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-23T14:23:04.887 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-04-23T14:23:04.887 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-23T14:23:04.887 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-23T14:23:04.887 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-23T14:23:04.887 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-23T14:23:04.888 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-04-23T14:23:04.888 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-23T14:23:04.888 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-23T14:23:04.888 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-23T14:23:04.888 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-04-23T14:23:04.888 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-23T14:23:04.888 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-23T14:23:04.888 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-23T14:23:04.888 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-23T14:23:04.888 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-04-23T14:23:04.888 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-23T14:23:04.888 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-04-23T14:23:04.888 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-23T14:23:04.888 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-04-23T14:23:04.888 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-23T14:23:04.889 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-23T14:23:04.889 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-04-23T14:23:04.889 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-23T14:23:04.889 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-23T14:23:04.889 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-04-23T14:23:04.889 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-23T14:23:04.889 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-23T14:23:04.889 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-04-23T14:23:04.889 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-23T14:23:04.889 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-04-23T14:23:04.889 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-23T14:23:04.889 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-23T14:23:04.889 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-04-23T14:23:04.889 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-23T14:23:04.889 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-23T14:23:04.890 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-23T14:23:04.890 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-04-23T14:23:04.890 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-23T14:23:04.890 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-23T14:23:04.890 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-23T14:23:04.890 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-23T14:23:04.890 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-23T14:23:04.890 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-04-23T14:23:04.890 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-23T14:23:04.890 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-23T14:23:04.890 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-04-23T14:23:04.890 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-23T14:23:04.890 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-23T14:23:04.890 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-04-23T14:23:04.891 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-23T14:23:04.891 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-23T14:23:04.891 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-23T14:23:04.891 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-23T14:23:04.891 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-23T14:23:04.891 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-23T14:23:04.891 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-23T14:23:04.891 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-23T14:23:04.891 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-04-23T14:23:04.891 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-23T14:23:04.891 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-23T14:23:04.891 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-23T14:23:04.891 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-23T14:23:04.891 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-23T14:23:04.891 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-23T14:23:04.892 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-23T14:23:04.892 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-23T14:23:04.892 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-23T14:23:04.892 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-23T14:23:04.892 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-23T14:23:04.892 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-23T14:23:04.892 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-04-23T14:23:04.892 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-23T14:23:04.892 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-23T14:23:04.892 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-23T14:23:04.892 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-23T14:23:04.892 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-23T14:23:04.892 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-23T14:23:04.892 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-23T14:23:04.892 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-23T14:23:04.893 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-23T14:23:04.893 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-04-23T14:23:04.893 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-04-23T14:23:04.893 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-23T14:23:04.893 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-23T14:23:04.893 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-23T14:23:04.893 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-04-23T14:23:04.893 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-23T14:23:04.893 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-23T14:23:04.893 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-23T14:23:04.893 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-23T14:23:04.893 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-23T14:23:04.893 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-23T14:23:04.893 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-04-23T14:23:04.893 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-23T14:23:04.894 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-04-23T14:23:04.894 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-04-23T14:23:04.894 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-23T14:23:04.894 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-04-23T14:23:04.894 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-23T14:23:04.894 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-04-23T14:23:04.894 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-23T14:23:04.894 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-04-23T14:23:04.894 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-04-23T14:23:04.894 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-23T14:23:04.894 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-04-23T14:23:04.894 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-04-23T14:23:04.894 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-23T14:23:04.894 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-23T14:23:04.895 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-04-23T14:23:04.895 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-23T14:23:04.895 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-23T14:23:04.895 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-23T14:23:04.895 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-23T14:23:04.895 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-04-23T14:23:04.895 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-04-23T14:23:04.895 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-23T14:23:04.895 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-04-23T14:23:04.895 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-23T14:23:04.895 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-23T14:23:04.895 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-04-23T14:23:04.895 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-23T14:23:04.895 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-23T14:23:04.896 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-23T14:23:04.896 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-04-23T14:23:04.896 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-04-23T14:23:04.896 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-23T14:23:04.896 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-04-23T14:23:04.896 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-04-23T14:23:04.896 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-23T14:23:04.896 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-23T14:23:04.896 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-23T14:23:04.896 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-23T14:23:04.896 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-23T14:23:04.896 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-23T14:23:04.896 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-23T14:23:04.896 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-23T14:23:04.897 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-23T14:23:04.897 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-23T14:23:04.897 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-23T14:23:04.897 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-23T14:23:04.897 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-04-23T14:23:04.897 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-23T14:23:04.897 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-23T14:23:04.897 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-23T14:23:04.897 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-23T14:23:04.897 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-23T14:23:04.897 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-23T14:23:04.897 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-23T14:23:04.897 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-23T14:23:04.897 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-23T14:23:04.897 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-23T14:23:04.898 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-23T14:23:04.898 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-23T14:23:04.898 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-04-23T14:23:04.898 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-23T14:23:04.898 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-23T14:23:04.898 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-04-23T14:23:04.898 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-04-23T14:23:04.898 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-23T14:23:04.898 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-23T14:23:04.898 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-23T14:23:04.898 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-23T14:23:04.898 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-04-23T14:23:04.898 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-23T14:23:04.898 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-23T14:23:04.899 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-04-23T14:23:04.899 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-04-23T14:23:04.899 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-04-23T14:23:04.899 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-23T14:23:04.899 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-23T14:23:04.899 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-04-23T14:23:04.899 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-23T14:23:04.899 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-23T14:23:04.899 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-23T14:23:04.899 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-23T14:23:04.899 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-23T14:23:04.899 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-23T14:23:04.899 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-23T14:23:04.899 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-23T14:23:04.899 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-23T14:23:04.900 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-23T14:23:04.900 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-23T14:23:04.900 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-23T14:23:04.900 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-23T14:23:04.900 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-23T14:23:04.900 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-23T14:23:04.900 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-23T14:23:04.900 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-23T14:23:04.900 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-23T14:23:04.900 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-23T14:23:04.900 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-23T14:23:04.900 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-23T14:23:04.900 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-23T14:23:04.900 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-23T14:23:04.900 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-23T14:23:04.901 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-23T14:23:04.901 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-23T14:23:04.901 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-23T14:23:04.901 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-23T14:23:04.901 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-23T14:23:04.901 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-23T14:23:04.901 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-23T14:23:04.901 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-04-23T14:23:04.901 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-23T14:23:04.901 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-23T14:23:04.901 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-23T14:23:04.901 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-23T14:23:04.901 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-23T14:23:04.901 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-04-23T14:23:04.901 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-23T14:23:04.902 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-23T14:23:04.902 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-04-23T14:23:04.902 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-23T14:23:04.902 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-23T14:23:04.902 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-23T14:23:04.902 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-04-23T14:23:04.902 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-23T14:23:04.902 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-23T14:23:04.902 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-04-23T14:23:04.902 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-23T14:23:04.902 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-04-23T14:23:04.902 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-23T14:23:04.902 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-04-23T14:23:04.902 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-23T14:23:04.902 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-04-23T14:23:04.902 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-23T14:23:04.903 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-23T14:23:04.903 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-04-23T14:23:04.903 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-23T14:23:04.903 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-04-23T14:23:04.903 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-23T14:23:04.903 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-23T14:23:04.903 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-23T14:23:04.903 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-23T14:23:04.903 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-23T14:23:04.903 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-23T14:23:04.903 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-04-23T14:23:04.903 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-23T14:23:04.903 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-23T14:23:04.903 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-23T14:23:04.904 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-23T14:23:04.904 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-23T14:23:04.904 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-04-23T14:23:04.904 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-23T14:23:04.904 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-23T14:23:04.904 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-04-23T14:23:04.904 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-23T14:23:04.904 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-23T14:23:04.904 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-04-23T14:23:04.904 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-23T14:23:04.904 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-23T14:23:04.904 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-23T14:23:04.904 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-23T14:23:04.904 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-23T14:23:04.904 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-23T14:23:04.905 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-23T14:23:04.905 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-04-23T14:23:04.905 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-23T14:23:04.905 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-23T14:23:04.905 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-23T14:23:04.905 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-04-23T14:23:04.905 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-23T14:23:04.905 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-23T14:23:04.905 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-23T14:23:04.905 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-04-23T14:23:04.905 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-23T14:23:04.905 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-04-23T14:23:04.905 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-23T14:23:04.905 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-04-23T14:23:04.905 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-23T14:23:04.906 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-23T14:23:04.906 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-23T14:23:04.906 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-23T14:23:04.906 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-04-23T14:23:04.906 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-23T14:23:04.906 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-04-23T14:23:04.906 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-23T14:23:04.906 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-23T14:23:04.906 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-04-23T14:23:04.906 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-23T14:23:04.906 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-23T14:23:04.906 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-23T14:23:04.906 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-04-23T14:23:04.906 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-23T14:23:04.907 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-23T14:23:04.907 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-04-23T14:23:04.907 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-23T14:23:04.907 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-23T14:23:04.907 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-23T14:23:04.907 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-23T14:23:04.907 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-23T14:23:04.907 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-23T14:23:04.907 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-23T14:23:04.907 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-23T14:23:04.907 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-23T14:23:04.907 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-23T14:23:04.907 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-23T14:23:04.907 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-04-23T14:23:04.907 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-23T14:23:04.908 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-23T14:23:04.908 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-23T14:23:04.908 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-23T14:23:04.908 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-04-23T14:23:04.908 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-23T14:23:04.908 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-04-23T14:23:04.908 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-04-23T14:23:04.908 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-23T14:23:04.908 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-04-23T14:23:04.908 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-23T14:23:04.908 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-23T14:23:04.908 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-23T14:23:04.908 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-23T14:23:04.908 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-23T14:23:04.908 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-23T14:23:04.909 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-04-23T14:23:04.909 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-23T14:23:04.909 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-04-23T14:23:04.909 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-04-23T14:23:04.909 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-04-23T14:23:04.909 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-23T14:23:04.909 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-23T14:23:04.909 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-23T14:23:04.909 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-23T14:23:04.909 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-23T14:23:04.909 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-23T14:23:04.909 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-23T14:23:04.909 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-23T14:23:04.909 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-23T14:23:04.909 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-23T14:23:04.910 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-23T14:23:04.910 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-23T14:23:04.910 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-23T14:23:04.910 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-23T14:23:04.910 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-23T14:23:04.910 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-23T14:23:04.910 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-23T14:23:04.910 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-23T14:23:04.910 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-04-23T14:23:04.910 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-04-23T14:23:04.910 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-23T14:23:04.910 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-23T14:23:04.910 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-23T14:23:04.910 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-23T14:23:04.911 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-04-23T14:23:04.911 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-04-23T14:23:04.911 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-23T14:23:04.911 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-23T14:23:04.911 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-04-23T14:23:04.911 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-23T14:23:04.911 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-04-23T14:23:04.911 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-04-23T14:23:04.911 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-23T14:23:04.911 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-04-23T14:23:04.911 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-23T14:23:04.911 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-04-23T14:23:04.911 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-23T14:23:04.911 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-23T14:23:04.912 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-23T14:23:04.912 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-23T14:23:04.912 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-23T14:23:04.912 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-04-23T14:23:04.912 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-04-23T14:23:04.912 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-23T14:23:04.912 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-23T14:23:04.912 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-23T14:23:04.912 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-23T14:23:04.912 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-04-23T14:23:04.912 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-23T14:23:04.912 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-04-23T14:23:04.912 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-23T14:23:04.912 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-23T14:23:04.913 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-04-23T14:23:04.913 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-23T14:23:04.913 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-23T14:23:04.913 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-23T14:23:04.913 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-23T14:23:04.913 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-23T14:23:04.913 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-23T14:23:04.913 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-23T14:23:04.913 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-23T14:23:04.913 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-23T14:23:04.913 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-23T14:23:04.913 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-04-23T14:23:04.913 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-23T14:23:04.913 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-23T14:23:04.913 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-23T14:23:04.914 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-23T14:23:04.914 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-23T14:23:04.914 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-23T14:23:04.914 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-23T14:23:04.914 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-04-23T14:23:04.914 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-23T14:23:04.914 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-04-23T14:23:04.914 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-23T14:23:04.914 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-23T14:23:04.914 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-23T14:23:04.914 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-23T14:23:04.914 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-23T14:23:04.914 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-23T14:23:04.914 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-23T14:23:04.914 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-23T14:23:04.915 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-23T14:23:04.915 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-23T14:23:04.915 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-23T14:23:04.915 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-23T14:23:04.915 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-23T14:23:04.915 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-23T14:23:04.915 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-23T14:23:04.915 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-23T14:23:04.915 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-23T14:23:04.915 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-23T14:23:04.915 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-23T14:23:04.915 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-23T14:23:04.915 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-23T14:23:04.916 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-23T14:23:04.916 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-23T14:23:04.916 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-23T14:23:04.916 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-23T14:23:04.916 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-23T14:23:04.916 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-23T14:23:04.916 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-23T14:23:04.916 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-23T14:23:04.916 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-23T14:23:04.916 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-23T14:23:04.916 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-23T14:23:04.916 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-23T14:23:04.916 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-23T14:23:04.916 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-23T14:23:04.916 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-23T14:23:04.917 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-23T14:23:04.917 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-23T14:23:04.917 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-23T14:23:04.917 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-23T14:23:04.917 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-23T14:23:04.917 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-23T14:23:04.917 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-23T14:23:04.917 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-23T14:23:04.917 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-23T14:23:04.917 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-04-23T14:23:04.917 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-23T14:23:04.917 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-23T14:23:04.917 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-23T14:23:04.917 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-23T14:23:04.917 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-23T14:23:04.917 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-23T14:23:04.918 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-23T14:23:04.918 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-23T14:23:04.918 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-23T14:23:04.918 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-23T14:23:04.918 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-23T14:23:04.918 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-23T14:23:04.918 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-23T14:23:04.918 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-23T14:23:04.918 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-23T14:23:04.918 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-04-23T14:23:04.918 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-23T14:23:04.918 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-23T14:23:04.918 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-23T14:23:04.918 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-04-23T14:23:04.919 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-04-23T14:23:04.919 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-23T14:23:04.919 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-23T14:23:04.919 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-23T14:23:04.919 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-23T14:23:04.919 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-04-23T14:23:04.919 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-23T14:23:04.919 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-23T14:23:04.919 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-23T14:23:04.919 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-23T14:23:04.919 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-04-23T14:23:04.919 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-04-23T14:23:04.919 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-23T14:23:04.919 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-23T14:23:04.920 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-23T14:23:04.920 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-04-23T14:23:04.920 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-04-23T14:23:04.920 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-04-23T14:23:04.920 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-04-23T14:23:04.920 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-04-23T14:23:04.920 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-23T14:23:04.920 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-23T14:23:04.920 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-04-23T14:23:04.920 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-04-23T14:23:04.920 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-04-23T14:23:04.920 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-23T14:23:04.920 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-23T14:23:04.920 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-04-23T14:23:04.920 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-23T14:23:04.921 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-23T14:23:04.921 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-23T14:23:04.921 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-23T14:23:04.921 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-23T14:23:04.921 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-23T14:23:04.921 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-23T14:23:04.921 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-23T14:23:04.921 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-23T14:23:04.921 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-23T14:23:04.921 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-23T14:23:04.921 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-23T14:23:04.921 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-04-23T14:23:04.921 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-23T14:23:04.921 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-23T14:23:04.921 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-23T14:23:04.922 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-23T14:23:04.922 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-23T14:23:04.922 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-23T14:23:04.922 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-23T14:23:04.922 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-23T14:23:04.922 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-23T14:23:04.922 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-23T14:23:04.922 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-23T14:23:04.922 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-23T14:23:04.922 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-23T14:23:04.922 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-23T14:23:04.922 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-23T14:23:04.922 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-23T14:23:04.922 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-23T14:23:04.922 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-23T14:23:04.923 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-23T14:23:04.923 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-23T14:23:04.923 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-23T14:23:04.923 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-23T14:23:04.923 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-23T14:23:04.923 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-23T14:23:04.923 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-23T14:23:04.923 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-23T14:23:04.923 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-04-23T14:23:04.923 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-23T14:23:04.923 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-23T14:23:04.923 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-23T14:23:04.923 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-23T14:23:04.923 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-04-23T14:23:04.923 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-23T14:23:04.924 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-23T14:23:04.924 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-04-23T14:23:04.924 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-23T14:23:04.924 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-04-23T14:23:04.924 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-04-23T14:23:04.924 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-23T14:23:04.924 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-04-23T14:23:04.924 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-23T14:23:04.924 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-04-23T14:23:04.924 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-23T14:23:04.924 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-23T14:23:04.924 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-04-23T14:23:04.924 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-23T14:23:04.924 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-04-23T14:23:04.924 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-23T14:23:04.925 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-04-23T14:23:04.925 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-23T14:23:04.925 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-04-23T14:23:04.925 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-23T14:23:04.925 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-04-23T14:23:04.925 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-23T14:23:04.925 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-04-23T14:23:04.925 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-23T14:23:04.925 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-04-23T14:23:04.925 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-23T14:23:04.925 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-04-23T14:23:04.925 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-23T14:23:04.925 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-04-23T14:23:04.925 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-04-23T14:23:04.925 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-23T14:23:04.926 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-04-23T14:23:04.926 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-04-23T14:23:04.926 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-23T14:23:04.926 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-04-23T14:23:04.926 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-04-23T14:23:04.926 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-23T14:23:04.926 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-04-23T14:23:04.926 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-23T14:23:04.926 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-04-23T14:23:04.926 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-23T14:23:04.926 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-04-23T14:23:04.926 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-23T14:23:04.926 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-04-23T14:23:04.926 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-23T14:23:04.926 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-04-23T14:23:04.927 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-23T14:23:04.927 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-04-23T14:23:04.927 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-23T14:23:04.927 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-04-23T14:23:04.927 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-23T14:23:04.927 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-04-23T14:23:04.927 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-04-23T14:23:04.927 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-23T14:23:04.927 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-04-23T14:23:04.927 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-23T14:23:04.927 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-04-23T14:23:04.927 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-23T14:23:04.927 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-23T14:23:04.927 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-23T14:23:04.927 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-23T14:23:04.928 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-04-23T14:23:04.928 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-23T14:23:04.928 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-23T14:23:04.928 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-04-23T14:23:04.928 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-23T14:23:04.928 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-04-23T14:23:04.928 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-23T14:23:04.928 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-04-23T14:23:04.928 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-23T14:23:04.928 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-23T14:23:04.928 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-23T14:23:04.928 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-23T14:23:04.928 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-23T14:23:04.928 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-23T14:23:04.928 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-23T14:23:04.929 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-23T14:23:04.929 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-23T14:23:04.929 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-23T14:23:04.929 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-23T14:23:04.929 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-23T14:23:04.929 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-23T14:23:04.929 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-23T14:23:04.929 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-23T14:23:04.929 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-23T14:23:04.929 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-23T14:23:04.929 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-23T14:23:04.929 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-23T14:23:04.929 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-23T14:23:04.929 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-23T14:23:04.929 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-23T14:23:04.930 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-23T14:23:04.930 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-23T14:23:04.930 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-23T14:23:04.930 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-23T14:23:04.930 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-23T14:23:04.930 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-23T14:23:04.930 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-23T14:23:04.930 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-23T14:23:04.930 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-23T14:23:04.930 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-23T14:23:04.930 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-23T14:23:04.930 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-23T14:23:04.930 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-23T14:23:04.930 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-23T14:23:04.931 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-23T14:23:04.931 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-23T14:23:04.931 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-23T14:23:04.931 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-23T14:23:04.931 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-23T14:23:04.931 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-23T14:23:04.931 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-23T14:23:04.931 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-23T14:23:04.931 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-23T14:23:04.931 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-23T14:23:04.931 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-23T14:23:04.931 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-23T14:23:04.931 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-23T14:23:04.931 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-23T14:23:04.931 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-04-23T14:23:04.932 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-04-23T14:23:04.932 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-23T14:23:04.932 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-04-23T14:23:04.932 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-23T14:23:04.932 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-04-23T14:23:04.932 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-23T14:23:04.932 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-23T14:23:04.932 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-23T14:23:04.932 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-23T14:23:04.932 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-23T14:23:04.932 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-04-23T14:23:04.932 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-23T14:23:04.932 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-04-23T14:23:04.932 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-23T14:23:04.933 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-04-23T14:23:04.933 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-23T14:23:04.933 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-04-23T14:23:04.933 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-23T14:23:04.933 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-04-23T14:23:04.933 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-04-23T14:23:04.933 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-23T14:23:04.933 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-04-23T14:23:04.933 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-23T14:23:04.933 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-23T14:23:04.933 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-04-23T14:23:04.933 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-23T14:23:04.933 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-04-23T14:23:04.933 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-23T14:23:04.933 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-04-23T14:23:04.934 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-23T14:23:04.934 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-04-23T14:23:04.934 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-23T14:23:04.934 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-04-23T14:23:04.934 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-23T14:23:04.934 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-04-23T14:23:04.934 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-04-23T14:23:04.934 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-04-23T14:23:04.934 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-23T14:23:04.934 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-04-23T14:23:04.934 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-23T14:23:04.934 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-04-23T14:23:04.934 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-04-23T14:23:04.934 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-23T14:23:04.935 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-23T14:23:04.935 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-04-23T14:23:04.935 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-23T14:23:04.935 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-23T14:23:04.935 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-23T14:23:04.935 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-23T14:23:04.935 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-04-23T14:23:04.935 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-23T14:23:04.935 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-23T14:23:04.935 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-04-23T14:23:04.935 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-23T14:23:04.935 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-04-23T14:23:04.935 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-23T14:23:04.935 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-04-23T14:23:04.935 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-23T14:23:04.936 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-23T14:23:04.936 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-23T14:23:04.936 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-23T14:23:04.936 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-04-23T14:23:04.936 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-04-23T14:23:04.936 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-04-23T14:23:04.936 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-23T14:23:04.936 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-04-23T14:23:04.936 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-04-23T14:23:04.936 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-23T14:23:04.936 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-23T14:23:04.936 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-23T14:23:04.936 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-23T14:23:04.936 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-23T14:23:04.936 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-23T14:23:04.937 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-23T14:23:04.937 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-23T14:23:04.937 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-04-23T14:23:04.937 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-23T14:23:04.937 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-23T14:23:04.937 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-23T14:23:04.937 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-23T14:23:04.937 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-23T14:23:04.937 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-04-23T14:23:04.937 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-23T14:23:04.937 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-04-23T14:23:04.937 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-23T14:23:04.937 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-23T14:23:04.937 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-23T14:23:04.938 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-23T14:23:04.938 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-04-23T14:23:04.938 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-23T14:23:04.938 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-04-23T14:23:04.938 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-23T14:23:04.938 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-23T14:23:04.938 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-04-23T14:23:04.938 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-23T14:23:04.938 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-23T14:23:04.938 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-23T14:23:04.938 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-23T14:23:04.938 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-23T14:23:04.938 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-23T14:23:04.938 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-23T14:23:04.939 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-23T14:23:04.939 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-23T14:23:04.939 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-23T14:23:04.939 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-23T14:23:04.939 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-23T14:23:04.939 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-23T14:23:04.939 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-23T14:23:04.939 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-23T14:23:04.939 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-23T14:23:04.939 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-23T14:23:04.939 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-23T14:23:04.939 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-23T14:23:04.939 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-23T14:23:04.939 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-23T14:23:04.939 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-23T14:23:04.940 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-23T14:23:04.940 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-23T14:23:04.940 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-04-23T14:23:04.940 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-23T14:23:04.940 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-04-23T14:23:04.940 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-04-23T14:23:04.940 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-23T14:23:04.940 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-04-23T14:23:04.940 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-23T14:23:04.940 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-23T14:23:04.940 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-23T14:23:04.940 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-23T14:23:04.940 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-04-23T14:23:04.940 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-04-23T14:23:04.940 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-04-23T14:23:04.941 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-23T14:23:04.941 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-23T14:23:04.941 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-23T14:23:04.941 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-23T14:23:04.941 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-23T14:23:04.941 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-04-23T14:23:04.941 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-04-23T14:23:04.941 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-23T14:23:04.941 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-23T14:23:04.941 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-23T14:23:04.941 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-04-23T14:23:04.941 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-23T14:23:04.941 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-23T14:23:04.941 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-23T14:23:04.941 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-23T14:23:04.942 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-23T14:23:04.942 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-23T14:23:04.942 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-23T14:23:04.942 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-23T14:23:04.942 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-23T14:23:04.942 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-23T14:23:04.942 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-04-23T14:23:04.942 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-23T14:23:04.942 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-23T14:23:04.942 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-23T14:23:04.942 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-23T14:23:04.942 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-23T14:23:04.942 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-23T14:23:04.942 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-23T14:23:04.942 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-23T14:23:04.943 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-23T14:23:04.943 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-23T14:23:04.943 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-23T14:23:04.943 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-23T14:23:04.943 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-23T14:23:04.943 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-23T14:23:04.943 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-23T14:23:04.943 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-23T14:23:04.943 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-23T14:23:04.943 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-23T14:23:04.943 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-23T14:23:04.943 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-23T14:23:04.943 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-23T14:23:04.943 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-23T14:23:04.943 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-23T14:23:04.944 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-23T14:23:04.944 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-23T14:23:04.944 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-23T14:23:04.944 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-23T14:23:04.944 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-23T14:23:04.944 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-23T14:23:04.944 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-23T14:23:04.944 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-23T14:23:04.944 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-23T14:23:04.946 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-23T14:23:04.946 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-23T14:23:04.947 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-23T14:23:04.947 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-23T14:23:04.947 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-23T14:23:04.947 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-23T14:23:04.947 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-04-23T14:23:04.947 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-23T14:23:04.947 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-23T14:23:04.947 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-23T14:23:04.947 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-23T14:23:04.947 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-23T14:23:04.947 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-23T14:23:04.947 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-23T14:23:04.947 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-04-23T14:23:04.947 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-23T14:23:04.948 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-23T14:23:04.948 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-23T14:23:04.948 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-23T14:23:04.948 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-23T14:23:04.948 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-23T14:23:04.948 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-23T14:23:04.948 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-23T14:23:04.948 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-23T14:23:04.948 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-23T14:23:04.948 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-23T14:23:04.948 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-23T14:23:04.948 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-23T14:23:04.948 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-23T14:23:04.948 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-23T14:23:04.949 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-23T14:23:04.949 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-23T14:23:04.949 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-23T14:23:04.949 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-23T14:23:04.949 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-23T14:23:04.949 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-23T14:23:04.949 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-23T14:23:04.949 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-23T14:23:04.949 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-23T14:23:04.949 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-23T14:23:04.949 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-23T14:23:04.949 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-23T14:23:04.949 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-04-23T14:23:04.949 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-23T14:23:04.949 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-04-23T14:23:04.950 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-23T14:23:04.950 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-23T14:23:04.950 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-23T14:23:04.950 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-23T14:23:04.950 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-23T14:23:04.950 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-23T14:23:04.950 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-23T14:23:04.950 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-04-23T14:23:04.950 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-23T14:23:04.950 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-04-23T14:23:04.950 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-23T14:23:04.950 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-04-23T14:23:04.950 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-23T14:23:04.950 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-04-23T14:23:04.951 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-04-23T14:23:04.951 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-23T14:23:04.951 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-23T14:23:04.951 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-23T14:23:04.951 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-23T14:23:04.951 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-23T14:23:04.951 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-23T14:23:04.951 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-23T14:23:04.951 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-23T14:23:04.951 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-23T14:23:04.951 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-23T14:23:04.951 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-23T14:23:04.951 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-23T14:23:04.951 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-23T14:23:04.952 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-23T14:23:04.952 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-23T14:23:04.952 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-23T14:23:04.952 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-04-23T14:23:04.952 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-23T14:23:04.952 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-23T14:23:04.952 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-23T14:23:04.952 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-23T14:23:04.952 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-23T14:23:04.952 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-23T14:23:04.952 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-23T14:23:04.952 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-23T14:23:04.952 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-23T14:23:04.952 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-23T14:23:04.952 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-23T14:23:04.952 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-23T14:23:04.953 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-23T14:23:04.953 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-23T14:23:04.953 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-23T14:23:04.953 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-23T14:23:04.953 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-23T14:23:04.953 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-23T14:23:04.953 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-23T14:23:04.953 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-23T14:23:04.953 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-23T14:23:04.953 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-23T14:23:04.953 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-23T14:23:04.953 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-23T14:23:04.953 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-23T14:23:04.953 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-23T14:23:04.954 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-23T14:23:04.954 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-23T14:23:04.954 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-23T14:23:04.954 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-23T14:23:04.954 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-23T14:23:04.954 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-23T14:23:04.954 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-23T14:23:04.954 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-23T14:23:04.954 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-23T14:23:04.954 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-23T14:23:04.954 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-23T14:23:04.954 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-23T14:23:04.954 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-23T14:23:04.954 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-23T14:23:04.954 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-23T14:23:04.955 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-23T14:23:04.955 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-23T14:23:04.955 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-23T14:23:04.955 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-23T14:23:04.955 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-23T14:23:04.955 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-23T14:23:04.955 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-23T14:23:04.955 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-23T14:23:04.955 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-23T14:23:04.955 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-23T14:23:04.955 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-23T14:23:04.955 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-23T14:23:04.955 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-23T14:23:04.955 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-23T14:23:04.955 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-23T14:23:04.956 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-23T14:23:04.956 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-23T14:23:04.956 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-04-23T14:23:04.956 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-23T14:23:04.956 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-23T14:23:04.956 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-23T14:23:04.956 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-23T14:23:04.956 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-04-23T14:23:04.956 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-23T14:23:04.956 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-23T14:23:04.956 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-23T14:23:04.956 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-23T14:23:04.956 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-23T14:23:04.956 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-23T14:23:04.956 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-23T14:23:04.957 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-23T14:23:04.957 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-23T14:23:04.957 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-23T14:23:04.957 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-23T14:23:04.957 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-23T14:23:04.957 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-23T14:23:04.957 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-23T14:23:04.957 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-23T14:23:04.957 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-23T14:23:04.957 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-23T14:23:04.957 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-23T14:23:04.957 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-23T14:23:04.957 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-23T14:23:04.958 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-23T14:23:04.958 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-23T14:23:04.958 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-23T14:23:04.958 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-23T14:23:04.958 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-23T14:23:04.958 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-23T14:23:04.958 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-23T14:23:04.958 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-23T14:23:04.958 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-23T14:23:04.958 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-23T14:23:04.958 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-23T14:23:04.958 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-23T14:23:04.958 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-23T14:23:04.958 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-23T14:23:04.959 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-23T14:23:04.959 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-23T14:23:04.959 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-23T14:23:04.959 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-23T14:23:04.959 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-23T14:23:04.959 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-23T14:23:04.959 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-23T14:23:04.959 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-23T14:23:04.959 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-23T14:23:04.959 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-23T14:23:04.959 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-23T14:23:04.959 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-23T14:23:04.959 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-23T14:23:04.959 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-23T14:23:04.959 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-23T14:23:04.960 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-23T14:23:04.960 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-23T14:23:04.960 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-23T14:23:04.960 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-23T14:23:04.960 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-23T14:23:04.960 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-23T14:23:04.960 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-23T14:23:04.960 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-23T14:23:04.960 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-23T14:23:04.960 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-23T14:23:04.960 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-23T14:23:04.960 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-23T14:23:04.960 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-23T14:23:04.960 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-23T14:23:04.960 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-23T14:23:04.961 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-23T14:23:04.961 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-23T14:23:04.961 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-23T14:23:04.961 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-23T14:23:04.961 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-23T14:23:04.961 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-23T14:23:04.961 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-23T14:23:04.961 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-04-23T14:23:04.961 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-23T14:23:04.961 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-04-23T14:23:04.961 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-23T14:23:04.961 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-04-23T14:23:04.961 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-23T14:23:04.962 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-23T14:23:04.962 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-23T14:23:04.962 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-23T14:23:04.962 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-04-23T14:23:04.962 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-23T14:23:04.962 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-04-23T14:23:04.962 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-23T14:23:04.962 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-23T14:23:04.962 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-23T14:23:04.962 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-04-23T14:23:04.962 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-23T14:23:04.962 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-23T14:23:04.962 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-23T14:23:04.962 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-23T14:23:04.962 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-23T14:23:04.963 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-23T14:23:04.963 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-23T14:23:04.963 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-23T14:23:04.963 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-23T14:23:04.963 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-23T14:23:04.963 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-23T14:23:04.963 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-23T14:23:04.963 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-23T14:23:04.963 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-23T14:23:04.963 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-23T14:23:04.963 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-23T14:23:04.963 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-23T14:23:04.963 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-23T14:23:04.963 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-23T14:23:04.963 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-23T14:23:04.964 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-23T14:23:04.964 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-23T14:23:04.964 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-23T14:23:04.964 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-23T14:23:04.964 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-23T14:23:04.964 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-23T14:23:04.964 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-23T14:23:04.964 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-23T14:23:04.964 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-23T14:23:04.964 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-23T14:23:04.964 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-23T14:23:04.964 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-23T14:23:04.964 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-23T14:23:04.964 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-23T14:23:04.964 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-23T14:23:04.965 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-23T14:23:04.965 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-23T14:23:04.965 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-23T14:23:04.965 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-23T14:23:04.965 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-23T14:23:04.965 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-23T14:23:04.965 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-23T14:23:04.965 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-23T14:23:04.965 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-04-23T14:23:04.965 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-23T14:23:04.965 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-23T14:23:04.965 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-04-23T14:23:04.965 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-04-23T14:23:04.965 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-23T14:23:04.966 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-23T14:23:04.966 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-23T14:23:04.966 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-04-23T14:23:04.966 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-23T14:23:04.966 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-04-23T14:23:04.966 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-23T14:23:04.966 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-23T14:23:04.966 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-04-23T14:23:04.966 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-23T14:23:04.966 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-04-23T14:23:04.966 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-23T14:23:04.966 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-23T14:23:04.966 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-23T14:23:04.967 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-23T14:23:04.967 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-23T14:23:04.967 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-04-23T14:23:04.967 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-23T14:23:04.967 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-04-23T14:23:04.967 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-04-23T14:23:04.967 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-04-23T14:23:04.967 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-23T14:23:04.967 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-04-23T14:23:04.967 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-04-23T14:23:04.967 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-23T14:23:04.967 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-23T14:23:04.967 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-23T14:23:04.967 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-23T14:23:04.967 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-23T14:23:04.968 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-23T14:23:04.968 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-23T14:23:04.968 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-23T14:23:04.968 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-23T14:23:04.968 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-23T14:23:04.968 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-23T14:23:04.968 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-23T14:23:04.968 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-23T14:23:04.968 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-23T14:23:04.972 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-23T14:23:04.972 DEBUG:teuthology.orchestra.run.smithi156:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-23T14:23:04.994 INFO:teuthology.orchestra.run.smithi156.stdout:postinstall scriptlet (using /bin/sh): 2024-04-23T14:23:04.994 INFO:teuthology.orchestra.run.smithi156.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-23T14:23:04.994 INFO:teuthology.orchestra.run.smithi156.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-23T14:23:04.994 INFO:teuthology.orchestra.run.smithi156.stdout:fi 2024-04-23T14:23:04.994 INFO:teuthology.orchestra.run.smithi156.stdout:for file in vmlinuz System.map config; do 2024-04-23T14:23:04.994 INFO:teuthology.orchestra.run.smithi156.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-04-23T14:23:04.995 INFO:teuthology.orchestra.run.smithi156.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-04-23T14:23:04.995 INFO:teuthology.orchestra.run.smithi156.stdout: fi 2024-04-23T14:23:04.995 INFO:teuthology.orchestra.run.smithi156.stdout:done 2024-04-23T14:23:04.995 INFO:teuthology.orchestra.run.smithi156.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-04-23T14:23:04.995 INFO:teuthology.orchestra.run.smithi156.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-04-23T14:23:04.995 INFO:teuthology.orchestra.run.smithi156.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-23T14:23:04.995 INFO:teuthology.orchestra.run.smithi156.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-23T14:23:04.995 INFO:teuthology.orchestra.run.smithi156.stdout:fi 2024-04-23T14:23:04.995 INFO:teuthology.orchestra.run.smithi156.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-04-23T14:23:04.995 INFO:teuthology.orchestra.run.smithi156.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-04-23T14:23:04.995 INFO:teuthology.orchestra.run.smithi156.stdout:fi 2024-04-23T14:23:04.995 INFO:teuthology.orchestra.run.smithi156.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-23T14:23:04.995 INFO:teuthology.orchestra.run.smithi156.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-23T14:23:04.995 INFO:teuthology.orchestra.run.smithi156.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-04-23T14:23:04.996 INFO:teuthology.orchestra.run.smithi156.stdout:fi 2024-04-23T14:23:04.996 DEBUG:teuthology.orchestra.run.smithi156:> sudo rpm -qi grub2-tools 2024-04-23T14:23:05.068 INFO:teuthology.orchestra.run.smithi156.stdout:Name : grub2-tools 2024-04-23T14:23:05.068 INFO:teuthology.orchestra.run.smithi156.stdout:Epoch : 1 2024-04-23T14:23:05.068 INFO:teuthology.orchestra.run.smithi156.stdout:Version : 2.06 2024-04-23T14:23:05.068 INFO:teuthology.orchestra.run.smithi156.stdout:Release : 68.el9 2024-04-23T14:23:05.068 INFO:teuthology.orchestra.run.smithi156.stdout:Architecture: x86_64 2024-04-23T14:23:05.068 INFO:teuthology.orchestra.run.smithi156.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-04-23T14:23:05.068 INFO:teuthology.orchestra.run.smithi156.stdout:Group : Unspecified 2024-04-23T14:23:05.068 INFO:teuthology.orchestra.run.smithi156.stdout:Size : 8264254 2024-04-23T14:23:05.068 INFO:teuthology.orchestra.run.smithi156.stdout:License : GPLv3+ 2024-04-23T14:23:05.068 INFO:teuthology.orchestra.run.smithi156.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-23T14:23:05.068 INFO:teuthology.orchestra.run.smithi156.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-23T14:23:05.069 INFO:teuthology.orchestra.run.smithi156.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-23T14:23:05.069 INFO:teuthology.orchestra.run.smithi156.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-23T14:23:05.069 INFO:teuthology.orchestra.run.smithi156.stdout:Packager : builder@centos.org 2024-04-23T14:23:05.069 INFO:teuthology.orchestra.run.smithi156.stdout:Vendor : CentOS 2024-04-23T14:23:05.069 INFO:teuthology.orchestra.run.smithi156.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-23T14:23:05.069 INFO:teuthology.orchestra.run.smithi156.stdout:Summary : Support tools for GRUB. 2024-04-23T14:23:05.069 INFO:teuthology.orchestra.run.smithi156.stdout:Description : 2024-04-23T14:23:05.069 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:23:05.069 INFO:teuthology.orchestra.run.smithi156.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-23T14:23:05.069 INFO:teuthology.orchestra.run.smithi156.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-23T14:23:05.069 INFO:teuthology.orchestra.run.smithi156.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-23T14:23:05.069 INFO:teuthology.orchestra.run.smithi156.stdout:hardware devices. 2024-04-23T14:23:05.069 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:23:05.069 INFO:teuthology.orchestra.run.smithi156.stdout:This subpackage provides tools for support of all platforms. 2024-04-23T14:23:05.070 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-23T14:23:05.070 INFO:teuthology.task.kernel:Updating grub on smithi156 to boot 6.9.0-rc3-g806ec36b2112 2024-04-23T14:23:05.070 DEBUG:teuthology.orchestra.run.smithi156:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-23T14:23:05.707 INFO:teuthology.orchestra.run.smithi156.stderr:Generating grub configuration file ... 2024-04-23T14:23:07.165 INFO:teuthology.orchestra.run.smithi156.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-23T14:23:07.180 INFO:teuthology.orchestra.run.smithi156.stderr:done 2024-04-23T14:23:07.183 DEBUG:teuthology.orchestra.run.smithi156:> mktemp 2024-04-23T14:23:07.202 INFO:teuthology.orchestra.run.smithi156.stdout:/tmp/tmp.KuUaGbAzP7 2024-04-23T14:23:07.202 DEBUG:teuthology.orchestra.run.smithi156:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.KuUaGbAzP7 2024-04-23T14:23:07.268 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 0666 /tmp/tmp.KuUaGbAzP7 2024-04-23T14:23:07.413 DEBUG:teuthology.orchestra.remote:smithi156:/tmp/tmp.KuUaGbAzP7 is 6KB 2024-04-23T14:23:07.433 DEBUG:teuthology.orchestra.run.smithi156:> rm -fr /tmp/tmp.KuUaGbAzP7 2024-04-23T14:23:07.447 DEBUG:teuthology.orchestra.run.smithi156:> sudo /bin/ls /boot/loader/entries || true 2024-04-23T14:23:07.515 INFO:teuthology.orchestra.run.smithi156.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-04-23T14:23:07.515 INFO:teuthology.orchestra.run.smithi156.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-04-23T14:23:07.515 INFO:teuthology.orchestra.run.smithi156.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-04-23T14:23:07.515 INFO:teuthology.orchestra.run.smithi156.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-04-23T14:23:07.516 DEBUG:teuthology.orchestra.run.smithi156:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-04-23T14:23:07.693 DEBUG:teuthology.orchestra.run.smithi156:> sudo shutdown -r now 2024-04-23T14:23:28.365 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi081.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-23T14:23:28.366 DEBUG:teuthology.orchestra.run.smithi081:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-23T14:23:28.462 INFO:teuthology.orchestra.run.smithi081.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-23T14:23:28.462 INFO:teuthology.orchestra.run.smithi081.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-04-23T14:23:28.462 INFO:teuthology.orchestra.run.smithi081.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-23T14:23:28.462 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-04-23T14:23:28.462 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-04-23T14:23:28.462 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-04-23T14:23:28.462 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-04-23T14:23:28.463 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-04-23T14:23:28.463 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-04-23T14:23:28.463 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-23T14:23:28.463 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-23T14:23:28.463 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-23T14:23:28.463 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-23T14:23:28.463 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-23T14:23:28.463 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-23T14:23:28.463 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-23T14:23:28.464 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-23T14:23:28.464 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-23T14:23:28.464 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-23T14:23:28.464 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-23T14:23:28.464 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-23T14:23:28.464 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-23T14:23:28.464 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-23T14:23:28.464 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-23T14:23:28.464 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-23T14:23:28.464 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-23T14:23:28.464 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-23T14:23:28.464 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-23T14:23:28.464 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-23T14:23:28.465 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-04-23T14:23:28.465 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-04-23T14:23:28.465 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-04-23T14:23:28.465 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-23T14:23:28.465 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-04-23T14:23:28.465 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-23T14:23:28.465 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-23T14:23:28.465 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-23T14:23:28.465 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-04-23T14:23:28.465 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-23T14:23:28.465 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-23T14:23:28.465 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-23T14:23:28.465 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-04-23T14:23:28.465 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-23T14:23:28.465 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-23T14:23:28.466 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-23T14:23:28.466 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-23T14:23:28.466 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-23T14:23:28.466 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-23T14:23:28.466 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-23T14:23:28.466 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-23T14:23:28.466 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-23T14:23:28.466 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-23T14:23:28.466 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-23T14:23:28.466 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-23T14:23:28.466 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-23T14:23:28.466 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-23T14:23:28.466 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-23T14:23:28.467 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-23T14:23:28.467 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-23T14:23:28.467 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-23T14:23:28.467 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-23T14:23:28.467 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-23T14:23:28.467 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-23T14:23:28.467 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-23T14:23:28.467 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-23T14:23:28.467 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-23T14:23:28.467 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-23T14:23:28.467 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-23T14:23:28.467 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-23T14:23:28.467 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-23T14:23:28.467 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-23T14:23:28.468 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-23T14:23:28.468 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-23T14:23:28.468 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-23T14:23:28.468 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-23T14:23:28.468 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-23T14:23:28.468 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-23T14:23:28.468 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-23T14:23:28.468 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-23T14:23:28.468 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-23T14:23:28.468 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-23T14:23:28.468 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-23T14:23:28.468 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-23T14:23:28.468 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-23T14:23:28.468 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-23T14:23:28.468 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-23T14:23:28.468 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-23T14:23:28.469 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-04-23T14:23:28.469 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-04-23T14:23:28.469 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-23T14:23:28.469 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-23T14:23:28.469 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-23T14:23:28.469 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-23T14:23:28.469 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-23T14:23:28.469 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-23T14:23:28.469 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-23T14:23:28.469 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-04-23T14:23:28.469 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-23T14:23:28.469 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-23T14:23:28.469 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-04-23T14:23:28.469 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-23T14:23:28.469 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-23T14:23:28.469 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-23T14:23:28.470 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-23T14:23:28.470 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-23T14:23:28.470 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-23T14:23:28.470 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-23T14:23:28.470 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-23T14:23:28.470 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-23T14:23:28.470 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-23T14:23:28.470 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-23T14:23:28.470 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-23T14:23:28.470 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-23T14:23:28.470 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-23T14:23:28.470 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-23T14:23:28.470 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-23T14:23:28.470 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-23T14:23:28.471 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-23T14:23:28.471 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-23T14:23:28.471 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-23T14:23:28.471 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-23T14:23:28.471 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-23T14:23:28.471 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-23T14:23:28.471 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-23T14:23:28.471 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-23T14:23:28.471 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-23T14:23:28.471 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-23T14:23:28.471 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-23T14:23:28.471 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-23T14:23:28.471 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-23T14:23:28.471 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-23T14:23:28.472 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-23T14:23:28.472 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-23T14:23:28.472 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-23T14:23:28.472 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-23T14:23:28.472 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-04-23T14:23:28.472 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-23T14:23:28.472 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-23T14:23:28.472 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-23T14:23:28.472 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-23T14:23:28.472 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-23T14:23:28.472 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-23T14:23:28.472 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-23T14:23:28.472 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-23T14:23:28.472 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-23T14:23:28.472 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-23T14:23:28.473 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-23T14:23:28.473 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-23T14:23:28.473 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-23T14:23:28.473 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-23T14:23:28.473 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-23T14:23:28.473 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-23T14:23:28.473 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-23T14:23:28.473 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-04-23T14:23:28.473 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-23T14:23:28.473 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-04-23T14:23:28.473 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-04-23T14:23:28.473 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-23T14:23:28.473 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-23T14:23:28.473 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-04-23T14:23:28.473 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-23T14:23:28.474 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-04-23T14:23:28.474 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-04-23T14:23:28.474 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-23T14:23:28.474 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-04-23T14:23:28.474 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-04-23T14:23:28.474 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-23T14:23:28.474 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-23T14:23:28.474 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-04-23T14:23:28.474 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-04-23T14:23:28.474 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-23T14:23:28.474 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-23T14:23:28.474 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-04-23T14:23:28.474 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-23T14:23:28.475 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-23T14:23:28.475 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-23T14:23:28.475 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-04-23T14:23:28.475 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-04-23T14:23:28.475 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-23T14:23:28.475 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-04-23T14:23:28.475 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-04-23T14:23:28.475 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-23T14:23:28.475 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-04-23T14:23:28.475 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-23T14:23:28.475 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-04-23T14:23:28.475 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-23T14:23:28.475 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-23T14:23:28.475 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-23T14:23:28.475 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-23T14:23:28.476 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-23T14:23:28.476 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-04-23T14:23:28.476 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-23T14:23:28.476 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-23T14:23:28.476 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-23T14:23:28.476 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-23T14:23:28.476 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-23T14:23:28.476 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-23T14:23:28.476 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-23T14:23:28.476 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-04-23T14:23:28.476 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-23T14:23:28.476 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-23T14:23:28.476 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-23T14:23:28.476 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-04-23T14:23:28.477 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-04-23T14:23:28.477 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-23T14:23:28.477 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-23T14:23:28.477 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-23T14:23:28.477 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-23T14:23:28.477 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-23T14:23:28.477 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-04-23T14:23:28.477 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-04-23T14:23:28.477 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-04-23T14:23:28.477 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-23T14:23:28.477 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-23T14:23:28.477 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-23T14:23:28.477 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-23T14:23:28.477 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-23T14:23:28.477 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-23T14:23:28.478 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-04-23T14:23:28.478 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-04-23T14:23:28.478 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-23T14:23:28.478 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-23T14:23:28.478 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-04-23T14:23:28.478 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-04-23T14:23:28.478 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-04-23T14:23:28.478 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-23T14:23:28.478 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-23T14:23:28.478 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-23T14:23:28.478 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-23T14:23:28.478 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-23T14:23:28.478 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-04-23T14:23:28.478 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-23T14:23:28.479 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-04-23T14:23:28.479 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-23T14:23:28.479 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-04-23T14:23:28.479 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-23T14:23:28.479 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-04-23T14:23:28.479 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-04-23T14:23:28.479 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-23T14:23:28.479 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-04-23T14:23:28.479 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-23T14:23:28.479 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-04-23T14:23:28.479 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-23T14:23:28.479 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-23T14:23:28.479 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-23T14:23:28.479 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-23T14:23:28.479 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-23T14:23:28.480 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-23T14:23:28.480 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-23T14:23:28.480 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-23T14:23:28.480 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-23T14:23:28.480 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-23T14:23:28.480 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-23T14:23:28.480 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-23T14:23:28.480 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-23T14:23:28.480 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-04-23T14:23:28.480 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-04-23T14:23:28.480 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-23T14:23:28.480 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-04-23T14:23:28.480 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-23T14:23:28.480 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-23T14:23:28.481 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-04-23T14:23:28.481 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-23T14:23:28.481 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-23T14:23:28.481 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-23T14:23:28.481 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-23T14:23:28.481 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-23T14:23:28.481 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-23T14:23:28.481 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-23T14:23:28.481 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-23T14:23:28.481 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-23T14:23:28.481 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-23T14:23:28.481 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-23T14:23:28.481 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-23T14:23:28.481 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-23T14:23:28.481 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-23T14:23:28.481 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-23T14:23:28.482 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-23T14:23:28.482 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-23T14:23:28.482 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-23T14:23:28.482 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-23T14:23:28.482 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-23T14:23:28.482 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-23T14:23:28.482 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-23T14:23:28.482 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-23T14:23:28.482 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-23T14:23:28.482 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-23T14:23:28.482 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-23T14:23:28.482 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-23T14:23:28.482 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-23T14:23:28.483 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-23T14:23:28.483 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-23T14:23:28.483 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-23T14:23:28.483 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-23T14:23:28.483 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-23T14:23:28.483 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-23T14:23:28.483 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-23T14:23:28.483 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-23T14:23:28.483 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-23T14:23:28.483 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-23T14:23:28.483 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-23T14:23:28.483 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-23T14:23:28.483 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-23T14:23:28.483 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-23T14:23:28.483 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-23T14:23:28.483 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-23T14:23:28.484 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-23T14:23:28.484 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-23T14:23:28.484 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-23T14:23:28.484 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-23T14:23:28.484 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-23T14:23:28.484 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-23T14:23:28.484 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-23T14:23:28.484 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-23T14:23:28.484 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-23T14:23:28.484 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-23T14:23:28.484 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-23T14:23:28.484 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-23T14:23:28.484 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-23T14:23:28.484 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-23T14:23:28.485 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-23T14:23:28.485 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-23T14:23:28.485 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-23T14:23:28.485 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-23T14:23:28.485 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-23T14:23:28.485 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-23T14:23:28.485 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-04-23T14:23:28.485 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-23T14:23:28.485 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-23T14:23:28.485 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-23T14:23:28.485 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-04-23T14:23:28.485 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-23T14:23:28.485 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-23T14:23:28.485 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-23T14:23:28.485 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-23T14:23:28.486 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-23T14:23:28.486 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-23T14:23:28.486 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-23T14:23:28.486 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-23T14:23:28.486 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-23T14:23:28.486 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-23T14:23:28.486 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-23T14:23:28.486 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-23T14:23:28.486 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-23T14:23:28.486 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-23T14:23:28.486 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-23T14:23:28.486 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-23T14:23:28.487 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-23T14:23:28.487 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-23T14:23:28.487 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-23T14:23:28.487 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-23T14:23:28.487 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-23T14:23:28.487 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-23T14:23:28.487 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-23T14:23:28.487 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-23T14:23:28.487 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-23T14:23:28.487 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-23T14:23:28.487 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-23T14:23:28.487 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-23T14:23:28.487 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-23T14:23:28.488 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-23T14:23:28.488 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-23T14:23:28.488 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-23T14:23:28.488 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-23T14:23:28.488 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-23T14:23:28.488 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-23T14:23:28.488 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-23T14:23:28.488 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-23T14:23:28.488 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-23T14:23:28.488 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-23T14:23:28.488 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-23T14:23:28.488 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-23T14:23:28.488 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-23T14:23:28.489 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-23T14:23:28.489 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-23T14:23:28.489 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-23T14:23:28.489 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-23T14:23:28.489 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-23T14:23:28.489 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-23T14:23:28.489 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-23T14:23:28.489 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-23T14:23:28.489 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-23T14:23:28.489 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-23T14:23:28.489 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-23T14:23:28.489 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-23T14:23:28.489 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-23T14:23:28.489 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-23T14:23:28.489 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-23T14:23:28.490 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-23T14:23:28.490 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-23T14:23:28.490 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-23T14:23:28.490 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-23T14:23:28.490 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-23T14:23:28.490 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-23T14:23:28.490 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-23T14:23:28.490 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-23T14:23:28.490 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-23T14:23:28.490 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-23T14:23:28.490 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-23T14:23:28.490 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-23T14:23:28.490 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-23T14:23:28.491 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-23T14:23:28.491 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-23T14:23:28.491 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-23T14:23:28.491 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-23T14:23:28.491 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-23T14:23:28.491 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-23T14:23:28.491 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-23T14:23:28.491 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-23T14:23:28.491 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-23T14:23:28.491 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-23T14:23:28.491 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-23T14:23:28.491 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-23T14:23:28.491 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-23T14:23:28.491 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-23T14:23:28.491 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-23T14:23:28.491 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-23T14:23:28.492 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-23T14:23:28.492 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-23T14:23:28.492 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-04-23T14:23:28.492 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-23T14:23:28.492 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-23T14:23:28.492 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-23T14:23:28.492 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-23T14:23:28.492 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-23T14:23:28.492 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-23T14:23:28.492 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-23T14:23:28.492 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-23T14:23:28.492 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-23T14:23:28.492 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-23T14:23:28.492 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-23T14:23:28.492 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-23T14:23:28.493 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-23T14:23:28.493 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-23T14:23:28.493 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-23T14:23:28.493 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-23T14:23:28.493 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-23T14:23:28.493 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-23T14:23:28.493 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-23T14:23:28.493 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-23T14:23:28.493 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-23T14:23:28.493 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-23T14:23:28.493 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-23T14:23:28.493 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-23T14:23:28.493 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-23T14:23:28.493 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-23T14:23:28.493 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-23T14:23:28.493 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-23T14:23:28.494 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-23T14:23:28.494 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-23T14:23:28.494 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-23T14:23:28.494 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-23T14:23:28.494 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-23T14:23:28.494 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-23T14:23:28.494 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-23T14:23:28.494 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-23T14:23:28.494 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-23T14:23:28.494 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-23T14:23:28.494 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-23T14:23:28.494 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-23T14:23:28.494 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-23T14:23:28.494 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-04-23T14:23:28.495 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-04-23T14:23:28.495 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-23T14:23:28.495 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-23T14:23:28.495 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-04-23T14:23:28.495 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-23T14:23:28.495 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-23T14:23:28.495 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-23T14:23:28.495 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-23T14:23:28.495 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-23T14:23:28.495 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-23T14:23:28.495 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-23T14:23:28.495 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-23T14:23:28.495 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-23T14:23:28.495 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-23T14:23:28.495 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-23T14:23:28.496 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-23T14:23:28.496 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-23T14:23:28.496 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-23T14:23:28.496 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-23T14:23:28.496 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-23T14:23:28.496 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-23T14:23:28.496 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-23T14:23:28.496 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-23T14:23:28.496 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-23T14:23:28.496 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-23T14:23:28.496 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-23T14:23:28.496 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-23T14:23:28.496 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-04-23T14:23:28.496 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-23T14:23:28.496 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-23T14:23:28.497 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-23T14:23:28.497 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-23T14:23:28.497 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-04-23T14:23:28.497 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-04-23T14:23:28.497 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-23T14:23:28.497 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-23T14:23:28.497 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-23T14:23:28.497 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-23T14:23:28.497 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-23T14:23:28.497 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-23T14:23:28.497 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-23T14:23:28.497 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-04-23T14:23:28.497 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-04-23T14:23:28.497 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-23T14:23:28.497 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-04-23T14:23:28.497 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-23T14:23:28.498 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-04-23T14:23:28.498 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-23T14:23:28.498 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-04-23T14:23:28.498 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-23T14:23:28.498 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-04-23T14:23:28.498 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-04-23T14:23:28.498 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-23T14:23:28.498 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-04-23T14:23:28.498 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-23T14:23:28.498 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-04-23T14:23:28.498 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-23T14:23:28.498 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-04-23T14:23:28.498 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-23T14:23:28.499 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-04-23T14:23:28.499 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-23T14:23:28.499 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-04-23T14:23:28.499 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-04-23T14:23:28.499 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-23T14:23:28.499 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-23T14:23:28.499 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-23T14:23:28.499 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-23T14:23:28.499 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-04-23T14:23:28.499 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-23T14:23:28.499 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-04-23T14:23:28.499 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-23T14:23:28.499 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-23T14:23:28.499 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-23T14:23:28.499 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-23T14:23:28.500 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-23T14:23:28.500 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-23T14:23:28.500 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-23T14:23:28.500 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-23T14:23:28.500 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-04-23T14:23:28.500 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-23T14:23:28.500 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-04-23T14:23:28.500 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-23T14:23:28.500 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-23T14:23:28.500 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-23T14:23:28.500 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-23T14:23:28.500 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-23T14:23:28.500 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-04-23T14:23:28.500 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-23T14:23:28.501 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-23T14:23:28.501 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-23T14:23:28.501 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-23T14:23:28.501 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-04-23T14:23:28.501 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-23T14:23:28.501 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-23T14:23:28.501 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-23T14:23:28.501 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-23T14:23:28.501 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-23T14:23:28.501 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-23T14:23:28.501 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-23T14:23:28.501 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-23T14:23:28.501 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-23T14:23:28.501 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-04-23T14:23:28.501 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-04-23T14:23:28.502 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-23T14:23:28.502 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-23T14:23:28.502 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-23T14:23:28.502 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-23T14:23:28.502 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-23T14:23:28.502 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-23T14:23:28.502 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-23T14:23:28.502 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-23T14:23:28.502 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-23T14:23:28.502 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-23T14:23:28.502 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-23T14:23:28.502 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-23T14:23:28.502 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-23T14:23:28.502 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-23T14:23:28.502 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-23T14:23:28.503 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-23T14:23:28.503 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-04-23T14:23:28.503 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-23T14:23:28.503 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-23T14:23:28.503 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-23T14:23:28.503 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-23T14:23:28.503 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-23T14:23:28.503 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-04-23T14:23:28.503 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-04-23T14:23:28.503 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-23T14:23:28.503 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-23T14:23:28.503 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-23T14:23:28.503 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-23T14:23:28.503 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-23T14:23:28.504 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-23T14:23:28.504 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-23T14:23:28.504 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-04-23T14:23:28.504 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-23T14:23:28.504 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-23T14:23:28.504 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-04-23T14:23:28.504 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-23T14:23:28.504 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-23T14:23:28.504 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-23T14:23:28.504 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-23T14:23:28.504 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-04-23T14:23:28.504 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-04-23T14:23:28.504 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-23T14:23:28.504 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-23T14:23:28.504 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-23T14:23:28.505 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-23T14:23:28.505 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-04-23T14:23:28.505 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-23T14:23:28.505 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-04-23T14:23:28.505 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-23T14:23:28.505 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-23T14:23:28.505 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-23T14:23:28.505 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-23T14:23:28.505 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-23T14:23:28.505 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-23T14:23:28.505 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-23T14:23:28.505 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-04-23T14:23:28.505 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-23T14:23:28.505 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-23T14:23:28.505 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-04-23T14:23:28.506 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-23T14:23:28.506 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-23T14:23:28.506 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-23T14:23:28.506 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-04-23T14:23:28.506 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-23T14:23:28.506 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-04-23T14:23:28.506 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-23T14:23:28.506 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-23T14:23:28.506 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-23T14:23:28.506 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-23T14:23:28.506 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-23T14:23:28.506 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-23T14:23:28.506 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-23T14:23:28.506 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-04-23T14:23:28.507 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-23T14:23:28.507 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-04-23T14:23:28.507 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-04-23T14:23:28.507 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-23T14:23:28.507 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-04-23T14:23:28.507 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-04-23T14:23:28.507 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-23T14:23:28.507 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-23T14:23:28.507 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-23T14:23:28.507 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-04-23T14:23:28.507 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-23T14:23:28.508 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-23T14:23:28.508 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-23T14:23:28.508 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-04-23T14:23:28.508 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-04-23T14:23:28.508 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-23T14:23:28.508 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-23T14:23:28.508 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-23T14:23:28.508 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-23T14:23:28.508 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-04-23T14:23:28.508 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-23T14:23:28.508 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-23T14:23:28.508 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-23T14:23:28.508 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-23T14:23:28.508 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-04-23T14:23:28.509 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-23T14:23:28.509 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-04-23T14:23:28.509 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-23T14:23:28.509 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-04-23T14:23:28.509 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-23T14:23:28.509 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-04-23T14:23:28.509 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-23T14:23:28.509 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-04-23T14:23:28.509 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-23T14:23:28.509 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-23T14:23:28.509 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-23T14:23:28.509 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-04-23T14:23:28.509 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-04-23T14:23:28.509 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-23T14:23:28.509 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-23T14:23:28.510 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-23T14:23:28.510 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-23T14:23:28.510 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-23T14:23:28.510 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-04-23T14:23:28.510 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-23T14:23:28.510 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-23T14:23:28.510 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-04-23T14:23:28.510 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-23T14:23:28.510 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-23T14:23:28.510 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-23T14:23:28.510 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-23T14:23:28.510 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-23T14:23:28.510 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-04-23T14:23:28.510 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-23T14:23:28.510 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-23T14:23:28.511 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-04-23T14:23:28.511 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-04-23T14:23:28.511 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-23T14:23:28.511 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-04-23T14:23:28.511 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-23T14:23:28.511 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-23T14:23:28.511 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-23T14:23:28.511 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-23T14:23:28.511 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-23T14:23:28.511 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-23T14:23:28.511 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-23T14:23:28.511 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-23T14:23:28.512 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-23T14:23:28.512 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-23T14:23:28.512 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-04-23T14:23:28.512 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-04-23T14:23:28.512 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-23T14:23:28.512 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-04-23T14:23:28.512 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-04-23T14:23:28.512 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-23T14:23:28.512 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-23T14:23:28.512 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-23T14:23:28.512 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-23T14:23:28.512 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-23T14:23:28.512 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-23T14:23:28.512 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-04-23T14:23:28.512 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-23T14:23:28.513 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-23T14:23:28.513 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-23T14:23:28.513 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-04-23T14:23:28.513 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-04-23T14:23:28.513 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-23T14:23:28.513 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-23T14:23:28.513 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-23T14:23:28.513 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-04-23T14:23:28.513 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-23T14:23:28.513 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-04-23T14:23:28.513 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-23T14:23:28.513 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-04-23T14:23:28.513 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-23T14:23:28.513 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-04-23T14:23:28.514 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-23T14:23:28.514 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-04-23T14:23:28.514 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-23T14:23:28.514 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-04-23T14:23:28.514 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-23T14:23:28.514 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-04-23T14:23:28.514 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-23T14:23:28.514 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-04-23T14:23:28.514 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-23T14:23:28.514 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-23T14:23:28.514 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-23T14:23:28.514 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-23T14:23:28.514 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-23T14:23:28.514 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-23T14:23:28.515 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-04-23T14:23:28.515 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-23T14:23:28.515 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-23T14:23:28.515 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-23T14:23:28.515 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-04-23T14:23:28.515 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-23T14:23:28.515 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-23T14:23:28.515 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-23T14:23:28.515 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-23T14:23:28.515 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-23T14:23:28.515 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-23T14:23:28.516 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-04-23T14:23:28.516 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-23T14:23:28.516 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-04-23T14:23:28.516 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-23T14:23:28.516 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-23T14:23:28.516 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-04-23T14:23:28.516 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-23T14:23:28.516 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-23T14:23:28.516 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-04-23T14:23:28.516 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-23T14:23:28.516 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-04-23T14:23:28.516 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-23T14:23:28.517 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-04-23T14:23:28.517 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-23T14:23:28.517 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-23T14:23:28.517 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-04-23T14:23:28.517 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-23T14:23:28.517 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-23T14:23:28.517 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-23T14:23:28.517 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-23T14:23:28.517 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-23T14:23:28.517 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-04-23T14:23:28.517 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-23T14:23:28.517 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-04-23T14:23:28.518 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-23T14:23:28.518 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-23T14:23:28.518 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-23T14:23:28.518 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-23T14:23:28.518 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-04-23T14:23:28.518 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-23T14:23:28.518 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-04-23T14:23:28.518 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-23T14:23:28.518 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-04-23T14:23:28.518 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-23T14:23:28.518 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-04-23T14:23:28.518 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-23T14:23:28.518 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-23T14:23:28.518 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-04-23T14:23:28.519 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-23T14:23:28.519 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-23T14:23:28.519 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-23T14:23:28.519 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-23T14:23:28.519 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-04-23T14:23:28.519 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-23T14:23:28.519 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-23T14:23:28.519 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-23T14:23:28.519 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-04-23T14:23:28.519 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-23T14:23:28.519 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-23T14:23:28.519 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-23T14:23:28.519 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-23T14:23:28.519 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-04-23T14:23:28.520 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-23T14:23:28.520 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-04-23T14:23:28.520 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-23T14:23:28.520 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-04-23T14:23:28.520 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-23T14:23:28.520 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-23T14:23:28.520 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-04-23T14:23:28.520 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-23T14:23:28.520 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-23T14:23:28.520 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-04-23T14:23:28.520 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-23T14:23:28.520 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-23T14:23:28.520 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-04-23T14:23:28.520 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-23T14:23:28.520 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-04-23T14:23:28.521 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-23T14:23:28.521 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-23T14:23:28.521 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-04-23T14:23:28.521 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-23T14:23:28.521 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-23T14:23:28.521 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-23T14:23:28.521 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-04-23T14:23:28.521 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-23T14:23:28.521 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-23T14:23:28.521 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-23T14:23:28.521 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-23T14:23:28.521 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-23T14:23:28.521 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-04-23T14:23:28.521 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-23T14:23:28.521 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-23T14:23:28.522 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-04-23T14:23:28.522 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-23T14:23:28.522 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-23T14:23:28.522 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-04-23T14:23:28.522 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-23T14:23:28.522 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-23T14:23:28.522 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-23T14:23:28.522 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-23T14:23:28.522 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-23T14:23:28.522 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-23T14:23:28.522 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-23T14:23:28.522 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-23T14:23:28.522 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-04-23T14:23:28.522 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-23T14:23:28.523 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-23T14:23:28.523 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-23T14:23:28.523 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-23T14:23:28.523 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-23T14:23:28.523 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-23T14:23:28.523 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-23T14:23:28.523 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-23T14:23:28.523 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-23T14:23:28.523 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-23T14:23:28.523 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-23T14:23:28.523 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-23T14:23:28.523 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-04-23T14:23:28.523 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-23T14:23:28.523 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-23T14:23:28.523 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-23T14:23:28.523 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-23T14:23:28.524 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-23T14:23:28.524 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-23T14:23:28.524 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-23T14:23:28.524 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-23T14:23:28.524 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-23T14:23:28.524 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-04-23T14:23:28.524 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-04-23T14:23:28.524 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-23T14:23:28.524 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-23T14:23:28.524 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-23T14:23:28.524 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-04-23T14:23:28.524 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-23T14:23:28.524 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-23T14:23:28.524 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-23T14:23:28.525 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-23T14:23:28.525 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-23T14:23:28.525 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-23T14:23:28.525 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-04-23T14:23:28.525 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-23T14:23:28.525 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-04-23T14:23:28.525 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-04-23T14:23:28.525 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-23T14:23:28.525 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-04-23T14:23:28.525 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-23T14:23:28.525 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-04-23T14:23:28.525 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-23T14:23:28.525 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-04-23T14:23:28.525 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-04-23T14:23:28.525 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-23T14:23:28.526 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-04-23T14:23:28.526 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-04-23T14:23:28.526 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-23T14:23:28.526 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-23T14:23:28.526 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-04-23T14:23:28.526 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-23T14:23:28.526 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-23T14:23:28.526 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-23T14:23:28.526 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-23T14:23:28.526 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-04-23T14:23:28.526 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-04-23T14:23:28.526 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-23T14:23:28.526 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-04-23T14:23:28.526 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-23T14:23:28.527 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-23T14:23:28.527 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-04-23T14:23:28.527 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-23T14:23:28.527 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-23T14:23:28.527 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-23T14:23:28.527 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-04-23T14:23:28.527 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-04-23T14:23:28.527 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-23T14:23:28.527 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-04-23T14:23:28.527 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-04-23T14:23:28.527 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-23T14:23:28.527 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-23T14:23:28.527 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-23T14:23:28.527 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-23T14:23:28.527 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-23T14:23:28.529 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-23T14:23:28.529 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-23T14:23:28.529 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-23T14:23:28.529 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-23T14:23:28.529 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-23T14:23:28.529 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-23T14:23:28.529 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-23T14:23:28.529 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-04-23T14:23:28.529 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-23T14:23:28.530 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-23T14:23:28.530 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-23T14:23:28.530 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-23T14:23:28.530 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-23T14:23:28.530 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-23T14:23:28.530 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-23T14:23:28.530 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-23T14:23:28.530 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-23T14:23:28.530 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-23T14:23:28.530 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-23T14:23:28.530 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-23T14:23:28.530 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-04-23T14:23:28.530 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-23T14:23:28.530 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-23T14:23:28.531 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-04-23T14:23:28.531 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-04-23T14:23:28.531 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-23T14:23:28.531 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-23T14:23:28.531 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-23T14:23:28.531 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-23T14:23:28.531 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-04-23T14:23:28.531 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-23T14:23:28.531 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-23T14:23:28.531 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-04-23T14:23:28.531 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-04-23T14:23:28.531 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-04-23T14:23:28.531 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-23T14:23:28.531 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-23T14:23:28.531 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-04-23T14:23:28.532 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-23T14:23:28.532 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-23T14:23:28.532 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-23T14:23:28.532 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-23T14:23:28.532 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-23T14:23:28.532 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-23T14:23:28.532 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-23T14:23:28.532 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-23T14:23:28.532 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-23T14:23:28.532 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-23T14:23:28.532 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-23T14:23:28.532 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-23T14:23:28.532 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-23T14:23:28.532 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-23T14:23:28.532 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-23T14:23:28.533 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-23T14:23:28.533 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-23T14:23:28.533 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-23T14:23:28.533 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-23T14:23:28.533 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-23T14:23:28.533 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-23T14:23:28.533 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-23T14:23:28.533 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-23T14:23:28.533 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-23T14:23:28.533 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-23T14:23:28.533 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-23T14:23:28.533 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-23T14:23:28.533 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-23T14:23:28.533 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-23T14:23:28.533 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-23T14:23:28.534 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-23T14:23:28.534 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-04-23T14:23:28.534 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-23T14:23:28.534 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-23T14:23:28.534 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-23T14:23:28.534 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-23T14:23:28.534 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-23T14:23:28.534 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-04-23T14:23:28.534 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-23T14:23:28.534 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-23T14:23:28.534 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-04-23T14:23:28.534 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-23T14:23:28.534 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-23T14:23:28.534 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-23T14:23:28.534 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-04-23T14:23:28.535 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-23T14:23:28.535 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-23T14:23:28.535 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-04-23T14:23:28.535 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-23T14:23:28.535 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-04-23T14:23:28.535 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-23T14:23:28.535 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-04-23T14:23:28.535 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-23T14:23:28.535 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-04-23T14:23:28.535 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-23T14:23:28.535 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-23T14:23:28.535 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-04-23T14:23:28.535 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-23T14:23:28.535 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-04-23T14:23:28.536 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-23T14:23:28.536 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-23T14:23:28.536 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-23T14:23:28.536 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-23T14:23:28.536 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-23T14:23:28.536 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-23T14:23:28.536 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-04-23T14:23:28.536 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-23T14:23:28.536 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-23T14:23:28.536 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-23T14:23:28.536 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-23T14:23:28.536 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-23T14:23:28.536 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-04-23T14:23:28.536 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-23T14:23:28.536 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-23T14:23:28.537 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-04-23T14:23:28.537 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-23T14:23:28.537 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-23T14:23:28.537 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-04-23T14:23:28.537 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-23T14:23:28.537 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-23T14:23:28.537 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-23T14:23:28.537 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-23T14:23:28.537 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-23T14:23:28.537 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-23T14:23:28.537 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-23T14:23:28.537 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-04-23T14:23:28.537 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-23T14:23:28.537 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-23T14:23:28.537 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-23T14:23:28.538 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-04-23T14:23:28.538 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-23T14:23:28.538 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-23T14:23:28.538 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-23T14:23:28.538 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-04-23T14:23:28.538 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-23T14:23:28.538 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-04-23T14:23:28.538 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-23T14:23:28.538 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-04-23T14:23:28.538 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-23T14:23:28.538 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-23T14:23:28.538 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-23T14:23:28.538 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-23T14:23:28.538 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-04-23T14:23:28.538 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-23T14:23:28.539 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-04-23T14:23:28.539 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-23T14:23:28.539 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-23T14:23:28.539 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-04-23T14:23:28.539 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-23T14:23:28.539 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-23T14:23:28.539 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-23T14:23:28.539 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-04-23T14:23:28.539 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-23T14:23:28.539 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-23T14:23:28.539 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-04-23T14:23:28.539 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-23T14:23:28.539 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-23T14:23:28.539 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-23T14:23:28.540 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-23T14:23:28.540 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-23T14:23:28.540 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-23T14:23:28.540 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-23T14:23:28.540 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-23T14:23:28.540 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-23T14:23:28.540 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-23T14:23:28.540 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-23T14:23:28.540 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-04-23T14:23:28.540 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-23T14:23:28.540 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-23T14:23:28.540 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-23T14:23:28.540 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-23T14:23:28.540 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-04-23T14:23:28.540 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-23T14:23:28.540 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-04-23T14:23:28.541 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-04-23T14:23:28.541 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-23T14:23:28.541 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-04-23T14:23:28.541 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-23T14:23:28.541 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-23T14:23:28.541 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-23T14:23:28.541 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-23T14:23:28.541 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-23T14:23:28.541 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-23T14:23:28.541 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-04-23T14:23:28.541 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-23T14:23:28.541 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-04-23T14:23:28.541 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-04-23T14:23:28.541 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-04-23T14:23:28.541 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-23T14:23:28.542 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-23T14:23:28.542 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-23T14:23:28.542 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-23T14:23:28.542 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-23T14:23:28.542 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-23T14:23:28.542 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-23T14:23:28.542 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-23T14:23:28.542 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-23T14:23:28.542 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-23T14:23:28.542 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-23T14:23:28.542 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-23T14:23:28.542 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-23T14:23:28.542 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-23T14:23:28.542 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-23T14:23:28.543 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-23T14:23:28.543 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-23T14:23:28.543 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-23T14:23:28.543 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-04-23T14:23:28.543 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-04-23T14:23:28.543 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-23T14:23:28.543 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-23T14:23:28.543 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-23T14:23:28.543 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-23T14:23:28.543 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-04-23T14:23:28.543 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-04-23T14:23:28.543 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-23T14:23:28.543 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-23T14:23:28.543 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-04-23T14:23:28.543 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-23T14:23:28.544 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-04-23T14:23:28.544 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-04-23T14:23:28.544 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-23T14:23:28.544 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-04-23T14:23:28.544 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-23T14:23:28.544 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-04-23T14:23:28.544 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-23T14:23:28.544 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-23T14:23:28.544 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-23T14:23:28.544 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-23T14:23:28.544 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-23T14:23:28.544 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-04-23T14:23:28.544 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-04-23T14:23:28.544 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-23T14:23:28.544 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-23T14:23:28.545 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-23T14:23:28.545 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-23T14:23:28.545 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-04-23T14:23:28.545 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-23T14:23:28.545 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-04-23T14:23:28.545 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-23T14:23:28.545 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-23T14:23:28.545 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-04-23T14:23:28.545 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-23T14:23:28.545 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-23T14:23:28.545 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-23T14:23:28.545 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-23T14:23:28.545 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-23T14:23:28.545 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-23T14:23:28.545 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-23T14:23:28.546 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-23T14:23:28.546 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-23T14:23:28.546 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-23T14:23:28.546 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-04-23T14:23:28.546 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-23T14:23:28.546 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-23T14:23:28.546 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-23T14:23:28.546 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-23T14:23:28.546 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-23T14:23:28.546 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-23T14:23:28.546 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-23T14:23:28.546 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-04-23T14:23:28.546 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-23T14:23:28.546 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-04-23T14:23:28.546 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-23T14:23:28.547 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-23T14:23:28.547 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-23T14:23:28.547 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-23T14:23:28.547 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-23T14:23:28.547 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-23T14:23:28.547 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-23T14:23:28.547 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-23T14:23:28.547 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-23T14:23:28.547 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-23T14:23:28.547 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-23T14:23:28.547 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-23T14:23:28.547 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-23T14:23:28.547 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-23T14:23:28.547 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-23T14:23:28.547 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-23T14:23:28.548 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-23T14:23:28.548 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-23T14:23:28.548 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-23T14:23:28.548 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-23T14:23:28.548 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-23T14:23:28.548 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-23T14:23:28.548 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-23T14:23:28.548 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-23T14:23:28.548 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-23T14:23:28.548 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-23T14:23:28.548 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-23T14:23:28.548 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-23T14:23:28.548 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-23T14:23:28.548 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-23T14:23:28.548 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-23T14:23:28.549 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-23T14:23:28.549 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-23T14:23:28.549 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-23T14:23:28.549 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-23T14:23:28.549 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-23T14:23:28.549 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-23T14:23:28.549 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-23T14:23:28.549 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-23T14:23:28.549 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-23T14:23:28.549 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-23T14:23:28.549 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-23T14:23:28.549 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-23T14:23:28.549 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-23T14:23:28.549 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-23T14:23:28.549 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-04-23T14:23:28.550 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-23T14:23:28.550 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-23T14:23:28.550 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-23T14:23:28.550 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-23T14:23:28.550 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-23T14:23:28.550 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-23T14:23:28.550 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-23T14:23:28.550 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-23T14:23:28.550 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-23T14:23:28.550 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-23T14:23:28.550 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-23T14:23:28.550 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-23T14:23:28.550 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-23T14:23:28.550 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-23T14:23:28.551 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-23T14:23:28.551 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-04-23T14:23:28.551 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-23T14:23:28.551 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-23T14:23:28.551 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-23T14:23:28.551 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-04-23T14:23:28.551 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-04-23T14:23:28.551 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-23T14:23:28.551 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-23T14:23:28.551 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-23T14:23:28.551 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-23T14:23:28.551 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-04-23T14:23:28.551 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-23T14:23:28.551 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-23T14:23:28.551 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-23T14:23:28.551 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-23T14:23:28.552 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-04-23T14:23:28.552 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-04-23T14:23:28.552 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-23T14:23:28.552 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-23T14:23:28.552 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-23T14:23:28.552 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-04-23T14:23:28.552 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-04-23T14:23:28.552 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-04-23T14:23:28.552 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-04-23T14:23:28.552 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-04-23T14:23:28.552 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-23T14:23:28.552 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-23T14:23:28.552 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-04-23T14:23:28.553 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-04-23T14:23:28.553 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-04-23T14:23:28.553 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-23T14:23:28.553 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-23T14:23:28.553 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-04-23T14:23:28.553 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-23T14:23:28.553 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-23T14:23:28.553 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-23T14:23:28.553 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-23T14:23:28.553 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-23T14:23:28.553 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-23T14:23:28.553 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-23T14:23:28.553 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-23T14:23:28.553 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-23T14:23:28.553 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-23T14:23:28.554 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-23T14:23:28.554 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-23T14:23:28.554 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-04-23T14:23:28.554 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-23T14:23:28.554 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-23T14:23:28.554 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-23T14:23:28.554 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-23T14:23:28.554 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-23T14:23:28.554 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-23T14:23:28.554 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-23T14:23:28.554 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-23T14:23:28.554 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-23T14:23:28.554 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-23T14:23:28.554 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-23T14:23:28.554 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-23T14:23:28.555 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-23T14:23:28.555 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-23T14:23:28.555 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-23T14:23:28.555 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-23T14:23:28.555 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-23T14:23:28.555 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-23T14:23:28.555 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-23T14:23:28.555 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-23T14:23:28.555 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-23T14:23:28.555 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-23T14:23:28.555 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-23T14:23:28.556 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-23T14:23:28.556 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-23T14:23:28.556 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-23T14:23:28.556 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-04-23T14:23:28.556 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-23T14:23:28.556 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-23T14:23:28.556 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-23T14:23:28.556 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-23T14:23:28.556 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-04-23T14:23:28.556 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-23T14:23:28.556 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-23T14:23:28.556 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-04-23T14:23:28.556 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-23T14:23:28.556 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-04-23T14:23:28.556 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-04-23T14:23:28.557 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-23T14:23:28.557 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-04-23T14:23:28.557 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-23T14:23:28.557 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-04-23T14:23:28.557 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-23T14:23:28.557 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-23T14:23:28.557 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-04-23T14:23:28.557 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-23T14:23:28.557 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-04-23T14:23:28.557 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-23T14:23:28.557 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-04-23T14:23:28.557 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-23T14:23:28.557 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-04-23T14:23:28.557 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-23T14:23:28.557 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-04-23T14:23:28.558 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-23T14:23:28.558 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-04-23T14:23:28.558 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-23T14:23:28.558 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-04-23T14:23:28.558 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-23T14:23:28.558 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-04-23T14:23:28.558 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-23T14:23:28.558 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-04-23T14:23:28.558 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-04-23T14:23:28.558 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-23T14:23:28.558 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-04-23T14:23:28.558 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-04-23T14:23:28.558 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-23T14:23:28.558 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-04-23T14:23:28.559 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-04-23T14:23:28.559 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-23T14:23:28.559 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-04-23T14:23:28.559 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-23T14:23:28.559 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-04-23T14:23:28.559 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-23T14:23:28.559 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-04-23T14:23:28.559 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-23T14:23:28.559 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-04-23T14:23:28.559 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-23T14:23:28.559 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-04-23T14:23:28.559 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-23T14:23:28.559 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-04-23T14:23:28.559 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-23T14:23:28.559 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-04-23T14:23:28.560 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-23T14:23:28.560 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-04-23T14:23:28.560 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-04-23T14:23:28.560 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-23T14:23:28.560 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-04-23T14:23:28.560 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-23T14:23:28.560 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-04-23T14:23:28.560 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-23T14:23:28.560 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-23T14:23:28.560 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-23T14:23:28.560 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-23T14:23:28.560 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-04-23T14:23:28.560 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-23T14:23:28.560 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-23T14:23:28.560 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-04-23T14:23:28.561 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-23T14:23:28.561 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-04-23T14:23:28.561 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-23T14:23:28.561 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-04-23T14:23:28.561 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-23T14:23:28.561 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-23T14:23:28.561 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-23T14:23:28.561 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-23T14:23:28.561 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-23T14:23:28.561 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-23T14:23:28.561 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-23T14:23:28.561 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-23T14:23:28.561 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-23T14:23:28.561 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-23T14:23:28.561 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-23T14:23:28.562 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-23T14:23:28.562 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-23T14:23:28.562 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-23T14:23:28.562 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-23T14:23:28.562 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-23T14:23:28.562 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-23T14:23:28.562 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-23T14:23:28.562 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-23T14:23:28.562 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-23T14:23:28.562 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-23T14:23:28.562 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-23T14:23:28.562 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-23T14:23:28.562 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-23T14:23:28.562 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-23T14:23:28.563 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-23T14:23:28.563 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-23T14:23:28.563 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-23T14:23:28.563 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-23T14:23:28.563 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-23T14:23:28.563 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-23T14:23:28.563 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-23T14:23:28.563 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-23T14:23:28.563 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-23T14:23:28.563 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-23T14:23:28.563 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-23T14:23:28.563 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-23T14:23:28.563 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-23T14:23:28.563 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-23T14:23:28.563 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-23T14:23:28.564 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-23T14:23:28.564 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-23T14:23:28.564 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-23T14:23:28.564 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-23T14:23:28.564 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-23T14:23:28.564 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-23T14:23:28.564 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-23T14:23:28.564 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-23T14:23:28.564 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-23T14:23:28.564 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-23T14:23:28.564 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-04-23T14:23:28.564 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-04-23T14:23:28.564 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-23T14:23:28.564 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-04-23T14:23:28.564 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-23T14:23:28.565 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-04-23T14:23:28.565 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-23T14:23:28.565 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-23T14:23:28.565 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-23T14:23:28.565 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-23T14:23:28.565 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-23T14:23:28.565 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-04-23T14:23:28.565 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-23T14:23:28.565 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-04-23T14:23:28.565 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-23T14:23:28.565 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-04-23T14:23:28.565 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-23T14:23:28.565 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-04-23T14:23:28.565 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-23T14:23:28.565 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-04-23T14:23:28.566 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-04-23T14:23:28.566 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-23T14:23:28.566 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-04-23T14:23:28.566 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-23T14:23:28.566 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-23T14:23:28.566 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-04-23T14:23:28.566 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-23T14:23:28.566 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-04-23T14:23:28.566 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-23T14:23:28.566 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-04-23T14:23:28.566 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-23T14:23:28.566 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-04-23T14:23:28.566 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-23T14:23:28.566 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-04-23T14:23:28.566 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-23T14:23:28.567 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-04-23T14:23:28.567 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-04-23T14:23:28.567 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-04-23T14:23:28.567 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-23T14:23:28.567 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-04-23T14:23:28.567 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-23T14:23:28.567 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-04-23T14:23:28.567 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-04-23T14:23:28.567 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-23T14:23:28.567 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-23T14:23:28.567 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-04-23T14:23:28.567 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-23T14:23:28.567 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-23T14:23:28.567 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-23T14:23:28.568 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-23T14:23:28.568 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-04-23T14:23:28.568 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-23T14:23:28.568 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-23T14:23:28.568 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-04-23T14:23:28.568 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-23T14:23:28.568 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-04-23T14:23:28.568 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-23T14:23:28.568 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-04-23T14:23:28.568 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-23T14:23:28.568 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-23T14:23:28.568 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-23T14:23:28.568 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-23T14:23:28.568 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-04-23T14:23:28.568 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-04-23T14:23:28.569 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-04-23T14:23:28.569 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-23T14:23:28.569 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-04-23T14:23:28.569 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-04-23T14:23:28.569 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-23T14:23:28.569 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-23T14:23:28.569 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-23T14:23:28.569 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-23T14:23:28.569 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-23T14:23:28.569 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-23T14:23:28.569 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-23T14:23:28.569 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-23T14:23:28.569 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-04-23T14:23:28.569 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-23T14:23:28.569 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-23T14:23:28.570 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-23T14:23:28.570 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-23T14:23:28.570 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-23T14:23:28.570 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-04-23T14:23:28.570 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-23T14:23:28.570 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-04-23T14:23:28.570 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-23T14:23:28.570 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-23T14:23:28.570 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-23T14:23:28.570 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-23T14:23:28.570 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-04-23T14:23:28.570 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-23T14:23:28.570 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-04-23T14:23:28.570 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-23T14:23:28.570 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-23T14:23:28.571 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-04-23T14:23:28.571 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-23T14:23:28.571 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-23T14:23:28.571 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-23T14:23:28.571 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-23T14:23:28.571 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-23T14:23:28.571 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-23T14:23:28.571 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-23T14:23:28.571 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-23T14:23:28.571 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-23T14:23:28.571 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-23T14:23:28.571 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-23T14:23:28.571 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-23T14:23:28.571 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-23T14:23:28.571 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-23T14:23:28.572 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-23T14:23:28.572 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-23T14:23:28.572 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-23T14:23:28.572 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-23T14:23:28.572 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-23T14:23:28.572 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-23T14:23:28.572 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-23T14:23:28.572 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-23T14:23:28.572 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-23T14:23:28.572 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-23T14:23:28.572 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-04-23T14:23:28.572 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-23T14:23:28.572 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-04-23T14:23:28.572 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-04-23T14:23:28.572 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-23T14:23:28.573 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-04-23T14:23:28.573 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-23T14:23:28.573 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-23T14:23:28.573 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-23T14:23:28.573 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-23T14:23:28.573 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-04-23T14:23:28.573 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-04-23T14:23:28.573 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-04-23T14:23:28.573 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-23T14:23:28.573 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-23T14:23:28.573 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-23T14:23:28.573 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-23T14:23:28.573 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-23T14:23:28.573 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-04-23T14:23:28.573 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-04-23T14:23:28.574 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-23T14:23:28.574 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-23T14:23:28.574 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-23T14:23:28.574 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-04-23T14:23:28.574 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-23T14:23:28.574 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-23T14:23:28.574 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-23T14:23:28.574 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-23T14:23:28.574 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-23T14:23:28.574 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-23T14:23:28.574 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-23T14:23:28.574 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-23T14:23:28.574 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-23T14:23:28.574 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-23T14:23:28.574 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-04-23T14:23:28.575 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-23T14:23:28.575 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-23T14:23:28.575 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-23T14:23:28.575 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-23T14:23:28.575 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-23T14:23:28.575 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-23T14:23:28.575 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-23T14:23:28.575 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-23T14:23:28.575 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-23T14:23:28.575 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-23T14:23:28.575 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-23T14:23:28.575 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-23T14:23:28.575 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-23T14:23:28.575 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-23T14:23:28.575 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-23T14:23:28.576 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-23T14:23:28.576 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-23T14:23:28.576 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-23T14:23:28.576 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-23T14:23:28.576 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-23T14:23:28.576 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-23T14:23:28.576 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-23T14:23:28.576 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-23T14:23:28.576 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-23T14:23:28.576 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-23T14:23:28.576 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-23T14:23:28.576 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-23T14:23:28.576 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-23T14:23:28.576 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-23T14:23:28.577 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-23T14:23:28.577 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-23T14:23:28.577 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-23T14:23:28.577 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-23T14:23:28.577 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-23T14:23:28.577 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-23T14:23:28.577 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-23T14:23:28.577 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-23T14:23:28.577 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-23T14:23:28.577 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-04-23T14:23:28.577 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-23T14:23:28.577 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-23T14:23:28.577 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-23T14:23:28.577 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-23T14:23:28.577 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-23T14:23:28.578 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-23T14:23:28.578 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-23T14:23:28.578 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-04-23T14:23:28.578 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-23T14:23:28.578 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-23T14:23:28.578 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-23T14:23:28.578 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-23T14:23:28.578 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-23T14:23:28.578 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-23T14:23:28.578 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-23T14:23:28.578 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-23T14:23:28.578 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-23T14:23:28.578 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-23T14:23:28.578 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-23T14:23:28.578 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-23T14:23:28.579 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-23T14:23:28.579 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-23T14:23:28.579 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-23T14:23:28.579 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-23T14:23:28.579 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-23T14:23:28.579 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-23T14:23:28.579 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-23T14:23:28.579 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-23T14:23:28.579 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-23T14:23:28.579 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-23T14:23:28.579 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-23T14:23:28.579 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-23T14:23:28.579 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-23T14:23:28.579 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-23T14:23:28.579 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-23T14:23:28.580 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-04-23T14:23:28.580 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-23T14:23:28.580 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-04-23T14:23:28.580 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-23T14:23:28.580 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-23T14:23:28.580 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-23T14:23:28.580 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-23T14:23:28.580 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-23T14:23:28.580 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-23T14:23:28.580 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-23T14:23:28.580 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-04-23T14:23:28.580 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-23T14:23:28.580 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-04-23T14:23:28.580 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-23T14:23:28.580 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-04-23T14:23:28.581 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-23T14:23:28.581 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-04-23T14:23:28.581 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-04-23T14:23:28.581 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-23T14:23:28.581 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-23T14:23:28.581 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-23T14:23:28.581 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-23T14:23:28.581 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-23T14:23:28.581 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-23T14:23:28.581 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-23T14:23:28.581 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-23T14:23:28.581 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-23T14:23:28.581 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-23T14:23:28.581 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-23T14:23:28.581 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-23T14:23:28.582 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-23T14:23:28.582 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-23T14:23:28.582 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-23T14:23:28.582 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-23T14:23:28.582 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-04-23T14:23:28.582 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-23T14:23:28.582 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-23T14:23:28.582 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-23T14:23:28.582 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-23T14:23:28.582 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-23T14:23:28.582 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-23T14:23:28.582 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-23T14:23:28.582 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-23T14:23:28.582 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-23T14:23:28.582 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-23T14:23:28.583 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-23T14:23:28.583 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-23T14:23:28.583 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-23T14:23:28.583 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-23T14:23:28.583 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-23T14:23:28.583 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-23T14:23:28.583 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-23T14:23:28.583 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-23T14:23:28.583 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-23T14:23:28.583 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-23T14:23:28.583 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-23T14:23:28.583 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-23T14:23:28.583 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-23T14:23:28.583 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-23T14:23:28.583 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-23T14:23:28.584 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-23T14:23:28.584 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-23T14:23:28.584 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-23T14:23:28.584 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-23T14:23:28.584 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-23T14:23:28.584 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-23T14:23:28.584 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-23T14:23:28.584 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-23T14:23:28.584 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-23T14:23:28.584 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-23T14:23:28.584 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-23T14:23:28.584 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-23T14:23:28.584 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-23T14:23:28.584 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-23T14:23:28.584 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-23T14:23:28.585 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-23T14:23:28.585 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-23T14:23:28.585 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-23T14:23:28.585 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-23T14:23:28.585 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-23T14:23:28.585 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-23T14:23:28.585 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-23T14:23:28.585 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-23T14:23:28.585 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-23T14:23:28.585 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-23T14:23:28.585 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-23T14:23:28.585 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-23T14:23:28.585 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-23T14:23:28.585 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-23T14:23:28.585 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-23T14:23:28.586 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-23T14:23:28.586 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-23T14:23:28.586 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-23T14:23:28.586 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-04-23T14:23:28.586 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-23T14:23:28.586 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-23T14:23:28.586 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-23T14:23:28.586 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-23T14:23:28.586 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-04-23T14:23:28.586 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-23T14:23:28.586 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-23T14:23:28.586 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-23T14:23:28.586 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-23T14:23:28.586 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-23T14:23:28.587 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-23T14:23:28.587 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-23T14:23:28.587 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-23T14:23:28.587 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-23T14:23:28.587 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-23T14:23:28.587 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-23T14:23:28.587 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-23T14:23:28.587 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-23T14:23:28.587 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-23T14:23:28.587 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-23T14:23:28.587 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-23T14:23:28.587 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-23T14:23:28.587 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-23T14:23:28.587 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-23T14:23:28.587 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-23T14:23:28.588 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-23T14:23:28.588 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-23T14:23:28.588 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-23T14:23:28.588 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-23T14:23:28.588 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-23T14:23:28.588 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-23T14:23:28.588 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-23T14:23:28.588 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-23T14:23:28.588 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-23T14:23:28.588 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-23T14:23:28.588 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-23T14:23:28.588 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-23T14:23:28.588 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-23T14:23:28.588 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-23T14:23:28.588 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-23T14:23:28.589 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-23T14:23:28.589 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-23T14:23:28.589 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-23T14:23:28.589 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-23T14:23:28.589 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-23T14:23:28.589 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-23T14:23:28.589 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-23T14:23:28.589 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-23T14:23:28.589 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-23T14:23:28.589 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-23T14:23:28.589 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-23T14:23:28.589 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-23T14:23:28.589 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-23T14:23:28.589 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-23T14:23:28.589 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-23T14:23:28.590 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-23T14:23:28.590 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-23T14:23:28.590 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-23T14:23:28.590 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-23T14:23:28.590 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-23T14:23:28.590 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-23T14:23:28.590 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-23T14:23:28.590 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-23T14:23:28.590 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-23T14:23:28.590 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-23T14:23:28.590 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-23T14:23:28.590 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-23T14:23:28.590 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-23T14:23:28.590 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-23T14:23:28.590 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-23T14:23:28.591 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-23T14:23:28.591 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-23T14:23:28.591 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-23T14:23:28.591 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-23T14:23:28.591 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-23T14:23:28.591 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-23T14:23:28.591 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-04-23T14:23:28.591 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-23T14:23:28.591 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-04-23T14:23:28.591 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-23T14:23:28.591 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-04-23T14:23:28.591 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-23T14:23:28.591 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-23T14:23:28.591 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-23T14:23:28.591 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-23T14:23:28.592 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-04-23T14:23:28.592 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-23T14:23:28.592 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-04-23T14:23:28.592 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-23T14:23:28.592 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-23T14:23:28.592 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-23T14:23:28.592 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-04-23T14:23:28.592 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-23T14:23:28.592 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-23T14:23:28.592 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-23T14:23:28.592 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-23T14:23:28.592 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-23T14:23:28.592 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-23T14:23:28.592 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-23T14:23:28.592 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-23T14:23:28.593 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-23T14:23:28.593 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-23T14:23:28.593 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-23T14:23:28.593 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-23T14:23:28.593 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-23T14:23:28.593 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-23T14:23:28.593 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-23T14:23:28.593 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-23T14:23:28.593 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-23T14:23:28.593 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-23T14:23:28.593 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-23T14:23:28.593 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-23T14:23:28.593 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-23T14:23:28.593 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-23T14:23:28.593 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-23T14:23:28.594 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-23T14:23:28.594 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-23T14:23:28.594 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-23T14:23:28.594 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-23T14:23:28.594 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-23T14:23:28.594 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-23T14:23:28.594 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-23T14:23:28.594 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-23T14:23:28.594 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-23T14:23:28.594 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-23T14:23:28.594 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-23T14:23:28.594 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-23T14:23:28.594 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-23T14:23:28.594 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-23T14:23:28.594 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-23T14:23:28.595 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-23T14:23:28.595 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-23T14:23:28.595 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-23T14:23:28.595 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-23T14:23:28.595 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-23T14:23:28.595 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-04-23T14:23:28.595 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-23T14:23:28.595 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-23T14:23:28.595 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-04-23T14:23:28.595 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-04-23T14:23:28.595 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-23T14:23:28.595 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-23T14:23:28.595 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-23T14:23:28.595 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-04-23T14:23:28.595 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-23T14:23:28.596 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-04-23T14:23:28.596 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-23T14:23:28.596 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-23T14:23:28.596 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-04-23T14:23:28.596 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-23T14:23:28.596 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-04-23T14:23:28.596 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-23T14:23:28.596 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-23T14:23:28.596 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-23T14:23:28.596 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-23T14:23:28.596 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-23T14:23:28.596 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-04-23T14:23:28.596 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-23T14:23:28.596 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-04-23T14:23:28.596 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-04-23T14:23:28.597 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-04-23T14:23:28.597 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-23T14:23:28.597 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-04-23T14:23:28.597 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-04-23T14:23:28.597 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-23T14:23:28.597 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-23T14:23:28.597 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-23T14:23:28.597 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-23T14:23:28.597 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-23T14:23:28.597 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-23T14:23:28.597 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-23T14:23:28.597 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-23T14:23:28.597 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-23T14:23:28.597 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-23T14:23:28.597 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-23T14:23:28.597 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-23T14:23:28.598 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-23T14:23:28.598 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-23T14:23:28.601 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-23T14:23:28.601 DEBUG:teuthology.orchestra.run.smithi081:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-23T14:23:28.623 INFO:teuthology.orchestra.run.smithi081.stdout:postinstall scriptlet (using /bin/sh): 2024-04-23T14:23:28.623 INFO:teuthology.orchestra.run.smithi081.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-23T14:23:28.623 INFO:teuthology.orchestra.run.smithi081.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-23T14:23:28.623 INFO:teuthology.orchestra.run.smithi081.stdout:fi 2024-04-23T14:23:28.623 INFO:teuthology.orchestra.run.smithi081.stdout:for file in vmlinuz System.map config; do 2024-04-23T14:23:28.624 INFO:teuthology.orchestra.run.smithi081.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-04-23T14:23:28.624 INFO:teuthology.orchestra.run.smithi081.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-04-23T14:23:28.624 INFO:teuthology.orchestra.run.smithi081.stdout: fi 2024-04-23T14:23:28.624 INFO:teuthology.orchestra.run.smithi081.stdout:done 2024-04-23T14:23:28.624 INFO:teuthology.orchestra.run.smithi081.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-04-23T14:23:28.624 INFO:teuthology.orchestra.run.smithi081.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-04-23T14:23:28.624 INFO:teuthology.orchestra.run.smithi081.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-23T14:23:28.624 INFO:teuthology.orchestra.run.smithi081.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-23T14:23:28.624 INFO:teuthology.orchestra.run.smithi081.stdout:fi 2024-04-23T14:23:28.624 INFO:teuthology.orchestra.run.smithi081.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-04-23T14:23:28.624 INFO:teuthology.orchestra.run.smithi081.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-04-23T14:23:28.624 INFO:teuthology.orchestra.run.smithi081.stdout:fi 2024-04-23T14:23:28.624 INFO:teuthology.orchestra.run.smithi081.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-23T14:23:28.624 INFO:teuthology.orchestra.run.smithi081.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-23T14:23:28.624 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-04-23T14:23:28.625 INFO:teuthology.orchestra.run.smithi081.stdout:fi 2024-04-23T14:23:28.625 DEBUG:teuthology.orchestra.run.smithi081:> sudo rpm -qi grub2-tools 2024-04-23T14:23:28.696 INFO:teuthology.orchestra.run.smithi081.stdout:Name : grub2-tools 2024-04-23T14:23:28.696 INFO:teuthology.orchestra.run.smithi081.stdout:Epoch : 1 2024-04-23T14:23:28.696 INFO:teuthology.orchestra.run.smithi081.stdout:Version : 2.06 2024-04-23T14:23:28.696 INFO:teuthology.orchestra.run.smithi081.stdout:Release : 68.el9 2024-04-23T14:23:28.696 INFO:teuthology.orchestra.run.smithi081.stdout:Architecture: x86_64 2024-04-23T14:23:28.696 INFO:teuthology.orchestra.run.smithi081.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-04-23T14:23:28.696 INFO:teuthology.orchestra.run.smithi081.stdout:Group : Unspecified 2024-04-23T14:23:28.696 INFO:teuthology.orchestra.run.smithi081.stdout:Size : 8264254 2024-04-23T14:23:28.697 INFO:teuthology.orchestra.run.smithi081.stdout:License : GPLv3+ 2024-04-23T14:23:28.697 INFO:teuthology.orchestra.run.smithi081.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-23T14:23:28.697 INFO:teuthology.orchestra.run.smithi081.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-23T14:23:28.697 INFO:teuthology.orchestra.run.smithi081.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-23T14:23:28.697 INFO:teuthology.orchestra.run.smithi081.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-23T14:23:28.697 INFO:teuthology.orchestra.run.smithi081.stdout:Packager : builder@centos.org 2024-04-23T14:23:28.697 INFO:teuthology.orchestra.run.smithi081.stdout:Vendor : CentOS 2024-04-23T14:23:28.697 INFO:teuthology.orchestra.run.smithi081.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-23T14:23:28.697 INFO:teuthology.orchestra.run.smithi081.stdout:Summary : Support tools for GRUB. 2024-04-23T14:23:28.697 INFO:teuthology.orchestra.run.smithi081.stdout:Description : 2024-04-23T14:23:28.697 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:23:28.697 INFO:teuthology.orchestra.run.smithi081.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-23T14:23:28.697 INFO:teuthology.orchestra.run.smithi081.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-23T14:23:28.697 INFO:teuthology.orchestra.run.smithi081.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-23T14:23:28.697 INFO:teuthology.orchestra.run.smithi081.stdout:hardware devices. 2024-04-23T14:23:28.698 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:23:28.698 INFO:teuthology.orchestra.run.smithi081.stdout:This subpackage provides tools for support of all platforms. 2024-04-23T14:23:28.698 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-23T14:23:28.699 INFO:teuthology.task.kernel:Updating grub on smithi081 to boot 6.9.0-rc3-g806ec36b2112 2024-04-23T14:23:28.699 DEBUG:teuthology.orchestra.run.smithi081:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-23T14:23:29.238 INFO:teuthology.orchestra.run.smithi081.stderr:Generating grub configuration file ... 2024-04-23T14:23:30.685 INFO:teuthology.orchestra.run.smithi081.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-23T14:23:30.714 INFO:teuthology.orchestra.run.smithi081.stderr:done 2024-04-23T14:23:30.716 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2024-04-23T14:23:30.731 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.PrIXX1GQC5 2024-04-23T14:23:30.731 DEBUG:teuthology.orchestra.run.smithi081:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.PrIXX1GQC5 2024-04-23T14:23:30.801 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.PrIXX1GQC5 2024-04-23T14:23:30.939 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.PrIXX1GQC5 is 6KB 2024-04-23T14:23:30.988 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.PrIXX1GQC5 2024-04-23T14:23:31.002 DEBUG:teuthology.orchestra.run.smithi081:> sudo /bin/ls /boot/loader/entries || true 2024-04-23T14:23:31.063 INFO:teuthology.orchestra.run.smithi081.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-04-23T14:23:31.063 INFO:teuthology.orchestra.run.smithi081.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-04-23T14:23:31.063 INFO:teuthology.orchestra.run.smithi081.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-04-23T14:23:31.064 INFO:teuthology.orchestra.run.smithi081.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-04-23T14:23:31.065 DEBUG:teuthology.orchestra.run.smithi081:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-04-23T14:23:31.216 DEBUG:teuthology.orchestra.run.smithi081:> sudo shutdown -r now 2024-04-23T14:23:37.702 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-04-23T14:23:37.703 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2024-04-23T14:23:37.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T14:23:56.191 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-04-23T14:24:01.222 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-04-23T14:24:01.223 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-04-23T14:24:01.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T14:24:05.194 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2024-04-23T14:24:05.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T14:24:08.254 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-04-23T14:24:19.746 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-04-23T14:24:20.256 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2024-04-23T14:24:20.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T14:24:28.754 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-04-23T14:24:28.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T14:24:31.806 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-04-23T14:24:38.686 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-04-23T14:24:43.810 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-04-23T14:24:43.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T14:24:53.694 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2024-04-23T14:24:53.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T14:25:01.401 DEBUG:teuthology.orchestra.run.smithi156:> true 2024-04-23T14:25:02.001 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2024-04-23T14:25:02.001 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "6.9.0-rc3-g806ec36b2112"... 2024-04-23T14:25:02.001 DEBUG:teuthology.orchestra.run.smithi156:> uname -r 2024-04-23T14:25:02.040 INFO:teuthology.orchestra.run.smithi156.stdout:6.9.0-rc3-g806ec36b2112 2024-04-23T14:25:02.041 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-23T14:25:02.041 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-23T14:25:02.041 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-23T14:25:03.042 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-04-23T14:25:03.042 DEBUG:teuthology.orchestra.run.smithi156:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-23T14:25:03.173 INFO:teuthology.orchestra.run.smithi156.stdout:ttyS1 2024-04-23T14:25:03.231 DEBUG:teuthology.parallel:result is None 2024-04-23T14:25:15.768 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-04-23T14:25:16.321 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-04-23T14:25:16.321 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "6.9.0-rc3-g806ec36b2112"... 2024-04-23T14:25:16.321 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-04-23T14:25:16.362 INFO:teuthology.orchestra.run.smithi081.stdout:6.9.0-rc3-g806ec36b2112 2024-04-23T14:25:16.362 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-23T14:25:16.362 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-23T14:25:16.362 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-23T14:25:17.363 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-04-23T14:25:17.364 DEBUG:teuthology.orchestra.run.smithi081:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-23T14:25:17.502 INFO:teuthology.orchestra.run.smithi081.stdout:ttyS1 2024-04-23T14:25:17.543 DEBUG:teuthology.parallel:result is None 2024-04-23T14:25:17.543 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-23T14:25:17.558 INFO:teuthology.task.internal:Creating test directory... 2024-04-23T14:25:17.559 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-23T14:25:17.566 DEBUG:teuthology.orchestra.run.smithi156:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-23T14:25:17.625 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-23T14:25:17.633 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-23T14:25:17.643 INFO:teuthology.task.internal:Creating archive directory... 2024-04-23T14:25:17.644 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-23T14:25:17.648 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-23T14:25:17.716 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-23T14:25:17.724 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-23T14:25:17.725 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-23T14:25:17.732 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-23T14:25:17.808 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T14:25:17.827 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T14:25:17.834 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T14:25:17.855 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T14:25:17.859 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-23T14:25:17.866 INFO:teuthology.task.internal:Configuring sudo... 2024-04-23T14:25:17.866 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-23T14:25:17.871 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-23T14:25:17.938 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-23T14:25:18.006 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-23T14:25:18.006 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-23T14:25:18.011 DEBUG:teuthology.orchestra.run.smithi156:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-23T14:25:18.061 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-23T14:25:18.136 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-23T14:25:18.216 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-23T14:25:18.285 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-23T14:25:18.352 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-23T14:25:18.352 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-23T14:25:18.444 DEBUG:teuthology.orchestra.run.smithi156:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-23T14:25:18.518 DEBUG:teuthology.orchestra.run.smithi156:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-23T14:25:18.614 DEBUG:teuthology.orchestra.run.smithi156:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-23T14:25:18.685 DEBUG:teuthology.orchestra.run.smithi156:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-23T14:25:18.767 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-04-23T14:25:18.767 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-23T14:25:18.830 DEBUG:teuthology.orchestra.run.smithi081:> sudo service rsyslog restart 2024-04-23T14:25:18.835 DEBUG:teuthology.orchestra.run.smithi156:> sudo service rsyslog restart 2024-04-23T14:25:18.919 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-23T14:25:19.270 INFO:teuthology.orchestra.run.smithi156.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-23T14:25:19.837 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-23T14:25:19.846 INFO:teuthology.task.internal:Starting timer... 2024-04-23T14:25:19.846 INFO:teuthology.run_tasks:Running task pcp... 2024-04-23T14:25:19.859 INFO:teuthology.run_tasks:Running task selinux... 2024-04-23T14:25:19.873 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-04-23T14:25:19.878 DEBUG:teuthology.orchestra.run.smithi081:> sudo service auditd rotate 2024-04-23T14:25:20.029 INFO:teuthology.orchestra.run.smithi081.stdout:Rotating logs: 2024-04-23T14:25:20.034 DEBUG:teuthology.orchestra.run.smithi156:> sudo service auditd rotate 2024-04-23T14:25:20.162 INFO:teuthology.orchestra.run.smithi156.stdout:Rotating logs: 2024-04-23T14:25:20.166 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-23T14:25:20.166 DEBUG:teuthology.orchestra.run.smithi081:> /usr/sbin/getenforce 2024-04-23T14:25:20.226 INFO:teuthology.orchestra.run.smithi081.stdout:Permissive 2024-04-23T14:25:20.226 DEBUG:teuthology.orchestra.run.smithi156:> /usr/sbin/getenforce 2024-04-23T14:25:20.283 INFO:teuthology.orchestra.run.smithi156.stdout:Permissive 2024-04-23T14:25:20.283 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi081.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi156.front.sepia.ceph.com': 'permissive'} 2024-04-23T14:25:20.283 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-23T14:25:20.360 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T14:25:20.361 DEBUG:teuthology.orchestra.run.smithi156:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-23T14:25:20.437 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T14:25:20.437 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-23T14:25:20.437 DEBUG:teuthology.orchestra.run.smithi081:> sudo /usr/sbin/setenforce permissive 2024-04-23T14:25:20.510 DEBUG:teuthology.orchestra.run.smithi156:> sudo /usr/sbin/setenforce permissive 2024-04-23T14:25:20.590 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-23T14:25:20.600 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-23T14:25:20.625 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-23T14:25:20.627 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi081.front.sepia.ceph.com,smithi156.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-23T14:30:40.825 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi081.front.sepia.ceph.com'), Remote(name='ubuntu@smithi156.front.sepia.ceph.com')] 2024-04-23T14:30:40.826 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-04-23T14:30:40.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T14:30:40.940 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-04-23T14:30:41.093 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-04-23T14:30:41.094 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2024-04-23T14:30:41.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T14:30:41.202 DEBUG:teuthology.orchestra.run.smithi156:> true 2024-04-23T14:30:41.355 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2024-04-23T14:30:41.355 INFO:teuthology.run_tasks:Running task clock... 2024-04-23T14:30:41.370 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-23T14:30:41.370 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-23T14:30:41.371 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T14:30:41.378 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-23T14:30:41.378 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T14:30:41.463 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-23T14:30:41.471 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-23T14:30:41.505 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-23T14:30:41.511 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-23T14:30:41.577 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: ntpd: command not found 2024-04-23T14:30:41.579 INFO:teuthology.orchestra.run.smithi156.stderr:sudo: ntpd: command not found 2024-04-23T14:30:41.609 INFO:teuthology.orchestra.run.smithi081.stdout:506 Cannot talk to daemon 2024-04-23T14:30:41.610 INFO:teuthology.orchestra.run.smithi156.stdout:506 Cannot talk to daemon 2024-04-23T14:30:41.649 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-23T14:30:41.651 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-23T14:30:41.689 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-23T14:30:41.692 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-23T14:30:41.809 INFO:teuthology.orchestra.run.smithi156.stderr:bash: line 1: ntpq: command not found 2024-04-23T14:30:41.818 INFO:teuthology.orchestra.run.smithi156.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-23T14:30:41.818 INFO:teuthology.orchestra.run.smithi156.stdout:=============================================================================== 2024-04-23T14:30:41.818 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T14:30:41.818 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T14:30:41.818 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T14:30:41.818 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T14:30:41.820 INFO:teuthology.orchestra.run.smithi081.stderr:bash: line 1: ntpq: command not found 2024-04-23T14:30:41.828 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-23T14:30:41.828 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2024-04-23T14:30:41.828 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T14:30:41.828 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T14:30:41.828 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T14:30:41.828 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T14:30:41.829 INFO:teuthology.run_tasks:Running task install... 2024-04-23T14:30:41.838 DEBUG:teuthology.task.install:project ceph 2024-04-23T14:30:41.838 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd44fddd910b5e94da0f2357af4be37d7bd495ae0'}} 2024-04-23T14:30:41.838 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': 'd44fddd910b5e94da0f2357af4be37d7bd495ae0'} 2024-04-23T14:30:41.838 INFO:teuthology.task.install:Using flavor: default 2024-04-23T14:30:41.844 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-23T14:30:41.844 INFO:teuthology.task.install:extra packages: [] 2024-04-23T14:30:41.844 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd44fddd910b5e94da0f2357af4be37d7bd495ae0', 'tag': None, 'wait_for_package': False} 2024-04-23T14:30:41.844 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-23T14:30:41.844 INFO:teuthology.packaging:ref: None 2024-04-23T14:30:41.845 INFO:teuthology.packaging:tag: None 2024-04-23T14:30:41.845 INFO:teuthology.packaging:branch: quincy 2024-04-23T14:30:41.845 INFO:teuthology.packaging:sha1: d44fddd910b5e94da0f2357af4be37d7bd495ae0 2024-04-23T14:30:41.845 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-04-23T14:30:41.847 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd44fddd910b5e94da0f2357af4be37d7bd495ae0', 'tag': None, 'wait_for_package': False} 2024-04-23T14:30:41.847 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-23T14:30:41.847 INFO:teuthology.packaging:ref: None 2024-04-23T14:30:41.847 INFO:teuthology.packaging:tag: None 2024-04-23T14:30:41.847 INFO:teuthology.packaging:branch: quincy 2024-04-23T14:30:41.847 INFO:teuthology.packaging:sha1: d44fddd910b5e94da0f2357af4be37d7bd495ae0 2024-04-23T14:30:41.847 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-04-23T14:30:42.066 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/quincy/70d0cb4b9d576828afb0a05dcf8732894d343ece/centos/9/flavors/default/ 2024-04-23T14:30:42.067 INFO:teuthology.task.install.rpm:Package version is 17.2.7-884.g70d0cb4b 2024-04-23T14:30:42.247 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/quincy/70d0cb4b9d576828afb0a05dcf8732894d343ece/centos/9/flavors/default/ 2024-04-23T14:30:42.248 INFO:teuthology.task.install.rpm:Package version is 17.2.7-884.g70d0cb4b 2024-04-23T14:30:42.288 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/quincy/70d0cb4b9d576828afb0a05dcf8732894d343ece/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/70d0cb4b9d576828afb0a05dcf8732894d343ece/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/70d0cb4b9d576828afb0a05dcf8732894d343ece/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-23T14:30:42.288 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-23T14:30:42.289 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-23T14:30:42.358 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/quincy/70d0cb4b9d576828afb0a05dcf8732894d343ece/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/70d0cb4b9d576828afb0a05dcf8732894d343ece/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/70d0cb4b9d576828afb0a05dcf8732894d343ece/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-23T14:30:42.358 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-04-23T14:30:42.358 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-23T14:30:42.378 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-23T14:30:42.378 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-23T14:30:42.378 INFO:teuthology.packaging:ref: None 2024-04-23T14:30:42.378 INFO:teuthology.packaging:tag: None 2024-04-23T14:30:42.378 INFO:teuthology.packaging:branch: quincy 2024-04-23T14:30:42.379 INFO:teuthology.packaging:sha1: d44fddd910b5e94da0f2357af4be37d7bd495ae0 2024-04-23T14:30:42.379 DEBUG:teuthology.orchestra.run.smithi081:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-23T14:30:42.450 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-23T14:30:42.450 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-23T14:30:42.450 INFO:teuthology.packaging:ref: None 2024-04-23T14:30:42.450 INFO:teuthology.packaging:tag: None 2024-04-23T14:30:42.450 INFO:teuthology.packaging:branch: quincy 2024-04-23T14:30:42.451 INFO:teuthology.packaging:sha1: d44fddd910b5e94da0f2357af4be37d7bd495ae0 2024-04-23T14:30:42.451 DEBUG:teuthology.orchestra.run.smithi156:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-23T14:30:42.505 DEBUG:teuthology.orchestra.run.smithi081:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-23T14:30:42.578 DEBUG:teuthology.orchestra.run.smithi156:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-23T14:30:42.615 DEBUG:teuthology.orchestra.run.smithi081:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-23T14:30:42.691 INFO:teuthology.orchestra.run.smithi081.stdout:check_obsoletes = 1 2024-04-23T14:30:42.693 DEBUG:teuthology.orchestra.run.smithi156:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-23T14:30:42.694 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum clean all 2024-04-23T14:30:42.771 INFO:teuthology.orchestra.run.smithi156.stdout:check_obsoletes = 1 2024-04-23T14:30:42.775 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum clean all 2024-04-23T14:30:43.016 INFO:teuthology.orchestra.run.smithi081.stdout:48 files removed 2024-04-23T14:30:43.058 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-radosgw 2024-04-23T14:30:43.097 INFO:teuthology.orchestra.run.smithi156.stdout:48 files removed 2024-04-23T14:30:43.135 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-radosgw 2024-04-23T14:30:44.010 INFO:teuthology.orchestra.run.smithi156.stdout:ceph packages for x86_64 177 kB/s | 77 kB 00:00 2024-04-23T14:30:44.065 INFO:teuthology.orchestra.run.smithi081.stdout:ceph packages for x86_64 135 kB/s | 77 kB 00:00 2024-04-23T14:30:44.519 INFO:teuthology.orchestra.run.smithi156.stdout:ceph noarch packages 26 kB/s | 11 kB 00:00 2024-04-23T14:30:44.666 INFO:teuthology.orchestra.run.smithi081.stdout:ceph noarch packages 21 kB/s | 11 kB 00:00 2024-04-23T14:30:45.135 INFO:teuthology.orchestra.run.smithi156.stdout:ceph source packages 3.4 kB/s | 1.8 kB 00:00 2024-04-23T14:30:45.233 INFO:teuthology.orchestra.run.smithi081.stdout:ceph source packages 3.7 kB/s | 1.8 kB 00:00 2024-04-23T14:30:46.102 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - BaseOS 9.1 MB/s | 8.0 MB 00:00 2024-04-23T14:30:47.565 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - BaseOS 3.6 MB/s | 8.0 MB 00:02 2024-04-23T14:30:48.136 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-04-23T14:30:55.286 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - CRB 2.0 MB/s | 6.2 MB 00:03 2024-04-23T14:30:57.516 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 16 kB 00:00 2024-04-23T14:30:59.589 INFO:teuthology.orchestra.run.smithi156.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-04-23T14:31:05.505 INFO:teuthology.orchestra.run.smithi156.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-04-23T14:31:07.891 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2024-04-23T14:31:07.906 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:31:07.906 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2024-04-23T14:31:07.906 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:31:07.906 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2024-04-23T14:31:07.906 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-radosgw x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 14 M 2024-04-23T14:31:07.907 INFO:teuthology.orchestra.run.smithi156.stdout:Upgrading: 2024-04-23T14:31:07.907 INFO:teuthology.orchestra.run.smithi156.stdout: librados2 x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 3.1 M 2024-04-23T14:31:07.907 INFO:teuthology.orchestra.run.smithi156.stdout: librbd1 x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 2.9 M 2024-04-23T14:31:07.907 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2024-04-23T14:31:07.907 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-base x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 5.0 M 2024-04-23T14:31:07.907 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-common x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 22 M 2024-04-23T14:31:07.907 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-selinux x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 25 k 2024-04-23T14:31:07.907 INFO:teuthology.orchestra.run.smithi156.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-23T14:31:07.907 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs2 x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 638 k 2024-04-23T14:31:07.907 INFO:teuthology.orchestra.run.smithi156.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-23T14:31:07.907 INFO:teuthology.orchestra.run.smithi156.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-23T14:31:07.908 INFO:teuthology.orchestra.run.smithi156.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-23T14:31:07.908 INFO:teuthology.orchestra.run.smithi156.stdout: libradosstriper1 x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 457 k 2024-04-23T14:31:07.908 INFO:teuthology.orchestra.run.smithi156.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-23T14:31:07.908 INFO:teuthology.orchestra.run.smithi156.stdout: librgw2 x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 4.9 M 2024-04-23T14:31:07.908 INFO:teuthology.orchestra.run.smithi156.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-23T14:31:07.908 INFO:teuthology.orchestra.run.smithi156.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-23T14:31:07.908 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-argparse x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 45 k 2024-04-23T14:31:07.908 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-common x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 118 k 2024-04-23T14:31:07.908 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cephfs x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 156 k 2024-04-23T14:31:07.908 INFO:teuthology.orchestra.run.smithi156.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-23T14:31:07.908 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rados x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 320 k 2024-04-23T14:31:07.908 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rbd x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 293 k 2024-04-23T14:31:07.909 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rgw x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 99 k 2024-04-23T14:31:07.909 INFO:teuthology.orchestra.run.smithi156.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-23T14:31:07.909 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:31:07.909 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2024-04-23T14:31:07.909 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:31:07.909 INFO:teuthology.orchestra.run.smithi156.stdout:Install 22 Packages 2024-04-23T14:31:07.909 INFO:teuthology.orchestra.run.smithi156.stdout:Upgrade 2 Packages 2024-04-23T14:31:07.909 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:31:07.910 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 58 M 2024-04-23T14:31:07.910 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2024-04-23T14:31:10.065 INFO:teuthology.orchestra.run.smithi156.stdout:(1/24): ceph-common-17.2.7-884.g70d0cb4b.el7.x8 15 MB/s | 22 MB 00:01 2024-04-23T14:31:10.115 INFO:teuthology.orchestra.run.smithi156.stdout:(2/24): ceph-selinux-17.2.7-884.g70d0cb4b.el7.x 516 kB/s | 25 kB 00:00 2024-04-23T14:31:10.207 INFO:teuthology.orchestra.run.smithi156.stdout:(3/24): libcephfs2-17.2.7-884.g70d0cb4b.el7.x86 6.9 MB/s | 638 kB 00:00 2024-04-23T14:31:10.291 INFO:teuthology.orchestra.run.smithi156.stdout:(4/24): libradosstriper1-17.2.7-884.g70d0cb4b.e 5.4 MB/s | 457 kB 00:00 2024-04-23T14:31:10.608 INFO:teuthology.orchestra.run.smithi156.stdout:(5/24): librgw2-17.2.7-884.g70d0cb4b.el7.x86_64 16 MB/s | 4.9 MB 00:00 2024-04-23T14:31:10.675 INFO:teuthology.orchestra.run.smithi156.stdout:(6/24): python3-ceph-argparse-17.2.7-884.g70d0c 684 kB/s | 45 kB 00:00 2024-04-23T14:31:10.733 INFO:teuthology.orchestra.run.smithi156.stdout:(7/24): python3-ceph-common-17.2.7-884.g70d0cb4 2.0 MB/s | 118 kB 00:00 2024-04-23T14:31:10.783 INFO:teuthology.orchestra.run.smithi156.stdout:(8/24): python3-cephfs-17.2.7-884.g70d0cb4b.el7 3.1 MB/s | 156 kB 00:00 2024-04-23T14:31:10.842 INFO:teuthology.orchestra.run.smithi156.stdout:(9/24): python3-rados-17.2.7-884.g70d0cb4b.el7. 5.4 MB/s | 320 kB 00:00 2024-04-23T14:31:10.926 INFO:teuthology.orchestra.run.smithi156.stdout:(10/24): python3-rbd-17.2.7-884.g70d0cb4b.el7.x 3.5 MB/s | 293 kB 00:00 2024-04-23T14:31:10.976 INFO:teuthology.orchestra.run.smithi156.stdout:(11/24): python3-rgw-17.2.7-884.g70d0cb4b.el7.x 2.0 MB/s | 99 kB 00:00 2024-04-23T14:31:11.518 INFO:teuthology.orchestra.run.smithi156.stdout:(12/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 297 kB/s | 160 kB 00:00 2024-04-23T14:31:11.626 INFO:teuthology.orchestra.run.smithi156.stdout:(13/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 420 kB/s | 45 kB 00:00 2024-04-23T14:31:11.868 INFO:teuthology.orchestra.run.smithi156.stdout:(14/24): ceph-radosgw-17.2.7-884.g70d0cb4b.el7. 4.2 MB/s | 14 MB 00:03 2024-04-23T14:31:12.135 INFO:teuthology.orchestra.run.smithi156.stdout:(15/24): librdkafka-1.6.1-102.el9.x86_64.rpm 1.3 MB/s | 662 kB 00:00 2024-04-23T14:31:12.147 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - AppStream 833 kB/s | 19 MB 00:23 2024-04-23T14:31:12.252 INFO:teuthology.orchestra.run.smithi156.stdout:(16/24): python3-prettytable-0.7.2-27.el9.noarc 365 kB/s | 42 kB 00:00 2024-04-23T14:31:12.486 INFO:teuthology.orchestra.run.smithi156.stdout:(17/24): ceph-base-17.2.7-884.g70d0cb4b.el7.x86 1.3 MB/s | 5.0 MB 00:03 2024-04-23T14:31:12.519 INFO:teuthology.orchestra.run.smithi156.stdout:(18/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 450 kB/s | 292 kB 00:00 2024-04-23T14:31:12.619 INFO:teuthology.orchestra.run.smithi156.stdout:(19/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 843 kB/s | 309 kB 00:00 2024-04-23T14:31:12.637 INFO:teuthology.orchestra.run.smithi156.stdout:(20/24): liboath-2.6.7-2.el9.x86_64.rpm 324 kB/s | 49 kB 00:00 2024-04-23T14:31:12.662 INFO:teuthology.orchestra.run.smithi156.stdout:(21/24): libunwind-1.6.2-1.el9.x86_64.rpm 474 kB/s | 67 kB 00:00 2024-04-23T14:31:12.762 INFO:teuthology.orchestra.run.smithi156.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-04-23T14:31:13.037 INFO:teuthology.orchestra.run.smithi156.stdout:(23/24): librbd1-17.2.7-884.g70d0cb4b.el7.x86_6 7.9 MB/s | 2.9 MB 00:00 2024-04-23T14:31:14.162 INFO:teuthology.orchestra.run.smithi156.stdout:(24/24): librados2-17.2.7-884.g70d0cb4b.el7.x86 2.1 MB/s | 3.1 MB 00:01 2024-04-23T14:31:14.169 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2024-04-23T14:31:14.170 INFO:teuthology.orchestra.run.smithi156.stdout:Total 9.2 MB/s | 58 MB 00:06 2024-04-23T14:31:14.361 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2024-04-23T14:31:14.451 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2024-04-23T14:31:14.451 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2024-04-23T14:31:15.384 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2024-04-23T14:31:15.385 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2024-04-23T14:31:16.523 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-04-23T14:31:16.810 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2024-04-23T14:31:17.221 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-04-23T14:31:17.323 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : librados2-2:17.2.7-884.g70d0cb4b.el7.x86_64 2/26 2024-04-23T14:31:17.455 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librados2-2:17.2.7-884.g70d0cb4b.el7.x86_64 2/26 2024-04-23T14:31:17.555 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rados-2:17.2.7-884.g70d0cb4b.el7.x86_64 3/26 2024-04-23T14:31:17.591 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcephfs2-2:17.2.7-884.g70d0cb4b.el7.x86_64 4/26 2024-04-23T14:31:17.736 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libcephfs2-2:17.2.7-884.g70d0cb4b.el7.x86_64 4/26 2024-04-23T14:31:17.812 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-04-23T14:31:17.857 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-04-23T14:31:18.402 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-04-23T14:31:18.444 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librgw2-2:17.2.7-884.g70d0cb4b.el7.x86_64 8/26 2024-04-23T14:31:18.527 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librgw2-2:17.2.7-884.g70d0cb4b.el7.x86_64 8/26 2024-04-23T14:31:18.568 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-04-23T14:31:18.645 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-ceph-argparse-2:17.2.7-884.g70d0cb4b.el7.x 10/26 2024-04-23T14:31:18.702 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cephfs-2:17.2.7-884.g70d0cb4b.el7.x86_64 11/26 2024-04-23T14:31:18.829 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rgw-2:17.2.7-884.g70d0cb4b.el7.x86_64 12/26 2024-04-23T14:31:18.872 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libradosstriper1-2:17.2.7-884.g70d0cb4b.el7.x86_64 13/26 2024-04-23T14:31:18.976 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libradosstriper1-2:17.2.7-884.g70d0cb4b.el7.x86_64 13/26 2024-04-23T14:31:19.048 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - Extras packages 13 kB/s | 16 kB 00:01 2024-04-23T14:31:19.055 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-04-23T14:31:19.110 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-04-23T14:31:19.160 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-04-23T14:31:19.565 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-04-23T14:31:19.601 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : librbd1-2:17.2.7-884.g70d0cb4b.el7.x86_64 18/26 2024-04-23T14:31:19.774 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librbd1-2:17.2.7-884.g70d0cb4b.el7.x86_64 18/26 2024-04-23T14:31:19.872 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rbd-2:17.2.7-884.g70d0cb4b.el7.x86_64 19/26 2024-04-23T14:31:19.903 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-ceph-common-2:17.2.7-884.g70d0cb4b.el7.x86 20/26 2024-04-23T14:31:20.726 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-04-23T14:31:23.010 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-common-2:17.2.7-884.g70d0cb4b.el7.x86_64 21/26 2024-04-23T14:31:23.060 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-common-2:17.2.7-884.g70d0cb4b.el7.x86_64 21/26 2024-04-23T14:31:23.724 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-common-2:17.2.7-884.g70d0cb4b.el7.x86_64 21/26 2024-04-23T14:31:23.774 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-base-2:17.2.7-884.g70d0cb4b.el7.x86_64 22/26 2024-04-23T14:31:23.964 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-base-2:17.2.7-884.g70d0cb4b.el7.x86_64 22/26 2024-04-23T14:31:23.964 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-23T14:31:23.964 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-23T14:31:23.964 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:31:24.016 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-selinux-2:17.2.7-884.g70d0cb4b.el7.x86_64 23/26 2024-04-23T14:31:26.686 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 17 kB/s | 1.7 kB 00:00 2024-04-23T14:31:29.121 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-04-23T14:31:29.146 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:31:29.146 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-04-23T14:31:29.146 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:31:29.147 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-04-23T14:31:29.147 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 14 M 2024-04-23T14:31:29.147 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrading: 2024-04-23T14:31:29.147 INFO:teuthology.orchestra.run.smithi081.stdout: librados2 x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 3.1 M 2024-04-23T14:31:29.147 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1 x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 2.9 M 2024-04-23T14:31:29.147 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-04-23T14:31:29.147 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 5.0 M 2024-04-23T14:31:29.147 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 22 M 2024-04-23T14:31:29.147 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 25 k 2024-04-23T14:31:29.147 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-23T14:31:29.147 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2 x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 638 k 2024-04-23T14:31:29.147 INFO:teuthology.orchestra.run.smithi081.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-23T14:31:29.148 INFO:teuthology.orchestra.run.smithi081.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-23T14:31:29.148 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-23T14:31:29.148 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1 x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 457 k 2024-04-23T14:31:29.148 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-23T14:31:29.148 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2 x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 4.9 M 2024-04-23T14:31:29.148 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-23T14:31:29.148 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-23T14:31:29.148 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 45 k 2024-04-23T14:31:29.148 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 118 k 2024-04-23T14:31:29.148 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 156 k 2024-04-23T14:31:29.148 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-23T14:31:29.148 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 320 k 2024-04-23T14:31:29.148 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 293 k 2024-04-23T14:31:29.149 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 99 k 2024-04-23T14:31:29.149 INFO:teuthology.orchestra.run.smithi081.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-23T14:31:29.149 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:31:29.149 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-04-23T14:31:29.149 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:31:29.149 INFO:teuthology.orchestra.run.smithi081.stdout:Install 22 Packages 2024-04-23T14:31:29.149 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrade 2 Packages 2024-04-23T14:31:29.149 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:31:29.149 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 58 M 2024-04-23T14:31:29.149 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-04-23T14:31:30.611 INFO:teuthology.orchestra.run.smithi081.stdout:(1/24): ceph-base-17.2.7-884.g70d0cb4b.el7.x86_ 4.9 MB/s | 5.0 MB 00:01 2024-04-23T14:31:30.661 INFO:teuthology.orchestra.run.smithi081.stdout:(2/24): ceph-selinux-17.2.7-884.g70d0cb4b.el7.x 513 kB/s | 25 kB 00:00 2024-04-23T14:31:30.761 INFO:teuthology.orchestra.run.smithi081.stdout:(3/24): libcephfs2-17.2.7-884.g70d0cb4b.el7.x86 6.3 MB/s | 638 kB 00:00 2024-04-23T14:31:30.862 INFO:teuthology.orchestra.run.smithi081.stdout:(4/24): libradosstriper1-17.2.7-884.g70d0cb4b.e 4.5 MB/s | 457 kB 00:00 2024-04-23T14:31:31.454 INFO:teuthology.orchestra.run.smithi081.stdout:(5/24): librgw2-17.2.7-884.g70d0cb4b.el7.x86_64 8.3 MB/s | 4.9 MB 00:00 2024-04-23T14:31:31.512 INFO:teuthology.orchestra.run.smithi081.stdout:(6/24): python3-ceph-argparse-17.2.7-884.g70d0c 784 kB/s | 45 kB 00:00 2024-04-23T14:31:31.587 INFO:teuthology.orchestra.run.smithi081.stdout:(7/24): python3-ceph-common-17.2.7-884.g70d0cb4 1.5 MB/s | 118 kB 00:00 2024-04-23T14:31:31.896 INFO:teuthology.orchestra.run.smithi081.stdout:(8/24): ceph-common-17.2.7-884.g70d0cb4b.el7.x8 9.8 MB/s | 22 MB 00:02 2024-04-23T14:31:31.929 INFO:teuthology.orchestra.run.smithi081.stdout:(9/24): python3-cephfs-17.2.7-884.g70d0cb4b.el7 457 kB/s | 156 kB 00:00 2024-04-23T14:31:31.971 INFO:teuthology.orchestra.run.smithi081.stdout:(10/24): python3-rados-17.2.7-884.g70d0cb4b.el7 4.2 MB/s | 320 kB 00:00 2024-04-23T14:31:32.013 INFO:teuthology.orchestra.run.smithi081.stdout:(11/24): python3-rbd-17.2.7-884.g70d0cb4b.el7.x 3.5 MB/s | 293 kB 00:00 2024-04-23T14:31:32.038 INFO:teuthology.orchestra.run.smithi081.stdout:(12/24): python3-rgw-17.2.7-884.g70d0cb4b.el7.x 1.5 MB/s | 99 kB 00:00 2024-04-23T14:31:32.764 INFO:teuthology.orchestra.run.smithi081.stdout:(13/24): ceph-radosgw-17.2.7-884.g70d0cb4b.el7. 4.4 MB/s | 14 MB 00:03 2024-04-23T14:31:32.797 INFO:teuthology.orchestra.run.smithi081.stdout:(14/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 60 kB/s | 45 kB 00:00 2024-04-23T14:31:32.973 INFO:teuthology.orchestra.run.smithi081.stdout:(15/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 167 kB/s | 160 kB 00:00 2024-04-23T14:31:33.765 INFO:teuthology.orchestra.run.smithi081.stdout:(16/24): python3-prettytable-0.7.2-27.el9.noarc 53 kB/s | 42 kB 00:00 2024-04-23T14:31:33.998 INFO:teuthology.orchestra.run.smithi081.stdout:(17/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 244 kB/s | 292 kB 00:01 2024-04-23T14:31:34.348 INFO:teuthology.orchestra.run.smithi081.stdout:(18/24): liboath-2.6.7-2.el9.x86_64.rpm 139 kB/s | 49 kB 00:00 2024-04-23T14:31:34.390 INFO:teuthology.orchestra.run.smithi081.stdout:(19/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 495 kB/s | 309 kB 00:00 2024-04-23T14:31:34.491 INFO:teuthology.orchestra.run.smithi081.stdout:(20/24): librdkafka-1.6.1-102.el9.x86_64.rpm 384 kB/s | 662 kB 00:01 2024-04-23T14:31:34.789 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-selinux-2:17.2.7-884.g70d0cb4b.el7.x86_64 23/26 2024-04-23T14:31:34.789 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /sys 2024-04-23T14:31:34.789 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /proc 2024-04-23T14:31:34.790 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /mnt 2024-04-23T14:31:34.790 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /var/tmp 2024-04-23T14:31:34.790 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /home 2024-04-23T14:31:34.790 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /root 2024-04-23T14:31:34.790 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /tmp 2024-04-23T14:31:34.790 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:31:34.800 INFO:teuthology.orchestra.run.smithi081.stdout:(21/24): librados2-17.2.7-884.g70d0cb4b.el7.x86 10 MB/s | 3.1 MB 00:00 2024-04-23T14:31:34.816 INFO:teuthology.orchestra.run.smithi081.stdout:(22/24): libunwind-1.6.2-1.el9.x86_64.rpm 144 kB/s | 67 kB 00:00 2024-04-23T14:31:34.991 INFO:teuthology.orchestra.run.smithi081.stdout:(23/24): librbd1-17.2.7-884.g70d0cb4b.el7.x86_6 15 MB/s | 2.9 MB 00:00 2024-04-23T14:31:35.642 INFO:teuthology.orchestra.run.smithi081.stdout:(24/24): thrift-0.15.0-2.el9.x86_64.rpm 1.3 MB/s | 1.6 MB 00:01 2024-04-23T14:31:35.647 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-04-23T14:31:35.647 INFO:teuthology.orchestra.run.smithi081.stdout:Total 8.9 MB/s | 58 MB 00:06 2024-04-23T14:31:35.846 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-04-23T14:31:35.938 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-04-23T14:31:35.939 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-04-23T14:31:36.193 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-radosgw-2:17.2.7-884.g70d0cb4b.el7.x86_64 24/26 2024-04-23T14:31:36.329 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-884.g70d0cb4b.el7.x86_64 24/26 2024-04-23T14:31:36.329 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:31:36.329 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-23T14:31:36.329 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-23T14:31:36.329 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-23T14:31:36.329 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:31:36.335 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-04-23T14:31:36.448 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-04-23T14:31:36.448 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-04-23T14:31:36.834 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-04-23T14:31:36.835 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-04-23T14:31:38.231 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-04-23T14:31:38.231 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-base-2:17.2.7-884.g70d0cb4b.el7.x86_64 1/26 2024-04-23T14:31:38.231 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-common-2:17.2.7-884.g70d0cb4b.el7.x86_64 2/26 2024-04-23T14:31:38.231 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-radosgw-2:17.2.7-884.g70d0cb4b.el7.x86_64 3/26 2024-04-23T14:31:38.231 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-selinux-2:17.2.7-884.g70d0cb4b.el7.x86_64 4/26 2024-04-23T14:31:38.231 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephfs2-2:17.2.7-884.g70d0cb4b.el7.x86_64 5/26 2024-04-23T14:31:38.231 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libradosstriper1-2:17.2.7-884.g70d0cb4b.el7.x86_64 6/26 2024-04-23T14:31:38.231 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librgw2-2:17.2.7-884.g70d0cb4b.el7.x86_64 7/26 2024-04-23T14:31:38.231 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-ceph-argparse-2:17.2.7-884.g70d0cb4b.el7.x 8/26 2024-04-23T14:31:38.231 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-ceph-common-2:17.2.7-884.g70d0cb4b.el7.x86 9/26 2024-04-23T14:31:38.232 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cephfs-2:17.2.7-884.g70d0cb4b.el7.x86_64 10/26 2024-04-23T14:31:38.232 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rados-2:17.2.7-884.g70d0cb4b.el7.x86_64 11/26 2024-04-23T14:31:38.232 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rbd-2:17.2.7-884.g70d0cb4b.el7.x86_64 12/26 2024-04-23T14:31:38.232 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rgw-2:17.2.7-884.g70d0cb4b.el7.x86_64 13/26 2024-04-23T14:31:38.232 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-04-23T14:31:38.232 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-04-23T14:31:38.232 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-04-23T14:31:38.232 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-04-23T14:31:38.232 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-04-23T14:31:38.232 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-04-23T14:31:38.232 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-04-23T14:31:38.232 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-04-23T14:31:38.232 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-04-23T14:31:38.232 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados2-2:17.2.7-884.g70d0cb4b.el7.x86_64 23/26 2024-04-23T14:31:38.233 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-04-23T14:31:38.233 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librbd1-2:17.2.7-884.g70d0cb4b.el7.x86_64 25/26 2024-04-23T14:31:38.345 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-04-23T14:31:38.780 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-04-23T14:31:38.919 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librados2-2:17.2.7-884.g70d0cb4b.el7.x86_64 2/26 2024-04-23T14:31:38.973 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-04-23T14:31:38.974 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:31:38.974 INFO:teuthology.orchestra.run.smithi156.stdout:Upgraded: 2024-04-23T14:31:38.974 INFO:teuthology.orchestra.run.smithi156.stdout: librados2-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:31:38.974 INFO:teuthology.orchestra.run.smithi156.stdout: librbd1-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:31:38.974 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2024-04-23T14:31:38.974 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-base-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:31:38.974 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-common-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:31:38.974 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-radosgw-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:31:38.974 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-selinux-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:31:38.974 INFO:teuthology.orchestra.run.smithi156.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-23T14:31:38.974 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs2-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:31:38.975 INFO:teuthology.orchestra.run.smithi156.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-23T14:31:38.975 INFO:teuthology.orchestra.run.smithi156.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-23T14:31:38.975 INFO:teuthology.orchestra.run.smithi156.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-23T14:31:38.975 INFO:teuthology.orchestra.run.smithi156.stdout: libradosstriper1-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:31:38.975 INFO:teuthology.orchestra.run.smithi156.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-23T14:31:38.975 INFO:teuthology.orchestra.run.smithi156.stdout: librgw2-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:31:38.975 INFO:teuthology.orchestra.run.smithi156.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-23T14:31:38.975 INFO:teuthology.orchestra.run.smithi156.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-23T14:31:38.975 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-argparse-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:31:38.975 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-common-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:31:38.975 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cephfs-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:31:38.975 INFO:teuthology.orchestra.run.smithi156.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-23T14:31:38.976 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rados-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:31:38.976 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rbd-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:31:38.976 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rgw-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:31:38.976 INFO:teuthology.orchestra.run.smithi156.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-23T14:31:38.976 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:31:38.976 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2024-04-23T14:31:39.047 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:17.2.7-884.g70d0cb4b.el7.x86_64 2/26 2024-04-23T14:31:39.163 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rados-2:17.2.7-884.g70d0cb4b.el7.x86_64 3/26 2024-04-23T14:31:39.220 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs2-2:17.2.7-884.g70d0cb4b.el7.x86_64 4/26 2024-04-23T14:31:39.365 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephfs2-2:17.2.7-884.g70d0cb4b.el7.x86_64 4/26 2024-04-23T14:31:39.399 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-test 2024-04-23T14:31:39.431 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-04-23T14:31:39.470 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-04-23T14:31:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-04-23T14:31:40.048 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librgw2-2:17.2.7-884.g70d0cb4b.el7.x86_64 8/26 2024-04-23T14:31:40.132 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librgw2-2:17.2.7-884.g70d0cb4b.el7.x86_64 8/26 2024-04-23T14:31:40.154 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:00:35 ago on Tue 23 Apr 2024 02:31:05 PM UTC. 2024-04-23T14:31:40.172 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-04-23T14:31:40.240 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-argparse-2:17.2.7-884.g70d0cb4b.el7.x 10/26 2024-04-23T14:31:40.287 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2024-04-23T14:31:40.287 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:31:40.288 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2024-04-23T14:31:40.288 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:31:40.288 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2024-04-23T14:31:40.288 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-test x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 48 M 2024-04-23T14:31:40.288 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2024-04-23T14:31:40.288 INFO:teuthology.orchestra.run.smithi156.stdout: libcephsqlite x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 163 k 2024-04-23T14:31:40.288 INFO:teuthology.orchestra.run.smithi156.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-23T14:31:40.288 INFO:teuthology.orchestra.run.smithi156.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-23T14:31:40.288 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:31:40.288 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2024-04-23T14:31:40.288 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:31:40.288 INFO:teuthology.orchestra.run.smithi156.stdout:Install 4 Packages 2024-04-23T14:31:40.288 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:31:40.289 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 48 M 2024-04-23T14:31:40.289 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 192 M 2024-04-23T14:31:40.289 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2024-04-23T14:31:40.293 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cephfs-2:17.2.7-884.g70d0cb4b.el7.x86_64 11/26 2024-04-23T14:31:40.411 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rgw-2:17.2.7-884.g70d0cb4b.el7.x86_64 12/26 2024-04-23T14:31:40.443 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libradosstriper1-2:17.2.7-884.g70d0cb4b.el7.x86_64 13/26 2024-04-23T14:31:40.547 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libradosstriper1-2:17.2.7-884.g70d0cb4b.el7.x86_64 13/26 2024-04-23T14:31:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-04-23T14:31:40.657 INFO:teuthology.orchestra.run.smithi156.stdout:(1/4): socat-1.7.4.1-5.el9.x86_64.rpm 1.0 MB/s | 305 kB 00:00 2024-04-23T14:31:40.680 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-04-23T14:31:40.731 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-04-23T14:31:40.740 INFO:teuthology.orchestra.run.smithi156.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 778 kB/s | 64 kB 00:00 2024-04-23T14:31:40.790 INFO:teuthology.orchestra.run.smithi156.stdout:(3/4): libcephsqlite-17.2.7-884.g70d0cb4b.el7.x 380 kB/s | 163 kB 00:00 2024-04-23T14:31:41.134 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-04-23T14:31:41.198 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librbd1-2:17.2.7-884.g70d0cb4b.el7.x86_64 18/26 2024-04-23T14:31:41.316 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:17.2.7-884.g70d0cb4b.el7.x86_64 18/26 2024-04-23T14:31:41.412 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rbd-2:17.2.7-884.g70d0cb4b.el7.x86_64 19/26 2024-04-23T14:31:41.452 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-common-2:17.2.7-884.g70d0cb4b.el7.x86 20/26 2024-04-23T14:31:42.888 INFO:teuthology.orchestra.run.smithi156.stdout:(4/4): ceph-test-17.2.7-884.g70d0cb4b.el7.x86_6 19 MB/s | 48 MB 00:02 2024-04-23T14:31:42.893 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2024-04-23T14:31:42.894 INFO:teuthology.orchestra.run.smithi156.stdout:Total 19 MB/s | 48 MB 00:02 2024-04-23T14:31:42.969 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2024-04-23T14:31:43.022 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2024-04-23T14:31:43.022 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2024-04-23T14:31:43.523 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2024-04-23T14:31:43.524 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2024-04-23T14:31:44.199 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2024-04-23T14:31:44.280 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:17.2.7-884.g70d0cb4b.el7.x86_64 21/26 2024-04-23T14:31:44.316 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-common-2:17.2.7-884.g70d0cb4b.el7.x86_64 21/26 2024-04-23T14:31:44.401 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-04-23T14:31:44.506 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-04-23T14:31:44.568 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcephsqlite-2:17.2.7-884.g70d0cb4b.el7.x86_64 3/4 2024-04-23T14:31:44.942 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:17.2.7-884.g70d0cb4b.el7.x86_64 21/26 2024-04-23T14:31:45.003 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-base-2:17.2.7-884.g70d0cb4b.el7.x86_64 22/26 2024-04-23T14:31:45.204 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-base-2:17.2.7-884.g70d0cb4b.el7.x86_64 22/26 2024-04-23T14:31:45.204 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-23T14:31:45.204 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-23T14:31:45.204 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:31:45.254 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-selinux-2:17.2.7-884.g70d0cb4b.el7.x86_64 23/26 2024-04-23T14:31:49.540 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libcephsqlite-2:17.2.7-884.g70d0cb4b.el7.x86_64 3/4 2024-04-23T14:31:49.798 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-test-2:17.2.7-884.g70d0cb4b.el7.x86_64 4/4 2024-04-23T14:31:51.780 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-test-2:17.2.7-884.g70d0cb4b.el7.x86_64 4/4 2024-04-23T14:31:51.780 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-test-2:17.2.7-884.g70d0cb4b.el7.x86_64 1/4 2024-04-23T14:31:51.780 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephsqlite-2:17.2.7-884.g70d0cb4b.el7.x86_64 2/4 2024-04-23T14:31:51.780 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-04-23T14:31:52.042 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-04-23T14:31:52.043 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:31:52.043 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2024-04-23T14:31:52.043 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-test-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:31:52.043 INFO:teuthology.orchestra.run.smithi156.stdout: libcephsqlite-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:31:52.043 INFO:teuthology.orchestra.run.smithi156.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-23T14:31:52.043 INFO:teuthology.orchestra.run.smithi156.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-23T14:31:52.043 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:31:52.043 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2024-04-23T14:31:52.360 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph 2024-04-23T14:31:53.124 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:00:48 ago on Tue 23 Apr 2024 02:31:05 PM UTC. 2024-04-23T14:31:53.252 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2024-04-23T14:31:53.255 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:31:53.255 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2024-04-23T14:31:53.255 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:31:53.255 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2024-04-23T14:31:53.255 INFO:teuthology.orchestra.run.smithi156.stdout: ceph x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 6.5 k 2024-04-23T14:31:53.255 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2024-04-23T14:31:53.255 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mds x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 2.1 M 2024-04-23T14:31:53.255 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 1.4 M 2024-04-23T14:31:53.255 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-modules-core noarch 2:17.2.7-884.g70d0cb4b.el7 ceph-noarch 240 k 2024-04-23T14:31:53.255 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mon x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 3.9 M 2024-04-23T14:31:53.255 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-osd x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 15 M 2024-04-23T14:31:53.255 INFO:teuthology.orchestra.run.smithi156.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-23T14:31:53.255 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-23T14:31:53.256 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-23T14:31:53.256 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-23T14:31:53.256 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-23T14:31:53.256 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-23T14:31:53.256 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-23T14:31:53.256 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-23T14:31:53.256 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-23T14:31:53.256 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-23T14:31:53.256 INFO:teuthology.orchestra.run.smithi156.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-23T14:31:53.256 INFO:teuthology.orchestra.run.smithi156.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-23T14:31:53.256 INFO:teuthology.orchestra.run.smithi156.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-23T14:31:53.256 INFO:teuthology.orchestra.run.smithi156.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-23T14:31:53.256 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-23T14:31:53.256 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-23T14:31:53.257 INFO:teuthology.orchestra.run.smithi156.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-23T14:31:53.257 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-23T14:31:53.257 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-23T14:31:53.257 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-23T14:31:53.257 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-23T14:31:53.257 INFO:teuthology.orchestra.run.smithi156.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-23T14:31:53.257 INFO:teuthology.orchestra.run.smithi156.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-23T14:31:53.257 INFO:teuthology.orchestra.run.smithi156.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-23T14:31:53.257 INFO:teuthology.orchestra.run.smithi156.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-23T14:31:53.257 INFO:teuthology.orchestra.run.smithi156.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-23T14:31:53.257 INFO:teuthology.orchestra.run.smithi156.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-23T14:31:53.257 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:31:53.257 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2024-04-23T14:31:53.257 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:31:53.257 INFO:teuthology.orchestra.run.smithi156.stdout:Install 33 Packages 2024-04-23T14:31:53.258 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:31:53.258 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 27 M 2024-04-23T14:31:53.258 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 96 M 2024-04-23T14:31:53.258 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2024-04-23T14:31:54.270 INFO:teuthology.orchestra.run.smithi156.stdout:(1/33): ceph-17.2.7-884.g70d0cb4b.el7.x86_64.rp 19 kB/s | 6.5 kB 00:00 2024-04-23T14:31:54.412 INFO:teuthology.orchestra.run.smithi156.stdout:(2/33): ceph-mds-17.2.7-884.g70d0cb4b.el7.x86_6 4.3 MB/s | 2.1 MB 00:00 2024-04-23T14:31:55.204 INFO:teuthology.orchestra.run.smithi156.stdout:(3/33): ceph-osd-17.2.7-884.g70d0cb4b.el7.x86_6 19 MB/s | 15 MB 00:00 2024-04-23T14:31:55.254 INFO:teuthology.orchestra.run.smithi156.stdout:(4/33): ceph-mgr-17.2.7-884.g70d0cb4b.el7.x86_6 1.1 MB/s | 1.4 MB 00:01 2024-04-23T14:31:55.288 INFO:teuthology.orchestra.run.smithi156.stdout:(5/33): ceph-mgr-modules-core-17.2.7-884.g70d0c 2.8 MB/s | 240 kB 00:00 2024-04-23T14:31:55.413 INFO:teuthology.orchestra.run.smithi156.stdout:(6/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.6 MB/s | 253 kB 00:00 2024-04-23T14:31:55.464 INFO:teuthology.orchestra.run.smithi156.stdout:(7/33): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-04-23T14:31:55.531 INFO:teuthology.orchestra.run.smithi156.stdout:(8/33): python3-cryptography-36.0.1-4.el9.x86_6 5.1 MB/s | 1.2 MB 00:00 2024-04-23T14:31:55.564 INFO:teuthology.orchestra.run.smithi156.stdout:(9/33): python3-pycparser-2.20-6.el9.noarch.rpm 1.3 MB/s | 135 kB 00:00 2024-04-23T14:31:55.598 INFO:teuthology.orchestra.run.smithi156.stdout:(10/33): python3-requests-2.25.1-8.el9.noarch.r 1.8 MB/s | 125 kB 00:00 2024-04-23T14:31:55.631 INFO:teuthology.orchestra.run.smithi156.stdout:(11/33): python3-urllib3-1.26.5-5.el9.noarch.rp 3.2 MB/s | 215 kB 00:00 2024-04-23T14:31:55.781 INFO:teuthology.orchestra.run.smithi156.stdout:(12/33): python3-markupsafe-1.1.1-12.el9.x86_64 233 kB/s | 35 kB 00:00 2024-04-23T14:31:55.848 INFO:teuthology.orchestra.run.smithi156.stdout:(13/33): python3-mako-1.1.4-6.el9.noarch.rpm 691 kB/s | 172 kB 00:00 2024-04-23T14:31:55.899 INFO:teuthology.orchestra.run.smithi156.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 439 kB/s | 51 kB 00:00 2024-04-23T14:31:55.941 INFO:teuthology.orchestra.run.smithi156.stdout:(15/33): python3-toml-0.10.2-6.el9.noarch.rpm 456 kB/s | 42 kB 00:00 2024-04-23T14:31:56.222 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-selinux-2:17.2.7-884.g70d0cb4b.el7.x86_64 23/26 2024-04-23T14:31:56.222 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /sys 2024-04-23T14:31:56.222 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /proc 2024-04-23T14:31:56.222 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /mnt 2024-04-23T14:31:56.222 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /var/tmp 2024-04-23T14:31:56.222 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /home 2024-04-23T14:31:56.222 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /root 2024-04-23T14:31:56.222 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /tmp 2024-04-23T14:31:56.222 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:31:56.241 INFO:teuthology.orchestra.run.smithi156.stdout:(16/33): ceph-mon-17.2.7-884.g70d0cb4b.el7.x86_ 2.0 MB/s | 3.9 MB 00:01 2024-04-23T14:31:56.283 INFO:teuthology.orchestra.run.smithi156.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 113 kB/s | 43 kB 00:00 2024-04-23T14:31:56.383 INFO:teuthology.orchestra.run.smithi156.stdout:(18/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 389 kB/s | 172 kB 00:00 2024-04-23T14:31:56.442 INFO:teuthology.orchestra.run.smithi156.stdout:(19/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 124 kB/s | 11 kB 00:00 2024-04-23T14:31:56.484 INFO:teuthology.orchestra.run.smithi156.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 177 kB/s | 18 kB 00:00 2024-04-23T14:31:56.584 INFO:teuthology.orchestra.run.smithi156.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 164 kB/s | 23 kB 00:00 2024-04-23T14:31:56.609 INFO:teuthology.orchestra.run.smithi156.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 156 kB/s | 19 kB 00:00 2024-04-23T14:31:56.734 INFO:teuthology.orchestra.run.smithi156.stdout:(23/33): python3-logutils-0.3.5-21.el9.noarch.r 372 kB/s | 46 kB 00:00 2024-04-23T14:31:56.760 INFO:teuthology.orchestra.run.smithi156.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 112 kB/s | 20 kB 00:00 2024-04-23T14:31:56.793 INFO:teuthology.orchestra.run.smithi156.stdout:(25/33): python3-cherrypy-18.6.1-2.el9.noarch.r 651 kB/s | 358 kB 00:00 2024-04-23T14:31:56.869 INFO:teuthology.orchestra.run.smithi156.stdout:(26/33): python3-portend-3.1.0-2.el9.noarch.rpm 220 kB/s | 16 kB 00:00 2024-04-23T14:31:56.902 INFO:teuthology.orchestra.run.smithi156.stdout:(27/33): python3-more-itertools-8.12.0-2.el9.no 473 kB/s | 79 kB 00:00 2024-04-23T14:31:56.936 INFO:teuthology.orchestra.run.smithi156.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.3 MB/s | 90 kB 00:00 2024-04-23T14:31:56.970 INFO:teuthology.orchestra.run.smithi156.stdout:(29/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.3 MB/s | 272 kB 00:00 2024-04-23T14:31:56.995 INFO:teuthology.orchestra.run.smithi156.stdout:(30/33): python3-tempora-5.0.0-2.el9.noarch.rpm 392 kB/s | 36 kB 00:00 2024-04-23T14:31:57.028 INFO:teuthology.orchestra.run.smithi156.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-04-23T14:31:57.062 INFO:teuthology.orchestra.run.smithi156.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 302 kB/s | 20 kB 00:00 2024-04-23T14:31:57.096 INFO:teuthology.orchestra.run.smithi156.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.3 MB/s | 427 kB 00:00 2024-04-23T14:31:57.105 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2024-04-23T14:31:57.105 INFO:teuthology.orchestra.run.smithi156.stdout:Total 7.1 MB/s | 27 MB 00:03 2024-04-23T14:31:57.463 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2024-04-23T14:31:57.550 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2024-04-23T14:31:57.550 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2024-04-23T14:31:57.632 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-radosgw-2:17.2.7-884.g70d0cb4b.el7.x86_64 24/26 2024-04-23T14:31:57.767 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-884.g70d0cb4b.el7.x86_64 24/26 2024-04-23T14:31:57.768 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:31:57.768 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-23T14:31:57.768 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-23T14:31:57.768 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-23T14:31:57.768 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:31:57.772 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-04-23T14:31:57.884 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-04-23T14:31:57.884 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-04-23T14:31:58.048 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2024-04-23T14:31:58.049 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2024-04-23T14:31:59.336 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2024-04-23T14:31:59.416 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-04-23T14:31:59.466 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-04-23T14:31:59.526 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-04-23T14:31:59.544 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-04-23T14:31:59.544 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-base-2:17.2.7-884.g70d0cb4b.el7.x86_64 1/26 2024-04-23T14:31:59.544 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-common-2:17.2.7-884.g70d0cb4b.el7.x86_64 2/26 2024-04-23T14:31:59.544 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-radosgw-2:17.2.7-884.g70d0cb4b.el7.x86_64 3/26 2024-04-23T14:31:59.544 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-selinux-2:17.2.7-884.g70d0cb4b.el7.x86_64 4/26 2024-04-23T14:31:59.544 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs2-2:17.2.7-884.g70d0cb4b.el7.x86_64 5/26 2024-04-23T14:31:59.544 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libradosstriper1-2:17.2.7-884.g70d0cb4b.el7.x86_64 6/26 2024-04-23T14:31:59.544 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librgw2-2:17.2.7-884.g70d0cb4b.el7.x86_64 7/26 2024-04-23T14:31:59.545 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-argparse-2:17.2.7-884.g70d0cb4b.el7.x 8/26 2024-04-23T14:31:59.545 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-common-2:17.2.7-884.g70d0cb4b.el7.x86 9/26 2024-04-23T14:31:59.545 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cephfs-2:17.2.7-884.g70d0cb4b.el7.x86_64 10/26 2024-04-23T14:31:59.545 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rados-2:17.2.7-884.g70d0cb4b.el7.x86_64 11/26 2024-04-23T14:31:59.545 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rbd-2:17.2.7-884.g70d0cb4b.el7.x86_64 12/26 2024-04-23T14:31:59.545 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rgw-2:17.2.7-884.g70d0cb4b.el7.x86_64 13/26 2024-04-23T14:31:59.545 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-04-23T14:31:59.545 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-04-23T14:31:59.545 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-04-23T14:31:59.545 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-04-23T14:31:59.545 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-04-23T14:31:59.545 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-04-23T14:31:59.545 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-04-23T14:31:59.545 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-04-23T14:31:59.545 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-04-23T14:31:59.546 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:17.2.7-884.g70d0cb4b.el7.x86_64 23/26 2024-04-23T14:31:59.546 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-04-23T14:31:59.546 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:17.2.7-884.g70d0cb4b.el7.x86_64 25/26 2024-04-23T14:31:59.675 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-04-23T14:31:59.778 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-04-23T14:31:59.831 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-04-23T14:31:59.872 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-04-23T14:31:59.909 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-04-23T14:31:59.945 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-04-23T14:31:59.988 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-04-23T14:32:00.065 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-04-23T14:32:00.129 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-04-23T14:32:00.175 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-04-23T14:32:00.233 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-04-23T14:32:00.321 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-04-23T14:32:00.321 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:32:00.321 INFO:teuthology.orchestra.run.smithi081.stdout:Upgraded: 2024-04-23T14:32:00.321 INFO:teuthology.orchestra.run.smithi081.stdout: librados2-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:32:00.321 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:32:00.321 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-04-23T14:32:00.322 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:32:00.322 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:32:00.322 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:32:00.322 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:32:00.322 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-23T14:32:00.322 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:32:00.322 INFO:teuthology.orchestra.run.smithi081.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-23T14:32:00.322 INFO:teuthology.orchestra.run.smithi081.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-23T14:32:00.322 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-23T14:32:00.322 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:32:00.322 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-23T14:32:00.322 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:32:00.323 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-23T14:32:00.323 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-23T14:32:00.323 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:32:00.323 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:32:00.323 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:32:00.323 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-23T14:32:00.323 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:32:00.323 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:32:00.323 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:32:00.323 INFO:teuthology.orchestra.run.smithi081.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-23T14:32:00.323 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:32:00.323 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-04-23T14:32:00.362 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-04-23T14:32:00.559 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-04-23T14:32:00.666 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-04-23T14:32:00.700 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-test 2024-04-23T14:32:00.733 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 18/33 2024-04-23T14:32:00.776 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-04-23T14:32:00.841 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-04-23T14:32:00.912 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-04-23T14:32:01.179 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-04-23T14:32:01.248 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-04-23T14:32:01.339 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-04-23T14:32:01.457 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-04-23T14:32:01.478 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:00:35 ago on Tue 23 Apr 2024 02:31:26 PM UTC. 2024-04-23T14:32:01.509 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-04-23T14:32:01.613 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-04-23T14:32:01.614 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:32:01.614 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-04-23T14:32:01.614 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:32:01.614 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-04-23T14:32:01.614 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 48 M 2024-04-23T14:32:01.614 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-04-23T14:32:01.614 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 163 k 2024-04-23T14:32:01.614 INFO:teuthology.orchestra.run.smithi081.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-23T14:32:01.614 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-23T14:32:01.614 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:32:01.614 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-04-23T14:32:01.615 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:32:01.615 INFO:teuthology.orchestra.run.smithi081.stdout:Install 4 Packages 2024-04-23T14:32:01.615 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:32:01.615 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 48 M 2024-04-23T14:32:01.615 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 192 M 2024-04-23T14:32:01.615 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-04-23T14:32:01.667 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-04-23T14:32:01.849 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-884.g70d0cb4b.el7.n 28/33 2024-04-23T14:32:01.885 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-2:17.2.7-884.g70d0cb4b.el7.x86_64 29/33 2024-04-23T14:32:01.919 INFO:teuthology.orchestra.run.smithi081.stdout:(1/4): socat-1.7.4.1-5.el9.x86_64.rpm 1.3 MB/s | 305 kB 00:00 2024-04-23T14:32:01.954 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-2:17.2.7-884.g70d0cb4b.el7.x86_64 29/33 2024-04-23T14:32:01.954 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:32:01.954 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-23T14:32:01.954 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-23T14:32:01.954 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-23T14:32:01.954 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:01.995 INFO:teuthology.orchestra.run.smithi081.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 850 kB/s | 64 kB 00:00 2024-04-23T14:32:02.095 INFO:teuthology.orchestra.run.smithi081.stdout:(3/4): libcephsqlite-17.2.7-884.g70d0cb4b.el7.x 407 kB/s | 163 kB 00:00 2024-04-23T14:32:03.387 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-osd-2:17.2.7-884.g70d0cb4b.el7.x86_64 30/33 2024-04-23T14:32:03.474 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-osd-2:17.2.7-884.g70d0cb4b.el7.x86_64 30/33 2024-04-23T14:32:03.474 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:32:03.474 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-23T14:32:03.474 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-23T14:32:03.474 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-23T14:32:03.474 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:03.895 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mon-2:17.2.7-884.g70d0cb4b.el7.x86_64 31/33 2024-04-23T14:32:03.969 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mon-2:17.2.7-884.g70d0cb4b.el7.x86_64 31/33 2024-04-23T14:32:03.969 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:32:03.969 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-23T14:32:03.969 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-23T14:32:03.969 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-23T14:32:03.969 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:04.188 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mds-2:17.2.7-884.g70d0cb4b.el7.x86_64 32/33 2024-04-23T14:32:04.254 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mds-2:17.2.7-884.g70d0cb4b.el7.x86_64 32/33 2024-04-23T14:32:04.254 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:32:04.254 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-23T14:32:04.254 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-23T14:32:04.254 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-23T14:32:04.254 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:04.319 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-2:17.2.7-884.g70d0cb4b.el7.x86_64 33/33 2024-04-23T14:32:04.329 INFO:teuthology.orchestra.run.smithi081.stdout:(4/4): ceph-test-17.2.7-884.g70d0cb4b.el7.x86_6 18 MB/s | 48 MB 00:02 2024-04-23T14:32:04.333 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-04-23T14:32:04.334 INFO:teuthology.orchestra.run.smithi081.stdout:Total 18 MB/s | 48 MB 00:02 2024-04-23T14:32:04.402 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-04-23T14:32:04.426 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-04-23T14:32:04.426 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-04-23T14:32:04.448 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-2:17.2.7-884.g70d0cb4b.el7.x86_64 33/33 2024-04-23T14:32:04.448 INFO:teuthology.orchestra.run.smithi156.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-23T14:32:04.448 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:04.923 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-04-23T14:32:04.924 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-04-23T14:32:05.597 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-04-23T14:32:05.679 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-04-23T14:32:05.734 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-04-23T14:32:05.806 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephsqlite-2:17.2.7-884.g70d0cb4b.el7.x86_64 3/4 2024-04-23T14:32:06.248 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-2:17.2.7-884.g70d0cb4b.el7.x86_64 1/33 2024-04-23T14:32:06.248 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mds-2:17.2.7-884.g70d0cb4b.el7.x86_64 2/33 2024-04-23T14:32:06.248 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-2:17.2.7-884.g70d0cb4b.el7.x86_64 3/33 2024-04-23T14:32:06.248 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mon-2:17.2.7-884.g70d0cb4b.el7.x86_64 4/33 2024-04-23T14:32:06.248 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-osd-2:17.2.7-884.g70d0cb4b.el7.x86_64 5/33 2024-04-23T14:32:06.248 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-884.g70d0cb4b.el7.n 6/33 2024-04-23T14:32:06.248 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-04-23T14:32:06.249 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-04-23T14:32:06.249 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-04-23T14:32:06.249 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-04-23T14:32:06.249 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-04-23T14:32:06.249 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/33 2024-04-23T14:32:06.249 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-04-23T14:32:06.249 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-04-23T14:32:06.249 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-04-23T14:32:06.249 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-04-23T14:32:06.249 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-04-23T14:32:06.249 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-04-23T14:32:06.249 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-04-23T14:32:06.249 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-04-23T14:32:06.250 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-04-23T14:32:06.250 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-04-23T14:32:06.250 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-04-23T14:32:06.250 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-04-23T14:32:06.250 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-04-23T14:32:06.250 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-04-23T14:32:06.251 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-04-23T14:32:06.251 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-04-23T14:32:06.251 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-04-23T14:32:06.251 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-04-23T14:32:06.251 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-04-23T14:32:06.251 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-04-23T14:32:07.626 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-04-23T14:32:07.626 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:07.626 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2024-04-23T14:32:07.626 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:32:07.626 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mds-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:32:07.626 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:32:07.626 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-modules-core-2:17.2.7-884.g70d0cb4b.el7.noarch 2024-04-23T14:32:07.627 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mon-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:32:07.627 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-osd-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:32:07.627 INFO:teuthology.orchestra.run.smithi156.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-23T14:32:07.627 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-23T14:32:07.627 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-23T14:32:07.627 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-23T14:32:07.627 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-23T14:32:07.627 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-23T14:32:07.627 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-23T14:32:07.627 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-23T14:32:07.627 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-23T14:32:07.627 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-23T14:32:07.627 INFO:teuthology.orchestra.run.smithi156.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-23T14:32:07.628 INFO:teuthology.orchestra.run.smithi156.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-23T14:32:07.628 INFO:teuthology.orchestra.run.smithi156.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-23T14:32:07.628 INFO:teuthology.orchestra.run.smithi156.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-23T14:32:07.628 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-23T14:32:07.628 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ply-3.11-14.el9.noarch 2024-04-23T14:32:07.628 INFO:teuthology.orchestra.run.smithi156.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-23T14:32:07.628 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-23T14:32:07.628 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-23T14:32:07.628 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-23T14:32:07.628 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-23T14:32:07.628 INFO:teuthology.orchestra.run.smithi156.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-23T14:32:07.628 INFO:teuthology.orchestra.run.smithi156.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-23T14:32:07.628 INFO:teuthology.orchestra.run.smithi156.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-23T14:32:07.628 INFO:teuthology.orchestra.run.smithi156.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-23T14:32:07.628 INFO:teuthology.orchestra.run.smithi156.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-23T14:32:07.629 INFO:teuthology.orchestra.run.smithi156.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-23T14:32:07.629 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:07.629 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2024-04-23T14:32:08.146 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-base 2024-04-23T14:32:08.894 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:03 ago on Tue 23 Apr 2024 02:31:05 PM UTC. 2024-04-23T14:32:08.981 INFO:teuthology.orchestra.run.smithi156.stdout:Package ceph-base-2:17.2.7-884.g70d0cb4b.el7.x86_64 is already installed. 2024-04-23T14:32:09.023 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2024-04-23T14:32:09.024 INFO:teuthology.orchestra.run.smithi156.stdout:Nothing to do. 2024-04-23T14:32:09.024 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2024-04-23T14:32:09.113 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install cephadm 2024-04-23T14:32:09.850 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:04 ago on Tue 23 Apr 2024 02:31:05 PM UTC. 2024-04-23T14:32:09.977 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2024-04-23T14:32:09.978 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:32:09.978 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2024-04-23T14:32:09.978 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:32:09.978 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2024-04-23T14:32:09.978 INFO:teuthology.orchestra.run.smithi156.stdout: cephadm noarch 2:17.2.7-884.g70d0cb4b.el7 ceph-noarch 82 k 2024-04-23T14:32:09.978 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:09.978 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2024-04-23T14:32:09.978 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:32:09.978 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2024-04-23T14:32:09.979 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:09.979 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 82 k 2024-04-23T14:32:09.979 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 372 k 2024-04-23T14:32:09.979 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2024-04-23T14:32:10.203 INFO:teuthology.orchestra.run.smithi156.stdout:cephadm-17.2.7-884.g70d0cb4b.el7.noarch.rpm 367 kB/s | 82 kB 00:00 2024-04-23T14:32:10.204 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2024-04-23T14:32:10.205 INFO:teuthology.orchestra.run.smithi156.stdout:Total 362 kB/s | 82 kB 00:00 2024-04-23T14:32:10.205 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2024-04-23T14:32:10.223 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2024-04-23T14:32:10.224 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2024-04-23T14:32:10.231 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2024-04-23T14:32:10.232 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2024-04-23T14:32:10.357 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2024-04-23T14:32:10.679 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephsqlite-2:17.2.7-884.g70d0cb4b.el7.x86_64 3/4 2024-04-23T14:32:10.774 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-test-2:17.2.7-884.g70d0cb4b.el7.x86_64 4/4 2024-04-23T14:32:11.038 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: cephadm-2:17.2.7-884.g70d0cb4b.el7.noarch 1/1 2024-04-23T14:32:11.181 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : cephadm-2:17.2.7-884.g70d0cb4b.el7.noarch 1/1 2024-04-23T14:32:11.573 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: cephadm-2:17.2.7-884.g70d0cb4b.el7.noarch 1/1 2024-04-23T14:32:11.829 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : cephadm-2:17.2.7-884.g70d0cb4b.el7.noarch 1/1 2024-04-23T14:32:11.829 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:11.829 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2024-04-23T14:32:11.829 INFO:teuthology.orchestra.run.smithi156.stdout: cephadm-2:17.2.7-884.g70d0cb4b.el7.noarch 2024-04-23T14:32:11.829 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:11.829 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2024-04-23T14:32:12.038 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-immutable-object-cache 2024-04-23T14:32:12.794 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:07 ago on Tue 23 Apr 2024 02:31:05 PM UTC. 2024-04-23T14:32:12.939 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2024-04-23T14:32:12.940 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:32:12.940 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repo Size 2024-04-23T14:32:12.940 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:32:12.940 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2024-04-23T14:32:12.940 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 137 k 2024-04-23T14:32:12.940 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:12.940 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2024-04-23T14:32:12.941 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:32:12.941 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2024-04-23T14:32:12.941 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:12.941 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 137 k 2024-04-23T14:32:12.941 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 379 k 2024-04-23T14:32:12.941 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2024-04-23T14:32:13.138 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-test-2:17.2.7-884.g70d0cb4b.el7.x86_64 4/4 2024-04-23T14:32:13.138 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-test-2:17.2.7-884.g70d0cb4b.el7.x86_64 1/4 2024-04-23T14:32:13.138 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephsqlite-2:17.2.7-884.g70d0cb4b.el7.x86_64 2/4 2024-04-23T14:32:13.138 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-04-23T14:32:13.176 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-immutable-object-cache-17.2.7-884.g70d0cb4 588 kB/s | 137 kB 00:00 2024-04-23T14:32:13.178 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2024-04-23T14:32:13.178 INFO:teuthology.orchestra.run.smithi156.stdout:Total 579 kB/s | 137 kB 00:00 2024-04-23T14:32:13.179 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2024-04-23T14:32:13.205 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2024-04-23T14:32:13.206 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2024-04-23T14:32:13.309 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2024-04-23T14:32:13.310 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2024-04-23T14:32:13.412 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-04-23T14:32:13.413 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:32:13.413 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-04-23T14:32:13.413 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:32:13.413 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:32:13.413 INFO:teuthology.orchestra.run.smithi081.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-23T14:32:13.413 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-23T14:32:13.413 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:32:13.413 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-04-23T14:32:13.507 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2024-04-23T14:32:13.594 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-884.g70d0cb4b.e 1/1 2024-04-23T14:32:13.668 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-884.g70d0cb4b.e 1/1 2024-04-23T14:32:13.668 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:32:13.669 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-23T14:32:13.669 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:13.793 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph 2024-04-23T14:32:14.519 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:00:48 ago on Tue 23 Apr 2024 02:31:26 PM UTC. 2024-04-23T14:32:14.644 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-04-23T14:32:14.646 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:32:14.646 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-04-23T14:32:14.646 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:32:14.646 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-04-23T14:32:14.646 INFO:teuthology.orchestra.run.smithi081.stdout: ceph x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 6.5 k 2024-04-23T14:32:14.646 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-04-23T14:32:14.647 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 2.1 M 2024-04-23T14:32:14.647 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 1.4 M 2024-04-23T14:32:14.647 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core noarch 2:17.2.7-884.g70d0cb4b.el7 ceph-noarch 240 k 2024-04-23T14:32:14.647 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 3.9 M 2024-04-23T14:32:14.647 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 15 M 2024-04-23T14:32:14.647 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-23T14:32:14.647 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-23T14:32:14.647 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-23T14:32:14.647 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-23T14:32:14.647 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-23T14:32:14.647 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-23T14:32:14.647 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-23T14:32:14.648 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-23T14:32:14.648 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-23T14:32:14.648 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-23T14:32:14.648 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-23T14:32:14.648 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-23T14:32:14.648 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-23T14:32:14.648 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-23T14:32:14.648 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-23T14:32:14.648 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-23T14:32:14.649 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-23T14:32:14.649 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-23T14:32:14.649 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-23T14:32:14.649 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-23T14:32:14.649 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-23T14:32:14.649 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-23T14:32:14.649 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-23T14:32:14.650 INFO:teuthology.orchestra.run.smithi081.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-23T14:32:14.650 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-23T14:32:14.650 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-23T14:32:14.650 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-23T14:32:14.650 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:32:14.650 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-04-23T14:32:14.650 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:32:14.650 INFO:teuthology.orchestra.run.smithi081.stdout:Install 33 Packages 2024-04-23T14:32:14.651 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:32:14.651 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 27 M 2024-04-23T14:32:14.652 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 96 M 2024-04-23T14:32:14.652 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-04-23T14:32:14.932 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-884.g70d0cb4b.e 1/1 2024-04-23T14:32:14.933 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:14.933 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2024-04-23T14:32:14.933 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-immutable-object-cache-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:32:14.933 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:14.933 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2024-04-23T14:32:15.230 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-mgr 2024-04-23T14:32:15.524 INFO:teuthology.orchestra.run.smithi081.stdout:(1/33): ceph-17.2.7-884.g70d0cb4b.el7.x86_64.rp 26 kB/s | 6.5 kB 00:00 2024-04-23T14:32:15.791 INFO:teuthology.orchestra.run.smithi081.stdout:(2/33): ceph-mgr-17.2.7-884.g70d0cb4b.el7.x86_6 2.7 MB/s | 1.4 MB 00:00 2024-04-23T14:32:15.924 INFO:teuthology.orchestra.run.smithi081.stdout:(3/33): ceph-mon-17.2.7-884.g70d0cb4b.el7.x86_6 9.8 MB/s | 3.9 MB 00:00 2024-04-23T14:32:15.991 INFO:teuthology.orchestra.run.smithi081.stdout:(4/33): ceph-mgr-modules-core-17.2.7-884.g70d0c 3.5 MB/s | 240 kB 00:00 2024-04-23T14:32:15.994 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:10 ago on Tue 23 Apr 2024 02:31:05 PM UTC. 2024-04-23T14:32:16.075 INFO:teuthology.orchestra.run.smithi156.stdout:Package ceph-mgr-2:17.2.7-884.g70d0cb4b.el7.x86_64 is already installed. 2024-04-23T14:32:16.118 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2024-04-23T14:32:16.119 INFO:teuthology.orchestra.run.smithi156.stdout:Nothing to do. 2024-04-23T14:32:16.119 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2024-04-23T14:32:16.202 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-mgr-dashboard 2024-04-23T14:32:16.292 INFO:teuthology.orchestra.run.smithi081.stdout:(5/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 846 kB/s | 253 kB 00:00 2024-04-23T14:32:16.600 INFO:teuthology.orchestra.run.smithi081.stdout:(6/33): ceph-osd-17.2.7-884.g70d0cb4b.el7.x86_6 19 MB/s | 15 MB 00:00 2024-04-23T14:32:16.650 INFO:teuthology.orchestra.run.smithi081.stdout:(7/33): python3-cryptography-36.0.1-4.el9.x86_6 3.4 MB/s | 1.2 MB 00:00 2024-04-23T14:32:16.709 INFO:teuthology.orchestra.run.smithi081.stdout:(8/33): python3-pycparser-2.20-6.el9.noarch.rpm 2.3 MB/s | 135 kB 00:00 2024-04-23T14:32:16.784 INFO:teuthology.orchestra.run.smithi081.stdout:(9/33): ceph-mds-17.2.7-884.g70d0cb4b.el7.x86_6 1.4 MB/s | 2.1 MB 00:01 2024-04-23T14:32:16.809 INFO:teuthology.orchestra.run.smithi081.stdout:(10/33): python3-requests-2.25.1-8.el9.noarch.r 1.2 MB/s | 125 kB 00:00 2024-04-23T14:32:16.843 INFO:teuthology.orchestra.run.smithi081.stdout:(11/33): python3-ply-3.11-14.el9.noarch.rpm 441 kB/s | 106 kB 00:00 2024-04-23T14:32:16.924 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:11 ago on Tue 23 Apr 2024 02:31:05 PM UTC. 2024-04-23T14:32:16.935 INFO:teuthology.orchestra.run.smithi081.stdout:(12/33): python3-markupsafe-1.1.1-12.el9.x86_64 382 kB/s | 35 kB 00:00 2024-04-23T14:32:16.968 INFO:teuthology.orchestra.run.smithi081.stdout:(13/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-04-23T14:32:17.010 INFO:teuthology.orchestra.run.smithi081.stdout:(14/33): python3-urllib3-1.26.5-5.el9.noarch.rp 954 kB/s | 215 kB 00:00 2024-04-23T14:32:17.027 INFO:teuthology.orchestra.run.smithi081.stdout:(15/33): python3-pytz-2021.1-5.el9.noarch.rpm 557 kB/s | 51 kB 00:00 2024-04-23T14:32:17.044 INFO:teuthology.orchestra.run.smithi081.stdout:(16/33): python3-toml-0.10.2-6.el9.noarch.rpm 557 kB/s | 42 kB 00:00 2024-04-23T14:32:17.050 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2024-04-23T14:32:17.052 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:32:17.052 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2024-04-23T14:32:17.052 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:32:17.052 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2024-04-23T14:32:17.052 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-dashboard noarch 2:17.2.7-884.g70d0cb4b.el7 ceph-noarch 3.4 M 2024-04-23T14:32:17.052 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2024-04-23T14:32:17.052 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-grafana-dashboards noarch 2:17.2.7-884.g70d0cb4b.el7 ceph-noarch 24 k 2024-04-23T14:32:17.052 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-prometheus-alerts noarch 2:17.2.7-884.g70d0cb4b.el7 ceph-noarch 15 k 2024-04-23T14:32:17.052 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-04-23T14:32:17.053 INFO:teuthology.orchestra.run.smithi156.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-23T14:32:17.053 INFO:teuthology.orchestra.run.smithi156.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-23T14:32:17.053 INFO:teuthology.orchestra.run.smithi156.stdout:Installing weak dependencies: 2024-04-23T14:32:17.053 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-04-23T14:32:17.053 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:17.053 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2024-04-23T14:32:17.053 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:32:17.053 INFO:teuthology.orchestra.run.smithi156.stdout:Install 7 Packages 2024-04-23T14:32:17.053 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:17.054 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 3.7 M 2024-04-23T14:32:17.054 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 80 M 2024-04-23T14:32:17.054 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2024-04-23T14:32:17.095 INFO:teuthology.orchestra.run.smithi081.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 523 kB/s | 43 kB 00:00 2024-04-23T14:32:17.128 INFO:teuthology.orchestra.run.smithi081.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 329 kB/s | 11 kB 00:00 2024-04-23T14:32:17.154 INFO:teuthology.orchestra.run.smithi081.stdout:(19/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-04-23T14:32:17.179 INFO:teuthology.orchestra.run.smithi081.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 357 kB/s | 18 kB 00:00 2024-04-23T14:32:17.246 INFO:teuthology.orchestra.run.smithi081.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 254 kB/s | 23 kB 00:00 2024-04-23T14:32:17.271 INFO:teuthology.orchestra.run.smithi081.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 213 kB/s | 19 kB 00:00 2024-04-23T14:32:17.296 INFO:teuthology.orchestra.run.smithi081.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 398 kB/s | 20 kB 00:00 2024-04-23T14:32:17.322 INFO:teuthology.orchestra.run.smithi081.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 936 kB/s | 46 kB 00:00 2024-04-23T14:32:17.347 INFO:teuthology.orchestra.run.smithi081.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 1.6 MB/s | 79 kB 00:00 2024-04-23T14:32:17.381 INFO:teuthology.orchestra.run.smithi081.stdout:(26/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.0 MB/s | 358 kB 00:00 2024-04-23T14:32:17.406 INFO:teuthology.orchestra.run.smithi081.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 284 kB/s | 16 kB 00:00 2024-04-23T14:32:17.439 INFO:teuthology.orchestra.run.smithi081.stdout:(28/33): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-04-23T14:32:17.465 INFO:teuthology.orchestra.run.smithi081.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.1 MB/s | 90 kB 00:00 2024-04-23T14:32:17.507 INFO:teuthology.orchestra.run.smithi081.stdout:(30/33): python3-tempora-5.0.0-2.el9.noarch.rpm 359 kB/s | 36 kB 00:00 2024-04-23T14:32:17.549 INFO:teuthology.orchestra.run.smithi081.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-04-23T14:32:17.574 INFO:teuthology.orchestra.run.smithi081.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 302 kB/s | 20 kB 00:00 2024-04-23T14:32:17.616 INFO:teuthology.orchestra.run.smithi081.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.8 MB/s | 427 kB 00:00 2024-04-23T14:32:17.619 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-04-23T14:32:17.620 INFO:teuthology.orchestra.run.smithi081.stdout:Total 9.1 MB/s | 27 MB 00:02 2024-04-23T14:32:17.630 INFO:teuthology.orchestra.run.smithi156.stdout:(1/7): ceph-grafana-dashboards-17.2.7-884.g70d0 69 kB/s | 24 kB 00:00 2024-04-23T14:32:17.655 INFO:teuthology.orchestra.run.smithi156.stdout:(2/7): ceph-prometheus-alerts-17.2.7-884.g70d0c 38 kB/s | 15 kB 00:00 2024-04-23T14:32:17.938 INFO:teuthology.orchestra.run.smithi156.stdout:(3/7): python3-jwt-2.4.0-1.el9.noarch.rpm 145 kB/s | 41 kB 00:00 2024-04-23T14:32:17.964 INFO:teuthology.orchestra.run.smithi156.stdout:(4/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 27 kB/s | 9.0 kB 00:00 2024-04-23T14:32:17.975 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-04-23T14:32:18.060 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-04-23T14:32:18.060 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-04-23T14:32:18.064 INFO:teuthology.orchestra.run.smithi156.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 248 kB/s | 31 kB 00:00 2024-04-23T14:32:18.281 INFO:teuthology.orchestra.run.smithi156.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 596 kB/s | 188 kB 00:00 2024-04-23T14:32:18.554 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-04-23T14:32:18.554 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-04-23T14:32:18.856 INFO:teuthology.orchestra.run.smithi156.stdout:(7/7): ceph-mgr-dashboard-17.2.7-884.g70d0cb4b. 2.1 MB/s | 3.4 MB 00:01 2024-04-23T14:32:18.864 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2024-04-23T14:32:18.865 INFO:teuthology.orchestra.run.smithi156.stdout:Total 2.0 MB/s | 3.7 MB 00:01 2024-04-23T14:32:18.866 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2024-04-23T14:32:18.895 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2024-04-23T14:32:18.895 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2024-04-23T14:32:19.066 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2024-04-23T14:32:19.067 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2024-04-23T14:32:19.485 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2024-04-23T14:32:19.591 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-04-23T14:32:19.645 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-04-23T14:32:19.748 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-04-23T14:32:19.790 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-04-23T14:32:19.852 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-04-23T14:32:19.860 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-884.g70d0cb4b.el7.no 5/7 2024-04-23T14:32:19.920 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-04-23T14:32:19.958 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-04-23T14:32:20.002 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-04-23T14:32:20.138 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-04-23T14:32:20.239 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-04-23T14:32:20.293 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-04-23T14:32:20.334 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-04-23T14:32:20.371 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-04-23T14:32:20.408 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-04-23T14:32:20.450 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-04-23T14:32:20.510 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-04-23T14:32:20.597 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-04-23T14:32:20.639 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-04-23T14:32:20.697 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-04-23T14:32:20.823 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-04-23T14:32:21.038 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-04-23T14:32:21.130 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-884.g70d0cb4b.el7.n 6/7 2024-04-23T14:32:21.137 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-04-23T14:32:21.178 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-884.g70d0cb4b.el7.noarch 7/7 2024-04-23T14:32:21.213 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 18/33 2024-04-23T14:32:21.256 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-04-23T14:32:21.320 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-04-23T14:32:21.400 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-04-23T14:32:21.681 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-04-23T14:32:21.752 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-04-23T14:32:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-04-23T14:32:21.962 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-04-23T14:32:22.015 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-04-23T14:32:22.171 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-04-23T14:32:22.345 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-884.g70d0cb4b.el7.n 28/33 2024-04-23T14:32:22.373 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-2:17.2.7-884.g70d0cb4b.el7.x86_64 29/33 2024-04-23T14:32:22.452 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-2:17.2.7-884.g70d0cb4b.el7.x86_64 29/33 2024-04-23T14:32:22.452 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:32:22.452 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-23T14:32:22.452 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-23T14:32:22.452 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-23T14:32:22.452 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:32:22.530 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-884.g70d0cb4b.el7.noarch 7/7 2024-04-23T14:32:22.530 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-884.g70d0cb4b.el7.n 1/7 2024-04-23T14:32:22.530 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-884.g70d0cb4b.el7.noarch 2/7 2024-04-23T14:32:22.530 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-884.g70d0cb4b.el7.no 3/7 2024-04-23T14:32:22.530 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-04-23T14:32:22.530 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-04-23T14:32:22.530 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-04-23T14:32:22.905 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-04-23T14:32:22.906 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:22.906 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2024-04-23T14:32:22.906 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-grafana-dashboards-2:17.2.7-884.g70d0cb4b.el7.noarch 2024-04-23T14:32:22.906 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-dashboard-2:17.2.7-884.g70d0cb4b.el7.noarch 2024-04-23T14:32:22.906 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-prometheus-alerts-2:17.2.7-884.g70d0cb4b.el7.noarch 2024-04-23T14:32:22.906 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-04-23T14:32:22.906 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-04-23T14:32:22.906 INFO:teuthology.orchestra.run.smithi156.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-23T14:32:22.906 INFO:teuthology.orchestra.run.smithi156.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-23T14:32:22.906 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:22.906 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2024-04-23T14:32:23.207 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-23T14:32:23.949 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:18 ago on Tue 23 Apr 2024 02:31:05 PM UTC. 2024-04-23T14:32:23.958 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-osd-2:17.2.7-884.g70d0cb4b.el7.x86_64 30/33 2024-04-23T14:32:24.036 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-osd-2:17.2.7-884.g70d0cb4b.el7.x86_64 30/33 2024-04-23T14:32:24.037 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:32:24.037 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-23T14:32:24.037 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-23T14:32:24.037 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-23T14:32:24.037 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:32:24.072 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2024-04-23T14:32:24.073 INFO:teuthology.orchestra.run.smithi156.stdout:====================================================================================== 2024-04-23T14:32:24.073 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2024-04-23T14:32:24.074 INFO:teuthology.orchestra.run.smithi156.stdout:====================================================================================== 2024-04-23T14:32:24.074 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2024-04-23T14:32:24.074 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-884.g70d0cb4b.el7 ceph-noarch 7.4 M 2024-04-23T14:32:24.074 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2024-04-23T14:32:24.074 INFO:teuthology.orchestra.run.smithi156.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-23T14:32:24.074 INFO:teuthology.orchestra.run.smithi156.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-23T14:32:24.074 INFO:teuthology.orchestra.run.smithi156.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-23T14:32:24.074 INFO:teuthology.orchestra.run.smithi156.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-23T14:32:24.074 INFO:teuthology.orchestra.run.smithi156.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-23T14:32:24.074 INFO:teuthology.orchestra.run.smithi156.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-23T14:32:24.074 INFO:teuthology.orchestra.run.smithi156.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-23T14:32:24.074 INFO:teuthology.orchestra.run.smithi156.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-23T14:32:24.074 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-23T14:32:24.074 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-23T14:32:24.075 INFO:teuthology.orchestra.run.smithi156.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-23T14:32:24.075 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:24.075 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2024-04-23T14:32:24.075 INFO:teuthology.orchestra.run.smithi156.stdout:====================================================================================== 2024-04-23T14:32:24.075 INFO:teuthology.orchestra.run.smithi156.stdout:Install 12 Packages 2024-04-23T14:32:24.075 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:24.075 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 38 M 2024-04-23T14:32:24.075 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 209 M 2024-04-23T14:32:24.076 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2024-04-23T14:32:24.476 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mon-2:17.2.7-884.g70d0cb4b.el7.x86_64 31/33 2024-04-23T14:32:24.498 INFO:teuthology.orchestra.run.smithi156.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.0 MB/s | 195 kB 00:00 2024-04-23T14:32:24.546 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mon-2:17.2.7-884.g70d0cb4b.el7.x86_64 31/33 2024-04-23T14:32:24.546 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:32:24.546 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-23T14:32:24.546 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-23T14:32:24.546 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-23T14:32:24.546 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:32:24.574 INFO:teuthology.orchestra.run.smithi156.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 3.0 MB/s | 803 kB 00:00 2024-04-23T14:32:24.649 INFO:teuthology.orchestra.run.smithi156.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 219 kB/s | 33 kB 00:00 2024-04-23T14:32:24.699 INFO:teuthology.orchestra.run.smithi156.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 370 kB/s | 18 kB 00:00 2024-04-23T14:32:24.749 INFO:teuthology.orchestra.run.smithi156.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 718 kB/s | 35 kB 00:00 2024-04-23T14:32:24.776 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mds-2:17.2.7-884.g70d0cb4b.el7.x86_64 32/33 2024-04-23T14:32:24.843 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mds-2:17.2.7-884.g70d0cb4b.el7.x86_64 32/33 2024-04-23T14:32:24.843 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:32:24.844 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-23T14:32:24.844 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-23T14:32:24.844 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-23T14:32:24.844 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:32:24.907 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-2:17.2.7-884.g70d0cb4b.el7.x86_64 33/33 2024-04-23T14:32:24.916 INFO:teuthology.orchestra.run.smithi156.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 8.8 MB/s | 3.0 MB 00:00 2024-04-23T14:32:24.975 INFO:teuthology.orchestra.run.smithi156.stdout:(7/12): python3-devel-3.9.18-3.el9.x86_64.rpm 4.2 MB/s | 244 kB 00:00 2024-04-23T14:32:25.020 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-2:17.2.7-884.g70d0cb4b.el7.x86_64 33/33 2024-04-23T14:32:25.020 INFO:teuthology.orchestra.run.smithi081.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-23T14:32:25.021 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:32:25.259 INFO:teuthology.orchestra.run.smithi156.stdout:(8/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 18 MB/s | 5.1 MB 00:00 2024-04-23T14:32:25.317 INFO:teuthology.orchestra.run.smithi156.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 4.3 MB/s | 250 kB 00:00 2024-04-23T14:32:25.467 INFO:teuthology.orchestra.run.smithi156.stdout:(10/12): ceph-mgr-diskprediction-local-17.2.7-8 6.4 MB/s | 7.4 MB 00:01 2024-04-23T14:32:25.743 INFO:teuthology.orchestra.run.smithi156.stdout:(11/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 4.8 MB/s | 4.7 MB 00:00 2024-04-23T14:32:25.993 INFO:teuthology.orchestra.run.smithi156.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-04-23T14:32:25.995 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2024-04-23T14:32:25.996 INFO:teuthology.orchestra.run.smithi156.stdout:Total 20 MB/s | 38 MB 00:01 2024-04-23T14:32:26.630 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2024-04-23T14:32:26.643 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-2:17.2.7-884.g70d0cb4b.el7.x86_64 1/33 2024-04-23T14:32:26.643 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mds-2:17.2.7-884.g70d0cb4b.el7.x86_64 2/33 2024-04-23T14:32:26.643 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-2:17.2.7-884.g70d0cb4b.el7.x86_64 3/33 2024-04-23T14:32:26.643 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mon-2:17.2.7-884.g70d0cb4b.el7.x86_64 4/33 2024-04-23T14:32:26.643 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-osd-2:17.2.7-884.g70d0cb4b.el7.x86_64 5/33 2024-04-23T14:32:26.643 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-884.g70d0cb4b.el7.n 6/33 2024-04-23T14:32:26.643 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-04-23T14:32:26.643 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-04-23T14:32:26.643 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-04-23T14:32:26.644 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-04-23T14:32:26.644 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-04-23T14:32:26.644 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/33 2024-04-23T14:32:26.644 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-04-23T14:32:26.644 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-04-23T14:32:26.644 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-04-23T14:32:26.644 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-04-23T14:32:26.644 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-04-23T14:32:26.644 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-04-23T14:32:26.644 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-04-23T14:32:26.644 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-04-23T14:32:26.644 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-04-23T14:32:26.644 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-04-23T14:32:26.645 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-04-23T14:32:26.645 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-04-23T14:32:26.645 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-04-23T14:32:26.645 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-04-23T14:32:26.645 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-04-23T14:32:26.645 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-04-23T14:32:26.645 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-04-23T14:32:26.645 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-04-23T14:32:26.645 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-04-23T14:32:26.645 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-04-23T14:32:26.706 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2024-04-23T14:32:26.706 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2024-04-23T14:32:27.345 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2024-04-23T14:32:27.346 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2024-04-23T14:32:27.604 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-04-23T14:32:27.605 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:32:27.605 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-04-23T14:32:27.605 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:32:27.605 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:32:27.605 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:32:27.605 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core-2:17.2.7-884.g70d0cb4b.el7.noarch 2024-04-23T14:32:27.605 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:32:27.605 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:32:27.605 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-23T14:32:27.605 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-23T14:32:27.605 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-23T14:32:27.605 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-23T14:32:27.605 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-23T14:32:27.605 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-23T14:32:27.605 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-23T14:32:27.606 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-23T14:32:27.606 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-23T14:32:27.606 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-23T14:32:27.606 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-23T14:32:27.606 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-23T14:32:27.606 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-23T14:32:27.606 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-23T14:32:27.606 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-23T14:32:27.606 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ply-3.11-14.el9.noarch 2024-04-23T14:32:27.606 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-23T14:32:27.606 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-23T14:32:27.606 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-23T14:32:27.606 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-23T14:32:27.606 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-23T14:32:27.607 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-23T14:32:27.607 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-23T14:32:27.607 INFO:teuthology.orchestra.run.smithi081.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-23T14:32:27.607 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-23T14:32:27.607 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-23T14:32:27.607 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-23T14:32:27.607 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:32:27.607 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-04-23T14:32:28.034 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-base 2024-04-23T14:32:28.240 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2024-04-23T14:32:28.326 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-23T14:32:28.389 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-23T14:32:28.540 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-23T14:32:28.586 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-04-23T14:32:28.788 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:02 ago on Tue 23 Apr 2024 02:31:26 PM UTC. 2024-04-23T14:32:28.858 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-23T14:32:28.873 INFO:teuthology.orchestra.run.smithi081.stdout:Package ceph-base-2:17.2.7-884.g70d0cb4b.el7.x86_64 is already installed. 2024-04-23T14:32:28.892 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-23T14:32:28.916 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-04-23T14:32:28.917 INFO:teuthology.orchestra.run.smithi081.stdout:Nothing to do. 2024-04-23T14:32:28.918 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-04-23T14:32:28.998 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-23T14:32:28.999 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install cephadm 2024-04-23T14:32:29.699 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:03 ago on Tue 23 Apr 2024 02:31:26 PM UTC. 2024-04-23T14:32:29.824 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-04-23T14:32:29.825 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:32:29.825 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-04-23T14:32:29.825 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:32:29.825 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-04-23T14:32:29.825 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm noarch 2:17.2.7-884.g70d0cb4b.el7 ceph-noarch 82 k 2024-04-23T14:32:29.825 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:32:29.825 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-04-23T14:32:29.825 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:32:29.826 INFO:teuthology.orchestra.run.smithi081.stdout:Install 1 Package 2024-04-23T14:32:29.826 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:32:29.826 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 82 k 2024-04-23T14:32:29.826 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 372 k 2024-04-23T14:32:29.826 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-04-23T14:32:29.898 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-23T14:32:30.029 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-23T14:32:30.234 INFO:teuthology.orchestra.run.smithi081.stdout:cephadm-17.2.7-884.g70d0cb4b.el7.noarch.rpm 201 kB/s | 82 kB 00:00 2024-04-23T14:32:30.235 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-04-23T14:32:30.236 INFO:teuthology.orchestra.run.smithi081.stdout:Total 200 kB/s | 82 kB 00:00 2024-04-23T14:32:30.236 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-04-23T14:32:30.255 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-04-23T14:32:30.255 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-04-23T14:32:30.262 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-04-23T14:32:30.263 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-04-23T14:32:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-04-23T14:32:31.049 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephadm-2:17.2.7-884.g70d0cb4b.el7.noarch 1/1 2024-04-23T14:32:31.194 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephadm-2:17.2.7-884.g70d0cb4b.el7.noarch 1/1 2024-04-23T14:32:31.617 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-23T14:32:31.664 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephadm-2:17.2.7-884.g70d0cb4b.el7.noarch 1/1 2024-04-23T14:32:31.974 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephadm-2:17.2.7-884.g70d0cb4b.el7.noarch 1/1 2024-04-23T14:32:31.974 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:32:31.975 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-04-23T14:32:31.975 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm-2:17.2.7-884.g70d0cb4b.el7.noarch 2024-04-23T14:32:31.975 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:32:31.975 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-04-23T14:32:32.279 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-immutable-object-cache 2024-04-23T14:32:32.782 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-23T14:32:32.816 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-884.g70d0cb 12/12 2024-04-23T14:32:33.048 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:07 ago on Tue 23 Apr 2024 02:31:26 PM UTC. 2024-04-23T14:32:33.192 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-04-23T14:32:33.193 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:32:33.193 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repo Size 2024-04-23T14:32:33.193 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:32:33.193 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-04-23T14:32:33.193 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 137 k 2024-04-23T14:32:33.193 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:32:33.194 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-04-23T14:32:33.194 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:32:33.194 INFO:teuthology.orchestra.run.smithi081.stdout:Install 1 Package 2024-04-23T14:32:33.194 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:32:33.194 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 137 k 2024-04-23T14:32:33.194 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 379 k 2024-04-23T14:32:33.195 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-04-23T14:32:33.432 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-immutable-object-cache-17.2.7-884.g70d0cb4 580 kB/s | 137 kB 00:00 2024-04-23T14:32:33.433 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-04-23T14:32:33.434 INFO:teuthology.orchestra.run.smithi081.stdout:Total 572 kB/s | 137 kB 00:00 2024-04-23T14:32:33.434 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-04-23T14:32:33.460 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-04-23T14:32:33.461 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-04-23T14:32:33.561 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-04-23T14:32:33.562 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-04-23T14:32:33.751 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-04-23T14:32:33.824 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-884.g70d0cb4b.e 1/1 2024-04-23T14:32:33.898 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-884.g70d0cb4b.e 1/1 2024-04-23T14:32:33.898 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:32:33.898 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-23T14:32:33.898 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:32:35.165 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-884.g70d0cb4b.e 1/1 2024-04-23T14:32:35.165 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:32:35.165 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-04-23T14:32:35.165 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:32:35.165 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:32:35.165 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-04-23T14:32:35.438 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-884.g70d0cb 12/12 2024-04-23T14:32:35.438 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-884.g70d0cb 1/12 2024-04-23T14:32:35.438 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-23T14:32:35.438 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-23T14:32:35.438 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-23T14:32:35.438 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-23T14:32:35.438 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-23T14:32:35.438 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-23T14:32:35.438 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-23T14:32:35.438 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-04-23T14:32:35.439 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-23T14:32:35.439 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-23T14:32:35.466 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-mgr 2024-04-23T14:32:35.952 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-23T14:32:35.952 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:35.952 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2024-04-23T14:32:35.952 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-diskprediction-local-2:17.2.7-884.g70d0cb4b.el7.noarch 2024-04-23T14:32:35.953 INFO:teuthology.orchestra.run.smithi156.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-23T14:32:35.953 INFO:teuthology.orchestra.run.smithi156.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-23T14:32:35.953 INFO:teuthology.orchestra.run.smithi156.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-23T14:32:35.953 INFO:teuthology.orchestra.run.smithi156.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-23T14:32:35.953 INFO:teuthology.orchestra.run.smithi156.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-23T14:32:35.953 INFO:teuthology.orchestra.run.smithi156.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-23T14:32:35.953 INFO:teuthology.orchestra.run.smithi156.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-23T14:32:35.953 INFO:teuthology.orchestra.run.smithi156.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-23T14:32:35.953 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-23T14:32:35.953 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-23T14:32:35.953 INFO:teuthology.orchestra.run.smithi156.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-23T14:32:35.953 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:35.953 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2024-04-23T14:32:36.209 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:10 ago on Tue 23 Apr 2024 02:31:26 PM UTC. 2024-04-23T14:32:36.291 INFO:teuthology.orchestra.run.smithi081.stdout:Package ceph-mgr-2:17.2.7-884.g70d0cb4b.el7.x86_64 is already installed. 2024-04-23T14:32:36.333 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-04-23T14:32:36.334 INFO:teuthology.orchestra.run.smithi081.stdout:Nothing to do. 2024-04-23T14:32:36.334 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-04-23T14:32:36.417 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-mgr-dashboard 2024-04-23T14:32:36.514 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-mgr-rook 2024-04-23T14:32:37.181 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:11 ago on Tue 23 Apr 2024 02:31:26 PM UTC. 2024-04-23T14:32:37.306 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:32 ago on Tue 23 Apr 2024 02:31:05 PM UTC. 2024-04-23T14:32:37.309 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-04-23T14:32:37.310 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:32:37.310 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-04-23T14:32:37.310 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:32:37.310 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-04-23T14:32:37.310 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard noarch 2:17.2.7-884.g70d0cb4b.el7 ceph-noarch 3.4 M 2024-04-23T14:32:37.310 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-04-23T14:32:37.310 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards noarch 2:17.2.7-884.g70d0cb4b.el7 ceph-noarch 24 k 2024-04-23T14:32:37.311 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts noarch 2:17.2.7-884.g70d0cb4b.el7 ceph-noarch 15 k 2024-04-23T14:32:37.311 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-04-23T14:32:37.311 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-23T14:32:37.311 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-23T14:32:37.311 INFO:teuthology.orchestra.run.smithi081.stdout:Installing weak dependencies: 2024-04-23T14:32:37.311 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-04-23T14:32:37.311 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:32:37.311 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-04-23T14:32:37.311 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:32:37.311 INFO:teuthology.orchestra.run.smithi081.stdout:Install 7 Packages 2024-04-23T14:32:37.311 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:32:37.312 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 3.7 M 2024-04-23T14:32:37.312 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 80 M 2024-04-23T14:32:37.312 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-04-23T14:32:37.431 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2024-04-23T14:32:37.433 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:32:37.433 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2024-04-23T14:32:37.433 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:32:37.433 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2024-04-23T14:32:37.433 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-rook noarch 2:17.2.7-884.g70d0cb4b.el7 ceph-noarch 47 k 2024-04-23T14:32:37.433 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2024-04-23T14:32:37.433 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-23T14:32:37.433 INFO:teuthology.orchestra.run.smithi156.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-23T14:32:37.433 INFO:teuthology.orchestra.run.smithi156.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-23T14:32:37.433 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-23T14:32:37.433 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-23T14:32:37.433 INFO:teuthology.orchestra.run.smithi156.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-23T14:32:37.433 INFO:teuthology.orchestra.run.smithi156.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-23T14:32:37.434 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-23T14:32:37.434 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-23T14:32:37.434 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-23T14:32:37.434 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-23T14:32:37.434 INFO:teuthology.orchestra.run.smithi156.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-23T14:32:37.434 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:37.434 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2024-04-23T14:32:37.434 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:32:37.434 INFO:teuthology.orchestra.run.smithi156.stdout:Install 13 Packages 2024-04-23T14:32:37.434 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:37.435 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 2.2 M 2024-04-23T14:32:37.435 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 26 M 2024-04-23T14:32:37.435 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2024-04-23T14:32:37.827 INFO:teuthology.orchestra.run.smithi081.stdout:(1/7): ceph-prometheus-alerts-17.2.7-884.g70d0c 53 kB/s | 15 kB 00:00 2024-04-23T14:32:37.894 INFO:teuthology.orchestra.run.smithi081.stdout:(2/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 138 kB/s | 9.0 kB 00:00 2024-04-23T14:32:37.945 INFO:teuthology.orchestra.run.smithi081.stdout:(3/7): ceph-grafana-dashboards-17.2.7-884.g70d0 62 kB/s | 24 kB 00:00 2024-04-23T14:32:37.970 INFO:teuthology.orchestra.run.smithi081.stdout:(4/7): python3-jwt-2.4.0-1.el9.noarch.rpm 548 kB/s | 41 kB 00:00 2024-04-23T14:32:38.010 INFO:teuthology.orchestra.run.smithi156.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 114 kB/s | 19 kB 00:00 2024-04-23T14:32:38.035 INFO:teuthology.orchestra.run.smithi156.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 132 kB/s | 26 kB 00:00 2024-04-23T14:32:38.037 INFO:teuthology.orchestra.run.smithi081.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 338 kB/s | 31 kB 00:00 2024-04-23T14:32:38.070 INFO:teuthology.orchestra.run.smithi081.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 1.9 MB/s | 188 kB 00:00 2024-04-23T14:32:38.219 INFO:teuthology.orchestra.run.smithi156.stdout:(3/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 868 kB/s | 159 kB 00:00 2024-04-23T14:32:38.244 INFO:teuthology.orchestra.run.smithi156.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 958 kB/s | 222 kB 00:00 2024-04-23T14:32:38.269 INFO:teuthology.orchestra.run.smithi156.stdout:(5/13): ceph-mgr-rook-17.2.7-884.g70d0cb4b.el7. 111 kB/s | 47 kB 00:00 2024-04-23T14:32:38.336 INFO:teuthology.orchestra.run.smithi156.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 586 kB/s | 54 kB 00:00 2024-04-23T14:32:38.445 INFO:teuthology.orchestra.run.smithi156.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.2 MB/s | 279 kB 00:00 2024-04-23T14:32:38.545 INFO:teuthology.orchestra.run.smithi156.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 117 kB/s | 32 kB 00:00 2024-04-23T14:32:38.620 INFO:teuthology.orchestra.run.smithi081.stdout:(7/7): ceph-mgr-dashboard-17.2.7-884.g70d0cb4b. 3.1 MB/s | 3.4 MB 00:01 2024-04-23T14:32:38.625 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-04-23T14:32:38.626 INFO:teuthology.orchestra.run.smithi081.stdout:Total 2.8 MB/s | 3.7 MB 00:01 2024-04-23T14:32:38.627 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-04-23T14:32:38.645 INFO:teuthology.orchestra.run.smithi156.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 49 kB/s | 15 kB 00:00 2024-04-23T14:32:38.656 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-04-23T14:32:38.656 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-04-23T14:32:38.818 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-04-23T14:32:38.818 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-04-23T14:32:38.854 INFO:teuthology.orchestra.run.smithi156.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 285 kB/s | 59 kB 00:00 2024-04-23T14:32:38.971 INFO:teuthology.orchestra.run.smithi156.stdout:(11/13): python3-google-auth-2.29.0-1.el9.noarc 392 kB/s | 206 kB 00:00 2024-04-23T14:32:39.021 INFO:teuthology.orchestra.run.smithi156.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 2.1 MB/s | 1.0 MB 00:00 2024-04-23T14:32:39.071 INFO:teuthology.orchestra.run.smithi156.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 415 kB/s | 90 kB 00:00 2024-04-23T14:32:39.072 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2024-04-23T14:32:39.072 INFO:teuthology.orchestra.run.smithi156.stdout:Total 1.3 MB/s | 2.2 MB 00:01 2024-04-23T14:32:39.238 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-04-23T14:32:39.284 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2024-04-23T14:32:39.329 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2024-04-23T14:32:39.330 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2024-04-23T14:32:39.347 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-04-23T14:32:39.402 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-04-23T14:32:39.476 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2024-04-23T14:32:39.476 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2024-04-23T14:32:39.495 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-04-23T14:32:39.529 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-04-23T14:32:39.577 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-884.g70d0cb4b.el7.no 5/7 2024-04-23T14:32:40.206 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2024-04-23T14:32:40.427 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-23T14:32:40.490 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-23T14:32:40.556 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-23T14:32:40.602 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-23T14:32:40.657 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-23T14:32:40.785 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-23T14:32:40.856 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-884.g70d0cb4b.el7.n 6/7 2024-04-23T14:32:40.909 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-884.g70d0cb4b.el7.noarch 7/7 2024-04-23T14:32:40.926 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-04-23T14:32:40.991 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-23T14:32:41.917 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-23T14:32:41.975 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-23T14:32:42.000 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-23T14:32:42.032 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-884.g70d0cb4b.el7.noarch 7/7 2024-04-23T14:32:42.032 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-884.g70d0cb4b.el7.n 1/7 2024-04-23T14:32:42.032 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-884.g70d0cb4b.el7.noarch 2/7 2024-04-23T14:32:42.032 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-884.g70d0cb4b.el7.no 3/7 2024-04-23T14:32:42.033 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-04-23T14:32:42.033 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-04-23T14:32:42.033 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-04-23T14:32:42.050 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-23T14:32:42.076 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-rook-2:17.2.7-884.g70d0cb4b.el7.noarch 13/13 2024-04-23T14:32:42.388 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-04-23T14:32:42.388 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:32:42.388 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-04-23T14:32:42.388 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards-2:17.2.7-884.g70d0cb4b.el7.noarch 2024-04-23T14:32:42.388 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard-2:17.2.7-884.g70d0cb4b.el7.noarch 2024-04-23T14:32:42.388 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts-2:17.2.7-884.g70d0cb4b.el7.noarch 2024-04-23T14:32:42.388 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-04-23T14:32:42.388 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-04-23T14:32:42.388 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-23T14:32:42.388 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-23T14:32:42.388 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:32:42.388 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-04-23T14:32:42.680 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-23T14:32:42.890 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-884.g70d0cb4b.el7.noarch 13/13 2024-04-23T14:32:42.890 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-rook-2:17.2.7-884.g70d0cb4b.el7.noarch 1/13 2024-04-23T14:32:42.890 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-23T14:32:42.890 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-23T14:32:42.890 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-23T14:32:42.891 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-23T14:32:42.891 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-23T14:32:42.891 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-23T14:32:42.891 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-23T14:32:42.891 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-23T14:32:42.891 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-04-23T14:32:42.891 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-23T14:32:42.891 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-23T14:32:43.350 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-23T14:32:43.350 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:43.351 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2024-04-23T14:32:43.351 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-rook-2:17.2.7-884.g70d0cb4b.el7.noarch 2024-04-23T14:32:43.351 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-23T14:32:43.351 INFO:teuthology.orchestra.run.smithi156.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-23T14:32:43.351 INFO:teuthology.orchestra.run.smithi156.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-23T14:32:43.351 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-23T14:32:43.351 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-23T14:32:43.351 INFO:teuthology.orchestra.run.smithi156.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-23T14:32:43.351 INFO:teuthology.orchestra.run.smithi156.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-23T14:32:43.351 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-23T14:32:43.351 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-23T14:32:43.351 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-23T14:32:43.352 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-23T14:32:43.352 INFO:teuthology.orchestra.run.smithi156.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-23T14:32:43.352 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:43.352 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2024-04-23T14:32:43.405 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:17 ago on Tue 23 Apr 2024 02:31:26 PM UTC. 2024-04-23T14:32:43.529 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-04-23T14:32:43.530 INFO:teuthology.orchestra.run.smithi081.stdout:====================================================================================== 2024-04-23T14:32:43.530 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-04-23T14:32:43.531 INFO:teuthology.orchestra.run.smithi081.stdout:====================================================================================== 2024-04-23T14:32:43.531 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-04-23T14:32:43.531 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-884.g70d0cb4b.el7 ceph-noarch 7.4 M 2024-04-23T14:32:43.531 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-04-23T14:32:43.531 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-23T14:32:43.531 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-23T14:32:43.531 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-23T14:32:43.531 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-23T14:32:43.532 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-23T14:32:43.532 INFO:teuthology.orchestra.run.smithi081.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-23T14:32:43.532 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-23T14:32:43.532 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-23T14:32:43.532 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-23T14:32:43.532 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-23T14:32:43.532 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-23T14:32:43.533 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:32:43.533 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-04-23T14:32:43.533 INFO:teuthology.orchestra.run.smithi081.stdout:====================================================================================== 2024-04-23T14:32:43.533 INFO:teuthology.orchestra.run.smithi081.stdout:Install 12 Packages 2024-04-23T14:32:43.533 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:32:43.534 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 38 M 2024-04-23T14:32:43.534 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 209 M 2024-04-23T14:32:43.534 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-04-23T14:32:43.684 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-mgr-cephadm 2024-04-23T14:32:44.414 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:39 ago on Tue 23 Apr 2024 02:31:05 PM UTC. 2024-04-23T14:32:44.536 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2024-04-23T14:32:44.537 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:32:44.537 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2024-04-23T14:32:44.537 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:32:44.537 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2024-04-23T14:32:44.537 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-cephadm noarch 2:17.2.7-884.g70d0cb4b.el7 ceph-noarch 123 k 2024-04-23T14:32:44.538 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2024-04-23T14:32:44.538 INFO:teuthology.orchestra.run.smithi156.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-23T14:32:44.538 INFO:teuthology.orchestra.run.smithi156.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-23T14:32:44.538 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-23T14:32:44.538 INFO:teuthology.orchestra.run.smithi156.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-23T14:32:44.538 INFO:teuthology.orchestra.run.smithi156.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-23T14:32:44.538 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:44.538 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2024-04-23T14:32:44.538 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:32:44.538 INFO:teuthology.orchestra.run.smithi156.stdout:Install 6 Packages 2024-04-23T14:32:44.538 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:44.539 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 7.0 M 2024-04-23T14:32:44.539 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 33 M 2024-04-23T14:32:44.539 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2024-04-23T14:32:45.166 INFO:teuthology.orchestra.run.smithi156.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 827 kB/s | 248 kB 00:00 2024-04-23T14:32:45.182 INFO:teuthology.orchestra.run.smithi156.stdout:(2/6): ceph-mgr-cephadm-17.2.7-884.g70d0cb4b.el 389 kB/s | 123 kB 00:00 2024-04-23T14:32:45.425 INFO:teuthology.orchestra.run.smithi156.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 240 kB/s | 58 kB 00:00 2024-04-23T14:32:45.683 INFO:teuthology.orchestra.run.smithi156.stdout:(4/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.0 MB/s | 548 kB 00:00 2024-04-23T14:32:45.709 INFO:teuthology.orchestra.run.smithi156.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 180 kB/s | 51 kB 00:00 2024-04-23T14:32:46.034 INFO:teuthology.orchestra.run.smithi156.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 5.1 MB/s | 6.0 MB 00:01 2024-04-23T14:32:46.040 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2024-04-23T14:32:46.041 INFO:teuthology.orchestra.run.smithi156.stdout:Total 4.6 MB/s | 7.0 MB 00:01 2024-04-23T14:32:46.172 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2024-04-23T14:32:46.213 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2024-04-23T14:32:46.213 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2024-04-23T14:32:46.364 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2024-04-23T14:32:46.364 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2024-04-23T14:32:46.379 INFO:teuthology.orchestra.run.smithi081.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 573 kB/s | 195 kB 00:00 2024-04-23T14:32:46.538 INFO:teuthology.orchestra.run.smithi081.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 208 kB/s | 33 kB 00:00 2024-04-23T14:32:46.688 INFO:teuthology.orchestra.run.smithi081.stdout:(3/12): libgfortran-11.4.1-3.el9.x86_64.rpm 1.2 MB/s | 803 kB 00:00 2024-04-23T14:32:46.763 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2024-04-23T14:32:46.809 INFO:teuthology.orchestra.run.smithi081.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 152 kB/s | 18 kB 00:00 2024-04-23T14:32:46.897 INFO:teuthology.orchestra.run.smithi081.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 404 kB/s | 35 kB 00:00 2024-04-23T14:32:46.980 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-23T14:32:47.043 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-23T14:32:47.198 INFO:teuthology.orchestra.run.smithi081.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 4.5 MB/s | 3.0 MB 00:00 2024-04-23T14:32:47.281 INFO:teuthology.orchestra.run.smithi081.stdout:(7/12): python3-devel-3.9.18-3.el9.x86_64.rpm 2.9 MB/s | 244 kB 00:00 2024-04-23T14:32:47.740 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-23T14:32:47.858 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-23T14:32:47.934 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-23T14:32:47.964 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-884.g70d0cb4b.el7.noarch 6/6 2024-04-23T14:32:47.998 INFO:teuthology.orchestra.run.smithi081.stdout:(8/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 4.3 MB/s | 4.7 MB 00:01 2024-04-23T14:32:48.099 INFO:teuthology.orchestra.run.smithi081.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.5 MB/s | 250 kB 00:00 2024-04-23T14:32:48.241 INFO:teuthology.orchestra.run.smithi081.stdout:(10/12): ceph-mgr-diskprediction-local-17.2.7-8 3.4 MB/s | 7.4 MB 00:02 2024-04-23T14:32:48.349 INFO:teuthology.orchestra.run.smithi081.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.8 MB/s | 5.1 MB 00:01 2024-04-23T14:32:48.874 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-884.g70d0cb4b.el7.noarch 6/6 2024-04-23T14:32:48.875 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-884.g70d0cb4b.el7.noarch 1/6 2024-04-23T14:32:48.875 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-23T14:32:48.875 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-23T14:32:48.875 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-23T14:32:48.875 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-23T14:32:49.228 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-23T14:32:49.228 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:49.228 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2024-04-23T14:32:49.228 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-cephadm-2:17.2.7-884.g70d0cb4b.el7.noarch 2024-04-23T14:32:49.228 INFO:teuthology.orchestra.run.smithi156.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-23T14:32:49.228 INFO:teuthology.orchestra.run.smithi156.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-23T14:32:49.229 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-23T14:32:49.229 INFO:teuthology.orchestra.run.smithi156.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-23T14:32:49.229 INFO:teuthology.orchestra.run.smithi156.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-23T14:32:49.229 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:49.229 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2024-04-23T14:32:49.576 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-fuse 2024-04-23T14:32:50.066 INFO:teuthology.orchestra.run.smithi081.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 8.3 MB/s | 16 MB 00:01 2024-04-23T14:32:50.068 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-04-23T14:32:50.069 INFO:teuthology.orchestra.run.smithi081.stdout:Total 5.8 MB/s | 38 MB 00:06 2024-04-23T14:32:50.324 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:45 ago on Tue 23 Apr 2024 02:31:05 PM UTC. 2024-04-23T14:32:50.451 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2024-04-23T14:32:50.451 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:32:50.451 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2024-04-23T14:32:50.451 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:32:50.451 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2024-04-23T14:32:50.452 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-fuse x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 812 k 2024-04-23T14:32:50.452 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2024-04-23T14:32:50.452 INFO:teuthology.orchestra.run.smithi156.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-23T14:32:50.452 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:50.452 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2024-04-23T14:32:50.452 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:32:50.452 INFO:teuthology.orchestra.run.smithi156.stdout:Install 2 Packages 2024-04-23T14:32:50.452 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:50.453 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 892 k 2024-04-23T14:32:50.453 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 2.6 M 2024-04-23T14:32:50.453 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2024-04-23T14:32:50.718 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-04-23T14:32:50.796 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-04-23T14:32:50.796 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-04-23T14:32:51.220 INFO:teuthology.orchestra.run.smithi156.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 319 kB/s | 80 kB 00:00 2024-04-23T14:32:51.312 INFO:teuthology.orchestra.run.smithi156.stdout:(2/2): ceph-fuse-17.2.7-884.g70d0cb4b.el7.x86_6 2.3 MB/s | 812 kB 00:00 2024-04-23T14:32:51.313 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2024-04-23T14:32:51.314 INFO:teuthology.orchestra.run.smithi156.stdout:Total 1.0 MB/s | 892 kB 00:00 2024-04-23T14:32:51.353 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2024-04-23T14:32:51.420 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-04-23T14:32:51.420 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-04-23T14:32:51.427 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2024-04-23T14:32:51.427 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2024-04-23T14:32:51.534 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2024-04-23T14:32:51.534 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2024-04-23T14:32:51.807 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2024-04-23T14:32:51.976 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-23T14:32:52.070 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-fuse-2:17.2.7-884.g70d0cb4b.el7.x86_64 2/2 2024-04-23T14:32:52.299 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-04-23T14:32:52.382 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-23T14:32:52.432 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-23T14:32:52.565 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-23T14:32:52.608 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-04-23T14:32:52.860 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-23T14:32:52.898 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-23T14:32:52.986 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-fuse-2:17.2.7-884.g70d0cb4b.el7.x86_64 2/2 2024-04-23T14:32:52.986 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-fuse-2:17.2.7-884.g70d0cb4b.el7.x86_64 1/2 2024-04-23T14:32:53.048 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-23T14:32:53.286 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-23T14:32:53.286 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:53.287 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2024-04-23T14:32:53.287 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-fuse-2:17.2.7-884.g70d0cb4b.el7.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-23T14:32:53.287 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:53.287 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2024-04-23T14:32:53.600 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install librados-devel 2024-04-23T14:32:53.866 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-23T14:32:54.020 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-23T14:32:54.380 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:49 ago on Tue 23 Apr 2024 02:31:05 PM UTC. 2024-04-23T14:32:54.500 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2024-04-23T14:32:54.501 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:32:54.501 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repo Size 2024-04-23T14:32:54.501 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:32:54.501 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2024-04-23T14:32:54.501 INFO:teuthology.orchestra.run.smithi156.stdout: librados-devel x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 126 k 2024-04-23T14:32:54.501 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:54.501 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2024-04-23T14:32:54.502 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:32:54.502 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2024-04-23T14:32:54.502 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:54.502 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 126 k 2024-04-23T14:32:54.502 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 448 k 2024-04-23T14:32:54.502 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2024-04-23T14:32:54.744 INFO:teuthology.orchestra.run.smithi156.stdout:librados-devel-17.2.7-884.g70d0cb4b.el7.x86_64. 523 kB/s | 126 kB 00:00 2024-04-23T14:32:54.745 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2024-04-23T14:32:54.746 INFO:teuthology.orchestra.run.smithi156.stdout:Total 516 kB/s | 126 kB 00:00 2024-04-23T14:32:54.747 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2024-04-23T14:32:54.766 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2024-04-23T14:32:54.766 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2024-04-23T14:32:54.880 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2024-04-23T14:32:54.881 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2024-04-23T14:32:55.118 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2024-04-23T14:32:55.238 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librados-devel-2:17.2.7-884.g70d0cb4b.el7.x86_64 1/1 2024-04-23T14:32:55.658 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-23T14:32:55.792 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librados-devel-2:17.2.7-884.g70d0cb4b.el7.x86_64 1/1 2024-04-23T14:32:56.082 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados-devel-2:17.2.7-884.g70d0cb4b.el7.x86_64 1/1 2024-04-23T14:32:56.082 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:56.082 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2024-04-23T14:32:56.082 INFO:teuthology.orchestra.run.smithi156.stdout: librados-devel-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:32:56.083 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:56.083 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2024-04-23T14:32:56.434 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install libcephfs2 2024-04-23T14:32:56.822 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-23T14:32:56.856 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-884.g70d0cb 12/12 2024-04-23T14:32:57.219 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:52 ago on Tue 23 Apr 2024 02:31:05 PM UTC. 2024-04-23T14:32:57.314 INFO:teuthology.orchestra.run.smithi156.stdout:Package libcephfs2-2:17.2.7-884.g70d0cb4b.el7.x86_64 is already installed. 2024-04-23T14:32:57.360 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2024-04-23T14:32:57.362 INFO:teuthology.orchestra.run.smithi156.stdout:Nothing to do. 2024-04-23T14:32:57.362 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2024-04-23T14:32:57.476 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install libcephfs-devel 2024-04-23T14:32:58.225 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:53 ago on Tue 23 Apr 2024 02:31:05 PM UTC. 2024-04-23T14:32:58.351 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2024-04-23T14:32:58.352 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:32:58.352 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repo Size 2024-04-23T14:32:58.352 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:32:58.352 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2024-04-23T14:32:58.352 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs-devel x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 25 k 2024-04-23T14:32:58.352 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:58.352 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2024-04-23T14:32:58.353 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:32:58.353 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2024-04-23T14:32:58.353 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:58.353 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 25 k 2024-04-23T14:32:58.353 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 110 k 2024-04-23T14:32:58.353 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2024-04-23T14:32:58.522 INFO:teuthology.orchestra.run.smithi156.stdout:libcephfs-devel-17.2.7-884.g70d0cb4b.el7.x86_64 148 kB/s | 25 kB 00:00 2024-04-23T14:32:58.523 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2024-04-23T14:32:58.523 INFO:teuthology.orchestra.run.smithi156.stdout:Total 146 kB/s | 25 kB 00:00 2024-04-23T14:32:58.524 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2024-04-23T14:32:58.532 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2024-04-23T14:32:58.532 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2024-04-23T14:32:58.536 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2024-04-23T14:32:58.537 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2024-04-23T14:32:58.673 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2024-04-23T14:32:58.844 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcephfs-devel-2:17.2.7-884.g70d0cb4b.el7.x86_64 1/1 2024-04-23T14:32:59.331 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-884.g70d0cb4b.el7.x86_64 1/1 2024-04-23T14:32:59.501 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-884.g70d0cb 12/12 2024-04-23T14:32:59.501 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-884.g70d0cb 1/12 2024-04-23T14:32:59.501 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-23T14:32:59.501 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-23T14:32:59.501 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-23T14:32:59.501 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-23T14:32:59.501 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-23T14:32:59.502 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-23T14:32:59.502 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-23T14:32:59.502 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-04-23T14:32:59.502 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-23T14:32:59.502 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-23T14:32:59.592 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephfs-devel-2:17.2.7-884.g70d0cb4b.el7.x86_64 1/1 2024-04-23T14:32:59.593 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:59.593 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2024-04-23T14:32:59.593 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs-devel-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:32:59.593 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:32:59.593 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2024-04-23T14:32:59.868 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install librados2 2024-04-23T14:32:59.950 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-23T14:32:59.950 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:32:59.950 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-04-23T14:32:59.950 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local-2:17.2.7-884.g70d0cb4b.el7.noarch 2024-04-23T14:32:59.950 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-23T14:32:59.950 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-23T14:32:59.950 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-23T14:32:59.950 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-23T14:32:59.951 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-23T14:32:59.951 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-23T14:32:59.951 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-23T14:32:59.951 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-23T14:32:59.951 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-23T14:32:59.951 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-23T14:32:59.951 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-23T14:32:59.951 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:32:59.951 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-04-23T14:33:00.366 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-mgr-rook 2024-04-23T14:33:00.625 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:55 ago on Tue 23 Apr 2024 02:31:05 PM UTC. 2024-04-23T14:33:00.709 INFO:teuthology.orchestra.run.smithi156.stdout:Package librados2-2:17.2.7-884.g70d0cb4b.el7.x86_64 is already installed. 2024-04-23T14:33:00.750 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2024-04-23T14:33:00.751 INFO:teuthology.orchestra.run.smithi156.stdout:Nothing to do. 2024-04-23T14:33:00.751 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2024-04-23T14:33:00.843 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install librbd1 2024-04-23T14:33:01.114 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:35 ago on Tue 23 Apr 2024 02:31:26 PM UTC. 2024-04-23T14:33:01.240 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-04-23T14:33:01.241 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:33:01.241 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-04-23T14:33:01.241 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:33:01.241 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-04-23T14:33:01.241 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook noarch 2:17.2.7-884.g70d0cb4b.el7 ceph-noarch 47 k 2024-04-23T14:33:01.241 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-04-23T14:33:01.241 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-23T14:33:01.241 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-23T14:33:01.242 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-23T14:33:01.242 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-23T14:33:01.242 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-23T14:33:01.242 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-23T14:33:01.242 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-23T14:33:01.242 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-23T14:33:01.242 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-23T14:33:01.242 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-23T14:33:01.242 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-23T14:33:01.242 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-23T14:33:01.242 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:33:01.242 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-04-23T14:33:01.242 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:33:01.243 INFO:teuthology.orchestra.run.smithi081.stdout:Install 13 Packages 2024-04-23T14:33:01.243 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:33:01.243 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 2.2 M 2024-04-23T14:33:01.243 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 26 M 2024-04-23T14:33:01.243 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-04-23T14:33:01.562 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:56 ago on Tue 23 Apr 2024 02:31:05 PM UTC. 2024-04-23T14:33:01.642 INFO:teuthology.orchestra.run.smithi156.stdout:Package librbd1-2:17.2.7-884.g70d0cb4b.el7.x86_64 is already installed. 2024-04-23T14:33:01.682 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2024-04-23T14:33:01.683 INFO:teuthology.orchestra.run.smithi156.stdout:Nothing to do. 2024-04-23T14:33:01.684 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2024-04-23T14:33:01.777 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install python3-rados 2024-04-23T14:33:02.075 INFO:teuthology.orchestra.run.smithi081.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 213 kB/s | 19 kB 00:00 2024-04-23T14:33:02.175 INFO:teuthology.orchestra.run.smithi081.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 135 kB/s | 26 kB 00:00 2024-04-23T14:33:02.259 INFO:teuthology.orchestra.run.smithi081.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.9 MB/s | 222 kB 00:00 2024-04-23T14:33:02.284 INFO:teuthology.orchestra.run.smithi081.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-04-23T14:33:02.317 INFO:teuthology.orchestra.run.smithi081.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.7 MB/s | 279 kB 00:00 2024-04-23T14:33:02.334 INFO:teuthology.orchestra.run.smithi081.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.1 MB/s | 54 kB 00:00 2024-04-23T14:33:02.509 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:57 ago on Tue 23 Apr 2024 02:31:05 PM UTC. 2024-04-23T14:33:02.551 INFO:teuthology.orchestra.run.smithi081.stdout:(7/13): ceph-mgr-rook-17.2.7-884.g70d0cb4b.el7. 84 kB/s | 47 kB 00:00 2024-04-23T14:33:02.589 INFO:teuthology.orchestra.run.smithi156.stdout:Package python3-rados-2:17.2.7-884.g70d0cb4b.el7.x86_64 is already installed. 2024-04-23T14:33:02.593 INFO:teuthology.orchestra.run.smithi081.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 117 kB/s | 32 kB 00:00 2024-04-23T14:33:02.610 INFO:teuthology.orchestra.run.smithi081.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 54 kB/s | 15 kB 00:00 2024-04-23T14:33:02.631 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2024-04-23T14:33:02.633 INFO:teuthology.orchestra.run.smithi156.stdout:Nothing to do. 2024-04-23T14:33:02.633 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2024-04-23T14:33:02.730 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install python3-rgw 2024-04-23T14:33:02.961 INFO:teuthology.orchestra.run.smithi081.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 169 kB/s | 59 kB 00:00 2024-04-23T14:33:03.061 INFO:teuthology.orchestra.run.smithi081.stdout:(11/13): python3-google-auth-2.29.0-1.el9.noarc 404 kB/s | 206 kB 00:00 2024-04-23T14:33:03.286 INFO:teuthology.orchestra.run.smithi081.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 1.5 MB/s | 1.0 MB 00:00 2024-04-23T14:33:03.328 INFO:teuthology.orchestra.run.smithi081.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 245 kB/s | 90 kB 00:00 2024-04-23T14:33:03.330 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-04-23T14:33:03.331 INFO:teuthology.orchestra.run.smithi081.stdout:Total 1.1 MB/s | 2.2 MB 00:02 2024-04-23T14:33:03.466 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:58 ago on Tue 23 Apr 2024 02:31:05 PM UTC. 2024-04-23T14:33:03.547 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-04-23T14:33:03.552 INFO:teuthology.orchestra.run.smithi156.stdout:Package python3-rgw-2:17.2.7-884.g70d0cb4b.el7.x86_64 is already installed. 2024-04-23T14:33:03.593 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-04-23T14:33:03.593 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-04-23T14:33:03.594 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2024-04-23T14:33:03.595 INFO:teuthology.orchestra.run.smithi156.stdout:Nothing to do. 2024-04-23T14:33:03.595 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2024-04-23T14:33:03.687 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install python3-cephfs 2024-04-23T14:33:03.740 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-04-23T14:33:03.741 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-04-23T14:33:04.398 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:59 ago on Tue 23 Apr 2024 02:31:05 PM UTC. 2024-04-23T14:33:04.438 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-04-23T14:33:04.483 INFO:teuthology.orchestra.run.smithi156.stdout:Package python3-cephfs-2:17.2.7-884.g70d0cb4b.el7.x86_64 is already installed. 2024-04-23T14:33:04.523 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2024-04-23T14:33:04.525 INFO:teuthology.orchestra.run.smithi156.stdout:Nothing to do. 2024-04-23T14:33:04.525 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2024-04-23T14:33:04.613 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install python3-rbd 2024-04-23T14:33:04.653 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-23T14:33:04.730 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-23T14:33:04.803 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-23T14:33:04.850 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-23T14:33:04.897 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-23T14:33:05.021 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-23T14:33:05.164 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-04-23T14:33:05.232 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-23T14:33:05.361 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:02:00 ago on Tue 23 Apr 2024 02:31:05 PM UTC. 2024-04-23T14:33:05.446 INFO:teuthology.orchestra.run.smithi156.stdout:Package python3-rbd-2:17.2.7-884.g70d0cb4b.el7.x86_64 is already installed. 2024-04-23T14:33:05.487 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2024-04-23T14:33:05.489 INFO:teuthology.orchestra.run.smithi156.stdout:Nothing to do. 2024-04-23T14:33:05.489 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2024-04-23T14:33:05.576 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install rbd-fuse 2024-04-23T14:33:06.128 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-23T14:33:06.190 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-23T14:33:06.223 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-23T14:33:06.276 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-23T14:33:06.300 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-rook-2:17.2.7-884.g70d0cb4b.el7.noarch 13/13 2024-04-23T14:33:06.309 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:02:01 ago on Tue 23 Apr 2024 02:31:05 PM UTC. 2024-04-23T14:33:06.434 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2024-04-23T14:33:06.434 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:33:06.435 INFO:teuthology.orchestra.run.smithi156.stdout: Package Architecture Version Repository Size 2024-04-23T14:33:06.435 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:33:06.435 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2024-04-23T14:33:06.435 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-fuse x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 82 k 2024-04-23T14:33:06.435 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:33:06.435 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2024-04-23T14:33:06.435 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:33:06.435 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2024-04-23T14:33:06.435 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:33:06.436 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 82 k 2024-04-23T14:33:06.436 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 222 k 2024-04-23T14:33:06.436 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2024-04-23T14:33:06.658 INFO:teuthology.orchestra.run.smithi156.stdout:rbd-fuse-17.2.7-884.g70d0cb4b.el7.x86_64.rpm 368 kB/s | 82 kB 00:00 2024-04-23T14:33:06.660 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2024-04-23T14:33:06.661 INFO:teuthology.orchestra.run.smithi156.stdout:Total 363 kB/s | 82 kB 00:00 2024-04-23T14:33:06.661 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2024-04-23T14:33:06.684 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2024-04-23T14:33:06.685 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2024-04-23T14:33:06.794 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2024-04-23T14:33:06.795 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2024-04-23T14:33:07.003 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2024-04-23T14:33:07.121 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rbd-fuse-2:17.2.7-884.g70d0cb4b.el7.x86_64 1/1 2024-04-23T14:33:07.152 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-884.g70d0cb4b.el7.noarch 13/13 2024-04-23T14:33:07.152 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-rook-2:17.2.7-884.g70d0cb4b.el7.noarch 1/13 2024-04-23T14:33:07.152 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-23T14:33:07.152 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-23T14:33:07.152 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-23T14:33:07.152 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-23T14:33:07.152 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-23T14:33:07.152 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-23T14:33:07.152 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-23T14:33:07.152 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-23T14:33:07.152 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-04-23T14:33:07.153 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-23T14:33:07.153 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-23T14:33:07.568 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-23T14:33:07.568 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:33:07.568 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-04-23T14:33:07.568 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook-2:17.2.7-884.g70d0cb4b.el7.noarch 2024-04-23T14:33:07.568 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-23T14:33:07.568 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-23T14:33:07.568 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-23T14:33:07.568 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-23T14:33:07.568 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-23T14:33:07.568 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-23T14:33:07.568 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-23T14:33:07.568 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-23T14:33:07.568 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-23T14:33:07.569 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-23T14:33:07.569 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-23T14:33:07.569 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-23T14:33:07.569 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:33:07.569 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-04-23T14:33:07.619 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: rbd-fuse-2:17.2.7-884.g70d0cb4b.el7.x86_64 1/1 2024-04-23T14:33:07.868 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-fuse-2:17.2.7-884.g70d0cb4b.el7.x86_64 1/1 2024-04-23T14:33:07.868 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:33:07.868 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2024-04-23T14:33:07.868 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-fuse-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:33:07.868 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:33:07.868 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2024-04-23T14:33:07.906 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-mgr-cephadm 2024-04-23T14:33:08.193 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install rbd-mirror 2024-04-23T14:33:08.643 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:42 ago on Tue 23 Apr 2024 02:31:26 PM UTC. 2024-04-23T14:33:08.762 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-04-23T14:33:08.763 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:33:08.763 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-04-23T14:33:08.763 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:33:08.764 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-04-23T14:33:08.764 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm noarch 2:17.2.7-884.g70d0cb4b.el7 ceph-noarch 123 k 2024-04-23T14:33:08.764 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-04-23T14:33:08.764 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-23T14:33:08.764 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-23T14:33:08.764 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-23T14:33:08.764 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-23T14:33:08.764 INFO:teuthology.orchestra.run.smithi081.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-23T14:33:08.764 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:33:08.764 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-04-23T14:33:08.764 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:33:08.764 INFO:teuthology.orchestra.run.smithi081.stdout:Install 6 Packages 2024-04-23T14:33:08.764 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:33:08.765 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 7.0 M 2024-04-23T14:33:08.765 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 33 M 2024-04-23T14:33:08.765 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-04-23T14:33:08.960 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:02:03 ago on Tue 23 Apr 2024 02:31:05 PM UTC. 2024-04-23T14:33:09.092 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2024-04-23T14:33:09.093 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:33:09.093 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repo Size 2024-04-23T14:33:09.093 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:33:09.093 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2024-04-23T14:33:09.093 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-mirror x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 2.9 M 2024-04-23T14:33:09.093 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:33:09.093 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2024-04-23T14:33:09.093 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:33:09.093 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2024-04-23T14:33:09.093 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:33:09.094 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 2.9 M 2024-04-23T14:33:09.094 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 12 M 2024-04-23T14:33:09.094 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2024-04-23T14:33:09.511 INFO:teuthology.orchestra.run.smithi156.stdout:rbd-mirror-17.2.7-884.g70d0cb4b.el7.x86_64.rpm 7.1 MB/s | 2.9 MB 00:00 2024-04-23T14:33:09.513 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2024-04-23T14:33:09.514 INFO:teuthology.orchestra.run.smithi156.stdout:Total 7.0 MB/s | 2.9 MB 00:00 2024-04-23T14:33:09.514 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2024-04-23T14:33:09.540 INFO:teuthology.orchestra.run.smithi081.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.3 MB/s | 248 kB 00:00 2024-04-23T14:33:09.547 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2024-04-23T14:33:09.547 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2024-04-23T14:33:09.664 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2024-04-23T14:33:09.665 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2024-04-23T14:33:09.723 INFO:teuthology.orchestra.run.smithi081.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-04-23T14:33:09.815 INFO:teuthology.orchestra.run.smithi081.stdout:(3/6): ceph-mgr-cephadm-17.2.7-884.g70d0cb4b.el 264 kB/s | 123 kB 00:00 2024-04-23T14:33:09.865 INFO:teuthology.orchestra.run.smithi081.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 410 kB/s | 58 kB 00:00 2024-04-23T14:33:09.916 INFO:teuthology.orchestra.run.smithi081.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 513 kB/s | 51 kB 00:00 2024-04-23T14:33:09.949 INFO:teuthology.orchestra.run.smithi081.stdout:(6/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.3 MB/s | 548 kB 00:00 2024-04-23T14:33:09.951 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-04-23T14:33:09.952 INFO:teuthology.orchestra.run.smithi081.stdout:Total 5.9 MB/s | 7.0 MB 00:01 2024-04-23T14:33:10.076 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-04-23T14:33:10.114 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-04-23T14:33:10.115 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-04-23T14:33:10.185 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2024-04-23T14:33:10.253 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rbd-mirror-2:17.2.7-884.g70d0cb4b.el7.x86_64 1/1 2024-04-23T14:33:10.265 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-04-23T14:33:10.266 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-04-23T14:33:10.323 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: rbd-mirror-2:17.2.7-884.g70d0cb4b.el7.x86_64 1/1 2024-04-23T14:33:10.324 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:33:10.324 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-23T14:33:10.324 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-23T14:33:10.324 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-23T14:33:10.324 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:33:10.679 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-04-23T14:33:10.893 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-23T14:33:10.983 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-23T14:33:11.667 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-23T14:33:11.735 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-mirror-2:17.2.7-884.g70d0cb4b.el7.x86_64 1/1 2024-04-23T14:33:11.735 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:33:11.735 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2024-04-23T14:33:11.735 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-mirror-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:33:11.735 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:33:11.735 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2024-04-23T14:33:11.774 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-23T14:33:11.841 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-23T14:33:11.871 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-884.g70d0cb4b.el7.noarch 6/6 2024-04-23T14:33:12.071 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install rbd-nbd 2024-04-23T14:33:12.753 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-884.g70d0cb4b.el7.noarch 6/6 2024-04-23T14:33:12.753 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-884.g70d0cb4b.el7.noarch 1/6 2024-04-23T14:33:12.753 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-23T14:33:12.753 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-23T14:33:12.753 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-23T14:33:12.753 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-23T14:33:12.834 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:02:07 ago on Tue 23 Apr 2024 02:31:05 PM UTC. 2024-04-23T14:33:12.956 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2024-04-23T14:33:12.957 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:33:12.957 INFO:teuthology.orchestra.run.smithi156.stdout: Package Architecture Version Repository Size 2024-04-23T14:33:12.957 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:33:12.957 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2024-04-23T14:33:12.957 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-nbd x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 165 k 2024-04-23T14:33:12.957 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:33:12.957 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2024-04-23T14:33:12.957 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2024-04-23T14:33:12.957 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2024-04-23T14:33:12.957 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:33:12.957 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 165 k 2024-04-23T14:33:12.957 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 477 k 2024-04-23T14:33:12.958 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2024-04-23T14:33:13.095 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-23T14:33:13.095 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:33:13.095 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-04-23T14:33:13.095 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm-2:17.2.7-884.g70d0cb4b.el7.noarch 2024-04-23T14:33:13.095 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-23T14:33:13.095 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-23T14:33:13.096 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-23T14:33:13.096 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-23T14:33:13.096 INFO:teuthology.orchestra.run.smithi081.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-23T14:33:13.096 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:33:13.096 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-04-23T14:33:13.198 INFO:teuthology.orchestra.run.smithi156.stdout:rbd-nbd-17.2.7-884.g70d0cb4b.el7.x86_64.rpm 690 kB/s | 165 kB 00:00 2024-04-23T14:33:13.199 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2024-04-23T14:33:13.200 INFO:teuthology.orchestra.run.smithi156.stdout:Total 680 kB/s | 165 kB 00:00 2024-04-23T14:33:13.200 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2024-04-23T14:33:13.227 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2024-04-23T14:33:13.228 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2024-04-23T14:33:13.337 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2024-04-23T14:33:13.338 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2024-04-23T14:33:13.437 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-fuse 2024-04-23T14:33:13.564 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2024-04-23T14:33:13.680 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rbd-nbd-2:17.2.7-884.g70d0cb4b.el7.x86_64 1/1 2024-04-23T14:33:14.202 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: rbd-nbd-2:17.2.7-884.g70d0cb4b.el7.x86_64 1/1 2024-04-23T14:33:14.207 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:48 ago on Tue 23 Apr 2024 02:31:26 PM UTC. 2024-04-23T14:33:14.335 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-04-23T14:33:14.336 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:33:14.336 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-04-23T14:33:14.336 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:33:14.336 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-04-23T14:33:14.336 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 812 k 2024-04-23T14:33:14.336 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-04-23T14:33:14.337 INFO:teuthology.orchestra.run.smithi081.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-23T14:33:14.337 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:33:14.337 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-04-23T14:33:14.337 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:33:14.337 INFO:teuthology.orchestra.run.smithi081.stdout:Install 2 Packages 2024-04-23T14:33:14.337 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:33:14.337 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 892 k 2024-04-23T14:33:14.337 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 2.6 M 2024-04-23T14:33:14.337 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-04-23T14:33:14.505 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-nbd-2:17.2.7-884.g70d0cb4b.el7.x86_64 1/1 2024-04-23T14:33:14.505 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:33:14.505 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2024-04-23T14:33:14.505 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-nbd-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:33:14.505 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:33:14.505 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2024-04-23T14:33:14.736 INFO:teuthology.orchestra.run.smithi081.stdout:(1/2): ceph-fuse-17.2.7-884.g70d0cb4b.el7.x86_6 2.4 MB/s | 812 kB 00:00 2024-04-23T14:33:14.836 INFO:teuthology.orchestra.run.smithi081.stdout:(2/2): fuse-2.9.9-15.el9.x86_64.rpm 189 kB/s | 80 kB 00:00 2024-04-23T14:33:14.838 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-04-23T14:33:14.838 INFO:teuthology.orchestra.run.smithi081.stdout:Total 1.7 MB/s | 892 kB 00:00 2024-04-23T14:33:14.864 DEBUG:teuthology.parallel:result is None 2024-04-23T14:33:14.878 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-04-23T14:33:14.952 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-04-23T14:33:14.952 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-04-23T14:33:15.052 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-04-23T14:33:15.052 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-04-23T14:33:15.330 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-04-23T14:33:15.495 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-23T14:33:15.574 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-fuse-2:17.2.7-884.g70d0cb4b.el7.x86_64 2/2 2024-04-23T14:33:16.441 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-fuse-2:17.2.7-884.g70d0cb4b.el7.x86_64 2/2 2024-04-23T14:33:16.442 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-fuse-2:17.2.7-884.g70d0cb4b.el7.x86_64 1/2 2024-04-23T14:33:16.767 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-23T14:33:16.767 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:33:16.767 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-04-23T14:33:16.768 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse-2:17.2.7-884.g70d0cb4b.el7.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-23T14:33:16.768 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:33:16.768 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-04-23T14:33:17.098 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install librados-devel 2024-04-23T14:33:17.890 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:51 ago on Tue 23 Apr 2024 02:31:26 PM UTC. 2024-04-23T14:33:18.016 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-04-23T14:33:18.017 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:33:18.017 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repo Size 2024-04-23T14:33:18.017 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:33:18.018 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-04-23T14:33:18.018 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 126 k 2024-04-23T14:33:18.018 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:33:18.018 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-04-23T14:33:18.018 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:33:18.018 INFO:teuthology.orchestra.run.smithi081.stdout:Install 1 Package 2024-04-23T14:33:18.018 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:33:18.018 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 126 k 2024-04-23T14:33:18.018 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 448 k 2024-04-23T14:33:18.018 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-04-23T14:33:18.260 INFO:teuthology.orchestra.run.smithi081.stdout:librados-devel-17.2.7-884.g70d0cb4b.el7.x86_64. 524 kB/s | 126 kB 00:00 2024-04-23T14:33:18.262 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-04-23T14:33:18.263 INFO:teuthology.orchestra.run.smithi081.stdout:Total 516 kB/s | 126 kB 00:00 2024-04-23T14:33:18.263 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-04-23T14:33:18.282 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-04-23T14:33:18.282 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-04-23T14:33:18.396 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-04-23T14:33:18.396 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-04-23T14:33:18.590 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-04-23T14:33:18.702 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librados-devel-2:17.2.7-884.g70d0cb4b.el7.x86_64 1/1 2024-04-23T14:33:19.163 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados-devel-2:17.2.7-884.g70d0cb4b.el7.x86_64 1/1 2024-04-23T14:33:19.466 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados-devel-2:17.2.7-884.g70d0cb4b.el7.x86_64 1/1 2024-04-23T14:33:19.466 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:33:19.466 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-04-23T14:33:19.466 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:33:19.466 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:33:19.467 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-04-23T14:33:19.773 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install libcephfs2 2024-04-23T14:33:20.552 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:54 ago on Tue 23 Apr 2024 02:31:26 PM UTC. 2024-04-23T14:33:20.640 INFO:teuthology.orchestra.run.smithi081.stdout:Package libcephfs2-2:17.2.7-884.g70d0cb4b.el7.x86_64 is already installed. 2024-04-23T14:33:20.681 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-04-23T14:33:20.683 INFO:teuthology.orchestra.run.smithi081.stdout:Nothing to do. 2024-04-23T14:33:20.683 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-04-23T14:33:20.757 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install libcephfs-devel 2024-04-23T14:33:21.508 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:55 ago on Tue 23 Apr 2024 02:31:26 PM UTC. 2024-04-23T14:33:21.633 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-04-23T14:33:21.633 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:33:21.633 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repo Size 2024-04-23T14:33:21.633 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:33:21.633 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-04-23T14:33:21.633 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 25 k 2024-04-23T14:33:21.633 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:33:21.633 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-04-23T14:33:21.634 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:33:21.634 INFO:teuthology.orchestra.run.smithi081.stdout:Install 1 Package 2024-04-23T14:33:21.634 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:33:21.634 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 25 k 2024-04-23T14:33:21.634 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 110 k 2024-04-23T14:33:21.634 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-04-23T14:33:21.814 INFO:teuthology.orchestra.run.smithi081.stdout:libcephfs-devel-17.2.7-884.g70d0cb4b.el7.x86_64 139 kB/s | 25 kB 00:00 2024-04-23T14:33:21.815 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-04-23T14:33:21.816 INFO:teuthology.orchestra.run.smithi081.stdout:Total 137 kB/s | 25 kB 00:00 2024-04-23T14:33:21.816 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-04-23T14:33:21.825 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-04-23T14:33:21.825 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-04-23T14:33:21.830 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-04-23T14:33:21.830 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-04-23T14:33:21.953 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-04-23T14:33:22.112 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs-devel-2:17.2.7-884.g70d0cb4b.el7.x86_64 1/1 2024-04-23T14:33:22.568 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-884.g70d0cb4b.el7.x86_64 1/1 2024-04-23T14:33:22.814 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs-devel-2:17.2.7-884.g70d0cb4b.el7.x86_64 1/1 2024-04-23T14:33:22.814 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:33:22.814 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-04-23T14:33:22.814 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:33:22.814 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:33:22.814 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-04-23T14:33:23.057 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install librados2 2024-04-23T14:33:23.822 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:57 ago on Tue 23 Apr 2024 02:31:26 PM UTC. 2024-04-23T14:33:23.902 INFO:teuthology.orchestra.run.smithi081.stdout:Package librados2-2:17.2.7-884.g70d0cb4b.el7.x86_64 is already installed. 2024-04-23T14:33:23.942 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-04-23T14:33:23.944 INFO:teuthology.orchestra.run.smithi081.stdout:Nothing to do. 2024-04-23T14:33:23.944 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-04-23T14:33:24.023 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install librbd1 2024-04-23T14:33:24.770 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:58 ago on Tue 23 Apr 2024 02:31:26 PM UTC. 2024-04-23T14:33:24.856 INFO:teuthology.orchestra.run.smithi081.stdout:Package librbd1-2:17.2.7-884.g70d0cb4b.el7.x86_64 is already installed. 2024-04-23T14:33:24.896 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-04-23T14:33:24.898 INFO:teuthology.orchestra.run.smithi081.stdout:Nothing to do. 2024-04-23T14:33:24.898 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-04-23T14:33:24.967 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install python3-rados 2024-04-23T14:33:25.715 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:59 ago on Tue 23 Apr 2024 02:31:26 PM UTC. 2024-04-23T14:33:25.800 INFO:teuthology.orchestra.run.smithi081.stdout:Package python3-rados-2:17.2.7-884.g70d0cb4b.el7.x86_64 is already installed. 2024-04-23T14:33:25.842 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-04-23T14:33:25.843 INFO:teuthology.orchestra.run.smithi081.stdout:Nothing to do. 2024-04-23T14:33:25.843 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-04-23T14:33:25.926 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install python3-rgw 2024-04-23T14:33:26.683 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:02:00 ago on Tue 23 Apr 2024 02:31:26 PM UTC. 2024-04-23T14:33:26.767 INFO:teuthology.orchestra.run.smithi081.stdout:Package python3-rgw-2:17.2.7-884.g70d0cb4b.el7.x86_64 is already installed. 2024-04-23T14:33:26.809 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-04-23T14:33:26.811 INFO:teuthology.orchestra.run.smithi081.stdout:Nothing to do. 2024-04-23T14:33:26.811 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-04-23T14:33:26.884 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install python3-cephfs 2024-04-23T14:33:27.613 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:02:01 ago on Tue 23 Apr 2024 02:31:26 PM UTC. 2024-04-23T14:33:27.698 INFO:teuthology.orchestra.run.smithi081.stdout:Package python3-cephfs-2:17.2.7-884.g70d0cb4b.el7.x86_64 is already installed. 2024-04-23T14:33:27.738 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-04-23T14:33:27.740 INFO:teuthology.orchestra.run.smithi081.stdout:Nothing to do. 2024-04-23T14:33:27.740 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-04-23T14:33:27.812 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install python3-rbd 2024-04-23T14:33:28.567 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:02:02 ago on Tue 23 Apr 2024 02:31:26 PM UTC. 2024-04-23T14:33:28.648 INFO:teuthology.orchestra.run.smithi081.stdout:Package python3-rbd-2:17.2.7-884.g70d0cb4b.el7.x86_64 is already installed. 2024-04-23T14:33:28.689 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-04-23T14:33:28.690 INFO:teuthology.orchestra.run.smithi081.stdout:Nothing to do. 2024-04-23T14:33:28.690 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-04-23T14:33:28.783 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install rbd-fuse 2024-04-23T14:33:29.527 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:02:03 ago on Tue 23 Apr 2024 02:31:26 PM UTC. 2024-04-23T14:33:29.648 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-04-23T14:33:29.649 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:33:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: Package Architecture Version Repository Size 2024-04-23T14:33:29.649 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:33:29.649 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-04-23T14:33:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 82 k 2024-04-23T14:33:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:33:29.649 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-04-23T14:33:29.649 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:33:29.649 INFO:teuthology.orchestra.run.smithi081.stdout:Install 1 Package 2024-04-23T14:33:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:33:29.650 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 82 k 2024-04-23T14:33:29.650 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 222 k 2024-04-23T14:33:29.650 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-04-23T14:33:29.876 INFO:teuthology.orchestra.run.smithi081.stdout:rbd-fuse-17.2.7-884.g70d0cb4b.el7.x86_64.rpm 363 kB/s | 82 kB 00:00 2024-04-23T14:33:29.878 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-04-23T14:33:29.878 INFO:teuthology.orchestra.run.smithi081.stdout:Total 358 kB/s | 82 kB 00:00 2024-04-23T14:33:29.879 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-04-23T14:33:29.902 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-04-23T14:33:29.902 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-04-23T14:33:30.014 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-04-23T14:33:30.015 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-04-23T14:33:30.203 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-04-23T14:33:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-fuse-2:17.2.7-884.g70d0cb4b.el7.x86_64 1/1 2024-04-23T14:33:30.807 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: rbd-fuse-2:17.2.7-884.g70d0cb4b.el7.x86_64 1/1 2024-04-23T14:33:31.124 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-fuse-2:17.2.7-884.g70d0cb4b.el7.x86_64 1/1 2024-04-23T14:33:31.125 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:33:31.125 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-04-23T14:33:31.125 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:33:31.125 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:33:31.125 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-04-23T14:33:31.437 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install rbd-mirror 2024-04-23T14:33:32.195 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:02:06 ago on Tue 23 Apr 2024 02:31:26 PM UTC. 2024-04-23T14:33:32.324 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-04-23T14:33:32.325 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:33:32.325 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repo Size 2024-04-23T14:33:32.325 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:33:32.325 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-04-23T14:33:32.325 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 2.9 M 2024-04-23T14:33:32.325 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:33:32.325 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-04-23T14:33:32.325 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:33:32.325 INFO:teuthology.orchestra.run.smithi081.stdout:Install 1 Package 2024-04-23T14:33:32.325 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:33:32.326 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 2.9 M 2024-04-23T14:33:32.326 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 12 M 2024-04-23T14:33:32.326 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-04-23T14:33:32.721 INFO:teuthology.orchestra.run.smithi081.stdout:rbd-mirror-17.2.7-884.g70d0cb4b.el7.x86_64.rpm 7.4 MB/s | 2.9 MB 00:00 2024-04-23T14:33:32.723 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-04-23T14:33:32.724 INFO:teuthology.orchestra.run.smithi081.stdout:Total 7.4 MB/s | 2.9 MB 00:00 2024-04-23T14:33:32.725 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-04-23T14:33:32.756 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-04-23T14:33:32.756 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-04-23T14:33:32.879 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-04-23T14:33:32.879 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-04-23T14:33:33.395 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-04-23T14:33:33.476 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-mirror-2:17.2.7-884.g70d0cb4b.el7.x86_64 1/1 2024-04-23T14:33:33.575 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: rbd-mirror-2:17.2.7-884.g70d0cb4b.el7.x86_64 1/1 2024-04-23T14:33:33.575 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T14:33:33.575 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-23T14:33:33.575 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-23T14:33:33.575 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-23T14:33:33.575 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:33:34.946 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-mirror-2:17.2.7-884.g70d0cb4b.el7.x86_64 1/1 2024-04-23T14:33:34.946 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:33:34.946 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-04-23T14:33:34.946 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:33:34.946 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:33:34.946 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-04-23T14:33:35.234 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install rbd-nbd 2024-04-23T14:33:36.009 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:02:10 ago on Tue 23 Apr 2024 02:31:26 PM UTC. 2024-04-23T14:33:36.131 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-04-23T14:33:36.132 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:33:36.132 INFO:teuthology.orchestra.run.smithi081.stdout: Package Architecture Version Repository Size 2024-04-23T14:33:36.132 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:33:36.132 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-04-23T14:33:36.132 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd x86_64 2:17.2.7-884.g70d0cb4b.el7 ceph 165 k 2024-04-23T14:33:36.132 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:33:36.132 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-04-23T14:33:36.132 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-04-23T14:33:36.132 INFO:teuthology.orchestra.run.smithi081.stdout:Install 1 Package 2024-04-23T14:33:36.133 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:33:36.133 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 165 k 2024-04-23T14:33:36.133 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 477 k 2024-04-23T14:33:36.133 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-04-23T14:33:36.375 INFO:teuthology.orchestra.run.smithi081.stdout:rbd-nbd-17.2.7-884.g70d0cb4b.el7.x86_64.rpm 683 kB/s | 165 kB 00:00 2024-04-23T14:33:36.377 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-04-23T14:33:36.377 INFO:teuthology.orchestra.run.smithi081.stdout:Total 675 kB/s | 165 kB 00:00 2024-04-23T14:33:36.378 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-04-23T14:33:36.404 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-04-23T14:33:36.404 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-04-23T14:33:36.516 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-04-23T14:33:36.516 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-04-23T14:33:36.754 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-04-23T14:33:36.871 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-nbd-2:17.2.7-884.g70d0cb4b.el7.x86_64 1/1 2024-04-23T14:33:37.385 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: rbd-nbd-2:17.2.7-884.g70d0cb4b.el7.x86_64 1/1 2024-04-23T14:33:37.707 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-nbd-2:17.2.7-884.g70d0cb4b.el7.x86_64 1/1 2024-04-23T14:33:37.707 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:33:37.707 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-04-23T14:33:37.707 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd-2:17.2.7-884.g70d0cb4b.el7.x86_64 2024-04-23T14:33:37.707 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:33:37.707 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-04-23T14:33:38.057 DEBUG:teuthology.parallel:result is None 2024-04-23T14:33:38.057 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-23T14:33:38.058 INFO:teuthology.packaging:ref: None 2024-04-23T14:33:38.058 INFO:teuthology.packaging:tag: None 2024-04-23T14:33:38.058 INFO:teuthology.packaging:branch: quincy 2024-04-23T14:33:38.058 INFO:teuthology.packaging:sha1: d44fddd910b5e94da0f2357af4be37d7bd495ae0 2024-04-23T14:33:38.058 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-04-23T14:33:38.381 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-23T14:33:38.450 INFO:teuthology.orchestra.run.smithi081.stdout:17.2.7-884.g70d0cb4b.el7 2024-04-23T14:33:38.450 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-884.g70d0cb4b.el7 2024-04-23T14:33:38.450 INFO:teuthology.task.install:The correct ceph version 17.2.7-884.g70d0cb4b is installed. 2024-04-23T14:33:38.452 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-23T14:33:38.452 INFO:teuthology.packaging:ref: None 2024-04-23T14:33:38.452 INFO:teuthology.packaging:tag: None 2024-04-23T14:33:38.452 INFO:teuthology.packaging:branch: quincy 2024-04-23T14:33:38.452 INFO:teuthology.packaging:sha1: d44fddd910b5e94da0f2357af4be37d7bd495ae0 2024-04-23T14:33:38.453 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-04-23T14:33:38.779 DEBUG:teuthology.orchestra.run.smithi156:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-23T14:33:38.847 INFO:teuthology.orchestra.run.smithi156.stdout:17.2.7-884.g70d0cb4b.el7 2024-04-23T14:33:38.847 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-884.g70d0cb4b.el7 2024-04-23T14:33:38.847 INFO:teuthology.task.install:The correct ceph version 17.2.7-884.g70d0cb4b is installed. 2024-04-23T14:33:38.849 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-23T14:33:38.850 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-23T14:33:38.850 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-23T14:33:38.926 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-04-23T14:33:38.926 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-23T14:33:39.015 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-23T14:33:39.015 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-23T14:33:39.015 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/daemon-helper 2024-04-23T14:33:39.104 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-23T14:33:39.191 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-04-23T14:33:39.192 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/daemon-helper 2024-04-23T14:33:39.279 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-23T14:33:39.395 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-23T14:33:39.395 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-23T14:33:39.395 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-23T14:33:39.483 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-23T14:33:39.603 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-04-23T14:33:39.603 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-23T14:33:39.687 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-23T14:33:39.793 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-23T14:33:39.793 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-23T14:33:39.793 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/stdin-killer 2024-04-23T14:33:39.881 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-23T14:33:39.963 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-04-23T14:33:39.963 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/stdin-killer 2024-04-23T14:33:40.032 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-23T14:33:40.150 INFO:teuthology.run_tasks:Running task print... 2024-04-23T14:33:40.161 INFO:teuthology.task.print:**** done install task... 2024-04-23T14:33:40.161 INFO:teuthology.run_tasks:Running task cephadm... 2024-04-23T14:33:40.265 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'd44fddd910b5e94da0f2357af4be37d7bd495ae0'} 2024-04-23T14:33:40.265 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2024-04-23T14:33:40.266 INFO:tasks.cephadm:Cluster fsid is 7a641bea-017e-11ef-bc93-c7b262605968 2024-04-23T14:33:40.266 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-04-23T14:33:40.266 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-04-23T14:33:40.266 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi081': '172.21.15.81', 'mon.smithi156': '172.21.15.156'} 2024-04-23T14:33:40.266 INFO:tasks.cephadm:Normalizing hostnames... 2024-04-23T14:33:40.267 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname $(hostname -s) 2024-04-23T14:33:40.357 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname $(hostname -s) 2024-04-23T14:33:40.429 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2024-04-23T14:33:40.429 DEBUG:teuthology.orchestra.run.smithi081:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-23T14:33:40.744 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r--. 1 ubuntu ubuntu 375153 Apr 23 14:33 /home/ubuntu/cephtest/cephadm 2024-04-23T14:33:40.744 DEBUG:teuthology.orchestra.run.smithi156:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-23T14:33:41.054 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r--. 1 ubuntu ubuntu 375153 Apr 23 14:33 /home/ubuntu/cephtest/cephadm 2024-04-23T14:33:41.054 DEBUG:teuthology.orchestra.run.smithi081:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-23T14:33:41.115 DEBUG:teuthology.orchestra.run.smithi156:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-23T14:33:41.184 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2024-04-23T14:33:41.184 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-04-23T14:33:41.192 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-04-23T14:33:43.198 INFO:teuthology.orchestra.run.smithi156.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-04-23T14:33:43.227 INFO:teuthology.orchestra.run.smithi081.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-04-23T14:36:27.982 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:36:27.983 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)", 2024-04-23T14:36:27.983 INFO:teuthology.orchestra.run.smithi081.stdout: "image_id": "cafd8ddac8fa176bf00aeacab8beaeeffcb0c5261d2d415c33683cb8bed0534e", 2024-04-23T14:36:27.983 INFO:teuthology.orchestra.run.smithi081.stdout: "repo_digests": [ 2024-04-23T14:36:27.983 INFO:teuthology.orchestra.run.smithi081.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:3890cd726bd5e73ae623dabdf4ed76dd5df81c936b8bd8d761026babda969466" 2024-04-23T14:36:27.983 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-23T14:36:27.983 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:36:52.416 INFO:teuthology.orchestra.run.smithi156.stdout:{ 2024-04-23T14:36:52.416 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_version": "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)", 2024-04-23T14:36:52.417 INFO:teuthology.orchestra.run.smithi156.stdout: "image_id": "cafd8ddac8fa176bf00aeacab8beaeeffcb0c5261d2d415c33683cb8bed0534e", 2024-04-23T14:36:52.417 INFO:teuthology.orchestra.run.smithi156.stdout: "repo_digests": [ 2024-04-23T14:36:52.417 INFO:teuthology.orchestra.run.smithi156.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:3890cd726bd5e73ae623dabdf4ed76dd5df81c936b8bd8d761026babda969466" 2024-04-23T14:36:52.417 INFO:teuthology.orchestra.run.smithi156.stdout: ] 2024-04-23T14:36:52.417 INFO:teuthology.orchestra.run.smithi156.stdout:} 2024-04-23T14:36:52.469 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /etc/ceph 2024-04-23T14:36:52.553 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /etc/ceph 2024-04-23T14:36:52.643 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 777 /etc/ceph 2024-04-23T14:36:52.724 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 777 /etc/ceph 2024-04-23T14:36:52.812 INFO:tasks.cephadm:Writing seed config... 2024-04-23T14:36:52.813 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-04-23T14:36:52.813 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-04-23T14:36:52.813 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-04-23T14:36:52.813 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-04-23T14:36:52.813 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-04-23T14:36:52.813 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-04-23T14:36:52.814 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-04-23T14:36:52.814 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-04-23T14:36:52.814 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-04-23T14:36:52.814 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-04-23T14:36:52.814 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-04-23T14:36:52.814 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-04-23T14:36:52.814 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-04-23T14:36:52.814 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-04-23T14:36:52.814 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-04-23T14:36:52.814 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-04-23T14:36:52.814 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-04-23T14:36:52.814 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-04-23T14:36:52.814 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-04-23T14:36:52.814 INFO:tasks.cephadm: override: [client] debug client = 20 2024-04-23T14:36:52.814 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-04-23T14:36:52.815 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-04-23T14:36:52.815 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-04-23T14:36:52.815 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-04-23T14:36:52.815 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-04-23T14:36:52.815 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-04-23T14:36:52.815 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-04-23T14:36:52.815 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-04-23T14:36:52.815 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-04-23T14:36:52.815 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-04-23T14:36:52.815 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-04-23T14:36:52.815 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-04-23T14:36:52.815 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-04-23T14:36:52.815 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-04-23T14:36:52.815 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-04-23T14:36:52.815 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-04-23T14:36:52.816 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-04-23T14:36:52.816 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-04-23T14:36:52.816 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-04-23T14:36:52.816 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-04-23T14:36:52.816 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-04-23T14:36:52.816 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-04-23T14:36:52.817 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-23T14:36:52.817 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-04-23T14:36:52.871 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 7a641bea-017e-11ef-bc93-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-04-23T14:36:52.872 DEBUG:teuthology.orchestra.run.smithi081:mon.smithi081> sudo journalctl -f -n 0 -u ceph-7a641bea-017e-11ef-bc93-c7b262605968@mon.smithi081.service 2024-04-23T14:36:52.920 INFO:tasks.cephadm:Bootstrapping... 2024-04-23T14:36:52.920 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid 7a641bea-017e-11ef-bc93-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.81 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-04-23T14:36:53.216 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-04-23T14:36:53.216 INFO:teuthology.orchestra.run.smithi081.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', '7a641bea-017e-11ef-bc93-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.81', '--skip-admin-label'] 2024-04-23T14:36:53.274 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-23T14:36:53.275 INFO:teuthology.orchestra.run.smithi081.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-04-23T14:36:53.275 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying podman|docker is present... 2024-04-23T14:36:53.324 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-23T14:36:53.325 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying lvm2 is present... 2024-04-23T14:36:53.325 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying time synchronization is in place... 2024-04-23T14:36:53.340 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-23T14:36:53.340 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-23T14:36:53.354 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-23T14:36:53.355 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-04-23T14:36:53.373 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout enabled 2024-04-23T14:36:53.388 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout active 2024-04-23T14:36:53.389 INFO:teuthology.orchestra.run.smithi081.stdout:Unit chronyd.service is enabled and running 2024-04-23T14:36:53.389 INFO:teuthology.orchestra.run.smithi081.stdout:Repeating the final host check... 2024-04-23T14:36:53.795 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-23T14:36:53.795 INFO:teuthology.orchestra.run.smithi081.stdout:podman (/bin/podman) version 4.9.4 is present 2024-04-23T14:36:53.795 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl is present 2024-04-23T14:36:53.795 INFO:teuthology.orchestra.run.smithi081.stdout:lvcreate is present 2024-04-23T14:36:53.815 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-23T14:36:53.815 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-23T14:36:53.832 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-23T14:36:53.832 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-04-23T14:36:53.852 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout enabled 2024-04-23T14:36:53.873 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout active 2024-04-23T14:36:53.873 INFO:teuthology.orchestra.run.smithi081.stdout:Unit chronyd.service is enabled and running 2024-04-23T14:36:53.873 INFO:teuthology.orchestra.run.smithi081.stdout:Host looks OK 2024-04-23T14:36:53.874 INFO:teuthology.orchestra.run.smithi081.stdout:Cluster fsid: 7a641bea-017e-11ef-bc93-c7b262605968 2024-04-23T14:36:53.875 INFO:teuthology.orchestra.run.smithi081.stdout:Acquiring lock 140116011107664 on /run/cephadm/7a641bea-017e-11ef-bc93-c7b262605968.lock 2024-04-23T14:36:53.875 INFO:teuthology.orchestra.run.smithi081.stdout:Lock 140116011107664 acquired on /run/cephadm/7a641bea-017e-11ef-bc93-c7b262605968.lock 2024-04-23T14:36:53.876 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying IP 172.21.15.81 port 3300 ... 2024-04-23T14:36:53.877 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying IP 172.21.15.81 port 6789 ... 2024-04-23T14:36:53.878 INFO:teuthology.orchestra.run.smithi081.stdout:Base mon IP(s) is [172.21.15.81:3300, 172.21.15.81:6789], mon addrv is [v2:172.21.15.81:3300,v1:172.21.15.81:6789] 2024-04-23T14:36:53.893 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.81 metric 100 2024-04-23T14:36:53.893 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.81 metric 100 2024-04-23T14:36:53.907 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-04-23T14:36:53.907 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-04-23T14:36:53.907 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1743sec hoplimit 64 pref medium 2024-04-23T14:36:53.919 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-04-23T14:36:53.919 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-04-23T14:36:53.919 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-23T14:36:53.920 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-04-23T14:36:53.920 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2024-04-23T14:36:53.920 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-23T14:36:53.922 INFO:teuthology.orchestra.run.smithi081.stdout:Mon IP `172.21.15.81` is in CIDR network `172.21.0.0/20` 2024-04-23T14:36:53.923 INFO:teuthology.orchestra.run.smithi081.stdout:Mon IP `172.21.15.81` is in CIDR network `172.21.0.0/20` 2024-04-23T14:36:53.923 INFO:teuthology.orchestra.run.smithi081.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-04-23T14:36:53.925 INFO:teuthology.orchestra.run.smithi081.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-04-23T14:36:53.928 INFO:teuthology.orchestra.run.smithi081.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-04-23T14:36:55.305 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stdout cafd8ddac8fa176bf00aeacab8beaeeffcb0c5261d2d415c33683cb8bed0534e 2024-04-23T14:36:55.305 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2024-04-23T14:36:55.305 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Getting image source signatures 2024-04-23T14:36:55.305 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Copying blob sha256:9977ec9f18cf69a6eaba4ac817ba680893fdb6756bbeabcd26f0bbb94288ba4a 2024-04-23T14:36:55.305 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Copying blob sha256:426fede9fffa2c7dfe40a4f9322a34794b72405170134d54d2c30d9cc6c6a5be 2024-04-23T14:36:55.305 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Copying config sha256:cafd8ddac8fa176bf00aeacab8beaeeffcb0c5261d2d415c33683cb8bed0534e 2024-04-23T14:36:55.305 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Writing manifest to image destination 2024-04-23T14:36:56.524 INFO:teuthology.orchestra.run.smithi081.stdout:ceph: stdout ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable) 2024-04-23T14:36:56.525 INFO:teuthology.orchestra.run.smithi081.stdout:Ceph version: ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable) 2024-04-23T14:36:56.525 INFO:teuthology.orchestra.run.smithi081.stdout:Extracting ceph user uid/gid from container image... 2024-04-23T14:36:57.687 INFO:teuthology.orchestra.run.smithi081.stdout:stat: stdout 167 167 2024-04-23T14:36:57.687 INFO:teuthology.orchestra.run.smithi081.stdout:Creating initial keys... 2024-04-23T14:36:58.809 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph-authtool: stdout AQCKxydmmBj1ChAAawGKbVmekjpFfHOhKrS5EA== 2024-04-23T14:37:00.124 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph-authtool: stdout AQCLxydmtwf/GxAA9qkB6YxT6MXl61V6oSp9ew== 2024-04-23T14:37:01.738 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph-authtool: stdout AQCMxydm/GgSIRAADJ4dwCrDcwpEZ5vs9hJrpw== 2024-04-23T14:37:01.740 INFO:teuthology.orchestra.run.smithi081.stdout:Creating initial monmap... 2024-04-23T14:37:02.804 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-23T14:37:02.805 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2024-04-23T14:37:02.805 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 7a641bea-017e-11ef-bc93-c7b262605968 2024-04-23T14:37:02.805 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-23T14:37:02.805 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool for smithi081 [v2:172.21.15.81:3300,v1:172.21.15.81:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-23T14:37:02.805 INFO:teuthology.orchestra.run.smithi081.stdout:setting min_mon_release = octopus 2024-04-23T14:37:02.805 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: set fsid to 7a641bea-017e-11ef-bc93-c7b262605968 2024-04-23T14:37:02.805 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-23T14:37:02.805 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:37:02.805 INFO:teuthology.orchestra.run.smithi081.stdout:Creating mon... 2024-04-23T14:37:03.887 INFO:teuthology.orchestra.run.smithi081.stdout:create mon.smithi081 on 2024-04-23T14:37:04.320 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-04-23T14:37:04.561 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-04-23T14:37:04.826 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-7a641bea-017e-11ef-bc93-c7b262605968.target → /etc/systemd/system/ceph-7a641bea-017e-11ef-bc93-c7b262605968.target. 2024-04-23T14:37:04.826 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-7a641bea-017e-11ef-bc93-c7b262605968.target → /etc/systemd/system/ceph-7a641bea-017e-11ef-bc93-c7b262605968.target. 2024-04-23T14:37:05.143 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-7a641bea-017e-11ef-bc93-c7b262605968@mon.smithi081 2024-04-23T14:37:05.143 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Failed to reset failed state of unit ceph-7a641bea-017e-11ef-bc93-c7b262605968@mon.smithi081.service: Unit ceph-7a641bea-017e-11ef-bc93-c7b262605968@mon.smithi081.service not loaded. 2024-04-23T14:37:05.465 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-7a641bea-017e-11ef-bc93-c7b262605968.target.wants/ceph-7a641bea-017e-11ef-bc93-c7b262605968@mon.smithi081.service → /etc/systemd/system/ceph-7a641bea-017e-11ef-bc93-c7b262605968@.service. 2024-04-23T14:37:06.131 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:05 smithi081 podman[25149]: 2024-04-23 14:37:05.865590588 +0000 UTC m=+0.136684588 container create 8a6b80acc4ea4f7fa341dd2cc6a918b3a86b009dc7dcdbabf21ed8f661993a58 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi081, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, ceph=True, RELEASE=quincy-70d0cb4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-04-23T14:37:06.131 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:06 smithi081 podman[25149]: 2024-04-23 14:37:06.129672203 +0000 UTC m=+0.400766210 container init 8a6b80acc4ea4f7fa341dd2cc6a918b3a86b009dc7dcdbabf21ed8f661993a58 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi081, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=quincy-70d0cb4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T14:37:06.233 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-23T14:37:06.233 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout disabled 2024-04-23T14:37:06.249 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-23T14:37:06.249 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-04-23T14:37:06.249 INFO:teuthology.orchestra.run.smithi081.stdout:firewalld.service is not enabled 2024-04-23T14:37:06.249 INFO:teuthology.orchestra.run.smithi081.stdout:Not possible to enable service . firewalld.service is not available 2024-04-23T14:37:06.250 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mon to start... 2024-04-23T14:37:06.250 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mon... 2024-04-23T14:37:06.396 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:06 smithi081 podman[25149]: 2024-04-23 14:37:06.140590657 +0000 UTC m=+0.411684629 container start 8a6b80acc4ea4f7fa341dd2cc6a918b3a86b009dc7dcdbabf21ed8f661993a58 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi081, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.license=GPLv2, RELEASE=quincy-70d0cb4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, io.buildah.version=1.33.5) 2024-04-23T14:37:06.396 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:06 smithi081 bash[25149]: 8a6b80acc4ea4f7fa341dd2cc6a918b3a86b009dc7dcdbabf21ed8f661993a58 2024-04-23T14:37:06.396 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:06 smithi081 systemd[1]: Started Ceph mon.smithi081 for 7a641bea-017e-11ef-bc93-c7b262605968. 2024-04-23T14:37:06.397 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:06 smithi081 ceph-mon[25168]: mkfs 7a641bea-017e-11ef-bc93-c7b262605968 2024-04-23T14:37:06.397 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:06 smithi081 ceph-mon[25168]: mon.smithi081 is new leader, mons smithi081 in quorum (ranks 0) 2024-04-23T14:37:07.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:07 smithi081 ceph-mon[25168]: mon.smithi081 is new leader, mons smithi081 in quorum (ranks 0) 2024-04-23T14:37:07.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:07 smithi081 ceph-mon[25168]: monmap e1: 1 mons at {smithi081=[v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-23T14:37:07.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:07 smithi081 ceph-mon[25168]: fsmap 2024-04-23T14:37:07.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:07 smithi081 ceph-mon[25168]: osdmap e1: 0 total, 0 up, 0 in 2024-04-23T14:37:07.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:07 smithi081 ceph-mon[25168]: mgrmap e1: no daemons active 2024-04-23T14:37:07.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:07 smithi081 ceph-mon[25168]: from='client.? 172.21.15.81:0/1971795702' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-04-23T14:37:07.641 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout cluster: 2024-04-23T14:37:07.648 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout id: 7a641bea-017e-11ef-bc93-c7b262605968 2024-04-23T14:37:07.648 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-04-23T14:37:07.648 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-04-23T14:37:07.648 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout services: 2024-04-23T14:37:07.648 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi081 (age 0.731439s) 2024-04-23T14:37:07.648 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-04-23T14:37:07.648 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-04-23T14:37:07.648 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-04-23T14:37:07.648 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout data: 2024-04-23T14:37:07.648 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-04-23T14:37:07.648 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-04-23T14:37:07.648 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-04-23T14:37:07.649 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout pgs: 2024-04-23T14:37:07.649 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-04-23T14:37:07.649 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.853+0000 7faba9e00700 1 Processor -- start 2024-04-23T14:37:07.649 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.853+0000 7faba9e00700 1 -- start start 2024-04-23T14:37:07.649 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.854+0000 7faba9e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faba4104c20 0x7faba4105030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:07.649 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.854+0000 7faba9e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba4105600 con 0x7faba4104c20 2024-04-23T14:37:07.649 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.855+0000 7faba2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faba4104c20 0x7faba4105030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:07.649 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.855+0000 7faba2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faba4104c20 0x7faba4105030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56328/0 (socket says 172.21.15.81:56328) 2024-04-23T14:37:07.649 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.855+0000 7faba2a00700 1 -- 172.21.15.81:0/2637673396 learned_addr learned my addr 172.21.15.81:0/2637673396 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:07.649 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.855+0000 7faba2a00700 1 -- 172.21.15.81:0/2637673396 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba4105740 con 0x7faba4104c20 2024-04-23T14:37:07.649 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.856+0000 7faba2a00700 1 --2- 172.21.15.81:0/2637673396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faba4104c20 0x7faba4105030 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fab940098e0 tx=0x7fab94009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1ce908f39b24d9f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:07.649 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.856+0000 7faba1600700 1 -- 172.21.15.81:0/2637673396 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab9400b860 con 0x7faba4104c20 2024-04-23T14:37:07.649 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.856+0000 7faba1600700 1 -- 172.21.15.81:0/2637673396 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9400b9c0 con 0x7faba4104c20 2024-04-23T14:37:07.649 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.856+0000 7faba1600700 1 -- 172.21.15.81:0/2637673396 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab9400bc90 con 0x7faba4104c20 2024-04-23T14:37:07.649 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.857+0000 7faba9e00700 1 -- 172.21.15.81:0/2637673396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faba4104c20 msgr2=0x7faba4105030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:07.650 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.857+0000 7faba9e00700 1 --2- 172.21.15.81:0/2637673396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faba4104c20 0x7faba4105030 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fab940098e0 tx=0x7fab94009250 comp rx=0 tx=0).stop 2024-04-23T14:37:07.650 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.857+0000 7faba9e00700 1 -- 172.21.15.81:0/2637673396 shutdown_connections 2024-04-23T14:37:07.650 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.857+0000 7faba9e00700 1 --2- 172.21.15.81:0/2637673396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faba4104c20 0x7faba4105030 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:07.650 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.857+0000 7faba9e00700 1 -- 172.21.15.81:0/2637673396 >> 172.21.15.81:0/2637673396 conn(0x7faba4078350 msgr2=0x7faba4078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:07.650 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.857+0000 7faba9e00700 1 -- 172.21.15.81:0/2637673396 shutdown_connections 2024-04-23T14:37:07.650 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.857+0000 7faba9e00700 1 -- 172.21.15.81:0/2637673396 wait complete. 2024-04-23T14:37:07.650 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.858+0000 7faba9e00700 1 Processor -- start 2024-04-23T14:37:07.650 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.858+0000 7faba9e00700 1 -- start start 2024-04-23T14:37:07.650 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.859+0000 7faba9e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faba4104c20 0x7faba4113040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:07.650 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.859+0000 7faba9e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba4113580 con 0x7faba4104c20 2024-04-23T14:37:07.650 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.859+0000 7faba2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faba4104c20 0x7faba4113040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:07.650 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.859+0000 7faba2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faba4104c20 0x7faba4113040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56330/0 (socket says 172.21.15.81:56330) 2024-04-23T14:37:07.650 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.859+0000 7faba2a00700 1 -- 172.21.15.81:0/1971795702 learned_addr learned my addr 172.21.15.81:0/1971795702 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:07.650 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.860+0000 7faba2a00700 1 -- 172.21.15.81:0/1971795702 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab940094f0 con 0x7faba4104c20 2024-04-23T14:37:07.650 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.860+0000 7faba2a00700 1 --2- 172.21.15.81:0/1971795702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faba4104c20 0x7faba4113040 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fab94009290 tx=0x7fab94016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:07.650 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.860+0000 7fab9aa00700 1 -- 172.21.15.81:0/1971795702 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab9401c5c0 con 0x7faba4104c20 2024-04-23T14:37:07.651 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.860+0000 7fab9aa00700 1 -- 172.21.15.81:0/1971795702 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9401c740 con 0x7faba4104c20 2024-04-23T14:37:07.651 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.860+0000 7fab9aa00700 1 -- 172.21.15.81:0/1971795702 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab9401ca50 con 0x7faba4104c20 2024-04-23T14:37:07.651 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.860+0000 7faba9e00700 1 -- 172.21.15.81:0/1971795702 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba4113780 con 0x7faba4104c20 2024-04-23T14:37:07.651 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.860+0000 7faba9e00700 1 -- 172.21.15.81:0/1971795702 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba41142f0 con 0x7faba4104c20 2024-04-23T14:37:07.651 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.860+0000 7fab9aa00700 1 -- 172.21.15.81:0/1971795702 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fab9401cbb0 con 0x7faba4104c20 2024-04-23T14:37:07.651 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.861+0000 7fab9aa00700 1 -- 172.21.15.81:0/1971795702 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fab9401ac30 con 0x7faba4104c20 2024-04-23T14:37:07.651 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.861+0000 7faba9e00700 1 -- 172.21.15.81:0/1971795702 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba405f5f0 con 0x7faba4104c20 2024-04-23T14:37:07.651 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.865+0000 7fab9aa00700 1 -- 172.21.15.81:0/1971795702 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7fab9401adf0 con 0x7faba4104c20 2024-04-23T14:37:07.651 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.943+0000 7faba9e00700 1 -- 172.21.15.81:0/1971795702 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7faba41145f0 con 0x7faba4104c20 2024-04-23T14:37:07.651 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.943+0000 7fab9aa00700 1 -- 172.21.15.81:0/1971795702 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7fab94025440 con 0x7faba4104c20 2024-04-23T14:37:07.651 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.945+0000 7faba9e00700 1 -- 172.21.15.81:0/1971795702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faba4104c20 msgr2=0x7faba4113040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:07.651 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.945+0000 7faba9e00700 1 --2- 172.21.15.81:0/1971795702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faba4104c20 0x7faba4113040 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fab94009290 tx=0x7fab94016000 comp rx=0 tx=0).stop 2024-04-23T14:37:07.651 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.946+0000 7faba9e00700 1 -- 172.21.15.81:0/1971795702 shutdown_connections 2024-04-23T14:37:07.651 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.946+0000 7faba9e00700 1 --2- 172.21.15.81:0/1971795702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faba4104c20 0x7faba4113040 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:07.651 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.946+0000 7faba9e00700 1 -- 172.21.15.81:0/1971795702 >> 172.21.15.81:0/1971795702 conn(0x7faba4078350 msgr2=0x7faba41077a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:07.652 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.946+0000 7faba9e00700 1 -- 172.21.15.81:0/1971795702 shutdown_connections 2024-04-23T14:37:07.652 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:06.946+0000 7faba9e00700 1 -- 172.21.15.81:0/1971795702 wait complete. 2024-04-23T14:37:07.652 INFO:teuthology.orchestra.run.smithi081.stdout:mon is available 2024-04-23T14:37:07.652 INFO:teuthology.orchestra.run.smithi081.stdout:Assimilating anything we can from ceph.conf... 2024-04-23T14:37:08.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:08 smithi081 ceph-mon[25168]: from='client.? 172.21.15.81:0/3905739623' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-23T14:37:08.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:08 smithi081 ceph-mon[25168]: from='client.? 172.21.15.81:0/3905739623' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-04-23T14:37:09.001 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-04-23T14:37:09.001 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [global] 2024-04-23T14:37:09.001 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout fsid = 7a641bea-017e-11ef-bc93-c7b262605968 2024-04-23T14:37:09.002 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.81:3300,v1:172.21.15.81:6789] 2024-04-23T14:37:09.002 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-23T14:37:09.002 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-23T14:37:09.002 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-23T14:37:09.002 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-23T14:37:09.002 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-04-23T14:37:09.002 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-23T14:37:09.002 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-23T14:37:09.002 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-04-23T14:37:09.002 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [osd] 2024-04-23T14:37:09.002 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-23T14:37:09.002 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-23T14:37:09.002 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-23T14:37:09.003 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-23T14:37:09.003 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-23T14:37:09.003 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.214+0000 7f6d5fc00700 1 Processor -- start 2024-04-23T14:37:09.003 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.214+0000 7f6d5fc00700 1 -- start start 2024-04-23T14:37:09.003 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.215+0000 7f6d5fc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d58077ad0 0x7f6d58076170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:09.003 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.215+0000 7f6d5fc00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d58077ee0 con 0x7f6d58077ad0 2024-04-23T14:37:09.003 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.215+0000 7f6d5d200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d58077ad0 0x7f6d58076170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:09.003 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.215+0000 7f6d5d200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d58077ad0 0x7f6d58076170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56342/0 (socket says 172.21.15.81:56342) 2024-04-23T14:37:09.003 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.215+0000 7f6d5d200700 1 -- 172.21.15.81:0/3981284984 learned_addr learned my addr 172.21.15.81:0/3981284984 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:09.003 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.216+0000 7f6d5d200700 1 -- 172.21.15.81:0/3981284984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d58078020 con 0x7f6d58077ad0 2024-04-23T14:37:09.003 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.216+0000 7f6d5d200700 1 --2- 172.21.15.81:0/3981284984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d58077ad0 0x7f6d58076170 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c0098e0 tx=0x7f6d4c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3072e6924d3452d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:09.003 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.216+0000 7f6d57400700 1 -- 172.21.15.81:0/3981284984 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6d4c00b8f0 con 0x7f6d58077ad0 2024-04-23T14:37:09.003 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.216+0000 7f6d57400700 1 -- 172.21.15.81:0/3981284984 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4c00ba50 con 0x7f6d58077ad0 2024-04-23T14:37:09.004 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.217+0000 7f6d57400700 1 -- 172.21.15.81:0/3981284984 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6d4c00bd20 con 0x7f6d58077ad0 2024-04-23T14:37:09.004 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.217+0000 7f6d5fc00700 1 -- 172.21.15.81:0/3981284984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d58077ad0 msgr2=0x7f6d58076170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:09.004 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.217+0000 7f6d5fc00700 1 --2- 172.21.15.81:0/3981284984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d58077ad0 0x7f6d58076170 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c0098e0 tx=0x7f6d4c009250 comp rx=0 tx=0).stop 2024-04-23T14:37:09.004 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.217+0000 7f6d5fc00700 1 -- 172.21.15.81:0/3981284984 shutdown_connections 2024-04-23T14:37:09.004 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.217+0000 7f6d5fc00700 1 --2- 172.21.15.81:0/3981284984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d58077ad0 0x7f6d58076170 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:09.004 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.217+0000 7f6d5fc00700 1 -- 172.21.15.81:0/3981284984 >> 172.21.15.81:0/3981284984 conn(0x7f6d580fe0b0 msgr2=0x7f6d58100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:09.004 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.217+0000 7f6d5fc00700 1 -- 172.21.15.81:0/3981284984 shutdown_connections 2024-04-23T14:37:09.004 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.217+0000 7f6d5fc00700 1 -- 172.21.15.81:0/3981284984 wait complete. 2024-04-23T14:37:09.004 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.218+0000 7f6d5fc00700 1 Processor -- start 2024-04-23T14:37:09.004 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.218+0000 7f6d5fc00700 1 -- start start 2024-04-23T14:37:09.004 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.219+0000 7f6d5fc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d58077ad0 0x7f6d581130c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:09.004 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.219+0000 7f6d5fc00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d58113600 con 0x7f6d58077ad0 2024-04-23T14:37:09.004 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.219+0000 7f6d5d200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d58077ad0 0x7f6d581130c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:09.005 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.219+0000 7f6d5d200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d58077ad0 0x7f6d581130c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56356/0 (socket says 172.21.15.81:56356) 2024-04-23T14:37:09.005 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.219+0000 7f6d5d200700 1 -- 172.21.15.81:0/3905739623 learned_addr learned my addr 172.21.15.81:0/3905739623 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:09.005 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.219+0000 7f6d5d200700 1 -- 172.21.15.81:0/3905739623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4c0094f0 con 0x7f6d58077ad0 2024-04-23T14:37:09.005 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.220+0000 7f6d5d200700 1 --2- 172.21.15.81:0/3905739623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d58077ad0 0x7f6d581130c0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c009290 tx=0x7f6d4c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:09.005 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.220+0000 7f6d54c00700 1 -- 172.21.15.81:0/3905739623 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6d4c01c670 con 0x7f6d58077ad0 2024-04-23T14:37:09.005 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.220+0000 7f6d54c00700 1 -- 172.21.15.81:0/3905739623 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4c01c7d0 con 0x7f6d58077ad0 2024-04-23T14:37:09.005 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.220+0000 7f6d5fc00700 1 -- 172.21.15.81:0/3905739623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d58113800 con 0x7f6d58077ad0 2024-04-23T14:37:09.005 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.220+0000 7f6d54c00700 1 -- 172.21.15.81:0/3905739623 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6d4c01cae0 con 0x7f6d58077ad0 2024-04-23T14:37:09.005 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.220+0000 7f6d5fc00700 1 -- 172.21.15.81:0/3905739623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d58114370 con 0x7f6d58077ad0 2024-04-23T14:37:09.005 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.220+0000 7f6d54c00700 1 -- 172.21.15.81:0/3905739623 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f6d4c01ccd0 con 0x7f6d58077ad0 2024-04-23T14:37:09.005 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.220+0000 7f6d54c00700 1 -- 172.21.15.81:0/3905739623 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f6d4c01acf0 con 0x7f6d58077ad0 2024-04-23T14:37:09.005 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.221+0000 7f6d5fc00700 1 -- 172.21.15.81:0/3905739623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d5805f5f0 con 0x7f6d58077ad0 2024-04-23T14:37:09.005 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.224+0000 7f6d54c00700 1 -- 172.21.15.81:0/3905739623 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7f6d4c01a450 con 0x7f6d58077ad0 2024-04-23T14:37:09.005 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.299+0000 7f6d5fc00700 1 -- 172.21.15.81:0/3905739623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f6d58076a20 con 0x7f6d58077ad0 2024-04-23T14:37:09.005 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.305+0000 7f6d54c00700 1 -- 172.21.15.81:0/3905739623 <== mon.0 v2:172.21.15.81:3300/0 7 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f6d4c01b870 con 0x7f6d58077ad0 2024-04-23T14:37:09.006 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.306+0000 7f6d54c00700 1 -- 172.21.15.81:0/3905739623 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f6d58076a20 con 0x7f6d58077ad0 2024-04-23T14:37:09.006 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.307+0000 7f6d5fc00700 1 -- 172.21.15.81:0/3905739623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d58077ad0 msgr2=0x7f6d581130c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:09.006 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.307+0000 7f6d5fc00700 1 --2- 172.21.15.81:0/3905739623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d58077ad0 0x7f6d581130c0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c009290 tx=0x7f6d4c016000 comp rx=0 tx=0).stop 2024-04-23T14:37:09.006 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.307+0000 7f6d5fc00700 1 -- 172.21.15.81:0/3905739623 shutdown_connections 2024-04-23T14:37:09.006 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.307+0000 7f6d5fc00700 1 --2- 172.21.15.81:0/3905739623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d58077ad0 0x7f6d581130c0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:09.006 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.307+0000 7f6d5fc00700 1 -- 172.21.15.81:0/3905739623 >> 172.21.15.81:0/3905739623 conn(0x7f6d580fe0b0 msgr2=0x7f6d58109ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:09.006 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.308+0000 7f6d5fc00700 1 -- 172.21.15.81:0/3905739623 shutdown_connections 2024-04-23T14:37:09.006 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:08.308+0000 7f6d5fc00700 1 -- 172.21.15.81:0/3905739623 wait complete. 2024-04-23T14:37:09.006 INFO:teuthology.orchestra.run.smithi081.stdout:Generating new minimal ceph.conf... 2024-04-23T14:37:10.026 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:09 smithi081 ceph-mon[25168]: from='client.? 172.21.15.81:0/3677581295' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:37:10.306 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.579+0000 7f9edd400700 1 Processor -- start 2024-04-23T14:37:10.306 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.579+0000 7f9edd400700 1 -- start start 2024-04-23T14:37:10.306 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.580+0000 7f9edd400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ed807ce00 0x7f9ed810bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:10.306 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.580+0000 7f9edd400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed807d2a0 con 0x7f9ed807ce00 2024-04-23T14:37:10.306 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.580+0000 7f9ed7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ed807ce00 0x7f9ed810bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:10.306 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.580+0000 7f9ed7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ed807ce00 0x7f9ed810bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56370/0 (socket says 172.21.15.81:56370) 2024-04-23T14:37:10.306 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.580+0000 7f9ed7e00700 1 -- 172.21.15.81:0/4161798273 learned_addr learned my addr 172.21.15.81:0/4161798273 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:10.307 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.581+0000 7f9ed7e00700 1 -- 172.21.15.81:0/4161798273 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed807d3e0 con 0x7f9ed807ce00 2024-04-23T14:37:10.307 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.581+0000 7f9ed7e00700 1 --2- 172.21.15.81:0/4161798273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ed807ce00 0x7f9ed810bce0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9ec80098e0 tx=0x7f9ec8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a53034f16e7e0f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:10.307 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.581+0000 7f9ed6a00700 1 -- 172.21.15.81:0/4161798273 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9ec800b860 con 0x7f9ed807ce00 2024-04-23T14:37:10.307 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.581+0000 7f9ed6a00700 1 -- 172.21.15.81:0/4161798273 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f9ec800be50 con 0x7f9ed807ce00 2024-04-23T14:37:10.307 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.581+0000 7f9ed6a00700 1 -- 172.21.15.81:0/4161798273 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9ec8010380 con 0x7f9ed807ce00 2024-04-23T14:37:10.307 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.582+0000 7f9edd400700 1 -- 172.21.15.81:0/4161798273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ed807ce00 msgr2=0x7f9ed810bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:10.307 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.582+0000 7f9edd400700 1 --2- 172.21.15.81:0/4161798273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ed807ce00 0x7f9ed810bce0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9ec80098e0 tx=0x7f9ec8009250 comp rx=0 tx=0).stop 2024-04-23T14:37:10.307 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.582+0000 7f9edd400700 1 -- 172.21.15.81:0/4161798273 shutdown_connections 2024-04-23T14:37:10.307 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.582+0000 7f9edd400700 1 --2- 172.21.15.81:0/4161798273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ed807ce00 0x7f9ed810bce0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:10.307 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.582+0000 7f9edd400700 1 -- 172.21.15.81:0/4161798273 >> 172.21.15.81:0/4161798273 conn(0x7f9ed8078330 msgr2=0x7f9ed807a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:10.307 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.582+0000 7f9edd400700 1 -- 172.21.15.81:0/4161798273 shutdown_connections 2024-04-23T14:37:10.307 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.582+0000 7f9edd400700 1 -- 172.21.15.81:0/4161798273 wait complete. 2024-04-23T14:37:10.307 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.583+0000 7f9edd400700 1 Processor -- start 2024-04-23T14:37:10.307 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.583+0000 7f9edd400700 1 -- start start 2024-04-23T14:37:10.308 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.583+0000 7f9edd400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ed807ce00 0x7f9ed8117a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:10.308 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.583+0000 7f9edd400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed8117fd0 con 0x7f9ed807ce00 2024-04-23T14:37:10.308 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.583+0000 7f9ed7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ed807ce00 0x7f9ed8117a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:10.308 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.584+0000 7f9ed7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ed807ce00 0x7f9ed8117a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56374/0 (socket says 172.21.15.81:56374) 2024-04-23T14:37:10.308 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.584+0000 7f9ed7e00700 1 -- 172.21.15.81:0/3677581295 learned_addr learned my addr 172.21.15.81:0/3677581295 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:10.308 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.584+0000 7f9ed7e00700 1 -- 172.21.15.81:0/3677581295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec80094f0 con 0x7f9ed807ce00 2024-04-23T14:37:10.308 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.584+0000 7f9ed7e00700 1 --2- 172.21.15.81:0/3677581295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ed807ce00 0x7f9ed8117a90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9ec8006b00 tx=0x7f9ec8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:10.308 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.584+0000 7f9ecfe00700 1 -- 172.21.15.81:0/3677581295 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9ec80107c0 con 0x7f9ed807ce00 2024-04-23T14:37:10.308 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.584+0000 7f9ecfe00700 1 -- 172.21.15.81:0/3677581295 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f9ec8010db0 con 0x7f9ed807ce00 2024-04-23T14:37:10.308 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.584+0000 7f9ecfe00700 1 -- 172.21.15.81:0/3677581295 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9ec801acf0 con 0x7f9ed807ce00 2024-04-23T14:37:10.308 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.584+0000 7f9edd400700 1 -- 172.21.15.81:0/3677581295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ed81181d0 con 0x7f9ed807ce00 2024-04-23T14:37:10.308 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.585+0000 7f9edd400700 1 -- 172.21.15.81:0/3677581295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ed8118d40 con 0x7f9ed807ce00 2024-04-23T14:37:10.308 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.585+0000 7f9ecfe00700 1 -- 172.21.15.81:0/3677581295 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f9ec8024440 con 0x7f9ed807ce00 2024-04-23T14:37:10.308 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.585+0000 7f9ecfe00700 1 -- 172.21.15.81:0/3677581295 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f9ec8019710 con 0x7f9ed807ce00 2024-04-23T14:37:10.308 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.586+0000 7f9edd400700 1 -- 172.21.15.81:0/3677581295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ed805f5f0 con 0x7f9ed807ce00 2024-04-23T14:37:10.308 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.588+0000 7f9ecfe00700 1 -- 172.21.15.81:0/3677581295 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7f9ec801a530 con 0x7f9ed807ce00 2024-04-23T14:37:10.309 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.663+0000 7f9edd400700 1 -- 172.21.15.81:0/3677581295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f9ed810cd00 con 0x7f9ed807ce00 2024-04-23T14:37:10.309 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.664+0000 7f9ecfe00700 1 -- 172.21.15.81:0/3677581295 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f9ec8010920 con 0x7f9ed807ce00 2024-04-23T14:37:10.309 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.666+0000 7f9edd400700 1 -- 172.21.15.81:0/3677581295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ed807ce00 msgr2=0x7f9ed8117a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:10.309 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.666+0000 7f9edd400700 1 --2- 172.21.15.81:0/3677581295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ed807ce00 0x7f9ed8117a90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9ec8006b00 tx=0x7f9ec8009250 comp rx=0 tx=0).stop 2024-04-23T14:37:10.309 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.666+0000 7f9edd400700 1 -- 172.21.15.81:0/3677581295 shutdown_connections 2024-04-23T14:37:10.309 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.666+0000 7f9edd400700 1 --2- 172.21.15.81:0/3677581295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ed807ce00 0x7f9ed8117a90 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:10.309 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.666+0000 7f9edd400700 1 -- 172.21.15.81:0/3677581295 >> 172.21.15.81:0/3677581295 conn(0x7f9ed8078330 msgr2=0x7f9ed8079e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:10.309 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.667+0000 7f9edd400700 1 -- 172.21.15.81:0/3677581295 shutdown_connections 2024-04-23T14:37:10.309 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:09.667+0000 7f9edd400700 1 -- 172.21.15.81:0/3677581295 wait complete. 2024-04-23T14:37:10.309 INFO:teuthology.orchestra.run.smithi081.stdout:Restarting the monitor... 2024-04-23T14:37:10.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:10 smithi081 systemd[1]: Stopping Ceph mon.smithi081 for 7a641bea-017e-11ef-bc93-c7b262605968... 2024-04-23T14:37:11.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:10 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi081[25164]: 2024-04-23T14:37:10.769+0000 7fbf3d200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi081 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T14:37:11.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:10 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi081[25164]: 2024-04-23T14:37:10.769+0000 7fbf3d200700 -1 mon.smithi081@0(leader) e1 *** Got Signal Terminated *** 2024-04-23T14:37:11.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:10 smithi081 podman[25412]: 2024-04-23 14:37:10.862000752 +0000 UTC m=+0.238486620 container died 8a6b80acc4ea4f7fa341dd2cc6a918b3a86b009dc7dcdbabf21ed8f661993a58 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi081, RELEASE=quincy-70d0cb4, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T14:37:11.405 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:11 smithi081 podman[25412]: 2024-04-23 14:37:11.220283883 +0000 UTC m=+0.596769776 container cleanup 8a6b80acc4ea4f7fa341dd2cc6a918b3a86b009dc7dcdbabf21ed8f661993a58 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi081, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, GIT_CLEAN=True, RELEASE=quincy-70d0cb4, ceph=True) 2024-04-23T14:37:11.405 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:11 smithi081 bash[25412]: ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi081 2024-04-23T14:37:11.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:11 smithi081 podman[25425]: 2024-04-23 14:37:11.404381779 +0000 UTC m=+0.523991767 container remove 8a6b80acc4ea4f7fa341dd2cc6a918b3a86b009dc7dcdbabf21ed8f661993a58 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi081, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=quincy-70d0cb4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T14:37:12.250 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:11 smithi081 systemd[1]: ceph-7a641bea-017e-11ef-bc93-c7b262605968@mon.smithi081.service: Deactivated successfully. 2024-04-23T14:37:12.250 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:11 smithi081 systemd[1]: Stopped Ceph mon.smithi081 for 7a641bea-017e-11ef-bc93-c7b262605968. 2024-04-23T14:37:12.250 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:11 smithi081 systemd[1]: ceph-7a641bea-017e-11ef-bc93-c7b262605968@mon.smithi081.service: Consumed 1.799s CPU time. 2024-04-23T14:37:12.250 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:11 smithi081 systemd[1]: Starting Ceph mon.smithi081 for 7a641bea-017e-11ef-bc93-c7b262605968... 2024-04-23T14:37:12.504 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 podman[25521]: 2024-04-23 14:37:12.15878218 +0000 UTC m=+0.036706195 image pull cafd8ddac8fa176bf00aeacab8beaeeffcb0c5261d2d415c33683cb8bed0534e quay.ceph.io/ceph-ci/ceph:quincy 2024-04-23T14:37:12.504 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 podman[25521]: 2024-04-23 14:37:12.267100975 +0000 UTC m=+0.145025009 container create 6e43d934b3363fcd52d6e0fbea127fe2882aab6077bc3f6253422d6c650ca0f5 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi081, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=quincy-70d0cb4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T14:37:12.504 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 podman[25521]: 2024-04-23 14:37:12.492106365 +0000 UTC m=+0.370030403 container init 6e43d934b3363fcd52d6e0fbea127fe2882aab6077bc3f6253422d6c650ca0f5 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi081, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, RELEASE=quincy-70d0cb4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-04-23T14:37:12.592 INFO:teuthology.orchestra.run.smithi081.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-04-23T14:37:12.828 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 podman[25521]: 2024-04-23 14:37:12.502464386 +0000 UTC m=+0.380388400 container start 6e43d934b3363fcd52d6e0fbea127fe2882aab6077bc3f6253422d6c650ca0f5 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi081, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=quincy-70d0cb4, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T14:37:12.828 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: set uid:gid to 167:167 (ceph:ceph) 2024-04-23T14:37:12.828 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable), process ceph-mon, pid 2 2024-04-23T14:37:12.828 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: pidfile_write: ignore empty --pid-file 2024-04-23T14:37:12.828 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: load: jerasure load: lrc 2024-04-23T14:37:12.828 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: RocksDB version: 6.15.5 2024-04-23T14:37:12.828 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-04-23T14:37:12.828 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Compile date Apr 22 2024 2024-04-23T14:37:12.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: DB SUMMARY 2024-04-23T14:37:12.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: DB Session ID: YJ8DWWQSFC2JUJ23N7QR 2024-04-23T14:37:12.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: CURRENT file: CURRENT 2024-04-23T14:37:12.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: IDENTITY file: IDENTITY 2024-04-23T14:37:12.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-04-23T14:37:12.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi081/store.db dir, Total Num: 1, files: 000008.sst 2024-04-23T14:37:12.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi081/store.db: 000010.log size: 98170 ; 2024-04-23T14:37:12.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.error_if_exists: 0 2024-04-23T14:37:12.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.create_if_missing: 0 2024-04-23T14:37:12.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.paranoid_checks: 1 2024-04-23T14:37:12.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-23T14:37:12.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.env: 0x55aca6a9eb00 2024-04-23T14:37:12.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.fs: Posix File System 2024-04-23T14:37:12.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.info_log: 0x55acb3655c00 2024-04-23T14:37:12.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.max_file_opening_threads: 16 2024-04-23T14:37:12.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.statistics: (nil) 2024-04-23T14:37:12.830 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.use_fsync: 0 2024-04-23T14:37:12.830 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.max_log_file_size: 0 2024-04-23T14:37:12.830 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-23T14:37:12.830 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-23T14:37:12.830 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.keep_log_file_num: 1000 2024-04-23T14:37:12.830 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.recycle_log_file_num: 0 2024-04-23T14:37:12.830 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.allow_fallocate: 1 2024-04-23T14:37:12.830 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.allow_mmap_reads: 0 2024-04-23T14:37:12.830 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.allow_mmap_writes: 0 2024-04-23T14:37:12.831 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.use_direct_reads: 0 2024-04-23T14:37:12.831 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-23T14:37:12.831 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.create_missing_column_families: 0 2024-04-23T14:37:12.831 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.db_log_dir: 2024-04-23T14:37:12.831 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi081/store.db 2024-04-23T14:37:12.831 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-23T14:37:12.831 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-23T14:37:12.831 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-23T14:37:12.832 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-23T14:37:12.832 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-23T14:37:12.832 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-23T14:37:12.832 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.advise_random_on_open: 1 2024-04-23T14:37:12.832 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.db_write_buffer_size: 0 2024-04-23T14:37:12.832 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.write_buffer_manager: 0x55acb43caa20 2024-04-23T14:37:12.832 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-23T14:37:12.832 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-04-23T14:37:12.832 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-23T14:37:12.832 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-23T14:37:12.832 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.rate_limiter: (nil) 2024-04-23T14:37:12.832 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-23T14:37:12.832 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.wal_recovery_mode: 2 2024-04-23T14:37:12.833 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.enable_thread_tracking: 0 2024-04-23T14:37:12.833 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.enable_pipelined_write: 0 2024-04-23T14:37:12.833 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.unordered_write: 0 2024-04-23T14:37:12.833 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-23T14:37:12.833 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-23T14:37:12.833 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-23T14:37:12.833 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-23T14:37:12.833 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.row_cache: None 2024-04-23T14:37:12.833 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.wal_filter: None 2024-04-23T14:37:12.833 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-23T14:37:12.833 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.allow_ingest_behind: 0 2024-04-23T14:37:12.833 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.preserve_deletes: 0 2024-04-23T14:37:12.833 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.two_write_queues: 0 2024-04-23T14:37:12.833 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.manual_wal_flush: 0 2024-04-23T14:37:12.834 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.atomic_flush: 0 2024-04-23T14:37:12.834 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-23T14:37:12.834 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-23T14:37:12.834 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-23T14:37:12.834 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.log_readahead_size: 0 2024-04-23T14:37:12.834 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-23T14:37:12.834 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.best_efforts_recovery: 0 2024-04-23T14:37:12.834 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-23T14:37:12.834 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-23T14:37:12.834 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.allow_data_in_errors: 0 2024-04-23T14:37:12.834 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.db_host_id: __hostname__ 2024-04-23T14:37:12.834 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.max_background_jobs: 2 2024-04-23T14:37:12.834 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.max_background_compactions: -1 2024-04-23T14:37:12.834 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.max_subcompactions: 1 2024-04-23T14:37:12.835 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-23T14:37:12.835 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-23T14:37:12.835 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-23T14:37:12.835 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.max_total_wal_size: 0 2024-04-23T14:37:12.835 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-23T14:37:12.835 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-23T14:37:12.835 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-23T14:37:12.835 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-23T14:37:12.835 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.max_open_files: -1 2024-04-23T14:37:12.835 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.bytes_per_sync: 0 2024-04-23T14:37:12.835 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-23T14:37:12.835 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-23T14:37:12.835 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.compaction_readahead_size: 0 2024-04-23T14:37:12.835 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.max_background_flushes: -1 2024-04-23T14:37:12.835 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Compression algorithms supported: 2024-04-23T14:37:12.836 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-23T14:37:12.836 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: kZSTD supported: 0 2024-04-23T14:37:12.836 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: kXpressCompression supported: 0 2024-04-23T14:37:12.836 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: kLZ4HCCompression supported: 1 2024-04-23T14:37:12.836 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: kZlibCompression supported: 1 2024-04-23T14:37:12.836 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: kSnappyCompression supported: 1 2024-04-23T14:37:12.836 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: kLZ4Compression supported: 1 2024-04-23T14:37:12.836 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: kBZip2Compression supported: 0 2024-04-23T14:37:12.836 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-23T14:37:12.836 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi081/store.db/MANIFEST-000009 2024-04-23T14:37:12.836 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-04-23T14:37:12.836 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-23T14:37:12.836 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.merge_operator: 2024-04-23T14:37:12.836 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.compaction_filter: None 2024-04-23T14:37:12.836 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.compaction_filter_factory: None 2024-04-23T14:37:12.837 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.sst_partitioner_factory: None 2024-04-23T14:37:12.837 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-23T14:37:12.837 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-23T14:37:12.837 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55acb36aaf58) 2024-04-23T14:37:12.837 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: cache_index_and_filter_blocks: 1 2024-04-23T14:37:12.837 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-23T14:37:12.837 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-23T14:37:12.837 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: pin_top_level_index_and_filter: 1 2024-04-23T14:37:12.837 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: index_type: 0 2024-04-23T14:37:12.837 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: data_block_index_type: 0 2024-04-23T14:37:12.837 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: index_shortening: 1 2024-04-23T14:37:12.837 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-23T14:37:12.837 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: hash_index_allow_collision: 1 2024-04-23T14:37:12.837 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: checksum: 1 2024-04-23T14:37:12.837 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: no_block_cache: 0 2024-04-23T14:37:12.837 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: block_cache: 0x55acb36dd090 2024-04-23T14:37:12.838 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: block_cache_name: BinnedLRUCache 2024-04-23T14:37:12.838 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: block_cache_options: 2024-04-23T14:37:12.838 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: capacity : 536870912 2024-04-23T14:37:12.838 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: num_shard_bits : 4 2024-04-23T14:37:12.838 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: strict_capacity_limit : 0 2024-04-23T14:37:12.838 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: high_pri_pool_ratio: 0.000 2024-04-23T14:37:12.838 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: block_cache_compressed: (nil) 2024-04-23T14:37:12.838 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: persistent_cache: (nil) 2024-04-23T14:37:12.838 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: block_size: 4096 2024-04-23T14:37:12.838 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: block_size_deviation: 10 2024-04-23T14:37:12.838 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: block_restart_interval: 16 2024-04-23T14:37:12.838 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: index_block_restart_interval: 1 2024-04-23T14:37:12.838 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: metadata_block_size: 4096 2024-04-23T14:37:12.838 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: partition_filters: 0 2024-04-23T14:37:12.838 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: use_delta_encoding: 1 2024-04-23T14:37:12.839 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-04-23T14:37:12.839 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: whole_key_filtering: 1 2024-04-23T14:37:12.839 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: verify_compression: 0 2024-04-23T14:37:12.839 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: read_amp_bytes_per_bit: 0 2024-04-23T14:37:12.839 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: format_version: 4 2024-04-23T14:37:12.839 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: enable_index_compression: 1 2024-04-23T14:37:12.839 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: block_align: 0 2024-04-23T14:37:12.839 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.write_buffer_size: 33554432 2024-04-23T14:37:12.839 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.max_write_buffer_number: 2 2024-04-23T14:37:12.839 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.compression: NoCompression 2024-04-23T14:37:12.839 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.bottommost_compression: Disabled 2024-04-23T14:37:12.839 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.prefix_extractor: nullptr 2024-04-23T14:37:12.839 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-23T14:37:12.839 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.num_levels: 7 2024-04-23T14:37:12.839 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-23T14:37:12.839 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-23T14:37:12.839 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-23T14:37:12.840 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-23T14:37:12.840 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-23T14:37:12.840 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-23T14:37:12.840 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-23T14:37:12.841 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-23T14:37:12.841 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-23T14:37:12.841 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-23T14:37:12.841 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-23T14:37:12.841 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.compression_opts.level: 32767 2024-04-23T14:37:12.841 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.compression_opts.strategy: 0 2024-04-23T14:37:12.841 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-23T14:37:12.841 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-23T14:37:12.841 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-23T14:37:12.841 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.compression_opts.enabled: false 2024-04-23T14:37:12.841 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-23T14:37:12.841 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-23T14:37:12.841 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-23T14:37:12.841 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.target_file_size_base: 67108864 2024-04-23T14:37:12.841 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-23T14:37:12.842 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-23T14:37:12.842 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-23T14:37:12.842 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-23T14:37:12.842 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-23T14:37:12.842 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-23T14:37:12.842 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-23T14:37:12.842 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-23T14:37:12.842 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-23T14:37:12.842 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-23T14:37:12.842 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-23T14:37:12.842 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-23T14:37:12.842 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-23T14:37:12.842 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.arena_block_size: 4194304 2024-04-23T14:37:12.842 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-23T14:37:12.843 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-23T14:37:12.843 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-04-23T14:37:12.843 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.disable_auto_compactions: 0 2024-04-23T14:37:12.843 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-23T14:37:12.843 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-23T14:37:12.843 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-23T14:37:12.843 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-23T14:37:12.843 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-23T14:37:12.843 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-23T14:37:12.843 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-23T14:37:12.843 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-23T14:37:12.843 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-23T14:37:12.843 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-23T14:37:12.843 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.table_properties_collectors: 2024-04-23T14:37:12.843 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.inplace_update_support: 0 2024-04-23T14:37:12.843 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-23T14:37:12.844 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-23T14:37:12.844 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-23T14:37:12.844 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-23T14:37:12.844 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.bloom_locality: 0 2024-04-23T14:37:12.844 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.max_successive_merges: 0 2024-04-23T14:37:12.844 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-23T14:37:12.844 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.paranoid_file_checks: 0 2024-04-23T14:37:12.844 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.force_consistency_checks: 1 2024-04-23T14:37:12.844 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.report_bg_io_stats: 0 2024-04-23T14:37:12.844 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.ttl: 2592000 2024-04-23T14:37:12.844 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-23T14:37:12.844 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.enable_blob_files: false 2024-04-23T14:37:12.844 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.min_blob_size: 0 2024-04-23T14:37:12.844 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.blob_file_size: 268435456 2024-04-23T14:37:12.844 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-23T14:37:12.844 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-23T14:37:12.844 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-23T14:37:12.845 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi081/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-23T14:37:12.845 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2024-04-23T14:37:12.845 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2024-04-23T14:37:12.845 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713883032557368, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-04-23T14:37:12.845 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2024-04-23T14:37:12.845 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-04-23T14:37:12.845 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713883032559132, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 93376, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 91488, "index_size": 248, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13576, "raw_average_key_size": 49, "raw_value_size": 84052, "raw_average_value_size": 307, "num_data_blocks": 11, "num_entries": 273, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1713883032, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "2dad8224-b58f-4a04-9af3-24c09c15ca67", "db_session_id": "YJ8DWWQSFC2JUJ23N7QR"}} 2024-04-23T14:37:12.845 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2024-04-23T14:37:12.845 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713883032559868, "job": 1, "event": "recovery_finished"} 2024-04-23T14:37:12.845 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi081/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-23T14:37:12.845 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55acb3671180 2024-04-23T14:37:12.845 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: DB pointer 0x55acb3746000 2024-04-23T14:37:12.845 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-04-23T14:37:12.845 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-04-23T14:37:12.846 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: ** DB Stats ** 2024-04-23T14:37:12.846 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-23T14:37:12.846 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-23T14:37:12.846 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-23T14:37:12.846 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-23T14:37:12.846 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-23T14:37:12.846 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-04-23T14:37:12.846 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-23T14:37:12.846 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: 2024-04-23T14:37:12.846 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: ** Compaction Stats [default] ** 2024-04-23T14:37:12.846 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-23T14:37:12.846 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-23T14:37:12.846 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: L0 2/0 92.99 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 73.6 0.00 0.00 1 0.001 0 0 2024-04-23T14:37:12.846 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Sum 2/0 92.99 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 73.6 0.00 0.00 1 0.001 0 0 2024-04-23T14:37:12.847 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 73.6 0.00 0.00 1 0.001 0 0 2024-04-23T14:37:12.847 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: 2024-04-23T14:37:12.847 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: ** Compaction Stats [default] ** 2024-04-23T14:37:12.847 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-23T14:37:12.847 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-23T14:37:12.847 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 73.6 0.00 0.00 1 0.001 0 0 2024-04-23T14:37:12.847 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-23T14:37:12.847 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-23T14:37:12.847 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-23T14:37:12.847 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-23T14:37:12.847 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-23T14:37:12.847 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-23T14:37:12.847 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Cumulative compaction: 0.00 GB write, 11.90 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-23T14:37:12.847 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Interval compaction: 0.00 GB write, 11.90 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-23T14:37:12.847 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-23T14:37:12.847 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: 2024-04-23T14:37:12.847 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-23T14:37:12.848 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: 2024-04-23T14:37:12.848 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: ** Compaction Stats [default] ** 2024-04-23T14:37:12.848 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-23T14:37:12.848 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-23T14:37:12.848 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: L0 2/0 92.99 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 73.6 0.00 0.00 1 0.001 0 0 2024-04-23T14:37:12.848 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Sum 2/0 92.99 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 73.6 0.00 0.00 1 0.001 0 0 2024-04-23T14:37:12.848 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-04-23T14:37:12.848 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: 2024-04-23T14:37:12.848 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: ** Compaction Stats [default] ** 2024-04-23T14:37:12.848 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-23T14:37:12.848 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-23T14:37:12.848 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 73.6 0.00 0.00 1 0.001 0 0 2024-04-23T14:37:12.848 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-23T14:37:12.848 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-23T14:37:12.848 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-23T14:37:12.848 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-23T14:37:12.849 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-23T14:37:12.849 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-23T14:37:12.849 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Cumulative compaction: 0.00 GB write, 11.76 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-23T14:37:12.849 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-23T14:37:12.849 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-23T14:37:12.849 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: 2024-04-23T14:37:12.849 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-23T14:37:12.849 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: starting mon.smithi081 rank 0 at public addrs [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] at bind addrs [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi081 fsid 7a641bea-017e-11ef-bc93-c7b262605968 2024-04-23T14:37:12.849 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: mon.smithi081@-1(???) e1 preinit fsid 7a641bea-017e-11ef-bc93-c7b262605968 2024-04-23T14:37:12.849 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: mon.smithi081@-1(???).mds e1 new map 2024-04-23T14:37:12.849 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: mon.smithi081@-1(???).mds e1 print_map 2024-04-23T14:37:12.849 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: e1 2024-04-23T14:37:12.849 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-23T14:37:12.849 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:37:12.849 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: legacy client fscid: -1 2024-04-23T14:37:12.849 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: 2024-04-23T14:37:12.850 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: No filesystems configured 2024-04-23T14:37:12.850 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: mon.smithi081@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-23T14:37:12.850 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: mon.smithi081@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-23T14:37:12.850 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: mon.smithi081@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-23T14:37:12.850 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: mon.smithi081@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-23T14:37:12.850 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: mon.smithi081@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-04-23T14:37:12.850 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 bash[25521]: 6e43d934b3363fcd52d6e0fbea127fe2882aab6077bc3f6253422d6c650ca0f5 2024-04-23T14:37:12.850 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 systemd[1]: Started Ceph mon.smithi081 for 7a641bea-017e-11ef-bc93-c7b262605968. 2024-04-23T14:37:12.850 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: mon.smithi081 is new leader, mons smithi081 in quorum (ranks 0) 2024-04-23T14:37:12.850 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: monmap e1: 1 mons at {smithi081=[v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-23T14:37:12.850 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: fsmap 2024-04-23T14:37:12.850 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: osdmap e1: 0 total, 0 up, 0 in 2024-04-23T14:37:12.850 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:12 smithi081 ceph-mon[25540]: mgrmap e1: no daemons active 2024-04-23T14:37:13.918 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.182+0000 7fa753200700 1 Processor -- start 2024-04-23T14:37:13.918 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.182+0000 7fa753200700 1 -- start start 2024-04-23T14:37:13.918 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.182+0000 7fa753200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa74c078ca0 0x7fa74c0772a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:13.919 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.182+0000 7fa753200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c0790b0 con 0x7fa74c078ca0 2024-04-23T14:37:13.919 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.183+0000 7fa74be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa74c078ca0 0x7fa74c0772a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:13.919 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.183+0000 7fa74be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa74c078ca0 0x7fa74c0772a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56380/0 (socket says 172.21.15.81:56380) 2024-04-23T14:37:13.919 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.183+0000 7fa74be00700 1 -- 172.21.15.81:0/780117218 learned_addr learned my addr 172.21.15.81:0/780117218 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:13.919 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.184+0000 7fa74be00700 1 -- 172.21.15.81:0/780117218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa74c0777e0 con 0x7fa74c078ca0 2024-04-23T14:37:13.919 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.184+0000 7fa74be00700 1 --2- 172.21.15.81:0/780117218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa74c078ca0 0x7fa74c0772a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0098e0 tx=0x7fa73c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a40b39c229cfad89 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:13.919 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.184+0000 7fa74aa00700 1 -- 172.21.15.81:0/780117218 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa73c00b860 con 0x7fa74c078ca0 2024-04-23T14:37:13.919 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.184+0000 7fa74aa00700 1 -- 172.21.15.81:0/780117218 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fa73c00be50 con 0x7fa74c078ca0 2024-04-23T14:37:13.919 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.184+0000 7fa74aa00700 1 -- 172.21.15.81:0/780117218 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa73c010380 con 0x7fa74c078ca0 2024-04-23T14:37:13.919 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.185+0000 7fa753200700 1 -- 172.21.15.81:0/780117218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa74c078ca0 msgr2=0x7fa74c0772a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:13.919 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.185+0000 7fa753200700 1 --2- 172.21.15.81:0/780117218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa74c078ca0 0x7fa74c0772a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0098e0 tx=0x7fa73c009250 comp rx=0 tx=0).stop 2024-04-23T14:37:13.919 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.185+0000 7fa753200700 1 -- 172.21.15.81:0/780117218 shutdown_connections 2024-04-23T14:37:13.919 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.185+0000 7fa753200700 1 --2- 172.21.15.81:0/780117218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa74c078ca0 0x7fa74c0772a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:13.919 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.185+0000 7fa753200700 1 -- 172.21.15.81:0/780117218 >> 172.21.15.81:0/780117218 conn(0x7fa74c0fe0b0 msgr2=0x7fa74c1004c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:13.919 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.185+0000 7fa753200700 1 -- 172.21.15.81:0/780117218 shutdown_connections 2024-04-23T14:37:13.919 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.185+0000 7fa753200700 1 -- 172.21.15.81:0/780117218 wait complete. 2024-04-23T14:37:13.920 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.186+0000 7fa753200700 1 Processor -- start 2024-04-23T14:37:13.920 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.186+0000 7fa753200700 1 -- start start 2024-04-23T14:37:13.920 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.186+0000 7fa753200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa74c078ca0 0x7fa74c1139f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:13.920 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.186+0000 7fa753200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c113f30 con 0x7fa74c078ca0 2024-04-23T14:37:13.920 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.187+0000 7fa74be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa74c078ca0 0x7fa74c1139f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:13.920 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.187+0000 7fa74be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa74c078ca0 0x7fa74c1139f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56396/0 (socket says 172.21.15.81:56396) 2024-04-23T14:37:13.920 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.187+0000 7fa74be00700 1 -- 172.21.15.81:0/645812232 learned_addr learned my addr 172.21.15.81:0/645812232 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:13.920 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.187+0000 7fa74be00700 1 -- 172.21.15.81:0/645812232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c0094f0 con 0x7fa74c078ca0 2024-04-23T14:37:13.920 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.187+0000 7fa74be00700 1 --2- 172.21.15.81:0/645812232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa74c078ca0 0x7fa74c1139f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa73c006d40 tx=0x7fa73c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:13.920 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.188+0000 7fa743e00700 1 -- 172.21.15.81:0/645812232 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa73c0107c0 con 0x7fa74c078ca0 2024-04-23T14:37:13.920 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.188+0000 7fa743e00700 1 -- 172.21.15.81:0/645812232 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fa73c010db0 con 0x7fa74c078ca0 2024-04-23T14:37:13.920 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.188+0000 7fa753200700 1 -- 172.21.15.81:0/645812232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa74c114130 con 0x7fa74c078ca0 2024-04-23T14:37:13.920 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.188+0000 7fa743e00700 1 -- 172.21.15.81:0/645812232 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa73c01ad40 con 0x7fa74c078ca0 2024-04-23T14:37:13.920 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.188+0000 7fa753200700 1 -- 172.21.15.81:0/645812232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa74c114ca0 con 0x7fa74c078ca0 2024-04-23T14:37:13.921 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.188+0000 7fa743e00700 1 -- 172.21.15.81:0/645812232 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fa73c025450 con 0x7fa74c078ca0 2024-04-23T14:37:13.921 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.188+0000 7fa743e00700 1 -- 172.21.15.81:0/645812232 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa73c019710 con 0x7fa74c078ca0 2024-04-23T14:37:13.921 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.189+0000 7fa753200700 1 -- 172.21.15.81:0/645812232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa74c05f5f0 con 0x7fa74c078ca0 2024-04-23T14:37:13.921 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.192+0000 7fa743e00700 1 -- 172.21.15.81:0/645812232 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7fa73c02a060 con 0x7fa74c078ca0 2024-04-23T14:37:13.921 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.267+0000 7fa753200700 1 -- 172.21.15.81:0/645812232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fa74c108b30 con 0x7fa74c078ca0 2024-04-23T14:37:13.921 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.273+0000 7fa743e00700 1 -- 172.21.15.81:0/645812232 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fa73c020070 con 0x7fa74c078ca0 2024-04-23T14:37:13.921 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.274+0000 7fa753200700 1 -- 172.21.15.81:0/645812232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa74c078ca0 msgr2=0x7fa74c1139f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:13.921 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.274+0000 7fa753200700 1 --2- 172.21.15.81:0/645812232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa74c078ca0 0x7fa74c1139f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa73c006d40 tx=0x7fa73c009250 comp rx=0 tx=0).stop 2024-04-23T14:37:13.921 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.274+0000 7fa753200700 1 -- 172.21.15.81:0/645812232 shutdown_connections 2024-04-23T14:37:13.921 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.274+0000 7fa753200700 1 --2- 172.21.15.81:0/645812232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa74c078ca0 0x7fa74c1139f0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:13.921 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.274+0000 7fa753200700 1 -- 172.21.15.81:0/645812232 >> 172.21.15.81:0/645812232 conn(0x7fa74c0fe0b0 msgr2=0x7fa74c0fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:13.921 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.275+0000 7fa753200700 1 -- 172.21.15.81:0/645812232 shutdown_connections 2024-04-23T14:37:13.921 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:13.275+0000 7fa753200700 1 -- 172.21.15.81:0/645812232 wait complete. 2024-04-23T14:37:13.921 INFO:teuthology.orchestra.run.smithi081.stdout:Wrote config to /etc/ceph/ceph.conf 2024-04-23T14:37:13.921 INFO:teuthology.orchestra.run.smithi081.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-04-23T14:37:13.922 INFO:teuthology.orchestra.run.smithi081.stdout:Creating mgr... 2024-04-23T14:37:13.922 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying port 9283 ... 2024-04-23T14:37:14.262 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-7a641bea-017e-11ef-bc93-c7b262605968@mgr.smithi081.ldghvq 2024-04-23T14:37:14.262 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Failed to reset failed state of unit ceph-7a641bea-017e-11ef-bc93-c7b262605968@mgr.smithi081.ldghvq.service: Unit ceph-7a641bea-017e-11ef-bc93-c7b262605968@mgr.smithi081.ldghvq.service not loaded. 2024-04-23T14:37:14.527 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-7a641bea-017e-11ef-bc93-c7b262605968.target.wants/ceph-7a641bea-017e-11ef-bc93-c7b262605968@mgr.smithi081.ldghvq.service → /etc/systemd/system/ceph-7a641bea-017e-11ef-bc93-c7b262605968@.service. 2024-04-23T14:37:14.568 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:14 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/645812232' entity='client.admin' 2024-04-23T14:37:15.281 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-23T14:37:15.281 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout disabled 2024-04-23T14:37:15.296 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-23T14:37:15.297 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-04-23T14:37:15.297 INFO:teuthology.orchestra.run.smithi081.stdout:firewalld.service is not enabled 2024-04-23T14:37:15.297 INFO:teuthology.orchestra.run.smithi081.stdout:Not possible to enable service . firewalld.service is not available 2024-04-23T14:37:15.316 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-23T14:37:15.316 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout disabled 2024-04-23T14:37:15.333 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-23T14:37:15.333 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-04-23T14:37:15.333 INFO:teuthology.orchestra.run.smithi081.stdout:firewalld.service is not enabled 2024-04-23T14:37:15.333 INFO:teuthology.orchestra.run.smithi081.stdout:Not possible to open ports <[9283]>. firewalld.service is not available 2024-04-23T14:37:15.333 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mgr to start... 2024-04-23T14:37:15.333 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mgr... 2024-04-23T14:37:16.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:16 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/2746254862' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-23T14:37:16.792 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-04-23T14:37:16.792 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-04-23T14:37:16.792 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsid": "7a641bea-017e-11ef-bc93-c7b262605968", 2024-04-23T14:37:16.792 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "health": { 2024-04-23T14:37:16.792 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-23T14:37:16.792 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-23T14:37:16.792 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-23T14:37:16.792 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:16.793 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-23T14:37:16.793 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-23T14:37:16.793 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 0 2024-04-23T14:37:16.793 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-04-23T14:37:16.793 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-23T14:37:16.793 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "smithi081" 2024-04-23T14:37:16.793 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-04-23T14:37:16.793 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-04-23T14:37:16.793 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-23T14:37:16.793 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T14:37:16.794 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-04-23T14:37:16.794 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-23T14:37:16.794 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:16.794 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-23T14:37:16.794 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T14:37:16.794 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-23T14:37:16.794 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-23T14:37:16.794 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-23T14:37:16.794 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-23T14:37:16.794 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-23T14:37:16.794 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-23T14:37:16.802 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:16.802 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-23T14:37:16.802 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-23T14:37:16.802 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-23T14:37:16.802 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-23T14:37:16.802 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-23T14:37:16.802 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-23T14:37:16.802 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-23T14:37:16.802 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-23T14:37:16.802 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-23T14:37:16.803 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:16.803 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-23T14:37:16.803 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T14:37:16.803 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-23T14:37:16.803 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-23T14:37:16.803 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:16.803 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-23T14:37:16.803 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-23T14:37:16.803 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-23T14:37:16.803 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-23T14:37:16.803 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-23T14:37:16.803 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-23T14:37:16.803 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "restful" 2024-04-23T14:37:16.803 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-04-23T14:37:16.804 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-23T14:37:16.804 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:16.804 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-23T14:37:16.804 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T14:37:16.804 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modified": "2024-04-23T14:37:06.214618+0000", 2024-04-23T14:37:16.804 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-23T14:37:16.804 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:16.804 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-23T14:37:16.804 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-04-23T14:37:16.804 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:15.964+0000 7effa1800700 1 Processor -- start 2024-04-23T14:37:16.804 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:15.964+0000 7effa1800700 1 -- start start 2024-04-23T14:37:16.804 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:15.965+0000 7effa1800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff9c077ad0 0x7eff9c076170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:16.804 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:15.965+0000 7effa1800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c077ee0 con 0x7eff9c077ad0 2024-04-23T14:37:16.804 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:15.965+0000 7eff9aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff9c077ad0 0x7eff9c076170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:16.804 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:15.966+0000 7eff9aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff9c077ad0 0x7eff9c076170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42330/0 (socket says 172.21.15.81:42330) 2024-04-23T14:37:16.805 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:15.966+0000 7eff9aa00700 1 -- 172.21.15.81:0/2336056008 learned_addr learned my addr 172.21.15.81:0/2336056008 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:16.805 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:15.966+0000 7eff9aa00700 1 -- 172.21.15.81:0/2336056008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff9c078020 con 0x7eff9c077ad0 2024-04-23T14:37:16.805 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:15.966+0000 7eff9aa00700 1 --2- 172.21.15.81:0/2336056008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff9c077ad0 0x7eff9c076170 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7eff8c0098e0 tx=0x7eff8c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e90b8c8a4660f2c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:16.805 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:15.967+0000 7eff99600700 1 -- 172.21.15.81:0/2336056008 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7eff8c00b8f0 con 0x7eff9c077ad0 2024-04-23T14:37:16.805 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:15.967+0000 7eff99600700 1 -- 172.21.15.81:0/2336056008 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7eff8c011420 con 0x7eff9c077ad0 2024-04-23T14:37:16.805 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:15.967+0000 7eff99600700 1 -- 172.21.15.81:0/2336056008 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7eff8c010540 con 0x7eff9c077ad0 2024-04-23T14:37:16.805 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:15.967+0000 7effa1800700 1 -- 172.21.15.81:0/2336056008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff9c077ad0 msgr2=0x7eff9c076170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:16.805 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:15.967+0000 7effa1800700 1 --2- 172.21.15.81:0/2336056008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff9c077ad0 0x7eff9c076170 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7eff8c0098e0 tx=0x7eff8c009250 comp rx=0 tx=0).stop 2024-04-23T14:37:16.805 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:15.968+0000 7effa1800700 1 -- 172.21.15.81:0/2336056008 shutdown_connections 2024-04-23T14:37:16.805 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:15.968+0000 7effa1800700 1 --2- 172.21.15.81:0/2336056008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff9c077ad0 0x7eff9c076170 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:16.805 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:15.968+0000 7effa1800700 1 -- 172.21.15.81:0/2336056008 >> 172.21.15.81:0/2336056008 conn(0x7eff9c0fe0b0 msgr2=0x7eff9c100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:16.805 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:15.968+0000 7effa1800700 1 -- 172.21.15.81:0/2336056008 shutdown_connections 2024-04-23T14:37:16.806 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:15.968+0000 7effa1800700 1 -- 172.21.15.81:0/2336056008 wait complete. 2024-04-23T14:37:16.806 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:15.969+0000 7effa1800700 1 Processor -- start 2024-04-23T14:37:16.806 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:15.969+0000 7effa1800700 1 -- start start 2024-04-23T14:37:16.806 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:15.969+0000 7effa1800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff9c077ad0 0x7eff9c1139b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:16.806 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:15.969+0000 7effa1800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c113ef0 con 0x7eff9c077ad0 2024-04-23T14:37:16.806 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:15.969+0000 7eff9aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff9c077ad0 0x7eff9c1139b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:16.806 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:15.969+0000 7eff9aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff9c077ad0 0x7eff9c1139b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42336/0 (socket says 172.21.15.81:42336) 2024-04-23T14:37:16.806 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:15.969+0000 7eff9aa00700 1 -- 172.21.15.81:0/2746254862 learned_addr learned my addr 172.21.15.81:0/2746254862 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:16.806 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:15.970+0000 7eff9aa00700 1 -- 172.21.15.81:0/2746254862 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8c0094f0 con 0x7eff9c077ad0 2024-04-23T14:37:16.806 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:15.970+0000 7eff9aa00700 1 --2- 172.21.15.81:0/2746254862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff9c077ad0 0x7eff9c1139b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7eff8c011db0 tx=0x7eff8c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:16.807 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:15.970+0000 7eff92a00700 1 -- 172.21.15.81:0/2746254862 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7eff8c0107b0 con 0x7eff9c077ad0 2024-04-23T14:37:16.807 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:15.970+0000 7eff92a00700 1 -- 172.21.15.81:0/2746254862 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7eff8c010da0 con 0x7eff9c077ad0 2024-04-23T14:37:16.807 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:15.970+0000 7effa1800700 1 -- 172.21.15.81:0/2746254862 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff9c1140f0 con 0x7eff9c077ad0 2024-04-23T14:37:16.807 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:15.970+0000 7eff92a00700 1 -- 172.21.15.81:0/2746254862 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7eff8c01ad60 con 0x7eff9c077ad0 2024-04-23T14:37:16.807 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:15.971+0000 7effa1800700 1 -- 172.21.15.81:0/2746254862 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff9c114c60 con 0x7eff9c077ad0 2024-04-23T14:37:16.807 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:15.971+0000 7eff92a00700 1 -- 172.21.15.81:0/2746254862 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7eff8c02e440 con 0x7eff9c077ad0 2024-04-23T14:37:16.807 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:15.971+0000 7eff92a00700 1 -- 172.21.15.81:0/2746254862 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7eff8c024790 con 0x7eff9c077ad0 2024-04-23T14:37:16.807 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:15.972+0000 7effa1800700 1 -- 172.21.15.81:0/2746254862 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff9c05f5f0 con 0x7eff9c077ad0 2024-04-23T14:37:16.807 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:15.974+0000 7eff92a00700 1 -- 172.21.15.81:0/2746254862 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7eff8c01a5c0 con 0x7eff9c077ad0 2024-04-23T14:37:16.808 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:16.052+0000 7effa1800700 1 -- 172.21.15.81:0/2746254862 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7eff9c108aa0 con 0x7eff9c077ad0 2024-04-23T14:37:16.808 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:16.052+0000 7eff92a00700 1 -- 172.21.15.81:0/2746254862 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7eff8c010910 con 0x7eff9c077ad0 2024-04-23T14:37:16.808 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:16.054+0000 7effa1800700 1 -- 172.21.15.81:0/2746254862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff9c077ad0 msgr2=0x7eff9c1139b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:16.808 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:16.054+0000 7effa1800700 1 --2- 172.21.15.81:0/2746254862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff9c077ad0 0x7eff9c1139b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7eff8c011db0 tx=0x7eff8c009250 comp rx=0 tx=0).stop 2024-04-23T14:37:16.808 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:16.054+0000 7effa1800700 1 -- 172.21.15.81:0/2746254862 shutdown_connections 2024-04-23T14:37:16.808 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:16.054+0000 7effa1800700 1 --2- 172.21.15.81:0/2746254862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff9c077ad0 0x7eff9c1139b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:16.808 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:16.054+0000 7effa1800700 1 -- 172.21.15.81:0/2746254862 >> 172.21.15.81:0/2746254862 conn(0x7eff9c0fe0b0 msgr2=0x7eff9c0fede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:16.808 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:16.054+0000 7effa1800700 1 -- 172.21.15.81:0/2746254862 shutdown_connections 2024-04-23T14:37:16.808 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:16.055+0000 7effa1800700 1 -- 172.21.15.81:0/2746254862 wait complete. 2024-04-23T14:37:16.808 INFO:teuthology.orchestra.run.smithi081.stdout:mgr not available, waiting (1/15)... 2024-04-23T14:37:19.813 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:19 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/2085627174' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-23T14:37:20.208 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-04-23T14:37:20.208 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-04-23T14:37:20.208 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsid": "7a641bea-017e-11ef-bc93-c7b262605968", 2024-04-23T14:37:20.208 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "health": { 2024-04-23T14:37:20.209 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-23T14:37:20.209 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-23T14:37:20.209 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-23T14:37:20.209 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:20.209 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-23T14:37:20.209 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-23T14:37:20.210 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 0 2024-04-23T14:37:20.210 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-04-23T14:37:20.210 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-23T14:37:20.210 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "smithi081" 2024-04-23T14:37:20.210 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-04-23T14:37:20.210 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-04-23T14:37:20.211 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-23T14:37:20.211 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T14:37:20.211 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-04-23T14:37:20.211 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-23T14:37:20.211 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:20.211 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-23T14:37:20.212 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T14:37:20.212 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-23T14:37:20.212 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-23T14:37:20.212 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-23T14:37:20.212 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-23T14:37:20.212 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-23T14:37:20.213 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-23T14:37:20.213 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:20.213 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-23T14:37:20.213 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-23T14:37:20.214 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-23T14:37:20.214 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-23T14:37:20.214 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-23T14:37:20.214 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-23T14:37:20.214 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-23T14:37:20.215 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-23T14:37:20.215 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-23T14:37:20.215 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:20.215 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-23T14:37:20.215 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T14:37:20.215 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-23T14:37:20.216 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-23T14:37:20.216 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:20.216 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-23T14:37:20.216 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-23T14:37:20.216 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-23T14:37:20.216 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-23T14:37:20.217 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-23T14:37:20.217 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-23T14:37:20.217 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "restful" 2024-04-23T14:37:20.217 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-04-23T14:37:20.217 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-23T14:37:20.217 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:20.218 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-23T14:37:20.218 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T14:37:20.218 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modified": "2024-04-23T14:37:06.214618+0000", 2024-04-23T14:37:20.218 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-23T14:37:20.218 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:20.219 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-23T14:37:20.219 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-04-23T14:37:20.219 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.356+0000 7fe82b200700 1 Processor -- start 2024-04-23T14:37:20.219 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.356+0000 7fe82b200700 1 -- start start 2024-04-23T14:37:20.219 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.357+0000 7fe82b200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe82c077ad0 0x7fe82c076170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:20.219 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.357+0000 7fe82b200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c077ee0 con 0x7fe82c077ad0 2024-04-23T14:37:20.219 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.357+0000 7fe829e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe82c077ad0 0x7fe82c076170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:20.220 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.357+0000 7fe829e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe82c077ad0 0x7fe82c076170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42340/0 (socket says 172.21.15.81:42340) 2024-04-23T14:37:20.220 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.357+0000 7fe829e00700 1 -- 172.21.15.81:0/532331038 learned_addr learned my addr 172.21.15.81:0/532331038 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:20.220 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.358+0000 7fe829e00700 1 -- 172.21.15.81:0/532331038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe82c078020 con 0x7fe82c077ad0 2024-04-23T14:37:20.220 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.358+0000 7fe829e00700 1 --2- 172.21.15.81:0/532331038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe82c077ad0 0x7fe82c076170 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe81c0098e0 tx=0x7fe81c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb7cb5bfa34a18b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:20.220 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.358+0000 7fe828a00700 1 -- 172.21.15.81:0/532331038 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe81c00b8f0 con 0x7fe82c077ad0 2024-04-23T14:37:20.221 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.358+0000 7fe828a00700 1 -- 172.21.15.81:0/532331038 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fe81c011420 con 0x7fe82c077ad0 2024-04-23T14:37:20.221 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.358+0000 7fe828a00700 1 -- 172.21.15.81:0/532331038 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe81c010540 con 0x7fe82c077ad0 2024-04-23T14:37:20.221 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.359+0000 7fe82b200700 1 -- 172.21.15.81:0/532331038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe82c077ad0 msgr2=0x7fe82c076170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:20.221 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.359+0000 7fe82b200700 1 --2- 172.21.15.81:0/532331038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe82c077ad0 0x7fe82c076170 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe81c0098e0 tx=0x7fe81c009250 comp rx=0 tx=0).stop 2024-04-23T14:37:20.221 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.359+0000 7fe82b200700 1 -- 172.21.15.81:0/532331038 shutdown_connections 2024-04-23T14:37:20.221 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.359+0000 7fe82b200700 1 --2- 172.21.15.81:0/532331038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe82c077ad0 0x7fe82c076170 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:20.222 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.359+0000 7fe82b200700 1 -- 172.21.15.81:0/532331038 >> 172.21.15.81:0/532331038 conn(0x7fe82c0fdf20 msgr2=0x7fe82c100330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:20.222 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.360+0000 7fe82b200700 1 -- 172.21.15.81:0/532331038 shutdown_connections 2024-04-23T14:37:20.222 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.360+0000 7fe82b200700 1 -- 172.21.15.81:0/532331038 wait complete. 2024-04-23T14:37:20.222 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.360+0000 7fe82b200700 1 Processor -- start 2024-04-23T14:37:20.222 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.361+0000 7fe82b200700 1 -- start start 2024-04-23T14:37:20.222 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.361+0000 7fe82b200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe82c077ad0 0x7fe82c1137e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:20.223 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.361+0000 7fe82b200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c113d20 con 0x7fe82c077ad0 2024-04-23T14:37:20.223 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.361+0000 7fe829e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe82c077ad0 0x7fe82c1137e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:20.223 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.361+0000 7fe829e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe82c077ad0 0x7fe82c1137e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42350/0 (socket says 172.21.15.81:42350) 2024-04-23T14:37:20.223 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.361+0000 7fe829e00700 1 -- 172.21.15.81:0/2085627174 learned_addr learned my addr 172.21.15.81:0/2085627174 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:20.223 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.362+0000 7fe829e00700 1 -- 172.21.15.81:0/2085627174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81c0094f0 con 0x7fe82c077ad0 2024-04-23T14:37:20.224 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.362+0000 7fe829e00700 1 --2- 172.21.15.81:0/2085627174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe82c077ad0 0x7fe82c1137e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe81c000c00 tx=0x7fe81c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:20.224 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.362+0000 7fe822000700 1 -- 172.21.15.81:0/2085627174 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe81c0107b0 con 0x7fe82c077ad0 2024-04-23T14:37:20.224 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.362+0000 7fe822000700 1 -- 172.21.15.81:0/2085627174 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fe81c010da0 con 0x7fe82c077ad0 2024-04-23T14:37:20.224 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.362+0000 7fe822000700 1 -- 172.21.15.81:0/2085627174 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe81c01add0 con 0x7fe82c077ad0 2024-04-23T14:37:20.224 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.362+0000 7fe82b200700 1 -- 172.21.15.81:0/2085627174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe82c113f20 con 0x7fe82c077ad0 2024-04-23T14:37:20.224 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.363+0000 7fe82b200700 1 -- 172.21.15.81:0/2085627174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe82c114a90 con 0x7fe82c077ad0 2024-04-23T14:37:20.225 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.363+0000 7fe822000700 1 -- 172.21.15.81:0/2085627174 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fe81c02e440 con 0x7fe82c077ad0 2024-04-23T14:37:20.225 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.363+0000 7fe822000700 1 -- 172.21.15.81:0/2085627174 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fe81c024790 con 0x7fe82c077ad0 2024-04-23T14:37:20.225 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.364+0000 7fe82b200700 1 -- 172.21.15.81:0/2085627174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe82c05f5f0 con 0x7fe82c077ad0 2024-04-23T14:37:20.225 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.366+0000 7fe822000700 1 -- 172.21.15.81:0/2085627174 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7fe81c01a5c0 con 0x7fe82c077ad0 2024-04-23T14:37:20.225 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.443+0000 7fe82b200700 1 -- 172.21.15.81:0/2085627174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fe82c1088d0 con 0x7fe82c077ad0 2024-04-23T14:37:20.225 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.444+0000 7fe822000700 1 -- 172.21.15.81:0/2085627174 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fe81c010910 con 0x7fe82c077ad0 2024-04-23T14:37:20.226 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.445+0000 7fe82b200700 1 -- 172.21.15.81:0/2085627174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe82c077ad0 msgr2=0x7fe82c1137e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:20.226 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.445+0000 7fe82b200700 1 --2- 172.21.15.81:0/2085627174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe82c077ad0 0x7fe82c1137e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe81c000c00 tx=0x7fe81c009250 comp rx=0 tx=0).stop 2024-04-23T14:37:20.226 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.445+0000 7fe82b200700 1 -- 172.21.15.81:0/2085627174 shutdown_connections 2024-04-23T14:37:20.226 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.445+0000 7fe82b200700 1 --2- 172.21.15.81:0/2085627174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe82c077ad0 0x7fe82c1137e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:20.226 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.445+0000 7fe82b200700 1 -- 172.21.15.81:0/2085627174 >> 172.21.15.81:0/2085627174 conn(0x7fe82c0fdf20 msgr2=0x7fe82c0fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:20.227 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.446+0000 7fe82b200700 1 -- 172.21.15.81:0/2085627174 shutdown_connections 2024-04-23T14:37:20.227 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:19.446+0000 7fe82b200700 1 -- 172.21.15.81:0/2085627174 wait complete. 2024-04-23T14:37:20.227 INFO:teuthology.orchestra.run.smithi081.stdout:mgr not available, waiting (2/15)... 2024-04-23T14:37:23.298 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:22 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/2127191336' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-23T14:37:23.625 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-04-23T14:37:23.625 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-04-23T14:37:23.626 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsid": "7a641bea-017e-11ef-bc93-c7b262605968", 2024-04-23T14:37:23.626 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "health": { 2024-04-23T14:37:23.626 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-23T14:37:23.626 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-23T14:37:23.626 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-23T14:37:23.626 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:23.626 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-23T14:37:23.626 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-23T14:37:23.626 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 0 2024-04-23T14:37:23.626 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-04-23T14:37:23.626 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-23T14:37:23.627 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "smithi081" 2024-04-23T14:37:23.627 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-04-23T14:37:23.627 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-04-23T14:37:23.627 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-23T14:37:23.627 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T14:37:23.627 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-04-23T14:37:23.627 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-23T14:37:23.627 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:23.627 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-23T14:37:23.627 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T14:37:23.627 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-23T14:37:23.627 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-23T14:37:23.627 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-23T14:37:23.627 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-23T14:37:23.627 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-23T14:37:23.635 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-23T14:37:23.635 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:23.635 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-23T14:37:23.635 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-23T14:37:23.635 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-23T14:37:23.635 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-23T14:37:23.635 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-23T14:37:23.635 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-23T14:37:23.635 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-23T14:37:23.636 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-23T14:37:23.636 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-23T14:37:23.636 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:23.636 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-23T14:37:23.636 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T14:37:23.636 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-23T14:37:23.636 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-23T14:37:23.636 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:23.636 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-23T14:37:23.636 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-23T14:37:23.636 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-23T14:37:23.636 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-23T14:37:23.636 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-23T14:37:23.636 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-23T14:37:23.636 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "restful" 2024-04-23T14:37:23.636 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-04-23T14:37:23.637 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-23T14:37:23.637 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:23.637 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-23T14:37:23.637 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T14:37:23.637 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modified": "2024-04-23T14:37:06.214618+0000", 2024-04-23T14:37:23.637 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-23T14:37:23.637 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:23.637 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-23T14:37:23.637 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-04-23T14:37:23.637 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.839+0000 7f761f800700 1 Processor -- start 2024-04-23T14:37:23.637 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.839+0000 7f761f800700 1 -- start start 2024-04-23T14:37:23.637 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.840+0000 7f761f800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7618102970 0x7f7618102d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:23.637 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.840+0000 7f761f800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76181032c0 con 0x7f7618102970 2024-04-23T14:37:23.637 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.840+0000 7f761ce00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7618102970 0x7f7618102d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:23.637 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.840+0000 7f761ce00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7618102970 0x7f7618102d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42364/0 (socket says 172.21.15.81:42364) 2024-04-23T14:37:23.637 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.840+0000 7f761ce00700 1 -- 172.21.15.81:0/1412235024 learned_addr learned my addr 172.21.15.81:0/1412235024 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:23.638 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.841+0000 7f761ce00700 1 -- 172.21.15.81:0/1412235024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7618103400 con 0x7f7618102970 2024-04-23T14:37:23.638 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.841+0000 7f761ce00700 1 --2- 172.21.15.81:0/1412235024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7618102970 0x7f7618102d80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f760c0098e0 tx=0x7f760c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eaa109983a80c09 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:23.638 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.841+0000 7f7617400700 1 -- 172.21.15.81:0/1412235024 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f760c00b8f0 con 0x7f7618102970 2024-04-23T14:37:23.638 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.841+0000 7f7617400700 1 -- 172.21.15.81:0/1412235024 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f760c011420 con 0x7f7618102970 2024-04-23T14:37:23.638 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.841+0000 7f7617400700 1 -- 172.21.15.81:0/1412235024 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f760c010540 con 0x7f7618102970 2024-04-23T14:37:23.638 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.842+0000 7f761f800700 1 -- 172.21.15.81:0/1412235024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7618102970 msgr2=0x7f7618102d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:23.638 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.842+0000 7f761f800700 1 --2- 172.21.15.81:0/1412235024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7618102970 0x7f7618102d80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f760c0098e0 tx=0x7f760c009250 comp rx=0 tx=0).stop 2024-04-23T14:37:23.638 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.842+0000 7f761f800700 1 -- 172.21.15.81:0/1412235024 shutdown_connections 2024-04-23T14:37:23.638 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.842+0000 7f761f800700 1 --2- 172.21.15.81:0/1412235024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7618102970 0x7f7618102d80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:23.638 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.842+0000 7f761f800700 1 -- 172.21.15.81:0/1412235024 >> 172.21.15.81:0/1412235024 conn(0x7f76180fe0b0 msgr2=0x7f7618100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:23.638 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.843+0000 7f761f800700 1 -- 172.21.15.81:0/1412235024 shutdown_connections 2024-04-23T14:37:23.638 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.843+0000 7f761f800700 1 -- 172.21.15.81:0/1412235024 wait complete. 2024-04-23T14:37:23.638 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.844+0000 7f761f800700 1 Processor -- start 2024-04-23T14:37:23.638 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.844+0000 7f761f800700 1 -- start start 2024-04-23T14:37:23.638 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.844+0000 7f761f800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7618102970 0x7f76181117b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:23.639 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.844+0000 7f761f800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7618111cf0 con 0x7f7618102970 2024-04-23T14:37:23.639 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.844+0000 7f761ce00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7618102970 0x7f76181117b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:23.639 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.844+0000 7f761ce00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7618102970 0x7f76181117b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42366/0 (socket says 172.21.15.81:42366) 2024-04-23T14:37:23.639 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.844+0000 7f761ce00700 1 -- 172.21.15.81:0/2127191336 learned_addr learned my addr 172.21.15.81:0/2127191336 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:23.639 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.845+0000 7f761ce00700 1 -- 172.21.15.81:0/2127191336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c0094f0 con 0x7f7618102970 2024-04-23T14:37:23.639 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.845+0000 7f761ce00700 1 --2- 172.21.15.81:0/2127191336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7618102970 0x7f76181117b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f760c00b440 tx=0x7f760c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:23.639 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.845+0000 7f7614c00700 1 -- 172.21.15.81:0/2127191336 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f760c0107b0 con 0x7f7618102970 2024-04-23T14:37:23.639 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.845+0000 7f7614c00700 1 -- 172.21.15.81:0/2127191336 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f760c010da0 con 0x7f7618102970 2024-04-23T14:37:23.639 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.845+0000 7f761f800700 1 -- 172.21.15.81:0/2127191336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7618111ef0 con 0x7f7618102970 2024-04-23T14:37:23.639 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.846+0000 7f7614c00700 1 -- 172.21.15.81:0/2127191336 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f760c024e10 con 0x7f7618102970 2024-04-23T14:37:23.639 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.846+0000 7f761f800700 1 -- 172.21.15.81:0/2127191336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7618112a60 con 0x7f7618102970 2024-04-23T14:37:23.639 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.846+0000 7f7614c00700 1 -- 172.21.15.81:0/2127191336 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f760c01a4c0 con 0x7f7618102970 2024-04-23T14:37:23.639 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.846+0000 7f7614c00700 1 -- 172.21.15.81:0/2127191336 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f760c02d740 con 0x7f7618102970 2024-04-23T14:37:23.639 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.847+0000 7f761f800700 1 -- 172.21.15.81:0/2127191336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f761805f5f0 con 0x7f7618102970 2024-04-23T14:37:23.639 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.849+0000 7f7614c00700 1 -- 172.21.15.81:0/2127191336 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7f760c024440 con 0x7f7618102970 2024-04-23T14:37:23.640 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.928+0000 7f761f800700 1 -- 172.21.15.81:0/2127191336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f7618104660 con 0x7f7618102970 2024-04-23T14:37:23.640 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.929+0000 7f7614c00700 1 -- 172.21.15.81:0/2127191336 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1249 (secure 0 0 0) 0x7f760c024660 con 0x7f7618102970 2024-04-23T14:37:23.640 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.930+0000 7f761f800700 1 -- 172.21.15.81:0/2127191336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7618102970 msgr2=0x7f76181117b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:23.640 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.930+0000 7f761f800700 1 --2- 172.21.15.81:0/2127191336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7618102970 0x7f76181117b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f760c00b440 tx=0x7f760c009250 comp rx=0 tx=0).stop 2024-04-23T14:37:23.640 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.930+0000 7f761f800700 1 -- 172.21.15.81:0/2127191336 shutdown_connections 2024-04-23T14:37:23.640 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.930+0000 7f761f800700 1 --2- 172.21.15.81:0/2127191336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7618102970 0x7f76181117b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:23.640 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.930+0000 7f761f800700 1 -- 172.21.15.81:0/2127191336 >> 172.21.15.81:0/2127191336 conn(0x7f76180fe0b0 msgr2=0x7f76180fee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:23.640 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.931+0000 7f761f800700 1 -- 172.21.15.81:0/2127191336 shutdown_connections 2024-04-23T14:37:23.640 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:22.931+0000 7f761f800700 1 -- 172.21.15.81:0/2127191336 wait complete. 2024-04-23T14:37:23.640 INFO:teuthology.orchestra.run.smithi081.stdout:mgr not available, waiting (3/15)... 2024-04-23T14:37:24.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:23 smithi081 ceph-mon[25540]: Activating manager daemon smithi081.ldghvq 2024-04-23T14:37:24.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:23 smithi081 ceph-mon[25540]: mgrmap e2: smithi081.ldghvq(active, starting, since 0.00445683s) 2024-04-23T14:37:24.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:23 smithi081 ceph-mon[25540]: from='mgr.14100 172.21.15.81:0/2299793513' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-23T14:37:24.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:23 smithi081 ceph-mon[25540]: from='mgr.14100 172.21.15.81:0/2299793513' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-23T14:37:24.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:23 smithi081 ceph-mon[25540]: from='mgr.14100 172.21.15.81:0/2299793513' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-23T14:37:24.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:23 smithi081 ceph-mon[25540]: from='mgr.14100 172.21.15.81:0/2299793513' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi081"}]: dispatch 2024-04-23T14:37:24.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:23 smithi081 ceph-mon[25540]: from='mgr.14100 172.21.15.81:0/2299793513' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mgr metadata", "who": "smithi081.ldghvq", "id": "smithi081.ldghvq"}]: dispatch 2024-04-23T14:37:24.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:23 smithi081 ceph-mon[25540]: Manager daemon smithi081.ldghvq is now available 2024-04-23T14:37:24.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:23 smithi081 ceph-mon[25540]: from='mgr.14100 172.21.15.81:0/2299793513' entity='mgr.smithi081.ldghvq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi081.ldghvq/mirror_snapshot_schedule"}]: dispatch 2024-04-23T14:37:24.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:23 smithi081 ceph-mon[25540]: from='mgr.14100 172.21.15.81:0/2299793513' entity='mgr.smithi081.ldghvq' 2024-04-23T14:37:24.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:23 smithi081 ceph-mon[25540]: from='mgr.14100 172.21.15.81:0/2299793513' entity='mgr.smithi081.ldghvq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi081.ldghvq/trash_purge_schedule"}]: dispatch 2024-04-23T14:37:24.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:23 smithi081 ceph-mon[25540]: from='mgr.14100 172.21.15.81:0/2299793513' entity='mgr.smithi081.ldghvq' 2024-04-23T14:37:24.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:23 smithi081 ceph-mon[25540]: from='mgr.14100 172.21.15.81:0/2299793513' entity='mgr.smithi081.ldghvq' 2024-04-23T14:37:25.934 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:25 smithi081 ceph-mon[25540]: mgrmap e3: smithi081.ldghvq(active, since 1.01872s) 2024-04-23T14:37:26.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:26 smithi081 ceph-mon[25540]: mgrmap e4: smithi081.ldghvq(active, since 2s) 2024-04-23T14:37:26.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:26 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/163293071' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-23T14:37:27.338 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-04-23T14:37:27.339 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-04-23T14:37:27.339 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsid": "7a641bea-017e-11ef-bc93-c7b262605968", 2024-04-23T14:37:27.339 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "health": { 2024-04-23T14:37:27.339 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-23T14:37:27.339 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-23T14:37:27.339 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-23T14:37:27.339 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:27.339 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-23T14:37:27.341 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-23T14:37:27.341 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 0 2024-04-23T14:37:27.341 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-04-23T14:37:27.341 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-23T14:37:27.341 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "smithi081" 2024-04-23T14:37:27.341 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-04-23T14:37:27.341 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_age": 13, 2024-04-23T14:37:27.341 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-23T14:37:27.341 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T14:37:27.342 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-04-23T14:37:27.342 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-23T14:37:27.342 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:27.342 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-23T14:37:27.342 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T14:37:27.342 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-23T14:37:27.342 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-23T14:37:27.342 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-23T14:37:27.348 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-23T14:37:27.348 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-23T14:37:27.348 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-23T14:37:27.348 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:27.348 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-23T14:37:27.348 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-23T14:37:27.348 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-23T14:37:27.349 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-23T14:37:27.349 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-23T14:37:27.349 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-23T14:37:27.349 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-23T14:37:27.349 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-23T14:37:27.349 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-23T14:37:27.349 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:27.349 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-23T14:37:27.349 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T14:37:27.349 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-23T14:37:27.349 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-23T14:37:27.349 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:27.349 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-23T14:37:27.350 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-23T14:37:27.350 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-23T14:37:27.350 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-23T14:37:27.350 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-23T14:37:27.350 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-23T14:37:27.350 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "restful" 2024-04-23T14:37:27.350 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-04-23T14:37:27.350 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-23T14:37:27.350 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:27.350 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-23T14:37:27.350 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T14:37:27.350 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modified": "2024-04-23T14:37:06.214618+0000", 2024-04-23T14:37:27.350 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-23T14:37:27.350 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-04-23T14:37:27.351 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-23T14:37:27.351 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-04-23T14:37:27.351 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.235+0000 7f66f8e00700 1 Processor -- start 2024-04-23T14:37:27.351 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.235+0000 7f66f8e00700 1 -- start start 2024-04-23T14:37:27.351 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.236+0000 7f66f8e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66f4078c50 0x7f66f40772a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:27.351 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.236+0000 7f66f8e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f4079060 con 0x7f66f4078c50 2024-04-23T14:37:27.351 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.236+0000 7f66f3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66f4078c50 0x7f66f40772a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:27.351 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.237+0000 7f66f3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66f4078c50 0x7f66f40772a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54820/0 (socket says 172.21.15.81:54820) 2024-04-23T14:37:27.351 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.237+0000 7f66f3400700 1 -- 172.21.15.81:0/2244570953 learned_addr learned my addr 172.21.15.81:0/2244570953 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:27.351 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.237+0000 7f66f3400700 1 -- 172.21.15.81:0/2244570953 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f40777e0 con 0x7f66f4078c50 2024-04-23T14:37:27.351 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.237+0000 7f66f3400700 1 --2- 172.21.15.81:0/2244570953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66f4078c50 0x7f66f40772a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f66e40098e0 tx=0x7f66e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2336c0873259638 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:27.351 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.238+0000 7f66f2000700 1 -- 172.21.15.81:0/2244570953 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f66e400b860 con 0x7f66f4078c50 2024-04-23T14:37:27.351 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.238+0000 7f66f2000700 1 -- 172.21.15.81:0/2244570953 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f66e400be50 con 0x7f66f4078c50 2024-04-23T14:37:27.352 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.238+0000 7f66f2000700 1 -- 172.21.15.81:0/2244570953 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f66e4010380 con 0x7f66f4078c50 2024-04-23T14:37:27.352 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.238+0000 7f66f8e00700 1 -- 172.21.15.81:0/2244570953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66f4078c50 msgr2=0x7f66f40772a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:27.352 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.238+0000 7f66f8e00700 1 --2- 172.21.15.81:0/2244570953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66f4078c50 0x7f66f40772a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f66e40098e0 tx=0x7f66e4009250 comp rx=0 tx=0).stop 2024-04-23T14:37:27.352 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.239+0000 7f66f8e00700 1 -- 172.21.15.81:0/2244570953 shutdown_connections 2024-04-23T14:37:27.352 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.239+0000 7f66f8e00700 1 --2- 172.21.15.81:0/2244570953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66f4078c50 0x7f66f40772a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:27.352 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.239+0000 7f66f8e00700 1 -- 172.21.15.81:0/2244570953 >> 172.21.15.81:0/2244570953 conn(0x7f66f40fdf30 msgr2=0x7f66f4100340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:27.352 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.239+0000 7f66f8e00700 1 -- 172.21.15.81:0/2244570953 shutdown_connections 2024-04-23T14:37:27.352 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.239+0000 7f66f8e00700 1 -- 172.21.15.81:0/2244570953 wait complete. 2024-04-23T14:37:27.352 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.240+0000 7f66f8e00700 1 Processor -- start 2024-04-23T14:37:27.352 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.240+0000 7f66f8e00700 1 -- start start 2024-04-23T14:37:27.352 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.241+0000 7f66f8e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66f4078c50 0x7f66f4113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:27.352 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.241+0000 7f66f8e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f4113c50 con 0x7f66f4078c50 2024-04-23T14:37:27.352 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.241+0000 7f66f3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66f4078c50 0x7f66f4113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:27.352 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.241+0000 7f66f3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66f4078c50 0x7f66f4113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54832/0 (socket says 172.21.15.81:54832) 2024-04-23T14:37:27.352 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.241+0000 7f66f3400700 1 -- 172.21.15.81:0/163293071 learned_addr learned my addr 172.21.15.81:0/163293071 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:27.352 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.241+0000 7f66f3400700 1 -- 172.21.15.81:0/163293071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e40094f0 con 0x7f66f4078c50 2024-04-23T14:37:27.355 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.242+0000 7f66f3400700 1 --2- 172.21.15.81:0/163293071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66f4078c50 0x7f66f4113710 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f66e4006b00 tx=0x7f66e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:27.355 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.242+0000 7f66eb400700 1 -- 172.21.15.81:0/163293071 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f66e40107c0 con 0x7f66f4078c50 2024-04-23T14:37:27.355 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.242+0000 7f66eb400700 1 -- 172.21.15.81:0/163293071 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f66e4010db0 con 0x7f66f4078c50 2024-04-23T14:37:27.355 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.242+0000 7f66f8e00700 1 -- 172.21.15.81:0/163293071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f4113e50 con 0x7f66f4078c50 2024-04-23T14:37:27.355 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.242+0000 7f66eb400700 1 -- 172.21.15.81:0/163293071 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f66e401acf0 con 0x7f66f4078c50 2024-04-23T14:37:27.355 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.242+0000 7f66f8e00700 1 -- 172.21.15.81:0/163293071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f41149c0 con 0x7f66f4078c50 2024-04-23T14:37:27.355 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.243+0000 7f66eb400700 1 -- 172.21.15.81:0/163293071 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 43365+0+0 (secure 0 0 0) 0x7f66e40193c0 con 0x7f66f4078c50 2024-04-23T14:37:27.355 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.243+0000 7f66f8e00700 1 -- 172.21.15.81:0/163293071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66f405f5f0 con 0x7f66f4078c50 2024-04-23T14:37:27.355 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.244+0000 7f66eb400700 1 --2- 172.21.15.81:0/163293071 >> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] conn(0x7f66d8036790 0x7f66d8038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:27.355 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.244+0000 7f66eb400700 1 -- 172.21.15.81:0/163293071 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f66e404a6f0 con 0x7f66f4078c50 2024-04-23T14:37:27.356 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.244+0000 7f66f2a00700 1 --2- 172.21.15.81:0/163293071 >> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] conn(0x7f66d8036790 0x7f66d8038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:27.356 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.245+0000 7f66f2a00700 1 --2- 172.21.15.81:0/163293071 >> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] conn(0x7f66d8036790 0x7f66d8038c40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f66e0009990 tx=0x7f66e0006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:27.356 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.250+0000 7f66eb400700 1 -- 172.21.15.81:0/163293071 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f66e4022700 con 0x7f66f4078c50 2024-04-23T14:37:27.356 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.549+0000 7f66f8e00700 1 -- 172.21.15.81:0/163293071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f66f404bed0 con 0x7f66f4078c50 2024-04-23T14:37:27.356 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.550+0000 7f66eb400700 1 -- 172.21.15.81:0/163293071 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f66e4022340 con 0x7f66f4078c50 2024-04-23T14:37:27.356 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.553+0000 7f66f8e00700 1 -- 172.21.15.81:0/163293071 >> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] conn(0x7f66d8036790 msgr2=0x7f66d8038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:27.356 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.553+0000 7f66f8e00700 1 --2- 172.21.15.81:0/163293071 >> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] conn(0x7f66d8036790 0x7f66d8038c40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f66e0009990 tx=0x7f66e0006e40 comp rx=0 tx=0).stop 2024-04-23T14:37:27.356 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.553+0000 7f66f8e00700 1 -- 172.21.15.81:0/163293071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66f4078c50 msgr2=0x7f66f4113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:27.356 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.553+0000 7f66f8e00700 1 --2- 172.21.15.81:0/163293071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66f4078c50 0x7f66f4113710 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f66e4006b00 tx=0x7f66e4009250 comp rx=0 tx=0).stop 2024-04-23T14:37:27.356 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.553+0000 7f66f8e00700 1 -- 172.21.15.81:0/163293071 shutdown_connections 2024-04-23T14:37:27.356 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.553+0000 7f66f8e00700 1 --2- 172.21.15.81:0/163293071 >> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] conn(0x7f66d8036790 0x7f66d8038c40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:27.356 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.553+0000 7f66f8e00700 1 --2- 172.21.15.81:0/163293071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66f4078c50 0x7f66f4113710 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:27.356 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.553+0000 7f66f8e00700 1 -- 172.21.15.81:0/163293071 >> 172.21.15.81:0/163293071 conn(0x7f66f40fdf30 msgr2=0x7f66f40feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:27.356 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.554+0000 7f66f8e00700 1 -- 172.21.15.81:0/163293071 shutdown_connections 2024-04-23T14:37:27.357 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:26.554+0000 7f66f8e00700 1 -- 172.21.15.81:0/163293071 wait complete. 2024-04-23T14:37:27.357 INFO:teuthology.orchestra.run.smithi081.stdout:mgr is available 2024-04-23T14:37:28.504 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:28 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/1402773889' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-23T14:37:28.837 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-04-23T14:37:28.840 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [global] 2024-04-23T14:37:28.840 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout fsid = 7a641bea-017e-11ef-bc93-c7b262605968 2024-04-23T14:37:28.840 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-23T14:37:28.841 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-23T14:37:28.841 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-23T14:37:28.841 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-23T14:37:28.841 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-04-23T14:37:28.841 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-23T14:37:28.841 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-23T14:37:28.841 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-04-23T14:37:28.841 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [osd] 2024-04-23T14:37:28.841 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-23T14:37:28.841 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-23T14:37:28.841 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-23T14:37:28.841 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-23T14:37:28.841 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-23T14:37:28.841 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:27.936+0000 7fa651400700 1 Processor -- start 2024-04-23T14:37:28.842 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:27.936+0000 7fa651400700 1 -- start start 2024-04-23T14:37:28.842 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:27.937+0000 7fa651400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa64c077a90 0x7fa64c076130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:28.842 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:27.937+0000 7fa651400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c077ea0 con 0x7fa64c077a90 2024-04-23T14:37:28.842 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:27.937+0000 7fa64a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa64c077a90 0x7fa64c076130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:28.842 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:27.937+0000 7fa64a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa64c077a90 0x7fa64c076130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54834/0 (socket says 172.21.15.81:54834) 2024-04-23T14:37:28.842 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:27.937+0000 7fa64a800700 1 -- 172.21.15.81:0/4052250979 learned_addr learned my addr 172.21.15.81:0/4052250979 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:28.842 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:27.938+0000 7fa64a800700 1 -- 172.21.15.81:0/4052250979 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa64c077fe0 con 0x7fa64c077a90 2024-04-23T14:37:28.842 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:27.938+0000 7fa64a800700 1 --2- 172.21.15.81:0/4052250979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa64c077a90 0x7fa64c076130 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa63c0098e0 tx=0x7fa63c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0781ef5da934541 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:28.842 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:27.938+0000 7fa649e00700 1 -- 172.21.15.81:0/4052250979 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa63c00b8f0 con 0x7fa64c077a90 2024-04-23T14:37:28.842 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:27.938+0000 7fa649e00700 1 -- 172.21.15.81:0/4052250979 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fa63c011420 con 0x7fa64c077a90 2024-04-23T14:37:28.847 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:27.938+0000 7fa649e00700 1 -- 172.21.15.81:0/4052250979 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa63c010540 con 0x7fa64c077a90 2024-04-23T14:37:28.847 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:27.939+0000 7fa651400700 1 -- 172.21.15.81:0/4052250979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa64c077a90 msgr2=0x7fa64c076130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:28.847 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:27.939+0000 7fa651400700 1 --2- 172.21.15.81:0/4052250979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa64c077a90 0x7fa64c076130 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa63c0098e0 tx=0x7fa63c009250 comp rx=0 tx=0).stop 2024-04-23T14:37:28.847 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:27.939+0000 7fa651400700 1 -- 172.21.15.81:0/4052250979 shutdown_connections 2024-04-23T14:37:28.847 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:27.939+0000 7fa651400700 1 --2- 172.21.15.81:0/4052250979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa64c077a90 0x7fa64c076130 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:28.847 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:27.939+0000 7fa651400700 1 -- 172.21.15.81:0/4052250979 >> 172.21.15.81:0/4052250979 conn(0x7fa64c0fe0b0 msgr2=0x7fa64c100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:28.847 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:27.939+0000 7fa651400700 1 -- 172.21.15.81:0/4052250979 shutdown_connections 2024-04-23T14:37:28.847 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:27.939+0000 7fa651400700 1 -- 172.21.15.81:0/4052250979 wait complete. 2024-04-23T14:37:28.847 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:27.940+0000 7fa651400700 1 Processor -- start 2024-04-23T14:37:28.847 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:27.941+0000 7fa651400700 1 -- start start 2024-04-23T14:37:28.847 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:27.941+0000 7fa651400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa64c077a90 0x7fa64c113950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:28.847 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:27.941+0000 7fa651400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c113e90 con 0x7fa64c077a90 2024-04-23T14:37:28.848 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:27.941+0000 7fa64a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa64c077a90 0x7fa64c113950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:28.848 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:27.941+0000 7fa64a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa64c077a90 0x7fa64c113950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54850/0 (socket says 172.21.15.81:54850) 2024-04-23T14:37:28.848 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:27.941+0000 7fa64a800700 1 -- 172.21.15.81:0/1402773889 learned_addr learned my addr 172.21.15.81:0/1402773889 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:28.848 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:27.942+0000 7fa64a800700 1 -- 172.21.15.81:0/1402773889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63c0094f0 con 0x7fa64c077a90 2024-04-23T14:37:28.848 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:27.942+0000 7fa64a800700 1 --2- 172.21.15.81:0/1402773889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa64c077a90 0x7fa64c113950 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa63c011db0 tx=0x7fa63c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:28.848 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:27.942+0000 7fa643400700 1 -- 172.21.15.81:0/1402773889 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa63c0107b0 con 0x7fa64c077a90 2024-04-23T14:37:28.848 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:27.942+0000 7fa643400700 1 -- 172.21.15.81:0/1402773889 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fa63c010da0 con 0x7fa64c077a90 2024-04-23T14:37:28.848 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:27.942+0000 7fa651400700 1 -- 172.21.15.81:0/1402773889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa64c1140f0 con 0x7fa64c077a90 2024-04-23T14:37:28.848 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:27.942+0000 7fa643400700 1 -- 172.21.15.81:0/1402773889 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa63c01ad60 con 0x7fa64c077a90 2024-04-23T14:37:28.848 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:27.942+0000 7fa651400700 1 -- 172.21.15.81:0/1402773889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa64c114c00 con 0x7fa64c077a90 2024-04-23T14:37:28.848 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:27.943+0000 7fa643400700 1 -- 172.21.15.81:0/1402773889 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 43365+0+0 (secure 0 0 0) 0x7fa63c010910 con 0x7fa64c077a90 2024-04-23T14:37:28.848 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:27.944+0000 7fa651400700 1 -- 172.21.15.81:0/1402773889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa64c05f5f0 con 0x7fa64c077a90 2024-04-23T14:37:28.848 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:27.944+0000 7fa643400700 1 --2- 172.21.15.81:0/1402773889 >> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] conn(0x7fa62c036790 0x7fa62c038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:28.848 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:27.944+0000 7fa643400700 1 -- 172.21.15.81:0/1402773889 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa63c04ab40 con 0x7fa64c077a90 2024-04-23T14:37:28.848 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:27.944+0000 7fa639e00700 1 --2- 172.21.15.81:0/1402773889 >> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] conn(0x7fa62c036790 0x7fa62c038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:28.848 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:27.945+0000 7fa639e00700 1 --2- 172.21.15.81:0/1402773889 >> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] conn(0x7fa62c036790 0x7fa62c038c40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa634009990 tx=0x7fa634006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:28.849 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:27.949+0000 7fa643400700 1 -- 172.21.15.81:0/1402773889 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa63c02d3e0 con 0x7fa64c077a90 2024-04-23T14:37:28.849 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:28.141+0000 7fa651400700 1 -- 172.21.15.81:0/1402773889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fa64c04bed0 con 0x7fa64c077a90 2024-04-23T14:37:28.849 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:28.142+0000 7fa643400700 1 -- 172.21.15.81:0/1402773889 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7fa63c018350 con 0x7fa64c077a90 2024-04-23T14:37:28.849 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:28.145+0000 7fa651400700 1 -- 172.21.15.81:0/1402773889 >> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] conn(0x7fa62c036790 msgr2=0x7fa62c038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:28.849 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:28.145+0000 7fa651400700 1 --2- 172.21.15.81:0/1402773889 >> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] conn(0x7fa62c036790 0x7fa62c038c40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa634009990 tx=0x7fa634006e40 comp rx=0 tx=0).stop 2024-04-23T14:37:28.849 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:28.145+0000 7fa651400700 1 -- 172.21.15.81:0/1402773889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa64c077a90 msgr2=0x7fa64c113950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:28.849 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:28.145+0000 7fa651400700 1 --2- 172.21.15.81:0/1402773889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa64c077a90 0x7fa64c113950 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa63c011db0 tx=0x7fa63c009250 comp rx=0 tx=0).stop 2024-04-23T14:37:28.849 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:28.145+0000 7fa651400700 1 -- 172.21.15.81:0/1402773889 shutdown_connections 2024-04-23T14:37:28.849 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:28.145+0000 7fa651400700 1 --2- 172.21.15.81:0/1402773889 >> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] conn(0x7fa62c036790 0x7fa62c038c40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:28.849 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:28.145+0000 7fa651400700 1 --2- 172.21.15.81:0/1402773889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa64c077a90 0x7fa64c113950 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:28.849 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:28.145+0000 7fa651400700 1 -- 172.21.15.81:0/1402773889 >> 172.21.15.81:0/1402773889 conn(0x7fa64c0fe0b0 msgr2=0x7fa64c0fee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:28.849 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:28.145+0000 7fa651400700 1 -- 172.21.15.81:0/1402773889 shutdown_connections 2024-04-23T14:37:28.849 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:28.146+0000 7fa651400700 1 -- 172.21.15.81:0/1402773889 wait complete. 2024-04-23T14:37:28.849 INFO:teuthology.orchestra.run.smithi081.stdout:Enabling cephadm module... 2024-04-23T14:37:30.042 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:29 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/1183593578' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-04-23T14:37:30.445 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.429+0000 7f2f72200700 1 Processor -- start 2024-04-23T14:37:30.445 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.430+0000 7f2f72200700 1 -- start start 2024-04-23T14:37:30.445 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.430+0000 7f2f72200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f6c071300 0x7f2f6c105500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:30.445 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.430+0000 7f2f72200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c071710 con 0x7f2f6c071300 2024-04-23T14:37:30.445 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.431+0000 7f2f6b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f6c071300 0x7f2f6c105500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:30.445 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.431+0000 7f2f6b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f6c071300 0x7f2f6c105500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54858/0 (socket says 172.21.15.81:54858) 2024-04-23T14:37:30.445 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.431+0000 7f2f6b400700 1 -- 172.21.15.81:0/4247181528 learned_addr learned my addr 172.21.15.81:0/4247181528 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:30.445 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.431+0000 7f2f6b400700 1 -- 172.21.15.81:0/4247181528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6c105a40 con 0x7f2f6c071300 2024-04-23T14:37:30.446 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.432+0000 7f2f6b400700 1 --2- 172.21.15.81:0/4247181528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f6c071300 0x7f2f6c105500 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c0098e0 tx=0x7f2f5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f110918429446590 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:30.446 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.432+0000 7f2f6aa00700 1 -- 172.21.15.81:0/4247181528 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f5c00b860 con 0x7f2f6c071300 2024-04-23T14:37:30.446 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.432+0000 7f2f6aa00700 1 -- 172.21.15.81:0/4247181528 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f2f5c00be50 con 0x7f2f6c071300 2024-04-23T14:37:30.446 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.432+0000 7f2f6aa00700 1 -- 172.21.15.81:0/4247181528 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f5c010380 con 0x7f2f6c071300 2024-04-23T14:37:30.446 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.433+0000 7f2f72200700 1 -- 172.21.15.81:0/4247181528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f6c071300 msgr2=0x7f2f6c105500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:30.446 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.433+0000 7f2f72200700 1 --2- 172.21.15.81:0/4247181528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f6c071300 0x7f2f6c105500 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c0098e0 tx=0x7f2f5c009250 comp rx=0 tx=0).stop 2024-04-23T14:37:30.446 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.433+0000 7f2f72200700 1 -- 172.21.15.81:0/4247181528 shutdown_connections 2024-04-23T14:37:30.446 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.433+0000 7f2f72200700 1 --2- 172.21.15.81:0/4247181528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f6c071300 0x7f2f6c105500 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:30.446 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.433+0000 7f2f72200700 1 -- 172.21.15.81:0/4247181528 >> 172.21.15.81:0/4247181528 conn(0x7f2f6c0fcfb0 msgr2=0x7f2f6c0ff3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:30.446 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.433+0000 7f2f72200700 1 -- 172.21.15.81:0/4247181528 shutdown_connections 2024-04-23T14:37:30.446 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.433+0000 7f2f72200700 1 -- 172.21.15.81:0/4247181528 wait complete. 2024-04-23T14:37:30.447 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.434+0000 7f2f72200700 1 Processor -- start 2024-04-23T14:37:30.447 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.434+0000 7f2f72200700 1 -- start start 2024-04-23T14:37:30.447 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.434+0000 7f2f72200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f6c071300 0x7f2f6c117e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:30.447 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.434+0000 7f2f72200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c118370 con 0x7f2f6c071300 2024-04-23T14:37:30.447 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.435+0000 7f2f6b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f6c071300 0x7f2f6c117e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:30.447 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.435+0000 7f2f6b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f6c071300 0x7f2f6c117e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54864/0 (socket says 172.21.15.81:54864) 2024-04-23T14:37:30.447 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.435+0000 7f2f6b400700 1 -- 172.21.15.81:0/1183593578 learned_addr learned my addr 172.21.15.81:0/1183593578 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:30.447 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.435+0000 7f2f6b400700 1 -- 172.21.15.81:0/1183593578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f5c0094f0 con 0x7f2f6c071300 2024-04-23T14:37:30.447 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.435+0000 7f2f6b400700 1 --2- 172.21.15.81:0/1183593578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f6c071300 0x7f2f6c117e30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c011bd0 tx=0x7f2f5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:30.447 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.436+0000 7f2f63400700 1 -- 172.21.15.81:0/1183593578 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f5c0107c0 con 0x7f2f6c071300 2024-04-23T14:37:30.447 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.436+0000 7f2f63400700 1 -- 172.21.15.81:0/1183593578 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f2f5c010db0 con 0x7f2f6c071300 2024-04-23T14:37:30.447 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.436+0000 7f2f72200700 1 -- 172.21.15.81:0/1183593578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f6c118570 con 0x7f2f6c071300 2024-04-23T14:37:30.447 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.436+0000 7f2f63400700 1 -- 172.21.15.81:0/1183593578 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f5c01ad60 con 0x7f2f6c071300 2024-04-23T14:37:30.448 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.436+0000 7f2f72200700 1 -- 172.21.15.81:0/1183593578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f6c118fa0 con 0x7f2f6c071300 2024-04-23T14:37:30.448 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.437+0000 7f2f63400700 1 -- 172.21.15.81:0/1183593578 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 43365+0+0 (secure 0 0 0) 0x7f2f5c01a5c0 con 0x7f2f6c071300 2024-04-23T14:37:30.448 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.437+0000 7f2f72200700 1 -- 172.21.15.81:0/1183593578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f6c05f5f0 con 0x7f2f6c071300 2024-04-23T14:37:30.448 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.437+0000 7f2f63400700 1 --2- 172.21.15.81:0/1183593578 >> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] conn(0x7f2f50036790 0x7f2f50038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:30.448 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.437+0000 7f2f63400700 1 -- 172.21.15.81:0/1183593578 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f2f5c04aac0 con 0x7f2f6c071300 2024-04-23T14:37:30.448 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.438+0000 7f2f63e00700 1 --2- 172.21.15.81:0/1183593578 >> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] conn(0x7f2f50036790 0x7f2f50038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:30.448 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.438+0000 7f2f63e00700 1 --2- 172.21.15.81:0/1183593578 >> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] conn(0x7f2f50036790 0x7f2f50038c40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2f54009990 tx=0x7f2f54006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:30.448 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.443+0000 7f2f63400700 1 -- 172.21.15.81:0/1183593578 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2f5c010920 con 0x7f2f6c071300 2024-04-23T14:37:30.448 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.709+0000 7f2f72200700 1 -- 172.21.15.81:0/1183593578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f2f6c04bed0 con 0x7f2f6c071300 2024-04-23T14:37:30.448 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.766+0000 7f2f63400700 1 -- 172.21.15.81:0/1183593578 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 5) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f2f5c02e960 con 0x7f2f6c071300 2024-04-23T14:37:30.448 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.768+0000 7f2f63400700 1 -- 172.21.15.81:0/1183593578 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f2f5c02a2b0 con 0x7f2f6c071300 2024-04-23T14:37:30.448 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.771+0000 7f2f72200700 1 -- 172.21.15.81:0/1183593578 >> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] conn(0x7f2f50036790 msgr2=0x7f2f50038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:30.448 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.771+0000 7f2f72200700 1 --2- 172.21.15.81:0/1183593578 >> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] conn(0x7f2f50036790 0x7f2f50038c40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2f54009990 tx=0x7f2f54006e40 comp rx=0 tx=0).stop 2024-04-23T14:37:30.449 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.771+0000 7f2f72200700 1 -- 172.21.15.81:0/1183593578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f6c071300 msgr2=0x7f2f6c117e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:30.449 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.771+0000 7f2f72200700 1 --2- 172.21.15.81:0/1183593578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f6c071300 0x7f2f6c117e30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c011bd0 tx=0x7f2f5c009250 comp rx=0 tx=0).stop 2024-04-23T14:37:30.449 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.772+0000 7f2f72200700 1 -- 172.21.15.81:0/1183593578 shutdown_connections 2024-04-23T14:37:30.449 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.772+0000 7f2f72200700 1 --2- 172.21.15.81:0/1183593578 >> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] conn(0x7f2f50036790 0x7f2f50038c40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:30.449 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.772+0000 7f2f72200700 1 --2- 172.21.15.81:0/1183593578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f6c071300 0x7f2f6c117e30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:30.449 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.772+0000 7f2f72200700 1 -- 172.21.15.81:0/1183593578 >> 172.21.15.81:0/1183593578 conn(0x7f2f6c0fcfb0 msgr2=0x7f2f6c0fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:30.449 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.772+0000 7f2f72200700 1 -- 172.21.15.81:0/1183593578 shutdown_connections 2024-04-23T14:37:30.449 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:29.772+0000 7f2f72200700 1 -- 172.21.15.81:0/1183593578 wait complete. 2024-04-23T14:37:31.069 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:30 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/1183593578' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-04-23T14:37:31.069 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:30 smithi081 ceph-mon[25540]: mgrmap e5: smithi081.ldghvq(active, since 6s) 2024-04-23T14:37:32.029 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:31 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/3652027303' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-23T14:37:32.045 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-04-23T14:37:32.045 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-04-23T14:37:32.046 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-23T14:37:32.046 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "active_name": "smithi081.ldghvq", 2024-04-23T14:37:32.046 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-23T14:37:32.046 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-04-23T14:37:32.046 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.067+0000 7fca7d400700 1 Processor -- start 2024-04-23T14:37:32.046 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.067+0000 7fca7d400700 1 -- start start 2024-04-23T14:37:32.046 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.067+0000 7fca7d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca781029a0 0x7fca78102db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:32.046 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.067+0000 7fca7d400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca781032f0 con 0x7fca781029a0 2024-04-23T14:37:32.046 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.068+0000 7fca76800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca781029a0 0x7fca78102db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:32.046 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.068+0000 7fca76800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca781029a0 0x7fca78102db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54886/0 (socket says 172.21.15.81:54886) 2024-04-23T14:37:32.046 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.068+0000 7fca76800700 1 -- 172.21.15.81:0/3219325518 learned_addr learned my addr 172.21.15.81:0/3219325518 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:32.046 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.068+0000 7fca76800700 1 -- 172.21.15.81:0/3219325518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca78103430 con 0x7fca781029a0 2024-04-23T14:37:32.046 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.069+0000 7fca76800700 1 --2- 172.21.15.81:0/3219325518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca781029a0 0x7fca78102db0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fca680098e0 tx=0x7fca68009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28e43a6c1bded476 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:32.047 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.069+0000 7fca75400700 1 -- 172.21.15.81:0/3219325518 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca6800b8f0 con 0x7fca781029a0 2024-04-23T14:37:32.047 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.069+0000 7fca75400700 1 -- 172.21.15.81:0/3219325518 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fca68011420 con 0x7fca781029a0 2024-04-23T14:37:32.047 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.069+0000 7fca75400700 1 -- 172.21.15.81:0/3219325518 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca68010540 con 0x7fca781029a0 2024-04-23T14:37:32.047 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.070+0000 7fca7d400700 1 -- 172.21.15.81:0/3219325518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca781029a0 msgr2=0x7fca78102db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:32.047 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.070+0000 7fca7d400700 1 --2- 172.21.15.81:0/3219325518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca781029a0 0x7fca78102db0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fca680098e0 tx=0x7fca68009250 comp rx=0 tx=0).stop 2024-04-23T14:37:32.047 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.070+0000 7fca7d400700 1 -- 172.21.15.81:0/3219325518 shutdown_connections 2024-04-23T14:37:32.047 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.070+0000 7fca7d400700 1 --2- 172.21.15.81:0/3219325518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca781029a0 0x7fca78102db0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:32.047 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.070+0000 7fca7d400700 1 -- 172.21.15.81:0/3219325518 >> 172.21.15.81:0/3219325518 conn(0x7fca780fe100 msgr2=0x7fca78100530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:32.047 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.070+0000 7fca7d400700 1 -- 172.21.15.81:0/3219325518 shutdown_connections 2024-04-23T14:37:32.047 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.070+0000 7fca7d400700 1 -- 172.21.15.81:0/3219325518 wait complete. 2024-04-23T14:37:32.047 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.071+0000 7fca7d400700 1 Processor -- start 2024-04-23T14:37:32.047 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.071+0000 7fca7d400700 1 -- start start 2024-04-23T14:37:32.047 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.072+0000 7fca7d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca781029a0 0x7fca78111790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:32.047 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.072+0000 7fca7d400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca78111cd0 con 0x7fca781029a0 2024-04-23T14:37:32.047 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.072+0000 7fca76800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca781029a0 0x7fca78111790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:32.048 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.072+0000 7fca76800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca781029a0 0x7fca78111790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54900/0 (socket says 172.21.15.81:54900) 2024-04-23T14:37:32.048 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.072+0000 7fca76800700 1 -- 172.21.15.81:0/3652027303 learned_addr learned my addr 172.21.15.81:0/3652027303 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:32.048 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.072+0000 7fca76800700 1 -- 172.21.15.81:0/3652027303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca680094f0 con 0x7fca781029a0 2024-04-23T14:37:32.048 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.073+0000 7fca76800700 1 --2- 172.21.15.81:0/3652027303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca781029a0 0x7fca78111790 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fca6800b440 tx=0x7fca68009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:32.048 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.073+0000 7fca6ea00700 1 -- 172.21.15.81:0/3652027303 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca680107b0 con 0x7fca781029a0 2024-04-23T14:37:32.048 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.073+0000 7fca6ea00700 1 -- 172.21.15.81:0/3652027303 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fca68010da0 con 0x7fca781029a0 2024-04-23T14:37:32.048 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.073+0000 7fca7d400700 1 -- 172.21.15.81:0/3652027303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca78111ed0 con 0x7fca781029a0 2024-04-23T14:37:32.048 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.073+0000 7fca6ea00700 1 -- 172.21.15.81:0/3652027303 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca68024e10 con 0x7fca781029a0 2024-04-23T14:37:32.048 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.073+0000 7fca7d400700 1 -- 172.21.15.81:0/3652027303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca78112a40 con 0x7fca781029a0 2024-04-23T14:37:32.048 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.074+0000 7fca6ea00700 1 -- 172.21.15.81:0/3652027303 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fca68010910 con 0x7fca781029a0 2024-04-23T14:37:32.048 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.075+0000 7fca7d400700 1 -- 172.21.15.81:0/3652027303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca7805f5f0 con 0x7fca781029a0 2024-04-23T14:37:32.048 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.075+0000 7fca6ea00700 1 --2- 172.21.15.81:0/3652027303 >> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] conn(0x7fca5c036740 0x7fca5c038bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:32.048 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.075+0000 7fca6ea00700 1 -- 172.21.15.81:0/3652027303 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fca6804a520 con 0x7fca781029a0 2024-04-23T14:37:32.048 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.075+0000 7fca75e00700 1 -- 172.21.15.81:0/3652027303 >> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] conn(0x7fca5c036740 msgr2=0x7fca5c038bf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/1764050360 2024-04-23T14:37:32.048 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.075+0000 7fca75e00700 1 --2- 172.21.15.81:0/3652027303 >> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] conn(0x7fca5c036740 0x7fca5c038bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T14:37:32.049 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.080+0000 7fca6ea00700 1 -- 172.21.15.81:0/3652027303 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fca6802d3f0 con 0x7fca781029a0 2024-04-23T14:37:32.049 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.276+0000 7fca75e00700 1 -- 172.21.15.81:0/3652027303 >> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] conn(0x7fca5c036740 msgr2=0x7fca5c038bf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/1764050360 2024-04-23T14:37:32.049 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.276+0000 7fca75e00700 1 --2- 172.21.15.81:0/3652027303 >> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] conn(0x7fca5c036740 0x7fca5c038bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-23T14:37:32.049 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.345+0000 7fca7d400700 1 -- 172.21.15.81:0/3652027303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fca78112d80 con 0x7fca781029a0 2024-04-23T14:37:32.049 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.346+0000 7fca6ea00700 1 -- 172.21.15.81:0/3652027303 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7fca68024440 con 0x7fca781029a0 2024-04-23T14:37:32.049 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.349+0000 7fca7d400700 1 -- 172.21.15.81:0/3652027303 >> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] conn(0x7fca5c036740 msgr2=0x7fca5c038bf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-23T14:37:32.049 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.349+0000 7fca7d400700 1 --2- 172.21.15.81:0/3652027303 >> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] conn(0x7fca5c036740 0x7fca5c038bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:32.049 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.349+0000 7fca7d400700 1 -- 172.21.15.81:0/3652027303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca781029a0 msgr2=0x7fca78111790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:32.049 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.349+0000 7fca7d400700 1 --2- 172.21.15.81:0/3652027303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca781029a0 0x7fca78111790 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fca6800b440 tx=0x7fca68009250 comp rx=0 tx=0).stop 2024-04-23T14:37:32.049 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.349+0000 7fca7d400700 1 -- 172.21.15.81:0/3652027303 shutdown_connections 2024-04-23T14:37:32.049 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.349+0000 7fca7d400700 1 --2- 172.21.15.81:0/3652027303 >> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] conn(0x7fca5c036740 0x7fca5c038bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:32.049 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.349+0000 7fca7d400700 1 --2- 172.21.15.81:0/3652027303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca781029a0 0x7fca78111790 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:32.049 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.349+0000 7fca7d400700 1 -- 172.21.15.81:0/3652027303 >> 172.21.15.81:0/3652027303 conn(0x7fca780fe100 msgr2=0x7fca780fedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:32.049 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.349+0000 7fca7d400700 1 -- 172.21.15.81:0/3652027303 shutdown_connections 2024-04-23T14:37:32.049 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:31.349+0000 7fca7d400700 1 -- 172.21.15.81:0/3652027303 wait complete. 2024-04-23T14:37:32.050 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for the mgr to restart... 2024-04-23T14:37:32.050 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mgr epoch 5... 2024-04-23T14:37:38.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:38 smithi081 ceph-mon[25540]: Active manager daemon smithi081.ldghvq restarted 2024-04-23T14:37:38.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:38 smithi081 ceph-mon[25540]: Activating manager daemon smithi081.ldghvq 2024-04-23T14:37:38.578 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:38 smithi081 ceph-mon[25540]: osdmap e2: 0 total, 0 up, 0 in 2024-04-23T14:37:38.578 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:38 smithi081 ceph-mon[25540]: mgrmap e6: smithi081.ldghvq(active, starting, since 0.00930731s) 2024-04-23T14:37:38.578 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:38 smithi081 ceph-mon[25540]: from='mgr.14120 172.21.15.81:0/2042221483' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi081"}]: dispatch 2024-04-23T14:37:38.578 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:38 smithi081 ceph-mon[25540]: from='mgr.14120 172.21.15.81:0/2042221483' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mgr metadata", "who": "smithi081.ldghvq", "id": "smithi081.ldghvq"}]: dispatch 2024-04-23T14:37:38.578 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:38 smithi081 ceph-mon[25540]: from='mgr.14120 172.21.15.81:0/2042221483' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-23T14:37:38.578 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:38 smithi081 ceph-mon[25540]: from='mgr.14120 172.21.15.81:0/2042221483' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-23T14:37:38.578 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:38 smithi081 ceph-mon[25540]: from='mgr.14120 172.21.15.81:0/2042221483' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-23T14:37:38.578 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:38 smithi081 ceph-mon[25540]: Manager daemon smithi081.ldghvq is now available 2024-04-23T14:37:38.578 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:38 smithi081 ceph-mon[25540]: from='mgr.14120 172.21.15.81:0/2042221483' entity='mgr.smithi081.ldghvq' 2024-04-23T14:37:39.540 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:39 smithi081 ceph-mon[25540]: Found migration_current of "None". Setting to last migration. 2024-04-23T14:37:39.540 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:39 smithi081 ceph-mon[25540]: from='mgr.14120 172.21.15.81:0/2042221483' entity='mgr.smithi081.ldghvq' 2024-04-23T14:37:39.540 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:39 smithi081 ceph-mon[25540]: from='mgr.14120 172.21.15.81:0/2042221483' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:37:39.540 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:39 smithi081 ceph-mon[25540]: from='mgr.14120 172.21.15.81:0/2042221483' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:37:39.540 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:39 smithi081 ceph-mon[25540]: from='mgr.14120 172.21.15.81:0/2042221483' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:37:39.540 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:39 smithi081 ceph-mon[25540]: from='mgr.14120 172.21.15.81:0/2042221483' entity='mgr.smithi081.ldghvq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi081.ldghvq/mirror_snapshot_schedule"}]: dispatch 2024-04-23T14:37:39.540 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:39 smithi081 ceph-mon[25540]: from='mgr.14120 172.21.15.81:0/2042221483' entity='mgr.smithi081.ldghvq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi081.ldghvq/trash_purge_schedule"}]: dispatch 2024-04-23T14:37:39.540 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:39 smithi081 ceph-mon[25540]: [23/Apr/2024:14:37:38] ENGINE Bus STARTING 2024-04-23T14:37:39.540 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:39 smithi081 ceph-mon[25540]: [23/Apr/2024:14:37:38] ENGINE Serving on https://172.21.15.81:7150 2024-04-23T14:37:39.540 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:39 smithi081 ceph-mon[25540]: [23/Apr/2024:14:37:38] ENGINE Bus STARTED 2024-04-23T14:37:39.540 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:39 smithi081 ceph-mon[25540]: from='mgr.14120 172.21.15.81:0/2042221483' entity='mgr.smithi081.ldghvq' 2024-04-23T14:37:39.540 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:39 smithi081 ceph-mon[25540]: from='mgr.14120 172.21.15.81:0/2042221483' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:37:39.540 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:39 smithi081 ceph-mon[25540]: mgrmap e7: smithi081.ldghvq(active, since 1.01796s) 2024-04-23T14:37:39.861 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-04-23T14:37:39.861 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-04-23T14:37:39.861 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-23T14:37:39.861 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-04-23T14:37:39.861 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.579+0000 7fdd66000700 1 Processor -- start 2024-04-23T14:37:39.861 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.579+0000 7fdd66000700 1 -- start start 2024-04-23T14:37:39.861 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.580+0000 7fdd66000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd60077ad0 0x7fdd60076170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:39.862 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.580+0000 7fdd66000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd60077ee0 con 0x7fdd60077ad0 2024-04-23T14:37:39.862 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.580+0000 7fdd5f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd60077ad0 0x7fdd60076170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:39.862 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.580+0000 7fdd5f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd60077ad0 0x7fdd60076170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54914/0 (socket says 172.21.15.81:54914) 2024-04-23T14:37:39.862 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.580+0000 7fdd5f400700 1 -- 172.21.15.81:0/2741867718 learned_addr learned my addr 172.21.15.81:0/2741867718 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:39.862 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.580+0000 7fdd5f400700 1 -- 172.21.15.81:0/2741867718 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd60078020 con 0x7fdd60077ad0 2024-04-23T14:37:39.862 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.581+0000 7fdd5f400700 1 --2- 172.21.15.81:0/2741867718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd60077ad0 0x7fdd60076170 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdd500098e0 tx=0x7fdd50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d991d50f0431b2ff server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:39.862 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.581+0000 7fdd5e000700 1 -- 172.21.15.81:0/2741867718 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdd5000b8f0 con 0x7fdd60077ad0 2024-04-23T14:37:39.862 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.581+0000 7fdd5e000700 1 -- 172.21.15.81:0/2741867718 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fdd50011420 con 0x7fdd60077ad0 2024-04-23T14:37:39.862 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.581+0000 7fdd5e000700 1 -- 172.21.15.81:0/2741867718 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdd50010540 con 0x7fdd60077ad0 2024-04-23T14:37:39.862 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.582+0000 7fdd66000700 1 -- 172.21.15.81:0/2741867718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd60077ad0 msgr2=0x7fdd60076170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:39.862 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.582+0000 7fdd66000700 1 --2- 172.21.15.81:0/2741867718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd60077ad0 0x7fdd60076170 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdd500098e0 tx=0x7fdd50009250 comp rx=0 tx=0).stop 2024-04-23T14:37:39.863 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.582+0000 7fdd66000700 1 -- 172.21.15.81:0/2741867718 shutdown_connections 2024-04-23T14:37:39.863 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.582+0000 7fdd66000700 1 --2- 172.21.15.81:0/2741867718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd60077ad0 0x7fdd60076170 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:39.863 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.582+0000 7fdd66000700 1 -- 172.21.15.81:0/2741867718 >> 172.21.15.81:0/2741867718 conn(0x7fdd600fe0b0 msgr2=0x7fdd60100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:39.863 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.582+0000 7fdd66000700 1 -- 172.21.15.81:0/2741867718 shutdown_connections 2024-04-23T14:37:39.863 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.582+0000 7fdd66000700 1 -- 172.21.15.81:0/2741867718 wait complete. 2024-04-23T14:37:39.863 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.583+0000 7fdd66000700 1 Processor -- start 2024-04-23T14:37:39.863 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.583+0000 7fdd66000700 1 -- start start 2024-04-23T14:37:39.863 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.584+0000 7fdd66000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd60077ad0 0x7fdd601139b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:39.863 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.584+0000 7fdd66000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd60113ef0 con 0x7fdd60077ad0 2024-04-23T14:37:39.863 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.584+0000 7fdd5f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd60077ad0 0x7fdd601139b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:39.863 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.584+0000 7fdd5f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd60077ad0 0x7fdd601139b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54918/0 (socket says 172.21.15.81:54918) 2024-04-23T14:37:39.863 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.584+0000 7fdd5f400700 1 -- 172.21.15.81:0/2523049680 learned_addr learned my addr 172.21.15.81:0/2523049680 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:39.864 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.585+0000 7fdd5f400700 1 -- 172.21.15.81:0/2523049680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd500094f0 con 0x7fdd60077ad0 2024-04-23T14:37:39.864 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.585+0000 7fdd5f400700 1 --2- 172.21.15.81:0/2523049680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd60077ad0 0x7fdd601139b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdd50011db0 tx=0x7fdd50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:39.864 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.585+0000 7fdd57400700 1 -- 172.21.15.81:0/2523049680 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdd500107b0 con 0x7fdd60077ad0 2024-04-23T14:37:39.864 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.585+0000 7fdd57400700 1 -- 172.21.15.81:0/2523049680 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fdd50010da0 con 0x7fdd60077ad0 2024-04-23T14:37:39.864 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.585+0000 7fdd66000700 1 -- 172.21.15.81:0/2523049680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd601140f0 con 0x7fdd60077ad0 2024-04-23T14:37:39.864 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.585+0000 7fdd57400700 1 -- 172.21.15.81:0/2523049680 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdd5001ad60 con 0x7fdd60077ad0 2024-04-23T14:37:39.864 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.585+0000 7fdd66000700 1 -- 172.21.15.81:0/2523049680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd60114c60 con 0x7fdd60077ad0 2024-04-23T14:37:39.864 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.587+0000 7fdd57400700 1 -- 172.21.15.81:0/2523049680 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fdd5001a5c0 con 0x7fdd60077ad0 2024-04-23T14:37:39.864 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.587+0000 7fdd57400700 1 --2- 172.21.15.81:0/2523049680 >> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] conn(0x7fdd440367e0 0x7fdd44038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:39.864 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.587+0000 7fdd57400700 1 -- 172.21.15.81:0/2523049680 --> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdd440393a0 con 0x7fdd440367e0 2024-04-23T14:37:39.864 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.587+0000 7fdd57400700 1 -- 172.21.15.81:0/2523049680 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fdd5004abb0 con 0x7fdd60077ad0 2024-04-23T14:37:39.865 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.587+0000 7fdd5ea00700 1 -- 172.21.15.81:0/2523049680 >> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] conn(0x7fdd440367e0 msgr2=0x7fdd44038c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/1764050360 2024-04-23T14:37:39.865 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.587+0000 7fdd5ea00700 1 --2- 172.21.15.81:0/2523049680 >> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] conn(0x7fdd440367e0 0x7fdd44038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T14:37:39.865 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.788+0000 7fdd5ea00700 1 -- 172.21.15.81:0/2523049680 >> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] conn(0x7fdd440367e0 msgr2=0x7fdd44038c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/1764050360 2024-04-23T14:37:39.865 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:32.788+0000 7fdd5ea00700 1 --2- 172.21.15.81:0/2523049680 >> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] conn(0x7fdd440367e0 0x7fdd44038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-23T14:37:39.865 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.189+0000 7fdd5ea00700 1 -- 172.21.15.81:0/2523049680 >> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] conn(0x7fdd440367e0 msgr2=0x7fdd44038c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/1764050360 2024-04-23T14:37:39.865 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.189+0000 7fdd5ea00700 1 --2- 172.21.15.81:0/2523049680 >> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] conn(0x7fdd440367e0 0x7fdd44038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-23T14:37:39.865 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.990+0000 7fdd5ea00700 1 -- 172.21.15.81:0/2523049680 >> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] conn(0x7fdd440367e0 msgr2=0x7fdd44038c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/1764050360 2024-04-23T14:37:39.865 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:33.990+0000 7fdd5ea00700 1 --2- 172.21.15.81:0/2523049680 >> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] conn(0x7fdd440367e0 0x7fdd44038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-23T14:37:39.865 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.592+0000 7fdd5ea00700 1 -- 172.21.15.81:0/2523049680 >> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] conn(0x7fdd440367e0 msgr2=0x7fdd44038c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/1764050360 2024-04-23T14:37:39.865 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:35.592+0000 7fdd5ea00700 1 --2- 172.21.15.81:0/2523049680 >> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] conn(0x7fdd440367e0 0x7fdd44038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-23T14:37:39.865 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:38.181+0000 7fdd57400700 1 -- 172.21.15.81:0/2523049680 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mgrmap(e 6) v1 ==== 43143+0+0 (secure 0 0 0) 0x7fdd5000fd90 con 0x7fdd60077ad0 2024-04-23T14:37:39.866 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:38.181+0000 7fdd57400700 1 -- 172.21.15.81:0/2523049680 >> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] conn(0x7fdd440367e0 msgr2=0x7fdd44038c90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-23T14:37:39.866 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:38.181+0000 7fdd57400700 1 --2- 172.21.15.81:0/2523049680 >> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] conn(0x7fdd440367e0 0x7fdd44038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:39.866 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:39.186+0000 7fdd57400700 1 -- 172.21.15.81:0/2523049680 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 7) v1 ==== 43270+0+0 (secure 0 0 0) 0x7fdd5002e440 con 0x7fdd60077ad0 2024-04-23T14:37:39.866 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:39.187+0000 7fdd57400700 1 --2- 172.21.15.81:0/2523049680 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fdd44039fc0 0x7fdd4403c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:39.866 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:39.187+0000 7fdd57400700 1 -- 172.21.15.81:0/2523049680 --> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdd440393a0 con 0x7fdd44039fc0 2024-04-23T14:37:39.866 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:39.189+0000 7fdd5ea00700 1 --2- 172.21.15.81:0/2523049680 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fdd44039fc0 0x7fdd4403c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:39.866 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:39.192+0000 7fdd5ea00700 1 --2- 172.21.15.81:0/2523049680 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fdd44039fc0 0x7fdd4403c3a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c0039d0 tx=0x7fdd4c009350 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:39.866 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:39.193+0000 7fdd57400700 1 -- 172.21.15.81:0/2523049680 <== mgr.14120 v2:172.21.15.81:6800/2072638798 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7fdd440393a0 con 0x7fdd44039fc0 2024-04-23T14:37:39.866 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:39.201+0000 7fdd66000700 1 -- 172.21.15.81:0/2523049680 --> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fdd60114580 con 0x7fdd44039fc0 2024-04-23T14:37:39.866 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:39.201+0000 7fdd57400700 1 -- 172.21.15.81:0/2523049680 <== mgr.14120 v2:172.21.15.81:6800/2072638798 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fdd60114580 con 0x7fdd44039fc0 2024-04-23T14:37:39.866 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:39.202+0000 7fdd66000700 1 -- 172.21.15.81:0/2523049680 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fdd44039fc0 msgr2=0x7fdd4403c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:39.867 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:39.202+0000 7fdd66000700 1 --2- 172.21.15.81:0/2523049680 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fdd44039fc0 0x7fdd4403c3a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c0039d0 tx=0x7fdd4c009350 comp rx=0 tx=0).stop 2024-04-23T14:37:39.867 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:39.202+0000 7fdd66000700 1 -- 172.21.15.81:0/2523049680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd60077ad0 msgr2=0x7fdd601139b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:39.867 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:39.202+0000 7fdd66000700 1 --2- 172.21.15.81:0/2523049680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd60077ad0 0x7fdd601139b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdd50011db0 tx=0x7fdd50009250 comp rx=0 tx=0).stop 2024-04-23T14:37:39.867 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:39.203+0000 7fdd66000700 1 -- 172.21.15.81:0/2523049680 shutdown_connections 2024-04-23T14:37:39.867 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:39.203+0000 7fdd66000700 1 --2- 172.21.15.81:0/2523049680 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fdd44039fc0 0x7fdd4403c3a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:39.867 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:39.203+0000 7fdd66000700 1 --2- 172.21.15.81:0/2523049680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd60077ad0 0x7fdd601139b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:39.867 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:39.203+0000 7fdd66000700 1 --2- 172.21.15.81:0/2523049680 >> [v2:172.21.15.81:6800/1764050360,v1:172.21.15.81:6801/1764050360] conn(0x7fdd440367e0 0x7fdd44038c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:39.867 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:39.203+0000 7fdd66000700 1 -- 172.21.15.81:0/2523049680 >> 172.21.15.81:0/2523049680 conn(0x7fdd600fe0b0 msgr2=0x7fdd600fede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:39.867 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:39.203+0000 7fdd66000700 1 -- 172.21.15.81:0/2523049680 shutdown_connections 2024-04-23T14:37:39.867 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:39.203+0000 7fdd66000700 1 -- 172.21.15.81:0/2523049680 wait complete. 2024-04-23T14:37:39.867 INFO:teuthology.orchestra.run.smithi081.stdout:mgr epoch 5 is available 2024-04-23T14:37:39.868 INFO:teuthology.orchestra.run.smithi081.stdout:Setting orchestrator backend to cephadm... 2024-04-23T14:37:40.474 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:40 smithi081 ceph-mon[25540]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-23T14:37:40.474 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:40 smithi081 ceph-mon[25540]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-23T14:37:41.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:41 smithi081 ceph-mon[25540]: mgrmap e8: smithi081.ldghvq(active, since 2s) 2024-04-23T14:37:41.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:41 smithi081 ceph-mon[25540]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:37:41.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:41 smithi081 ceph-mon[25540]: from='mgr.14120 172.21.15.81:0/2042221483' entity='mgr.smithi081.ldghvq' 2024-04-23T14:37:41.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:41 smithi081 ceph-mon[25540]: from='mgr.14120 172.21.15.81:0/2042221483' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:37:41.372 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.472+0000 7f8432c00700 1 Processor -- start 2024-04-23T14:37:41.372 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.472+0000 7f8432c00700 1 -- start start 2024-04-23T14:37:41.372 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.473+0000 7f8432c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f842c104c20 0x7f842c105030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:41.372 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.473+0000 7f8432c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842c105600 con 0x7f842c104c20 2024-04-23T14:37:41.372 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.473+0000 7f842be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f842c104c20 0x7f842c105030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:41.373 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.473+0000 7f842be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f842c104c20 0x7f842c105030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56582/0 (socket says 172.21.15.81:56582) 2024-04-23T14:37:41.373 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.473+0000 7f842be00700 1 -- 172.21.15.81:0/3792918637 learned_addr learned my addr 172.21.15.81:0/3792918637 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:41.373 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.474+0000 7f842be00700 1 -- 172.21.15.81:0/3792918637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f842c105740 con 0x7f842c104c20 2024-04-23T14:37:41.373 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.474+0000 7f842be00700 1 --2- 172.21.15.81:0/3792918637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f842c104c20 0x7f842c105030 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f841c0098e0 tx=0x7f841c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bedce9bf377b60d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:41.373 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.474+0000 7f842aa00700 1 -- 172.21.15.81:0/3792918637 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f841c00b860 con 0x7f842c104c20 2024-04-23T14:37:41.373 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.475+0000 7f842aa00700 1 -- 172.21.15.81:0/3792918637 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f841c00be50 con 0x7f842c104c20 2024-04-23T14:37:41.373 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.475+0000 7f842aa00700 1 -- 172.21.15.81:0/3792918637 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f841c010380 con 0x7f842c104c20 2024-04-23T14:37:41.373 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.475+0000 7f8432c00700 1 -- 172.21.15.81:0/3792918637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f842c104c20 msgr2=0x7f842c105030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:41.373 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.475+0000 7f8432c00700 1 --2- 172.21.15.81:0/3792918637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f842c104c20 0x7f842c105030 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f841c0098e0 tx=0x7f841c009250 comp rx=0 tx=0).stop 2024-04-23T14:37:41.373 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.475+0000 7f8432c00700 1 -- 172.21.15.81:0/3792918637 shutdown_connections 2024-04-23T14:37:41.373 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.475+0000 7f8432c00700 1 --2- 172.21.15.81:0/3792918637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f842c104c20 0x7f842c105030 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:41.373 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.475+0000 7f8432c00700 1 -- 172.21.15.81:0/3792918637 >> 172.21.15.81:0/3792918637 conn(0x7f842c078350 msgr2=0x7f842c078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:41.373 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.475+0000 7f8432c00700 1 -- 172.21.15.81:0/3792918637 shutdown_connections 2024-04-23T14:37:41.373 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.475+0000 7f8432c00700 1 -- 172.21.15.81:0/3792918637 wait complete. 2024-04-23T14:37:41.374 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.476+0000 7f8432c00700 1 Processor -- start 2024-04-23T14:37:41.374 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.476+0000 7f8432c00700 1 -- start start 2024-04-23T14:37:41.374 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.477+0000 7f8432c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f842c104c20 0x7f842c113850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:41.374 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.477+0000 7f8432c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842c113d90 con 0x7f842c104c20 2024-04-23T14:37:41.374 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.477+0000 7f842be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f842c104c20 0x7f842c113850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:41.374 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.477+0000 7f842be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f842c104c20 0x7f842c113850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56596/0 (socket says 172.21.15.81:56596) 2024-04-23T14:37:41.374 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.477+0000 7f842be00700 1 -- 172.21.15.81:0/3608301078 learned_addr learned my addr 172.21.15.81:0/3608301078 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:41.374 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.477+0000 7f842be00700 1 -- 172.21.15.81:0/3608301078 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f841c0094f0 con 0x7f842c104c20 2024-04-23T14:37:41.374 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.477+0000 7f842be00700 1 --2- 172.21.15.81:0/3608301078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f842c104c20 0x7f842c113850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f841c006b00 tx=0x7f841c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:41.374 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.478+0000 7f8423e00700 1 -- 172.21.15.81:0/3608301078 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f841c0107c0 con 0x7f842c104c20 2024-04-23T14:37:41.374 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.478+0000 7f8423e00700 1 -- 172.21.15.81:0/3608301078 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f841c010db0 con 0x7f842c104c20 2024-04-23T14:37:41.374 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.478+0000 7f8423e00700 1 -- 172.21.15.81:0/3608301078 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f841c01acf0 con 0x7f842c104c20 2024-04-23T14:37:41.374 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.478+0000 7f8432c00700 1 -- 172.21.15.81:0/3608301078 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f842c113f90 con 0x7f842c104c20 2024-04-23T14:37:41.374 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.478+0000 7f8432c00700 1 -- 172.21.15.81:0/3608301078 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f842c114b00 con 0x7f842c104c20 2024-04-23T14:37:41.375 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.479+0000 7f8432c00700 1 -- 172.21.15.81:0/3608301078 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f842c05f5f0 con 0x7f842c104c20 2024-04-23T14:37:41.375 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.479+0000 7f8423e00700 1 -- 172.21.15.81:0/3608301078 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f841c010920 con 0x7f842c104c20 2024-04-23T14:37:41.375 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.480+0000 7f8423e00700 1 --2- 172.21.15.81:0/3608301078 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f8410036830 0x7f8410038ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:41.375 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.480+0000 7f8423e00700 1 -- 172.21.15.81:0/3608301078 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f841c04a650 con 0x7f842c104c20 2024-04-23T14:37:41.375 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.480+0000 7f842b400700 1 --2- 172.21.15.81:0/3608301078 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f8410036830 0x7f8410038ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:41.375 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.481+0000 7f842b400700 1 --2- 172.21.15.81:0/3608301078 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f8410036830 0x7f8410038ce0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8418009990 tx=0x7f8418006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:41.375 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.485+0000 7f8423e00700 1 -- 172.21.15.81:0/3608301078 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f841c01a530 con 0x7f842c104c20 2024-04-23T14:37:41.375 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.711+0000 7f8432c00700 1 -- 172.21.15.81:0/3608301078 --> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f842c102bd0 con 0x7f8410036830 2024-04-23T14:37:41.375 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.737+0000 7f8423e00700 1 -- 172.21.15.81:0/3608301078 <== mgr.14120 v2:172.21.15.81:6800/2072638798 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f842c102bd0 con 0x7f8410036830 2024-04-23T14:37:41.375 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.740+0000 7f8432c00700 1 -- 172.21.15.81:0/3608301078 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f8410036830 msgr2=0x7f8410038ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:41.375 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.740+0000 7f8432c00700 1 --2- 172.21.15.81:0/3608301078 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f8410036830 0x7f8410038ce0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8418009990 tx=0x7f8418006e40 comp rx=0 tx=0).stop 2024-04-23T14:37:41.375 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.740+0000 7f8432c00700 1 -- 172.21.15.81:0/3608301078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f842c104c20 msgr2=0x7f842c113850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:41.375 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.740+0000 7f8432c00700 1 --2- 172.21.15.81:0/3608301078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f842c104c20 0x7f842c113850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f841c006b00 tx=0x7f841c009250 comp rx=0 tx=0).stop 2024-04-23T14:37:41.375 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.741+0000 7f8432c00700 1 -- 172.21.15.81:0/3608301078 shutdown_connections 2024-04-23T14:37:41.376 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.741+0000 7f8432c00700 1 --2- 172.21.15.81:0/3608301078 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f8410036830 0x7f8410038ce0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:41.376 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.741+0000 7f8432c00700 1 --2- 172.21.15.81:0/3608301078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f842c104c20 0x7f842c113850 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:41.376 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.741+0000 7f8432c00700 1 -- 172.21.15.81:0/3608301078 >> 172.21.15.81:0/3608301078 conn(0x7f842c078350 msgr2=0x7f842c1024c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:41.376 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.741+0000 7f8432c00700 1 -- 172.21.15.81:0/3608301078 shutdown_connections 2024-04-23T14:37:41.376 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:40.741+0000 7f8432c00700 1 -- 172.21.15.81:0/3608301078 wait complete. 2024-04-23T14:37:42.900 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout value unchanged 2024-04-23T14:37:42.900 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:41.974+0000 7fc797600700 1 Processor -- start 2024-04-23T14:37:42.900 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:41.974+0000 7fc797600700 1 -- start start 2024-04-23T14:37:42.900 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:41.975+0000 7fc797600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc790102910 0x7fc790102d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:42.900 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:41.975+0000 7fc797600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc790103260 con 0x7fc790102910 2024-04-23T14:37:42.900 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:41.975+0000 7fc794c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc790102910 0x7fc790102d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:42.900 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:41.975+0000 7fc794c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc790102910 0x7fc790102d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56612/0 (socket says 172.21.15.81:56612) 2024-04-23T14:37:42.900 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:41.975+0000 7fc794c00700 1 -- 172.21.15.81:0/2747324476 learned_addr learned my addr 172.21.15.81:0/2747324476 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:42.901 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:41.976+0000 7fc794c00700 1 -- 172.21.15.81:0/2747324476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7901033a0 con 0x7fc790102910 2024-04-23T14:37:42.901 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:41.976+0000 7fc794c00700 1 --2- 172.21.15.81:0/2747324476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc790102910 0x7fc790102d20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc7840098e0 tx=0x7fc784009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c569622bfdb63fb4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:42.901 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:41.976+0000 7fc78f400700 1 -- 172.21.15.81:0/2747324476 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc78400b860 con 0x7fc790102910 2024-04-23T14:37:42.901 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:41.976+0000 7fc78f400700 1 -- 172.21.15.81:0/2747324476 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fc78400be50 con 0x7fc790102910 2024-04-23T14:37:42.901 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:41.976+0000 7fc78f400700 1 -- 172.21.15.81:0/2747324476 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc784010380 con 0x7fc790102910 2024-04-23T14:37:42.901 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:41.977+0000 7fc797600700 1 -- 172.21.15.81:0/2747324476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc790102910 msgr2=0x7fc790102d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:42.901 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:41.977+0000 7fc797600700 1 --2- 172.21.15.81:0/2747324476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc790102910 0x7fc790102d20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc7840098e0 tx=0x7fc784009250 comp rx=0 tx=0).stop 2024-04-23T14:37:42.901 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:41.977+0000 7fc797600700 1 -- 172.21.15.81:0/2747324476 shutdown_connections 2024-04-23T14:37:42.901 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:41.977+0000 7fc797600700 1 --2- 172.21.15.81:0/2747324476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc790102910 0x7fc790102d20 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:42.901 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:41.977+0000 7fc797600700 1 -- 172.21.15.81:0/2747324476 >> 172.21.15.81:0/2747324476 conn(0x7fc7900fe0b0 msgr2=0x7fc7901004c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:42.901 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:41.977+0000 7fc797600700 1 -- 172.21.15.81:0/2747324476 shutdown_connections 2024-04-23T14:37:42.901 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:41.977+0000 7fc797600700 1 -- 172.21.15.81:0/2747324476 wait complete. 2024-04-23T14:37:42.901 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:41.978+0000 7fc797600700 1 Processor -- start 2024-04-23T14:37:42.901 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:41.978+0000 7fc797600700 1 -- start start 2024-04-23T14:37:42.901 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:41.979+0000 7fc797600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc790102910 0x7fc790111700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:42.902 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:41.979+0000 7fc797600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc790111c40 con 0x7fc790102910 2024-04-23T14:37:42.902 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:41.979+0000 7fc794c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc790102910 0x7fc790111700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:42.902 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:41.979+0000 7fc794c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc790102910 0x7fc790111700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56614/0 (socket says 172.21.15.81:56614) 2024-04-23T14:37:42.902 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:41.979+0000 7fc794c00700 1 -- 172.21.15.81:0/609469432 learned_addr learned my addr 172.21.15.81:0/609469432 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:42.902 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:41.980+0000 7fc794c00700 1 -- 172.21.15.81:0/609469432 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7840094f0 con 0x7fc790102910 2024-04-23T14:37:42.902 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:41.980+0000 7fc794c00700 1 --2- 172.21.15.81:0/609469432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc790102910 0x7fc790111700 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc78400ba90 tx=0x7fc784009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:42.902 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:41.980+0000 7fc78cc00700 1 -- 172.21.15.81:0/609469432 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc7840107c0 con 0x7fc790102910 2024-04-23T14:37:42.902 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:41.980+0000 7fc78cc00700 1 -- 172.21.15.81:0/609469432 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fc784010db0 con 0x7fc790102910 2024-04-23T14:37:42.902 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:41.980+0000 7fc78cc00700 1 -- 172.21.15.81:0/609469432 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc78401add0 con 0x7fc790102910 2024-04-23T14:37:42.902 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:41.980+0000 7fc797600700 1 -- 172.21.15.81:0/609469432 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc790111e40 con 0x7fc790102910 2024-04-23T14:37:42.902 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:41.980+0000 7fc797600700 1 -- 172.21.15.81:0/609469432 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7901129b0 con 0x7fc790102910 2024-04-23T14:37:42.902 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:41.981+0000 7fc797600700 1 -- 172.21.15.81:0/609469432 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc79005f5f0 con 0x7fc790102910 2024-04-23T14:37:42.902 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:41.981+0000 7fc78cc00700 1 -- 172.21.15.81:0/609469432 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fc784010920 con 0x7fc790102910 2024-04-23T14:37:42.902 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:41.982+0000 7fc78cc00700 1 --2- 172.21.15.81:0/609469432 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fc778036830 0x7fc778038ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:42.902 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:41.982+0000 7fc78cc00700 1 -- 172.21.15.81:0/609469432 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fc78404a600 con 0x7fc790102910 2024-04-23T14:37:42.903 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:41.982+0000 7fc78fe00700 1 --2- 172.21.15.81:0/609469432 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fc778036830 0x7fc778038ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:42.903 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:41.983+0000 7fc78fe00700 1 --2- 172.21.15.81:0/609469432 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fc778036830 0x7fc778038ce0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc77c009990 tx=0x7fc77c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:42.903 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:41.987+0000 7fc78cc00700 1 -- 172.21.15.81:0/609469432 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fc78401a430 con 0x7fc790102910 2024-04-23T14:37:42.903 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:42.199+0000 7fc797600700 1 -- 172.21.15.81:0/609469432 --> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7fc7900ff3d0 con 0x7fc778036830 2024-04-23T14:37:42.903 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:42.200+0000 7fc78cc00700 1 -- 172.21.15.81:0/609469432 <== mgr.14120 v2:172.21.15.81:6800/2072638798 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7fc7900ff3d0 con 0x7fc778036830 2024-04-23T14:37:42.903 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:42.203+0000 7fc797600700 1 -- 172.21.15.81:0/609469432 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fc778036830 msgr2=0x7fc778038ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:42.903 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:42.203+0000 7fc797600700 1 --2- 172.21.15.81:0/609469432 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fc778036830 0x7fc778038ce0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc77c009990 tx=0x7fc77c006e40 comp rx=0 tx=0).stop 2024-04-23T14:37:42.903 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:42.203+0000 7fc797600700 1 -- 172.21.15.81:0/609469432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc790102910 msgr2=0x7fc790111700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:42.903 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:42.203+0000 7fc797600700 1 --2- 172.21.15.81:0/609469432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc790102910 0x7fc790111700 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc78400ba90 tx=0x7fc784009250 comp rx=0 tx=0).stop 2024-04-23T14:37:42.903 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:42.203+0000 7fc797600700 1 -- 172.21.15.81:0/609469432 shutdown_connections 2024-04-23T14:37:42.903 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:42.203+0000 7fc797600700 1 --2- 172.21.15.81:0/609469432 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fc778036830 0x7fc778038ce0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:42.903 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:42.203+0000 7fc797600700 1 --2- 172.21.15.81:0/609469432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc790102910 0x7fc790111700 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:42.903 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:42.203+0000 7fc797600700 1 -- 172.21.15.81:0/609469432 >> 172.21.15.81:0/609469432 conn(0x7fc7900fe0b0 msgr2=0x7fc7900feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:42.903 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:42.203+0000 7fc797600700 1 -- 172.21.15.81:0/609469432 shutdown_connections 2024-04-23T14:37:42.903 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:42.203+0000 7fc797600700 1 -- 172.21.15.81:0/609469432 wait complete. 2024-04-23T14:37:42.904 INFO:teuthology.orchestra.run.smithi081.stdout:Generating ssh key... 2024-04-23T14:37:43.228 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:42 smithi081 ceph-mon[25540]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:37:44.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.526+0000 7f99ba200700 1 Processor -- start 2024-04-23T14:37:44.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.527+0000 7f99ba200700 1 -- start start 2024-04-23T14:37:44.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.527+0000 7f99ba200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b4101680 0x7f99b4101a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:44.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.527+0000 7f99ba200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b4101fd0 con 0x7f99b4101680 2024-04-23T14:37:44.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.527+0000 7f99b8e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b4101680 0x7f99b4101a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:44.588 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.528+0000 7f99b8e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b4101680 0x7f99b4101a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56620/0 (socket says 172.21.15.81:56620) 2024-04-23T14:37:44.588 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.528+0000 7f99b8e00700 1 -- 172.21.15.81:0/2846073849 learned_addr learned my addr 172.21.15.81:0/2846073849 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:44.588 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.528+0000 7f99b8e00700 1 -- 172.21.15.81:0/2846073849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b4102110 con 0x7f99b4101680 2024-04-23T14:37:44.588 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.528+0000 7f99b8e00700 1 --2- 172.21.15.81:0/2846073849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b4101680 0x7f99b4101a90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f99a80098e0 tx=0x7f99a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78ee6c99767fb529 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:44.589 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.529+0000 7f99b3400700 1 -- 172.21.15.81:0/2846073849 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f99a800b860 con 0x7f99b4101680 2024-04-23T14:37:44.589 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.529+0000 7f99b3400700 1 -- 172.21.15.81:0/2846073849 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f99a800be50 con 0x7f99b4101680 2024-04-23T14:37:44.589 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.529+0000 7f99b3400700 1 -- 172.21.15.81:0/2846073849 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f99a8010380 con 0x7f99b4101680 2024-04-23T14:37:44.590 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.529+0000 7f99ba200700 1 -- 172.21.15.81:0/2846073849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b4101680 msgr2=0x7f99b4101a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:44.590 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.529+0000 7f99ba200700 1 --2- 172.21.15.81:0/2846073849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b4101680 0x7f99b4101a90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f99a80098e0 tx=0x7f99a8009250 comp rx=0 tx=0).stop 2024-04-23T14:37:44.590 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.530+0000 7f99ba200700 1 -- 172.21.15.81:0/2846073849 shutdown_connections 2024-04-23T14:37:44.590 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.530+0000 7f99ba200700 1 --2- 172.21.15.81:0/2846073849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b4101680 0x7f99b4101a90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:44.591 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.530+0000 7f99ba200700 1 -- 172.21.15.81:0/2846073849 >> 172.21.15.81:0/2846073849 conn(0x7f99b40fce20 msgr2=0x7f99b40ff230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:44.591 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.530+0000 7f99ba200700 1 -- 172.21.15.81:0/2846073849 shutdown_connections 2024-04-23T14:37:44.591 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.530+0000 7f99ba200700 1 -- 172.21.15.81:0/2846073849 wait complete. 2024-04-23T14:37:44.591 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.531+0000 7f99ba200700 1 Processor -- start 2024-04-23T14:37:44.591 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.531+0000 7f99ba200700 1 -- start start 2024-04-23T14:37:44.591 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.531+0000 7f99ba200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b4101680 0x7f99b41136d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:44.592 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.531+0000 7f99ba200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b4113c10 con 0x7f99b4101680 2024-04-23T14:37:44.592 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.531+0000 7f99b8e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b4101680 0x7f99b41136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:44.592 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.531+0000 7f99b8e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b4101680 0x7f99b41136d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56632/0 (socket says 172.21.15.81:56632) 2024-04-23T14:37:44.592 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.531+0000 7f99b8e00700 1 -- 172.21.15.81:0/854027148 learned_addr learned my addr 172.21.15.81:0/854027148 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:44.592 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.532+0000 7f99b8e00700 1 -- 172.21.15.81:0/854027148 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a80094f0 con 0x7f99b4101680 2024-04-23T14:37:44.592 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.532+0000 7f99b8e00700 1 --2- 172.21.15.81:0/854027148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b4101680 0x7f99b41136d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f99a8000c00 tx=0x7f99a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:44.593 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.532+0000 7f99b0c00700 1 -- 172.21.15.81:0/854027148 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f99a80107c0 con 0x7f99b4101680 2024-04-23T14:37:44.594 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.532+0000 7f99b0c00700 1 -- 172.21.15.81:0/854027148 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f99a8010db0 con 0x7f99b4101680 2024-04-23T14:37:44.594 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.532+0000 7f99b0c00700 1 -- 172.21.15.81:0/854027148 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f99a801ad00 con 0x7f99b4101680 2024-04-23T14:37:44.594 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.532+0000 7f99ba200700 1 -- 172.21.15.81:0/854027148 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b4113e10 con 0x7f99b4101680 2024-04-23T14:37:44.594 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.532+0000 7f99ba200700 1 -- 172.21.15.81:0/854027148 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b4114980 con 0x7f99b4101680 2024-04-23T14:37:44.594 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.533+0000 7f99ba200700 1 -- 172.21.15.81:0/854027148 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b405f5f0 con 0x7f99b4101680 2024-04-23T14:37:44.595 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.534+0000 7f99b0c00700 1 -- 172.21.15.81:0/854027148 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f99a801a530 con 0x7f99b4101680 2024-04-23T14:37:44.595 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.534+0000 7f99b0c00700 1 --2- 172.21.15.81:0/854027148 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f999c036790 0x7f999c038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:44.595 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.534+0000 7f99b0c00700 1 -- 172.21.15.81:0/854027148 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f99a804a710 con 0x7f99b4101680 2024-04-23T14:37:44.595 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.534+0000 7f99b3e00700 1 --2- 172.21.15.81:0/854027148 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f999c036790 0x7f999c038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:44.595 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.535+0000 7f99b3e00700 1 --2- 172.21.15.81:0/854027148 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f999c036790 0x7f999c038c40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f99a0009990 tx=0x7f99a0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:44.595 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.540+0000 7f99b0c00700 1 -- 172.21.15.81:0/854027148 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f99a8010920 con 0x7f99b4101680 2024-04-23T14:37:44.596 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.752+0000 7f99ba200700 1 -- 172.21.15.81:0/854027148 --> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f99b4115510 con 0x7f999c036790 2024-04-23T14:37:44.596 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.875+0000 7f99b0c00700 1 -- 172.21.15.81:0/854027148 <== mgr.14120 v2:172.21.15.81:6800/2072638798 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f99b4115510 con 0x7f999c036790 2024-04-23T14:37:44.596 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.878+0000 7f99ba200700 1 -- 172.21.15.81:0/854027148 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f999c036790 msgr2=0x7f999c038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:44.596 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.878+0000 7f99ba200700 1 --2- 172.21.15.81:0/854027148 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f999c036790 0x7f999c038c40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f99a0009990 tx=0x7f99a0006e40 comp rx=0 tx=0).stop 2024-04-23T14:37:44.596 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.878+0000 7f99ba200700 1 -- 172.21.15.81:0/854027148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b4101680 msgr2=0x7f99b41136d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:44.597 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.878+0000 7f99ba200700 1 --2- 172.21.15.81:0/854027148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b4101680 0x7f99b41136d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f99a8000c00 tx=0x7f99a8009250 comp rx=0 tx=0).stop 2024-04-23T14:37:44.597 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.878+0000 7f99ba200700 1 -- 172.21.15.81:0/854027148 shutdown_connections 2024-04-23T14:37:44.598 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.878+0000 7f99ba200700 1 --2- 172.21.15.81:0/854027148 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f999c036790 0x7f999c038c40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:44.598 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.878+0000 7f99ba200700 1 --2- 172.21.15.81:0/854027148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b4101680 0x7f99b41136d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:44.598 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.878+0000 7f99ba200700 1 -- 172.21.15.81:0/854027148 >> 172.21.15.81:0/854027148 conn(0x7f99b40fce20 msgr2=0x7f99b40fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:44.598 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.878+0000 7f99ba200700 1 -- 172.21.15.81:0/854027148 shutdown_connections 2024-04-23T14:37:44.598 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:43.878+0000 7f99ba200700 1 -- 172.21.15.81:0/854027148 wait complete. 2024-04-23T14:37:45.172 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:44 smithi081 ceph-mon[25540]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:37:45.172 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:44 smithi081 ceph-mon[25540]: Generating ssh key... 2024-04-23T14:37:45.172 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:44 smithi081 ceph-mon[25540]: from='mgr.14120 172.21.15.81:0/2042221483' entity='mgr.smithi081.ldghvq' 2024-04-23T14:37:45.172 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:44 smithi081 ceph-mon[25540]: from='mgr.14120 172.21.15.81:0/2042221483' entity='mgr.smithi081.ldghvq' 2024-04-23T14:37:46.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:45 smithi081 ceph-mon[25540]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:37:46.090 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCsevqb/hswC1sxFpdHRNQO+ZpC3PJgalaBmLm2tgWBvq3xYbIW59qV9UK1MOiE56kch5BE9JGa9YdSlbi/rnXlUBMjqUokGAaGIMcyj6xHsemgvQVV37f5uHC1mcoxRVTZRXa5iBgz9B+zXU2qJoTlqRqOhRWJZ16Nce4vpDkj4wuT+GN+zqcXxen95YdE+Cqq3WAoiETiri8ZZiEKxULvv9tzL4j1MTFAYrFtKFzee4SwNMDsZxhuZn+6heIjekxyCpwocnKVZR+kW+txR5cYysnKXDmB6gBq2BcDfDriFMw6lnaYjrF3X9FIeOfMwcv9N/k4YJMzVDEL6Qhh02/OJkXtT/j6KdhvxmQJZ1frCp41gy6CdUvoxZ0lDj6QhqKtNGqYnzjXYqGr0nh+zewSWOwEflJhqMiqMWQbp5CoBsbJMiSL0J3F0+6SsfO6NiOIWU5ZRvGA6EvwSIbVqFOyCvyXpZe1RTnO2mfQ2oNCY9Fww/rSsAQ5ftM8U63YQis= ceph-7a641bea-017e-11ef-bc93-c7b262605968 2024-04-23T14:37:46.090 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.171+0000 7f5595600700 1 Processor -- start 2024-04-23T14:37:46.090 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.171+0000 7f5595600700 1 -- start start 2024-04-23T14:37:46.090 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.172+0000 7f5595600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559007cff0 0x7f559010bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:46.090 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.172+0000 7f5595600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559007d490 con 0x7f559007cff0 2024-04-23T14:37:46.090 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.172+0000 7f558ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559007cff0 0x7f559010bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:46.090 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.172+0000 7f558ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559007cff0 0x7f559010bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40840/0 (socket says 172.21.15.81:40840) 2024-04-23T14:37:46.090 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.172+0000 7f558ea00700 1 -- 172.21.15.81:0/2386108451 learned_addr learned my addr 172.21.15.81:0/2386108451 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:46.091 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.173+0000 7f558ea00700 1 -- 172.21.15.81:0/2386108451 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f559010c220 con 0x7f559007cff0 2024-04-23T14:37:46.091 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.173+0000 7f558ea00700 1 --2- 172.21.15.81:0/2386108451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559007cff0 0x7f559010bce0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f55800098e0 tx=0x7f5580009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=168d096db0985c95 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:46.091 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.173+0000 7f558d600700 1 -- 172.21.15.81:0/2386108451 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f558000b860 con 0x7f559007cff0 2024-04-23T14:37:46.091 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.174+0000 7f558d600700 1 -- 172.21.15.81:0/2386108451 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f558000be50 con 0x7f559007cff0 2024-04-23T14:37:46.091 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.174+0000 7f558d600700 1 -- 172.21.15.81:0/2386108451 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5580010380 con 0x7f559007cff0 2024-04-23T14:37:46.095 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.174+0000 7f5595600700 1 -- 172.21.15.81:0/2386108451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559007cff0 msgr2=0x7f559010bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:46.095 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.174+0000 7f5595600700 1 --2- 172.21.15.81:0/2386108451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559007cff0 0x7f559010bce0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f55800098e0 tx=0x7f5580009250 comp rx=0 tx=0).stop 2024-04-23T14:37:46.096 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.174+0000 7f5595600700 1 -- 172.21.15.81:0/2386108451 shutdown_connections 2024-04-23T14:37:46.096 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.174+0000 7f5595600700 1 --2- 172.21.15.81:0/2386108451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559007cff0 0x7f559010bce0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:46.096 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.174+0000 7f5595600700 1 -- 172.21.15.81:0/2386108451 >> 172.21.15.81:0/2386108451 conn(0x7f5590078540 msgr2=0x7f559007a950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:46.096 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.175+0000 7f5595600700 1 -- 172.21.15.81:0/2386108451 shutdown_connections 2024-04-23T14:37:46.096 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.175+0000 7f5595600700 1 -- 172.21.15.81:0/2386108451 wait complete. 2024-04-23T14:37:46.096 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.175+0000 7f5595600700 1 Processor -- start 2024-04-23T14:37:46.096 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.176+0000 7f5595600700 1 -- start start 2024-04-23T14:37:46.096 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.176+0000 7f5595600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559007cff0 0x7f5590117c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:46.096 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.176+0000 7f5595600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5590118140 con 0x7f559007cff0 2024-04-23T14:37:46.096 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.176+0000 7f558ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559007cff0 0x7f5590117c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:46.096 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.176+0000 7f558ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559007cff0 0x7f5590117c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40850/0 (socket says 172.21.15.81:40850) 2024-04-23T14:37:46.096 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.176+0000 7f558ea00700 1 -- 172.21.15.81:0/712260514 learned_addr learned my addr 172.21.15.81:0/712260514 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:46.096 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.177+0000 7f558ea00700 1 -- 172.21.15.81:0/712260514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55800094f0 con 0x7f559007cff0 2024-04-23T14:37:46.096 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.177+0000 7f558ea00700 1 --2- 172.21.15.81:0/712260514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559007cff0 0x7f5590117c00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5580000c00 tx=0x7f5580009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:46.097 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.177+0000 7f5586a00700 1 -- 172.21.15.81:0/712260514 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f55800107c0 con 0x7f559007cff0 2024-04-23T14:37:46.097 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.177+0000 7f5586a00700 1 -- 172.21.15.81:0/712260514 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f5580010db0 con 0x7f559007cff0 2024-04-23T14:37:46.097 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.177+0000 7f5595600700 1 -- 172.21.15.81:0/712260514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5590118340 con 0x7f559007cff0 2024-04-23T14:37:46.097 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.177+0000 7f5586a00700 1 -- 172.21.15.81:0/712260514 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f558001ad00 con 0x7f559007cff0 2024-04-23T14:37:46.097 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.177+0000 7f5595600700 1 -- 172.21.15.81:0/712260514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5590118eb0 con 0x7f559007cff0 2024-04-23T14:37:46.097 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.178+0000 7f5586a00700 1 -- 172.21.15.81:0/712260514 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f55800193c0 con 0x7f559007cff0 2024-04-23T14:37:46.097 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.179+0000 7f5595600700 1 -- 172.21.15.81:0/712260514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f559005f5f0 con 0x7f559007cff0 2024-04-23T14:37:46.097 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.179+0000 7f5586a00700 1 --2- 172.21.15.81:0/712260514 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f5574036830 0x7f5574038ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:46.097 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.179+0000 7f5586a00700 1 -- 172.21.15.81:0/712260514 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f558004a6d0 con 0x7f559007cff0 2024-04-23T14:37:46.097 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.179+0000 7f558e000700 1 --2- 172.21.15.81:0/712260514 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f5574036830 0x7f5574038ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:46.097 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.180+0000 7f558e000700 1 --2- 172.21.15.81:0/712260514 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f5574036830 0x7f5574038ce0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f557c009990 tx=0x7f557c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:46.097 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.184+0000 7f5586a00700 1 -- 172.21.15.81:0/712260514 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f5580022930 con 0x7f559007cff0 2024-04-23T14:37:46.097 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.396+0000 7f5595600700 1 -- 172.21.15.81:0/712260514 --> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f559007a790 con 0x7f5574036830 2024-04-23T14:37:46.097 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.397+0000 7f5586a00700 1 -- 172.21.15.81:0/712260514 <== mgr.14120 v2:172.21.15.81:6800/2072638798 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f559007a790 con 0x7f5574036830 2024-04-23T14:37:46.097 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.400+0000 7f5595600700 1 -- 172.21.15.81:0/712260514 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f5574036830 msgr2=0x7f5574038ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:46.098 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.400+0000 7f5595600700 1 --2- 172.21.15.81:0/712260514 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f5574036830 0x7f5574038ce0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f557c009990 tx=0x7f557c006e40 comp rx=0 tx=0).stop 2024-04-23T14:37:46.098 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.400+0000 7f5595600700 1 -- 172.21.15.81:0/712260514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559007cff0 msgr2=0x7f5590117c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:46.098 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.400+0000 7f5595600700 1 --2- 172.21.15.81:0/712260514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559007cff0 0x7f5590117c00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5580000c00 tx=0x7f5580009250 comp rx=0 tx=0).stop 2024-04-23T14:37:46.098 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.400+0000 7f5595600700 1 -- 172.21.15.81:0/712260514 shutdown_connections 2024-04-23T14:37:46.098 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.400+0000 7f5595600700 1 --2- 172.21.15.81:0/712260514 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f5574036830 0x7f5574038ce0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:46.098 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.400+0000 7f5595600700 1 --2- 172.21.15.81:0/712260514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559007cff0 0x7f5590117c00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:46.098 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.400+0000 7f5595600700 1 -- 172.21.15.81:0/712260514 >> 172.21.15.81:0/712260514 conn(0x7f5590078540 msgr2=0x7f559007a080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:46.098 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.400+0000 7f5595600700 1 -- 172.21.15.81:0/712260514 shutdown_connections 2024-04-23T14:37:46.098 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:45.401+0000 7f5595600700 1 -- 172.21.15.81:0/712260514 wait complete. 2024-04-23T14:37:46.098 INFO:teuthology.orchestra.run.smithi081.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-04-23T14:37:46.098 INFO:teuthology.orchestra.run.smithi081.stdout:Adding key to root@localhost authorized_keys... 2024-04-23T14:37:46.102 INFO:teuthology.orchestra.run.smithi081.stdout:Adding host smithi081... 2024-04-23T14:37:48.147 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:47 smithi081 ceph-mon[25540]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi081", "addr": "172.21.15.81", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:37:48.974 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:48 smithi081 ceph-mon[25540]: Deploying cephadm binary to smithi081 2024-04-23T14:37:51.015 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout Added host 'smithi081' with addr '172.21.15.81' 2024-04-23T14:37:51.015 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.700+0000 7f53d9a00700 1 Processor -- start 2024-04-23T14:37:51.015 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.700+0000 7f53d9a00700 1 -- start start 2024-04-23T14:37:51.015 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.701+0000 7f53d9a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53d4077be0 0x7f53d4076190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:51.015 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.701+0000 7f53d9a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d4077ff0 con 0x7f53d4077be0 2024-04-23T14:37:51.015 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.701+0000 7f53d2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53d4077be0 0x7f53d4076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:51.015 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.701+0000 7f53d2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53d4077be0 0x7f53d4076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40864/0 (socket says 172.21.15.81:40864) 2024-04-23T14:37:51.015 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.701+0000 7f53d2a00700 1 -- 172.21.15.81:0/3362324505 learned_addr learned my addr 172.21.15.81:0/3362324505 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:51.015 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.702+0000 7f53d2a00700 1 -- 172.21.15.81:0/3362324505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d40766d0 con 0x7f53d4077be0 2024-04-23T14:37:51.015 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.702+0000 7f53d2a00700 1 --2- 172.21.15.81:0/3362324505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53d4077be0 0x7f53d4076190 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f53c40098e0 tx=0x7f53c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40effa38926a870a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:51.015 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.702+0000 7f53d1600700 1 -- 172.21.15.81:0/3362324505 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f53c400b860 con 0x7f53d4077be0 2024-04-23T14:37:51.016 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.703+0000 7f53d1600700 1 -- 172.21.15.81:0/3362324505 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f53c400be50 con 0x7f53d4077be0 2024-04-23T14:37:51.019 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.703+0000 7f53d1600700 1 -- 172.21.15.81:0/3362324505 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f53c4010380 con 0x7f53d4077be0 2024-04-23T14:37:51.020 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.703+0000 7f53d9a00700 1 -- 172.21.15.81:0/3362324505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53d4077be0 msgr2=0x7f53d4076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:51.020 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.703+0000 7f53d9a00700 1 --2- 172.21.15.81:0/3362324505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53d4077be0 0x7f53d4076190 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f53c40098e0 tx=0x7f53c4009250 comp rx=0 tx=0).stop 2024-04-23T14:37:51.020 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.703+0000 7f53d9a00700 1 -- 172.21.15.81:0/3362324505 shutdown_connections 2024-04-23T14:37:51.020 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.703+0000 7f53d9a00700 1 --2- 172.21.15.81:0/3362324505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53d4077be0 0x7f53d4076190 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:51.020 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.703+0000 7f53d9a00700 1 -- 172.21.15.81:0/3362324505 >> 172.21.15.81:0/3362324505 conn(0x7f53d40fe0e0 msgr2=0x7f53d41004f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:51.020 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.703+0000 7f53d9a00700 1 -- 172.21.15.81:0/3362324505 shutdown_connections 2024-04-23T14:37:51.020 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.703+0000 7f53d9a00700 1 -- 172.21.15.81:0/3362324505 wait complete. 2024-04-23T14:37:51.020 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.704+0000 7f53d9a00700 1 Processor -- start 2024-04-23T14:37:51.020 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.704+0000 7f53d9a00700 1 -- start start 2024-04-23T14:37:51.020 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.705+0000 7f53d9a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53d4077be0 0x7f53d4113990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:51.020 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.705+0000 7f53d9a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d4113ed0 con 0x7f53d4077be0 2024-04-23T14:37:51.020 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.705+0000 7f53d2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53d4077be0 0x7f53d4113990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:51.020 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.705+0000 7f53d2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53d4077be0 0x7f53d4113990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40878/0 (socket says 172.21.15.81:40878) 2024-04-23T14:37:51.020 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.705+0000 7f53d2a00700 1 -- 172.21.15.81:0/3512302622 learned_addr learned my addr 172.21.15.81:0/3512302622 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:51.021 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.705+0000 7f53d2a00700 1 -- 172.21.15.81:0/3512302622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c40094f0 con 0x7f53d4077be0 2024-04-23T14:37:51.021 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.706+0000 7f53d2a00700 1 --2- 172.21.15.81:0/3512302622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53d4077be0 0x7f53d4113990 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f53c4011bd0 tx=0x7f53c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:51.021 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.706+0000 7f53caa00700 1 -- 172.21.15.81:0/3512302622 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f53c40107c0 con 0x7f53d4077be0 2024-04-23T14:37:51.021 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.706+0000 7f53caa00700 1 -- 172.21.15.81:0/3512302622 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f53c4010db0 con 0x7f53d4077be0 2024-04-23T14:37:51.021 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.706+0000 7f53caa00700 1 -- 172.21.15.81:0/3512302622 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f53c401ad00 con 0x7f53d4077be0 2024-04-23T14:37:51.021 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.706+0000 7f53d9a00700 1 -- 172.21.15.81:0/3512302622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d41140d0 con 0x7f53d4077be0 2024-04-23T14:37:51.021 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.706+0000 7f53d9a00700 1 -- 172.21.15.81:0/3512302622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d4114c40 con 0x7f53d4077be0 2024-04-23T14:37:51.021 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.707+0000 7f53caa00700 1 -- 172.21.15.81:0/3512302622 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f53c401a560 con 0x7f53d4077be0 2024-04-23T14:37:51.021 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.707+0000 7f53d9a00700 1 -- 172.21.15.81:0/3512302622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d405f5f0 con 0x7f53d4077be0 2024-04-23T14:37:51.021 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.708+0000 7f53caa00700 1 --2- 172.21.15.81:0/3512302622 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f53b8036790 0x7f53b8038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:51.021 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.708+0000 7f53caa00700 1 -- 172.21.15.81:0/3512302622 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f53c404a200 con 0x7f53d4077be0 2024-04-23T14:37:51.022 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.708+0000 7f53d2000700 1 --2- 172.21.15.81:0/3512302622 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f53b8036790 0x7f53b8038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:51.022 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.709+0000 7f53d2000700 1 --2- 172.21.15.81:0/3512302622 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f53b8036790 0x7f53b8038c40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f53c0009990 tx=0x7f53c0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:51.022 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.713+0000 7f53caa00700 1 -- 172.21.15.81:0/3512302622 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f53c4024590 con 0x7f53d4077be0 2024-04-23T14:37:51.022 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:46.929+0000 7f53d9a00700 1 -- 172.21.15.81:0/3512302622 --> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi081", "addr": "172.21.15.81", "target": ["mon-mgr", ""]}) v1 -- 0x7f53d40ff4b0 con 0x7f53b8036790 2024-04-23T14:37:51.022 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.339+0000 7f53caa00700 1 -- 172.21.15.81:0/3512302622 <== mgr.14120 v2:172.21.15.81:6800/2072638798 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f53d40ff4b0 con 0x7f53b8036790 2024-04-23T14:37:51.022 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.343+0000 7f53d9a00700 1 -- 172.21.15.81:0/3512302622 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f53b8036790 msgr2=0x7f53b8038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:51.022 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.343+0000 7f53d9a00700 1 --2- 172.21.15.81:0/3512302622 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f53b8036790 0x7f53b8038c40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f53c0009990 tx=0x7f53c0006e40 comp rx=0 tx=0).stop 2024-04-23T14:37:51.022 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.343+0000 7f53d9a00700 1 -- 172.21.15.81:0/3512302622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53d4077be0 msgr2=0x7f53d4113990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:51.024 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.343+0000 7f53d9a00700 1 --2- 172.21.15.81:0/3512302622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53d4077be0 0x7f53d4113990 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f53c4011bd0 tx=0x7f53c4009250 comp rx=0 tx=0).stop 2024-04-23T14:37:51.024 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.344+0000 7f53d9a00700 1 -- 172.21.15.81:0/3512302622 shutdown_connections 2024-04-23T14:37:51.024 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.344+0000 7f53d9a00700 1 --2- 172.21.15.81:0/3512302622 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f53b8036790 0x7f53b8038c40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:51.025 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.344+0000 7f53d9a00700 1 --2- 172.21.15.81:0/3512302622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53d4077be0 0x7f53d4113990 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:51.025 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.344+0000 7f53d9a00700 1 -- 172.21.15.81:0/3512302622 >> 172.21.15.81:0/3512302622 conn(0x7f53d40fe0e0 msgr2=0x7f53d40fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:51.025 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.344+0000 7f53d9a00700 1 -- 172.21.15.81:0/3512302622 shutdown_connections 2024-04-23T14:37:51.025 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:50.344+0000 7f53d9a00700 1 -- 172.21.15.81:0/3512302622 wait complete. 2024-04-23T14:37:51.025 INFO:teuthology.orchestra.run.smithi081.stdout:Deploying mon service with default placement... 2024-04-23T14:37:51.613 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:51 smithi081 ceph-mon[25540]: from='mgr.14120 172.21.15.81:0/2042221483' entity='mgr.smithi081.ldghvq' 2024-04-23T14:37:51.613 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:51 smithi081 ceph-mon[25540]: Added host smithi081 2024-04-23T14:37:51.613 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:51 smithi081 ceph-mon[25540]: from='mgr.14120 172.21.15.81:0/2042221483' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:37:52.634 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-04-23T14:37:52.634 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.669+0000 7f035fe00700 1 Processor -- start 2024-04-23T14:37:52.634 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.669+0000 7f035fe00700 1 -- start start 2024-04-23T14:37:52.634 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.670+0000 7f035fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0358077ab0 0x7f0358076150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:52.634 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.670+0000 7f035fe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0358077ec0 con 0x7f0358077ab0 2024-04-23T14:37:52.634 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.670+0000 7f035d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0358077ab0 0x7f0358076150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:52.634 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.670+0000 7f035d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0358077ab0 0x7f0358076150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40886/0 (socket says 172.21.15.81:40886) 2024-04-23T14:37:52.634 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.670+0000 7f035d400700 1 -- 172.21.15.81:0/2229187147 learned_addr learned my addr 172.21.15.81:0/2229187147 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:52.635 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.671+0000 7f035d400700 1 -- 172.21.15.81:0/2229187147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0358078000 con 0x7f0358077ab0 2024-04-23T14:37:52.635 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.671+0000 7f035d400700 1 --2- 172.21.15.81:0/2229187147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0358077ab0 0x7f0358076150 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f034c009e50 tx=0x7f034c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6719102f20886c95 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:52.635 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.672+0000 7f0357e00700 1 -- 172.21.15.81:0/2229187147 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f034c0092e0 con 0x7f0358077ab0 2024-04-23T14:37:52.635 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.672+0000 7f0357e00700 1 -- 172.21.15.81:0/2229187147 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f034c012430 con 0x7f0358077ab0 2024-04-23T14:37:52.635 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.672+0000 7f0357e00700 1 -- 172.21.15.81:0/2229187147 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f034c0075c0 con 0x7f0358077ab0 2024-04-23T14:37:52.635 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.673+0000 7f035fe00700 1 -- 172.21.15.81:0/2229187147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0358077ab0 msgr2=0x7f0358076150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:52.635 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.673+0000 7f035fe00700 1 --2- 172.21.15.81:0/2229187147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0358077ab0 0x7f0358076150 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f034c009e50 tx=0x7f034c009840 comp rx=0 tx=0).stop 2024-04-23T14:37:52.635 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.673+0000 7f035fe00700 1 -- 172.21.15.81:0/2229187147 shutdown_connections 2024-04-23T14:37:52.635 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.673+0000 7f035fe00700 1 --2- 172.21.15.81:0/2229187147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0358077ab0 0x7f0358076150 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:52.635 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.673+0000 7f035fe00700 1 -- 172.21.15.81:0/2229187147 >> 172.21.15.81:0/2229187147 conn(0x7f03580fe0b0 msgr2=0x7f0358100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:52.635 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.673+0000 7f035fe00700 1 -- 172.21.15.81:0/2229187147 shutdown_connections 2024-04-23T14:37:52.635 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.673+0000 7f035fe00700 1 -- 172.21.15.81:0/2229187147 wait complete. 2024-04-23T14:37:52.635 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.674+0000 7f035fe00700 1 Processor -- start 2024-04-23T14:37:52.636 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.674+0000 7f035fe00700 1 -- start start 2024-04-23T14:37:52.636 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.674+0000 7f035fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0358077ab0 0x7f0358113980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:52.636 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.674+0000 7f035fe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0358113ec0 con 0x7f0358077ab0 2024-04-23T14:37:52.636 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.674+0000 7f035d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0358077ab0 0x7f0358113980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:52.636 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.674+0000 7f035d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0358077ab0 0x7f0358113980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40894/0 (socket says 172.21.15.81:40894) 2024-04-23T14:37:52.636 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.675+0000 7f035d400700 1 -- 172.21.15.81:0/231674970 learned_addr learned my addr 172.21.15.81:0/231674970 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:52.636 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.675+0000 7f035d400700 1 -- 172.21.15.81:0/231674970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f034c009ae0 con 0x7f0358077ab0 2024-04-23T14:37:52.636 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.675+0000 7f035d400700 1 --2- 172.21.15.81:0/231674970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0358077ab0 0x7f0358113980 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f034c000f80 tx=0x7f034c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:52.636 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.675+0000 7f0355600700 1 -- 172.21.15.81:0/231674970 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f034c0092e0 con 0x7f0358077ab0 2024-04-23T14:37:52.636 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.675+0000 7f0355600700 1 -- 172.21.15.81:0/231674970 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f034c007cc0 con 0x7f0358077ab0 2024-04-23T14:37:52.636 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.675+0000 7f0355600700 1 -- 172.21.15.81:0/231674970 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f034c01c960 con 0x7f0358077ab0 2024-04-23T14:37:52.636 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.676+0000 7f035fe00700 1 -- 172.21.15.81:0/231674970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03581140c0 con 0x7f0358077ab0 2024-04-23T14:37:52.636 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.676+0000 7f035fe00700 1 -- 172.21.15.81:0/231674970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0358114c30 con 0x7f0358077ab0 2024-04-23T14:37:52.637 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.677+0000 7f035fe00700 1 -- 172.21.15.81:0/231674970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f035805f5f0 con 0x7f0358077ab0 2024-04-23T14:37:52.637 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.677+0000 7f0355600700 1 -- 172.21.15.81:0/231674970 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f034c019070 con 0x7f0358077ab0 2024-04-23T14:37:52.637 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.678+0000 7f0355600700 1 --2- 172.21.15.81:0/231674970 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f03400367e0 0x7f0340038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:52.637 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.678+0000 7f0355600700 1 -- 172.21.15.81:0/231674970 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f034c049ee0 con 0x7f0358077ab0 2024-04-23T14:37:52.637 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.678+0000 7f035ca00700 1 --2- 172.21.15.81:0/231674970 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f03400367e0 0x7f0340038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:52.637 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.679+0000 7f035ca00700 1 --2- 172.21.15.81:0/231674970 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f03400367e0 0x7f0340038c90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0344009990 tx=0x7f0344006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:52.637 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.683+0000 7f0355600700 1 -- 172.21.15.81:0/231674970 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f034c00bdc0 con 0x7f0358077ab0 2024-04-23T14:37:52.637 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.908+0000 7f035fe00700 1 -- 172.21.15.81:0/231674970 --> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f03580ff5b0 con 0x7f03400367e0 2024-04-23T14:37:52.637 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.917+0000 7f0355600700 1 -- 172.21.15.81:0/231674970 <== mgr.14120 v2:172.21.15.81:6800/2072638798 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f03580ff5b0 con 0x7f03400367e0 2024-04-23T14:37:52.637 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.919+0000 7f035fe00700 1 -- 172.21.15.81:0/231674970 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f03400367e0 msgr2=0x7f0340038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:52.637 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.919+0000 7f035fe00700 1 --2- 172.21.15.81:0/231674970 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f03400367e0 0x7f0340038c90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0344009990 tx=0x7f0344006e40 comp rx=0 tx=0).stop 2024-04-23T14:37:52.637 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.919+0000 7f035fe00700 1 -- 172.21.15.81:0/231674970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0358077ab0 msgr2=0x7f0358113980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:52.637 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.919+0000 7f035fe00700 1 --2- 172.21.15.81:0/231674970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0358077ab0 0x7f0358113980 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f034c000f80 tx=0x7f034c009840 comp rx=0 tx=0).stop 2024-04-23T14:37:52.638 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.920+0000 7f035fe00700 1 -- 172.21.15.81:0/231674970 shutdown_connections 2024-04-23T14:37:52.638 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.920+0000 7f035fe00700 1 --2- 172.21.15.81:0/231674970 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f03400367e0 0x7f0340038c90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:52.638 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.920+0000 7f035fe00700 1 --2- 172.21.15.81:0/231674970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0358077ab0 0x7f0358113980 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:52.638 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.920+0000 7f035fe00700 1 -- 172.21.15.81:0/231674970 >> 172.21.15.81:0/231674970 conn(0x7f03580fe0b0 msgr2=0x7f03580fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:52.638 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.920+0000 7f035fe00700 1 -- 172.21.15.81:0/231674970 shutdown_connections 2024-04-23T14:37:52.638 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:51.920+0000 7f035fe00700 1 -- 172.21.15.81:0/231674970 wait complete. 2024-04-23T14:37:52.638 INFO:teuthology.orchestra.run.smithi081.stdout:Deploying mgr service with default placement... 2024-04-23T14:37:53.198 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:52 smithi081 ceph-mon[25540]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:37:53.198 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:52 smithi081 ceph-mon[25540]: Saving service mon spec with placement count:5 2024-04-23T14:37:53.198 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:52 smithi081 ceph-mon[25540]: from='mgr.14120 172.21.15.81:0/2042221483' entity='mgr.smithi081.ldghvq' 2024-04-23T14:37:54.869 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-04-23T14:37:54.869 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.454+0000 7f1140000700 1 Processor -- start 2024-04-23T14:37:54.870 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.454+0000 7f1140000700 1 -- start start 2024-04-23T14:37:54.870 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.454+0000 7f1140000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1138077a70 0x7f1138076110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:54.870 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.454+0000 7f1140000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1138077e80 con 0x7f1138077a70 2024-04-23T14:37:54.870 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.455+0000 7f113d600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1138077a70 0x7f1138076110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:54.870 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.455+0000 7f113d600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1138077a70 0x7f1138076110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40906/0 (socket says 172.21.15.81:40906) 2024-04-23T14:37:54.870 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.455+0000 7f113d600700 1 -- 172.21.15.81:0/1286482126 learned_addr learned my addr 172.21.15.81:0/1286482126 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:54.870 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.455+0000 7f113d600700 1 -- 172.21.15.81:0/1286482126 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1138077fc0 con 0x7f1138077a70 2024-04-23T14:37:54.870 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.456+0000 7f113d600700 1 --2- 172.21.15.81:0/1286482126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1138077a70 0x7f1138076110 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f112c0098e0 tx=0x7f112c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=380b1835e0995e65 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:54.870 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.456+0000 7f1137e00700 1 -- 172.21.15.81:0/1286482126 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f112c00b8f0 con 0x7f1138077a70 2024-04-23T14:37:54.870 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.456+0000 7f1137e00700 1 -- 172.21.15.81:0/1286482126 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f112c011420 con 0x7f1138077a70 2024-04-23T14:37:54.870 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.456+0000 7f1137e00700 1 -- 172.21.15.81:0/1286482126 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f112c010540 con 0x7f1138077a70 2024-04-23T14:37:54.870 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.456+0000 7f1140000700 1 -- 172.21.15.81:0/1286482126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1138077a70 msgr2=0x7f1138076110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:54.870 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.456+0000 7f1140000700 1 --2- 172.21.15.81:0/1286482126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1138077a70 0x7f1138076110 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f112c0098e0 tx=0x7f112c009250 comp rx=0 tx=0).stop 2024-04-23T14:37:54.871 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.457+0000 7f1140000700 1 -- 172.21.15.81:0/1286482126 shutdown_connections 2024-04-23T14:37:54.871 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.457+0000 7f1140000700 1 --2- 172.21.15.81:0/1286482126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1138077a70 0x7f1138076110 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:54.871 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.457+0000 7f1140000700 1 -- 172.21.15.81:0/1286482126 >> 172.21.15.81:0/1286482126 conn(0x7f11380fe0e0 msgr2=0x7f1138100510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:54.871 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.457+0000 7f1140000700 1 -- 172.21.15.81:0/1286482126 shutdown_connections 2024-04-23T14:37:54.871 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.457+0000 7f1140000700 1 -- 172.21.15.81:0/1286482126 wait complete. 2024-04-23T14:37:54.871 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.458+0000 7f1140000700 1 Processor -- start 2024-04-23T14:37:54.871 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.458+0000 7f1140000700 1 -- start start 2024-04-23T14:37:54.871 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.458+0000 7f1140000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1138077a70 0x7f11381139c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:54.871 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.458+0000 7f1140000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1138113f00 con 0x7f1138077a70 2024-04-23T14:37:54.871 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.458+0000 7f113d600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1138077a70 0x7f11381139c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:54.871 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.458+0000 7f113d600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1138077a70 0x7f11381139c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40914/0 (socket says 172.21.15.81:40914) 2024-04-23T14:37:54.871 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.458+0000 7f113d600700 1 -- 172.21.15.81:0/1724795926 learned_addr learned my addr 172.21.15.81:0/1724795926 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:54.871 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.459+0000 7f113d600700 1 -- 172.21.15.81:0/1724795926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f112c0094f0 con 0x7f1138077a70 2024-04-23T14:37:54.871 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.459+0000 7f113d600700 1 --2- 172.21.15.81:0/1724795926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1138077a70 0x7f11381139c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f112c011db0 tx=0x7f112c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:54.871 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.459+0000 7f1135600700 1 -- 172.21.15.81:0/1724795926 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f112c0107b0 con 0x7f1138077a70 2024-04-23T14:37:54.872 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.459+0000 7f1135600700 1 -- 172.21.15.81:0/1724795926 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f112c010da0 con 0x7f1138077a70 2024-04-23T14:37:54.872 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.459+0000 7f1135600700 1 -- 172.21.15.81:0/1724795926 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f112c01ad60 con 0x7f1138077a70 2024-04-23T14:37:54.872 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.459+0000 7f1140000700 1 -- 172.21.15.81:0/1724795926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1138114100 con 0x7f1138077a70 2024-04-23T14:37:54.872 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.459+0000 7f1140000700 1 -- 172.21.15.81:0/1724795926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1138114c70 con 0x7f1138077a70 2024-04-23T14:37:54.872 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.460+0000 7f1135600700 1 -- 172.21.15.81:0/1724795926 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f112c01a5c0 con 0x7f1138077a70 2024-04-23T14:37:54.872 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.460+0000 7f1140000700 1 -- 172.21.15.81:0/1724795926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f113805f5f0 con 0x7f1138077a70 2024-04-23T14:37:54.872 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.461+0000 7f1135600700 1 --2- 172.21.15.81:0/1724795926 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f11200367e0 0x7f1120038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:54.872 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.461+0000 7f1135600700 1 -- 172.21.15.81:0/1724795926 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f112c04acb0 con 0x7f1138077a70 2024-04-23T14:37:54.872 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.461+0000 7f113cc00700 1 --2- 172.21.15.81:0/1724795926 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f11200367e0 0x7f1120038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:54.872 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.462+0000 7f113cc00700 1 --2- 172.21.15.81:0/1724795926 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f11200367e0 0x7f1120038c90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1124009990 tx=0x7f1124006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:54.872 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.466+0000 7f1135600700 1 -- 172.21.15.81:0/1724795926 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f112c0239e0 con 0x7f1138077a70 2024-04-23T14:37:54.872 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.689+0000 7f1140000700 1 -- 172.21.15.81:0/1724795926 --> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f11381157f0 con 0x7f11200367e0 2024-04-23T14:37:54.872 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.696+0000 7f1135600700 1 -- 172.21.15.81:0/1724795926 <== mgr.14120 v2:172.21.15.81:6800/2072638798 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f11381157f0 con 0x7f11200367e0 2024-04-23T14:37:54.872 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.699+0000 7f1140000700 1 -- 172.21.15.81:0/1724795926 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f11200367e0 msgr2=0x7f1120038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:54.872 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.699+0000 7f1140000700 1 --2- 172.21.15.81:0/1724795926 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f11200367e0 0x7f1120038c90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1124009990 tx=0x7f1124006e40 comp rx=0 tx=0).stop 2024-04-23T14:37:54.873 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.699+0000 7f1140000700 1 -- 172.21.15.81:0/1724795926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1138077a70 msgr2=0x7f11381139c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:54.873 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.699+0000 7f1140000700 1 --2- 172.21.15.81:0/1724795926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1138077a70 0x7f11381139c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f112c011db0 tx=0x7f112c009250 comp rx=0 tx=0).stop 2024-04-23T14:37:54.873 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.699+0000 7f1140000700 1 -- 172.21.15.81:0/1724795926 shutdown_connections 2024-04-23T14:37:54.873 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.699+0000 7f1140000700 1 --2- 172.21.15.81:0/1724795926 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f11200367e0 0x7f1120038c90 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:54.873 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.699+0000 7f1140000700 1 --2- 172.21.15.81:0/1724795926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1138077a70 0x7f11381139c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:54.873 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.699+0000 7f1140000700 1 -- 172.21.15.81:0/1724795926 >> 172.21.15.81:0/1724795926 conn(0x7f11380fe0e0 msgr2=0x7f11380fee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:54.873 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.699+0000 7f1140000700 1 -- 172.21.15.81:0/1724795926 shutdown_connections 2024-04-23T14:37:54.873 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:53.699+0000 7f1140000700 1 -- 172.21.15.81:0/1724795926 wait complete. 2024-04-23T14:37:54.873 INFO:teuthology.orchestra.run.smithi081.stdout:Deploying crash service with default placement... 2024-04-23T14:37:55.027 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:54 smithi081 ceph-mon[25540]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:37:55.027 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:54 smithi081 ceph-mon[25540]: Saving service mgr spec with placement count:2 2024-04-23T14:37:55.027 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:54 smithi081 ceph-mon[25540]: from='mgr.14120 172.21.15.81:0/2042221483' entity='mgr.smithi081.ldghvq' 2024-04-23T14:37:55.028 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:54 smithi081 ceph-mon[25540]: from='mgr.14120 172.21.15.81:0/2042221483' entity='mgr.smithi081.ldghvq' 2024-04-23T14:37:56.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:56 smithi081 ceph-mon[25540]: from='mgr.14120 172.21.15.81:0/2042221483' entity='mgr.smithi081.ldghvq' 2024-04-23T14:37:56.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:56 smithi081 ceph-mon[25540]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:37:56.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:56 smithi081 ceph-mon[25540]: Saving service crash spec with placement * 2024-04-23T14:37:56.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:56 smithi081 ceph-mon[25540]: from='mgr.14120 172.21.15.81:0/2042221483' entity='mgr.smithi081.ldghvq' 2024-04-23T14:37:56.375 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-04-23T14:37:56.376 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.437+0000 7f0d66400700 1 Processor -- start 2024-04-23T14:37:56.376 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.437+0000 7f0d66400700 1 -- start start 2024-04-23T14:37:56.376 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.437+0000 7f0d66400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d60078cb0 0x7f0d600772a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:56.376 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.437+0000 7f0d66400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d600790c0 con 0x7f0d60078cb0 2024-04-23T14:37:56.376 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.437+0000 7f0d5f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d60078cb0 0x7f0d600772a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:56.377 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.438+0000 7f0d5f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d60078cb0 0x7f0d600772a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38828/0 (socket says 172.21.15.81:38828) 2024-04-23T14:37:56.378 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.438+0000 7f0d5f400700 1 -- 172.21.15.81:0/55282959 learned_addr learned my addr 172.21.15.81:0/55282959 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:56.378 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.438+0000 7f0d5f400700 1 -- 172.21.15.81:0/55282959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d600777e0 con 0x7f0d60078cb0 2024-04-23T14:37:56.379 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.438+0000 7f0d5f400700 1 --2- 172.21.15.81:0/55282959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d60078cb0 0x7f0d600772a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0d500098e0 tx=0x7f0d50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b59c3d1d72728a81 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:56.379 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.439+0000 7f0d5e000700 1 -- 172.21.15.81:0/55282959 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0d5000b860 con 0x7f0d60078cb0 2024-04-23T14:37:56.379 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.439+0000 7f0d5e000700 1 -- 172.21.15.81:0/55282959 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0d5000be90 con 0x7f0d60078cb0 2024-04-23T14:37:56.379 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.439+0000 7f0d5e000700 1 -- 172.21.15.81:0/55282959 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0d500103c0 con 0x7f0d60078cb0 2024-04-23T14:37:56.379 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.439+0000 7f0d66400700 1 -- 172.21.15.81:0/55282959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d60078cb0 msgr2=0x7f0d600772a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:56.379 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.439+0000 7f0d66400700 1 --2- 172.21.15.81:0/55282959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d60078cb0 0x7f0d600772a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0d500098e0 tx=0x7f0d50009250 comp rx=0 tx=0).stop 2024-04-23T14:37:56.379 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.440+0000 7f0d66400700 1 -- 172.21.15.81:0/55282959 shutdown_connections 2024-04-23T14:37:56.379 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.440+0000 7f0d66400700 1 --2- 172.21.15.81:0/55282959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d60078cb0 0x7f0d600772a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:56.379 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.440+0000 7f0d66400700 1 -- 172.21.15.81:0/55282959 >> 172.21.15.81:0/55282959 conn(0x7f0d600fe0e0 msgr2=0x7f0d601004f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:56.379 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.440+0000 7f0d66400700 1 -- 172.21.15.81:0/55282959 shutdown_connections 2024-04-23T14:37:56.383 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.440+0000 7f0d66400700 1 -- 172.21.15.81:0/55282959 wait complete. 2024-04-23T14:37:56.383 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.441+0000 7f0d66400700 1 Processor -- start 2024-04-23T14:37:56.383 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.441+0000 7f0d66400700 1 -- start start 2024-04-23T14:37:56.383 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.441+0000 7f0d66400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d60078cb0 0x7f0d60117d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:56.383 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.441+0000 7f0d66400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d60118240 con 0x7f0d60078cb0 2024-04-23T14:37:56.383 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.441+0000 7f0d5f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d60078cb0 0x7f0d60117d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:56.383 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.441+0000 7f0d5f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d60078cb0 0x7f0d60117d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38830/0 (socket says 172.21.15.81:38830) 2024-04-23T14:37:56.384 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.441+0000 7f0d5f400700 1 -- 172.21.15.81:0/2773441834 learned_addr learned my addr 172.21.15.81:0/2773441834 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:56.384 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.442+0000 7f0d5f400700 1 -- 172.21.15.81:0/2773441834 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d500094f0 con 0x7f0d60078cb0 2024-04-23T14:37:56.384 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.442+0000 7f0d5f400700 1 --2- 172.21.15.81:0/2773441834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d60078cb0 0x7f0d60117d00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0d50006d40 tx=0x7f0d50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:56.384 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.442+0000 7f0d57400700 1 -- 172.21.15.81:0/2773441834 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0d50010840 con 0x7f0d60078cb0 2024-04-23T14:37:56.384 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.442+0000 7f0d57400700 1 -- 172.21.15.81:0/2773441834 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0d50010e70 con 0x7f0d60078cb0 2024-04-23T14:37:56.384 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.443+0000 7f0d57400700 1 -- 172.21.15.81:0/2773441834 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0d50024ea0 con 0x7f0d60078cb0 2024-04-23T14:37:56.384 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.443+0000 7f0d66400700 1 -- 172.21.15.81:0/2773441834 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d60118440 con 0x7f0d60078cb0 2024-04-23T14:37:56.384 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.443+0000 7f0d66400700 1 -- 172.21.15.81:0/2773441834 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d60118f60 con 0x7f0d60078cb0 2024-04-23T14:37:56.384 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.444+0000 7f0d66400700 1 -- 172.21.15.81:0/2773441834 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d6005f5f0 con 0x7f0d60078cb0 2024-04-23T14:37:56.384 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.444+0000 7f0d57400700 1 -- 172.21.15.81:0/2773441834 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f0d50024780 con 0x7f0d60078cb0 2024-04-23T14:37:56.384 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.445+0000 7f0d57400700 1 --2- 172.21.15.81:0/2773441834 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f0d44036740 0x7f0d44038bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:56.384 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.445+0000 7f0d57400700 1 -- 172.21.15.81:0/2773441834 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f0d5004a750 con 0x7f0d60078cb0 2024-04-23T14:37:56.385 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.445+0000 7f0d5ea00700 1 --2- 172.21.15.81:0/2773441834 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f0d44036740 0x7f0d44038bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:56.385 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.446+0000 7f0d5ea00700 1 --2- 172.21.15.81:0/2773441834 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f0d44036740 0x7f0d44038bf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c009990 tx=0x7f0d4c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:56.385 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.450+0000 7f0d57400700 1 -- 172.21.15.81:0/2773441834 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f0d5002c910 con 0x7f0d60078cb0 2024-04-23T14:37:56.385 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.685+0000 7f0d66400700 1 -- 172.21.15.81:0/2773441834 --> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d60119af0 con 0x7f0d44036740 2024-04-23T14:37:56.385 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.690+0000 7f0d57400700 1 -- 172.21.15.81:0/2773441834 <== mgr.14120 v2:172.21.15.81:6800/2072638798 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f0d60119af0 con 0x7f0d44036740 2024-04-23T14:37:56.385 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.693+0000 7f0d66400700 1 -- 172.21.15.81:0/2773441834 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f0d44036740 msgr2=0x7f0d44038bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:56.385 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.693+0000 7f0d66400700 1 --2- 172.21.15.81:0/2773441834 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f0d44036740 0x7f0d44038bf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c009990 tx=0x7f0d4c006e40 comp rx=0 tx=0).stop 2024-04-23T14:37:56.385 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.693+0000 7f0d66400700 1 -- 172.21.15.81:0/2773441834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d60078cb0 msgr2=0x7f0d60117d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:56.385 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.693+0000 7f0d66400700 1 --2- 172.21.15.81:0/2773441834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d60078cb0 0x7f0d60117d00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0d50006d40 tx=0x7f0d50009250 comp rx=0 tx=0).stop 2024-04-23T14:37:56.385 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.693+0000 7f0d66400700 1 -- 172.21.15.81:0/2773441834 shutdown_connections 2024-04-23T14:37:56.385 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.693+0000 7f0d66400700 1 --2- 172.21.15.81:0/2773441834 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f0d44036740 0x7f0d44038bf0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:56.385 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.693+0000 7f0d66400700 1 --2- 172.21.15.81:0/2773441834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d60078cb0 0x7f0d60117d00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:56.386 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.693+0000 7f0d66400700 1 -- 172.21.15.81:0/2773441834 >> 172.21.15.81:0/2773441834 conn(0x7f0d600fe0e0 msgr2=0x7f0d6010f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:56.386 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.693+0000 7f0d66400700 1 -- 172.21.15.81:0/2773441834 shutdown_connections 2024-04-23T14:37:56.386 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:55.694+0000 7f0d66400700 1 -- 172.21.15.81:0/2773441834 wait complete. 2024-04-23T14:37:56.386 INFO:teuthology.orchestra.run.smithi081.stdout:Deploying prometheus service with default placement... 2024-04-23T14:37:58.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:58 smithi081 ceph-mon[25540]: from='mgr.14120 172.21.15.81:0/2042221483' entity='mgr.smithi081.ldghvq' 2024-04-23T14:37:58.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:58 smithi081 ceph-mon[25540]: from='mgr.14120 172.21.15.81:0/2042221483' entity='mgr.smithi081.ldghvq' 2024-04-23T14:37:58.642 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-04-23T14:37:58.642 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.678+0000 7fad5e200700 1 Processor -- start 2024-04-23T14:37:58.642 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.678+0000 7fad5e200700 1 -- start start 2024-04-23T14:37:58.642 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.679+0000 7fad5e200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad581029a0 0x7fad58102db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:58.642 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.679+0000 7fad5e200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad581032f0 con 0x7fad581029a0 2024-04-23T14:37:58.642 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.679+0000 7fad57400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad581029a0 0x7fad58102db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:58.642 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.679+0000 7fad57400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad581029a0 0x7fad58102db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38838/0 (socket says 172.21.15.81:38838) 2024-04-23T14:37:58.643 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.679+0000 7fad57400700 1 -- 172.21.15.81:0/2826134752 learned_addr learned my addr 172.21.15.81:0/2826134752 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:58.643 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.679+0000 7fad57400700 1 -- 172.21.15.81:0/2826134752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad58103430 con 0x7fad581029a0 2024-04-23T14:37:58.643 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.680+0000 7fad57400700 1 --2- 172.21.15.81:0/2826134752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad581029a0 0x7fad58102db0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fad480098e0 tx=0x7fad48009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c170806e7eafe7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:58.643 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.680+0000 7fad56000700 1 -- 172.21.15.81:0/2826134752 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad4800b8f0 con 0x7fad581029a0 2024-04-23T14:37:58.643 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.681+0000 7fad56000700 1 -- 172.21.15.81:0/2826134752 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fad48011420 con 0x7fad581029a0 2024-04-23T14:37:58.643 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.681+0000 7fad56000700 1 -- 172.21.15.81:0/2826134752 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad48010540 con 0x7fad581029a0 2024-04-23T14:37:58.643 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.681+0000 7fad5e200700 1 -- 172.21.15.81:0/2826134752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad581029a0 msgr2=0x7fad58102db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:58.643 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.681+0000 7fad5e200700 1 --2- 172.21.15.81:0/2826134752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad581029a0 0x7fad58102db0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fad480098e0 tx=0x7fad48009250 comp rx=0 tx=0).stop 2024-04-23T14:37:58.643 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.682+0000 7fad5e200700 1 -- 172.21.15.81:0/2826134752 shutdown_connections 2024-04-23T14:37:58.643 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.682+0000 7fad5e200700 1 --2- 172.21.15.81:0/2826134752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad581029a0 0x7fad58102db0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:58.643 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.682+0000 7fad5e200700 1 -- 172.21.15.81:0/2826134752 >> 172.21.15.81:0/2826134752 conn(0x7fad580fe0e0 msgr2=0x7fad58100530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:58.643 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.682+0000 7fad5e200700 1 -- 172.21.15.81:0/2826134752 shutdown_connections 2024-04-23T14:37:58.644 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.682+0000 7fad5e200700 1 -- 172.21.15.81:0/2826134752 wait complete. 2024-04-23T14:37:58.644 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.683+0000 7fad5e200700 1 Processor -- start 2024-04-23T14:37:58.644 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.683+0000 7fad5e200700 1 -- start start 2024-04-23T14:37:58.644 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.683+0000 7fad5e200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad581029a0 0x7fad58078c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:58.644 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.683+0000 7fad5e200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad58079190 con 0x7fad581029a0 2024-04-23T14:37:58.644 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.683+0000 7fad57400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad581029a0 0x7fad58078c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:58.644 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.684+0000 7fad57400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad581029a0 0x7fad58078c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38852/0 (socket says 172.21.15.81:38852) 2024-04-23T14:37:58.644 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.684+0000 7fad57400700 1 -- 172.21.15.81:0/2782037372 learned_addr learned my addr 172.21.15.81:0/2782037372 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:37:58.644 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.684+0000 7fad57400700 1 -- 172.21.15.81:0/2782037372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad480094f0 con 0x7fad581029a0 2024-04-23T14:37:58.644 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.684+0000 7fad57400700 1 --2- 172.21.15.81:0/2782037372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad581029a0 0x7fad58078c50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fad480090b0 tx=0x7fad48009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:58.644 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.685+0000 7fad4f400700 1 -- 172.21.15.81:0/2782037372 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad480107b0 con 0x7fad581029a0 2024-04-23T14:37:58.644 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.685+0000 7fad4f400700 1 -- 172.21.15.81:0/2782037372 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fad48010de0 con 0x7fad581029a0 2024-04-23T14:37:58.645 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.685+0000 7fad5e200700 1 -- 172.21.15.81:0/2782037372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad58077200 con 0x7fad581029a0 2024-04-23T14:37:58.645 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.685+0000 7fad4f400700 1 -- 172.21.15.81:0/2782037372 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad4801ae50 con 0x7fad581029a0 2024-04-23T14:37:58.645 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.685+0000 7fad5e200700 1 -- 172.21.15.81:0/2782037372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad580776f0 con 0x7fad581029a0 2024-04-23T14:37:58.645 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.686+0000 7fad5e200700 1 -- 172.21.15.81:0/2782037372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad5804bed0 con 0x7fad581029a0 2024-04-23T14:37:58.645 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.686+0000 7fad4f400700 1 -- 172.21.15.81:0/2782037372 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fad4801a430 con 0x7fad581029a0 2024-04-23T14:37:58.645 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.687+0000 7fad4f400700 1 --2- 172.21.15.81:0/2782037372 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fad3c036810 0x7fad3c038cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:37:58.645 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.687+0000 7fad4f400700 1 -- 172.21.15.81:0/2782037372 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fad4804a0f0 con 0x7fad581029a0 2024-04-23T14:37:58.645 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.687+0000 7fad56a00700 1 --2- 172.21.15.81:0/2782037372 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fad3c036810 0x7fad3c038cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:37:58.645 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.688+0000 7fad56a00700 1 --2- 172.21.15.81:0/2782037372 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fad3c036810 0x7fad3c038cc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fad44009990 tx=0x7fad44006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:37:58.645 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.692+0000 7fad4f400700 1 -- 172.21.15.81:0/2782037372 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fad4802b8c0 con 0x7fad581029a0 2024-04-23T14:37:58.645 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.923+0000 7fad5e200700 1 -- 172.21.15.81:0/2782037372 --> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7fad58077ed0 con 0x7fad3c036810 2024-04-23T14:37:58.645 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.929+0000 7fad4f400700 1 -- 172.21.15.81:0/2782037372 <== mgr.14120 v2:172.21.15.81:6800/2072638798 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7fad58077ed0 con 0x7fad3c036810 2024-04-23T14:37:58.646 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.932+0000 7fad5e200700 1 -- 172.21.15.81:0/2782037372 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fad3c036810 msgr2=0x7fad3c038cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:58.646 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.932+0000 7fad5e200700 1 --2- 172.21.15.81:0/2782037372 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fad3c036810 0x7fad3c038cc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fad44009990 tx=0x7fad44006e40 comp rx=0 tx=0).stop 2024-04-23T14:37:58.646 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.932+0000 7fad5e200700 1 -- 172.21.15.81:0/2782037372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad581029a0 msgr2=0x7fad58078c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:37:58.646 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.932+0000 7fad5e200700 1 --2- 172.21.15.81:0/2782037372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad581029a0 0x7fad58078c50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fad480090b0 tx=0x7fad48009250 comp rx=0 tx=0).stop 2024-04-23T14:37:58.646 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.932+0000 7fad5e200700 1 -- 172.21.15.81:0/2782037372 shutdown_connections 2024-04-23T14:37:58.646 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.932+0000 7fad5e200700 1 --2- 172.21.15.81:0/2782037372 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fad3c036810 0x7fad3c038cc0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:58.646 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.932+0000 7fad5e200700 1 --2- 172.21.15.81:0/2782037372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad581029a0 0x7fad58078c50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:37:58.646 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.932+0000 7fad5e200700 1 -- 172.21.15.81:0/2782037372 >> 172.21.15.81:0/2782037372 conn(0x7fad580fe0e0 msgr2=0x7fad580fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:37:58.646 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.932+0000 7fad5e200700 1 -- 172.21.15.81:0/2782037372 shutdown_connections 2024-04-23T14:37:58.646 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:57.932+0000 7fad5e200700 1 -- 172.21.15.81:0/2782037372 wait complete. 2024-04-23T14:37:58.646 INFO:teuthology.orchestra.run.smithi081.stdout:Deploying grafana service with default placement... 2024-04-23T14:37:59.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:59 smithi081 ceph-mon[25540]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:37:59.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:59 smithi081 ceph-mon[25540]: Saving service prometheus spec with placement count:1 2024-04-23T14:37:59.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:59 smithi081 ceph-mon[25540]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:37:59.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:37:59 smithi081 ceph-mon[25540]: from='mgr.14120 172.21.15.81:0/2042221483' entity='mgr.smithi081.ldghvq' 2024-04-23T14:38:00.236 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-04-23T14:38:00.237 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.305+0000 7feba9600700 1 Processor -- start 2024-04-23T14:38:00.237 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.306+0000 7feba9600700 1 -- start start 2024-04-23T14:38:00.237 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.306+0000 7feba9600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feba4078c10 0x7feba40772a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:00.237 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.306+0000 7feba9600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba4079020 con 0x7feba4078c10 2024-04-23T14:38:00.237 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.306+0000 7feba2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feba4078c10 0x7feba40772a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:00.239 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.306+0000 7feba2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feba4078c10 0x7feba40772a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38856/0 (socket says 172.21.15.81:38856) 2024-04-23T14:38:00.239 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.306+0000 7feba2a00700 1 -- 172.21.15.81:0/506555078 learned_addr learned my addr 172.21.15.81:0/506555078 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:38:00.239 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.307+0000 7feba2a00700 1 -- 172.21.15.81:0/506555078 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba4079160 con 0x7feba4078c10 2024-04-23T14:38:00.239 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.307+0000 7feba2a00700 1 --2- 172.21.15.81:0/506555078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feba4078c10 0x7feba40772a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7feb940098e0 tx=0x7feb94009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=277d5ce490c6735b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:00.239 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.307+0000 7feba1600700 1 -- 172.21.15.81:0/506555078 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feb9400b8f0 con 0x7feba4078c10 2024-04-23T14:38:00.239 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.308+0000 7feba1600700 1 -- 172.21.15.81:0/506555078 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feb94011420 con 0x7feba4078c10 2024-04-23T14:38:00.239 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.308+0000 7feba1600700 1 -- 172.21.15.81:0/506555078 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feb94010540 con 0x7feba4078c10 2024-04-23T14:38:00.240 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.308+0000 7feba9600700 1 -- 172.21.15.81:0/506555078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feba4078c10 msgr2=0x7feba40772a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:00.240 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.308+0000 7feba9600700 1 --2- 172.21.15.81:0/506555078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feba4078c10 0x7feba40772a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7feb940098e0 tx=0x7feb94009250 comp rx=0 tx=0).stop 2024-04-23T14:38:00.240 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.308+0000 7feba9600700 1 -- 172.21.15.81:0/506555078 shutdown_connections 2024-04-23T14:38:00.241 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.308+0000 7feba9600700 1 --2- 172.21.15.81:0/506555078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feba4078c10 0x7feba40772a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:00.241 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.308+0000 7feba9600700 1 -- 172.21.15.81:0/506555078 >> 172.21.15.81:0/506555078 conn(0x7feba40fe140 msgr2=0x7feba4100550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:00.241 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.308+0000 7feba9600700 1 -- 172.21.15.81:0/506555078 shutdown_connections 2024-04-23T14:38:00.241 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.308+0000 7feba9600700 1 -- 172.21.15.81:0/506555078 wait complete. 2024-04-23T14:38:00.241 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.309+0000 7feba9600700 1 Processor -- start 2024-04-23T14:38:00.242 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.309+0000 7feba9600700 1 -- start start 2024-04-23T14:38:00.242 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.310+0000 7feba9600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feba4078c10 0x7feba4117e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:00.242 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.310+0000 7feba9600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba4118340 con 0x7feba4078c10 2024-04-23T14:38:00.242 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.310+0000 7feba2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feba4078c10 0x7feba4117e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:00.242 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.310+0000 7feba2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feba4078c10 0x7feba4117e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38872/0 (socket says 172.21.15.81:38872) 2024-04-23T14:38:00.242 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.310+0000 7feba2a00700 1 -- 172.21.15.81:0/2456063264 learned_addr learned my addr 172.21.15.81:0/2456063264 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:38:00.242 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.310+0000 7feba2a00700 1 -- 172.21.15.81:0/2456063264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb940094f0 con 0x7feba4078c10 2024-04-23T14:38:00.242 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.311+0000 7feba2a00700 1 --2- 172.21.15.81:0/2456063264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feba4078c10 0x7feba4117e00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7feb94011e90 tx=0x7feb94009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:00.245 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.311+0000 7feb9aa00700 1 -- 172.21.15.81:0/2456063264 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feb9400beb0 con 0x7feba4078c10 2024-04-23T14:38:00.245 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.311+0000 7feb9aa00700 1 -- 172.21.15.81:0/2456063264 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feb94010c80 con 0x7feba4078c10 2024-04-23T14:38:00.245 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.311+0000 7feb9aa00700 1 -- 172.21.15.81:0/2456063264 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feb9401ad40 con 0x7feba4078c10 2024-04-23T14:38:00.245 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.311+0000 7feba9600700 1 -- 172.21.15.81:0/2456063264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba4118540 con 0x7feba4078c10 2024-04-23T14:38:00.245 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.311+0000 7feba9600700 1 -- 172.21.15.81:0/2456063264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba4118f70 con 0x7feba4078c10 2024-04-23T14:38:00.246 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.312+0000 7feba9600700 1 -- 172.21.15.81:0/2456063264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba405f5f0 con 0x7feba4078c10 2024-04-23T14:38:00.246 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.313+0000 7feb9aa00700 1 -- 172.21.15.81:0/2456063264 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7feb9401a650 con 0x7feba4078c10 2024-04-23T14:38:00.246 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.313+0000 7feb9aa00700 1 --2- 172.21.15.81:0/2456063264 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7feb88036870 0x7feb88038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:00.246 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.313+0000 7feb9aa00700 1 -- 172.21.15.81:0/2456063264 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7feb9404a470 con 0x7feba4078c10 2024-04-23T14:38:00.246 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.313+0000 7feba2000700 1 --2- 172.21.15.81:0/2456063264 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7feb88036870 0x7feb88038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:00.246 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.314+0000 7feba2000700 1 --2- 172.21.15.81:0/2456063264 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7feb88036870 0x7feb88038d20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7feb90009990 tx=0x7feb90006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:00.246 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.318+0000 7feb9aa00700 1 -- 172.21.15.81:0/2456063264 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7feb9401a430 con 0x7feba4078c10 2024-04-23T14:38:00.246 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.550+0000 7feba9600700 1 -- 172.21.15.81:0/2456063264 --> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7feba4119b00 con 0x7feb88036870 2024-04-23T14:38:00.246 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.555+0000 7feb9aa00700 1 -- 172.21.15.81:0/2456063264 <== mgr.14120 v2:172.21.15.81:6800/2072638798 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7feba4119b00 con 0x7feb88036870 2024-04-23T14:38:00.246 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.557+0000 7feba9600700 1 -- 172.21.15.81:0/2456063264 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7feb88036870 msgr2=0x7feb88038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:00.246 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.557+0000 7feba9600700 1 --2- 172.21.15.81:0/2456063264 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7feb88036870 0x7feb88038d20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7feb90009990 tx=0x7feb90006e40 comp rx=0 tx=0).stop 2024-04-23T14:38:00.246 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.557+0000 7feba9600700 1 -- 172.21.15.81:0/2456063264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feba4078c10 msgr2=0x7feba4117e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:00.246 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.557+0000 7feba9600700 1 --2- 172.21.15.81:0/2456063264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feba4078c10 0x7feba4117e00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7feb94011e90 tx=0x7feb94009250 comp rx=0 tx=0).stop 2024-04-23T14:38:00.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.557+0000 7feba9600700 1 -- 172.21.15.81:0/2456063264 shutdown_connections 2024-04-23T14:38:00.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.557+0000 7feba9600700 1 --2- 172.21.15.81:0/2456063264 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7feb88036870 0x7feb88038d20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:00.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.557+0000 7feba9600700 1 --2- 172.21.15.81:0/2456063264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feba4078c10 0x7feba4117e00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:00.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.557+0000 7feba9600700 1 -- 172.21.15.81:0/2456063264 >> 172.21.15.81:0/2456063264 conn(0x7feba40fe140 msgr2=0x7feba410f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:00.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.558+0000 7feba9600700 1 -- 172.21.15.81:0/2456063264 shutdown_connections 2024-04-23T14:38:00.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:37:59.558+0000 7feba9600700 1 -- 172.21.15.81:0/2456063264 wait complete. 2024-04-23T14:38:00.247 INFO:teuthology.orchestra.run.smithi081.stdout:Deploying node-exporter service with default placement... 2024-04-23T14:38:00.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:00 smithi081 ceph-mon[25540]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:38:00.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:00 smithi081 ceph-mon[25540]: Saving service grafana spec with placement count:1 2024-04-23T14:38:00.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:00 smithi081 ceph-mon[25540]: from='mgr.14120 172.21.15.81:0/2042221483' entity='mgr.smithi081.ldghvq' 2024-04-23T14:38:01.747 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:01 smithi081 ceph-mon[25540]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:38:01.747 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:01 smithi081 ceph-mon[25540]: from='mgr.14120 172.21.15.81:0/2042221483' entity='mgr.smithi081.ldghvq' 2024-04-23T14:38:02.450 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-04-23T14:38:02.451 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.302+0000 7ff585400700 1 Processor -- start 2024-04-23T14:38:02.451 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.302+0000 7ff585400700 1 -- start start 2024-04-23T14:38:02.451 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.303+0000 7ff585400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff580101da0 0x7ff5801021b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:02.452 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.303+0000 7ff585400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5801026f0 con 0x7ff580101da0 2024-04-23T14:38:02.452 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.303+0000 7ff57e800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff580101da0 0x7ff5801021b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:02.452 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.303+0000 7ff57e800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff580101da0 0x7ff5801021b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38878/0 (socket says 172.21.15.81:38878) 2024-04-23T14:38:02.452 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.304+0000 7ff57e800700 1 -- 172.21.15.81:0/4198940043 learned_addr learned my addr 172.21.15.81:0/4198940043 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:38:02.453 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.304+0000 7ff57e800700 1 -- 172.21.15.81:0/4198940043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff580102830 con 0x7ff580101da0 2024-04-23T14:38:02.453 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.304+0000 7ff57e800700 1 --2- 172.21.15.81:0/4198940043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff580101da0 0x7ff5801021b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff5700098e0 tx=0x7ff570009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56a6b4875a92e526 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:02.453 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.305+0000 7ff57d400700 1 -- 172.21.15.81:0/4198940043 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff57000b860 con 0x7ff580101da0 2024-04-23T14:38:02.453 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.305+0000 7ff57d400700 1 -- 172.21.15.81:0/4198940043 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff57000be90 con 0x7ff580101da0 2024-04-23T14:38:02.453 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.305+0000 7ff57d400700 1 -- 172.21.15.81:0/4198940043 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff5700103c0 con 0x7ff580101da0 2024-04-23T14:38:02.454 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.306+0000 7ff585400700 1 -- 172.21.15.81:0/4198940043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff580101da0 msgr2=0x7ff5801021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:02.454 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.306+0000 7ff585400700 1 --2- 172.21.15.81:0/4198940043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff580101da0 0x7ff5801021b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff5700098e0 tx=0x7ff570009250 comp rx=0 tx=0).stop 2024-04-23T14:38:02.456 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.306+0000 7ff585400700 1 -- 172.21.15.81:0/4198940043 shutdown_connections 2024-04-23T14:38:02.456 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.306+0000 7ff585400700 1 --2- 172.21.15.81:0/4198940043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff580101da0 0x7ff5801021b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:02.457 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.306+0000 7ff585400700 1 -- 172.21.15.81:0/4198940043 >> 172.21.15.81:0/4198940043 conn(0x7ff5800fc770 msgr2=0x7ff5800feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:02.457 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.306+0000 7ff585400700 1 -- 172.21.15.81:0/4198940043 shutdown_connections 2024-04-23T14:38:02.457 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.306+0000 7ff585400700 1 -- 172.21.15.81:0/4198940043 wait complete. 2024-04-23T14:38:02.457 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.307+0000 7ff585400700 1 Processor -- start 2024-04-23T14:38:02.457 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.307+0000 7ff585400700 1 -- start start 2024-04-23T14:38:02.457 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.308+0000 7ff585400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff580101da0 0x7ff580107a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:02.457 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.308+0000 7ff585400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff580107fa0 con 0x7ff580101da0 2024-04-23T14:38:02.457 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.308+0000 7ff57e800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff580101da0 0x7ff580107a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:02.457 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.308+0000 7ff57e800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff580101da0 0x7ff580107a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38890/0 (socket says 172.21.15.81:38890) 2024-04-23T14:38:02.457 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.308+0000 7ff57e800700 1 -- 172.21.15.81:0/51108179 learned_addr learned my addr 172.21.15.81:0/51108179 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:38:02.457 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.308+0000 7ff57e800700 1 -- 172.21.15.81:0/51108179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5700094f0 con 0x7ff580101da0 2024-04-23T14:38:02.457 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.309+0000 7ff57e800700 1 --2- 172.21.15.81:0/51108179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff580101da0 0x7ff580107a60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff570006b00 tx=0x7ff570009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:02.457 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.309+0000 7ff576a00700 1 -- 172.21.15.81:0/51108179 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff570010840 con 0x7ff580101da0 2024-04-23T14:38:02.457 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.309+0000 7ff576a00700 1 -- 172.21.15.81:0/51108179 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff570010e70 con 0x7ff580101da0 2024-04-23T14:38:02.457 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.309+0000 7ff585400700 1 -- 172.21.15.81:0/51108179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff580106010 con 0x7ff580101da0 2024-04-23T14:38:02.458 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.309+0000 7ff576a00700 1 -- 172.21.15.81:0/51108179 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff57001ae70 con 0x7ff580101da0 2024-04-23T14:38:02.458 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.309+0000 7ff585400700 1 -- 172.21.15.81:0/51108179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff580106500 con 0x7ff580101da0 2024-04-23T14:38:02.458 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.310+0000 7ff585400700 1 -- 172.21.15.81:0/51108179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff58005f5f0 con 0x7ff580101da0 2024-04-23T14:38:02.458 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.311+0000 7ff576a00700 1 -- 172.21.15.81:0/51108179 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7ff57001a780 con 0x7ff580101da0 2024-04-23T14:38:02.458 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.312+0000 7ff576a00700 1 --2- 172.21.15.81:0/51108179 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7ff564036790 0x7ff564038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:02.458 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.312+0000 7ff576a00700 1 -- 172.21.15.81:0/51108179 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7ff57004abc0 con 0x7ff580101da0 2024-04-23T14:38:02.458 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.312+0000 7ff57de00700 1 --2- 172.21.15.81:0/51108179 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7ff564036790 0x7ff564038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:02.458 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.313+0000 7ff57de00700 1 --2- 172.21.15.81:0/51108179 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7ff564036790 0x7ff564038c40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff56c009990 tx=0x7ff56c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:02.458 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.319+0000 7ff576a00700 1 -- 172.21.15.81:0/51108179 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff57002cb80 con 0x7ff580101da0 2024-04-23T14:38:02.458 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.544+0000 7ff585400700 1 -- 172.21.15.81:0/51108179 --> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7ff58010b480 con 0x7ff564036790 2024-04-23T14:38:02.460 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.553+0000 7ff576a00700 1 -- 172.21.15.81:0/51108179 <== mgr.14120 v2:172.21.15.81:6800/2072638798 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7ff58010b480 con 0x7ff564036790 2024-04-23T14:38:02.460 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.556+0000 7ff585400700 1 -- 172.21.15.81:0/51108179 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7ff564036790 msgr2=0x7ff564038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:02.460 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.556+0000 7ff585400700 1 --2- 172.21.15.81:0/51108179 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7ff564036790 0x7ff564038c40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff56c009990 tx=0x7ff56c006e40 comp rx=0 tx=0).stop 2024-04-23T14:38:02.460 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.556+0000 7ff585400700 1 -- 172.21.15.81:0/51108179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff580101da0 msgr2=0x7ff580107a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:02.460 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.556+0000 7ff585400700 1 --2- 172.21.15.81:0/51108179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff580101da0 0x7ff580107a60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff570006b00 tx=0x7ff570009250 comp rx=0 tx=0).stop 2024-04-23T14:38:02.460 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.556+0000 7ff585400700 1 -- 172.21.15.81:0/51108179 shutdown_connections 2024-04-23T14:38:02.460 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.556+0000 7ff585400700 1 --2- 172.21.15.81:0/51108179 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7ff564036790 0x7ff564038c40 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:02.460 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.556+0000 7ff585400700 1 --2- 172.21.15.81:0/51108179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff580101da0 0x7ff580107a60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:02.460 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.556+0000 7ff585400700 1 -- 172.21.15.81:0/51108179 >> 172.21.15.81:0/51108179 conn(0x7ff5800fc770 msgr2=0x7ff5800fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:02.460 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.556+0000 7ff585400700 1 -- 172.21.15.81:0/51108179 shutdown_connections 2024-04-23T14:38:02.460 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:01.556+0000 7ff585400700 1 -- 172.21.15.81:0/51108179 wait complete. 2024-04-23T14:38:02.460 INFO:teuthology.orchestra.run.smithi081.stdout:Deploying alertmanager service with default placement... 2024-04-23T14:38:02.792 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:02 smithi081 ceph-mon[25540]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:38:02.792 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:02 smithi081 ceph-mon[25540]: Saving service node-exporter spec with placement * 2024-04-23T14:38:03.702 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:03 smithi081 ceph-mon[25540]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:38:03.702 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:03 smithi081 ceph-mon[25540]: from='mgr.14120 172.21.15.81:0/2042221483' entity='mgr.smithi081.ldghvq' 2024-04-23T14:38:04.016 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-04-23T14:38:04.017 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.082+0000 7f416c200700 1 Processor -- start 2024-04-23T14:38:04.017 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.082+0000 7f416c200700 1 -- start start 2024-04-23T14:38:04.017 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.082+0000 7f416c200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41640712c0 0x7f4164105530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:04.018 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.082+0000 7f416c200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41640716d0 con 0x7f41640712c0 2024-04-23T14:38:04.018 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.083+0000 7f4169800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41640712c0 0x7f4164105530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:04.018 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.083+0000 7f4169800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41640712c0 0x7f4164105530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38894/0 (socket says 172.21.15.81:38894) 2024-04-23T14:38:04.018 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.083+0000 7f4169800700 1 -- 172.21.15.81:0/3051764683 learned_addr learned my addr 172.21.15.81:0/3051764683 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:38:04.019 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.083+0000 7f4169800700 1 -- 172.21.15.81:0/3051764683 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4164105a70 con 0x7f41640712c0 2024-04-23T14:38:04.019 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.084+0000 7f4169800700 1 --2- 172.21.15.81:0/3051764683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41640712c0 0x7f4164105530 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f41580098e0 tx=0x7f4158009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c420a315651a8e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:04.019 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.084+0000 7f4163e00700 1 -- 172.21.15.81:0/3051764683 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f415800b860 con 0x7f41640712c0 2024-04-23T14:38:04.019 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.084+0000 7f4163e00700 1 -- 172.21.15.81:0/3051764683 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f415800be90 con 0x7f41640712c0 2024-04-23T14:38:04.020 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.084+0000 7f4163e00700 1 -- 172.21.15.81:0/3051764683 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f41580103c0 con 0x7f41640712c0 2024-04-23T14:38:04.020 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.084+0000 7f416c200700 1 -- 172.21.15.81:0/3051764683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41640712c0 msgr2=0x7f4164105530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:04.020 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.084+0000 7f416c200700 1 --2- 172.21.15.81:0/3051764683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41640712c0 0x7f4164105530 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f41580098e0 tx=0x7f4158009250 comp rx=0 tx=0).stop 2024-04-23T14:38:04.020 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.085+0000 7f416c200700 1 -- 172.21.15.81:0/3051764683 shutdown_connections 2024-04-23T14:38:04.020 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.085+0000 7f416c200700 1 --2- 172.21.15.81:0/3051764683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41640712c0 0x7f4164105530 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:04.021 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.085+0000 7f416c200700 1 -- 172.21.15.81:0/3051764683 >> 172.21.15.81:0/3051764683 conn(0x7f41640fcf80 msgr2=0x7f41640ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:04.022 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.085+0000 7f416c200700 1 -- 172.21.15.81:0/3051764683 shutdown_connections 2024-04-23T14:38:04.022 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.085+0000 7f416c200700 1 -- 172.21.15.81:0/3051764683 wait complete. 2024-04-23T14:38:04.022 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.086+0000 7f416c200700 1 Processor -- start 2024-04-23T14:38:04.022 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.086+0000 7f416c200700 1 -- start start 2024-04-23T14:38:04.022 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.086+0000 7f416c200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41640712c0 0x7f4164111790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:04.022 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.086+0000 7f416c200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4164111cd0 con 0x7f41640712c0 2024-04-23T14:38:04.022 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.086+0000 7f4169800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41640712c0 0x7f4164111790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:04.023 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.086+0000 7f4169800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41640712c0 0x7f4164111790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38910/0 (socket says 172.21.15.81:38910) 2024-04-23T14:38:04.023 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.086+0000 7f4169800700 1 -- 172.21.15.81:0/488678398 learned_addr learned my addr 172.21.15.81:0/488678398 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:38:04.023 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.087+0000 7f4169800700 1 -- 172.21.15.81:0/488678398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41580094f0 con 0x7f41640712c0 2024-04-23T14:38:04.023 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.087+0000 7f4169800700 1 --2- 172.21.15.81:0/488678398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41640712c0 0x7f4164111790 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f41580105b0 tx=0x7f4158009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:04.023 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.087+0000 7f4161600700 1 -- 172.21.15.81:0/488678398 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4158010840 con 0x7f41640712c0 2024-04-23T14:38:04.023 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.087+0000 7f4161600700 1 -- 172.21.15.81:0/488678398 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4158010e70 con 0x7f41640712c0 2024-04-23T14:38:04.024 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.087+0000 7f4161600700 1 -- 172.21.15.81:0/488678398 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f415801ae30 con 0x7f41640712c0 2024-04-23T14:38:04.024 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.087+0000 7f416c200700 1 -- 172.21.15.81:0/488678398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4164111ed0 con 0x7f41640712c0 2024-04-23T14:38:04.024 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.088+0000 7f416c200700 1 -- 172.21.15.81:0/488678398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4164112a40 con 0x7f41640712c0 2024-04-23T14:38:04.024 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.089+0000 7f4161600700 1 -- 172.21.15.81:0/488678398 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f415801a430 con 0x7f41640712c0 2024-04-23T14:38:04.025 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.089+0000 7f416c200700 1 -- 172.21.15.81:0/488678398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f416405f5f0 con 0x7f41640712c0 2024-04-23T14:38:04.025 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.089+0000 7f4161600700 1 --2- 172.21.15.81:0/488678398 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f414c0367e0 0x7f414c038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:04.025 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.089+0000 7f4161600700 1 -- 172.21.15.81:0/488678398 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f415804a150 con 0x7f41640712c0 2024-04-23T14:38:04.026 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.090+0000 7f4168e00700 1 --2- 172.21.15.81:0/488678398 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f414c0367e0 0x7f414c038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:04.026 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.090+0000 7f4168e00700 1 --2- 172.21.15.81:0/488678398 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f414c0367e0 0x7f414c038c90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4150009990 tx=0x7f4150006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:04.026 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.094+0000 7f4161600700 1 -- 172.21.15.81:0/488678398 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f415802b4d0 con 0x7f41640712c0 2024-04-23T14:38:04.026 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.317+0000 7f416c200700 1 -- 172.21.15.81:0/488678398 --> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f41640fe420 con 0x7f414c0367e0 2024-04-23T14:38:04.026 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.326+0000 7f4161600700 1 -- 172.21.15.81:0/488678398 <== mgr.14120 v2:172.21.15.81:6800/2072638798 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f41640fe420 con 0x7f414c0367e0 2024-04-23T14:38:04.026 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.328+0000 7f416c200700 1 -- 172.21.15.81:0/488678398 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f414c0367e0 msgr2=0x7f414c038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:04.027 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.328+0000 7f416c200700 1 --2- 172.21.15.81:0/488678398 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f414c0367e0 0x7f414c038c90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4150009990 tx=0x7f4150006e40 comp rx=0 tx=0).stop 2024-04-23T14:38:04.027 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.328+0000 7f416c200700 1 -- 172.21.15.81:0/488678398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41640712c0 msgr2=0x7f4164111790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:04.027 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.328+0000 7f416c200700 1 --2- 172.21.15.81:0/488678398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41640712c0 0x7f4164111790 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f41580105b0 tx=0x7f4158009250 comp rx=0 tx=0).stop 2024-04-23T14:38:04.027 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.328+0000 7f416c200700 1 -- 172.21.15.81:0/488678398 shutdown_connections 2024-04-23T14:38:04.027 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.328+0000 7f416c200700 1 --2- 172.21.15.81:0/488678398 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f414c0367e0 0x7f414c038c90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:04.027 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.328+0000 7f416c200700 1 --2- 172.21.15.81:0/488678398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41640712c0 0x7f4164111790 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:04.027 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.329+0000 7f416c200700 1 -- 172.21.15.81:0/488678398 >> 172.21.15.81:0/488678398 conn(0x7f41640fcf80 msgr2=0x7f41640fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:04.028 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.329+0000 7f416c200700 1 -- 172.21.15.81:0/488678398 shutdown_connections 2024-04-23T14:38:04.028 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:03.329+0000 7f416c200700 1 -- 172.21.15.81:0/488678398 wait complete. 2024-04-23T14:38:04.839 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:04 smithi081 ceph-mon[25540]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:38:04.839 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:04 smithi081 ceph-mon[25540]: Saving service alertmanager spec with placement count:1 2024-04-23T14:38:05.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.617+0000 7fa046400700 1 Processor -- start 2024-04-23T14:38:05.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.618+0000 7fa046400700 1 -- start start 2024-04-23T14:38:05.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.618+0000 7fa046400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa04007cf80 0x7fa04010bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:05.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.618+0000 7fa046400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04007d420 con 0x7fa04007cf80 2024-04-23T14:38:05.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.619+0000 7fa03f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa04007cf80 0x7fa04010bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:05.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.619+0000 7fa03f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa04007cf80 0x7fa04010bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50342/0 (socket says 172.21.15.81:50342) 2024-04-23T14:38:05.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.619+0000 7fa03f400700 1 -- 172.21.15.81:0/2520573945 learned_addr learned my addr 172.21.15.81:0/2520573945 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:38:05.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.619+0000 7fa03f400700 1 -- 172.21.15.81:0/2520573945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa04007d560 con 0x7fa04007cf80 2024-04-23T14:38:05.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.619+0000 7fa03f400700 1 --2- 172.21.15.81:0/2520573945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa04007cf80 0x7fa04010bce0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa0300098e0 tx=0x7fa030009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3a9c6918fb34429 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:05.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.620+0000 7fa03e000700 1 -- 172.21.15.81:0/2520573945 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa03000b860 con 0x7fa04007cf80 2024-04-23T14:38:05.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.620+0000 7fa03e000700 1 -- 172.21.15.81:0/2520573945 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa03000be90 con 0x7fa04007cf80 2024-04-23T14:38:05.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.620+0000 7fa03e000700 1 -- 172.21.15.81:0/2520573945 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa0300103c0 con 0x7fa04007cf80 2024-04-23T14:38:05.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.620+0000 7fa046400700 1 -- 172.21.15.81:0/2520573945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa04007cf80 msgr2=0x7fa04010bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:05.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.620+0000 7fa046400700 1 --2- 172.21.15.81:0/2520573945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa04007cf80 0x7fa04010bce0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa0300098e0 tx=0x7fa030009250 comp rx=0 tx=0).stop 2024-04-23T14:38:05.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.621+0000 7fa046400700 1 -- 172.21.15.81:0/2520573945 shutdown_connections 2024-04-23T14:38:05.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.621+0000 7fa046400700 1 --2- 172.21.15.81:0/2520573945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa04007cf80 0x7fa04010bce0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:05.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.621+0000 7fa046400700 1 -- 172.21.15.81:0/2520573945 >> 172.21.15.81:0/2520573945 conn(0x7fa040078350 msgr2=0x7fa04007a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:05.490 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.621+0000 7fa046400700 1 -- 172.21.15.81:0/2520573945 shutdown_connections 2024-04-23T14:38:05.490 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.621+0000 7fa046400700 1 -- 172.21.15.81:0/2520573945 wait complete. 2024-04-23T14:38:05.490 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.621+0000 7fa046400700 1 Processor -- start 2024-04-23T14:38:05.490 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.622+0000 7fa046400700 1 -- start start 2024-04-23T14:38:05.490 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.622+0000 7fa046400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa04007cf80 0x7fa040117cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:05.490 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.622+0000 7fa046400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa040118210 con 0x7fa04007cf80 2024-04-23T14:38:05.490 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.622+0000 7fa03f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa04007cf80 0x7fa040117cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:05.490 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.622+0000 7fa03f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa04007cf80 0x7fa040117cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50344/0 (socket says 172.21.15.81:50344) 2024-04-23T14:38:05.490 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.622+0000 7fa03f400700 1 -- 172.21.15.81:0/3304749078 learned_addr learned my addr 172.21.15.81:0/3304749078 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:38:05.490 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.623+0000 7fa03f400700 1 -- 172.21.15.81:0/3304749078 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0300094f0 con 0x7fa04007cf80 2024-04-23T14:38:05.490 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.623+0000 7fa03f400700 1 --2- 172.21.15.81:0/3304749078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa04007cf80 0x7fa040117cd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa030006d40 tx=0x7fa030009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:05.490 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.623+0000 7fa037400700 1 -- 172.21.15.81:0/3304749078 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa030010840 con 0x7fa04007cf80 2024-04-23T14:38:05.490 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.623+0000 7fa037400700 1 -- 172.21.15.81:0/3304749078 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa030010e70 con 0x7fa04007cf80 2024-04-23T14:38:05.491 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.623+0000 7fa037400700 1 -- 172.21.15.81:0/3304749078 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa030024ea0 con 0x7fa04007cf80 2024-04-23T14:38:05.491 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.623+0000 7fa046400700 1 -- 172.21.15.81:0/3304749078 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa040118410 con 0x7fa04007cf80 2024-04-23T14:38:05.491 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.623+0000 7fa046400700 1 -- 172.21.15.81:0/3304749078 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa040118f80 con 0x7fa04007cf80 2024-04-23T14:38:05.491 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.624+0000 7fa037400700 1 -- 172.21.15.81:0/3304749078 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fa030024780 con 0x7fa04007cf80 2024-04-23T14:38:05.491 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.625+0000 7fa046400700 1 -- 172.21.15.81:0/3304749078 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa04005f5f0 con 0x7fa04007cf80 2024-04-23T14:38:05.491 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.625+0000 7fa037400700 1 --2- 172.21.15.81:0/3304749078 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fa024036740 0x7fa024038bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:05.491 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.625+0000 7fa037400700 1 -- 172.21.15.81:0/3304749078 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fa03004a540 con 0x7fa04007cf80 2024-04-23T14:38:05.491 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.625+0000 7fa03ea00700 1 --2- 172.21.15.81:0/3304749078 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fa024036740 0x7fa024038bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:05.491 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.626+0000 7fa03ea00700 1 --2- 172.21.15.81:0/3304749078 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fa024036740 0x7fa024038bf0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa02c009990 tx=0x7fa02c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:05.491 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.630+0000 7fa037400700 1 -- 172.21.15.81:0/3304749078 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa03002c930 con 0x7fa04007cf80 2024-04-23T14:38:05.491 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.838+0000 7fa046400700 1 -- 172.21.15.81:0/3304749078 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fa04007d560 con 0x7fa04007cf80 2024-04-23T14:38:05.491 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.848+0000 7fa037400700 1 -- 172.21.15.81:0/3304749078 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fa04007d560 con 0x7fa04007cf80 2024-04-23T14:38:05.491 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.851+0000 7fa046400700 1 -- 172.21.15.81:0/3304749078 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fa024036740 msgr2=0x7fa024038bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:05.491 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.851+0000 7fa046400700 1 --2- 172.21.15.81:0/3304749078 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fa024036740 0x7fa024038bf0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa02c009990 tx=0x7fa02c006e40 comp rx=0 tx=0).stop 2024-04-23T14:38:05.492 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.851+0000 7fa046400700 1 -- 172.21.15.81:0/3304749078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa04007cf80 msgr2=0x7fa040117cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:05.492 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.851+0000 7fa046400700 1 --2- 172.21.15.81:0/3304749078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa04007cf80 0x7fa040117cd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa030006d40 tx=0x7fa030009250 comp rx=0 tx=0).stop 2024-04-23T14:38:05.492 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.851+0000 7fa046400700 1 -- 172.21.15.81:0/3304749078 shutdown_connections 2024-04-23T14:38:05.492 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.851+0000 7fa046400700 1 --2- 172.21.15.81:0/3304749078 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fa024036740 0x7fa024038bf0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:05.492 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.851+0000 7fa046400700 1 --2- 172.21.15.81:0/3304749078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa04007cf80 0x7fa040117cd0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:05.492 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.851+0000 7fa046400700 1 -- 172.21.15.81:0/3304749078 >> 172.21.15.81:0/3304749078 conn(0x7fa040078350 msgr2=0x7fa040078ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:05.492 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.851+0000 7fa046400700 1 -- 172.21.15.81:0/3304749078 shutdown_connections 2024-04-23T14:38:05.492 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:04.851+0000 7fa046400700 1 -- 172.21.15.81:0/3304749078 wait complete. 2024-04-23T14:38:06.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:05 smithi081 ceph-mon[25540]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:38:06.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:05 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/3304749078' entity='client.admin' 2024-04-23T14:38:07.011 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.108+0000 7fcfca200700 1 Processor -- start 2024-04-23T14:38:07.011 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.108+0000 7fcfca200700 1 -- start start 2024-04-23T14:38:07.011 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.108+0000 7fcfca200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfc407cf80 0x7fcfc410bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:07.011 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.109+0000 7fcfca200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc407d420 con 0x7fcfc407cf80 2024-04-23T14:38:07.011 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.109+0000 7fcfc3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfc407cf80 0x7fcfc410bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:07.011 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.109+0000 7fcfc3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfc407cf80 0x7fcfc410bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50346/0 (socket says 172.21.15.81:50346) 2024-04-23T14:38:07.011 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.109+0000 7fcfc3400700 1 -- 172.21.15.81:0/1026988154 learned_addr learned my addr 172.21.15.81:0/1026988154 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:38:07.011 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.109+0000 7fcfc3400700 1 -- 172.21.15.81:0/1026988154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc407d560 con 0x7fcfc407cf80 2024-04-23T14:38:07.011 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.110+0000 7fcfc3400700 1 --2- 172.21.15.81:0/1026988154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfc407cf80 0x7fcfc410bce0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcfb40098e0 tx=0x7fcfb4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5df73bd0ad1734f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:07.011 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.110+0000 7fcfc2000700 1 -- 172.21.15.81:0/1026988154 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcfb400b860 con 0x7fcfc407cf80 2024-04-23T14:38:07.011 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.110+0000 7fcfc2000700 1 -- 172.21.15.81:0/1026988154 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcfb400be90 con 0x7fcfc407cf80 2024-04-23T14:38:07.011 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.110+0000 7fcfc2000700 1 -- 172.21.15.81:0/1026988154 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcfb40103c0 con 0x7fcfc407cf80 2024-04-23T14:38:07.012 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.111+0000 7fcfca200700 1 -- 172.21.15.81:0/1026988154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfc407cf80 msgr2=0x7fcfc410bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:07.012 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.111+0000 7fcfca200700 1 --2- 172.21.15.81:0/1026988154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfc407cf80 0x7fcfc410bce0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcfb40098e0 tx=0x7fcfb4009250 comp rx=0 tx=0).stop 2024-04-23T14:38:07.012 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.111+0000 7fcfca200700 1 -- 172.21.15.81:0/1026988154 shutdown_connections 2024-04-23T14:38:07.012 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.111+0000 7fcfca200700 1 --2- 172.21.15.81:0/1026988154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfc407cf80 0x7fcfc410bce0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:07.012 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.111+0000 7fcfca200700 1 -- 172.21.15.81:0/1026988154 >> 172.21.15.81:0/1026988154 conn(0x7fcfc4078350 msgr2=0x7fcfc407a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:07.012 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.111+0000 7fcfca200700 1 -- 172.21.15.81:0/1026988154 shutdown_connections 2024-04-23T14:38:07.012 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.111+0000 7fcfca200700 1 -- 172.21.15.81:0/1026988154 wait complete. 2024-04-23T14:38:07.012 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.112+0000 7fcfca200700 1 Processor -- start 2024-04-23T14:38:07.012 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.112+0000 7fcfca200700 1 -- start start 2024-04-23T14:38:07.012 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.112+0000 7fcfca200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfc407cf80 0x7fcfc4117cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:07.012 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.112+0000 7fcfca200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc41181f0 con 0x7fcfc407cf80 2024-04-23T14:38:07.012 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.113+0000 7fcfc3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfc407cf80 0x7fcfc4117cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:07.012 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.113+0000 7fcfc3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfc407cf80 0x7fcfc4117cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50358/0 (socket says 172.21.15.81:50358) 2024-04-23T14:38:07.012 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.113+0000 7fcfc3400700 1 -- 172.21.15.81:0/511202225 learned_addr learned my addr 172.21.15.81:0/511202225 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:38:07.012 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.113+0000 7fcfc3400700 1 -- 172.21.15.81:0/511202225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb40094f0 con 0x7fcfc407cf80 2024-04-23T14:38:07.012 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.113+0000 7fcfc3400700 1 --2- 172.21.15.81:0/511202225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfc407cf80 0x7fcfc4117cb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4006d40 tx=0x7fcfb4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:07.013 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.114+0000 7fcfbb400700 1 -- 172.21.15.81:0/511202225 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcfb4010840 con 0x7fcfc407cf80 2024-04-23T14:38:07.013 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.114+0000 7fcfbb400700 1 -- 172.21.15.81:0/511202225 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcfb4010e70 con 0x7fcfc407cf80 2024-04-23T14:38:07.013 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.114+0000 7fcfbb400700 1 -- 172.21.15.81:0/511202225 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcfb4024ea0 con 0x7fcfc407cf80 2024-04-23T14:38:07.013 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.114+0000 7fcfca200700 1 -- 172.21.15.81:0/511202225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfc41183f0 con 0x7fcfc407cf80 2024-04-23T14:38:07.013 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.114+0000 7fcfca200700 1 -- 172.21.15.81:0/511202225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfc4118f60 con 0x7fcfc407cf80 2024-04-23T14:38:07.013 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.115+0000 7fcfca200700 1 -- 172.21.15.81:0/511202225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfc405f5f0 con 0x7fcfc407cf80 2024-04-23T14:38:07.013 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.115+0000 7fcfbb400700 1 -- 172.21.15.81:0/511202225 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fcfb4024780 con 0x7fcfc407cf80 2024-04-23T14:38:07.013 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.115+0000 7fcfbb400700 1 --2- 172.21.15.81:0/511202225 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fcfa8036790 0x7fcfa8038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:07.013 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.115+0000 7fcfbb400700 1 -- 172.21.15.81:0/511202225 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fcfb404a5a0 con 0x7fcfc407cf80 2024-04-23T14:38:07.013 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.116+0000 7fcfc2a00700 1 --2- 172.21.15.81:0/511202225 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fcfa8036790 0x7fcfa8038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:07.013 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.116+0000 7fcfc2a00700 1 --2- 172.21.15.81:0/511202225 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fcfa8036790 0x7fcfa8038c40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0009990 tx=0x7fcfb0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:07.013 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.120+0000 7fcfbb400700 1 -- 172.21.15.81:0/511202225 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fcfb402c910 con 0x7fcfc407cf80 2024-04-23T14:38:07.013 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.332+0000 7fcfca200700 1 -- 172.21.15.81:0/511202225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7fcfc407d560 con 0x7fcfc407cf80 2024-04-23T14:38:07.013 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.337+0000 7fcfbb400700 1 -- 172.21.15.81:0/511202225 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7fcfc407d560 con 0x7fcfc407cf80 2024-04-23T14:38:07.013 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.340+0000 7fcfca200700 1 -- 172.21.15.81:0/511202225 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fcfa8036790 msgr2=0x7fcfa8038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:07.013 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.340+0000 7fcfca200700 1 --2- 172.21.15.81:0/511202225 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fcfa8036790 0x7fcfa8038c40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0009990 tx=0x7fcfb0006e40 comp rx=0 tx=0).stop 2024-04-23T14:38:07.014 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.340+0000 7fcfca200700 1 -- 172.21.15.81:0/511202225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfc407cf80 msgr2=0x7fcfc4117cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:07.014 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.340+0000 7fcfca200700 1 --2- 172.21.15.81:0/511202225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfc407cf80 0x7fcfc4117cb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4006d40 tx=0x7fcfb4009250 comp rx=0 tx=0).stop 2024-04-23T14:38:07.014 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.340+0000 7fcfca200700 1 -- 172.21.15.81:0/511202225 shutdown_connections 2024-04-23T14:38:07.014 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.340+0000 7fcfca200700 1 --2- 172.21.15.81:0/511202225 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fcfa8036790 0x7fcfa8038c40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:07.014 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.340+0000 7fcfca200700 1 --2- 172.21.15.81:0/511202225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfc407cf80 0x7fcfc4117cb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:07.014 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.340+0000 7fcfca200700 1 -- 172.21.15.81:0/511202225 >> 172.21.15.81:0/511202225 conn(0x7fcfc4078350 msgr2=0x7fcfc4078f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:07.014 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.341+0000 7fcfca200700 1 -- 172.21.15.81:0/511202225 shutdown_connections 2024-04-23T14:38:07.014 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:06.341+0000 7fcfca200700 1 -- 172.21.15.81:0/511202225 wait complete. 2024-04-23T14:38:07.014 INFO:teuthology.orchestra.run.smithi081.stdout:Enabling the dashboard module... 2024-04-23T14:38:07.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:07 smithi081 ceph-mon[25540]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:38:07.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:07 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/511202225' entity='client.admin' 2024-04-23T14:38:08.647 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:08 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/1918221536' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-04-23T14:38:09.117 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.618+0000 7ff11d200700 1 Processor -- start 2024-04-23T14:38:09.122 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.618+0000 7ff11d200700 1 -- start start 2024-04-23T14:38:09.122 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.618+0000 7ff11d200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff118104c40 0x7ff118105050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:09.122 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.618+0000 7ff11d200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff118105620 con 0x7ff118104c40 2024-04-23T14:38:09.122 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.619+0000 7ff115e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff118104c40 0x7ff118105050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:09.122 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.619+0000 7ff115e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff118104c40 0x7ff118105050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50360/0 (socket says 172.21.15.81:50360) 2024-04-23T14:38:09.122 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.619+0000 7ff115e00700 1 -- 172.21.15.81:0/845237885 learned_addr learned my addr 172.21.15.81:0/845237885 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:38:09.123 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.619+0000 7ff115e00700 1 -- 172.21.15.81:0/845237885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff118105760 con 0x7ff118104c40 2024-04-23T14:38:09.123 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.620+0000 7ff115e00700 1 --2- 172.21.15.81:0/845237885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff118104c40 0x7ff118105050 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff1080098e0 tx=0x7ff108009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92abb3b8429dcc1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:09.123 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.620+0000 7ff115400700 1 -- 172.21.15.81:0/845237885 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff10800b860 con 0x7ff118104c40 2024-04-23T14:38:09.123 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.620+0000 7ff115400700 1 -- 172.21.15.81:0/845237885 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff10800be90 con 0x7ff118104c40 2024-04-23T14:38:09.123 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.620+0000 7ff115400700 1 -- 172.21.15.81:0/845237885 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff1080103c0 con 0x7ff118104c40 2024-04-23T14:38:09.123 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.621+0000 7ff11d200700 1 -- 172.21.15.81:0/845237885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff118104c40 msgr2=0x7ff118105050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:09.123 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.621+0000 7ff11d200700 1 --2- 172.21.15.81:0/845237885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff118104c40 0x7ff118105050 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff1080098e0 tx=0x7ff108009250 comp rx=0 tx=0).stop 2024-04-23T14:38:09.123 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.621+0000 7ff11d200700 1 -- 172.21.15.81:0/845237885 shutdown_connections 2024-04-23T14:38:09.123 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.621+0000 7ff11d200700 1 --2- 172.21.15.81:0/845237885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff118104c40 0x7ff118105050 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:09.123 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.621+0000 7ff11d200700 1 -- 172.21.15.81:0/845237885 >> 172.21.15.81:0/845237885 conn(0x7ff1180782f0 msgr2=0x7ff118078710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:09.123 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.621+0000 7ff11d200700 1 -- 172.21.15.81:0/845237885 shutdown_connections 2024-04-23T14:38:09.123 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.621+0000 7ff11d200700 1 -- 172.21.15.81:0/845237885 wait complete. 2024-04-23T14:38:09.123 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.622+0000 7ff11d200700 1 Processor -- start 2024-04-23T14:38:09.123 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.622+0000 7ff11d200700 1 -- start start 2024-04-23T14:38:09.124 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.622+0000 7ff11d200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff118104c40 0x7ff1181138f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:09.124 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.622+0000 7ff11d200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff118113e30 con 0x7ff118104c40 2024-04-23T14:38:09.124 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.623+0000 7ff115e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff118104c40 0x7ff1181138f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:09.124 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.623+0000 7ff115e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff118104c40 0x7ff1181138f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50376/0 (socket says 172.21.15.81:50376) 2024-04-23T14:38:09.124 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.623+0000 7ff115e00700 1 -- 172.21.15.81:0/1918221536 learned_addr learned my addr 172.21.15.81:0/1918221536 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:38:09.124 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.623+0000 7ff115e00700 1 -- 172.21.15.81:0/1918221536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1080094f0 con 0x7ff118104c40 2024-04-23T14:38:09.124 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.623+0000 7ff115e00700 1 --2- 172.21.15.81:0/1918221536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff118104c40 0x7ff1181138f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff1080105b0 tx=0x7ff108009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:09.124 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.624+0000 7ff10ea00700 1 -- 172.21.15.81:0/1918221536 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff108010840 con 0x7ff118104c40 2024-04-23T14:38:09.124 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.624+0000 7ff10ea00700 1 -- 172.21.15.81:0/1918221536 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff108010e70 con 0x7ff118104c40 2024-04-23T14:38:09.124 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.624+0000 7ff11d200700 1 -- 172.21.15.81:0/1918221536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff118114030 con 0x7ff118104c40 2024-04-23T14:38:09.124 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.624+0000 7ff10ea00700 1 -- 172.21.15.81:0/1918221536 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff10801ae30 con 0x7ff118104c40 2024-04-23T14:38:09.124 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.624+0000 7ff11d200700 1 -- 172.21.15.81:0/1918221536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff118114ba0 con 0x7ff118104c40 2024-04-23T14:38:09.124 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.625+0000 7ff10ea00700 1 -- 172.21.15.81:0/1918221536 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7ff10802d3f0 con 0x7ff118104c40 2024-04-23T14:38:09.124 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.625+0000 7ff11d200700 1 -- 172.21.15.81:0/1918221536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0f40052e0 con 0x7ff118104c40 2024-04-23T14:38:09.124 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.625+0000 7ff10ea00700 1 --2- 172.21.15.81:0/1918221536 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7ff0fc0367e0 0x7ff0fc038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:09.125 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.625+0000 7ff10ea00700 1 -- 172.21.15.81:0/1918221536 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7ff10804a150 con 0x7ff118104c40 2024-04-23T14:38:09.125 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.625+0000 7ff10d400700 1 --2- 172.21.15.81:0/1918221536 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7ff0fc0367e0 0x7ff0fc038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:09.125 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.626+0000 7ff10d400700 1 --2- 172.21.15.81:0/1918221536 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7ff0fc0367e0 0x7ff0fc038c90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff100009990 tx=0x7ff100006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:09.125 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.631+0000 7ff10ea00700 1 -- 172.21.15.81:0/1918221536 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff10802b8e0 con 0x7ff118104c40 2024-04-23T14:38:09.125 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:07.896+0000 7ff11d200700 1 -- 172.21.15.81:0/1918221536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7ff0f4005590 con 0x7ff118104c40 2024-04-23T14:38:09.125 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:08.352+0000 7ff10ea00700 1 -- 172.21.15.81:0/1918221536 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 9) v1 ==== 43389+0+0 (secure 0 0 0) 0x7ff10801a430 con 0x7ff118104c40 2024-04-23T14:38:09.125 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:08.354+0000 7ff10ea00700 1 -- 172.21.15.81:0/1918221536 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7ff1080179f0 con 0x7ff118104c40 2024-04-23T14:38:09.125 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:08.358+0000 7ff11d200700 1 -- 172.21.15.81:0/1918221536 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7ff0fc0367e0 msgr2=0x7ff0fc038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:09.125 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:08.358+0000 7ff11d200700 1 --2- 172.21.15.81:0/1918221536 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7ff0fc0367e0 0x7ff0fc038c90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff100009990 tx=0x7ff100006e40 comp rx=0 tx=0).stop 2024-04-23T14:38:09.125 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:08.358+0000 7ff11d200700 1 -- 172.21.15.81:0/1918221536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff118104c40 msgr2=0x7ff1181138f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:09.125 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:08.358+0000 7ff11d200700 1 --2- 172.21.15.81:0/1918221536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff118104c40 0x7ff1181138f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff1080105b0 tx=0x7ff108009250 comp rx=0 tx=0).stop 2024-04-23T14:38:09.125 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:08.358+0000 7ff11d200700 1 -- 172.21.15.81:0/1918221536 shutdown_connections 2024-04-23T14:38:09.125 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:08.358+0000 7ff11d200700 1 --2- 172.21.15.81:0/1918221536 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7ff0fc0367e0 0x7ff0fc038c90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:09.125 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:08.358+0000 7ff11d200700 1 --2- 172.21.15.81:0/1918221536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff118104c40 0x7ff1181138f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:09.125 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:08.358+0000 7ff11d200700 1 -- 172.21.15.81:0/1918221536 >> 172.21.15.81:0/1918221536 conn(0x7ff1180782f0 msgr2=0x7ff118102510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:09.125 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:08.358+0000 7ff11d200700 1 -- 172.21.15.81:0/1918221536 shutdown_connections 2024-04-23T14:38:09.126 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:08.358+0000 7ff11d200700 1 -- 172.21.15.81:0/1918221536 wait complete. 2024-04-23T14:38:09.529 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:09 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/1918221536' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-04-23T14:38:09.530 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:09 smithi081 ceph-mon[25540]: mgrmap e9: smithi081.ldghvq(active, since 30s) 2024-04-23T14:38:10.651 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:10 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/2576773163' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-23T14:38:10.660 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-04-23T14:38:10.667 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-04-23T14:38:10.667 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-23T14:38:10.667 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "active_name": "smithi081.ldghvq", 2024-04-23T14:38:10.667 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-23T14:38:10.667 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-04-23T14:38:10.667 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.717+0000 7f8641000700 1 Processor -- start 2024-04-23T14:38:10.667 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.717+0000 7f8641000700 1 -- start start 2024-04-23T14:38:10.667 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.717+0000 7f8641000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f863c071280 0x7f863c107970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:10.667 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.717+0000 7f8641000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863c071690 con 0x7f863c071280 2024-04-23T14:38:10.667 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.718+0000 7f8639e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f863c071280 0x7f863c107970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:10.668 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.718+0000 7f8639e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f863c071280 0x7f863c107970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50412/0 (socket says 172.21.15.81:50412) 2024-04-23T14:38:10.668 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.718+0000 7f8639e00700 1 -- 172.21.15.81:0/3936458069 learned_addr learned my addr 172.21.15.81:0/3936458069 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:38:10.668 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.718+0000 7f8639e00700 1 -- 172.21.15.81:0/3936458069 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f863c103360 con 0x7f863c071280 2024-04-23T14:38:10.668 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.719+0000 7f8639e00700 1 --2- 172.21.15.81:0/3936458069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f863c071280 0x7f863c107970 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f862c0098e0 tx=0x7f862c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5abaa79ebdbc34a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:10.668 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.719+0000 7f8639400700 1 -- 172.21.15.81:0/3936458069 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f862c00b860 con 0x7f863c071280 2024-04-23T14:38:10.668 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.719+0000 7f8639400700 1 -- 172.21.15.81:0/3936458069 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f862c00be90 con 0x7f863c071280 2024-04-23T14:38:10.668 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.719+0000 7f8639400700 1 -- 172.21.15.81:0/3936458069 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f862c0103c0 con 0x7f863c071280 2024-04-23T14:38:10.668 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.720+0000 7f8641000700 1 -- 172.21.15.81:0/3936458069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f863c071280 msgr2=0x7f863c107970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:10.668 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.720+0000 7f8641000700 1 --2- 172.21.15.81:0/3936458069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f863c071280 0x7f863c107970 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f862c0098e0 tx=0x7f862c009250 comp rx=0 tx=0).stop 2024-04-23T14:38:10.668 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.720+0000 7f8641000700 1 -- 172.21.15.81:0/3936458069 shutdown_connections 2024-04-23T14:38:10.668 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.720+0000 7f8641000700 1 --2- 172.21.15.81:0/3936458069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f863c071280 0x7f863c107970 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:10.668 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.720+0000 7f8641000700 1 -- 172.21.15.81:0/3936458069 >> 172.21.15.81:0/3936458069 conn(0x7f863c0fcf80 msgr2=0x7f863c0ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:10.669 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.720+0000 7f8641000700 1 -- 172.21.15.81:0/3936458069 shutdown_connections 2024-04-23T14:38:10.669 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.720+0000 7f8641000700 1 -- 172.21.15.81:0/3936458069 wait complete. 2024-04-23T14:38:10.669 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.721+0000 7f8641000700 1 Processor -- start 2024-04-23T14:38:10.669 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.721+0000 7f8641000700 1 -- start start 2024-04-23T14:38:10.669 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.721+0000 7f8641000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f863c071280 0x7f863c113930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:10.669 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.721+0000 7f8641000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863c113e70 con 0x7f863c071280 2024-04-23T14:38:10.669 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.721+0000 7f8639e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f863c071280 0x7f863c113930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:10.669 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.721+0000 7f8639e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f863c071280 0x7f863c113930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50428/0 (socket says 172.21.15.81:50428) 2024-04-23T14:38:10.669 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.721+0000 7f8639e00700 1 -- 172.21.15.81:0/2576773163 learned_addr learned my addr 172.21.15.81:0/2576773163 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:38:10.669 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.722+0000 7f8639e00700 1 -- 172.21.15.81:0/2576773163 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f862c0094f0 con 0x7f863c071280 2024-04-23T14:38:10.669 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.722+0000 7f8639e00700 1 --2- 172.21.15.81:0/2576773163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f863c071280 0x7f863c113930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f862c0105b0 tx=0x7f862c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:10.669 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.722+0000 7f8632a00700 1 -- 172.21.15.81:0/2576773163 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f862c010840 con 0x7f863c071280 2024-04-23T14:38:10.669 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.722+0000 7f8632a00700 1 -- 172.21.15.81:0/2576773163 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f862c010e70 con 0x7f863c071280 2024-04-23T14:38:10.669 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.722+0000 7f8641000700 1 -- 172.21.15.81:0/2576773163 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f863c1140d0 con 0x7f863c071280 2024-04-23T14:38:10.670 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.722+0000 7f8632a00700 1 -- 172.21.15.81:0/2576773163 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f862c01ae30 con 0x7f863c071280 2024-04-23T14:38:10.670 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.722+0000 7f8641000700 1 -- 172.21.15.81:0/2576773163 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f863c114be0 con 0x7f863c071280 2024-04-23T14:38:10.670 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.723+0000 7f8632a00700 1 -- 172.21.15.81:0/2576773163 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) v1 ==== 43389+0+0 (secure 0 0 0) 0x7f862c01a430 con 0x7f863c071280 2024-04-23T14:38:10.670 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.723+0000 7f8641000700 1 -- 172.21.15.81:0/2576773163 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f863c05f5f0 con 0x7f863c071280 2024-04-23T14:38:10.670 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.724+0000 7f8632a00700 1 --2- 172.21.15.81:0/2576773163 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f86200367b0 0x7f8620038c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:10.670 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.724+0000 7f8632a00700 1 -- 172.21.15.81:0/2576773163 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f862c04a250 con 0x7f863c071280 2024-04-23T14:38:10.670 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.724+0000 7f8631400700 1 -- 172.21.15.81:0/2576773163 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f86200367b0 msgr2=0x7f8620038c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2072638798 2024-04-23T14:38:10.670 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.724+0000 7f8631400700 1 --2- 172.21.15.81:0/2576773163 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f86200367b0 0x7f8620038c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T14:38:10.670 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.733+0000 7f8632a00700 1 -- 172.21.15.81:0/2576773163 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f862c02b8c0 con 0x7f863c071280 2024-04-23T14:38:10.670 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.925+0000 7f8631400700 1 -- 172.21.15.81:0/2576773163 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f86200367b0 msgr2=0x7f8620038c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2072638798 2024-04-23T14:38:10.670 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.925+0000 7f8631400700 1 --2- 172.21.15.81:0/2576773163 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f86200367b0 0x7f8620038c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-23T14:38:10.670 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.997+0000 7f8641000700 1 -- 172.21.15.81:0/2576773163 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f863c04bed0 con 0x7f863c071280 2024-04-23T14:38:10.670 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:09.998+0000 7f8632a00700 1 -- 172.21.15.81:0/2576773163 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f862c02b2f0 con 0x7f863c071280 2024-04-23T14:38:10.671 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:10.001+0000 7f8641000700 1 -- 172.21.15.81:0/2576773163 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f86200367b0 msgr2=0x7f8620038c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-23T14:38:10.671 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:10.001+0000 7f8641000700 1 --2- 172.21.15.81:0/2576773163 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f86200367b0 0x7f8620038c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:10.671 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:10.001+0000 7f8641000700 1 -- 172.21.15.81:0/2576773163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f863c071280 msgr2=0x7f863c113930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:10.671 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:10.001+0000 7f8641000700 1 --2- 172.21.15.81:0/2576773163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f863c071280 0x7f863c113930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f862c0105b0 tx=0x7f862c009250 comp rx=0 tx=0).stop 2024-04-23T14:38:10.671 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:10.001+0000 7f8641000700 1 -- 172.21.15.81:0/2576773163 shutdown_connections 2024-04-23T14:38:10.671 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:10.001+0000 7f8641000700 1 --2- 172.21.15.81:0/2576773163 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7f86200367b0 0x7f8620038c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:10.671 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:10.001+0000 7f8641000700 1 --2- 172.21.15.81:0/2576773163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f863c071280 0x7f863c113930 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:10.671 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:10.001+0000 7f8641000700 1 -- 172.21.15.81:0/2576773163 >> 172.21.15.81:0/2576773163 conn(0x7f863c0fcf80 msgr2=0x7f863c0fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:10.671 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:10.001+0000 7f8641000700 1 -- 172.21.15.81:0/2576773163 shutdown_connections 2024-04-23T14:38:10.671 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:10.001+0000 7f8641000700 1 -- 172.21.15.81:0/2576773163 wait complete. 2024-04-23T14:38:10.671 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for the mgr to restart... 2024-04-23T14:38:10.672 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mgr epoch 9... 2024-04-23T14:38:17.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:16 smithi081 ceph-mon[25540]: Active manager daemon smithi081.ldghvq restarted 2024-04-23T14:38:17.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:16 smithi081 ceph-mon[25540]: Activating manager daemon smithi081.ldghvq 2024-04-23T14:38:17.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:16 smithi081 ceph-mon[25540]: osdmap e3: 0 total, 0 up, 0 in 2024-04-23T14:38:17.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:16 smithi081 ceph-mon[25540]: mgrmap e10: smithi081.ldghvq(active, starting, since 0.00570048s) 2024-04-23T14:38:17.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:16 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi081"}]: dispatch 2024-04-23T14:38:17.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:16 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mgr metadata", "who": "smithi081.ldghvq", "id": "smithi081.ldghvq"}]: dispatch 2024-04-23T14:38:17.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:16 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-23T14:38:17.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:16 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-23T14:38:17.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:16 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-23T14:38:17.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:16 smithi081 ceph-mon[25540]: Manager daemon smithi081.ldghvq is now available 2024-04-23T14:38:17.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:16 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:38:17.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:16 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:38:18.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:17 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi081.ldghvq/mirror_snapshot_schedule"}]: dispatch 2024-04-23T14:38:18.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:17 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi081.ldghvq/trash_purge_schedule"}]: dispatch 2024-04-23T14:38:18.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:17 smithi081 ceph-mon[25540]: [23/Apr/2024:14:38:17] ENGINE Bus STARTING 2024-04-23T14:38:18.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:17 smithi081 ceph-mon[25540]: [23/Apr/2024:14:38:17] ENGINE Serving on https://172.21.15.81:7150 2024-04-23T14:38:18.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:17 smithi081 ceph-mon[25540]: [23/Apr/2024:14:38:17] ENGINE Bus STARTED 2024-04-23T14:38:18.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:17 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' 2024-04-23T14:38:18.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:17 smithi081 ceph-mon[25540]: mgrmap e11: smithi081.ldghvq(active, since 1.01744s) 2024-04-23T14:38:19.178 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:18 smithi081 ceph-mon[25540]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-23T14:38:19.178 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:18 smithi081 ceph-mon[25540]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-23T14:38:19.186 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-04-23T14:38:19.187 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-04-23T14:38:19.187 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-23T14:38:19.188 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-04-23T14:38:19.188 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.244+0000 7fd792600700 1 Processor -- start 2024-04-23T14:38:19.188 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.245+0000 7fd792600700 1 -- start start 2024-04-23T14:38:19.188 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.245+0000 7fd792600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd78c102970 0x7fd78c102d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:19.188 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.245+0000 7fd792600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c1032c0 con 0x7fd78c102970 2024-04-23T14:38:19.190 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.246+0000 7fd78b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd78c102970 0x7fd78c102d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:19.190 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.246+0000 7fd78b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd78c102970 0x7fd78c102d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50442/0 (socket says 172.21.15.81:50442) 2024-04-23T14:38:19.190 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.246+0000 7fd78b400700 1 -- 172.21.15.81:0/1921266830 learned_addr learned my addr 172.21.15.81:0/1921266830 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:38:19.191 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.246+0000 7fd78b400700 1 -- 172.21.15.81:0/1921266830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd78c103400 con 0x7fd78c102970 2024-04-23T14:38:19.191 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.246+0000 7fd78b400700 1 --2- 172.21.15.81:0/1921266830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd78c102970 0x7fd78c102d80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd77c0098e0 tx=0x7fd77c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e05a62cb1ab227f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:19.191 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.247+0000 7fd78a000700 1 -- 172.21.15.81:0/1921266830 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd77c00b8f0 con 0x7fd78c102970 2024-04-23T14:38:19.191 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.247+0000 7fd78a000700 1 -- 172.21.15.81:0/1921266830 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd77c011420 con 0x7fd78c102970 2024-04-23T14:38:19.191 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.247+0000 7fd78a000700 1 -- 172.21.15.81:0/1921266830 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd77c010540 con 0x7fd78c102970 2024-04-23T14:38:19.191 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.248+0000 7fd792600700 1 -- 172.21.15.81:0/1921266830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd78c102970 msgr2=0x7fd78c102d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:19.191 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.248+0000 7fd792600700 1 --2- 172.21.15.81:0/1921266830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd78c102970 0x7fd78c102d80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd77c0098e0 tx=0x7fd77c009250 comp rx=0 tx=0).stop 2024-04-23T14:38:19.191 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.248+0000 7fd792600700 1 -- 172.21.15.81:0/1921266830 shutdown_connections 2024-04-23T14:38:19.191 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.248+0000 7fd792600700 1 --2- 172.21.15.81:0/1921266830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd78c102970 0x7fd78c102d80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:19.191 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.248+0000 7fd792600700 1 -- 172.21.15.81:0/1921266830 >> 172.21.15.81:0/1921266830 conn(0x7fd78c0fe0b0 msgr2=0x7fd78c100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:19.191 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.248+0000 7fd792600700 1 -- 172.21.15.81:0/1921266830 shutdown_connections 2024-04-23T14:38:19.191 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.248+0000 7fd792600700 1 -- 172.21.15.81:0/1921266830 wait complete. 2024-04-23T14:38:19.191 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.249+0000 7fd792600700 1 Processor -- start 2024-04-23T14:38:19.191 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.249+0000 7fd792600700 1 -- start start 2024-04-23T14:38:19.191 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.249+0000 7fd792600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd78c102970 0x7fd78c113960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:19.192 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.249+0000 7fd792600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c113ea0 con 0x7fd78c102970 2024-04-23T14:38:19.192 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.250+0000 7fd78b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd78c102970 0x7fd78c113960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:19.192 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.250+0000 7fd78b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd78c102970 0x7fd78c113960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50458/0 (socket says 172.21.15.81:50458) 2024-04-23T14:38:19.192 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.250+0000 7fd78b400700 1 -- 172.21.15.81:0/1751364997 learned_addr learned my addr 172.21.15.81:0/1751364997 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:38:19.192 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.250+0000 7fd78b400700 1 -- 172.21.15.81:0/1751364997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd77c0094f0 con 0x7fd78c102970 2024-04-23T14:38:19.196 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.250+0000 7fd78b400700 1 --2- 172.21.15.81:0/1751364997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd78c102970 0x7fd78c113960 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd77c006d40 tx=0x7fd77c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:19.196 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.251+0000 7fd783400700 1 -- 172.21.15.81:0/1751364997 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd77c00beb0 con 0x7fd78c102970 2024-04-23T14:38:19.196 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.251+0000 7fd792600700 1 -- 172.21.15.81:0/1751364997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd78c1140a0 con 0x7fd78c102970 2024-04-23T14:38:19.196 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.251+0000 7fd783400700 1 -- 172.21.15.81:0/1751364997 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd77c010c80 con 0x7fd78c102970 2024-04-23T14:38:19.197 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.251+0000 7fd783400700 1 -- 172.21.15.81:0/1751364997 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd77c024d40 con 0x7fd78c102970 2024-04-23T14:38:19.197 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.251+0000 7fd792600700 1 -- 172.21.15.81:0/1751364997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd78c114c10 con 0x7fd78c102970 2024-04-23T14:38:19.197 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.252+0000 7fd783400700 1 -- 172.21.15.81:0/1751364997 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) v1 ==== 43389+0+0 (secure 0 0 0) 0x7fd77c024650 con 0x7fd78c102970 2024-04-23T14:38:19.197 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.253+0000 7fd783400700 1 --2- 172.21.15.81:0/1751364997 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fd7700368c0 0x7fd770038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:19.197 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.253+0000 7fd783400700 1 -- 172.21.15.81:0/1751364997 --> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd770039480 con 0x7fd7700368c0 2024-04-23T14:38:19.197 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.253+0000 7fd783400700 1 -- 172.21.15.81:0/1751364997 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fd77c04a260 con 0x7fd78c102970 2024-04-23T14:38:19.197 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.253+0000 7fd78aa00700 1 -- 172.21.15.81:0/1751364997 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fd7700368c0 msgr2=0x7fd770038d70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2072638798 2024-04-23T14:38:19.197 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.253+0000 7fd78aa00700 1 --2- 172.21.15.81:0/1751364997 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fd7700368c0 0x7fd770038d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T14:38:19.197 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.454+0000 7fd78aa00700 1 -- 172.21.15.81:0/1751364997 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fd7700368c0 msgr2=0x7fd770038d70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2072638798 2024-04-23T14:38:19.197 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.454+0000 7fd78aa00700 1 --2- 172.21.15.81:0/1751364997 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fd7700368c0 0x7fd770038d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-23T14:38:19.197 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.855+0000 7fd78aa00700 1 -- 172.21.15.81:0/1751364997 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fd7700368c0 msgr2=0x7fd770038d70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2072638798 2024-04-23T14:38:19.197 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:11.855+0000 7fd78aa00700 1 --2- 172.21.15.81:0/1751364997 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fd7700368c0 0x7fd770038d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-23T14:38:19.197 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.656+0000 7fd78aa00700 1 -- 172.21.15.81:0/1751364997 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fd7700368c0 msgr2=0x7fd770038d70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2072638798 2024-04-23T14:38:19.197 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:12.656+0000 7fd78aa00700 1 --2- 172.21.15.81:0/1751364997 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fd7700368c0 0x7fd770038d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-23T14:38:19.197 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.258+0000 7fd78aa00700 1 -- 172.21.15.81:0/1751364997 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fd7700368c0 msgr2=0x7fd770038d70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2072638798 2024-04-23T14:38:19.197 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:14.258+0000 7fd78aa00700 1 --2- 172.21.15.81:0/1751364997 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fd7700368c0 0x7fd770038d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-23T14:38:19.198 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.829+0000 7fd783400700 1 -- 172.21.15.81:0/1751364997 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mgrmap(e 10) v1 ==== 43156+0+0 (secure 0 0 0) 0x7fd77c00fda0 con 0x7fd78c102970 2024-04-23T14:38:19.198 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.829+0000 7fd783400700 1 -- 172.21.15.81:0/1751364997 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fd7700368c0 msgr2=0x7fd770038d70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-23T14:38:19.198 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:16.829+0000 7fd783400700 1 --2- 172.21.15.81:0/1751364997 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fd7700368c0 0x7fd770038d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:19.198 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:17.835+0000 7fd783400700 1 -- 172.21.15.81:0/1751364997 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 11) v1 ==== 43283+0+0 (secure 0 0 0) 0x7fd77c02ecf0 con 0x7fd78c102970 2024-04-23T14:38:19.198 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:17.835+0000 7fd783400700 1 --2- 172.21.15.81:0/1751364997 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fd77003a370 0x7fd77003c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:19.198 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:17.836+0000 7fd783400700 1 -- 172.21.15.81:0/1751364997 --> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd770039480 con 0x7fd77003a370 2024-04-23T14:38:19.198 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:17.837+0000 7fd78aa00700 1 --2- 172.21.15.81:0/1751364997 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fd77003a370 0x7fd77003c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:19.198 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:17.839+0000 7fd78aa00700 1 --2- 172.21.15.81:0/1751364997 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fd77003a370 0x7fd77003c750 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd7780039d0 tx=0x7fd778009350 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:19.198 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:17.842+0000 7fd783400700 1 -- 172.21.15.81:0/1751364997 <== mgr.14162 v2:172.21.15.81:6800/3624015234 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7fd770039480 con 0x7fd77003a370 2024-04-23T14:38:19.198 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:17.850+0000 7fd792600700 1 -- 172.21.15.81:0/1751364997 --> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fd78c114530 con 0x7fd77003a370 2024-04-23T14:38:19.198 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:17.850+0000 7fd783400700 1 -- 172.21.15.81:0/1751364997 <== mgr.14162 v2:172.21.15.81:6800/3624015234 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7fd78c114530 con 0x7fd77003a370 2024-04-23T14:38:19.198 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:17.851+0000 7fd792600700 1 -- 172.21.15.81:0/1751364997 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fd77003a370 msgr2=0x7fd77003c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:19.198 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:17.851+0000 7fd792600700 1 --2- 172.21.15.81:0/1751364997 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fd77003a370 0x7fd77003c750 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd7780039d0 tx=0x7fd778009350 comp rx=0 tx=0).stop 2024-04-23T14:38:19.198 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:17.851+0000 7fd792600700 1 -- 172.21.15.81:0/1751364997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd78c102970 msgr2=0x7fd78c113960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:19.199 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:17.851+0000 7fd792600700 1 --2- 172.21.15.81:0/1751364997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd78c102970 0x7fd78c113960 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd77c006d40 tx=0x7fd77c009250 comp rx=0 tx=0).stop 2024-04-23T14:38:19.199 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:17.851+0000 7fd792600700 1 -- 172.21.15.81:0/1751364997 shutdown_connections 2024-04-23T14:38:19.199 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:17.851+0000 7fd792600700 1 --2- 172.21.15.81:0/1751364997 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fd77003a370 0x7fd77003c750 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:19.199 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:17.851+0000 7fd792600700 1 --2- 172.21.15.81:0/1751364997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd78c102970 0x7fd78c113960 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:19.199 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:17.851+0000 7fd792600700 1 --2- 172.21.15.81:0/1751364997 >> [v2:172.21.15.81:6800/2072638798,v1:172.21.15.81:6801/2072638798] conn(0x7fd7700368c0 0x7fd770038d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:19.199 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:17.851+0000 7fd792600700 1 -- 172.21.15.81:0/1751364997 >> 172.21.15.81:0/1751364997 conn(0x7fd78c0fe0b0 msgr2=0x7fd78c0fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:19.199 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:17.851+0000 7fd792600700 1 -- 172.21.15.81:0/1751364997 shutdown_connections 2024-04-23T14:38:19.199 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:17.852+0000 7fd792600700 1 -- 172.21.15.81:0/1751364997 wait complete. 2024-04-23T14:38:19.199 INFO:teuthology.orchestra.run.smithi081.stdout:mgr epoch 9 is available 2024-04-23T14:38:19.199 INFO:teuthology.orchestra.run.smithi081.stdout:Generating a dashboard self-signed certificate... 2024-04-23T14:38:20.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:19 smithi081 ceph-mon[25540]: mgrmap e12: smithi081.ldghvq(active, since 2s) 2024-04-23T14:38:20.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:19 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' 2024-04-23T14:38:20.856 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-04-23T14:38:20.856 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:19.773+0000 7fb77b200700 1 Processor -- start 2024-04-23T14:38:20.856 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:19.773+0000 7fb77b200700 1 -- start start 2024-04-23T14:38:20.856 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:19.773+0000 7fb77b200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb77c100b80 0x7fb77c100f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:20.856 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:19.773+0000 7fb77b200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c103a20 con 0x7fb77c100b80 2024-04-23T14:38:20.856 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:19.774+0000 7fb779e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb77c100b80 0x7fb77c100f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:20.857 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:19.774+0000 7fb779e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb77c100b80 0x7fb77c100f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40952/0 (socket says 172.21.15.81:40952) 2024-04-23T14:38:20.857 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:19.774+0000 7fb779e00700 1 -- 172.21.15.81:0/2970074788 learned_addr learned my addr 172.21.15.81:0/2970074788 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:38:20.857 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:19.774+0000 7fb779e00700 1 -- 172.21.15.81:0/2970074788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb77c1014d0 con 0x7fb77c100b80 2024-04-23T14:38:20.857 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:19.774+0000 7fb779e00700 1 --2- 172.21.15.81:0/2970074788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb77c100b80 0x7fb77c100f90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb76c0098e0 tx=0x7fb76c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=748b36f9ed61920e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:20.857 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:19.775+0000 7fb778a00700 1 -- 172.21.15.81:0/2970074788 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb76c00b860 con 0x7fb77c100b80 2024-04-23T14:38:20.857 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:19.775+0000 7fb778a00700 1 -- 172.21.15.81:0/2970074788 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb76c00be90 con 0x7fb77c100b80 2024-04-23T14:38:20.857 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:19.775+0000 7fb778a00700 1 -- 172.21.15.81:0/2970074788 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb76c0103c0 con 0x7fb77c100b80 2024-04-23T14:38:20.857 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:19.775+0000 7fb77b200700 1 -- 172.21.15.81:0/2970074788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb77c100b80 msgr2=0x7fb77c100f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:20.857 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:19.775+0000 7fb77b200700 1 --2- 172.21.15.81:0/2970074788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb77c100b80 0x7fb77c100f90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb76c0098e0 tx=0x7fb76c009250 comp rx=0 tx=0).stop 2024-04-23T14:38:20.857 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:19.776+0000 7fb77b200700 1 -- 172.21.15.81:0/2970074788 shutdown_connections 2024-04-23T14:38:20.857 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:19.776+0000 7fb77b200700 1 --2- 172.21.15.81:0/2970074788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb77c100b80 0x7fb77c100f90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:20.857 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:19.776+0000 7fb77b200700 1 -- 172.21.15.81:0/2970074788 >> 172.21.15.81:0/2970074788 conn(0x7fb77c0fc580 msgr2=0x7fb77c0fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:20.858 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:19.776+0000 7fb77b200700 1 -- 172.21.15.81:0/2970074788 shutdown_connections 2024-04-23T14:38:20.858 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:19.776+0000 7fb77b200700 1 -- 172.21.15.81:0/2970074788 wait complete. 2024-04-23T14:38:20.858 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:19.777+0000 7fb77b200700 1 Processor -- start 2024-04-23T14:38:20.858 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:19.777+0000 7fb77b200700 1 -- start start 2024-04-23T14:38:20.858 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:19.778+0000 7fb77b200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb77c100b80 0x7fb77c113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:20.858 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:19.778+0000 7fb77b200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c113cb0 con 0x7fb77c100b80 2024-04-23T14:38:20.858 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:19.778+0000 7fb779e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb77c100b80 0x7fb77c113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:20.858 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:19.778+0000 7fb779e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb77c100b80 0x7fb77c113770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40966/0 (socket says 172.21.15.81:40966) 2024-04-23T14:38:20.858 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:19.778+0000 7fb779e00700 1 -- 172.21.15.81:0/3380207528 learned_addr learned my addr 172.21.15.81:0/3380207528 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:38:20.858 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:19.778+0000 7fb779e00700 1 -- 172.21.15.81:0/3380207528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb76c0094f0 con 0x7fb77c100b80 2024-04-23T14:38:20.858 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:19.779+0000 7fb779e00700 1 --2- 172.21.15.81:0/3380207528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb77c100b80 0x7fb77c113770 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb76c006d40 tx=0x7fb76c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:20.858 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:19.779+0000 7fb772000700 1 -- 172.21.15.81:0/3380207528 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb76c010840 con 0x7fb77c100b80 2024-04-23T14:38:20.858 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:19.779+0000 7fb772000700 1 -- 172.21.15.81:0/3380207528 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb76c010e70 con 0x7fb77c100b80 2024-04-23T14:38:20.858 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:19.779+0000 7fb77b200700 1 -- 172.21.15.81:0/3380207528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb77c113eb0 con 0x7fb77c100b80 2024-04-23T14:38:20.859 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:19.779+0000 7fb772000700 1 -- 172.21.15.81:0/3380207528 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb76c024ea0 con 0x7fb77c100b80 2024-04-23T14:38:20.859 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:19.779+0000 7fb77b200700 1 -- 172.21.15.81:0/3380207528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb77c114a20 con 0x7fb77c100b80 2024-04-23T14:38:20.859 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:19.780+0000 7fb772000700 1 -- 172.21.15.81:0/3380207528 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 12) v1 ==== 43389+0+0 (secure 0 0 0) 0x7fb76c024780 con 0x7fb77c100b80 2024-04-23T14:38:20.859 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:19.780+0000 7fb77b200700 1 -- 172.21.15.81:0/3380207528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb77c05f5f0 con 0x7fb77c100b80 2024-04-23T14:38:20.859 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:19.781+0000 7fb772000700 1 --2- 172.21.15.81:0/3380207528 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fb7600367e0 0x7fb760038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:20.859 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:19.781+0000 7fb772000700 1 -- 172.21.15.81:0/3380207528 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fb76c04a870 con 0x7fb77c100b80 2024-04-23T14:38:20.859 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:19.781+0000 7fb779400700 1 --2- 172.21.15.81:0/3380207528 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fb7600367e0 0x7fb760038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:20.859 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:19.782+0000 7fb779400700 1 --2- 172.21.15.81:0/3380207528 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fb7600367e0 0x7fb760038c90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb768009990 tx=0x7fb768006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:20.859 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:19.787+0000 7fb772000700 1 -- 172.21.15.81:0/3380207528 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fb76c02c930 con 0x7fb77c100b80 2024-04-23T14:38:20.859 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:20.006+0000 7fb77b200700 1 -- 172.21.15.81:0/3380207528 --> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fb77c0fd920 con 0x7fb7600367e0 2024-04-23T14:38:20.859 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:20.124+0000 7fb772000700 1 -- 172.21.15.81:0/3380207528 <== mgr.14162 v2:172.21.15.81:6800/3624015234 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fb77c0fd920 con 0x7fb7600367e0 2024-04-23T14:38:20.859 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:20.127+0000 7fb77b200700 1 -- 172.21.15.81:0/3380207528 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fb7600367e0 msgr2=0x7fb760038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:20.859 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:20.127+0000 7fb77b200700 1 --2- 172.21.15.81:0/3380207528 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fb7600367e0 0x7fb760038c90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb768009990 tx=0x7fb768006e40 comp rx=0 tx=0).stop 2024-04-23T14:38:20.859 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:20.127+0000 7fb77b200700 1 -- 172.21.15.81:0/3380207528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb77c100b80 msgr2=0x7fb77c113770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:20.860 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:20.127+0000 7fb77b200700 1 --2- 172.21.15.81:0/3380207528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb77c100b80 0x7fb77c113770 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb76c006d40 tx=0x7fb76c009250 comp rx=0 tx=0).stop 2024-04-23T14:38:20.860 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:20.128+0000 7fb77b200700 1 -- 172.21.15.81:0/3380207528 shutdown_connections 2024-04-23T14:38:20.860 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:20.128+0000 7fb77b200700 1 --2- 172.21.15.81:0/3380207528 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fb7600367e0 0x7fb760038c90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:20.860 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:20.128+0000 7fb77b200700 1 --2- 172.21.15.81:0/3380207528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb77c100b80 0x7fb77c113770 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:20.860 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:20.128+0000 7fb77b200700 1 -- 172.21.15.81:0/3380207528 >> 172.21.15.81:0/3380207528 conn(0x7fb77c0fc580 msgr2=0x7fb77c0fd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:20.860 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:20.128+0000 7fb77b200700 1 -- 172.21.15.81:0/3380207528 shutdown_connections 2024-04-23T14:38:20.860 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:20.128+0000 7fb77b200700 1 -- 172.21.15.81:0/3380207528 wait complete. 2024-04-23T14:38:20.860 INFO:teuthology.orchestra.run.smithi081.stdout:Creating initial admin user... 2024-04-23T14:38:21.387 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:21 smithi081 ceph-mon[25540]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:38:21.387 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:21 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' 2024-04-23T14:38:21.387 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:21 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' 2024-04-23T14:38:21.387 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:21 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' 2024-04-23T14:38:22.795 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$MLfjU8v3Vcbsq3JuDUsyQOJrI/4TTuivCCrhERtRBpxbQBfE.MrrW", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1713883101, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-04-23T14:38:22.796 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.467+0000 7f4d56a00700 1 Processor -- start 2024-04-23T14:38:22.796 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.467+0000 7f4d56a00700 1 -- start start 2024-04-23T14:38:22.796 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.467+0000 7f4d56a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d50101650 0x7f4d50101a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:22.796 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.467+0000 7f4d56a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d50101fa0 con 0x7f4d50101650 2024-04-23T14:38:22.796 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.468+0000 7f4d55600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d50101650 0x7f4d50101a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:22.796 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.468+0000 7f4d55600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d50101650 0x7f4d50101a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40982/0 (socket says 172.21.15.81:40982) 2024-04-23T14:38:22.796 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.468+0000 7f4d55600700 1 -- 172.21.15.81:0/2677064092 learned_addr learned my addr 172.21.15.81:0/2677064092 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:38:22.796 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.468+0000 7f4d55600700 1 -- 172.21.15.81:0/2677064092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d501020e0 con 0x7f4d50101650 2024-04-23T14:38:22.796 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.468+0000 7f4d55600700 1 --2- 172.21.15.81:0/2677064092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d50101650 0x7f4d50101a60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4d440098e0 tx=0x7f4d44009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28059a506f96791f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:22.796 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.469+0000 7f4d4fe00700 1 -- 172.21.15.81:0/2677064092 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4d4400b860 con 0x7f4d50101650 2024-04-23T14:38:22.796 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.469+0000 7f4d4fe00700 1 -- 172.21.15.81:0/2677064092 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4d4400be90 con 0x7f4d50101650 2024-04-23T14:38:22.796 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.469+0000 7f4d4fe00700 1 -- 172.21.15.81:0/2677064092 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4d440103c0 con 0x7f4d50101650 2024-04-23T14:38:22.796 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.470+0000 7f4d56a00700 1 -- 172.21.15.81:0/2677064092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d50101650 msgr2=0x7f4d50101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:22.796 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.470+0000 7f4d56a00700 1 --2- 172.21.15.81:0/2677064092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d50101650 0x7f4d50101a60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4d440098e0 tx=0x7f4d44009250 comp rx=0 tx=0).stop 2024-04-23T14:38:22.797 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.470+0000 7f4d56a00700 1 -- 172.21.15.81:0/2677064092 shutdown_connections 2024-04-23T14:38:22.797 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.470+0000 7f4d56a00700 1 --2- 172.21.15.81:0/2677064092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d50101650 0x7f4d50101a60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:22.797 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.470+0000 7f4d56a00700 1 -- 172.21.15.81:0/2677064092 >> 172.21.15.81:0/2677064092 conn(0x7f4d500fcdd0 msgr2=0x7f4d500ff1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:22.797 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.470+0000 7f4d56a00700 1 -- 172.21.15.81:0/2677064092 shutdown_connections 2024-04-23T14:38:22.797 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.470+0000 7f4d56a00700 1 -- 172.21.15.81:0/2677064092 wait complete. 2024-04-23T14:38:22.797 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.471+0000 7f4d56a00700 1 Processor -- start 2024-04-23T14:38:22.797 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.472+0000 7f4d56a00700 1 -- start start 2024-04-23T14:38:22.797 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.472+0000 7f4d56a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d50101650 0x7f4d5010f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:22.797 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.472+0000 7f4d56a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5010f860 con 0x7f4d50101650 2024-04-23T14:38:22.797 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.472+0000 7f4d55600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d50101650 0x7f4d5010f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:22.797 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.472+0000 7f4d55600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d50101650 0x7f4d5010f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40990/0 (socket says 172.21.15.81:40990) 2024-04-23T14:38:22.797 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.472+0000 7f4d55600700 1 -- 172.21.15.81:0/2563965692 learned_addr learned my addr 172.21.15.81:0/2563965692 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:38:22.797 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.473+0000 7f4d55600700 1 -- 172.21.15.81:0/2563965692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d440094f0 con 0x7f4d50101650 2024-04-23T14:38:22.797 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.473+0000 7f4d55600700 1 --2- 172.21.15.81:0/2563965692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d50101650 0x7f4d5010f320 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4d440090b0 tx=0x7f4d44009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:22.797 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.473+0000 7f4d4d600700 1 -- 172.21.15.81:0/2563965692 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4d44010840 con 0x7f4d50101650 2024-04-23T14:38:22.798 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.473+0000 7f4d4d600700 1 -- 172.21.15.81:0/2563965692 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4d44010e70 con 0x7f4d50101650 2024-04-23T14:38:22.798 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.473+0000 7f4d56a00700 1 -- 172.21.15.81:0/2563965692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d5010fa60 con 0x7f4d50101650 2024-04-23T14:38:22.798 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.473+0000 7f4d4d600700 1 -- 172.21.15.81:0/2563965692 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4d44024e40 con 0x7f4d50101650 2024-04-23T14:38:22.798 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.474+0000 7f4d56a00700 1 -- 172.21.15.81:0/2563965692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d501105d0 con 0x7f4d50101650 2024-04-23T14:38:22.798 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.474+0000 7f4d4d600700 1 -- 172.21.15.81:0/2563965692 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 12) v1 ==== 43389+0+0 (secure 0 0 0) 0x7f4d4401a4c0 con 0x7f4d50101650 2024-04-23T14:38:22.798 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.475+0000 7f4d4d600700 1 --2- 172.21.15.81:0/2563965692 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f4d38038a10 0x7f4d3803aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:22.798 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.475+0000 7f4d4d600700 1 -- 172.21.15.81:0/2563965692 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f4d4404a980 con 0x7f4d50101650 2024-04-23T14:38:22.798 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.475+0000 7f4d56a00700 1 -- 172.21.15.81:0/2563965692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d5005f5f0 con 0x7f4d50101650 2024-04-23T14:38:22.798 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.476+0000 7f4d54c00700 1 --2- 172.21.15.81:0/2563965692 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f4d38038a10 0x7f4d3803aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:22.798 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.476+0000 7f4d54c00700 1 --2- 172.21.15.81:0/2563965692 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f4d38038a10 0x7f4d3803aec0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c009990 tx=0x7f4d3c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:22.798 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.483+0000 7f4d4d600700 1 -- 172.21.15.81:0/2563965692 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f4d44018940 con 0x7f4d50101650 2024-04-23T14:38:22.798 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.721+0000 7f4d56a00700 1 -- 172.21.15.81:0/2563965692 --> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f4d5005f410 con 0x7f4d38038a10 2024-04-23T14:38:22.798 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.959+0000 7f4d4d600700 1 -- 172.21.15.81:0/2563965692 <== mgr.14162 v2:172.21.15.81:6800/3624015234 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f4d5005f410 con 0x7f4d38038a10 2024-04-23T14:38:22.798 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.962+0000 7f4d56a00700 1 -- 172.21.15.81:0/2563965692 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f4d38038a10 msgr2=0x7f4d3803aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:22.799 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.962+0000 7f4d56a00700 1 --2- 172.21.15.81:0/2563965692 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f4d38038a10 0x7f4d3803aec0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c009990 tx=0x7f4d3c006e40 comp rx=0 tx=0).stop 2024-04-23T14:38:22.799 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.962+0000 7f4d56a00700 1 -- 172.21.15.81:0/2563965692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d50101650 msgr2=0x7f4d5010f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:22.799 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.962+0000 7f4d56a00700 1 --2- 172.21.15.81:0/2563965692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d50101650 0x7f4d5010f320 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4d440090b0 tx=0x7f4d44009250 comp rx=0 tx=0).stop 2024-04-23T14:38:22.799 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.962+0000 7f4d56a00700 1 -- 172.21.15.81:0/2563965692 shutdown_connections 2024-04-23T14:38:22.799 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.962+0000 7f4d56a00700 1 --2- 172.21.15.81:0/2563965692 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f4d38038a10 0x7f4d3803aec0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:22.799 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.962+0000 7f4d56a00700 1 --2- 172.21.15.81:0/2563965692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d50101650 0x7f4d5010f320 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:22.799 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.962+0000 7f4d56a00700 1 -- 172.21.15.81:0/2563965692 >> 172.21.15.81:0/2563965692 conn(0x7f4d500fcdd0 msgr2=0x7f4d50105af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:22.799 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.963+0000 7f4d56a00700 1 -- 172.21.15.81:0/2563965692 shutdown_connections 2024-04-23T14:38:22.799 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:21.963+0000 7f4d56a00700 1 -- 172.21.15.81:0/2563965692 wait complete. 2024-04-23T14:38:22.799 INFO:teuthology.orchestra.run.smithi081.stdout:Fetching dashboard port number... 2024-04-23T14:38:23.057 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:22 smithi081 ceph-mon[25540]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:38:23.058 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:22 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' 2024-04-23T14:38:24.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:23 smithi081 ceph-mon[25540]: mgrmap e13: smithi081.ldghvq(active, since 6s) 2024-04-23T14:38:24.726 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 8443 2024-04-23T14:38:24.727 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:23.836+0000 7f5972800700 1 Processor -- start 2024-04-23T14:38:24.727 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:23.836+0000 7f5972800700 1 -- start start 2024-04-23T14:38:24.727 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:23.837+0000 7f5972800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f596c100c20 0x7f596c101030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:24.728 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:23.837+0000 7f5972800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596c101570 con 0x7f596c100c20 2024-04-23T14:38:24.728 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:23.837+0000 7f596b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f596c100c20 0x7f596c101030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:24.728 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:23.837+0000 7f596b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f596c100c20 0x7f596c101030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39542/0 (socket says 172.21.15.81:39542) 2024-04-23T14:38:24.729 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:23.837+0000 7f596b400700 1 -- 172.21.15.81:0/3068073867 learned_addr learned my addr 172.21.15.81:0/3068073867 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:38:24.729 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:23.838+0000 7f596b400700 1 -- 172.21.15.81:0/3068073867 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f596c1016b0 con 0x7f596c100c20 2024-04-23T14:38:24.729 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:23.838+0000 7f596b400700 1 --2- 172.21.15.81:0/3068073867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f596c100c20 0x7f596c101030 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f595c0098e0 tx=0x7f595c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a002f0efc2399d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:24.729 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:23.838+0000 7f596a000700 1 -- 172.21.15.81:0/3068073867 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f595c00b860 con 0x7f596c100c20 2024-04-23T14:38:24.729 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:23.839+0000 7f596a000700 1 -- 172.21.15.81:0/3068073867 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f595c00be90 con 0x7f596c100c20 2024-04-23T14:38:24.729 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:23.839+0000 7f596a000700 1 -- 172.21.15.81:0/3068073867 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f595c0103c0 con 0x7f596c100c20 2024-04-23T14:38:24.729 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:23.839+0000 7f5972800700 1 -- 172.21.15.81:0/3068073867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f596c100c20 msgr2=0x7f596c101030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:24.729 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:23.839+0000 7f5972800700 1 --2- 172.21.15.81:0/3068073867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f596c100c20 0x7f596c101030 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f595c0098e0 tx=0x7f595c009250 comp rx=0 tx=0).stop 2024-04-23T14:38:24.731 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:23.839+0000 7f5972800700 1 -- 172.21.15.81:0/3068073867 shutdown_connections 2024-04-23T14:38:24.731 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:23.839+0000 7f5972800700 1 --2- 172.21.15.81:0/3068073867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f596c100c20 0x7f596c101030 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:24.731 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:23.839+0000 7f5972800700 1 -- 172.21.15.81:0/3068073867 >> 172.21.15.81:0/3068073867 conn(0x7f596c0fc700 msgr2=0x7f596c0feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:24.732 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:23.840+0000 7f5972800700 1 -- 172.21.15.81:0/3068073867 shutdown_connections 2024-04-23T14:38:24.732 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:23.840+0000 7f5972800700 1 -- 172.21.15.81:0/3068073867 wait complete. 2024-04-23T14:38:24.732 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:23.841+0000 7f5972800700 1 Processor -- start 2024-04-23T14:38:24.732 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:23.841+0000 7f5972800700 1 -- start start 2024-04-23T14:38:24.732 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:23.841+0000 7f5972800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f596c100c20 0x7f596c1116d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:24.732 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:23.841+0000 7f5972800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596c111c10 con 0x7f596c100c20 2024-04-23T14:38:24.732 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:23.841+0000 7f596b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f596c100c20 0x7f596c1116d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:24.732 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:23.842+0000 7f596b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f596c100c20 0x7f596c1116d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39548/0 (socket says 172.21.15.81:39548) 2024-04-23T14:38:24.732 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:23.842+0000 7f596b400700 1 -- 172.21.15.81:0/1129319898 learned_addr learned my addr 172.21.15.81:0/1129319898 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:38:24.732 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:23.842+0000 7f596b400700 1 -- 172.21.15.81:0/1129319898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f595c0094f0 con 0x7f596c100c20 2024-04-23T14:38:24.732 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:23.842+0000 7f596b400700 1 --2- 172.21.15.81:0/1129319898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f596c100c20 0x7f596c1116d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f595c0090b0 tx=0x7f595c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:24.732 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:23.842+0000 7f5963400700 1 -- 172.21.15.81:0/1129319898 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f595c010840 con 0x7f596c100c20 2024-04-23T14:38:24.732 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:23.842+0000 7f5963400700 1 -- 172.21.15.81:0/1129319898 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f595c010e70 con 0x7f596c100c20 2024-04-23T14:38:24.732 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:23.842+0000 7f5963400700 1 -- 172.21.15.81:0/1129319898 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f595c024e40 con 0x7f596c100c20 2024-04-23T14:38:24.732 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:23.843+0000 7f5972800700 1 -- 172.21.15.81:0/1129319898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f596c111e10 con 0x7f596c100c20 2024-04-23T14:38:24.735 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:23.843+0000 7f5972800700 1 -- 172.21.15.81:0/1129319898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f596c112980 con 0x7f596c100c20 2024-04-23T14:38:24.735 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:23.844+0000 7f5963400700 1 -- 172.21.15.81:0/1129319898 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f595c024430 con 0x7f596c100c20 2024-04-23T14:38:24.735 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:23.844+0000 7f5972800700 1 -- 172.21.15.81:0/1129319898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f596c05f5f0 con 0x7f596c100c20 2024-04-23T14:38:24.735 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:23.844+0000 7f5963400700 1 --2- 172.21.15.81:0/1129319898 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f5950036880 0x7f5950038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:24.735 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:23.844+0000 7f5963400700 1 -- 172.21.15.81:0/1129319898 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f595c04a950 con 0x7f596c100c20 2024-04-23T14:38:24.735 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:23.844+0000 7f596aa00700 1 --2- 172.21.15.81:0/1129319898 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f5950036880 0x7f5950038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:24.735 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:23.845+0000 7f596aa00700 1 --2- 172.21.15.81:0/1129319898 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f5950036880 0x7f5950038d30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5958009990 tx=0x7f5958006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:24.735 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:23.850+0000 7f5963400700 1 -- 172.21.15.81:0/1129319898 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f595c02c930 con 0x7f596c100c20 2024-04-23T14:38:24.735 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.064+0000 7f5972800700 1 -- 172.21.15.81:0/1129319898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f596c04bed0 con 0x7f596c100c20 2024-04-23T14:38:24.735 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.065+0000 7f5963400700 1 -- 172.21.15.81:0/1129319898 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f595c02c340 con 0x7f596c100c20 2024-04-23T14:38:24.735 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.067+0000 7f5972800700 1 -- 172.21.15.81:0/1129319898 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f5950036880 msgr2=0x7f5950038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:24.736 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.067+0000 7f5972800700 1 --2- 172.21.15.81:0/1129319898 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f5950036880 0x7f5950038d30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5958009990 tx=0x7f5958006e40 comp rx=0 tx=0).stop 2024-04-23T14:38:24.736 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.067+0000 7f5972800700 1 -- 172.21.15.81:0/1129319898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f596c100c20 msgr2=0x7f596c1116d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:24.736 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.067+0000 7f5972800700 1 --2- 172.21.15.81:0/1129319898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f596c100c20 0x7f596c1116d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f595c0090b0 tx=0x7f595c009250 comp rx=0 tx=0).stop 2024-04-23T14:38:24.736 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.067+0000 7f5972800700 1 -- 172.21.15.81:0/1129319898 shutdown_connections 2024-04-23T14:38:24.736 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.068+0000 7f5972800700 1 --2- 172.21.15.81:0/1129319898 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f5950036880 0x7f5950038d30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:24.736 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.068+0000 7f5972800700 1 --2- 172.21.15.81:0/1129319898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f596c100c20 0x7f596c1116d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:24.736 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.068+0000 7f5972800700 1 -- 172.21.15.81:0/1129319898 >> 172.21.15.81:0/1129319898 conn(0x7f596c0fc700 msgr2=0x7f596c0fd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:24.736 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.068+0000 7f5972800700 1 -- 172.21.15.81:0/1129319898 shutdown_connections 2024-04-23T14:38:24.736 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:24.068+0000 7f5972800700 1 -- 172.21.15.81:0/1129319898 wait complete. 2024-04-23T14:38:24.772 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-23T14:38:24.772 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout disabled 2024-04-23T14:38:24.796 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-23T14:38:24.797 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-04-23T14:38:24.797 INFO:teuthology.orchestra.run.smithi081.stdout:firewalld.service is not enabled 2024-04-23T14:38:24.797 INFO:teuthology.orchestra.run.smithi081.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-04-23T14:38:24.804 INFO:teuthology.orchestra.run.smithi081.stdout:Ceph Dashboard is now available at: 2024-04-23T14:38:24.805 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:38:24.805 INFO:teuthology.orchestra.run.smithi081.stdout: URL: https://smithi081.front.sepia.ceph.com:8443/ 2024-04-23T14:38:24.805 INFO:teuthology.orchestra.run.smithi081.stdout: User: admin 2024-04-23T14:38:24.805 INFO:teuthology.orchestra.run.smithi081.stdout: Password: yr0rsxvono 2024-04-23T14:38:24.805 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:38:24.806 INFO:teuthology.orchestra.run.smithi081.stdout:Saving cluster configuration to /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/config directory 2024-04-23T14:38:24.808 INFO:teuthology.orchestra.run.smithi081.stdout:Enabling autotune for osd_memory_target 2024-04-23T14:38:25.256 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:24 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/1129319898' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-04-23T14:38:26.307 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.415+0000 7f790b200700 1 Processor -- start 2024-04-23T14:38:26.307 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.415+0000 7f790b200700 1 -- start start 2024-04-23T14:38:26.307 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.416+0000 7f790b200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7904077ad0 0x7f7904076170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:26.307 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.416+0000 7f790b200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7904077ee0 con 0x7f7904077ad0 2024-04-23T14:38:26.307 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.416+0000 7f7903e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7904077ad0 0x7f7904076170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:26.307 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.416+0000 7f7903e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7904077ad0 0x7f7904076170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39550/0 (socket says 172.21.15.81:39550) 2024-04-23T14:38:26.307 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.416+0000 7f7903e00700 1 -- 172.21.15.81:0/2661532938 learned_addr learned my addr 172.21.15.81:0/2661532938 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:38:26.307 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.417+0000 7f7903e00700 1 -- 172.21.15.81:0/2661532938 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7904078020 con 0x7f7904077ad0 2024-04-23T14:38:26.307 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.417+0000 7f7903e00700 1 --2- 172.21.15.81:0/2661532938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7904077ad0 0x7f7904076170 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f78f4009e50 tx=0x7f78f4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71bd044919d65503 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:26.307 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.417+0000 7f7902a00700 1 -- 172.21.15.81:0/2661532938 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f78f40092e0 con 0x7f7904077ad0 2024-04-23T14:38:26.307 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.417+0000 7f7902a00700 1 -- 172.21.15.81:0/2661532938 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f78f4012430 con 0x7f7904077ad0 2024-04-23T14:38:26.308 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.417+0000 7f7902a00700 1 -- 172.21.15.81:0/2661532938 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f78f40075c0 con 0x7f7904077ad0 2024-04-23T14:38:26.308 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.418+0000 7f790b200700 1 -- 172.21.15.81:0/2661532938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7904077ad0 msgr2=0x7f7904076170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:26.308 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.418+0000 7f790b200700 1 --2- 172.21.15.81:0/2661532938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7904077ad0 0x7f7904076170 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f78f4009e50 tx=0x7f78f4009840 comp rx=0 tx=0).stop 2024-04-23T14:38:26.308 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.418+0000 7f790b200700 1 -- 172.21.15.81:0/2661532938 shutdown_connections 2024-04-23T14:38:26.308 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.418+0000 7f790b200700 1 --2- 172.21.15.81:0/2661532938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7904077ad0 0x7f7904076170 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:26.308 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.418+0000 7f790b200700 1 -- 172.21.15.81:0/2661532938 >> 172.21.15.81:0/2661532938 conn(0x7f79040fe0e0 msgr2=0x7f7904100510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:26.308 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.418+0000 7f790b200700 1 -- 172.21.15.81:0/2661532938 shutdown_connections 2024-04-23T14:38:26.308 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.418+0000 7f790b200700 1 -- 172.21.15.81:0/2661532938 wait complete. 2024-04-23T14:38:26.308 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.419+0000 7f790b200700 1 Processor -- start 2024-04-23T14:38:26.308 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.419+0000 7f790b200700 1 -- start start 2024-04-23T14:38:26.308 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.420+0000 7f790b200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7904077ad0 0x7f7904113970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:26.308 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.420+0000 7f790b200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7904113eb0 con 0x7f7904077ad0 2024-04-23T14:38:26.308 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.420+0000 7f7903e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7904077ad0 0x7f7904113970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:26.308 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.420+0000 7f7903e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7904077ad0 0x7f7904113970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39566/0 (socket says 172.21.15.81:39566) 2024-04-23T14:38:26.308 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.420+0000 7f7903e00700 1 -- 172.21.15.81:0/3423368491 learned_addr learned my addr 172.21.15.81:0/3423368491 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:38:26.309 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.420+0000 7f7903e00700 1 -- 172.21.15.81:0/3423368491 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f4009ae0 con 0x7f7904077ad0 2024-04-23T14:38:26.309 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.421+0000 7f7903e00700 1 --2- 172.21.15.81:0/3423368491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7904077ad0 0x7f7904113970 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f78f4012e80 tx=0x7f78f4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:26.309 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.421+0000 7f78fbe00700 1 -- 172.21.15.81:0/3423368491 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f78f40092e0 con 0x7f7904077ad0 2024-04-23T14:38:26.309 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.421+0000 7f78fbe00700 1 -- 172.21.15.81:0/3423368491 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f78f4007d00 con 0x7f7904077ad0 2024-04-23T14:38:26.309 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.421+0000 7f790b200700 1 -- 172.21.15.81:0/3423368491 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79041140b0 con 0x7f7904077ad0 2024-04-23T14:38:26.309 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.421+0000 7f78fbe00700 1 -- 172.21.15.81:0/3423368491 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f78f401c820 con 0x7f7904077ad0 2024-04-23T14:38:26.309 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.421+0000 7f790b200700 1 -- 172.21.15.81:0/3423368491 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7904114c20 con 0x7f7904077ad0 2024-04-23T14:38:26.309 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.422+0000 7f790b200700 1 -- 172.21.15.81:0/3423368491 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f790405f5f0 con 0x7f7904077ad0 2024-04-23T14:38:26.309 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.422+0000 7f78fbe00700 1 -- 172.21.15.81:0/3423368491 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f78f4019070 con 0x7f7904077ad0 2024-04-23T14:38:26.309 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.423+0000 7f78fbe00700 1 --2- 172.21.15.81:0/3423368491 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f78e80368d0 0x7f78e8038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:26.309 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.423+0000 7f78fbe00700 1 -- 172.21.15.81:0/3423368491 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f78f4049e80 con 0x7f7904077ad0 2024-04-23T14:38:26.309 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.423+0000 7f7903400700 1 --2- 172.21.15.81:0/3423368491 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f78e80368d0 0x7f78e8038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:26.309 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.424+0000 7f7903400700 1 --2- 172.21.15.81:0/3423368491 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f78e80368d0 0x7f78e8038d80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f78f0009990 tx=0x7f78f0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:26.309 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.428+0000 7f78fbe00700 1 -- 172.21.15.81:0/3423368491 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f78f4011390 con 0x7f7904077ad0 2024-04-23T14:38:26.310 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.637+0000 7f790b200700 1 -- 172.21.15.81:0/3423368491 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f7904115030 con 0x7f7904077ad0 2024-04-23T14:38:26.310 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.638+0000 7f78fbe00700 1 -- 172.21.15.81:0/3423368491 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f78f40170c0 con 0x7f7904077ad0 2024-04-23T14:38:26.310 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.641+0000 7f790b200700 1 -- 172.21.15.81:0/3423368491 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f78e80368d0 msgr2=0x7f78e8038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:26.310 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.641+0000 7f790b200700 1 --2- 172.21.15.81:0/3423368491 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f78e80368d0 0x7f78e8038d80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f78f0009990 tx=0x7f78f0006e40 comp rx=0 tx=0).stop 2024-04-23T14:38:26.310 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.641+0000 7f790b200700 1 -- 172.21.15.81:0/3423368491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7904077ad0 msgr2=0x7f7904113970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:26.310 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.641+0000 7f790b200700 1 --2- 172.21.15.81:0/3423368491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7904077ad0 0x7f7904113970 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f78f4012e80 tx=0x7f78f4009840 comp rx=0 tx=0).stop 2024-04-23T14:38:26.310 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.641+0000 7f790b200700 1 -- 172.21.15.81:0/3423368491 shutdown_connections 2024-04-23T14:38:26.310 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.641+0000 7f790b200700 1 --2- 172.21.15.81:0/3423368491 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f78e80368d0 0x7f78e8038d80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:26.310 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.641+0000 7f790b200700 1 --2- 172.21.15.81:0/3423368491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7904077ad0 0x7f7904113970 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:26.310 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.641+0000 7f790b200700 1 -- 172.21.15.81:0/3423368491 >> 172.21.15.81:0/3423368491 conn(0x7f79040fe0e0 msgr2=0x7f79040fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:26.310 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.641+0000 7f790b200700 1 -- 172.21.15.81:0/3423368491 shutdown_connections 2024-04-23T14:38:26.310 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:25.641+0000 7f790b200700 1 -- 172.21.15.81:0/3423368491 wait complete. 2024-04-23T14:38:27.817 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.830+0000 7f5b5e000700 1 Processor -- start 2024-04-23T14:38:27.818 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.830+0000 7f5b5e000700 1 -- start start 2024-04-23T14:38:27.818 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.831+0000 7f5b5e000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b58102980 0x7f5b58102d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:27.818 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.831+0000 7f5b5e000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b581032d0 con 0x7f5b58102980 2024-04-23T14:38:27.818 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.831+0000 7f5b57400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b58102980 0x7f5b58102d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:27.818 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.831+0000 7f5b57400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b58102980 0x7f5b58102d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39580/0 (socket says 172.21.15.81:39580) 2024-04-23T14:38:27.818 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.831+0000 7f5b57400700 1 -- 172.21.15.81:0/2723208065 learned_addr learned my addr 172.21.15.81:0/2723208065 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:38:27.818 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.832+0000 7f5b57400700 1 -- 172.21.15.81:0/2723208065 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b58103410 con 0x7f5b58102980 2024-04-23T14:38:27.819 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.832+0000 7f5b57400700 1 --2- 172.21.15.81:0/2723208065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b58102980 0x7f5b58102d90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5b480098e0 tx=0x7f5b48009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf626c1f4ff38af server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:27.819 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.832+0000 7f5b56a00700 1 -- 172.21.15.81:0/2723208065 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b4800b8f0 con 0x7f5b58102980 2024-04-23T14:38:27.819 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.832+0000 7f5b56a00700 1 -- 172.21.15.81:0/2723208065 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5b48011420 con 0x7f5b58102980 2024-04-23T14:38:27.825 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.832+0000 7f5b56a00700 1 -- 172.21.15.81:0/2723208065 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b48010540 con 0x7f5b58102980 2024-04-23T14:38:27.825 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.833+0000 7f5b5e000700 1 -- 172.21.15.81:0/2723208065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b58102980 msgr2=0x7f5b58102d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:27.825 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.833+0000 7f5b5e000700 1 --2- 172.21.15.81:0/2723208065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b58102980 0x7f5b58102d90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5b480098e0 tx=0x7f5b48009250 comp rx=0 tx=0).stop 2024-04-23T14:38:27.825 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.833+0000 7f5b5e000700 1 -- 172.21.15.81:0/2723208065 shutdown_connections 2024-04-23T14:38:27.825 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.833+0000 7f5b5e000700 1 --2- 172.21.15.81:0/2723208065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b58102980 0x7f5b58102d90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:27.825 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.833+0000 7f5b5e000700 1 -- 172.21.15.81:0/2723208065 >> 172.21.15.81:0/2723208065 conn(0x7f5b580fe0e0 msgr2=0x7f5b58100510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:27.825 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.833+0000 7f5b5e000700 1 -- 172.21.15.81:0/2723208065 shutdown_connections 2024-04-23T14:38:27.825 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.833+0000 7f5b5e000700 1 -- 172.21.15.81:0/2723208065 wait complete. 2024-04-23T14:38:27.825 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.834+0000 7f5b5e000700 1 Processor -- start 2024-04-23T14:38:27.825 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.834+0000 7f5b5e000700 1 -- start start 2024-04-23T14:38:27.825 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.835+0000 7f5b5e000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b58102980 0x7f5b58077b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:27.826 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.835+0000 7f5b5e000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b58078080 con 0x7f5b58102980 2024-04-23T14:38:27.826 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.835+0000 7f5b57400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b58102980 0x7f5b58077b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:27.826 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.835+0000 7f5b57400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b58102980 0x7f5b58077b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39592/0 (socket says 172.21.15.81:39592) 2024-04-23T14:38:27.826 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.835+0000 7f5b57400700 1 -- 172.21.15.81:0/2296091098 learned_addr learned my addr 172.21.15.81:0/2296091098 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:38:27.826 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.836+0000 7f5b57400700 1 -- 172.21.15.81:0/2296091098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b480094f0 con 0x7f5b58102980 2024-04-23T14:38:27.826 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.836+0000 7f5b57400700 1 --2- 172.21.15.81:0/2296091098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b58102980 0x7f5b58077b40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5b48006d40 tx=0x7f5b48009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:27.826 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.836+0000 7f5b4f400700 1 -- 172.21.15.81:0/2296091098 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b4800beb0 con 0x7f5b58102980 2024-04-23T14:38:27.826 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.836+0000 7f5b4f400700 1 -- 172.21.15.81:0/2296091098 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5b48010c80 con 0x7f5b58102980 2024-04-23T14:38:27.826 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.836+0000 7f5b4f400700 1 -- 172.21.15.81:0/2296091098 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b48024d40 con 0x7f5b58102980 2024-04-23T14:38:27.826 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.836+0000 7f5b5e000700 1 -- 172.21.15.81:0/2296091098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b580760f0 con 0x7f5b58102980 2024-04-23T14:38:27.826 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.836+0000 7f5b5e000700 1 -- 172.21.15.81:0/2296091098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b580765e0 con 0x7f5b58102980 2024-04-23T14:38:27.826 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.837+0000 7f5b4f400700 1 -- 172.21.15.81:0/2296091098 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f5b48024650 con 0x7f5b58102980 2024-04-23T14:38:27.826 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.838+0000 7f5b5e000700 1 -- 172.21.15.81:0/2296091098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b5804bed0 con 0x7f5b58102980 2024-04-23T14:38:27.826 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.838+0000 7f5b4f400700 1 --2- 172.21.15.81:0/2296091098 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f5b3c036910 0x7f5b3c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:27.827 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.838+0000 7f5b4f400700 1 -- 172.21.15.81:0/2296091098 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f5b4804a4c0 con 0x7f5b58102980 2024-04-23T14:38:27.827 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.838+0000 7f5b4fe00700 1 --2- 172.21.15.81:0/2296091098 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f5b3c036910 0x7f5b3c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:27.827 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.839+0000 7f5b4fe00700 1 --2- 172.21.15.81:0/2296091098 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f5b3c036910 0x7f5b3c038dc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5b40009990 tx=0x7f5b40006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:27.827 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:26.843+0000 7f5b4f400700 1 -- 172.21.15.81:0/2296091098 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f5b48024430 con 0x7f5b58102980 2024-04-23T14:38:27.827 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:27.166+0000 7f5b5e000700 1 -- 172.21.15.81:0/2296091098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f5b58076b10 con 0x7f5b58102980 2024-04-23T14:38:27.827 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:27.174+0000 7f5b4f400700 1 -- 172.21.15.81:0/2296091098 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7f5b48022330 con 0x7f5b58102980 2024-04-23T14:38:27.827 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:27.176+0000 7f5b5e000700 1 -- 172.21.15.81:0/2296091098 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f5b3c036910 msgr2=0x7f5b3c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:27.827 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:27.176+0000 7f5b5e000700 1 --2- 172.21.15.81:0/2296091098 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f5b3c036910 0x7f5b3c038dc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5b40009990 tx=0x7f5b40006e40 comp rx=0 tx=0).stop 2024-04-23T14:38:27.827 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:27.176+0000 7f5b5e000700 1 -- 172.21.15.81:0/2296091098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b58102980 msgr2=0x7f5b58077b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:27.827 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:27.176+0000 7f5b5e000700 1 --2- 172.21.15.81:0/2296091098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b58102980 0x7f5b58077b40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5b48006d40 tx=0x7f5b48009250 comp rx=0 tx=0).stop 2024-04-23T14:38:27.827 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:27.177+0000 7f5b5e000700 1 -- 172.21.15.81:0/2296091098 shutdown_connections 2024-04-23T14:38:27.827 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:27.177+0000 7f5b5e000700 1 --2- 172.21.15.81:0/2296091098 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f5b3c036910 0x7f5b3c038dc0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:27.828 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:27.177+0000 7f5b5e000700 1 --2- 172.21.15.81:0/2296091098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b58102980 0x7f5b58077b40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:27.828 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:27.177+0000 7f5b5e000700 1 -- 172.21.15.81:0/2296091098 >> 172.21.15.81:0/2296091098 conn(0x7f5b580fe0e0 msgr2=0x7f5b580fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:27.828 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:27.177+0000 7f5b5e000700 1 -- 172.21.15.81:0/2296091098 shutdown_connections 2024-04-23T14:38:27.828 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-04-23T14:38:27.177+0000 7f5b5e000700 1 -- 172.21.15.81:0/2296091098 wait complete. 2024-04-23T14:38:27.828 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-04-23T14:38:27.828 INFO:teuthology.orchestra.run.smithi081.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-04-23T14:38:27.828 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:38:27.828 INFO:teuthology.orchestra.run.smithi081.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-04-23T14:38:27.828 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:38:27.828 INFO:teuthology.orchestra.run.smithi081.stdout:Or, if you are only running a single cluster on this host: 2024-04-23T14:38:27.828 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:38:27.828 INFO:teuthology.orchestra.run.smithi081.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-04-23T14:38:27.828 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:38:27.828 INFO:teuthology.orchestra.run.smithi081.stdout:Please consider enabling telemetry to help improve Ceph: 2024-04-23T14:38:27.828 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:38:27.828 INFO:teuthology.orchestra.run.smithi081.stdout: ceph telemetry on 2024-04-23T14:38:27.829 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:38:27.829 INFO:teuthology.orchestra.run.smithi081.stdout:For more information see: 2024-04-23T14:38:27.829 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:38:27.829 INFO:teuthology.orchestra.run.smithi081.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-04-23T14:38:27.829 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:38:27.829 INFO:teuthology.orchestra.run.smithi081.stdout:Bootstrap complete. 2024-04-23T14:38:27.913 INFO:tasks.cephadm:Fetching config... 2024-04-23T14:38:27.913 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-23T14:38:27.913 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-04-23T14:38:27.955 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-04-23T14:38:27.955 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-23T14:38:27.955 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-04-23T14:38:28.033 INFO:tasks.cephadm:Fetching mon keyring... 2024-04-23T14:38:28.034 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-23T14:38:28.034 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/keyring of=/dev/stdout 2024-04-23T14:38:28.139 INFO:tasks.cephadm:Fetching pub ssh key... 2024-04-23T14:38:28.140 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-23T14:38:28.140 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-04-23T14:38:28.230 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-04-23T14:38:28.230 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCsevqb/hswC1sxFpdHRNQO+ZpC3PJgalaBmLm2tgWBvq3xYbIW59qV9UK1MOiE56kch5BE9JGa9YdSlbi/rnXlUBMjqUokGAaGIMcyj6xHsemgvQVV37f5uHC1mcoxRVTZRXa5iBgz9B+zXU2qJoTlqRqOhRWJZ16Nce4vpDkj4wuT+GN+zqcXxen95YdE+Cqq3WAoiETiri8ZZiEKxULvv9tzL4j1MTFAYrFtKFzee4SwNMDsZxhuZn+6heIjekxyCpwocnKVZR+kW+txR5cYysnKXDmB6gBq2BcDfDriFMw6lnaYjrF3X9FIeOfMwcv9N/k4YJMzVDEL6Qhh02/OJkXtT/j6KdhvxmQJZ1frCp41gy6CdUvoxZ0lDj6QhqKtNGqYnzjXYqGr0nh+zewSWOwEflJhqMiqMWQbp5CoBsbJMiSL0J3F0+6SsfO6NiOIWU5ZRvGA6EvwSIbVqFOyCvyXpZe1RTnO2mfQ2oNCY9Fww/rSsAQ5ftM8U63YQis= ceph-7a641bea-017e-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-23T14:38:28.351 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:28 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/2296091098' entity='client.admin' 2024-04-23T14:38:28.357 INFO:teuthology.orchestra.run.smithi081.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCsevqb/hswC1sxFpdHRNQO+ZpC3PJgalaBmLm2tgWBvq3xYbIW59qV9UK1MOiE56kch5BE9JGa9YdSlbi/rnXlUBMjqUokGAaGIMcyj6xHsemgvQVV37f5uHC1mcoxRVTZRXa5iBgz9B+zXU2qJoTlqRqOhRWJZ16Nce4vpDkj4wuT+GN+zqcXxen95YdE+Cqq3WAoiETiri8ZZiEKxULvv9tzL4j1MTFAYrFtKFzee4SwNMDsZxhuZn+6heIjekxyCpwocnKVZR+kW+txR5cYysnKXDmB6gBq2BcDfDriFMw6lnaYjrF3X9FIeOfMwcv9N/k4YJMzVDEL6Qhh02/OJkXtT/j6KdhvxmQJZ1frCp41gy6CdUvoxZ0lDj6QhqKtNGqYnzjXYqGr0nh+zewSWOwEflJhqMiqMWQbp5CoBsbJMiSL0J3F0+6SsfO6NiOIWU5ZRvGA6EvwSIbVqFOyCvyXpZe1RTnO2mfQ2oNCY9Fww/rSsAQ5ftM8U63YQis= ceph-7a641bea-017e-11ef-bc93-c7b262605968 2024-04-23T14:38:28.384 DEBUG:teuthology.orchestra.run.smithi156:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCsevqb/hswC1sxFpdHRNQO+ZpC3PJgalaBmLm2tgWBvq3xYbIW59qV9UK1MOiE56kch5BE9JGa9YdSlbi/rnXlUBMjqUokGAaGIMcyj6xHsemgvQVV37f5uHC1mcoxRVTZRXa5iBgz9B+zXU2qJoTlqRqOhRWJZ16Nce4vpDkj4wuT+GN+zqcXxen95YdE+Cqq3WAoiETiri8ZZiEKxULvv9tzL4j1MTFAYrFtKFzee4SwNMDsZxhuZn+6heIjekxyCpwocnKVZR+kW+txR5cYysnKXDmB6gBq2BcDfDriFMw6lnaYjrF3X9FIeOfMwcv9N/k4YJMzVDEL6Qhh02/OJkXtT/j6KdhvxmQJZ1frCp41gy6CdUvoxZ0lDj6QhqKtNGqYnzjXYqGr0nh+zewSWOwEflJhqMiqMWQbp5CoBsbJMiSL0J3F0+6SsfO6NiOIWU5ZRvGA6EvwSIbVqFOyCvyXpZe1RTnO2mfQ2oNCY9Fww/rSsAQ5ftM8U63YQis= ceph-7a641bea-017e-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-23T14:38:28.516 INFO:teuthology.orchestra.run.smithi156.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCsevqb/hswC1sxFpdHRNQO+ZpC3PJgalaBmLm2tgWBvq3xYbIW59qV9UK1MOiE56kch5BE9JGa9YdSlbi/rnXlUBMjqUokGAaGIMcyj6xHsemgvQVV37f5uHC1mcoxRVTZRXa5iBgz9B+zXU2qJoTlqRqOhRWJZ16Nce4vpDkj4wuT+GN+zqcXxen95YdE+Cqq3WAoiETiri8ZZiEKxULvv9tzL4j1MTFAYrFtKFzee4SwNMDsZxhuZn+6heIjekxyCpwocnKVZR+kW+txR5cYysnKXDmB6gBq2BcDfDriFMw6lnaYjrF3X9FIeOfMwcv9N/k4YJMzVDEL6Qhh02/OJkXtT/j6KdhvxmQJZ1frCp41gy6CdUvoxZ0lDj6QhqKtNGqYnzjXYqGr0nh+zewSWOwEflJhqMiqMWQbp5CoBsbJMiSL0J3F0+6SsfO6NiOIWU5ZRvGA6EvwSIbVqFOyCvyXpZe1RTnO2mfQ2oNCY9Fww/rSsAQ5ftM8U63YQis= ceph-7a641bea-017e-11ef-bc93-c7b262605968 2024-04-23T14:38:28.569 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-04-23T14:38:29.018 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:38:31.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:31.585+0000 7fafd5200700 1 -- 172.21.15.81:0/646272882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafd00fc890 msgr2=0x7fafd00fcca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:31.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:31.585+0000 7fafd5200700 1 --2- 172.21.15.81:0/646272882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafd00fc890 0x7fafd00fcca0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fafc00048c0 tx=0x7fafc0009e30 comp rx=0 tx=0).stop 2024-04-23T14:38:31.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:31.585+0000 7fafd5200700 1 -- 172.21.15.81:0/646272882 shutdown_connections 2024-04-23T14:38:31.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:31.585+0000 7fafd5200700 1 --2- 172.21.15.81:0/646272882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafd00fc890 0x7fafd00fcca0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:31.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:31.585+0000 7fafd5200700 1 -- 172.21.15.81:0/646272882 >> 172.21.15.81:0/646272882 conn(0x7fafd00f7ff0 msgr2=0x7fafd00fa420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:31.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:31.585+0000 7fafd5200700 1 -- 172.21.15.81:0/646272882 shutdown_connections 2024-04-23T14:38:31.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:31.585+0000 7fafd5200700 1 -- 172.21.15.81:0/646272882 wait complete. 2024-04-23T14:38:31.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:31.586+0000 7fafd5200700 1 Processor -- start 2024-04-23T14:38:31.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:31.586+0000 7fafd5200700 1 -- start start 2024-04-23T14:38:31.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:31.586+0000 7fafd5200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafd00fc890 0x7fafd0071d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:31.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:31.587+0000 7fafd5200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd00722a0 con 0x7fafd00fc890 2024-04-23T14:38:31.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:31.587+0000 7fafcf400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafd00fc890 0x7fafd0071d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:31.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:31.587+0000 7fafcf400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafd00fc890 0x7fafd0071d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39608/0 (socket says 172.21.15.81:39608) 2024-04-23T14:38:31.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:31.587+0000 7fafcf400700 1 -- 172.21.15.81:0/3781584284 learned_addr learned my addr 172.21.15.81:0/3781584284 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:38:31.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:31.587+0000 7fafcf400700 1 -- 172.21.15.81:0/3781584284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc0005040 con 0x7fafd00fc890 2024-04-23T14:38:31.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:31.587+0000 7fafcf400700 1 --2- 172.21.15.81:0/3781584284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafd00fc890 0x7fafd0071d60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009680 tx=0x7fafc0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:31.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:31.588+0000 7fafc7400700 1 -- 172.21.15.81:0/3781584284 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fafc000b5c0 con 0x7fafd00fc890 2024-04-23T14:38:31.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:31.588+0000 7fafc7400700 1 -- 172.21.15.81:0/3781584284 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fafc000be70 con 0x7fafd00fc890 2024-04-23T14:38:31.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:31.588+0000 7fafd5200700 1 -- 172.21.15.81:0/3781584284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd0070370 con 0x7fafd00fc890 2024-04-23T14:38:31.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:31.588+0000 7fafc7400700 1 -- 172.21.15.81:0/3781584284 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fafc00135a0 con 0x7fafd00fc890 2024-04-23T14:38:31.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:31.588+0000 7fafd5200700 1 -- 172.21.15.81:0/3781584284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd0070860 con 0x7fafd00fc890 2024-04-23T14:38:31.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:31.589+0000 7fafc7400700 1 -- 172.21.15.81:0/3781584284 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fafc001ca90 con 0x7fafd00fc890 2024-04-23T14:38:31.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:31.589+0000 7fafd5200700 1 -- 172.21.15.81:0/3781584284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd005f5f0 con 0x7fafd00fc890 2024-04-23T14:38:31.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:31.589+0000 7fafc7400700 1 --2- 172.21.15.81:0/3781584284 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fafb00368d0 0x7fafb0038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:31.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:31.589+0000 7fafc7400700 1 -- 172.21.15.81:0/3781584284 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fafc0049420 con 0x7fafd00fc890 2024-04-23T14:38:31.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:31.590+0000 7fafc7e00700 1 --2- 172.21.15.81:0/3781584284 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fafb00368d0 0x7fafb0038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:31.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:31.590+0000 7fafc7e00700 1 --2- 172.21.15.81:0/3781584284 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fafb00368d0 0x7fafb0038d80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fafb8009990 tx=0x7fafb8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:31.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:31.595+0000 7fafc7400700 1 -- 172.21.15.81:0/3781584284 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fafc0011960 con 0x7fafd00fc890 2024-04-23T14:38:31.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:31.822+0000 7fafd5200700 1 -- 172.21.15.81:0/3781584284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fafd004bed0 con 0x7fafd00fc890 2024-04-23T14:38:31.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:31.829+0000 7fafc7400700 1 -- 172.21.15.81:0/3781584284 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7fafc0021020 con 0x7fafd00fc890 2024-04-23T14:38:31.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:31.831+0000 7fafd5200700 1 -- 172.21.15.81:0/3781584284 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fafb00368d0 msgr2=0x7fafb0038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:31.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:31.831+0000 7fafd5200700 1 --2- 172.21.15.81:0/3781584284 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fafb00368d0 0x7fafb0038d80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fafb8009990 tx=0x7fafb8006e40 comp rx=0 tx=0).stop 2024-04-23T14:38:31.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:31.831+0000 7fafd5200700 1 -- 172.21.15.81:0/3781584284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafd00fc890 msgr2=0x7fafd0071d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:31.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:31.831+0000 7fafd5200700 1 --2- 172.21.15.81:0/3781584284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafd00fc890 0x7fafd0071d60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009680 tx=0x7fafc0009e30 comp rx=0 tx=0).stop 2024-04-23T14:38:31.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:31.832+0000 7fafd5200700 1 -- 172.21.15.81:0/3781584284 shutdown_connections 2024-04-23T14:38:31.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:31.832+0000 7fafd5200700 1 --2- 172.21.15.81:0/3781584284 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fafb00368d0 0x7fafb0038d80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:31.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:31.832+0000 7fafd5200700 1 --2- 172.21.15.81:0/3781584284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafd00fc890 0x7fafd0071d60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:31.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:31.832+0000 7fafd5200700 1 -- 172.21.15.81:0/3781584284 >> 172.21.15.81:0/3781584284 conn(0x7fafd00f7ff0 msgr2=0x7fafd01039d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:31.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:31.832+0000 7fafd5200700 1 -- 172.21.15.81:0/3781584284 shutdown_connections 2024-04-23T14:38:31.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:31.832+0000 7fafd5200700 1 -- 172.21.15.81:0/3781584284 wait complete. 2024-04-23T14:38:32.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:31 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' 2024-04-23T14:38:32.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:31 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' 2024-04-23T14:38:32.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:31 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "who": "osd/host:smithi081", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:38:32.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:31 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' 2024-04-23T14:38:32.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:31 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi081", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-23T14:38:32.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:31 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi081", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-04-23T14:38:32.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:31 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:38:32.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:31 smithi081 ceph-mon[25540]: Deploying daemon crash.smithi081 on smithi081 2024-04-23T14:38:32.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:31 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/3781584284' entity='client.admin' 2024-04-23T14:38:32.656 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-04-23T14:38:32.656 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-04-23T14:38:33.083 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:38:35.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:35.448+0000 7fbcd0200700 1 -- 172.21.15.81:0/1698935553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcc8071ea0 msgr2=0x7fbcc80703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:35.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:35.448+0000 7fbcd0200700 1 --2- 172.21.15.81:0/1698935553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcc8071ea0 0x7fbcc80703b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc0048c0 tx=0x7fbcbc009e30 comp rx=0 tx=0).stop 2024-04-23T14:38:35.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:35.448+0000 7fbcd0200700 1 -- 172.21.15.81:0/1698935553 shutdown_connections 2024-04-23T14:38:35.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:35.448+0000 7fbcd0200700 1 --2- 172.21.15.81:0/1698935553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcc8071ea0 0x7fbcc80703b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:35.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:35.448+0000 7fbcd0200700 1 -- 172.21.15.81:0/1698935553 >> 172.21.15.81:0/1698935553 conn(0x7fbcc80f81d0 msgr2=0x7fbcc80fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:35.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:35.448+0000 7fbcd0200700 1 -- 172.21.15.81:0/1698935553 shutdown_connections 2024-04-23T14:38:35.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:35.448+0000 7fbcd0200700 1 -- 172.21.15.81:0/1698935553 wait complete. 2024-04-23T14:38:35.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:35.449+0000 7fbcd0200700 1 Processor -- start 2024-04-23T14:38:35.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:35.449+0000 7fbcd0200700 1 -- start start 2024-04-23T14:38:35.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:35.450+0000 7fbcd0200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcc8071ea0 0x7fbcc810f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:35.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:35.450+0000 7fbcd0200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc810f860 con 0x7fbcc8071ea0 2024-04-23T14:38:35.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:35.450+0000 7fbccd800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcc8071ea0 0x7fbcc810f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:35.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:35.450+0000 7fbccd800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcc8071ea0 0x7fbcc810f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59406/0 (socket says 172.21.15.81:59406) 2024-04-23T14:38:35.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:35.450+0000 7fbccd800700 1 -- 172.21.15.81:0/3535501087 learned_addr learned my addr 172.21.15.81:0/3535501087 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:38:35.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:35.450+0000 7fbccd800700 1 -- 172.21.15.81:0/3535501087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcbc005040 con 0x7fbcc8071ea0 2024-04-23T14:38:35.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:35.451+0000 7fbccd800700 1 --2- 172.21.15.81:0/3535501087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcc8071ea0 0x7fbcc810f320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc00b900 tx=0x7fbcbc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:35.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:35.451+0000 7fbcc5600700 1 -- 172.21.15.81:0/3535501087 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbcbc00b5c0 con 0x7fbcc8071ea0 2024-04-23T14:38:35.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:35.451+0000 7fbcc5600700 1 -- 172.21.15.81:0/3535501087 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbcbc00be70 con 0x7fbcc8071ea0 2024-04-23T14:38:35.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:35.451+0000 7fbcd0200700 1 -- 172.21.15.81:0/3535501087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcc810fa60 con 0x7fbcc8071ea0 2024-04-23T14:38:35.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:35.451+0000 7fbcc5600700 1 -- 172.21.15.81:0/3535501087 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbcbc01c590 con 0x7fbcc8071ea0 2024-04-23T14:38:35.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:35.451+0000 7fbcd0200700 1 -- 172.21.15.81:0/3535501087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcc81105d0 con 0x7fbcc8071ea0 2024-04-23T14:38:35.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:35.452+0000 7fbcc5600700 1 -- 172.21.15.81:0/3535501087 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fbcbc004d30 con 0x7fbcc8071ea0 2024-04-23T14:38:35.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:35.452+0000 7fbcd0200700 1 -- 172.21.15.81:0/3535501087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcc8105190 con 0x7fbcc8071ea0 2024-04-23T14:38:35.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:35.453+0000 7fbcc5600700 1 --2- 172.21.15.81:0/3535501087 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fbcb00368d0 0x7fbcb0038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:35.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:35.453+0000 7fbcc5600700 1 -- 172.21.15.81:0/3535501087 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fbcbc049350 con 0x7fbcc8071ea0 2024-04-23T14:38:35.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:35.453+0000 7fbccce00700 1 --2- 172.21.15.81:0/3535501087 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fbcb00368d0 0x7fbcb0038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:35.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:35.453+0000 7fbccce00700 1 --2- 172.21.15.81:0/3535501087 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fbcb00368d0 0x7fbcb0038d80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4009990 tx=0x7fbcb4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:35.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:35.458+0000 7fbcc5600700 1 -- 172.21.15.81:0/3535501087 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fbcbc01b350 con 0x7fbcc8071ea0 2024-04-23T14:38:35.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:35.687+0000 7fbcd0200700 1 -- 172.21.15.81:0/3535501087 --> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7fbcc81108d0 con 0x7fbcb00368d0 2024-04-23T14:38:35.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:35.692+0000 7fbcc5600700 1 -- 172.21.15.81:0/3535501087 <== mgr.14162 v2:172.21.15.81:6800/3624015234 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fbcc81108d0 con 0x7fbcb00368d0 2024-04-23T14:38:35.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:35.694+0000 7fbcd0200700 1 -- 172.21.15.81:0/3535501087 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fbcb00368d0 msgr2=0x7fbcb0038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:35.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:35.694+0000 7fbcd0200700 1 --2- 172.21.15.81:0/3535501087 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fbcb00368d0 0x7fbcb0038d80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4009990 tx=0x7fbcb4006e40 comp rx=0 tx=0).stop 2024-04-23T14:38:35.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:35.694+0000 7fbcd0200700 1 -- 172.21.15.81:0/3535501087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcc8071ea0 msgr2=0x7fbcc810f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:35.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:35.694+0000 7fbcd0200700 1 --2- 172.21.15.81:0/3535501087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcc8071ea0 0x7fbcc810f320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc00b900 tx=0x7fbcbc009e30 comp rx=0 tx=0).stop 2024-04-23T14:38:35.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:35.694+0000 7fbcd0200700 1 -- 172.21.15.81:0/3535501087 shutdown_connections 2024-04-23T14:38:35.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:35.694+0000 7fbcd0200700 1 --2- 172.21.15.81:0/3535501087 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fbcb00368d0 0x7fbcb0038d80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:35.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:35.694+0000 7fbcd0200700 1 --2- 172.21.15.81:0/3535501087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcc8071ea0 0x7fbcc810f320 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:35.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:35.694+0000 7fbcd0200700 1 -- 172.21.15.81:0/3535501087 >> 172.21.15.81:0/3535501087 conn(0x7fbcc80f81d0 msgr2=0x7fbcc8105dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:35.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:35.694+0000 7fbcd0200700 1 -- 172.21.15.81:0/3535501087 shutdown_connections 2024-04-23T14:38:35.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:35.695+0000 7fbcd0200700 1 -- 172.21.15.81:0/3535501087 wait complete. 2024-04-23T14:38:36.758 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi156 2024-04-23T14:38:36.758 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-04-23T14:38:36.758 DEBUG:teuthology.orchestra.run.smithi156:> dd of=/etc/ceph/ceph.conf 2024-04-23T14:38:36.815 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-04-23T14:38:36.816 DEBUG:teuthology.orchestra.run.smithi156:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-23T14:38:36.909 INFO:tasks.cephadm:Adding host smithi156 to orchestrator... 2024-04-23T14:38:36.909 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph orch host add smithi156 2024-04-23T14:38:36.985 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:36 smithi081 ceph-mon[25540]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:38:36.985 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:36 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' 2024-04-23T14:38:37.386 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:38:37.821 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:37 smithi081 ceph-mon[25540]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:38:39.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:39.493+0000 7f9d46200700 1 -- 172.21.15.81:0/2594472577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d400fca70 msgr2=0x7f9d400fce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:39.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:39.493+0000 7f9d46200700 1 --2- 172.21.15.81:0/2594472577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d400fca70 0x7f9d400fce80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9d300048c0 tx=0x7f9d30009e30 comp rx=0 tx=0).stop 2024-04-23T14:38:39.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:39.493+0000 7f9d46200700 1 -- 172.21.15.81:0/2594472577 shutdown_connections 2024-04-23T14:38:39.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:39.493+0000 7f9d46200700 1 --2- 172.21.15.81:0/2594472577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d400fca70 0x7f9d400fce80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:39.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:39.493+0000 7f9d46200700 1 -- 172.21.15.81:0/2594472577 >> 172.21.15.81:0/2594472577 conn(0x7f9d400f81d0 msgr2=0x7f9d400fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:39.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:39.494+0000 7f9d46200700 1 -- 172.21.15.81:0/2594472577 shutdown_connections 2024-04-23T14:38:39.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:39.494+0000 7f9d46200700 1 -- 172.21.15.81:0/2594472577 wait complete. 2024-04-23T14:38:39.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:39.494+0000 7f9d46200700 1 Processor -- start 2024-04-23T14:38:39.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:39.495+0000 7f9d46200700 1 -- start start 2024-04-23T14:38:39.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:39.495+0000 7f9d46200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d400fca70 0x7f9d40071d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:39.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:39.495+0000 7f9d46200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d400722a0 con 0x7f9d400fca70 2024-04-23T14:38:39.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:39.495+0000 7f9d3f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d400fca70 0x7f9d40071d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:39.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:39.495+0000 7f9d3f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d400fca70 0x7f9d40071d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59418/0 (socket says 172.21.15.81:59418) 2024-04-23T14:38:39.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:39.495+0000 7f9d3f400700 1 -- 172.21.15.81:0/2536233809 learned_addr learned my addr 172.21.15.81:0/2536233809 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:38:39.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:39.496+0000 7f9d3f400700 1 -- 172.21.15.81:0/2536233809 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d30005040 con 0x7f9d400fca70 2024-04-23T14:38:39.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:39.496+0000 7f9d3f400700 1 --2- 172.21.15.81:0/2536233809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d400fca70 0x7f9d40071d60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9d30009680 tx=0x7f9d30009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:39.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:39.496+0000 7f9d37400700 1 -- 172.21.15.81:0/2536233809 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9d3000b5c0 con 0x7f9d400fca70 2024-04-23T14:38:39.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:39.496+0000 7f9d37400700 1 -- 172.21.15.81:0/2536233809 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9d3000be70 con 0x7f9d400fca70 2024-04-23T14:38:39.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:39.496+0000 7f9d46200700 1 -- 172.21.15.81:0/2536233809 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d40070370 con 0x7f9d400fca70 2024-04-23T14:38:39.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:39.496+0000 7f9d37400700 1 -- 172.21.15.81:0/2536233809 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9d300135a0 con 0x7f9d400fca70 2024-04-23T14:38:39.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:39.496+0000 7f9d46200700 1 -- 172.21.15.81:0/2536233809 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d40070860 con 0x7f9d400fca70 2024-04-23T14:38:39.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:39.498+0000 7f9d37400700 1 -- 172.21.15.81:0/2536233809 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f9d3001c430 con 0x7f9d400fca70 2024-04-23T14:38:39.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:39.498+0000 7f9d46200700 1 -- 172.21.15.81:0/2536233809 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d4005f5f0 con 0x7f9d400fca70 2024-04-23T14:38:39.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:39.498+0000 7f9d37400700 1 --2- 172.21.15.81:0/2536233809 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f9d240368d0 0x7f9d24038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:39.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:39.499+0000 7f9d37400700 1 -- 172.21.15.81:0/2536233809 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f9d300493b0 con 0x7f9d400fca70 2024-04-23T14:38:39.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:39.499+0000 7f9d3ea00700 1 --2- 172.21.15.81:0/2536233809 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f9d240368d0 0x7f9d24038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:39.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:39.500+0000 7f9d3ea00700 1 --2- 172.21.15.81:0/2536233809 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f9d240368d0 0x7f9d24038d80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c009990 tx=0x7f9d2c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:39.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:39.504+0000 7f9d37400700 1 -- 172.21.15.81:0/2536233809 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f9d300117e0 con 0x7f9d400fca70 2024-04-23T14:38:39.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:39.724+0000 7f9d46200700 1 -- 172.21.15.81:0/2536233809 --> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi156", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d401064c0 con 0x7f9d240368d0 2024-04-23T14:38:40.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:39 smithi081 ceph-mon[25540]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:38:40.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:39 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' 2024-04-23T14:38:40.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:39 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' 2024-04-23T14:38:40.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:39 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' 2024-04-23T14:38:40.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:39 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' 2024-04-23T14:38:41.149 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:40 smithi081 ceph-mon[25540]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi156", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:38:41.149 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:40 smithi081 ceph-mon[25540]: Deploying daemon node-exporter.smithi081 on smithi081 2024-04-23T14:38:42.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:41 smithi081 ceph-mon[25540]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:38:42.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:41 smithi081 ceph-mon[25540]: Deploying cephadm binary to smithi156 2024-04-23T14:38:42.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:41 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' 2024-04-23T14:38:43.277 INFO:teuthology.orchestra.run.smithi081.stdout:Added host 'smithi156' with addr '172.21.15.156' 2024-04-23T14:38:43.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:43.274+0000 7f9d37400700 1 -- 172.21.15.81:0/2536233809 <== mgr.14162 v2:172.21.15.81:6800/3624015234 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f9d401064c0 con 0x7f9d240368d0 2024-04-23T14:38:43.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:43.277+0000 7f9d46200700 1 -- 172.21.15.81:0/2536233809 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f9d240368d0 msgr2=0x7f9d24038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:43.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:43.277+0000 7f9d46200700 1 --2- 172.21.15.81:0/2536233809 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f9d240368d0 0x7f9d24038d80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c009990 tx=0x7f9d2c006e40 comp rx=0 tx=0).stop 2024-04-23T14:38:43.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:43.278+0000 7f9d46200700 1 -- 172.21.15.81:0/2536233809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d400fca70 msgr2=0x7f9d40071d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:43.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:43.278+0000 7f9d46200700 1 --2- 172.21.15.81:0/2536233809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d400fca70 0x7f9d40071d60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9d30009680 tx=0x7f9d30009e30 comp rx=0 tx=0).stop 2024-04-23T14:38:43.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:43.278+0000 7f9d46200700 1 -- 172.21.15.81:0/2536233809 shutdown_connections 2024-04-23T14:38:43.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:43.278+0000 7f9d46200700 1 --2- 172.21.15.81:0/2536233809 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f9d240368d0 0x7f9d24038d80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:43.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:43.278+0000 7f9d46200700 1 --2- 172.21.15.81:0/2536233809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d400fca70 0x7f9d40071d60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:43.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:43.278+0000 7f9d46200700 1 -- 172.21.15.81:0/2536233809 >> 172.21.15.81:0/2536233809 conn(0x7f9d400f81d0 msgr2=0x7f9d40103bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:43.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:43.278+0000 7f9d46200700 1 -- 172.21.15.81:0/2536233809 shutdown_connections 2024-04-23T14:38:43.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:43.278+0000 7f9d46200700 1 -- 172.21.15.81:0/2536233809 wait complete. 2024-04-23T14:38:44.473 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:44 smithi081 ceph-mon[25540]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:38:44.473 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:44 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' 2024-04-23T14:38:44.473 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:44 smithi081 ceph-mon[25540]: Added host smithi156 2024-04-23T14:38:44.531 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph orch host ls --format=json 2024-04-23T14:38:45.072 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:38:46.291 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:46 smithi081 ceph-mon[25540]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:38:46.291 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:46 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' 2024-04-23T14:38:46.291 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:46 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' 2024-04-23T14:38:46.292 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:46 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' 2024-04-23T14:38:46.292 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:46 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' 2024-04-23T14:38:46.292 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:46 smithi081 ceph-mon[25540]: Deploying daemon alertmanager.smithi081 on smithi081 2024-04-23T14:38:47.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:47.108+0000 7f3a89800700 1 -- 172.21.15.81:0/1531452061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a840fec70 msgr2=0x7f3a840ff080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:47.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:47.108+0000 7f3a89800700 1 --2- 172.21.15.81:0/1531452061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a840fec70 0x7f3a840ff080 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3a740048c0 tx=0x7f3a74009e30 comp rx=0 tx=0).stop 2024-04-23T14:38:47.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:47.108+0000 7f3a89800700 1 -- 172.21.15.81:0/1531452061 shutdown_connections 2024-04-23T14:38:47.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:47.108+0000 7f3a89800700 1 --2- 172.21.15.81:0/1531452061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a840fec70 0x7f3a840ff080 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:47.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:47.108+0000 7f3a89800700 1 -- 172.21.15.81:0/1531452061 >> 172.21.15.81:0/1531452061 conn(0x7f3a840fa5d0 msgr2=0x7f3a840fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:47.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:47.108+0000 7f3a89800700 1 -- 172.21.15.81:0/1531452061 shutdown_connections 2024-04-23T14:38:47.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:47.108+0000 7f3a89800700 1 -- 172.21.15.81:0/1531452061 wait complete. 2024-04-23T14:38:47.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:47.109+0000 7f3a89800700 1 Processor -- start 2024-04-23T14:38:47.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:47.109+0000 7f3a89800700 1 -- start start 2024-04-23T14:38:47.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:47.109+0000 7f3a89800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a840fec70 0x7f3a8410f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:47.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:47.109+0000 7f3a89800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8410f830 con 0x7f3a840fec70 2024-04-23T14:38:47.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:47.110+0000 7f3a82a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a840fec70 0x7f3a8410f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:47.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:47.110+0000 7f3a82a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a840fec70 0x7f3a8410f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32918/0 (socket says 172.21.15.81:32918) 2024-04-23T14:38:47.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:47.110+0000 7f3a82a00700 1 -- 172.21.15.81:0/858302338 learned_addr learned my addr 172.21.15.81:0/858302338 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:38:47.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:47.110+0000 7f3a82a00700 1 -- 172.21.15.81:0/858302338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a74005040 con 0x7f3a840fec70 2024-04-23T14:38:47.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:47.110+0000 7f3a82a00700 1 --2- 172.21.15.81:0/858302338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a840fec70 0x7f3a8410f2f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3a74009680 tx=0x7f3a74009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:47.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:47.111+0000 7f3a7b400700 1 -- 172.21.15.81:0/858302338 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3a7400b5c0 con 0x7f3a840fec70 2024-04-23T14:38:47.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:47.111+0000 7f3a7b400700 1 -- 172.21.15.81:0/858302338 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3a7400be70 con 0x7f3a840fec70 2024-04-23T14:38:47.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:47.111+0000 7f3a89800700 1 -- 172.21.15.81:0/858302338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a8410fa30 con 0x7f3a840fec70 2024-04-23T14:38:47.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:47.111+0000 7f3a7b400700 1 -- 172.21.15.81:0/858302338 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3a740135a0 con 0x7f3a840fec70 2024-04-23T14:38:47.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:47.111+0000 7f3a89800700 1 -- 172.21.15.81:0/858302338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a84110550 con 0x7f3a840fec70 2024-04-23T14:38:47.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:47.112+0000 7f3a89800700 1 -- 172.21.15.81:0/858302338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a84105180 con 0x7f3a840fec70 2024-04-23T14:38:47.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:47.112+0000 7f3a7b400700 1 -- 172.21.15.81:0/858302338 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f3a74004d30 con 0x7f3a840fec70 2024-04-23T14:38:47.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:47.113+0000 7f3a7b400700 1 --2- 172.21.15.81:0/858302338 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f3a68036880 0x7f3a68038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:47.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:47.113+0000 7f3a7b400700 1 -- 172.21.15.81:0/858302338 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f3a74049460 con 0x7f3a840fec70 2024-04-23T14:38:47.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:47.113+0000 7f3a7a000700 1 --2- 172.21.15.81:0/858302338 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f3a68036880 0x7f3a68038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:47.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:47.114+0000 7f3a7a000700 1 --2- 172.21.15.81:0/858302338 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f3a68036880 0x7f3a68038d30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c00ad90 tx=0x7f3a6c009410 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:47.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:47.118+0000 7f3a7b400700 1 -- 172.21.15.81:0/858302338 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3a74011960 con 0x7f3a840fec70 2024-04-23T14:38:47.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:47.337+0000 7f3a89800700 1 -- 172.21.15.81:0/858302338 --> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3a8405f690 con 0x7f3a68036880 2024-04-23T14:38:47.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:47.340+0000 7f3a7b400700 1 -- 172.21.15.81:0/858302338 <== mgr.14162 v2:172.21.15.81:6800/3624015234 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7f3a8405f690 con 0x7f3a68036880 2024-04-23T14:38:47.340 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:38:47.340 INFO:teuthology.orchestra.run.smithi081.stdout:[{"addr": "172.21.15.81", "hostname": "smithi081", "labels": [], "status": ""}, {"addr": "172.21.15.156", "hostname": "smithi156", "labels": [], "status": ""}] 2024-04-23T14:38:47.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:47.342+0000 7f3a89800700 1 -- 172.21.15.81:0/858302338 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f3a68036880 msgr2=0x7f3a68038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:47.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:47.342+0000 7f3a89800700 1 --2- 172.21.15.81:0/858302338 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f3a68036880 0x7f3a68038d30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c00ad90 tx=0x7f3a6c009410 comp rx=0 tx=0).stop 2024-04-23T14:38:47.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:47.342+0000 7f3a89800700 1 -- 172.21.15.81:0/858302338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a840fec70 msgr2=0x7f3a8410f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:47.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:47.342+0000 7f3a89800700 1 --2- 172.21.15.81:0/858302338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a840fec70 0x7f3a8410f2f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3a74009680 tx=0x7f3a74009e30 comp rx=0 tx=0).stop 2024-04-23T14:38:47.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:47.343+0000 7f3a89800700 1 -- 172.21.15.81:0/858302338 shutdown_connections 2024-04-23T14:38:47.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:47.343+0000 7f3a89800700 1 --2- 172.21.15.81:0/858302338 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f3a68036880 0x7f3a68038d30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:47.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:47.343+0000 7f3a89800700 1 --2- 172.21.15.81:0/858302338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a840fec70 0x7f3a8410f2f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:47.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:47.343+0000 7f3a89800700 1 -- 172.21.15.81:0/858302338 >> 172.21.15.81:0/858302338 conn(0x7f3a840fa5d0 msgr2=0x7f3a840fc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:47.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:47.343+0000 7f3a89800700 1 -- 172.21.15.81:0/858302338 shutdown_connections 2024-04-23T14:38:47.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:47.343+0000 7f3a89800700 1 -- 172.21.15.81:0/858302338 wait complete. 2024-04-23T14:38:48.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:47 smithi081 ceph-mon[25540]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:38:48.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:47 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' 2024-04-23T14:38:48.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:47 smithi081 ceph-mon[25540]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T14:38:48.424 INFO:tasks.cephadm:Setting crush tunables to default 2024-04-23T14:38:48.425 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph osd crush tunables default 2024-04-23T14:38:48.875 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:38:50.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:49 smithi081 ceph-mon[25540]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:38:52.008 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:51 smithi081 ceph-mon[25540]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:38:54.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:53 smithi081 ceph-mon[25540]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:38:54.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:54.278+0000 7f6c43000700 1 -- 172.21.15.81:0/771914965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c3c065d00 msgr2=0x7f6c3c0ff6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:54.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:54.278+0000 7f6c43000700 1 --2- 172.21.15.81:0/771914965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c3c065d00 0x7f6c3c0ff6c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c0048c0 tx=0x7f6c2c009e30 comp rx=0 tx=0).stop 2024-04-23T14:38:54.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:54.278+0000 7f6c43000700 1 -- 172.21.15.81:0/771914965 shutdown_connections 2024-04-23T14:38:54.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:54.279+0000 7f6c43000700 1 --2- 172.21.15.81:0/771914965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c3c065d00 0x7f6c3c0ff6c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:54.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:54.279+0000 7f6c43000700 1 -- 172.21.15.81:0/771914965 >> 172.21.15.81:0/771914965 conn(0x7f6c3c0f70d0 msgr2=0x7f6c3c0f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:54.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:54.279+0000 7f6c43000700 1 -- 172.21.15.81:0/771914965 shutdown_connections 2024-04-23T14:38:54.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:54.279+0000 7f6c43000700 1 -- 172.21.15.81:0/771914965 wait complete. 2024-04-23T14:38:54.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:54.280+0000 7f6c43000700 1 Processor -- start 2024-04-23T14:38:54.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:54.280+0000 7f6c43000700 1 -- start start 2024-04-23T14:38:54.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:54.281+0000 7f6c43000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c3c065d00 0x7f6c3c0fd010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:54.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:54.281+0000 7f6c43000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3c0fd550 con 0x7f6c3c065d00 2024-04-23T14:38:54.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:54.281+0000 7f6c3be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c3c065d00 0x7f6c3c0fd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:54.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:54.281+0000 7f6c3be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c3c065d00 0x7f6c3c0fd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54766/0 (socket says 172.21.15.81:54766) 2024-04-23T14:38:54.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:54.281+0000 7f6c3be00700 1 -- 172.21.15.81:0/3369781589 learned_addr learned my addr 172.21.15.81:0/3369781589 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:38:54.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:54.281+0000 7f6c3be00700 1 -- 172.21.15.81:0/3369781589 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c2c005040 con 0x7f6c3c065d00 2024-04-23T14:38:54.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:54.282+0000 7f6c3be00700 1 --2- 172.21.15.81:0/3369781589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c3c065d00 0x7f6c3c0fd010 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c00b900 tx=0x7f6c2c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:54.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:54.282+0000 7f6c33e00700 1 -- 172.21.15.81:0/3369781589 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c2c00b5c0 con 0x7f6c3c065d00 2024-04-23T14:38:54.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:54.282+0000 7f6c33e00700 1 -- 172.21.15.81:0/3369781589 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6c2c00be70 con 0x7f6c3c065d00 2024-04-23T14:38:54.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:54.282+0000 7f6c33e00700 1 -- 172.21.15.81:0/3369781589 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c2c01c590 con 0x7f6c3c065d00 2024-04-23T14:38:54.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:54.282+0000 7f6c43000700 1 -- 172.21.15.81:0/3369781589 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c3c0fb620 con 0x7f6c3c065d00 2024-04-23T14:38:54.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:54.282+0000 7f6c43000700 1 -- 172.21.15.81:0/3369781589 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c3c0fbb10 con 0x7f6c3c065d00 2024-04-23T14:38:54.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:54.283+0000 7f6c33e00700 1 -- 172.21.15.81:0/3369781589 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f6c2c013420 con 0x7f6c3c065d00 2024-04-23T14:38:54.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:54.283+0000 7f6c33e00700 1 --2- 172.21.15.81:0/3369781589 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f6c200368d0 0x7f6c20038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:54.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:54.284+0000 7f6c33e00700 1 -- 172.21.15.81:0/3369781589 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f6c2c0495b0 con 0x7f6c3c065d00 2024-04-23T14:38:54.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:54.284+0000 7f6c3b400700 1 --2- 172.21.15.81:0/3369781589 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f6c200368d0 0x7f6c20038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:54.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:54.284+0000 7f6c31600700 1 -- 172.21.15.81:0/3369781589 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c140052b0 con 0x7f6c3c065d00 2024-04-23T14:38:54.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:54.285+0000 7f6c3b400700 1 --2- 172.21.15.81:0/3369781589 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f6c200368d0 0x7f6c20038d80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6c28009990 tx=0x7f6c28006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:54.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:54.290+0000 7f6c33e00700 1 -- 172.21.15.81:0/3369781589 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6c2c021030 con 0x7f6c3c065d00 2024-04-23T14:38:54.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:54.513+0000 7f6c31600700 1 -- 172.21.15.81:0/3369781589 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f6c14005560 con 0x7f6c3c065d00 2024-04-23T14:38:54.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:54.920+0000 7f6c33e00700 1 -- 172.21.15.81:0/3369781589 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f6c2c02e070 con 0x7f6c3c065d00 2024-04-23T14:38:54.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:54.924+0000 7f6c31600700 1 -- 172.21.15.81:0/3369781589 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f6c200368d0 msgr2=0x7f6c20038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:54.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:54.924+0000 7f6c31600700 1 --2- 172.21.15.81:0/3369781589 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f6c200368d0 0x7f6c20038d80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6c28009990 tx=0x7f6c28006e40 comp rx=0 tx=0).stop 2024-04-23T14:38:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:54.924+0000 7f6c31600700 1 -- 172.21.15.81:0/3369781589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c3c065d00 msgr2=0x7f6c3c0fd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:54.924+0000 7f6c31600700 1 --2- 172.21.15.81:0/3369781589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c3c065d00 0x7f6c3c0fd010 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c00b900 tx=0x7f6c2c009e30 comp rx=0 tx=0).stop 2024-04-23T14:38:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:54.924+0000 7f6c31600700 1 -- 172.21.15.81:0/3369781589 shutdown_connections 2024-04-23T14:38:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:54.924+0000 7f6c31600700 1 --2- 172.21.15.81:0/3369781589 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f6c200368d0 0x7f6c20038d80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:54.924+0000 7f6c31600700 1 --2- 172.21.15.81:0/3369781589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c3c065d00 0x7f6c3c0fd010 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:54.924+0000 7f6c31600700 1 -- 172.21.15.81:0/3369781589 >> 172.21.15.81:0/3369781589 conn(0x7f6c3c0f70d0 msgr2=0x7f6c3c103ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:54.924+0000 7f6c31600700 1 -- 172.21.15.81:0/3369781589 shutdown_connections 2024-04-23T14:38:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:38:54.924+0000 7f6c31600700 1 -- 172.21.15.81:0/3369781589 wait complete. 2024-04-23T14:38:54.926 INFO:teuthology.orchestra.run.smithi081.stderr:adjusted tunables profile to default 2024-04-23T14:38:55.124 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:54 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/3369781589' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-23T14:38:56.078 INFO:tasks.cephadm:Adding mon.smithi081 on smithi081 2024-04-23T14:38:56.078 INFO:tasks.cephadm:Adding mon.smithi156 on smithi156 2024-04-23T14:38:56.078 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph orch apply mon '2;smithi081:172.21.15.81=smithi081;smithi156:172.21.15.156=smithi156' 2024-04-23T14:38:56.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:55 smithi081 ceph-mon[25540]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:38:56.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:55 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/3369781589' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-23T14:38:56.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:55 smithi081 ceph-mon[25540]: osdmap e4: 0 total, 0 up, 0 in 2024-04-23T14:38:56.544 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-23T14:38:56.647 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-23T14:38:58.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:58 smithi081 ceph-mon[25540]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:38:58.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:58 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' 2024-04-23T14:38:58.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:58 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' 2024-04-23T14:38:58.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:58 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' 2024-04-23T14:38:58.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:58 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' 2024-04-23T14:38:58.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:58 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' 2024-04-23T14:38:58.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:58 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' 2024-04-23T14:38:58.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:58 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-23T14:38:58.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:58 smithi081 ceph-mon[25540]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-23T14:38:58.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:58 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' 2024-04-23T14:38:58.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:38:58 smithi081 ceph-mon[25540]: Deploying daemon grafana.smithi081 on smithi081 2024-04-23T14:38:58.854 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:38:58.852+0000 7f8d1aa00700 1 -- 172.21.15.156:0/91439550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d140fc850 msgr2=0x7f8d140fcc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:58.854 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:38:58.852+0000 7f8d1aa00700 1 --2- 172.21.15.156:0/91439550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d140fc850 0x7f8d140fcc60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8d080048c0 tx=0x7f8d08009e30 comp rx=0 tx=0).stop 2024-04-23T14:38:58.854 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:38:58.852+0000 7f8d1aa00700 1 -- 172.21.15.156:0/91439550 shutdown_connections 2024-04-23T14:38:58.855 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:38:58.852+0000 7f8d1aa00700 1 --2- 172.21.15.156:0/91439550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d140fc850 0x7f8d140fcc60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:58.855 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:38:58.852+0000 7f8d1aa00700 1 -- 172.21.15.156:0/91439550 >> 172.21.15.156:0/91439550 conn(0x7f8d140f7fb0 msgr2=0x7f8d140fa3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:58.855 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:38:58.852+0000 7f8d1aa00700 1 -- 172.21.15.156:0/91439550 shutdown_connections 2024-04-23T14:38:58.855 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:38:58.853+0000 7f8d1aa00700 1 -- 172.21.15.156:0/91439550 wait complete. 2024-04-23T14:38:58.855 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:38:58.854+0000 7f8d1aa00700 1 Processor -- start 2024-04-23T14:38:58.856 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:38:58.854+0000 7f8d1aa00700 1 -- start start 2024-04-23T14:38:58.856 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:38:58.855+0000 7f8d1aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d140fc850 0x7f8d14071d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:58.856 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:38:58.855+0000 7f8d1aa00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d140722a0 con 0x7f8d140fc850 2024-04-23T14:38:58.856 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:38:58.855+0000 7f8d19600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d140fc850 0x7f8d14071d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:58.856 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:38:58.855+0000 7f8d19600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d140fc850 0x7f8d14071d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.156:51358/0 (socket says 172.21.15.156:51358) 2024-04-23T14:38:58.857 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:38:58.855+0000 7f8d19600700 1 -- 172.21.15.156:0/4103722468 learned_addr learned my addr 172.21.15.156:0/4103722468 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-04-23T14:38:58.857 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:38:58.856+0000 7f8d19600700 1 -- 172.21.15.156:0/4103722468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d08005040 con 0x7f8d140fc850 2024-04-23T14:38:58.857 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:38:58.856+0000 7f8d19600700 1 --2- 172.21.15.156:0/4103722468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d140fc850 0x7f8d14071d60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8d08009680 tx=0x7f8d08009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:58.858 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:38:58.857+0000 7f8d11600700 1 -- 172.21.15.156:0/4103722468 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8d0800b5c0 con 0x7f8d140fc850 2024-04-23T14:38:58.858 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:38:58.857+0000 7f8d1aa00700 1 -- 172.21.15.156:0/4103722468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d14070370 con 0x7f8d140fc850 2024-04-23T14:38:58.858 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:38:58.857+0000 7f8d1aa00700 1 -- 172.21.15.156:0/4103722468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d14070860 con 0x7f8d140fc850 2024-04-23T14:38:58.858 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:38:58.857+0000 7f8d11600700 1 -- 172.21.15.156:0/4103722468 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8d0800be70 con 0x7f8d140fc850 2024-04-23T14:38:58.858 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:38:58.857+0000 7f8d11600700 1 -- 172.21.15.156:0/4103722468 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8d080135c0 con 0x7f8d140fc850 2024-04-23T14:38:58.859 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:38:58.858+0000 7f8d1aa00700 1 -- 172.21.15.156:0/4103722468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d1405f5f0 con 0x7f8d140fc850 2024-04-23T14:38:58.859 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:38:58.859+0000 7f8d11600700 1 -- 172.21.15.156:0/4103722468 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f8d08004d30 con 0x7f8d140fc850 2024-04-23T14:38:58.860 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:38:58.859+0000 7f8d11600700 1 --2- 172.21.15.156:0/4103722468 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f8cfc036830 0x7f8cfc038ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:38:58.860 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:38:58.859+0000 7f8d11600700 1 -- 172.21.15.156:0/4103722468 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f8d080494d0 con 0x7f8d140fc850 2024-04-23T14:38:58.861 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:38:58.860+0000 7f8d18c00700 1 --2- 172.21.15.156:0/4103722468 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f8cfc036830 0x7f8cfc038ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:38:58.862 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:38:58.861+0000 7f8d18c00700 1 --2- 172.21.15.156:0/4103722468 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f8cfc036830 0x7f8cfc038ce0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8d00009990 tx=0x7f8d00006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:38:58.881 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:38:58.880+0000 7f8d11600700 1 -- 172.21.15.156:0/4103722468 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f8d08011550 con 0x7f8d140fc850 2024-04-23T14:38:59.104 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:38:59.103+0000 7f8d1aa00700 1 -- 172.21.15.156:0/4103722468 --> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi081:172.21.15.81=smithi081;smithi156:172.21.15.156=smithi156", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d14106350 con 0x7f8cfc036830 2024-04-23T14:38:59.122 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:38:59.121+0000 7f8d11600700 1 -- 172.21.15.156:0/4103722468 <== mgr.14162 v2:172.21.15.81:6800/3624015234 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f8d14106350 con 0x7f8cfc036830 2024-04-23T14:38:59.123 INFO:teuthology.orchestra.run.smithi156.stdout:Scheduled mon update... 2024-04-23T14:38:59.125 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:38:59.124+0000 7f8d1aa00700 1 -- 172.21.15.156:0/4103722468 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f8cfc036830 msgr2=0x7f8cfc038ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:59.125 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:38:59.124+0000 7f8d1aa00700 1 --2- 172.21.15.156:0/4103722468 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f8cfc036830 0x7f8cfc038ce0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8d00009990 tx=0x7f8d00006e40 comp rx=0 tx=0).stop 2024-04-23T14:38:59.125 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:38:59.124+0000 7f8d1aa00700 1 -- 172.21.15.156:0/4103722468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d140fc850 msgr2=0x7f8d14071d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:38:59.125 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:38:59.124+0000 7f8d1aa00700 1 --2- 172.21.15.156:0/4103722468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d140fc850 0x7f8d14071d60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8d08009680 tx=0x7f8d08009e30 comp rx=0 tx=0).stop 2024-04-23T14:38:59.126 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:38:59.124+0000 7f8d1aa00700 1 -- 172.21.15.156:0/4103722468 shutdown_connections 2024-04-23T14:38:59.126 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:38:59.124+0000 7f8d1aa00700 1 --2- 172.21.15.156:0/4103722468 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f8cfc036830 0x7f8cfc038ce0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:59.126 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:38:59.124+0000 7f8d1aa00700 1 --2- 172.21.15.156:0/4103722468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d140fc850 0x7f8d14071d60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:38:59.126 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:38:59.124+0000 7f8d1aa00700 1 -- 172.21.15.156:0/4103722468 >> 172.21.15.156:0/4103722468 conn(0x7f8d140f7fb0 msgr2=0x7f8d14103990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:38:59.126 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:38:59.124+0000 7f8d1aa00700 1 -- 172.21.15.156:0/4103722468 shutdown_connections 2024-04-23T14:38:59.126 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:38:59.124+0000 7f8d1aa00700 1 -- 172.21.15.156:0/4103722468 wait complete. 2024-04-23T14:38:59.825 DEBUG:teuthology.orchestra.run.smithi156:mon.smithi156> sudo journalctl -f -n 0 -u ceph-7a641bea-017e-11ef-bc93-c7b262605968@mon.smithi156.service 2024-04-23T14:38:59.830 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-23T14:38:59.830 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-23T14:39:00.284 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-23T14:39:00.380 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-23T14:39:00.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:00 smithi081 ceph-mon[25540]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:00.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:00 smithi081 ceph-mon[25540]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi081:172.21.15.81=smithi081;smithi156:172.21.15.156=smithi156", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:39:00.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:00 smithi081 ceph-mon[25540]: Saving service mon spec with placement smithi081:172.21.15.81=smithi081;smithi156:172.21.15.156=smithi156;count:2 2024-04-23T14:39:00.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:00 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' 2024-04-23T14:39:02.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:02 smithi081 ceph-mon[25540]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:02.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:02 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' 2024-04-23T14:39:02.678 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:02.676+0000 7f6b7b800700 1 -- 172.21.15.156:0/1501980714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b74071ea0 msgr2=0x7f6b740703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:02.678 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:02.676+0000 7f6b7b800700 1 --2- 172.21.15.156:0/1501980714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b74071ea0 0x7f6b740703b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6b680048c0 tx=0x7f6b68009e30 comp rx=0 tx=0).stop 2024-04-23T14:39:02.678 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:02.676+0000 7f6b7b800700 1 -- 172.21.15.156:0/1501980714 shutdown_connections 2024-04-23T14:39:02.678 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:02.676+0000 7f6b7b800700 1 --2- 172.21.15.156:0/1501980714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b74071ea0 0x7f6b740703b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:02.678 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:02.676+0000 7f6b7b800700 1 -- 172.21.15.156:0/1501980714 >> 172.21.15.156:0/1501980714 conn(0x7f6b740f81d0 msgr2=0x7f6b740fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:02.678 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:02.676+0000 7f6b7b800700 1 -- 172.21.15.156:0/1501980714 shutdown_connections 2024-04-23T14:39:02.678 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:02.676+0000 7f6b7b800700 1 -- 172.21.15.156:0/1501980714 wait complete. 2024-04-23T14:39:02.679 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:02.678+0000 7f6b7b800700 1 Processor -- start 2024-04-23T14:39:02.679 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:02.678+0000 7f6b7b800700 1 -- start start 2024-04-23T14:39:02.679 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:02.678+0000 7f6b7b800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b74071ea0 0x7f6b741136d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:02.679 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:02.678+0000 7f6b7b800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b74113c10 con 0x7f6b74071ea0 2024-04-23T14:39:02.680 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:02.679+0000 7f6b78e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b74071ea0 0x7f6b741136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:02.680 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:02.679+0000 7f6b78e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b74071ea0 0x7f6b741136d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.156:43858/0 (socket says 172.21.15.156:43858) 2024-04-23T14:39:02.680 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:02.679+0000 7f6b78e00700 1 -- 172.21.15.156:0/141476420 learned_addr learned my addr 172.21.15.156:0/141476420 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-04-23T14:39:02.680 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:02.679+0000 7f6b78e00700 1 -- 172.21.15.156:0/141476420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b68005040 con 0x7f6b74071ea0 2024-04-23T14:39:02.680 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:02.680+0000 7f6b78e00700 1 --2- 172.21.15.156:0/141476420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b74071ea0 0x7f6b741136d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6b68009680 tx=0x7f6b68009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:02.681 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:02.680+0000 7f6b70c00700 1 -- 172.21.15.156:0/141476420 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6b6800bed0 con 0x7f6b74071ea0 2024-04-23T14:39:02.681 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:02.680+0000 7f6b7b800700 1 -- 172.21.15.156:0/141476420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b74113e10 con 0x7f6b74071ea0 2024-04-23T14:39:02.681 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:02.680+0000 7f6b70c00700 1 -- 172.21.15.156:0/141476420 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6b6800b5c0 con 0x7f6b74071ea0 2024-04-23T14:39:02.681 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:02.680+0000 7f6b70c00700 1 -- 172.21.15.156:0/141476420 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6b6801c5b0 con 0x7f6b74071ea0 2024-04-23T14:39:02.681 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:02.680+0000 7f6b7b800700 1 -- 172.21.15.156:0/141476420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b74114980 con 0x7f6b74071ea0 2024-04-23T14:39:02.683 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:02.682+0000 7f6b7b800700 1 -- 172.21.15.156:0/141476420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b741095b0 con 0x7f6b74071ea0 2024-04-23T14:39:02.683 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:02.682+0000 7f6b70c00700 1 -- 172.21.15.156:0/141476420 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f6b68004d30 con 0x7f6b74071ea0 2024-04-23T14:39:02.683 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:02.683+0000 7f6b70c00700 1 --2- 172.21.15.156:0/141476420 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f6b5c0368d0 0x7f6b5c038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:02.683 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:02.683+0000 7f6b70c00700 1 -- 172.21.15.156:0/141476420 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f6b68049990 con 0x7f6b74071ea0 2024-04-23T14:39:02.684 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:02.683+0000 7f6b73e00700 1 --2- 172.21.15.156:0/141476420 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f6b5c0368d0 0x7f6b5c038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:02.685 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:02.684+0000 7f6b73e00700 1 --2- 172.21.15.156:0/141476420 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f6b5c0368d0 0x7f6b5c038d80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6b60009990 tx=0x7f6b60006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:02.693 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:02.693+0000 7f6b70c00700 1 -- 172.21.15.156:0/141476420 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6b68011940 con 0x7f6b74071ea0 2024-04-23T14:39:02.976 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:02.975+0000 7f6b7b800700 1 -- 172.21.15.156:0/141476420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6b74115390 con 0x7f6b74071ea0 2024-04-23T14:39:02.976 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:02.975+0000 7f6b70c00700 1 -- 172.21.15.156:0/141476420 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f6b68011370 con 0x7f6b74071ea0 2024-04-23T14:39:02.976 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:39:02.977 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":1,"fsid":"7a641bea-017e-11ef-bc93-c7b262605968","modified":"2024-04-23T14:37:02.223037Z","created":"2024-04-23T14:37:02.223037Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi081","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-23T14:39:02.979 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:02.978+0000 7f6b7b800700 1 -- 172.21.15.156:0/141476420 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f6b5c0368d0 msgr2=0x7f6b5c038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:02.979 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:02.978+0000 7f6b7b800700 1 --2- 172.21.15.156:0/141476420 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f6b5c0368d0 0x7f6b5c038d80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6b60009990 tx=0x7f6b60006e40 comp rx=0 tx=0).stop 2024-04-23T14:39:02.980 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:02.978+0000 7f6b7b800700 1 -- 172.21.15.156:0/141476420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b74071ea0 msgr2=0x7f6b741136d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:02.980 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:02.978+0000 7f6b7b800700 1 --2- 172.21.15.156:0/141476420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b74071ea0 0x7f6b741136d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6b68009680 tx=0x7f6b68009e30 comp rx=0 tx=0).stop 2024-04-23T14:39:02.980 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:02.978+0000 7f6b7b800700 1 -- 172.21.15.156:0/141476420 shutdown_connections 2024-04-23T14:39:02.980 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:02.978+0000 7f6b7b800700 1 --2- 172.21.15.156:0/141476420 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f6b5c0368d0 0x7f6b5c038d80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:02.980 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:02.978+0000 7f6b7b800700 1 --2- 172.21.15.156:0/141476420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b74071ea0 0x7f6b741136d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:02.980 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:02.978+0000 7f6b7b800700 1 -- 172.21.15.156:0/141476420 >> 172.21.15.156:0/141476420 conn(0x7f6b740f81d0 msgr2=0x7f6b7410a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:02.980 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:02.979+0000 7f6b7b800700 1 -- 172.21.15.156:0/141476420 shutdown_connections 2024-04-23T14:39:02.980 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:02.979+0000 7f6b7b800700 1 -- 172.21.15.156:0/141476420 wait complete. 2024-04-23T14:39:02.981 INFO:teuthology.orchestra.run.smithi156.stderr:dumped monmap epoch 1 2024-04-23T14:39:03.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:03 smithi081 ceph-mon[25540]: from='client.? 172.21.15.156:0/141476420' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-23T14:39:04.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:04 smithi081 ceph-mon[25540]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:04.722 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-23T14:39:04.722 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-23T14:39:05.168 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-23T14:39:05.281 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-23T14:39:06.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:06 smithi081 ceph-mon[25540]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:07.192 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:07.190+0000 7f2dabc00700 1 -- 172.21.15.156:0/2582468880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2da40fec70 msgr2=0x7f2da40ff080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:07.192 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:07.190+0000 7f2dabc00700 1 --2- 172.21.15.156:0/2582468880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2da40fec70 0x7f2da40ff080 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2d940048c0 tx=0x7f2d94009e30 comp rx=0 tx=0).stop 2024-04-23T14:39:07.192 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:07.190+0000 7f2dabc00700 1 -- 172.21.15.156:0/2582468880 shutdown_connections 2024-04-23T14:39:07.192 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:07.190+0000 7f2dabc00700 1 --2- 172.21.15.156:0/2582468880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2da40fec70 0x7f2da40ff080 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:07.192 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:07.190+0000 7f2dabc00700 1 -- 172.21.15.156:0/2582468880 >> 172.21.15.156:0/2582468880 conn(0x7f2da40fa5d0 msgr2=0x7f2da40fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:07.192 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:07.191+0000 7f2dabc00700 1 -- 172.21.15.156:0/2582468880 shutdown_connections 2024-04-23T14:39:07.192 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:07.191+0000 7f2dabc00700 1 -- 172.21.15.156:0/2582468880 wait complete. 2024-04-23T14:39:07.193 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:07.192+0000 7f2dabc00700 1 Processor -- start 2024-04-23T14:39:07.193 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:07.192+0000 7f2dabc00700 1 -- start start 2024-04-23T14:39:07.193 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:07.192+0000 7f2dabc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2da40fec70 0x7f2da410f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:07.193 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:07.192+0000 7f2dabc00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da410f830 con 0x7f2da40fec70 2024-04-23T14:39:07.194 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:07.193+0000 7f2da9200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2da40fec70 0x7f2da410f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:07.194 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:07.193+0000 7f2da9200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2da40fec70 0x7f2da410f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.156:43862/0 (socket says 172.21.15.156:43862) 2024-04-23T14:39:07.194 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:07.193+0000 7f2da9200700 1 -- 172.21.15.156:0/367494775 learned_addr learned my addr 172.21.15.156:0/367494775 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-04-23T14:39:07.194 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:07.194+0000 7f2da9200700 1 -- 172.21.15.156:0/367494775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d94005040 con 0x7f2da40fec70 2024-04-23T14:39:07.195 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:07.194+0000 7f2da9200700 1 --2- 172.21.15.156:0/367494775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2da40fec70 0x7f2da410f2f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2d94009680 tx=0x7f2d94009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:07.195 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:07.194+0000 7f2da1600700 1 -- 172.21.15.156:0/367494775 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2d9400b5c0 con 0x7f2da40fec70 2024-04-23T14:39:07.195 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:07.195+0000 7f2dabc00700 1 -- 172.21.15.156:0/367494775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2da410fa30 con 0x7f2da40fec70 2024-04-23T14:39:07.196 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:07.195+0000 7f2da1600700 1 -- 172.21.15.156:0/367494775 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2d9400be70 con 0x7f2da40fec70 2024-04-23T14:39:07.196 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:07.195+0000 7f2da1600700 1 -- 172.21.15.156:0/367494775 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2d940135a0 con 0x7f2da40fec70 2024-04-23T14:39:07.196 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:07.195+0000 7f2dabc00700 1 -- 172.21.15.156:0/367494775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da4110550 con 0x7f2da40fec70 2024-04-23T14:39:07.196 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:07.196+0000 7f2dabc00700 1 -- 172.21.15.156:0/367494775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2da4105180 con 0x7f2da40fec70 2024-04-23T14:39:07.197 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:07.196+0000 7f2da1600700 1 -- 172.21.15.156:0/367494775 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f2d9401ca90 con 0x7f2da40fec70 2024-04-23T14:39:07.197 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:07.197+0000 7f2da1600700 1 --2- 172.21.15.156:0/367494775 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f2d880368d0 0x7f2d88038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:07.198 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:07.197+0000 7f2da1600700 1 -- 172.21.15.156:0/367494775 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f2d940493f0 con 0x7f2da40fec70 2024-04-23T14:39:07.198 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:07.197+0000 7f2d9be00700 1 --2- 172.21.15.156:0/367494775 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f2d880368d0 0x7f2d88038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:07.199 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:07.198+0000 7f2d9be00700 1 --2- 172.21.15.156:0/367494775 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f2d880368d0 0x7f2d88038d80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c009990 tx=0x7f2d8c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:07.208 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:07.207+0000 7f2da1600700 1 -- 172.21.15.156:0/367494775 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2d94024360 con 0x7f2da40fec70 2024-04-23T14:39:07.503 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:07.502+0000 7f2dabc00700 1 -- 172.21.15.156:0/367494775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2da404bed0 con 0x7f2da40fec70 2024-04-23T14:39:07.504 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:07.503+0000 7f2da1600700 1 -- 172.21.15.156:0/367494775 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f2d94021020 con 0x7f2da40fec70 2024-04-23T14:39:07.504 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:39:07.505 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":1,"fsid":"7a641bea-017e-11ef-bc93-c7b262605968","modified":"2024-04-23T14:37:02.223037Z","created":"2024-04-23T14:37:02.223037Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi081","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-23T14:39:07.507 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:07.506+0000 7f2dabc00700 1 -- 172.21.15.156:0/367494775 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f2d880368d0 msgr2=0x7f2d88038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:07.507 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:07.506+0000 7f2dabc00700 1 --2- 172.21.15.156:0/367494775 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f2d880368d0 0x7f2d88038d80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c009990 tx=0x7f2d8c006e40 comp rx=0 tx=0).stop 2024-04-23T14:39:07.507 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:07.506+0000 7f2dabc00700 1 -- 172.21.15.156:0/367494775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2da40fec70 msgr2=0x7f2da410f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:07.507 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:07.506+0000 7f2dabc00700 1 --2- 172.21.15.156:0/367494775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2da40fec70 0x7f2da410f2f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2d94009680 tx=0x7f2d94009e30 comp rx=0 tx=0).stop 2024-04-23T14:39:07.507 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:07.506+0000 7f2dabc00700 1 -- 172.21.15.156:0/367494775 shutdown_connections 2024-04-23T14:39:07.508 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:07.506+0000 7f2dabc00700 1 --2- 172.21.15.156:0/367494775 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f2d880368d0 0x7f2d88038d80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:07.508 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:07.506+0000 7f2dabc00700 1 --2- 172.21.15.156:0/367494775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2da40fec70 0x7f2da410f2f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:07.508 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:07.506+0000 7f2dabc00700 1 -- 172.21.15.156:0/367494775 >> 172.21.15.156:0/367494775 conn(0x7f2da40fa5d0 msgr2=0x7f2da40fc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:07.508 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:07.506+0000 7f2dabc00700 1 -- 172.21.15.156:0/367494775 shutdown_connections 2024-04-23T14:39:07.508 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:07.506+0000 7f2dabc00700 1 -- 172.21.15.156:0/367494775 wait complete. 2024-04-23T14:39:07.508 INFO:teuthology.orchestra.run.smithi156.stderr:dumped monmap epoch 1 2024-04-23T14:39:08.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:08 smithi081 ceph-mon[25540]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:08.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:08 smithi081 ceph-mon[25540]: from='client.? 172.21.15.156:0/367494775' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-23T14:39:09.145 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-23T14:39:09.146 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-23T14:39:09.585 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-23T14:39:09.686 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-23T14:39:10.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:10 smithi081 ceph-mon[25540]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:11.566 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:11.565+0000 7f7fbf200700 1 -- 172.21.15.156:0/274372617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fc0103160 msgr2=0x7f7fc0103570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:11.567 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:11.565+0000 7f7fbf200700 1 --2- 172.21.15.156:0/274372617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fc0103160 0x7f7fc0103570 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7fb00048c0 tx=0x7f7fb0009e30 comp rx=0 tx=0).stop 2024-04-23T14:39:11.567 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:11.565+0000 7f7fbf200700 1 -- 172.21.15.156:0/274372617 shutdown_connections 2024-04-23T14:39:11.567 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:11.565+0000 7f7fbf200700 1 --2- 172.21.15.156:0/274372617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fc0103160 0x7f7fc0103570 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:11.567 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:11.565+0000 7f7fbf200700 1 -- 172.21.15.156:0/274372617 >> 172.21.15.156:0/274372617 conn(0x7f7fc0072080 msgr2=0x7f7fc0074490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:11.567 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:11.565+0000 7f7fbf200700 1 -- 172.21.15.156:0/274372617 shutdown_connections 2024-04-23T14:39:11.567 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:11.565+0000 7f7fbf200700 1 -- 172.21.15.156:0/274372617 wait complete. 2024-04-23T14:39:11.568 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:11.566+0000 7f7fbf200700 1 Processor -- start 2024-04-23T14:39:11.568 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:11.567+0000 7f7fbf200700 1 -- start start 2024-04-23T14:39:11.568 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:11.567+0000 7f7fbf200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fc0103160 0x7f7fc0113490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:11.568 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:11.567+0000 7f7fbf200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc01139d0 con 0x7f7fc0103160 2024-04-23T14:39:11.568 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:11.568+0000 7f7fbde00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fc0103160 0x7f7fc0113490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:11.568 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:11.568+0000 7f7fbde00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fc0103160 0x7f7fc0113490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.156:48044/0 (socket says 172.21.15.156:48044) 2024-04-23T14:39:11.569 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:11.568+0000 7f7fbde00700 1 -- 172.21.15.156:0/2343559528 learned_addr learned my addr 172.21.15.156:0/2343559528 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-04-23T14:39:11.569 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:11.568+0000 7f7fbde00700 1 -- 172.21.15.156:0/2343559528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb0005040 con 0x7f7fc0103160 2024-04-23T14:39:11.569 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:11.569+0000 7f7fbde00700 1 --2- 172.21.15.156:0/2343559528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fc0103160 0x7f7fc0113490 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7fb000b900 tx=0x7f7fb0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:11.570 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:11.569+0000 7f7fb6000700 1 -- 172.21.15.156:0/2343559528 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7fb000bed0 con 0x7f7fc0103160 2024-04-23T14:39:11.570 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:11.569+0000 7f7fbf200700 1 -- 172.21.15.156:0/2343559528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fc0113bd0 con 0x7f7fc0103160 2024-04-23T14:39:11.570 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:11.569+0000 7f7fb6000700 1 -- 172.21.15.156:0/2343559528 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7fb000b5c0 con 0x7f7fc0103160 2024-04-23T14:39:11.570 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:11.569+0000 7f7fb6000700 1 -- 172.21.15.156:0/2343559528 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7fb001c5b0 con 0x7f7fc0103160 2024-04-23T14:39:11.570 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:11.569+0000 7f7fbf200700 1 -- 172.21.15.156:0/2343559528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fc0114740 con 0x7f7fc0103160 2024-04-23T14:39:11.571 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:11.570+0000 7f7fbf200700 1 -- 172.21.15.156:0/2343559528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fc0109390 con 0x7f7fc0103160 2024-04-23T14:39:11.572 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:11.571+0000 7f7fb6000700 1 -- 172.21.15.156:0/2343559528 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f7fb0004d30 con 0x7f7fc0103160 2024-04-23T14:39:11.572 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:11.572+0000 7f7fb6000700 1 --2- 172.21.15.156:0/2343559528 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f7fa4036830 0x7f7fa4038ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:11.572 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:11.572+0000 7f7fb6000700 1 -- 172.21.15.156:0/2343559528 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f7fb0049b50 con 0x7f7fc0103160 2024-04-23T14:39:11.573 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:11.572+0000 7f7fbd400700 1 --2- 172.21.15.156:0/2343559528 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f7fa4036830 0x7f7fa4038ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:11.574 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:11.574+0000 7f7fbd400700 1 --2- 172.21.15.156:0/2343559528 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f7fa4036830 0x7f7fa4038ce0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7fac009990 tx=0x7f7fac006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:11.588 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:11.587+0000 7f7fb6000700 1 -- 172.21.15.156:0/2343559528 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7fb0011960 con 0x7f7fc0103160 2024-04-23T14:39:11.886 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:11.884+0000 7f7fbf200700 1 -- 172.21.15.156:0/2343559528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7fc0115210 con 0x7f7fc0103160 2024-04-23T14:39:11.887 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:11.886+0000 7f7fb6000700 1 -- 172.21.15.156:0/2343559528 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f7fb0011370 con 0x7f7fc0103160 2024-04-23T14:39:11.887 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:39:11.887 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":1,"fsid":"7a641bea-017e-11ef-bc93-c7b262605968","modified":"2024-04-23T14:37:02.223037Z","created":"2024-04-23T14:37:02.223037Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi081","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-23T14:39:11.890 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:11.889+0000 7f7fbf200700 1 -- 172.21.15.156:0/2343559528 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f7fa4036830 msgr2=0x7f7fa4038ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:11.890 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:11.889+0000 7f7fbf200700 1 --2- 172.21.15.156:0/2343559528 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f7fa4036830 0x7f7fa4038ce0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7fac009990 tx=0x7f7fac006e40 comp rx=0 tx=0).stop 2024-04-23T14:39:11.890 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:11.889+0000 7f7fbf200700 1 -- 172.21.15.156:0/2343559528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fc0103160 msgr2=0x7f7fc0113490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:11.890 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:11.889+0000 7f7fbf200700 1 --2- 172.21.15.156:0/2343559528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fc0103160 0x7f7fc0113490 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7fb000b900 tx=0x7f7fb0009e30 comp rx=0 tx=0).stop 2024-04-23T14:39:11.890 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:11.889+0000 7f7fbf200700 1 -- 172.21.15.156:0/2343559528 shutdown_connections 2024-04-23T14:39:11.890 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:11.889+0000 7f7fbf200700 1 --2- 172.21.15.156:0/2343559528 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f7fa4036830 0x7f7fa4038ce0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:11.891 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:11.889+0000 7f7fbf200700 1 --2- 172.21.15.156:0/2343559528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fc0103160 0x7f7fc0113490 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:11.891 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:11.889+0000 7f7fbf200700 1 -- 172.21.15.156:0/2343559528 >> 172.21.15.156:0/2343559528 conn(0x7f7fc0072080 msgr2=0x7f7fc0109fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:11.891 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:11.889+0000 7f7fbf200700 1 -- 172.21.15.156:0/2343559528 shutdown_connections 2024-04-23T14:39:11.891 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:11.889+0000 7f7fbf200700 1 -- 172.21.15.156:0/2343559528 wait complete. 2024-04-23T14:39:11.891 INFO:teuthology.orchestra.run.smithi156.stderr:dumped monmap epoch 1 2024-04-23T14:39:12.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:12 smithi081 ceph-mon[25540]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:12.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:12 smithi081 ceph-mon[25540]: from='client.? 172.21.15.156:0/2343559528' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-23T14:39:13.549 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-23T14:39:13.549 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-23T14:39:13.989 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-23T14:39:14.097 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-23T14:39:14.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:14 smithi081 ceph-mon[25540]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:15.997 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:15.996+0000 7ff9fc600700 1 -- 172.21.15.156:0/4109258795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9f40fca60 msgr2=0x7ff9f40fce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:15.997 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:15.996+0000 7ff9fc600700 1 --2- 172.21.15.156:0/4109258795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9f40fca60 0x7ff9f40fce70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff9e80048c0 tx=0x7ff9e8009e30 comp rx=0 tx=0).stop 2024-04-23T14:39:15.998 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:15.996+0000 7ff9fc600700 1 -- 172.21.15.156:0/4109258795 shutdown_connections 2024-04-23T14:39:15.998 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:15.996+0000 7ff9fc600700 1 --2- 172.21.15.156:0/4109258795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9f40fca60 0x7ff9f40fce70 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:15.998 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:15.996+0000 7ff9fc600700 1 -- 172.21.15.156:0/4109258795 >> 172.21.15.156:0/4109258795 conn(0x7ff9f40f81c0 msgr2=0x7ff9f40fa5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:15.998 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:15.996+0000 7ff9fc600700 1 -- 172.21.15.156:0/4109258795 shutdown_connections 2024-04-23T14:39:15.998 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:15.996+0000 7ff9fc600700 1 -- 172.21.15.156:0/4109258795 wait complete. 2024-04-23T14:39:15.998 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:15.997+0000 7ff9fc600700 1 Processor -- start 2024-04-23T14:39:15.999 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:15.997+0000 7ff9fc600700 1 -- start start 2024-04-23T14:39:15.999 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:15.997+0000 7ff9fc600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9f40fca60 0x7ff9f410f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:15.999 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:15.997+0000 7ff9fc600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f410f810 con 0x7ff9f40fca60 2024-04-23T14:39:15.999 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:15.998+0000 7ff9f9c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9f40fca60 0x7ff9f410f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:15.999 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:15.998+0000 7ff9f9c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9f40fca60 0x7ff9f410f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.156:48058/0 (socket says 172.21.15.156:48058) 2024-04-23T14:39:15.999 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:15.998+0000 7ff9f9c00700 1 -- 172.21.15.156:0/69365558 learned_addr learned my addr 172.21.15.156:0/69365558 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-04-23T14:39:16.000 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:15.999+0000 7ff9f9c00700 1 -- 172.21.15.156:0/69365558 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e8005040 con 0x7ff9f40fca60 2024-04-23T14:39:16.000 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:15.999+0000 7ff9f9c00700 1 --2- 172.21.15.156:0/69365558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9f40fca60 0x7ff9f410f2d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8009680 tx=0x7ff9e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:16.000 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:16.000+0000 7ff9f1600700 1 -- 172.21.15.156:0/69365558 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9e800b5c0 con 0x7ff9f40fca60 2024-04-23T14:39:16.001 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:16.000+0000 7ff9fc600700 1 -- 172.21.15.156:0/69365558 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9f410fa10 con 0x7ff9f40fca60 2024-04-23T14:39:16.001 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:16.000+0000 7ff9f1600700 1 -- 172.21.15.156:0/69365558 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff9e800be70 con 0x7ff9f40fca60 2024-04-23T14:39:16.001 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:16.000+0000 7ff9f1600700 1 -- 172.21.15.156:0/69365558 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9e80135a0 con 0x7ff9f40fca60 2024-04-23T14:39:16.001 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:16.000+0000 7ff9fc600700 1 -- 172.21.15.156:0/69365558 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f4110580 con 0x7ff9f40fca60 2024-04-23T14:39:16.001 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:16.001+0000 7ff9fc600700 1 -- 172.21.15.156:0/69365558 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9f4102f70 con 0x7ff9f40fca60 2024-04-23T14:39:16.002 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:16.001+0000 7ff9f1600700 1 -- 172.21.15.156:0/69365558 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7ff9e801ca90 con 0x7ff9f40fca60 2024-04-23T14:39:16.002 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:16.002+0000 7ff9f1600700 1 --2- 172.21.15.156:0/69365558 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7ff9dc0368d0 0x7ff9dc038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:16.003 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:16.002+0000 7ff9f1600700 1 -- 172.21.15.156:0/69365558 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff9e8049360 con 0x7ff9f40fca60 2024-04-23T14:39:16.003 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:16.003+0000 7ff9f9200700 1 --2- 172.21.15.156:0/69365558 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7ff9dc0368d0 0x7ff9dc038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:16.004 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:16.004+0000 7ff9f9200700 1 --2- 172.21.15.156:0/69365558 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7ff9dc0368d0 0x7ff9dc038d80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0009990 tx=0x7ff9e0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:16.018 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:16.017+0000 7ff9f1600700 1 -- 172.21.15.156:0/69365558 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff9e8011960 con 0x7ff9f40fca60 2024-04-23T14:39:16.314 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:16.313+0000 7ff9fc600700 1 -- 172.21.15.156:0/69365558 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff9f4110880 con 0x7ff9f40fca60 2024-04-23T14:39:16.315 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:16.314+0000 7ff9f1600700 1 -- 172.21.15.156:0/69365558 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7ff9e8021020 con 0x7ff9f40fca60 2024-04-23T14:39:16.315 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:39:16.315 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":1,"fsid":"7a641bea-017e-11ef-bc93-c7b262605968","modified":"2024-04-23T14:37:02.223037Z","created":"2024-04-23T14:37:02.223037Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi081","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-23T14:39:16.318 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:16.316+0000 7ff9fc600700 1 -- 172.21.15.156:0/69365558 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7ff9dc0368d0 msgr2=0x7ff9dc038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:16.318 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:16.316+0000 7ff9fc600700 1 --2- 172.21.15.156:0/69365558 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7ff9dc0368d0 0x7ff9dc038d80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0009990 tx=0x7ff9e0006e40 comp rx=0 tx=0).stop 2024-04-23T14:39:16.318 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:16.316+0000 7ff9fc600700 1 -- 172.21.15.156:0/69365558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9f40fca60 msgr2=0x7ff9f410f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:16.318 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:16.316+0000 7ff9fc600700 1 --2- 172.21.15.156:0/69365558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9f40fca60 0x7ff9f410f2d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8009680 tx=0x7ff9e8009e30 comp rx=0 tx=0).stop 2024-04-23T14:39:16.318 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:16.317+0000 7ff9fc600700 1 -- 172.21.15.156:0/69365558 shutdown_connections 2024-04-23T14:39:16.318 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:16.317+0000 7ff9fc600700 1 --2- 172.21.15.156:0/69365558 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7ff9dc0368d0 0x7ff9dc038d80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:16.318 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:16.317+0000 7ff9fc600700 1 --2- 172.21.15.156:0/69365558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9f40fca60 0x7ff9f410f2d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:16.318 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:16.317+0000 7ff9fc600700 1 -- 172.21.15.156:0/69365558 >> 172.21.15.156:0/69365558 conn(0x7ff9f40f81c0 msgr2=0x7ff9f40fa5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:16.318 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:16.317+0000 7ff9fc600700 1 -- 172.21.15.156:0/69365558 shutdown_connections 2024-04-23T14:39:16.318 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:16.317+0000 7ff9fc600700 1 -- 172.21.15.156:0/69365558 wait complete. 2024-04-23T14:39:16.319 INFO:teuthology.orchestra.run.smithi156.stderr:dumped monmap epoch 1 2024-04-23T14:39:16.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:16 smithi081 ceph-mon[25540]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:17.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:17 smithi081 ceph-mon[25540]: from='client.? 172.21.15.156:0/69365558' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-23T14:39:17.991 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-23T14:39:17.992 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-23T14:39:18.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:18 smithi081 ceph-mon[25540]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:18.434 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-23T14:39:18.543 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-23T14:39:20.182 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:20 smithi081 ceph-mon[25540]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:20.182 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:20 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' 2024-04-23T14:39:20.182 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:20 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' 2024-04-23T14:39:20.183 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:20 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' 2024-04-23T14:39:20.183 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:20 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' 2024-04-23T14:39:20.183 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:20 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' 2024-04-23T14:39:20.183 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:20 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' 2024-04-23T14:39:20.423 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:20.421+0000 7fb17d800700 1 -- 172.21.15.156:0/2162288800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1780fec70 msgr2=0x7fb1780ff080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:20.423 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:20.421+0000 7fb17d800700 1 --2- 172.21.15.156:0/2162288800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1780fec70 0x7fb1780ff080 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb1680048c0 tx=0x7fb168009e30 comp rx=0 tx=0).stop 2024-04-23T14:39:20.423 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:20.421+0000 7fb17d800700 1 -- 172.21.15.156:0/2162288800 shutdown_connections 2024-04-23T14:39:20.423 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:20.421+0000 7fb17d800700 1 --2- 172.21.15.156:0/2162288800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1780fec70 0x7fb1780ff080 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:20.423 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:20.421+0000 7fb17d800700 1 -- 172.21.15.156:0/2162288800 >> 172.21.15.156:0/2162288800 conn(0x7fb1780fa5d0 msgr2=0x7fb1780fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:20.423 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:20.421+0000 7fb17d800700 1 -- 172.21.15.156:0/2162288800 shutdown_connections 2024-04-23T14:39:20.424 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:20.421+0000 7fb17d800700 1 -- 172.21.15.156:0/2162288800 wait complete. 2024-04-23T14:39:20.424 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:20.422+0000 7fb17d800700 1 Processor -- start 2024-04-23T14:39:20.424 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:20.422+0000 7fb17d800700 1 -- start start 2024-04-23T14:39:20.426 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:20.423+0000 7fb17d800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1780fec70 0x7fb17810f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:20.426 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:20.423+0000 7fb17d800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17810f830 con 0x7fb1780fec70 2024-04-23T14:39:20.426 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:20.423+0000 7fb176a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1780fec70 0x7fb17810f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:20.426 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:20.423+0000 7fb176a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1780fec70 0x7fb17810f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.156:48076/0 (socket says 172.21.15.156:48076) 2024-04-23T14:39:20.426 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:20.423+0000 7fb176a00700 1 -- 172.21.15.156:0/4013818385 learned_addr learned my addr 172.21.15.156:0/4013818385 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-04-23T14:39:20.427 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:20.423+0000 7fb176a00700 1 -- 172.21.15.156:0/4013818385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb168005040 con 0x7fb1780fec70 2024-04-23T14:39:20.427 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:20.424+0000 7fb176a00700 1 --2- 172.21.15.156:0/4013818385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1780fec70 0x7fb17810f2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb168009680 tx=0x7fb168009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:20.427 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:20.424+0000 7fb16ea00700 1 -- 172.21.15.156:0/4013818385 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb16800b5c0 con 0x7fb1780fec70 2024-04-23T14:39:20.427 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:20.424+0000 7fb16ea00700 1 -- 172.21.15.156:0/4013818385 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb16800be70 con 0x7fb1780fec70 2024-04-23T14:39:20.427 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:20.424+0000 7fb16ea00700 1 -- 172.21.15.156:0/4013818385 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb1680135a0 con 0x7fb1780fec70 2024-04-23T14:39:20.427 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:20.424+0000 7fb17d800700 1 -- 172.21.15.156:0/4013818385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb17810fa30 con 0x7fb1780fec70 2024-04-23T14:39:20.427 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:20.424+0000 7fb17d800700 1 -- 172.21.15.156:0/4013818385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb178110550 con 0x7fb1780fec70 2024-04-23T14:39:20.428 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:20.426+0000 7fb17d800700 1 -- 172.21.15.156:0/4013818385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb178105180 con 0x7fb1780fec70 2024-04-23T14:39:20.428 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:20.426+0000 7fb16ea00700 1 -- 172.21.15.156:0/4013818385 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fb16801ca90 con 0x7fb1780fec70 2024-04-23T14:39:20.429 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:20.426+0000 7fb16ea00700 1 --2- 172.21.15.156:0/4013818385 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fb15c0368d0 0x7fb15c038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:20.429 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:20.426+0000 7fb16ea00700 1 -- 172.21.15.156:0/4013818385 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fb168049410 con 0x7fb1780fec70 2024-04-23T14:39:20.429 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:20.426+0000 7fb176000700 1 --2- 172.21.15.156:0/4013818385 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fb15c0368d0 0x7fb15c038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:20.430 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:20.427+0000 7fb176000700 1 --2- 172.21.15.156:0/4013818385 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fb15c0368d0 0x7fb15c038d80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb164009990 tx=0x7fb164006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:20.433 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:20.432+0000 7fb16ea00700 1 -- 172.21.15.156:0/4013818385 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fb168011940 con 0x7fb1780fec70 2024-04-23T14:39:20.724 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:20.723+0000 7fb17d800700 1 -- 172.21.15.156:0/4013818385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb178110f60 con 0x7fb1780fec70 2024-04-23T14:39:20.725 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:20.724+0000 7fb16ea00700 1 -- 172.21.15.156:0/4013818385 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fb168021070 con 0x7fb1780fec70 2024-04-23T14:39:20.725 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:39:20.725 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":1,"fsid":"7a641bea-017e-11ef-bc93-c7b262605968","modified":"2024-04-23T14:37:02.223037Z","created":"2024-04-23T14:37:02.223037Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi081","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-23T14:39:20.729 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:20.727+0000 7fb17d800700 1 -- 172.21.15.156:0/4013818385 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fb15c0368d0 msgr2=0x7fb15c038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:20.729 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:20.727+0000 7fb17d800700 1 --2- 172.21.15.156:0/4013818385 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fb15c0368d0 0x7fb15c038d80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb164009990 tx=0x7fb164006e40 comp rx=0 tx=0).stop 2024-04-23T14:39:20.729 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:20.727+0000 7fb17d800700 1 -- 172.21.15.156:0/4013818385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1780fec70 msgr2=0x7fb17810f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:20.729 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:20.727+0000 7fb17d800700 1 --2- 172.21.15.156:0/4013818385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1780fec70 0x7fb17810f2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb168009680 tx=0x7fb168009e30 comp rx=0 tx=0).stop 2024-04-23T14:39:20.729 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:20.727+0000 7fb17d800700 1 -- 172.21.15.156:0/4013818385 shutdown_connections 2024-04-23T14:39:20.729 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:20.727+0000 7fb17d800700 1 --2- 172.21.15.156:0/4013818385 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fb15c0368d0 0x7fb15c038d80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:20.729 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:20.727+0000 7fb17d800700 1 --2- 172.21.15.156:0/4013818385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1780fec70 0x7fb17810f2f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:20.729 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:20.727+0000 7fb17d800700 1 -- 172.21.15.156:0/4013818385 >> 172.21.15.156:0/4013818385 conn(0x7fb1780fa5d0 msgr2=0x7fb1780fc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:20.730 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:20.727+0000 7fb17d800700 1 -- 172.21.15.156:0/4013818385 shutdown_connections 2024-04-23T14:39:20.730 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:20.727+0000 7fb17d800700 1 -- 172.21.15.156:0/4013818385 wait complete. 2024-04-23T14:39:20.730 INFO:teuthology.orchestra.run.smithi156.stderr:dumped monmap epoch 1 2024-04-23T14:39:21.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:21 smithi081 ceph-mon[25540]: Deploying daemon prometheus.smithi081 on smithi081 2024-04-23T14:39:21.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:21 smithi081 ceph-mon[25540]: from='client.? 172.21.15.156:0/4013818385' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-23T14:39:22.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:22 smithi081 ceph-mon[25540]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:22.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:22 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' 2024-04-23T14:39:22.458 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-23T14:39:22.459 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-23T14:39:22.879 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-23T14:39:22.985 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-23T14:39:24.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:24 smithi081 ceph-mon[25540]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:24.922 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:24.920+0000 7f7222000700 1 -- 172.21.15.156:0/2822010533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f721c0fec70 msgr2=0x7f721c0ff080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:24.922 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:24.920+0000 7f7222000700 1 --2- 172.21.15.156:0/2822010533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f721c0fec70 0x7f721c0ff080 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f720c0048c0 tx=0x7f720c009e30 comp rx=0 tx=0).stop 2024-04-23T14:39:24.922 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:24.921+0000 7f7222000700 1 -- 172.21.15.156:0/2822010533 shutdown_connections 2024-04-23T14:39:24.922 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:24.921+0000 7f7222000700 1 --2- 172.21.15.156:0/2822010533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f721c0fec70 0x7f721c0ff080 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:24.922 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:24.921+0000 7f7222000700 1 -- 172.21.15.156:0/2822010533 >> 172.21.15.156:0/2822010533 conn(0x7f721c0fa5d0 msgr2=0x7f721c0fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:24.922 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:24.921+0000 7f7222000700 1 -- 172.21.15.156:0/2822010533 shutdown_connections 2024-04-23T14:39:24.922 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:24.921+0000 7f7222000700 1 -- 172.21.15.156:0/2822010533 wait complete. 2024-04-23T14:39:24.923 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:24.922+0000 7f7222000700 1 Processor -- start 2024-04-23T14:39:24.923 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:24.922+0000 7f7222000700 1 -- start start 2024-04-23T14:39:24.923 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:24.922+0000 7f7222000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f721c0fec70 0x7f721c10f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:24.923 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:24.922+0000 7f7222000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721c10f830 con 0x7f721c0fec70 2024-04-23T14:39:24.924 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:24.923+0000 7f721b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f721c0fec70 0x7f721c10f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:24.924 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:24.923+0000 7f721b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f721c0fec70 0x7f721c10f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.156:41496/0 (socket says 172.21.15.156:41496) 2024-04-23T14:39:24.924 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:24.923+0000 7f721b400700 1 -- 172.21.15.156:0/3728042765 learned_addr learned my addr 172.21.15.156:0/3728042765 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-04-23T14:39:24.924 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:24.924+0000 7f721b400700 1 -- 172.21.15.156:0/3728042765 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f720c005040 con 0x7f721c0fec70 2024-04-23T14:39:24.925 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:24.924+0000 7f721b400700 1 --2- 172.21.15.156:0/3728042765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f721c0fec70 0x7f721c10f2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f720c0096b0 tx=0x7f720c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:24.926 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:24.925+0000 7f7213400700 1 -- 172.21.15.156:0/3728042765 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f720c00bed0 con 0x7f721c0fec70 2024-04-23T14:39:24.926 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:24.925+0000 7f7213400700 1 -- 172.21.15.156:0/3728042765 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f720c00b5c0 con 0x7f721c0fec70 2024-04-23T14:39:24.926 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:24.925+0000 7f7222000700 1 -- 172.21.15.156:0/3728042765 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f721c10fa30 con 0x7f721c0fec70 2024-04-23T14:39:24.926 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:24.925+0000 7f7213400700 1 -- 172.21.15.156:0/3728042765 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f720c01c5b0 con 0x7f721c0fec70 2024-04-23T14:39:24.926 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:24.925+0000 7f7222000700 1 -- 172.21.15.156:0/3728042765 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f721c110550 con 0x7f721c0fec70 2024-04-23T14:39:24.927 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:24.926+0000 7f7222000700 1 -- 172.21.15.156:0/3728042765 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f721c105180 con 0x7f721c0fec70 2024-04-23T14:39:24.927 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:24.927+0000 7f7213400700 1 -- 172.21.15.156:0/3728042765 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f720c013a80 con 0x7f721c0fec70 2024-04-23T14:39:24.928 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:24.927+0000 7f7213400700 1 --2- 172.21.15.156:0/3728042765 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f7200036880 0x7f7200038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:24.928 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:24.927+0000 7f7213400700 1 -- 172.21.15.156:0/3728042765 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f720c049a00 con 0x7f721c0fec70 2024-04-23T14:39:24.929 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:24.928+0000 7f721aa00700 1 --2- 172.21.15.156:0/3728042765 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f7200036880 0x7f7200038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:24.929 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:24.929+0000 7f721aa00700 1 --2- 172.21.15.156:0/3728042765 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f7200036880 0x7f7200038d30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7208009990 tx=0x7f7208006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:24.947 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:24.947+0000 7f7213400700 1 -- 172.21.15.156:0/3728042765 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f720c011960 con 0x7f721c0fec70 2024-04-23T14:39:25.242 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:25.240+0000 7f7222000700 1 -- 172.21.15.156:0/3728042765 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f721c110f60 con 0x7f721c0fec70 2024-04-23T14:39:25.242 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:25.241+0000 7f7213400700 1 -- 172.21.15.156:0/3728042765 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f720c011370 con 0x7f721c0fec70 2024-04-23T14:39:25.243 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:39:25.243 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":1,"fsid":"7a641bea-017e-11ef-bc93-c7b262605968","modified":"2024-04-23T14:37:02.223037Z","created":"2024-04-23T14:37:02.223037Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi081","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-23T14:39:25.245 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:25.244+0000 7f7222000700 1 -- 172.21.15.156:0/3728042765 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f7200036880 msgr2=0x7f7200038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:25.246 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:25.244+0000 7f7222000700 1 --2- 172.21.15.156:0/3728042765 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f7200036880 0x7f7200038d30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7208009990 tx=0x7f7208006e40 comp rx=0 tx=0).stop 2024-04-23T14:39:25.246 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:25.244+0000 7f7222000700 1 -- 172.21.15.156:0/3728042765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f721c0fec70 msgr2=0x7f721c10f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:25.246 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:25.244+0000 7f7222000700 1 --2- 172.21.15.156:0/3728042765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f721c0fec70 0x7f721c10f2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f720c0096b0 tx=0x7f720c009e30 comp rx=0 tx=0).stop 2024-04-23T14:39:25.246 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:25.244+0000 7f7222000700 1 -- 172.21.15.156:0/3728042765 shutdown_connections 2024-04-23T14:39:25.246 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:25.244+0000 7f7222000700 1 --2- 172.21.15.156:0/3728042765 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7f7200036880 0x7f7200038d30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:25.246 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:25.244+0000 7f7222000700 1 --2- 172.21.15.156:0/3728042765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f721c0fec70 0x7f721c10f2f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:25.246 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:25.245+0000 7f7222000700 1 -- 172.21.15.156:0/3728042765 >> 172.21.15.156:0/3728042765 conn(0x7f721c0fa5d0 msgr2=0x7f721c0fc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:25.246 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:25.245+0000 7f7222000700 1 -- 172.21.15.156:0/3728042765 shutdown_connections 2024-04-23T14:39:25.246 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:25.245+0000 7f7222000700 1 -- 172.21.15.156:0/3728042765 wait complete. 2024-04-23T14:39:25.247 INFO:teuthology.orchestra.run.smithi156.stderr:dumped monmap epoch 1 2024-04-23T14:39:26.425 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:26 smithi081 ceph-mon[25540]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:26.426 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:26 smithi081 ceph-mon[25540]: from='client.? 172.21.15.156:0/3728042765' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-23T14:39:26.938 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-23T14:39:26.939 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-23T14:39:27.387 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-23T14:39:27.493 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-23T14:39:28.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:28 smithi081 ceph-mon[25540]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:29.384 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:29.382+0000 7fe759000700 1 -- 172.21.15.156:0/2113348308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe754071ea0 msgr2=0x7fe7540703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:29.384 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:29.382+0000 7fe759000700 1 --2- 172.21.15.156:0/2113348308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe754071ea0 0x7fe7540703b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe7440048c0 tx=0x7fe744009e30 comp rx=0 tx=0).stop 2024-04-23T14:39:29.384 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:29.383+0000 7fe759000700 1 -- 172.21.15.156:0/2113348308 shutdown_connections 2024-04-23T14:39:29.384 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:29.383+0000 7fe759000700 1 --2- 172.21.15.156:0/2113348308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe754071ea0 0x7fe7540703b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:29.384 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:29.383+0000 7fe759000700 1 -- 172.21.15.156:0/2113348308 >> 172.21.15.156:0/2113348308 conn(0x7fe7540f81d0 msgr2=0x7fe7540fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:29.384 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:29.383+0000 7fe759000700 1 -- 172.21.15.156:0/2113348308 shutdown_connections 2024-04-23T14:39:29.384 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:29.383+0000 7fe759000700 1 -- 172.21.15.156:0/2113348308 wait complete. 2024-04-23T14:39:29.385 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:29.384+0000 7fe759000700 1 Processor -- start 2024-04-23T14:39:29.385 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:29.384+0000 7fe759000700 1 -- start start 2024-04-23T14:39:29.385 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:29.384+0000 7fe759000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe754071ea0 0x7fe7541136d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:29.385 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:29.384+0000 7fe759000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe754113c10 con 0x7fe754071ea0 2024-04-23T14:39:29.386 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:29.385+0000 7fe751e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe754071ea0 0x7fe7541136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:29.386 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:29.385+0000 7fe751e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe754071ea0 0x7fe7541136d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.156:41510/0 (socket says 172.21.15.156:41510) 2024-04-23T14:39:29.386 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:29.385+0000 7fe751e00700 1 -- 172.21.15.156:0/1857594344 learned_addr learned my addr 172.21.15.156:0/1857594344 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-04-23T14:39:29.386 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:29.386+0000 7fe751e00700 1 -- 172.21.15.156:0/1857594344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe744005040 con 0x7fe754071ea0 2024-04-23T14:39:29.387 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:29.386+0000 7fe751e00700 1 --2- 172.21.15.156:0/1857594344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe754071ea0 0x7fe7541136d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe74400b900 tx=0x7fe744009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:29.387 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:29.386+0000 7fe74a000700 1 -- 172.21.15.156:0/1857594344 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe74400b5c0 con 0x7fe754071ea0 2024-04-23T14:39:29.387 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:29.387+0000 7fe759000700 1 -- 172.21.15.156:0/1857594344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe754113e10 con 0x7fe754071ea0 2024-04-23T14:39:29.387 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:29.387+0000 7fe74a000700 1 -- 172.21.15.156:0/1857594344 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe74400be70 con 0x7fe754071ea0 2024-04-23T14:39:29.388 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:29.387+0000 7fe74a000700 1 -- 172.21.15.156:0/1857594344 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe74401c590 con 0x7fe754071ea0 2024-04-23T14:39:29.388 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:29.387+0000 7fe759000700 1 -- 172.21.15.156:0/1857594344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe754114980 con 0x7fe754071ea0 2024-04-23T14:39:29.388 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:29.388+0000 7fe759000700 1 -- 172.21.15.156:0/1857594344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7541095b0 con 0x7fe754071ea0 2024-04-23T14:39:29.389 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:29.388+0000 7fe74a000700 1 -- 172.21.15.156:0/1857594344 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fe744004d30 con 0x7fe754071ea0 2024-04-23T14:39:29.389 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:29.389+0000 7fe74a000700 1 --2- 172.21.15.156:0/1857594344 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fe7380368d0 0x7fe738038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:29.389 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:29.389+0000 7fe74a000700 1 -- 172.21.15.156:0/1857594344 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe7440493d0 con 0x7fe754071ea0 2024-04-23T14:39:29.390 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:29.389+0000 7fe751400700 1 --2- 172.21.15.156:0/1857594344 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fe7380368d0 0x7fe738038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:29.391 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:29.391+0000 7fe751400700 1 --2- 172.21.15.156:0/1857594344 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fe7380368d0 0x7fe738038d80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe740009990 tx=0x7fe740006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:29.405 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:29.405+0000 7fe74a000700 1 -- 172.21.15.156:0/1857594344 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe74401b350 con 0x7fe754071ea0 2024-04-23T14:39:29.700 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:29.699+0000 7fe759000700 1 -- 172.21.15.156:0/1857594344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe754115390 con 0x7fe754071ea0 2024-04-23T14:39:29.701 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:29.700+0000 7fe74a000700 1 -- 172.21.15.156:0/1857594344 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fe744021020 con 0x7fe754071ea0 2024-04-23T14:39:29.701 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:39:29.701 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":1,"fsid":"7a641bea-017e-11ef-bc93-c7b262605968","modified":"2024-04-23T14:37:02.223037Z","created":"2024-04-23T14:37:02.223037Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi081","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-23T14:39:29.704 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:29.703+0000 7fe759000700 1 -- 172.21.15.156:0/1857594344 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fe7380368d0 msgr2=0x7fe738038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:29.704 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:29.703+0000 7fe759000700 1 --2- 172.21.15.156:0/1857594344 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fe7380368d0 0x7fe738038d80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe740009990 tx=0x7fe740006e40 comp rx=0 tx=0).stop 2024-04-23T14:39:29.704 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:29.703+0000 7fe759000700 1 -- 172.21.15.156:0/1857594344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe754071ea0 msgr2=0x7fe7541136d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:29.704 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:29.703+0000 7fe759000700 1 --2- 172.21.15.156:0/1857594344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe754071ea0 0x7fe7541136d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe74400b900 tx=0x7fe744009e30 comp rx=0 tx=0).stop 2024-04-23T14:39:29.704 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:29.703+0000 7fe759000700 1 -- 172.21.15.156:0/1857594344 shutdown_connections 2024-04-23T14:39:29.704 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:29.703+0000 7fe759000700 1 --2- 172.21.15.156:0/1857594344 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fe7380368d0 0x7fe738038d80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:29.704 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:29.703+0000 7fe759000700 1 --2- 172.21.15.156:0/1857594344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe754071ea0 0x7fe7541136d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:29.704 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:29.703+0000 7fe759000700 1 -- 172.21.15.156:0/1857594344 >> 172.21.15.156:0/1857594344 conn(0x7fe7540f81d0 msgr2=0x7fe75410a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:29.704 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:29.703+0000 7fe759000700 1 -- 172.21.15.156:0/1857594344 shutdown_connections 2024-04-23T14:39:29.705 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:29.703+0000 7fe759000700 1 -- 172.21.15.156:0/1857594344 wait complete. 2024-04-23T14:39:29.705 INFO:teuthology.orchestra.run.smithi156.stderr:dumped monmap epoch 1 2024-04-23T14:39:30.498 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:30 smithi081 ceph-mon[25540]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:30.498 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:30 smithi081 ceph-mon[25540]: from='client.? 172.21.15.156:0/1857594344' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-23T14:39:31.404 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-23T14:39:31.404 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-23T14:39:31.839 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-23T14:39:31.936 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-23T14:39:32.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:32 smithi081 ceph-mon[25540]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:33.908 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:33 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' 2024-04-23T14:39:33.908 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:33 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' 2024-04-23T14:39:33.908 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:33 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' 2024-04-23T14:39:33.908 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:33 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-04-23T14:39:33.908 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:33 smithi081 ceph-mon[25540]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:39:34.009 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.008+0000 7fa11d200700 1 -- 172.21.15.156:0/3171315078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa118103080 msgr2=0x7fa118103490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:34.010 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.008+0000 7fa11d200700 1 --2- 172.21.15.156:0/3171315078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa118103080 0x7fa118103490 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa1080048c0 tx=0x7fa108009e30 comp rx=0 tx=0).stop 2024-04-23T14:39:34.010 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.008+0000 7fa11d200700 1 -- 172.21.15.156:0/3171315078 shutdown_connections 2024-04-23T14:39:34.010 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.008+0000 7fa11d200700 1 --2- 172.21.15.156:0/3171315078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa118103080 0x7fa118103490 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:34.010 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.008+0000 7fa11d200700 1 -- 172.21.15.156:0/3171315078 >> 172.21.15.156:0/3171315078 conn(0x7fa118072300 msgr2=0x7fa118074710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:34.011 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.008+0000 7fa11d200700 1 -- 172.21.15.156:0/3171315078 shutdown_connections 2024-04-23T14:39:34.011 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.009+0000 7fa11d200700 1 -- 172.21.15.156:0/3171315078 wait complete. 2024-04-23T14:39:34.011 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.010+0000 7fa11d200700 1 Processor -- start 2024-04-23T14:39:34.011 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.010+0000 7fa11d200700 1 -- start start 2024-04-23T14:39:34.011 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.010+0000 7fa11d200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa118103080 0x7fa1181136c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:34.011 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.010+0000 7fa11d200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa118113c00 con 0x7fa118103080 2024-04-23T14:39:34.012 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.010+0000 7fa115e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa118103080 0x7fa1181136c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:34.012 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.011+0000 7fa115e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa118103080 0x7fa1181136c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.156:37718/0 (socket says 172.21.15.156:37718) 2024-04-23T14:39:34.012 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.011+0000 7fa115e00700 1 -- 172.21.15.156:0/1593316006 learned_addr learned my addr 172.21.15.156:0/1593316006 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-04-23T14:39:34.012 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.011+0000 7fa115e00700 1 -- 172.21.15.156:0/1593316006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa108005040 con 0x7fa118103080 2024-04-23T14:39:34.013 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.011+0000 7fa115e00700 1 --2- 172.21.15.156:0/1593316006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa118103080 0x7fa1181136c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa1080096b0 tx=0x7fa108009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:34.013 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.012+0000 7fa10e000700 1 -- 172.21.15.156:0/1593316006 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa10800bed0 con 0x7fa118103080 2024-04-23T14:39:34.013 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.012+0000 7fa11d200700 1 -- 172.21.15.156:0/1593316006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa118113e00 con 0x7fa118103080 2024-04-23T14:39:34.013 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.012+0000 7fa10e000700 1 -- 172.21.15.156:0/1593316006 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa10800b5c0 con 0x7fa118103080 2024-04-23T14:39:34.013 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.012+0000 7fa10e000700 1 -- 172.21.15.156:0/1593316006 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa10801c5b0 con 0x7fa118103080 2024-04-23T14:39:34.013 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.012+0000 7fa11d200700 1 -- 172.21.15.156:0/1593316006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa118114970 con 0x7fa118103080 2024-04-23T14:39:34.013 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.013+0000 7fa11d200700 1 -- 172.21.15.156:0/1593316006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa118109570 con 0x7fa118103080 2024-04-23T14:39:34.014 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.014+0000 7fa10e000700 1 -- 172.21.15.156:0/1593316006 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 14) v1 ==== 43446+0+0 (secure 0 0 0) 0x7fa108004d30 con 0x7fa118103080 2024-04-23T14:39:34.015 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.014+0000 7fa10e000700 1 --2- 172.21.15.156:0/1593316006 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fa0fc0368d0 0x7fa0fc038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:34.015 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.014+0000 7fa10e000700 1 -- 172.21.15.156:0/1593316006 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa108049cc0 con 0x7fa118103080 2024-04-23T14:39:34.015 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.014+0000 7fa115400700 1 -- 172.21.15.156:0/1593316006 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fa0fc0368d0 msgr2=0x7fa0fc038d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/3624015234 2024-04-23T14:39:34.015 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.014+0000 7fa115400700 1 --2- 172.21.15.156:0/1593316006 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fa0fc0368d0 0x7fa0fc038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T14:39:34.029 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.028+0000 7fa10e000700 1 -- 172.21.15.156:0/1593316006 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa108013420 con 0x7fa118103080 2024-04-23T14:39:34.216 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.215+0000 7fa115400700 1 -- 172.21.15.156:0/1593316006 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fa0fc0368d0 msgr2=0x7fa0fc038d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/3624015234 2024-04-23T14:39:34.216 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.215+0000 7fa115400700 1 --2- 172.21.15.156:0/1593316006 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fa0fc0368d0 0x7fa0fc038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-23T14:39:34.323 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.321+0000 7fa11d200700 1 -- 172.21.15.156:0/1593316006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa118115440 con 0x7fa118103080 2024-04-23T14:39:34.324 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.323+0000 7fa10e000700 1 -- 172.21.15.156:0/1593316006 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fa10801bb80 con 0x7fa118103080 2024-04-23T14:39:34.324 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:39:34.324 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":1,"fsid":"7a641bea-017e-11ef-bc93-c7b262605968","modified":"2024-04-23T14:37:02.223037Z","created":"2024-04-23T14:37:02.223037Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi081","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-23T14:39:34.327 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.326+0000 7fa11d200700 1 -- 172.21.15.156:0/1593316006 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fa0fc0368d0 msgr2=0x7fa0fc038d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-23T14:39:34.327 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.326+0000 7fa11d200700 1 --2- 172.21.15.156:0/1593316006 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fa0fc0368d0 0x7fa0fc038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:34.327 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.326+0000 7fa11d200700 1 -- 172.21.15.156:0/1593316006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa118103080 msgr2=0x7fa1181136c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:34.327 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.326+0000 7fa11d200700 1 --2- 172.21.15.156:0/1593316006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa118103080 0x7fa1181136c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa1080096b0 tx=0x7fa108009e30 comp rx=0 tx=0).stop 2024-04-23T14:39:34.327 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.326+0000 7fa11d200700 1 -- 172.21.15.156:0/1593316006 shutdown_connections 2024-04-23T14:39:34.327 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.326+0000 7fa11d200700 1 --2- 172.21.15.156:0/1593316006 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7fa0fc0368d0 0x7fa0fc038d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:34.327 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.326+0000 7fa11d200700 1 --2- 172.21.15.156:0/1593316006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa118103080 0x7fa1181136c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:34.327 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.326+0000 7fa11d200700 1 -- 172.21.15.156:0/1593316006 >> 172.21.15.156:0/1593316006 conn(0x7fa118072300 msgr2=0x7fa118074230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:34.327 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.326+0000 7fa11d200700 1 -- 172.21.15.156:0/1593316006 shutdown_connections 2024-04-23T14:39:34.327 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:34.326+0000 7fa11d200700 1 -- 172.21.15.156:0/1593316006 wait complete. 2024-04-23T14:39:34.328 INFO:teuthology.orchestra.run.smithi156.stderr:dumped monmap epoch 1 2024-04-23T14:39:35.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:34 smithi081 ceph-mon[25540]: from='mgr.14162 172.21.15.81:0/649877872' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-04-23T14:39:35.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:34 smithi081 ceph-mon[25540]: mgrmap e14: smithi081.ldghvq(active, since 76s) 2024-04-23T14:39:35.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:34 smithi081 ceph-mon[25540]: from='client.? 172.21.15.156:0/1593316006' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-23T14:39:36.043 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-23T14:39:36.043 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-23T14:39:36.506 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-23T14:39:36.610 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-23T14:39:38.492 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.492+0000 7ff990600700 1 -- 172.21.15.156:0/3353498641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9880fca60 msgr2=0x7ff9880fce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:38.493 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.492+0000 7ff990600700 1 --2- 172.21.15.156:0/3353498641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9880fca60 0x7ff9880fce70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff97c0048c0 tx=0x7ff97c009e30 comp rx=0 tx=0).stop 2024-04-23T14:39:38.493 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.492+0000 7ff990600700 1 -- 172.21.15.156:0/3353498641 shutdown_connections 2024-04-23T14:39:38.493 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.492+0000 7ff990600700 1 --2- 172.21.15.156:0/3353498641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9880fca60 0x7ff9880fce70 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:38.493 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.492+0000 7ff990600700 1 -- 172.21.15.156:0/3353498641 >> 172.21.15.156:0/3353498641 conn(0x7ff9880f81c0 msgr2=0x7ff9880fa5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:38.493 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.492+0000 7ff990600700 1 -- 172.21.15.156:0/3353498641 shutdown_connections 2024-04-23T14:39:38.493 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.492+0000 7ff990600700 1 -- 172.21.15.156:0/3353498641 wait complete. 2024-04-23T14:39:38.494 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.493+0000 7ff990600700 1 Processor -- start 2024-04-23T14:39:38.494 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.494+0000 7ff990600700 1 -- start start 2024-04-23T14:39:38.494 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.494+0000 7ff990600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9880fca60 0x7ff98810d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:38.494 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.494+0000 7ff990600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98810d5f0 con 0x7ff9880fca60 2024-04-23T14:39:38.494 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.495+0000 7ff98dc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9880fca60 0x7ff98810d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:38.495 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.495+0000 7ff98dc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9880fca60 0x7ff98810d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.156:37738/0 (socket says 172.21.15.156:37738) 2024-04-23T14:39:38.495 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.495+0000 7ff98dc00700 1 -- 172.21.15.156:0/1373370088 learned_addr learned my addr 172.21.15.156:0/1373370088 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-04-23T14:39:38.495 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.495+0000 7ff98dc00700 1 -- 172.21.15.156:0/1373370088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff97c005040 con 0x7ff9880fca60 2024-04-23T14:39:38.495 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.496+0000 7ff98dc00700 1 --2- 172.21.15.156:0/1373370088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9880fca60 0x7ff98810d0b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff97c009680 tx=0x7ff97c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:38.496 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.496+0000 7ff985600700 1 -- 172.21.15.156:0/1373370088 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff97c00b5c0 con 0x7ff9880fca60 2024-04-23T14:39:38.496 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.496+0000 7ff990600700 1 -- 172.21.15.156:0/1373370088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff98810d7f0 con 0x7ff9880fca60 2024-04-23T14:39:38.496 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.496+0000 7ff990600700 1 -- 172.21.15.156:0/1373370088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff98810e360 con 0x7ff9880fca60 2024-04-23T14:39:38.496 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.496+0000 7ff985600700 1 -- 172.21.15.156:0/1373370088 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff97c00be70 con 0x7ff9880fca60 2024-04-23T14:39:38.496 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.496+0000 7ff985600700 1 -- 172.21.15.156:0/1373370088 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff97c0135c0 con 0x7ff9880fca60 2024-04-23T14:39:38.497 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.497+0000 7ff990600700 1 -- 172.21.15.156:0/1373370088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9680052e0 con 0x7ff9880fca60 2024-04-23T14:39:38.498 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.498+0000 7ff985600700 1 -- 172.21.15.156:0/1373370088 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 14) v1 ==== 43446+0+0 (secure 0 0 0) 0x7ff97c004d30 con 0x7ff9880fca60 2024-04-23T14:39:38.498 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.498+0000 7ff985600700 1 --2- 172.21.15.156:0/1373370088 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7ff9700368d0 0x7ff970038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:38.498 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.499+0000 7ff985600700 1 -- 172.21.15.156:0/1373370088 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff97c049470 con 0x7ff9880fca60 2024-04-23T14:39:38.499 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.499+0000 7ff98d200700 1 -- 172.21.15.156:0/1373370088 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7ff9700368d0 msgr2=0x7ff970038d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/3624015234 2024-04-23T14:39:38.499 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.499+0000 7ff98d200700 1 --2- 172.21.15.156:0/1373370088 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7ff9700368d0 0x7ff970038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T14:39:38.513 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.514+0000 7ff985600700 1 -- 172.21.15.156:0/1373370088 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff97c025d30 con 0x7ff9880fca60 2024-04-23T14:39:38.700 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.700+0000 7ff98d200700 1 -- 172.21.15.156:0/1373370088 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7ff9700368d0 msgr2=0x7ff970038d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/3624015234 2024-04-23T14:39:38.700 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.700+0000 7ff98d200700 1 --2- 172.21.15.156:0/1373370088 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7ff9700368d0 0x7ff970038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-23T14:39:38.810 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.810+0000 7ff990600700 1 -- 172.21.15.156:0/1373370088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff968005860 con 0x7ff9880fca60 2024-04-23T14:39:38.812 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.812+0000 7ff985600700 1 -- 172.21.15.156:0/1373370088 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7ff97c021020 con 0x7ff9880fca60 2024-04-23T14:39:38.812 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:39:38.812 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":1,"fsid":"7a641bea-017e-11ef-bc93-c7b262605968","modified":"2024-04-23T14:37:02.223037Z","created":"2024-04-23T14:37:02.223037Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi081","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-23T14:39:38.815 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.815+0000 7ff990600700 1 -- 172.21.15.156:0/1373370088 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7ff9700368d0 msgr2=0x7ff970038d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-23T14:39:38.815 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.815+0000 7ff990600700 1 --2- 172.21.15.156:0/1373370088 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7ff9700368d0 0x7ff970038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:38.816 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.815+0000 7ff990600700 1 -- 172.21.15.156:0/1373370088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9880fca60 msgr2=0x7ff98810d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:38.816 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.815+0000 7ff990600700 1 --2- 172.21.15.156:0/1373370088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9880fca60 0x7ff98810d0b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff97c009680 tx=0x7ff97c009e30 comp rx=0 tx=0).stop 2024-04-23T14:39:38.816 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.815+0000 7ff990600700 1 -- 172.21.15.156:0/1373370088 shutdown_connections 2024-04-23T14:39:38.816 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.815+0000 7ff990600700 1 --2- 172.21.15.156:0/1373370088 >> [v2:172.21.15.81:6800/3624015234,v1:172.21.15.81:6801/3624015234] conn(0x7ff9700368d0 0x7ff970038d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:38.816 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.815+0000 7ff990600700 1 --2- 172.21.15.156:0/1373370088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9880fca60 0x7ff98810d0b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:38.816 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.815+0000 7ff990600700 1 -- 172.21.15.156:0/1373370088 >> 172.21.15.156:0/1373370088 conn(0x7ff9880f81c0 msgr2=0x7ff988103ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:38.816 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.815+0000 7ff990600700 1 -- 172.21.15.156:0/1373370088 shutdown_connections 2024-04-23T14:39:38.816 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:38.815+0000 7ff990600700 1 -- 172.21.15.156:0/1373370088 wait complete. 2024-04-23T14:39:38.817 INFO:teuthology.orchestra.run.smithi156.stderr:dumped monmap epoch 1 2024-04-23T14:39:39.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:38 smithi081 ceph-mon[25540]: from='client.? 172.21.15.156:0/1373370088' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-23T14:39:40.474 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-23T14:39:40.475 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-23T14:39:40.918 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-23T14:39:41.019 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-23T14:39:42.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:42 smithi081 ceph-mon[25540]: Active manager daemon smithi081.ldghvq restarted 2024-04-23T14:39:42.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:42 smithi081 ceph-mon[25540]: Activating manager daemon smithi081.ldghvq 2024-04-23T14:39:42.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:42 smithi081 ceph-mon[25540]: osdmap e5: 0 total, 0 up, 0 in 2024-04-23T14:39:42.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:42 smithi081 ceph-mon[25540]: mgrmap e15: smithi081.ldghvq(active, starting, since 0.00787564s) 2024-04-23T14:39:42.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:42 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi081"}]: dispatch 2024-04-23T14:39:42.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:42 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mgr metadata", "who": "smithi081.ldghvq", "id": "smithi081.ldghvq"}]: dispatch 2024-04-23T14:39:42.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:42 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-23T14:39:42.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:42 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-23T14:39:42.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:42 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-23T14:39:42.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:42 smithi081 ceph-mon[25540]: Manager daemon smithi081.ldghvq is now available 2024-04-23T14:39:42.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:42 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:39:42.848 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:42.847+0000 7fee01e00700 1 -- 172.21.15.156:0/1527824223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedfc065ce0 msgr2=0x7fedfc101ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:42.848 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:42.847+0000 7fee01e00700 1 --2- 172.21.15.156:0/1527824223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedfc065ce0 0x7fedfc101ae0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fedec0048c0 tx=0x7fedec009e30 comp rx=0 tx=0).stop 2024-04-23T14:39:42.848 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:42.847+0000 7fee01e00700 1 -- 172.21.15.156:0/1527824223 shutdown_connections 2024-04-23T14:39:42.848 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:42.847+0000 7fee01e00700 1 --2- 172.21.15.156:0/1527824223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedfc065ce0 0x7fedfc101ae0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:42.849 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:42.847+0000 7fee01e00700 1 -- 172.21.15.156:0/1527824223 >> 172.21.15.156:0/1527824223 conn(0x7fedfc0f70d0 msgr2=0x7fedfc0f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:42.849 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:42.847+0000 7fee01e00700 1 -- 172.21.15.156:0/1527824223 shutdown_connections 2024-04-23T14:39:42.849 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:42.847+0000 7fee01e00700 1 -- 172.21.15.156:0/1527824223 wait complete. 2024-04-23T14:39:42.849 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:42.848+0000 7fee01e00700 1 Processor -- start 2024-04-23T14:39:42.849 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:42.848+0000 7fee01e00700 1 -- start start 2024-04-23T14:39:42.850 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:42.849+0000 7fee01e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedfc065ce0 0x7fedfc10f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:42.850 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:42.849+0000 7fee01e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc10f810 con 0x7fedfc065ce0 2024-04-23T14:39:42.850 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:42.849+0000 7fedfaa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedfc065ce0 0x7fedfc10f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:42.850 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:42.849+0000 7fedfaa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedfc065ce0 0x7fedfc10f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.156:46114/0 (socket says 172.21.15.156:46114) 2024-04-23T14:39:42.850 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:42.849+0000 7fedfaa00700 1 -- 172.21.15.156:0/3744479981 learned_addr learned my addr 172.21.15.156:0/3744479981 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-04-23T14:39:42.850 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:42.850+0000 7fedfaa00700 1 -- 172.21.15.156:0/3744479981 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedec005040 con 0x7fedfc065ce0 2024-04-23T14:39:42.850 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:42.850+0000 7fedfaa00700 1 --2- 172.21.15.156:0/3744479981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedfc065ce0 0x7fedfc10f2d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fedec00b900 tx=0x7fedec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:42.850 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:42.850+0000 7fedf2a00700 1 -- 172.21.15.156:0/3744479981 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fedec00b5c0 con 0x7fedfc065ce0 2024-04-23T14:39:42.850 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:42.850+0000 7fedf2a00700 1 -- 172.21.15.156:0/3744479981 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fedec00be70 con 0x7fedfc065ce0 2024-04-23T14:39:42.851 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:42.850+0000 7fee01e00700 1 -- 172.21.15.156:0/3744479981 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedfc10fa10 con 0x7fedfc065ce0 2024-04-23T14:39:42.851 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:42.850+0000 7fedf2a00700 1 -- 172.21.15.156:0/3744479981 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fedec01c590 con 0x7fedfc065ce0 2024-04-23T14:39:42.851 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:42.850+0000 7fee01e00700 1 -- 172.21.15.156:0/3744479981 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedfc110580 con 0x7fedfc065ce0 2024-04-23T14:39:42.852 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:42.851+0000 7fedf2a00700 1 -- 172.21.15.156:0/3744479981 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 15) v1 ==== 43170+0+0 (secure 0 0 0) 0x7fedec01c850 con 0x7fedfc065ce0 2024-04-23T14:39:42.852 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:42.851+0000 7fee01e00700 1 -- 172.21.15.156:0/3744479981 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedfc105180 con 0x7fedfc065ce0 2024-04-23T14:39:42.852 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:42.852+0000 7fedf2a00700 1 -- 172.21.15.156:0/3744479981 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fedec049120 con 0x7fedfc065ce0 2024-04-23T14:39:42.857 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:42.857+0000 7fedf2a00700 1 -- 172.21.15.156:0/3744479981 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fedec011960 con 0x7fedfc065ce0 2024-04-23T14:39:43.014 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:43.014+0000 7fedf2a00700 1 -- 172.21.15.156:0/3744479981 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 16) v1 ==== 43297+0+0 (secure 0 0 0) 0x7fedec004d30 con 0x7fedfc065ce0 2024-04-23T14:39:43.015 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:43.015+0000 7fedf2a00700 1 --2- 172.21.15.156:0/3744479981 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fede0037880 0x7fede0039c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:43.015 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:43.015+0000 7fedf3e00700 1 --2- 172.21.15.156:0/3744479981 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fede0037880 0x7fede0039c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:43.016 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:43.016+0000 7fedf3e00700 1 --2- 172.21.15.156:0/3744479981 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fede0037880 0x7fede0039c60 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fede4009990 tx=0x7fede4006e40 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:43.186 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:43.186+0000 7fee01e00700 1 -- 172.21.15.156:0/3744479981 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fedfc110f90 con 0x7fedfc065ce0 2024-04-23T14:39:43.187 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:43.187+0000 7fedf2a00700 1 -- 172.21.15.156:0/3744479981 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fedec021070 con 0x7fedfc065ce0 2024-04-23T14:39:43.187 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:39:43.188 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":1,"fsid":"7a641bea-017e-11ef-bc93-c7b262605968","modified":"2024-04-23T14:37:02.223037Z","created":"2024-04-23T14:37:02.223037Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi081","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-23T14:39:43.190 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:43.190+0000 7fee01e00700 1 -- 172.21.15.156:0/3744479981 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fede0037880 msgr2=0x7fede0039c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:43.190 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:43.190+0000 7fee01e00700 1 --2- 172.21.15.156:0/3744479981 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fede0037880 0x7fede0039c60 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fede4009990 tx=0x7fede4006e40 comp rx=0 tx=0).stop 2024-04-23T14:39:43.190 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:43.190+0000 7fee01e00700 1 -- 172.21.15.156:0/3744479981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedfc065ce0 msgr2=0x7fedfc10f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:43.190 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:43.190+0000 7fee01e00700 1 --2- 172.21.15.156:0/3744479981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedfc065ce0 0x7fedfc10f2d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fedec00b900 tx=0x7fedec009e30 comp rx=0 tx=0).stop 2024-04-23T14:39:43.190 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:43.190+0000 7fee01e00700 1 -- 172.21.15.156:0/3744479981 shutdown_connections 2024-04-23T14:39:43.191 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:43.190+0000 7fee01e00700 1 --2- 172.21.15.156:0/3744479981 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fede0037880 0x7fede0039c60 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:43.191 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:43.190+0000 7fee01e00700 1 --2- 172.21.15.156:0/3744479981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedfc065ce0 0x7fedfc10f2d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:43.191 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:43.190+0000 7fee01e00700 1 -- 172.21.15.156:0/3744479981 >> 172.21.15.156:0/3744479981 conn(0x7fedfc0f70d0 msgr2=0x7fedfc105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:43.191 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:43.190+0000 7fee01e00700 1 -- 172.21.15.156:0/3744479981 shutdown_connections 2024-04-23T14:39:43.191 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:43.191+0000 7fee01e00700 1 -- 172.21.15.156:0/3744479981 wait complete. 2024-04-23T14:39:43.192 INFO:teuthology.orchestra.run.smithi156.stderr:dumped monmap epoch 1 2024-04-23T14:39:43.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:43 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:39:43.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:43 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:39:43.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:43 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:39:43.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:43 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi081.ldghvq/mirror_snapshot_schedule"}]: dispatch 2024-04-23T14:39:43.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:43 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi081.ldghvq/trash_purge_schedule"}]: dispatch 2024-04-23T14:39:43.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:43 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:39:43.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:43 smithi081 ceph-mon[25540]: mgrmap e16: smithi081.ldghvq(active, since 1.00962s) 2024-04-23T14:39:44.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:44 smithi081 ceph-mon[25540]: [23/Apr/2024:14:39:42] ENGINE Bus STARTING 2024-04-23T14:39:44.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:44 smithi081 ceph-mon[25540]: [23/Apr/2024:14:39:43] ENGINE Serving on https://172.21.15.81:7150 2024-04-23T14:39:44.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:44 smithi081 ceph-mon[25540]: [23/Apr/2024:14:39:43] ENGINE Bus STARTED 2024-04-23T14:39:44.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:44 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:39:44.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:44 smithi081 ceph-mon[25540]: from='client.? 172.21.15.156:0/3744479981' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-23T14:39:44.942 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-23T14:39:44.942 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-23T14:39:45.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:45 smithi081 ceph-mon[25540]: mgrmap e17: smithi081.ldghvq(active, since 2s) 2024-04-23T14:39:45.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:45 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:39:45.381 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-23T14:39:45.493 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-23T14:39:46.947 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:46 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:39:48.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:47 smithi081 ceph-mon[25540]: from='client.? 172.21.15.156:0/4083200298' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-23T14:39:48.182 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:47.532+0000 7f9e01200700 1 -- 172.21.15.156:0/24322555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dfc071e40 msgr2=0x7f9dfc070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:48.182 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:47.532+0000 7f9e01200700 1 --2- 172.21.15.156:0/24322555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dfc071e40 0x7f9dfc070350 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9dec0048c0 tx=0x7f9dec009e30 comp rx=0 tx=0).stop 2024-04-23T14:39:48.182 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:47.532+0000 7f9e01200700 1 -- 172.21.15.156:0/24322555 shutdown_connections 2024-04-23T14:39:48.182 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:47.532+0000 7f9e01200700 1 --2- 172.21.15.156:0/24322555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dfc071e40 0x7f9dfc070350 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:48.182 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:47.532+0000 7f9e01200700 1 -- 172.21.15.156:0/24322555 >> 172.21.15.156:0/24322555 conn(0x7f9dfc0f8050 msgr2=0x7f9dfc0fa460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:48.182 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:47.532+0000 7f9e01200700 1 -- 172.21.15.156:0/24322555 shutdown_connections 2024-04-23T14:39:48.182 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:47.532+0000 7f9e01200700 1 -- 172.21.15.156:0/24322555 wait complete. 2024-04-23T14:39:48.183 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:47.533+0000 7f9e01200700 1 Processor -- start 2024-04-23T14:39:48.183 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:47.533+0000 7f9e01200700 1 -- start start 2024-04-23T14:39:48.183 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:47.534+0000 7f9e01200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dfc071e40 0x7f9dfc10f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:48.183 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:47.534+0000 7f9e01200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc10f670 con 0x7f9dfc071e40 2024-04-23T14:39:48.183 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:47.534+0000 7f9dfb400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dfc071e40 0x7f9dfc10f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:48.183 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:47.534+0000 7f9dfb400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dfc071e40 0x7f9dfc10f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.156:46138/0 (socket says 172.21.15.156:46138) 2024-04-23T14:39:48.183 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:47.534+0000 7f9dfb400700 1 -- 172.21.15.156:0/4083200298 learned_addr learned my addr 172.21.15.156:0/4083200298 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-04-23T14:39:48.183 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:47.535+0000 7f9dfb400700 1 -- 172.21.15.156:0/4083200298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dec005040 con 0x7f9dfc071e40 2024-04-23T14:39:48.183 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:47.535+0000 7f9dfb400700 1 --2- 172.21.15.156:0/4083200298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dfc071e40 0x7f9dfc10f130 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9dec00b900 tx=0x7f9dec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:48.183 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:47.536+0000 7f9df3400700 1 -- 172.21.15.156:0/4083200298 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9dec00b5c0 con 0x7f9dfc071e40 2024-04-23T14:39:48.183 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:47.536+0000 7f9e01200700 1 -- 172.21.15.156:0/4083200298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dfc10f870 con 0x7f9dfc071e40 2024-04-23T14:39:48.183 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:47.536+0000 7f9df3400700 1 -- 172.21.15.156:0/4083200298 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9dec00be70 con 0x7f9dfc071e40 2024-04-23T14:39:48.183 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:47.536+0000 7f9df3400700 1 -- 172.21.15.156:0/4083200298 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9dec01c590 con 0x7f9dfc071e40 2024-04-23T14:39:48.184 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:39:48.184 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":1,"fsid":"7a641bea-017e-11ef-bc93-c7b262605968","modified":"2024-04-23T14:37:02.223037Z","created":"2024-04-23T14:37:02.223037Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi081","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-23T14:39:48.184 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:47.536+0000 7f9e01200700 1 -- 172.21.15.156:0/4083200298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dfc1103e0 con 0x7f9dfc071e40 2024-04-23T14:39:48.184 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:47.537+0000 7f9e01200700 1 -- 172.21.15.156:0/4083200298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dfc104ff0 con 0x7f9dfc071e40 2024-04-23T14:39:48.184 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:47.538+0000 7f9df3400700 1 -- 172.21.15.156:0/4083200298 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7f9dec004d30 con 0x7f9dfc071e40 2024-04-23T14:39:48.184 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:47.538+0000 7f9df3400700 1 --2- 172.21.15.156:0/4083200298 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f9de0036970 0x7f9de0038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:48.184 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:47.538+0000 7f9df3400700 1 -- 172.21.15.156:0/4083200298 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f9dec049aa0 con 0x7f9dfc071e40 2024-04-23T14:39:48.184 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:47.539+0000 7f9dfaa00700 1 --2- 172.21.15.156:0/4083200298 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f9de0036970 0x7f9de0038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:48.185 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:47.540+0000 7f9dfaa00700 1 --2- 172.21.15.156:0/4083200298 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f9de0036970 0x7f9de0038e20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9de8009990 tx=0x7f9de8006e40 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:48.185 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:47.552+0000 7f9df3400700 1 -- 172.21.15.156:0/4083200298 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f9dec011370 con 0x7f9dfc071e40 2024-04-23T14:39:48.185 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:47.850+0000 7f9e01200700 1 -- 172.21.15.156:0/4083200298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f9dfc04bed0 con 0x7f9dfc071e40 2024-04-23T14:39:48.185 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:47.851+0000 7f9df3400700 1 -- 172.21.15.156:0/4083200298 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f9dec02b070 con 0x7f9dfc071e40 2024-04-23T14:39:48.185 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:47.854+0000 7f9e01200700 1 -- 172.21.15.156:0/4083200298 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f9de0036970 msgr2=0x7f9de0038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:48.185 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:47.854+0000 7f9e01200700 1 --2- 172.21.15.156:0/4083200298 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f9de0036970 0x7f9de0038e20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9de8009990 tx=0x7f9de8006e40 comp rx=0 tx=0).stop 2024-04-23T14:39:48.185 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:47.854+0000 7f9e01200700 1 -- 172.21.15.156:0/4083200298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dfc071e40 msgr2=0x7f9dfc10f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:48.185 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:47.854+0000 7f9e01200700 1 --2- 172.21.15.156:0/4083200298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dfc071e40 0x7f9dfc10f130 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9dec00b900 tx=0x7f9dec009e30 comp rx=0 tx=0).stop 2024-04-23T14:39:48.185 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:47.854+0000 7f9e01200700 1 -- 172.21.15.156:0/4083200298 shutdown_connections 2024-04-23T14:39:48.185 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:47.854+0000 7f9e01200700 1 --2- 172.21.15.156:0/4083200298 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f9de0036970 0x7f9de0038e20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:48.185 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:47.854+0000 7f9e01200700 1 --2- 172.21.15.156:0/4083200298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dfc071e40 0x7f9dfc10f130 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:48.185 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:47.854+0000 7f9e01200700 1 -- 172.21.15.156:0/4083200298 >> 172.21.15.156:0/4083200298 conn(0x7f9dfc0f8050 msgr2=0x7f9dfc105c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:48.185 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:47.854+0000 7f9e01200700 1 -- 172.21.15.156:0/4083200298 shutdown_connections 2024-04-23T14:39:48.185 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:47.854+0000 7f9e01200700 1 -- 172.21.15.156:0/4083200298 wait complete. 2024-04-23T14:39:48.186 INFO:teuthology.orchestra.run.smithi156.stderr:dumped monmap epoch 1 2024-04-23T14:39:49.801 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-23T14:39:49.802 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-23T14:39:50.229 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-23T14:39:50.344 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-23T14:39:50.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:50 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:39:50.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:50 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:39:52.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:51 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:39:52.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:51 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:39:52.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:51 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "who": "osd/host:smithi081", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:39:53.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:53 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:39:53.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:53 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:39:53.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:53 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:39:53.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:53 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:39:53.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:53 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "who": "osd/host:smithi156", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:39:53.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:53 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:39:53.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:53 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:39:53.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:53 smithi081 ceph-mon[25540]: Updating smithi081:/etc/ceph/ceph.conf 2024-04-23T14:39:53.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:53 smithi081 ceph-mon[25540]: Updating smithi156:/etc/ceph/ceph.conf 2024-04-23T14:39:54.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:54 smithi081 ceph-mon[25540]: Updating smithi156:/var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:39:54.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:54 smithi081 ceph-mon[25540]: Updating smithi081:/var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:39:54.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:54 smithi081 ceph-mon[25540]: Updating smithi156:/etc/ceph/ceph.client.admin.keyring 2024-04-23T14:39:54.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:54 smithi081 ceph-mon[25540]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-04-23T14:39:54.697 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:54.696+0000 7f83af200700 1 -- 172.21.15.156:0/2688222240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a80702e0 msgr2=0x7f83a80706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:54.697 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:54.696+0000 7f83af200700 1 --2- 172.21.15.156:0/2688222240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a80702e0 0x7f83a80706b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f83980048c0 tx=0x7f8398009e30 comp rx=0 tx=0).stop 2024-04-23T14:39:54.697 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:54.696+0000 7f83af200700 1 -- 172.21.15.156:0/2688222240 shutdown_connections 2024-04-23T14:39:54.697 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:54.696+0000 7f83af200700 1 --2- 172.21.15.156:0/2688222240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a80702e0 0x7f83a80706b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:54.697 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:54.696+0000 7f83af200700 1 -- 172.21.15.156:0/2688222240 >> 172.21.15.156:0/2688222240 conn(0x7f83a80f85f0 msgr2=0x7f83a80faa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:54.697 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:54.696+0000 7f83af200700 1 -- 172.21.15.156:0/2688222240 shutdown_connections 2024-04-23T14:39:54.697 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:54.696+0000 7f83af200700 1 -- 172.21.15.156:0/2688222240 wait complete. 2024-04-23T14:39:54.698 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:54.697+0000 7f83af200700 1 Processor -- start 2024-04-23T14:39:54.698 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:54.697+0000 7f83af200700 1 -- start start 2024-04-23T14:39:54.699 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:54.697+0000 7f83af200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a80702e0 0x7f83a81153a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:54.699 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:54.697+0000 7f83af200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a81158e0 con 0x7f83a80702e0 2024-04-23T14:39:54.699 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:54.698+0000 7f83a7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a80702e0 0x7f83a81153a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:54.699 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:54.698+0000 7f83a7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a80702e0 0x7f83a81153a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.156:46090/0 (socket says 172.21.15.156:46090) 2024-04-23T14:39:54.699 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:54.698+0000 7f83a7e00700 1 -- 172.21.15.156:0/1117202547 learned_addr learned my addr 172.21.15.156:0/1117202547 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-04-23T14:39:54.699 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:54.698+0000 7f83a7e00700 1 -- 172.21.15.156:0/1117202547 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8398005040 con 0x7f83a80702e0 2024-04-23T14:39:54.699 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:54.699+0000 7f83a7e00700 1 --2- 172.21.15.156:0/1117202547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a80702e0 0x7f83a81153a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f839800b7f0 tx=0x7f8398009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:54.700 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:54.699+0000 7f839fe00700 1 -- 172.21.15.156:0/1117202547 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8398009370 con 0x7f83a80702e0 2024-04-23T14:39:54.700 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:54.699+0000 7f83af200700 1 -- 172.21.15.156:0/1117202547 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83a8115ae0 con 0x7f83a80702e0 2024-04-23T14:39:54.700 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:54.699+0000 7f83af200700 1 -- 172.21.15.156:0/1117202547 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a8115f50 con 0x7f83a80702e0 2024-04-23T14:39:54.700 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:54.699+0000 7f839fe00700 1 -- 172.21.15.156:0/1117202547 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8398013420 con 0x7f83a80702e0 2024-04-23T14:39:54.700 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:54.699+0000 7f839fe00700 1 -- 172.21.15.156:0/1117202547 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f839801c570 con 0x7f83a80702e0 2024-04-23T14:39:54.701 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:54.701+0000 7f83af200700 1 -- 172.21.15.156:0/1117202547 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a8071a20 con 0x7f83a80702e0 2024-04-23T14:39:54.701 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:54.701+0000 7f839fe00700 1 -- 172.21.15.156:0/1117202547 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7f8398013a50 con 0x7f83a80702e0 2024-04-23T14:39:54.702 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:54.701+0000 7f839fe00700 1 --2- 172.21.15.156:0/1117202547 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f838c036970 0x7f838c038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:54.702 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:54.701+0000 7f839fe00700 1 -- 172.21.15.156:0/1117202547 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f8398049490 con 0x7f83a80702e0 2024-04-23T14:39:54.702 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:54.702+0000 7f83a7400700 1 --2- 172.21.15.156:0/1117202547 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f838c036970 0x7f838c038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:54.703 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:54.702+0000 7f83a7400700 1 --2- 172.21.15.156:0/1117202547 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f838c036970 0x7f838c038e20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8394009990 tx=0x7f8394006e40 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:54.720 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:54.719+0000 7f839fe00700 1 -- 172.21.15.156:0/1117202547 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f8398024950 con 0x7f83a80702e0 2024-04-23T14:39:55.000 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:54.999+0000 7f83af200700 1 -- 172.21.15.156:0/1117202547 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f83a805f5f0 con 0x7f83a80702e0 2024-04-23T14:39:55.000 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:54.999+0000 7f839fe00700 1 -- 172.21.15.156:0/1117202547 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f8398021030 con 0x7f83a80702e0 2024-04-23T14:39:55.001 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:39:55.001 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":1,"fsid":"7a641bea-017e-11ef-bc93-c7b262605968","modified":"2024-04-23T14:37:02.223037Z","created":"2024-04-23T14:37:02.223037Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi081","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-23T14:39:55.003 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:55.002+0000 7f83af200700 1 -- 172.21.15.156:0/1117202547 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f838c036970 msgr2=0x7f838c038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:55.004 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:55.002+0000 7f83af200700 1 --2- 172.21.15.156:0/1117202547 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f838c036970 0x7f838c038e20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8394009990 tx=0x7f8394006e40 comp rx=0 tx=0).stop 2024-04-23T14:39:55.004 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:55.002+0000 7f83af200700 1 -- 172.21.15.156:0/1117202547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a80702e0 msgr2=0x7f83a81153a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:55.004 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:55.002+0000 7f83af200700 1 --2- 172.21.15.156:0/1117202547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a80702e0 0x7f83a81153a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f839800b7f0 tx=0x7f8398009e30 comp rx=0 tx=0).stop 2024-04-23T14:39:55.004 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:55.002+0000 7f83af200700 1 -- 172.21.15.156:0/1117202547 shutdown_connections 2024-04-23T14:39:55.004 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:55.002+0000 7f83af200700 1 --2- 172.21.15.156:0/1117202547 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f838c036970 0x7f838c038e20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:55.004 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:55.002+0000 7f83af200700 1 --2- 172.21.15.156:0/1117202547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a80702e0 0x7f83a81153a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:55.004 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:55.002+0000 7f83af200700 1 -- 172.21.15.156:0/1117202547 >> 172.21.15.156:0/1117202547 conn(0x7f83a80f85f0 msgr2=0x7f83a8105ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:55.004 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:55.003+0000 7f83af200700 1 -- 172.21.15.156:0/1117202547 shutdown_connections 2024-04-23T14:39:55.004 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:55.003+0000 7f83af200700 1 -- 172.21.15.156:0/1117202547 wait complete. 2024-04-23T14:39:55.005 INFO:teuthology.orchestra.run.smithi156.stderr:dumped monmap epoch 1 2024-04-23T14:39:55.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:55 smithi081 ceph-mon[25540]: Updating smithi156:/var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T14:39:55.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:55 smithi081 ceph-mon[25540]: Updating smithi081:/var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T14:39:55.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:55 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:39:55.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:55 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:39:55.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:55 smithi081 ceph-mon[25540]: from='client.? 172.21.15.156:0/1117202547' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-23T14:39:55.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:55 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:39:55.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:55 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:39:55.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:55 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:39:55.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:55 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi156", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-23T14:39:55.578 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:55 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi156", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-04-23T14:39:55.578 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:55 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:39:56.515 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:56 smithi081 ceph-mon[25540]: Deploying daemon crash.smithi156 on smithi156 2024-04-23T14:39:56.717 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-23T14:39:56.717 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-23T14:39:57.204 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:39:57.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:39:57 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:39:59.651 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:59.647+0000 7f420ca00700 1 -- 172.21.15.156:0/2244031774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4208102b00 msgr2=0x7f4208102ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:59.651 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:59.647+0000 7f420ca00700 1 --2- 172.21.15.156:0/2244031774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4208102b00 0x7f4208102ed0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f41f80048c0 tx=0x7f41f8009e30 comp rx=0 tx=0).stop 2024-04-23T14:39:59.651 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:59.648+0000 7f420ca00700 1 -- 172.21.15.156:0/2244031774 shutdown_connections 2024-04-23T14:39:59.651 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:59.648+0000 7f420ca00700 1 --2- 172.21.15.156:0/2244031774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4208102b00 0x7f4208102ed0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:59.651 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:59.648+0000 7f420ca00700 1 -- 172.21.15.156:0/2244031774 >> 172.21.15.156:0/2244031774 conn(0x7f42080f8600 msgr2=0x7f42080faa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:59.651 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:59.648+0000 7f420ca00700 1 -- 172.21.15.156:0/2244031774 shutdown_connections 2024-04-23T14:39:59.652 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:59.648+0000 7f420ca00700 1 -- 172.21.15.156:0/2244031774 wait complete. 2024-04-23T14:39:59.652 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:59.649+0000 7f420ca00700 1 Processor -- start 2024-04-23T14:39:59.652 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:59.649+0000 7f420ca00700 1 -- start start 2024-04-23T14:39:59.652 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:59.650+0000 7f420ca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4208102b00 0x7f4208113160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:59.652 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:59.650+0000 7f420ca00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42081136a0 con 0x7f4208102b00 2024-04-23T14:39:59.652 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:59.650+0000 7f4205e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4208102b00 0x7f4208113160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:59.652 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:59.650+0000 7f4205e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4208102b00 0x7f4208113160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.156:46100/0 (socket says 172.21.15.156:46100) 2024-04-23T14:39:59.652 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:59.650+0000 7f4205e00700 1 -- 172.21.15.156:0/1790088233 learned_addr learned my addr 172.21.15.156:0/1790088233 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-04-23T14:39:59.653 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:59.651+0000 7f4205e00700 1 -- 172.21.15.156:0/1790088233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f8005040 con 0x7f4208102b00 2024-04-23T14:39:59.653 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:59.651+0000 7f4205e00700 1 --2- 172.21.15.156:0/1790088233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4208102b00 0x7f4208113160 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f41f800b7f0 tx=0x7f41f8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:59.653 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:59.652+0000 7f41fe000700 1 -- 172.21.15.156:0/1790088233 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f41f8009370 con 0x7f4208102b00 2024-04-23T14:39:59.653 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:59.652+0000 7f420ca00700 1 -- 172.21.15.156:0/1790088233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42081138a0 con 0x7f4208102b00 2024-04-23T14:39:59.653 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:59.652+0000 7f41fe000700 1 -- 172.21.15.156:0/1790088233 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f41f8013420 con 0x7f4208102b00 2024-04-23T14:39:59.653 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:59.652+0000 7f41fe000700 1 -- 172.21.15.156:0/1790088233 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f41f801c590 con 0x7f4208102b00 2024-04-23T14:39:59.653 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:59.652+0000 7f420ca00700 1 -- 172.21.15.156:0/1790088233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4208113d90 con 0x7f4208102b00 2024-04-23T14:39:59.654 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:59.653+0000 7f420ca00700 1 -- 172.21.15.156:0/1790088233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42080fe200 con 0x7f4208102b00 2024-04-23T14:39:59.654 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:59.654+0000 7f41fe000700 1 -- 172.21.15.156:0/1790088233 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7f41f8013a70 con 0x7f4208102b00 2024-04-23T14:39:59.655 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:59.654+0000 7f41fe000700 1 --2- 172.21.15.156:0/1790088233 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f41ec036970 0x7f41ec038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:39:59.655 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:59.654+0000 7f41fe000700 1 -- 172.21.15.156:0/1790088233 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f41f80495a0 con 0x7f4208102b00 2024-04-23T14:39:59.655 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:59.655+0000 7f4205400700 1 --2- 172.21.15.156:0/1790088233 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f41ec036970 0x7f41ec038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:39:59.657 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:59.656+0000 7f4205400700 1 --2- 172.21.15.156:0/1790088233 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f41ec036970 0x7f41ec038e20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f41f4009990 tx=0x7f41f4006e40 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:39:59.671 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:59.670+0000 7f41fe000700 1 -- 172.21.15.156:0/1790088233 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f41f8011d40 con 0x7f4208102b00 2024-04-23T14:39:59.968 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:59.967+0000 7f420ca00700 1 -- 172.21.15.156:0/1790088233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f420805f5f0 con 0x7f4208102b00 2024-04-23T14:39:59.969 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:59.968+0000 7f41fe000700 1 -- 172.21.15.156:0/1790088233 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f41f8021020 con 0x7f4208102b00 2024-04-23T14:39:59.969 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:39:59.969 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":1,"fsid":"7a641bea-017e-11ef-bc93-c7b262605968","modified":"2024-04-23T14:37:02.223037Z","created":"2024-04-23T14:37:02.223037Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi081","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-23T14:39:59.972 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:59.971+0000 7f420ca00700 1 -- 172.21.15.156:0/1790088233 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f41ec036970 msgr2=0x7f41ec038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:59.972 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:59.971+0000 7f420ca00700 1 --2- 172.21.15.156:0/1790088233 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f41ec036970 0x7f41ec038e20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f41f4009990 tx=0x7f41f4006e40 comp rx=0 tx=0).stop 2024-04-23T14:39:59.972 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:59.971+0000 7f420ca00700 1 -- 172.21.15.156:0/1790088233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4208102b00 msgr2=0x7f4208113160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:39:59.972 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:59.971+0000 7f420ca00700 1 --2- 172.21.15.156:0/1790088233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4208102b00 0x7f4208113160 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f41f800b7f0 tx=0x7f41f8009e30 comp rx=0 tx=0).stop 2024-04-23T14:39:59.972 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:59.971+0000 7f420ca00700 1 -- 172.21.15.156:0/1790088233 shutdown_connections 2024-04-23T14:39:59.972 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:59.971+0000 7f420ca00700 1 --2- 172.21.15.156:0/1790088233 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f41ec036970 0x7f41ec038e20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:59.972 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:59.971+0000 7f420ca00700 1 --2- 172.21.15.156:0/1790088233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4208102b00 0x7f4208113160 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:39:59.972 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:59.971+0000 7f420ca00700 1 -- 172.21.15.156:0/1790088233 >> 172.21.15.156:0/1790088233 conn(0x7f42080f8600 msgr2=0x7f42080f9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:39:59.973 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:59.971+0000 7f420ca00700 1 -- 172.21.15.156:0/1790088233 shutdown_connections 2024-04-23T14:39:59.973 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:39:59.971+0000 7f420ca00700 1 -- 172.21.15.156:0/1790088233 wait complete. 2024-04-23T14:39:59.973 INFO:teuthology.orchestra.run.smithi156.stderr:dumped monmap epoch 1 2024-04-23T14:40:01.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:00 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:01.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:00 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:01.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:00 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:01.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:00 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:01.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:00 smithi081 ceph-mon[25540]: Deploying daemon node-exporter.smithi156 on smithi156 2024-04-23T14:40:01.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:00 smithi081 ceph-mon[25540]: from='client.? 172.21.15.156:0/1790088233' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-23T14:40:01.693 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-23T14:40:01.693 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-23T14:40:02.127 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:40:03.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:03 smithi081 ceph-mon[25540]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:03.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:03 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:05.515 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:05.410+0000 7f353c400700 1 -- 172.21.15.156:0/3523718866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3534071f90 msgr2=0x7f3534070360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:40:05.515 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:05.410+0000 7f353c400700 1 --2- 172.21.15.156:0/3523718866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3534071f90 0x7f3534070360 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f35280048c0 tx=0x7f3528009e30 comp rx=0 tx=0).stop 2024-04-23T14:40:05.515 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:05.410+0000 7f353c400700 1 -- 172.21.15.156:0/3523718866 shutdown_connections 2024-04-23T14:40:05.515 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:05.410+0000 7f353c400700 1 --2- 172.21.15.156:0/3523718866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3534071f90 0x7f3534070360 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:05.515 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:05.410+0000 7f353c400700 1 -- 172.21.15.156:0/3523718866 >> 172.21.15.156:0/3523718866 conn(0x7f35340f85f0 msgr2=0x7f35340faa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:40:05.515 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:05.410+0000 7f353c400700 1 -- 172.21.15.156:0/3523718866 shutdown_connections 2024-04-23T14:40:05.516 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:05.410+0000 7f353c400700 1 -- 172.21.15.156:0/3523718866 wait complete. 2024-04-23T14:40:05.516 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:05.411+0000 7f353c400700 1 Processor -- start 2024-04-23T14:40:05.516 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:05.411+0000 7f353c400700 1 -- start start 2024-04-23T14:40:05.516 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:05.411+0000 7f353c400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3534071f90 0x7f35341197c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:40:05.516 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:05.411+0000 7f353c400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3534119d00 con 0x7f3534071f90 2024-04-23T14:40:05.516 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:05.412+0000 7f3539a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3534071f90 0x7f35341197c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:40:05.516 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:05.412+0000 7f3539a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3534071f90 0x7f35341197c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.156:44750/0 (socket says 172.21.15.156:44750) 2024-04-23T14:40:05.516 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:05.412+0000 7f3539a00700 1 -- 172.21.15.156:0/1100787016 learned_addr learned my addr 172.21.15.156:0/1100787016 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-04-23T14:40:05.516 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:05.413+0000 7f3539a00700 1 -- 172.21.15.156:0/1100787016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3528005040 con 0x7f3534071f90 2024-04-23T14:40:05.516 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:05.413+0000 7f3539a00700 1 --2- 172.21.15.156:0/1100787016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3534071f90 0x7f35341197c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3528009330 tx=0x7f3528009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:40:05.516 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:05.414+0000 7f3531600700 1 -- 172.21.15.156:0/1100787016 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f352800b970 con 0x7f3534071f90 2024-04-23T14:40:05.516 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:05.414+0000 7f353c400700 1 -- 172.21.15.156:0/1100787016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3534119f00 con 0x7f3534071f90 2024-04-23T14:40:05.516 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:05.414+0000 7f353c400700 1 -- 172.21.15.156:0/1100787016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f353411a370 con 0x7f3534071f90 2024-04-23T14:40:05.516 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:05.414+0000 7f3531600700 1 -- 172.21.15.156:0/1100787016 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3528013420 con 0x7f3534071f90 2024-04-23T14:40:05.516 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:05.414+0000 7f3531600700 1 -- 172.21.15.156:0/1100787016 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f352801c590 con 0x7f3534071f90 2024-04-23T14:40:05.517 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:05.415+0000 7f353c400700 1 -- 172.21.15.156:0/1100787016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3534071aa0 con 0x7f3534071f90 2024-04-23T14:40:05.517 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:05.415+0000 7f3531600700 1 -- 172.21.15.156:0/1100787016 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7f3528013a90 con 0x7f3534071f90 2024-04-23T14:40:05.517 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:05.416+0000 7f3531600700 1 --2- 172.21.15.156:0/1100787016 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f351c0369c0 0x7f351c038e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:40:05.517 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:05.416+0000 7f3531600700 1 -- 172.21.15.156:0/1100787016 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f35280494f0 con 0x7f3534071f90 2024-04-23T14:40:05.517 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:05.417+0000 7f3539000700 1 --2- 172.21.15.156:0/1100787016 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f351c0369c0 0x7f351c038e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:40:05.517 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:05.418+0000 7f3539000700 1 --2- 172.21.15.156:0/1100787016 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f351c0369c0 0x7f351c038e70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3520009990 tx=0x7f3520006e40 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:40:05.517 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:05.431+0000 7f3531600700 1 -- 172.21.15.156:0/1100787016 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3528024770 con 0x7f3534071f90 2024-04-23T14:40:05.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:05 smithi081 ceph-mon[25540]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:05.729 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:05.727+0000 7f353c400700 1 -- 172.21.15.156:0/1100787016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f353410d430 con 0x7f3534071f90 2024-04-23T14:40:05.729 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:05.728+0000 7f3531600700 1 -- 172.21.15.156:0/1100787016 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f3528021030 con 0x7f3534071f90 2024-04-23T14:40:05.730 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:40:05.730 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":1,"fsid":"7a641bea-017e-11ef-bc93-c7b262605968","modified":"2024-04-23T14:37:02.223037Z","created":"2024-04-23T14:37:02.223037Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi081","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-23T14:40:05.732 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:05.731+0000 7f353c400700 1 -- 172.21.15.156:0/1100787016 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f351c0369c0 msgr2=0x7f351c038e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:40:05.732 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:05.731+0000 7f353c400700 1 --2- 172.21.15.156:0/1100787016 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f351c0369c0 0x7f351c038e70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3520009990 tx=0x7f3520006e40 comp rx=0 tx=0).stop 2024-04-23T14:40:05.732 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:05.731+0000 7f353c400700 1 -- 172.21.15.156:0/1100787016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3534071f90 msgr2=0x7f35341197c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:40:05.732 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:05.731+0000 7f353c400700 1 --2- 172.21.15.156:0/1100787016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3534071f90 0x7f35341197c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3528009330 tx=0x7f3528009e30 comp rx=0 tx=0).stop 2024-04-23T14:40:05.732 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:05.731+0000 7f353c400700 1 -- 172.21.15.156:0/1100787016 shutdown_connections 2024-04-23T14:40:05.732 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:05.731+0000 7f353c400700 1 --2- 172.21.15.156:0/1100787016 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f351c0369c0 0x7f351c038e70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:05.733 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:05.731+0000 7f353c400700 1 --2- 172.21.15.156:0/1100787016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3534071f90 0x7f35341197c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:05.733 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:05.731+0000 7f353c400700 1 -- 172.21.15.156:0/1100787016 >> 172.21.15.156:0/1100787016 conn(0x7f35340f85f0 msgr2=0x7f35340f9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:40:05.733 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:05.731+0000 7f353c400700 1 -- 172.21.15.156:0/1100787016 shutdown_connections 2024-04-23T14:40:05.733 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:05.731+0000 7f353c400700 1 -- 172.21.15.156:0/1100787016 wait complete. 2024-04-23T14:40:05.733 INFO:teuthology.orchestra.run.smithi156.stderr:dumped monmap epoch 1 2024-04-23T14:40:06.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:06 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:06.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:06 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:06.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:06 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:06.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:06 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:06.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:06 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi156.ounwyj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-23T14:40:06.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:06 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi156.ounwyj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-23T14:40:06.828 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:06 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-23T14:40:06.828 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:06 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:06.828 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:06 smithi081 ceph-mon[25540]: Deploying daemon mgr.smithi156.ounwyj on smithi156 2024-04-23T14:40:06.828 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:06 smithi081 ceph-mon[25540]: from='client.? 172.21.15.156:0/1100787016' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-23T14:40:07.458 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-23T14:40:07.458 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-23T14:40:07.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:07 smithi081 ceph-mon[25540]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:07.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:07 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:08.130 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:40:10.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:09 smithi081 ceph-mon[25540]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:10.450 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:10.378+0000 7f4d2d200700 1 -- 172.21.15.156:0/725075218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d281028f0 msgr2=0x7f4d28102cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:40:10.450 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:10.378+0000 7f4d2d200700 1 --2- 172.21.15.156:0/725075218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d281028f0 0x7f4d28102cc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4d180048c0 tx=0x7f4d18009e30 comp rx=0 tx=0).stop 2024-04-23T14:40:10.450 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:10.378+0000 7f4d2d200700 1 -- 172.21.15.156:0/725075218 shutdown_connections 2024-04-23T14:40:10.450 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:10.378+0000 7f4d2d200700 1 --2- 172.21.15.156:0/725075218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d281028f0 0x7f4d28102cc0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:10.450 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:10.378+0000 7f4d2d200700 1 -- 172.21.15.156:0/725075218 >> 172.21.15.156:0/725075218 conn(0x7f4d280f83f0 msgr2=0x7f4d280fa800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:40:10.450 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:10.378+0000 7f4d2d200700 1 -- 172.21.15.156:0/725075218 shutdown_connections 2024-04-23T14:40:10.450 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:10.378+0000 7f4d2d200700 1 -- 172.21.15.156:0/725075218 wait complete. 2024-04-23T14:40:10.450 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:10.379+0000 7f4d2d200700 1 Processor -- start 2024-04-23T14:40:10.450 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:10.379+0000 7f4d2d200700 1 -- start start 2024-04-23T14:40:10.450 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:10.380+0000 7f4d2d200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d281028f0 0x7f4d28112fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:40:10.450 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:10.380+0000 7f4d2d200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d281134e0 con 0x7f4d281028f0 2024-04-23T14:40:10.451 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:10.380+0000 7f4d27400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d281028f0 0x7f4d28112fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:40:10.451 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:10.380+0000 7f4d27400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d281028f0 0x7f4d28112fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.156:44776/0 (socket says 172.21.15.156:44776) 2024-04-23T14:40:10.451 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:10.380+0000 7f4d27400700 1 -- 172.21.15.156:0/1317015074 learned_addr learned my addr 172.21.15.156:0/1317015074 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-04-23T14:40:10.451 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:10.381+0000 7f4d27400700 1 -- 172.21.15.156:0/1317015074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d18005040 con 0x7f4d281028f0 2024-04-23T14:40:10.451 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:10.382+0000 7f4d27400700 1 --2- 172.21.15.156:0/1317015074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d281028f0 0x7f4d28112fa0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4d1800b820 tx=0x7f4d18009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:40:10.451 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:10.382+0000 7f4d1f400700 1 -- 172.21.15.156:0/1317015074 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4d180093c0 con 0x7f4d281028f0 2024-04-23T14:40:10.451 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:10.382+0000 7f4d2d200700 1 -- 172.21.15.156:0/1317015074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d281136e0 con 0x7f4d281028f0 2024-04-23T14:40:10.451 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:10.382+0000 7f4d2d200700 1 -- 172.21.15.156:0/1317015074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d28113bd0 con 0x7f4d281028f0 2024-04-23T14:40:10.451 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:10.382+0000 7f4d1f400700 1 -- 172.21.15.156:0/1317015074 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4d18013420 con 0x7f4d281028f0 2024-04-23T14:40:10.451 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:10.382+0000 7f4d1f400700 1 -- 172.21.15.156:0/1317015074 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4d180255c0 con 0x7f4d281028f0 2024-04-23T14:40:10.451 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:10.383+0000 7f4d2d200700 1 -- 172.21.15.156:0/1317015074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d280fdff0 con 0x7f4d281028f0 2024-04-23T14:40:10.451 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:10.384+0000 7f4d1f400700 1 -- 172.21.15.156:0/1317015074 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7f4d18013590 con 0x7f4d281028f0 2024-04-23T14:40:10.451 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:10.384+0000 7f4d1f400700 1 --2- 172.21.15.156:0/1317015074 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f4d0c036970 0x7f4d0c038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:40:10.451 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:10.384+0000 7f4d1f400700 1 -- 172.21.15.156:0/1317015074 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f4d18049ee0 con 0x7f4d281028f0 2024-04-23T14:40:10.451 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:10.385+0000 7f4d26a00700 1 --2- 172.21.15.156:0/1317015074 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f4d0c036970 0x7f4d0c038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:40:10.452 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:10.386+0000 7f4d26a00700 1 --2- 172.21.15.156:0/1317015074 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f4d0c036970 0x7f4d0c038e20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4d14009990 tx=0x7f4d14006e40 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:40:10.452 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:10.399+0000 7f4d1f400700 1 -- 172.21.15.156:0/1317015074 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f4d18024360 con 0x7f4d281028f0 2024-04-23T14:40:10.700 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:10.699+0000 7f4d2d200700 1 -- 172.21.15.156:0/1317015074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4d2805f5f0 con 0x7f4d281028f0 2024-04-23T14:40:10.701 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:10.701+0000 7f4d1f400700 1 -- 172.21.15.156:0/1317015074 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f4d18011ad0 con 0x7f4d281028f0 2024-04-23T14:40:10.702 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:40:10.702 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":1,"fsid":"7a641bea-017e-11ef-bc93-c7b262605968","modified":"2024-04-23T14:37:02.223037Z","created":"2024-04-23T14:37:02.223037Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi081","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-23T14:40:10.704 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:10.703+0000 7f4d2d200700 1 -- 172.21.15.156:0/1317015074 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f4d0c036970 msgr2=0x7f4d0c038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:40:10.704 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:10.703+0000 7f4d2d200700 1 --2- 172.21.15.156:0/1317015074 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f4d0c036970 0x7f4d0c038e20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4d14009990 tx=0x7f4d14006e40 comp rx=0 tx=0).stop 2024-04-23T14:40:10.704 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:10.703+0000 7f4d2d200700 1 -- 172.21.15.156:0/1317015074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d281028f0 msgr2=0x7f4d28112fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:40:10.704 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:10.703+0000 7f4d2d200700 1 --2- 172.21.15.156:0/1317015074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d281028f0 0x7f4d28112fa0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4d1800b820 tx=0x7f4d18009e30 comp rx=0 tx=0).stop 2024-04-23T14:40:10.704 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:10.703+0000 7f4d2d200700 1 -- 172.21.15.156:0/1317015074 shutdown_connections 2024-04-23T14:40:10.705 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:10.703+0000 7f4d2d200700 1 --2- 172.21.15.156:0/1317015074 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f4d0c036970 0x7f4d0c038e20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:10.705 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:10.703+0000 7f4d2d200700 1 --2- 172.21.15.156:0/1317015074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d281028f0 0x7f4d28112fa0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:10.705 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:10.703+0000 7f4d2d200700 1 -- 172.21.15.156:0/1317015074 >> 172.21.15.156:0/1317015074 conn(0x7f4d280f83f0 msgr2=0x7f4d280f9a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:40:10.705 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:10.703+0000 7f4d2d200700 1 -- 172.21.15.156:0/1317015074 shutdown_connections 2024-04-23T14:40:10.705 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:10.703+0000 7f4d2d200700 1 -- 172.21.15.156:0/1317015074 wait complete. 2024-04-23T14:40:10.705 INFO:teuthology.orchestra.run.smithi156.stderr:dumped monmap epoch 1 2024-04-23T14:40:12.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:11 smithi081 ceph-mon[25540]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:12.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:11 smithi081 ceph-mon[25540]: from='client.? 172.21.15.156:0/1317015074' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-23T14:40:12.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:11 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:12.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:11 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:12.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:11 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:12.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:11 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:12.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:11 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T14:40:12.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:11 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:12.377 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-23T14:40:12.378 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-23T14:40:13.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:12 smithi081 ceph-mon[25540]: Deploying daemon mon.smithi156 on smithi156 2024-04-23T14:40:13.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:12 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:40:13.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:12 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:13.881 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi156/config 2024-04-23T14:40:14.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:13 smithi081 ceph-mon[25540]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:15.356 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 podman[32304]: 2024-04-23 14:40:15.239706676 +0000 UTC m=+0.034341881 image pull cafd8ddac8fa176bf00aeacab8beaeeffcb0c5261d2d415c33683cb8bed0534e quay.ceph.io/ceph-ci/ceph@sha256:3890cd726bd5e73ae623dabdf4ed76dd5df81c936b8bd8d761026babda969466 2024-04-23T14:40:15.357 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 podman[32304]: 2024-04-23 14:40:15.355396562 +0000 UTC m=+0.150031805 container create d9127540d3bbee23319d4759bdab29035952e95c1fcc3bd9c128d99991cffc33 (image=quay.ceph.io/ceph-ci/ceph@sha256:3890cd726bd5e73ae623dabdf4ed76dd5df81c936b8bd8d761026babda969466, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi156, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-70d0cb4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-04-23T14:40:15.972 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 podman[32304]: 2024-04-23 14:40:15.608704866 +0000 UTC m=+0.403340086 container init d9127540d3bbee23319d4759bdab29035952e95c1fcc3bd9c128d99991cffc33 (image=quay.ceph.io/ceph-ci/ceph@sha256:3890cd726bd5e73ae623dabdf4ed76dd5df81c936b8bd8d761026babda969466, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi156, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=quincy-70d0cb4, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-04-23T14:40:15.972 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 podman[32304]: 2024-04-23 14:40:15.619361051 +0000 UTC m=+0.413996262 container start d9127540d3bbee23319d4759bdab29035952e95c1fcc3bd9c128d99991cffc33 (image=quay.ceph.io/ceph-ci/ceph@sha256:3890cd726bd5e73ae623dabdf4ed76dd5df81c936b8bd8d761026babda969466, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi156, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=quincy-70d0cb4, io.buildah.version=1.33.5, ceph=True) 2024-04-23T14:40:15.972 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: set uid:gid to 167:167 (ceph:ceph) 2024-04-23T14:40:15.972 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable), process ceph-mon, pid 2 2024-04-23T14:40:15.972 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: pidfile_write: ignore empty --pid-file 2024-04-23T14:40:15.973 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: load: jerasure load: lrc 2024-04-23T14:40:15.973 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: RocksDB version: 6.15.5 2024-04-23T14:40:15.973 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-04-23T14:40:15.973 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Compile date Apr 22 2024 2024-04-23T14:40:15.973 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: DB SUMMARY 2024-04-23T14:40:15.973 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: DB Session ID: CMAANQDQNI9QG5EVC01G 2024-04-23T14:40:15.973 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: CURRENT file: CURRENT 2024-04-23T14:40:15.973 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: IDENTITY file: IDENTITY 2024-04-23T14:40:15.973 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2024-04-23T14:40:15.973 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi156/store.db dir, Total Num: 0, files: 2024-04-23T14:40:15.973 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi156/store.db: 000004.log size: 511 ; 2024-04-23T14:40:15.974 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.error_if_exists: 0 2024-04-23T14:40:15.974 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.create_if_missing: 0 2024-04-23T14:40:15.974 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.paranoid_checks: 1 2024-04-23T14:40:15.974 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-23T14:40:15.974 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.env: 0x55cf69ef7b00 2024-04-23T14:40:15.974 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.fs: Posix File System 2024-04-23T14:40:15.974 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.info_log: 0x55cfa2c03c00 2024-04-23T14:40:15.974 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.max_file_opening_threads: 16 2024-04-23T14:40:15.974 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.statistics: (nil) 2024-04-23T14:40:15.974 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.use_fsync: 0 2024-04-23T14:40:15.976 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.max_log_file_size: 0 2024-04-23T14:40:15.977 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-23T14:40:15.977 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-23T14:40:15.977 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.keep_log_file_num: 1000 2024-04-23T14:40:15.977 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.recycle_log_file_num: 0 2024-04-23T14:40:15.977 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.allow_fallocate: 1 2024-04-23T14:40:15.977 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.allow_mmap_reads: 0 2024-04-23T14:40:15.977 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.allow_mmap_writes: 0 2024-04-23T14:40:15.977 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.use_direct_reads: 0 2024-04-23T14:40:15.977 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-23T14:40:15.977 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.create_missing_column_families: 0 2024-04-23T14:40:15.977 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.db_log_dir: 2024-04-23T14:40:15.977 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi156/store.db 2024-04-23T14:40:15.978 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-23T14:40:15.978 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-23T14:40:15.978 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-23T14:40:15.978 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-23T14:40:15.978 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-23T14:40:15.978 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-23T14:40:15.978 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.advise_random_on_open: 1 2024-04-23T14:40:15.978 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.db_write_buffer_size: 0 2024-04-23T14:40:15.978 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.write_buffer_manager: 0x55cfa3978a20 2024-04-23T14:40:15.978 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-23T14:40:15.978 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-04-23T14:40:15.979 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-23T14:40:15.979 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-23T14:40:15.979 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.rate_limiter: (nil) 2024-04-23T14:40:15.979 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-23T14:40:15.979 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.wal_recovery_mode: 2 2024-04-23T14:40:15.979 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.enable_thread_tracking: 0 2024-04-23T14:40:15.979 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.enable_pipelined_write: 0 2024-04-23T14:40:15.979 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.unordered_write: 0 2024-04-23T14:40:15.979 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-23T14:40:15.979 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-23T14:40:15.979 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-23T14:40:15.979 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-23T14:40:15.979 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.row_cache: None 2024-04-23T14:40:15.980 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.wal_filter: None 2024-04-23T14:40:15.980 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-23T14:40:15.980 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.allow_ingest_behind: 0 2024-04-23T14:40:15.980 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.preserve_deletes: 0 2024-04-23T14:40:15.980 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.two_write_queues: 0 2024-04-23T14:40:15.980 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.manual_wal_flush: 0 2024-04-23T14:40:15.980 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.atomic_flush: 0 2024-04-23T14:40:15.980 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-23T14:40:15.980 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-23T14:40:15.980 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-23T14:40:15.980 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.log_readahead_size: 0 2024-04-23T14:40:15.980 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-23T14:40:15.980 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.best_efforts_recovery: 0 2024-04-23T14:40:15.981 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-23T14:40:15.981 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-23T14:40:15.981 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.allow_data_in_errors: 0 2024-04-23T14:40:15.981 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.db_host_id: __hostname__ 2024-04-23T14:40:15.981 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.max_background_jobs: 2 2024-04-23T14:40:15.981 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.max_background_compactions: -1 2024-04-23T14:40:15.981 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.max_subcompactions: 1 2024-04-23T14:40:15.981 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-23T14:40:15.981 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-23T14:40:15.981 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-23T14:40:15.981 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.max_total_wal_size: 0 2024-04-23T14:40:15.981 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-23T14:40:15.981 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-23T14:40:15.982 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-23T14:40:15.982 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-23T14:40:15.982 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.max_open_files: -1 2024-04-23T14:40:15.982 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.bytes_per_sync: 0 2024-04-23T14:40:15.982 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-23T14:40:15.982 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-23T14:40:15.982 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.compaction_readahead_size: 0 2024-04-23T14:40:15.982 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.max_background_flushes: -1 2024-04-23T14:40:15.982 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Compression algorithms supported: 2024-04-23T14:40:15.982 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-23T14:40:15.982 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: kZSTD supported: 0 2024-04-23T14:40:15.982 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: kXpressCompression supported: 0 2024-04-23T14:40:15.983 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: kLZ4HCCompression supported: 1 2024-04-23T14:40:15.983 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: kZlibCompression supported: 1 2024-04-23T14:40:15.983 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: kSnappyCompression supported: 1 2024-04-23T14:40:15.983 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: kLZ4Compression supported: 1 2024-04-23T14:40:15.983 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: kBZip2Compression supported: 0 2024-04-23T14:40:15.983 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-23T14:40:15.983 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi156/store.db/MANIFEST-000003 2024-04-23T14:40:15.983 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-04-23T14:40:15.983 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-23T14:40:15.983 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.merge_operator: 2024-04-23T14:40:15.983 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.compaction_filter: None 2024-04-23T14:40:15.983 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.compaction_filter_factory: None 2024-04-23T14:40:15.984 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.sst_partitioner_factory: None 2024-04-23T14:40:15.984 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-23T14:40:15.984 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-23T14:40:15.984 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55cfa2c58f58) 2024-04-23T14:40:15.984 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: cache_index_and_filter_blocks: 1 2024-04-23T14:40:15.984 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-23T14:40:15.984 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-23T14:40:15.984 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: pin_top_level_index_and_filter: 1 2024-04-23T14:40:15.984 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: index_type: 0 2024-04-23T14:40:15.984 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: data_block_index_type: 0 2024-04-23T14:40:15.984 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: index_shortening: 1 2024-04-23T14:40:15.984 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-23T14:40:15.985 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: hash_index_allow_collision: 1 2024-04-23T14:40:15.985 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: checksum: 1 2024-04-23T14:40:15.985 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: no_block_cache: 0 2024-04-23T14:40:15.985 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: block_cache: 0x55cfa2c8b090 2024-04-23T14:40:15.985 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: block_cache_name: BinnedLRUCache 2024-04-23T14:40:15.985 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: block_cache_options: 2024-04-23T14:40:15.985 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: capacity : 536870912 2024-04-23T14:40:15.985 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: num_shard_bits : 4 2024-04-23T14:40:15.985 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: strict_capacity_limit : 0 2024-04-23T14:40:15.985 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: high_pri_pool_ratio: 0.000 2024-04-23T14:40:15.985 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: block_cache_compressed: (nil) 2024-04-23T14:40:15.985 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: persistent_cache: (nil) 2024-04-23T14:40:15.985 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: block_size: 4096 2024-04-23T14:40:15.986 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: block_size_deviation: 10 2024-04-23T14:40:15.986 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: block_restart_interval: 16 2024-04-23T14:40:15.986 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: index_block_restart_interval: 1 2024-04-23T14:40:15.986 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: metadata_block_size: 4096 2024-04-23T14:40:15.986 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: partition_filters: 0 2024-04-23T14:40:15.986 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: use_delta_encoding: 1 2024-04-23T14:40:15.986 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-04-23T14:40:15.986 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: whole_key_filtering: 1 2024-04-23T14:40:15.986 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: verify_compression: 0 2024-04-23T14:40:15.986 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: read_amp_bytes_per_bit: 0 2024-04-23T14:40:15.986 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: format_version: 4 2024-04-23T14:40:15.986 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: enable_index_compression: 1 2024-04-23T14:40:15.987 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: block_align: 0 2024-04-23T14:40:15.987 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.write_buffer_size: 33554432 2024-04-23T14:40:15.987 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.max_write_buffer_number: 2 2024-04-23T14:40:15.987 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.compression: NoCompression 2024-04-23T14:40:15.987 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.bottommost_compression: Disabled 2024-04-23T14:40:15.987 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.prefix_extractor: nullptr 2024-04-23T14:40:15.987 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-23T14:40:15.987 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.num_levels: 7 2024-04-23T14:40:15.987 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-23T14:40:15.987 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-23T14:40:15.987 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-23T14:40:15.987 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-23T14:40:15.987 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-23T14:40:15.988 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-23T14:40:15.988 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-23T14:40:15.988 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-23T14:40:15.988 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-23T14:40:15.988 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-23T14:40:15.988 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-23T14:40:15.988 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.compression_opts.level: 32767 2024-04-23T14:40:15.988 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.compression_opts.strategy: 0 2024-04-23T14:40:15.988 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-23T14:40:15.988 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-23T14:40:15.988 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-23T14:40:15.988 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.compression_opts.enabled: false 2024-04-23T14:40:15.988 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-23T14:40:15.988 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-23T14:40:15.989 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-23T14:40:15.989 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.target_file_size_base: 67108864 2024-04-23T14:40:15.989 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-23T14:40:15.989 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-23T14:40:15.989 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-23T14:40:15.989 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-23T14:40:15.989 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-23T14:40:15.989 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-23T14:40:15.989 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-23T14:40:15.989 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-23T14:40:15.989 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-23T14:40:15.989 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-23T14:40:15.990 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-23T14:40:15.990 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-23T14:40:15.990 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-23T14:40:15.990 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.arena_block_size: 4194304 2024-04-23T14:40:15.990 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-23T14:40:15.990 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-23T14:40:15.990 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-04-23T14:40:15.990 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.disable_auto_compactions: 0 2024-04-23T14:40:15.990 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-23T14:40:15.990 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-23T14:40:15.990 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-23T14:40:15.990 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-23T14:40:15.991 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-23T14:40:15.991 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-23T14:40:15.991 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-23T14:40:15.991 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-23T14:40:15.991 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-23T14:40:15.991 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-23T14:40:15.991 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.table_properties_collectors: 2024-04-23T14:40:15.991 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.inplace_update_support: 0 2024-04-23T14:40:15.991 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-23T14:40:15.991 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-23T14:40:15.991 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-23T14:40:15.991 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-23T14:40:15.992 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.bloom_locality: 0 2024-04-23T14:40:15.992 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.max_successive_merges: 0 2024-04-23T14:40:15.992 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-23T14:40:15.992 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.paranoid_file_checks: 0 2024-04-23T14:40:15.992 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.force_consistency_checks: 1 2024-04-23T14:40:15.992 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.report_bg_io_stats: 0 2024-04-23T14:40:15.992 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.ttl: 2592000 2024-04-23T14:40:15.992 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-23T14:40:15.992 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.enable_blob_files: false 2024-04-23T14:40:15.992 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.min_blob_size: 0 2024-04-23T14:40:15.992 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.blob_file_size: 268435456 2024-04-23T14:40:15.992 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-23T14:40:15.992 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-23T14:40:15.993 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-23T14:40:15.993 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi156/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-23T14:40:15.993 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 0 2024-04-23T14:40:15.993 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: [db/version_set.cc:4082] Creating manifest 7 2024-04-23T14:40:15.993 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713883215667655, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-04-23T14:40:15.993 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #4 mode 2 2024-04-23T14:40:15.993 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-04-23T14:40:15.993 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713883215668497, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1545, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1713883215, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "4f9377e5-bedd-4293-bb80-1b7a54d7ef18", "db_session_id": "CMAANQDQNI9QG5EVC01G"}} 2024-04-23T14:40:15.993 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: [db/version_set.cc:4082] Creating manifest 9 2024-04-23T14:40:15.993 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713883215669208, "job": 1, "event": "recovery_finished"} 2024-04-23T14:40:15.993 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi156/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-23T14:40:15.993 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55cfa2c1f180 2024-04-23T14:40:15.993 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: DB pointer 0x55cfa2cf4000 2024-04-23T14:40:15.994 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-04-23T14:40:15.994 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-04-23T14:40:15.994 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: ** DB Stats ** 2024-04-23T14:40:15.994 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-23T14:40:15.994 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-23T14:40:15.994 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-23T14:40:15.994 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-23T14:40:15.994 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-23T14:40:15.994 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-04-23T14:40:15.994 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-23T14:40:15.994 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: 2024-04-23T14:40:15.994 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: ** Compaction Stats [default] ** 2024-04-23T14:40:15.994 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-23T14:40:15.994 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-23T14:40:15.995 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.8 0.00 0.00 1 0.001 0 0 2024-04-23T14:40:15.995 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.8 0.00 0.00 1 0.001 0 0 2024-04-23T14:40:15.995 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.8 0.00 0.00 1 0.001 0 0 2024-04-23T14:40:15.995 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: 2024-04-23T14:40:15.995 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: ** Compaction Stats [default] ** 2024-04-23T14:40:15.995 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-23T14:40:15.995 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-23T14:40:15.995 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.8 0.00 0.00 1 0.001 0 0 2024-04-23T14:40:15.995 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-23T14:40:15.995 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-23T14:40:15.995 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-23T14:40:15.995 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-23T14:40:15.996 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-23T14:40:15.996 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-23T14:40:15.996 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Cumulative compaction: 0.00 GB write, 0.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-23T14:40:15.996 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Interval compaction: 0.00 GB write, 0.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-23T14:40:15.996 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-23T14:40:15.996 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: 2024-04-23T14:40:15.996 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-23T14:40:15.996 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: 2024-04-23T14:40:15.996 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: ** Compaction Stats [default] ** 2024-04-23T14:40:15.996 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-23T14:40:15.996 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-23T14:40:15.996 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.8 0.00 0.00 1 0.001 0 0 2024-04-23T14:40:15.997 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.8 0.00 0.00 1 0.001 0 0 2024-04-23T14:40:15.997 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-04-23T14:40:15.997 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: 2024-04-23T14:40:15.997 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: ** Compaction Stats [default] ** 2024-04-23T14:40:15.997 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-23T14:40:15.997 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-23T14:40:15.997 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.8 0.00 0.00 1 0.001 0 0 2024-04-23T14:40:15.997 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-23T14:40:15.997 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-23T14:40:15.997 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-23T14:40:15.997 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-23T14:40:15.997 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-23T14:40:15.997 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-23T14:40:15.998 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Cumulative compaction: 0.00 GB write, 0.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-23T14:40:15.998 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-23T14:40:15.998 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-23T14:40:15.998 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: 2024-04-23T14:40:15.998 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-23T14:40:15.998 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: mon.smithi156 does not exist in monmap, will attempt to join an existing cluster 2024-04-23T14:40:15.998 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: using public_addr v2:172.21.15.156:0/0 -> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2024-04-23T14:40:15.998 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: starting mon.smithi156 rank -1 at public addrs [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] at bind addrs [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi156 fsid 7a641bea-017e-11ef-bc93-c7b262605968 2024-04-23T14:40:15.998 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: mon.smithi156@-1(???) e0 preinit fsid 7a641bea-017e-11ef-bc93-c7b262605968 2024-04-23T14:40:15.998 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 bash[32304]: d9127540d3bbee23319d4759bdab29035952e95c1fcc3bd9c128d99991cffc33 2024-04-23T14:40:15.998 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 systemd[1]: Started Ceph mon.smithi156 for 7a641bea-017e-11ef-bc93-c7b262605968. 2024-04-23T14:40:15.998 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: mon.smithi156@-1(synchronizing).mds e1 new map 2024-04-23T14:40:15.999 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: mon.smithi156@-1(synchronizing).mds e1 print_map 2024-04-23T14:40:15.999 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: e1 2024-04-23T14:40:15.999 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-23T14:40:15.999 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:40:15.999 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: legacy client fscid: -1 2024-04-23T14:40:15.999 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: 2024-04-23T14:40:15.999 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: No filesystems configured 2024-04-23T14:40:15.999 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: mon.smithi156@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-04-23T14:40:15.999 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: mon.smithi156@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-04-23T14:40:15.999 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: mon.smithi156@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-04-23T14:40:15.999 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: mon.smithi156@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-04-23T14:40:15.999 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: mon.smithi156@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-04-23T14:40:15.999 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: mon.smithi156@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-04-23T14:40:16.000 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: mon.smithi156@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-04-23T14:40:16.000 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: mon.smithi156@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-23T14:40:16.000 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: mon.smithi156@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-04-23T14:40:16.000 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: mon.smithi156@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-04-23T14:40:16.000 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: mon.smithi156@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-04-23T14:40:16.000 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:16.000 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:16.000 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:16.000 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:16.000 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: Deploying daemon node-exporter.smithi156 on smithi156 2024-04-23T14:40:16.000 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: from='client.? 172.21.15.156:0/1790088233' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-23T14:40:16.000 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:16.000 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:16.001 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:16.001 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:16.001 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:16.001 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:16.001 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:16.001 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi156.ounwyj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-23T14:40:16.001 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi156.ounwyj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-23T14:40:16.001 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-23T14:40:16.001 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:16.001 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: Deploying daemon mgr.smithi156.ounwyj on smithi156 2024-04-23T14:40:16.001 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: from='client.? 172.21.15.156:0/1100787016' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-23T14:40:16.001 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:16.001 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:16.002 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:16.002 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:16.002 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: from='client.? 172.21.15.156:0/1317015074' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-23T14:40:16.002 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:16.002 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:16.002 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:16.002 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:16.002 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T14:40:16.002 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:16.002 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: Deploying daemon mon.smithi156 on smithi156 2024-04-23T14:40:16.002 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:40:16.002 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:16.003 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:16.003 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:16.003 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:15 smithi156 ceph-mon[32341]: mon.smithi156@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2024-04-23T14:40:16.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:15 smithi081 ceph-mon[25540]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:21.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:20 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi081"}]: dispatch 2024-04-23T14:40:21.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:20 smithi081 ceph-mon[25540]: mon.smithi081 calling monitor election 2024-04-23T14:40:21.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:20 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2024-04-23T14:40:21.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:20 smithi081 ceph-mon[25540]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:21.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:20 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2024-04-23T14:40:21.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:20 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2024-04-23T14:40:21.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:20 smithi081 ceph-mon[25540]: mon.smithi156 calling monitor election 2024-04-23T14:40:21.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:20 smithi081 ceph-mon[25540]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:21.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:20 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2024-04-23T14:40:21.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:20 smithi081 ceph-mon[25540]: from='mgr.? 172.21.15.156:0/264119920' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi156.ounwyj/crt"}]: dispatch 2024-04-23T14:40:21.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:20 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2024-04-23T14:40:21.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:20 smithi081 ceph-mon[25540]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:21.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:20 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2024-04-23T14:40:21.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:20 smithi081 ceph-mon[25540]: mon.smithi081 is new leader, mons smithi081,smithi156 in quorum (ranks 0,1) 2024-04-23T14:40:21.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:20 smithi081 ceph-mon[25540]: monmap e2: 2 mons at {smithi081=[v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0],smithi156=[v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-23T14:40:21.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:20 smithi081 ceph-mon[25540]: fsmap 2024-04-23T14:40:21.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:20 smithi081 ceph-mon[25540]: osdmap e5: 0 total, 0 up, 0 in 2024-04-23T14:40:21.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:20 smithi081 ceph-mon[25540]: mgrmap e17: smithi081.ldghvq(active, since 38s) 2024-04-23T14:40:21.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:20 smithi081 ceph-mon[25540]: overall HEALTH_OK 2024-04-23T14:40:21.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:20 smithi081 ceph-mon[25540]: Standby manager daemon smithi156.ounwyj started 2024-04-23T14:40:21.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:20 smithi081 ceph-mon[25540]: from='mgr.? 172.21.15.156:0/264119920' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-23T14:40:21.080 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:20 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:21.080 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:20 smithi081 ceph-mon[25540]: from='mgr.? 172.21.15.156:0/264119920' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi156.ounwyj/key"}]: dispatch 2024-04-23T14:40:21.080 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:20 smithi081 ceph-mon[25540]: from='mgr.? 172.21.15.156:0/264119920' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-23T14:40:21.080 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:20 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:21.080 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:20 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:21.080 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:20 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:21.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:20 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi081"}]: dispatch 2024-04-23T14:40:21.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:20 smithi156 ceph-mon[32341]: mon.smithi081 calling monitor election 2024-04-23T14:40:21.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:20 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2024-04-23T14:40:21.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:20 smithi156 ceph-mon[32341]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:21.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:20 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2024-04-23T14:40:21.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:20 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2024-04-23T14:40:21.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:20 smithi156 ceph-mon[32341]: mon.smithi156 calling monitor election 2024-04-23T14:40:21.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:20 smithi156 ceph-mon[32341]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:21.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:20 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2024-04-23T14:40:21.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:20 smithi156 ceph-mon[32341]: from='mgr.? 172.21.15.156:0/264119920' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi156.ounwyj/crt"}]: dispatch 2024-04-23T14:40:21.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:20 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2024-04-23T14:40:21.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:20 smithi156 ceph-mon[32341]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:21.289 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:20 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2024-04-23T14:40:21.289 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:20 smithi156 ceph-mon[32341]: mon.smithi081 is new leader, mons smithi081,smithi156 in quorum (ranks 0,1) 2024-04-23T14:40:21.289 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:20 smithi156 ceph-mon[32341]: monmap e2: 2 mons at {smithi081=[v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0],smithi156=[v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-23T14:40:21.289 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:20 smithi156 ceph-mon[32341]: fsmap 2024-04-23T14:40:21.289 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:20 smithi156 ceph-mon[32341]: osdmap e5: 0 total, 0 up, 0 in 2024-04-23T14:40:21.289 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:20 smithi156 ceph-mon[32341]: mgrmap e17: smithi081.ldghvq(active, since 38s) 2024-04-23T14:40:21.289 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:20 smithi156 ceph-mon[32341]: overall HEALTH_OK 2024-04-23T14:40:21.289 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:20 smithi156 ceph-mon[32341]: Standby manager daemon smithi156.ounwyj started 2024-04-23T14:40:21.289 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:20 smithi156 ceph-mon[32341]: from='mgr.? 172.21.15.156:0/264119920' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-23T14:40:21.289 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:20 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:21.289 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:20 smithi156 ceph-mon[32341]: from='mgr.? 172.21.15.156:0/264119920' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi156.ounwyj/key"}]: dispatch 2024-04-23T14:40:21.289 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:20 smithi156 ceph-mon[32341]: from='mgr.? 172.21.15.156:0/264119920' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-23T14:40:21.290 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:20 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:21.290 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:20 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:21.290 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:20 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:22.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:21 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:22.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:21 smithi081 ceph-mon[25540]: mgrmap e18: smithi081.ldghvq(active, since 38s), standbys: smithi156.ounwyj 2024-04-23T14:40:22.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:21 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mgr metadata", "who": "smithi156.ounwyj", "id": "smithi156.ounwyj"}]: dispatch 2024-04-23T14:40:22.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:21 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:40:22.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:21 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2024-04-23T14:40:22.146 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:21 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:22.146 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:21 smithi156 ceph-mon[32341]: mgrmap e18: smithi081.ldghvq(active, since 38s), standbys: smithi156.ounwyj 2024-04-23T14:40:22.146 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:21 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mgr metadata", "who": "smithi156.ounwyj", "id": "smithi156.ounwyj"}]: dispatch 2024-04-23T14:40:22.146 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:21 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:40:22.146 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:21 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2024-04-23T14:40:22.268 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.266+0000 7f80cdc00700 1 -- 172.21.15.156:0/3224630382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80ac0061f0 msgr2=0x7f80ac008650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:40:22.268 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.266+0000 7f80cdc00700 1 --2- 172.21.15.156:0/3224630382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80ac0061f0 0x7f80ac008650 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f80c80fdc90 tx=0x7f80b8002040 comp rx=0 tx=0).stop 2024-04-23T14:40:22.268 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.266+0000 7f80cdc00700 1 -- 172.21.15.156:0/3224630382 shutdown_connections 2024-04-23T14:40:22.268 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.266+0000 7f80cdc00700 1 --2- 172.21.15.156:0/3224630382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80ac0061f0 0x7f80ac008650 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:22.269 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.266+0000 7f80cdc00700 1 -- 172.21.15.156:0/3224630382 >> 172.21.15.156:0/3224630382 conn(0x7f80c80f8730 msgr2=0x7f80c80fab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:40:22.269 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.266+0000 7f80cdc00700 1 -- 172.21.15.156:0/3224630382 shutdown_connections 2024-04-23T14:40:22.269 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.266+0000 7f80cdc00700 1 -- 172.21.15.156:0/3224630382 wait complete. 2024-04-23T14:40:22.269 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.267+0000 7f80cdc00700 1 Processor -- start 2024-04-23T14:40:22.269 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.268+0000 7f80cdc00700 1 -- start start 2024-04-23T14:40:22.270 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.268+0000 7f80cdc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80c8113420 0x7f80c81137f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:40:22.270 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.268+0000 7f80cdc00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80c8113d30 0x7f80c810d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:40:22.270 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.268+0000 7f80cdc00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c810daa0 con 0x7f80c8113420 2024-04-23T14:40:22.270 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.268+0000 7f80cdc00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c810dc10 con 0x7f80c8113d30 2024-04-23T14:40:22.270 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.269+0000 7f80c6a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80c8113420 0x7f80c81137f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:40:22.271 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.269+0000 7f80c6a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80c8113420 0x7f80c81137f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.156:47976/0 (socket says 172.21.15.156:47976) 2024-04-23T14:40:22.271 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.269+0000 7f80c6a00700 1 -- 172.21.15.156:0/1420169422 learned_addr learned my addr 172.21.15.156:0/1420169422 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-04-23T14:40:22.271 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.269+0000 7f80c6000700 1 --2- 172.21.15.156:0/1420169422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80c8113d30 0x7f80c810d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:40:22.271 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.270+0000 7f80c6000700 1 -- 172.21.15.156:0/1420169422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80c8113d30 msgr2=0x7f80c810d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-23T14:40:22.271 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.270+0000 7f80c6000700 1 -- 172.21.15.156:0/1420169422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80c8113d30 msgr2=0x7f80c810d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-23T14:40:22.271 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.270+0000 7f80c6000700 1 --2- 172.21.15.156:0/1420169422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80c8113d30 0x7f80c810d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-23T14:40:22.271 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.270+0000 7f80c6a00700 1 -- 172.21.15.156:0/1420169422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80c8113d30 msgr2=0x7f80c810d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:40:22.271 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.270+0000 7f80c6000700 1 --2- 172.21.15.156:0/1420169422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80c8113d30 0x7f80c810d3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T14:40:22.271 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.270+0000 7f80c6a00700 1 --2- 172.21.15.156:0/1420169422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80c8113d30 0x7f80c810d3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:22.271 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.270+0000 7f80c6a00700 1 -- 172.21.15.156:0/1420169422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b8005040 con 0x7f80c8113420 2024-04-23T14:40:22.272 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.270+0000 7f80c6a00700 1 --2- 172.21.15.156:0/1420169422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80c8113420 0x7f80c81137f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f80b8000c00 tx=0x7f80b8002040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:40:22.272 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.271+0000 7f80bea00700 1 -- 172.21.15.156:0/1420169422 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80b8004db0 con 0x7f80c8113420 2024-04-23T14:40:22.272 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.271+0000 7f80bea00700 1 -- 172.21.15.156:0/1420169422 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f80b8018e30 con 0x7f80c8113420 2024-04-23T14:40:22.272 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.271+0000 7f80bea00700 1 -- 172.21.15.156:0/1420169422 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80b8022b00 con 0x7f80c8113420 2024-04-23T14:40:22.272 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.271+0000 7f80cdc00700 1 -- 172.21.15.156:0/1420169422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c810de90 con 0x7f80c8113420 2024-04-23T14:40:22.272 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.271+0000 7f80cdc00700 1 -- 172.21.15.156:0/1420169422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c8118280 con 0x7f80c8113420 2024-04-23T14:40:22.273 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.272+0000 7f80cdc00700 1 -- 172.21.15.156:0/1420169422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80c8107310 con 0x7f80c8113420 2024-04-23T14:40:22.275 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.274+0000 7f80bea00700 1 -- 172.21.15.156:0/1420169422 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7f80b8022c60 con 0x7f80c8113420 2024-04-23T14:40:22.275 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.275+0000 7f80bea00700 1 --2- 172.21.15.156:0/1420169422 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f80a8069360 0x7f80a806b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:40:22.276 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.275+0000 7f80bea00700 1 -- 172.21.15.156:0/1420169422 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f80b80883f0 con 0x7f80c8113420 2024-04-23T14:40:22.276 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.275+0000 7f80c6000700 1 --2- 172.21.15.156:0/1420169422 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f80a8069360 0x7f80a806b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:40:22.277 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.277+0000 7f80c6000700 1 --2- 172.21.15.156:0/1420169422 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f80a8069360 0x7f80a806b810 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f80b4006f30 tx=0x7f80b4008040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:40:22.289 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.288+0000 7f80bea00700 1 -- 172.21.15.156:0/1420169422 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f80b8055760 con 0x7f80c8113420 2024-04-23T14:40:22.587 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.585+0000 7f80cdc00700 1 -- 172.21.15.156:0/1420169422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f80c804bed0 con 0x7f80c8113420 2024-04-23T14:40:22.588 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.586+0000 7f80bea00700 1 -- 172.21.15.156:0/1420169422 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1017 (secure 0 0 0) 0x7f80b8058d80 con 0x7f80c8113420 2024-04-23T14:40:22.588 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-23T14:40:22.588 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":2,"fsid":"7a641bea-017e-11ef-bc93-c7b262605968","modified":"2024-04-23T14:40:15.732440Z","created":"2024-04-23T14:37:02.223037Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi081","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi156","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:3300","nonce":0},{"type":"v1","addr":"172.21.15.156:6789","nonce":0}]},"addr":"172.21.15.156:6789/0","public_addr":"172.21.15.156:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-23T14:40:22.590 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.588+0000 7f80cdc00700 1 -- 172.21.15.156:0/1420169422 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f80a8069360 msgr2=0x7f80a806b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:40:22.590 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.588+0000 7f80cdc00700 1 --2- 172.21.15.156:0/1420169422 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f80a8069360 0x7f80a806b810 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f80b4006f30 tx=0x7f80b4008040 comp rx=0 tx=0).stop 2024-04-23T14:40:22.590 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.588+0000 7f80cdc00700 1 -- 172.21.15.156:0/1420169422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80c8113420 msgr2=0x7f80c81137f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:40:22.591 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.588+0000 7f80cdc00700 1 --2- 172.21.15.156:0/1420169422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80c8113420 0x7f80c81137f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f80b8000c00 tx=0x7f80b8002040 comp rx=0 tx=0).stop 2024-04-23T14:40:22.591 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.589+0000 7f80cdc00700 1 -- 172.21.15.156:0/1420169422 shutdown_connections 2024-04-23T14:40:22.591 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.589+0000 7f80cdc00700 1 --2- 172.21.15.156:0/1420169422 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f80a8069360 0x7f80a806b810 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:22.591 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.589+0000 7f80cdc00700 1 --2- 172.21.15.156:0/1420169422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80c8113420 0x7f80c81137f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:22.591 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.589+0000 7f80cdc00700 1 --2- 172.21.15.156:0/1420169422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80c8113d30 0x7f80c810d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:22.591 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.589+0000 7f80cdc00700 1 -- 172.21.15.156:0/1420169422 >> 172.21.15.156:0/1420169422 conn(0x7f80c80f8730 msgr2=0x7f80c8101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:40:22.591 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.589+0000 7f80cdc00700 1 -- 172.21.15.156:0/1420169422 shutdown_connections 2024-04-23T14:40:22.591 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:40:22.589+0000 7f80cdc00700 1 -- 172.21.15.156:0/1420169422 wait complete. 2024-04-23T14:40:22.591 INFO:teuthology.orchestra.run.smithi156.stderr:dumped monmap epoch 2 2024-04-23T14:40:23.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:23 smithi156 ceph-mon[32341]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:23.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:23 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:23.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:23 smithi156 ceph-mon[32341]: from='client.? 172.21.15.156:0/1420169422' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-23T14:40:23.371 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-04-23T14:40:23.371 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph config generate-minimal-conf 2024-04-23T14:40:23.451 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:23 smithi081 ceph-mon[25540]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:23.451 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:23 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:23.452 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:23 smithi081 ceph-mon[25540]: from='client.? 172.21.15.156:0/1420169422' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-23T14:40:23.843 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:40:25.634 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:25 smithi081 ceph-mon[25540]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:25.634 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:25 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:25.634 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:25 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:25.634 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:25 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:25.635 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:25 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:40:25.635 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:25 smithi081 ceph-mon[25540]: Updating smithi081:/etc/ceph/ceph.conf 2024-04-23T14:40:25.635 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:25 smithi081 ceph-mon[25540]: Updating smithi156:/etc/ceph/ceph.conf 2024-04-23T14:40:25.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:25 smithi156 ceph-mon[32341]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:25.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:25 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:25.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:25 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:25.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:25 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:25.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:25 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:40:25.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:25 smithi156 ceph-mon[32341]: Updating smithi081:/etc/ceph/ceph.conf 2024-04-23T14:40:25.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:25 smithi156 ceph-mon[32341]: Updating smithi156:/etc/ceph/ceph.conf 2024-04-23T14:40:25.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:25.917+0000 7f1cae600700 1 -- 172.21.15.81:0/4017448724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca8104b10 msgr2=0x7f1ca8104ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:40:25.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:25.917+0000 7f1cae600700 1 --2- 172.21.15.81:0/4017448724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca8104b10 0x7f1ca8104ee0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1c980048c0 tx=0x7f1c98009e30 comp rx=0 tx=0).stop 2024-04-23T14:40:25.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:25.917+0000 7f1cae600700 1 -- 172.21.15.81:0/4017448724 shutdown_connections 2024-04-23T14:40:25.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:25.917+0000 7f1cae600700 1 --2- 172.21.15.81:0/4017448724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca8104b10 0x7f1ca8104ee0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:25.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:25.917+0000 7f1cae600700 1 -- 172.21.15.81:0/4017448724 >> 172.21.15.81:0/4017448724 conn(0x7f1ca80fa950 msgr2=0x7f1ca80fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:40:25.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:25.917+0000 7f1cae600700 1 -- 172.21.15.81:0/4017448724 shutdown_connections 2024-04-23T14:40:25.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:25.917+0000 7f1cae600700 1 -- 172.21.15.81:0/4017448724 wait complete. 2024-04-23T14:40:25.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:25.919+0000 7f1cae600700 1 Processor -- start 2024-04-23T14:40:25.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:25.919+0000 7f1cae600700 1 -- start start 2024-04-23T14:40:25.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:25.920+0000 7f1cae600700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ca8104b10 0x7f1ca8115290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:40:25.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:25.920+0000 7f1cae600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca81157d0 0x7f1ca810f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:40:25.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:25.920+0000 7f1cae600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca8115de0 con 0x7f1ca81157d0 2024-04-23T14:40:25.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:25.920+0000 7f1cae600700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca810f730 con 0x7f1ca8104b10 2024-04-23T14:40:25.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:25.920+0000 7f1c9fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca81157d0 0x7f1ca810f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:40:25.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:25.920+0000 7f1c9fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca81157d0 0x7f1ca810f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36712/0 (socket says 172.21.15.81:36712) 2024-04-23T14:40:25.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:25.920+0000 7f1c9fe00700 1 -- 172.21.15.81:0/3125023673 learned_addr learned my addr 172.21.15.81:0/3125023673 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:40:25.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:25.920+0000 7f1cad200700 1 --2- 172.21.15.81:0/3125023673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ca8104b10 0x7f1ca8115290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:40:25.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:25.920+0000 7f1c9fe00700 1 -- 172.21.15.81:0/3125023673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ca8104b10 msgr2=0x7f1ca8115290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:40:25.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:25.921+0000 7f1c9fe00700 1 --2- 172.21.15.81:0/3125023673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ca8104b10 0x7f1ca8115290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:25.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:25.921+0000 7f1c9fe00700 1 -- 172.21.15.81:0/3125023673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c98005040 con 0x7f1ca81157d0 2024-04-23T14:40:25.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:25.921+0000 7f1c9fe00700 1 --2- 172.21.15.81:0/3125023673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca81157d0 0x7f1ca810f1f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1c9000b790 tx=0x7f1c90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:40:25.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:25.921+0000 7f1ca5600700 1 -- 172.21.15.81:0/3125023673 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c90010870 con 0x7f1ca81157d0 2024-04-23T14:40:25.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:25.921+0000 7f1cae600700 1 -- 172.21.15.81:0/3125023673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ca810fa10 con 0x7f1ca81157d0 2024-04-23T14:40:25.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:25.921+0000 7f1ca5600700 1 -- 172.21.15.81:0/3125023673 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1c9000f3e0 con 0x7f1ca81157d0 2024-04-23T14:40:25.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:25.921+0000 7f1ca5600700 1 -- 172.21.15.81:0/3125023673 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c90010ea0 con 0x7f1ca81157d0 2024-04-23T14:40:25.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:25.921+0000 7f1cae600700 1 -- 172.21.15.81:0/3125023673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ca810ffd0 con 0x7f1ca81157d0 2024-04-23T14:40:25.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:25.923+0000 7f1cae600700 1 -- 172.21.15.81:0/3125023673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ca8103dd0 con 0x7f1ca81157d0 2024-04-23T14:40:25.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:25.923+0000 7f1ca5600700 1 -- 172.21.15.81:0/3125023673 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7f1c9000f550 con 0x7f1ca81157d0 2024-04-23T14:40:25.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:25.925+0000 7f1ca5600700 1 --2- 172.21.15.81:0/3125023673 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f1c8c069360 0x7f1c8c06b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:40:25.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:25.925+0000 7f1ca5600700 1 -- 172.21.15.81:0/3125023673 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f1c90086680 con 0x7f1ca81157d0 2024-04-23T14:40:25.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:25.925+0000 7f1cad200700 1 --2- 172.21.15.81:0/3125023673 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f1c8c069360 0x7f1c8c06b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:40:25.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:25.926+0000 7f1cad200700 1 --2- 172.21.15.81:0/3125023673 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f1c8c069360 0x7f1c8c06b810 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1c98005010 tx=0x7f1c98009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:40:25.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:25.929+0000 7f1ca5600700 1 -- 172.21.15.81:0/3125023673 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f1c90057480 con 0x7f1ca81157d0 2024-04-23T14:40:26.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:26.148+0000 7f1cae600700 1 -- 172.21.15.81:0/3125023673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f1ca8100200 con 0x7f1ca81157d0 2024-04-23T14:40:26.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:26.149+0000 7f1ca5600700 1 -- 172.21.15.81:0/3125023673 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+225 (secure 0 0 0) 0x7f1c90014100 con 0x7f1ca81157d0 2024-04-23T14:40:26.149 INFO:teuthology.orchestra.run.smithi081.stdout:# minimal ceph.conf for 7a641bea-017e-11ef-bc93-c7b262605968 2024-04-23T14:40:26.150 INFO:teuthology.orchestra.run.smithi081.stdout:[global] 2024-04-23T14:40:26.150 INFO:teuthology.orchestra.run.smithi081.stdout: fsid = 7a641bea-017e-11ef-bc93-c7b262605968 2024-04-23T14:40:26.150 INFO:teuthology.orchestra.run.smithi081.stdout: mon_host = [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2024-04-23T14:40:26.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:26.152+0000 7f1cae600700 1 -- 172.21.15.81:0/3125023673 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f1c8c069360 msgr2=0x7f1c8c06b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:40:26.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:26.152+0000 7f1cae600700 1 --2- 172.21.15.81:0/3125023673 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f1c8c069360 0x7f1c8c06b810 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1c98005010 tx=0x7f1c98009e30 comp rx=0 tx=0).stop 2024-04-23T14:40:26.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:26.152+0000 7f1cae600700 1 -- 172.21.15.81:0/3125023673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca81157d0 msgr2=0x7f1ca810f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:40:26.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:26.152+0000 7f1cae600700 1 --2- 172.21.15.81:0/3125023673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca81157d0 0x7f1ca810f1f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1c9000b790 tx=0x7f1c90009250 comp rx=0 tx=0).stop 2024-04-23T14:40:26.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:26.153+0000 7f1cae600700 1 -- 172.21.15.81:0/3125023673 shutdown_connections 2024-04-23T14:40:26.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:26.153+0000 7f1cae600700 1 --2- 172.21.15.81:0/3125023673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ca8104b10 0x7f1ca8115290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:26.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:26.153+0000 7f1cae600700 1 --2- 172.21.15.81:0/3125023673 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f1c8c069360 0x7f1c8c06b810 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:26.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:26.153+0000 7f1cae600700 1 --2- 172.21.15.81:0/3125023673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca81157d0 0x7f1ca810f1f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:26.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:26.153+0000 7f1cae600700 1 -- 172.21.15.81:0/3125023673 >> 172.21.15.81:0/3125023673 conn(0x7f1ca80fa950 msgr2=0x7f1ca80fb380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:40:26.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:26.153+0000 7f1cae600700 1 -- 172.21.15.81:0/3125023673 shutdown_connections 2024-04-23T14:40:26.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:26.153+0000 7f1cae600700 1 -- 172.21.15.81:0/3125023673 wait complete. 2024-04-23T14:40:26.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:26 smithi081 ceph-mon[25540]: Updating smithi081:/var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:40:26.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:26 smithi081 ceph-mon[25540]: Updating smithi156:/var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:40:26.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:26 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:26.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:26 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:26.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:26 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:26.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:26 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:26.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:26 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:26.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:26 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/3125023673' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:26.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:26 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T14:40:26.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:26 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-23T14:40:26.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:26 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:27.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:26 smithi156 ceph-mon[32341]: Updating smithi081:/var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:40:27.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:26 smithi156 ceph-mon[32341]: Updating smithi156:/var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:40:27.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:26 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:27.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:26 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:27.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:26 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:27.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:26 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:27.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:26 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:27.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:26 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/3125023673' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:27.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:26 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T14:40:27.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:26 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-23T14:40:27.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:26 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:27.096 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-04-23T14:40:27.097 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-23T14:40:27.097 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.conf 2024-04-23T14:40:27.166 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-23T14:40:27.166 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-23T14:40:27.280 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-04-23T14:40:27.280 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/ceph/ceph.conf 2024-04-23T14:40:27.363 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-04-23T14:40:27.364 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-23T14:40:27.477 INFO:tasks.cephadm:Deploying OSDs... 2024-04-23T14:40:27.477 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-23T14:40:27.478 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/scratch_devs of=/dev/stdout 2024-04-23T14:40:27.529 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-23T14:40:27.529 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_1 2024-04-23T14:40:27.611 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-23T14:40:27.611 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T14:40:27.611 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 632 Links: 1 2024-04-23T14:40:27.611 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T14:40:27.611 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T14:40:27.611 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-04-23 14:39:31.566253470 +0000 2024-04-23T14:40:27.611 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-04-23 14:30:08.018088210 +0000 2024-04-23T14:40:27.611 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-04-23 14:30:08.018088210 +0000 2024-04-23T14:40:27.611 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-04-23 14:30:08.018088210 +0000 2024-04-23T14:40:27.612 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-23T14:40:27.718 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-04-23T14:40:27.718 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-04-23T14:40:27.719 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000313401 s, 1.6 MB/s 2024-04-23T14:40:27.722 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-23T14:40:27.764 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_2 2024-04-23T14:40:27.859 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-23T14:40:27.859 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T14:40:27.859 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 653 Links: 1 2024-04-23T14:40:27.859 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T14:40:27.859 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T14:40:27.859 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-04-23 14:39:31.567253450 +0000 2024-04-23T14:40:27.859 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-04-23 14:30:08.579076823 +0000 2024-04-23T14:40:27.859 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-04-23 14:30:08.579076823 +0000 2024-04-23T14:40:27.859 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-04-23 14:30:08.579076823 +0000 2024-04-23T14:40:27.860 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-23T14:40:27.929 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-04-23T14:40:27.929 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-04-23T14:40:27.929 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.00027156 s, 1.9 MB/s 2024-04-23T14:40:27.932 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-23T14:40:27.981 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:27 smithi156 ceph-mon[32341]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:27.982 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:27 smithi156 ceph-mon[32341]: Reconfiguring mon.smithi081 (unknown last config time)... 2024-04-23T14:40:27.982 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:27 smithi156 ceph-mon[32341]: Reconfiguring daemon mon.smithi081 on smithi081 2024-04-23T14:40:27.982 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:27 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:40:27.983 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_3 2024-04-23T14:40:28.006 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:27 smithi081 ceph-mon[25540]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:28.006 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:27 smithi081 ceph-mon[25540]: Reconfiguring mon.smithi081 (unknown last config time)... 2024-04-23T14:40:28.006 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:27 smithi081 ceph-mon[25540]: Reconfiguring daemon mon.smithi081 on smithi081 2024-04-23T14:40:28.006 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:27 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:40:28.029 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-23T14:40:28.029 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T14:40:28.029 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 672 Links: 1 2024-04-23T14:40:28.029 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T14:40:28.029 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T14:40:28.030 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-04-23 14:39:31.567253450 +0000 2024-04-23T14:40:28.030 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-04-23 14:30:09.182064583 +0000 2024-04-23T14:40:28.030 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-04-23 14:30:09.182064583 +0000 2024-04-23T14:40:28.030 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-04-23 14:30:09.182064583 +0000 2024-04-23T14:40:28.030 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-23T14:40:28.139 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-04-23T14:40:28.139 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-04-23T14:40:28.140 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000354695 s, 1.4 MB/s 2024-04-23T14:40:28.143 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-23T14:40:28.198 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_4 2024-04-23T14:40:28.244 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-23T14:40:28.244 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T14:40:28.244 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 689 Links: 1 2024-04-23T14:40:28.244 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T14:40:28.244 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T14:40:28.244 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-04-23 14:39:31.568253429 +0000 2024-04-23T14:40:28.244 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-04-23 14:30:09.793052180 +0000 2024-04-23T14:40:28.244 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-04-23 14:30:09.794052160 +0000 2024-04-23T14:40:28.244 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-04-23 14:30:09.793052180 +0000 2024-04-23T14:40:28.245 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-23T14:40:28.368 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-04-23T14:40:28.369 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-04-23T14:40:28.369 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000325388 s, 1.6 MB/s 2024-04-23T14:40:28.373 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-23T14:40:28.420 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-04-23T14:40:28.420 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/scratch_devs of=/dev/stdout 2024-04-23T14:40:28.473 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-23T14:40:28.473 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_1 2024-04-23T14:40:28.522 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-23T14:40:28.522 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T14:40:28.522 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 6h/6d Inode: 634 Links: 1 2024-04-23T14:40:28.522 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T14:40:28.522 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T14:40:28.523 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2024-04-23 14:40:14.398528675 +0000 2024-04-23T14:40:28.523 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2024-04-23 14:30:13.265723056 +0000 2024-04-23T14:40:28.523 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2024-04-23 14:30:13.265723056 +0000 2024-04-23T14:40:28.523 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: 2024-04-23 14:30:13.265723056 +0000 2024-04-23T14:40:28.523 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-23T14:40:28.597 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2024-04-23T14:40:28.597 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2024-04-23T14:40:28.597 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000315699 s, 1.6 MB/s 2024-04-23T14:40:28.600 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-23T14:40:28.651 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_2 2024-04-23T14:40:28.698 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-23T14:40:28.699 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T14:40:28.699 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 6h/6d Inode: 653 Links: 1 2024-04-23T14:40:28.699 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T14:40:28.699 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T14:40:28.699 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2024-04-23 14:40:14.399528660 +0000 2024-04-23T14:40:28.699 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2024-04-23 14:30:13.888713790 +0000 2024-04-23T14:40:28.699 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2024-04-23 14:30:13.888713790 +0000 2024-04-23T14:40:28.699 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: 2024-04-23 14:30:13.888713790 +0000 2024-04-23T14:40:28.699 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-23T14:40:28.766 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2024-04-23T14:40:28.766 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2024-04-23T14:40:28.766 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000237578 s, 2.2 MB/s 2024-04-23T14:40:28.769 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-23T14:40:28.817 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_3 2024-04-23T14:40:28.862 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-23T14:40:28.862 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T14:40:28.863 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 6h/6d Inode: 671 Links: 1 2024-04-23T14:40:28.863 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T14:40:28.863 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T14:40:28.863 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2024-04-23 14:40:14.400528644 +0000 2024-04-23T14:40:28.863 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2024-04-23 14:30:14.477705029 +0000 2024-04-23T14:40:28.863 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2024-04-23 14:30:14.477705029 +0000 2024-04-23T14:40:28.863 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: 2024-04-23 14:30:14.477705029 +0000 2024-04-23T14:40:28.863 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-23T14:40:28.965 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2024-04-23T14:40:28.965 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2024-04-23T14:40:28.966 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000245628 s, 2.1 MB/s 2024-04-23T14:40:28.968 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-23T14:40:29.013 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_4 2024-04-23T14:40:29.102 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-23T14:40:29.102 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T14:40:29.102 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 6h/6d Inode: 691 Links: 1 2024-04-23T14:40:29.102 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T14:40:29.102 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T14:40:29.103 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2024-04-23 14:40:14.400528644 +0000 2024-04-23T14:40:29.103 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2024-04-23 14:30:15.082696031 +0000 2024-04-23T14:40:29.103 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2024-04-23 14:30:15.082696031 +0000 2024-04-23T14:40:29.103 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: 2024-04-23 14:30:15.082696031 +0000 2024-04-23T14:40:29.103 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-23T14:40:29.180 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2024-04-23T14:40:29.180 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2024-04-23T14:40:29.180 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000282016 s, 1.8 MB/s 2024-04-23T14:40:29.183 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-23T14:40:29.240 INFO:tasks.cephadm:Deploying osd.0 on smithi081 with /dev/vg_nvme/lv_4... 2024-04-23T14:40:29.240 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-23T14:40:29.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:29 smithi156 ceph-mon[32341]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:29.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:29 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:29.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:29 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:29.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:29 smithi156 ceph-mon[32341]: Reconfiguring mgr.smithi081.ldghvq (unknown last config time)... 2024-04-23T14:40:29.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:29 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi081.ldghvq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-23T14:40:29.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:29 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-23T14:40:29.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:29 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:29.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:29 smithi156 ceph-mon[32341]: Reconfiguring daemon mgr.smithi081.ldghvq on smithi081 2024-04-23T14:40:29.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:29 smithi081 ceph-mon[25540]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:29.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:29 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:29.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:29 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:29.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:29 smithi081 ceph-mon[25540]: Reconfiguring mgr.smithi081.ldghvq (unknown last config time)... 2024-04-23T14:40:29.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:29 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi081.ldghvq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-23T14:40:29.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:29 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-23T14:40:29.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:29 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:29.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:29 smithi081 ceph-mon[25540]: Reconfiguring daemon mgr.smithi081.ldghvq on smithi081 2024-04-23T14:40:30.338 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:40:31.543 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:31 smithi081 ceph-mon[25540]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:31.543 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:31 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:31.543 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:31 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:31.543 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:31 smithi081 ceph-mon[25540]: Reconfiguring crash.smithi081 (monmap changed)... 2024-04-23T14:40:31.543 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:31 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi081", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-23T14:40:31.543 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:31 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:31.543 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:31 smithi081 ceph-mon[25540]: Reconfiguring daemon crash.smithi081 on smithi081 2024-04-23T14:40:31.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:31 smithi156 ceph-mon[32341]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:31.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:31 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:31.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:31 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:31.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:31 smithi156 ceph-mon[32341]: Reconfiguring crash.smithi081 (monmap changed)... 2024-04-23T14:40:31.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:31 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi081", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-23T14:40:31.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:31 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:31.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:31 smithi156 ceph-mon[32341]: Reconfiguring daemon crash.smithi081 on smithi081 2024-04-23T14:40:33.319 INFO:teuthology.orchestra.run.smithi081.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-23T14:40:33.320 INFO:teuthology.orchestra.run.smithi081.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-23T14:40:33.320 INFO:teuthology.orchestra.run.smithi081.stderr: stderr: 10+0 records in 2024-04-23T14:40:33.320 INFO:teuthology.orchestra.run.smithi081.stderr:10+0 records out 2024-04-23T14:40:33.320 INFO:teuthology.orchestra.run.smithi081.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0338945 s, 309 MB/s 2024-04-23T14:40:33.320 INFO:teuthology.orchestra.run.smithi081.stderr:--> Zapping successful for: 2024-04-23T14:40:33.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:33 smithi081 ceph-mon[25540]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:33.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:33 smithi156 ceph-mon[32341]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:34.099 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi081:vg_nvme/lv_4 2024-04-23T14:40:34.644 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:34 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:34.644 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:34 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:34.644 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:34 smithi081 ceph-mon[25540]: Reconfiguring alertmanager.smithi081 (dependencies changed)... 2024-04-23T14:40:34.644 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:34 smithi081 ceph-mon[25540]: Reconfiguring daemon alertmanager.smithi081 on smithi081 2024-04-23T14:40:34.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:34 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:34.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:34 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:34.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:34 smithi156 ceph-mon[32341]: Reconfiguring alertmanager.smithi081 (dependencies changed)... 2024-04-23T14:40:34.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:34 smithi156 ceph-mon[32341]: Reconfiguring daemon alertmanager.smithi081 on smithi081 2024-04-23T14:40:35.637 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:40:35.775 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:35 smithi081 ceph-mon[25540]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:35.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:35 smithi156 ceph-mon[32341]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:37.738 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:37 smithi081 ceph-mon[25540]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:37.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:37 smithi156 ceph-mon[32341]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:39.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:39.110+0000 7f6973e00700 1 -- 172.21.15.81:0/2882364290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f696c1046b0 msgr2=0x7f696c104b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:40:39.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:39.110+0000 7f6973e00700 1 --2- 172.21.15.81:0/2882364290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f696c1046b0 0x7f696c104b20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6958004940 tx=0x7f6958009e30 comp rx=0 tx=0).stop 2024-04-23T14:40:39.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:39.110+0000 7f6973e00700 1 -- 172.21.15.81:0/2882364290 shutdown_connections 2024-04-23T14:40:39.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:39.110+0000 7f6973e00700 1 --2- 172.21.15.81:0/2882364290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f696c1046b0 0x7f696c104b20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:39.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:39.110+0000 7f6973e00700 1 --2- 172.21.15.81:0/2882364290 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f696c103400 0x7f696c103810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:39.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:39.110+0000 7f6973e00700 1 -- 172.21.15.81:0/2882364290 >> 172.21.15.81:0/2882364290 conn(0x7f696c0725e0 msgr2=0x7f696c074a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:40:39.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:39.110+0000 7f6973e00700 1 -- 172.21.15.81:0/2882364290 shutdown_connections 2024-04-23T14:40:39.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:39.110+0000 7f6973e00700 1 -- 172.21.15.81:0/2882364290 wait complete. 2024-04-23T14:40:39.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:39.111+0000 7f6973e00700 1 Processor -- start 2024-04-23T14:40:39.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:39.111+0000 7f6973e00700 1 -- start start 2024-04-23T14:40:39.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:39.111+0000 7f6973e00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f696c103400 0x7f696c113f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:40:39.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:39.111+0000 7f6973e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f696c1046b0 0x7f696c114450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:40:39.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:39.111+0000 7f6973e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c114a50 con 0x7f696c1046b0 2024-04-23T14:40:39.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:39.111+0000 7f6973e00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c114bc0 con 0x7f696c103400 2024-04-23T14:40:39.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:39.112+0000 7f6970a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f696c1046b0 0x7f696c114450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:40:39.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:39.112+0000 7f6970a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f696c1046b0 0x7f696c114450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41404/0 (socket says 172.21.15.81:41404) 2024-04-23T14:40:39.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:39.112+0000 7f6970a00700 1 -- 172.21.15.81:0/1492132535 learned_addr learned my addr 172.21.15.81:0/1492132535 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:40:39.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:39.112+0000 7f6971400700 1 --2- 172.21.15.81:0/1492132535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f696c103400 0x7f696c113f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:40:39.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:39.112+0000 7f6970a00700 1 -- 172.21.15.81:0/1492132535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f696c103400 msgr2=0x7f696c113f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:40:39.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:39.112+0000 7f6970a00700 1 --2- 172.21.15.81:0/1492132535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f696c103400 0x7f696c113f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:40:39.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:39.112+0000 7f6970a00700 1 -- 172.21.15.81:0/1492132535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6958005040 con 0x7f696c1046b0 2024-04-23T14:40:39.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:39.112+0000 7f6970a00700 1 --2- 172.21.15.81:0/1492132535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f696c1046b0 0x7f696c114450 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6958009150 tx=0x7f6958009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:40:39.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:39.113+0000 7f6969600700 1 -- 172.21.15.81:0/1492132535 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f695800e040 con 0x7f696c1046b0 2024-04-23T14:40:39.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:39.113+0000 7f6969600700 1 -- 172.21.15.81:0/1492132535 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f695800bbf0 con 0x7f696c1046b0 2024-04-23T14:40:39.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:39.113+0000 7f6969600700 1 -- 172.21.15.81:0/1492132535 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f695801c630 con 0x7f696c1046b0 2024-04-23T14:40:39.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:39.113+0000 7f6973e00700 1 -- 172.21.15.81:0/1492132535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f696c1195c0 con 0x7f696c1046b0 2024-04-23T14:40:39.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:39.113+0000 7f6973e00700 1 -- 172.21.15.81:0/1492132535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f696c119b80 con 0x7f696c1046b0 2024-04-23T14:40:39.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:39.114+0000 7f6973e00700 1 -- 172.21.15.81:0/1492132535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f696c04c710 con 0x7f696c1046b0 2024-04-23T14:40:39.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:39.115+0000 7f6969600700 1 -- 172.21.15.81:0/1492132535 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7f695800bd60 con 0x7f696c1046b0 2024-04-23T14:40:39.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:39.116+0000 7f6969600700 1 --2- 172.21.15.81:0/1492132535 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f6954069210 0x7f695406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:40:39.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:39.116+0000 7f6969600700 1 -- 172.21.15.81:0/1492132535 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f69580874a0 con 0x7f696c1046b0 2024-04-23T14:40:39.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:39.116+0000 7f6971400700 1 --2- 172.21.15.81:0/1492132535 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f6954069210 0x7f695406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:40:39.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:39.117+0000 7f6971400700 1 --2- 172.21.15.81:0/1492132535 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f6954069210 0x7f695406b6c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6960004550 tx=0x7f6960009040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:40:39.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:39.121+0000 7f6969600700 1 -- 172.21.15.81:0/1492132535 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f69580583d0 con 0x7f696c1046b0 2024-04-23T14:40:39.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:40:39.347+0000 7f6973e00700 1 -- 172.21.15.81:0/1492132535 --> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f696c108990 con 0x7f6954069210 2024-04-23T14:40:39.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:39 smithi156 ceph-mon[32341]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:39.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:39 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:40:39.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:39 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:40:39.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:39 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:39.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:39 smithi081 ceph-mon[25540]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:39.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:39 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:40:39.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:39 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:40:39.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:39 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:40.656 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:40 smithi081 ceph-mon[25540]: from='client.14246 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:40:40.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:40 smithi156 ceph-mon[32341]: from='client.14246 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:40:41.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:41 smithi156 ceph-mon[32341]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:41.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:41 smithi081 ceph-mon[25540]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:42.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:42 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:40:42.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:42 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:40:44.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:43 smithi156 ceph-mon[32341]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:44.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:43 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:44.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:43 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:44.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:43 smithi156 ceph-mon[32341]: Reconfiguring grafana.smithi081 (dependencies changed)... 2024-04-23T14:40:44.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:43 smithi156 ceph-mon[32341]: Reconfiguring daemon grafana.smithi081 on smithi081 2024-04-23T14:40:44.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:43 smithi081 ceph-mon[25540]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:44.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:43 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:44.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:43 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:44.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:43 smithi081 ceph-mon[25540]: Reconfiguring grafana.smithi081 (dependencies changed)... 2024-04-23T14:40:44.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:43 smithi081 ceph-mon[25540]: Reconfiguring daemon grafana.smithi081 on smithi081 2024-04-23T14:40:44.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:44 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/3321110495' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c084af11-7048-409a-9932-9ede242d3abc"}]: dispatch 2024-04-23T14:40:44.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:44 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/3321110495' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c084af11-7048-409a-9932-9ede242d3abc"}]': finished 2024-04-23T14:40:44.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:44 smithi081 ceph-mon[25540]: osdmap e6: 1 total, 0 up, 1 in 2024-04-23T14:40:44.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:44 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:40:45.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:44 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/3321110495' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c084af11-7048-409a-9932-9ede242d3abc"}]: dispatch 2024-04-23T14:40:45.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:44 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/3321110495' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c084af11-7048-409a-9932-9ede242d3abc"}]': finished 2024-04-23T14:40:45.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:44 smithi156 ceph-mon[32341]: osdmap e6: 1 total, 0 up, 1 in 2024-04-23T14:40:45.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:44 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:40:46.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:45 smithi156 ceph-mon[32341]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:46.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:45 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/98286075' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:40:46.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:45 smithi081 ceph-mon[25540]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:46.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:45 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/98286075' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:40:48.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:47 smithi156 ceph-mon[32341]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:48.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:47 smithi081 ceph-mon[25540]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:49.896 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:49 smithi081 ceph-mon[25540]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:50.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:49 smithi156 ceph-mon[32341]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:51.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:51 smithi081 ceph-mon[25540]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:52.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:51 smithi156 ceph-mon[32341]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:53.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:53 smithi081 ceph-mon[25540]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:54.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:53 smithi156 ceph-mon[32341]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:55.822 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:55 smithi081 ceph-mon[25540]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:56.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:55 smithi156 ceph-mon[32341]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:57.021 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:56 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:57.021 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:56 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:57.021 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:56 smithi081 ceph-mon[25540]: Reconfiguring prometheus.smithi081 (dependencies changed)... 2024-04-23T14:40:57.021 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:56 smithi081 ceph-mon[25540]: Reconfiguring daemon prometheus.smithi081 on smithi081 2024-04-23T14:40:57.021 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:56 smithi081 ceph-mon[25540]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:57.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:56 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:57.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:56 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:40:57.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:56 smithi156 ceph-mon[32341]: Reconfiguring prometheus.smithi081 (dependencies changed)... 2024-04-23T14:40:57.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:56 smithi156 ceph-mon[32341]: Reconfiguring daemon prometheus.smithi081 on smithi081 2024-04-23T14:40:57.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:56 smithi156 ceph-mon[32341]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:58.096 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:58 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:40:58.097 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:58 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-23T14:40:58.097 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:58 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:58.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:58 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:40:58.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:58 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-23T14:40:58.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:58 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:40:59.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:59 smithi156 ceph-mon[32341]: Deploying daemon osd.0 on smithi081 2024-04-23T14:40:59.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:40:59 smithi156 ceph-mon[32341]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:40:59.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:59 smithi081 ceph-mon[25540]: Deploying daemon osd.0 on smithi081 2024-04-23T14:40:59.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:40:59 smithi081 ceph-mon[25540]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:41:01.394 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:01 smithi081 ceph-mon[25540]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:41:01.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:01 smithi156 ceph-mon[32341]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:41:03.321 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:03 smithi081 ceph-mon[25540]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:41:03.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:03 smithi156 ceph-mon[32341]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:41:05.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:04 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:05.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:04 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:05.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:04 smithi156 ceph-mon[32341]: Reconfiguring crash.smithi156 (monmap changed)... 2024-04-23T14:41:05.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:04 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi156", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-23T14:41:05.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:04 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:41:05.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:04 smithi156 ceph-mon[32341]: Reconfiguring daemon crash.smithi156 on smithi156 2024-04-23T14:41:05.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:04 smithi156 ceph-mon[32341]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:41:05.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:04 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:05.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:04 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:05.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:04 smithi081 ceph-mon[25540]: Reconfiguring crash.smithi156 (monmap changed)... 2024-04-23T14:41:05.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:04 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi156", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-23T14:41:05.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:04 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:41:05.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:04 smithi081 ceph-mon[25540]: Reconfiguring daemon crash.smithi156 on smithi156 2024-04-23T14:41:05.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:04 smithi081 ceph-mon[25540]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:41:07.018 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:06 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:07.019 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:06 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:07.019 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:06 smithi156 ceph-mon[32341]: Reconfiguring mgr.smithi156.ounwyj (monmap changed)... 2024-04-23T14:41:07.019 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:06 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi156.ounwyj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-23T14:41:07.019 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:06 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-23T14:41:07.019 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:06 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:41:07.019 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:06 smithi156 ceph-mon[32341]: Reconfiguring daemon mgr.smithi156.ounwyj on smithi156 2024-04-23T14:41:07.019 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:06 smithi156 ceph-mon[32341]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:41:07.042 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:06 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:07.042 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:06 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:07.042 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:06 smithi081 ceph-mon[25540]: Reconfiguring mgr.smithi156.ounwyj (monmap changed)... 2024-04-23T14:41:07.042 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:06 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi156.ounwyj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-23T14:41:07.042 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:06 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-23T14:41:07.042 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:06 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:41:07.042 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:06 smithi081 ceph-mon[25540]: Reconfiguring daemon mgr.smithi156.ounwyj on smithi156 2024-04-23T14:41:07.042 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:06 smithi081 ceph-mon[25540]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:41:08.856 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:08 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:08.856 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:08 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:08.856 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:08 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T14:41:08.856 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:08 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-23T14:41:08.856 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:08 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:41:09.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:08 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:09.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:08 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:09.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:08 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T14:41:09.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:08 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-23T14:41:09.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:08 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:41:09.901 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:09 smithi081 ceph-mon[25540]: Reconfiguring mon.smithi156 (monmap changed)... 2024-04-23T14:41:09.902 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:09 smithi081 ceph-mon[25540]: Reconfiguring daemon mon.smithi156 on smithi156 2024-04-23T14:41:09.902 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:09 smithi081 ceph-mon[25540]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:41:09.902 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:09 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:09.902 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:09 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:09.902 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:09 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-23T14:41:09.902 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:09 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi081.front.sepia.ceph.com:9093"}]: dispatch 2024-04-23T14:41:09.915 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:09 smithi156 ceph-mon[32341]: Reconfiguring mon.smithi156 (monmap changed)... 2024-04-23T14:41:09.915 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:09 smithi156 ceph-mon[32341]: Reconfiguring daemon mon.smithi156 on smithi156 2024-04-23T14:41:09.915 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:09 smithi156 ceph-mon[32341]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:41:09.915 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:09 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:09.915 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:09 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:09.915 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:09 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-23T14:41:09.915 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:09 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi081.front.sepia.ceph.com:9093"}]: dispatch 2024-04-23T14:41:11.013 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:10 smithi081 ceph-mon[25540]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-23T14:41:11.013 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:10 smithi081 ceph-mon[25540]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi081.front.sepia.ceph.com:9093"}]: dispatch 2024-04-23T14:41:11.013 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:10 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:11.013 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:10 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-23T14:41:11.013 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:10 smithi081 ceph-mon[25540]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-23T14:41:11.013 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:10 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi081.front.sepia.ceph.com:3000"}]: dispatch 2024-04-23T14:41:11.014 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:10 smithi081 ceph-mon[25540]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi081.front.sepia.ceph.com:3000"}]: dispatch 2024-04-23T14:41:11.014 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:10 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:11.014 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:10 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-23T14:41:11.014 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:10 smithi081 ceph-mon[25540]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-23T14:41:11.014 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:10 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi081.front.sepia.ceph.com:9095"}]: dispatch 2024-04-23T14:41:11.014 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:10 smithi081 ceph-mon[25540]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi081.front.sepia.ceph.com:9095"}]: dispatch 2024-04-23T14:41:11.014 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:10 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:11.014 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:10 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:41:11.014 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:10 smithi081 ceph-mon[25540]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:41:11.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:10 smithi156 ceph-mon[32341]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-23T14:41:11.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:10 smithi156 ceph-mon[32341]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi081.front.sepia.ceph.com:9093"}]: dispatch 2024-04-23T14:41:11.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:10 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:11.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:10 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-23T14:41:11.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:10 smithi156 ceph-mon[32341]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-23T14:41:11.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:10 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi081.front.sepia.ceph.com:3000"}]: dispatch 2024-04-23T14:41:11.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:10 smithi156 ceph-mon[32341]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi081.front.sepia.ceph.com:3000"}]: dispatch 2024-04-23T14:41:11.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:10 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:11.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:10 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-23T14:41:11.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:10 smithi156 ceph-mon[32341]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-23T14:41:11.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:10 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi081.front.sepia.ceph.com:9095"}]: dispatch 2024-04-23T14:41:11.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:10 smithi156 ceph-mon[32341]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi081.front.sepia.ceph.com:9095"}]: dispatch 2024-04-23T14:41:11.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:10 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:11.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:10 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:41:11.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:10 smithi156 ceph-mon[32341]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:41:12.412 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:12 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:12.412 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:12 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:12.412 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:12 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:41:12.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:12 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:12.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:12 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:12.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:12 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:41:13.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:13 smithi156 ceph-mon[32341]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:41:13.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:13 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:13.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:13 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:13.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:13 smithi081 ceph-mon[25540]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:41:13.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:13 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:13.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:13 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:15.778 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:15 smithi081 ceph-mon[25540]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:41:15.779 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:15 smithi081 ceph-mon[25540]: from='osd.0 [v2:172.21.15.81:6802/3586146569,v1:172.21.15.81:6803/3586146569]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-23T14:41:15.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:15 smithi156 ceph-mon[32341]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:41:15.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:15 smithi156 ceph-mon[32341]: from='osd.0 [v2:172.21.15.81:6802/3586146569,v1:172.21.15.81:6803/3586146569]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-23T14:41:16.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:16 smithi156 ceph-mon[32341]: from='osd.0 [v2:172.21.15.81:6802/3586146569,v1:172.21.15.81:6803/3586146569]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-23T14:41:16.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:16 smithi156 ceph-mon[32341]: osdmap e7: 1 total, 0 up, 1 in 2024-04-23T14:41:16.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:16 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:41:16.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:16 smithi156 ceph-mon[32341]: from='osd.0 [v2:172.21.15.81:6802/3586146569,v1:172.21.15.81:6803/3586146569]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-04-23T14:41:16.801 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:16 smithi081 ceph-mon[25540]: from='osd.0 [v2:172.21.15.81:6802/3586146569,v1:172.21.15.81:6803/3586146569]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-23T14:41:16.801 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:16 smithi081 ceph-mon[25540]: osdmap e7: 1 total, 0 up, 1 in 2024-04-23T14:41:16.801 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:16 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:41:16.801 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:16 smithi081 ceph-mon[25540]: from='osd.0 [v2:172.21.15.81:6802/3586146569,v1:172.21.15.81:6803/3586146569]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-04-23T14:41:16.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:16.875+0000 7f6969600700 1 -- 172.21.15.81:0/1492132535 <== mgr.14210 v2:172.21.15.81:6800/1053506915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f696c108990 con 0x7f6954069210 2024-04-23T14:41:16.877 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 0 on host 'smithi081' 2024-04-23T14:41:16.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:16.878+0000 7f6973e00700 1 -- 172.21.15.81:0/1492132535 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f6954069210 msgr2=0x7f695406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:41:16.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:16.878+0000 7f6973e00700 1 --2- 172.21.15.81:0/1492132535 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f6954069210 0x7f695406b6c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6960004550 tx=0x7f6960009040 comp rx=0 tx=0).stop 2024-04-23T14:41:16.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:16.879+0000 7f6973e00700 1 -- 172.21.15.81:0/1492132535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f696c1046b0 msgr2=0x7f696c114450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:41:16.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:16.879+0000 7f6973e00700 1 --2- 172.21.15.81:0/1492132535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f696c1046b0 0x7f696c114450 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6958009150 tx=0x7f6958009e30 comp rx=0 tx=0).stop 2024-04-23T14:41:16.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:16.879+0000 7f6973e00700 1 -- 172.21.15.81:0/1492132535 shutdown_connections 2024-04-23T14:41:16.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:16.879+0000 7f6973e00700 1 --2- 172.21.15.81:0/1492132535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f696c103400 0x7f696c113f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:41:16.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:16.879+0000 7f6973e00700 1 --2- 172.21.15.81:0/1492132535 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f6954069210 0x7f695406b6c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:41:16.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:16.879+0000 7f6973e00700 1 --2- 172.21.15.81:0/1492132535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f696c1046b0 0x7f696c114450 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:41:16.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:16.879+0000 7f6973e00700 1 -- 172.21.15.81:0/1492132535 >> 172.21.15.81:0/1492132535 conn(0x7f696c0725e0 msgr2=0x7f696c073c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:41:16.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:16.879+0000 7f6973e00700 1 -- 172.21.15.81:0/1492132535 shutdown_connections 2024-04-23T14:41:16.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:16.879+0000 7f6973e00700 1 -- 172.21.15.81:0/1492132535 wait complete. 2024-04-23T14:41:17.705 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:17 smithi156 ceph-mon[32341]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:41:17.705 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:17 smithi156 ceph-mon[32341]: from='osd.0 [v2:172.21.15.81:6802/3586146569,v1:172.21.15.81:6803/3586146569]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-04-23T14:41:17.705 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:17 smithi156 ceph-mon[32341]: osdmap e8: 1 total, 0 up, 1 in 2024-04-23T14:41:17.705 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:17 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:41:17.705 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:17 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:41:17.705 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:17 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:17.705 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:17 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:17.803 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:17 smithi081 ceph-mon[25540]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:41:17.803 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:17 smithi081 ceph-mon[25540]: from='osd.0 [v2:172.21.15.81:6802/3586146569,v1:172.21.15.81:6803/3586146569]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-04-23T14:41:17.803 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:17 smithi081 ceph-mon[25540]: osdmap e8: 1 total, 0 up, 1 in 2024-04-23T14:41:17.803 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:17 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:41:17.803 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:17 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:41:17.803 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:17 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:17.804 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:17 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:18.199 DEBUG:teuthology.orchestra.run.smithi081:osd.0> sudo journalctl -f -n 0 -u ceph-7a641bea-017e-11ef-bc93-c7b262605968@osd.0.service 2024-04-23T14:41:18.204 INFO:tasks.cephadm:Deploying osd.1 on smithi081 with /dev/vg_nvme/lv_3... 2024-04-23T14:41:18.205 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-23T14:41:18.684 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:41:18.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:18 smithi156 ceph-mon[32341]: purged_snaps scrub starts 2024-04-23T14:41:18.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:18 smithi156 ceph-mon[32341]: purged_snaps scrub ok 2024-04-23T14:41:18.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:18 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:41:18.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:18 smithi156 ceph-mon[32341]: osd.0 [v2:172.21.15.81:6802/3586146569,v1:172.21.15.81:6803/3586146569] boot 2024-04-23T14:41:18.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:18 smithi156 ceph-mon[32341]: osdmap e9: 1 total, 1 up, 1 in 2024-04-23T14:41:18.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:18 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:41:18.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:18 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:18.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:18 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:18.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:18 smithi081 ceph-mon[25540]: purged_snaps scrub starts 2024-04-23T14:41:18.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:18 smithi081 ceph-mon[25540]: purged_snaps scrub ok 2024-04-23T14:41:18.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:18 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:41:18.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:18 smithi081 ceph-mon[25540]: osd.0 [v2:172.21.15.81:6802/3586146569,v1:172.21.15.81:6803/3586146569] boot 2024-04-23T14:41:18.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:18 smithi081 ceph-mon[25540]: osdmap e9: 1 total, 1 up, 1 in 2024-04-23T14:41:18.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:18 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:41:18.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:18 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:18.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:18 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:19.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:19 smithi156 ceph-mon[32341]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:41:19.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:19 smithi156 ceph-mon[32341]: osdmap e10: 1 total, 1 up, 1 in 2024-04-23T14:41:19.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:19 smithi081 ceph-mon[25540]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T14:41:19.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:19 smithi081 ceph-mon[25540]: osdmap e10: 1 total, 1 up, 1 in 2024-04-23T14:41:21.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:21 smithi081 ceph-mon[25540]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:21.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:21 smithi156 ceph-mon[32341]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:22.328 INFO:teuthology.orchestra.run.smithi081.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-23T14:41:22.328 INFO:teuthology.orchestra.run.smithi081.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-23T14:41:22.328 INFO:teuthology.orchestra.run.smithi081.stderr: stderr: 10+0 records in 2024-04-23T14:41:22.328 INFO:teuthology.orchestra.run.smithi081.stderr:10+0 records out 2024-04-23T14:41:22.328 INFO:teuthology.orchestra.run.smithi081.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0340308 s, 308 MB/s 2024-04-23T14:41:22.328 INFO:teuthology.orchestra.run.smithi081.stderr:--> Zapping successful for: 2024-04-23T14:41:23.298 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi081:vg_nvme/lv_3 2024-04-23T14:41:23.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:23 smithi081 ceph-mon[25540]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:23.753 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:41:23.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:23 smithi156 ceph-mon[32341]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:25.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:25 smithi081 ceph-mon[25540]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:25.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:25 smithi156 ceph-mon[32341]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:26.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:26.292+0000 7fa9fb600700 1 -- 172.21.15.81:0/2816246145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9f4071e40 msgr2=0x7fa9f4070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:41:26.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:26.292+0000 7fa9fb600700 1 --2- 172.21.15.81:0/2816246145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9f4071e40 0x7fa9f4070350 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8004940 tx=0x7fa9e8009e30 comp rx=0 tx=0).stop 2024-04-23T14:41:26.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:26.292+0000 7fa9fb600700 1 -- 172.21.15.81:0/2816246145 shutdown_connections 2024-04-23T14:41:26.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:26.292+0000 7fa9fb600700 1 --2- 172.21.15.81:0/2816246145 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9f4070890 0x7fa9f4070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:41:26.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:26.292+0000 7fa9fb600700 1 --2- 172.21.15.81:0/2816246145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9f4071e40 0x7fa9f4070350 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:41:26.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:26.292+0000 7fa9fb600700 1 -- 172.21.15.81:0/2816246145 >> 172.21.15.81:0/2816246145 conn(0x7fa9f40f8530 msgr2=0x7fa9f40fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:41:26.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:26.292+0000 7fa9fb600700 1 -- 172.21.15.81:0/2816246145 shutdown_connections 2024-04-23T14:41:26.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:26.292+0000 7fa9fb600700 1 -- 172.21.15.81:0/2816246145 wait complete. 2024-04-23T14:41:26.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:26.293+0000 7fa9fb600700 1 Processor -- start 2024-04-23T14:41:26.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:26.294+0000 7fa9fb600700 1 -- start start 2024-04-23T14:41:26.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:26.294+0000 7fa9fb600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9f4070890 0x7fa9f410fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:41:26.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:26.294+0000 7fa9fb600700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9f4071e40 0x7fa9f4110130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:41:26.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:26.294+0000 7fa9fb600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f4110730 con 0x7fa9f4070890 2024-04-23T14:41:26.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:26.294+0000 7fa9fb600700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f4110f80 con 0x7fa9f4071e40 2024-04-23T14:41:26.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:26.295+0000 7fa9f8c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9f4070890 0x7fa9f410fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:41:26.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:26.295+0000 7fa9f8c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9f4070890 0x7fa9f410fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34184/0 (socket says 172.21.15.81:34184) 2024-04-23T14:41:26.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:26.295+0000 7fa9f8c00700 1 -- 172.21.15.81:0/1087548644 learned_addr learned my addr 172.21.15.81:0/1087548644 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:41:26.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:26.295+0000 7fa9f3e00700 1 --2- 172.21.15.81:0/1087548644 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9f4071e40 0x7fa9f4110130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:41:26.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:26.295+0000 7fa9f8c00700 1 -- 172.21.15.81:0/1087548644 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9f4071e40 msgr2=0x7fa9f4110130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:41:26.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:26.295+0000 7fa9f8c00700 1 --2- 172.21.15.81:0/1087548644 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9f4071e40 0x7fa9f4110130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:41:26.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:26.295+0000 7fa9f8c00700 1 -- 172.21.15.81:0/1087548644 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e8005040 con 0x7fa9f4070890 2024-04-23T14:41:26.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:26.295+0000 7fa9f8c00700 1 --2- 172.21.15.81:0/1087548644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9f4070890 0x7fa9f410fbf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa9e80040d0 tx=0x7fa9e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:41:26.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:26.296+0000 7fa9f0c00700 1 -- 172.21.15.81:0/1087548644 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9e800e070 con 0x7fa9f4070890 2024-04-23T14:41:26.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:26.296+0000 7fa9f0c00700 1 -- 172.21.15.81:0/1087548644 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa9e801c400 con 0x7fa9f4070890 2024-04-23T14:41:26.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:26.296+0000 7fa9fb600700 1 -- 172.21.15.81:0/1087548644 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f4111200 con 0x7fa9f4070890 2024-04-23T14:41:26.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:26.296+0000 7fa9f0c00700 1 -- 172.21.15.81:0/1087548644 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9e800b610 con 0x7fa9f4070890 2024-04-23T14:41:26.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:26.296+0000 7fa9fb600700 1 -- 172.21.15.81:0/1087548644 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f41116e0 con 0x7fa9f4070890 2024-04-23T14:41:26.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:26.298+0000 7fa9fb600700 1 -- 172.21.15.81:0/1087548644 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9f405f5f0 con 0x7fa9f4070890 2024-04-23T14:41:26.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:26.299+0000 7fa9f0c00700 1 -- 172.21.15.81:0/1087548644 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7fa9e8013af0 con 0x7fa9f4070890 2024-04-23T14:41:26.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:26.300+0000 7fa9f0c00700 1 --2- 172.21.15.81:0/1087548644 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fa9dc069210 0x7fa9dc06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:41:26.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:26.300+0000 7fa9f0c00700 1 -- 172.21.15.81:0/1087548644 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1978+0+0 (secure 0 0 0) 0x7fa9e80878a0 con 0x7fa9f4070890 2024-04-23T14:41:26.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:26.300+0000 7fa9f3e00700 1 --2- 172.21.15.81:0/1087548644 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fa9dc069210 0x7fa9dc06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:41:26.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:26.301+0000 7fa9f3e00700 1 --2- 172.21.15.81:0/1087548644 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fa9dc069210 0x7fa9dc06b6c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0009b80 tx=0x7fa9e000b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:41:26.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:26.305+0000 7fa9f0c00700 1 -- 172.21.15.81:0/1087548644 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa9e8058580 con 0x7fa9f4070890 2024-04-23T14:41:26.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:26.530+0000 7fa9fb600700 1 -- 172.21.15.81:0/1087548644 --> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fa9f4111a10 con 0x7fa9dc069210 2024-04-23T14:41:26.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:26 smithi081 ceph-mon[25540]: Detected new or changed devices on smithi081 2024-04-23T14:41:26.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:26 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:26.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:26 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:26.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:26 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:41:26.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:26 smithi081 ceph-mon[25540]: Adjusting osd_memory_target on smithi081 to 12865M 2024-04-23T14:41:26.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:26 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:26.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:26 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:41:26.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:26 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:41:26.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:26 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:26.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:26 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:41:26.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:26 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:41:26.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:26 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:41:26.828 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:26 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:41:27.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:26 smithi156 ceph-mon[32341]: Detected new or changed devices on smithi081 2024-04-23T14:41:27.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:26 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:27.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:26 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:27.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:26 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:41:27.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:26 smithi156 ceph-mon[32341]: Adjusting osd_memory_target on smithi081 to 12865M 2024-04-23T14:41:27.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:26 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:27.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:26 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:41:27.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:26 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:41:27.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:26 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:27.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:26 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:41:27.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:26 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:41:27.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:26 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:41:27.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:26 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:41:28.031 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:27 smithi081 ceph-mon[25540]: pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:28.031 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:27 smithi081 ceph-mon[25540]: from='client.14264 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:41:28.031 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:27 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:41:28.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:27 smithi156 ceph-mon[32341]: pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:28.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:27 smithi156 ceph-mon[32341]: from='client.14264 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:41:28.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:27 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:41:29.913 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:29 smithi156 ceph-mon[32341]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:29.914 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:29 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:29.914 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:29 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:30.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:29 smithi081 ceph-mon[25540]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:30.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:29 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:30.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:29 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:32.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:31 smithi156 ceph-mon[32341]: pgmap v52: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:32.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:31 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/868351767' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b642368-c907-404e-9f69-32f059f5426e"}]: dispatch 2024-04-23T14:41:32.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:31 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/868351767' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0b642368-c907-404e-9f69-32f059f5426e"}]': finished 2024-04-23T14:41:32.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:31 smithi156 ceph-mon[32341]: osdmap e11: 2 total, 1 up, 2 in 2024-04-23T14:41:32.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:31 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T14:41:32.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:31 smithi081 ceph-mon[25540]: pgmap v52: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:32.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:31 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/868351767' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b642368-c907-404e-9f69-32f059f5426e"}]: dispatch 2024-04-23T14:41:32.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:31 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/868351767' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0b642368-c907-404e-9f69-32f059f5426e"}]': finished 2024-04-23T14:41:32.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:31 smithi081 ceph-mon[25540]: osdmap e11: 2 total, 1 up, 2 in 2024-04-23T14:41:32.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:31 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T14:41:33.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:32 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/3550410048' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:41:33.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:32 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/3550410048' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:41:34.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:33 smithi156 ceph-mon[32341]: pgmap v54: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:34.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:33 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:34.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:33 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:34.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:33 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:41:34.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:33 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:41:34.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:33 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:34.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:33 smithi081 ceph-mon[25540]: pgmap v54: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:34.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:33 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:34.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:33 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:34.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:33 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:41:34.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:33 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:41:34.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:33 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:36.011 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:35 smithi081 ceph-mon[25540]: pgmap v55: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:36.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:35 smithi156 ceph-mon[32341]: pgmap v55: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:37.944 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:37 smithi081 ceph-mon[25540]: pgmap v56: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:38.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:37 smithi156 ceph-mon[32341]: pgmap v56: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:39.759 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:39 smithi081 ceph-mon[25540]: pgmap v57: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:40.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:39 smithi156 ceph-mon[32341]: pgmap v57: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:40.955 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:40 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-23T14:41:40.955 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:40 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:41:41.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:40 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-23T14:41:41.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:40 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:41:41.749 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:41 smithi081 ceph-mon[25540]: Deploying daemon osd.1 on smithi081 2024-04-23T14:41:41.749 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:41 smithi081 ceph-mon[25540]: pgmap v58: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:42.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:41 smithi156 ceph-mon[32341]: Deploying daemon osd.1 on smithi081 2024-04-23T14:41:42.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:41 smithi156 ceph-mon[32341]: pgmap v58: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:42.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:42 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:41:43.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:42 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:41:43.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:43 smithi081 ceph-mon[25540]: pgmap v59: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:44.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:43 smithi156 ceph-mon[32341]: pgmap v59: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:46.029 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:45 smithi081 ceph-mon[25540]: pgmap v60: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:46.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:45 smithi156 ceph-mon[32341]: pgmap v60: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:47.720 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:47 smithi081 ceph-mon[25540]: pgmap v61: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:47.720 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:47 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:41:48.035 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:47 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:48.035 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:47 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:48.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:47 smithi156 ceph-mon[32341]: pgmap v61: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:48.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:47 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:41:48.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:47 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:48.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:47 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:49.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:49 smithi081 ceph-mon[25540]: pgmap v62: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:49.915 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:49 smithi156 ceph-mon[32341]: pgmap v62: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:51.662 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:51 smithi081 ceph-mon[25540]: pgmap v63: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:51.662 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:51 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:51.662 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:51 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:51.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:51 smithi156 ceph-mon[32341]: pgmap v63: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:51.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:51 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:51.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:51 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:52.564 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 1 on host 'smithi081' 2024-04-23T14:41:52.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:52.563+0000 7fa9f0c00700 1 -- 172.21.15.81:0/1087548644 <== mgr.14210 v2:172.21.15.81:6800/1053506915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa9f4111a10 con 0x7fa9dc069210 2024-04-23T14:41:52.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:52.567+0000 7fa9fb600700 1 -- 172.21.15.81:0/1087548644 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fa9dc069210 msgr2=0x7fa9dc06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:41:52.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:52.567+0000 7fa9fb600700 1 --2- 172.21.15.81:0/1087548644 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fa9dc069210 0x7fa9dc06b6c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0009b80 tx=0x7fa9e000b040 comp rx=0 tx=0).stop 2024-04-23T14:41:52.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:52.567+0000 7fa9fb600700 1 -- 172.21.15.81:0/1087548644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9f4070890 msgr2=0x7fa9f410fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:41:52.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:52.567+0000 7fa9fb600700 1 --2- 172.21.15.81:0/1087548644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9f4070890 0x7fa9f410fbf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa9e80040d0 tx=0x7fa9e8009e30 comp rx=0 tx=0).stop 2024-04-23T14:41:52.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:52.567+0000 7fa9fb600700 1 -- 172.21.15.81:0/1087548644 shutdown_connections 2024-04-23T14:41:52.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:52.567+0000 7fa9fb600700 1 --2- 172.21.15.81:0/1087548644 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fa9dc069210 0x7fa9dc06b6c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:41:52.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:52.567+0000 7fa9fb600700 1 --2- 172.21.15.81:0/1087548644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9f4070890 0x7fa9f410fbf0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:41:52.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:52.567+0000 7fa9fb600700 1 --2- 172.21.15.81:0/1087548644 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9f4071e40 0x7fa9f4110130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:41:52.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:52.567+0000 7fa9fb600700 1 -- 172.21.15.81:0/1087548644 >> 172.21.15.81:0/1087548644 conn(0x7fa9f40f8530 msgr2=0x7fa9f40f9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:41:52.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:52.567+0000 7fa9fb600700 1 -- 172.21.15.81:0/1087548644 shutdown_connections 2024-04-23T14:41:52.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:41:52.567+0000 7fa9fb600700 1 -- 172.21.15.81:0/1087548644 wait complete. 2024-04-23T14:41:52.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:52 smithi156 ceph-mon[32341]: from='osd.1 [v2:172.21.15.81:6810/48369012,v1:172.21.15.81:6811/48369012]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-23T14:41:52.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:52 smithi081 ceph-mon[25540]: from='osd.1 [v2:172.21.15.81:6810/48369012,v1:172.21.15.81:6811/48369012]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-23T14:41:53.636 DEBUG:teuthology.orchestra.run.smithi081:osd.1> sudo journalctl -f -n 0 -u ceph-7a641bea-017e-11ef-bc93-c7b262605968@osd.1.service 2024-04-23T14:41:53.643 INFO:tasks.cephadm:Deploying osd.2 on smithi081 with /dev/vg_nvme/lv_2... 2024-04-23T14:41:53.643 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-23T14:41:53.711 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:53 smithi081 ceph-mon[25540]: pgmap v64: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:53.711 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:53 smithi081 ceph-mon[25540]: from='osd.1 [v2:172.21.15.81:6810/48369012,v1:172.21.15.81:6811/48369012]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-23T14:41:53.711 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:53 smithi081 ceph-mon[25540]: osdmap e12: 2 total, 1 up, 2 in 2024-04-23T14:41:53.711 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:53 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T14:41:53.711 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:53 smithi081 ceph-mon[25540]: from='osd.1 [v2:172.21.15.81:6810/48369012,v1:172.21.15.81:6811/48369012]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-04-23T14:41:53.711 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:53 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:53.711 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:53 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:53.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:53 smithi156 ceph-mon[32341]: pgmap v64: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:53.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:53 smithi156 ceph-mon[32341]: from='osd.1 [v2:172.21.15.81:6810/48369012,v1:172.21.15.81:6811/48369012]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-23T14:41:53.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:53 smithi156 ceph-mon[32341]: osdmap e12: 2 total, 1 up, 2 in 2024-04-23T14:41:53.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:53 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T14:41:53.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:53 smithi156 ceph-mon[32341]: from='osd.1 [v2:172.21.15.81:6810/48369012,v1:172.21.15.81:6811/48369012]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-04-23T14:41:53.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:53 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:53.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:53 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:54.140 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:41:54.617 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:54 smithi081 ceph-mon[25540]: from='osd.1 [v2:172.21.15.81:6810/48369012,v1:172.21.15.81:6811/48369012]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-04-23T14:41:54.617 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:54 smithi081 ceph-mon[25540]: osdmap e13: 2 total, 1 up, 2 in 2024-04-23T14:41:54.617 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:54 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T14:41:54.617 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:54 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T14:41:54.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:54 smithi156 ceph-mon[32341]: from='osd.1 [v2:172.21.15.81:6810/48369012,v1:172.21.15.81:6811/48369012]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-04-23T14:41:54.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:54 smithi156 ceph-mon[32341]: osdmap e13: 2 total, 1 up, 2 in 2024-04-23T14:41:54.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:54 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T14:41:54.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:54 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T14:41:55.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:55 smithi156 ceph-mon[32341]: purged_snaps scrub starts 2024-04-23T14:41:55.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:55 smithi156 ceph-mon[32341]: purged_snaps scrub ok 2024-04-23T14:41:55.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:55 smithi156 ceph-mon[32341]: pgmap v67: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:55.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:55 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T14:41:55.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:55 smithi156 ceph-mon[32341]: osd.1 [v2:172.21.15.81:6810/48369012,v1:172.21.15.81:6811/48369012] boot 2024-04-23T14:41:55.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:55 smithi156 ceph-mon[32341]: osdmap e14: 2 total, 2 up, 2 in 2024-04-23T14:41:55.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:55 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T14:41:55.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:55 smithi081 ceph-mon[25540]: purged_snaps scrub starts 2024-04-23T14:41:55.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:55 smithi081 ceph-mon[25540]: purged_snaps scrub ok 2024-04-23T14:41:55.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:55 smithi081 ceph-mon[25540]: pgmap v67: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-23T14:41:55.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:55 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T14:41:55.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:55 smithi081 ceph-mon[25540]: osd.1 [v2:172.21.15.81:6810/48369012,v1:172.21.15.81:6811/48369012] boot 2024-04-23T14:41:55.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:55 smithi081 ceph-mon[25540]: osdmap e14: 2 total, 2 up, 2 in 2024-04-23T14:41:55.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:55 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T14:41:56.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:56 smithi156 ceph-mon[32341]: osdmap e15: 2 total, 2 up, 2 in 2024-04-23T14:41:56.816 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:56 smithi081 ceph-mon[25540]: osdmap e15: 2 total, 2 up, 2 in 2024-04-23T14:41:57.723 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:57 smithi156 ceph-mon[32341]: pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-23T14:41:57.724 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:57 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:41:57.775 INFO:teuthology.orchestra.run.smithi081.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-23T14:41:57.776 INFO:teuthology.orchestra.run.smithi081.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-23T14:41:57.776 INFO:teuthology.orchestra.run.smithi081.stderr: stderr: 10+0 records in 2024-04-23T14:41:57.776 INFO:teuthology.orchestra.run.smithi081.stderr:10+0 records out 2024-04-23T14:41:57.776 INFO:teuthology.orchestra.run.smithi081.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0352324 s, 298 MB/s 2024-04-23T14:41:57.776 INFO:teuthology.orchestra.run.smithi081.stderr: stderr: 2024-04-23T14:41:57.776 INFO:teuthology.orchestra.run.smithi081.stderr:--> Zapping successful for: 2024-04-23T14:41:57.776 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:57 smithi081 ceph-mon[25540]: pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-23T14:41:57.776 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:57 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:41:58.722 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi081:vg_nvme/lv_2 2024-04-23T14:41:58.950 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:58 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:58.950 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:58 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:59.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:58 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:41:59.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:58 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:00.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:41:59 smithi156 ceph-mon[32341]: pgmap v71: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-23T14:42:00.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:41:59 smithi081 ceph-mon[25540]: pgmap v71: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-23T14:42:00.185 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:42:02.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:01 smithi156 ceph-mon[32341]: pgmap v72: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-23T14:42:02.061 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:01 smithi081 ceph-mon[25540]: pgmap v72: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-23T14:42:02.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:02.495+0000 7f620e000700 1 -- 172.21.15.81:0/568045786 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62081021c0 msgr2=0x7f62081045a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:42:02.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:02.495+0000 7f620e000700 1 --2- 172.21.15.81:0/568045786 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62081021c0 0x7f62081045a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f61f4004970 tx=0x7f61f4009e30 comp rx=0 tx=0).stop 2024-04-23T14:42:02.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:02.495+0000 7f620e000700 1 -- 172.21.15.81:0/568045786 shutdown_connections 2024-04-23T14:42:02.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:02.495+0000 7f620e000700 1 --2- 172.21.15.81:0/568045786 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62081021c0 0x7f62081045a0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:42:02.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:02.495+0000 7f620e000700 1 --2- 172.21.15.81:0/568045786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6208066270 0x7f6208101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:42:02.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:02.495+0000 7f620e000700 1 -- 172.21.15.81:0/568045786 >> 172.21.15.81:0/568045786 conn(0x7f62080f7270 msgr2=0x7f62080f96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:42:02.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:02.495+0000 7f620e000700 1 -- 172.21.15.81:0/568045786 shutdown_connections 2024-04-23T14:42:02.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:02.495+0000 7f620e000700 1 -- 172.21.15.81:0/568045786 wait complete. 2024-04-23T14:42:02.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:02.496+0000 7f620e000700 1 Processor -- start 2024-04-23T14:42:02.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:02.496+0000 7f620e000700 1 -- start start 2024-04-23T14:42:02.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:02.496+0000 7f620e000700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6208066270 0x7f620810fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:42:02.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:02.496+0000 7f620e000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62081021c0 0x7f620810ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:42:02.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:02.496+0000 7f620e000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6208110550 con 0x7f62081021c0 2024-04-23T14:42:02.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:02.497+0000 7f620e000700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6208110d50 con 0x7f6208066270 2024-04-23T14:42:02.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:02.497+0000 7f6207e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62081021c0 0x7f620810ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:42:02.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:02.497+0000 7f6207e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62081021c0 0x7f620810ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48334/0 (socket says 172.21.15.81:48334) 2024-04-23T14:42:02.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:02.497+0000 7f6207e00700 1 -- 172.21.15.81:0/2998865516 learned_addr learned my addr 172.21.15.81:0/2998865516 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:42:02.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:02.497+0000 7f620cc00700 1 --2- 172.21.15.81:0/2998865516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6208066270 0x7f620810fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:42:02.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:02.497+0000 7f6207e00700 1 -- 172.21.15.81:0/2998865516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6208066270 msgr2=0x7f620810fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:42:02.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:02.497+0000 7f6207e00700 1 --2- 172.21.15.81:0/2998865516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6208066270 0x7f620810fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:42:02.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:02.497+0000 7f6207e00700 1 -- 172.21.15.81:0/2998865516 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61fc005040 con 0x7f62081021c0 2024-04-23T14:42:02.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:02.498+0000 7f6207e00700 1 --2- 172.21.15.81:0/2998865516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62081021c0 0x7f620810ff50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f61f4004890 tx=0x7f61f4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:42:02.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:02.498+0000 7f6204c00700 1 -- 172.21.15.81:0/2998865516 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61f400e040 con 0x7f62081021c0 2024-04-23T14:42:02.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:02.498+0000 7f6204c00700 1 -- 172.21.15.81:0/2998865516 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f61f4009660 con 0x7f62081021c0 2024-04-23T14:42:02.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:02.498+0000 7f6204c00700 1 -- 172.21.15.81:0/2998865516 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61f401c630 con 0x7f62081021c0 2024-04-23T14:42:02.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:02.498+0000 7f620e000700 1 -- 172.21.15.81:0/2998865516 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f4005040 con 0x7f62081021c0 2024-04-23T14:42:02.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:02.498+0000 7f620e000700 1 -- 172.21.15.81:0/2998865516 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6208111380 con 0x7f62081021c0 2024-04-23T14:42:02.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:02.499+0000 7f620e000700 1 -- 172.21.15.81:0/2998865516 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f620805f5f0 con 0x7f62081021c0 2024-04-23T14:42:02.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:02.501+0000 7f6204c00700 1 -- 172.21.15.81:0/2998865516 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7f61f4013980 con 0x7f62081021c0 2024-04-23T14:42:02.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:02.502+0000 7f6204c00700 1 --2- 172.21.15.81:0/2998865516 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f61f0069210 0x7f61f006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:42:02.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:02.502+0000 7f6204c00700 1 -- 172.21.15.81:0/2998865516 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2410+0+0 (secure 0 0 0) 0x7f61f40877d0 con 0x7f62081021c0 2024-04-23T14:42:02.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:02.502+0000 7f620cc00700 1 --2- 172.21.15.81:0/2998865516 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f61f0069210 0x7f61f006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:42:02.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:02.503+0000 7f620cc00700 1 --2- 172.21.15.81:0/2998865516 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f61f0069210 0x7f61f006b6c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6208065fb0 tx=0x7f61fc009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:42:02.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:02.509+0000 7f6204c00700 1 -- 172.21.15.81:0/2998865516 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f61f4058240 con 0x7f62081021c0 2024-04-23T14:42:02.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:02.730+0000 7f620e000700 1 -- 172.21.15.81:0/2998865516 --> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f6208111700 con 0x7f61f0069210 2024-04-23T14:42:03.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:02 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:42:03.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:02 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:42:03.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:02 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:42:03.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:02 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:42:03.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:02 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:42:03.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:02 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:42:03.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:03 smithi081 ceph-mon[25540]: pgmap v73: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-23T14:42:03.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:03 smithi081 ceph-mon[25540]: from='client.14282 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:42:04.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:03 smithi156 ceph-mon[32341]: pgmap v73: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-23T14:42:04.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:03 smithi156 ceph-mon[32341]: from='client.14282 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:42:05.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:05 smithi081 ceph-mon[25540]: Detected new or changed devices on smithi081 2024-04-23T14:42:05.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:05 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:05.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:05 smithi081 ceph-mon[25540]: pgmap v74: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-23T14:42:05.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:05 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:05.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:05 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:42:05.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:05 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:42:05.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:05 smithi081 ceph-mon[25540]: Adjusting osd_memory_target on smithi081 to 6432M 2024-04-23T14:42:05.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:05 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:05.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:05 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:42:05.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:05 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:42:05.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:05 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:05.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:05 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:42:05.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:05 smithi156 ceph-mon[32341]: Detected new or changed devices on smithi081 2024-04-23T14:42:05.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:05 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:05.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:05 smithi156 ceph-mon[32341]: pgmap v74: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-23T14:42:05.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:05 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:05.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:05 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:42:05.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:05 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:42:05.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:05 smithi156 ceph-mon[32341]: Adjusting osd_memory_target on smithi081 to 6432M 2024-04-23T14:42:05.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:05 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:05.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:05 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:42:05.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:05 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:42:05.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:05 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:05.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:05 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:42:07.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:07 smithi081 ceph-mon[25540]: pgmap v75: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-23T14:42:07.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:07 smithi156 ceph-mon[32341]: pgmap v75: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-23T14:42:08.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:08 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/219810605' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cde59edc-3e7d-4d53-ba08-a67ec2250898"}]: dispatch 2024-04-23T14:42:08.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:08 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/219810605' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cde59edc-3e7d-4d53-ba08-a67ec2250898"}]': finished 2024-04-23T14:42:08.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:08 smithi081 ceph-mon[25540]: osdmap e16: 3 total, 2 up, 3 in 2024-04-23T14:42:08.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:08 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T14:42:08.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:08 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/219810605' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cde59edc-3e7d-4d53-ba08-a67ec2250898"}]: dispatch 2024-04-23T14:42:08.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:08 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/219810605' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cde59edc-3e7d-4d53-ba08-a67ec2250898"}]': finished 2024-04-23T14:42:08.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:08 smithi156 ceph-mon[32341]: osdmap e16: 3 total, 2 up, 3 in 2024-04-23T14:42:08.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:08 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T14:42:09.325 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:09 smithi081 ceph-mon[25540]: pgmap v77: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-23T14:42:09.325 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:09 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/2183391527' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:42:09.380 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:09 smithi156 ceph-mon[32341]: pgmap v77: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-23T14:42:09.380 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:09 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/2183391527' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:42:11.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:11 smithi081 ceph-mon[25540]: pgmap v78: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-23T14:42:11.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:11 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:11.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:11 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:11.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:11 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:42:11.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:11 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:42:11.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:11 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:11.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:11 smithi156 ceph-mon[32341]: pgmap v78: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-23T14:42:11.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:11 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:11.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:11 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:11.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:11 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:42:11.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:11 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:42:11.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:11 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:13.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:13 smithi081 ceph-mon[25540]: pgmap v79: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-23T14:42:13.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:13 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:42:13.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:13 smithi156 ceph-mon[32341]: pgmap v79: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-23T14:42:13.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:13 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:42:15.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:15 smithi081 ceph-mon[25540]: pgmap v80: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-23T14:42:15.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:15 smithi156 ceph-mon[32341]: pgmap v80: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-23T14:42:17.526 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:17 smithi081 ceph-mon[25540]: pgmap v81: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-23T14:42:17.526 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:17 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-23T14:42:17.526 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:17 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:42:17.526 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:17 smithi081 ceph-mon[25540]: Deploying daemon osd.2 on smithi081 2024-04-23T14:42:17.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:17 smithi156 ceph-mon[32341]: pgmap v81: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-23T14:42:17.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:17 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-23T14:42:17.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:17 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:42:17.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:17 smithi156 ceph-mon[32341]: Deploying daemon osd.2 on smithi081 2024-04-23T14:42:19.357 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:19 smithi081 ceph-mon[25540]: pgmap v82: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-23T14:42:19.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:19 smithi156 ceph-mon[32341]: pgmap v82: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-23T14:42:21.280 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:21 smithi081 ceph-mon[25540]: pgmap v83: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-23T14:42:21.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:21 smithi156 ceph-mon[32341]: pgmap v83: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-23T14:42:23.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:23 smithi156 ceph-mon[32341]: pgmap v84: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-23T14:42:23.578 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:23 smithi081 ceph-mon[25540]: pgmap v84: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-23T14:42:25.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:25 smithi156 ceph-mon[32341]: pgmap v85: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-23T14:42:25.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:25 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:25.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:25 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:25.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:25 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:42:25.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:25 smithi081 ceph-mon[25540]: pgmap v85: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-23T14:42:25.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:25 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:25.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:25 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:25.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:25 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:42:27.381 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:27 smithi081 ceph-mon[25540]: pgmap v86: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-23T14:42:27.381 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:27 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:42:27.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:27 smithi156 ceph-mon[32341]: pgmap v86: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-23T14:42:27.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:27 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:42:29.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:29 smithi156 ceph-mon[32341]: pgmap v87: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-23T14:42:29.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:29 smithi156 ceph-mon[32341]: from='osd.2 [v2:172.21.15.81:6818/3840720313,v1:172.21.15.81:6819/3840720313]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-23T14:42:29.377 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:29 smithi081 ceph-mon[25540]: pgmap v87: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-23T14:42:29.378 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:29 smithi081 ceph-mon[25540]: from='osd.2 [v2:172.21.15.81:6818/3840720313,v1:172.21.15.81:6819/3840720313]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-23T14:42:29.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:29.775+0000 7f6204c00700 1 -- 172.21.15.81:0/2998865516 <== mgr.14210 v2:172.21.15.81:6800/1053506915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6208111700 con 0x7f61f0069210 2024-04-23T14:42:29.778 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 2 on host 'smithi081' 2024-04-23T14:42:29.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:29.779+0000 7f620e000700 1 -- 172.21.15.81:0/2998865516 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f61f0069210 msgr2=0x7f61f006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:42:29.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:29.779+0000 7f620e000700 1 --2- 172.21.15.81:0/2998865516 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f61f0069210 0x7f61f006b6c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6208065fb0 tx=0x7f61fc009e30 comp rx=0 tx=0).stop 2024-04-23T14:42:29.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:29.779+0000 7f620e000700 1 -- 172.21.15.81:0/2998865516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62081021c0 msgr2=0x7f620810ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:42:29.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:29.779+0000 7f620e000700 1 --2- 172.21.15.81:0/2998865516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62081021c0 0x7f620810ff50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f61f4004890 tx=0x7f61f4009e30 comp rx=0 tx=0).stop 2024-04-23T14:42:29.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:29.779+0000 7f620e000700 1 -- 172.21.15.81:0/2998865516 shutdown_connections 2024-04-23T14:42:29.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:29.779+0000 7f620e000700 1 --2- 172.21.15.81:0/2998865516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6208066270 0x7f620810fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:42:29.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:29.779+0000 7f620e000700 1 --2- 172.21.15.81:0/2998865516 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f61f0069210 0x7f61f006b6c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:42:29.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:29.779+0000 7f620e000700 1 --2- 172.21.15.81:0/2998865516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62081021c0 0x7f620810ff50 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:42:29.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:29.779+0000 7f620e000700 1 -- 172.21.15.81:0/2998865516 >> 172.21.15.81:0/2998865516 conn(0x7f62080f7270 msgr2=0x7f62080f7690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:42:29.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:29.779+0000 7f620e000700 1 -- 172.21.15.81:0/2998865516 shutdown_connections 2024-04-23T14:42:29.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:42:29.779+0000 7f620e000700 1 -- 172.21.15.81:0/2998865516 wait complete. 2024-04-23T14:42:30.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:30 smithi156 ceph-mon[32341]: from='osd.2 [v2:172.21.15.81:6818/3840720313,v1:172.21.15.81:6819/3840720313]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-23T14:42:30.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:30 smithi156 ceph-mon[32341]: osdmap e17: 3 total, 2 up, 3 in 2024-04-23T14:42:30.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:30 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T14:42:30.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:30 smithi156 ceph-mon[32341]: from='osd.2 [v2:172.21.15.81:6818/3840720313,v1:172.21.15.81:6819/3840720313]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-04-23T14:42:30.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:30 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:30.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:30 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:30.451 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:30 smithi081 ceph-mon[25540]: from='osd.2 [v2:172.21.15.81:6818/3840720313,v1:172.21.15.81:6819/3840720313]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-23T14:42:30.451 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:30 smithi081 ceph-mon[25540]: osdmap e17: 3 total, 2 up, 3 in 2024-04-23T14:42:30.451 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:30 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T14:42:30.451 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:30 smithi081 ceph-mon[25540]: from='osd.2 [v2:172.21.15.81:6818/3840720313,v1:172.21.15.81:6819/3840720313]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-04-23T14:42:30.451 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:30 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:30.451 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:30 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:31.178 DEBUG:teuthology.orchestra.run.smithi081:osd.2> sudo journalctl -f -n 0 -u ceph-7a641bea-017e-11ef-bc93-c7b262605968@osd.2.service 2024-04-23T14:42:31.185 INFO:tasks.cephadm:Deploying osd.3 on smithi156 with /dev/vg_nvme/lv_4... 2024-04-23T14:42:31.185 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-23T14:42:31.506 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:31 smithi081 ceph-mon[25540]: pgmap v89: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-23T14:42:31.506 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:31 smithi081 ceph-mon[25540]: from='osd.2 [v2:172.21.15.81:6818/3840720313,v1:172.21.15.81:6819/3840720313]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-04-23T14:42:31.506 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:31 smithi081 ceph-mon[25540]: osdmap e18: 3 total, 2 up, 3 in 2024-04-23T14:42:31.506 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:31 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T14:42:31.506 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:31 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T14:42:31.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:31 smithi156 ceph-mon[32341]: pgmap v89: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-23T14:42:31.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:31 smithi156 ceph-mon[32341]: from='osd.2 [v2:172.21.15.81:6818/3840720313,v1:172.21.15.81:6819/3840720313]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-04-23T14:42:31.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:31 smithi156 ceph-mon[32341]: osdmap e18: 3 total, 2 up, 3 in 2024-04-23T14:42:31.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:31 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T14:42:31.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:31 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T14:42:31.627 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi156/config 2024-04-23T14:42:32.465 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:32 smithi081 ceph-mon[25540]: purged_snaps scrub starts 2024-04-23T14:42:32.466 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:32 smithi081 ceph-mon[25540]: purged_snaps scrub ok 2024-04-23T14:42:32.466 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:32 smithi081 ceph-mon[25540]: osd.2 [v2:172.21.15.81:6818/3840720313,v1:172.21.15.81:6819/3840720313] boot 2024-04-23T14:42:32.466 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:32 smithi081 ceph-mon[25540]: osdmap e19: 3 total, 3 up, 3 in 2024-04-23T14:42:32.466 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:32 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T14:42:32.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:32 smithi156 ceph-mon[32341]: purged_snaps scrub starts 2024-04-23T14:42:32.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:32 smithi156 ceph-mon[32341]: purged_snaps scrub ok 2024-04-23T14:42:32.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:32 smithi156 ceph-mon[32341]: osd.2 [v2:172.21.15.81:6818/3840720313,v1:172.21.15.81:6819/3840720313] boot 2024-04-23T14:42:32.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:32 smithi156 ceph-mon[32341]: osdmap e19: 3 total, 3 up, 3 in 2024-04-23T14:42:32.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:32 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T14:42:33.264 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:33 smithi156 ceph-mon[32341]: pgmap v92: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-23T14:42:33.265 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:33 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-04-23T14:42:33.265 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:33 smithi156 ceph-mon[32341]: osdmap e20: 3 total, 3 up, 3 in 2024-04-23T14:42:33.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:33 smithi081 ceph-mon[25540]: pgmap v92: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-23T14:42:33.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:33 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-04-23T14:42:33.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:33 smithi081 ceph-mon[25540]: osdmap e20: 3 total, 3 up, 3 in 2024-04-23T14:42:34.464 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-23T14:42:34.464 INFO:teuthology.orchestra.run.smithi156.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-23T14:42:34.464 INFO:teuthology.orchestra.run.smithi156.stderr: stderr: 10+0 records in 2024-04-23T14:42:34.464 INFO:teuthology.orchestra.run.smithi156.stderr:10+0 records out 2024-04-23T14:42:34.464 INFO:teuthology.orchestra.run.smithi156.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0345309 s, 304 MB/s 2024-04-23T14:42:34.464 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping successful for: 2024-04-23T14:42:34.465 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:34 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-04-23T14:42:34.465 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:34 smithi156 ceph-mon[32341]: osdmap e21: 3 total, 3 up, 3 in 2024-04-23T14:42:34.465 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:34 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-23T14:42:34.465 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:34 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:34.465 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:34 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:34.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:34 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-04-23T14:42:34.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:34 smithi081 ceph-mon[25540]: osdmap e21: 3 total, 3 up, 3 in 2024-04-23T14:42:34.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:34 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-23T14:42:34.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:34 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:34.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:34 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:35.253 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi156:vg_nvme/lv_4 2024-04-23T14:42:35.351 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:35 smithi081 ceph-mon[25540]: pgmap v95: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-23T14:42:35.351 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:35 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-23T14:42:35.351 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:35 smithi081 ceph-mon[25540]: osdmap e22: 3 total, 3 up, 3 in 2024-04-23T14:42:35.351 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:35 smithi081 ceph-mon[25540]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-23T14:42:35.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:35 smithi156 ceph-mon[32341]: pgmap v95: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-23T14:42:35.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:35 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-23T14:42:35.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:35 smithi156 ceph-mon[32341]: osdmap e22: 3 total, 3 up, 3 in 2024-04-23T14:42:35.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:35 smithi156 ceph-mon[32341]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-23T14:42:35.619 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:42:35 smithi081 sudo[60812]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-23T14:42:35.620 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:42:35 smithi081 sudo[60812]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-23T14:42:35.620 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:42:35 smithi081 sudo[60812]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-23T14:42:35.620 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:42:35 smithi081 sudo[60812]: pam_unix(sudo:session): session closed for user root 2024-04-23T14:42:35.714 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi156/config 2024-04-23T14:42:36.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:36 smithi156 ceph-mon[32341]: osdmap e23: 3 total, 3 up, 3 in 2024-04-23T14:42:36.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:36 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:36.558 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:36 smithi081 ceph-mon[25540]: osdmap e23: 3 total, 3 up, 3 in 2024-04-23T14:42:36.559 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:36 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:36.559 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:42:36 smithi081 sudo[60819]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-23T14:42:36.559 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:42:36 smithi081 sudo[60819]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-23T14:42:36.559 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:42:36 smithi081 sudo[60819]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-23T14:42:36.559 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:42:36 smithi081 sudo[60819]: pam_unix(sudo:session): session closed for user root 2024-04-23T14:42:36.827 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:42:36 smithi081 sudo[60847]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-23T14:42:36.828 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:42:36 smithi081 sudo[60847]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-23T14:42:36.828 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:42:36 smithi081 sudo[60847]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-23T14:42:36.828 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:42:36 smithi081 sudo[60847]: pam_unix(sudo:session): session closed for user root 2024-04-23T14:42:37.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:37 smithi156 ceph-mon[32341]: pgmap v98: 1 pgs: 1 active+clean; 449 KiB data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-23T14:42:37.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:37 smithi156 ceph-mon[32341]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-23T14:42:37.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:37 smithi156 ceph-mon[32341]: Cluster is now healthy 2024-04-23T14:42:37.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:37 smithi156 ceph-mon[32341]: mgrmap e19: smithi081.ldghvq(active, since 2m), standbys: smithi156.ounwyj 2024-04-23T14:42:37.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:37 smithi081 ceph-mon[25540]: pgmap v98: 1 pgs: 1 active+clean; 449 KiB data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-23T14:42:37.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:37 smithi081 ceph-mon[25540]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-23T14:42:37.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:37 smithi081 ceph-mon[25540]: Cluster is now healthy 2024-04-23T14:42:37.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:37 smithi081 ceph-mon[25540]: mgrmap e19: smithi081.ldghvq(active, since 2m), standbys: smithi156.ounwyj 2024-04-23T14:42:37.577 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:42:37 smithi081 sudo[60861]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-23T14:42:37.577 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:42:37 smithi081 sudo[60861]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-23T14:42:37.577 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:42:37 smithi081 sudo[60861]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-23T14:42:37.577 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:42:37 smithi081 sudo[60861]: pam_unix(sudo:session): session closed for user root 2024-04-23T14:42:37.794 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:42:37.792+0000 7f17bd400700 1 -- 172.21.15.156:0/4257876699 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17b81023d0 msgr2=0x7f17b81047b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:42:37.794 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:42:37.792+0000 7f17bd400700 1 --2- 172.21.15.156:0/4257876699 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17b81023d0 0x7f17b81047b0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f17a4004940 tx=0x7f17a4009e30 comp rx=0 tx=0).stop 2024-04-23T14:42:37.794 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:42:37.792+0000 7f17bd400700 1 -- 172.21.15.156:0/4257876699 shutdown_connections 2024-04-23T14:42:37.794 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:42:37.792+0000 7f17bd400700 1 --2- 172.21.15.156:0/4257876699 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17b81023d0 0x7f17b81047b0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:42:37.794 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:42:37.792+0000 7f17bd400700 1 --2- 172.21.15.156:0/4257876699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17b8066290 0x7f17b8101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:42:37.794 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:42:37.792+0000 7f17bd400700 1 -- 172.21.15.156:0/4257876699 >> 172.21.15.156:0/4257876699 conn(0x7f17b80f74c0 msgr2=0x7f17b80f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:42:37.794 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:42:37.793+0000 7f17bd400700 1 -- 172.21.15.156:0/4257876699 shutdown_connections 2024-04-23T14:42:37.795 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:42:37.793+0000 7f17bd400700 1 -- 172.21.15.156:0/4257876699 wait complete. 2024-04-23T14:42:37.796 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:42:37.793+0000 7f17bd400700 1 Processor -- start 2024-04-23T14:42:37.796 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:42:37.794+0000 7f17bd400700 1 -- start start 2024-04-23T14:42:37.796 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:42:37.794+0000 7f17bd400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17b8066290 0x7f17b810fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:42:37.796 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:42:37.794+0000 7f17bd400700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17b81023d0 0x7f17b8110170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:42:37.796 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:42:37.794+0000 7f17bd400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b8110770 con 0x7f17b8066290 2024-04-23T14:42:37.796 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:42:37.794+0000 7f17bd400700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b8110fc0 con 0x7f17b81023d0 2024-04-23T14:42:37.797 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:42:37.794+0000 7f17b5e00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17b81023d0 0x7f17b8110170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:42:37.797 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:42:37.794+0000 7f17b5e00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17b81023d0 0x7f17b8110170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:52718/0 (socket says 172.21.15.156:52718) 2024-04-23T14:42:37.797 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:42:37.794+0000 7f17b5e00700 1 -- 172.21.15.156:0/1509597185 learned_addr learned my addr 172.21.15.156:0/1509597185 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-04-23T14:42:37.797 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:42:37.794+0000 7f17b6800700 1 --2- 172.21.15.156:0/1509597185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17b8066290 0x7f17b810fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:42:37.797 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:42:37.795+0000 7f17b5e00700 1 -- 172.21.15.156:0/1509597185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17b8066290 msgr2=0x7f17b810fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:42:37.797 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:42:37.795+0000 7f17b5e00700 1 --2- 172.21.15.156:0/1509597185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17b8066290 0x7f17b810fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:42:37.797 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:42:37.795+0000 7f17b5e00700 1 -- 172.21.15.156:0/1509597185 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a4005040 con 0x7f17b81023d0 2024-04-23T14:42:37.797 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:42:37.795+0000 7f17b5e00700 1 --2- 172.21.15.156:0/1509597185 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17b81023d0 0x7f17b8110170 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f17a400b3b0 tx=0x7f17a4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:42:37.797 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:42:37.795+0000 7f17aea00700 1 -- 172.21.15.156:0/1509597185 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17a400e040 con 0x7f17b81023d0 2024-04-23T14:42:37.797 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:42:37.795+0000 7f17aea00700 1 -- 172.21.15.156:0/1509597185 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f17a4004290 con 0x7f17b81023d0 2024-04-23T14:42:37.797 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:42:37.795+0000 7f17bd400700 1 -- 172.21.15.156:0/1509597185 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b8111240 con 0x7f17b81023d0 2024-04-23T14:42:37.797 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:42:37.795+0000 7f17aea00700 1 -- 172.21.15.156:0/1509597185 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17a401c630 con 0x7f17b81023d0 2024-04-23T14:42:37.797 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:42:37.795+0000 7f17bd400700 1 -- 172.21.15.156:0/1509597185 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b8111780 con 0x7f17b81023d0 2024-04-23T14:42:37.798 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:42:37.796+0000 7f17bd400700 1 -- 172.21.15.156:0/1509597185 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b805f5f0 con 0x7f17b81023d0 2024-04-23T14:42:37.798 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:42:37.797+0000 7f17aea00700 1 -- 172.21.15.156:0/1509597185 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f17a400bbf0 con 0x7f17b81023d0 2024-04-23T14:42:37.799 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:42:37.798+0000 7f17aea00700 1 --2- 172.21.15.156:0/1509597185 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f179c0692b0 0x7f179c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:42:37.799 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:42:37.798+0000 7f17aea00700 1 -- 172.21.15.156:0/1509597185 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3228+0+0 (secure 0 0 0) 0x7f17a4087d50 con 0x7f17b81023d0 2024-04-23T14:42:37.799 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:42:37.799+0000 7f17b6800700 1 --2- 172.21.15.156:0/1509597185 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f179c0692b0 0x7f179c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:42:37.800 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:42:37.799+0000 7f17b6800700 1 --2- 172.21.15.156:0/1509597185 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f179c0692b0 0x7f179c06b760 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f17a8009fd0 tx=0x7f17a8009f00 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:42:37.804 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:42:37.804+0000 7f17aea00700 1 -- 172.21.15.156:0/1509597185 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f17a40583b0 con 0x7f17b81023d0 2024-04-23T14:42:38.027 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:42:38.026+0000 7f17bd400700 1 -- 172.21.15.156:0/1509597185 --> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f17b805f5f0 con 0x7f179c0692b0 2024-04-23T14:42:38.239 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:42:37 smithi081 sudo[61345]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-23T14:42:38.239 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:42:37 smithi081 sudo[61345]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-23T14:42:38.239 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:42:37 smithi081 sudo[61345]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-23T14:42:38.239 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:42:37 smithi081 sudo[61345]: pam_unix(sudo:session): session closed for user root 2024-04-23T14:42:38.570 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:38 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:42:38.571 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:38 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:42:38.571 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:38 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:42:38.741 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:38 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:42:38.741 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:38 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:42:38.741 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:38 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:42:38.826 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:42:38 smithi081 sudo[63551]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-23T14:42:38.827 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:42:38 smithi081 sudo[63551]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-23T14:42:38.827 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:42:38 smithi081 sudo[63551]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-23T14:42:38.827 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:42:38 smithi081 sudo[63551]: pam_unix(sudo:session): session closed for user root 2024-04-23T14:42:39.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:39 smithi081 sudo[63555]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-23T14:42:39.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:39 smithi081 sudo[63555]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-23T14:42:39.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:39 smithi081 sudo[63555]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-23T14:42:39.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:39 smithi081 sudo[63555]: pam_unix(sudo:session): session closed for user root 2024-04-23T14:42:40.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:39 smithi081 sudo[63558]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-23T14:42:40.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:39 smithi081 sudo[63558]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-23T14:42:40.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:39 smithi081 sudo[63558]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-23T14:42:40.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:39 smithi081 sudo[63558]: pam_unix(sudo:session): session closed for user root 2024-04-23T14:42:40.436 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:40 smithi156 sudo[35638]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-23T14:42:40.436 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:40 smithi156 sudo[35638]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-23T14:42:40.436 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:40 smithi156 sudo[35638]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-23T14:42:40.436 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:40 smithi156 sudo[35638]: pam_unix(sudo:session): session closed for user root 2024-04-23T14:42:41.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:40 smithi156 sudo[35656]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-23T14:42:41.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:40 smithi156 sudo[35656]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-23T14:42:41.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:40 smithi156 sudo[35656]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-23T14:42:41.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:40 smithi156 sudo[35656]: pam_unix(sudo:session): session closed for user root 2024-04-23T14:42:41.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:40 smithi156 ceph-mon[32341]: from='client.24131 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:42:41.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:40 smithi156 ceph-mon[32341]: pgmap v99: 1 pgs: 1 active+clean; 449 KiB data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-23T14:42:41.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:40 smithi156 ceph-mon[32341]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-23T14:42:41.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:40 smithi156 ceph-mon[32341]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-23T14:42:41.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:40 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi081"}]: dispatch 2024-04-23T14:42:41.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:40 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2024-04-23T14:42:41.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:40 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:41.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:40 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi081"}]: dispatch 2024-04-23T14:42:41.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:40 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2024-04-23T14:42:41.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:40 smithi081 ceph-mon[25540]: from='client.24131 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:42:41.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:40 smithi081 ceph-mon[25540]: pgmap v99: 1 pgs: 1 active+clean; 449 KiB data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-23T14:42:41.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:40 smithi081 ceph-mon[25540]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-23T14:42:41.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:40 smithi081 ceph-mon[25540]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-23T14:42:41.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:40 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi081"}]: dispatch 2024-04-23T14:42:41.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:40 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2024-04-23T14:42:41.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:40 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:41.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:40 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi081"}]: dispatch 2024-04-23T14:42:41.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:40 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2024-04-23T14:42:42.252 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:41 smithi081 ceph-mon[25540]: Detected new or changed devices on smithi081 2024-04-23T14:42:42.252 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:41 smithi081 ceph-mon[25540]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-23T14:42:42.252 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:41 smithi081 ceph-mon[25540]: pgmap v100: 1 pgs: 1 active+clean; 449 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-04-23T14:42:42.252 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:41 smithi081 ceph-mon[25540]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-23T14:42:42.252 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:41 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:42.252 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:41 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:42:42.252 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:41 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:42:42.252 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:41 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:42:42.253 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:41 smithi081 ceph-mon[25540]: Adjusting osd_memory_target on smithi081 to 4288M 2024-04-23T14:42:42.253 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:41 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:42.253 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:41 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:42:42.253 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:41 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:42:42.253 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:41 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:42.253 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:41 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:42.253 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:41 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:42:42.253 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:41 smithi081 ceph-mon[25540]: from='client.? 172.21.15.156:0/3543526714' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "722814fb-aeb5-4765-8440-05563f47c8ae"}]: dispatch 2024-04-23T14:42:42.253 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:41 smithi081 ceph-mon[25540]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "722814fb-aeb5-4765-8440-05563f47c8ae"}]: dispatch 2024-04-23T14:42:42.253 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:41 smithi081 ceph-mon[25540]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "722814fb-aeb5-4765-8440-05563f47c8ae"}]': finished 2024-04-23T14:42:42.253 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:41 smithi081 ceph-mon[25540]: osdmap e24: 4 total, 3 up, 4 in 2024-04-23T14:42:42.253 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:41 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T14:42:42.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:41 smithi156 ceph-mon[32341]: Detected new or changed devices on smithi081 2024-04-23T14:42:42.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:41 smithi156 ceph-mon[32341]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-23T14:42:42.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:41 smithi156 ceph-mon[32341]: pgmap v100: 1 pgs: 1 active+clean; 449 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-04-23T14:42:42.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:41 smithi156 ceph-mon[32341]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-23T14:42:42.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:41 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:42.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:41 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:42:42.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:41 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:42:42.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:41 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:42:42.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:41 smithi156 ceph-mon[32341]: Adjusting osd_memory_target on smithi081 to 4288M 2024-04-23T14:42:42.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:41 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:42.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:41 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:42:42.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:41 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:42:42.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:41 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:42.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:41 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:42.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:41 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:42:42.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:41 smithi156 ceph-mon[32341]: from='client.? 172.21.15.156:0/3543526714' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "722814fb-aeb5-4765-8440-05563f47c8ae"}]: dispatch 2024-04-23T14:42:42.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:41 smithi156 ceph-mon[32341]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "722814fb-aeb5-4765-8440-05563f47c8ae"}]: dispatch 2024-04-23T14:42:42.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:41 smithi156 ceph-mon[32341]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "722814fb-aeb5-4765-8440-05563f47c8ae"}]': finished 2024-04-23T14:42:42.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:41 smithi156 ceph-mon[32341]: osdmap e24: 4 total, 3 up, 4 in 2024-04-23T14:42:42.289 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:41 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T14:42:43.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:42 smithi156 ceph-mon[32341]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 87 KiB/s wr, 5 op/s 2024-04-23T14:42:43.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:42 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:42:43.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:42 smithi156 ceph-mon[32341]: from='client.? 172.21.15.156:0/4029112552' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:42:43.322 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:42 smithi081 ceph-mon[25540]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 87 KiB/s wr, 5 op/s 2024-04-23T14:42:43.322 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:42 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:42:43.322 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:42 smithi081 ceph-mon[25540]: from='client.? 172.21.15.156:0/4029112552' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:42:45.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:45 smithi081 ceph-mon[25540]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.1 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-04-23T14:42:45.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:45 smithi156 ceph-mon[32341]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.1 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-04-23T14:42:48.016 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:47 smithi156 ceph-mon[32341]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-04-23T14:42:48.016 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:47 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:48.016 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:47 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:48.016 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:47 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:42:48.016 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:47 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:42:48.016 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:47 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:48.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:47 smithi081 ceph-mon[25540]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-04-23T14:42:48.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:47 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:48.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:47 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:48.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:47 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:42:48.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:47 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:42:48.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:47 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:50.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:49 smithi156 ceph-mon[32341]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-04-23T14:42:50.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:49 smithi081 ceph-mon[25540]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-04-23T14:42:51.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:50 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-23T14:42:51.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:50 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:42:51.086 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:50 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-23T14:42:51.087 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:50 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:42:52.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:51 smithi081 ceph-mon[25540]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-04-23T14:42:52.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:51 smithi081 ceph-mon[25540]: Deploying daemon osd.3 on smithi156 2024-04-23T14:42:52.118 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:51 smithi156 ceph-mon[32341]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-04-23T14:42:52.119 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:51 smithi156 ceph-mon[32341]: Deploying daemon osd.3 on smithi156 2024-04-23T14:42:52.910 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:52 smithi156 ceph-mon[32341]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.7 KiB/s rd, 74 KiB/s wr, 5 op/s 2024-04-23T14:42:53.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:52 smithi081 ceph-mon[25540]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.7 KiB/s rd, 74 KiB/s wr, 5 op/s 2024-04-23T14:42:55.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:55 smithi156 ceph-mon[32341]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-04-23T14:42:55.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:55 smithi081 ceph-mon[25540]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-04-23T14:42:57.379 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:57 smithi081 ceph-mon[25540]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-04-23T14:42:57.379 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:57 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:42:57.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:57 smithi156 ceph-mon[32341]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-04-23T14:42:57.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:57 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:42:59.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:59 smithi081 ceph-mon[25540]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-23T14:42:59.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:59 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:59.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:59 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:59.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:42:59 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:42:59.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:59 smithi156 ceph-mon[32341]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-23T14:42:59.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:59 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:59.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:59 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:42:59.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:42:59 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:43:01.447 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:01 smithi156 ceph-mon[32341]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-23T14:43:01.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:01 smithi081 ceph-mon[25540]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-23T14:43:02.282 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:02 smithi156 ceph-mon[32341]: from='osd.3 [v2:172.21.15.156:6800/2727527147,v1:172.21.15.156:6801/2727527147]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-23T14:43:02.282 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:02 smithi156 ceph-mon[32341]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-23T14:43:02.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:02 smithi081 ceph-mon[25540]: from='osd.3 [v2:172.21.15.156:6800/2727527147,v1:172.21.15.156:6801/2727527147]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-23T14:43:02.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:02 smithi081 ceph-mon[25540]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-23T14:43:02.768 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:02.766+0000 7f17aea00700 1 -- 172.21.15.156:0/1509597185 <== mgr.14210 v2:172.21.15.81:6800/1053506915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f17b805f5f0 con 0x7f179c0692b0 2024-04-23T14:43:02.768 INFO:teuthology.orchestra.run.smithi156.stdout:Created osd(s) 3 on host 'smithi156' 2024-04-23T14:43:02.770 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:02.769+0000 7f17bd400700 1 -- 172.21.15.156:0/1509597185 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f179c0692b0 msgr2=0x7f179c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:43:02.771 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:02.769+0000 7f17bd400700 1 --2- 172.21.15.156:0/1509597185 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f179c0692b0 0x7f179c06b760 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f17a8009fd0 tx=0x7f17a8009f00 comp rx=0 tx=0).stop 2024-04-23T14:43:02.771 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:02.769+0000 7f17bd400700 1 -- 172.21.15.156:0/1509597185 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17b81023d0 msgr2=0x7f17b8110170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:43:02.771 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:02.769+0000 7f17bd400700 1 --2- 172.21.15.156:0/1509597185 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17b81023d0 0x7f17b8110170 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f17a400b3b0 tx=0x7f17a4009e30 comp rx=0 tx=0).stop 2024-04-23T14:43:02.771 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:02.769+0000 7f17bd400700 1 -- 172.21.15.156:0/1509597185 shutdown_connections 2024-04-23T14:43:02.771 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:02.769+0000 7f17bd400700 1 --2- 172.21.15.156:0/1509597185 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f179c0692b0 0x7f179c06b760 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:43:02.771 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:02.769+0000 7f17bd400700 1 --2- 172.21.15.156:0/1509597185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17b8066290 0x7f17b810fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:43:02.771 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:02.769+0000 7f17bd400700 1 --2- 172.21.15.156:0/1509597185 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17b81023d0 0x7f17b8110170 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:43:02.771 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:02.769+0000 7f17bd400700 1 -- 172.21.15.156:0/1509597185 >> 172.21.15.156:0/1509597185 conn(0x7f17b80f74c0 msgr2=0x7f17b80f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:43:02.771 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:02.769+0000 7f17bd400700 1 -- 172.21.15.156:0/1509597185 shutdown_connections 2024-04-23T14:43:02.771 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:02.770+0000 7f17bd400700 1 -- 172.21.15.156:0/1509597185 wait complete. 2024-04-23T14:43:03.476 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:03 smithi156 ceph-mon[32341]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-23T14:43:03.476 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:03 smithi156 ceph-mon[32341]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-23T14:43:03.476 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:03 smithi156 ceph-mon[32341]: osdmap e25: 4 total, 3 up, 4 in 2024-04-23T14:43:03.476 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:03 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T14:43:03.476 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:03 smithi156 ceph-mon[32341]: from='osd.3 [v2:172.21.15.156:6800/2727527147,v1:172.21.15.156:6801/2727527147]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-23T14:43:03.476 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:03 smithi156 ceph-mon[32341]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-23T14:43:03.476 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:03 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:43:03.476 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:03 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:43:03.476 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:03 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:43:03.476 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:03 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:43:03.548 DEBUG:teuthology.orchestra.run.smithi156:osd.3> sudo journalctl -f -n 0 -u ceph-7a641bea-017e-11ef-bc93-c7b262605968@osd.3.service 2024-04-23T14:43:03.554 INFO:tasks.cephadm:Deploying osd.4 on smithi156 with /dev/vg_nvme/lv_3... 2024-04-23T14:43:03.554 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-23T14:43:03.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:03 smithi081 ceph-mon[25540]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-23T14:43:03.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:03 smithi081 ceph-mon[25540]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-23T14:43:03.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:03 smithi081 ceph-mon[25540]: osdmap e25: 4 total, 3 up, 4 in 2024-04-23T14:43:03.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:03 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T14:43:03.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:03 smithi081 ceph-mon[25540]: from='osd.3 [v2:172.21.15.156:6800/2727527147,v1:172.21.15.156:6801/2727527147]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-23T14:43:03.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:03 smithi081 ceph-mon[25540]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-23T14:43:03.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:03 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:43:03.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:03 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:43:03.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:03 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:43:03.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:03 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:43:04.524 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi156/config 2024-04-23T14:43:04.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:04 smithi156 ceph-mon[32341]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2024-04-23T14:43:04.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:04 smithi156 ceph-mon[32341]: osdmap e26: 4 total, 3 up, 4 in 2024-04-23T14:43:04.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:04 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T14:43:04.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:04 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T14:43:04.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:04 smithi081 ceph-mon[25540]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2024-04-23T14:43:04.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:04 smithi081 ceph-mon[25540]: osdmap e26: 4 total, 3 up, 4 in 2024-04-23T14:43:04.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:04 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T14:43:04.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:04 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T14:43:05.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:05 smithi156 ceph-mon[32341]: purged_snaps scrub starts 2024-04-23T14:43:05.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:05 smithi156 ceph-mon[32341]: purged_snaps scrub ok 2024-04-23T14:43:05.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:05 smithi156 ceph-mon[32341]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-23T14:43:05.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:05 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T14:43:05.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:05 smithi156 ceph-mon[32341]: osd.3 [v2:172.21.15.156:6800/2727527147,v1:172.21.15.156:6801/2727527147] boot 2024-04-23T14:43:05.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:05 smithi156 ceph-mon[32341]: osdmap e27: 4 total, 4 up, 4 in 2024-04-23T14:43:05.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:05 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T14:43:05.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:05 smithi081 ceph-mon[25540]: purged_snaps scrub starts 2024-04-23T14:43:05.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:05 smithi081 ceph-mon[25540]: purged_snaps scrub ok 2024-04-23T14:43:05.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:05 smithi081 ceph-mon[25540]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-23T14:43:05.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:05 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T14:43:05.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:05 smithi081 ceph-mon[25540]: osd.3 [v2:172.21.15.156:6800/2727527147,v1:172.21.15.156:6801/2727527147] boot 2024-04-23T14:43:05.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:05 smithi081 ceph-mon[25540]: osdmap e27: 4 total, 4 up, 4 in 2024-04-23T14:43:05.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:05 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T14:43:06.441 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:06 smithi156 ceph-mon[32341]: osdmap e28: 4 total, 4 up, 4 in 2024-04-23T14:43:06.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:06 smithi081 ceph-mon[25540]: osdmap e28: 4 total, 4 up, 4 in 2024-04-23T14:43:07.346 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:07 smithi156 ceph-mon[32341]: pgmap v118: 1 pgs: 1 remapped+peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-23T14:43:07.346 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:07 smithi156 ceph-mon[32341]: osdmap e29: 4 total, 4 up, 4 in 2024-04-23T14:43:07.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:07 smithi081 ceph-mon[25540]: pgmap v118: 1 pgs: 1 remapped+peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-23T14:43:07.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:07 smithi081 ceph-mon[25540]: osdmap e29: 4 total, 4 up, 4 in 2024-04-23T14:43:08.036 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-23T14:43:08.036 INFO:teuthology.orchestra.run.smithi156.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-23T14:43:08.037 INFO:teuthology.orchestra.run.smithi156.stderr: stderr: 10+0 records in 2024-04-23T14:43:08.037 INFO:teuthology.orchestra.run.smithi156.stderr:10+0 records out 2024-04-23T14:43:08.037 INFO:teuthology.orchestra.run.smithi156.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.036345 s, 289 MB/s 2024-04-23T14:43:08.037 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping successful for: 2024-04-23T14:43:08.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:08 smithi156 ceph-mon[32341]: osdmap e30: 4 total, 4 up, 4 in 2024-04-23T14:43:08.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:08 smithi156 ceph-mon[32341]: osdmap e31: 4 total, 4 up, 4 in 2024-04-23T14:43:08.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:08 smithi081 ceph-mon[25540]: osdmap e30: 4 total, 4 up, 4 in 2024-04-23T14:43:08.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:08 smithi081 ceph-mon[25540]: osdmap e31: 4 total, 4 up, 4 in 2024-04-23T14:43:08.979 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi156:vg_nvme/lv_3 2024-04-23T14:43:09.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:09 smithi156 ceph-mon[32341]: pgmap v121: 1 pgs: 1 remapped+peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-23T14:43:09.439 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:09 smithi081 ceph-mon[25540]: pgmap v121: 1 pgs: 1 remapped+peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-23T14:43:09.590 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi156/config 2024-04-23T14:43:10.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:10 smithi156 ceph-mon[32341]: Detected new or changed devices on smithi156 2024-04-23T14:43:10.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:10 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:43:10.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:10 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:43:10.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:10 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:43:10.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:10 smithi156 ceph-mon[32341]: Adjusting osd_memory_target on smithi156 to 15937M 2024-04-23T14:43:10.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:10 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:43:10.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:10 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:43:10.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:10 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:43:10.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:10 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:43:10.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:10 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:43:10.788 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:10 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:43:10.788 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:10 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:43:10.788 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:10 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:43:10.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:10 smithi081 ceph-mon[25540]: Detected new or changed devices on smithi156 2024-04-23T14:43:10.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:10 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:43:10.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:10 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:43:10.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:10 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:43:10.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:10 smithi081 ceph-mon[25540]: Adjusting osd_memory_target on smithi156 to 15937M 2024-04-23T14:43:10.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:10 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:43:10.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:10 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:43:10.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:10 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:43:10.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:10 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:43:10.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:10 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:43:10.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:10 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:43:10.828 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:10 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:43:10.828 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:10 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:43:11.676 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:11.675+0000 7f9a92400700 1 -- 172.21.15.156:0/53857760 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a8c0fffb0 msgr2=0x7f9a8c102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:43:11.676 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:11.675+0000 7f9a92400700 1 --2- 172.21.15.156:0/53857760 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a8c0fffb0 0x7f9a8c102390 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9a78004940 tx=0x7f9a78009e30 comp rx=0 tx=0).stop 2024-04-23T14:43:11.677 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:11.675+0000 7f9a92400700 1 -- 172.21.15.156:0/53857760 shutdown_connections 2024-04-23T14:43:11.677 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:11.675+0000 7f9a92400700 1 --2- 172.21.15.156:0/53857760 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a8c0fffb0 0x7f9a8c102390 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:43:11.677 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:11.675+0000 7f9a92400700 1 --2- 172.21.15.156:0/53857760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a8c066f00 0x7f9a8c0ffa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:43:11.677 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:11.675+0000 7f9a92400700 1 -- 172.21.15.156:0/53857760 >> 172.21.15.156:0/53857760 conn(0x7f9a8c0f7480 msgr2=0x7f9a8c0f98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:43:11.677 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:11.675+0000 7f9a92400700 1 -- 172.21.15.156:0/53857760 shutdown_connections 2024-04-23T14:43:11.677 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:11.675+0000 7f9a92400700 1 -- 172.21.15.156:0/53857760 wait complete. 2024-04-23T14:43:11.679 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:11.676+0000 7f9a92400700 1 Processor -- start 2024-04-23T14:43:11.679 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:11.676+0000 7f9a92400700 1 -- start start 2024-04-23T14:43:11.679 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:11.676+0000 7f9a92400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a8c066f00 0x7f9a8c0fd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:43:11.679 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:11.676+0000 7f9a92400700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a8c0fffb0 0x7f9a8c0fb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:43:11.679 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:11.676+0000 7f9a92400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8c0fd8c0 con 0x7f9a8c066f00 2024-04-23T14:43:11.679 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:11.676+0000 7f9a92400700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8c0fbeb0 con 0x7f9a8c0fffb0 2024-04-23T14:43:11.679 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:11.677+0000 7f9a8aa00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a8c0fffb0 0x7f9a8c0fb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:43:11.679 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:11.677+0000 7f9a8aa00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a8c0fffb0 0x7f9a8c0fb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:35750/0 (socket says 172.21.15.156:35750) 2024-04-23T14:43:11.679 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:11.677+0000 7f9a8aa00700 1 -- 172.21.15.156:0/3327883061 learned_addr learned my addr 172.21.15.156:0/3327883061 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-04-23T14:43:11.679 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:11.677+0000 7f9a8b400700 1 --2- 172.21.15.156:0/3327883061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a8c066f00 0x7f9a8c0fd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:43:11.680 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:11.677+0000 7f9a8aa00700 1 -- 172.21.15.156:0/3327883061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a8c066f00 msgr2=0x7f9a8c0fd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:43:11.680 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:11.677+0000 7f9a8aa00700 1 --2- 172.21.15.156:0/3327883061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a8c066f00 0x7f9a8c0fd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:43:11.680 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:11.677+0000 7f9a8aa00700 1 -- 172.21.15.156:0/3327883061 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a78005040 con 0x7f9a8c0fffb0 2024-04-23T14:43:11.680 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:11.677+0000 7f9a8aa00700 1 --2- 172.21.15.156:0/3327883061 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a8c0fffb0 0x7f9a8c0fb970 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9a7800b3b0 tx=0x7f9a78009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:43:11.680 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:11.678+0000 7f9a83400700 1 -- 172.21.15.156:0/3327883061 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a7800e040 con 0x7f9a8c0fffb0 2024-04-23T14:43:11.680 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:11.678+0000 7f9a83400700 1 -- 172.21.15.156:0/3327883061 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9a78004290 con 0x7f9a8c0fffb0 2024-04-23T14:43:11.680 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:11.678+0000 7f9a83400700 1 -- 172.21.15.156:0/3327883061 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a7801c630 con 0x7f9a8c0fffb0 2024-04-23T14:43:11.680 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:11.678+0000 7f9a92400700 1 -- 172.21.15.156:0/3327883061 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a8c0fc100 con 0x7f9a8c0fffb0 2024-04-23T14:43:11.680 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:11.678+0000 7f9a92400700 1 -- 172.21.15.156:0/3327883061 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a8c0fc670 con 0x7f9a8c0fffb0 2024-04-23T14:43:11.680 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:11.679+0000 7f9a92400700 1 -- 172.21.15.156:0/3327883061 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a8c04c710 con 0x7f9a8c0fffb0 2024-04-23T14:43:11.681 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:11.680+0000 7f9a83400700 1 -- 172.21.15.156:0/3327883061 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f9a7800bbf0 con 0x7f9a8c0fffb0 2024-04-23T14:43:11.682 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:11.681+0000 7f9a83400700 1 --2- 172.21.15.156:0/3327883061 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f9a700692a0 0x7f9a7006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:43:11.682 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:11.681+0000 7f9a83400700 1 -- 172.21.15.156:0/3327883061 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 3770+0+0 (secure 0 0 0) 0x7f9a78087f50 con 0x7f9a8c0fffb0 2024-04-23T14:43:11.682 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:11.682+0000 7f9a8b400700 1 --2- 172.21.15.156:0/3327883061 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f9a700692a0 0x7f9a7006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:43:11.683 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:11.683+0000 7f9a8b400700 1 --2- 172.21.15.156:0/3327883061 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f9a700692a0 0x7f9a7006b750 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c007fd0 tx=0x7f9a7c009040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:43:11.687 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:11.686+0000 7f9a83400700 1 -- 172.21.15.156:0/3327883061 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f9a780ba250 con 0x7f9a8c0fffb0 2024-04-23T14:43:11.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:11 smithi156 ceph-mon[32341]: pgmap v123: 1 pgs: 1 remapped+peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-23T14:43:11.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:11 smithi081 ceph-mon[25540]: pgmap v123: 1 pgs: 1 remapped+peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-23T14:43:11.912 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:11.910+0000 7f9a92400700 1 -- 172.21.15.156:0/3327883061 --> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a8c101c00 con 0x7f9a700692a0 2024-04-23T14:43:12.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:12 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:43:12.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:12 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:43:12.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:12 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:43:12.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:12 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:43:12.866 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:12 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:43:12.867 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:12 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:43:12.867 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:12 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:43:12.867 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:12 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:43:13.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:13 smithi156 ceph-mon[32341]: from='client.24151 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:43:13.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:13 smithi156 ceph-mon[32341]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-23T14:43:13.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:13 smithi081 ceph-mon[25540]: from='client.24151 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:43:13.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:13 smithi081 ceph-mon[25540]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-23T14:43:15.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:15 smithi081 ceph-mon[25540]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-04-23T14:43:16.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:15 smithi156 ceph-mon[32341]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-04-23T14:43:16.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:16 smithi081 ceph-mon[25540]: from='client.? 172.21.15.156:0/4110673485' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f660c6e-38d1-4982-9cba-46242bf2de6f"}]: dispatch 2024-04-23T14:43:16.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:16 smithi081 ceph-mon[25540]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f660c6e-38d1-4982-9cba-46242bf2de6f"}]: dispatch 2024-04-23T14:43:16.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:16 smithi081 ceph-mon[25540]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2f660c6e-38d1-4982-9cba-46242bf2de6f"}]': finished 2024-04-23T14:43:16.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:16 smithi081 ceph-mon[25540]: osdmap e32: 5 total, 4 up, 5 in 2024-04-23T14:43:16.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:16 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T14:43:16.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:16 smithi081 ceph-mon[25540]: from='client.? 172.21.15.156:0/2648821723' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:43:17.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:16 smithi156 ceph-mon[32341]: from='client.? 172.21.15.156:0/4110673485' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f660c6e-38d1-4982-9cba-46242bf2de6f"}]: dispatch 2024-04-23T14:43:17.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:16 smithi156 ceph-mon[32341]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f660c6e-38d1-4982-9cba-46242bf2de6f"}]: dispatch 2024-04-23T14:43:17.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:16 smithi156 ceph-mon[32341]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2f660c6e-38d1-4982-9cba-46242bf2de6f"}]': finished 2024-04-23T14:43:17.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:16 smithi156 ceph-mon[32341]: osdmap e32: 5 total, 4 up, 5 in 2024-04-23T14:43:17.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:16 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T14:43:17.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:16 smithi156 ceph-mon[32341]: from='client.? 172.21.15.156:0/2648821723' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:43:18.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:17 smithi156 ceph-mon[32341]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-23T14:43:18.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:17 smithi081 ceph-mon[25540]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-23T14:43:19.913 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:19 smithi156 ceph-mon[32341]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-23T14:43:20.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:19 smithi081 ceph-mon[25540]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-23T14:43:21.712 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:21 smithi156 ceph-mon[32341]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-23T14:43:22.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:21 smithi081 ceph-mon[25540]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-23T14:43:24.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:23 smithi156 ceph-mon[32341]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-23T14:43:24.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:23 smithi081 ceph-mon[25540]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-23T14:43:24.789 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:24 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-23T14:43:24.789 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:24 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:43:25.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:24 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-23T14:43:25.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:24 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:43:26.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:25 smithi156 ceph-mon[32341]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-23T14:43:26.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:25 smithi156 ceph-mon[32341]: Deploying daemon osd.4 on smithi156 2024-04-23T14:43:26.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:25 smithi081 ceph-mon[25540]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-23T14:43:26.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:25 smithi081 ceph-mon[25540]: Deploying daemon osd.4 on smithi156 2024-04-23T14:43:27.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:27 smithi156 ceph-mon[32341]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-23T14:43:27.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:27 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:43:27.880 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:27 smithi081 ceph-mon[25540]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-23T14:43:27.880 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:27 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:43:29.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:29 smithi081 ceph-mon[25540]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-23T14:43:29.890 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:29 smithi156 ceph-mon[32341]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-23T14:43:31.766 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:31 smithi156 ceph-mon[32341]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-23T14:43:32.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:31 smithi081 ceph-mon[25540]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-23T14:43:33.406 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:33 smithi156 ceph-mon[32341]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-23T14:43:33.407 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:33 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:43:33.407 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:33 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:43:33.407 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:33 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:43:33.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:33 smithi081 ceph-mon[25540]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-23T14:43:33.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:33 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:43:33.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:33 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:43:33.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:33 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:43:35.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:35 smithi156 ceph-mon[32341]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-23T14:43:35.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:35 smithi081 ceph-mon[25540]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-23T14:43:36.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:36 smithi156 ceph-mon[32341]: from='osd.4 [v2:172.21.15.156:6808/821376629,v1:172.21.15.156:6809/821376629]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-23T14:43:36.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:36 smithi156 ceph-mon[32341]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-23T14:43:36.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:36 smithi081 ceph-mon[25540]: from='osd.4 [v2:172.21.15.156:6808/821376629,v1:172.21.15.156:6809/821376629]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-23T14:43:36.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:36 smithi081 ceph-mon[25540]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-23T14:43:37.496 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:37 smithi156 ceph-mon[32341]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-23T14:43:37.496 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:37 smithi156 ceph-mon[32341]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-23T14:43:37.496 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:37 smithi156 ceph-mon[32341]: osdmap e33: 5 total, 4 up, 5 in 2024-04-23T14:43:37.496 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:37 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T14:43:37.496 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:37 smithi156 ceph-mon[32341]: from='osd.4 [v2:172.21.15.156:6808/821376629,v1:172.21.15.156:6809/821376629]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-23T14:43:37.496 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:37 smithi156 ceph-mon[32341]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-23T14:43:37.497 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:37 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:43:37.497 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:37 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:43:37.635 INFO:teuthology.orchestra.run.smithi156.stdout:Created osd(s) 4 on host 'smithi156' 2024-04-23T14:43:37.636 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:37.633+0000 7f9a83400700 1 -- 172.21.15.156:0/3327883061 <== mgr.14210 v2:172.21.15.81:6800/1053506915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9a8c101c00 con 0x7f9a700692a0 2024-04-23T14:43:37.638 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:37.637+0000 7f9a92400700 1 -- 172.21.15.156:0/3327883061 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f9a700692a0 msgr2=0x7f9a7006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:43:37.638 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:37.637+0000 7f9a92400700 1 --2- 172.21.15.156:0/3327883061 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f9a700692a0 0x7f9a7006b750 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c007fd0 tx=0x7f9a7c009040 comp rx=0 tx=0).stop 2024-04-23T14:43:37.638 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:37.637+0000 7f9a92400700 1 -- 172.21.15.156:0/3327883061 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a8c0fffb0 msgr2=0x7f9a8c0fb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:43:37.639 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:37.637+0000 7f9a92400700 1 --2- 172.21.15.156:0/3327883061 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a8c0fffb0 0x7f9a8c0fb970 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9a7800b3b0 tx=0x7f9a78009e30 comp rx=0 tx=0).stop 2024-04-23T14:43:37.639 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:37.637+0000 7f9a92400700 1 -- 172.21.15.156:0/3327883061 shutdown_connections 2024-04-23T14:43:37.639 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:37.637+0000 7f9a92400700 1 --2- 172.21.15.156:0/3327883061 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f9a700692a0 0x7f9a7006b750 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:43:37.639 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:37.637+0000 7f9a92400700 1 --2- 172.21.15.156:0/3327883061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a8c066f00 0x7f9a8c0fd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:43:37.639 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:37.637+0000 7f9a92400700 1 --2- 172.21.15.156:0/3327883061 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a8c0fffb0 0x7f9a8c0fb970 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:43:37.639 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:37.637+0000 7f9a92400700 1 -- 172.21.15.156:0/3327883061 >> 172.21.15.156:0/3327883061 conn(0x7f9a8c0f7480 msgr2=0x7f9a8c0f98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:43:37.639 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:37.637+0000 7f9a92400700 1 -- 172.21.15.156:0/3327883061 shutdown_connections 2024-04-23T14:43:37.639 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:37.637+0000 7f9a92400700 1 -- 172.21.15.156:0/3327883061 wait complete. 2024-04-23T14:43:37.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:37 smithi081 ceph-mon[25540]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-23T14:43:37.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:37 smithi081 ceph-mon[25540]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-23T14:43:37.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:37 smithi081 ceph-mon[25540]: osdmap e33: 5 total, 4 up, 5 in 2024-04-23T14:43:37.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:37 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T14:43:37.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:37 smithi081 ceph-mon[25540]: from='osd.4 [v2:172.21.15.156:6808/821376629,v1:172.21.15.156:6809/821376629]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-23T14:43:37.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:37 smithi081 ceph-mon[25540]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-23T14:43:37.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:37 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:43:37.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:37 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:43:38.462 DEBUG:teuthology.orchestra.run.smithi156:osd.4> sudo journalctl -f -n 0 -u ceph-7a641bea-017e-11ef-bc93-c7b262605968@osd.4.service 2024-04-23T14:43:38.467 INFO:tasks.cephadm:Deploying osd.5 on smithi156 with /dev/vg_nvme/lv_2... 2024-04-23T14:43:38.467 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-23T14:43:38.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:38 smithi081 ceph-mon[25540]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2024-04-23T14:43:38.578 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:38 smithi081 ceph-mon[25540]: osdmap e34: 5 total, 4 up, 5 in 2024-04-23T14:43:38.578 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:38 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T14:43:38.578 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:38 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T14:43:38.578 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:38 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:43:38.578 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:38 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:43:38.578 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:38 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:43:38.578 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:38 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:43:38.578 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:38 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:43:38.578 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:38 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:43:38.578 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:38 smithi081 ceph-mon[25540]: osd.4 [v2:172.21.15.156:6808/821376629,v1:172.21.15.156:6809/821376629] boot 2024-04-23T14:43:38.578 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:38 smithi081 ceph-mon[25540]: osdmap e35: 5 total, 5 up, 5 in 2024-04-23T14:43:38.578 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:38 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T14:43:38.717 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:38 smithi156 ceph-mon[32341]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2024-04-23T14:43:38.718 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:38 smithi156 ceph-mon[32341]: osdmap e34: 5 total, 4 up, 5 in 2024-04-23T14:43:38.718 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:38 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T14:43:38.718 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:38 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T14:43:38.718 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:38 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:43:38.718 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:38 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:43:38.718 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:38 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:43:38.718 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:38 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:43:38.718 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:38 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:43:38.718 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:38 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:43:38.718 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:38 smithi156 ceph-mon[32341]: osd.4 [v2:172.21.15.156:6808/821376629,v1:172.21.15.156:6809/821376629] boot 2024-04-23T14:43:38.719 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:38 smithi156 ceph-mon[32341]: osdmap e35: 5 total, 5 up, 5 in 2024-04-23T14:43:38.719 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:38 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T14:43:39.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:39 smithi156 ceph-mon[32341]: purged_snaps scrub starts 2024-04-23T14:43:39.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:39 smithi156 ceph-mon[32341]: purged_snaps scrub ok 2024-04-23T14:43:39.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:39 smithi156 ceph-mon[32341]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-23T14:43:39.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:39 smithi081 ceph-mon[25540]: purged_snaps scrub starts 2024-04-23T14:43:39.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:39 smithi081 ceph-mon[25540]: purged_snaps scrub ok 2024-04-23T14:43:39.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:39 smithi081 ceph-mon[25540]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-23T14:43:39.872 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi156/config 2024-04-23T14:43:40.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:40 smithi156 ceph-mon[32341]: osdmap e36: 5 total, 5 up, 5 in 2024-04-23T14:43:41.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:40 smithi081 ceph-mon[25540]: osdmap e36: 5 total, 5 up, 5 in 2024-04-23T14:43:41.859 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:41 smithi156 ceph-mon[32341]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-23T14:43:42.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:41 smithi081 ceph-mon[25540]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-23T14:43:42.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:42 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:43:43.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:42 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:43:43.078 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-23T14:43:43.078 INFO:teuthology.orchestra.run.smithi156.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-23T14:43:43.078 INFO:teuthology.orchestra.run.smithi156.stderr: stderr: 10+0 records in 2024-04-23T14:43:43.078 INFO:teuthology.orchestra.run.smithi156.stderr:10+0 records out 2024-04-23T14:43:43.079 INFO:teuthology.orchestra.run.smithi156.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.03382 s, 310 MB/s 2024-04-23T14:43:43.079 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping successful for: 2024-04-23T14:43:43.875 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:43 smithi156 ceph-mon[32341]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-23T14:43:43.875 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:43 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:43:43.875 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:43 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:43:43.875 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:43 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:43:43.875 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:43 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:43:43.875 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:43 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:43:43.876 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:43 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:43:43.876 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:43 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:43:43.876 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:43 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:43:43.956 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi156:vg_nvme/lv_2 2024-04-23T14:43:44.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:43 smithi081 ceph-mon[25540]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-23T14:43:44.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:43 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:43:44.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:43 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:43:44.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:43 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:43:44.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:43 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:43:44.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:43 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:43:44.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:43 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:43:44.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:43 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:43:44.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:43 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:43:44.412 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi156/config 2024-04-23T14:43:44.862 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:44 smithi156 ceph-mon[32341]: Detected new or changed devices on smithi156 2024-04-23T14:43:44.862 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:44 smithi156 ceph-mon[32341]: Adjusting osd_memory_target on smithi156 to 7968M 2024-04-23T14:43:45.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:44 smithi081 ceph-mon[25540]: Detected new or changed devices on smithi156 2024-04-23T14:43:45.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:44 smithi081 ceph-mon[25540]: Adjusting osd_memory_target on smithi156 to 7968M 2024-04-23T14:43:46.023 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:45 smithi156 ceph-mon[32341]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-23T14:43:46.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:45 smithi081 ceph-mon[25540]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-23T14:43:46.525 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:46.522+0000 7febf3400700 1 -- 172.21.15.156:0/2569201904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febec066f60 msgr2=0x7febec0ff9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:43:46.525 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:46.522+0000 7febf3400700 1 --2- 172.21.15.156:0/2569201904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febec066f60 0x7febec0ff9e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7febdc004940 tx=0x7febdc009e30 comp rx=0 tx=0).stop 2024-04-23T14:43:46.525 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:46.522+0000 7febf3400700 1 -- 172.21.15.156:0/2569201904 shutdown_connections 2024-04-23T14:43:46.525 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:46.522+0000 7febf3400700 1 --2- 172.21.15.156:0/2569201904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febec0fff20 0x7febec102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:43:46.525 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:46.522+0000 7febf3400700 1 --2- 172.21.15.156:0/2569201904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febec066f60 0x7febec0ff9e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:43:46.526 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:46.522+0000 7febf3400700 1 -- 172.21.15.156:0/2569201904 >> 172.21.15.156:0/2569201904 conn(0x7febec0f7450 msgr2=0x7febec0f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:43:46.526 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:46.523+0000 7febf3400700 1 -- 172.21.15.156:0/2569201904 shutdown_connections 2024-04-23T14:43:46.526 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:46.523+0000 7febf3400700 1 -- 172.21.15.156:0/2569201904 wait complete. 2024-04-23T14:43:46.526 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:46.523+0000 7febf3400700 1 Processor -- start 2024-04-23T14:43:46.526 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:46.524+0000 7febf3400700 1 -- start start 2024-04-23T14:43:46.526 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:46.524+0000 7febf3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febec066f60 0x7febec10fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:43:46.526 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:46.524+0000 7febf3400700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febec0fff20 0x7febec110400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:43:46.526 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:46.524+0000 7febf3400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febec110a00 con 0x7febec066f60 2024-04-23T14:43:46.526 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:46.524+0000 7febf3400700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febec110b70 con 0x7febec0fff20 2024-04-23T14:43:46.526 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:46.524+0000 7febe3e00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febec0fff20 0x7febec110400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:43:46.526 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:46.524+0000 7febe3e00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febec0fff20 0x7febec110400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:42150/0 (socket says 172.21.15.156:42150) 2024-04-23T14:43:46.526 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:46.524+0000 7febe3e00700 1 -- 172.21.15.156:0/358147822 learned_addr learned my addr 172.21.15.156:0/358147822 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-04-23T14:43:46.527 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:46.525+0000 7febf0a00700 1 --2- 172.21.15.156:0/358147822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febec066f60 0x7febec10fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:43:46.527 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:46.525+0000 7febe3e00700 1 -- 172.21.15.156:0/358147822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febec066f60 msgr2=0x7febec10fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:43:46.528 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:46.525+0000 7febe3e00700 1 --2- 172.21.15.156:0/358147822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febec066f60 0x7febec10fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:43:46.528 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:46.525+0000 7febe3e00700 1 -- 172.21.15.156:0/358147822 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febdc005040 con 0x7febec0fff20 2024-04-23T14:43:46.528 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:46.525+0000 7febe3e00700 1 --2- 172.21.15.156:0/358147822 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febec0fff20 0x7febec110400 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7febd400c830 tx=0x7febd4004470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:43:46.528 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:46.525+0000 7febe9600700 1 -- 172.21.15.156:0/358147822 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febd400a760 con 0x7febec0fff20 2024-04-23T14:43:46.528 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:46.525+0000 7febe9600700 1 -- 172.21.15.156:0/358147822 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7febd400ad90 con 0x7febec0fff20 2024-04-23T14:43:46.528 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:46.525+0000 7febf3400700 1 -- 172.21.15.156:0/358147822 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febec1155d0 con 0x7febec0fff20 2024-04-23T14:43:46.528 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:46.525+0000 7febe9600700 1 -- 172.21.15.156:0/358147822 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febd40113a0 con 0x7febec0fff20 2024-04-23T14:43:46.528 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:46.526+0000 7febf3400700 1 -- 172.21.15.156:0/358147822 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febec115b90 con 0x7febec0fff20 2024-04-23T14:43:46.528 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:46.527+0000 7febf3400700 1 -- 172.21.15.156:0/358147822 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febec0f8fd0 con 0x7febec0fff20 2024-04-23T14:43:46.529 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:46.528+0000 7febe9600700 1 -- 172.21.15.156:0/358147822 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7febd4012400 con 0x7febec0fff20 2024-04-23T14:43:46.530 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:46.529+0000 7febe9600700 1 --2- 172.21.15.156:0/358147822 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7febd00692a0 0x7febd006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:43:46.530 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:46.529+0000 7febe9600700 1 -- 172.21.15.156:0/358147822 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4202+0+0 (secure 0 0 0) 0x7febd4086df0 con 0x7febec0fff20 2024-04-23T14:43:46.530 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:46.529+0000 7febf0a00700 1 --2- 172.21.15.156:0/358147822 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7febd00692a0 0x7febd006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:43:46.531 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:46.531+0000 7febf0a00700 1 --2- 172.21.15.156:0/358147822 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7febd00692a0 0x7febd006b750 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7febdc00b3b0 tx=0x7febdc009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:43:46.534 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:46.534+0000 7febe9600700 1 -- 172.21.15.156:0/358147822 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7febd4057000 con 0x7febec0fff20 2024-04-23T14:43:46.755 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:43:46.754+0000 7febf3400700 1 -- 172.21.15.156:0/358147822 --> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7febec105a90 con 0x7febd00692a0 2024-04-23T14:43:47.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:47 smithi156 ceph-mon[32341]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-23T14:43:47.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:47 smithi156 ceph-mon[32341]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:43:47.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:47 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:43:47.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:47 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:43:47.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:47 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:43:48.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:47 smithi081 ceph-mon[25540]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-23T14:43:48.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:47 smithi081 ceph-mon[25540]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:43:48.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:47 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T14:43:48.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:47 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T14:43:48.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:47 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:43:49.913 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:49 smithi156 ceph-mon[32341]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-23T14:43:50.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:49 smithi081 ceph-mon[25540]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-23T14:43:51.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:50 smithi156 ceph-mon[32341]: from='client.? 172.21.15.156:0/2121896817' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82590b0d-f1e5-4491-b341-8db75ce2ea50"}]: dispatch 2024-04-23T14:43:51.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:50 smithi156 ceph-mon[32341]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82590b0d-f1e5-4491-b341-8db75ce2ea50"}]: dispatch 2024-04-23T14:43:51.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:50 smithi156 ceph-mon[32341]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "82590b0d-f1e5-4491-b341-8db75ce2ea50"}]': finished 2024-04-23T14:43:51.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:50 smithi156 ceph-mon[32341]: osdmap e37: 6 total, 5 up, 6 in 2024-04-23T14:43:51.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:50 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T14:43:51.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:50 smithi081 ceph-mon[25540]: from='client.? 172.21.15.156:0/2121896817' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82590b0d-f1e5-4491-b341-8db75ce2ea50"}]: dispatch 2024-04-23T14:43:51.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:50 smithi081 ceph-mon[25540]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82590b0d-f1e5-4491-b341-8db75ce2ea50"}]: dispatch 2024-04-23T14:43:51.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:50 smithi081 ceph-mon[25540]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "82590b0d-f1e5-4491-b341-8db75ce2ea50"}]': finished 2024-04-23T14:43:51.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:50 smithi081 ceph-mon[25540]: osdmap e37: 6 total, 5 up, 6 in 2024-04-23T14:43:51.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:50 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T14:43:52.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:51 smithi156 ceph-mon[32341]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-23T14:43:52.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:51 smithi156 ceph-mon[32341]: from='client.? 172.21.15.156:0/1245368628' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:43:52.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:51 smithi081 ceph-mon[25540]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-23T14:43:52.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:51 smithi081 ceph-mon[25540]: from='client.? 172.21.15.156:0/1245368628' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T14:43:54.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:53 smithi156 ceph-mon[32341]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-23T14:43:54.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:53 smithi081 ceph-mon[25540]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-23T14:43:56.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:55 smithi156 ceph-mon[32341]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-23T14:43:56.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:55 smithi081 ceph-mon[25540]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-23T14:43:57.945 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:57 smithi156 ceph-mon[32341]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-23T14:43:58.071 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:57 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:43:58.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:57 smithi081 ceph-mon[25540]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-23T14:43:58.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:57 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:44:00.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:59 smithi156 ceph-mon[32341]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-23T14:44:00.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:59 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-23T14:44:00.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:43:59 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:44:00.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:59 smithi081 ceph-mon[25540]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-23T14:44:00.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:59 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-23T14:44:00.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:43:59 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:44:00.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:00 smithi156 ceph-mon[32341]: Deploying daemon osd.5 on smithi156 2024-04-23T14:44:01.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:00 smithi081 ceph-mon[25540]: Deploying daemon osd.5 on smithi156 2024-04-23T14:44:02.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:01 smithi156 ceph-mon[32341]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-23T14:44:02.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:01 smithi081 ceph-mon[25540]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-23T14:44:03.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:03 smithi156 ceph-mon[32341]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-23T14:44:04.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:03 smithi081 ceph-mon[25540]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-23T14:44:05.994 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:05 smithi156 ceph-mon[32341]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-23T14:44:06.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:05 smithi081 ceph-mon[25540]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-23T14:44:08.022 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:07 smithi156 ceph-mon[32341]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-23T14:44:08.022 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:07 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:44:08.022 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:07 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:44:08.022 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:07 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:44:08.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:07 smithi081 ceph-mon[25540]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-23T14:44:08.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:07 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:44:08.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:07 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:44:08.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:07 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:44:10.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:09 smithi156 ceph-mon[32341]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-23T14:44:10.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:09 smithi081 ceph-mon[25540]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-23T14:44:12.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:11 smithi156 ceph-mon[32341]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-23T14:44:12.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:11 smithi156 ceph-mon[32341]: from='osd.5 [v2:172.21.15.156:6816/4222896396,v1:172.21.15.156:6817/4222896396]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-23T14:44:12.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:11 smithi156 ceph-mon[32341]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-23T14:44:12.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:11 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:44:12.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:11 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:44:12.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:11 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:44:12.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:11 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:44:12.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:11 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:44:12.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:11 smithi081 ceph-mon[25540]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-23T14:44:12.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:11 smithi081 ceph-mon[25540]: from='osd.5 [v2:172.21.15.156:6816/4222896396,v1:172.21.15.156:6817/4222896396]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-23T14:44:12.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:11 smithi081 ceph-mon[25540]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-23T14:44:12.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:11 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:44:12.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:11 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:44:12.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:11 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:44:12.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:11 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:44:12.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:11 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:44:12.661 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:12.660+0000 7febe9600700 1 -- 172.21.15.156:0/358147822 <== mgr.14210 v2:172.21.15.81:6800/1053506915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7febec105a90 con 0x7febd00692a0 2024-04-23T14:44:12.662 INFO:teuthology.orchestra.run.smithi156.stdout:Created osd(s) 5 on host 'smithi156' 2024-04-23T14:44:12.665 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:12.664+0000 7febf3400700 1 -- 172.21.15.156:0/358147822 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7febd00692a0 msgr2=0x7febd006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:12.665 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:12.664+0000 7febf3400700 1 --2- 172.21.15.156:0/358147822 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7febd00692a0 0x7febd006b750 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7febdc00b3b0 tx=0x7febdc009e30 comp rx=0 tx=0).stop 2024-04-23T14:44:12.666 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:12.664+0000 7febf3400700 1 -- 172.21.15.156:0/358147822 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febec0fff20 msgr2=0x7febec110400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:12.666 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:12.664+0000 7febf3400700 1 --2- 172.21.15.156:0/358147822 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febec0fff20 0x7febec110400 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7febd400c830 tx=0x7febd4004470 comp rx=0 tx=0).stop 2024-04-23T14:44:12.666 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:12.664+0000 7febf3400700 1 -- 172.21.15.156:0/358147822 shutdown_connections 2024-04-23T14:44:12.666 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:12.664+0000 7febf3400700 1 --2- 172.21.15.156:0/358147822 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7febd00692a0 0x7febd006b750 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:12.666 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:12.664+0000 7febf3400700 1 --2- 172.21.15.156:0/358147822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febec066f60 0x7febec10fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:12.666 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:12.664+0000 7febf3400700 1 --2- 172.21.15.156:0/358147822 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febec0fff20 0x7febec110400 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:12.666 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:12.664+0000 7febf3400700 1 -- 172.21.15.156:0/358147822 >> 172.21.15.156:0/358147822 conn(0x7febec0f7450 msgr2=0x7febec0fc050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:44:12.666 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:12.664+0000 7febf3400700 1 -- 172.21.15.156:0/358147822 shutdown_connections 2024-04-23T14:44:12.666 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:12.664+0000 7febf3400700 1 -- 172.21.15.156:0/358147822 wait complete. 2024-04-23T14:44:13.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:12 smithi156 ceph-mon[32341]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-23T14:44:13.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:12 smithi156 ceph-mon[32341]: osdmap e38: 6 total, 5 up, 6 in 2024-04-23T14:44:13.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:12 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T14:44:13.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:12 smithi156 ceph-mon[32341]: from='osd.5 [v2:172.21.15.156:6816/4222896396,v1:172.21.15.156:6817/4222896396]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-23T14:44:13.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:12 smithi156 ceph-mon[32341]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-23T14:44:13.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:12 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:44:13.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:12 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:44:13.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:12 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:44:13.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:12 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:44:13.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:12 smithi081 ceph-mon[25540]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-23T14:44:13.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:12 smithi081 ceph-mon[25540]: osdmap e38: 6 total, 5 up, 6 in 2024-04-23T14:44:13.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:12 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T14:44:13.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:12 smithi081 ceph-mon[25540]: from='osd.5 [v2:172.21.15.156:6816/4222896396,v1:172.21.15.156:6817/4222896396]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-23T14:44:13.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:12 smithi081 ceph-mon[25540]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-23T14:44:13.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:12 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:44:13.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:12 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:44:13.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:12 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:44:13.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:12 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:44:13.450 DEBUG:teuthology.orchestra.run.smithi156:osd.5> sudo journalctl -f -n 0 -u ceph-7a641bea-017e-11ef-bc93-c7b262605968@osd.5.service 2024-04-23T14:44:13.457 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-04-23T14:44:13.458 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph osd stat -f json 2024-04-23T14:44:13.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:13 smithi081 ceph-mon[25540]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-23T14:44:13.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:13 smithi081 ceph-mon[25540]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2024-04-23T14:44:13.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:13 smithi081 ceph-mon[25540]: osdmap e39: 6 total, 5 up, 6 in 2024-04-23T14:44:13.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:13 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T14:44:13.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:13 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T14:44:13.924 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:44:13.959 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:13 smithi156 ceph-mon[32341]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-23T14:44:13.959 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:13 smithi156 ceph-mon[32341]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2024-04-23T14:44:13.960 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:13 smithi156 ceph-mon[32341]: osdmap e39: 6 total, 5 up, 6 in 2024-04-23T14:44:13.960 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:13 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T14:44:13.960 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:13 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T14:44:14.999 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:14 smithi156 ceph-mon[32341]: purged_snaps scrub starts 2024-04-23T14:44:14.999 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:14 smithi156 ceph-mon[32341]: purged_snaps scrub ok 2024-04-23T14:44:14.999 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:14 smithi156 ceph-mon[32341]: osd.5 [v2:172.21.15.156:6816/4222896396,v1:172.21.15.156:6817/4222896396] boot 2024-04-23T14:44:14.999 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:14 smithi156 ceph-mon[32341]: osdmap e40: 6 total, 6 up, 6 in 2024-04-23T14:44:14.999 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:14 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T14:44:15.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:14 smithi081 ceph-mon[25540]: purged_snaps scrub starts 2024-04-23T14:44:15.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:14 smithi081 ceph-mon[25540]: purged_snaps scrub ok 2024-04-23T14:44:15.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:14 smithi081 ceph-mon[25540]: osd.5 [v2:172.21.15.156:6816/4222896396,v1:172.21.15.156:6817/4222896396] boot 2024-04-23T14:44:15.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:14 smithi081 ceph-mon[25540]: osdmap e40: 6 total, 6 up, 6 in 2024-04-23T14:44:15.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:14 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T14:44:15.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:15 smithi081 ceph-mon[25540]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-23T14:44:15.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:15 smithi081 ceph-mon[25540]: osdmap e41: 6 total, 6 up, 6 in 2024-04-23T14:44:16.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:15 smithi156 ceph-mon[32341]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-23T14:44:16.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:15 smithi156 ceph-mon[32341]: osdmap e41: 6 total, 6 up, 6 in 2024-04-23T14:44:16.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.068+0000 7f9e4fa00700 1 -- 172.21.15.81:0/3530249751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e480fcef0 msgr2=0x7f9e480fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:16.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.068+0000 7f9e4fa00700 1 --2- 172.21.15.81:0/3530249751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e480fcef0 0x7f9e480fd320 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c009ce0 tx=0x7f9e3c004d10 comp rx=0 tx=0).stop 2024-04-23T14:44:16.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.068+0000 7f9e4fa00700 1 -- 172.21.15.81:0/3530249751 shutdown_connections 2024-04-23T14:44:16.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.068+0000 7f9e4fa00700 1 --2- 172.21.15.81:0/3530249751 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e480fe0e0 0x7f9e480fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:16.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.068+0000 7f9e4fa00700 1 --2- 172.21.15.81:0/3530249751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e480fcef0 0x7f9e480fd320 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:16.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.068+0000 7f9e4fa00700 1 -- 172.21.15.81:0/3530249751 >> 172.21.15.81:0/3530249751 conn(0x7f9e480f8530 msgr2=0x7f9e480fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:44:16.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.069+0000 7f9e4fa00700 1 -- 172.21.15.81:0/3530249751 shutdown_connections 2024-04-23T14:44:16.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.069+0000 7f9e4fa00700 1 -- 172.21.15.81:0/3530249751 wait complete. 2024-04-23T14:44:16.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.069+0000 7f9e4fa00700 1 Processor -- start 2024-04-23T14:44:16.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.070+0000 7f9e4fa00700 1 -- start start 2024-04-23T14:44:16.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.070+0000 7f9e4fa00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e480fcef0 0x7f9e4810fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:16.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.070+0000 7f9e4fa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e480fe0e0 0x7f9e481103c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:16.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.070+0000 7f9e4fa00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e48111130 con 0x7f9e480fe0e0 2024-04-23T14:44:16.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.070+0000 7f9e4fa00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e481112a0 con 0x7f9e480fcef0 2024-04-23T14:44:16.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.070+0000 7f9e47e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e480fe0e0 0x7f9e481103c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:16.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.070+0000 7f9e47e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e480fe0e0 0x7f9e481103c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33914/0 (socket says 172.21.15.81:33914) 2024-04-23T14:44:16.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.070+0000 7f9e47e00700 1 -- 172.21.15.81:0/2719734048 learned_addr learned my addr 172.21.15.81:0/2719734048 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:44:16.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.071+0000 7f9e4d000700 1 --2- 172.21.15.81:0/2719734048 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e480fcef0 0x7f9e4810fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:16.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.071+0000 7f9e47e00700 1 -- 172.21.15.81:0/2719734048 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e480fcef0 msgr2=0x7f9e4810fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:16.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.071+0000 7f9e47e00700 1 --2- 172.21.15.81:0/2719734048 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e480fcef0 0x7f9e4810fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:16.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.071+0000 7f9e47e00700 1 -- 172.21.15.81:0/2719734048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e3c009940 con 0x7f9e480fe0e0 2024-04-23T14:44:16.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.071+0000 7f9e47e00700 1 --2- 172.21.15.81:0/2719734048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e480fe0e0 0x7f9e481103c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9e34002a50 tx=0x7f9e340046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:44:16.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.071+0000 7f9e44c00700 1 -- 172.21.15.81:0/2719734048 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e34007cc0 con 0x7f9e480fe0e0 2024-04-23T14:44:16.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.072+0000 7f9e44c00700 1 -- 172.21.15.81:0/2719734048 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9e3400f040 con 0x7f9e480fe0e0 2024-04-23T14:44:16.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.072+0000 7f9e44c00700 1 -- 172.21.15.81:0/2719734048 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e3400da30 con 0x7f9e480fe0e0 2024-04-23T14:44:16.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.072+0000 7f9e4fa00700 1 -- 172.21.15.81:0/2719734048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e48111520 con 0x7f9e480fe0e0 2024-04-23T14:44:16.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.072+0000 7f9e4fa00700 1 -- 172.21.15.81:0/2719734048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e48111ae0 con 0x7f9e480fe0e0 2024-04-23T14:44:16.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.073+0000 7f9e4fa00700 1 -- 172.21.15.81:0/2719734048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e48101a70 con 0x7f9e480fe0e0 2024-04-23T14:44:16.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.074+0000 7f9e44c00700 1 -- 172.21.15.81:0/2719734048 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f9e3400db90 con 0x7f9e480fe0e0 2024-04-23T14:44:16.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.075+0000 7f9e44c00700 1 --2- 172.21.15.81:0/2719734048 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f9e300692b0 0x7f9e3006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:16.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.075+0000 7f9e44c00700 1 -- 172.21.15.81:0/2719734048 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9e34086bd0 con 0x7f9e480fe0e0 2024-04-23T14:44:16.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.076+0000 7f9e4d000700 1 --2- 172.21.15.81:0/2719734048 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f9e300692b0 0x7f9e3006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:16.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.076+0000 7f9e4d000700 1 --2- 172.21.15.81:0/2719734048 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f9e300692b0 0x7f9e3006b760 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9e4810fbf0 tx=0x7f9e3c004d10 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:44:16.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.081+0000 7f9e44c00700 1 -- 172.21.15.81:0/2719734048 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f9e340531a0 con 0x7f9e480fe0e0 2024-04-23T14:44:16.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.292+0000 7f9e4fa00700 1 -- 172.21.15.81:0/2719734048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f9e4805f5f0 con 0x7f9e480fe0e0 2024-04-23T14:44:16.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.294+0000 7f9e44c00700 1 -- 172.21.15.81:0/2719734048 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v41) v1 ==== 74+0+130 (secure 0 0 0) 0x7f9e340567c0 con 0x7f9e480fe0e0 2024-04-23T14:44:16.294 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:44:16.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.297+0000 7f9e4fa00700 1 -- 172.21.15.81:0/2719734048 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f9e300692b0 msgr2=0x7f9e3006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:16.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.297+0000 7f9e4fa00700 1 --2- 172.21.15.81:0/2719734048 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f9e300692b0 0x7f9e3006b760 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9e4810fbf0 tx=0x7f9e3c004d10 comp rx=0 tx=0).stop 2024-04-23T14:44:16.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.297+0000 7f9e4fa00700 1 -- 172.21.15.81:0/2719734048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e480fe0e0 msgr2=0x7f9e481103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:16.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.297+0000 7f9e4fa00700 1 --2- 172.21.15.81:0/2719734048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e480fe0e0 0x7f9e481103c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9e34002a50 tx=0x7f9e340046b0 comp rx=0 tx=0).stop 2024-04-23T14:44:16.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.297+0000 7f9e4fa00700 1 -- 172.21.15.81:0/2719734048 shutdown_connections 2024-04-23T14:44:16.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.297+0000 7f9e4fa00700 1 --2- 172.21.15.81:0/2719734048 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e480fcef0 0x7f9e4810fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:16.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.297+0000 7f9e4fa00700 1 --2- 172.21.15.81:0/2719734048 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f9e300692b0 0x7f9e3006b760 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:16.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.297+0000 7f9e4fa00700 1 --2- 172.21.15.81:0/2719734048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e480fe0e0 0x7f9e481103c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:16.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.297+0000 7f9e4fa00700 1 -- 172.21.15.81:0/2719734048 >> 172.21.15.81:0/2719734048 conn(0x7f9e480f8530 msgr2=0x7f9e480f9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:44:16.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.297+0000 7f9e4fa00700 1 -- 172.21.15.81:0/2719734048 shutdown_connections 2024-04-23T14:44:16.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:16.298+0000 7f9e4fa00700 1 -- 172.21.15.81:0/2719734048 wait complete. 2024-04-23T14:44:16.991 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:16 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/2719734048' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-23T14:44:17.103 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":41,"num_osds":6,"num_up_osds":6,"osd_up_since":1713883453,"num_in_osds":6,"osd_in_since":1713883430,"num_remapped_pgs":0} 2024-04-23T14:44:17.104 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-23T14:44:17.202 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:16 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/2719734048' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-23T14:44:17.571 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:44:17.955 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:17 smithi156 ceph-mon[32341]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:18.052 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:17 smithi081 ceph-mon[25540]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:19.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:19 smithi081 ceph-mon[25540]: Detected new or changed devices on smithi156 2024-04-23T14:44:19.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:19 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:44:19.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:19 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:44:19.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:19 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:44:19.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:19 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:44:19.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:19 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:44:19.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:19 smithi081 ceph-mon[25540]: Adjusting osd_memory_target on smithi156 to 5312M 2024-04-23T14:44:19.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:19 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:44:19.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:19 smithi081 ceph-mon[25540]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:19.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:19 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:44:19.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:19 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:44:19.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:19 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:44:19.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:19 smithi156 ceph-mon[32341]: Detected new or changed devices on smithi156 2024-04-23T14:44:19.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:19 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:44:19.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:19 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:44:19.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:19 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:44:19.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:19 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:44:19.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:19 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:44:19.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:19 smithi156 ceph-mon[32341]: Adjusting osd_memory_target on smithi156 to 5312M 2024-04-23T14:44:19.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:19 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:44:19.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:19 smithi156 ceph-mon[32341]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:19.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:19 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:44:19.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:19 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:44:19.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:19 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:44:19.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.715+0000 7f2edfe00700 1 -- 172.21.15.81:0/1306945547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee0102c40 msgr2=0x7f2ee0103010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:19.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.715+0000 7f2edfe00700 1 --2- 172.21.15.81:0/1306945547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee0102c40 0x7f2ee0103010 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0004940 tx=0x7f2ed0009e30 comp rx=0 tx=0).stop 2024-04-23T14:44:19.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.715+0000 7f2edfe00700 1 -- 172.21.15.81:0/1306945547 shutdown_connections 2024-04-23T14:44:19.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.715+0000 7f2edfe00700 1 --2- 172.21.15.81:0/1306945547 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ee01035e0 0x7f2ee00fcc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:19.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.715+0000 7f2edfe00700 1 --2- 172.21.15.81:0/1306945547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee0102c40 0x7f2ee0103010 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:19.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.715+0000 7f2edfe00700 1 -- 172.21.15.81:0/1306945547 >> 172.21.15.81:0/1306945547 conn(0x7f2ee00f8790 msgr2=0x7f2ee00faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:44:19.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.715+0000 7f2edfe00700 1 -- 172.21.15.81:0/1306945547 shutdown_connections 2024-04-23T14:44:19.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.715+0000 7f2edfe00700 1 -- 172.21.15.81:0/1306945547 wait complete. 2024-04-23T14:44:19.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.716+0000 7f2edfe00700 1 Processor -- start 2024-04-23T14:44:19.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.716+0000 7f2edfe00700 1 -- start start 2024-04-23T14:44:19.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.717+0000 7f2edfe00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ee0102c40 0x7f2ee00702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:19.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.717+0000 7f2edfe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee01035e0 0x7f2ee0070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:19.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.717+0000 7f2edfe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee0070d90 con 0x7f2ee01035e0 2024-04-23T14:44:19.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.717+0000 7f2edfe00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee0070ed0 con 0x7f2ee0102c40 2024-04-23T14:44:19.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.717+0000 7f2ede000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee01035e0 0x7f2ee0070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:19.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.717+0000 7f2ede000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee01035e0 0x7f2ee0070800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33938/0 (socket says 172.21.15.81:33938) 2024-04-23T14:44:19.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.717+0000 7f2ede000700 1 -- 172.21.15.81:0/1237478269 learned_addr learned my addr 172.21.15.81:0/1237478269 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:44:19.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.717+0000 7f2edea00700 1 --2- 172.21.15.81:0/1237478269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ee0102c40 0x7f2ee00702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:19.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.718+0000 7f2ede000700 1 -- 172.21.15.81:0/1237478269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ee0102c40 msgr2=0x7f2ee00702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:19.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.718+0000 7f2ede000700 1 --2- 172.21.15.81:0/1237478269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ee0102c40 0x7f2ee00702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:19.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.718+0000 7f2ede000700 1 -- 172.21.15.81:0/1237478269 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed0005040 con 0x7f2ee01035e0 2024-04-23T14:44:19.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.718+0000 7f2edea00700 1 --2- 172.21.15.81:0/1237478269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ee0102c40 0x7f2ee00702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:44:19.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.718+0000 7f2ede000700 1 --2- 172.21.15.81:0/1237478269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee01035e0 0x7f2ee0070800 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc002a80 tx=0x7f2ecc004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:44:19.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.718+0000 7f2ed6a00700 1 -- 172.21.15.81:0/1237478269 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ecc007cc0 con 0x7f2ee01035e0 2024-04-23T14:44:19.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.718+0000 7f2edfe00700 1 -- 172.21.15.81:0/1237478269 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ee0119d10 con 0x7f2ee01035e0 2024-04-23T14:44:19.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.718+0000 7f2ed6a00700 1 -- 172.21.15.81:0/1237478269 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2ecc00f040 con 0x7f2ee01035e0 2024-04-23T14:44:19.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.718+0000 7f2ed6a00700 1 -- 172.21.15.81:0/1237478269 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ecc00daf0 con 0x7f2ee01035e0 2024-04-23T14:44:19.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.718+0000 7f2edfe00700 1 -- 172.21.15.81:0/1237478269 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee011a190 con 0x7f2ee01035e0 2024-04-23T14:44:19.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.719+0000 7f2edfe00700 1 -- 172.21.15.81:0/1237478269 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ee00fe390 con 0x7f2ee01035e0 2024-04-23T14:44:19.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.720+0000 7f2ed6a00700 1 -- 172.21.15.81:0/1237478269 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f2ecc00dc90 con 0x7f2ee01035e0 2024-04-23T14:44:19.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.721+0000 7f2ed6a00700 1 --2- 172.21.15.81:0/1237478269 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f2ec40692a0 0x7f2ec406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:19.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.721+0000 7f2ed6a00700 1 -- 172.21.15.81:0/1237478269 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2ecc086610 con 0x7f2ee01035e0 2024-04-23T14:44:19.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.721+0000 7f2edea00700 1 --2- 172.21.15.81:0/1237478269 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f2ec40692a0 0x7f2ec406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:19.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.722+0000 7f2edea00700 1 --2- 172.21.15.81:0/1237478269 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f2ec40692a0 0x7f2ec406b750 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0004560 tx=0x7f2ed0009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:44:19.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.726+0000 7f2ed6a00700 1 -- 172.21.15.81:0/1237478269 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2ecc04d250 con 0x7f2ee01035e0 2024-04-23T14:44:19.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.939+0000 7f2edfe00700 1 -- 172.21.15.81:0/1237478269 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ee004bed0 con 0x7f2ee01035e0 2024-04-23T14:44:19.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.941+0000 7f2ed6a00700 1 -- 172.21.15.81:0/1237478269 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11059 (secure 0 0 0) 0x7f2ecc052b60 con 0x7f2ee01035e0 2024-04-23T14:44:19.942 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:44:19.943 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":41,"fsid":"7a641bea-017e-11ef-bc93-c7b262605968","created":"2024-04-23T14:37:06.214022+0000","modified":"2024-04-23T14:44:14.780272+0000","last_up_change":"2024-04-23T14:44:13.762548+0000","last_in_change":"2024-04-23T14:43:50.423631+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T14:42:32.718276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"c084af11-7048-409a-9932-9ede242d3abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3586146569},{"type":"v1","addr":"172.21.15.81:6803","nonce":3586146569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3586146569},{"type":"v1","addr":"172.21.15.81:6805","nonce":3586146569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3586146569},{"type":"v1","addr":"172.21.15.81:6809","nonce":3586146569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3586146569},{"type":"v1","addr":"172.21.15.81:6807","nonce":3586146569}]},"public_addr":"172.21.15.81:6803/3586146569","cluster_addr":"172.21.15.81:6805/3586146569","heartbeat_back_addr":"172.21.15.81:6809/3586146569","heartbeat_front_addr":"172.21.15.81:6807/3586146569","state":["exists","up"]},{"osd":1,"uuid":"0b642368-c907-404e-9f69-32f059f5426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":48369012},{"type":"v1","addr":"172.21.15.81:6811","nonce":48369012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":48369012},{"type":"v1","addr":"172.21.15.81:6813","nonce":48369012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":48369012},{"type":"v1","addr":"172.21.15.81:6817","nonce":48369012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":48369012},{"type":"v1","addr":"172.21.15.81:6815","nonce":48369012}]},"public_addr":"172.21.15.81:6811/48369012","cluster_addr":"172.21.15.81:6813/48369012","heartbeat_back_addr":"172.21.15.81:6817/48369012","heartbeat_front_addr":"172.21.15.81:6815/48369012","state":["exists","up"]},{"osd":2,"uuid":"cde59edc-3e7d-4d53-ba08-a67ec2250898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3840720313},{"type":"v1","addr":"172.21.15.81:6819","nonce":3840720313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3840720313},{"type":"v1","addr":"172.21.15.81:6821","nonce":3840720313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3840720313},{"type":"v1","addr":"172.21.15.81:6825","nonce":3840720313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3840720313},{"type":"v1","addr":"172.21.15.81:6823","nonce":3840720313}]},"public_addr":"172.21.15.81:6819/3840720313","cluster_addr":"172.21.15.81:6821/3840720313","heartbeat_back_addr":"172.21.15.81:6825/3840720313","heartbeat_front_addr":"172.21.15.81:6823/3840720313","state":["exists","up"]},{"osd":3,"uuid":"722814fb-aeb5-4765-8440-05563f47c8ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":2727527147},{"type":"v1","addr":"172.21.15.156:6801","nonce":2727527147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":2727527147},{"type":"v1","addr":"172.21.15.156:6803","nonce":2727527147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":2727527147},{"type":"v1","addr":"172.21.15.156:6807","nonce":2727527147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":2727527147},{"type":"v1","addr":"172.21.15.156:6805","nonce":2727527147}]},"public_addr":"172.21.15.156:6801/2727527147","cluster_addr":"172.21.15.156:6803/2727527147","heartbeat_back_addr":"172.21.15.156:6807/2727527147","heartbeat_front_addr":"172.21.15.156:6805/2727527147","state":["exists","up"]},{"osd":4,"uuid":"2f660c6e-38d1-4982-9cba-46242bf2de6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":821376629},{"type":"v1","addr":"172.21.15.156:6809","nonce":821376629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":821376629},{"type":"v1","addr":"172.21.15.156:6811","nonce":821376629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":821376629},{"type":"v1","addr":"172.21.15.156:6815","nonce":821376629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":821376629},{"type":"v1","addr":"172.21.15.156:6813","nonce":821376629}]},"public_addr":"172.21.15.156:6809/821376629","cluster_addr":"172.21.15.156:6811/821376629","heartbeat_back_addr":"172.21.15.156:6815/821376629","heartbeat_front_addr":"172.21.15.156:6813/821376629","state":["exists","up"]},{"osd":5,"uuid":"82590b0d-f1e5-4491-b341-8db75ce2ea50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":4222896396},{"type":"v1","addr":"172.21.15.156:6817","nonce":4222896396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":4222896396},{"type":"v1","addr":"172.21.15.156:6819","nonce":4222896396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":4222896396},{"type":"v1","addr":"172.21.15.156:6823","nonce":4222896396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":4222896396},{"type":"v1","addr":"172.21.15.156:6821","nonce":4222896396}]},"public_addr":"172.21.15.156:6817/4222896396","cluster_addr":"172.21.15.156:6819/4222896396","heartbeat_back_addr":"172.21.15.156:6823/4222896396","heartbeat_front_addr":"172.21.15.156:6821/4222896396","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:16.189027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:52.737106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:42:29.838157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:03.041762+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:37.248449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:12.266170+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/3883051436":"2024-04-24T14:39:42.006227+0000","172.21.15.81:6800/3624015234":"2024-04-24T14:39:42.006227+0000","172.21.15.81:0/652570605":"2024-04-24T14:38:16.825251+0000","172.21.15.81:0/644202147":"2024-04-24T14:38:16.825251+0000","172.21.15.81:0/3173386887":"2024-04-24T14:38:16.825251+0000","172.21.15.81:0/4290566211":"2024-04-24T14:39:42.006227+0000","172.21.15.81:0/1308908574":"2024-04-24T14:39:42.006227+0000","172.21.15.81:0/2253455652":"2024-04-24T14:37:38.176351+0000","172.21.15.81:0/4004069135":"2024-04-24T14:37:38.176351+0000","172.21.15.81:6801/3624015234":"2024-04-24T14:39:42.006227+0000","172.21.15.81:6801/1764050360":"2024-04-24T14:37:38.176351+0000","172.21.15.81:6801/2072638798":"2024-04-24T14:38:16.825251+0000","172.21.15.81:0/3010656646":"2024-04-24T14:37:38.176351+0000","172.21.15.81:6800/1764050360":"2024-04-24T14:37:38.176351+0000","172.21.15.81:6800/2072638798":"2024-04-24T14:38:16.825251+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T14:44:19.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.944+0000 7f2edfe00700 1 -- 172.21.15.81:0/1237478269 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f2ec40692a0 msgr2=0x7f2ec406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:19.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.944+0000 7f2edfe00700 1 --2- 172.21.15.81:0/1237478269 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f2ec40692a0 0x7f2ec406b750 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0004560 tx=0x7f2ed0009e30 comp rx=0 tx=0).stop 2024-04-23T14:44:19.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.944+0000 7f2edfe00700 1 -- 172.21.15.81:0/1237478269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee01035e0 msgr2=0x7f2ee0070800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:19.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.944+0000 7f2edfe00700 1 --2- 172.21.15.81:0/1237478269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee01035e0 0x7f2ee0070800 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc002a80 tx=0x7f2ecc004630 comp rx=0 tx=0).stop 2024-04-23T14:44:19.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.944+0000 7f2edfe00700 1 -- 172.21.15.81:0/1237478269 shutdown_connections 2024-04-23T14:44:19.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.944+0000 7f2edfe00700 1 --2- 172.21.15.81:0/1237478269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ee0102c40 0x7f2ee00702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:19.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.944+0000 7f2edfe00700 1 --2- 172.21.15.81:0/1237478269 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f2ec40692a0 0x7f2ec406b750 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:19.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.944+0000 7f2edfe00700 1 --2- 172.21.15.81:0/1237478269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee01035e0 0x7f2ee0070800 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:19.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.944+0000 7f2edfe00700 1 -- 172.21.15.81:0/1237478269 >> 172.21.15.81:0/1237478269 conn(0x7f2ee00f8790 msgr2=0x7f2ee00f9770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:44:19.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.944+0000 7f2edfe00700 1 -- 172.21.15.81:0/1237478269 shutdown_connections 2024-04-23T14:44:19.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:19.945+0000 7f2edfe00700 1 -- 172.21.15.81:0/1237478269 wait complete. 2024-04-23T14:44:20.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:20 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/1237478269' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:44:20.302 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:20 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/1237478269' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:44:20.679 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T14:42:32.718276+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-04-23T14:44:20.679 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-04-23T14:44:21.153 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:44:21.434 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:21 smithi081 ceph-mon[25540]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:21.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:21 smithi156 ceph-mon[32341]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:23.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.263+0000 7f4015a00700 1 -- 172.21.15.81:0/1330517982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4010105020 msgr2=0x7f40101053f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:23.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.263+0000 7f4015a00700 1 --2- 172.21.15.81:0/1330517982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4010105020 0x7f40101053f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4000004940 tx=0x7f4000009e30 comp rx=0 tx=0).stop 2024-04-23T14:44:23.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.264+0000 7f4015a00700 1 -- 172.21.15.81:0/1330517982 shutdown_connections 2024-04-23T14:44:23.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.264+0000 7f4015a00700 1 --2- 172.21.15.81:0/1330517982 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f40101059c0 0x7f40100ff030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:23.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.264+0000 7f4015a00700 1 --2- 172.21.15.81:0/1330517982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4010105020 0x7f40101053f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:23.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.264+0000 7f4015a00700 1 -- 172.21.15.81:0/1330517982 >> 172.21.15.81:0/1330517982 conn(0x7f40100fac10 msgr2=0x7f40100fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:44:23.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.264+0000 7f4015a00700 1 -- 172.21.15.81:0/1330517982 shutdown_connections 2024-04-23T14:44:23.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.264+0000 7f4015a00700 1 -- 172.21.15.81:0/1330517982 wait complete. 2024-04-23T14:44:23.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.265+0000 7f4015a00700 1 Processor -- start 2024-04-23T14:44:23.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.265+0000 7f4015a00700 1 -- start start 2024-04-23T14:44:23.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.265+0000 7f4015a00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4010105020 0x7f4010115de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:23.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.265+0000 7f4015a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40101059c0 0x7f4010116320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:23.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.265+0000 7f4015a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4010116970 con 0x7f40101059c0 2024-04-23T14:44:23.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.265+0000 7f4015a00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401010fd40 con 0x7f4010105020 2024-04-23T14:44:23.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.266+0000 7f400e000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40101059c0 0x7f4010116320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:23.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.266+0000 7f400e000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40101059c0 0x7f4010116320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33970/0 (socket says 172.21.15.81:33970) 2024-04-23T14:44:23.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.266+0000 7f400e000700 1 -- 172.21.15.81:0/4218054696 learned_addr learned my addr 172.21.15.81:0/4218054696 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:44:23.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.266+0000 7f400ea00700 1 --2- 172.21.15.81:0/4218054696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4010105020 0x7f4010115de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:23.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.266+0000 7f400e000700 1 -- 172.21.15.81:0/4218054696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4010105020 msgr2=0x7f4010115de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:23.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.266+0000 7f400e000700 1 --2- 172.21.15.81:0/4218054696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4010105020 0x7f4010115de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:23.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.266+0000 7f400e000700 1 -- 172.21.15.81:0/4218054696 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4000005040 con 0x7f40101059c0 2024-04-23T14:44:23.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.266+0000 7f400ea00700 1 --2- 172.21.15.81:0/4218054696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4010105020 0x7f4010115de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:44:23.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.267+0000 7f400e000700 1 --2- 172.21.15.81:0/4218054696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40101059c0 0x7f4010116320 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc00c800 tx=0x7f3ffc004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:44:23.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.267+0000 7f4006a00700 1 -- 172.21.15.81:0/4218054696 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ffc00a760 con 0x7f40101059c0 2024-04-23T14:44:23.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.267+0000 7f4006a00700 1 -- 172.21.15.81:0/4218054696 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3ffc00ad90 con 0x7f40101059c0 2024-04-23T14:44:23.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.267+0000 7f4015a00700 1 -- 172.21.15.81:0/4218054696 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4010110020 con 0x7f40101059c0 2024-04-23T14:44:23.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.267+0000 7f4006a00700 1 -- 172.21.15.81:0/4218054696 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ffc0113a0 con 0x7f40101059c0 2024-04-23T14:44:23.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.267+0000 7f4015a00700 1 -- 172.21.15.81:0/4218054696 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40101105e0 con 0x7f40101059c0 2024-04-23T14:44:23.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.268+0000 7f4015a00700 1 -- 172.21.15.81:0/4218054696 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4010100770 con 0x7f40101059c0 2024-04-23T14:44:23.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.269+0000 7f4006a00700 1 -- 172.21.15.81:0/4218054696 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f3ffc012400 con 0x7f40101059c0 2024-04-23T14:44:23.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.270+0000 7f4006a00700 1 --2- 172.21.15.81:0/4218054696 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f3ff40692b0 0x7f3ff406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:23.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.270+0000 7f4006a00700 1 -- 172.21.15.81:0/4218054696 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3ffc086e70 con 0x7f40101059c0 2024-04-23T14:44:23.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.270+0000 7f400ea00700 1 --2- 172.21.15.81:0/4218054696 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f3ff40692b0 0x7f3ff406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:23.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.271+0000 7f400ea00700 1 --2- 172.21.15.81:0/4218054696 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f3ff40692b0 0x7f3ff406b760 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f400000b3b0 tx=0x7f4000009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:44:23.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.275+0000 7f4006a00700 1 -- 172.21.15.81:0/4218054696 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3ffc056f50 con 0x7f40101059c0 2024-04-23T14:44:23.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.487+0000 7f4015a00700 1 -- 172.21.15.81:0/4218054696 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f401005f5f0 con 0x7f40101059c0 2024-04-23T14:44:23.503 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:23 smithi081 ceph-mon[25540]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:23.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.488+0000 7f4006a00700 1 -- 172.21.15.81:0/4218054696 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3ffc056ae0 con 0x7f40101059c0 2024-04-23T14:44:23.504 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-04-23T14:44:23.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.491+0000 7f4015a00700 1 -- 172.21.15.81:0/4218054696 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f3ff40692b0 msgr2=0x7f3ff406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:23.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.491+0000 7f4015a00700 1 --2- 172.21.15.81:0/4218054696 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f3ff40692b0 0x7f3ff406b760 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f400000b3b0 tx=0x7f4000009e30 comp rx=0 tx=0).stop 2024-04-23T14:44:23.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.491+0000 7f4015a00700 1 -- 172.21.15.81:0/4218054696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40101059c0 msgr2=0x7f4010116320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:23.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.491+0000 7f4015a00700 1 --2- 172.21.15.81:0/4218054696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40101059c0 0x7f4010116320 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc00c800 tx=0x7f3ffc004470 comp rx=0 tx=0).stop 2024-04-23T14:44:23.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.492+0000 7f4015a00700 1 -- 172.21.15.81:0/4218054696 shutdown_connections 2024-04-23T14:44:23.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.492+0000 7f4015a00700 1 --2- 172.21.15.81:0/4218054696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4010105020 0x7f4010115de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:23.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.492+0000 7f4015a00700 1 --2- 172.21.15.81:0/4218054696 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f3ff40692b0 0x7f3ff406b760 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:23.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.492+0000 7f4015a00700 1 --2- 172.21.15.81:0/4218054696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40101059c0 0x7f4010116320 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:23.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.492+0000 7f4015a00700 1 -- 172.21.15.81:0/4218054696 >> 172.21.15.81:0/4218054696 conn(0x7f40100fac10 msgr2=0x7f40100fbd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:44:23.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.492+0000 7f4015a00700 1 -- 172.21.15.81:0/4218054696 shutdown_connections 2024-04-23T14:44:23.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:23.492+0000 7f4015a00700 1 -- 172.21.15.81:0/4218054696 wait complete. 2024-04-23T14:44:23.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:23 smithi156 ceph-mon[32341]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:24.276 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:24 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/4218054696' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T14:44:24.338 INFO:tasks.cephadm:Setting up client nodes... 2024-04-23T14:44:24.338 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-23T14:44:24.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:24 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/4218054696' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T14:44:24.805 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:44:25.220 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:25 smithi081 ceph-mon[25540]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:25.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:25 smithi156 ceph-mon[32341]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:26.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:26.978+0000 7f5241600700 1 -- 172.21.15.81:0/1723139534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f523c0ff000 msgr2=0x7f523c0ff410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:26.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:26.978+0000 7f5241600700 1 --2- 172.21.15.81:0/1723139534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f523c0ff000 0x7f523c0ff410 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f522c004940 tx=0x7f522c009e30 comp rx=0 tx=0).stop 2024-04-23T14:44:26.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:26.978+0000 7f5241600700 1 -- 172.21.15.81:0/1723139534 shutdown_connections 2024-04-23T14:44:26.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:26.978+0000 7f5241600700 1 --2- 172.21.15.81:0/1723139534 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f523c1002b0 0x7f523c100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:26.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:26.978+0000 7f5241600700 1 --2- 172.21.15.81:0/1723139534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f523c0ff000 0x7f523c0ff410 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:26.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:26.978+0000 7f5241600700 1 -- 172.21.15.81:0/1723139534 >> 172.21.15.81:0/1723139534 conn(0x7f523c0fa950 msgr2=0x7f523c0fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:44:26.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:26.978+0000 7f5241600700 1 -- 172.21.15.81:0/1723139534 shutdown_connections 2024-04-23T14:44:26.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:26.978+0000 7f5241600700 1 -- 172.21.15.81:0/1723139534 wait complete. 2024-04-23T14:44:26.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:26.979+0000 7f5241600700 1 Processor -- start 2024-04-23T14:44:26.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:26.979+0000 7f5241600700 1 -- start start 2024-04-23T14:44:26.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:26.979+0000 7f5241600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f523c0ff000 0x7f523c10fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:26.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:26.979+0000 7f5241600700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f523c1002b0 0x7f523c110070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:26.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:26.979+0000 7f5241600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523c110700 con 0x7f523c0ff000 2024-04-23T14:44:26.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:26.979+0000 7f5241600700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523c1150a0 con 0x7f523c1002b0 2024-04-23T14:44:26.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:26.980+0000 7f523aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f523c0ff000 0x7f523c10fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:26.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:26.980+0000 7f523aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f523c0ff000 0x7f523c10fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58648/0 (socket says 172.21.15.81:58648) 2024-04-23T14:44:26.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:26.980+0000 7f523aa00700 1 -- 172.21.15.81:0/1091465976 learned_addr learned my addr 172.21.15.81:0/1091465976 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:44:26.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:26.980+0000 7f523aa00700 1 -- 172.21.15.81:0/1091465976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f523c1002b0 msgr2=0x7f523c110070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:26.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:26.980+0000 7f523aa00700 1 --2- 172.21.15.81:0/1091465976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f523c1002b0 0x7f523c110070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:26.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:26.980+0000 7f523aa00700 1 -- 172.21.15.81:0/1091465976 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f522c005040 con 0x7f523c0ff000 2024-04-23T14:44:26.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:26.980+0000 7f523aa00700 1 --2- 172.21.15.81:0/1091465976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f523c0ff000 0x7f523c10fb30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f522c009150 tx=0x7f522c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:44:26.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:26.981+0000 7f5232a00700 1 -- 172.21.15.81:0/1091465976 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f522c00e040 con 0x7f523c0ff000 2024-04-23T14:44:26.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:26.981+0000 7f5232a00700 1 -- 172.21.15.81:0/1091465976 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f522c00bbf0 con 0x7f523c0ff000 2024-04-23T14:44:26.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:26.981+0000 7f5241600700 1 -- 172.21.15.81:0/1091465976 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f523c1152a0 con 0x7f523c0ff000 2024-04-23T14:44:26.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:26.981+0000 7f5232a00700 1 -- 172.21.15.81:0/1091465976 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f522c01c630 con 0x7f523c0ff000 2024-04-23T14:44:26.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:26.981+0000 7f5241600700 1 -- 172.21.15.81:0/1091465976 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f523c115810 con 0x7f523c0ff000 2024-04-23T14:44:26.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:26.982+0000 7f5241600700 1 -- 172.21.15.81:0/1091465976 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f523c04c710 con 0x7f523c0ff000 2024-04-23T14:44:26.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:26.983+0000 7f5232a00700 1 -- 172.21.15.81:0/1091465976 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f522c00bd60 con 0x7f523c0ff000 2024-04-23T14:44:26.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:26.984+0000 7f5232a00700 1 --2- 172.21.15.81:0/1091465976 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f5220069380 0x7f522006b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:26.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:26.984+0000 7f5232a00700 1 -- 172.21.15.81:0/1091465976 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f522c088250 con 0x7f523c0ff000 2024-04-23T14:44:26.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:26.984+0000 7f523a000700 1 --2- 172.21.15.81:0/1091465976 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f5220069380 0x7f522006b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:26.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:26.985+0000 7f523a000700 1 --2- 172.21.15.81:0/1091465976 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f5220069380 0x7f522006b830 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5228006fd0 tx=0x7f5228006db0 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:44:26.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:26.988+0000 7f5232a00700 1 -- 172.21.15.81:0/1091465976 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f522c058330 con 0x7f523c0ff000 2024-04-23T14:44:27.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:27.288+0000 7f5241600700 1 -- 172.21.15.81:0/1091465976 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f523c115b90 con 0x7f523c0ff000 2024-04-23T14:44:27.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:27.297+0000 7f5232a00700 1 -- 172.21.15.81:0/1091465976 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7f522c054020 con 0x7f523c0ff000 2024-04-23T14:44:27.297 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-04-23T14:44:27.298 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBLySdmK2xHERAAZzqLGXq2Xu2tTBtU1nAFxg== 2024-04-23T14:44:27.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:27.299+0000 7f5241600700 1 -- 172.21.15.81:0/1091465976 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f5220069380 msgr2=0x7f522006b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:27.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:27.299+0000 7f5241600700 1 --2- 172.21.15.81:0/1091465976 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f5220069380 0x7f522006b830 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5228006fd0 tx=0x7f5228006db0 comp rx=0 tx=0).stop 2024-04-23T14:44:27.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:27.300+0000 7f5241600700 1 -- 172.21.15.81:0/1091465976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f523c0ff000 msgr2=0x7f523c10fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:27.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:27.300+0000 7f5241600700 1 --2- 172.21.15.81:0/1091465976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f523c0ff000 0x7f523c10fb30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f522c009150 tx=0x7f522c009e30 comp rx=0 tx=0).stop 2024-04-23T14:44:27.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:27.300+0000 7f5241600700 1 -- 172.21.15.81:0/1091465976 shutdown_connections 2024-04-23T14:44:27.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:27.300+0000 7f5241600700 1 --2- 172.21.15.81:0/1091465976 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f5220069380 0x7f522006b830 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:27.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:27.300+0000 7f5241600700 1 --2- 172.21.15.81:0/1091465976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f523c0ff000 0x7f523c10fb30 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:27.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:27.300+0000 7f5241600700 1 --2- 172.21.15.81:0/1091465976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f523c1002b0 0x7f523c110070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:27.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:27.300+0000 7f5241600700 1 -- 172.21.15.81:0/1091465976 >> 172.21.15.81:0/1091465976 conn(0x7f523c0fa950 msgr2=0x7f523c0fceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:44:27.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:27.300+0000 7f5241600700 1 -- 172.21.15.81:0/1091465976 shutdown_connections 2024-04-23T14:44:27.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:27.300+0000 7f5241600700 1 -- 172.21.15.81:0/1091465976 wait complete. 2024-04-23T14:44:27.377 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:27 smithi156 ceph-mon[32341]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:27.377 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:27 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:44:27.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:27 smithi081 ceph-mon[25540]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:27.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:27 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:44:28.094 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-23T14:44:28.094 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-04-23T14:44:28.094 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-23T14:44:28.226 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-23T14:44:28.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:28 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/1091465976' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-23T14:44:28.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:28 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/1091465976' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-23T14:44:28.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:28 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/1091465976' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-23T14:44:28.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:28 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/1091465976' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-23T14:44:28.670 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi156/config 2024-04-23T14:44:29.543 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:29 smithi156 ceph-mon[32341]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:29.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:29 smithi081 ceph-mon[25540]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:30.841 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:30.839+0000 7f5e92c00700 1 -- 172.21.15.156:0/516824401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e8c1046d0 msgr2=0x7f5e8c104b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:30.841 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:30.839+0000 7f5e92c00700 1 --2- 172.21.15.156:0/516824401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e8c1046d0 0x7f5e8c104b40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5e78004940 tx=0x7f5e78009e30 comp rx=0 tx=0).stop 2024-04-23T14:44:30.841 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:30.839+0000 7f5e92c00700 1 -- 172.21.15.156:0/516824401 shutdown_connections 2024-04-23T14:44:30.841 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:30.839+0000 7f5e92c00700 1 --2- 172.21.15.156:0/516824401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e8c1046d0 0x7f5e8c104b40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:30.841 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:30.839+0000 7f5e92c00700 1 --2- 172.21.15.156:0/516824401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e8c103420 0x7f5e8c103830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:30.841 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:30.839+0000 7f5e92c00700 1 -- 172.21.15.156:0/516824401 >> 172.21.15.156:0/516824401 conn(0x7f5e8c072640 msgr2=0x7f5e8c074a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:44:30.841 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:30.840+0000 7f5e92c00700 1 -- 172.21.15.156:0/516824401 shutdown_connections 2024-04-23T14:44:30.842 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:30.840+0000 7f5e92c00700 1 -- 172.21.15.156:0/516824401 wait complete. 2024-04-23T14:44:30.842 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:30.841+0000 7f5e92c00700 1 Processor -- start 2024-04-23T14:44:30.843 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:30.841+0000 7f5e92c00700 1 -- start start 2024-04-23T14:44:30.843 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:30.841+0000 7f5e92c00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e8c103420 0x7f5e8c113f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:30.843 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:30.841+0000 7f5e92c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e8c1046d0 0x7f5e8c1144a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:30.843 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:30.841+0000 7f5e92c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c114aa0 con 0x7f5e8c1046d0 2024-04-23T14:44:30.843 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:30.841+0000 7f5e92c00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c114c10 con 0x7f5e8c103420 2024-04-23T14:44:30.843 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:30.842+0000 7f5e8be00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e8c103420 0x7f5e8c113f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:30.843 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:30.842+0000 7f5e8be00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e8c103420 0x7f5e8c113f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44656/0 (socket says 172.21.15.156:44656) 2024-04-23T14:44:30.843 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:30.842+0000 7f5e8be00700 1 -- 172.21.15.156:0/3129711631 learned_addr learned my addr 172.21.15.156:0/3129711631 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-04-23T14:44:30.844 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:30.842+0000 7f5e8b400700 1 --2- 172.21.15.156:0/3129711631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e8c1046d0 0x7f5e8c1144a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:30.844 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:30.842+0000 7f5e8be00700 1 -- 172.21.15.156:0/3129711631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e8c1046d0 msgr2=0x7f5e8c1144a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:30.844 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:30.842+0000 7f5e8be00700 1 --2- 172.21.15.156:0/3129711631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e8c1046d0 0x7f5e8c1144a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:30.844 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:30.842+0000 7f5e8be00700 1 -- 172.21.15.156:0/3129711631 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e78005040 con 0x7f5e8c103420 2024-04-23T14:44:30.845 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:30.842+0000 7f5e8be00700 1 --2- 172.21.15.156:0/3129711631 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e8c103420 0x7f5e8c113f60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c00c810 tx=0x7f5e7c004470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:44:30.845 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:30.843+0000 7f5e83e00700 1 -- 172.21.15.156:0/3129711631 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e7c012810 con 0x7f5e8c103420 2024-04-23T14:44:30.845 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:30.843+0000 7f5e83e00700 1 -- 172.21.15.156:0/3129711631 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5e7c012e40 con 0x7f5e8c103420 2024-04-23T14:44:30.845 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:30.843+0000 7f5e83e00700 1 -- 172.21.15.156:0/3129711631 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e7c00a370 con 0x7f5e8c103420 2024-04-23T14:44:30.845 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:30.843+0000 7f5e92c00700 1 -- 172.21.15.156:0/3129711631 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e8c119620 con 0x7f5e8c103420 2024-04-23T14:44:30.845 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:30.843+0000 7f5e92c00700 1 -- 172.21.15.156:0/3129711631 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e8c119be0 con 0x7f5e8c103420 2024-04-23T14:44:30.845 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:30.844+0000 7f5e92c00700 1 -- 172.21.15.156:0/3129711631 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e8c04c710 con 0x7f5e8c103420 2024-04-23T14:44:30.846 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:30.845+0000 7f5e83e00700 1 -- 172.21.15.156:0/3129711631 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f5e7c011810 con 0x7f5e8c103420 2024-04-23T14:44:30.847 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:30.846+0000 7f5e83e00700 1 --2- 172.21.15.156:0/3129711631 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f5e700692b0 0x7f5e7006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:30.847 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:30.846+0000 7f5e83e00700 1 -- 172.21.15.156:0/3129711631 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5e7c087320 con 0x7f5e8c103420 2024-04-23T14:44:30.847 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:30.847+0000 7f5e8b400700 1 --2- 172.21.15.156:0/3129711631 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f5e700692b0 0x7f5e7006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:30.849 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:30.848+0000 7f5e8b400700 1 --2- 172.21.15.156:0/3129711631 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f5e700692b0 0x7f5e7006b760 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5e7800b3b0 tx=0x7f5e78009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:44:30.851 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:30.851+0000 7f5e83e00700 1 -- 172.21.15.156:0/3129711631 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f5e7c057380 con 0x7f5e8c103420 2024-04-23T14:44:31.146 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:31.144+0000 7f5e92c00700 1 -- 172.21.15.156:0/3129711631 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f5e8c10bf30 con 0x7f5e8c103420 2024-04-23T14:44:31.157 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:31.156+0000 7f5e83e00700 1 -- 172.21.15.156:0/3129711631 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7f5e7c016050 con 0x7f5e8c103420 2024-04-23T14:44:31.157 INFO:teuthology.orchestra.run.smithi156.stdout:[client.1] 2024-04-23T14:44:31.157 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQBPySdmO8rPCBAAcKbWdH2Bjj+PcmMjrOBmSg== 2024-04-23T14:44:31.160 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:31.159+0000 7f5e92c00700 1 -- 172.21.15.156:0/3129711631 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f5e700692b0 msgr2=0x7f5e7006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:31.160 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:31.159+0000 7f5e92c00700 1 --2- 172.21.15.156:0/3129711631 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f5e700692b0 0x7f5e7006b760 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5e7800b3b0 tx=0x7f5e78009e30 comp rx=0 tx=0).stop 2024-04-23T14:44:31.160 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:31.159+0000 7f5e92c00700 1 -- 172.21.15.156:0/3129711631 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e8c103420 msgr2=0x7f5e8c113f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:31.160 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:31.159+0000 7f5e92c00700 1 --2- 172.21.15.156:0/3129711631 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e8c103420 0x7f5e8c113f60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c00c810 tx=0x7f5e7c004470 comp rx=0 tx=0).stop 2024-04-23T14:44:31.160 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:31.159+0000 7f5e92c00700 1 -- 172.21.15.156:0/3129711631 shutdown_connections 2024-04-23T14:44:31.160 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:31.159+0000 7f5e92c00700 1 --2- 172.21.15.156:0/3129711631 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e8c103420 0x7f5e8c113f60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:31.160 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:31.159+0000 7f5e92c00700 1 --2- 172.21.15.156:0/3129711631 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f5e700692b0 0x7f5e7006b760 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:31.160 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:31.159+0000 7f5e92c00700 1 --2- 172.21.15.156:0/3129711631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e8c1046d0 0x7f5e8c1144a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:31.161 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:31.159+0000 7f5e92c00700 1 -- 172.21.15.156:0/3129711631 >> 172.21.15.156:0/3129711631 conn(0x7f5e8c072640 msgr2=0x7f5e8c073cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:44:31.161 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:31.159+0000 7f5e92c00700 1 -- 172.21.15.156:0/3129711631 shutdown_connections 2024-04-23T14:44:31.161 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:44:31.159+0000 7f5e92c00700 1 -- 172.21.15.156:0/3129711631 wait complete. 2024-04-23T14:44:31.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:31 smithi156 ceph-mon[32341]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:31.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:31 smithi156 ceph-mon[32341]: from='client.? 172.21.15.156:0/3129711631' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-23T14:44:31.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:31 smithi156 ceph-mon[32341]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-23T14:44:31.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:31 smithi156 ceph-mon[32341]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-23T14:44:31.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:31 smithi081 ceph-mon[25540]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:31.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:31 smithi081 ceph-mon[25540]: from='client.? 172.21.15.156:0/3129711631' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-23T14:44:31.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:31 smithi081 ceph-mon[25540]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-23T14:44:31.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:31 smithi081 ceph-mon[25540]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-23T14:44:31.965 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-04-23T14:44:31.965 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-04-23T14:44:31.966 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-23T14:44:32.084 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-23T14:44:32.084 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-04-23T14:44:32.084 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph mgr dump --format=json 2024-04-23T14:44:32.558 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:44:33.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:33 smithi081 ceph-mon[25540]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:33.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:33 smithi156 ceph-mon[32341]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:34.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:34.794+0000 7f2989200700 1 -- 172.21.15.81:0/2952979331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29841094c0 msgr2=0x7f2984109890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:34.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:34.794+0000 7f2989200700 1 --2- 172.21.15.81:0/2952979331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29841094c0 0x7f2984109890 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2974004940 tx=0x7f2974009e30 comp rx=0 tx=0).stop 2024-04-23T14:44:34.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:34.795+0000 7f2989200700 1 -- 172.21.15.81:0/2952979331 shutdown_connections 2024-04-23T14:44:34.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:34.795+0000 7f2989200700 1 --2- 172.21.15.81:0/2952979331 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2984103460 0x7f29841038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:34.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:34.795+0000 7f2989200700 1 --2- 172.21.15.81:0/2952979331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29841094c0 0x7f2984109890 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:34.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:34.795+0000 7f2989200700 1 -- 172.21.15.81:0/2952979331 >> 172.21.15.81:0/2952979331 conn(0x7f2984072c30 msgr2=0x7f2984075040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:44:34.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:34.795+0000 7f2989200700 1 -- 172.21.15.81:0/2952979331 shutdown_connections 2024-04-23T14:44:34.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:34.795+0000 7f2989200700 1 -- 172.21.15.81:0/2952979331 wait complete. 2024-04-23T14:44:34.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:34.796+0000 7f2989200700 1 Processor -- start 2024-04-23T14:44:34.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:34.796+0000 7f2989200700 1 -- start start 2024-04-23T14:44:34.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:34.796+0000 7f2989200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2984103460 0x7f298411a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:34.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:34.796+0000 7f2989200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f298411a5b0 0x7f2984114220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:34.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:34.796+0000 7f2989200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298411ab30 con 0x7f298411a5b0 2024-04-23T14:44:34.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:34.796+0000 7f2989200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298411aca0 con 0x7f2984103460 2024-04-23T14:44:34.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:34.797+0000 7f2981400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f298411a5b0 0x7f2984114220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:34.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:34.797+0000 7f2981400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f298411a5b0 0x7f2984114220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44380/0 (socket says 172.21.15.81:44380) 2024-04-23T14:44:34.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:34.797+0000 7f2981400700 1 -- 172.21.15.81:0/1601686768 learned_addr learned my addr 172.21.15.81:0/1601686768 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:44:34.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:34.797+0000 7f2981e00700 1 --2- 172.21.15.81:0/1601686768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2984103460 0x7f298411a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:34.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:34.797+0000 7f2981400700 1 -- 172.21.15.81:0/1601686768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2984103460 msgr2=0x7f298411a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:34.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:34.797+0000 7f2981400700 1 --2- 172.21.15.81:0/1601686768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2984103460 0x7f298411a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:34.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:34.797+0000 7f2981400700 1 -- 172.21.15.81:0/1601686768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2974005040 con 0x7f298411a5b0 2024-04-23T14:44:34.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:34.797+0000 7f2981400700 1 --2- 172.21.15.81:0/1601686768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f298411a5b0 0x7f2984114220 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f297000eb70 tx=0x7f297000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:44:34.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:34.798+0000 7f297a000700 1 -- 172.21.15.81:0/1601686768 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2970007cc0 con 0x7f298411a5b0 2024-04-23T14:44:34.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:34.798+0000 7f297a000700 1 -- 172.21.15.81:0/1601686768 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f297000f040 con 0x7f298411a5b0 2024-04-23T14:44:34.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:34.798+0000 7f297a000700 1 -- 172.21.15.81:0/1601686768 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2970009670 con 0x7f298411a5b0 2024-04-23T14:44:34.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:34.798+0000 7f2989200700 1 -- 172.21.15.81:0/1601686768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29841147c0 con 0x7f298411a5b0 2024-04-23T14:44:34.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:34.798+0000 7f2989200700 1 -- 172.21.15.81:0/1601686768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2984114d00 con 0x7f298411a5b0 2024-04-23T14:44:34.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:34.799+0000 7f2989200700 1 -- 172.21.15.81:0/1601686768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2984104ba0 con 0x7f298411a5b0 2024-04-23T14:44:34.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:34.800+0000 7f297a000700 1 -- 172.21.15.81:0/1601686768 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f29700097d0 con 0x7f298411a5b0 2024-04-23T14:44:34.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:34.801+0000 7f297a000700 1 --2- 172.21.15.81:0/1601686768 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f29680692a0 0x7f296806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:34.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:34.801+0000 7f297a000700 1 -- 172.21.15.81:0/1601686768 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2970086a90 con 0x7f298411a5b0 2024-04-23T14:44:34.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:34.801+0000 7f2981e00700 1 --2- 172.21.15.81:0/1601686768 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f29680692a0 0x7f296806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:34.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:34.802+0000 7f2981e00700 1 --2- 172.21.15.81:0/1601686768 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f29680692a0 0x7f296806b750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2974000c00 tx=0x7f2974009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:44:34.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:34.805+0000 7f297a000700 1 -- 172.21.15.81:0/1601686768 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f297004e250 con 0x7f298411a5b0 2024-04-23T14:44:35.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:35.074+0000 7f2989200700 1 -- 172.21.15.81:0/1601686768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f2984115000 con 0x7f298411a5b0 2024-04-23T14:44:35.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:35.080+0000 7f297a000700 1 -- 172.21.15.81:0/1601686768 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+167178 (secure 0 0 0) 0x7f297004bd20 con 0x7f298411a5b0 2024-04-23T14:44:35.083 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:44:35.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:35.084+0000 7f2989200700 1 -- 172.21.15.81:0/1601686768 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f29680692a0 msgr2=0x7f296806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:35.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:35.084+0000 7f2989200700 1 --2- 172.21.15.81:0/1601686768 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f29680692a0 0x7f296806b750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2974000c00 tx=0x7f2974009e30 comp rx=0 tx=0).stop 2024-04-23T14:44:35.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:35.084+0000 7f2989200700 1 -- 172.21.15.81:0/1601686768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f298411a5b0 msgr2=0x7f2984114220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:35.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:35.084+0000 7f2989200700 1 --2- 172.21.15.81:0/1601686768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f298411a5b0 0x7f2984114220 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f297000eb70 tx=0x7f297000b040 comp rx=0 tx=0).stop 2024-04-23T14:44:35.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:35.084+0000 7f2989200700 1 -- 172.21.15.81:0/1601686768 shutdown_connections 2024-04-23T14:44:35.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:35.084+0000 7f2989200700 1 --2- 172.21.15.81:0/1601686768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2984103460 0x7f298411a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:35.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:35.084+0000 7f2989200700 1 --2- 172.21.15.81:0/1601686768 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f29680692a0 0x7f296806b750 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:35.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:35.084+0000 7f2989200700 1 --2- 172.21.15.81:0/1601686768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f298411a5b0 0x7f2984114220 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:35.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:35.084+0000 7f2989200700 1 -- 172.21.15.81:0/1601686768 >> 172.21.15.81:0/1601686768 conn(0x7f2984072c30 msgr2=0x7f2984105cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:44:35.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:35.084+0000 7f2989200700 1 -- 172.21.15.81:0/1601686768 shutdown_connections 2024-04-23T14:44:35.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:35.084+0000 7f2989200700 1 -- 172.21.15.81:0/1601686768 wait complete. 2024-04-23T14:44:35.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:35 smithi081 ceph-mon[25540]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:35.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:35 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/1601686768' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-23T14:44:35.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:35 smithi156 ceph-mon[32341]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:35.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:35 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/1601686768' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-23T14:44:35.869 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":19,"flags":0,"active_gid":14210,"active_name":"smithi081.ldghvq","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1053506915},{"type":"v1","addr":"172.21.15.81:6801","nonce":1053506915}]},"active_addr":"172.21.15.81:6801/1053506915","active_change":"2024-04-23T14:39:42.006431+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14234,"name":"smithi156.ounwyj","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.81:8443/","prometheus":"http://172.21.15.81:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":934339506}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":3215003917}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":2921033786}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":1248767795}]}]} 2024-04-23T14:44:35.873 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-04-23T14:44:35.873 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-04-23T14:44:35.873 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-23T14:44:36.341 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:44:37.522 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:37 smithi081 ceph-mon[25540]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:37.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:37 smithi156 ceph-mon[32341]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:38.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.331+0000 7f396d600700 1 -- 172.21.15.81:0/4245735845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39680656b0 msgr2=0x7f3968065b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:38.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.331+0000 7f396d600700 1 --2- 172.21.15.81:0/4245735845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39680656b0 0x7f3968065b20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3954004940 tx=0x7f3954009e30 comp rx=0 tx=0).stop 2024-04-23T14:44:38.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.331+0000 7f396d600700 1 -- 172.21.15.81:0/4245735845 shutdown_connections 2024-04-23T14:44:38.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.331+0000 7f396d600700 1 --2- 172.21.15.81:0/4245735845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39680656b0 0x7f3968065b20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:38.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.331+0000 7f396d600700 1 --2- 172.21.15.81:0/4245735845 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3968102e60 0x7f3968103230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:38.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.331+0000 7f396d600700 1 -- 172.21.15.81:0/4245735845 >> 172.21.15.81:0/4245735845 conn(0x7f3968072bc0 msgr2=0x7f3968072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:44:38.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.331+0000 7f396d600700 1 -- 172.21.15.81:0/4245735845 shutdown_connections 2024-04-23T14:44:38.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.331+0000 7f396d600700 1 -- 172.21.15.81:0/4245735845 wait complete. 2024-04-23T14:44:38.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.332+0000 7f396d600700 1 Processor -- start 2024-04-23T14:44:38.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.332+0000 7f396d600700 1 -- start start 2024-04-23T14:44:38.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.332+0000 7f396d600700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39680656b0 0x7f39680fbd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:38.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.332+0000 7f396d600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3968102e60 0x7f39680fc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:38.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.332+0000 7f396d600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39680fc8b0 con 0x7f3968102e60 2024-04-23T14:44:38.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.332+0000 7f396d600700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39680fc9f0 con 0x7f39680656b0 2024-04-23T14:44:38.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.333+0000 7f3966000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3968102e60 0x7f39680fc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:38.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.333+0000 7f3966000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3968102e60 0x7f39680fc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44406/0 (socket says 172.21.15.81:44406) 2024-04-23T14:44:38.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.333+0000 7f3966000700 1 -- 172.21.15.81:0/3991358594 learned_addr learned my addr 172.21.15.81:0/3991358594 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:44:38.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.333+0000 7f3966a00700 1 --2- 172.21.15.81:0/3991358594 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39680656b0 0x7f39680fbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:38.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.333+0000 7f3966000700 1 -- 172.21.15.81:0/3991358594 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39680656b0 msgr2=0x7f39680fbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:38.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.333+0000 7f3966000700 1 --2- 172.21.15.81:0/3991358594 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39680656b0 0x7f39680fbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:38.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.333+0000 7f3966000700 1 -- 172.21.15.81:0/3991358594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3954005040 con 0x7f3968102e60 2024-04-23T14:44:38.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.333+0000 7f3966000700 1 --2- 172.21.15.81:0/3991358594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3968102e60 0x7f39680fc290 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3954009180 tx=0x7f3954009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:44:38.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.334+0000 7f395ea00700 1 -- 172.21.15.81:0/3991358594 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f395400e040 con 0x7f3968102e60 2024-04-23T14:44:38.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.334+0000 7f395ea00700 1 -- 172.21.15.81:0/3991358594 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f395400bbc0 con 0x7f3968102e60 2024-04-23T14:44:38.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.334+0000 7f395ea00700 1 -- 172.21.15.81:0/3991358594 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f395401c630 con 0x7f3968102e60 2024-04-23T14:44:38.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.334+0000 7f396d600700 1 -- 172.21.15.81:0/3991358594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3968119e90 con 0x7f3968102e60 2024-04-23T14:44:38.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.334+0000 7f396d600700 1 -- 172.21.15.81:0/3991358594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f396811a370 con 0x7f3968102e60 2024-04-23T14:44:38.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.335+0000 7f396d600700 1 -- 172.21.15.81:0/3991358594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39680fe570 con 0x7f3968102e60 2024-04-23T14:44:38.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.336+0000 7f395ea00700 1 -- 172.21.15.81:0/3991358594 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f395400bd30 con 0x7f3968102e60 2024-04-23T14:44:38.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.337+0000 7f395ea00700 1 --2- 172.21.15.81:0/3991358594 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f394c0692b0 0x7f394c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:38.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.337+0000 7f395ea00700 1 -- 172.21.15.81:0/3991358594 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3954088140 con 0x7f3968102e60 2024-04-23T14:44:38.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.337+0000 7f3966a00700 1 --2- 172.21.15.81:0/3991358594 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f394c0692b0 0x7f394c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:38.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.338+0000 7f3966a00700 1 --2- 172.21.15.81:0/3991358594 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f394c0692b0 0x7f394c06b760 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3958006fd0 tx=0x7f3958008040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:44:38.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.342+0000 7f395ea00700 1 -- 172.21.15.81:0/3991358594 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3954054850 con 0x7f3968102e60 2024-04-23T14:44:38.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.555+0000 7f396d600700 1 -- 172.21.15.81:0/3991358594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39680fcb80 con 0x7f3968102e60 2024-04-23T14:44:38.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.558+0000 7f395ea00700 1 -- 172.21.15.81:0/3991358594 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11059 (secure 0 0 0) 0x7f39680fcb80 con 0x7f3968102e60 2024-04-23T14:44:38.559 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:44:38.560 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":41,"fsid":"7a641bea-017e-11ef-bc93-c7b262605968","created":"2024-04-23T14:37:06.214022+0000","modified":"2024-04-23T14:44:14.780272+0000","last_up_change":"2024-04-23T14:44:13.762548+0000","last_in_change":"2024-04-23T14:43:50.423631+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T14:42:32.718276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"c084af11-7048-409a-9932-9ede242d3abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3586146569},{"type":"v1","addr":"172.21.15.81:6803","nonce":3586146569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3586146569},{"type":"v1","addr":"172.21.15.81:6805","nonce":3586146569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3586146569},{"type":"v1","addr":"172.21.15.81:6809","nonce":3586146569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3586146569},{"type":"v1","addr":"172.21.15.81:6807","nonce":3586146569}]},"public_addr":"172.21.15.81:6803/3586146569","cluster_addr":"172.21.15.81:6805/3586146569","heartbeat_back_addr":"172.21.15.81:6809/3586146569","heartbeat_front_addr":"172.21.15.81:6807/3586146569","state":["exists","up"]},{"osd":1,"uuid":"0b642368-c907-404e-9f69-32f059f5426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":48369012},{"type":"v1","addr":"172.21.15.81:6811","nonce":48369012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":48369012},{"type":"v1","addr":"172.21.15.81:6813","nonce":48369012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":48369012},{"type":"v1","addr":"172.21.15.81:6817","nonce":48369012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":48369012},{"type":"v1","addr":"172.21.15.81:6815","nonce":48369012}]},"public_addr":"172.21.15.81:6811/48369012","cluster_addr":"172.21.15.81:6813/48369012","heartbeat_back_addr":"172.21.15.81:6817/48369012","heartbeat_front_addr":"172.21.15.81:6815/48369012","state":["exists","up"]},{"osd":2,"uuid":"cde59edc-3e7d-4d53-ba08-a67ec2250898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3840720313},{"type":"v1","addr":"172.21.15.81:6819","nonce":3840720313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3840720313},{"type":"v1","addr":"172.21.15.81:6821","nonce":3840720313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3840720313},{"type":"v1","addr":"172.21.15.81:6825","nonce":3840720313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3840720313},{"type":"v1","addr":"172.21.15.81:6823","nonce":3840720313}]},"public_addr":"172.21.15.81:6819/3840720313","cluster_addr":"172.21.15.81:6821/3840720313","heartbeat_back_addr":"172.21.15.81:6825/3840720313","heartbeat_front_addr":"172.21.15.81:6823/3840720313","state":["exists","up"]},{"osd":3,"uuid":"722814fb-aeb5-4765-8440-05563f47c8ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":2727527147},{"type":"v1","addr":"172.21.15.156:6801","nonce":2727527147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":2727527147},{"type":"v1","addr":"172.21.15.156:6803","nonce":2727527147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":2727527147},{"type":"v1","addr":"172.21.15.156:6807","nonce":2727527147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":2727527147},{"type":"v1","addr":"172.21.15.156:6805","nonce":2727527147}]},"public_addr":"172.21.15.156:6801/2727527147","cluster_addr":"172.21.15.156:6803/2727527147","heartbeat_back_addr":"172.21.15.156:6807/2727527147","heartbeat_front_addr":"172.21.15.156:6805/2727527147","state":["exists","up"]},{"osd":4,"uuid":"2f660c6e-38d1-4982-9cba-46242bf2de6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":821376629},{"type":"v1","addr":"172.21.15.156:6809","nonce":821376629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":821376629},{"type":"v1","addr":"172.21.15.156:6811","nonce":821376629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":821376629},{"type":"v1","addr":"172.21.15.156:6815","nonce":821376629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":821376629},{"type":"v1","addr":"172.21.15.156:6813","nonce":821376629}]},"public_addr":"172.21.15.156:6809/821376629","cluster_addr":"172.21.15.156:6811/821376629","heartbeat_back_addr":"172.21.15.156:6815/821376629","heartbeat_front_addr":"172.21.15.156:6813/821376629","state":["exists","up"]},{"osd":5,"uuid":"82590b0d-f1e5-4491-b341-8db75ce2ea50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":4222896396},{"type":"v1","addr":"172.21.15.156:6817","nonce":4222896396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":4222896396},{"type":"v1","addr":"172.21.15.156:6819","nonce":4222896396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":4222896396},{"type":"v1","addr":"172.21.15.156:6823","nonce":4222896396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":4222896396},{"type":"v1","addr":"172.21.15.156:6821","nonce":4222896396}]},"public_addr":"172.21.15.156:6817/4222896396","cluster_addr":"172.21.15.156:6819/4222896396","heartbeat_back_addr":"172.21.15.156:6823/4222896396","heartbeat_front_addr":"172.21.15.156:6821/4222896396","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:16.189027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:52.737106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:42:29.838157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:03.041762+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:37.248449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:12.266170+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/3883051436":"2024-04-24T14:39:42.006227+0000","172.21.15.81:6800/3624015234":"2024-04-24T14:39:42.006227+0000","172.21.15.81:0/652570605":"2024-04-24T14:38:16.825251+0000","172.21.15.81:0/644202147":"2024-04-24T14:38:16.825251+0000","172.21.15.81:0/3173386887":"2024-04-24T14:38:16.825251+0000","172.21.15.81:0/4290566211":"2024-04-24T14:39:42.006227+0000","172.21.15.81:0/1308908574":"2024-04-24T14:39:42.006227+0000","172.21.15.81:0/2253455652":"2024-04-24T14:37:38.176351+0000","172.21.15.81:0/4004069135":"2024-04-24T14:37:38.176351+0000","172.21.15.81:6801/3624015234":"2024-04-24T14:39:42.006227+0000","172.21.15.81:6801/1764050360":"2024-04-24T14:37:38.176351+0000","172.21.15.81:6801/2072638798":"2024-04-24T14:38:16.825251+0000","172.21.15.81:0/3010656646":"2024-04-24T14:37:38.176351+0000","172.21.15.81:6800/1764050360":"2024-04-24T14:37:38.176351+0000","172.21.15.81:6800/2072638798":"2024-04-24T14:38:16.825251+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T14:44:38.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.561+0000 7f396d600700 1 -- 172.21.15.81:0/3991358594 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f394c0692b0 msgr2=0x7f394c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:38.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.561+0000 7f396d600700 1 --2- 172.21.15.81:0/3991358594 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f394c0692b0 0x7f394c06b760 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3958006fd0 tx=0x7f3958008040 comp rx=0 tx=0).stop 2024-04-23T14:44:38.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.561+0000 7f396d600700 1 -- 172.21.15.81:0/3991358594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3968102e60 msgr2=0x7f39680fc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:38.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.561+0000 7f396d600700 1 --2- 172.21.15.81:0/3991358594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3968102e60 0x7f39680fc290 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3954009180 tx=0x7f3954009e30 comp rx=0 tx=0).stop 2024-04-23T14:44:38.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.561+0000 7f396d600700 1 -- 172.21.15.81:0/3991358594 shutdown_connections 2024-04-23T14:44:38.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.561+0000 7f396d600700 1 --2- 172.21.15.81:0/3991358594 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39680656b0 0x7f39680fbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:38.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.561+0000 7f396d600700 1 --2- 172.21.15.81:0/3991358594 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f394c0692b0 0x7f394c06b760 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:38.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.561+0000 7f396d600700 1 --2- 172.21.15.81:0/3991358594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3968102e60 0x7f39680fc290 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:38.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.561+0000 7f396d600700 1 -- 172.21.15.81:0/3991358594 >> 172.21.15.81:0/3991358594 conn(0x7f3968072bc0 msgr2=0x7f39680fa060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:44:38.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.561+0000 7f396d600700 1 -- 172.21.15.81:0/3991358594 shutdown_connections 2024-04-23T14:44:38.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:38.561+0000 7f396d600700 1 -- 172.21.15.81:0/3991358594 wait complete. 2024-04-23T14:44:39.309 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-04-23T14:44:39.309 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-23T14:44:39.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:39 smithi156 ceph-mon[32341]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:39.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:39 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/3991358594' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:44:39.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:39 smithi081 ceph-mon[25540]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:39.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:39 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/3991358594' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:44:39.777 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:44:41.619 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:41 smithi081 ceph-mon[25540]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:41.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:41 smithi156 ceph-mon[32341]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:41.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:41.874+0000 7f89f2200700 1 -- 172.21.15.81:0/1641510144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89ec102e20 msgr2=0x7f89ec1031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:41.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:41.874+0000 7f89f2200700 1 --2- 172.21.15.81:0/1641510144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89ec102e20 0x7f89ec1031f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f89dc004940 tx=0x7f89dc009e30 comp rx=0 tx=0).stop 2024-04-23T14:44:41.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:41.874+0000 7f89f2200700 1 -- 172.21.15.81:0/1641510144 shutdown_connections 2024-04-23T14:44:41.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:41.874+0000 7f89f2200700 1 --2- 172.21.15.81:0/1641510144 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89ec1037c0 0x7f89ec0fce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:41.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:41.874+0000 7f89f2200700 1 --2- 172.21.15.81:0/1641510144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89ec102e20 0x7f89ec1031f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:41.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:41.874+0000 7f89f2200700 1 -- 172.21.15.81:0/1641510144 >> 172.21.15.81:0/1641510144 conn(0x7f89ec0f89b0 msgr2=0x7f89ec0fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:44:41.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:41.875+0000 7f89f2200700 1 -- 172.21.15.81:0/1641510144 shutdown_connections 2024-04-23T14:44:41.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:41.875+0000 7f89f2200700 1 -- 172.21.15.81:0/1641510144 wait complete. 2024-04-23T14:44:41.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:41.875+0000 7f89f2200700 1 Processor -- start 2024-04-23T14:44:41.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:41.876+0000 7f89f2200700 1 -- start start 2024-04-23T14:44:41.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:41.876+0000 7f89f2200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89ec102e20 0x7f89ec0702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:41.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:41.876+0000 7f89f2200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89ec1037c0 0x7f89ec070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:41.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:41.876+0000 7f89f2200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec072210 con 0x7f89ec1037c0 2024-04-23T14:44:41.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:41.876+0000 7f89f2200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec070d40 con 0x7f89ec102e20 2024-04-23T14:44:41.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:41.876+0000 7f89eaa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89ec1037c0 0x7f89ec070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:41.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:41.876+0000 7f89eaa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89ec1037c0 0x7f89ec070800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44424/0 (socket says 172.21.15.81:44424) 2024-04-23T14:44:41.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:41.876+0000 7f89eaa00700 1 -- 172.21.15.81:0/1428207363 learned_addr learned my addr 172.21.15.81:0/1428207363 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:44:41.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:41.877+0000 7f89eb400700 1 --2- 172.21.15.81:0/1428207363 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89ec102e20 0x7f89ec0702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:41.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:41.877+0000 7f89eaa00700 1 -- 172.21.15.81:0/1428207363 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89ec102e20 msgr2=0x7f89ec0702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:41.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:41.877+0000 7f89eaa00700 1 --2- 172.21.15.81:0/1428207363 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89ec102e20 0x7f89ec0702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:41.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:41.877+0000 7f89eaa00700 1 -- 172.21.15.81:0/1428207363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89dc005040 con 0x7f89ec1037c0 2024-04-23T14:44:41.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:41.877+0000 7f89eaa00700 1 --2- 172.21.15.81:0/1428207363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89ec1037c0 0x7f89ec070800 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f89d8002a50 tx=0x7f89d8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:44:41.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:41.877+0000 7f89e3400700 1 -- 172.21.15.81:0/1428207363 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89d8007cc0 con 0x7f89ec1037c0 2024-04-23T14:44:41.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:41.877+0000 7f89e3400700 1 -- 172.21.15.81:0/1428207363 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f89d800f040 con 0x7f89ec1037c0 2024-04-23T14:44:41.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:41.877+0000 7f89f2200700 1 -- 172.21.15.81:0/1428207363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89ec071020 con 0x7f89ec1037c0 2024-04-23T14:44:41.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:41.878+0000 7f89e3400700 1 -- 172.21.15.81:0/1428207363 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89d800daf0 con 0x7f89ec1037c0 2024-04-23T14:44:41.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:41.878+0000 7f89f2200700 1 -- 172.21.15.81:0/1428207363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89ec11a170 con 0x7f89ec1037c0 2024-04-23T14:44:41.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:41.879+0000 7f89f2200700 1 -- 172.21.15.81:0/1428207363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89ec100130 con 0x7f89ec1037c0 2024-04-23T14:44:41.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:41.880+0000 7f89e3400700 1 -- 172.21.15.81:0/1428207363 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f89d8009810 con 0x7f89ec1037c0 2024-04-23T14:44:41.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:41.880+0000 7f89e3400700 1 --2- 172.21.15.81:0/1428207363 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f89d00692a0 0x7f89d006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:41.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:41.881+0000 7f89e3400700 1 -- 172.21.15.81:0/1428207363 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f89d8086cd0 con 0x7f89ec1037c0 2024-04-23T14:44:41.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:41.881+0000 7f89eb400700 1 --2- 172.21.15.81:0/1428207363 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f89d00692a0 0x7f89d006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:41.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:41.882+0000 7f89eb400700 1 --2- 172.21.15.81:0/1428207363 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f89d00692a0 0x7f89d006b750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f89dc00b3b0 tx=0x7f89dc009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:44:41.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:41.885+0000 7f89e3400700 1 -- 172.21.15.81:0/1428207363 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f89d8053220 con 0x7f89ec1037c0 2024-04-23T14:44:42.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:42.098+0000 7f89f2200700 1 -- 172.21.15.81:0/1428207363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89ec0fe570 con 0x7f89ec1037c0 2024-04-23T14:44:42.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:42.100+0000 7f89e3400700 1 -- 172.21.15.81:0/1428207363 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11059 (secure 0 0 0) 0x7f89d8056840 con 0x7f89ec1037c0 2024-04-23T14:44:42.102 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:44:42.102 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":41,"fsid":"7a641bea-017e-11ef-bc93-c7b262605968","created":"2024-04-23T14:37:06.214022+0000","modified":"2024-04-23T14:44:14.780272+0000","last_up_change":"2024-04-23T14:44:13.762548+0000","last_in_change":"2024-04-23T14:43:50.423631+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T14:42:32.718276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"c084af11-7048-409a-9932-9ede242d3abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3586146569},{"type":"v1","addr":"172.21.15.81:6803","nonce":3586146569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3586146569},{"type":"v1","addr":"172.21.15.81:6805","nonce":3586146569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3586146569},{"type":"v1","addr":"172.21.15.81:6809","nonce":3586146569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3586146569},{"type":"v1","addr":"172.21.15.81:6807","nonce":3586146569}]},"public_addr":"172.21.15.81:6803/3586146569","cluster_addr":"172.21.15.81:6805/3586146569","heartbeat_back_addr":"172.21.15.81:6809/3586146569","heartbeat_front_addr":"172.21.15.81:6807/3586146569","state":["exists","up"]},{"osd":1,"uuid":"0b642368-c907-404e-9f69-32f059f5426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":48369012},{"type":"v1","addr":"172.21.15.81:6811","nonce":48369012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":48369012},{"type":"v1","addr":"172.21.15.81:6813","nonce":48369012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":48369012},{"type":"v1","addr":"172.21.15.81:6817","nonce":48369012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":48369012},{"type":"v1","addr":"172.21.15.81:6815","nonce":48369012}]},"public_addr":"172.21.15.81:6811/48369012","cluster_addr":"172.21.15.81:6813/48369012","heartbeat_back_addr":"172.21.15.81:6817/48369012","heartbeat_front_addr":"172.21.15.81:6815/48369012","state":["exists","up"]},{"osd":2,"uuid":"cde59edc-3e7d-4d53-ba08-a67ec2250898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3840720313},{"type":"v1","addr":"172.21.15.81:6819","nonce":3840720313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3840720313},{"type":"v1","addr":"172.21.15.81:6821","nonce":3840720313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3840720313},{"type":"v1","addr":"172.21.15.81:6825","nonce":3840720313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3840720313},{"type":"v1","addr":"172.21.15.81:6823","nonce":3840720313}]},"public_addr":"172.21.15.81:6819/3840720313","cluster_addr":"172.21.15.81:6821/3840720313","heartbeat_back_addr":"172.21.15.81:6825/3840720313","heartbeat_front_addr":"172.21.15.81:6823/3840720313","state":["exists","up"]},{"osd":3,"uuid":"722814fb-aeb5-4765-8440-05563f47c8ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":2727527147},{"type":"v1","addr":"172.21.15.156:6801","nonce":2727527147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":2727527147},{"type":"v1","addr":"172.21.15.156:6803","nonce":2727527147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":2727527147},{"type":"v1","addr":"172.21.15.156:6807","nonce":2727527147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":2727527147},{"type":"v1","addr":"172.21.15.156:6805","nonce":2727527147}]},"public_addr":"172.21.15.156:6801/2727527147","cluster_addr":"172.21.15.156:6803/2727527147","heartbeat_back_addr":"172.21.15.156:6807/2727527147","heartbeat_front_addr":"172.21.15.156:6805/2727527147","state":["exists","up"]},{"osd":4,"uuid":"2f660c6e-38d1-4982-9cba-46242bf2de6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":821376629},{"type":"v1","addr":"172.21.15.156:6809","nonce":821376629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":821376629},{"type":"v1","addr":"172.21.15.156:6811","nonce":821376629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":821376629},{"type":"v1","addr":"172.21.15.156:6815","nonce":821376629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":821376629},{"type":"v1","addr":"172.21.15.156:6813","nonce":821376629}]},"public_addr":"172.21.15.156:6809/821376629","cluster_addr":"172.21.15.156:6811/821376629","heartbeat_back_addr":"172.21.15.156:6815/821376629","heartbeat_front_addr":"172.21.15.156:6813/821376629","state":["exists","up"]},{"osd":5,"uuid":"82590b0d-f1e5-4491-b341-8db75ce2ea50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":4222896396},{"type":"v1","addr":"172.21.15.156:6817","nonce":4222896396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":4222896396},{"type":"v1","addr":"172.21.15.156:6819","nonce":4222896396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":4222896396},{"type":"v1","addr":"172.21.15.156:6823","nonce":4222896396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":4222896396},{"type":"v1","addr":"172.21.15.156:6821","nonce":4222896396}]},"public_addr":"172.21.15.156:6817/4222896396","cluster_addr":"172.21.15.156:6819/4222896396","heartbeat_back_addr":"172.21.15.156:6823/4222896396","heartbeat_front_addr":"172.21.15.156:6821/4222896396","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:16.189027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:52.737106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:42:29.838157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:03.041762+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:37.248449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:12.266170+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/3883051436":"2024-04-24T14:39:42.006227+0000","172.21.15.81:6800/3624015234":"2024-04-24T14:39:42.006227+0000","172.21.15.81:0/652570605":"2024-04-24T14:38:16.825251+0000","172.21.15.81:0/644202147":"2024-04-24T14:38:16.825251+0000","172.21.15.81:0/3173386887":"2024-04-24T14:38:16.825251+0000","172.21.15.81:0/4290566211":"2024-04-24T14:39:42.006227+0000","172.21.15.81:0/1308908574":"2024-04-24T14:39:42.006227+0000","172.21.15.81:0/2253455652":"2024-04-24T14:37:38.176351+0000","172.21.15.81:0/4004069135":"2024-04-24T14:37:38.176351+0000","172.21.15.81:6801/3624015234":"2024-04-24T14:39:42.006227+0000","172.21.15.81:6801/1764050360":"2024-04-24T14:37:38.176351+0000","172.21.15.81:6801/2072638798":"2024-04-24T14:38:16.825251+0000","172.21.15.81:0/3010656646":"2024-04-24T14:37:38.176351+0000","172.21.15.81:6800/1764050360":"2024-04-24T14:37:38.176351+0000","172.21.15.81:6800/2072638798":"2024-04-24T14:38:16.825251+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T14:44:42.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:42.102+0000 7f89f2200700 1 -- 172.21.15.81:0/1428207363 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f89d00692a0 msgr2=0x7f89d006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:42.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:42.102+0000 7f89f2200700 1 --2- 172.21.15.81:0/1428207363 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f89d00692a0 0x7f89d006b750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f89dc00b3b0 tx=0x7f89dc009e30 comp rx=0 tx=0).stop 2024-04-23T14:44:42.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:42.102+0000 7f89f2200700 1 -- 172.21.15.81:0/1428207363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89ec1037c0 msgr2=0x7f89ec070800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:42.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:42.102+0000 7f89f2200700 1 --2- 172.21.15.81:0/1428207363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89ec1037c0 0x7f89ec070800 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f89d8002a50 tx=0x7f89d8004600 comp rx=0 tx=0).stop 2024-04-23T14:44:42.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:42.103+0000 7f89f2200700 1 -- 172.21.15.81:0/1428207363 shutdown_connections 2024-04-23T14:44:42.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:42.103+0000 7f89f2200700 1 --2- 172.21.15.81:0/1428207363 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89ec102e20 0x7f89ec0702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:42.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:42.103+0000 7f89f2200700 1 --2- 172.21.15.81:0/1428207363 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f89d00692a0 0x7f89d006b750 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:42.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:42.103+0000 7f89f2200700 1 --2- 172.21.15.81:0/1428207363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89ec1037c0 0x7f89ec070800 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:42.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:42.103+0000 7f89f2200700 1 -- 172.21.15.81:0/1428207363 >> 172.21.15.81:0/1428207363 conn(0x7f89ec0f89b0 msgr2=0x7f89ec107410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:44:42.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:42.103+0000 7f89f2200700 1 -- 172.21.15.81:0/1428207363 shutdown_connections 2024-04-23T14:44:42.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:42.103+0000 7f89f2200700 1 -- 172.21.15.81:0/1428207363 wait complete. 2024-04-23T14:44:42.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:42 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:44:42.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:42 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/1428207363' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:44:42.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:42 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:44:42.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:42 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/1428207363' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:44:42.921 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-04-23T14:44:42.922 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-04-23T14:44:42.922 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-04-23T14:44:42.923 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-04-23T14:44:42.923 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-04-23T14:44:42.923 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-04-23T14:44:43.462 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:44:43.472 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:44:43.628 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:43 smithi081 ceph-mon[25540]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:43.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:43 smithi156 ceph-mon[32341]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:43.810 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:44:44.240 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:44:44.240 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:44:44.242 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:44:45.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:45 smithi081 ceph-mon[25540]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:45.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:45 smithi156 ceph-mon[32341]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:47.683 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:47 smithi081 ceph-mon[25540]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:47.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:47 smithi156 ceph-mon[32341]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:48.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.220+0000 7f0f87a00700 1 -- 172.21.15.81:0/174721843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f800656b0 msgr2=0x7f0f80065b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:48.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.220+0000 7f0f87a00700 1 --2- 172.21.15.81:0/174721843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f800656b0 0x7f0f80065b20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c004940 tx=0x7f0f6c009e30 comp rx=0 tx=0).stop 2024-04-23T14:44:48.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.220+0000 7f0f87a00700 1 -- 172.21.15.81:0/174721843 shutdown_connections 2024-04-23T14:44:48.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.220+0000 7f0f87a00700 1 --2- 172.21.15.81:0/174721843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f800656b0 0x7f0f80065b20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:48.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.220+0000 7f0f87a00700 1 --2- 172.21.15.81:0/174721843 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f80102e60 0x7f0f80103230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:48.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.220+0000 7f0f87a00700 1 -- 172.21.15.81:0/174721843 >> 172.21.15.81:0/174721843 conn(0x7f0f80072bc0 msgr2=0x7f0f80072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:44:48.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.220+0000 7f0f87a00700 1 -- 172.21.15.81:0/174721843 shutdown_connections 2024-04-23T14:44:48.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.221+0000 7f0f87a00700 1 -- 172.21.15.81:0/174721843 wait complete. 2024-04-23T14:44:48.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.221+0000 7f0f87a00700 1 Processor -- start 2024-04-23T14:44:48.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.221+0000 7f0f87a00700 1 -- start start 2024-04-23T14:44:48.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.222+0000 7f0f87a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f800656b0 0x7f0f80115d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:48.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.222+0000 7f0f87a00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f80102e60 0x7f0f801162a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:48.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.222+0000 7f0f87a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f801168f0 con 0x7f0f800656b0 2024-04-23T14:44:48.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.222+0000 7f0f87a00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8010fcc0 con 0x7f0f80102e60 2024-04-23T14:44:48.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.222+0000 7f0f85000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f800656b0 0x7f0f80115d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:48.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.222+0000 7f0f85000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f800656b0 0x7f0f80115d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46770/0 (socket says 172.21.15.81:46770) 2024-04-23T14:44:48.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.222+0000 7f0f85000700 1 -- 172.21.15.81:0/2068701852 learned_addr learned my addr 172.21.15.81:0/2068701852 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:44:48.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.223+0000 7f0f7fe00700 1 --2- 172.21.15.81:0/2068701852 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f80102e60 0x7f0f801162a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:48.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.223+0000 7f0f85000700 1 -- 172.21.15.81:0/2068701852 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f80102e60 msgr2=0x7f0f801162a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:48.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.223+0000 7f0f85000700 1 --2- 172.21.15.81:0/2068701852 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f80102e60 0x7f0f801162a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:48.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.223+0000 7f0f85000700 1 -- 172.21.15.81:0/2068701852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f6c005040 con 0x7f0f800656b0 2024-04-23T14:44:48.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.223+0000 7f0f85000700 1 --2- 172.21.15.81:0/2068701852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f800656b0 0x7f0f80115d60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0f7400c830 tx=0x7f0f74004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:44:48.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.223+0000 7f0f7cc00700 1 -- 172.21.15.81:0/2068701852 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f7400a760 con 0x7f0f800656b0 2024-04-23T14:44:48.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.223+0000 7f0f7cc00700 1 -- 172.21.15.81:0/2068701852 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0f7400ad90 con 0x7f0f800656b0 2024-04-23T14:44:48.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.223+0000 7f0f87a00700 1 -- 172.21.15.81:0/2068701852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f8010ffa0 con 0x7f0f800656b0 2024-04-23T14:44:48.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.223+0000 7f0f87a00700 1 -- 172.21.15.81:0/2068701852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f80110560 con 0x7f0f800656b0 2024-04-23T14:44:48.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.224+0000 7f0f7cc00700 1 -- 172.21.15.81:0/2068701852 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f740113a0 con 0x7f0f800656b0 2024-04-23T14:44:48.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.224+0000 7f0f87a00700 1 -- 172.21.15.81:0/2068701852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0f80110af0 con 0x7f0f800656b0 2024-04-23T14:44:48.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.226+0000 7f0f7cc00700 1 -- 172.21.15.81:0/2068701852 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f0f74012400 con 0x7f0f800656b0 2024-04-23T14:44:48.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.226+0000 7f0f7cc00700 1 --2- 172.21.15.81:0/2068701852 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f0f680692b0 0x7f0f6806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:48.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.227+0000 7f0f7cc00700 1 -- 172.21.15.81:0/2068701852 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0f74087980 con 0x7f0f800656b0 2024-04-23T14:44:48.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.227+0000 7f0f7fe00700 1 --2- 172.21.15.81:0/2068701852 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f0f680692b0 0x7f0f6806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:48.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.227+0000 7f0f7cc00700 1 --2- 172.21.15.81:0/2068701852 >> [v2:172.21.15.156:6808/821376629,v1:172.21.15.156:6809/821376629] conn(0x7f0f6806ef80 0x7f0f68071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:48.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.227+0000 7f0f7cc00700 1 -- 172.21.15.81:0/2068701852 --> [v2:172.21.15.156:6808/821376629,v1:172.21.15.156:6809/821376629] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0f68071a40 con 0x7f0f6806ef80 2024-04-23T14:44:48.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.227+0000 7f0f7cc00700 1 -- 172.21.15.81:0/2068701852 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f74087cc0 con 0x7f0f800656b0 2024-04-23T14:44:48.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.227+0000 7f0f7fe00700 1 --2- 172.21.15.81:0/2068701852 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f0f680692b0 0x7f0f6806b760 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c00b020 tx=0x7f0f6c009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:44:48.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.227+0000 7f0f85a00700 1 --2- 172.21.15.81:0/2068701852 >> [v2:172.21.15.156:6808/821376629,v1:172.21.15.156:6809/821376629] conn(0x7f0f6806ef80 0x7f0f68071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:48.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.229+0000 7f0f85a00700 1 --2- 172.21.15.81:0/2068701852 >> [v2:172.21.15.156:6808/821376629,v1:172.21.15.156:6809/821376629] conn(0x7f0f6806ef80 0x7f0f68071390 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:44:48.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.231+0000 7f0f7cc00700 1 -- 172.21.15.81:0/2068701852 <== osd.4 v2:172.21.15.156:6808/821376629 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f0f68071a40 con 0x7f0f6806ef80 2024-04-23T14:44:48.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.249+0000 7f0f87a00700 1 -- 172.21.15.81:0/2068701852 --> [v2:172.21.15.156:6808/821376629,v1:172.21.15.156:6809/821376629] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0f800fe570 con 0x7f0f6806ef80 2024-04-23T14:44:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.250+0000 7f0f7cc00700 1 -- 172.21.15.81:0/2068701852 <== osd.4 v2:172.21.15.156:6808/821376629 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f0f800fe570 con 0x7f0f6806ef80 2024-04-23T14:44:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.250+0000 7f0f87a00700 1 -- 172.21.15.81:0/2068701852 >> [v2:172.21.15.156:6808/821376629,v1:172.21.15.156:6809/821376629] conn(0x7f0f6806ef80 msgr2=0x7f0f68071390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.250+0000 7f0f87a00700 1 --2- 172.21.15.81:0/2068701852 >> [v2:172.21.15.156:6808/821376629,v1:172.21.15.156:6809/821376629] conn(0x7f0f6806ef80 0x7f0f68071390 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.250+0000 7f0f87a00700 1 -- 172.21.15.81:0/2068701852 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f0f680692b0 msgr2=0x7f0f6806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.250+0000 7f0f87a00700 1 --2- 172.21.15.81:0/2068701852 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f0f680692b0 0x7f0f6806b760 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c00b020 tx=0x7f0f6c009e30 comp rx=0 tx=0).stop 2024-04-23T14:44:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.250+0000 7f0f87a00700 1 -- 172.21.15.81:0/2068701852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f800656b0 msgr2=0x7f0f80115d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:48.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.250+0000 7f0f87a00700 1 --2- 172.21.15.81:0/2068701852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f800656b0 0x7f0f80115d60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0f7400c830 tx=0x7f0f74004470 comp rx=0 tx=0).stop 2024-04-23T14:44:48.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.251+0000 7f0f87a00700 1 -- 172.21.15.81:0/2068701852 shutdown_connections 2024-04-23T14:44:48.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.251+0000 7f0f87a00700 1 --2- 172.21.15.81:0/2068701852 >> [v2:172.21.15.156:6808/821376629,v1:172.21.15.156:6809/821376629] conn(0x7f0f6806ef80 0x7f0f68071390 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:48.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.251+0000 7f0f87a00700 1 --2- 172.21.15.81:0/2068701852 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f0f680692b0 0x7f0f6806b760 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:48.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.251+0000 7f0f87a00700 1 --2- 172.21.15.81:0/2068701852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f800656b0 0x7f0f80115d60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:48.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.251+0000 7f0f87a00700 1 --2- 172.21.15.81:0/2068701852 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f80102e60 0x7f0f801162a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:48.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.251+0000 7f0f87a00700 1 -- 172.21.15.81:0/2068701852 >> 172.21.15.81:0/2068701852 conn(0x7f0f80072bc0 msgr2=0x7f0f800fad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:44:48.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.251+0000 7f0f87a00700 1 -- 172.21.15.81:0/2068701852 shutdown_connections 2024-04-23T14:44:48.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:48.251+0000 7f0f87a00700 1 -- 172.21.15.81:0/2068701852 wait complete. 2024-04-23T14:44:49.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:49 smithi081 ceph-mon[25540]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:49.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:49 smithi156 ceph-mon[32341]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:50.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.623+0000 7f7fb9c00700 1 -- 172.21.15.81:0/1458071515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb4103460 msgr2=0x7f7fb41038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:50.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.623+0000 7f7fb9c00700 1 --2- 172.21.15.81:0/1458071515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb4103460 0x7f7fb41038d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0004940 tx=0x7f7fa0009e30 comp rx=0 tx=0).stop 2024-04-23T14:44:50.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.623+0000 7f7fb9c00700 1 -- 172.21.15.81:0/1458071515 shutdown_connections 2024-04-23T14:44:50.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.623+0000 7f7fb9c00700 1 --2- 172.21.15.81:0/1458071515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb4103460 0x7f7fb41038d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:50.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.623+0000 7f7fb9c00700 1 --2- 172.21.15.81:0/1458071515 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fb41094c0 0x7f7fb4109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:50.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.623+0000 7f7fb9c00700 1 -- 172.21.15.81:0/1458071515 >> 172.21.15.81:0/1458071515 conn(0x7f7fb4072c30 msgr2=0x7f7fb4075040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:44:50.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.623+0000 7f7fb9c00700 1 -- 172.21.15.81:0/1458071515 shutdown_connections 2024-04-23T14:44:50.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.623+0000 7f7fb9c00700 1 -- 172.21.15.81:0/1458071515 wait complete. 2024-04-23T14:44:50.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.624+0000 7f7fb9c00700 1 Processor -- start 2024-04-23T14:44:50.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.624+0000 7f7fb9c00700 1 -- start start 2024-04-23T14:44:50.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.625+0000 7f7fb9c00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fb4103460 0x7f7fb4119f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:50.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.625+0000 7f7fb9c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb41094c0 0x7f7fb411a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:50.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.625+0000 7f7fb9c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb411aaf0 con 0x7f7fb41094c0 2024-04-23T14:44:50.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.625+0000 7f7fb9c00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb4114110 con 0x7f7fb4103460 2024-04-23T14:44:50.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.625+0000 7f7fb2000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb41094c0 0x7f7fb411a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:50.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.625+0000 7f7fb2000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb41094c0 0x7f7fb411a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46788/0 (socket says 172.21.15.81:46788) 2024-04-23T14:44:50.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.625+0000 7f7fb2000700 1 -- 172.21.15.81:0/2880512795 learned_addr learned my addr 172.21.15.81:0/2880512795 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:44:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.625+0000 7f7fb2a00700 1 --2- 172.21.15.81:0/2880512795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fb4103460 0x7f7fb4119f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.625+0000 7f7fb2000700 1 -- 172.21.15.81:0/2880512795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fb4103460 msgr2=0x7f7fb4119f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.625+0000 7f7fb2000700 1 --2- 172.21.15.81:0/2880512795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fb4103460 0x7f7fb4119f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.625+0000 7f7fb2000700 1 -- 172.21.15.81:0/2880512795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa0005040 con 0x7f7fb41094c0 2024-04-23T14:44:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.626+0000 7f7fb2000700 1 --2- 172.21.15.81:0/2880512795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb41094c0 0x7f7fb411a4a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7fa000b8b0 tx=0x7f7fa0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:44:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.626+0000 7f7faaa00700 1 -- 172.21.15.81:0/2880512795 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fa000e040 con 0x7f7fb41094c0 2024-04-23T14:44:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.626+0000 7f7faaa00700 1 -- 172.21.15.81:0/2880512795 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7fa0004290 con 0x7f7fb41094c0 2024-04-23T14:44:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.626+0000 7f7fb9c00700 1 -- 172.21.15.81:0/2880512795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fb4114390 con 0x7f7fb41094c0 2024-04-23T14:44:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.626+0000 7f7faaa00700 1 -- 172.21.15.81:0/2880512795 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fa001c3f0 con 0x7f7fb41094c0 2024-04-23T14:44:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.626+0000 7f7fb9c00700 1 -- 172.21.15.81:0/2880512795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb4114950 con 0x7f7fb41094c0 2024-04-23T14:44:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.627+0000 7f7fb9c00700 1 -- 172.21.15.81:0/2880512795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7fb4114f80 con 0x7f7fb41094c0 2024-04-23T14:44:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.628+0000 7f7faaa00700 1 -- 172.21.15.81:0/2880512795 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f7fa00137b0 con 0x7f7fb41094c0 2024-04-23T14:44:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.629+0000 7f7faaa00700 1 --2- 172.21.15.81:0/2880512795 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f7f980692a0 0x7f7f9806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.629+0000 7f7faaa00700 1 -- 172.21.15.81:0/2880512795 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7fa00880a0 con 0x7f7fb41094c0 2024-04-23T14:44:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.629+0000 7f7fb2a00700 1 --2- 172.21.15.81:0/2880512795 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f7f980692a0 0x7f7f9806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.629+0000 7f7faaa00700 1 --2- 172.21.15.81:0/2880512795 >> [v2:172.21.15.81:6818/3840720313,v1:172.21.15.81:6819/3840720313] conn(0x7f7f9806ef70 0x7f7f98071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.629+0000 7f7faaa00700 1 -- 172.21.15.81:0/2880512795 --> [v2:172.21.15.81:6818/3840720313,v1:172.21.15.81:6819/3840720313] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7f98071a30 con 0x7f7f9806ef70 2024-04-23T14:44:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.629+0000 7f7faaa00700 1 -- 172.21.15.81:0/2880512795 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7fa008a6b0 con 0x7f7fb41094c0 2024-04-23T14:44:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.630+0000 7f7fb3400700 1 --2- 172.21.15.81:0/2880512795 >> [v2:172.21.15.81:6818/3840720313,v1:172.21.15.81:6819/3840720313] conn(0x7f7f9806ef70 0x7f7f98071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.630+0000 7f7fb2a00700 1 --2- 172.21.15.81:0/2880512795 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f7f980692a0 0x7f7f9806b750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4004d60 tx=0x7f7fa400b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:44:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.630+0000 7f7fb3400700 1 --2- 172.21.15.81:0/2880512795 >> [v2:172.21.15.81:6818/3840720313,v1:172.21.15.81:6819/3840720313] conn(0x7f7f9806ef70 0x7f7f98071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:44:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.631+0000 7f7faaa00700 1 -- 172.21.15.81:0/2880512795 <== osd.2 v2:172.21.15.81:6818/3840720313 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f7f98071a30 con 0x7f7f9806ef70 2024-04-23T14:44:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.647+0000 7f7fb9c00700 1 -- 172.21.15.81:0/2880512795 --> [v2:172.21.15.81:6818/3840720313,v1:172.21.15.81:6819/3840720313] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7fb4106580 con 0x7f7f9806ef70 2024-04-23T14:44:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.647+0000 7f7faaa00700 1 -- 172.21.15.81:0/2880512795 <== osd.2 v2:172.21.15.81:6818/3840720313 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7fb4106580 con 0x7f7f9806ef70 2024-04-23T14:44:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.648+0000 7f7fb9c00700 1 -- 172.21.15.81:0/2880512795 >> [v2:172.21.15.81:6818/3840720313,v1:172.21.15.81:6819/3840720313] conn(0x7f7f9806ef70 msgr2=0x7f7f98071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.648+0000 7f7fb9c00700 1 --2- 172.21.15.81:0/2880512795 >> [v2:172.21.15.81:6818/3840720313,v1:172.21.15.81:6819/3840720313] conn(0x7f7f9806ef70 0x7f7f98071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.648+0000 7f7fb9c00700 1 -- 172.21.15.81:0/2880512795 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f7f980692a0 msgr2=0x7f7f9806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.648+0000 7f7fb9c00700 1 --2- 172.21.15.81:0/2880512795 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f7f980692a0 0x7f7f9806b750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4004d60 tx=0x7f7fa400b040 comp rx=0 tx=0).stop 2024-04-23T14:44:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.648+0000 7f7fb9c00700 1 -- 172.21.15.81:0/2880512795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb41094c0 msgr2=0x7f7fb411a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.648+0000 7f7fb9c00700 1 --2- 172.21.15.81:0/2880512795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb41094c0 0x7f7fb411a4a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7fa000b8b0 tx=0x7f7fa0009e30 comp rx=0 tx=0).stop 2024-04-23T14:44:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.648+0000 7f7fb9c00700 1 -- 172.21.15.81:0/2880512795 shutdown_connections 2024-04-23T14:44:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.648+0000 7f7fb9c00700 1 --2- 172.21.15.81:0/2880512795 >> [v2:172.21.15.81:6818/3840720313,v1:172.21.15.81:6819/3840720313] conn(0x7f7f9806ef70 0x7f7f98071380 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.648+0000 7f7fb9c00700 1 --2- 172.21.15.81:0/2880512795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fb4103460 0x7f7fb4119f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:50.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.648+0000 7f7fb9c00700 1 --2- 172.21.15.81:0/2880512795 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f7f980692a0 0x7f7f9806b750 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:50.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.648+0000 7f7fb9c00700 1 --2- 172.21.15.81:0/2880512795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb41094c0 0x7f7fb411a4a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:50.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.648+0000 7f7fb9c00700 1 -- 172.21.15.81:0/2880512795 >> 172.21.15.81:0/2880512795 conn(0x7f7fb4072c30 msgr2=0x7f7fb4105c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:44:50.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.648+0000 7f7fb9c00700 1 -- 172.21.15.81:0/2880512795 shutdown_connections 2024-04-23T14:44:50.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:49.648+0000 7f7fb9c00700 1 -- 172.21.15.81:0/2880512795 wait complete. 2024-04-23T14:44:51.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:51 smithi081 ceph-mon[25540]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:51.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:51 smithi156 ceph-mon[32341]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:51.887 INFO:teuthology.orchestra.run.smithi081.stdout:150323855376 2024-04-23T14:44:51.887 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-04-23T14:44:53.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.364+0000 7f791ca00700 1 -- 172.21.15.81:0/1041966549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7918102e00 msgr2=0x7f79181031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:53.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.364+0000 7f791ca00700 1 --2- 172.21.15.81:0/1041966549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7918102e00 0x7f79181031d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7908004940 tx=0x7f7908009e30 comp rx=0 tx=0).stop 2024-04-23T14:44:53.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.364+0000 7f791ca00700 1 -- 172.21.15.81:0/1041966549 shutdown_connections 2024-04-23T14:44:53.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.364+0000 7f791ca00700 1 --2- 172.21.15.81:0/1041966549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79181037a0 0x7f79180fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:53.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.364+0000 7f791ca00700 1 --2- 172.21.15.81:0/1041966549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7918102e00 0x7f79181031d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:53.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.364+0000 7f791ca00700 1 -- 172.21.15.81:0/1041966549 >> 172.21.15.81:0/1041966549 conn(0x7f79180f8950 msgr2=0x7f79180fad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:44:53.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.364+0000 7f791ca00700 1 -- 172.21.15.81:0/1041966549 shutdown_connections 2024-04-23T14:44:53.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.364+0000 7f791ca00700 1 -- 172.21.15.81:0/1041966549 wait complete. 2024-04-23T14:44:53.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.365+0000 7f791ca00700 1 Processor -- start 2024-04-23T14:44:53.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.365+0000 7f791ca00700 1 -- start start 2024-04-23T14:44:53.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.366+0000 7f791ca00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7918102e00 0x7f79181139a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:53.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.366+0000 7f791ca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79181037a0 0x7f7918113ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:53.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.366+0000 7f791ca00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7918114530 con 0x7f79181037a0 2024-04-23T14:44:53.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.366+0000 7f791ca00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791810db30 con 0x7f7918102e00 2024-04-23T14:44:53.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.366+0000 7f7915400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79181037a0 0x7f7918113ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:53.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.366+0000 7f7915400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79181037a0 0x7f7918113ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46814/0 (socket says 172.21.15.81:46814) 2024-04-23T14:44:53.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.366+0000 7f7915400700 1 -- 172.21.15.81:0/896657434 learned_addr learned my addr 172.21.15.81:0/896657434 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:44:53.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.366+0000 7f7915e00700 1 --2- 172.21.15.81:0/896657434 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7918102e00 0x7f79181139a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:53.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.366+0000 7f7915400700 1 -- 172.21.15.81:0/896657434 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7918102e00 msgr2=0x7f79181139a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:53.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.367+0000 7f7915400700 1 --2- 172.21.15.81:0/896657434 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7918102e00 0x7f79181139a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:53.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.367+0000 7f7915400700 1 -- 172.21.15.81:0/896657434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7908005040 con 0x7f79181037a0 2024-04-23T14:44:53.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.367+0000 7f7915e00700 1 --2- 172.21.15.81:0/896657434 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7918102e00 0x7f79181139a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:44:53.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.367+0000 7f7915400700 1 --2- 172.21.15.81:0/896657434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79181037a0 0x7f7918113ee0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f790400c800 tx=0x7f7904004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:44:53.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.367+0000 7f790e000700 1 -- 172.21.15.81:0/896657434 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f790400a760 con 0x7f79181037a0 2024-04-23T14:44:53.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.367+0000 7f790e000700 1 -- 172.21.15.81:0/896657434 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f790400ad90 con 0x7f79181037a0 2024-04-23T14:44:53.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.367+0000 7f791ca00700 1 -- 172.21.15.81:0/896657434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f791810de10 con 0x7f79181037a0 2024-04-23T14:44:53.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.367+0000 7f790e000700 1 -- 172.21.15.81:0/896657434 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79040113a0 con 0x7f79181037a0 2024-04-23T14:44:53.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.367+0000 7f791ca00700 1 -- 172.21.15.81:0/896657434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f791810e3d0 con 0x7f79181037a0 2024-04-23T14:44:53.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.368+0000 7f791ca00700 1 -- 172.21.15.81:0/896657434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f791810e910 con 0x7f79181037a0 2024-04-23T14:44:53.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.369+0000 7f790e000700 1 -- 172.21.15.81:0/896657434 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f7904012400 con 0x7f79181037a0 2024-04-23T14:44:53.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.370+0000 7f790e000700 1 --2- 172.21.15.81:0/896657434 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f78fc0692a0 0x7f78fc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:53.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.370+0000 7f790e000700 1 -- 172.21.15.81:0/896657434 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7904086f80 con 0x7f79181037a0 2024-04-23T14:44:53.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.371+0000 7f7915e00700 1 --2- 172.21.15.81:0/896657434 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f78fc0692a0 0x7f78fc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:53.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.371+0000 7f790e000700 1 --2- 172.21.15.81:0/896657434 >> [v2:172.21.15.156:6800/2727527147,v1:172.21.15.156:6801/2727527147] conn(0x7f78fc06ef70 0x7f78fc071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:53.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.371+0000 7f790e000700 1 -- 172.21.15.81:0/896657434 --> [v2:172.21.15.156:6800/2727527147,v1:172.21.15.156:6801/2727527147] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f78fc071a30 con 0x7f78fc06ef70 2024-04-23T14:44:53.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.371+0000 7f790e000700 1 -- 172.21.15.81:0/896657434 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7904089540 con 0x7f79181037a0 2024-04-23T14:44:53.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.371+0000 7f7915e00700 1 --2- 172.21.15.81:0/896657434 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f78fc0692a0 0x7f78fc06b750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f790800b3b0 tx=0x7f7908009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:44:53.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.371+0000 7f7916800700 1 --2- 172.21.15.81:0/896657434 >> [v2:172.21.15.156:6800/2727527147,v1:172.21.15.156:6801/2727527147] conn(0x7f78fc06ef70 0x7f78fc071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:53.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.372+0000 7f7916800700 1 --2- 172.21.15.81:0/896657434 >> [v2:172.21.15.156:6800/2727527147,v1:172.21.15.156:6801/2727527147] conn(0x7f78fc06ef70 0x7f78fc071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:44:53.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.374+0000 7f790e000700 1 -- 172.21.15.81:0/896657434 <== osd.3 v2:172.21.15.156:6800/2727527147 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f78fc071a30 con 0x7f78fc06ef70 2024-04-23T14:44:53.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.391+0000 7f791ca00700 1 -- 172.21.15.81:0/896657434 --> [v2:172.21.15.156:6800/2727527147,v1:172.21.15.156:6801/2727527147] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f791805e6c0 con 0x7f78fc06ef70 2024-04-23T14:44:53.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.392+0000 7f790e000700 1 -- 172.21.15.81:0/896657434 <== osd.3 v2:172.21.15.156:6800/2727527147 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f791805e6c0 con 0x7f78fc06ef70 2024-04-23T14:44:53.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.393+0000 7f791ca00700 1 -- 172.21.15.81:0/896657434 >> [v2:172.21.15.156:6800/2727527147,v1:172.21.15.156:6801/2727527147] conn(0x7f78fc06ef70 msgr2=0x7f78fc071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:53.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.393+0000 7f791ca00700 1 --2- 172.21.15.81:0/896657434 >> [v2:172.21.15.156:6800/2727527147,v1:172.21.15.156:6801/2727527147] conn(0x7f78fc06ef70 0x7f78fc071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:53.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.393+0000 7f791ca00700 1 -- 172.21.15.81:0/896657434 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f78fc0692a0 msgr2=0x7f78fc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:53.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.393+0000 7f791ca00700 1 --2- 172.21.15.81:0/896657434 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f78fc0692a0 0x7f78fc06b750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f790800b3b0 tx=0x7f7908009e30 comp rx=0 tx=0).stop 2024-04-23T14:44:53.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.393+0000 7f791ca00700 1 -- 172.21.15.81:0/896657434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79181037a0 msgr2=0x7f7918113ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:53.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.393+0000 7f791ca00700 1 --2- 172.21.15.81:0/896657434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79181037a0 0x7f7918113ee0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f790400c800 tx=0x7f7904004470 comp rx=0 tx=0).stop 2024-04-23T14:44:53.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.393+0000 7f791ca00700 1 -- 172.21.15.81:0/896657434 shutdown_connections 2024-04-23T14:44:53.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.393+0000 7f791ca00700 1 --2- 172.21.15.81:0/896657434 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7918102e00 0x7f79181139a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:53.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.393+0000 7f791ca00700 1 --2- 172.21.15.81:0/896657434 >> [v2:172.21.15.156:6800/2727527147,v1:172.21.15.156:6801/2727527147] conn(0x7f78fc06ef70 0x7f78fc071380 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:53.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.393+0000 7f791ca00700 1 --2- 172.21.15.81:0/896657434 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f78fc0692a0 0x7f78fc06b750 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:53.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.393+0000 7f791ca00700 1 --2- 172.21.15.81:0/896657434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79181037a0 0x7f7918113ee0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:53.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.393+0000 7f791ca00700 1 -- 172.21.15.81:0/896657434 >> 172.21.15.81:0/896657434 conn(0x7f79180f8950 msgr2=0x7f79181073c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:44:53.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.393+0000 7f791ca00700 1 -- 172.21.15.81:0/896657434 shutdown_connections 2024-04-23T14:44:53.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:53.393+0000 7f791ca00700 1 -- 172.21.15.81:0/896657434 wait complete. 2024-04-23T14:44:53.462 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:53 smithi081 ceph-mon[25540]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:53.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:53 smithi156 ceph-mon[32341]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:54.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.105+0000 7f01f2200700 1 -- 172.21.15.81:0/79655511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01ec1094c0 msgr2=0x7f01ec109890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:54.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.105+0000 7f01f2200700 1 --2- 172.21.15.81:0/79655511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01ec1094c0 0x7f01ec109890 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f01dc004940 tx=0x7f01dc009e30 comp rx=0 tx=0).stop 2024-04-23T14:44:54.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.105+0000 7f01f2200700 1 -- 172.21.15.81:0/79655511 shutdown_connections 2024-04-23T14:44:54.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.105+0000 7f01f2200700 1 --2- 172.21.15.81:0/79655511 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01ec103460 0x7f01ec1038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:54.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.105+0000 7f01f2200700 1 --2- 172.21.15.81:0/79655511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01ec1094c0 0x7f01ec109890 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:54.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.105+0000 7f01f2200700 1 -- 172.21.15.81:0/79655511 >> 172.21.15.81:0/79655511 conn(0x7f01ec072c30 msgr2=0x7f01ec075040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:44:54.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.105+0000 7f01f2200700 1 -- 172.21.15.81:0/79655511 shutdown_connections 2024-04-23T14:44:54.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.106+0000 7f01f2200700 1 -- 172.21.15.81:0/79655511 wait complete. 2024-04-23T14:44:54.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.107+0000 7f01f2200700 1 Processor -- start 2024-04-23T14:44:54.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.107+0000 7f01f2200700 1 -- start start 2024-04-23T14:44:54.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.107+0000 7f01f2200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01ec103460 0x7f01ec11a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:54.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.107+0000 7f01f2200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01ec1094c0 0x7f01ec11a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:54.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.107+0000 7f01f2200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec11abb0 con 0x7f01ec103460 2024-04-23T14:44:54.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.107+0000 7f01f2200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec114190 con 0x7f01ec1094c0 2024-04-23T14:44:54.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.108+0000 7f01eb400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01ec103460 0x7f01ec11a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:54.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.108+0000 7f01eb400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01ec103460 0x7f01ec11a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55714/0 (socket says 172.21.15.81:55714) 2024-04-23T14:44:54.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.108+0000 7f01eb400700 1 -- 172.21.15.81:0/2739627360 learned_addr learned my addr 172.21.15.81:0/2739627360 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:44:54.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.108+0000 7f01eb400700 1 -- 172.21.15.81:0/2739627360 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01ec1094c0 msgr2=0x7f01ec11a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:54.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.108+0000 7f01eb400700 1 --2- 172.21.15.81:0/2739627360 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01ec1094c0 0x7f01ec11a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:54.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.108+0000 7f01eb400700 1 -- 172.21.15.81:0/2739627360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01dc005040 con 0x7f01ec103460 2024-04-23T14:44:54.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.108+0000 7f01eb400700 1 --2- 172.21.15.81:0/2739627360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01ec103460 0x7f01ec11a020 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f01dc009180 tx=0x7f01dc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:44:54.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.108+0000 7f01e3400700 1 -- 172.21.15.81:0/2739627360 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01dc00e040 con 0x7f01ec103460 2024-04-23T14:44:54.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.109+0000 7f01e3400700 1 -- 172.21.15.81:0/2739627360 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f01dc00bbc0 con 0x7f01ec103460 2024-04-23T14:44:54.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.109+0000 7f01f2200700 1 -- 172.21.15.81:0/2739627360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01ec114410 con 0x7f01ec103460 2024-04-23T14:44:54.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.109+0000 7f01e3400700 1 -- 172.21.15.81:0/2739627360 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01dc01c630 con 0x7f01ec103460 2024-04-23T14:44:54.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.109+0000 7f01f2200700 1 -- 172.21.15.81:0/2739627360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01ec114950 con 0x7f01ec103460 2024-04-23T14:44:54.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.109+0000 7f01f2200700 1 -- 172.21.15.81:0/2739627360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f01ec114ef0 con 0x7f01ec103460 2024-04-23T14:44:54.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.111+0000 7f01e3400700 1 -- 172.21.15.81:0/2739627360 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f01dc00bd30 con 0x7f01ec103460 2024-04-23T14:44:54.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.112+0000 7f01e3400700 1 --2- 172.21.15.81:0/2739627360 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f01d00692a0 0x7f01d006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:54.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.112+0000 7f01e3400700 1 -- 172.21.15.81:0/2739627360 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f01dc088d90 con 0x7f01ec103460 2024-04-23T14:44:54.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.112+0000 7f01eaa00700 1 --2- 172.21.15.81:0/2739627360 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f01d00692a0 0x7f01d006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:54.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.112+0000 7f01e3400700 1 --2- 172.21.15.81:0/2739627360 >> [v2:172.21.15.81:6802/3586146569,v1:172.21.15.81:6803/3586146569] conn(0x7f01d006ef70 0x7f01d0071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:54.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.112+0000 7f01e3400700 1 -- 172.21.15.81:0/2739627360 --> [v2:172.21.15.81:6802/3586146569,v1:172.21.15.81:6803/3586146569] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f01d0071a30 con 0x7f01d006ef70 2024-04-23T14:44:54.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.112+0000 7f01e3400700 1 -- 172.21.15.81:0/2739627360 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01dc0890d0 con 0x7f01ec103460 2024-04-23T14:44:54.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.112+0000 7f01ebe00700 1 --2- 172.21.15.81:0/2739627360 >> [v2:172.21.15.81:6802/3586146569,v1:172.21.15.81:6803/3586146569] conn(0x7f01d006ef70 0x7f01d0071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:54.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.113+0000 7f01eaa00700 1 --2- 172.21.15.81:0/2739627360 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f01d00692a0 0x7f01d006b750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f01ec1158c0 tx=0x7f01d8009ce0 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:44:54.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.113+0000 7f01ebe00700 1 --2- 172.21.15.81:0/2739627360 >> [v2:172.21.15.81:6802/3586146569,v1:172.21.15.81:6803/3586146569] conn(0x7f01d006ef70 0x7f01d0071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:44:54.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.114+0000 7f01e3400700 1 -- 172.21.15.81:0/2739627360 <== osd.0 v2:172.21.15.81:6802/3586146569 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f01d0071a30 con 0x7f01d006ef70 2024-04-23T14:44:54.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.130+0000 7f01f2200700 1 -- 172.21.15.81:0/2739627360 --> [v2:172.21.15.81:6802/3586146569,v1:172.21.15.81:6803/3586146569] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f01ec106610 con 0x7f01d006ef70 2024-04-23T14:44:54.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.131+0000 7f01e3400700 1 -- 172.21.15.81:0/2739627360 <== osd.0 v2:172.21.15.81:6802/3586146569 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f01ec106610 con 0x7f01d006ef70 2024-04-23T14:44:54.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.131+0000 7f01f2200700 1 -- 172.21.15.81:0/2739627360 >> [v2:172.21.15.81:6802/3586146569,v1:172.21.15.81:6803/3586146569] conn(0x7f01d006ef70 msgr2=0x7f01d0071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:54.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.131+0000 7f01f2200700 1 --2- 172.21.15.81:0/2739627360 >> [v2:172.21.15.81:6802/3586146569,v1:172.21.15.81:6803/3586146569] conn(0x7f01d006ef70 0x7f01d0071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:54.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.131+0000 7f01f2200700 1 -- 172.21.15.81:0/2739627360 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f01d00692a0 msgr2=0x7f01d006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:54.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.131+0000 7f01f2200700 1 --2- 172.21.15.81:0/2739627360 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f01d00692a0 0x7f01d006b750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f01ec1158c0 tx=0x7f01d8009ce0 comp rx=0 tx=0).stop 2024-04-23T14:44:54.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.131+0000 7f01f2200700 1 -- 172.21.15.81:0/2739627360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01ec103460 msgr2=0x7f01ec11a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:54.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.131+0000 7f01f2200700 1 --2- 172.21.15.81:0/2739627360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01ec103460 0x7f01ec11a020 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f01dc009180 tx=0x7f01dc009e30 comp rx=0 tx=0).stop 2024-04-23T14:44:54.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.131+0000 7f01f2200700 1 -- 172.21.15.81:0/2739627360 shutdown_connections 2024-04-23T14:44:54.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.131+0000 7f01f2200700 1 --2- 172.21.15.81:0/2739627360 >> [v2:172.21.15.81:6802/3586146569,v1:172.21.15.81:6803/3586146569] conn(0x7f01d006ef70 0x7f01d0071380 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:54.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.131+0000 7f01f2200700 1 --2- 172.21.15.81:0/2739627360 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f01d00692a0 0x7f01d006b750 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:54.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.131+0000 7f01f2200700 1 --2- 172.21.15.81:0/2739627360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01ec103460 0x7f01ec11a020 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:54.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.131+0000 7f01f2200700 1 --2- 172.21.15.81:0/2739627360 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01ec1094c0 0x7f01ec11a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:54.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.131+0000 7f01f2200700 1 -- 172.21.15.81:0/2739627360 >> 172.21.15.81:0/2739627360 conn(0x7f01ec072c30 msgr2=0x7f01ec105c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:44:54.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.132+0000 7f01f2200700 1 -- 172.21.15.81:0/2739627360 shutdown_connections 2024-04-23T14:44:54.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:54.132+0000 7f01f2200700 1 -- 172.21.15.81:0/2739627360 wait complete. 2024-04-23T14:44:54.685 INFO:teuthology.orchestra.run.smithi081.stdout:81604378653 2024-04-23T14:44:54.686 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-04-23T14:44:55.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.027+0000 7f56d0200700 1 -- 172.21.15.81:0/1007370986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56c81037c0 msgr2=0x7f56c80fce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:55.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.027+0000 7f56d0200700 1 --2- 172.21.15.81:0/1007370986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56c81037c0 0x7f56c80fce30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f56b4004940 tx=0x7f56b4009e30 comp rx=0 tx=0).stop 2024-04-23T14:44:55.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.027+0000 7f56d0200700 1 -- 172.21.15.81:0/1007370986 shutdown_connections 2024-04-23T14:44:55.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.027+0000 7f56d0200700 1 --2- 172.21.15.81:0/1007370986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56c81037c0 0x7f56c80fce30 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:55.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.027+0000 7f56d0200700 1 --2- 172.21.15.81:0/1007370986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56c8102e20 0x7f56c81031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:55.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.027+0000 7f56d0200700 1 -- 172.21.15.81:0/1007370986 >> 172.21.15.81:0/1007370986 conn(0x7f56c80f89d0 msgr2=0x7f56c80fade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:44:55.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.027+0000 7f56d0200700 1 -- 172.21.15.81:0/1007370986 shutdown_connections 2024-04-23T14:44:55.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.027+0000 7f56d0200700 1 -- 172.21.15.81:0/1007370986 wait complete. 2024-04-23T14:44:55.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.028+0000 7f56d0200700 1 Processor -- start 2024-04-23T14:44:55.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.028+0000 7f56d0200700 1 -- start start 2024-04-23T14:44:55.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.029+0000 7f56d0200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56c8102e20 0x7f56c8115da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:55.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.029+0000 7f56d0200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56c81037c0 0x7f56c81162e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:55.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.029+0000 7f56d0200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c8116930 con 0x7f56c81037c0 2024-04-23T14:44:55.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.029+0000 7f56d0200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c810fd00 con 0x7f56c8102e20 2024-04-23T14:44:55.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.029+0000 7f56cce00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56c81037c0 0x7f56c81162e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:55.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.029+0000 7f56cce00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56c81037c0 0x7f56c81162e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55734/0 (socket says 172.21.15.81:55734) 2024-04-23T14:44:55.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.029+0000 7f56cce00700 1 -- 172.21.15.81:0/1721533871 learned_addr learned my addr 172.21.15.81:0/1721533871 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:44:55.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.029+0000 7f56cd800700 1 --2- 172.21.15.81:0/1721533871 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56c8102e20 0x7f56c8115da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:55.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.030+0000 7f56cce00700 1 -- 172.21.15.81:0/1721533871 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56c8102e20 msgr2=0x7f56c8115da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:55.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.030+0000 7f56cce00700 1 --2- 172.21.15.81:0/1721533871 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56c8102e20 0x7f56c8115da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:55.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.030+0000 7f56cce00700 1 -- 172.21.15.81:0/1721533871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b4005040 con 0x7f56c81037c0 2024-04-23T14:44:55.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.030+0000 7f56cce00700 1 --2- 172.21.15.81:0/1721533871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56c81037c0 0x7f56c81162e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f56b4009100 tx=0x7f56b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:44:55.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.030+0000 7f56c5600700 1 -- 172.21.15.81:0/1721533871 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56b400e040 con 0x7f56c81037c0 2024-04-23T14:44:55.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.030+0000 7f56c5600700 1 -- 172.21.15.81:0/1721533871 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f56b4013420 con 0x7f56c81037c0 2024-04-23T14:44:55.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.030+0000 7f56d0200700 1 -- 172.21.15.81:0/1721533871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56c810ff80 con 0x7f56c81037c0 2024-04-23T14:44:55.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.030+0000 7f56c5600700 1 -- 172.21.15.81:0/1721533871 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56b401c630 con 0x7f56c81037c0 2024-04-23T14:44:55.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.031+0000 7f56d0200700 1 -- 172.21.15.81:0/1721533871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c8110540 con 0x7f56c81037c0 2024-04-23T14:44:55.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.032+0000 7f56d0200700 1 -- 172.21.15.81:0/1721533871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f56c8110a70 con 0x7f56c81037c0 2024-04-23T14:44:55.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.033+0000 7f56c5600700 1 -- 172.21.15.81:0/1721533871 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f56b4013a00 con 0x7f56c81037c0 2024-04-23T14:44:55.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.034+0000 7f56c5600700 1 --2- 172.21.15.81:0/1721533871 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f56b00692b0 0x7f56b006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:55.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.034+0000 7f56c5600700 1 -- 172.21.15.81:0/1721533871 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f56b4087f20 con 0x7f56c81037c0 2024-04-23T14:44:55.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.034+0000 7f56cd800700 1 --2- 172.21.15.81:0/1721533871 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f56b00692b0 0x7f56b006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:55.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.034+0000 7f56c5600700 1 --2- 172.21.15.81:0/1721533871 >> [v2:172.21.15.81:6810/48369012,v1:172.21.15.81:6811/48369012] conn(0x7f56b006ef80 0x7f56b0071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:55.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.034+0000 7f56c5600700 1 -- 172.21.15.81:0/1721533871 --> [v2:172.21.15.81:6810/48369012,v1:172.21.15.81:6811/48369012] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f56b0071a40 con 0x7f56b006ef80 2024-04-23T14:44:55.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.034+0000 7f56c5600700 1 -- 172.21.15.81:0/1721533871 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f56b408d490 con 0x7f56c81037c0 2024-04-23T14:44:55.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.035+0000 7f56ce200700 1 --2- 172.21.15.81:0/1721533871 >> [v2:172.21.15.81:6810/48369012,v1:172.21.15.81:6811/48369012] conn(0x7f56b006ef80 0x7f56b0071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:55.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.035+0000 7f56cd800700 1 --2- 172.21.15.81:0/1721533871 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f56b00692b0 0x7f56b006b760 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f56bc004f40 tx=0x7f56bc00b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:44:55.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.035+0000 7f56ce200700 1 --2- 172.21.15.81:0/1721533871 >> [v2:172.21.15.81:6810/48369012,v1:172.21.15.81:6811/48369012] conn(0x7f56b006ef80 0x7f56b0071390 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:44:55.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.037+0000 7f56c5600700 1 -- 172.21.15.81:0/1721533871 <== osd.1 v2:172.21.15.81:6810/48369012 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f56b0071a40 con 0x7f56b006ef80 2024-04-23T14:44:55.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.054+0000 7f56d0200700 1 -- 172.21.15.81:0/1721533871 --> [v2:172.21.15.81:6810/48369012,v1:172.21.15.81:6811/48369012] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f56c805e640 con 0x7f56b006ef80 2024-04-23T14:44:55.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.054+0000 7f56c5600700 1 -- 172.21.15.81:0/1721533871 <== osd.1 v2:172.21.15.81:6810/48369012 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f56c805e640 con 0x7f56b006ef80 2024-04-23T14:44:55.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.055+0000 7f56d0200700 1 -- 172.21.15.81:0/1721533871 >> [v2:172.21.15.81:6810/48369012,v1:172.21.15.81:6811/48369012] conn(0x7f56b006ef80 msgr2=0x7f56b0071390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:55.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.055+0000 7f56d0200700 1 --2- 172.21.15.81:0/1721533871 >> [v2:172.21.15.81:6810/48369012,v1:172.21.15.81:6811/48369012] conn(0x7f56b006ef80 0x7f56b0071390 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:55.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.055+0000 7f56d0200700 1 -- 172.21.15.81:0/1721533871 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f56b00692b0 msgr2=0x7f56b006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:55.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.055+0000 7f56d0200700 1 --2- 172.21.15.81:0/1721533871 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f56b00692b0 0x7f56b006b760 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f56bc004f40 tx=0x7f56bc00b040 comp rx=0 tx=0).stop 2024-04-23T14:44:55.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.055+0000 7f56d0200700 1 -- 172.21.15.81:0/1721533871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56c81037c0 msgr2=0x7f56c81162e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:55.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.055+0000 7f56d0200700 1 --2- 172.21.15.81:0/1721533871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56c81037c0 0x7f56c81162e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f56b4009100 tx=0x7f56b4009e30 comp rx=0 tx=0).stop 2024-04-23T14:44:55.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.055+0000 7f56d0200700 1 -- 172.21.15.81:0/1721533871 shutdown_connections 2024-04-23T14:44:55.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.055+0000 7f56d0200700 1 --2- 172.21.15.81:0/1721533871 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56c8102e20 0x7f56c8115da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:55.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.055+0000 7f56d0200700 1 --2- 172.21.15.81:0/1721533871 >> [v2:172.21.15.81:6810/48369012,v1:172.21.15.81:6811/48369012] conn(0x7f56b006ef80 0x7f56b0071390 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:55.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.055+0000 7f56d0200700 1 --2- 172.21.15.81:0/1721533871 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f56b00692b0 0x7f56b006b760 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:55.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.055+0000 7f56d0200700 1 --2- 172.21.15.81:0/1721533871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56c81037c0 0x7f56c81162e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:55.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.055+0000 7f56d0200700 1 -- 172.21.15.81:0/1721533871 >> 172.21.15.81:0/1721533871 conn(0x7f56c80f89d0 msgr2=0x7f56c8070be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:44:55.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.055+0000 7f56d0200700 1 -- 172.21.15.81:0/1721533871 shutdown_connections 2024-04-23T14:44:55.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:55.055+0000 7f56d0200700 1 -- 172.21.15.81:0/1721533871 wait complete. 2024-04-23T14:44:55.497 INFO:teuthology.orchestra.run.smithi081.stdout:38654705711 2024-04-23T14:44:55.497 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-04-23T14:44:55.574 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:55 smithi081 ceph-mon[25540]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:55.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:55 smithi156 ceph-mon[32341]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:56.204 INFO:teuthology.orchestra.run.smithi081.stdout:115964117017 2024-04-23T14:44:56.204 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-04-23T14:44:56.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.700+0000 7fb739000700 1 -- 172.21.15.81:0/1723803402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb734070c70 msgr2=0x7fb734108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:56.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.700+0000 7fb739000700 1 --2- 172.21.15.81:0/1723803402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb734070c70 0x7fb734108f60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb720004970 tx=0x7fb720009e30 comp rx=0 tx=0).stop 2024-04-23T14:44:56.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.700+0000 7fb739000700 1 -- 172.21.15.81:0/1723803402 shutdown_connections 2024-04-23T14:44:56.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.700+0000 7fb739000700 1 --2- 172.21.15.81:0/1723803402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb734070c70 0x7fb734108f60 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:56.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.700+0000 7fb739000700 1 --2- 172.21.15.81:0/1723803402 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb734070360 0x7fb734070730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:56.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.700+0000 7fb739000700 1 -- 172.21.15.81:0/1723803402 >> 172.21.15.81:0/1723803402 conn(0x7fb7340f87e0 msgr2=0x7fb7340fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:44:56.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.700+0000 7fb739000700 1 -- 172.21.15.81:0/1723803402 shutdown_connections 2024-04-23T14:44:56.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.700+0000 7fb739000700 1 -- 172.21.15.81:0/1723803402 wait complete. 2024-04-23T14:44:56.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.701+0000 7fb739000700 1 Processor -- start 2024-04-23T14:44:56.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.701+0000 7fb739000700 1 -- start start 2024-04-23T14:44:56.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.701+0000 7fb739000700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb734070360 0x7fb734115b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:56.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.701+0000 7fb739000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb734070c70 0x7fb7341160d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:56.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.701+0000 7fb739000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb734116720 con 0x7fb734070c70 2024-04-23T14:44:56.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.701+0000 7fb739000700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73410fb30 con 0x7fb734070360 2024-04-23T14:44:56.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.702+0000 7fb732a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb734070c70 0x7fb7341160d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:56.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.702+0000 7fb732a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb734070c70 0x7fb7341160d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55742/0 (socket says 172.21.15.81:55742) 2024-04-23T14:44:56.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.702+0000 7fb732a00700 1 -- 172.21.15.81:0/3082653627 learned_addr learned my addr 172.21.15.81:0/3082653627 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:44:56.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.702+0000 7fb733400700 1 --2- 172.21.15.81:0/3082653627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb734070360 0x7fb734115b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:56.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.702+0000 7fb732a00700 1 -- 172.21.15.81:0/3082653627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb734070360 msgr2=0x7fb734115b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:56.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.702+0000 7fb732a00700 1 --2- 172.21.15.81:0/3082653627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb734070360 0x7fb734115b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:56.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.702+0000 7fb732a00700 1 -- 172.21.15.81:0/3082653627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb720005040 con 0x7fb734070c70 2024-04-23T14:44:56.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.702+0000 7fb733400700 1 --2- 172.21.15.81:0/3082653627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb734070360 0x7fb734115b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:44:56.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.702+0000 7fb732a00700 1 --2- 172.21.15.81:0/3082653627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb734070c70 0x7fb7341160d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb720000c00 tx=0x7fb720009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:44:56.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.703+0000 7fb72b400700 1 -- 172.21.15.81:0/3082653627 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb72000e040 con 0x7fb734070c70 2024-04-23T14:44:56.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.703+0000 7fb72b400700 1 -- 172.21.15.81:0/3082653627 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb72000bc10 con 0x7fb734070c70 2024-04-23T14:44:56.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.703+0000 7fb72b400700 1 -- 172.21.15.81:0/3082653627 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb72001c3f0 con 0x7fb734070c70 2024-04-23T14:44:56.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.703+0000 7fb739000700 1 -- 172.21.15.81:0/3082653627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb73410fdb0 con 0x7fb734070c70 2024-04-23T14:44:56.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.703+0000 7fb739000700 1 -- 172.21.15.81:0/3082653627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7341102f0 con 0x7fb734070c70 2024-04-23T14:44:56.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.704+0000 7fb739000700 1 -- 172.21.15.81:0/3082653627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb734110790 con 0x7fb734070c70 2024-04-23T14:44:56.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.705+0000 7fb72b400700 1 -- 172.21.15.81:0/3082653627 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fb72000bd80 con 0x7fb734070c70 2024-04-23T14:44:56.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.706+0000 7fb72b400700 1 --2- 172.21.15.81:0/3082653627 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fb7180692a0 0x7fb71806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:56.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.706+0000 7fb72b400700 1 -- 172.21.15.81:0/3082653627 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb720088240 con 0x7fb734070c70 2024-04-23T14:44:56.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.706+0000 7fb733400700 1 --2- 172.21.15.81:0/3082653627 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fb7180692a0 0x7fb71806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:56.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.706+0000 7fb72b400700 1 --2- 172.21.15.81:0/3082653627 >> [v2:172.21.15.156:6816/4222896396,v1:172.21.15.156:6817/4222896396] conn(0x7fb71806ef70 0x7fb718071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:44:56.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.706+0000 7fb72b400700 1 -- 172.21.15.81:0/3082653627 --> [v2:172.21.15.156:6816/4222896396,v1:172.21.15.156:6817/4222896396] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb718071a30 con 0x7fb71806ef70 2024-04-23T14:44:56.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.706+0000 7fb72b400700 1 -- 172.21.15.81:0/3082653627 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb72008a790 con 0x7fb734070c70 2024-04-23T14:44:56.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.707+0000 7fb733e00700 1 --2- 172.21.15.81:0/3082653627 >> [v2:172.21.15.156:6816/4222896396,v1:172.21.15.156:6817/4222896396] conn(0x7fb71806ef70 0x7fb718071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:44:56.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.707+0000 7fb733400700 1 --2- 172.21.15.81:0/3082653627 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fb7180692a0 0x7fb71806b750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb724007fd0 tx=0x7fb724009040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:44:56.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.708+0000 7fb733e00700 1 --2- 172.21.15.81:0/3082653627 >> [v2:172.21.15.156:6816/4222896396,v1:172.21.15.156:6817/4222896396] conn(0x7fb71806ef70 0x7fb718071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:44:56.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.710+0000 7fb72b400700 1 -- 172.21.15.81:0/3082653627 <== osd.5 v2:172.21.15.156:6816/4222896396 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fb718071a30 con 0x7fb71806ef70 2024-04-23T14:44:56.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.726+0000 7fb739000700 1 -- 172.21.15.81:0/3082653627 --> [v2:172.21.15.156:6816/4222896396,v1:172.21.15.156:6817/4222896396] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb734104470 con 0x7fb71806ef70 2024-04-23T14:44:56.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.727+0000 7fb72b400700 1 -- 172.21.15.81:0/3082653627 <== osd.5 v2:172.21.15.156:6816/4222896396 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fb734104470 con 0x7fb71806ef70 2024-04-23T14:44:56.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.727+0000 7fb739000700 1 -- 172.21.15.81:0/3082653627 >> [v2:172.21.15.156:6816/4222896396,v1:172.21.15.156:6817/4222896396] conn(0x7fb71806ef70 msgr2=0x7fb718071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:56.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.727+0000 7fb739000700 1 --2- 172.21.15.81:0/3082653627 >> [v2:172.21.15.156:6816/4222896396,v1:172.21.15.156:6817/4222896396] conn(0x7fb71806ef70 0x7fb718071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:56.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.728+0000 7fb739000700 1 -- 172.21.15.81:0/3082653627 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fb7180692a0 msgr2=0x7fb71806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:56.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.728+0000 7fb739000700 1 --2- 172.21.15.81:0/3082653627 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fb7180692a0 0x7fb71806b750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb724007fd0 tx=0x7fb724009040 comp rx=0 tx=0).stop 2024-04-23T14:44:56.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.728+0000 7fb739000700 1 -- 172.21.15.81:0/3082653627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb734070c70 msgr2=0x7fb7341160d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:44:56.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.728+0000 7fb739000700 1 --2- 172.21.15.81:0/3082653627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb734070c70 0x7fb7341160d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb720000c00 tx=0x7fb720009e30 comp rx=0 tx=0).stop 2024-04-23T14:44:56.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.728+0000 7fb739000700 1 -- 172.21.15.81:0/3082653627 shutdown_connections 2024-04-23T14:44:56.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.728+0000 7fb739000700 1 --2- 172.21.15.81:0/3082653627 >> [v2:172.21.15.156:6816/4222896396,v1:172.21.15.156:6817/4222896396] conn(0x7fb71806ef70 0x7fb718071380 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:56.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.728+0000 7fb739000700 1 --2- 172.21.15.81:0/3082653627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb734070360 0x7fb734115b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:56.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.728+0000 7fb739000700 1 --2- 172.21.15.81:0/3082653627 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fb7180692a0 0x7fb71806b750 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:56.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.728+0000 7fb739000700 1 --2- 172.21.15.81:0/3082653627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb734070c70 0x7fb7341160d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:44:56.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.728+0000 7fb739000700 1 -- 172.21.15.81:0/3082653627 >> 172.21.15.81:0/3082653627 conn(0x7fb7340f87e0 msgr2=0x7fb734105810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:44:56.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.728+0000 7fb739000700 1 -- 172.21.15.81:0/3082653627 shutdown_connections 2024-04-23T14:44:56.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:44:56.728+0000 7fb739000700 1 -- 172.21.15.81:0/3082653627 wait complete. 2024-04-23T14:44:57.074 INFO:teuthology.orchestra.run.smithi081.stdout:60129542182 2024-04-23T14:44:57.075 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-04-23T14:44:57.746 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:57 smithi081 ceph-mon[25540]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:57.746 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:57 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:44:57.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:57 smithi156 ceph-mon[32341]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:57.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:57 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:44:57.815 INFO:teuthology.orchestra.run.smithi081.stdout:171798691852 2024-04-23T14:44:57.815 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-04-23T14:44:57.843 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:44:57.843 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:44:57.857 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:44:57.871 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:44:58.721 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:44:59.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:44:59 smithi081 ceph-mon[25540]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:44:59.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:44:59 smithi156 ceph-mon[32341]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:01.729 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:01 smithi081 ceph-mon[25540]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:01.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:01 smithi156 ceph-mon[32341]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:02.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:02.936+0000 7f385d000700 1 -- 172.21.15.81:0/4140872448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38581059d0 msgr2=0x7f38580ff090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:02.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:02.936+0000 7f385d000700 1 --2- 172.21.15.81:0/4140872448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38581059d0 0x7f38580ff090 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3840004940 tx=0x7f3840009e30 comp rx=0 tx=0).stop 2024-04-23T14:45:02.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:02.936+0000 7f385d000700 1 -- 172.21.15.81:0/4140872448 shutdown_connections 2024-04-23T14:45:02.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:02.936+0000 7f385d000700 1 --2- 172.21.15.81:0/4140872448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38581059d0 0x7f38580ff090 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:02.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:02.936+0000 7f385d000700 1 --2- 172.21.15.81:0/4140872448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3858105030 0x7f3858105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:02.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:02.936+0000 7f385d000700 1 -- 172.21.15.81:0/4140872448 >> 172.21.15.81:0/4140872448 conn(0x7f38580fabd0 msgr2=0x7f38580fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:45:02.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:02.936+0000 7f385d000700 1 -- 172.21.15.81:0/4140872448 shutdown_connections 2024-04-23T14:45:02.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:02.936+0000 7f385d000700 1 -- 172.21.15.81:0/4140872448 wait complete. 2024-04-23T14:45:02.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:02.937+0000 7f385d000700 1 Processor -- start 2024-04-23T14:45:02.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:02.937+0000 7f385d000700 1 -- start start 2024-04-23T14:45:02.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:02.937+0000 7f385d000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3858105030 0x7f3858115ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:02.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:02.937+0000 7f385d000700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38581059d0 0x7f38581160e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:02.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:02.937+0000 7f385d000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38581167c0 con 0x7f3858105030 2024-04-23T14:45:02.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:02.937+0000 7f385d000700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385810fd10 con 0x7f38581059d0 2024-04-23T14:45:02.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:02.938+0000 7f3855e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3858105030 0x7f3858115ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:02.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:02.938+0000 7f3855e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3858105030 0x7f3858115ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55752/0 (socket says 172.21.15.81:55752) 2024-04-23T14:45:02.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:02.938+0000 7f3855e00700 1 -- 172.21.15.81:0/2088986209 learned_addr learned my addr 172.21.15.81:0/2088986209 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:45:02.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:02.938+0000 7f3855400700 1 --2- 172.21.15.81:0/2088986209 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38581059d0 0x7f38581160e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:02.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:02.938+0000 7f3855e00700 1 -- 172.21.15.81:0/2088986209 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38581059d0 msgr2=0x7f38581160e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:02.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:02.938+0000 7f3855e00700 1 --2- 172.21.15.81:0/2088986209 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38581059d0 0x7f38581160e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:02.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:02.938+0000 7f3855e00700 1 -- 172.21.15.81:0/2088986209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3840005040 con 0x7f3858105030 2024-04-23T14:45:02.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:02.938+0000 7f3855e00700 1 --2- 172.21.15.81:0/2088986209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3858105030 0x7f3858115ba0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f384800b790 tx=0x7f3848009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:45:02.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:02.939+0000 7f384e000700 1 -- 172.21.15.81:0/2088986209 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f384800f770 con 0x7f3858105030 2024-04-23T14:45:02.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:02.939+0000 7f384e000700 1 -- 172.21.15.81:0/2088986209 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f384800fda0 con 0x7f3858105030 2024-04-23T14:45:02.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:02.939+0000 7f385d000700 1 -- 172.21.15.81:0/2088986209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f385810ff90 con 0x7f3858105030 2024-04-23T14:45:02.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:02.939+0000 7f384e000700 1 -- 172.21.15.81:0/2088986209 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f384800d310 con 0x7f3858105030 2024-04-23T14:45:02.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:02.939+0000 7f385d000700 1 -- 172.21.15.81:0/2088986209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3858110550 con 0x7f3858105030 2024-04-23T14:45:02.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:02.940+0000 7f385d000700 1 -- 172.21.15.81:0/2088986209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3858100780 con 0x7f3858105030 2024-04-23T14:45:02.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:02.941+0000 7f384e000700 1 -- 172.21.15.81:0/2088986209 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f3848010420 con 0x7f3858105030 2024-04-23T14:45:02.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:02.942+0000 7f384e000700 1 --2- 172.21.15.81:0/2088986209 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f383c0692a0 0x7f383c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:02.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:02.942+0000 7f384e000700 1 -- 172.21.15.81:0/2088986209 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3848087610 con 0x7f3858105030 2024-04-23T14:45:02.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:02.942+0000 7f3855400700 1 --2- 172.21.15.81:0/2088986209 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f383c0692a0 0x7f383c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:02.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:02.943+0000 7f3855400700 1 --2- 172.21.15.81:0/2088986209 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f383c0692a0 0x7f383c06b750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f384000b3b0 tx=0x7f3840009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:45:02.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:02.946+0000 7f384e000700 1 -- 172.21.15.81:0/2088986209 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f38480576f0 con 0x7f3858105030 2024-04-23T14:45:03.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:03.162+0000 7f385d000700 1 -- 172.21.15.81:0/2088986209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f385804c710 con 0x7f3858105030 2024-04-23T14:45:03.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:03.163+0000 7f384e000700 1 -- 172.21.15.81:0/2088986209 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3848057280 con 0x7f3858105030 2024-04-23T14:45:03.164 INFO:teuthology.orchestra.run.smithi081.stdout:115964117019 2024-04-23T14:45:03.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:03.165+0000 7f385d000700 1 -- 172.21.15.81:0/2088986209 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f383c0692a0 msgr2=0x7f383c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:03.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:03.165+0000 7f385d000700 1 --2- 172.21.15.81:0/2088986209 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f383c0692a0 0x7f383c06b750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f384000b3b0 tx=0x7f3840009e30 comp rx=0 tx=0).stop 2024-04-23T14:45:03.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:03.165+0000 7f385d000700 1 -- 172.21.15.81:0/2088986209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3858105030 msgr2=0x7f3858115ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:03.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:03.165+0000 7f385d000700 1 --2- 172.21.15.81:0/2088986209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3858105030 0x7f3858115ba0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f384800b790 tx=0x7f3848009250 comp rx=0 tx=0).stop 2024-04-23T14:45:03.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:03.166+0000 7f385d000700 1 -- 172.21.15.81:0/2088986209 shutdown_connections 2024-04-23T14:45:03.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:03.166+0000 7f385d000700 1 --2- 172.21.15.81:0/2088986209 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f383c0692a0 0x7f383c06b750 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:03.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:03.166+0000 7f385d000700 1 --2- 172.21.15.81:0/2088986209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3858105030 0x7f3858115ba0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:03.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:03.166+0000 7f385d000700 1 --2- 172.21.15.81:0/2088986209 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38581059d0 0x7f38581160e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:03.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:03.166+0000 7f385d000700 1 -- 172.21.15.81:0/2088986209 >> 172.21.15.81:0/2088986209 conn(0x7f38580fabd0 msgr2=0x7f38580fba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:45:03.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:03.166+0000 7f385d000700 1 -- 172.21.15.81:0/2088986209 shutdown_connections 2024-04-23T14:45:03.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:03.166+0000 7f385d000700 1 -- 172.21.15.81:0/2088986209 wait complete. 2024-04-23T14:45:03.691 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:03 smithi081 ceph-mon[25540]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:03.691 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:03 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/2088986209' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-23T14:45:03.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:03 smithi156 ceph-mon[32341]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:03.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:03 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/2088986209' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-23T14:45:04.539 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117017 got 115964117019 for osd.3 2024-04-23T14:45:04.539 DEBUG:teuthology.parallel:result is None 2024-04-23T14:45:05.163 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:45:05.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.209+0000 7f97bca00700 1 -- 172.21.15.81:0/3041111638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97b81037c0 msgr2=0x7f97b80fce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:05.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.209+0000 7f97bca00700 1 --2- 172.21.15.81:0/3041111638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97b81037c0 0x7f97b80fce30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f97a4004940 tx=0x7f97a4009e30 comp rx=0 tx=0).stop 2024-04-23T14:45:05.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.210+0000 7f97bca00700 1 -- 172.21.15.81:0/3041111638 shutdown_connections 2024-04-23T14:45:05.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.210+0000 7f97bca00700 1 --2- 172.21.15.81:0/3041111638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97b81037c0 0x7f97b80fce30 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:05.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.210+0000 7f97bca00700 1 --2- 172.21.15.81:0/3041111638 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97b8102e20 0x7f97b81031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:05.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.210+0000 7f97bca00700 1 -- 172.21.15.81:0/3041111638 >> 172.21.15.81:0/3041111638 conn(0x7f97b80f89d0 msgr2=0x7f97b80fade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:45:05.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.210+0000 7f97bca00700 1 -- 172.21.15.81:0/3041111638 shutdown_connections 2024-04-23T14:45:05.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.210+0000 7f97bca00700 1 -- 172.21.15.81:0/3041111638 wait complete. 2024-04-23T14:45:05.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.211+0000 7f97bca00700 1 Processor -- start 2024-04-23T14:45:05.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.211+0000 7f97bca00700 1 -- start start 2024-04-23T14:45:05.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.211+0000 7f97bca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97b8102e20 0x7f97b8115dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:05.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.211+0000 7f97bca00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97b81037c0 0x7f97b8116300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:05.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.211+0000 7f97bca00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b8116950 con 0x7f97b8102e20 2024-04-23T14:45:05.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.211+0000 7f97bca00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b810fd20 con 0x7f97b81037c0 2024-04-23T14:45:05.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.211+0000 7f97b5e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97b8102e20 0x7f97b8115dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:05.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.211+0000 7f97b5e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97b8102e20 0x7f97b8115dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33612/0 (socket says 172.21.15.81:33612) 2024-04-23T14:45:05.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.211+0000 7f97b5e00700 1 -- 172.21.15.81:0/1668850175 learned_addr learned my addr 172.21.15.81:0/1668850175 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:45:05.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.212+0000 7f97b5400700 1 --2- 172.21.15.81:0/1668850175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97b81037c0 0x7f97b8116300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:05.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.212+0000 7f97b5e00700 1 -- 172.21.15.81:0/1668850175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97b81037c0 msgr2=0x7f97b8116300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:05.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.212+0000 7f97b5e00700 1 --2- 172.21.15.81:0/1668850175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97b81037c0 0x7f97b8116300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:05.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.212+0000 7f97b5e00700 1 -- 172.21.15.81:0/1668850175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a4005040 con 0x7f97b8102e20 2024-04-23T14:45:05.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.212+0000 7f97b5e00700 1 --2- 172.21.15.81:0/1668850175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97b8102e20 0x7f97b8115dc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f97a800c810 tx=0x7f97a8004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:45:05.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.212+0000 7f97ae000700 1 -- 172.21.15.81:0/1668850175 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97a8012810 con 0x7f97b8102e20 2024-04-23T14:45:05.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.212+0000 7f97ae000700 1 -- 172.21.15.81:0/1668850175 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f97a8012e40 con 0x7f97b8102e20 2024-04-23T14:45:05.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.212+0000 7f97ae000700 1 -- 172.21.15.81:0/1668850175 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97a800a370 con 0x7f97b8102e20 2024-04-23T14:45:05.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.212+0000 7f97bca00700 1 -- 172.21.15.81:0/1668850175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97b8110000 con 0x7f97b8102e20 2024-04-23T14:45:05.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.213+0000 7f97bca00700 1 -- 172.21.15.81:0/1668850175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97b81105c0 con 0x7f97b8102e20 2024-04-23T14:45:05.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.214+0000 7f97bca00700 1 -- 172.21.15.81:0/1668850175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97b8102140 con 0x7f97b8102e20 2024-04-23T14:45:05.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.215+0000 7f97ae000700 1 -- 172.21.15.81:0/1668850175 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f97a8011810 con 0x7f97b8102e20 2024-04-23T14:45:05.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.215+0000 7f97ae000700 1 --2- 172.21.15.81:0/1668850175 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f979c0692a0 0x7f979c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:05.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.216+0000 7f97ae000700 1 -- 172.21.15.81:0/1668850175 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f97a8087320 con 0x7f97b8102e20 2024-04-23T14:45:05.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.216+0000 7f97b5400700 1 --2- 172.21.15.81:0/1668850175 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f979c0692a0 0x7f979c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:05.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.217+0000 7f97b5400700 1 --2- 172.21.15.81:0/1668850175 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f979c0692a0 0x7f979c06b750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f97a4000c00 tx=0x7f97a4009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:45:05.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.220+0000 7f97ae000700 1 -- 172.21.15.81:0/1668850175 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f97a8057380 con 0x7f97b8102e20 2024-04-23T14:45:05.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.446+0000 7f97bca00700 1 -- 172.21.15.81:0/1668850175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f97b80fe570 con 0x7f97b8102e20 2024-04-23T14:45:05.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.447+0000 7f97ae000700 1 -- 172.21.15.81:0/1668850175 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f97a8016020 con 0x7f97b8102e20 2024-04-23T14:45:05.448 INFO:teuthology.orchestra.run.smithi081.stdout:81604378656 2024-04-23T14:45:05.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.449+0000 7f97bca00700 1 -- 172.21.15.81:0/1668850175 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f979c0692a0 msgr2=0x7f979c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:05.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.449+0000 7f97bca00700 1 --2- 172.21.15.81:0/1668850175 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f979c0692a0 0x7f979c06b750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f97a4000c00 tx=0x7f97a4009e30 comp rx=0 tx=0).stop 2024-04-23T14:45:05.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.449+0000 7f97bca00700 1 -- 172.21.15.81:0/1668850175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97b8102e20 msgr2=0x7f97b8115dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:05.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.449+0000 7f97bca00700 1 --2- 172.21.15.81:0/1668850175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97b8102e20 0x7f97b8115dc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f97a800c810 tx=0x7f97a8004470 comp rx=0 tx=0).stop 2024-04-23T14:45:05.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.450+0000 7f97bca00700 1 -- 172.21.15.81:0/1668850175 shutdown_connections 2024-04-23T14:45:05.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.450+0000 7f97bca00700 1 --2- 172.21.15.81:0/1668850175 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f979c0692a0 0x7f979c06b750 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:05.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.450+0000 7f97bca00700 1 --2- 172.21.15.81:0/1668850175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97b8102e20 0x7f97b8115dc0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:05.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.450+0000 7f97bca00700 1 --2- 172.21.15.81:0/1668850175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97b81037c0 0x7f97b8116300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:05.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.450+0000 7f97bca00700 1 -- 172.21.15.81:0/1668850175 >> 172.21.15.81:0/1668850175 conn(0x7f97b80f89d0 msgr2=0x7f97b80fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:45:05.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.450+0000 7f97bca00700 1 -- 172.21.15.81:0/1668850175 shutdown_connections 2024-04-23T14:45:05.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.450+0000 7f97bca00700 1 -- 172.21.15.81:0/1668850175 wait complete. 2024-04-23T14:45:05.683 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:05 smithi081 ceph-mon[25540]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:05.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:05 smithi156 ceph-mon[32341]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:06.527 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:06 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/1668850175' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-23T14:45:06.527 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:06 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/822534147' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-23T14:45:06.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:06 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/1668850175' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-23T14:45:06.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:06 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/822534147' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-23T14:45:07.321 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378653 got 81604378656 for osd.2 2024-04-23T14:45:07.321 DEBUG:teuthology.parallel:result is None 2024-04-23T14:45:07.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.912+0000 7f1523000700 1 -- 172.21.15.81:0/2027000557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f151c102e60 msgr2=0x7f151c103230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.912+0000 7f1523000700 1 --2- 172.21.15.81:0/2027000557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f151c102e60 0x7f151c103230 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f150c004940 tx=0x7f150c009e30 comp rx=0 tx=0).stop 2024-04-23T14:45:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.912+0000 7f1523000700 1 -- 172.21.15.81:0/2027000557 shutdown_connections 2024-04-23T14:45:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.912+0000 7f1523000700 1 --2- 172.21.15.81:0/2027000557 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f151c0656b0 0x7f151c065b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.912+0000 7f1523000700 1 --2- 172.21.15.81:0/2027000557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f151c102e60 0x7f151c103230 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.912+0000 7f1523000700 1 -- 172.21.15.81:0/2027000557 >> 172.21.15.81:0/2027000557 conn(0x7f151c072bc0 msgr2=0x7f151c072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:45:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.912+0000 7f1523000700 1 -- 172.21.15.81:0/2027000557 shutdown_connections 2024-04-23T14:45:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.912+0000 7f1523000700 1 -- 172.21.15.81:0/2027000557 wait complete. 2024-04-23T14:45:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.913+0000 7f1523000700 1 Processor -- start 2024-04-23T14:45:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.913+0000 7f1523000700 1 -- start start 2024-04-23T14:45:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.914+0000 7f1523000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f151c0656b0 0x7f151c115d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.914+0000 7f1523000700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f151c102e60 0x7f151c1162a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.914+0000 7f1523000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151c1168f0 con 0x7f151c0656b0 2024-04-23T14:45:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.914+0000 7f1523000700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151c10fcc0 con 0x7f151c102e60 2024-04-23T14:45:07.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.914+0000 7f151be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f151c0656b0 0x7f151c115d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:07.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.914+0000 7f151be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f151c0656b0 0x7f151c115d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33628/0 (socket says 172.21.15.81:33628) 2024-04-23T14:45:07.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.914+0000 7f151be00700 1 -- 172.21.15.81:0/822534147 learned_addr learned my addr 172.21.15.81:0/822534147 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:45:07.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.914+0000 7f151be00700 1 -- 172.21.15.81:0/822534147 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f151c102e60 msgr2=0x7f151c1162a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:07.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.914+0000 7f151be00700 1 --2- 172.21.15.81:0/822534147 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f151c102e60 0x7f151c1162a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:07.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.914+0000 7f151be00700 1 -- 172.21.15.81:0/822534147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150c005040 con 0x7f151c0656b0 2024-04-23T14:45:07.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.915+0000 7f151be00700 1 --2- 172.21.15.81:0/822534147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f151c0656b0 0x7f151c115d60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f150c009180 tx=0x7f150c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:45:07.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.915+0000 7f1513e00700 1 -- 172.21.15.81:0/822534147 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f150c00e040 con 0x7f151c0656b0 2024-04-23T14:45:07.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.915+0000 7f1513e00700 1 -- 172.21.15.81:0/822534147 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f150c00bbc0 con 0x7f151c0656b0 2024-04-23T14:45:07.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.915+0000 7f1513e00700 1 -- 172.21.15.81:0/822534147 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f150c01c630 con 0x7f151c0656b0 2024-04-23T14:45:07.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.915+0000 7f1523000700 1 -- 172.21.15.81:0/822534147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f151c10ff40 con 0x7f151c0656b0 2024-04-23T14:45:07.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.915+0000 7f1523000700 1 -- 172.21.15.81:0/822534147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f151c110500 con 0x7f151c0656b0 2024-04-23T14:45:07.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.916+0000 7f1523000700 1 -- 172.21.15.81:0/822534147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f151c106a70 con 0x7f151c0656b0 2024-04-23T14:45:07.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.917+0000 7f1513e00700 1 -- 172.21.15.81:0/822534147 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f150c00bd30 con 0x7f151c0656b0 2024-04-23T14:45:07.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.918+0000 7f1513e00700 1 --2- 172.21.15.81:0/822534147 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f1500069380 0x7f150006b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:07.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.918+0000 7f1513e00700 1 -- 172.21.15.81:0/822534147 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f150c088240 con 0x7f151c0656b0 2024-04-23T14:45:07.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.918+0000 7f151b400700 1 --2- 172.21.15.81:0/822534147 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f1500069380 0x7f150006b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:07.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.919+0000 7f151b400700 1 --2- 172.21.15.81:0/822534147 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f1500069380 0x7f150006b830 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f151c111600 tx=0x7f1508007d40 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:45:07.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:05.922+0000 7f1513e00700 1 -- 172.21.15.81:0/822534147 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f150c058320 con 0x7f151c0656b0 2024-04-23T14:45:07.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:06.138+0000 7f1523000700 1 -- 172.21.15.81:0/822534147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f151c0fe570 con 0x7f151c0656b0 2024-04-23T14:45:07.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:06.138+0000 7f1513e00700 1 -- 172.21.15.81:0/822534147 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f150c057eb0 con 0x7f151c0656b0 2024-04-23T14:45:07.401 INFO:teuthology.orchestra.run.smithi081.stdout:150323855380 2024-04-23T14:45:07.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:06.141+0000 7f1523000700 1 -- 172.21.15.81:0/822534147 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f1500069380 msgr2=0x7f150006b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:07.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:06.141+0000 7f1523000700 1 --2- 172.21.15.81:0/822534147 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f1500069380 0x7f150006b830 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f151c111600 tx=0x7f1508007d40 comp rx=0 tx=0).stop 2024-04-23T14:45:07.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:06.141+0000 7f1523000700 1 -- 172.21.15.81:0/822534147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f151c0656b0 msgr2=0x7f151c115d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:07.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:06.141+0000 7f1523000700 1 --2- 172.21.15.81:0/822534147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f151c0656b0 0x7f151c115d60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f150c009180 tx=0x7f150c009e30 comp rx=0 tx=0).stop 2024-04-23T14:45:07.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:06.141+0000 7f1523000700 1 -- 172.21.15.81:0/822534147 shutdown_connections 2024-04-23T14:45:07.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:06.141+0000 7f1523000700 1 --2- 172.21.15.81:0/822534147 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f1500069380 0x7f150006b830 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:07.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:06.141+0000 7f1523000700 1 --2- 172.21.15.81:0/822534147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f151c0656b0 0x7f151c115d60 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:07.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:06.141+0000 7f1523000700 1 --2- 172.21.15.81:0/822534147 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f151c102e60 0x7f151c1162a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:07.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:06.141+0000 7f1523000700 1 -- 172.21.15.81:0/822534147 >> 172.21.15.81:0/822534147 conn(0x7f151c072bc0 msgr2=0x7f151c0fadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:45:07.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:06.141+0000 7f1523000700 1 -- 172.21.15.81:0/822534147 shutdown_connections 2024-04-23T14:45:07.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:06.142+0000 7f1523000700 1 -- 172.21.15.81:0/822534147 wait complete. 2024-04-23T14:45:07.727 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:07 smithi081 ceph-mon[25540]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:07.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:07 smithi156 ceph-mon[32341]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:08.915 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855376 got 150323855380 for osd.4 2024-04-23T14:45:08.916 DEBUG:teuthology.parallel:result is None 2024-04-23T14:45:08.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.074+0000 7ff62b200700 1 -- 172.21.15.81:0/487612586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff624109280 msgr2=0x7ff624109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:08.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.074+0000 7ff62b200700 1 --2- 172.21.15.81:0/487612586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff624109280 0x7ff624109650 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff618004940 tx=0x7ff618009e30 comp rx=0 tx=0).stop 2024-04-23T14:45:08.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.075+0000 7ff62b200700 1 -- 172.21.15.81:0/487612586 shutdown_connections 2024-04-23T14:45:08.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.075+0000 7ff62b200700 1 --2- 172.21.15.81:0/487612586 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff624109c20 0x7ff624103330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:08.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.075+0000 7ff62b200700 1 --2- 172.21.15.81:0/487612586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff624109280 0x7ff624109650 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:08.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.075+0000 7ff62b200700 1 -- 172.21.15.81:0/487612586 >> 172.21.15.81:0/487612586 conn(0x7ff624072a60 msgr2=0x7ff624074e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:45:08.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.075+0000 7ff62b200700 1 -- 172.21.15.81:0/487612586 shutdown_connections 2024-04-23T14:45:08.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.075+0000 7ff62b200700 1 -- 172.21.15.81:0/487612586 wait complete. 2024-04-23T14:45:08.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.075+0000 7ff62b200700 1 Processor -- start 2024-04-23T14:45:08.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.076+0000 7ff62b200700 1 -- start start 2024-04-23T14:45:08.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.076+0000 7ff62b200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff624109280 0x7ff62411a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:08.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.076+0000 7ff62b200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff624109c20 0x7ff62411a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:08.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.076+0000 7ff62b200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62411ac20 con 0x7ff624109c20 2024-04-23T14:45:08.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.076+0000 7ff62b200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff624113f60 con 0x7ff624109280 2024-04-23T14:45:08.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.077+0000 7ff629400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff624109c20 0x7ff62411a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:08.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.077+0000 7ff629400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff624109c20 0x7ff62411a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33640/0 (socket says 172.21.15.81:33640) 2024-04-23T14:45:08.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.077+0000 7ff629400700 1 -- 172.21.15.81:0/1173216637 learned_addr learned my addr 172.21.15.81:0/1173216637 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:45:08.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.077+0000 7ff629e00700 1 --2- 172.21.15.81:0/1173216637 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff624109280 0x7ff62411a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:08.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.077+0000 7ff629400700 1 -- 172.21.15.81:0/1173216637 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff624109280 msgr2=0x7ff62411a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:08.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.077+0000 7ff629400700 1 --2- 172.21.15.81:0/1173216637 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff624109280 0x7ff62411a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:08.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.077+0000 7ff629400700 1 -- 172.21.15.81:0/1173216637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff618005040 con 0x7ff624109c20 2024-04-23T14:45:08.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.078+0000 7ff629400700 1 --2- 172.21.15.81:0/1173216637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff624109c20 0x7ff62411a540 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff61400b790 tx=0x7ff614009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:45:08.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.078+0000 7ff61e000700 1 -- 172.21.15.81:0/1173216637 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff61400f6f0 con 0x7ff624109c20 2024-04-23T14:45:08.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.078+0000 7ff61e000700 1 -- 172.21.15.81:0/1173216637 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff61400fd20 con 0x7ff624109c20 2024-04-23T14:45:08.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.078+0000 7ff61e000700 1 -- 172.21.15.81:0/1173216637 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6140103a0 con 0x7ff624109c20 2024-04-23T14:45:08.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.078+0000 7ff62b200700 1 -- 172.21.15.81:0/1173216637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6241141e0 con 0x7ff624109c20 2024-04-23T14:45:08.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.078+0000 7ff62b200700 1 -- 172.21.15.81:0/1173216637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6241147a0 con 0x7ff624109c20 2024-04-23T14:45:08.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.079+0000 7ff62b200700 1 -- 172.21.15.81:0/1173216637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6241049d0 con 0x7ff624109c20 2024-04-23T14:45:08.943 INFO:teuthology.orchestra.run.smithi081.stdout:38654705713 2024-04-23T14:45:08.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.080+0000 7ff61e000700 1 -- 172.21.15.81:0/1173216637 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7ff614011400 con 0x7ff624109c20 2024-04-23T14:45:08.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.081+0000 7ff61e000700 1 --2- 172.21.15.81:0/1173216637 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7ff60c0692a0 0x7ff60c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:08.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.081+0000 7ff61e000700 1 -- 172.21.15.81:0/1173216637 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff614086bf0 con 0x7ff624109c20 2024-04-23T14:45:08.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.081+0000 7ff629e00700 1 --2- 172.21.15.81:0/1173216637 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7ff60c0692a0 0x7ff60c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:08.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.082+0000 7ff629e00700 1 --2- 172.21.15.81:0/1173216637 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7ff60c0692a0 0x7ff60c06b750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff618009fd0 tx=0x7ff618009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:45:08.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.086+0000 7ff61e000700 1 -- 172.21.15.81:0/1173216637 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff614056cd0 con 0x7ff624109c20 2024-04-23T14:45:08.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.335+0000 7ff62b200700 1 -- 172.21.15.81:0/1173216637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff624076590 con 0x7ff624109c20 2024-04-23T14:45:08.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.336+0000 7ff61e000700 1 -- 172.21.15.81:0/1173216637 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff614056860 con 0x7ff624109c20 2024-04-23T14:45:08.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.339+0000 7ff62b200700 1 -- 172.21.15.81:0/1173216637 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7ff60c0692a0 msgr2=0x7ff60c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:08.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.339+0000 7ff62b200700 1 --2- 172.21.15.81:0/1173216637 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7ff60c0692a0 0x7ff60c06b750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff618009fd0 tx=0x7ff618009e30 comp rx=0 tx=0).stop 2024-04-23T14:45:08.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.339+0000 7ff62b200700 1 -- 172.21.15.81:0/1173216637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff624109c20 msgr2=0x7ff62411a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:08.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.339+0000 7ff62b200700 1 --2- 172.21.15.81:0/1173216637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff624109c20 0x7ff62411a540 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff61400b790 tx=0x7ff614009220 comp rx=0 tx=0).stop 2024-04-23T14:45:08.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.339+0000 7ff62b200700 1 -- 172.21.15.81:0/1173216637 shutdown_connections 2024-04-23T14:45:08.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.339+0000 7ff62b200700 1 --2- 172.21.15.81:0/1173216637 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff624109280 0x7ff62411a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:08.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.339+0000 7ff62b200700 1 --2- 172.21.15.81:0/1173216637 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7ff60c0692a0 0x7ff60c06b750 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:08.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.339+0000 7ff62b200700 1 --2- 172.21.15.81:0/1173216637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff624109c20 0x7ff62411a540 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:08.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.339+0000 7ff62b200700 1 -- 172.21.15.81:0/1173216637 >> 172.21.15.81:0/1173216637 conn(0x7ff624072a60 msgr2=0x7ff6240749a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:45:08.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.339+0000 7ff62b200700 1 -- 172.21.15.81:0/1173216637 shutdown_connections 2024-04-23T14:45:08.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:08.339+0000 7ff62b200700 1 -- 172.21.15.81:0/1173216637 wait complete. 2024-04-23T14:45:09.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:08 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/1173216637' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-23T14:45:09.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:08 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/1173216637' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-23T14:45:09.687 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705711 got 38654705713 for osd.0 2024-04-23T14:45:09.687 DEBUG:teuthology.parallel:result is None 2024-04-23T14:45:09.914 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:09 smithi156 ceph-mon[32341]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:09.940 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:09 smithi081 ceph-mon[25540]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:10.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.360+0000 7f6c9a000700 1 -- 172.21.15.81:0/2369229776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c940fc600 msgr2=0x7f6c940fc9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:10.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.360+0000 7f6c9a000700 1 --2- 172.21.15.81:0/2369229776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c940fc600 0x7f6c940fc9d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6c88004940 tx=0x7f6c88009e30 comp rx=0 tx=0).stop 2024-04-23T14:45:10.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.360+0000 7f6c9a000700 1 -- 172.21.15.81:0/2369229776 shutdown_connections 2024-04-23T14:45:10.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.360+0000 7f6c9a000700 1 --2- 172.21.15.81:0/2369229776 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c940fcf10 0x7f6c941091c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:10.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.360+0000 7f6c9a000700 1 --2- 172.21.15.81:0/2369229776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c940fc600 0x7f6c940fc9d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:10.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.360+0000 7f6c9a000700 1 -- 172.21.15.81:0/2369229776 >> 172.21.15.81:0/2369229776 conn(0x7f6c94071b70 msgr2=0x7f6c94071f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:45:10.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.360+0000 7f6c9a000700 1 -- 172.21.15.81:0/2369229776 shutdown_connections 2024-04-23T14:45:10.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.360+0000 7f6c9a000700 1 -- 172.21.15.81:0/2369229776 wait complete. 2024-04-23T14:45:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.361+0000 7f6c9a000700 1 Processor -- start 2024-04-23T14:45:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.361+0000 7f6c9a000700 1 -- start start 2024-04-23T14:45:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.361+0000 7f6c9a000700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c940fc600 0x7f6c94115cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.361+0000 7f6c9a000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c940fcf10 0x7f6c941161f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.361+0000 7f6c9a000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c94116840 con 0x7f6c940fcf10 2024-04-23T14:45:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.361+0000 7f6c9a000700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9410fc60 con 0x7f6c940fc600 2024-04-23T14:45:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.361+0000 7f6c93e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c940fcf10 0x7f6c941161f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:10.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.361+0000 7f6c93e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c940fcf10 0x7f6c941161f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33654/0 (socket says 172.21.15.81:33654) 2024-04-23T14:45:10.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.362+0000 7f6c93e00700 1 -- 172.21.15.81:0/4200200548 learned_addr learned my addr 172.21.15.81:0/4200200548 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:45:10.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.362+0000 7f6c98c00700 1 --2- 172.21.15.81:0/4200200548 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c940fc600 0x7f6c94115cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:10.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.362+0000 7f6c93e00700 1 -- 172.21.15.81:0/4200200548 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c940fc600 msgr2=0x7f6c94115cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:10.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.362+0000 7f6c93e00700 1 --2- 172.21.15.81:0/4200200548 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c940fc600 0x7f6c94115cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:10.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.362+0000 7f6c93e00700 1 -- 172.21.15.81:0/4200200548 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c88005040 con 0x7f6c940fcf10 2024-04-23T14:45:10.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.362+0000 7f6c93e00700 1 --2- 172.21.15.81:0/4200200548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c940fcf10 0x7f6c941161f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6c8000c830 tx=0x7f6c80004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:45:10.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.362+0000 7f6c90c00700 1 -- 172.21.15.81:0/4200200548 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c8000a760 con 0x7f6c940fcf10 2024-04-23T14:45:10.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.362+0000 7f6c90c00700 1 -- 172.21.15.81:0/4200200548 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6c8000ad90 con 0x7f6c940fcf10 2024-04-23T14:45:10.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.362+0000 7f6c9a000700 1 -- 172.21.15.81:0/4200200548 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c9410ff40 con 0x7f6c940fcf10 2024-04-23T14:45:10.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.363+0000 7f6c90c00700 1 -- 172.21.15.81:0/4200200548 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c800113a0 con 0x7f6c940fcf10 2024-04-23T14:45:10.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.363+0000 7f6c9a000700 1 -- 172.21.15.81:0/4200200548 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c94110480 con 0x7f6c940fcf10 2024-04-23T14:45:10.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.364+0000 7f6c9a000700 1 -- 172.21.15.81:0/4200200548 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c940fc1a0 con 0x7f6c940fcf10 2024-04-23T14:45:10.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.365+0000 7f6c90c00700 1 -- 172.21.15.81:0/4200200548 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f6c80012400 con 0x7f6c940fcf10 2024-04-23T14:45:10.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.367+0000 7f6c90c00700 1 --2- 172.21.15.81:0/4200200548 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f6c7c0692b0 0x7f6c7c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:10.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.367+0000 7f6c90c00700 1 -- 172.21.15.81:0/4200200548 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6c80086e10 con 0x7f6c940fcf10 2024-04-23T14:45:10.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.367+0000 7f6c98c00700 1 --2- 172.21.15.81:0/4200200548 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f6c7c0692b0 0x7f6c7c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:10.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.367+0000 7f6c98c00700 1 --2- 172.21.15.81:0/4200200548 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f6c7c0692b0 0x7f6c7c06b760 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6c8800b020 tx=0x7f6c88009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:45:10.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.371+0000 7f6c90c00700 1 -- 172.21.15.81:0/4200200548 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6c80056fb0 con 0x7f6c940fcf10 2024-04-23T14:45:10.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.589+0000 7f6c9a000700 1 -- 172.21.15.81:0/4200200548 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f6c9404bed0 con 0x7f6c940fcf10 2024-04-23T14:45:10.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.590+0000 7f6c90c00700 1 -- 172.21.15.81:0/4200200548 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6c8005c020 con 0x7f6c940fcf10 2024-04-23T14:45:10.591 INFO:teuthology.orchestra.run.smithi081.stdout:171798691854 2024-04-23T14:45:10.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.593+0000 7f6c9a000700 1 -- 172.21.15.81:0/4200200548 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f6c7c0692b0 msgr2=0x7f6c7c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:10.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.593+0000 7f6c9a000700 1 --2- 172.21.15.81:0/4200200548 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f6c7c0692b0 0x7f6c7c06b760 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6c8800b020 tx=0x7f6c88009e30 comp rx=0 tx=0).stop 2024-04-23T14:45:10.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.593+0000 7f6c9a000700 1 -- 172.21.15.81:0/4200200548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c940fcf10 msgr2=0x7f6c941161f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:10.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.593+0000 7f6c9a000700 1 --2- 172.21.15.81:0/4200200548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c940fcf10 0x7f6c941161f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6c8000c830 tx=0x7f6c80004470 comp rx=0 tx=0).stop 2024-04-23T14:45:10.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.593+0000 7f6c9a000700 1 -- 172.21.15.81:0/4200200548 shutdown_connections 2024-04-23T14:45:10.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.593+0000 7f6c9a000700 1 --2- 172.21.15.81:0/4200200548 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c940fc600 0x7f6c94115cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:10.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.593+0000 7f6c9a000700 1 --2- 172.21.15.81:0/4200200548 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f6c7c0692b0 0x7f6c7c06b760 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:10.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.593+0000 7f6c9a000700 1 --2- 172.21.15.81:0/4200200548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c940fcf10 0x7f6c941161f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:10.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.593+0000 7f6c9a000700 1 -- 172.21.15.81:0/4200200548 >> 172.21.15.81:0/4200200548 conn(0x7f6c94071b70 msgr2=0x7f6c940f9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:45:10.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.593+0000 7f6c9a000700 1 -- 172.21.15.81:0/4200200548 shutdown_connections 2024-04-23T14:45:10.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.593+0000 7f6c9a000700 1 -- 172.21.15.81:0/4200200548 wait complete. 2024-04-23T14:45:10.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.794+0000 7f70ffe00700 1 -- 172.21.15.81:0/2202844336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7100065670 msgr2=0x7f7100065ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:10.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.794+0000 7f70ffe00700 1 --2- 172.21.15.81:0/2202844336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7100065670 0x7f7100065ae0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f70ec004940 tx=0x7f70ec009e30 comp rx=0 tx=0).stop 2024-04-23T14:45:10.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.794+0000 7f70ffe00700 1 -- 172.21.15.81:0/2202844336 shutdown_connections 2024-04-23T14:45:10.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.794+0000 7f70ffe00700 1 --2- 172.21.15.81:0/2202844336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7100065670 0x7f7100065ae0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:10.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.794+0000 7f70ffe00700 1 --2- 172.21.15.81:0/2202844336 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7100102cc0 0x7f7100103090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:10.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.794+0000 7f70ffe00700 1 -- 172.21.15.81:0/2202844336 >> 172.21.15.81:0/2202844336 conn(0x7f7100071b70 msgr2=0x7f7100071f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:45:10.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.794+0000 7f70ffe00700 1 -- 172.21.15.81:0/2202844336 shutdown_connections 2024-04-23T14:45:10.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.794+0000 7f70ffe00700 1 -- 172.21.15.81:0/2202844336 wait complete. 2024-04-23T14:45:10.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.795+0000 7f70ffe00700 1 Processor -- start 2024-04-23T14:45:10.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.795+0000 7f70ffe00700 1 -- start start 2024-04-23T14:45:10.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.796+0000 7f70ffe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7100065670 0x7f7100115c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:10.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.796+0000 7f70ffe00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7100102cc0 0x7f7100116160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:10.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.796+0000 7f70ffe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71001167b0 con 0x7f7100065670 2024-04-23T14:45:10.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.796+0000 7f70ffe00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710010fba0 con 0x7f7100102cc0 2024-04-23T14:45:10.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.796+0000 7f70fea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7100065670 0x7f7100115c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:10.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.796+0000 7f70fea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7100065670 0x7f7100115c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33680/0 (socket says 172.21.15.81:33680) 2024-04-23T14:45:10.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.796+0000 7f70fea00700 1 -- 172.21.15.81:0/4208094670 learned_addr learned my addr 172.21.15.81:0/4208094670 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:45:10.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.796+0000 7f70fea00700 1 -- 172.21.15.81:0/4208094670 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7100102cc0 msgr2=0x7f7100116160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:10.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.796+0000 7f70fea00700 1 --2- 172.21.15.81:0/4208094670 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7100102cc0 0x7f7100116160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:10.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.796+0000 7f70fea00700 1 -- 172.21.15.81:0/4208094670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ec005040 con 0x7f7100065670 2024-04-23T14:45:10.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.797+0000 7f70fea00700 1 --2- 172.21.15.81:0/4208094670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7100065670 0x7f7100115c20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f70f0002a50 tx=0x7f70f00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:45:10.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.797+0000 7f70f6a00700 1 -- 172.21.15.81:0/4208094670 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70f0007cc0 con 0x7f7100065670 2024-04-23T14:45:10.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.797+0000 7f70f6a00700 1 -- 172.21.15.81:0/4208094670 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f70f000f040 con 0x7f7100065670 2024-04-23T14:45:10.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.797+0000 7f70f6a00700 1 -- 172.21.15.81:0/4208094670 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70f0009640 con 0x7f7100065670 2024-04-23T14:45:10.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.797+0000 7f70ffe00700 1 -- 172.21.15.81:0/4208094670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f710010fe80 con 0x7f7100065670 2024-04-23T14:45:10.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.797+0000 7f70ffe00700 1 -- 172.21.15.81:0/4208094670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7100110440 con 0x7f7100065670 2024-04-23T14:45:10.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.798+0000 7f70ffe00700 1 -- 172.21.15.81:0/4208094670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71000fe3b0 con 0x7f7100065670 2024-04-23T14:45:10.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.799+0000 7f70f6a00700 1 -- 172.21.15.81:0/4208094670 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f70f00097a0 con 0x7f7100065670 2024-04-23T14:45:10.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.800+0000 7f70f6a00700 1 --2- 172.21.15.81:0/4208094670 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f70e40692a0 0x7f70e406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:10.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.801+0000 7f70f6a00700 1 -- 172.21.15.81:0/4208094670 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f70f0086b80 con 0x7f7100065670 2024-04-23T14:45:10.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.801+0000 7f70fe000700 1 --2- 172.21.15.81:0/4208094670 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f70e40692a0 0x7f70e406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:10.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.801+0000 7f70fe000700 1 --2- 172.21.15.81:0/4208094670 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f70e40692a0 0x7f70e406b750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f70ec004f90 tx=0x7f70ec009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:45:10.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:10.806+0000 7f70f6a00700 1 -- 172.21.15.81:0/4208094670 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f70f0056c80 con 0x7f7100065670 2024-04-23T14:45:11.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:11.027+0000 7f70ffe00700 1 -- 172.21.15.81:0/4208094670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f710004bed0 con 0x7f7100065670 2024-04-23T14:45:11.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:11.027+0000 7f70f6a00700 1 -- 172.21.15.81:0/4208094670 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f70f0056810 con 0x7f7100065670 2024-04-23T14:45:11.028 INFO:teuthology.orchestra.run.smithi081.stdout:60129542185 2024-04-23T14:45:11.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:11.030+0000 7f70ffe00700 1 -- 172.21.15.81:0/4208094670 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f70e40692a0 msgr2=0x7f70e406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:11.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:11.030+0000 7f70ffe00700 1 --2- 172.21.15.81:0/4208094670 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f70e40692a0 0x7f70e406b750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f70ec004f90 tx=0x7f70ec009e30 comp rx=0 tx=0).stop 2024-04-23T14:45:11.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:11.030+0000 7f70ffe00700 1 -- 172.21.15.81:0/4208094670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7100065670 msgr2=0x7f7100115c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:11.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:11.030+0000 7f70ffe00700 1 --2- 172.21.15.81:0/4208094670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7100065670 0x7f7100115c20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f70f0002a50 tx=0x7f70f00046b0 comp rx=0 tx=0).stop 2024-04-23T14:45:11.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:11.030+0000 7f70ffe00700 1 -- 172.21.15.81:0/4208094670 shutdown_connections 2024-04-23T14:45:11.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:11.030+0000 7f70ffe00700 1 --2- 172.21.15.81:0/4208094670 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f70e40692a0 0x7f70e406b750 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:11.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:11.030+0000 7f70ffe00700 1 --2- 172.21.15.81:0/4208094670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7100065670 0x7f7100115c20 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:11.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:11.030+0000 7f70ffe00700 1 --2- 172.21.15.81:0/4208094670 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7100102cc0 0x7f7100116160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:11.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:11.030+0000 7f70ffe00700 1 -- 172.21.15.81:0/4208094670 >> 172.21.15.81:0/4208094670 conn(0x7f7100071b70 msgr2=0x7f71000f9fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:45:11.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:11.030+0000 7f70ffe00700 1 -- 172.21.15.81:0/4208094670 shutdown_connections 2024-04-23T14:45:11.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:11.030+0000 7f70ffe00700 1 -- 172.21.15.81:0/4208094670 wait complete. 2024-04-23T14:45:11.048 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:10 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/4200200548' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-23T14:45:11.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:10 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/4200200548' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-23T14:45:11.757 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691852 got 171798691854 for osd.5 2024-04-23T14:45:11.757 DEBUG:teuthology.parallel:result is None 2024-04-23T14:45:12.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:11 smithi081 ceph-mon[25540]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:12.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:11 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/4208094670' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-23T14:45:12.234 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542182 got 60129542185 for osd.1 2024-04-23T14:45:12.235 DEBUG:teuthology.parallel:result is None 2024-04-23T14:45:12.235 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-23T14:45:12.235 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-23T14:45:12.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:11 smithi156 ceph-mon[32341]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:12.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:11 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/4208094670' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-23T14:45:12.699 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:45:13.059 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:12 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:45:13.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:12 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:45:14.034 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:13 smithi081 ceph-mon[25540]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:14.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:13 smithi156 ceph-mon[32341]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:14.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:14.827+0000 7fb826000700 1 -- 172.21.15.81:0/3354586957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8201094c0 msgr2=0x7fb820109890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:14.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:14.827+0000 7fb826000700 1 --2- 172.21.15.81:0/3354586957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8201094c0 0x7fb820109890 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb810004940 tx=0x7fb810009e30 comp rx=0 tx=0).stop 2024-04-23T14:45:14.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:14.827+0000 7fb826000700 1 -- 172.21.15.81:0/3354586957 shutdown_connections 2024-04-23T14:45:14.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:14.827+0000 7fb826000700 1 --2- 172.21.15.81:0/3354586957 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb820103460 0x7fb8201038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:14.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:14.827+0000 7fb826000700 1 --2- 172.21.15.81:0/3354586957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8201094c0 0x7fb820109890 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:14.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:14.827+0000 7fb826000700 1 -- 172.21.15.81:0/3354586957 >> 172.21.15.81:0/3354586957 conn(0x7fb820072c30 msgr2=0x7fb820075040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:45:14.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:14.828+0000 7fb826000700 1 -- 172.21.15.81:0/3354586957 shutdown_connections 2024-04-23T14:45:14.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:14.828+0000 7fb826000700 1 -- 172.21.15.81:0/3354586957 wait complete. 2024-04-23T14:45:14.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:14.828+0000 7fb826000700 1 Processor -- start 2024-04-23T14:45:14.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:14.829+0000 7fb826000700 1 -- start start 2024-04-23T14:45:14.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:14.829+0000 7fb826000700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb820103460 0x7fb820119f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:14.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:14.829+0000 7fb826000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8201094c0 0x7fb82011a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:14.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:14.829+0000 7fb826000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82011ab70 con 0x7fb8201094c0 2024-04-23T14:45:14.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:14.829+0000 7fb826000700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8201140c0 con 0x7fb820103460 2024-04-23T14:45:14.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:14.829+0000 7fb81ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8201094c0 0x7fb82011a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:14.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:14.829+0000 7fb81ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8201094c0 0x7fb82011a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60510/0 (socket says 172.21.15.81:60510) 2024-04-23T14:45:14.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:14.829+0000 7fb81ea00700 1 -- 172.21.15.81:0/2498774469 learned_addr learned my addr 172.21.15.81:0/2498774469 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:45:14.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:14.830+0000 7fb81f400700 1 --2- 172.21.15.81:0/2498774469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb820103460 0x7fb820119f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:14.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:14.830+0000 7fb81ea00700 1 -- 172.21.15.81:0/2498774469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb820103460 msgr2=0x7fb820119f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:14.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:14.830+0000 7fb81ea00700 1 --2- 172.21.15.81:0/2498774469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb820103460 0x7fb820119f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:14.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:14.830+0000 7fb81ea00700 1 -- 172.21.15.81:0/2498774469 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb810005040 con 0x7fb8201094c0 2024-04-23T14:45:14.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:14.830+0000 7fb81ea00700 1 --2- 172.21.15.81:0/2498774469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8201094c0 0x7fb82011a490 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00b790 tx=0x7fb80c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:45:14.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:14.830+0000 7fb817400700 1 -- 172.21.15.81:0/2498774469 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb80c00f770 con 0x7fb8201094c0 2024-04-23T14:45:14.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:14.830+0000 7fb817400700 1 -- 172.21.15.81:0/2498774469 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb80c00fda0 con 0x7fb8201094c0 2024-04-23T14:45:14.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:14.830+0000 7fb826000700 1 -- 172.21.15.81:0/2498774469 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb820114340 con 0x7fb8201094c0 2024-04-23T14:45:14.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:14.830+0000 7fb817400700 1 -- 172.21.15.81:0/2498774469 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb80c00d310 con 0x7fb8201094c0 2024-04-23T14:45:14.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:14.831+0000 7fb826000700 1 -- 172.21.15.81:0/2498774469 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb820114900 con 0x7fb8201094c0 2024-04-23T14:45:14.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:14.832+0000 7fb826000700 1 -- 172.21.15.81:0/2498774469 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb820104ba0 con 0x7fb8201094c0 2024-04-23T14:45:14.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:14.832+0000 7fb817400700 1 -- 172.21.15.81:0/2498774469 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fb80c010420 con 0x7fb8201094c0 2024-04-23T14:45:14.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:14.833+0000 7fb817400700 1 --2- 172.21.15.81:0/2498774469 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fb8040692a0 0x7fb80406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:14.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:14.833+0000 7fb817400700 1 -- 172.21.15.81:0/2498774469 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb80c086e70 con 0x7fb8201094c0 2024-04-23T14:45:14.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:14.834+0000 7fb81f400700 1 --2- 172.21.15.81:0/2498774469 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fb8040692a0 0x7fb80406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:14.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:14.834+0000 7fb81f400700 1 --2- 172.21.15.81:0/2498774469 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fb8040692a0 0x7fb80406b750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb81000b020 tx=0x7fb810009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:45:14.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:14.838+0000 7fb817400700 1 -- 172.21.15.81:0/2498774469 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fb80c056f50 con 0x7fb8201094c0 2024-04-23T14:45:15.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:15.042+0000 7fb826000700 1 -- 172.21.15.81:0/2498774469 --> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb820110620 con 0x7fb8040692a0 2024-04-23T14:45:15.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:15.046+0000 7fb817400700 1 -- 172.21.15.81:0/2498774469 <== mgr.14210 v2:172.21.15.81:6800/1053506915 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27027 (secure 0 0 0) 0x7fb820110620 con 0x7fb8040692a0 2024-04-23T14:45:15.048 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:45:15.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:15.049+0000 7fb826000700 1 -- 172.21.15.81:0/2498774469 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fb8040692a0 msgr2=0x7fb80406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:15.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:15.049+0000 7fb826000700 1 --2- 172.21.15.81:0/2498774469 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fb8040692a0 0x7fb80406b750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb81000b020 tx=0x7fb810009e30 comp rx=0 tx=0).stop 2024-04-23T14:45:15.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:15.049+0000 7fb826000700 1 -- 172.21.15.81:0/2498774469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8201094c0 msgr2=0x7fb82011a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:15.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:15.049+0000 7fb826000700 1 --2- 172.21.15.81:0/2498774469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8201094c0 0x7fb82011a490 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00b790 tx=0x7fb80c009250 comp rx=0 tx=0).stop 2024-04-23T14:45:15.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:15.049+0000 7fb826000700 1 -- 172.21.15.81:0/2498774469 shutdown_connections 2024-04-23T14:45:15.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:15.049+0000 7fb826000700 1 --2- 172.21.15.81:0/2498774469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb820103460 0x7fb820119f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:15.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:15.049+0000 7fb826000700 1 --2- 172.21.15.81:0/2498774469 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fb8040692a0 0x7fb80406b750 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:15.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:15.049+0000 7fb826000700 1 --2- 172.21.15.81:0/2498774469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8201094c0 0x7fb82011a490 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:15.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:15.049+0000 7fb826000700 1 -- 172.21.15.81:0/2498774469 >> 172.21.15.81:0/2498774469 conn(0x7fb820072c30 msgr2=0x7fb820105bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:45:15.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:15.050+0000 7fb826000700 1 -- 172.21.15.81:0/2498774469 shutdown_connections 2024-04-23T14:45:15.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:15.050+0000 7fb826000700 1 -- 172.21.15.81:0/2498774469 wait complete. 2024-04-23T14:45:15.052 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-04-23T14:45:15.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:15 smithi081 ceph-mon[25540]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:15.999 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":195,"stamp":"2024-04-23T14:45:14.093631+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1788068,"kb_used_data":3924,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682844,"statfs":{"total":575970213888,"available":574139232256,"internally_reserved":0,"allocated":4018176,"data_stored":2624466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003375"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":188,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-23T14:44:13.774840+0000","last_change":"2024-04-23T14:43:38.344870+0000","last_active":"2024-04-23T14:44:13.774840+0000","last_peered":"2024-04-23T14:44:13.774840+0000","last_clean":"2024-04-23T14:44:13.774840+0000","last_became_active":"2024-04-23T14:43:38.343998+0000","last_became_peered":"2024-04-23T14:43:38.343998+0000","last_unstale":"2024-04-23T14:44:13.774840+0000","last_undegraded":"2024-04-23T14:44:13.774840+0000","last_fullsized":"2024-04-23T14:44:13.774840+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:42:33.153186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:42:33.153186+0000","last_clean_scrub_stamp":"2024-04-23T14:42:33.153186+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:08:59.849431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297720,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447432,"statfs":{"total":95995035648,"available":95690170368,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]}]},{"osd":4,"up_from":35,"seq":150323855382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297728,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447424,"statfs":{"total":95995035648,"available":95690162176,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 23 14:44:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.516}]},{"osd":1,"last update":"Tue Apr 23 14:44:40 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":1.1519999999999999}]},{"osd":2,"last update":"Tue Apr 23 14:44:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":1.0960000000000001}]},{"osd":3,"last update":"Tue Apr 23 14:44:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":1.0600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.292}]}]},{"osd":3,"up_from":27,"seq":115964117021,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298300,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446852,"statfs":{"total":95995035648,"available":95689576448,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 23 14:45:09 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.004,"15min":0.99299999999999999},"min":{"1min":0.71499999999999997,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.071,"15min":1.0640000000000001},"min":{"1min":0.81999999999999995,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.3400000000000001,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":1.2450000000000001}]},{"osd":1,"last update":"Tue Apr 23 14:45:09 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":0.96899999999999997,"15min":0.94599999999999995},"min":{"1min":0.79800000000000004,"5min":0.745,"15min":0.745},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.0780000000000001,"15min":1.0720000000000001},"min":{"1min":0.81799999999999995,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.361,"5min":1.931,"15min":1.931},"last":1.1140000000000001}]},{"osd":2,"last update":"Tue Apr 23 14:45:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0329999999999999,"15min":1.024},"min":{"1min":0.71299999999999997,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":1.143},{"interface":"front","average":{"1min":1.175,"5min":1.071,"15min":1.0529999999999999},"min":{"1min":0.78800000000000003,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.296}]},{"osd":4,"last update":"Tue Apr 23 14:44:38 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.996},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.78400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]}]},{"osd":2,"up_from":19,"seq":81604378658,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297720,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447432,"statfs":{"total":95995035648,"available":95690170368,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 23 14:44:34 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.78600000000000003,"15min":0.77100000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.752},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.87,"15min":0.85999999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.90400000000000003}]},{"osd":1,"last update":"Tue Apr 23 14:44:34 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.91200000000000003,"15min":0.92000000000000004},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.369,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.135},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0660000000000001,"15min":1.0640000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.48,"5min":2.008,"15min":2.008},"last":0.71399999999999997}]},{"osd":3,"last update":"Tue Apr 23 14:45:05 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1180000000000001,"15min":1.1120000000000001},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":0.99199999999999999},{"interface":"front","average":{"1min":1,"5min":1.0229999999999999,"15min":1.0269999999999999},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":1.032}]},{"osd":4,"last update":"Tue Apr 23 14:44:40 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":1.087}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.296}]}]},{"osd":0,"up_from":9,"seq":38654705715,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298300,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446852,"statfs":{"total":95995035648,"available":95689576448,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Apr 23 14:45:05 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.72899999999999998,"15min":0.69499999999999995},"min":{"1min":0.40999999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.74099999999999999,"15min":0.69899999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.93400000000000005}]},{"osd":2,"last update":"Tue Apr 23 14:44:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.879,"15min":0.88400000000000001},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":1.004},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.94899999999999995,"15min":0.95699999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.2210000000000001,"5min":1.29,"15min":1.29},"last":1.3779999999999999}]},{"osd":3,"last update":"Tue Apr 23 14:45:12 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.0700000000000001,"15min":1.0800000000000001},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.042,"5min":1.0249999999999999,"15min":1.022},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":1.0760000000000001}]},{"osd":4,"last update":"Tue Apr 23 14:44:40 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":1.218}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4299999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542186,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298300,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446852,"statfs":{"total":95995035648,"available":95689576448,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 23 14:44:57 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.76900000000000002,"15min":0.745},"min":{"1min":0.48499999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.5249999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":1.109},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.82699999999999996,"15min":0.79200000000000004},"min":{"1min":0.50900000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.92600000000000005}]},{"osd":2,"last update":"Tue Apr 23 14:44:36 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.96699999999999997,"15min":0.96899999999999997},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1479999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":1.214},{"interface":"front","average":{"1min":0.93100000000000005,"5min":1.0149999999999999,"15min":1.0289999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.343,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.83499999999999996}]},{"osd":3,"last update":"Tue Apr 23 14:45:07 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.103,"15min":1.081},"min":{"1min":0.93700000000000006,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.335},{"interface":"front","average":{"1min":1.212,"5min":1.093,"15min":1.073},"min":{"1min":0.94899999999999995,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":1.171}]},{"osd":4,"last update":"Tue Apr 23 14:44:38 2024","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":1.0660000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2829999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T14:45:16.000 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-23T14:45:16.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:15 smithi156 ceph-mon[32341]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:16.470 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:45:16.913 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:16 smithi081 ceph-mon[25540]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T14:45:17.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:16 smithi156 ceph-mon[32341]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T14:45:18.028 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:17 smithi081 ceph-mon[25540]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:18.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:17 smithi156 ceph-mon[32341]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:18.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.547+0000 7fe438a00700 1 -- 172.21.15.81:0/1870743927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe434070360 msgr2=0x7fe434070730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:18.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.547+0000 7fe438a00700 1 --2- 172.21.15.81:0/1870743927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe434070360 0x7fe434070730 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe424004970 tx=0x7fe424009e30 comp rx=0 tx=0).stop 2024-04-23T14:45:18.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.547+0000 7fe438a00700 1 -- 172.21.15.81:0/1870743927 shutdown_connections 2024-04-23T14:45:18.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.547+0000 7fe438a00700 1 --2- 172.21.15.81:0/1870743927 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe434070c70 0x7fe434109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:18.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.547+0000 7fe438a00700 1 --2- 172.21.15.81:0/1870743927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe434070360 0x7fe434070730 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:18.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.547+0000 7fe438a00700 1 -- 172.21.15.81:0/1870743927 >> 172.21.15.81:0/1870743927 conn(0x7fe4340f89d0 msgr2=0x7fe4340fade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:45:18.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.547+0000 7fe438a00700 1 -- 172.21.15.81:0/1870743927 shutdown_connections 2024-04-23T14:45:18.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.547+0000 7fe438a00700 1 -- 172.21.15.81:0/1870743927 wait complete. 2024-04-23T14:45:18.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.548+0000 7fe438a00700 1 Processor -- start 2024-04-23T14:45:18.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.549+0000 7fe438a00700 1 -- start start 2024-04-23T14:45:18.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.549+0000 7fe438a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe434070360 0x7fe4340fcd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:18.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.549+0000 7fe438a00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe434070c70 0x7fe4340fd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:18.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.549+0000 7fe438a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe434100f20 con 0x7fe434070360 2024-04-23T14:45:18.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.549+0000 7fe438a00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4340fd810 con 0x7fe434070c70 2024-04-23T14:45:18.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.549+0000 7fe431e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe434070360 0x7fe4340fcd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:18.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.549+0000 7fe431e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe434070360 0x7fe4340fcd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60524/0 (socket says 172.21.15.81:60524) 2024-04-23T14:45:18.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.549+0000 7fe431e00700 1 -- 172.21.15.81:0/797053349 learned_addr learned my addr 172.21.15.81:0/797053349 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:45:18.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.549+0000 7fe431400700 1 --2- 172.21.15.81:0/797053349 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe434070c70 0x7fe4340fd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:18.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.550+0000 7fe431e00700 1 -- 172.21.15.81:0/797053349 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe434070c70 msgr2=0x7fe4340fd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:18.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.550+0000 7fe431e00700 1 --2- 172.21.15.81:0/797053349 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe434070c70 0x7fe4340fd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:18.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.550+0000 7fe431e00700 1 -- 172.21.15.81:0/797053349 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe424005040 con 0x7fe434070360 2024-04-23T14:45:18.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.550+0000 7fe431e00700 1 --2- 172.21.15.81:0/797053349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe434070360 0x7fe4340fcd90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe424004f50 tx=0x7fe424009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:45:18.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.550+0000 7fe42a000700 1 -- 172.21.15.81:0/797053349 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe42400e040 con 0x7fe434070360 2024-04-23T14:45:18.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.551+0000 7fe438a00700 1 -- 172.21.15.81:0/797053349 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4340fda90 con 0x7fe434070360 2024-04-23T14:45:18.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.551+0000 7fe438a00700 1 -- 172.21.15.81:0/797053349 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe43411e660 con 0x7fe434070360 2024-04-23T14:45:18.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.551+0000 7fe42a000700 1 -- 172.21.15.81:0/797053349 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe424009400 con 0x7fe434070360 2024-04-23T14:45:18.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.551+0000 7fe42a000700 1 -- 172.21.15.81:0/797053349 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe42401c3f0 con 0x7fe434070360 2024-04-23T14:45:18.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.553+0000 7fe438a00700 1 -- 172.21.15.81:0/797053349 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4140052b0 con 0x7fe434070360 2024-04-23T14:45:18.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.554+0000 7fe42a000700 1 -- 172.21.15.81:0/797053349 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fe424013420 con 0x7fe434070360 2024-04-23T14:45:18.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.554+0000 7fe42a000700 1 --2- 172.21.15.81:0/797053349 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fe4180692b0 0x7fe41806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:18.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.555+0000 7fe42a000700 1 -- 172.21.15.81:0/797053349 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe424088060 con 0x7fe434070360 2024-04-23T14:45:18.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.555+0000 7fe431400700 1 --2- 172.21.15.81:0/797053349 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fe4180692b0 0x7fe41806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:18.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.556+0000 7fe431400700 1 --2- 172.21.15.81:0/797053349 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fe4180692b0 0x7fe41806b760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe4340fe6d0 tx=0x7fe42000b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:45:18.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.560+0000 7fe42a000700 1 -- 172.21.15.81:0/797053349 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe4240546d0 con 0x7fe434070360 2024-04-23T14:45:18.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.783+0000 7fe438a00700 1 -- 172.21.15.81:0/797053349 --> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe414000bc0 con 0x7fe4180692b0 2024-04-23T14:45:18.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.784+0000 7fe42a000700 1 -- 172.21.15.81:0/797053349 <== mgr.14210 v2:172.21.15.81:6800/1053506915 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+29344 (secure 0 0 0) 0x7fe414000bc0 con 0x7fe4180692b0 2024-04-23T14:45:18.786 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:45:18.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.788+0000 7fe438a00700 1 -- 172.21.15.81:0/797053349 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fe4180692b0 msgr2=0x7fe41806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:18.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.788+0000 7fe438a00700 1 --2- 172.21.15.81:0/797053349 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fe4180692b0 0x7fe41806b760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe4340fe6d0 tx=0x7fe42000b040 comp rx=0 tx=0).stop 2024-04-23T14:45:18.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.788+0000 7fe438a00700 1 -- 172.21.15.81:0/797053349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe434070360 msgr2=0x7fe4340fcd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:18.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.788+0000 7fe438a00700 1 --2- 172.21.15.81:0/797053349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe434070360 0x7fe4340fcd90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe424004f50 tx=0x7fe424009e30 comp rx=0 tx=0).stop 2024-04-23T14:45:18.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.788+0000 7fe438a00700 1 -- 172.21.15.81:0/797053349 shutdown_connections 2024-04-23T14:45:18.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.788+0000 7fe438a00700 1 --2- 172.21.15.81:0/797053349 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fe4180692b0 0x7fe41806b760 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:18.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.788+0000 7fe438a00700 1 --2- 172.21.15.81:0/797053349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe434070360 0x7fe4340fcd90 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:18.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.788+0000 7fe438a00700 1 --2- 172.21.15.81:0/797053349 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe434070c70 0x7fe4340fd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:18.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.788+0000 7fe438a00700 1 -- 172.21.15.81:0/797053349 >> 172.21.15.81:0/797053349 conn(0x7fe4340f89d0 msgr2=0x7fe4340f9e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:45:18.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.788+0000 7fe438a00700 1 -- 172.21.15.81:0/797053349 shutdown_connections 2024-04-23T14:45:18.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:18.788+0000 7fe438a00700 1 -- 172.21.15.81:0/797053349 wait complete. 2024-04-23T14:45:18.790 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-04-23T14:45:19.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:18 smithi081 ceph-mon[25540]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:19.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:18 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:45:19.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:18 smithi081 ceph-mon[25540]: from='client.14422 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T14:45:19.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:18 smithi156 ceph-mon[32341]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:19.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:18 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:45:19.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:18 smithi156 ceph-mon[32341]: from='client.14422 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T14:45:19.600 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":197,"stamp":"2024-04-23T14:45:18.094677+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1788068,"kb_used_data":3924,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682844,"statfs":{"total":575970213888,"available":574139232256,"internally_reserved":0,"allocated":4018176,"data_stored":2624466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003223"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":188,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-23T14:44:13.774840+0000","last_change":"2024-04-23T14:43:38.344870+0000","last_active":"2024-04-23T14:44:13.774840+0000","last_peered":"2024-04-23T14:44:13.774840+0000","last_clean":"2024-04-23T14:44:13.774840+0000","last_became_active":"2024-04-23T14:43:38.343998+0000","last_became_peered":"2024-04-23T14:43:38.343998+0000","last_unstale":"2024-04-23T14:44:13.774840+0000","last_undegraded":"2024-04-23T14:44:13.774840+0000","last_fullsized":"2024-04-23T14:44:13.774840+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T14:42:33.153186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T14:42:33.153186+0000","last_clean_scrub_stamp":"2024-04-23T14:42:33.153186+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:08:59.849431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691856,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297720,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447432,"statfs":{"total":95995035648,"available":95690170368,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 23 14:45:14 2024","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.335}]},{"osd":1,"last update":"Tue Apr 23 14:45:14 2024","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":2.29,"5min":2.29,"15min":2.29},"last":1.034}]},{"osd":2,"last update":"Tue Apr 23 14:45:14 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.278}]},{"osd":3,"last update":"Tue Apr 23 14:45:14 2024","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.248},{"interface":"front","average":{"1min":1.349,"5min":1.349,"15min":1.349},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.4570000000000001}]},{"osd":4,"last update":"Tue Apr 23 14:45:14 2024","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.2509999999999999,"5min":2.2509999999999999,"15min":2.2509999999999999},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":1.016,"5min":1.016,"15min":1.016},"max":{"1min":2.9329999999999998,"5min":2.9329999999999998,"15min":2.9329999999999998},"last":1.387}]}]},{"osd":4,"up_from":35,"seq":150323855382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297728,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447424,"statfs":{"total":95995035648,"available":95690162176,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 23 14:44:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.516}]},{"osd":1,"last update":"Tue Apr 23 14:44:40 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":1.1519999999999999}]},{"osd":2,"last update":"Tue Apr 23 14:44:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":1.0960000000000001}]},{"osd":3,"last update":"Tue Apr 23 14:44:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":1.0600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.292}]}]},{"osd":3,"up_from":27,"seq":115964117022,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298300,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446852,"statfs":{"total":95995035648,"available":95689576448,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 23 14:45:09 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.004,"15min":0.99299999999999999},"min":{"1min":0.71499999999999997,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.071,"15min":1.0640000000000001},"min":{"1min":0.81999999999999995,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.3400000000000001,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":1.2450000000000001}]},{"osd":1,"last update":"Tue Apr 23 14:45:09 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":0.96899999999999997,"15min":0.94599999999999995},"min":{"1min":0.79800000000000004,"5min":0.745,"15min":0.745},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.0780000000000001,"15min":1.0720000000000001},"min":{"1min":0.81799999999999995,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.361,"5min":1.931,"15min":1.931},"last":1.1140000000000001}]},{"osd":2,"last update":"Tue Apr 23 14:45:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0329999999999999,"15min":1.024},"min":{"1min":0.71299999999999997,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":1.143},{"interface":"front","average":{"1min":1.175,"5min":1.071,"15min":1.0529999999999999},"min":{"1min":0.78800000000000003,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.296}]},{"osd":4,"last update":"Tue Apr 23 14:44:38 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.996},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.78400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]}]},{"osd":2,"up_from":19,"seq":81604378659,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297720,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447432,"statfs":{"total":95995035648,"available":95690170368,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 23 14:44:34 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.78600000000000003,"15min":0.77100000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.87,"15min":0.85999999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":1.1259999999999999}]},{"osd":1,"last update":"Tue Apr 23 14:44:34 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.91200000000000003,"15min":0.92000000000000004},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.369,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0660000000000001,"15min":1.0640000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.48,"5min":2.008,"15min":2.008},"last":1.073}]},{"osd":3,"last update":"Tue Apr 23 14:45:05 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1180000000000001,"15min":1.1120000000000001},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":1.228},{"interface":"front","average":{"1min":1,"5min":1.0229999999999999,"15min":1.0269999999999999},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":1.048}]},{"osd":4,"last update":"Tue Apr 23 14:44:40 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":1.304}]},{"osd":5,"last update":"Tue Apr 23 14:45:16 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.359},{"interface":"front","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.1819999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705715,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298300,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446852,"statfs":{"total":95995035648,"available":95689576448,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Apr 23 14:45:05 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.72899999999999998,"15min":0.69499999999999995},"min":{"1min":0.40999999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.74099999999999999,"15min":0.69899999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.93400000000000005}]},{"osd":2,"last update":"Tue Apr 23 14:44:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.879,"15min":0.88400000000000001},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":1.004},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.94899999999999995,"15min":0.95699999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.2210000000000001,"5min":1.29,"15min":1.29},"last":1.3779999999999999}]},{"osd":3,"last update":"Tue Apr 23 14:45:12 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.0700000000000001,"15min":1.0800000000000001},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.042,"5min":1.0249999999999999,"15min":1.022},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":1.0760000000000001}]},{"osd":4,"last update":"Tue Apr 23 14:44:40 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":1.218}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4299999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542187,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298300,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446852,"statfs":{"total":95995035648,"available":95689576448,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 23 14:44:57 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.76900000000000002,"15min":0.745},"min":{"1min":0.48499999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.5249999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.82699999999999996,"15min":0.79200000000000004},"min":{"1min":0.50900000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.503}]},{"osd":2,"last update":"Tue Apr 23 14:44:36 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.96699999999999997,"15min":0.96899999999999997},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1479999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.93100000000000005,"5min":1.0149999999999999,"15min":1.0289999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.343,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.52000000000000002}]},{"osd":3,"last update":"Tue Apr 23 14:45:07 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.103,"15min":1.081},"min":{"1min":0.93700000000000006,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.03},{"interface":"front","average":{"1min":1.212,"5min":1.093,"15min":1.073},"min":{"1min":0.94899999999999995,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.86699999999999999}]},{"osd":4,"last update":"Tue Apr 23 14:44:38 2024","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":1.1299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T14:45:19.601 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-23T14:45:19.602 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-23T14:45:19.602 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-04-23T14:45:19.602 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph health --format=json 2024-04-23T14:45:20.044 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:45:20.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:20 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:45:20.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:20 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:45:20.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:20 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:45:20.417 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:20 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:45:20.417 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:20 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:45:20.417 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:20 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:45:21.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:21 smithi081 ceph-mon[25540]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:21.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:21 smithi156 ceph-mon[32341]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:22.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.179+0000 7f4344800700 1 -- 172.21.15.81:0/2314702627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f433c102e20 msgr2=0x7f433c1031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:22.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.179+0000 7f4344800700 1 --2- 172.21.15.81:0/2314702627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f433c102e20 0x7f433c1031f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4330004940 tx=0x7f4330009e30 comp rx=0 tx=0).stop 2024-04-23T14:45:22.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.179+0000 7f4344800700 1 -- 172.21.15.81:0/2314702627 shutdown_connections 2024-04-23T14:45:22.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.179+0000 7f4344800700 1 --2- 172.21.15.81:0/2314702627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f433c1037c0 0x7f433c0fce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:22.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.179+0000 7f4344800700 1 --2- 172.21.15.81:0/2314702627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f433c102e20 0x7f433c1031f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:22.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.179+0000 7f4344800700 1 -- 172.21.15.81:0/2314702627 >> 172.21.15.81:0/2314702627 conn(0x7f433c0f89d0 msgr2=0x7f433c0fade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:45:22.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.179+0000 7f4344800700 1 -- 172.21.15.81:0/2314702627 shutdown_connections 2024-04-23T14:45:22.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.180+0000 7f4344800700 1 -- 172.21.15.81:0/2314702627 wait complete. 2024-04-23T14:45:22.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.180+0000 7f4344800700 1 Processor -- start 2024-04-23T14:45:22.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.181+0000 7f4344800700 1 -- start start 2024-04-23T14:45:22.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.181+0000 7f4344800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f433c102e20 0x7f433c0702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:22.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.181+0000 7f4344800700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f433c1037c0 0x7f433c070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:22.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.181+0000 7f4344800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433c070d90 con 0x7f433c102e20 2024-04-23T14:45:22.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.181+0000 7f4344800700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433c070ed0 con 0x7f433c1037c0 2024-04-23T14:45:22.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.181+0000 7f4341e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f433c102e20 0x7f433c0702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:22.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.181+0000 7f4341e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f433c102e20 0x7f433c0702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60538/0 (socket says 172.21.15.81:60538) 2024-04-23T14:45:22.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.181+0000 7f4341e00700 1 -- 172.21.15.81:0/618711769 learned_addr learned my addr 172.21.15.81:0/618711769 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:45:22.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.182+0000 7f4341400700 1 --2- 172.21.15.81:0/618711769 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f433c1037c0 0x7f433c070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:22.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.182+0000 7f4341e00700 1 -- 172.21.15.81:0/618711769 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f433c1037c0 msgr2=0x7f433c070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:22.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.182+0000 7f4341e00700 1 --2- 172.21.15.81:0/618711769 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f433c1037c0 0x7f433c070800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:22.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.182+0000 7f4341e00700 1 -- 172.21.15.81:0/618711769 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4330005040 con 0x7f433c102e20 2024-04-23T14:45:22.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.182+0000 7f4341e00700 1 --2- 172.21.15.81:0/618711769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f433c102e20 0x7f433c0702c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4330009150 tx=0x7f4330009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:45:22.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.182+0000 7f4336000700 1 -- 172.21.15.81:0/618711769 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f433000e040 con 0x7f433c102e20 2024-04-23T14:45:22.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.182+0000 7f4336000700 1 -- 172.21.15.81:0/618711769 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4330013420 con 0x7f433c102e20 2024-04-23T14:45:22.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.182+0000 7f4336000700 1 -- 172.21.15.81:0/618711769 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f433001c630 con 0x7f433c102e20 2024-04-23T14:45:22.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.182+0000 7f4344800700 1 -- 172.21.15.81:0/618711769 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f433c071120 con 0x7f433c102e20 2024-04-23T14:45:22.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.182+0000 7f4344800700 1 -- 172.21.15.81:0/618711769 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f433c11a2d0 con 0x7f433c102e20 2024-04-23T14:45:22.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.184+0000 7f4344800700 1 -- 172.21.15.81:0/618711769 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f433c100130 con 0x7f433c102e20 2024-04-23T14:45:22.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.184+0000 7f4336000700 1 -- 172.21.15.81:0/618711769 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f4330013590 con 0x7f433c102e20 2024-04-23T14:45:22.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.185+0000 7f4336000700 1 --2- 172.21.15.81:0/618711769 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f43240692b0 0x7f432406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:22.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.185+0000 7f4336000700 1 -- 172.21.15.81:0/618711769 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f43300880e0 con 0x7f433c102e20 2024-04-23T14:45:22.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.186+0000 7f4341400700 1 --2- 172.21.15.81:0/618711769 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f43240692b0 0x7f432406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:22.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.186+0000 7f4341400700 1 --2- 172.21.15.81:0/618711769 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f43240692b0 0x7f432406b760 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f433c071c00 tx=0x7f432c00b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:45:22.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.190+0000 7f4336000700 1 -- 172.21.15.81:0/618711769 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f4330054750 con 0x7f433c102e20 2024-04-23T14:45:22.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.445+0000 7f4344800700 1 -- 172.21.15.81:0/618711769 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f433c0fe570 con 0x7f433c102e20 2024-04-23T14:45:22.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.445+0000 7f4336000700 1 -- 172.21.15.81:0/618711769 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f4330057d70 con 0x7f433c102e20 2024-04-23T14:45:22.446 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:45:22.446 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-23T14:45:22.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.448+0000 7f4344800700 1 -- 172.21.15.81:0/618711769 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f43240692b0 msgr2=0x7f432406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:22.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.448+0000 7f4344800700 1 --2- 172.21.15.81:0/618711769 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f43240692b0 0x7f432406b760 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f433c071c00 tx=0x7f432c00b040 comp rx=0 tx=0).stop 2024-04-23T14:45:22.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.448+0000 7f4344800700 1 -- 172.21.15.81:0/618711769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f433c102e20 msgr2=0x7f433c0702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:22.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.448+0000 7f4344800700 1 --2- 172.21.15.81:0/618711769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f433c102e20 0x7f433c0702c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4330009150 tx=0x7f4330009e30 comp rx=0 tx=0).stop 2024-04-23T14:45:22.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.449+0000 7f4344800700 1 -- 172.21.15.81:0/618711769 shutdown_connections 2024-04-23T14:45:22.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.449+0000 7f4344800700 1 --2- 172.21.15.81:0/618711769 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f43240692b0 0x7f432406b760 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:22.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.449+0000 7f4344800700 1 --2- 172.21.15.81:0/618711769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f433c102e20 0x7f433c0702c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:22.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.449+0000 7f4344800700 1 --2- 172.21.15.81:0/618711769 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f433c1037c0 0x7f433c070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:22.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.449+0000 7f4344800700 1 -- 172.21.15.81:0/618711769 >> 172.21.15.81:0/618711769 conn(0x7f433c0f89d0 msgr2=0x7f433c107390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:45:22.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.449+0000 7f4344800700 1 -- 172.21.15.81:0/618711769 shutdown_connections 2024-04-23T14:45:22.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:22.449+0000 7f4344800700 1 -- 172.21.15.81:0/618711769 wait complete. 2024-04-23T14:45:23.219 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-04-23T14:45:23.219 INFO:tasks.cephadm:Setup complete, yielding 2024-04-23T14:45:23.220 INFO:teuthology.run_tasks:Running task print... 2024-04-23T14:45:23.229 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2024-04-23T14:45:23.229 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-23T14:45:23.238 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi081.front.sepia.ceph.com 2024-04-23T14:45:23.238 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-04-23T14:45:23.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:23 smithi156 ceph-mon[32341]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:23.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:23 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/618711769' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-23T14:45:23.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:23 smithi081 ceph-mon[25540]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:23.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:23 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/618711769' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-23T14:45:23.696 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:45:25.525 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:25 smithi081 ceph-mon[25540]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:25.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:25 smithi156 ceph-mon[32341]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:25.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:25.831+0000 7fed75000700 1 -- 172.21.15.81:0/2877671254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed700fffb0 msgr2=0x7fed701023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:25.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:25.831+0000 7fed75000700 1 --2- 172.21.15.81:0/2877671254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed700fffb0 0x7fed701023d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fed5c004940 tx=0x7fed5c009e30 comp rx=0 tx=0).stop 2024-04-23T14:45:25.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:25.831+0000 7fed75000700 1 -- 172.21.15.81:0/2877671254 shutdown_connections 2024-04-23T14:45:25.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:25.831+0000 7fed75000700 1 --2- 172.21.15.81:0/2877671254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed700fffb0 0x7fed701023d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:25.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:25.831+0000 7fed75000700 1 --2- 172.21.15.81:0/2877671254 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fed70066b80 0x7fed700ffa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:25.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:25.831+0000 7fed75000700 1 -- 172.21.15.81:0/2877671254 >> 172.21.15.81:0/2877671254 conn(0x7fed700f74e0 msgr2=0x7fed700f9910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:45:25.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:25.831+0000 7fed75000700 1 -- 172.21.15.81:0/2877671254 shutdown_connections 2024-04-23T14:45:25.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:25.831+0000 7fed75000700 1 -- 172.21.15.81:0/2877671254 wait complete. 2024-04-23T14:45:25.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:25.832+0000 7fed75000700 1 Processor -- start 2024-04-23T14:45:25.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:25.832+0000 7fed75000700 1 -- start start 2024-04-23T14:45:25.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:25.832+0000 7fed75000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed70066b80 0x7fed7010fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:25.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:25.832+0000 7fed75000700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fed700fffb0 0x7fed70110290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:25.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:25.832+0000 7fed75000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed70110890 con 0x7fed70066b80 2024-04-23T14:45:25.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:25.832+0000 7fed75000700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed70110fd0 con 0x7fed700fffb0 2024-04-23T14:45:25.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:25.833+0000 7fed6de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed70066b80 0x7fed7010fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:25.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:25.833+0000 7fed6de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed70066b80 0x7fed7010fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34070/0 (socket says 172.21.15.81:34070) 2024-04-23T14:45:25.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:25.833+0000 7fed6de00700 1 -- 172.21.15.81:0/1585694964 learned_addr learned my addr 172.21.15.81:0/1585694964 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:45:25.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:25.833+0000 7fed6d400700 1 --2- 172.21.15.81:0/1585694964 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fed700fffb0 0x7fed70110290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:25.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:25.833+0000 7fed6de00700 1 -- 172.21.15.81:0/1585694964 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fed700fffb0 msgr2=0x7fed70110290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:25.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:25.833+0000 7fed6de00700 1 --2- 172.21.15.81:0/1585694964 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fed700fffb0 0x7fed70110290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:25.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:25.833+0000 7fed6de00700 1 -- 172.21.15.81:0/1585694964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5c005040 con 0x7fed70066b80 2024-04-23T14:45:25.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:25.833+0000 7fed6de00700 1 --2- 172.21.15.81:0/1585694964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed70066b80 0x7fed7010fd50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fed6000c800 tx=0x7fed60004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:45:25.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:25.834+0000 7fed66000700 1 -- 172.21.15.81:0/1585694964 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed6000a760 con 0x7fed70066b80 2024-04-23T14:45:25.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:25.834+0000 7fed66000700 1 -- 172.21.15.81:0/1585694964 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fed6000ad90 con 0x7fed70066b80 2024-04-23T14:45:25.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:25.834+0000 7fed66000700 1 -- 172.21.15.81:0/1585694964 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed600113a0 con 0x7fed70066b80 2024-04-23T14:45:25.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:25.834+0000 7fed75000700 1 -- 172.21.15.81:0/1585694964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed701112b0 con 0x7fed70066b80 2024-04-23T14:45:25.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:25.834+0000 7fed75000700 1 -- 172.21.15.81:0/1585694964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed70111870 con 0x7fed70066b80 2024-04-23T14:45:25.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:25.835+0000 7fed75000700 1 -- 172.21.15.81:0/1585694964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed7005f5f0 con 0x7fed70066b80 2024-04-23T14:45:25.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:25.836+0000 7fed66000700 1 -- 172.21.15.81:0/1585694964 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fed60012400 con 0x7fed70066b80 2024-04-23T14:45:25.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:25.837+0000 7fed66000700 1 --2- 172.21.15.81:0/1585694964 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fed540692a0 0x7fed5406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:25.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:25.837+0000 7fed66000700 1 -- 172.21.15.81:0/1585694964 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fed60086ea0 con 0x7fed70066b80 2024-04-23T14:45:25.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:25.837+0000 7fed6d400700 1 --2- 172.21.15.81:0/1585694964 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fed540692a0 0x7fed5406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:25.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:25.838+0000 7fed6d400700 1 --2- 172.21.15.81:0/1585694964 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fed540692a0 0x7fed5406b750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fed5c00b3b0 tx=0x7fed5c009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:45:25.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:25.841+0000 7fed66000700 1 -- 172.21.15.81:0/1585694964 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fed60056f80 con 0x7fed70066b80 2024-04-23T14:45:26.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:26.054+0000 7fed75000700 1 -- 172.21.15.81:0/1585694964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7fed7004bed0 con 0x7fed70066b80 2024-04-23T14:45:26.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:26.061+0000 7fed66000700 1 -- 172.21.15.81:0/1585694964 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7fed60056b10 con 0x7fed70066b80 2024-04-23T14:45:26.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:26.064+0000 7fed75000700 1 -- 172.21.15.81:0/1585694964 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fed540692a0 msgr2=0x7fed5406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:26.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:26.064+0000 7fed75000700 1 --2- 172.21.15.81:0/1585694964 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fed540692a0 0x7fed5406b750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fed5c00b3b0 tx=0x7fed5c009e30 comp rx=0 tx=0).stop 2024-04-23T14:45:26.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:26.064+0000 7fed75000700 1 -- 172.21.15.81:0/1585694964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed70066b80 msgr2=0x7fed7010fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:26.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:26.064+0000 7fed75000700 1 --2- 172.21.15.81:0/1585694964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed70066b80 0x7fed7010fd50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fed6000c800 tx=0x7fed60004470 comp rx=0 tx=0).stop 2024-04-23T14:45:26.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:26.064+0000 7fed75000700 1 -- 172.21.15.81:0/1585694964 shutdown_connections 2024-04-23T14:45:26.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:26.064+0000 7fed75000700 1 --2- 172.21.15.81:0/1585694964 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fed540692a0 0x7fed5406b750 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:26.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:26.064+0000 7fed75000700 1 --2- 172.21.15.81:0/1585694964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed70066b80 0x7fed7010fd50 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:26.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:26.064+0000 7fed75000700 1 --2- 172.21.15.81:0/1585694964 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fed700fffb0 0x7fed70110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:26.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:26.064+0000 7fed75000700 1 -- 172.21.15.81:0/1585694964 >> 172.21.15.81:0/1585694964 conn(0x7fed700f74e0 msgr2=0x7fed700fbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:45:26.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:26.065+0000 7fed75000700 1 -- 172.21.15.81:0/1585694964 shutdown_connections 2024-04-23T14:45:26.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:26.065+0000 7fed75000700 1 -- 172.21.15.81:0/1585694964 wait complete. 2024-04-23T14:45:27.015 INFO:teuthology.run_tasks:Running task print... 2024-04-23T14:45:27.024 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-04-23T14:45:27.024 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-23T14:45:27.121 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi081.front.sepia.ceph.com 2024-04-23T14:45:27.122 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- bash -c 'ceph orch status' 2024-04-23T14:45:27.199 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:27 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/1585694964' entity='client.admin' 2024-04-23T14:45:27.199 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:27 smithi081 ceph-mon[25540]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:27.199 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:27 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:45:27.199 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:27 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:45:27.199 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:27 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:45:27.199 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:27 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:45:27.339 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:27 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/1585694964' entity='client.admin' 2024-04-23T14:45:27.340 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:27 smithi156 ceph-mon[32341]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:27.340 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:27 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:45:27.340 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:27 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:45:27.340 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:27 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:45:27.340 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:27 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:45:27.586 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:45:28.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:28 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:45:28.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:28 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:45:29.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:29 smithi156 ceph-mon[32341]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:29.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:29 smithi081 ceph-mon[25540]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:29.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:29.836+0000 7fb0b7e00700 1 -- 172.21.15.81:0/3801584354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b00fce80 msgr2=0x7fb0b00fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:29.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:29.836+0000 7fb0b7e00700 1 --2- 172.21.15.81:0/3801584354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b00fce80 0x7fb0b00fd290 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4004940 tx=0x7fb0a4009e30 comp rx=0 tx=0).stop 2024-04-23T14:45:29.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:29.836+0000 7fb0b7e00700 1 -- 172.21.15.81:0/3801584354 shutdown_connections 2024-04-23T14:45:29.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:29.836+0000 7fb0b7e00700 1 --2- 172.21.15.81:0/3801584354 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb0b00fdff0 0x7fb0b00fe460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:29.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:29.836+0000 7fb0b7e00700 1 --2- 172.21.15.81:0/3801584354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b00fce80 0x7fb0b00fd290 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:29.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:29.836+0000 7fb0b7e00700 1 -- 172.21.15.81:0/3801584354 >> 172.21.15.81:0/3801584354 conn(0x7fb0b00f8580 msgr2=0x7fb0b00fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:45:29.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:29.836+0000 7fb0b7e00700 1 -- 172.21.15.81:0/3801584354 shutdown_connections 2024-04-23T14:45:29.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:29.836+0000 7fb0b7e00700 1 -- 172.21.15.81:0/3801584354 wait complete. 2024-04-23T14:45:29.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:29.837+0000 7fb0b7e00700 1 Processor -- start 2024-04-23T14:45:29.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:29.837+0000 7fb0b7e00700 1 -- start start 2024-04-23T14:45:29.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:29.838+0000 7fb0b7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b00fce80 0x7fb0b010fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:29.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:29.838+0000 7fb0b7e00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb0b00fdff0 0x7fb0b01100c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:29.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:29.838+0000 7fb0b7e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b01106c0 con 0x7fb0b00fce80 2024-04-23T14:45:29.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:29.838+0000 7fb0b7e00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b0110830 con 0x7fb0b00fdff0 2024-04-23T14:45:29.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:29.838+0000 7fb0b5400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b00fce80 0x7fb0b010fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:29.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:29.838+0000 7fb0b5400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b00fce80 0x7fb0b010fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34096/0 (socket says 172.21.15.81:34096) 2024-04-23T14:45:29.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:29.838+0000 7fb0b5400700 1 -- 172.21.15.81:0/3507583755 learned_addr learned my addr 172.21.15.81:0/3507583755 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:45:29.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:29.838+0000 7fb0b5400700 1 -- 172.21.15.81:0/3507583755 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb0b00fdff0 msgr2=0x7fb0b01100c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:29.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:29.838+0000 7fb0b4a00700 1 --2- 172.21.15.81:0/3507583755 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb0b00fdff0 0x7fb0b01100c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:29.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:29.838+0000 7fb0b5400700 1 --2- 172.21.15.81:0/3507583755 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb0b00fdff0 0x7fb0b01100c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:29.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:29.838+0000 7fb0b5400700 1 -- 172.21.15.81:0/3507583755 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a4005040 con 0x7fb0b00fce80 2024-04-23T14:45:29.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:29.839+0000 7fb0b5400700 1 --2- 172.21.15.81:0/3507583755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b00fce80 0x7fb0b010fb80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb0a400b3b0 tx=0x7fb0a4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:45:29.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:29.839+0000 7fb0ad600700 1 -- 172.21.15.81:0/3507583755 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0a400e040 con 0x7fb0b00fce80 2024-04-23T14:45:29.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:29.839+0000 7fb0ad600700 1 -- 172.21.15.81:0/3507583755 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb0a4004290 con 0x7fb0b00fce80 2024-04-23T14:45:29.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:29.839+0000 7fb0b7e00700 1 -- 172.21.15.81:0/3507583755 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b01151e0 con 0x7fb0b00fce80 2024-04-23T14:45:29.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:29.839+0000 7fb0ad600700 1 -- 172.21.15.81:0/3507583755 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0a401c630 con 0x7fb0b00fce80 2024-04-23T14:45:29.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:29.839+0000 7fb0b7e00700 1 -- 172.21.15.81:0/3507583755 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b01157a0 con 0x7fb0b00fce80 2024-04-23T14:45:29.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:29.840+0000 7fb0b7e00700 1 -- 172.21.15.81:0/3507583755 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b0101980 con 0x7fb0b00fce80 2024-04-23T14:45:29.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:29.841+0000 7fb0ad600700 1 -- 172.21.15.81:0/3507583755 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fb0a400bbf0 con 0x7fb0b00fce80 2024-04-23T14:45:29.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:29.842+0000 7fb0ad600700 1 --2- 172.21.15.81:0/3507583755 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fb0980692a0 0x7fb09806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:29.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:29.842+0000 7fb0ad600700 1 -- 172.21.15.81:0/3507583755 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb0a40882d0 con 0x7fb0b00fce80 2024-04-23T14:45:29.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:29.842+0000 7fb0b4a00700 1 --2- 172.21.15.81:0/3507583755 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fb0980692a0 0x7fb09806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:29.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:29.843+0000 7fb0b4a00700 1 --2- 172.21.15.81:0/3507583755 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fb0980692a0 0x7fb09806b750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0041d0 tx=0x7fb09c009040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:45:29.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:29.847+0000 7fb0ad600700 1 -- 172.21.15.81:0/3507583755 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fb0a40583b0 con 0x7fb0b00fce80 2024-04-23T14:45:30.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:30.082+0000 7fb0b7e00700 1 -- 172.21.15.81:0/3507583755 --> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0b002b3b0 con 0x7fb0980692a0 2024-04-23T14:45:30.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:30.085+0000 7fb0ad600700 1 -- 172.21.15.81:0/3507583755 <== mgr.14210 v2:172.21.15.81:6800/1053506915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fb0b002b3b0 con 0x7fb0980692a0 2024-04-23T14:45:30.087 INFO:teuthology.orchestra.run.smithi081.stdout:Backend: cephadm 2024-04-23T14:45:30.087 INFO:teuthology.orchestra.run.smithi081.stdout:Available: Yes 2024-04-23T14:45:30.087 INFO:teuthology.orchestra.run.smithi081.stdout:Paused: No 2024-04-23T14:45:30.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:30.088+0000 7fb0b7e00700 1 -- 172.21.15.81:0/3507583755 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fb0980692a0 msgr2=0x7fb09806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:30.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:30.088+0000 7fb0b7e00700 1 --2- 172.21.15.81:0/3507583755 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fb0980692a0 0x7fb09806b750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0041d0 tx=0x7fb09c009040 comp rx=0 tx=0).stop 2024-04-23T14:45:30.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:30.088+0000 7fb0b7e00700 1 -- 172.21.15.81:0/3507583755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b00fce80 msgr2=0x7fb0b010fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:30.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:30.088+0000 7fb0b7e00700 1 --2- 172.21.15.81:0/3507583755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b00fce80 0x7fb0b010fb80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb0a400b3b0 tx=0x7fb0a4009e30 comp rx=0 tx=0).stop 2024-04-23T14:45:30.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:30.088+0000 7fb0b7e00700 1 -- 172.21.15.81:0/3507583755 shutdown_connections 2024-04-23T14:45:30.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:30.088+0000 7fb0b7e00700 1 --2- 172.21.15.81:0/3507583755 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fb0980692a0 0x7fb09806b750 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:30.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:30.088+0000 7fb0b7e00700 1 --2- 172.21.15.81:0/3507583755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b00fce80 0x7fb0b010fb80 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:30.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:30.088+0000 7fb0b7e00700 1 --2- 172.21.15.81:0/3507583755 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb0b00fdff0 0x7fb0b01100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:30.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:30.088+0000 7fb0b7e00700 1 -- 172.21.15.81:0/3507583755 >> 172.21.15.81:0/3507583755 conn(0x7fb0b00f8580 msgr2=0x7fb0b00f9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:45:30.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:30.089+0000 7fb0b7e00700 1 -- 172.21.15.81:0/3507583755 shutdown_connections 2024-04-23T14:45:30.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:30.089+0000 7fb0b7e00700 1 -- 172.21.15.81:0/3507583755 wait complete. 2024-04-23T14:45:31.085 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- bash -c 'ceph orch ps' 2024-04-23T14:45:31.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:31 smithi081 ceph-mon[25540]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:45:31.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:31 smithi081 ceph-mon[25540]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:31.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:31 smithi156 ceph-mon[32341]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:45:31.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:31 smithi156 ceph-mon[32341]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:31.550 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:45:33.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:33 smithi081 ceph-mon[25540]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:33.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:33 smithi156 ceph-mon[32341]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:33.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:33.889+0000 7fdd93600700 1 -- 172.21.15.81:0/649503521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd8c071ea0 msgr2=0x7fdd8c0703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:33.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:33.889+0000 7fdd93600700 1 --2- 172.21.15.81:0/649503521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd8c071ea0 0x7fdd8c0703b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdd80004940 tx=0x7fdd80009e30 comp rx=0 tx=0).stop 2024-04-23T14:45:33.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:33.889+0000 7fdd93600700 1 -- 172.21.15.81:0/649503521 shutdown_connections 2024-04-23T14:45:33.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:33.889+0000 7fdd93600700 1 --2- 172.21.15.81:0/649503521 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd8c0708f0 0x7fdd8c070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:33.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:33.889+0000 7fdd93600700 1 --2- 172.21.15.81:0/649503521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd8c071ea0 0x7fdd8c0703b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:33.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:33.889+0000 7fdd93600700 1 -- 172.21.15.81:0/649503521 >> 172.21.15.81:0/649503521 conn(0x7fdd8c0f8580 msgr2=0x7fdd8c0fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:45:33.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:33.889+0000 7fdd93600700 1 -- 172.21.15.81:0/649503521 shutdown_connections 2024-04-23T14:45:33.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:33.889+0000 7fdd93600700 1 -- 172.21.15.81:0/649503521 wait complete. 2024-04-23T14:45:33.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:33.890+0000 7fdd93600700 1 Processor -- start 2024-04-23T14:45:33.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:33.890+0000 7fdd93600700 1 -- start start 2024-04-23T14:45:33.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:33.891+0000 7fdd93600700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd8c0708f0 0x7fdd8c10fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:33.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:33.891+0000 7fdd93600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd8c071ea0 0x7fdd8c110100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:33.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:33.891+0000 7fdd93600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c110700 con 0x7fdd8c071ea0 2024-04-23T14:45:33.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:33.891+0000 7fdd93600700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c110870 con 0x7fdd8c0708f0 2024-04-23T14:45:33.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:33.891+0000 7fdd8be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd8c071ea0 0x7fdd8c110100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:33.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:33.891+0000 7fdd8be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd8c071ea0 0x7fdd8c110100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53498/0 (socket says 172.21.15.81:53498) 2024-04-23T14:45:33.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:33.891+0000 7fdd8be00700 1 -- 172.21.15.81:0/3117213456 learned_addr learned my addr 172.21.15.81:0/3117213456 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:45:33.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:33.891+0000 7fdd90c00700 1 --2- 172.21.15.81:0/3117213456 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd8c0708f0 0x7fdd8c10fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:33.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:33.892+0000 7fdd8be00700 1 -- 172.21.15.81:0/3117213456 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd8c0708f0 msgr2=0x7fdd8c10fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:33.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:33.892+0000 7fdd8be00700 1 --2- 172.21.15.81:0/3117213456 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd8c0708f0 0x7fdd8c10fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:33.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:33.892+0000 7fdd8be00700 1 -- 172.21.15.81:0/3117213456 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd80005040 con 0x7fdd8c071ea0 2024-04-23T14:45:33.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:33.892+0000 7fdd8be00700 1 --2- 172.21.15.81:0/3117213456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd8c071ea0 0x7fdd8c110100 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdd78002a50 tx=0x7fdd780046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:45:33.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:33.893+0000 7fdd88c00700 1 -- 172.21.15.81:0/3117213456 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd78007cc0 con 0x7fdd8c071ea0 2024-04-23T14:45:33.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:33.893+0000 7fdd88c00700 1 -- 172.21.15.81:0/3117213456 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdd7800f040 con 0x7fdd8c071ea0 2024-04-23T14:45:33.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:33.893+0000 7fdd93600700 1 -- 172.21.15.81:0/3117213456 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd8c1152d0 con 0x7fdd8c071ea0 2024-04-23T14:45:33.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:33.893+0000 7fdd88c00700 1 -- 172.21.15.81:0/3117213456 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd7800da30 con 0x7fdd8c071ea0 2024-04-23T14:45:33.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:33.893+0000 7fdd93600700 1 -- 172.21.15.81:0/3117213456 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd8c115890 con 0x7fdd8c071ea0 2024-04-23T14:45:33.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:33.894+0000 7fdd93600700 1 -- 172.21.15.81:0/3117213456 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd8c04c710 con 0x7fdd8c071ea0 2024-04-23T14:45:33.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:33.895+0000 7fdd88c00700 1 -- 172.21.15.81:0/3117213456 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fdd7800dbb0 con 0x7fdd8c071ea0 2024-04-23T14:45:33.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:33.896+0000 7fdd88c00700 1 --2- 172.21.15.81:0/3117213456 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fdd740692a0 0x7fdd7406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:33.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:33.896+0000 7fdd88c00700 1 -- 172.21.15.81:0/3117213456 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fdd78086bf0 con 0x7fdd8c071ea0 2024-04-23T14:45:33.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:33.897+0000 7fdd90c00700 1 --2- 172.21.15.81:0/3117213456 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fdd740692a0 0x7fdd7406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:33.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:33.897+0000 7fdd90c00700 1 --2- 172.21.15.81:0/3117213456 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fdd740692a0 0x7fdd7406b750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdd80004890 tx=0x7fdd80009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:45:33.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:33.900+0000 7fdd88c00700 1 -- 172.21.15.81:0/3117213456 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fdd780569c0 con 0x7fdd8c071ea0 2024-04-23T14:45:34.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:34.125+0000 7fdd93600700 1 -- 172.21.15.81:0/3117213456 --> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdd8c103ea0 con 0x7fdd740692a0 2024-04-23T14:45:34.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:34.149+0000 7fdd88c00700 1 -- 172.21.15.81:0/3117213456 <== mgr.14210 v2:172.21.15.81:6800/1053506915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2682 (secure 0 0 0) 0x7fdd8c103ea0 con 0x7fdd740692a0 2024-04-23T14:45:34.151 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-23T14:45:34.151 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (4m) 2m ago 6m 14.7M - 0.25.0 c8568f914cd2 730d7164defb 2024-04-23T14:45:34.151 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (6m) 2m ago 6m 6660k - 17.2.7-884-g70d0cb4b cafd8ddac8fa 6ae90c81b232 2024-04-23T14:45:34.151 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi156 smithi156 running (5m) 82s ago 5m 6660k - 17.2.7-884-g70d0cb4b cafd8ddac8fa ecc141919f37 2024-04-23T14:45:34.151 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (4m) 2m ago 6m 73.8M - 9.4.7 954c08fa6188 96965e7e10cc 2024-04-23T14:45:34.151 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.ldghvq smithi081 *:9283 running (8m) 2m ago 8m 473M - 17.2.7-884-g70d0cb4b cafd8ddac8fa b3d1da9bbf01 2024-04-23T14:45:34.151 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi156.ounwyj smithi156 *:8443,9283 running (5m) 82s ago 5m 431M - 17.2.7-884-g70d0cb4b cafd8ddac8fa e41b78b84933 2024-04-23T14:45:34.151 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (8m) 2m ago 8m 40.9M 2048M 17.2.7-884-g70d0cb4b cafd8ddac8fa 6e43d934b336 2024-04-23T14:45:34.151 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi156 smithi156 running (5m) 82s ago 5m 37.8M 2048M 17.2.7-884-g70d0cb4b cafd8ddac8fa d9127540d3bb 2024-04-23T14:45:34.152 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (6m) 2m ago 6m 7583k - 1.5.0 0da6a335fe13 06716415b80c 2024-04-23T14:45:34.152 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi156 smithi156 *:9100 running (5m) 82s ago 5m 7407k - 1.5.0 0da6a335fe13 2d9e680be69f 2024-04-23T14:45:34.152 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (4m) 2m ago 4m 39.6M 4288M 17.2.7-884-g70d0cb4b cafd8ddac8fa 272ca032bec1 2024-04-23T14:45:34.152 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (3m) 2m ago 3m 38.7M 4288M 17.2.7-884-g70d0cb4b cafd8ddac8fa ee6d0c8af6ed 2024-04-23T14:45:34.152 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (3m) 2m ago 3m 39.7M 4288M 17.2.7-884-g70d0cb4b cafd8ddac8fa c26c640828a2 2024-04-23T14:45:34.152 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi156 running (2m) 82s ago 2m 38.8M 5312M 17.2.7-884-g70d0cb4b cafd8ddac8fa c1c261b1ee90 2024-04-23T14:45:34.152 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi156 running (2m) 82s ago 2m 34.8M 5312M 17.2.7-884-g70d0cb4b cafd8ddac8fa 83f996ee64de 2024-04-23T14:45:34.152 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi156 running (87s) 82s ago 87s 10.5M 5312M 17.2.7-884-g70d0cb4b cafd8ddac8fa b754244bef18 2024-04-23T14:45:34.152 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (4m) 2m ago 6m 35.5M - 2.43.0 a07b618ecd1d 1779b897e5df 2024-04-23T14:45:34.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:34.152+0000 7fdd93600700 1 -- 172.21.15.81:0/3117213456 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fdd740692a0 msgr2=0x7fdd7406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:34.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:34.152+0000 7fdd93600700 1 --2- 172.21.15.81:0/3117213456 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fdd740692a0 0x7fdd7406b750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdd80004890 tx=0x7fdd80009e30 comp rx=0 tx=0).stop 2024-04-23T14:45:34.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:34.152+0000 7fdd93600700 1 -- 172.21.15.81:0/3117213456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd8c071ea0 msgr2=0x7fdd8c110100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:34.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:34.152+0000 7fdd93600700 1 --2- 172.21.15.81:0/3117213456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd8c071ea0 0x7fdd8c110100 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdd78002a50 tx=0x7fdd780046b0 comp rx=0 tx=0).stop 2024-04-23T14:45:34.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:34.152+0000 7fdd93600700 1 -- 172.21.15.81:0/3117213456 shutdown_connections 2024-04-23T14:45:34.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:34.152+0000 7fdd93600700 1 --2- 172.21.15.81:0/3117213456 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd8c0708f0 0x7fdd8c10fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:34.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:34.152+0000 7fdd93600700 1 --2- 172.21.15.81:0/3117213456 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fdd740692a0 0x7fdd7406b750 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:34.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:34.152+0000 7fdd93600700 1 --2- 172.21.15.81:0/3117213456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd8c071ea0 0x7fdd8c110100 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:34.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:34.152+0000 7fdd93600700 1 -- 172.21.15.81:0/3117213456 >> 172.21.15.81:0/3117213456 conn(0x7fdd8c0f8580 msgr2=0x7fdd8c0f9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:45:34.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:34.152+0000 7fdd93600700 1 -- 172.21.15.81:0/3117213456 shutdown_connections 2024-04-23T14:45:34.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:34.153+0000 7fdd93600700 1 -- 172.21.15.81:0/3117213456 wait complete. 2024-04-23T14:45:35.049 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- bash -c 'ceph orch ls' 2024-04-23T14:45:35.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:35 smithi081 ceph-mon[25540]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:35.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:35 smithi081 ceph-mon[25540]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:45:35.510 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:45:35.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:35 smithi156 ceph-mon[32341]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:35.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:35 smithi156 ceph-mon[32341]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:45:37.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:37 smithi081 ceph-mon[25540]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:37.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:37 smithi156 ceph-mon[32341]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:37.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:37.856+0000 7f75f6400700 1 -- 172.21.15.81:0/2004988214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75f00fef00 msgr2=0x7f75f00ff310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:37.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:37.856+0000 7f75f6400700 1 --2- 172.21.15.81:0/2004988214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75f00fef00 0x7f75f00ff310 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f75e4004940 tx=0x7f75e4009e30 comp rx=0 tx=0).stop 2024-04-23T14:45:37.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:37.856+0000 7f75f6400700 1 -- 172.21.15.81:0/2004988214 shutdown_connections 2024-04-23T14:45:37.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:37.856+0000 7f75f6400700 1 --2- 172.21.15.81:0/2004988214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75f0100070 0x7f75f01004e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:37.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:37.856+0000 7f75f6400700 1 --2- 172.21.15.81:0/2004988214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75f00fef00 0x7f75f00ff310 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:37.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:37.856+0000 7f75f6400700 1 -- 172.21.15.81:0/2004988214 >> 172.21.15.81:0/2004988214 conn(0x7f75f00fa790 msgr2=0x7f75f00fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:45:37.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:37.857+0000 7f75f6400700 1 -- 172.21.15.81:0/2004988214 shutdown_connections 2024-04-23T14:45:37.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:37.857+0000 7f75f6400700 1 -- 172.21.15.81:0/2004988214 wait complete. 2024-04-23T14:45:37.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:37.857+0000 7f75f6400700 1 Processor -- start 2024-04-23T14:45:37.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:37.858+0000 7f75f6400700 1 -- start start 2024-04-23T14:45:37.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:37.858+0000 7f75f6400700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75f00fef00 0x7f75f010fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:37.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:37.858+0000 7f75f6400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75f0100070 0x7f75f010ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:37.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:37.858+0000 7f75f6400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f01105a0 con 0x7f75f0100070 2024-04-23T14:45:37.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:37.858+0000 7f75f6400700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f0110df0 con 0x7f75f00fef00 2024-04-23T14:45:37.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:37.858+0000 7f75efe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75f0100070 0x7f75f010ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:37.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:37.858+0000 7f75efe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75f0100070 0x7f75f010ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53518/0 (socket says 172.21.15.81:53518) 2024-04-23T14:45:37.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:37.858+0000 7f75efe00700 1 -- 172.21.15.81:0/4038688772 learned_addr learned my addr 172.21.15.81:0/4038688772 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:45:37.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:37.859+0000 7f75f5000700 1 --2- 172.21.15.81:0/4038688772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75f00fef00 0x7f75f010fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:37.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:37.859+0000 7f75efe00700 1 -- 172.21.15.81:0/4038688772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75f00fef00 msgr2=0x7f75f010fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:37.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:37.859+0000 7f75efe00700 1 --2- 172.21.15.81:0/4038688772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75f00fef00 0x7f75f010fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:37.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:37.859+0000 7f75efe00700 1 -- 172.21.15.81:0/4038688772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e4005040 con 0x7f75f0100070 2024-04-23T14:45:37.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:37.859+0000 7f75efe00700 1 --2- 172.21.15.81:0/4038688772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75f0100070 0x7f75f010ffa0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f75dc002a50 tx=0x7f75dc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:45:37.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:37.860+0000 7f75ecc00700 1 -- 172.21.15.81:0/4038688772 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75dc007cc0 con 0x7f75f0100070 2024-04-23T14:45:37.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:37.860+0000 7f75f6400700 1 -- 172.21.15.81:0/4038688772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f01110d0 con 0x7f75f0100070 2024-04-23T14:45:37.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:37.860+0000 7f75ecc00700 1 -- 172.21.15.81:0/4038688772 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f75dc00f040 con 0x7f75f0100070 2024-04-23T14:45:37.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:37.860+0000 7f75f6400700 1 -- 172.21.15.81:0/4038688772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f0111610 con 0x7f75f0100070 2024-04-23T14:45:37.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:37.860+0000 7f75ecc00700 1 -- 172.21.15.81:0/4038688772 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75dc00d9f0 con 0x7f75f0100070 2024-04-23T14:45:37.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:37.861+0000 7f75f6400700 1 -- 172.21.15.81:0/4038688772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f00fe290 con 0x7f75f0100070 2024-04-23T14:45:37.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:37.862+0000 7f75ecc00700 1 -- 172.21.15.81:0/4038688772 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f75dc00db90 con 0x7f75f0100070 2024-04-23T14:45:37.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:37.863+0000 7f75ecc00700 1 --2- 172.21.15.81:0/4038688772 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f75d80692a0 0x7f75d806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:37.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:37.863+0000 7f75ecc00700 1 -- 172.21.15.81:0/4038688772 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f75dc086c70 con 0x7f75f0100070 2024-04-23T14:45:37.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:37.863+0000 7f75f5000700 1 --2- 172.21.15.81:0/4038688772 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f75d80692a0 0x7f75d806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:37.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:37.864+0000 7f75f5000700 1 --2- 172.21.15.81:0/4038688772 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f75d80692a0 0x7f75d806b750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f75e400b3b0 tx=0x7f75e4009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:45:37.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:37.867+0000 7f75ecc00700 1 -- 172.21.15.81:0/4038688772 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f75dc08d080 con 0x7f75f0100070 2024-04-23T14:45:38.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:38.094+0000 7f75f6400700 1 -- 172.21.15.81:0/4038688772 --> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f75f0111990 con 0x7f75d80692a0 2024-04-23T14:45:38.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:38.102+0000 7f75ecc00700 1 -- 172.21.15.81:0/4038688772 <== mgr.14210 v2:172.21.15.81:6800/1053506915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1170 (secure 0 0 0) 0x7f75f0111990 con 0x7f75d80692a0 2024-04-23T14:45:38.104 INFO:teuthology.orchestra.run.smithi081.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-04-23T14:45:38.104 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager ?:9093,9094 1/1 2m ago 7m count:1 2024-04-23T14:45:38.104 INFO:teuthology.orchestra.run.smithi081.stdout:crash 2/2 2m ago 7m * 2024-04-23T14:45:38.104 INFO:teuthology.orchestra.run.smithi081.stdout:grafana ?:3000 1/1 2m ago 7m count:1 2024-04-23T14:45:38.104 INFO:teuthology.orchestra.run.smithi081.stdout:mgr 2/2 2m ago 7m count:2 2024-04-23T14:45:38.104 INFO:teuthology.orchestra.run.smithi081.stdout:mon 2/2 2m ago 6m smithi081:172.21.15.81=smithi081;smithi156:172.21.15.156=smithi156;count:2 2024-04-23T14:45:38.104 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter ?:9100 2/2 2m ago 7m * 2024-04-23T14:45:38.104 INFO:teuthology.orchestra.run.smithi081.stdout:osd 6 2m ago - 2024-04-23T14:45:38.104 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus ?:9095 1/1 2m ago 7m count:1 2024-04-23T14:45:38.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:38.105+0000 7f75f6400700 1 -- 172.21.15.81:0/4038688772 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f75d80692a0 msgr2=0x7f75d806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:38.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:38.105+0000 7f75f6400700 1 --2- 172.21.15.81:0/4038688772 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f75d80692a0 0x7f75d806b750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f75e400b3b0 tx=0x7f75e4009e30 comp rx=0 tx=0).stop 2024-04-23T14:45:38.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:38.105+0000 7f75f6400700 1 -- 172.21.15.81:0/4038688772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75f0100070 msgr2=0x7f75f010ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:38.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:38.105+0000 7f75f6400700 1 --2- 172.21.15.81:0/4038688772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75f0100070 0x7f75f010ffa0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f75dc002a50 tx=0x7f75dc0046b0 comp rx=0 tx=0).stop 2024-04-23T14:45:38.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:38.106+0000 7f75f6400700 1 -- 172.21.15.81:0/4038688772 shutdown_connections 2024-04-23T14:45:38.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:38.106+0000 7f75f6400700 1 --2- 172.21.15.81:0/4038688772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75f00fef00 0x7f75f010fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:38.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:38.106+0000 7f75f6400700 1 --2- 172.21.15.81:0/4038688772 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f75d80692a0 0x7f75d806b750 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:38.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:38.106+0000 7f75f6400700 1 --2- 172.21.15.81:0/4038688772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75f0100070 0x7f75f010ffa0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:38.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:38.106+0000 7f75f6400700 1 -- 172.21.15.81:0/4038688772 >> 172.21.15.81:0/4038688772 conn(0x7f75f00fa790 msgr2=0x7f75f00fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:45:38.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:38.106+0000 7f75f6400700 1 -- 172.21.15.81:0/4038688772 shutdown_connections 2024-04-23T14:45:38.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:38.106+0000 7f75f6400700 1 -- 172.21.15.81:0/4038688772 wait complete. 2024-04-23T14:45:39.015 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- bash -c 'ceph orch host ls' 2024-04-23T14:45:39.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:39 smithi156 ceph-mon[32341]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:45:39.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:39 smithi156 ceph-mon[32341]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:39.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:39 smithi081 ceph-mon[25540]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:45:39.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:39 smithi081 ceph-mon[25540]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:39.502 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:45:41.441 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:41 smithi081 ceph-mon[25540]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:41.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:41 smithi156 ceph-mon[32341]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:41.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.695+0000 7fc21dc00700 1 -- 172.21.15.81:0/4027685933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2180662f0 msgr2=0x7fc2180ffa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:41.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.695+0000 7fc21dc00700 1 --2- 172.21.15.81:0/4027685933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2180662f0 0x7fc2180ffa30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc208004940 tx=0x7fc208009e30 comp rx=0 tx=0).stop 2024-04-23T14:45:41.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.695+0000 7fc21dc00700 1 -- 172.21.15.81:0/4027685933 shutdown_connections 2024-04-23T14:45:41.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.695+0000 7fc21dc00700 1 --2- 172.21.15.81:0/4027685933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc2180fff70 0x7fc218102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:41.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.695+0000 7fc21dc00700 1 --2- 172.21.15.81:0/4027685933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2180662f0 0x7fc2180ffa30 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:41.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.695+0000 7fc21dc00700 1 -- 172.21.15.81:0/4027685933 >> 172.21.15.81:0/4027685933 conn(0x7fc2180f74c0 msgr2=0x7fc2180f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:45:41.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.695+0000 7fc21dc00700 1 -- 172.21.15.81:0/4027685933 shutdown_connections 2024-04-23T14:45:41.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.695+0000 7fc21dc00700 1 -- 172.21.15.81:0/4027685933 wait complete. 2024-04-23T14:45:41.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.696+0000 7fc21dc00700 1 Processor -- start 2024-04-23T14:45:41.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.696+0000 7fc21dc00700 1 -- start start 2024-04-23T14:45:41.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.697+0000 7fc21dc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2180662f0 0x7fc21810fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:41.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.697+0000 7fc21dc00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc2180fff70 0x7fc218110250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:41.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.697+0000 7fc21dc00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc218110f60 con 0x7fc2180662f0 2024-04-23T14:45:41.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.697+0000 7fc21dc00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2181110d0 con 0x7fc2180fff70 2024-04-23T14:45:41.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.697+0000 7fc216a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2180662f0 0x7fc21810fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:41.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.697+0000 7fc216a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2180662f0 0x7fc21810fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53536/0 (socket says 172.21.15.81:53536) 2024-04-23T14:45:41.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.697+0000 7fc216a00700 1 -- 172.21.15.81:0/2340678975 learned_addr learned my addr 172.21.15.81:0/2340678975 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:45:41.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.697+0000 7fc216a00700 1 -- 172.21.15.81:0/2340678975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc2180fff70 msgr2=0x7fc218110250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:41.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.697+0000 7fc216a00700 1 --2- 172.21.15.81:0/2340678975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc2180fff70 0x7fc218110250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:41.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.697+0000 7fc216a00700 1 -- 172.21.15.81:0/2340678975 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc208005040 con 0x7fc2180662f0 2024-04-23T14:45:41.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.698+0000 7fc216a00700 1 --2- 172.21.15.81:0/2340678975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2180662f0 0x7fc21810fd10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc20800b970 tx=0x7fc208009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:45:41.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.698+0000 7fc20ea00700 1 -- 172.21.15.81:0/2340678975 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc20800e040 con 0x7fc2180662f0 2024-04-23T14:45:41.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.698+0000 7fc20ea00700 1 -- 172.21.15.81:0/2340678975 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc208004290 con 0x7fc2180662f0 2024-04-23T14:45:41.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.698+0000 7fc21dc00700 1 -- 172.21.15.81:0/2340678975 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc218111350 con 0x7fc2180662f0 2024-04-23T14:45:41.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.698+0000 7fc20ea00700 1 -- 172.21.15.81:0/2340678975 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc20801c630 con 0x7fc2180662f0 2024-04-23T14:45:41.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.698+0000 7fc21dc00700 1 -- 172.21.15.81:0/2340678975 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc218111910 con 0x7fc2180662f0 2024-04-23T14:45:41.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.699+0000 7fc21dc00700 1 -- 172.21.15.81:0/2340678975 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc21805f5f0 con 0x7fc2180662f0 2024-04-23T14:45:41.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.700+0000 7fc20ea00700 1 -- 172.21.15.81:0/2340678975 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fc20800bbf0 con 0x7fc2180662f0 2024-04-23T14:45:41.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.701+0000 7fc20ea00700 1 --2- 172.21.15.81:0/2340678975 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fc1fc0692b0 0x7fc1fc06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:41.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.701+0000 7fc20ea00700 1 -- 172.21.15.81:0/2340678975 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc208088260 con 0x7fc2180662f0 2024-04-23T14:45:41.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.701+0000 7fc216000700 1 --2- 172.21.15.81:0/2340678975 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fc1fc0692b0 0x7fc1fc06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:41.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.702+0000 7fc216000700 1 --2- 172.21.15.81:0/2340678975 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fc1fc0692b0 0x7fc1fc06b760 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc204006fd0 tx=0x7fc204006db0 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:45:41.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.705+0000 7fc20ea00700 1 -- 172.21.15.81:0/2340678975 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fc208058360 con 0x7fc2180662f0 2024-04-23T14:45:41.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.925+0000 7fc21dc00700 1 -- 172.21.15.81:0/2340678975 --> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fc218111bd0 con 0x7fc1fc0692b0 2024-04-23T14:45:41.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.928+0000 7fc20ea00700 1 -- 172.21.15.81:0/2340678975 <== mgr.14210 v2:172.21.15.81:6800/1053506915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7fc218111bd0 con 0x7fc1fc0692b0 2024-04-23T14:45:41.930 INFO:teuthology.orchestra.run.smithi081.stdout:HOST ADDR LABELS STATUS 2024-04-23T14:45:41.930 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081 172.21.15.81 2024-04-23T14:45:41.930 INFO:teuthology.orchestra.run.smithi081.stdout:smithi156 172.21.15.156 2024-04-23T14:45:41.930 INFO:teuthology.orchestra.run.smithi081.stdout:2 hosts in cluster 2024-04-23T14:45:41.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.931+0000 7fc21dc00700 1 -- 172.21.15.81:0/2340678975 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fc1fc0692b0 msgr2=0x7fc1fc06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:41.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.931+0000 7fc21dc00700 1 --2- 172.21.15.81:0/2340678975 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fc1fc0692b0 0x7fc1fc06b760 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc204006fd0 tx=0x7fc204006db0 comp rx=0 tx=0).stop 2024-04-23T14:45:41.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.931+0000 7fc21dc00700 1 -- 172.21.15.81:0/2340678975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2180662f0 msgr2=0x7fc21810fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:41.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.931+0000 7fc21dc00700 1 --2- 172.21.15.81:0/2340678975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2180662f0 0x7fc21810fd10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc20800b970 tx=0x7fc208009e30 comp rx=0 tx=0).stop 2024-04-23T14:45:41.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.931+0000 7fc21dc00700 1 -- 172.21.15.81:0/2340678975 shutdown_connections 2024-04-23T14:45:41.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.931+0000 7fc21dc00700 1 --2- 172.21.15.81:0/2340678975 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fc1fc0692b0 0x7fc1fc06b760 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:41.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.931+0000 7fc21dc00700 1 --2- 172.21.15.81:0/2340678975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2180662f0 0x7fc21810fd10 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:41.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.931+0000 7fc21dc00700 1 --2- 172.21.15.81:0/2340678975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc2180fff70 0x7fc218110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:41.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.931+0000 7fc21dc00700 1 -- 172.21.15.81:0/2340678975 >> 172.21.15.81:0/2340678975 conn(0x7fc2180f74c0 msgr2=0x7fc2180fbb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:45:41.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.931+0000 7fc21dc00700 1 -- 172.21.15.81:0/2340678975 shutdown_connections 2024-04-23T14:45:41.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:41.931+0000 7fc21dc00700 1 -- 172.21.15.81:0/2340678975 wait complete. 2024-04-23T14:45:42.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:42 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:45:42.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:42 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:45:42.700 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- bash -c 'ceph orch device ls' 2024-04-23T14:45:43.175 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:45:43.512 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:43 smithi081 ceph-mon[25540]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:45:43.512 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:43 smithi081 ceph-mon[25540]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:43.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:43 smithi156 ceph-mon[32341]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:45:43.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:43 smithi156 ceph-mon[32341]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:45.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.419+0000 7f47cce00700 1 -- 172.21.15.81:0/2646589341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47c8103420 msgr2=0x7f47c8103830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:45.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.419+0000 7f47cce00700 1 --2- 172.21.15.81:0/2646589341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47c8103420 0x7f47c8103830 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f47b8004940 tx=0x7f47b8009e30 comp rx=0 tx=0).stop 2024-04-23T14:45:45.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.419+0000 7f47cce00700 1 -- 172.21.15.81:0/2646589341 shutdown_connections 2024-04-23T14:45:45.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.419+0000 7f47cce00700 1 --2- 172.21.15.81:0/2646589341 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47c81046d0 0x7f47c8104b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:45.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.419+0000 7f47cce00700 1 --2- 172.21.15.81:0/2646589341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47c8103420 0x7f47c8103830 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:45.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.419+0000 7f47cce00700 1 -- 172.21.15.81:0/2646589341 >> 172.21.15.81:0/2646589341 conn(0x7f47c8072640 msgr2=0x7f47c8074a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:45:45.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.419+0000 7f47cce00700 1 -- 172.21.15.81:0/2646589341 shutdown_connections 2024-04-23T14:45:45.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.419+0000 7f47cce00700 1 -- 172.21.15.81:0/2646589341 wait complete. 2024-04-23T14:45:45.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.420+0000 7f47cce00700 1 Processor -- start 2024-04-23T14:45:45.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.420+0000 7f47cce00700 1 -- start start 2024-04-23T14:45:45.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.421+0000 7f47cce00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47c8103420 0x7f47c8113f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:45.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.421+0000 7f47cce00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47c81046d0 0x7f47c81144a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:45.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.421+0000 7f47cce00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c8114aa0 con 0x7f47c81046d0 2024-04-23T14:45:45.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.421+0000 7f47cce00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c8114c10 con 0x7f47c8103420 2024-04-23T14:45:45.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.421+0000 7f47c5400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47c81046d0 0x7f47c81144a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:45.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.421+0000 7f47c5400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47c81046d0 0x7f47c81144a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59202/0 (socket says 172.21.15.81:59202) 2024-04-23T14:45:45.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.421+0000 7f47c5400700 1 -- 172.21.15.81:0/2813895421 learned_addr learned my addr 172.21.15.81:0/2813895421 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:45:45.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.421+0000 7f47c5e00700 1 --2- 172.21.15.81:0/2813895421 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47c8103420 0x7f47c8113f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:45.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.422+0000 7f47c5400700 1 -- 172.21.15.81:0/2813895421 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47c8103420 msgr2=0x7f47c8113f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:45.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.422+0000 7f47c5400700 1 --2- 172.21.15.81:0/2813895421 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47c8103420 0x7f47c8113f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:45.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.422+0000 7f47c5400700 1 -- 172.21.15.81:0/2813895421 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b8005040 con 0x7f47c81046d0 2024-04-23T14:45:45.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.422+0000 7f47c5400700 1 --2- 172.21.15.81:0/2813895421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47c81046d0 0x7f47c81144a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f47b4002a50 tx=0x7f47b40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:45:45.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.422+0000 7f47be000700 1 -- 172.21.15.81:0/2813895421 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47b4007cc0 con 0x7f47c81046d0 2024-04-23T14:45:45.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.422+0000 7f47be000700 1 -- 172.21.15.81:0/2813895421 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f47b400f040 con 0x7f47c81046d0 2024-04-23T14:45:45.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.422+0000 7f47cce00700 1 -- 172.21.15.81:0/2813895421 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47c8119670 con 0x7f47c81046d0 2024-04-23T14:45:45.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.422+0000 7f47be000700 1 -- 172.21.15.81:0/2813895421 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47b4009640 con 0x7f47c81046d0 2024-04-23T14:45:45.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.422+0000 7f47cce00700 1 -- 172.21.15.81:0/2813895421 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47c8119c30 con 0x7f47c81046d0 2024-04-23T14:45:45.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.423+0000 7f47cce00700 1 -- 172.21.15.81:0/2813895421 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47c804c710 con 0x7f47c81046d0 2024-04-23T14:45:45.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.424+0000 7f47be000700 1 -- 172.21.15.81:0/2813895421 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f47b40097a0 con 0x7f47c81046d0 2024-04-23T14:45:45.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.426+0000 7f47be000700 1 --2- 172.21.15.81:0/2813895421 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f47ac0692a0 0x7f47ac06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:45.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.426+0000 7f47be000700 1 -- 172.21.15.81:0/2813895421 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f47b4086c20 con 0x7f47c81046d0 2024-04-23T14:45:45.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.426+0000 7f47c5e00700 1 --2- 172.21.15.81:0/2813895421 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f47ac0692a0 0x7f47ac06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:45.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.427+0000 7f47c5e00700 1 --2- 172.21.15.81:0/2813895421 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f47ac0692a0 0x7f47ac06b750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f47b800b3b0 tx=0x7f47b8009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:45:45.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.430+0000 7f47be000700 1 -- 172.21.15.81:0/2813895421 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f47b4056c80 con 0x7f47c81046d0 2024-04-23T14:45:45.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:45 smithi156 ceph-mon[32341]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:45.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:45 smithi081 ceph-mon[25540]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:45.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.654+0000 7f47cce00700 1 -- 172.21.15.81:0/2813895421 --> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f47c8108a60 con 0x7f47ac0692a0 2024-04-23T14:45:45.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.657+0000 7f47be000700 1 -- 172.21.15.81:0/2813895421 <== mgr.14210 v2:172.21.15.81:6800/1053506915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f47c8108a60 con 0x7f47ac0692a0 2024-04-23T14:45:45.659 INFO:teuthology.orchestra.run.smithi081.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-04-23T14:45:45.659 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400N7400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-04-23T14:45:45.659 INFO:teuthology.orchestra.run.smithi081.stdout:smithi156 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB74760040480DGN 447G No 87s ago Has a FileSystem, LVM detected 2024-04-23T14:45:45.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.660+0000 7f47cce00700 1 -- 172.21.15.81:0/2813895421 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f47ac0692a0 msgr2=0x7f47ac06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:45.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.660+0000 7f47cce00700 1 --2- 172.21.15.81:0/2813895421 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f47ac0692a0 0x7f47ac06b750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f47b800b3b0 tx=0x7f47b8009e30 comp rx=0 tx=0).stop 2024-04-23T14:45:45.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.660+0000 7f47cce00700 1 -- 172.21.15.81:0/2813895421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47c81046d0 msgr2=0x7f47c81144a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:45.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.660+0000 7f47cce00700 1 --2- 172.21.15.81:0/2813895421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47c81046d0 0x7f47c81144a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f47b4002a50 tx=0x7f47b40046b0 comp rx=0 tx=0).stop 2024-04-23T14:45:45.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.660+0000 7f47cce00700 1 -- 172.21.15.81:0/2813895421 shutdown_connections 2024-04-23T14:45:45.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.660+0000 7f47cce00700 1 --2- 172.21.15.81:0/2813895421 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47c8103420 0x7f47c8113f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:45.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.660+0000 7f47cce00700 1 --2- 172.21.15.81:0/2813895421 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f47ac0692a0 0x7f47ac06b750 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:45.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.660+0000 7f47cce00700 1 --2- 172.21.15.81:0/2813895421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47c81046d0 0x7f47c81144a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:45.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.660+0000 7f47cce00700 1 -- 172.21.15.81:0/2813895421 >> 172.21.15.81:0/2813895421 conn(0x7f47c8072640 msgr2=0x7f47c8073d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:45:45.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.661+0000 7f47cce00700 1 -- 172.21.15.81:0/2813895421 shutdown_connections 2024-04-23T14:45:45.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:45.661+0000 7f47cce00700 1 -- 172.21.15.81:0/2813895421 wait complete. 2024-04-23T14:45:46.509 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:46 smithi081 ceph-mon[25540]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:45:46.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:46 smithi156 ceph-mon[32341]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:45:46.560 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-23T14:45:46.571 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi081.front.sepia.ceph.com 2024-04-23T14:45:46.571 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-04-23T14:45:47.032 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:45:47.506 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:47 smithi081 ceph-mon[25540]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:47.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:47 smithi156 ceph-mon[32341]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:49.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:49.203+0000 7f6898600700 1 -- 172.21.15.81:0/4226271740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68901002d0 msgr2=0x7f6890100740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:49.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:49.203+0000 7f6898600700 1 --2- 172.21.15.81:0/4226271740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68901002d0 0x7f6890100740 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f687c004940 tx=0x7f687c009e30 comp rx=0 tx=0).stop 2024-04-23T14:45:49.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:49.203+0000 7f6898600700 1 -- 172.21.15.81:0/4226271740 shutdown_connections 2024-04-23T14:45:49.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:49.203+0000 7f6898600700 1 --2- 172.21.15.81:0/4226271740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68901002d0 0x7f6890100740 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:49.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:49.203+0000 7f6898600700 1 --2- 172.21.15.81:0/4226271740 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68900ff020 0x7f68900ff430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:49.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:49.203+0000 7f6898600700 1 -- 172.21.15.81:0/4226271740 >> 172.21.15.81:0/4226271740 conn(0x7f68900fa950 msgr2=0x7f68900fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:45:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:49.203+0000 7f6898600700 1 -- 172.21.15.81:0/4226271740 shutdown_connections 2024-04-23T14:45:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:49.203+0000 7f6898600700 1 -- 172.21.15.81:0/4226271740 wait complete. 2024-04-23T14:45:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:49.204+0000 7f6898600700 1 Processor -- start 2024-04-23T14:45:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:49.204+0000 7f6898600700 1 -- start start 2024-04-23T14:45:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:49.204+0000 7f6898600700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68900ff020 0x7f689010fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:49.204+0000 7f6898600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68901002d0 0x7f6890110070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:49.204+0000 7f6898600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6890110670 con 0x7f68901002d0 2024-04-23T14:45:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:49.204+0000 7f6898600700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68901107e0 con 0x7f68900ff020 2024-04-23T14:45:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:49.205+0000 7f6895200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68901002d0 0x7f6890110070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:49.205+0000 7f6895c00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68900ff020 0x7f689010fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:49.205+0000 7f6895200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68901002d0 0x7f6890110070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59216/0 (socket says 172.21.15.81:59216) 2024-04-23T14:45:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:49.205+0000 7f6895200700 1 -- 172.21.15.81:0/1592619238 learned_addr learned my addr 172.21.15.81:0/1592619238 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:45:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:49.206+0000 7f6895200700 1 -- 172.21.15.81:0/1592619238 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68900ff020 msgr2=0x7f689010fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:49.206+0000 7f6895200700 1 --2- 172.21.15.81:0/1592619238 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68900ff020 0x7f689010fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:49.206+0000 7f6895200700 1 -- 172.21.15.81:0/1592619238 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f687c005040 con 0x7f68901002d0 2024-04-23T14:45:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:49.206+0000 7f6895200700 1 --2- 172.21.15.81:0/1592619238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68901002d0 0x7f6890110070 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f687c009150 tx=0x7f687c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:45:49.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:49.206+0000 7f688d600700 1 -- 172.21.15.81:0/1592619238 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f687c00e040 con 0x7f68901002d0 2024-04-23T14:45:49.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:49.206+0000 7f6898600700 1 -- 172.21.15.81:0/1592619238 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68901151e0 con 0x7f68901002d0 2024-04-23T14:45:49.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:49.206+0000 7f688d600700 1 -- 172.21.15.81:0/1592619238 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f687c004290 con 0x7f68901002d0 2024-04-23T14:45:49.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:49.206+0000 7f688d600700 1 -- 172.21.15.81:0/1592619238 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f687c01c630 con 0x7f68901002d0 2024-04-23T14:45:49.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:49.206+0000 7f6898600700 1 -- 172.21.15.81:0/1592619238 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68901157a0 con 0x7f68901002d0 2024-04-23T14:45:49.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:49.208+0000 7f6898600700 1 -- 172.21.15.81:0/1592619238 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f689004c710 con 0x7f68901002d0 2024-04-23T14:45:49.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:49.209+0000 7f688d600700 1 -- 172.21.15.81:0/1592619238 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f687c00bbf0 con 0x7f68901002d0 2024-04-23T14:45:49.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:49.210+0000 7f688d600700 1 --2- 172.21.15.81:0/1592619238 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f68780692a0 0x7f687806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:49.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:49.210+0000 7f688d600700 1 -- 172.21.15.81:0/1592619238 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f687c087bc0 con 0x7f68901002d0 2024-04-23T14:45:49.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:49.210+0000 7f6895c00700 1 --2- 172.21.15.81:0/1592619238 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f68780692a0 0x7f687806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:49.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:49.211+0000 7f6895c00700 1 --2- 172.21.15.81:0/1592619238 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f68780692a0 0x7f687806b750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6884004550 tx=0x7f6884007ed0 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:45:49.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:49.215+0000 7f688d600700 1 -- 172.21.15.81:0/1592619238 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f687c057c20 con 0x7f68901002d0 2024-04-23T14:45:49.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:49 smithi081 ceph-mon[25540]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:49.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:49.462+0000 7f6898600700 1 -- 172.21.15.81:0/1592619238 --> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f6890104640 con 0x7f68780692a0 2024-04-23T14:45:49.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:49 smithi156 ceph-mon[32341]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:50.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:50 smithi156 ceph-mon[32341]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:45:50.622 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:50 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-04-23T14:45:50.623 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:50 smithi081 ceph-mon[25540]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:45:50.623 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:50 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-04-23T14:45:51.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:51.291+0000 7f688d600700 1 -- 172.21.15.81:0/1592619238 <== mgr.14210 v2:172.21.15.81:6800/1053506915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f6890104640 con 0x7f68780692a0 2024-04-23T14:45:51.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:51.294+0000 7f6898600700 1 -- 172.21.15.81:0/1592619238 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f68780692a0 msgr2=0x7f687806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:51.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:51.294+0000 7f6898600700 1 --2- 172.21.15.81:0/1592619238 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f68780692a0 0x7f687806b750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6884004550 tx=0x7f6884007ed0 comp rx=0 tx=0).stop 2024-04-23T14:45:51.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:51.294+0000 7f6898600700 1 -- 172.21.15.81:0/1592619238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68901002d0 msgr2=0x7f6890110070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:51.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:51.294+0000 7f6898600700 1 --2- 172.21.15.81:0/1592619238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68901002d0 0x7f6890110070 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f687c009150 tx=0x7f687c009e30 comp rx=0 tx=0).stop 2024-04-23T14:45:51.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:51.294+0000 7f6898600700 1 -- 172.21.15.81:0/1592619238 shutdown_connections 2024-04-23T14:45:51.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:51.294+0000 7f6898600700 1 --2- 172.21.15.81:0/1592619238 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68900ff020 0x7f689010fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:51.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:51.294+0000 7f6898600700 1 --2- 172.21.15.81:0/1592619238 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f68780692a0 0x7f687806b750 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:51.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:51.294+0000 7f6898600700 1 --2- 172.21.15.81:0/1592619238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68901002d0 0x7f6890110070 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:51.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:51.294+0000 7f6898600700 1 -- 172.21.15.81:0/1592619238 >> 172.21.15.81:0/1592619238 conn(0x7f68900fa950 msgr2=0x7f68900fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:45:51.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:51.295+0000 7f6898600700 1 -- 172.21.15.81:0/1592619238 shutdown_connections 2024-04-23T14:45:51.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:51.295+0000 7f6898600700 1 -- 172.21.15.81:0/1592619238 wait complete. 2024-04-23T14:45:51.514 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:51 smithi081 ceph-mon[25540]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:51.514 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:51 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-04-23T14:45:51.514 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:51 smithi081 ceph-mon[25540]: osdmap e42: 6 total, 6 up, 6 in 2024-04-23T14:45:51.514 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:51 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-04-23T14:45:51.514 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:51 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi081[25536]: 2024-04-23T14:45:51.264+0000 7f3404a00700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-23T14:45:51.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:51 smithi156 ceph-mon[32341]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:51.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:51 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-04-23T14:45:51.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:51 smithi156 ceph-mon[32341]: osdmap e42: 6 total, 6 up, 6 in 2024-04-23T14:45:51.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:51 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-04-23T14:45:52.267 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-23T14:45:52.487 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:52 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-04-23T14:45:52.488 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:52 smithi081 ceph-mon[25540]: osdmap e43: 6 total, 6 up, 6 in 2024-04-23T14:45:52.488 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:52 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-04-23T14:45:52.488 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:52 smithi081 ceph-mon[25540]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-23T14:45:52.488 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:52 smithi081 ceph-mon[25540]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-23T14:45:52.488 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:52 smithi081 ceph-mon[25540]: osdmap e44: 6 total, 6 up, 6 in 2024-04-23T14:45:52.488 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:52 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-04-23T14:45:52.488 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:52 smithi081 ceph-mon[25540]: fsmap cephfs:0 2024-04-23T14:45:52.488 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:52 smithi081 ceph-mon[25540]: Saving service mds.cephfs spec with placement count:4 2024-04-23T14:45:52.488 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:52 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:45:52.488 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:52 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:45:52.488 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:52 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:45:52.488 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:52 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:45:52.488 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:52 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:45:52.488 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:52 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi081.wydgcg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:45:52.489 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:52 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi081.wydgcg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:45:52.489 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:52 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:45:52.489 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:52 smithi081 ceph-mon[25540]: Deploying daemon mds.cephfs.smithi081.wydgcg on smithi081 2024-04-23T14:45:52.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:52 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-04-23T14:45:52.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:52 smithi156 ceph-mon[32341]: osdmap e43: 6 total, 6 up, 6 in 2024-04-23T14:45:52.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:52 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-04-23T14:45:52.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:52 smithi156 ceph-mon[32341]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-23T14:45:52.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:52 smithi156 ceph-mon[32341]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-23T14:45:52.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:52 smithi156 ceph-mon[32341]: osdmap e44: 6 total, 6 up, 6 in 2024-04-23T14:45:52.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:52 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-04-23T14:45:52.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:52 smithi156 ceph-mon[32341]: fsmap cephfs:0 2024-04-23T14:45:52.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:52 smithi156 ceph-mon[32341]: Saving service mds.cephfs spec with placement count:4 2024-04-23T14:45:52.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:52 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:45:52.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:52 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:45:52.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:52 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:45:52.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:52 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:45:52.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:52 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:45:52.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:52 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi081.wydgcg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:45:52.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:52 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi081.wydgcg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:45:52.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:52 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:45:52.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:52 smithi156 ceph-mon[32341]: Deploying daemon mds.cephfs.smithi081.wydgcg on smithi081 2024-04-23T14:45:53.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:53 smithi081 ceph-mon[25540]: pgmap v217: 65 pgs: 7 creating+peering, 1 active+clean, 57 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:53.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:53 smithi081 ceph-mon[25540]: osdmap e45: 6 total, 6 up, 6 in 2024-04-23T14:45:53.659 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:45:53.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:53 smithi156 ceph-mon[32341]: pgmap v217: 65 pgs: 7 creating+peering, 1 active+clean, 57 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:53.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:53 smithi156 ceph-mon[32341]: osdmap e45: 6 total, 6 up, 6 in 2024-04-23T14:45:54.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:54 smithi081 ceph-mon[25540]: osdmap e46: 6 total, 6 up, 6 in 2024-04-23T14:45:54.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:54 smithi156 ceph-mon[32341]: osdmap e46: 6 total, 6 up, 6 in 2024-04-23T14:45:55.430 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:55 smithi081 ceph-mon[25540]: pgmap v220: 65 pgs: 7 creating+peering, 25 active+clean, 33 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:55.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:55 smithi156 ceph-mon[32341]: pgmap v220: 65 pgs: 7 creating+peering, 25 active+clean, 33 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:55.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:55.964+0000 7f3982000700 1 -- 172.21.15.81:0/3526913206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f397c103420 msgr2=0x7f397c103830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:55.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:55.964+0000 7f3982000700 1 --2- 172.21.15.81:0/3526913206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f397c103420 0x7f397c103830 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f396c004940 tx=0x7f396c009e30 comp rx=0 tx=0).stop 2024-04-23T14:45:55.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:55.964+0000 7f3982000700 1 -- 172.21.15.81:0/3526913206 shutdown_connections 2024-04-23T14:45:55.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:55.964+0000 7f3982000700 1 --2- 172.21.15.81:0/3526913206 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f397c1046d0 0x7f397c104b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:55.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:55.964+0000 7f3982000700 1 --2- 172.21.15.81:0/3526913206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f397c103420 0x7f397c103830 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:55.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:55.964+0000 7f3982000700 1 -- 172.21.15.81:0/3526913206 >> 172.21.15.81:0/3526913206 conn(0x7f397c072640 msgr2=0x7f397c074a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:45:55.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:55.964+0000 7f3982000700 1 -- 172.21.15.81:0/3526913206 shutdown_connections 2024-04-23T14:45:55.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:55.964+0000 7f3982000700 1 -- 172.21.15.81:0/3526913206 wait complete. 2024-04-23T14:45:55.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:55.965+0000 7f3982000700 1 Processor -- start 2024-04-23T14:45:55.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:55.965+0000 7f3982000700 1 -- start start 2024-04-23T14:45:55.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:55.966+0000 7f3982000700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f397c103420 0x7f397c113ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:55.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:55.966+0000 7f3982000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f397c1046d0 0x7f397c114420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:55.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:55.966+0000 7f3982000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397c114a20 con 0x7f397c1046d0 2024-04-23T14:45:55.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:55.966+0000 7f3982000700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397c114b90 con 0x7f397c103420 2024-04-23T14:45:55.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:55.966+0000 7f397aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f397c1046d0 0x7f397c114420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:55.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:55.966+0000 7f397aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f397c1046d0 0x7f397c114420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50548/0 (socket says 172.21.15.81:50548) 2024-04-23T14:45:55.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:55.966+0000 7f397aa00700 1 -- 172.21.15.81:0/657739307 learned_addr learned my addr 172.21.15.81:0/657739307 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:45:55.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:55.966+0000 7f397aa00700 1 -- 172.21.15.81:0/657739307 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f397c103420 msgr2=0x7f397c113ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:55.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:55.966+0000 7f397aa00700 1 --2- 172.21.15.81:0/657739307 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f397c103420 0x7f397c113ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:55.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:55.966+0000 7f397aa00700 1 -- 172.21.15.81:0/657739307 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f396c005040 con 0x7f397c1046d0 2024-04-23T14:45:55.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:55.967+0000 7f397aa00700 1 --2- 172.21.15.81:0/657739307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f397c1046d0 0x7f397c114420 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f396800eb40 tx=0x7f396800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:45:55.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:55.967+0000 7f3973400700 1 -- 172.21.15.81:0/657739307 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3968007cc0 con 0x7f397c1046d0 2024-04-23T14:45:55.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:55.967+0000 7f3973400700 1 -- 172.21.15.81:0/657739307 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f396800f040 con 0x7f397c1046d0 2024-04-23T14:45:55.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:55.967+0000 7f3973400700 1 -- 172.21.15.81:0/657739307 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3968009620 con 0x7f397c1046d0 2024-04-23T14:45:55.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:55.967+0000 7f3982000700 1 -- 172.21.15.81:0/657739307 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f397c119590 con 0x7f397c1046d0 2024-04-23T14:45:55.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:55.967+0000 7f3982000700 1 -- 172.21.15.81:0/657739307 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f397c119b50 con 0x7f397c1046d0 2024-04-23T14:45:55.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:55.968+0000 7f3982000700 1 -- 172.21.15.81:0/657739307 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f397c04c710 con 0x7f397c1046d0 2024-04-23T14:45:55.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:55.969+0000 7f3973400700 1 -- 172.21.15.81:0/657739307 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f3968009780 con 0x7f397c1046d0 2024-04-23T14:45:55.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:55.970+0000 7f3973400700 1 --2- 172.21.15.81:0/657739307 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f39600692a0 0x7f396006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:55.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:55.970+0000 7f3973400700 1 -- 172.21.15.81:0/657739307 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f3968086db0 con 0x7f397c1046d0 2024-04-23T14:45:55.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:55.970+0000 7f397b400700 1 --2- 172.21.15.81:0/657739307 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f39600692a0 0x7f396006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:55.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:55.971+0000 7f397b400700 1 --2- 172.21.15.81:0/657739307 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f39600692a0 0x7f396006b750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f396c009fd0 tx=0x7f396c009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:45:55.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:55.975+0000 7f3973400700 1 -- 172.21.15.81:0/657739307 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f396804e250 con 0x7f397c1046d0 2024-04-23T14:45:56.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:56.253+0000 7f3982000700 1 -- 172.21.15.81:0/657739307 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f397c11a010 con 0x7f397c1046d0 2024-04-23T14:45:56.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:56.253+0000 7f3973400700 1 -- 172.21.15.81:0/657739307 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1076 (secure 0 0 0) 0x7f3968056b80 con 0x7f397c1046d0 2024-04-23T14:45:56.255 INFO:teuthology.orchestra.run.smithi081.stdout:e2 2024-04-23T14:45:56.255 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-23T14:45:56.255 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:45:56.255 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-04-23T14:45:56.255 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:45:56.255 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-04-23T14:45:56.255 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-04-23T14:45:56.255 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 2 2024-04-23T14:45:56.255 INFO:teuthology.orchestra.run.smithi081.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-23T14:45:56.255 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-04-23T14:45:51.264703+0000 2024-04-23T14:45:56.255 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-04-23T14:45:51.264780+0000 2024-04-23T14:45:56.255 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-04-23T14:45:56.255 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-04-23T14:45:56.255 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-04-23T14:45:56.255 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-04-23T14:45:56.256 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-04-23T14:45:56.256 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-04-23T14:45:56.256 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-04-23T14:45:56.256 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 0 2024-04-23T14:45:56.256 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:45:56.256 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 1 2024-04-23T14:45:56.256 INFO:teuthology.orchestra.run.smithi081.stdout:in 2024-04-23T14:45:56.256 INFO:teuthology.orchestra.run.smithi081.stdout:up {} 2024-04-23T14:45:56.256 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-04-23T14:45:56.256 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-04-23T14:45:56.256 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-04-23T14:45:56.256 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-04-23T14:45:56.256 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-04-23T14:45:56.256 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-04-23T14:45:56.256 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-04-23T14:45:56.256 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 0 2024-04-23T14:45:56.256 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:45:56.257 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:45:56.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:56.256+0000 7f3982000700 1 -- 172.21.15.81:0/657739307 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f39600692a0 msgr2=0x7f396006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:56.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:56.256+0000 7f3982000700 1 --2- 172.21.15.81:0/657739307 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f39600692a0 0x7f396006b750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f396c009fd0 tx=0x7f396c009e30 comp rx=0 tx=0).stop 2024-04-23T14:45:56.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:56.256+0000 7f3982000700 1 -- 172.21.15.81:0/657739307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f397c1046d0 msgr2=0x7f397c114420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:56.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:56.256+0000 7f3982000700 1 --2- 172.21.15.81:0/657739307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f397c1046d0 0x7f397c114420 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f396800eb40 tx=0x7f396800b040 comp rx=0 tx=0).stop 2024-04-23T14:45:56.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:56.256+0000 7f3982000700 1 -- 172.21.15.81:0/657739307 shutdown_connections 2024-04-23T14:45:56.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:56.256+0000 7f3982000700 1 --2- 172.21.15.81:0/657739307 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f397c103420 0x7f397c113ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:56.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:56.256+0000 7f3982000700 1 --2- 172.21.15.81:0/657739307 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f39600692a0 0x7f396006b750 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:56.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:56.256+0000 7f3982000700 1 --2- 172.21.15.81:0/657739307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f397c1046d0 0x7f397c114420 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:56.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:56.256+0000 7f3982000700 1 -- 172.21.15.81:0/657739307 >> 172.21.15.81:0/657739307 conn(0x7f397c072640 msgr2=0x7f397c073cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:45:56.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:56.256+0000 7f3982000700 1 -- 172.21.15.81:0/657739307 shutdown_connections 2024-04-23T14:45:56.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:56.256+0000 7f3982000700 1 -- 172.21.15.81:0/657739307 wait complete. 2024-04-23T14:45:56.258 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 2 2024-04-23T14:45:57.009 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-23T14:45:57.018 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi081.front.sepia.ceph.com 2024-04-23T14:45:57.018 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-04-23T14:45:57.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:57 smithi156 ceph-mon[32341]: pgmap v221: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:57.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:57 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:45:57.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:57 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:45:57.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:57 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:45:57.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:57 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi156.rhbtxt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:45:57.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:57 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi156.rhbtxt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:45:57.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:57 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:45:57.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:57 smithi156 ceph-mon[32341]: Deploying daemon mds.cephfs.smithi156.rhbtxt on smithi156 2024-04-23T14:45:57.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:57 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/657739307' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:45:57.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:57 smithi156 ceph-mon[32341]: mds.? [v2:172.21.15.81:6826/2500326945,v1:172.21.15.81:6827/2500326945] up:boot 2024-04-23T14:45:57.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:57 smithi156 ceph-mon[32341]: daemon mds.cephfs.smithi081.wydgcg assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-04-23T14:45:57.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:57 smithi156 ceph-mon[32341]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-23T14:45:57.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:57 smithi156 ceph-mon[32341]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-23T14:45:57.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:57 smithi156 ceph-mon[32341]: Cluster is now healthy 2024-04-23T14:45:57.289 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:57 smithi156 ceph-mon[32341]: fsmap cephfs:0 1 up:standby 2024-04-23T14:45:57.289 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:57 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi081.wydgcg"}]: dispatch 2024-04-23T14:45:57.289 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:57 smithi156 ceph-mon[32341]: fsmap cephfs:1 {0=cephfs.smithi081.wydgcg=up:creating} 2024-04-23T14:45:57.289 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:57 smithi156 ceph-mon[32341]: daemon mds.cephfs.smithi081.wydgcg is now active in filesystem cephfs as rank 0 2024-04-23T14:45:57.289 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:57 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:45:57.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:57 smithi081 ceph-mon[25540]: pgmap v221: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:45:57.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:57 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:45:57.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:57 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:45:57.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:57 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:45:57.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:57 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi156.rhbtxt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:45:57.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:57 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi156.rhbtxt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:45:57.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:57 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:45:57.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:57 smithi081 ceph-mon[25540]: Deploying daemon mds.cephfs.smithi156.rhbtxt on smithi156 2024-04-23T14:45:57.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:57 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/657739307' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:45:57.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:57 smithi081 ceph-mon[25540]: mds.? [v2:172.21.15.81:6826/2500326945,v1:172.21.15.81:6827/2500326945] up:boot 2024-04-23T14:45:57.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:57 smithi081 ceph-mon[25540]: daemon mds.cephfs.smithi081.wydgcg assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-04-23T14:45:57.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:57 smithi081 ceph-mon[25540]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-23T14:45:57.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:57 smithi081 ceph-mon[25540]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-23T14:45:57.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:57 smithi081 ceph-mon[25540]: Cluster is now healthy 2024-04-23T14:45:57.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:57 smithi081 ceph-mon[25540]: fsmap cephfs:0 1 up:standby 2024-04-23T14:45:57.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:57 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi081.wydgcg"}]: dispatch 2024-04-23T14:45:57.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:57 smithi081 ceph-mon[25540]: fsmap cephfs:1 {0=cephfs.smithi081.wydgcg=up:creating} 2024-04-23T14:45:57.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:57 smithi081 ceph-mon[25540]: daemon mds.cephfs.smithi081.wydgcg is now active in filesystem cephfs as rank 0 2024-04-23T14:45:57.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:57 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:45:57.493 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:45:58.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:58 smithi156 ceph-mon[32341]: mds.? [v2:172.21.15.81:6826/2500326945,v1:172.21.15.81:6827/2500326945] up:active 2024-04-23T14:45:58.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:58 smithi156 ceph-mon[32341]: fsmap cephfs:1 {0=cephfs.smithi081.wydgcg=up:active} 2024-04-23T14:45:58.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:58 smithi081 ceph-mon[25540]: mds.? [v2:172.21.15.81:6826/2500326945,v1:172.21.15.81:6827/2500326945] up:active 2024-04-23T14:45:58.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:58 smithi081 ceph-mon[25540]: fsmap cephfs:1 {0=cephfs.smithi081.wydgcg=up:active} 2024-04-23T14:45:59.528 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:45:59 smithi081 ceph-mon[25540]: pgmap v222: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 2 op/s 2024-04-23T14:45:59.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:45:59 smithi156 ceph-mon[32341]: pgmap v222: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 2 op/s 2024-04-23T14:45:59.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:59.808+0000 7ff47ee00700 1 -- 172.21.15.81:0/1496990416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4780fcef0 msgr2=0x7ff4780fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:59.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:59.808+0000 7ff47ee00700 1 --2- 172.21.15.81:0/1496990416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4780fcef0 0x7ff4780fd320 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff468004940 tx=0x7ff468009e30 comp rx=0 tx=0).stop 2024-04-23T14:45:59.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:59.808+0000 7ff47ee00700 1 -- 172.21.15.81:0/1496990416 shutdown_connections 2024-04-23T14:45:59.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:59.808+0000 7ff47ee00700 1 --2- 172.21.15.81:0/1496990416 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4780fe0e0 0x7ff4780fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:59.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:59.808+0000 7ff47ee00700 1 --2- 172.21.15.81:0/1496990416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4780fcef0 0x7ff4780fd320 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:59.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:59.808+0000 7ff47ee00700 1 -- 172.21.15.81:0/1496990416 >> 172.21.15.81:0/1496990416 conn(0x7ff4780f8530 msgr2=0x7ff4780fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:45:59.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:59.809+0000 7ff47ee00700 1 -- 172.21.15.81:0/1496990416 shutdown_connections 2024-04-23T14:45:59.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:59.809+0000 7ff47ee00700 1 -- 172.21.15.81:0/1496990416 wait complete. 2024-04-23T14:45:59.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:59.809+0000 7ff47ee00700 1 Processor -- start 2024-04-23T14:45:59.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:59.810+0000 7ff47ee00700 1 -- start start 2024-04-23T14:45:59.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:59.810+0000 7ff47ee00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4780fcef0 0x7ff478071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:59.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:59.810+0000 7ff47ee00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4780fe0e0 0x7ff478070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:59.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:59.810+0000 7ff47ee00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff478111710 con 0x7ff4780fe0e0 2024-04-23T14:45:59.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:59.810+0000 7ff47ee00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff478111880 con 0x7ff4780fcef0 2024-04-23T14:45:59.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:59.811+0000 7ff477400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4780fe0e0 0x7ff478070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:59.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:59.811+0000 7ff477400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4780fe0e0 0x7ff478070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50560/0 (socket says 172.21.15.81:50560) 2024-04-23T14:45:59.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:59.811+0000 7ff477400700 1 -- 172.21.15.81:0/2251644353 learned_addr learned my addr 172.21.15.81:0/2251644353 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:45:59.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:59.811+0000 7ff477e00700 1 --2- 172.21.15.81:0/2251644353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4780fcef0 0x7ff478071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:59.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:59.811+0000 7ff477400700 1 -- 172.21.15.81:0/2251644353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4780fcef0 msgr2=0x7ff478071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:45:59.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:59.811+0000 7ff477400700 1 --2- 172.21.15.81:0/2251644353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4780fcef0 0x7ff478071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:45:59.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:59.811+0000 7ff477400700 1 -- 172.21.15.81:0/2251644353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff468005040 con 0x7ff4780fe0e0 2024-04-23T14:45:59.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:59.811+0000 7ff477e00700 1 --2- 172.21.15.81:0/2251644353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4780fcef0 0x7ff478071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:45:59.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:59.812+0000 7ff477400700 1 --2- 172.21.15.81:0/2251644353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4780fe0e0 0x7ff478070310 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff464002a50 tx=0x7ff4640046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:45:59.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:59.814+0000 7ff46fe00700 1 -- 172.21.15.81:0/2251644353 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff464007cc0 con 0x7ff4780fe0e0 2024-04-23T14:45:59.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:59.814+0000 7ff47ee00700 1 -- 172.21.15.81:0/2251644353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff478070970 con 0x7ff4780fe0e0 2024-04-23T14:45:59.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:59.814+0000 7ff46fe00700 1 -- 172.21.15.81:0/2251644353 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff46400f040 con 0x7ff4780fe0e0 2024-04-23T14:45:59.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:59.814+0000 7ff46fe00700 1 -- 172.21.15.81:0/2251644353 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff464009640 con 0x7ff4780fe0e0 2024-04-23T14:45:59.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:59.814+0000 7ff47ee00700 1 -- 172.21.15.81:0/2251644353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff478070ee0 con 0x7ff4780fe0e0 2024-04-23T14:45:59.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:59.816+0000 7ff47ee00700 1 -- 172.21.15.81:0/2251644353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff47805f5f0 con 0x7ff4780fe0e0 2024-04-23T14:45:59.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:59.818+0000 7ff46fe00700 1 -- 172.21.15.81:0/2251644353 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7ff4640097a0 con 0x7ff4780fe0e0 2024-04-23T14:45:59.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:59.818+0000 7ff46fe00700 1 --2- 172.21.15.81:0/2251644353 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7ff45c0692b0 0x7ff45c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:45:59.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:59.819+0000 7ff46fe00700 1 -- 172.21.15.81:0/2251644353 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7ff464086ff0 con 0x7ff4780fe0e0 2024-04-23T14:45:59.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:59.819+0000 7ff477e00700 1 --2- 172.21.15.81:0/2251644353 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7ff45c0692b0 0x7ff45c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:45:59.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:59.820+0000 7ff477e00700 1 --2- 172.21.15.81:0/2251644353 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7ff45c0692b0 0x7ff45c06b760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff468000c00 tx=0x7ff468009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:45:59.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:45:59.825+0000 7ff46fe00700 1 -- 172.21.15.81:0/2251644353 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff464053280 con 0x7ff4780fe0e0 2024-04-23T14:46:00.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:00.090+0000 7ff47ee00700 1 -- 172.21.15.81:0/2251644353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7ff478105af0 con 0x7ff4780fe0e0 2024-04-23T14:46:00.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:00.330+0000 7ff46fe00700 1 -- 172.21.15.81:0/2251644353 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7ff4640568a0 con 0x7ff4780fe0e0 2024-04-23T14:46:00.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:00.333+0000 7ff47ee00700 1 -- 172.21.15.81:0/2251644353 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7ff45c0692b0 msgr2=0x7ff45c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:00.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:00.333+0000 7ff47ee00700 1 --2- 172.21.15.81:0/2251644353 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7ff45c0692b0 0x7ff45c06b760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff468000c00 tx=0x7ff468009e30 comp rx=0 tx=0).stop 2024-04-23T14:46:00.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:00.333+0000 7ff47ee00700 1 -- 172.21.15.81:0/2251644353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4780fe0e0 msgr2=0x7ff478070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:00.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:00.333+0000 7ff47ee00700 1 --2- 172.21.15.81:0/2251644353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4780fe0e0 0x7ff478070310 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff464002a50 tx=0x7ff4640046b0 comp rx=0 tx=0).stop 2024-04-23T14:46:00.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:00.333+0000 7ff47ee00700 1 -- 172.21.15.81:0/2251644353 shutdown_connections 2024-04-23T14:46:00.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:00.333+0000 7ff47ee00700 1 --2- 172.21.15.81:0/2251644353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4780fcef0 0x7ff478071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:00.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:00.333+0000 7ff47ee00700 1 --2- 172.21.15.81:0/2251644353 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7ff45c0692b0 0x7ff45c06b760 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:00.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:00.333+0000 7ff47ee00700 1 --2- 172.21.15.81:0/2251644353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4780fe0e0 0x7ff478070310 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:00.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:00.333+0000 7ff47ee00700 1 -- 172.21.15.81:0/2251644353 >> 172.21.15.81:0/2251644353 conn(0x7ff4780f8530 msgr2=0x7ff4780f9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:46:00.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:00.334+0000 7ff47ee00700 1 -- 172.21.15.81:0/2251644353 shutdown_connections 2024-04-23T14:46:00.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:00.334+0000 7ff47ee00700 1 -- 172.21.15.81:0/2251644353 wait complete. 2024-04-23T14:46:01.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:00 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:01.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:00 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:01.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:00 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:01.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:00 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi081.vcoywg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:46:01.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:00 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi081.vcoywg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:46:01.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:00 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:46:01.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:00 smithi156 ceph-mon[32341]: Deploying daemon mds.cephfs.smithi081.vcoywg on smithi081 2024-04-23T14:46:01.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:00 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/2251644353' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-04-23T14:46:01.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:00 smithi156 ceph-mon[32341]: mds.? [v2:172.21.15.156:6824/2669199694,v1:172.21.15.156:6825/2669199694] up:boot 2024-04-23T14:46:01.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:00 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/2251644353' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-04-23T14:46:01.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:00 smithi156 ceph-mon[32341]: fsmap cephfs:1 {0=cephfs.smithi081.wydgcg=up:active} 1 up:standby 2024-04-23T14:46:01.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:00 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi156.rhbtxt"}]: dispatch 2024-04-23T14:46:01.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:00 smithi156 ceph-mon[32341]: fsmap cephfs:1 {0=cephfs.smithi081.wydgcg=up:active} 1 up:standby 2024-04-23T14:46:01.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:00 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:01.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:00 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:01.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:00 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:01.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:00 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi081.vcoywg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:46:01.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:00 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi081.vcoywg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:46:01.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:00 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:46:01.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:00 smithi081 ceph-mon[25540]: Deploying daemon mds.cephfs.smithi081.vcoywg on smithi081 2024-04-23T14:46:01.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:00 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/2251644353' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-04-23T14:46:01.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:00 smithi081 ceph-mon[25540]: mds.? [v2:172.21.15.156:6824/2669199694,v1:172.21.15.156:6825/2669199694] up:boot 2024-04-23T14:46:01.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:00 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/2251644353' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-04-23T14:46:01.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:00 smithi081 ceph-mon[25540]: fsmap cephfs:1 {0=cephfs.smithi081.wydgcg=up:active} 1 up:standby 2024-04-23T14:46:01.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:00 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi156.rhbtxt"}]: dispatch 2024-04-23T14:46:01.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:00 smithi081 ceph-mon[25540]: fsmap cephfs:1 {0=cephfs.smithi081.wydgcg=up:active} 1 up:standby 2024-04-23T14:46:01.251 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-23T14:46:01.260 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi081.front.sepia.ceph.com 2024-04-23T14:46:01.260 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2024-04-23T14:46:02.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:01 smithi081 ceph-mon[25540]: pgmap v223: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 3 op/s 2024-04-23T14:46:02.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:01 smithi156 ceph-mon[32341]: pgmap v223: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 3 op/s 2024-04-23T14:46:02.771 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:46:03.477 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:03 smithi081 ceph-mon[25540]: pgmap v224: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-04-23T14:46:03.477 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:03 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:03.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:03 smithi156 ceph-mon[32341]: pgmap v224: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-04-23T14:46:03.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:03 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:05.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:05 smithi081 ceph-mon[25540]: pgmap v225: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 4 op/s 2024-04-23T14:46:05.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:05 smithi156 ceph-mon[32341]: pgmap v225: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 4 op/s 2024-04-23T14:46:05.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:05.698+0000 7f91d4c00700 1 -- 172.21.15.81:0/3443432152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91d00fff70 msgr2=0x7f91d0102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:05.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:05.698+0000 7f91d4c00700 1 --2- 172.21.15.81:0/3443432152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91d00fff70 0x7f91d0102390 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f91bc004940 tx=0x7f91bc009e30 comp rx=0 tx=0).stop 2024-04-23T14:46:05.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:05.698+0000 7f91d4c00700 1 -- 172.21.15.81:0/3443432152 shutdown_connections 2024-04-23T14:46:05.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:05.698+0000 7f91d4c00700 1 --2- 172.21.15.81:0/3443432152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91d00fff70 0x7f91d0102390 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:05.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:05.698+0000 7f91d4c00700 1 --2- 172.21.15.81:0/3443432152 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91d00662f0 0x7f91d00ffa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:05.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:05.698+0000 7f91d4c00700 1 -- 172.21.15.81:0/3443432152 >> 172.21.15.81:0/3443432152 conn(0x7f91d00f74c0 msgr2=0x7f91d00f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:46:05.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:05.698+0000 7f91d4c00700 1 -- 172.21.15.81:0/3443432152 shutdown_connections 2024-04-23T14:46:05.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:05.698+0000 7f91d4c00700 1 -- 172.21.15.81:0/3443432152 wait complete. 2024-04-23T14:46:05.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:05.699+0000 7f91d4c00700 1 Processor -- start 2024-04-23T14:46:05.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:05.699+0000 7f91d4c00700 1 -- start start 2024-04-23T14:46:05.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:05.700+0000 7f91d4c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91d00662f0 0x7f91d010fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:05.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:05.700+0000 7f91d4c00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91d00fff70 0x7f91d0110250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:05.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:05.700+0000 7f91d4c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d0110850 con 0x7f91d00662f0 2024-04-23T14:46:05.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:05.700+0000 7f91d4c00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d0110f90 con 0x7f91d00fff70 2024-04-23T14:46:05.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:05.700+0000 7f91cde00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91d00662f0 0x7f91d010fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:05.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:05.700+0000 7f91cde00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91d00662f0 0x7f91d010fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45886/0 (socket says 172.21.15.81:45886) 2024-04-23T14:46:05.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:05.700+0000 7f91cde00700 1 -- 172.21.15.81:0/718584107 learned_addr learned my addr 172.21.15.81:0/718584107 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:46:05.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:05.700+0000 7f91cd400700 1 --2- 172.21.15.81:0/718584107 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91d00fff70 0x7f91d0110250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:05.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:05.700+0000 7f91cde00700 1 -- 172.21.15.81:0/718584107 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91d00fff70 msgr2=0x7f91d0110250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:05.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:05.700+0000 7f91cde00700 1 --2- 172.21.15.81:0/718584107 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91d00fff70 0x7f91d0110250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:05.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:05.700+0000 7f91cde00700 1 -- 172.21.15.81:0/718584107 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91bc005040 con 0x7f91d00662f0 2024-04-23T14:46:05.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:05.701+0000 7f91cde00700 1 --2- 172.21.15.81:0/718584107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91d00662f0 0x7f91d010fd10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f91c000c7e0 tx=0x7f91c0007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:46:05.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:05.701+0000 7f91c6000700 1 -- 172.21.15.81:0/718584107 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91c0012810 con 0x7f91d00662f0 2024-04-23T14:46:05.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:05.701+0000 7f91c6000700 1 -- 172.21.15.81:0/718584107 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f91c0012e40 con 0x7f91d00662f0 2024-04-23T14:46:05.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:05.701+0000 7f91d4c00700 1 -- 172.21.15.81:0/718584107 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91d0111270 con 0x7f91d00662f0 2024-04-23T14:46:05.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:05.701+0000 7f91c6000700 1 -- 172.21.15.81:0/718584107 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91c000a550 con 0x7f91d00662f0 2024-04-23T14:46:05.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:05.701+0000 7f91d4c00700 1 -- 172.21.15.81:0/718584107 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91d0111830 con 0x7f91d00662f0 2024-04-23T14:46:05.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:05.702+0000 7f91d4c00700 1 -- 172.21.15.81:0/718584107 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91d005f5f0 con 0x7f91d00662f0 2024-04-23T14:46:05.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:05.703+0000 7f91c6000700 1 -- 172.21.15.81:0/718584107 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f91c0011380 con 0x7f91d00662f0 2024-04-23T14:46:05.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:05.704+0000 7f91c6000700 1 --2- 172.21.15.81:0/718584107 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f91b40692b0 0x7f91b406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:05.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:05.704+0000 7f91c6000700 1 -- 172.21.15.81:0/718584107 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f91c0087590 con 0x7f91d00662f0 2024-04-23T14:46:05.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:05.705+0000 7f91cd400700 1 --2- 172.21.15.81:0/718584107 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f91b40692b0 0x7f91b406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:05.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:05.705+0000 7f91cd400700 1 --2- 172.21.15.81:0/718584107 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f91b40692b0 0x7f91b406b760 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f91bc004f90 tx=0x7f91bc009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:46:05.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:05.709+0000 7f91c6000700 1 -- 172.21.15.81:0/718584107 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f91c00572d0 con 0x7f91d00662f0 2024-04-23T14:46:05.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:05.969+0000 7f91d4c00700 1 -- 172.21.15.81:0/718584107 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f91d004bed0 con 0x7f91d00662f0 2024-04-23T14:46:06.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:06 smithi081 ceph-mon[25540]: mds.? [v2:172.21.15.81:6828/2563365650,v1:172.21.15.81:6829/2563365650] up:boot 2024-04-23T14:46:06.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:06 smithi081 ceph-mon[25540]: fsmap cephfs:1 {0=cephfs.smithi081.wydgcg=up:active} 2 up:standby 2024-04-23T14:46:06.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:06 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi081.vcoywg"}]: dispatch 2024-04-23T14:46:06.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:06 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:06.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:06 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:06.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:06 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:06.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:06 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi156.vynkxn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:46:06.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:06 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi156.vynkxn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:46:06.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:06 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:46:06.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:06 smithi081 ceph-mon[25540]: Deploying daemon mds.cephfs.smithi156.vynkxn on smithi156 2024-04-23T14:46:06.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:06 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/718584107' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-23T14:46:06.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:06.375+0000 7f91c6000700 1 -- 172.21.15.81:0/718584107 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v9) v1 ==== 121+0+0 (secure 0 0 0) 0x7f91c0011630 con 0x7f91d00662f0 2024-04-23T14:46:06.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:06.379+0000 7f91d4c00700 1 -- 172.21.15.81:0/718584107 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f91b40692b0 msgr2=0x7f91b406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:06.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:06.379+0000 7f91d4c00700 1 --2- 172.21.15.81:0/718584107 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f91b40692b0 0x7f91b406b760 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f91bc004f90 tx=0x7f91bc009e30 comp rx=0 tx=0).stop 2024-04-23T14:46:06.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:06.379+0000 7f91d4c00700 1 -- 172.21.15.81:0/718584107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91d00662f0 msgr2=0x7f91d010fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:06.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:06.379+0000 7f91d4c00700 1 --2- 172.21.15.81:0/718584107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91d00662f0 0x7f91d010fd10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f91c000c7e0 tx=0x7f91c0007f90 comp rx=0 tx=0).stop 2024-04-23T14:46:06.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:06.379+0000 7f91d4c00700 1 -- 172.21.15.81:0/718584107 shutdown_connections 2024-04-23T14:46:06.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:06.379+0000 7f91d4c00700 1 --2- 172.21.15.81:0/718584107 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f91b40692b0 0x7f91b406b760 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:06.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:06.379+0000 7f91d4c00700 1 --2- 172.21.15.81:0/718584107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91d00662f0 0x7f91d010fd10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:06.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:06.379+0000 7f91d4c00700 1 --2- 172.21.15.81:0/718584107 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91d00fff70 0x7f91d0110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:06.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:06.379+0000 7f91d4c00700 1 -- 172.21.15.81:0/718584107 >> 172.21.15.81:0/718584107 conn(0x7f91d00f74c0 msgr2=0x7f91d00fbb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:46:06.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:06.380+0000 7f91d4c00700 1 -- 172.21.15.81:0/718584107 shutdown_connections 2024-04-23T14:46:06.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:06.380+0000 7f91d4c00700 1 -- 172.21.15.81:0/718584107 wait complete. 2024-04-23T14:46:06.517 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:06 smithi156 ceph-mon[32341]: mds.? [v2:172.21.15.81:6828/2563365650,v1:172.21.15.81:6829/2563365650] up:boot 2024-04-23T14:46:06.518 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:06 smithi156 ceph-mon[32341]: fsmap cephfs:1 {0=cephfs.smithi081.wydgcg=up:active} 2 up:standby 2024-04-23T14:46:06.518 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:06 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi081.vcoywg"}]: dispatch 2024-04-23T14:46:06.518 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:06 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:06.518 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:06 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:06.518 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:06 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:06.518 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:06 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi156.vynkxn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:46:06.518 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:06 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi156.vynkxn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T14:46:06.518 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:06 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:46:06.518 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:06 smithi156 ceph-mon[32341]: Deploying daemon mds.cephfs.smithi156.vynkxn on smithi156 2024-04-23T14:46:06.518 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:06 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/718584107' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-23T14:46:07.301 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-23T14:46:07.311 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi081.front.sepia.ceph.com 2024-04-23T14:46:07.312 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data false' 2024-04-23T14:46:07.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:07 smithi081 ceph-mon[25540]: pgmap v226: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-04-23T14:46:07.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:07 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/718584107' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-23T14:46:07.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:07 smithi081 ceph-mon[25540]: fsmap cephfs:1 {0=cephfs.smithi081.wydgcg=up:active} 2 up:standby 2024-04-23T14:46:07.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:07 smithi081 ceph-mon[25540]: fsmap cephfs:1 {0=cephfs.smithi081.wydgcg=up:active} 1 up:standby-replay 1 up:standby 2024-04-23T14:46:07.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:07 smithi156 ceph-mon[32341]: pgmap v226: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-04-23T14:46:07.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:07 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/718584107' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-23T14:46:07.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:07 smithi156 ceph-mon[32341]: fsmap cephfs:1 {0=cephfs.smithi081.wydgcg=up:active} 2 up:standby 2024-04-23T14:46:07.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:07 smithi156 ceph-mon[32341]: fsmap cephfs:1 {0=cephfs.smithi081.wydgcg=up:active} 1 up:standby-replay 1 up:standby 2024-04-23T14:46:07.794 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:46:09.400 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:09 smithi081 ceph-mon[25540]: pgmap v227: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-04-23T14:46:09.400 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:09 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:09.400 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:09 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:09.401 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:09 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:09.401 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:09 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:09.401 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:09 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:09.401 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:09 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:46:09.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:09 smithi156 ceph-mon[32341]: pgmap v227: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-04-23T14:46:09.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:09 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:09.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:09 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:09.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:09 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:09.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:09 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:09.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:09 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:09.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:09 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:46:09.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:09.931+0000 7faf27200700 1 -- 172.21.15.81:0/1362172909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf28073170 msgr2=0x7faf28073b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:09.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:09.931+0000 7faf27200700 1 --2- 172.21.15.81:0/1362172909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf28073170 0x7faf28073b80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7faf14004940 tx=0x7faf14009e30 comp rx=0 tx=0).stop 2024-04-23T14:46:09.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:09.931+0000 7faf27200700 1 -- 172.21.15.81:0/1362172909 shutdown_connections 2024-04-23T14:46:09.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:09.931+0000 7faf27200700 1 --2- 172.21.15.81:0/1362172909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf28073170 0x7faf28073b80 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:09.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:09.932+0000 7faf27200700 1 --2- 172.21.15.81:0/1362172909 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf28072820 0x7faf28072c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:09.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:09.932+0000 7faf27200700 1 -- 172.21.15.81:0/1362172909 >> 172.21.15.81:0/1362172909 conn(0x7faf280fa5d0 msgr2=0x7faf280fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:46:09.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:09.932+0000 7faf27200700 1 -- 172.21.15.81:0/1362172909 shutdown_connections 2024-04-23T14:46:09.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:09.932+0000 7faf27200700 1 -- 172.21.15.81:0/1362172909 wait complete. 2024-04-23T14:46:09.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:09.933+0000 7faf27200700 1 Processor -- start 2024-04-23T14:46:09.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:09.933+0000 7faf27200700 1 -- start start 2024-04-23T14:46:09.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:09.933+0000 7faf27200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf28072820 0x7faf28113de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:09.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:09.933+0000 7faf27200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf28114320 0x7faf281150c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:09.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:09.933+0000 7faf27200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf281147e0 con 0x7faf28114320 2024-04-23T14:46:09.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:09.933+0000 7faf27200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf28114920 con 0x7faf28072820 2024-04-23T14:46:09.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:09.934+0000 7faf25400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf28114320 0x7faf281150c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:09.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:09.934+0000 7faf25e00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf28072820 0x7faf28113de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:09.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:09.934+0000 7faf25400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf28114320 0x7faf281150c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45912/0 (socket says 172.21.15.81:45912) 2024-04-23T14:46:09.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:09.934+0000 7faf25400700 1 -- 172.21.15.81:0/2602355403 learned_addr learned my addr 172.21.15.81:0/2602355403 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:46:09.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:09.934+0000 7faf25400700 1 -- 172.21.15.81:0/2602355403 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf28072820 msgr2=0x7faf28113de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:09.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:09.934+0000 7faf25400700 1 --2- 172.21.15.81:0/2602355403 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf28072820 0x7faf28113de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:09.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:09.934+0000 7faf25400700 1 -- 172.21.15.81:0/2602355403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf14005040 con 0x7faf28114320 2024-04-23T14:46:09.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:09.934+0000 7faf25400700 1 --2- 172.21.15.81:0/2602355403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf28114320 0x7faf281150c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7faf1400b0d0 tx=0x7faf14009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:46:09.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:09.935+0000 7faf1e000700 1 -- 172.21.15.81:0/2602355403 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf1400e070 con 0x7faf28114320 2024-04-23T14:46:09.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:09.935+0000 7faf1e000700 1 -- 172.21.15.81:0/2602355403 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faf1400b410 con 0x7faf28114320 2024-04-23T14:46:09.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:09.935+0000 7faf1e000700 1 -- 172.21.15.81:0/2602355403 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf140125e0 con 0x7faf28114320 2024-04-23T14:46:09.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:09.935+0000 7faf27200700 1 -- 172.21.15.81:0/2602355403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf281156f0 con 0x7faf28114320 2024-04-23T14:46:09.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:09.935+0000 7faf27200700 1 -- 172.21.15.81:0/2602355403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf28115c00 con 0x7faf28114320 2024-04-23T14:46:09.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:09.936+0000 7faf13400700 1 -- 172.21.15.81:0/2602355403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf000052b0 con 0x7faf28114320 2024-04-23T14:46:09.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:09.937+0000 7faf1e000700 1 -- 172.21.15.81:0/2602355403 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7faf1400b580 con 0x7faf28114320 2024-04-23T14:46:09.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:09.938+0000 7faf1e000700 1 --2- 172.21.15.81:0/2602355403 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7faf0c0692a0 0x7faf0c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:09.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:09.938+0000 7faf1e000700 1 -- 172.21.15.81:0/2602355403 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7faf14088060 con 0x7faf28114320 2024-04-23T14:46:09.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:09.938+0000 7faf25e00700 1 --2- 172.21.15.81:0/2602355403 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7faf0c0692a0 0x7faf0c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:09.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:09.939+0000 7faf25e00700 1 --2- 172.21.15.81:0/2602355403 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7faf0c0692a0 0x7faf0c06b750 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faf280fd040 tx=0x7faf1800b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:46:09.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:09.943+0000 7faf1e000700 1 -- 172.21.15.81:0/2602355403 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7faf140542a0 con 0x7faf28114320 2024-04-23T14:46:10.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:10.254+0000 7faf13400700 1 -- 172.21.15.81:0/2602355403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7faf00005ae0 con 0x7faf28114320 2024-04-23T14:46:10.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:10.414+0000 7faf1e000700 1 -- 172.21.15.81:0/2602355403 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v14) v1 ==== 133+0+0 (secure 0 0 0) 0x7faf140578c0 con 0x7faf28114320 2024-04-23T14:46:10.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:10.419+0000 7faf13400700 1 -- 172.21.15.81:0/2602355403 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7faf0c0692a0 msgr2=0x7faf0c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:10.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:10.419+0000 7faf13400700 1 --2- 172.21.15.81:0/2602355403 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7faf0c0692a0 0x7faf0c06b750 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faf280fd040 tx=0x7faf1800b040 comp rx=0 tx=0).stop 2024-04-23T14:46:10.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:10.419+0000 7faf13400700 1 -- 172.21.15.81:0/2602355403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf28114320 msgr2=0x7faf281150c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:10.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:10.419+0000 7faf13400700 1 --2- 172.21.15.81:0/2602355403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf28114320 0x7faf281150c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7faf1400b0d0 tx=0x7faf14009e30 comp rx=0 tx=0).stop 2024-04-23T14:46:10.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:10.420+0000 7faf13400700 1 -- 172.21.15.81:0/2602355403 shutdown_connections 2024-04-23T14:46:10.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:10.420+0000 7faf13400700 1 --2- 172.21.15.81:0/2602355403 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf28072820 0x7faf28113de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:10.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:10.420+0000 7faf13400700 1 --2- 172.21.15.81:0/2602355403 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7faf0c0692a0 0x7faf0c06b750 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:10.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:10.420+0000 7faf13400700 1 --2- 172.21.15.81:0/2602355403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf28114320 0x7faf281150c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:10.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:10.420+0000 7faf13400700 1 -- 172.21.15.81:0/2602355403 >> 172.21.15.81:0/2602355403 conn(0x7faf280fa5d0 msgr2=0x7faf280fbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:46:10.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:10.420+0000 7faf13400700 1 -- 172.21.15.81:0/2602355403 shutdown_connections 2024-04-23T14:46:10.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:10.420+0000 7faf13400700 1 -- 172.21.15.81:0/2602355403 wait complete. 2024-04-23T14:46:10.422 INFO:teuthology.orchestra.run.smithi081.stderr:inline data disabled 2024-04-23T14:46:10.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:10 smithi081 ceph-mon[25540]: mds.? [v2:172.21.15.156:6826/1794690362,v1:172.21.15.156:6827/1794690362] up:boot 2024-04-23T14:46:10.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:10 smithi081 ceph-mon[25540]: mds.? [v2:172.21.15.81:6828/2563365650,v1:172.21.15.81:6829/2563365650] up:standby 2024-04-23T14:46:10.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:10 smithi081 ceph-mon[25540]: Dropping low affinity standby-replay daemon mds.cephfs.smithi156.rhbtxt in favor of higher affinity standby. 2024-04-23T14:46:10.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:10 smithi081 ceph-mon[25540]: fsmap cephfs:1 {0=cephfs.smithi081.wydgcg=up:active} 1 up:standby-replay 2 up:standby 2024-04-23T14:46:10.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:10 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi156.vynkxn"}]: dispatch 2024-04-23T14:46:10.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:10 smithi081 ceph-mon[25540]: Dropping low affinity active daemon mds.cephfs.smithi081.wydgcg in favor of higher affinity standby. 2024-04-23T14:46:10.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:10 smithi081 ceph-mon[25540]: Replacing daemon mds.cephfs.smithi081.wydgcg as rank 0 with standby daemon mds.cephfs.smithi081.vcoywg 2024-04-23T14:46:10.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:10 smithi081 ceph-mon[25540]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-23T14:46:10.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:10 smithi081 ceph-mon[25540]: fsmap cephfs:1 {0=cephfs.smithi081.wydgcg=up:active} 1 up:standby-replay 1 up:standby 2024-04-23T14:46:10.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:10 smithi081 ceph-mon[25540]: osdmap e47: 6 total, 6 up, 6 in 2024-04-23T14:46:10.578 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:10 smithi081 ceph-mon[25540]: fsmap cephfs:1/1 {0=cephfs.smithi081.vcoywg=up:replay} 1 up:standby 2024-04-23T14:46:10.578 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:10 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/2602355403' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-04-23T14:46:10.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:10 smithi156 ceph-mon[32341]: mds.? [v2:172.21.15.156:6826/1794690362,v1:172.21.15.156:6827/1794690362] up:boot 2024-04-23T14:46:10.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:10 smithi156 ceph-mon[32341]: mds.? [v2:172.21.15.81:6828/2563365650,v1:172.21.15.81:6829/2563365650] up:standby 2024-04-23T14:46:10.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:10 smithi156 ceph-mon[32341]: Dropping low affinity standby-replay daemon mds.cephfs.smithi156.rhbtxt in favor of higher affinity standby. 2024-04-23T14:46:10.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:10 smithi156 ceph-mon[32341]: fsmap cephfs:1 {0=cephfs.smithi081.wydgcg=up:active} 1 up:standby-replay 2 up:standby 2024-04-23T14:46:10.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:10 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi156.vynkxn"}]: dispatch 2024-04-23T14:46:10.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:10 smithi156 ceph-mon[32341]: Dropping low affinity active daemon mds.cephfs.smithi081.wydgcg in favor of higher affinity standby. 2024-04-23T14:46:10.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:10 smithi156 ceph-mon[32341]: Replacing daemon mds.cephfs.smithi081.wydgcg as rank 0 with standby daemon mds.cephfs.smithi081.vcoywg 2024-04-23T14:46:10.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:10 smithi156 ceph-mon[32341]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-23T14:46:10.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:10 smithi156 ceph-mon[32341]: fsmap cephfs:1 {0=cephfs.smithi081.wydgcg=up:active} 1 up:standby-replay 1 up:standby 2024-04-23T14:46:10.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:10 smithi156 ceph-mon[32341]: osdmap e47: 6 total, 6 up, 6 in 2024-04-23T14:46:10.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:10 smithi156 ceph-mon[32341]: fsmap cephfs:1/1 {0=cephfs.smithi081.vcoywg=up:replay} 1 up:standby 2024-04-23T14:46:10.788 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:10 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/2602355403' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-04-23T14:46:11.302 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-23T14:46:11.314 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi081.front.sepia.ceph.com 2024-04-23T14:46:11.314 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-23T14:46:11.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:11 smithi156 ceph-mon[32341]: pgmap v229: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 307 B/s rd, 511 B/s wr, 2 op/s 2024-04-23T14:46:11.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:11 smithi156 ceph-mon[32341]: mds.? [v2:172.21.15.156:6824/3854041261,v1:172.21.15.156:6825/3854041261] up:boot 2024-04-23T14:46:11.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:11 smithi156 ceph-mon[32341]: mds.? [v2:172.21.15.81:6826/759909104,v1:172.21.15.81:6827/759909104] up:boot 2024-04-23T14:46:11.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:11 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/2602355403' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-04-23T14:46:11.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:11 smithi156 ceph-mon[32341]: fsmap cephfs:1/1 {0=cephfs.smithi081.vcoywg=up:replay} 3 up:standby 2024-04-23T14:46:11.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:11 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi081.wydgcg"}]: dispatch 2024-04-23T14:46:11.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:11 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi156.rhbtxt"}]: dispatch 2024-04-23T14:46:11.572 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:11 smithi081 ceph-mon[25540]: pgmap v229: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 307 B/s rd, 511 B/s wr, 2 op/s 2024-04-23T14:46:11.572 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:11 smithi081 ceph-mon[25540]: mds.? [v2:172.21.15.156:6824/3854041261,v1:172.21.15.156:6825/3854041261] up:boot 2024-04-23T14:46:11.572 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:11 smithi081 ceph-mon[25540]: mds.? [v2:172.21.15.81:6826/759909104,v1:172.21.15.81:6827/759909104] up:boot 2024-04-23T14:46:11.572 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:11 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/2602355403' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-04-23T14:46:11.572 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:11 smithi081 ceph-mon[25540]: fsmap cephfs:1/1 {0=cephfs.smithi081.vcoywg=up:replay} 3 up:standby 2024-04-23T14:46:11.572 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:11 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi081.wydgcg"}]: dispatch 2024-04-23T14:46:11.572 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:11 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi156.rhbtxt"}]: dispatch 2024-04-23T14:46:11.930 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:46:12.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:12 smithi156 ceph-mon[32341]: mds.? [v2:172.21.15.81:6828/2563365650,v1:172.21.15.81:6829/2563365650] up:reconnect 2024-04-23T14:46:12.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:12 smithi156 ceph-mon[32341]: fsmap cephfs:1/1 {0=cephfs.smithi081.vcoywg=up:reconnect} 3 up:standby 2024-04-23T14:46:12.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:12 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:12.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:12 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:46:12.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:12 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:12.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:12 smithi081 ceph-mon[25540]: mds.? [v2:172.21.15.81:6828/2563365650,v1:172.21.15.81:6829/2563365650] up:reconnect 2024-04-23T14:46:12.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:12 smithi081 ceph-mon[25540]: fsmap cephfs:1/1 {0=cephfs.smithi081.vcoywg=up:reconnect} 3 up:standby 2024-04-23T14:46:12.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:12 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:12.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:12 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:46:12.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:12 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:13.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:13 smithi081 ceph-mon[25540]: pgmap v230: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-23T14:46:13.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:13 smithi081 ceph-mon[25540]: mds.? [v2:172.21.15.81:6828/2563365650,v1:172.21.15.81:6829/2563365650] up:rejoin 2024-04-23T14:46:13.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:13 smithi081 ceph-mon[25540]: fsmap cephfs:1/1 {0=cephfs.smithi081.vcoywg=up:rejoin} 3 up:standby 2024-04-23T14:46:13.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:13 smithi081 ceph-mon[25540]: daemon mds.cephfs.smithi081.vcoywg is now active in filesystem cephfs as rank 0 2024-04-23T14:46:13.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:13 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:13.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:13 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:13.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:13 smithi081 ceph-mon[25540]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-23T14:46:13.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:13 smithi081 ceph-mon[25540]: Cluster is now healthy 2024-04-23T14:46:13.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:13 smithi081 ceph-mon[25540]: mds.? [v2:172.21.15.81:6828/2563365650,v1:172.21.15.81:6829/2563365650] up:active 2024-04-23T14:46:13.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:13 smithi081 ceph-mon[25540]: fsmap cephfs:1 {0=cephfs.smithi081.vcoywg=up:active} 1 up:standby-replay 2 up:standby 2024-04-23T14:46:13.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:13 smithi156 ceph-mon[32341]: pgmap v230: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-23T14:46:13.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:13 smithi156 ceph-mon[32341]: mds.? [v2:172.21.15.81:6828/2563365650,v1:172.21.15.81:6829/2563365650] up:rejoin 2024-04-23T14:46:13.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:13 smithi156 ceph-mon[32341]: fsmap cephfs:1/1 {0=cephfs.smithi081.vcoywg=up:rejoin} 3 up:standby 2024-04-23T14:46:13.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:13 smithi156 ceph-mon[32341]: daemon mds.cephfs.smithi081.vcoywg is now active in filesystem cephfs as rank 0 2024-04-23T14:46:13.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:13 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:13.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:13 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:13.788 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:13 smithi156 ceph-mon[32341]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-23T14:46:13.788 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:13 smithi156 ceph-mon[32341]: Cluster is now healthy 2024-04-23T14:46:13.788 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:13 smithi156 ceph-mon[32341]: mds.? [v2:172.21.15.81:6828/2563365650,v1:172.21.15.81:6829/2563365650] up:active 2024-04-23T14:46:13.788 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:13 smithi156 ceph-mon[32341]: fsmap cephfs:1 {0=cephfs.smithi081.vcoywg=up:active} 1 up:standby-replay 2 up:standby 2024-04-23T14:46:15.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:14 smithi081 ceph-mon[25540]: mds.? [v2:172.21.15.156:6826/1794690362,v1:172.21.15.156:6827/1794690362] up:standby 2024-04-23T14:46:15.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:14 smithi081 ceph-mon[25540]: fsmap cephfs:1 {0=cephfs.smithi081.vcoywg=up:active} 1 up:standby-replay 2 up:standby 2024-04-23T14:46:15.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:14 smithi156 ceph-mon[32341]: mds.? [v2:172.21.15.156:6826/1794690362,v1:172.21.15.156:6827/1794690362] up:standby 2024-04-23T14:46:15.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:14 smithi156 ceph-mon[32341]: fsmap cephfs:1 {0=cephfs.smithi081.vcoywg=up:active} 1 up:standby-replay 2 up:standby 2024-04-23T14:46:15.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.407+0000 7f4564200700 1 -- 172.21.15.81:0/1205947846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f455c0fce80 msgr2=0x7f455c0fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:15.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.407+0000 7f4564200700 1 --2- 172.21.15.81:0/1205947846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f455c0fce80 0x7f455c0fd290 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4550004940 tx=0x7f4550009e30 comp rx=0 tx=0).stop 2024-04-23T14:46:15.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.407+0000 7f4564200700 1 -- 172.21.15.81:0/1205947846 shutdown_connections 2024-04-23T14:46:15.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.407+0000 7f4564200700 1 --2- 172.21.15.81:0/1205947846 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f455c0fdff0 0x7f455c0fe460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:15.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.407+0000 7f4564200700 1 --2- 172.21.15.81:0/1205947846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f455c0fce80 0x7f455c0fd290 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:15.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.407+0000 7f4564200700 1 -- 172.21.15.81:0/1205947846 >> 172.21.15.81:0/1205947846 conn(0x7f455c0f8580 msgr2=0x7f455c0fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:46:15.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.407+0000 7f4564200700 1 -- 172.21.15.81:0/1205947846 shutdown_connections 2024-04-23T14:46:15.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.407+0000 7f4564200700 1 -- 172.21.15.81:0/1205947846 wait complete. 2024-04-23T14:46:15.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.408+0000 7f4564200700 1 Processor -- start 2024-04-23T14:46:15.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.409+0000 7f4564200700 1 -- start start 2024-04-23T14:46:15.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.409+0000 7f4564200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f455c0fce80 0x7f455c10d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:15.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.409+0000 7f4564200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f455c0fdff0 0x7f455c10dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:15.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.409+0000 7f4564200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f455c10e4a0 con 0x7f455c0fce80 2024-04-23T14:46:15.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.409+0000 7f4564200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f455c10e610 con 0x7f455c0fdff0 2024-04-23T14:46:15.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.409+0000 7f4561800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f455c0fce80 0x7f455c10d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:15.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.409+0000 7f4561800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f455c0fce80 0x7f455c10d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36662/0 (socket says 172.21.15.81:36662) 2024-04-23T14:46:15.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.409+0000 7f4561800700 1 -- 172.21.15.81:0/1108394644 learned_addr learned my addr 172.21.15.81:0/1108394644 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:46:15.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.410+0000 7f4561800700 1 -- 172.21.15.81:0/1108394644 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f455c0fdff0 msgr2=0x7f455c10dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:15.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.410+0000 7f4560e00700 1 --2- 172.21.15.81:0/1108394644 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f455c0fdff0 0x7f455c10dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:15.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.410+0000 7f4561800700 1 --2- 172.21.15.81:0/1108394644 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f455c0fdff0 0x7f455c10dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:15.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.410+0000 7f4561800700 1 -- 172.21.15.81:0/1108394644 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4550005040 con 0x7f455c0fce80 2024-04-23T14:46:15.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.410+0000 7f4560e00700 1 --2- 172.21.15.81:0/1108394644 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f455c0fdff0 0x7f455c10dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:46:15.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.410+0000 7f4561800700 1 --2- 172.21.15.81:0/1108394644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f455c0fce80 0x7f455c10d960 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4550009150 tx=0x7f4550009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:46:15.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.410+0000 7f4559600700 1 -- 172.21.15.81:0/1108394644 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f455000e040 con 0x7f455c0fce80 2024-04-23T14:46:15.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.410+0000 7f4559600700 1 -- 172.21.15.81:0/1108394644 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f455000bbf0 con 0x7f455c0fce80 2024-04-23T14:46:15.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.410+0000 7f4564200700 1 -- 172.21.15.81:0/1108394644 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f455c113010 con 0x7f455c0fce80 2024-04-23T14:46:15.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.410+0000 7f4559600700 1 -- 172.21.15.81:0/1108394644 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f455001c630 con 0x7f455c0fce80 2024-04-23T14:46:15.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.411+0000 7f4564200700 1 -- 172.21.15.81:0/1108394644 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f455c1135d0 con 0x7f455c0fce80 2024-04-23T14:46:15.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.412+0000 7f4564200700 1 -- 172.21.15.81:0/1108394644 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f455c04c710 con 0x7f455c0fce80 2024-04-23T14:46:15.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.413+0000 7f4559600700 1 -- 172.21.15.81:0/1108394644 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f455000bd60 con 0x7f455c0fce80 2024-04-23T14:46:15.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.414+0000 7f4559600700 1 --2- 172.21.15.81:0/1108394644 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f45440692a0 0x7f454406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:15.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.414+0000 7f4559600700 1 -- 172.21.15.81:0/1108394644 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f4550088670 con 0x7f455c0fce80 2024-04-23T14:46:15.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.414+0000 7f4560e00700 1 --2- 172.21.15.81:0/1108394644 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f45440692a0 0x7f454406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:15.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.415+0000 7f4560e00700 1 --2- 172.21.15.81:0/1108394644 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f45440692a0 0x7f454406b750 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4548009fd0 tx=0x7f454800b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:46:15.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.419+0000 7f4559600700 1 -- 172.21.15.81:0/1108394644 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f4550058340 con 0x7f455c0fce80 2024-04-23T14:46:15.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.690+0000 7f4564200700 1 -- 172.21.15.81:0/1108394644 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f455c113a10 con 0x7f455c0fce80 2024-04-23T14:46:15.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.691+0000 7f4559600700 1 -- 172.21.15.81:0/1108394644 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1837 (secure 0 0 0) 0x7f4550057ed0 con 0x7f455c0fce80 2024-04-23T14:46:15.692 INFO:teuthology.orchestra.run.smithi081.stdout:e18 2024-04-23T14:46:15.692 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-23T14:46:15.693 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:46:15.693 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-04-23T14:46:15.693 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:46:15.693 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-04-23T14:46:15.693 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-04-23T14:46:15.693 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 17 2024-04-23T14:46:15.693 INFO:teuthology.orchestra.run.smithi081.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-23T14:46:15.693 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-04-23T14:45:51.264703+0000 2024-04-23T14:46:15.693 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-04-23T14:46:12.782992+0000 2024-04-23T14:46:15.693 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-04-23T14:46:15.693 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-04-23T14:46:15.693 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-04-23T14:46:15.693 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-04-23T14:46:15.693 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-04-23T14:46:15.694 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-04-23T14:46:15.694 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-04-23T14:46:15.694 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 47 2024-04-23T14:46:15.694 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:46:15.694 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 1 2024-04-23T14:46:15.694 INFO:teuthology.orchestra.run.smithi081.stdout:in 0 2024-04-23T14:46:15.694 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=14472} 2024-04-23T14:46:15.694 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-04-23T14:46:15.694 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-04-23T14:46:15.694 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-04-23T14:46:15.694 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-04-23T14:46:15.694 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-04-23T14:46:15.694 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-04-23T14:46:15.694 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-04-23T14:46:15.695 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-04-23T14:46:15.695 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.vcoywg{0:14472} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.81:6828/2563365650,v1:172.21.15.81:6829/2563365650] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:46:15.695 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.wydgcg{0:14482} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.81:6826/759909104,v1:172.21.15.81:6827/759909104] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:46:15.695 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:46:15.695 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:46:15.695 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-04-23T14:46:15.695 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:46:15.695 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.vynkxn{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.156:6826/1794690362,v1:172.21.15.156:6827/1794690362] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:46:15.695 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.rhbtxt{-1:24263} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.156:6824/3854041261,v1:172.21.15.156:6825/3854041261] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:46:15.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.693+0000 7f4564200700 1 -- 172.21.15.81:0/1108394644 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f45440692a0 msgr2=0x7f454406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:15.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.693+0000 7f4564200700 1 --2- 172.21.15.81:0/1108394644 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f45440692a0 0x7f454406b750 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4548009fd0 tx=0x7f454800b040 comp rx=0 tx=0).stop 2024-04-23T14:46:15.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.693+0000 7f4564200700 1 -- 172.21.15.81:0/1108394644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f455c0fce80 msgr2=0x7f455c10d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:15.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.693+0000 7f4564200700 1 --2- 172.21.15.81:0/1108394644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f455c0fce80 0x7f455c10d960 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4550009150 tx=0x7f4550009e30 comp rx=0 tx=0).stop 2024-04-23T14:46:15.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.694+0000 7f4564200700 1 -- 172.21.15.81:0/1108394644 shutdown_connections 2024-04-23T14:46:15.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.694+0000 7f4564200700 1 --2- 172.21.15.81:0/1108394644 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f45440692a0 0x7f454406b750 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:15.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.694+0000 7f4564200700 1 --2- 172.21.15.81:0/1108394644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f455c0fce80 0x7f455c10d960 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:15.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.694+0000 7f4564200700 1 --2- 172.21.15.81:0/1108394644 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f455c0fdff0 0x7f455c10dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:15.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.694+0000 7f4564200700 1 -- 172.21.15.81:0/1108394644 >> 172.21.15.81:0/1108394644 conn(0x7f455c0f8580 msgr2=0x7f455c0f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:46:15.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.694+0000 7f4564200700 1 -- 172.21.15.81:0/1108394644 shutdown_connections 2024-04-23T14:46:15.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:15.694+0000 7f4564200700 1 -- 172.21.15.81:0/1108394644 wait complete. 2024-04-23T14:46:15.697 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 18 2024-04-23T14:46:15.957 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:15 smithi081 ceph-mon[25540]: pgmap v231: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.8 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-23T14:46:15.957 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:15 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/1108394644' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:46:16.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:15 smithi156 ceph-mon[32341]: pgmap v231: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.8 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-23T14:46:16.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:15 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/1108394644' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:46:17.041 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-04-23T14:46:17.910 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:46:18.058 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:17 smithi081 ceph-mon[25540]: pgmap v232: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.0 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-23T14:46:18.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:17 smithi156 ceph-mon[32341]: pgmap v232: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.0 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-23T14:46:19.914 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:19 smithi081 ceph-mon[25540]: pgmap v233: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 7.5 KiB/s rd, 0 B/s wr, 8 op/s 2024-04-23T14:46:19.914 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:19 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:19.914 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:19 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:19.914 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:19 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:46:19.914 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:19 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:46:19.914 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:19 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:19.914 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:19 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:46:20.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.203+0000 7f66e3a00700 1 -- 172.21.15.81:0/83770250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66dc1002a0 msgr2=0x7f66dc100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:20.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.203+0000 7f66e3a00700 1 --2- 172.21.15.81:0/83770250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66dc1002a0 0x7f66dc100710 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f66c8004940 tx=0x7f66c8009e30 comp rx=0 tx=0).stop 2024-04-23T14:46:20.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.204+0000 7f66e3a00700 1 -- 172.21.15.81:0/83770250 shutdown_connections 2024-04-23T14:46:20.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.204+0000 7f66e3a00700 1 --2- 172.21.15.81:0/83770250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66dc1002a0 0x7f66dc100710 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:20.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.204+0000 7f66e3a00700 1 --2- 172.21.15.81:0/83770250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66dc0feff0 0x7f66dc0ff400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:20.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.204+0000 7f66e3a00700 1 -- 172.21.15.81:0/83770250 >> 172.21.15.81:0/83770250 conn(0x7f66dc0fa790 msgr2=0x7f66dc0fcba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:46:20.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.204+0000 7f66e3a00700 1 -- 172.21.15.81:0/83770250 shutdown_connections 2024-04-23T14:46:20.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.204+0000 7f66e3a00700 1 -- 172.21.15.81:0/83770250 wait complete. 2024-04-23T14:46:20.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.205+0000 7f66e3a00700 1 Processor -- start 2024-04-23T14:46:20.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.205+0000 7f66e3a00700 1 -- start start 2024-04-23T14:46:20.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.206+0000 7f66e3a00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66dc0feff0 0x7f66dc10fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:20.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.206+0000 7f66e3a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66dc1002a0 0x7f66dc110040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:20.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.206+0000 7f66e3a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc110640 con 0x7f66dc1002a0 2024-04-23T14:46:20.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.206+0000 7f66e3a00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc1107b0 con 0x7f66dc0feff0 2024-04-23T14:46:20.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.206+0000 7f66dbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66dc1002a0 0x7f66dc110040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:20.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.206+0000 7f66dbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66dc1002a0 0x7f66dc110040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36684/0 (socket says 172.21.15.81:36684) 2024-04-23T14:46:20.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.206+0000 7f66dbe00700 1 -- 172.21.15.81:0/2021126963 learned_addr learned my addr 172.21.15.81:0/2021126963 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:46:20.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.206+0000 7f66e1000700 1 --2- 172.21.15.81:0/2021126963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66dc0feff0 0x7f66dc10fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:20.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.207+0000 7f66dbe00700 1 -- 172.21.15.81:0/2021126963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66dc0feff0 msgr2=0x7f66dc10fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:20.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.207+0000 7f66dbe00700 1 --2- 172.21.15.81:0/2021126963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66dc0feff0 0x7f66dc10fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:20.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.207+0000 7f66dbe00700 1 -- 172.21.15.81:0/2021126963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c8005040 con 0x7f66dc1002a0 2024-04-23T14:46:20.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.207+0000 7f66e1000700 1 --2- 172.21.15.81:0/2021126963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66dc0feff0 0x7f66dc10fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:46:20.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.207+0000 7f66dbe00700 1 --2- 172.21.15.81:0/2021126963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66dc1002a0 0x7f66dc110040 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f66c8009150 tx=0x7f66c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:46:20.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.207+0000 7f66d8c00700 1 -- 172.21.15.81:0/2021126963 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66c800e040 con 0x7f66dc1002a0 2024-04-23T14:46:20.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.207+0000 7f66d8c00700 1 -- 172.21.15.81:0/2021126963 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f66c800bbf0 con 0x7f66dc1002a0 2024-04-23T14:46:20.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.207+0000 7f66e3a00700 1 -- 172.21.15.81:0/2021126963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66dc1151b0 con 0x7f66dc1002a0 2024-04-23T14:46:20.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.207+0000 7f66e3a00700 1 -- 172.21.15.81:0/2021126963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66dc115770 con 0x7f66dc1002a0 2024-04-23T14:46:20.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.208+0000 7f66d8c00700 1 -- 172.21.15.81:0/2021126963 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66c801c630 con 0x7f66dc1002a0 2024-04-23T14:46:20.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.209+0000 7f66e3a00700 1 -- 172.21.15.81:0/2021126963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66bc0052e0 con 0x7f66dc1002a0 2024-04-23T14:46:20.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.210+0000 7f66d8c00700 1 -- 172.21.15.81:0/2021126963 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f66c8013420 con 0x7f66dc1002a0 2024-04-23T14:46:20.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.211+0000 7f66d8c00700 1 --2- 172.21.15.81:0/2021126963 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f66c40692a0 0x7f66c406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:20.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.211+0000 7f66d8c00700 1 -- 172.21.15.81:0/2021126963 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f66c8088500 con 0x7f66dc1002a0 2024-04-23T14:46:20.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.211+0000 7f66e1000700 1 --2- 172.21.15.81:0/2021126963 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f66c40692a0 0x7f66c406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:20.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.212+0000 7f66e1000700 1 --2- 172.21.15.81:0/2021126963 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f66c40692a0 0x7f66c406b750 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f66d0009fd0 tx=0x7f66d0009ee0 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:46:20.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.216+0000 7f66d8c00700 1 -- 172.21.15.81:0/2021126963 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f66c8058270 con 0x7f66dc1002a0 2024-04-23T14:46:20.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:19 smithi156 ceph-mon[32341]: pgmap v233: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 7.5 KiB/s rd, 0 B/s wr, 8 op/s 2024-04-23T14:46:20.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:19 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:20.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:19 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:20.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:19 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:46:20.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:19 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:46:20.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:19 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:20.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:19 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:46:20.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.520+0000 7f66e3a00700 1 -- 172.21.15.81:0/2021126963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f66bc005b10 con 0x7f66dc1002a0 2024-04-23T14:46:20.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.521+0000 7f66d8c00700 1 -- 172.21.15.81:0/2021126963 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4699 (secure 0 0 0) 0x7f66c8057e00 con 0x7f66dc1002a0 2024-04-23T14:46:20.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.523+0000 7f66e3a00700 1 -- 172.21.15.81:0/2021126963 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f66c40692a0 msgr2=0x7f66c406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:20.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.523+0000 7f66e3a00700 1 --2- 172.21.15.81:0/2021126963 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f66c40692a0 0x7f66c406b750 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f66d0009fd0 tx=0x7f66d0009ee0 comp rx=0 tx=0).stop 2024-04-23T14:46:20.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.523+0000 7f66e3a00700 1 -- 172.21.15.81:0/2021126963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66dc1002a0 msgr2=0x7f66dc110040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:20.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.523+0000 7f66e3a00700 1 --2- 172.21.15.81:0/2021126963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66dc1002a0 0x7f66dc110040 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f66c8009150 tx=0x7f66c8009e30 comp rx=0 tx=0).stop 2024-04-23T14:46:20.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.524+0000 7f66e3a00700 1 -- 172.21.15.81:0/2021126963 shutdown_connections 2024-04-23T14:46:20.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.524+0000 7f66e3a00700 1 --2- 172.21.15.81:0/2021126963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66dc0feff0 0x7f66dc10fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:20.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.524+0000 7f66e3a00700 1 --2- 172.21.15.81:0/2021126963 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f66c40692a0 0x7f66c406b750 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:20.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.524+0000 7f66e3a00700 1 --2- 172.21.15.81:0/2021126963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66dc1002a0 0x7f66dc110040 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:20.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.524+0000 7f66e3a00700 1 -- 172.21.15.81:0/2021126963 >> 172.21.15.81:0/2021126963 conn(0x7f66dc0fa790 msgr2=0x7f66dc0fbe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:46:20.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.524+0000 7f66e3a00700 1 -- 172.21.15.81:0/2021126963 shutdown_connections 2024-04-23T14:46:20.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:20.524+0000 7f66e3a00700 1 -- 172.21.15.81:0/2021126963 wait complete. 2024-04-23T14:46:20.527 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 18 2024-04-23T14:46:20.540 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-04-23T14:46:21.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:20 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/2021126963' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:46:21.165 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:20 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/2021126963' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:46:21.961 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-04-23T14:46:22.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:21 smithi081 ceph-mon[25540]: pgmap v234: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-23T14:46:22.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:21 smithi156 ceph-mon[32341]: pgmap v234: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-23T14:46:23.124 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:46:23.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:23 smithi081 ceph-mon[25540]: pgmap v235: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.4 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-23T14:46:23.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:23 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:23.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:23 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:23.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:23 smithi156 ceph-mon[32341]: pgmap v235: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.4 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-23T14:46:23.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:23 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:23.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:23 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:25.568 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:25 smithi081 ceph-mon[25540]: pgmap v236: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.0 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-23T14:46:25.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:25 smithi156 ceph-mon[32341]: pgmap v236: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.0 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-23T14:46:26.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.324+0000 7f536d200700 1 -- 172.21.15.81:0/3687465841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5368066d40 msgr2=0x7f53680fd610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:26.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.324+0000 7f536d200700 1 --2- 172.21.15.81:0/3687465841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5368066d40 0x7f53680fd610 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5358004940 tx=0x7f5358009e30 comp rx=0 tx=0).stop 2024-04-23T14:46:26.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.324+0000 7f536d200700 1 -- 172.21.15.81:0/3687465841 shutdown_connections 2024-04-23T14:46:26.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.324+0000 7f536d200700 1 --2- 172.21.15.81:0/3687465841 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f53680fdb50 0x7f53680fffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:26.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.324+0000 7f536d200700 1 --2- 172.21.15.81:0/3687465841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5368066d40 0x7f53680fd610 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:26.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.324+0000 7f536d200700 1 -- 172.21.15.81:0/3687465841 >> 172.21.15.81:0/3687465841 conn(0x7f53680f7290 msgr2=0x7f53680f96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:46:26.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.324+0000 7f536d200700 1 -- 172.21.15.81:0/3687465841 shutdown_connections 2024-04-23T14:46:26.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.324+0000 7f536d200700 1 -- 172.21.15.81:0/3687465841 wait complete. 2024-04-23T14:46:26.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.325+0000 7f536d200700 1 Processor -- start 2024-04-23T14:46:26.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.325+0000 7f536d200700 1 -- start start 2024-04-23T14:46:26.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.325+0000 7f536d200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5368066d40 0x7f5368113f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:26.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.325+0000 7f536d200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f53680fdb50 0x7f5368114480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:26.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.325+0000 7f536d200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5368114a80 con 0x7f5368066d40 2024-04-23T14:46:26.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.325+0000 7f536d200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5368115170 con 0x7f53680fdb50 2024-04-23T14:46:26.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.326+0000 7f5367400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5368066d40 0x7f5368113f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:26.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.326+0000 7f5367400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5368066d40 0x7f5368113f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35552/0 (socket says 172.21.15.81:35552) 2024-04-23T14:46:26.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.326+0000 7f5367400700 1 -- 172.21.15.81:0/3827457990 learned_addr learned my addr 172.21.15.81:0/3827457990 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:46:26.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.326+0000 7f5366a00700 1 --2- 172.21.15.81:0/3827457990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f53680fdb50 0x7f5368114480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:26.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.326+0000 7f5367400700 1 -- 172.21.15.81:0/3827457990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f53680fdb50 msgr2=0x7f5368114480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:26.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.326+0000 7f5367400700 1 --2- 172.21.15.81:0/3827457990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f53680fdb50 0x7f5368114480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:26.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.326+0000 7f5367400700 1 -- 172.21.15.81:0/3827457990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5358005040 con 0x7f5368066d40 2024-04-23T14:46:26.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.326+0000 7f5367400700 1 --2- 172.21.15.81:0/3827457990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5368066d40 0x7f5368113f40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f535800b970 tx=0x7f5358009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:46:26.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.327+0000 7f535f400700 1 -- 172.21.15.81:0/3827457990 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f535800e040 con 0x7f5368066d40 2024-04-23T14:46:26.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.327+0000 7f535f400700 1 -- 172.21.15.81:0/3827457990 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5358004290 con 0x7f5368066d40 2024-04-23T14:46:26.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.327+0000 7f536d200700 1 -- 172.21.15.81:0/3827457990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53681153f0 con 0x7f5368066d40 2024-04-23T14:46:26.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.327+0000 7f535f400700 1 -- 172.21.15.81:0/3827457990 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f535801c630 con 0x7f5368066d40 2024-04-23T14:46:26.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.327+0000 7f536d200700 1 -- 172.21.15.81:0/3827457990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53681159b0 con 0x7f5368066d40 2024-04-23T14:46:26.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.328+0000 7f536d200700 1 -- 172.21.15.81:0/3827457990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53680faf30 con 0x7f5368066d40 2024-04-23T14:46:26.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.329+0000 7f535f400700 1 -- 172.21.15.81:0/3827457990 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f535800bbf0 con 0x7f5368066d40 2024-04-23T14:46:26.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.330+0000 7f535f400700 1 --2- 172.21.15.81:0/3827457990 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f534c0692a0 0x7f534c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:26.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.330+0000 7f535f400700 1 -- 172.21.15.81:0/3827457990 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f5358088690 con 0x7f5368066d40 2024-04-23T14:46:26.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.330+0000 7f5366a00700 1 --2- 172.21.15.81:0/3827457990 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f534c0692a0 0x7f534c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:26.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.331+0000 7f5366a00700 1 --2- 172.21.15.81:0/3827457990 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f534c0692a0 0x7f534c06b750 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f53500041d0 tx=0x7f5350009040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:46:26.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.335+0000 7f535f400700 1 -- 172.21.15.81:0/3827457990 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f5358058360 con 0x7f5368066d40 2024-04-23T14:46:26.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.651+0000 7f536d200700 1 -- 172.21.15.81:0/3827457990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f536804bed0 con 0x7f5368066d40 2024-04-23T14:46:26.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.652+0000 7f535f400700 1 -- 172.21.15.81:0/3827457990 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v18) v1 ==== 78+0+99 (secure 0 0 0) 0x7f5358013e60 con 0x7f5368066d40 2024-04-23T14:46:26.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.655+0000 7f536d200700 1 -- 172.21.15.81:0/3827457990 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f534c0692a0 msgr2=0x7f534c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:26.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.655+0000 7f536d200700 1 --2- 172.21.15.81:0/3827457990 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f534c0692a0 0x7f534c06b750 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f53500041d0 tx=0x7f5350009040 comp rx=0 tx=0).stop 2024-04-23T14:46:26.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.655+0000 7f536d200700 1 -- 172.21.15.81:0/3827457990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5368066d40 msgr2=0x7f5368113f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:26.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.655+0000 7f536d200700 1 --2- 172.21.15.81:0/3827457990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5368066d40 0x7f5368113f40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f535800b970 tx=0x7f5358009e30 comp rx=0 tx=0).stop 2024-04-23T14:46:26.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.655+0000 7f536d200700 1 -- 172.21.15.81:0/3827457990 shutdown_connections 2024-04-23T14:46:26.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.655+0000 7f536d200700 1 --2- 172.21.15.81:0/3827457990 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f534c0692a0 0x7f534c06b750 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:26.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.655+0000 7f536d200700 1 --2- 172.21.15.81:0/3827457990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5368066d40 0x7f5368113f40 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:26.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.655+0000 7f536d200700 1 --2- 172.21.15.81:0/3827457990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f53680fdb50 0x7f5368114480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:26.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.655+0000 7f536d200700 1 -- 172.21.15.81:0/3827457990 >> 172.21.15.81:0/3827457990 conn(0x7f53680f7290 msgr2=0x7f53680f76b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:46:26.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.655+0000 7f536d200700 1 -- 172.21.15.81:0/3827457990 shutdown_connections 2024-04-23T14:46:26.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:26.655+0000 7f536d200700 1 -- 172.21.15.81:0/3827457990 wait complete. 2024-04-23T14:46:26.676 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-04-23T14:46:27.739 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:27 smithi081 ceph-mon[25540]: pgmap v237: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-23T14:46:27.740 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:27 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/3827457990' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-04-23T14:46:27.740 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:27 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:27.740 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:27 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:46:27.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:27 smithi156 ceph-mon[32341]: pgmap v237: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-23T14:46:27.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:27 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/3827457990' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-04-23T14:46:27.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:27 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:27.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:27 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:46:28.122 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-04-23T14:46:28.134 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T14:46:28.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.323+0000 7fb051600640 1 -- 172.21.15.81:0/3561537560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb04c0fbfb0 msgr2=0x7fb04c0fc3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:28.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.323+0000 7fb051600640 1 --2- 172.21.15.81:0/3561537560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb04c0fbfb0 0x7fb04c0fc3c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb03c0048d0 tx=0x7fb03c009da0 comp rx=0 tx=0).stop 2024-04-23T14:46:28.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.324+0000 7fb051600640 1 -- 172.21.15.81:0/3561537560 shutdown_connections 2024-04-23T14:46:28.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.324+0000 7fb051600640 1 --2- 172.21.15.81:0/3561537560 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb04c0fd280 0x7fb04c0fd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:28.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.324+0000 7fb051600640 1 --2- 172.21.15.81:0/3561537560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb04c0fbfb0 0x7fb04c0fc3c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:28.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.324+0000 7fb051600640 1 -- 172.21.15.81:0/3561537560 >> 172.21.15.81:0/3561537560 conn(0x7fb04c0f7770 msgr2=0x7fb04c0f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:46:28.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.324+0000 7fb051600640 1 -- 172.21.15.81:0/3561537560 shutdown_connections 2024-04-23T14:46:28.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.324+0000 7fb051600640 1 -- 172.21.15.81:0/3561537560 wait complete. 2024-04-23T14:46:28.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.325+0000 7fb051600640 1 Processor -- start 2024-04-23T14:46:28.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.325+0000 7fb051600640 1 -- start start 2024-04-23T14:46:28.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.325+0000 7fb051600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb04c0fbfb0 0x7fb04c10cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:28.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.325+0000 7fb051600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb04c0fd280 0x7fb04c10d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:28.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.325+0000 7fb051600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c10d660 con 0x7fb04c0fd280 2024-04-23T14:46:28.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.325+0000 7fb051600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c112060 con 0x7fb04c0fbfb0 2024-04-23T14:46:28.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.325+0000 7fb04b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb04c0fd280 0x7fb04c10d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:28.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.326+0000 7fb04b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb04c0fd280 0x7fb04c10d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35558/0 (socket says 172.21.15.81:35558) 2024-04-23T14:46:28.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.326+0000 7fb04b400640 1 -- 172.21.15.81:0/4124109791 learned_addr learned my addr 172.21.15.81:0/4124109791 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:46:28.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.326+0000 7fb04be00640 1 --2- 172.21.15.81:0/4124109791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb04c0fbfb0 0x7fb04c10cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:28.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.326+0000 7fb04b400640 1 -- 172.21.15.81:0/4124109791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb04c0fbfb0 msgr2=0x7fb04c10cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:28.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.326+0000 7fb04b400640 1 --2- 172.21.15.81:0/4124109791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb04c0fbfb0 0x7fb04c10cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:28.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.326+0000 7fb04b400640 1 -- 172.21.15.81:0/4124109791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb03c005040 con 0x7fb04c0fd280 2024-04-23T14:46:28.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.326+0000 7fb04b400640 1 --2- 172.21.15.81:0/4124109791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb04c0fd280 0x7fb04c10d010 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb03800c810 tx=0x7fb0380043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:46:28.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.327+0000 7fb043e00640 1 -- 172.21.15.81:0/4124109791 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb03800a7a0 con 0x7fb04c0fd280 2024-04-23T14:46:28.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.327+0000 7fb043e00640 1 -- 172.21.15.81:0/4124109791 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb03800add0 con 0x7fb04c0fd280 2024-04-23T14:46:28.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.327+0000 7fb051600640 1 -- 172.21.15.81:0/4124109791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb04c112200 con 0x7fb04c0fd280 2024-04-23T14:46:28.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.327+0000 7fb043e00640 1 -- 172.21.15.81:0/4124109791 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0380115c0 con 0x7fb04c0fd280 2024-04-23T14:46:28.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.327+0000 7fb051600640 1 -- 172.21.15.81:0/4124109791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb04c1126f0 con 0x7fb04c0fd280 2024-04-23T14:46:28.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.328+0000 7fb051600640 1 -- 172.21.15.81:0/4124109791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb04c04bcc0 con 0x7fb04c0fd280 2024-04-23T14:46:28.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.329+0000 7fb043e00640 1 -- 172.21.15.81:0/4124109791 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fb038012420 con 0x7fb04c0fd280 2024-04-23T14:46:28.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.330+0000 7fb043e00640 1 --2- 172.21.15.81:0/4124109791 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fb030069220 0x7fb03006b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:28.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.330+0000 7fb043e00640 1 -- 172.21.15.81:0/4124109791 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fb038087710 con 0x7fb04c0fd280 2024-04-23T14:46:28.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.330+0000 7fb04be00640 1 --2- 172.21.15.81:0/4124109791 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fb030069220 0x7fb03006b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:28.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.331+0000 7fb04be00640 1 --2- 172.21.15.81:0/4124109791 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fb030069220 0x7fb03006b6d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb03c0048a0 tx=0x7fb03c009da0 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:46:28.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.335+0000 7fb043e00640 1 -- 172.21.15.81:0/4124109791 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fb038053990 con 0x7fb04c0fd280 2024-04-23T14:46:28.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.537+0000 7fb051600640 1 -- 172.21.15.81:0/4124109791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb04c112ce0 con 0x7fb04c0fd280 2024-04-23T14:46:28.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.538+0000 7fb043e00640 1 -- 172.21.15.81:0/4124109791 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+14374 (secure 0 0 0) 0x7fb038056fb0 con 0x7fb04c0fd280 2024-04-23T14:46:28.540 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:46:28.540 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":47,"fsid":"7a641bea-017e-11ef-bc93-c7b262605968","created":"2024-04-23T14:37:06.214022+0000","modified":"2024-04-23T14:46:09.390998+0000","last_up_change":"2024-04-23T14:44:13.762548+0000","last_in_change":"2024-04-23T14:43:50.423631+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T14:42:32.718276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-23T14:45:50.013431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-23T14:45:50.800862+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c084af11-7048-409a-9932-9ede242d3abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3586146569},{"type":"v1","addr":"172.21.15.81:6803","nonce":3586146569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3586146569},{"type":"v1","addr":"172.21.15.81:6805","nonce":3586146569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3586146569},{"type":"v1","addr":"172.21.15.81:6809","nonce":3586146569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3586146569},{"type":"v1","addr":"172.21.15.81:6807","nonce":3586146569}]},"public_addr":"172.21.15.81:6803/3586146569","cluster_addr":"172.21.15.81:6805/3586146569","heartbeat_back_addr":"172.21.15.81:6809/3586146569","heartbeat_front_addr":"172.21.15.81:6807/3586146569","state":["exists","up"]},{"osd":1,"uuid":"0b642368-c907-404e-9f69-32f059f5426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":48369012},{"type":"v1","addr":"172.21.15.81:6811","nonce":48369012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":48369012},{"type":"v1","addr":"172.21.15.81:6813","nonce":48369012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":48369012},{"type":"v1","addr":"172.21.15.81:6817","nonce":48369012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":48369012},{"type":"v1","addr":"172.21.15.81:6815","nonce":48369012}]},"public_addr":"172.21.15.81:6811/48369012","cluster_addr":"172.21.15.81:6813/48369012","heartbeat_back_addr":"172.21.15.81:6817/48369012","heartbeat_front_addr":"172.21.15.81:6815/48369012","state":["exists","up"]},{"osd":2,"uuid":"cde59edc-3e7d-4d53-ba08-a67ec2250898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3840720313},{"type":"v1","addr":"172.21.15.81:6819","nonce":3840720313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3840720313},{"type":"v1","addr":"172.21.15.81:6821","nonce":3840720313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3840720313},{"type":"v1","addr":"172.21.15.81:6825","nonce":3840720313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3840720313},{"type":"v1","addr":"172.21.15.81:6823","nonce":3840720313}]},"public_addr":"172.21.15.81:6819/3840720313","cluster_addr":"172.21.15.81:6821/3840720313","heartbeat_back_addr":"172.21.15.81:6825/3840720313","heartbeat_front_addr":"172.21.15.81:6823/3840720313","state":["exists","up"]},{"osd":3,"uuid":"722814fb-aeb5-4765-8440-05563f47c8ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":2727527147},{"type":"v1","addr":"172.21.15.156:6801","nonce":2727527147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":2727527147},{"type":"v1","addr":"172.21.15.156:6803","nonce":2727527147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":2727527147},{"type":"v1","addr":"172.21.15.156:6807","nonce":2727527147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":2727527147},{"type":"v1","addr":"172.21.15.156:6805","nonce":2727527147}]},"public_addr":"172.21.15.156:6801/2727527147","cluster_addr":"172.21.15.156:6803/2727527147","heartbeat_back_addr":"172.21.15.156:6807/2727527147","heartbeat_front_addr":"172.21.15.156:6805/2727527147","state":["exists","up"]},{"osd":4,"uuid":"2f660c6e-38d1-4982-9cba-46242bf2de6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":821376629},{"type":"v1","addr":"172.21.15.156:6809","nonce":821376629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":821376629},{"type":"v1","addr":"172.21.15.156:6811","nonce":821376629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":821376629},{"type":"v1","addr":"172.21.15.156:6815","nonce":821376629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":821376629},{"type":"v1","addr":"172.21.15.156:6813","nonce":821376629}]},"public_addr":"172.21.15.156:6809/821376629","cluster_addr":"172.21.15.156:6811/821376629","heartbeat_back_addr":"172.21.15.156:6815/821376629","heartbeat_front_addr":"172.21.15.156:6813/821376629","state":["exists","up"]},{"osd":5,"uuid":"82590b0d-f1e5-4491-b341-8db75ce2ea50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":4222896396},{"type":"v1","addr":"172.21.15.156:6817","nonce":4222896396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":4222896396},{"type":"v1","addr":"172.21.15.156:6819","nonce":4222896396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":4222896396},{"type":"v1","addr":"172.21.15.156:6823","nonce":4222896396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":4222896396},{"type":"v1","addr":"172.21.15.156:6821","nonce":4222896396}]},"public_addr":"172.21.15.156:6817/4222896396","cluster_addr":"172.21.15.156:6819/4222896396","heartbeat_back_addr":"172.21.15.156:6823/4222896396","heartbeat_front_addr":"172.21.15.156:6821/4222896396","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:16.189027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:52.737106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:42:29.838157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:03.041762+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:37.248449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:12.266170+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6800/1764050360":"2024-04-24T14:37:38.176351+0000","172.21.15.81:0/3010656646":"2024-04-24T14:37:38.176351+0000","172.21.15.81:6801/2072638798":"2024-04-24T14:38:16.825251+0000","172.21.15.81:6826/2500326945":"2024-04-24T14:46:09.390974+0000","172.21.15.81:6801/1764050360":"2024-04-24T14:37:38.176351+0000","172.21.15.81:6827/2500326945":"2024-04-24T14:46:09.390974+0000","172.21.15.81:6801/3624015234":"2024-04-24T14:39:42.006227+0000","172.21.15.81:0/2253455652":"2024-04-24T14:37:38.176351+0000","172.21.15.81:0/1308908574":"2024-04-24T14:39:42.006227+0000","172.21.15.81:6800/2072638798":"2024-04-24T14:38:16.825251+0000","172.21.15.81:0/4290566211":"2024-04-24T14:39:42.006227+0000","172.21.15.81:0/3173386887":"2024-04-24T14:38:16.825251+0000","172.21.15.81:0/644202147":"2024-04-24T14:38:16.825251+0000","172.21.15.81:0/652570605":"2024-04-24T14:38:16.825251+0000","172.21.15.81:6800/3624015234":"2024-04-24T14:39:42.006227+0000","172.21.15.81:0/4004069135":"2024-04-24T14:37:38.176351+0000","172.21.15.81:0/3883051436":"2024-04-24T14:39:42.006227+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T14:46:28.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.541+0000 7fb051600640 1 -- 172.21.15.81:0/4124109791 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fb030069220 msgr2=0x7fb03006b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:28.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.541+0000 7fb051600640 1 --2- 172.21.15.81:0/4124109791 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fb030069220 0x7fb03006b6d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb03c0048a0 tx=0x7fb03c009da0 comp rx=0 tx=0).stop 2024-04-23T14:46:28.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.541+0000 7fb051600640 1 -- 172.21.15.81:0/4124109791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb04c0fd280 msgr2=0x7fb04c10d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:28.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.541+0000 7fb051600640 1 --2- 172.21.15.81:0/4124109791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb04c0fd280 0x7fb04c10d010 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb03800c810 tx=0x7fb0380043c0 comp rx=0 tx=0).stop 2024-04-23T14:46:28.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.541+0000 7fb051600640 1 -- 172.21.15.81:0/4124109791 shutdown_connections 2024-04-23T14:46:28.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.541+0000 7fb051600640 1 --2- 172.21.15.81:0/4124109791 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fb030069220 0x7fb03006b6d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:28.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.541+0000 7fb051600640 1 --2- 172.21.15.81:0/4124109791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb04c0fd280 0x7fb04c10d010 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:28.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.541+0000 7fb051600640 1 --2- 172.21.15.81:0/4124109791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb04c0fbfb0 0x7fb04c10cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:28.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.541+0000 7fb051600640 1 -- 172.21.15.81:0/4124109791 >> 172.21.15.81:0/4124109791 conn(0x7fb04c0f7770 msgr2=0x7fb04c0f8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:46:28.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.541+0000 7fb051600640 1 -- 172.21.15.81:0/4124109791 shutdown_connections 2024-04-23T14:46:28.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.541+0000 7fb051600640 1 -- 172.21.15.81:0/4124109791 wait complete. 2024-04-23T14:46:28.568 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T14:42:32.718276+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-23T14:45:50.013431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-23T14:45:50.800862+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-23T14:46:28.568 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T14:46:28.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.749+0000 7f056f200640 1 -- 172.21.15.81:0/908174512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05680fcf40 msgr2=0x7f05680ff3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:28.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.749+0000 7f056f200640 1 --2- 172.21.15.81:0/908174512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05680fcf40 0x7f05680ff3c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f05580048d0 tx=0x7f0558009da0 comp rx=0 tx=0).stop 2024-04-23T14:46:28.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.750+0000 7f056f200640 1 -- 172.21.15.81:0/908174512 shutdown_connections 2024-04-23T14:46:28.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.750+0000 7f056f200640 1 --2- 172.21.15.81:0/908174512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05680fcf40 0x7f05680ff3c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:28.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.750+0000 7f056f200640 1 --2- 172.21.15.81:0/908174512 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0568065040 0x7f05680fca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:28.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.750+0000 7f056f200640 1 -- 172.21.15.81:0/908174512 >> 172.21.15.81:0/908174512 conn(0x7f05680f6720 msgr2=0x7f05680f8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:46:28.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.750+0000 7f056f200640 1 -- 172.21.15.81:0/908174512 shutdown_connections 2024-04-23T14:46:28.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.750+0000 7f056f200640 1 -- 172.21.15.81:0/908174512 wait complete. 2024-04-23T14:46:28.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.750+0000 7f056f200640 1 Processor -- start 2024-04-23T14:46:28.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.751+0000 7f056f200640 1 -- start start 2024-04-23T14:46:28.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.751+0000 7f056f200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0568065040 0x7f0568113170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:28.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.751+0000 7f056f200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05680fcf40 0x7f05681136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:28.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.751+0000 7f056f200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0568113d00 con 0x7f05680fcf40 2024-04-23T14:46:28.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.751+0000 7f056f200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0568118700 con 0x7f0568065040 2024-04-23T14:46:28.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.751+0000 7f056d400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05680fcf40 0x7f05681136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:28.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.751+0000 7f056d400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05680fcf40 0x7f05681136b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35578/0 (socket says 172.21.15.81:35578) 2024-04-23T14:46:28.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.751+0000 7f056d400640 1 -- 172.21.15.81:0/510814268 learned_addr learned my addr 172.21.15.81:0/510814268 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:46:28.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.751+0000 7f056de00640 1 --2- 172.21.15.81:0/510814268 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0568065040 0x7f0568113170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:28.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.752+0000 7f056d400640 1 -- 172.21.15.81:0/510814268 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0568065040 msgr2=0x7f0568113170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:28.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.752+0000 7f056d400640 1 --2- 172.21.15.81:0/510814268 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0568065040 0x7f0568113170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:28.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.752+0000 7f056d400640 1 -- 172.21.15.81:0/510814268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0558005040 con 0x7f05680fcf40 2024-04-23T14:46:28.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.752+0000 7f056de00640 1 --2- 172.21.15.81:0/510814268 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0568065040 0x7f0568113170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:46:28.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.752+0000 7f056d400640 1 --2- 172.21.15.81:0/510814268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05680fcf40 0x7f05681136b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0558000c00 tx=0x7f0558009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:46:28.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.752+0000 7f0562000640 1 -- 172.21.15.81:0/510814268 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05580094c0 con 0x7f05680fcf40 2024-04-23T14:46:28.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.752+0000 7f0562000640 1 -- 172.21.15.81:0/510814268 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0558032e90 con 0x7f05680fcf40 2024-04-23T14:46:28.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.752+0000 7f056f200640 1 -- 172.21.15.81:0/510814268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0568118840 con 0x7f05680fcf40 2024-04-23T14:46:28.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.752+0000 7f0562000640 1 -- 172.21.15.81:0/510814268 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05580435f0 con 0x7f05680fcf40 2024-04-23T14:46:28.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.752+0000 7f056f200640 1 -- 172.21.15.81:0/510814268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0568118cd0 con 0x7f05680fcf40 2024-04-23T14:46:28.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.754+0000 7f056f200640 1 -- 172.21.15.81:0/510814268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f056804bcc0 con 0x7f05680fcf40 2024-04-23T14:46:28.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.754+0000 7f0562000640 1 -- 172.21.15.81:0/510814268 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f055802f070 con 0x7f05680fcf40 2024-04-23T14:46:28.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.756+0000 7f0562000640 1 --2- 172.21.15.81:0/510814268 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f0550069220 0x7f055006b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:28.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.756+0000 7f0562000640 1 -- 172.21.15.81:0/510814268 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f05580a9190 con 0x7f05680fcf40 2024-04-23T14:46:28.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.756+0000 7f056de00640 1 --2- 172.21.15.81:0/510814268 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f0550069220 0x7f055006b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:28.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.757+0000 7f056de00640 1 --2- 172.21.15.81:0/510814268 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f0550069220 0x7f055006b6d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f055c009fd0 tx=0x7f055c009e50 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:46:28.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.760+0000 7f0562000640 1 -- 172.21.15.81:0/510814268 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f05580753f0 con 0x7f05680fcf40 2024-04-23T14:46:28.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.955+0000 7f056f200640 1 -- 172.21.15.81:0/510814268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0568118fb0 con 0x7f05680fcf40 2024-04-23T14:46:28.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.956+0000 7f0562000640 1 -- 172.21.15.81:0/510814268 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7f055803b960 con 0x7f05680fcf40 2024-04-23T14:46:28.957 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-04-23T14:46:28.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.958+0000 7f056f200640 1 -- 172.21.15.81:0/510814268 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f0550069220 msgr2=0x7f055006b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:28.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.958+0000 7f056f200640 1 --2- 172.21.15.81:0/510814268 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f0550069220 0x7f055006b6d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f055c009fd0 tx=0x7f055c009e50 comp rx=0 tx=0).stop 2024-04-23T14:46:28.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.958+0000 7f056f200640 1 -- 172.21.15.81:0/510814268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05680fcf40 msgr2=0x7f05681136b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:28.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.958+0000 7f056f200640 1 --2- 172.21.15.81:0/510814268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05680fcf40 0x7f05681136b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0558000c00 tx=0x7f0558009da0 comp rx=0 tx=0).stop 2024-04-23T14:46:28.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.958+0000 7f056f200640 1 -- 172.21.15.81:0/510814268 shutdown_connections 2024-04-23T14:46:28.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.958+0000 7f056f200640 1 --2- 172.21.15.81:0/510814268 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f0550069220 0x7f055006b6d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:28.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.958+0000 7f056f200640 1 --2- 172.21.15.81:0/510814268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05680fcf40 0x7f05681136b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:28.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.958+0000 7f056f200640 1 --2- 172.21.15.81:0/510814268 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0568065040 0x7f0568113170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:28.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.958+0000 7f056f200640 1 -- 172.21.15.81:0/510814268 >> 172.21.15.81:0/510814268 conn(0x7f05680f6720 msgr2=0x7f05680f6af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:46:28.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.958+0000 7f056f200640 1 -- 172.21.15.81:0/510814268 shutdown_connections 2024-04-23T14:46:28.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:28.958+0000 7f056f200640 1 -- 172.21.15.81:0/510814268 wait complete. 2024-04-23T14:46:28.979 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-23T14:46:29.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.151+0000 7f3071400640 1 -- 172.21.15.81:0/441000589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f306c071390 msgr2=0x7f306c06f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:29.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.151+0000 7f3071400640 1 --2- 172.21.15.81:0/441000589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f306c071390 0x7f306c06f8c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f305c0048d0 tx=0x7f305c009da0 comp rx=0 tx=0).stop 2024-04-23T14:46:29.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.152+0000 7f3071400640 1 -- 172.21.15.81:0/441000589 shutdown_connections 2024-04-23T14:46:29.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.152+0000 7f3071400640 1 --2- 172.21.15.81:0/441000589 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f306c06fe00 0x7f306c070270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:29.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.152+0000 7f3071400640 1 --2- 172.21.15.81:0/441000589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f306c071390 0x7f306c06f8c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:29.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.152+0000 7f3071400640 1 -- 172.21.15.81:0/441000589 >> 172.21.15.81:0/441000589 conn(0x7f306c0f77b0 msgr2=0x7f306c0f9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:46:29.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.152+0000 7f3071400640 1 -- 172.21.15.81:0/441000589 shutdown_connections 2024-04-23T14:46:29.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.152+0000 7f3071400640 1 -- 172.21.15.81:0/441000589 wait complete. 2024-04-23T14:46:29.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.153+0000 7f3071400640 1 Processor -- start 2024-04-23T14:46:29.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.153+0000 7f3071400640 1 -- start start 2024-04-23T14:46:29.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.153+0000 7f3071400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f306c06fe00 0x7f306c10ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:29.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.153+0000 7f3071400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f306c071390 0x7f306c10f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:29.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.153+0000 7f3071400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306c10f910 con 0x7f306c06fe00 2024-04-23T14:46:29.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.153+0000 7f3071400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306c114310 con 0x7f306c071390 2024-04-23T14:46:29.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.154+0000 7f306be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f306c06fe00 0x7f306c10ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:29.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.154+0000 7f306be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f306c06fe00 0x7f306c10ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35592/0 (socket says 172.21.15.81:35592) 2024-04-23T14:46:29.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.154+0000 7f306be00640 1 -- 172.21.15.81:0/648681889 learned_addr learned my addr 172.21.15.81:0/648681889 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:46:29.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.154+0000 7f3063e00640 1 --2- 172.21.15.81:0/648681889 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f306c071390 0x7f306c10f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:29.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.154+0000 7f306be00640 1 -- 172.21.15.81:0/648681889 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f306c071390 msgr2=0x7f306c10f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:29.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.154+0000 7f306be00640 1 --2- 172.21.15.81:0/648681889 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f306c071390 0x7f306c10f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:29.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.154+0000 7f306be00640 1 -- 172.21.15.81:0/648681889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305c005040 con 0x7f306c06fe00 2024-04-23T14:46:29.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.155+0000 7f306be00640 1 --2- 172.21.15.81:0/648681889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f306c06fe00 0x7f306c10ed80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f305c000c00 tx=0x7f305c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:46:29.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.155+0000 7f3068c00640 1 -- 172.21.15.81:0/648681889 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f305c0094c0 con 0x7f306c06fe00 2024-04-23T14:46:29.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.155+0000 7f3068c00640 1 -- 172.21.15.81:0/648681889 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f305c032e90 con 0x7f306c06fe00 2024-04-23T14:46:29.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.155+0000 7f3071400640 1 -- 172.21.15.81:0/648681889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f306c114450 con 0x7f306c06fe00 2024-04-23T14:46:29.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.155+0000 7f3068c00640 1 -- 172.21.15.81:0/648681889 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f305c0435f0 con 0x7f306c06fe00 2024-04-23T14:46:29.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.155+0000 7f3071400640 1 -- 172.21.15.81:0/648681889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f306c1148e0 con 0x7f306c06fe00 2024-04-23T14:46:29.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.157+0000 7f3071400640 1 -- 172.21.15.81:0/648681889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f306c04bcc0 con 0x7f306c06fe00 2024-04-23T14:46:29.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.159+0000 7f3068c00640 1 -- 172.21.15.81:0/648681889 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f305c02f070 con 0x7f306c06fe00 2024-04-23T14:46:29.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.159+0000 7f3068c00640 1 --2- 172.21.15.81:0/648681889 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f3050069220 0x7f305006b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:29.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.160+0000 7f3068c00640 1 -- 172.21.15.81:0/648681889 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f305c0a9180 con 0x7f306c06fe00 2024-04-23T14:46:29.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.160+0000 7f3063e00640 1 --2- 172.21.15.81:0/648681889 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f3050069220 0x7f305006b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:29.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.161+0000 7f3063e00640 1 --2- 172.21.15.81:0/648681889 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f3050069220 0x7f305006b6d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3054007fd0 tx=0x7f3054009e90 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:46:29.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.165+0000 7f3068c00640 1 -- 172.21.15.81:0/648681889 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f305c0753e0 con 0x7f306c06fe00 2024-04-23T14:46:29.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.354+0000 7f3071400640 1 -- 172.21.15.81:0/648681889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f306c114da0 con 0x7f306c06fe00 2024-04-23T14:46:29.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.355+0000 7f3068c00640 1 -- 172.21.15.81:0/648681889 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v47) v1 ==== 107+0+11 (secure 0 0 0) 0x7f305c078a00 con 0x7f306c06fe00 2024-04-23T14:46:29.357 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-04-23T14:46:29.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.357+0000 7f3071400640 1 -- 172.21.15.81:0/648681889 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f3050069220 msgr2=0x7f305006b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:29.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.357+0000 7f3071400640 1 --2- 172.21.15.81:0/648681889 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f3050069220 0x7f305006b6d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3054007fd0 tx=0x7f3054009e90 comp rx=0 tx=0).stop 2024-04-23T14:46:29.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.358+0000 7f3071400640 1 -- 172.21.15.81:0/648681889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f306c06fe00 msgr2=0x7f306c10ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:29.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.358+0000 7f3071400640 1 --2- 172.21.15.81:0/648681889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f306c06fe00 0x7f306c10ed80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f305c000c00 tx=0x7f305c009da0 comp rx=0 tx=0).stop 2024-04-23T14:46:29.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.358+0000 7f3071400640 1 -- 172.21.15.81:0/648681889 shutdown_connections 2024-04-23T14:46:29.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.358+0000 7f3071400640 1 --2- 172.21.15.81:0/648681889 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f3050069220 0x7f305006b6d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:29.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.358+0000 7f3071400640 1 --2- 172.21.15.81:0/648681889 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f306c071390 0x7f306c10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:29.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.358+0000 7f3071400640 1 --2- 172.21.15.81:0/648681889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f306c06fe00 0x7f306c10ed80 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:29.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.358+0000 7f3071400640 1 -- 172.21.15.81:0/648681889 >> 172.21.15.81:0/648681889 conn(0x7f306c0f77b0 msgr2=0x7f306c0f8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:46:29.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.358+0000 7f3071400640 1 -- 172.21.15.81:0/648681889 shutdown_connections 2024-04-23T14:46:29.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.358+0000 7f3071400640 1 -- 172.21.15.81:0/648681889 wait complete. 2024-04-23T14:46:29.379 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-23T14:46:29.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:29 smithi156 ceph-mon[32341]: pgmap v238: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 2 op/s 2024-04-23T14:46:29.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:29 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/4124109791' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:46:29.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:29 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:29.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:29 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:29.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:29 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/510814268' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T14:46:29.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:29 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/648681889' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-23T14:46:29.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.570+0000 7fb573e00640 1 -- 172.21.15.81:0/2091363019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5740fd2e0 msgr2=0x7fb5740fd750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:29.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.570+0000 7fb573e00640 1 --2- 172.21.15.81:0/2091363019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5740fd2e0 0x7fb5740fd750 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb5600048d0 tx=0x7fb560009da0 comp rx=0 tx=0).stop 2024-04-23T14:46:29.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.570+0000 7fb573e00640 1 -- 172.21.15.81:0/2091363019 shutdown_connections 2024-04-23T14:46:29.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.570+0000 7fb573e00640 1 --2- 172.21.15.81:0/2091363019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5740fd2e0 0x7fb5740fd750 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:29.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.570+0000 7fb573e00640 1 --2- 172.21.15.81:0/2091363019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5740fc010 0x7fb5740fc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:29.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.570+0000 7fb573e00640 1 -- 172.21.15.81:0/2091363019 >> 172.21.15.81:0/2091363019 conn(0x7fb5740f77b0 msgr2=0x7fb5740f9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:46:29.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.570+0000 7fb573e00640 1 -- 172.21.15.81:0/2091363019 shutdown_connections 2024-04-23T14:46:29.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.570+0000 7fb573e00640 1 -- 172.21.15.81:0/2091363019 wait complete. 2024-04-23T14:46:29.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.571+0000 7fb573e00640 1 Processor -- start 2024-04-23T14:46:29.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.571+0000 7fb573e00640 1 -- start start 2024-04-23T14:46:29.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.572+0000 7fb573e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5740fc010 0x7fb57410ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:29.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.572+0000 7fb573e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5740fd2e0 0x7fb57410f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:29.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.572+0000 7fb573e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57410f8d0 con 0x7fb5740fd2e0 2024-04-23T14:46:29.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.572+0000 7fb573e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb574114290 con 0x7fb5740fc010 2024-04-23T14:46:29.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.572+0000 7fb572000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5740fd2e0 0x7fb57410f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:29.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.572+0000 7fb572000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5740fd2e0 0x7fb57410f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35608/0 (socket says 172.21.15.81:35608) 2024-04-23T14:46:29.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.572+0000 7fb572000640 1 -- 172.21.15.81:0/2619496027 learned_addr learned my addr 172.21.15.81:0/2619496027 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:46:29.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.572+0000 7fb572a00640 1 --2- 172.21.15.81:0/2619496027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5740fc010 0x7fb57410ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:29.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.572+0000 7fb572000640 1 -- 172.21.15.81:0/2619496027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5740fc010 msgr2=0x7fb57410ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:29.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.572+0000 7fb572000640 1 --2- 172.21.15.81:0/2619496027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5740fc010 0x7fb57410ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:29.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.572+0000 7fb572000640 1 -- 172.21.15.81:0/2619496027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb560005040 con 0x7fb5740fd2e0 2024-04-23T14:46:29.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.572+0000 7fb572a00640 1 --2- 172.21.15.81:0/2619496027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5740fc010 0x7fb57410ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:46:29.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.573+0000 7fb572000640 1 --2- 172.21.15.81:0/2619496027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5740fd2e0 0x7fb57410f280 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb560000c00 tx=0x7fb560009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:46:29.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.573+0000 7fb56aa00640 1 -- 172.21.15.81:0/2619496027 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5600094c0 con 0x7fb5740fd2e0 2024-04-23T14:46:29.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.573+0000 7fb56aa00640 1 -- 172.21.15.81:0/2619496027 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb560009620 con 0x7fb5740fd2e0 2024-04-23T14:46:29.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.573+0000 7fb56aa00640 1 -- 172.21.15.81:0/2619496027 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5600435f0 con 0x7fb5740fd2e0 2024-04-23T14:46:29.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.573+0000 7fb573e00640 1 -- 172.21.15.81:0/2619496027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5741143d0 con 0x7fb5740fd2e0 2024-04-23T14:46:29.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.573+0000 7fb573e00640 1 -- 172.21.15.81:0/2619496027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb574114840 con 0x7fb5740fd2e0 2024-04-23T14:46:29.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.574+0000 7fb573e00640 1 -- 172.21.15.81:0/2619496027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb57404bcc0 con 0x7fb5740fd2e0 2024-04-23T14:46:29.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.575+0000 7fb56aa00640 1 -- 172.21.15.81:0/2619496027 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fb56002f070 con 0x7fb5740fd2e0 2024-04-23T14:46:29.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.576+0000 7fb56aa00640 1 --2- 172.21.15.81:0/2619496027 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fb558069220 0x7fb55806b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:29.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.576+0000 7fb56aa00640 1 -- 172.21.15.81:0/2619496027 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fb5600a9240 con 0x7fb5740fd2e0 2024-04-23T14:46:29.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.576+0000 7fb572a00640 1 --2- 172.21.15.81:0/2619496027 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fb558069220 0x7fb55806b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:29.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.577+0000 7fb572a00640 1 --2- 172.21.15.81:0/2619496027 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fb558069220 0x7fb55806b6d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb5640041d0 tx=0x7fb564009040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:46:29.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.580+0000 7fb56aa00640 1 -- 172.21.15.81:0/2619496027 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fb560075400 con 0x7fb5740fd2e0 2024-04-23T14:46:29.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.786+0000 7fb573e00640 1 -- 172.21.15.81:0/2619496027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fb574100be0 con 0x7fb5740fd2e0 2024-04-23T14:46:29.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.787+0000 7fb56aa00640 1 -- 172.21.15.81:0/2619496027 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v47) v1 ==== 107+0+11 (secure 0 0 0) 0x7fb560078a20 con 0x7fb5740fd2e0 2024-04-23T14:46:29.788 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-04-23T14:46:29.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.790+0000 7fb573e00640 1 -- 172.21.15.81:0/2619496027 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fb558069220 msgr2=0x7fb55806b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:29.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.790+0000 7fb573e00640 1 --2- 172.21.15.81:0/2619496027 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fb558069220 0x7fb55806b6d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb5640041d0 tx=0x7fb564009040 comp rx=0 tx=0).stop 2024-04-23T14:46:29.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.790+0000 7fb573e00640 1 -- 172.21.15.81:0/2619496027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5740fd2e0 msgr2=0x7fb57410f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:29.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.790+0000 7fb573e00640 1 --2- 172.21.15.81:0/2619496027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5740fd2e0 0x7fb57410f280 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb560000c00 tx=0x7fb560009da0 comp rx=0 tx=0).stop 2024-04-23T14:46:29.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.790+0000 7fb573e00640 1 -- 172.21.15.81:0/2619496027 shutdown_connections 2024-04-23T14:46:29.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.790+0000 7fb573e00640 1 --2- 172.21.15.81:0/2619496027 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fb558069220 0x7fb55806b6d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:29.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.790+0000 7fb573e00640 1 --2- 172.21.15.81:0/2619496027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5740fd2e0 0x7fb57410f280 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:29.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.790+0000 7fb573e00640 1 --2- 172.21.15.81:0/2619496027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5740fc010 0x7fb57410ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:29.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.790+0000 7fb573e00640 1 -- 172.21.15.81:0/2619496027 >> 172.21.15.81:0/2619496027 conn(0x7fb5740f77b0 msgr2=0x7fb5740f8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:46:29.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.790+0000 7fb573e00640 1 -- 172.21.15.81:0/2619496027 shutdown_connections 2024-04-23T14:46:29.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.790+0000 7fb573e00640 1 -- 172.21.15.81:0/2619496027 wait complete. 2024-04-23T14:46:29.806 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:29 smithi081 ceph-mon[25540]: pgmap v238: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 2 op/s 2024-04-23T14:46:29.806 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:29 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/4124109791' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T14:46:29.806 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:29 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:29.806 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:29 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:29.806 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:29 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/510814268' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T14:46:29.806 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:29 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/648681889' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-23T14:46:29.809 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T14:46:29.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.985+0000 7f5298400640 1 -- 172.21.15.81:0/225070359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52900fc180 msgr2=0x7f52900fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:29.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.985+0000 7f5298400640 1 --2- 172.21.15.81:0/225070359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52900fc180 0x7f52900fc590 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f52840048d0 tx=0x7f5284009da0 comp rx=0 tx=0).stop 2024-04-23T14:46:29.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.985+0000 7f5298400640 1 -- 172.21.15.81:0/225070359 shutdown_connections 2024-04-23T14:46:29.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.985+0000 7f5298400640 1 --2- 172.21.15.81:0/225070359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52900fd450 0x7f52900fd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:29.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.985+0000 7f5298400640 1 --2- 172.21.15.81:0/225070359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52900fc180 0x7f52900fc590 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:29.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.985+0000 7f5298400640 1 -- 172.21.15.81:0/225070359 >> 172.21.15.81:0/225070359 conn(0x7f52900f7960 msgr2=0x7f52900f9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:46:29.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.986+0000 7f5298400640 1 -- 172.21.15.81:0/225070359 shutdown_connections 2024-04-23T14:46:29.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.986+0000 7f5298400640 1 -- 172.21.15.81:0/225070359 wait complete. 2024-04-23T14:46:29.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.986+0000 7f5298400640 1 Processor -- start 2024-04-23T14:46:29.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.986+0000 7f5298400640 1 -- start start 2024-04-23T14:46:29.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.987+0000 7f5298400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52900fc180 0x7f529010eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:29.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.987+0000 7f5298400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52900fd450 0x7f529010f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:29.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.987+0000 7f5298400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529010fa30 con 0x7f52900fc180 2024-04-23T14:46:29.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.987+0000 7f5298400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5290114430 con 0x7f52900fd450 2024-04-23T14:46:29.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.987+0000 7f5295a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52900fc180 0x7f529010eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:29.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.987+0000 7f5295a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52900fc180 0x7f529010eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35634/0 (socket says 172.21.15.81:35634) 2024-04-23T14:46:29.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.987+0000 7f5295a00640 1 -- 172.21.15.81:0/3329184397 learned_addr learned my addr 172.21.15.81:0/3329184397 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:46:29.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.987+0000 7f5295a00640 1 -- 172.21.15.81:0/3329184397 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52900fd450 msgr2=0x7f529010f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:29.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.987+0000 7f5295a00640 1 --2- 172.21.15.81:0/3329184397 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52900fd450 0x7f529010f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:29.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.987+0000 7f5295a00640 1 -- 172.21.15.81:0/3329184397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5284005040 con 0x7f52900fc180 2024-04-23T14:46:29.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.988+0000 7f5295a00640 1 --2- 172.21.15.81:0/3329184397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52900fc180 0x7f529010eea0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5284000c00 tx=0x7f5284009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:46:29.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.988+0000 7f528d600640 1 -- 172.21.15.81:0/3329184397 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52840094c0 con 0x7f52900fc180 2024-04-23T14:46:29.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.988+0000 7f5298400640 1 -- 172.21.15.81:0/3329184397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5290114570 con 0x7f52900fc180 2024-04-23T14:46:29.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.988+0000 7f528d600640 1 -- 172.21.15.81:0/3329184397 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5284009620 con 0x7f52900fc180 2024-04-23T14:46:29.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.988+0000 7f528d600640 1 -- 172.21.15.81:0/3329184397 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5284044630 con 0x7f52900fc180 2024-04-23T14:46:29.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.988+0000 7f5298400640 1 -- 172.21.15.81:0/3329184397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5290114a00 con 0x7f52900fc180 2024-04-23T14:46:29.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.989+0000 7f5298400640 1 -- 172.21.15.81:0/3329184397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5290063f30 con 0x7f52900fc180 2024-04-23T14:46:29.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.990+0000 7f528d600640 1 -- 172.21.15.81:0/3329184397 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f528402f070 con 0x7f52900fc180 2024-04-23T14:46:29.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.991+0000 7f528d600640 1 --2- 172.21.15.81:0/3329184397 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f5278069210 0x7f527806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:29.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.991+0000 7f528d600640 1 -- 172.21.15.81:0/3329184397 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f52840a9770 con 0x7f52900fc180 2024-04-23T14:46:29.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.991+0000 7f5295000640 1 --2- 172.21.15.81:0/3329184397 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f5278069210 0x7f527806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:29.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.992+0000 7f5295000640 1 --2- 172.21.15.81:0/3329184397 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f5278069210 0x7f527806b6c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f52901103a0 tx=0x7f527c007cb0 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:46:29.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:29.996+0000 7f528d600640 1 -- 172.21.15.81:0/3329184397 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f5284075930 con 0x7f52900fc180 2024-04-23T14:46:30.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:30.224+0000 7f5298400640 1 -- 172.21.15.81:0/3329184397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5290100d50 con 0x7f52900fc180 2024-04-23T14:46:30.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:30.226+0000 7f528d600640 1 -- 172.21.15.81:0/3329184397 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4699 (secure 0 0 0) 0x7f5284078f50 con 0x7f52900fc180 2024-04-23T14:46:30.227 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:46:30.228 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24259,"name":"cephfs.smithi156.vynkxn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.156:6827/1794690362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1794690362},{"type":"v1","addr":"172.21.15.156:6827","nonce":1794690362}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":24263,"name":"cephfs.smithi156.rhbtxt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6825/3854041261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3854041261},{"type":"v1","addr":"172.21.15.156:6825","nonce":3854041261}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":17,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T14:45:51.264703+0000","modified":"2024-04-23T14:46:12.782992+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14472":{"gid":14472,"name":"cephfs.smithi081.vcoywg","rank":0,"incarnation":13,"state":"up:active","state_seq":5,"addr":"172.21.15.81:6829/2563365650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2563365650},{"type":"v1","addr":"172.21.15.81:6829","nonce":2563365650}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14482":{"gid":14482,"name":"cephfs.smithi081.wydgcg","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6827/759909104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":759909104},{"type":"v1","addr":"172.21.15.81:6827","nonce":759909104}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-04-23T14:46:30.228 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 18 2024-04-23T14:46:30.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:30.228+0000 7f5298400640 1 -- 172.21.15.81:0/3329184397 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f5278069210 msgr2=0x7f527806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:30.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:30.228+0000 7f5298400640 1 --2- 172.21.15.81:0/3329184397 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f5278069210 0x7f527806b6c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f52901103a0 tx=0x7f527c007cb0 comp rx=0 tx=0).stop 2024-04-23T14:46:30.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:30.228+0000 7f5298400640 1 -- 172.21.15.81:0/3329184397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52900fc180 msgr2=0x7f529010eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:30.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:30.228+0000 7f5298400640 1 --2- 172.21.15.81:0/3329184397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52900fc180 0x7f529010eea0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5284000c00 tx=0x7f5284009da0 comp rx=0 tx=0).stop 2024-04-23T14:46:30.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:30.229+0000 7f5298400640 1 -- 172.21.15.81:0/3329184397 shutdown_connections 2024-04-23T14:46:30.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:30.229+0000 7f5298400640 1 --2- 172.21.15.81:0/3329184397 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f5278069210 0x7f527806b6c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:30.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:30.229+0000 7f5298400640 1 --2- 172.21.15.81:0/3329184397 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52900fd450 0x7f529010f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:30.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:30.229+0000 7f5298400640 1 --2- 172.21.15.81:0/3329184397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52900fc180 0x7f529010eea0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:30.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:30.229+0000 7f5298400640 1 -- 172.21.15.81:0/3329184397 >> 172.21.15.81:0/3329184397 conn(0x7f52900f7960 msgr2=0x7f52900f8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:46:30.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:30.229+0000 7f5298400640 1 -- 172.21.15.81:0/3329184397 shutdown_connections 2024-04-23T14:46:30.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:30.229+0000 7f5298400640 1 -- 172.21.15.81:0/3329184397 wait complete. 2024-04-23T14:46:30.247 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 17, 'max_mds': 1, 'flags': 50} 2024-04-23T14:46:30.248 INFO:teuthology.run_tasks:Running task kclient... 2024-04-23T14:46:30.272 INFO:tasks.kclient:Mounting kernel clients... 2024-04-23T14:46:30.272 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-04-23T14:46:30.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:46:30.273 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-04-23T14:46:30.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:46:30.328 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2024-04-23T14:46:30.418 INFO:teuthology.orchestra.run.smithi081.stderr:Cannot find device "ceph-brx" 2024-04-23T14:46:30.421 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T14:46:30.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:46:30.422 DEBUG:teuthology.orchestra.run.smithi156:> ip netns list 2024-04-23T14:46:30.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:46:30.484 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip link delete ceph-brx 2024-04-23T14:46:30.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:30 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:46:30.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:30 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:46:30.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:30 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:30.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:30 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/2619496027' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-23T14:46:30.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:30 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/3329184397' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:46:30.580 INFO:teuthology.orchestra.run.smithi156.stderr:Cannot find device "ceph-brx" 2024-04-23T14:46:30.584 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T14:46:30.584 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-04-23T14:46:30.584 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-23T14:46:30.584 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-23T14:46:30.585 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph fs ls 2024-04-23T14:46:30.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:30 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:46:30.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:30 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:46:30.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:30 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:46:30.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:30 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/2619496027' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-23T14:46:30.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:30 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/3329184397' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T14:46:31.048 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:46:31.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:31 smithi081 ceph-mon[25540]: pgmap v239: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:46:32.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:31 smithi156 ceph-mon[32341]: pgmap v239: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:46:33.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.477+0000 7f6928400700 1 -- 172.21.15.81:0/2621700780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6920103460 msgr2=0x7f69201038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:33.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.477+0000 7f6928400700 1 --2- 172.21.15.81:0/2621700780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6920103460 0x7f69201038d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f690c004940 tx=0x7f690c009e30 comp rx=0 tx=0).stop 2024-04-23T14:46:33.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.477+0000 7f6928400700 1 -- 172.21.15.81:0/2621700780 shutdown_connections 2024-04-23T14:46:33.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.477+0000 7f6928400700 1 --2- 172.21.15.81:0/2621700780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6920103460 0x7f69201038d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:33.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.477+0000 7f6928400700 1 --2- 172.21.15.81:0/2621700780 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f69201094c0 0x7f6920109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:33.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.477+0000 7f6928400700 1 -- 172.21.15.81:0/2621700780 >> 172.21.15.81:0/2621700780 conn(0x7f6920072c30 msgr2=0x7f6920075040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:46:33.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.477+0000 7f6928400700 1 -- 172.21.15.81:0/2621700780 shutdown_connections 2024-04-23T14:46:33.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.477+0000 7f6928400700 1 -- 172.21.15.81:0/2621700780 wait complete. 2024-04-23T14:46:33.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.478+0000 7f6928400700 1 Processor -- start 2024-04-23T14:46:33.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.478+0000 7f6928400700 1 -- start start 2024-04-23T14:46:33.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.478+0000 7f6928400700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6920103460 0x7f6920119fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:33.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.478+0000 7f6928400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69201094c0 0x7f692011a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:33.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.478+0000 7f6928400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692011abe0 con 0x7f69201094c0 2024-04-23T14:46:33.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.478+0000 7f6928400700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6920114130 con 0x7f6920103460 2024-04-23T14:46:33.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.479+0000 7f6925000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69201094c0 0x7f692011a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:33.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.479+0000 7f6925000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69201094c0 0x7f692011a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35646/0 (socket says 172.21.15.81:35646) 2024-04-23T14:46:33.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.479+0000 7f6925000700 1 -- 172.21.15.81:0/2275600980 learned_addr learned my addr 172.21.15.81:0/2275600980 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:46:33.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.479+0000 7f6925a00700 1 --2- 172.21.15.81:0/2275600980 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6920103460 0x7f6920119fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:33.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.479+0000 7f6925000700 1 -- 172.21.15.81:0/2275600980 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6920103460 msgr2=0x7f6920119fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:33.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.479+0000 7f6925000700 1 --2- 172.21.15.81:0/2275600980 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6920103460 0x7f6920119fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:33.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.479+0000 7f6925000700 1 -- 172.21.15.81:0/2275600980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f690c005040 con 0x7f69201094c0 2024-04-23T14:46:33.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.480+0000 7f6925000700 1 --2- 172.21.15.81:0/2275600980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69201094c0 0x7f692011a500 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f690c009180 tx=0x7f690c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:46:33.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.480+0000 7f691d600700 1 -- 172.21.15.81:0/2275600980 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f690c00e040 con 0x7f69201094c0 2024-04-23T14:46:33.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.480+0000 7f691d600700 1 -- 172.21.15.81:0/2275600980 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f690c00bbc0 con 0x7f69201094c0 2024-04-23T14:46:33.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.480+0000 7f691d600700 1 -- 172.21.15.81:0/2275600980 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f690c01c630 con 0x7f69201094c0 2024-04-23T14:46:33.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.480+0000 7f6928400700 1 -- 172.21.15.81:0/2275600980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6920114350 con 0x7f69201094c0 2024-04-23T14:46:33.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.480+0000 7f6928400700 1 -- 172.21.15.81:0/2275600980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6920114910 con 0x7f69201094c0 2024-04-23T14:46:33.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.481+0000 7f6928400700 1 -- 172.21.15.81:0/2275600980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6920104ba0 con 0x7f69201094c0 2024-04-23T14:46:33.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.483+0000 7f691d600700 1 -- 172.21.15.81:0/2275600980 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f690c00bd30 con 0x7f69201094c0 2024-04-23T14:46:33.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.484+0000 7f691d600700 1 --2- 172.21.15.81:0/2275600980 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f69080692a0 0x7f690806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:33.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.484+0000 7f691d600700 1 -- 172.21.15.81:0/2275600980 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f690c088670 con 0x7f69201094c0 2024-04-23T14:46:33.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.484+0000 7f6925a00700 1 --2- 172.21.15.81:0/2275600980 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f69080692a0 0x7f690806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:33.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.485+0000 7f6925a00700 1 --2- 172.21.15.81:0/2275600980 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f69080692a0 0x7f690806b750 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6914006fd0 tx=0x7f6914008040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:46:33.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.488+0000 7f691d600700 1 -- 172.21.15.81:0/2275600980 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f690c058340 con 0x7f69201094c0 2024-04-23T14:46:33.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.750+0000 7f6928400700 1 -- 172.21.15.81:0/2275600980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f692004c710 con 0x7f69201094c0 2024-04-23T14:46:33.752 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:33 smithi081 ceph-mon[25540]: pgmap v240: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:46:33.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.751+0000 7f691d600700 1 -- 172.21.15.81:0/2275600980 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+83 (secure 0 0 0) 0x7f690c057ed0 con 0x7f69201094c0 2024-04-23T14:46:33.753 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-04-23T14:46:33.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.754+0000 7f6928400700 1 -- 172.21.15.81:0/2275600980 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f69080692a0 msgr2=0x7f690806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:33.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.754+0000 7f6928400700 1 --2- 172.21.15.81:0/2275600980 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f69080692a0 0x7f690806b750 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6914006fd0 tx=0x7f6914008040 comp rx=0 tx=0).stop 2024-04-23T14:46:33.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.754+0000 7f6928400700 1 -- 172.21.15.81:0/2275600980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69201094c0 msgr2=0x7f692011a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:33.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.754+0000 7f6928400700 1 --2- 172.21.15.81:0/2275600980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69201094c0 0x7f692011a500 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f690c009180 tx=0x7f690c009e30 comp rx=0 tx=0).stop 2024-04-23T14:46:33.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.754+0000 7f6928400700 1 -- 172.21.15.81:0/2275600980 shutdown_connections 2024-04-23T14:46:33.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.754+0000 7f6928400700 1 --2- 172.21.15.81:0/2275600980 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6920103460 0x7f6920119fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:33.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.754+0000 7f6928400700 1 --2- 172.21.15.81:0/2275600980 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f69080692a0 0x7f690806b750 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:33.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.754+0000 7f6928400700 1 --2- 172.21.15.81:0/2275600980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69201094c0 0x7f692011a500 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:33.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.754+0000 7f6928400700 1 -- 172.21.15.81:0/2275600980 >> 172.21.15.81:0/2275600980 conn(0x7f6920072c30 msgr2=0x7f6920105b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:46:33.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.754+0000 7f6928400700 1 -- 172.21.15.81:0/2275600980 shutdown_connections 2024-04-23T14:46:33.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:33.755+0000 7f6928400700 1 -- 172.21.15.81:0/2275600980 wait complete. 2024-04-23T14:46:34.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:33 smithi156 ceph-mon[32341]: pgmap v240: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:46:34.522 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-23T14:46:34.522 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-23T14:46:34.522 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-04-23T14:46:34.522 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-23T14:46:34.522 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-23T14:46:34.523 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-23T14:46:34.523 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-23T14:46:34.523 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-23T14:46:34.523 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-23T14:46:34.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:46:34.523 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-04-23T14:46:34.579 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-23T14:46:34.579 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-23T14:46:34.579 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-04-23T14:46:34.580 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-04-23T14:46:34.580 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-04-23T14:46:34.580 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-04-23T14:46:34.580 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-23T14:46:34.580 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-04-23T14:46:34.580 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-04-23T14:46:34.580 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-23T14:46:34.580 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-04-23T14:46:34.580 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-04-23T14:46:34.580 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-23T14:46:34.580 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-04-23T14:46:34.580 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-23T14:46:34.580 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-04-23T14:46:34.581 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-23T14:46:34.581 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 41919sec preferred_lft 41919sec 2024-04-23T14:46:34.581 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2024-04-23T14:46:34.581 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-04-23T14:46:34.582 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-23T14:46:34.582 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T14:46:34.582 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-04-23T14:46:34.582 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add name ceph-brx type bridge 2024-04-23T14:46:34.582 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr flush dev ceph-brx 2024-04-23T14:46:34.582 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set ceph-brx up 2024-04-23T14:46:34.583 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-23T14:46:34.583 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-04-23T14:46:34.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T14:46:34.707 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:34 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/2275600980' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-23T14:46:35.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:34 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/2275600980' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-23T14:46:35.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T14:46:35.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:46:35.050 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-23T14:46:35.119 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-04-23T14:46:35.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:46:35.123 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-04-23T14:46:35.187 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-04-23T14:46:35.187 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-23T14:46:35.187 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-23T14:46:35.187 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-23T14:46:35.187 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-23T14:46:35.188 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T14:46:35.188 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-04-23T14:46:35.188 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-23T14:46:35.188 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-23T14:46:35.188 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-23T14:46:35.188 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-04-23T14:46:35.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T14:46:35.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:35 smithi081 ceph-mon[25540]: pgmap v241: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-23T14:46:35.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T14:46:35.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:46:35.950 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-04-23T14:46:36.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:46:36.002 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2024-04-23T14:46:36.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:35 smithi156 ceph-mon[32341]: pgmap v241: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-23T14:46:36.052 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T14:46:36.052 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-04-23T14:46:36.052 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-23T14:46:36.053 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-23T14:46:36.053 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-04-23T14:46:36.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T14:46:36.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T14:46:36.239 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-23T14:46:36.240 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T14:46:36.240 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-04-23T14:46:36.240 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-23T14:46:36.240 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-23T14:46:36.240 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-23T14:46:36.240 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-23T14:46:36.240 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-23T14:46:36.240 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-04-23T14:46:36.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T14:46:36.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T14:46:36.538 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T14:46:36.539 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-04-23T14:46:36.539 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-04-23T14:46:36.539 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.0 master ceph-brx 2024-04-23T14:46:36.539 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-04-23T14:46:36.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T14:46:36.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T14:46:36.736 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-23T14:46:36.736 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-23T14:46:36.780 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-23T14:46:36.780 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-23T14:46:36.780 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-23T14:46:36.872 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-23T14:46:36.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:46:36.873 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-23T14:46:36.985 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-23T14:46:36.985 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-23T14:46:36.985 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-04-23T14:46:37.683 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-23T14:46:37.684 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-23T14:46:37.684 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-04-23T14:46:37.684 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.156:3300" 2024-04-23T14:46:37.684 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-23T14:46:37.722 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-23T14:46:37.722 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-23T14:46:37.722 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-04-23T14:46:37.722 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.156:3300" 2024-04-23T14:46:37.722 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-23T14:46:37.722 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.156:6789" 2024-04-23T14:46:37.722 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.156:6789:/ 2024-04-23T14:46:37.722 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=7a641bea-017e-11ef-bc93-c7b262605968" will pass to kernel 2024-04-23T14:46:37.726 INFO:teuthology.orchestra.run.smithi081.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-23T14:46:37.726 INFO:teuthology.orchestra.run.smithi081.stdout: You just mounted a file system that supports labels which does not 2024-04-23T14:46:37.726 INFO:teuthology.orchestra.run.smithi081.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-23T14:46:37.726 INFO:teuthology.orchestra.run.smithi081.stdout: applications will generate AVC messages and not be allowed access to 2024-04-23T14:46:37.726 INFO:teuthology.orchestra.run.smithi081.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-23T14:46:37.731 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-23T14:46:37.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:46:37.732 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-23T14:46:37.815 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-23T14:46:37.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:37 smithi081 ceph-mon[25540]: pgmap v242: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:46:37.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-23T14:46:37.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T14:46:37.954 INFO:teuthology.orchestra.run.smithi081.stdout:client14524 2024-04-23T14:46:37.955 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-23T14:46:37.955 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-23T14:46:38.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:37 smithi156 ceph-mon[32341]: pgmap v242: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:46:38.054 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-23T14:46:38.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-23T14:46:38.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T14:46:38.188 INFO:teuthology.orchestra.run.smithi081.stdout:client14524 2024-04-23T14:46:38.189 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-23T14:46:38.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-23T14:46:38.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T14:46:38.309 INFO:teuthology.orchestra.run.smithi081.stdout:client14524 2024-04-23T14:46:38.310 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/7a641bea-017e-11ef-bc93-c7b262605968.client14524/status') 2024-04-23T14:46:38.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T14:46:38.444 INFO:teuthology.orchestra.run.smithi081.stdout:instance: client.14524 (3)192.168.0.1:0/2829014833 2024-04-23T14:46:38.444 INFO:teuthology.orchestra.run.smithi081.stdout:blocklisted: false 2024-04-23T14:46:38.444 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records in 2024-04-23T14:46:38.444 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records out 2024-04-23T14:46:38.444 INFO:teuthology.orchestra.run.smithi081.stderr:70 bytes copied, 0.000112114 s, 624 kB/s 2024-04-23T14:46:38.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T14:46:38.457 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-04-23T14:46:38.457 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-23T14:46:38.457 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-23T14:46:38.457 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- ceph fs ls 2024-04-23T14:46:38.930 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:46:39.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:39 smithi156 ceph-mon[32341]: pgmap v243: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-23T14:46:39.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:39 smithi081 ceph-mon[25540]: pgmap v243: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-23T14:46:41.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.274+0000 7f3497800700 1 -- 172.21.15.81:0/2921337075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34901059d0 msgr2=0x7f34900ff090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:41.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.274+0000 7f3497800700 1 --2- 172.21.15.81:0/2921337075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34901059d0 0x7f34900ff090 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f347c004940 tx=0x7f347c009e30 comp rx=0 tx=0).stop 2024-04-23T14:46:41.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.274+0000 7f3497800700 1 -- 172.21.15.81:0/2921337075 shutdown_connections 2024-04-23T14:46:41.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.274+0000 7f3497800700 1 --2- 172.21.15.81:0/2921337075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34901059d0 0x7f34900ff090 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:41.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.274+0000 7f3497800700 1 --2- 172.21.15.81:0/2921337075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3490105030 0x7f3490105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:41.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.274+0000 7f3497800700 1 -- 172.21.15.81:0/2921337075 >> 172.21.15.81:0/2921337075 conn(0x7f34900fabd0 msgr2=0x7f34900fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:46:41.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.275+0000 7f3497800700 1 -- 172.21.15.81:0/2921337075 shutdown_connections 2024-04-23T14:46:41.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.275+0000 7f3497800700 1 -- 172.21.15.81:0/2921337075 wait complete. 2024-04-23T14:46:41.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.275+0000 7f3497800700 1 Processor -- start 2024-04-23T14:46:41.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.276+0000 7f3497800700 1 -- start start 2024-04-23T14:46:41.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.276+0000 7f3497800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3490105030 0x7f3490115b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:41.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.276+0000 7f3497800700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34901059d0 0x7f34901160d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:41.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.276+0000 7f3497800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3490116720 con 0x7f3490105030 2024-04-23T14:46:41.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.276+0000 7f3497800700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349010fd00 con 0x7f34901059d0 2024-04-23T14:46:41.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.276+0000 7f3494e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3490105030 0x7f3490115b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:41.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.276+0000 7f3494e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3490105030 0x7f3490115b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55458/0 (socket says 172.21.15.81:55458) 2024-04-23T14:46:41.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.276+0000 7f3494e00700 1 -- 172.21.15.81:0/1087558077 learned_addr learned my addr 172.21.15.81:0/1087558077 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:46:41.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.277+0000 7f348fe00700 1 --2- 172.21.15.81:0/1087558077 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34901059d0 0x7f34901160d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:41.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.277+0000 7f3494e00700 1 -- 172.21.15.81:0/1087558077 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34901059d0 msgr2=0x7f34901160d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:41.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.277+0000 7f3494e00700 1 --2- 172.21.15.81:0/1087558077 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34901059d0 0x7f34901160d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:41.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.277+0000 7f3494e00700 1 -- 172.21.15.81:0/1087558077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f347c005040 con 0x7f3490105030 2024-04-23T14:46:41.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.277+0000 7f348fe00700 1 --2- 172.21.15.81:0/1087558077 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34901059d0 0x7f34901160d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:46:41.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.277+0000 7f3494e00700 1 --2- 172.21.15.81:0/1087558077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3490105030 0x7f3490115b90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3484002a50 tx=0x7f34840046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:46:41.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.277+0000 7f348cc00700 1 -- 172.21.15.81:0/1087558077 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3484007cc0 con 0x7f3490105030 2024-04-23T14:46:41.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.278+0000 7f348cc00700 1 -- 172.21.15.81:0/1087558077 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f348400f040 con 0x7f3490105030 2024-04-23T14:46:41.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.278+0000 7f348cc00700 1 -- 172.21.15.81:0/1087558077 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3484009640 con 0x7f3490105030 2024-04-23T14:46:41.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.278+0000 7f3497800700 1 -- 172.21.15.81:0/1087558077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f349010ffe0 con 0x7f3490105030 2024-04-23T14:46:41.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.278+0000 7f3497800700 1 -- 172.21.15.81:0/1087558077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34901105a0 con 0x7f3490105030 2024-04-23T14:46:41.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.279+0000 7f3497800700 1 -- 172.21.15.81:0/1087558077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3490100780 con 0x7f3490105030 2024-04-23T14:46:41.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.280+0000 7f348cc00700 1 -- 172.21.15.81:0/1087558077 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f34840097a0 con 0x7f3490105030 2024-04-23T14:46:41.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.281+0000 7f348cc00700 1 --2- 172.21.15.81:0/1087558077 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f34780692a0 0x7f347806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:41.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.281+0000 7f348cc00700 1 -- 172.21.15.81:0/1087558077 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f3484086c90 con 0x7f3490105030 2024-04-23T14:46:41.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.281+0000 7f348fe00700 1 --2- 172.21.15.81:0/1087558077 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f34780692a0 0x7f347806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:41.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.282+0000 7f348fe00700 1 --2- 172.21.15.81:0/1087558077 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f34780692a0 0x7f347806b750 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f347c000c00 tx=0x7f347c009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:46:41.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.286+0000 7f348cc00700 1 -- 172.21.15.81:0/1087558077 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3484056a00 con 0x7f3490105030 2024-04-23T14:46:41.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.548+0000 7f3497800700 1 -- 172.21.15.81:0/1087558077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f34901111e0 con 0x7f3490105030 2024-04-23T14:46:41.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.549+0000 7f348cc00700 1 -- 172.21.15.81:0/1087558077 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+83 (secure 0 0 0) 0x7f3484056590 con 0x7f3490105030 2024-04-23T14:46:41.550 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-04-23T14:46:41.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.552+0000 7f3497800700 1 -- 172.21.15.81:0/1087558077 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f34780692a0 msgr2=0x7f347806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:41.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.552+0000 7f3497800700 1 --2- 172.21.15.81:0/1087558077 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f34780692a0 0x7f347806b750 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f347c000c00 tx=0x7f347c009e30 comp rx=0 tx=0).stop 2024-04-23T14:46:41.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.552+0000 7f3497800700 1 -- 172.21.15.81:0/1087558077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3490105030 msgr2=0x7f3490115b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:41.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.552+0000 7f3497800700 1 --2- 172.21.15.81:0/1087558077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3490105030 0x7f3490115b90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3484002a50 tx=0x7f34840046b0 comp rx=0 tx=0).stop 2024-04-23T14:46:41.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.552+0000 7f3497800700 1 -- 172.21.15.81:0/1087558077 shutdown_connections 2024-04-23T14:46:41.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.552+0000 7f3497800700 1 --2- 172.21.15.81:0/1087558077 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f34780692a0 0x7f347806b750 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:41.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.552+0000 7f3497800700 1 --2- 172.21.15.81:0/1087558077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3490105030 0x7f3490115b90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:41.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.552+0000 7f3497800700 1 --2- 172.21.15.81:0/1087558077 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34901059d0 0x7f34901160d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:41.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.552+0000 7f3497800700 1 -- 172.21.15.81:0/1087558077 >> 172.21.15.81:0/1087558077 conn(0x7f34900fabd0 msgr2=0x7f34900fbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:46:41.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.553+0000 7f3497800700 1 -- 172.21.15.81:0/1087558077 shutdown_connections 2024-04-23T14:46:41.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:41.553+0000 7f3497800700 1 -- 172.21.15.81:0/1087558077 wait complete. 2024-04-23T14:46:41.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:41 smithi081 ceph-mon[25540]: pgmap v244: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:46:41.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:41 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/1087558077' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-23T14:46:42.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:41 smithi156 ceph-mon[32341]: pgmap v244: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:46:42.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:41 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/1087558077' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-23T14:46:42.481 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-23T14:46:42.482 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-23T14:46:42.482 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi156.front.sepia.ceph.com 2024-04-23T14:46:42.482 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-23T14:46:42.482 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-23T14:46:42.482 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-23T14:46:42.482 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-23T14:46:42.482 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-23T14:46:42.482 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-23T14:46:42.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:46:42.482 DEBUG:teuthology.orchestra.run.smithi156:> ip addr 2024-04-23T14:46:42.541 INFO:teuthology.orchestra.run.smithi156.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-23T14:46:42.541 INFO:teuthology.orchestra.run.smithi156.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-23T14:46:42.541 INFO:teuthology.orchestra.run.smithi156.stdout: inet 127.0.0.1/8 scope host lo 2024-04-23T14:46:42.541 INFO:teuthology.orchestra.run.smithi156.stdout: valid_lft forever preferred_lft forever 2024-04-23T14:46:42.541 INFO:teuthology.orchestra.run.smithi156.stdout: inet6 ::1/128 scope host 2024-04-23T14:46:42.541 INFO:teuthology.orchestra.run.smithi156.stdout: valid_lft forever preferred_lft forever 2024-04-23T14:46:42.541 INFO:teuthology.orchestra.run.smithi156.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-23T14:46:42.542 INFO:teuthology.orchestra.run.smithi156.stdout: link/ether 0c:c4:7a:da:6a:c0 brd ff:ff:ff:ff:ff:ff 2024-04-23T14:46:42.542 INFO:teuthology.orchestra.run.smithi156.stdout: altname enp7s0f0 2024-04-23T14:46:42.542 INFO:teuthology.orchestra.run.smithi156.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-23T14:46:42.542 INFO:teuthology.orchestra.run.smithi156.stdout: link/ether 0c:c4:7a:da:6a:c1 brd ff:ff:ff:ff:ff:ff 2024-04-23T14:46:42.542 INFO:teuthology.orchestra.run.smithi156.stdout: altname enp7s0f1 2024-04-23T14:46:42.542 INFO:teuthology.orchestra.run.smithi156.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-23T14:46:42.542 INFO:teuthology.orchestra.run.smithi156.stdout: link/ether 0c:c4:7a:88:6d:fc brd ff:ff:ff:ff:ff:ff 2024-04-23T14:46:42.542 INFO:teuthology.orchestra.run.smithi156.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-23T14:46:42.542 INFO:teuthology.orchestra.run.smithi156.stdout: link/ether 0c:c4:7a:88:6d:fd brd ff:ff:ff:ff:ff:ff 2024-04-23T14:46:42.542 INFO:teuthology.orchestra.run.smithi156.stdout: inet 172.21.15.156/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-23T14:46:42.542 INFO:teuthology.orchestra.run.smithi156.stdout: valid_lft 41892sec preferred_lft 41892sec 2024-04-23T14:46:42.542 INFO:teuthology.orchestra.run.smithi156.stdout: inet6 fe80::ec4:7aff:fe88:6dfd/64 scope link 2024-04-23T14:46:42.542 INFO:teuthology.orchestra.run.smithi156.stdout: valid_lft forever preferred_lft forever 2024-04-23T14:46:42.543 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-23T14:46:42.544 DEBUG:teuthology.orchestra.run.smithi156:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T14:46:42.544 DEBUG:teuthology.orchestra.run.smithi156:> set -e 2024-04-23T14:46:42.544 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip link add name ceph-brx type bridge 2024-04-23T14:46:42.544 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip addr flush dev ceph-brx 2024-04-23T14:46:42.544 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip link set ceph-brx up 2024-04-23T14:46:42.544 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-23T14:46:42.544 DEBUG:teuthology.orchestra.run.smithi156:> ') 2024-04-23T14:46:42.653 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:46:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T14:46:42.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:42 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:46:42.924 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:42 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:46:43.023 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:46:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T14:46:43.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:46:43.033 DEBUG:teuthology.orchestra.run.smithi156:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-23T14:46:43.099 INFO:teuthology.orchestra.run.smithi156.stdout:1 2024-04-23T14:46:43.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:46:43.103 DEBUG:teuthology.orchestra.run.smithi156:> route 2024-04-23T14:46:43.152 INFO:teuthology.orchestra.run.smithi156.stdout:Kernel IP routing table 2024-04-23T14:46:43.153 INFO:teuthology.orchestra.run.smithi156.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-23T14:46:43.153 INFO:teuthology.orchestra.run.smithi156.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-23T14:46:43.153 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-23T14:46:43.153 INFO:teuthology.orchestra.run.smithi156.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-23T14:46:43.154 DEBUG:teuthology.orchestra.run.smithi156:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T14:46:43.154 DEBUG:teuthology.orchestra.run.smithi156:> set -e 2024-04-23T14:46:43.154 DEBUG:teuthology.orchestra.run.smithi156:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-23T14:46:43.154 DEBUG:teuthology.orchestra.run.smithi156:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-23T14:46:43.154 DEBUG:teuthology.orchestra.run.smithi156:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-23T14:46:43.154 DEBUG:teuthology.orchestra.run.smithi156:> ') 2024-04-23T14:46:43.248 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:46:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T14:46:43.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:43 smithi156 ceph-mon[32341]: pgmap v245: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-23T14:46:43.881 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:46:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T14:46:43.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:46:43.890 DEBUG:teuthology.orchestra.run.smithi156:> ip netns list 2024-04-23T14:46:43.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:46:43.933 DEBUG:teuthology.orchestra.run.smithi156:> ip netns list-id 2024-04-23T14:46:44.022 DEBUG:teuthology.orchestra.run.smithi156:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T14:46:44.022 DEBUG:teuthology.orchestra.run.smithi156:> set -e 2024-04-23T14:46:44.022 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-23T14:46:44.022 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-23T14:46:44.022 DEBUG:teuthology.orchestra.run.smithi156:> ') 2024-04-23T14:46:44.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:43 smithi081 ceph-mon[25540]: pgmap v245: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-23T14:46:44.120 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:46:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T14:46:44.186 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:46:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T14:46:44.195 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-23T14:46:44.196 DEBUG:teuthology.orchestra.run.smithi156:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T14:46:44.196 DEBUG:teuthology.orchestra.run.smithi156:> set -e 2024-04-23T14:46:44.196 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-23T14:46:44.196 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-23T14:46:44.196 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-23T14:46:44.196 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-23T14:46:44.196 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-23T14:46:44.196 DEBUG:teuthology.orchestra.run.smithi156:> ') 2024-04-23T14:46:44.294 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:46:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T14:46:44.471 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:46:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T14:46:44.479 DEBUG:teuthology.orchestra.run.smithi156:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T14:46:44.480 DEBUG:teuthology.orchestra.run.smithi156:> set -e 2024-04-23T14:46:44.480 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip link set brx.0 up 2024-04-23T14:46:44.480 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip link set dev brx.0 master ceph-brx 2024-04-23T14:46:44.480 DEBUG:teuthology.orchestra.run.smithi156:> ') 2024-04-23T14:46:44.564 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:46:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T14:46:44.653 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:46:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T14:46:44.662 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-23T14:46:44.662 DEBUG:teuthology.orchestra.run.smithi156:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-23T14:46:44.703 INFO:teuthology.orchestra.run.smithi156.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-23T14:46:44.704 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-23T14:46:44.704 DEBUG:teuthology.orchestra.run.smithi156:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-23T14:46:44.795 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-23T14:46:44.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:46:44.796 DEBUG:teuthology.orchestra.run.smithi156:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-23T14:46:44.907 INFO:teuthology.orchestra.run.smithi156.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-23T14:46:44.907 INFO:teuthology.orchestra.run.smithi156.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-23T14:46:44.908 INFO:teuthology.orchestra.run.smithi156.stdout:invalid new device string format 2024-04-23T14:46:45.627 INFO:teuthology.orchestra.run.smithi156.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-23T14:46:45.627 INFO:teuthology.orchestra.run.smithi156.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-23T14:46:45.628 INFO:teuthology.orchestra.run.smithi156.stdout:invalid new device string format 2024-04-23T14:46:45.628 INFO:teuthology.orchestra.run.smithi156.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.156:3300" 2024-04-23T14:46:45.628 INFO:teuthology.orchestra.run.smithi156.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-23T14:46:45.664 INFO:teuthology.orchestra.run.smithi156.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-23T14:46:45.664 INFO:teuthology.orchestra.run.smithi156.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-23T14:46:45.664 INFO:teuthology.orchestra.run.smithi156.stdout:invalid new device string format 2024-04-23T14:46:45.664 INFO:teuthology.orchestra.run.smithi156.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.156:3300" 2024-04-23T14:46:45.664 INFO:teuthology.orchestra.run.smithi156.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-23T14:46:45.664 INFO:teuthology.orchestra.run.smithi156.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.156:6789" 2024-04-23T14:46:45.664 INFO:teuthology.orchestra.run.smithi156.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.156:6789:/ 2024-04-23T14:46:45.664 INFO:teuthology.orchestra.run.smithi156.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=7a641bea-017e-11ef-bc93-c7b262605968" will pass to kernel 2024-04-23T14:46:45.671 INFO:teuthology.orchestra.run.smithi156.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-04-23T14:46:45.671 INFO:teuthology.orchestra.run.smithi156.stdout: You just mounted a file system that supports labels which does not 2024-04-23T14:46:45.671 INFO:teuthology.orchestra.run.smithi156.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-23T14:46:45.672 INFO:teuthology.orchestra.run.smithi156.stdout: applications will generate AVC messages and not be allowed access to 2024-04-23T14:46:45.672 INFO:teuthology.orchestra.run.smithi156.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-23T14:46:45.676 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-23T14:46:45.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T14:46:45.676 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-23T14:46:45.755 DEBUG:teuthology.orchestra.run.smithi156:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-23T14:46:45.866 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:46:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-23T14:46:45.873 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:46:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T14:46:45.883 INFO:teuthology.orchestra.run.smithi156.stdout:client14530 2024-04-23T14:46:45.883 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-04-23T14:46:45.883 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-23T14:46:45.939 DEBUG:teuthology.orchestra.run.smithi156:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-23T14:46:46.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:45 smithi156 ceph-mon[32341]: pgmap v246: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 937 B/s rd, 255 B/s wr, 1 op/s 2024-04-23T14:46:46.042 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:46:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-23T14:46:46.048 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:46:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T14:46:46.057 INFO:teuthology.orchestra.run.smithi156.stdout:client14530 2024-04-23T14:46:46.058 DEBUG:teuthology.orchestra.run.smithi156:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-23T14:46:46.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:45 smithi081 ceph-mon[25540]: pgmap v246: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 937 B/s rd, 255 B/s wr, 1 op/s 2024-04-23T14:46:46.164 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:46:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-23T14:46:46.169 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:46:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T14:46:46.178 INFO:teuthology.orchestra.run.smithi156.stdout:client14530 2024-04-23T14:46:46.178 DEBUG:teuthology.orchestra.run.smithi156:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/7a641bea-017e-11ef-bc93-c7b262605968.client14530/status') 2024-04-23T14:46:46.281 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:46:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T14:46:46.310 INFO:teuthology.orchestra.run.smithi156.stdout:instance: client.14530 (3)172.21.15.156:0/596389174 2024-04-23T14:46:46.310 INFO:teuthology.orchestra.run.smithi156.stdout:blocklisted: false 2024-04-23T14:46:46.310 INFO:teuthology.orchestra.run.smithi156.stderr:0+1 records in 2024-04-23T14:46:46.310 INFO:teuthology.orchestra.run.smithi156.stderr:0+1 records out 2024-04-23T14:46:46.310 INFO:teuthology.orchestra.run.smithi156.stderr:71 bytes copied, 0.00010204 s, 696 kB/s 2024-04-23T14:46:46.313 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-23T14:46:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T14:46:46.323 INFO:teuthology.run_tasks:Running task print... 2024-04-23T14:46:46.335 INFO:teuthology.task.print:**** done client 2024-04-23T14:46:46.335 INFO:teuthology.run_tasks:Running task parallel... 2024-04-23T14:46:46.368 INFO:teuthology.task.parallel:starting parallel... 2024-04-23T14:46:46.368 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-04-23T14:46:46.369 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-23T14:46:46.369 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi081.front.sepia.ceph.com 2024-04-23T14:46:46.369 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -e sha1=d44fddd910b5e94da0f2357af4be37d7bd495ae0 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs false || true' 2024-04-23T14:46:46.370 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-04-23T14:46:46.370 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-04-23T14:46:46.374 INFO:tasks.workunit:Pulling workunits from ref d44fddd910b5e94da0f2357af4be37d7bd495ae0 2024-04-23T14:46:46.374 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-23T14:46:46.374 INFO:tasks.workunit:timeout=3h 2024-04-23T14:46:46.374 INFO:tasks.workunit:cleanup=True 2024-04-23T14:46:46.374 DEBUG:teuthology.orchestra.run.smithi081:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-23T14:46:46.430 INFO:teuthology.orchestra.run.smithi081.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-23T14:46:46.430 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-04-23T14:46:46.430 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 90h/144d Inode: 1 Links: 2 2024-04-23T14:46:46.430 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T14:46:46.430 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-04-23T14:46:46.430 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-23T14:46:46.431 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-04-23 14:45:56.315557417 +0000 2024-04-23T14:46:46.431 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-04-23 14:46:37.807523866 +0000 2024-04-23T14:46:46.431 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-04-23 14:45:56.315557417 +0000 2024-04-23T14:46:46.431 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-23T14:46:46.431 DEBUG:teuthology.orchestra.run.smithi081:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-23T14:46:46.556 DEBUG:teuthology.orchestra.run.smithi156:> stat -- /home/ubuntu/cephtest/mnt.1 2024-04-23T14:46:46.617 INFO:teuthology.orchestra.run.smithi156.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-04-23T14:46:46.617 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2024-04-23T14:46:46.617 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 6fh/111d Inode: 1 Links: 3 2024-04-23T14:46:46.617 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T14:46:46.617 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-04-23T14:46:46.617 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-23T14:46:46.617 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2024-04-23 14:46:46.543345333 +0000 2024-04-23T14:46:46.617 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2024-04-23 14:46:46.543345333 +0000 2024-04-23T14:46:46.617 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: 2024-04-23 14:45:56.315557417 +0000 2024-04-23T14:46:46.617 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-04-23T14:46:46.617 DEBUG:teuthology.orchestra.run.smithi156:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-04-23T14:46:46.714 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d44fddd910b5e94da0f2357af4be37d7bd495ae0 2024-04-23T14:46:46.714 DEBUG:teuthology.orchestra.run.smithi156:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout d44fddd910b5e94da0f2357af4be37d7bd495ae0 2024-04-23T14:46:46.757 INFO:tasks.workunit.client.0.smithi081.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-23T14:46:46.771 INFO:tasks.workunit.client.1.smithi156.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-04-23T14:46:46.837 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:46:47.867 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:47 smithi081 ceph-mon[25540]: pgmap v247: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-23T14:46:48.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:47 smithi156 ceph-mon[32341]: pgmap v247: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-23T14:46:49.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:49.087+0000 7f3517600700 1 -- 172.21.15.81:0/614096271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3510066290 msgr2=0x7f3510101e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:49.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:49.087+0000 7f3517600700 1 --2- 172.21.15.81:0/614096271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3510066290 0x7f3510101e90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3500004940 tx=0x7f3500009e30 comp rx=0 tx=0).stop 2024-04-23T14:46:49.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:49.087+0000 7f3517600700 1 -- 172.21.15.81:0/614096271 shutdown_connections 2024-04-23T14:46:49.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:49.087+0000 7f3517600700 1 --2- 172.21.15.81:0/614096271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35101023d0 0x7f35101047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:49.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:49.087+0000 7f3517600700 1 --2- 172.21.15.81:0/614096271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3510066290 0x7f3510101e90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:49.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:49.087+0000 7f3517600700 1 -- 172.21.15.81:0/614096271 >> 172.21.15.81:0/614096271 conn(0x7f35100f74c0 msgr2=0x7f35100f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:46:49.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:49.087+0000 7f3517600700 1 -- 172.21.15.81:0/614096271 shutdown_connections 2024-04-23T14:46:49.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:49.087+0000 7f3517600700 1 -- 172.21.15.81:0/614096271 wait complete. 2024-04-23T14:46:49.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:49.088+0000 7f3517600700 1 Processor -- start 2024-04-23T14:46:49.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:49.088+0000 7f3517600700 1 -- start start 2024-04-23T14:46:49.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:49.088+0000 7f3517600700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3510066290 0x7f351010fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:49.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:49.088+0000 7f3517600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35101023d0 0x7f35101102a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:49.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:49.088+0000 7f3517600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3510110f60 con 0x7f35101023d0 2024-04-23T14:46:49.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:49.088+0000 7f3517600700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35101110d0 con 0x7f3510066290 2024-04-23T14:46:49.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:49.089+0000 7f3507e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35101023d0 0x7f35101102a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:49.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:49.089+0000 7f3507e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35101023d0 0x7f35101102a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51288/0 (socket says 172.21.15.81:51288) 2024-04-23T14:46:49.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:49.089+0000 7f3507e00700 1 -- 172.21.15.81:0/2452315996 learned_addr learned my addr 172.21.15.81:0/2452315996 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:46:49.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:49.089+0000 7f3514c00700 1 --2- 172.21.15.81:0/2452315996 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3510066290 0x7f351010fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:49.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:49.089+0000 7f3507e00700 1 -- 172.21.15.81:0/2452315996 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3510066290 msgr2=0x7f351010fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:49.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:49.089+0000 7f3507e00700 1 --2- 172.21.15.81:0/2452315996 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3510066290 0x7f351010fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:49.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:49.089+0000 7f3507e00700 1 -- 172.21.15.81:0/2452315996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3500005040 con 0x7f35101023d0 2024-04-23T14:46:49.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:49.089+0000 7f3507e00700 1 --2- 172.21.15.81:0/2452315996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35101023d0 0x7f35101102a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f34fc00b790 tx=0x7f34fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:46:49.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:49.090+0000 7f350d600700 1 -- 172.21.15.81:0/2452315996 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34fc00f770 con 0x7f35101023d0 2024-04-23T14:46:49.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:49.090+0000 7f350d600700 1 -- 172.21.15.81:0/2452315996 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f34fc00fda0 con 0x7f35101023d0 2024-04-23T14:46:49.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:49.090+0000 7f350d600700 1 -- 172.21.15.81:0/2452315996 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34fc00d310 con 0x7f35101023d0 2024-04-23T14:46:49.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:49.090+0000 7f3517600700 1 -- 172.21.15.81:0/2452315996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35101113b0 con 0x7f35101023d0 2024-04-23T14:46:49.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:49.090+0000 7f3517600700 1 -- 172.21.15.81:0/2452315996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3510111970 con 0x7f35101023d0 2024-04-23T14:46:49.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:49.091+0000 7f3517600700 1 -- 172.21.15.81:0/2452315996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f351005f5f0 con 0x7f35101023d0 2024-04-23T14:46:49.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:49.092+0000 7f350d600700 1 -- 172.21.15.81:0/2452315996 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f34fc010420 con 0x7f35101023d0 2024-04-23T14:46:49.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:49.093+0000 7f350d600700 1 --2- 172.21.15.81:0/2452315996 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f34f40692b0 0x7f34f406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:49.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:49.093+0000 7f350d600700 1 -- 172.21.15.81:0/2452315996 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f34fc0871c0 con 0x7f35101023d0 2024-04-23T14:46:49.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:49.093+0000 7f3514c00700 1 --2- 172.21.15.81:0/2452315996 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f34f40692b0 0x7f34f406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:49.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:49.094+0000 7f3514c00700 1 --2- 172.21.15.81:0/2452315996 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f34f40692b0 0x7f34f406b760 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f350000b3b0 tx=0x7f3500009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:46:49.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:49.097+0000 7f350d600700 1 -- 172.21.15.81:0/2452315996 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f34fc056f10 con 0x7f35101023d0 2024-04-23T14:46:49.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:49.310+0000 7f3517600700 1 -- 172.21.15.81:0/2452315996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f351004bed0 con 0x7f35101023d0 2024-04-23T14:46:49.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:49.310+0000 7f350d600700 1 -- 172.21.15.81:0/2452315996 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21)=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21) v1 ==== 179+0+0 (secure 0 0 0) 0x7f34fc056aa0 con 0x7f35101023d0 2024-04-23T14:46:49.313 INFO:teuthology.orchestra.run.smithi081.stderr:Error EINVAL: unrecognized config option 'mgr/orchestrator/fail_fs' 2024-04-23T14:46:49.914 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:49 smithi156 ceph-mon[32341]: pgmap v248: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 255 B/s wr, 2 op/s 2024-04-23T14:46:50.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:49 smithi081 ceph-mon[25540]: pgmap v248: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 255 B/s wr, 2 op/s 2024-04-23T14:46:50.219 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-23T14:46:50.219 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi081.front.sepia.ceph.com 2024-04-23T14:46:50.220 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -e sha1=d44fddd910b5e94da0f2357af4be37d7bd495ae0 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-04-23T14:46:50.728 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:46:51.925 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:51 smithi081 ceph-mon[25540]: pgmap v249: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 255 B/s wr, 2 op/s 2024-04-23T14:46:52.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:51 smithi156 ceph-mon[32341]: pgmap v249: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 255 B/s wr, 2 op/s 2024-04-23T14:46:53.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.059+0000 7f73bae00700 1 -- 172.21.15.81:0/1949590587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73b40662f0 msgr2=0x7f73b40ffa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:53.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.059+0000 7f73bae00700 1 --2- 172.21.15.81:0/1949590587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73b40662f0 0x7f73b40ffa30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f73a4004940 tx=0x7f73a4009e30 comp rx=0 tx=0).stop 2024-04-23T14:46:53.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.059+0000 7f73bae00700 1 -- 172.21.15.81:0/1949590587 shutdown_connections 2024-04-23T14:46:53.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.059+0000 7f73bae00700 1 --2- 172.21.15.81:0/1949590587 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73b40fff70 0x7f73b4102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:53.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.059+0000 7f73bae00700 1 --2- 172.21.15.81:0/1949590587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73b40662f0 0x7f73b40ffa30 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:53.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.059+0000 7f73bae00700 1 -- 172.21.15.81:0/1949590587 >> 172.21.15.81:0/1949590587 conn(0x7f73b40f74c0 msgr2=0x7f73b40f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:46:53.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.059+0000 7f73bae00700 1 -- 172.21.15.81:0/1949590587 shutdown_connections 2024-04-23T14:46:53.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.060+0000 7f73bae00700 1 -- 172.21.15.81:0/1949590587 wait complete. 2024-04-23T14:46:53.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.061+0000 7f73bae00700 1 Processor -- start 2024-04-23T14:46:53.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.061+0000 7f73bae00700 1 -- start start 2024-04-23T14:46:53.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.061+0000 7f73bae00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73b40662f0 0x7f73b410fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:53.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.061+0000 7f73bae00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73b40fff70 0x7f73b4110190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:53.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.062+0000 7f73bae00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b4110790 con 0x7f73b40662f0 2024-04-23T14:46:53.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.062+0000 7f73bae00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b4110fe0 con 0x7f73b40fff70 2024-04-23T14:46:53.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.062+0000 7f73b3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73b40662f0 0x7f73b410fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:53.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.062+0000 7f73b3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73b40662f0 0x7f73b410fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51308/0 (socket says 172.21.15.81:51308) 2024-04-23T14:46:53.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.062+0000 7f73b3e00700 1 -- 172.21.15.81:0/2324620426 learned_addr learned my addr 172.21.15.81:0/2324620426 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:46:53.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.062+0000 7f73b3e00700 1 -- 172.21.15.81:0/2324620426 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73b40fff70 msgr2=0x7f73b4110190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:53.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.062+0000 7f73b3e00700 1 --2- 172.21.15.81:0/2324620426 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73b40fff70 0x7f73b4110190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:53.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.062+0000 7f73b3e00700 1 -- 172.21.15.81:0/2324620426 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a4005040 con 0x7f73b40662f0 2024-04-23T14:46:53.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.063+0000 7f73b3e00700 1 --2- 172.21.15.81:0/2324620426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73b40662f0 0x7f73b410fc50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f73a400b970 tx=0x7f73a4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:46:53.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.063+0000 7f73abe00700 1 -- 172.21.15.81:0/2324620426 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73a400e040 con 0x7f73b40662f0 2024-04-23T14:46:53.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.063+0000 7f73abe00700 1 -- 172.21.15.81:0/2324620426 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f73a4004290 con 0x7f73b40662f0 2024-04-23T14:46:53.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.063+0000 7f73bae00700 1 -- 172.21.15.81:0/2324620426 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73b4111260 con 0x7f73b40662f0 2024-04-23T14:46:53.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.063+0000 7f73abe00700 1 -- 172.21.15.81:0/2324620426 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73a401c630 con 0x7f73b40662f0 2024-04-23T14:46:53.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.063+0000 7f73bae00700 1 -- 172.21.15.81:0/2324620426 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73b41117a0 con 0x7f73b40662f0 2024-04-23T14:46:53.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.064+0000 7f73bae00700 1 -- 172.21.15.81:0/2324620426 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73b405f5f0 con 0x7f73b40662f0 2024-04-23T14:46:53.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.065+0000 7f73abe00700 1 -- 172.21.15.81:0/2324620426 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f73a400bbf0 con 0x7f73b40662f0 2024-04-23T14:46:53.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.066+0000 7f73abe00700 1 --2- 172.21.15.81:0/2324620426 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f73980692b0 0x7f739806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:53.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.066+0000 7f73abe00700 1 -- 172.21.15.81:0/2324620426 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f73a4088690 con 0x7f73b40662f0 2024-04-23T14:46:53.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.066+0000 7f73b3400700 1 --2- 172.21.15.81:0/2324620426 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f73980692b0 0x7f739806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:53.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.067+0000 7f73b3400700 1 --2- 172.21.15.81:0/2324620426 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f73980692b0 0x7f739806b760 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f73a0004d00 tx=0x7f73a0009ce0 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:46:53.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.071+0000 7f73abe00700 1 -- 172.21.15.81:0/2324620426 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f73a4058360 con 0x7f73b40662f0 2024-04-23T14:46:53.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.281+0000 7f73bae00700 1 -- 172.21.15.81:0/2324620426 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f73b404bed0 con 0x7f73b40662f0 2024-04-23T14:46:53.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.282+0000 7f73abe00700 1 -- 172.21.15.81:0/2324620426 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7f73a4013e60 con 0x7f73b40662f0 2024-04-23T14:46:53.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.284+0000 7f73bae00700 1 -- 172.21.15.81:0/2324620426 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f73980692b0 msgr2=0x7f739806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:53.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.284+0000 7f73bae00700 1 --2- 172.21.15.81:0/2324620426 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f73980692b0 0x7f739806b760 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f73a0004d00 tx=0x7f73a0009ce0 comp rx=0 tx=0).stop 2024-04-23T14:46:53.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.284+0000 7f73bae00700 1 -- 172.21.15.81:0/2324620426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73b40662f0 msgr2=0x7f73b410fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:53.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.284+0000 7f73bae00700 1 --2- 172.21.15.81:0/2324620426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73b40662f0 0x7f73b410fc50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f73a400b970 tx=0x7f73a4009e30 comp rx=0 tx=0).stop 2024-04-23T14:46:53.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.285+0000 7f73bae00700 1 -- 172.21.15.81:0/2324620426 shutdown_connections 2024-04-23T14:46:53.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.285+0000 7f73bae00700 1 --2- 172.21.15.81:0/2324620426 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f73980692b0 0x7f739806b760 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:53.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.285+0000 7f73bae00700 1 --2- 172.21.15.81:0/2324620426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73b40662f0 0x7f73b410fc50 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:53.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.285+0000 7f73bae00700 1 --2- 172.21.15.81:0/2324620426 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73b40fff70 0x7f73b4110190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:53.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.285+0000 7f73bae00700 1 -- 172.21.15.81:0/2324620426 >> 172.21.15.81:0/2324620426 conn(0x7f73b40f74c0 msgr2=0x7f73b40fbb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:46:53.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.285+0000 7f73bae00700 1 -- 172.21.15.81:0/2324620426 shutdown_connections 2024-04-23T14:46:53.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:53.285+0000 7f73bae00700 1 -- 172.21.15.81:0/2324620426 wait complete. 2024-04-23T14:46:53.973 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:53 smithi156 ceph-mon[32341]: pgmap v250: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 937 B/s wr, 3 op/s 2024-04-23T14:46:54.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:53 smithi081 ceph-mon[25540]: pgmap v250: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 937 B/s wr, 3 op/s 2024-04-23T14:46:54.143 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -e sha1=d44fddd910b5e94da0f2357af4be37d7bd495ae0 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-04-23T14:46:54.613 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:46:56.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:55 smithi156 ceph-mon[32341]: pgmap v251: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 682 B/s wr, 2 op/s 2024-04-23T14:46:56.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:55 smithi081 ceph-mon[25540]: pgmap v251: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 682 B/s wr, 2 op/s 2024-04-23T14:46:56.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:56.995+0000 7f1dca000700 1 -- 172.21.15.81:0/1934178664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dc4071f50 msgr2=0x7f1dc4070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:56.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:56.995+0000 7f1dca000700 1 --2- 172.21.15.81:0/1934178664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dc4071f50 0x7f1dc4070460 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1db4004940 tx=0x7f1db4009e30 comp rx=0 tx=0).stop 2024-04-23T14:46:56.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:56.995+0000 7f1dca000700 1 -- 172.21.15.81:0/1934178664 shutdown_connections 2024-04-23T14:46:56.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:56.995+0000 7f1dca000700 1 --2- 172.21.15.81:0/1934178664 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1dc40709a0 0x7f1dc4070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:56.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:56.995+0000 7f1dca000700 1 --2- 172.21.15.81:0/1934178664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dc4071f50 0x7f1dc4070460 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:56.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:56.995+0000 7f1dca000700 1 -- 172.21.15.81:0/1934178664 >> 172.21.15.81:0/1934178664 conn(0x7f1dc40f8530 msgr2=0x7f1dc40fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:46:56.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:56.995+0000 7f1dca000700 1 -- 172.21.15.81:0/1934178664 shutdown_connections 2024-04-23T14:46:56.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:56.995+0000 7f1dca000700 1 -- 172.21.15.81:0/1934178664 wait complete. 2024-04-23T14:46:56.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:56.996+0000 7f1dca000700 1 Processor -- start 2024-04-23T14:46:56.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:56.996+0000 7f1dca000700 1 -- start start 2024-04-23T14:46:56.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:56.997+0000 7f1dca000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dc40709a0 0x7f1dc4114060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:56.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:56.997+0000 7f1dca000700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1dc4071f50 0x7f1dc41145a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:56.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:56.997+0000 7f1dca000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc4114ba0 con 0x7f1dc40709a0 2024-04-23T14:46:56.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:56.997+0000 7f1dca000700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc41153f0 con 0x7f1dc4071f50 2024-04-23T14:46:56.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:56.997+0000 7f1dc3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dc40709a0 0x7f1dc4114060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:56.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:56.997+0000 7f1dc3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dc40709a0 0x7f1dc4114060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49000/0 (socket says 172.21.15.81:49000) 2024-04-23T14:46:56.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:56.997+0000 7f1dc3400700 1 -- 172.21.15.81:0/2802985135 learned_addr learned my addr 172.21.15.81:0/2802985135 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:46:56.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:56.997+0000 7f1dbbe00700 1 --2- 172.21.15.81:0/2802985135 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1dc4071f50 0x7f1dc41145a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:56.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:56.998+0000 7f1dc3400700 1 -- 172.21.15.81:0/2802985135 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1dc4071f50 msgr2=0x7f1dc41145a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:56.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:56.998+0000 7f1dc3400700 1 --2- 172.21.15.81:0/2802985135 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1dc4071f50 0x7f1dc41145a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:56.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:56.998+0000 7f1dc3400700 1 -- 172.21.15.81:0/2802985135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db4005040 con 0x7f1dc40709a0 2024-04-23T14:46:56.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:56.998+0000 7f1dc3400700 1 --2- 172.21.15.81:0/2802985135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dc40709a0 0x7f1dc4114060 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1db400b970 tx=0x7f1db4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:46:57.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:56.998+0000 7f1dbb400700 1 -- 172.21.15.81:0/2802985135 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1db400e040 con 0x7f1dc40709a0 2024-04-23T14:46:57.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:56.998+0000 7f1dbb400700 1 -- 172.21.15.81:0/2802985135 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1db4004290 con 0x7f1dc40709a0 2024-04-23T14:46:57.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:56.998+0000 7f1dca000700 1 -- 172.21.15.81:0/2802985135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dc4115670 con 0x7f1dc40709a0 2024-04-23T14:46:57.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:56.998+0000 7f1dbb400700 1 -- 172.21.15.81:0/2802985135 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1db401c630 con 0x7f1dc40709a0 2024-04-23T14:46:57.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:56.998+0000 7f1dca000700 1 -- 172.21.15.81:0/2802985135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dc4115bb0 con 0x7f1dc40709a0 2024-04-23T14:46:57.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:57.000+0000 7f1dca000700 1 -- 172.21.15.81:0/2802985135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dc405f5f0 con 0x7f1dc40709a0 2024-04-23T14:46:57.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:57.000+0000 7f1dbb400700 1 -- 172.21.15.81:0/2802985135 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f1db400bbf0 con 0x7f1dc40709a0 2024-04-23T14:46:57.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:57.001+0000 7f1dbb400700 1 --2- 172.21.15.81:0/2802985135 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f1da80692b0 0x7f1da806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:46:57.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:57.001+0000 7f1dbb400700 1 -- 172.21.15.81:0/2802985135 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f1db4088570 con 0x7f1dc40709a0 2024-04-23T14:46:57.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:57.002+0000 7f1dbbe00700 1 --2- 172.21.15.81:0/2802985135 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f1da80692b0 0x7f1da806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:46:57.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:57.002+0000 7f1dbbe00700 1 --2- 172.21.15.81:0/2802985135 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f1da80692b0 0x7f1da806b760 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1dac007fd0 tx=0x7f1dac009040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:46:57.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:57.006+0000 7f1dbb400700 1 -- 172.21.15.81:0/2802985135 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f1db40582c0 con 0x7f1dc40709a0 2024-04-23T14:46:57.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:57.222+0000 7f1dca000700 1 -- 172.21.15.81:0/2802985135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f1dc404bed0 con 0x7f1dc40709a0 2024-04-23T14:46:57.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:57.223+0000 7f1dbb400700 1 -- 172.21.15.81:0/2802985135 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7f1db4013e60 con 0x7f1dc40709a0 2024-04-23T14:46:57.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:57.226+0000 7f1dca000700 1 -- 172.21.15.81:0/2802985135 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f1da80692b0 msgr2=0x7f1da806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:57.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:57.226+0000 7f1dca000700 1 --2- 172.21.15.81:0/2802985135 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f1da80692b0 0x7f1da806b760 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1dac007fd0 tx=0x7f1dac009040 comp rx=0 tx=0).stop 2024-04-23T14:46:57.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:57.226+0000 7f1dca000700 1 -- 172.21.15.81:0/2802985135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dc40709a0 msgr2=0x7f1dc4114060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:46:57.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:57.226+0000 7f1dca000700 1 --2- 172.21.15.81:0/2802985135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dc40709a0 0x7f1dc4114060 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1db400b970 tx=0x7f1db4009e30 comp rx=0 tx=0).stop 2024-04-23T14:46:57.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:57.226+0000 7f1dca000700 1 -- 172.21.15.81:0/2802985135 shutdown_connections 2024-04-23T14:46:57.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:57.226+0000 7f1dca000700 1 --2- 172.21.15.81:0/2802985135 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f1da80692b0 0x7f1da806b760 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:57.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:57.226+0000 7f1dca000700 1 --2- 172.21.15.81:0/2802985135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dc40709a0 0x7f1dc4114060 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:57.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:57.226+0000 7f1dca000700 1 --2- 172.21.15.81:0/2802985135 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1dc4071f50 0x7f1dc41145a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:46:57.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:57.226+0000 7f1dca000700 1 -- 172.21.15.81:0/2802985135 >> 172.21.15.81:0/2802985135 conn(0x7f1dc40f8530 msgr2=0x7f1dc40f9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:46:57.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:57.226+0000 7f1dca000700 1 -- 172.21.15.81:0/2802985135 shutdown_connections 2024-04-23T14:46:57.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:46:57.226+0000 7f1dca000700 1 -- 172.21.15.81:0/2802985135 wait complete. 2024-04-23T14:46:58.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:57 smithi156 ceph-mon[32341]: pgmap v252: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 682 B/s wr, 3 op/s 2024-04-23T14:46:58.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:57 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:46:58.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:57 smithi081 ceph-mon[25540]: pgmap v252: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 682 B/s wr, 3 op/s 2024-04-23T14:46:58.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:57 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:46:58.239 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -e sha1=d44fddd910b5e94da0f2357af4be37d7bd495ae0 -- bash -c 'ceph config set global log_to_journald false --force' 2024-04-23T14:46:58.705 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:46:59.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:46:59 smithi156 ceph-mon[32341]: pgmap v253: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-04-23T14:46:59.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:46:59 smithi081 ceph-mon[25540]: pgmap v253: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-04-23T14:47:00.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:00.803+0000 7f0019e00700 1 -- 172.21.15.81:0/3955740041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00141046d0 msgr2=0x7f0014104b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:00.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:00.803+0000 7f0019e00700 1 --2- 172.21.15.81:0/3955740041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00141046d0 0x7f0014104b40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7efffc004940 tx=0x7efffc009e30 comp rx=0 tx=0).stop 2024-04-23T14:47:00.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:00.803+0000 7f0019e00700 1 -- 172.21.15.81:0/3955740041 shutdown_connections 2024-04-23T14:47:00.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:00.803+0000 7f0019e00700 1 --2- 172.21.15.81:0/3955740041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00141046d0 0x7f0014104b40 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:00.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:00.804+0000 7f0019e00700 1 --2- 172.21.15.81:0/3955740041 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0014103420 0x7f0014103830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:00.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:00.804+0000 7f0019e00700 1 -- 172.21.15.81:0/3955740041 >> 172.21.15.81:0/3955740041 conn(0x7f0014072640 msgr2=0x7f0014074a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:00.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:00.804+0000 7f0019e00700 1 -- 172.21.15.81:0/3955740041 shutdown_connections 2024-04-23T14:47:00.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:00.804+0000 7f0019e00700 1 -- 172.21.15.81:0/3955740041 wait complete. 2024-04-23T14:47:00.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:00.805+0000 7f0019e00700 1 Processor -- start 2024-04-23T14:47:00.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:00.805+0000 7f0019e00700 1 -- start start 2024-04-23T14:47:00.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:00.805+0000 7f0019e00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0014103420 0x7f0014113f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:00.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:00.805+0000 7f0019e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00141046d0 0x7f00141144a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:00.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:00.805+0000 7f0019e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0014114b30 con 0x7f00141046d0 2024-04-23T14:47:00.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:00.805+0000 7f0019e00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00141194d0 con 0x7f0014103420 2024-04-23T14:47:00.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:00.805+0000 7f000be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00141046d0 0x7f00141144a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:00.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:00.805+0000 7f000be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00141046d0 0x7f00141144a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49030/0 (socket says 172.21.15.81:49030) 2024-04-23T14:47:00.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:00.806+0000 7f000be00700 1 -- 172.21.15.81:0/4054321159 learned_addr learned my addr 172.21.15.81:0/4054321159 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:47:00.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:00.806+0000 7f0012a00700 1 --2- 172.21.15.81:0/4054321159 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0014103420 0x7f0014113f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:00.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:00.806+0000 7f000be00700 1 -- 172.21.15.81:0/4054321159 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0014103420 msgr2=0x7f0014113f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:00.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:00.806+0000 7f000be00700 1 --2- 172.21.15.81:0/4054321159 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0014103420 0x7f0014113f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:00.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:00.806+0000 7f000be00700 1 -- 172.21.15.81:0/4054321159 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efffc005040 con 0x7f00141046d0 2024-04-23T14:47:00.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:00.806+0000 7f0012a00700 1 --2- 172.21.15.81:0/4054321159 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0014103420 0x7f0014113f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:47:00.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:00.806+0000 7f000be00700 1 --2- 172.21.15.81:0/4054321159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00141046d0 0x7f00141144a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7efffc00b3b0 tx=0x7efffc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:00.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:00.806+0000 7f000aa00700 1 -- 172.21.15.81:0/4054321159 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efffc00e040 con 0x7f00141046d0 2024-04-23T14:47:00.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:00.806+0000 7f000aa00700 1 -- 172.21.15.81:0/4054321159 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efffc004290 con 0x7f00141046d0 2024-04-23T14:47:00.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:00.806+0000 7f000aa00700 1 -- 172.21.15.81:0/4054321159 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efffc01c630 con 0x7f00141046d0 2024-04-23T14:47:00.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:00.807+0000 7f0019e00700 1 -- 172.21.15.81:0/4054321159 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00141196d0 con 0x7f00141046d0 2024-04-23T14:47:00.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:00.807+0000 7f0019e00700 1 -- 172.21.15.81:0/4054321159 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0014119c10 con 0x7f00141046d0 2024-04-23T14:47:00.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:00.808+0000 7f0019e00700 1 -- 172.21.15.81:0/4054321159 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f001404c710 con 0x7f00141046d0 2024-04-23T14:47:00.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:00.809+0000 7f000aa00700 1 -- 172.21.15.81:0/4054321159 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7efffc00bbf0 con 0x7f00141046d0 2024-04-23T14:47:00.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:00.810+0000 7f000aa00700 1 --2- 172.21.15.81:0/4054321159 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7efff80692a0 0x7efff806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:00.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:00.810+0000 7f000aa00700 1 -- 172.21.15.81:0/4054321159 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7efffc0886e0 con 0x7f00141046d0 2024-04-23T14:47:00.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:00.810+0000 7f0012a00700 1 --2- 172.21.15.81:0/4054321159 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7efff80692a0 0x7efff806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:00.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:00.811+0000 7f0012a00700 1 --2- 172.21.15.81:0/4054321159 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7efff80692a0 0x7efff806b750 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0004006fd0 tx=0x7f0004008040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:00.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:00.815+0000 7f000aa00700 1 -- 172.21.15.81:0/4054321159 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7efffc0583b0 con 0x7f00141046d0 2024-04-23T14:47:01.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:01.027+0000 7f0019e00700 1 -- 172.21.15.81:0/4054321159 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f001410bf90 con 0x7f00141046d0 2024-04-23T14:47:01.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:01.028+0000 7f000aa00700 1 -- 172.21.15.81:0/4054321159 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7efffc057f40 con 0x7f00141046d0 2024-04-23T14:47:01.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:01.031+0000 7f0019e00700 1 -- 172.21.15.81:0/4054321159 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7efff80692a0 msgr2=0x7efff806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:01.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:01.031+0000 7f0019e00700 1 --2- 172.21.15.81:0/4054321159 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7efff80692a0 0x7efff806b750 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0004006fd0 tx=0x7f0004008040 comp rx=0 tx=0).stop 2024-04-23T14:47:01.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:01.031+0000 7f0019e00700 1 -- 172.21.15.81:0/4054321159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00141046d0 msgr2=0x7f00141144a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:01.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:01.031+0000 7f0019e00700 1 --2- 172.21.15.81:0/4054321159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00141046d0 0x7f00141144a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7efffc00b3b0 tx=0x7efffc009e30 comp rx=0 tx=0).stop 2024-04-23T14:47:01.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:01.031+0000 7f0019e00700 1 -- 172.21.15.81:0/4054321159 shutdown_connections 2024-04-23T14:47:01.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:01.031+0000 7f0019e00700 1 --2- 172.21.15.81:0/4054321159 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0014103420 0x7f0014113f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:01.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:01.031+0000 7f0019e00700 1 --2- 172.21.15.81:0/4054321159 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7efff80692a0 0x7efff806b750 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:01.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:01.031+0000 7f0019e00700 1 --2- 172.21.15.81:0/4054321159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00141046d0 0x7f00141144a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:01.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:01.031+0000 7f0019e00700 1 -- 172.21.15.81:0/4054321159 >> 172.21.15.81:0/4054321159 conn(0x7f0014072640 msgr2=0x7f0014073cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:01.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:01.031+0000 7f0019e00700 1 -- 172.21.15.81:0/4054321159 shutdown_connections 2024-04-23T14:47:01.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:01.031+0000 7f0019e00700 1 -- 172.21.15.81:0/4054321159 wait complete. 2024-04-23T14:47:01.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:01 smithi081 ceph-mon[25540]: pgmap v254: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-04-23T14:47:01.982 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -e sha1=d44fddd910b5e94da0f2357af4be37d7bd495ae0 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-04-23T14:47:02.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:01 smithi156 ceph-mon[32341]: pgmap v254: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-04-23T14:47:02.467 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:47:03.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:03 smithi081 ceph-mon[25540]: pgmap v255: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 682 B/s wr, 3 op/s 2024-04-23T14:47:04.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:03 smithi156 ceph-mon[32341]: pgmap v255: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 682 B/s wr, 3 op/s 2024-04-23T14:47:04.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:04.759+0000 7f39da200700 1 -- 172.21.15.81:0/2506097002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39d41002d0 msgr2=0x7f39d4100740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:04.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:04.759+0000 7f39da200700 1 --2- 172.21.15.81:0/2506097002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39d41002d0 0x7f39d4100740 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f39c0004940 tx=0x7f39c0009e30 comp rx=0 tx=0).stop 2024-04-23T14:47:04.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:04.759+0000 7f39da200700 1 -- 172.21.15.81:0/2506097002 shutdown_connections 2024-04-23T14:47:04.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:04.759+0000 7f39da200700 1 --2- 172.21.15.81:0/2506097002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39d41002d0 0x7f39d4100740 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:04.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:04.759+0000 7f39da200700 1 --2- 172.21.15.81:0/2506097002 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39d40ff020 0x7f39d40ff430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:04.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:04.759+0000 7f39da200700 1 -- 172.21.15.81:0/2506097002 >> 172.21.15.81:0/2506097002 conn(0x7f39d40fa950 msgr2=0x7f39d40fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:04.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:04.760+0000 7f39da200700 1 -- 172.21.15.81:0/2506097002 shutdown_connections 2024-04-23T14:47:04.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:04.760+0000 7f39da200700 1 -- 172.21.15.81:0/2506097002 wait complete. 2024-04-23T14:47:04.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:04.760+0000 7f39da200700 1 Processor -- start 2024-04-23T14:47:04.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:04.761+0000 7f39da200700 1 -- start start 2024-04-23T14:47:04.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:04.761+0000 7f39da200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39d40ff020 0x7f39d410fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:04.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:04.761+0000 7f39da200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39d41002d0 0x7f39d4110070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:04.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:04.761+0000 7f39da200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d4110670 con 0x7f39d40ff020 2024-04-23T14:47:04.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:04.761+0000 7f39da200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d41107e0 con 0x7f39d41002d0 2024-04-23T14:47:04.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:04.761+0000 7f39d3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39d40ff020 0x7f39d410fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:04.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:04.761+0000 7f39d3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39d40ff020 0x7f39d410fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56358/0 (socket says 172.21.15.81:56358) 2024-04-23T14:47:04.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:04.761+0000 7f39d3400700 1 -- 172.21.15.81:0/2847674897 learned_addr learned my addr 172.21.15.81:0/2847674897 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:47:04.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:04.762+0000 7f39d2a00700 1 --2- 172.21.15.81:0/2847674897 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39d41002d0 0x7f39d4110070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:04.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:04.762+0000 7f39d3400700 1 -- 172.21.15.81:0/2847674897 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39d41002d0 msgr2=0x7f39d4110070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:04.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:04.762+0000 7f39d3400700 1 --2- 172.21.15.81:0/2847674897 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39d41002d0 0x7f39d4110070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:04.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:04.762+0000 7f39d3400700 1 -- 172.21.15.81:0/2847674897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c0005040 con 0x7f39d40ff020 2024-04-23T14:47:04.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:04.762+0000 7f39d3400700 1 --2- 172.21.15.81:0/2847674897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39d40ff020 0x7f39d410fb30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f39c4002a50 tx=0x7f39c40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:04.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:04.762+0000 7f39cb400700 1 -- 172.21.15.81:0/2847674897 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39c4007cc0 con 0x7f39d40ff020 2024-04-23T14:47:04.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:04.762+0000 7f39cb400700 1 -- 172.21.15.81:0/2847674897 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f39c400f040 con 0x7f39d40ff020 2024-04-23T14:47:04.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:04.762+0000 7f39da200700 1 -- 172.21.15.81:0/2847674897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d4115240 con 0x7f39d40ff020 2024-04-23T14:47:04.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:04.762+0000 7f39cb400700 1 -- 172.21.15.81:0/2847674897 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39c4009640 con 0x7f39d40ff020 2024-04-23T14:47:04.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:04.763+0000 7f39da200700 1 -- 172.21.15.81:0/2847674897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d4115800 con 0x7f39d40ff020 2024-04-23T14:47:04.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:04.764+0000 7f39da200700 1 -- 172.21.15.81:0/2847674897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39d404c710 con 0x7f39d40ff020 2024-04-23T14:47:04.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:04.765+0000 7f39cb400700 1 -- 172.21.15.81:0/2847674897 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f39c40097a0 con 0x7f39d40ff020 2024-04-23T14:47:04.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:04.765+0000 7f39cb400700 1 --2- 172.21.15.81:0/2847674897 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f39b80692a0 0x7f39b806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:04.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:04.766+0000 7f39cb400700 1 -- 172.21.15.81:0/2847674897 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f39c40870c0 con 0x7f39d40ff020 2024-04-23T14:47:04.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:04.766+0000 7f39d2a00700 1 --2- 172.21.15.81:0/2847674897 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f39b80692a0 0x7f39b806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:04.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:04.766+0000 7f39d2a00700 1 --2- 172.21.15.81:0/2847674897 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f39b80692a0 0x7f39b806b750 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f39c000b3b0 tx=0x7f39c0009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:04.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:04.770+0000 7f39cb400700 1 -- 172.21.15.81:0/2847674897 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f39c4056d10 con 0x7f39d40ff020 2024-04-23T14:47:05.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:05.001+0000 7f39da200700 1 -- 172.21.15.81:0/2847674897 --> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0", "target": ["mon-mgr", ""]}) v1 -- 0x7f39d4104640 con 0x7f39b80692a0 2024-04-23T14:47:05.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:05.012+0000 7f39cb400700 1 -- 172.21.15.81:0/2847674897 <== mgr.14210 v2:172.21.15.81:6800/1053506915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f39d4104640 con 0x7f39b80692a0 2024-04-23T14:47:05.013 INFO:teuthology.orchestra.run.smithi081.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 2024-04-23T14:47:05.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:05.014+0000 7f39da200700 1 -- 172.21.15.81:0/2847674897 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f39b80692a0 msgr2=0x7f39b806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:05.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:05.014+0000 7f39da200700 1 --2- 172.21.15.81:0/2847674897 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f39b80692a0 0x7f39b806b750 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f39c000b3b0 tx=0x7f39c0009e30 comp rx=0 tx=0).stop 2024-04-23T14:47:05.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:05.014+0000 7f39da200700 1 -- 172.21.15.81:0/2847674897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39d40ff020 msgr2=0x7f39d410fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:05.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:05.014+0000 7f39da200700 1 --2- 172.21.15.81:0/2847674897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39d40ff020 0x7f39d410fb30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f39c4002a50 tx=0x7f39c40046b0 comp rx=0 tx=0).stop 2024-04-23T14:47:05.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:05.015+0000 7f39da200700 1 -- 172.21.15.81:0/2847674897 shutdown_connections 2024-04-23T14:47:05.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:05.015+0000 7f39da200700 1 --2- 172.21.15.81:0/2847674897 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f39b80692a0 0x7f39b806b750 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:05.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:05.015+0000 7f39da200700 1 --2- 172.21.15.81:0/2847674897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39d40ff020 0x7f39d410fb30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:05.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:05.015+0000 7f39da200700 1 --2- 172.21.15.81:0/2847674897 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39d41002d0 0x7f39d4110070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:05.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:05.015+0000 7f39da200700 1 -- 172.21.15.81:0/2847674897 >> 172.21.15.81:0/2847674897 conn(0x7f39d40fa950 msgr2=0x7f39d40fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:05.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:05.015+0000 7f39da200700 1 -- 172.21.15.81:0/2847674897 shutdown_connections 2024-04-23T14:47:05.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:05.015+0000 7f39da200700 1 -- 172.21.15.81:0/2847674897 wait complete. 2024-04-23T14:47:05.917 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:05 smithi081 ceph-mon[25540]: pgmap v256: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:47:05.917 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:05 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:47:05.917 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:05 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:47:05.917 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:05 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:47:05.917 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:05 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:47:05.917 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:05 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:47:05.919 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-23T14:47:05.920 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi081.front.sepia.ceph.com 2024-04-23T14:47:05.920 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -e sha1=d44fddd910b5e94da0f2357af4be37d7bd495ae0 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-04-23T14:47:06.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:05 smithi156 ceph-mon[32341]: pgmap v256: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:47:06.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:05 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:47:06.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:05 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:47:06.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:05 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:47:06.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:05 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:47:06.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:05 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:47:06.373 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T14:47:06.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:06 smithi081 ceph-mon[25540]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:47:06.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:06 smithi081 ceph-mon[25540]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 2024-04-23T14:47:06.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:06 smithi081 ceph-mon[25540]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 2024-04-23T14:47:07.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:06 smithi156 ceph-mon[32341]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:47:07.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:06 smithi156 ceph-mon[32341]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 2024-04-23T14:47:07.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:06 smithi156 ceph-mon[32341]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 2024-04-23T14:47:07.799 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:07 smithi081 ceph-mon[25540]: pgmap v257: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:47:08.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:07 smithi156 ceph-mon[32341]: pgmap v257: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:47:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.614+0000 7f56e8800700 1 -- 172.21.15.81:0/1521007398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56e00fe040 msgr2=0x7f56e00fe4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.614+0000 7f56e8800700 1 --2- 172.21.15.81:0/1521007398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56e00fe040 0x7f56e00fe4b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f56d0004940 tx=0x7f56d0009e30 comp rx=0 tx=0).stop 2024-04-23T14:47:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.615+0000 7f56e8800700 1 -- 172.21.15.81:0/1521007398 shutdown_connections 2024-04-23T14:47:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.615+0000 7f56e8800700 1 --2- 172.21.15.81:0/1521007398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56e00fe040 0x7f56e00fe4b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.615+0000 7f56e8800700 1 --2- 172.21.15.81:0/1521007398 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56e00fce40 0x7f56e00fd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.615+0000 7f56e8800700 1 -- 172.21.15.81:0/1521007398 >> 172.21.15.81:0/1521007398 conn(0x7f56e00f8590 msgr2=0x7f56e00fa9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.615+0000 7f56e8800700 1 -- 172.21.15.81:0/1521007398 shutdown_connections 2024-04-23T14:47:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.615+0000 7f56e8800700 1 -- 172.21.15.81:0/1521007398 wait complete. 2024-04-23T14:47:08.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.616+0000 7f56e8800700 1 Processor -- start 2024-04-23T14:47:08.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.616+0000 7f56e8800700 1 -- start start 2024-04-23T14:47:08.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.616+0000 7f56e8800700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56e00fce40 0x7f56e0071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:08.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.616+0000 7f56e8800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56e00fe040 0x7f56e0070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:08.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.616+0000 7f56e8800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e00708c0 con 0x7f56e00fe040 2024-04-23T14:47:08.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.616+0000 7f56e8800700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e0070a30 con 0x7f56e00fce40 2024-04-23T14:47:08.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.617+0000 7f56e5400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56e00fe040 0x7f56e0070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:08.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.617+0000 7f56e5400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56e00fe040 0x7f56e0070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56372/0 (socket says 172.21.15.81:56372) 2024-04-23T14:47:08.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.617+0000 7f56e5400700 1 -- 172.21.15.81:0/1010962118 learned_addr learned my addr 172.21.15.81:0/1010962118 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:47:08.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.617+0000 7f56e5e00700 1 --2- 172.21.15.81:0/1010962118 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56e00fce40 0x7f56e0071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:08.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.617+0000 7f56e5400700 1 -- 172.21.15.81:0/1010962118 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56e00fce40 msgr2=0x7f56e0071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:08.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.617+0000 7f56e5400700 1 --2- 172.21.15.81:0/1010962118 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56e00fce40 0x7f56e0071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:08.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.617+0000 7f56e5400700 1 -- 172.21.15.81:0/1010962118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d0005040 con 0x7f56e00fe040 2024-04-23T14:47:08.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.618+0000 7f56e5400700 1 --2- 172.21.15.81:0/1010962118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56e00fe040 0x7f56e0070310 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f56d0009150 tx=0x7f56d0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:08.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.618+0000 7f56da000700 1 -- 172.21.15.81:0/1010962118 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56d000e040 con 0x7f56e00fe040 2024-04-23T14:47:08.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.618+0000 7f56da000700 1 -- 172.21.15.81:0/1010962118 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f56d000bcc0 con 0x7f56e00fe040 2024-04-23T14:47:08.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.618+0000 7f56da000700 1 -- 172.21.15.81:0/1010962118 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56d001c630 con 0x7f56e00fe040 2024-04-23T14:47:08.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.618+0000 7f56e8800700 1 -- 172.21.15.81:0/1010962118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e0070cb0 con 0x7f56e00fe040 2024-04-23T14:47:08.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.618+0000 7f56e8800700 1 -- 172.21.15.81:0/1010962118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e0115a90 con 0x7f56e00fe040 2024-04-23T14:47:08.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.620+0000 7f56e8800700 1 -- 172.21.15.81:0/1010962118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56e005f5f0 con 0x7f56e00fe040 2024-04-23T14:47:08.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.621+0000 7f56da000700 1 -- 172.21.15.81:0/1010962118 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f56d0013420 con 0x7f56e00fe040 2024-04-23T14:47:08.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.622+0000 7f56da000700 1 --2- 172.21.15.81:0/1010962118 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f56c80692a0 0x7f56c806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:08.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.622+0000 7f56da000700 1 -- 172.21.15.81:0/1010962118 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f56d0087f80 con 0x7f56e00fe040 2024-04-23T14:47:08.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.622+0000 7f56e5e00700 1 --2- 172.21.15.81:0/1010962118 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f56c80692a0 0x7f56c806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:08.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.623+0000 7f56e5e00700 1 --2- 172.21.15.81:0/1010962118 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f56c80692a0 0x7f56c806b750 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f56d4009fd0 tx=0x7f56d4009f00 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:08.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.627+0000 7f56da000700 1 -- 172.21.15.81:0/1010962118 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f56d0054240 con 0x7f56e00fe040 2024-04-23T14:47:08.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.873+0000 7f56e8800700 1 -- 172.21.15.81:0/1010962118 --> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f56e01023a0 con 0x7f56c80692a0 2024-04-23T14:47:08.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.876+0000 7f56da000700 1 -- 172.21.15.81:0/1010962118 <== mgr.14210 v2:172.21.15.81:6800/1053506915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f56e01023a0 con 0x7f56c80692a0 2024-04-23T14:47:08.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.878+0000 7f56e8800700 1 -- 172.21.15.81:0/1010962118 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f56c80692a0 msgr2=0x7f56c806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:08.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.878+0000 7f56e8800700 1 --2- 172.21.15.81:0/1010962118 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f56c80692a0 0x7f56c806b750 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f56d4009fd0 tx=0x7f56d4009f00 comp rx=0 tx=0).stop 2024-04-23T14:47:08.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.878+0000 7f56e8800700 1 -- 172.21.15.81:0/1010962118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56e00fe040 msgr2=0x7f56e0070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:08.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.878+0000 7f56e8800700 1 --2- 172.21.15.81:0/1010962118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56e00fe040 0x7f56e0070310 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f56d0009150 tx=0x7f56d0009e30 comp rx=0 tx=0).stop 2024-04-23T14:47:08.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.879+0000 7f56e8800700 1 -- 172.21.15.81:0/1010962118 shutdown_connections 2024-04-23T14:47:08.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.879+0000 7f56e8800700 1 --2- 172.21.15.81:0/1010962118 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56e00fce40 0x7f56e0071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:08.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.879+0000 7f56e8800700 1 --2- 172.21.15.81:0/1010962118 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f56c80692a0 0x7f56c806b750 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:08.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.879+0000 7f56e8800700 1 --2- 172.21.15.81:0/1010962118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56e00fe040 0x7f56e0070310 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:08.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.879+0000 7f56e8800700 1 -- 172.21.15.81:0/1010962118 >> 172.21.15.81:0/1010962118 conn(0x7f56e00f8590 msgr2=0x7f56e00f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:08.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.879+0000 7f56e8800700 1 -- 172.21.15.81:0/1010962118 shutdown_connections 2024-04-23T14:47:08.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:08.879+0000 7f56e8800700 1 -- 172.21.15.81:0/1010962118 wait complete. 2024-04-23T14:47:08.896 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-04-23T14:47:09.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.043+0000 7f5128600700 1 -- 172.21.15.81:0/3769630622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51200fee20 msgr2=0x7f51200faf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:09.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.043+0000 7f5128600700 1 --2- 172.21.15.81:0/3769630622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51200fee20 0x7f51200faf60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f510c004940 tx=0x7f510c009e30 comp rx=0 tx=0).stop 2024-04-23T14:47:09.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.043+0000 7f5128600700 1 -- 172.21.15.81:0/3769630622 shutdown_connections 2024-04-23T14:47:09.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.043+0000 7f5128600700 1 --2- 172.21.15.81:0/3769630622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51200fee20 0x7f51200faf60 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:09.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.043+0000 7f5128600700 1 --2- 172.21.15.81:0/3769630622 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51200fe4d0 0x7f51200fe8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:09.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.043+0000 7f5128600700 1 -- 172.21.15.81:0/3769630622 >> 172.21.15.81:0/3769630622 conn(0x7f51200f6bd0 msgr2=0x7f51200f8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:09.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.043+0000 7f5128600700 1 -- 172.21.15.81:0/3769630622 shutdown_connections 2024-04-23T14:47:09.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.044+0000 7f5128600700 1 -- 172.21.15.81:0/3769630622 wait complete. 2024-04-23T14:47:09.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.044+0000 7f5128600700 1 Processor -- start 2024-04-23T14:47:09.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.045+0000 7f5128600700 1 -- start start 2024-04-23T14:47:09.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.045+0000 7f5128600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51200fe4d0 0x7f512010fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:09.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.045+0000 7f5128600700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51200fee20 0x7f5120110160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:09.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.045+0000 7f5128600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51201107f0 con 0x7f51200fe4d0 2024-04-23T14:47:09.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.045+0000 7f5128600700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5120110f70 con 0x7f51200fee20 2024-04-23T14:47:09.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.045+0000 7f5125c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51200fe4d0 0x7f512010fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:09.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.045+0000 7f5125c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51200fe4d0 0x7f512010fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56392/0 (socket says 172.21.15.81:56392) 2024-04-23T14:47:09.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.045+0000 7f5125c00700 1 -- 172.21.15.81:0/1294692884 learned_addr learned my addr 172.21.15.81:0/1294692884 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:47:09.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.046+0000 7f5125200700 1 --2- 172.21.15.81:0/1294692884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51200fee20 0x7f5120110160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:09.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.046+0000 7f5125c00700 1 -- 172.21.15.81:0/1294692884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51200fee20 msgr2=0x7f5120110160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:09.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.046+0000 7f5125c00700 1 --2- 172.21.15.81:0/1294692884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51200fee20 0x7f5120110160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:09.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.046+0000 7f5125c00700 1 -- 172.21.15.81:0/1294692884 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510c005040 con 0x7f51200fe4d0 2024-04-23T14:47:09.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.046+0000 7f5125c00700 1 --2- 172.21.15.81:0/1294692884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51200fe4d0 0x7f512010fc20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f511400b790 tx=0x7f5114009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:09.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.046+0000 7f511d600700 1 -- 172.21.15.81:0/1294692884 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f511400f770 con 0x7f51200fe4d0 2024-04-23T14:47:09.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.046+0000 7f511d600700 1 -- 172.21.15.81:0/1294692884 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f511400fda0 con 0x7f51200fe4d0 2024-04-23T14:47:09.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.047+0000 7f5128600700 1 -- 172.21.15.81:0/1294692884 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5120111250 con 0x7f51200fe4d0 2024-04-23T14:47:09.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.047+0000 7f511d600700 1 -- 172.21.15.81:0/1294692884 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f511400d310 con 0x7f51200fe4d0 2024-04-23T14:47:09.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.047+0000 7f5128600700 1 -- 172.21.15.81:0/1294692884 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5120111810 con 0x7f51200fe4d0 2024-04-23T14:47:09.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.048+0000 7f5128600700 1 -- 172.21.15.81:0/1294692884 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5120101c10 con 0x7f51200fe4d0 2024-04-23T14:47:09.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.049+0000 7f511d600700 1 -- 172.21.15.81:0/1294692884 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f5114010420 con 0x7f51200fe4d0 2024-04-23T14:47:09.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.050+0000 7f511d600700 1 --2- 172.21.15.81:0/1294692884 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f51080692b0 0x7f510806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:09.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.051+0000 7f511d600700 1 -- 172.21.15.81:0/1294692884 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f51140871c0 con 0x7f51200fe4d0 2024-04-23T14:47:09.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.051+0000 7f5125200700 1 --2- 172.21.15.81:0/1294692884 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f51080692b0 0x7f510806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:09.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.052+0000 7f5125200700 1 --2- 172.21.15.81:0/1294692884 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f51080692b0 0x7f510806b760 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f510c00b3b0 tx=0x7f510c009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:09.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.055+0000 7f511d600700 1 -- 172.21.15.81:0/1294692884 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f5114056f10 con 0x7f51200fe4d0 2024-04-23T14:47:09.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.324+0000 7f5128600700 1 -- 172.21.15.81:0/1294692884 --> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5120111ae0 con 0x7f51080692b0 2024-04-23T14:47:09.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.326+0000 7f511d600700 1 -- 172.21.15.81:0/1294692884 <== mgr.14210 v2:172.21.15.81:6800/1053506915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f5120111ae0 con 0x7f51080692b0 2024-04-23T14:47:09.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.329+0000 7f5128600700 1 -- 172.21.15.81:0/1294692884 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f51080692b0 msgr2=0x7f510806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:09.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.329+0000 7f5128600700 1 --2- 172.21.15.81:0/1294692884 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f51080692b0 0x7f510806b760 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f510c00b3b0 tx=0x7f510c009e30 comp rx=0 tx=0).stop 2024-04-23T14:47:09.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.329+0000 7f5128600700 1 -- 172.21.15.81:0/1294692884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51200fe4d0 msgr2=0x7f512010fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:09.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.329+0000 7f5128600700 1 --2- 172.21.15.81:0/1294692884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51200fe4d0 0x7f512010fc20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f511400b790 tx=0x7f5114009250 comp rx=0 tx=0).stop 2024-04-23T14:47:09.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.329+0000 7f5128600700 1 -- 172.21.15.81:0/1294692884 shutdown_connections 2024-04-23T14:47:09.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.329+0000 7f5128600700 1 --2- 172.21.15.81:0/1294692884 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f51080692b0 0x7f510806b760 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:09.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.329+0000 7f5128600700 1 --2- 172.21.15.81:0/1294692884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51200fe4d0 0x7f512010fc20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:09.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.329+0000 7f5128600700 1 --2- 172.21.15.81:0/1294692884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51200fee20 0x7f5120110160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:09.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.329+0000 7f5128600700 1 -- 172.21.15.81:0/1294692884 >> 172.21.15.81:0/1294692884 conn(0x7f51200f6bd0 msgr2=0x7f51200f81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:09.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.329+0000 7f5128600700 1 -- 172.21.15.81:0/1294692884 shutdown_connections 2024-04-23T14:47:09.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.329+0000 7f5128600700 1 -- 172.21.15.81:0/1294692884 wait complete. 2024-04-23T14:47:09.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.484+0000 7f8b39800700 1 -- 172.21.15.81:0/3183454559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b340ffd40 msgr2=0x7f8b34102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:09.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.484+0000 7f8b39800700 1 --2- 172.21.15.81:0/3183454559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b340ffd40 0x7f8b34102160 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8b20004940 tx=0x7f8b20009e30 comp rx=0 tx=0).stop 2024-04-23T14:47:09.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.485+0000 7f8b39800700 1 -- 172.21.15.81:0/3183454559 shutdown_connections 2024-04-23T14:47:09.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.485+0000 7f8b39800700 1 --2- 172.21.15.81:0/3183454559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b340ffd40 0x7f8b34102160 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:09.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.485+0000 7f8b39800700 1 --2- 172.21.15.81:0/3183454559 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b340662f0 0x7f8b340ff800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:09.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.485+0000 7f8b39800700 1 -- 172.21.15.81:0/3183454559 >> 172.21.15.81:0/3183454559 conn(0x7f8b340f7270 msgr2=0x7f8b340f96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:09.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.485+0000 7f8b39800700 1 -- 172.21.15.81:0/3183454559 shutdown_connections 2024-04-23T14:47:09.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.485+0000 7f8b39800700 1 -- 172.21.15.81:0/3183454559 wait complete. 2024-04-23T14:47:09.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.486+0000 7f8b39800700 1 Processor -- start 2024-04-23T14:47:09.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.486+0000 7f8b39800700 1 -- start start 2024-04-23T14:47:09.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.486+0000 7f8b39800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b340662f0 0x7f8b3410fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:09.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.486+0000 7f8b39800700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b340ffd40 0x7f8b34110050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:09.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.486+0000 7f8b39800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b341106e0 con 0x7f8b340662f0 2024-04-23T14:47:09.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.486+0000 7f8b39800700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b34110e80 con 0x7f8b340ffd40 2024-04-23T14:47:09.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.487+0000 7f8b33e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b340662f0 0x7f8b3410fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:09.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.487+0000 7f8b33400700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b340ffd40 0x7f8b34110050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:09.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.487+0000 7f8b33e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b340662f0 0x7f8b3410fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56404/0 (socket says 172.21.15.81:56404) 2024-04-23T14:47:09.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.487+0000 7f8b33400700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b340ffd40 0x7f8b34110050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.81:40468/0 (socket says 172.21.15.81:40468) 2024-04-23T14:47:09.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.487+0000 7f8b33e00700 1 -- 172.21.15.81:0/2354146320 learned_addr learned my addr 172.21.15.81:0/2354146320 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:47:09.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.488+0000 7f8b33e00700 1 -- 172.21.15.81:0/2354146320 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b340ffd40 msgr2=0x7f8b34110050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:09.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.488+0000 7f8b33e00700 1 --2- 172.21.15.81:0/2354146320 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b340ffd40 0x7f8b34110050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:09.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.488+0000 7f8b33e00700 1 -- 172.21.15.81:0/2354146320 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b20005040 con 0x7f8b340662f0 2024-04-23T14:47:09.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.489+0000 7f8b33e00700 1 --2- 172.21.15.81:0/2354146320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b340662f0 0x7f8b3410fb10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8b2400b790 tx=0x7f8b24009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:09.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.489+0000 7f8b2be00700 1 -- 172.21.15.81:0/2354146320 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b2400f6f0 con 0x7f8b340662f0 2024-04-23T14:47:09.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.489+0000 7f8b39800700 1 -- 172.21.15.81:0/2354146320 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b34111160 con 0x7f8b340662f0 2024-04-23T14:47:09.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.489+0000 7f8b2be00700 1 -- 172.21.15.81:0/2354146320 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8b2400fd20 con 0x7f8b340662f0 2024-04-23T14:47:09.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.489+0000 7f8b2be00700 1 -- 172.21.15.81:0/2354146320 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b240103a0 con 0x7f8b340662f0 2024-04-23T14:47:09.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.489+0000 7f8b39800700 1 -- 172.21.15.81:0/2354146320 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b34111720 con 0x7f8b340662f0 2024-04-23T14:47:09.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.491+0000 7f8b39800700 1 -- 172.21.15.81:0/2354146320 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b3405f5f0 con 0x7f8b340662f0 2024-04-23T14:47:09.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.492+0000 7f8b2be00700 1 -- 172.21.15.81:0/2354146320 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f8b24011400 con 0x7f8b340662f0 2024-04-23T14:47:09.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.493+0000 7f8b2be00700 1 --2- 172.21.15.81:0/2354146320 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f8b180692b0 0x7f8b1806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:09.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.493+0000 7f8b2be00700 1 -- 172.21.15.81:0/2354146320 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f8b24086f90 con 0x7f8b340662f0 2024-04-23T14:47:09.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.493+0000 7f8b33400700 1 --2- 172.21.15.81:0/2354146320 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f8b180692b0 0x7f8b1806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:09.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.494+0000 7f8b33400700 1 --2- 172.21.15.81:0/2354146320 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f8b180692b0 0x7f8b1806b760 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8b2000b3b0 tx=0x7f8b20009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:09.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.499+0000 7f8b2be00700 1 -- 172.21.15.81:0/2354146320 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f8b24056d00 con 0x7f8b340662f0 2024-04-23T14:47:09.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.755+0000 7f8b39800700 1 -- 172.21.15.81:0/2354146320 --> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b34111a00 con 0x7f8b180692b0 2024-04-23T14:47:09.758 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:09 smithi081 ceph-mon[25540]: pgmap v258: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:47:09.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.767+0000 7f8b2be00700 1 -- 172.21.15.81:0/2354146320 <== mgr.14210 v2:172.21.15.81:6800/1053506915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f8b34111a00 con 0x7f8b180692b0 2024-04-23T14:47:09.769 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-23T14:47:09.770 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (6m) 41s ago 8m 13.4M - 0.25.0 c8568f914cd2 730d7164defb 2024-04-23T14:47:09.770 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (8m) 41s ago 8m 6660k - 17.2.7-884-g70d0cb4b cafd8ddac8fa 6ae90c81b232 2024-04-23T14:47:09.770 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi156 smithi156 running (7m) 47s ago 7m 6660k - 17.2.7-884-g70d0cb4b cafd8ddac8fa ecc141919f37 2024-04-23T14:47:09.770 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (6m) 41s ago 7m 74.6M - 9.4.7 954c08fa6188 96965e7e10cc 2024-04-23T14:47:09.770 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.vcoywg smithi081 running (65s) 41s ago 64s 12.8M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 2ca7601ab60f 2024-04-23T14:47:09.770 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.wydgcg smithi081 running (74s) 41s ago 73s 11.6M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 58eb1a961b61 2024-04-23T14:47:09.770 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.rhbtxt smithi156 running (70s) 47s ago 70s 10.4M - 17.2.7-884-g70d0cb4b cafd8ddac8fa db3cb5034381 2024-04-23T14:47:09.770 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.vynkxn smithi156 running (61s) 47s ago 60s 10.4M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 1c8f2219e7fd 2024-04-23T14:47:09.770 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.ldghvq smithi081 *:9283 running (9m) 41s ago 9m 482M - 17.2.7-884-g70d0cb4b cafd8ddac8fa b3d1da9bbf01 2024-04-23T14:47:09.770 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi156.ounwyj smithi156 *:8443,9283 running (6m) 47s ago 6m 432M - 17.2.7-884-g70d0cb4b cafd8ddac8fa e41b78b84933 2024-04-23T14:47:09.770 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (9m) 41s ago 10m 44.6M 2048M 17.2.7-884-g70d0cb4b cafd8ddac8fa 6e43d934b336 2024-04-23T14:47:09.770 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi156 smithi156 running (6m) 47s ago 6m 34.3M 2048M 17.2.7-884-g70d0cb4b cafd8ddac8fa d9127540d3bb 2024-04-23T14:47:09.771 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (8m) 41s ago 8m 7759k - 1.5.0 0da6a335fe13 06716415b80c 2024-04-23T14:47:09.771 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi156 smithi156 *:9100 running (7m) 47s ago 7m 7532k - 1.5.0 0da6a335fe13 2d9e680be69f 2024-04-23T14:47:09.771 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (5m) 41s ago 5m 46.6M 4288M 17.2.7-884-g70d0cb4b cafd8ddac8fa 272ca032bec1 2024-04-23T14:47:09.771 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (5m) 41s ago 5m 44.7M 4288M 17.2.7-884-g70d0cb4b cafd8ddac8fa ee6d0c8af6ed 2024-04-23T14:47:09.771 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (4m) 41s ago 4m 45.0M 4288M 17.2.7-884-g70d0cb4b cafd8ddac8fa c26c640828a2 2024-04-23T14:47:09.771 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi156 running (4m) 47s ago 4m 43.8M 5312M 17.2.7-884-g70d0cb4b cafd8ddac8fa c1c261b1ee90 2024-04-23T14:47:09.771 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi156 running (3m) 47s ago 3m 40.4M 5312M 17.2.7-884-g70d0cb4b cafd8ddac8fa 83f996ee64de 2024-04-23T14:47:09.771 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi156 running (3m) 47s ago 3m 40.8M 5312M 17.2.7-884-g70d0cb4b cafd8ddac8fa b754244bef18 2024-04-23T14:47:09.771 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (6m) 41s ago 7m 46.0M - 2.43.0 a07b618ecd1d 1779b897e5df 2024-04-23T14:47:09.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.771+0000 7f8b39800700 1 -- 172.21.15.81:0/2354146320 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f8b180692b0 msgr2=0x7f8b1806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:09.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.771+0000 7f8b39800700 1 --2- 172.21.15.81:0/2354146320 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f8b180692b0 0x7f8b1806b760 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8b2000b3b0 tx=0x7f8b20009e30 comp rx=0 tx=0).stop 2024-04-23T14:47:09.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.771+0000 7f8b39800700 1 -- 172.21.15.81:0/2354146320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b340662f0 msgr2=0x7f8b3410fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:09.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.771+0000 7f8b39800700 1 --2- 172.21.15.81:0/2354146320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b340662f0 0x7f8b3410fb10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8b2400b790 tx=0x7f8b24009220 comp rx=0 tx=0).stop 2024-04-23T14:47:09.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.771+0000 7f8b39800700 1 -- 172.21.15.81:0/2354146320 shutdown_connections 2024-04-23T14:47:09.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.771+0000 7f8b39800700 1 --2- 172.21.15.81:0/2354146320 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f8b180692b0 0x7f8b1806b760 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:09.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.771+0000 7f8b39800700 1 --2- 172.21.15.81:0/2354146320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b340662f0 0x7f8b3410fb10 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:09.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.771+0000 7f8b39800700 1 --2- 172.21.15.81:0/2354146320 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b340ffd40 0x7f8b34110050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:09.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.771+0000 7f8b39800700 1 -- 172.21.15.81:0/2354146320 >> 172.21.15.81:0/2354146320 conn(0x7f8b340f7270 msgr2=0x7f8b340fb880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:09.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.772+0000 7f8b39800700 1 -- 172.21.15.81:0/2354146320 shutdown_connections 2024-04-23T14:47:09.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.772+0000 7f8b39800700 1 -- 172.21.15.81:0/2354146320 wait complete. 2024-04-23T14:47:09.913 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:09 smithi156 ceph-mon[32341]: pgmap v258: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:47:09.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.940+0000 7fa854000700 1 -- 172.21.15.81:0/2989369437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa84c0fe040 msgr2=0x7fa84c0fe4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:09.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.940+0000 7fa854000700 1 --2- 172.21.15.81:0/2989369437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa84c0fe040 0x7fa84c0fe4b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa838004940 tx=0x7fa838009e30 comp rx=0 tx=0).stop 2024-04-23T14:47:09.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.940+0000 7fa854000700 1 -- 172.21.15.81:0/2989369437 shutdown_connections 2024-04-23T14:47:09.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.940+0000 7fa854000700 1 --2- 172.21.15.81:0/2989369437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa84c0fe040 0x7fa84c0fe4b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:09.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.940+0000 7fa854000700 1 --2- 172.21.15.81:0/2989369437 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa84c0fce40 0x7fa84c0fd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:09.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.940+0000 7fa854000700 1 -- 172.21.15.81:0/2989369437 >> 172.21.15.81:0/2989369437 conn(0x7fa84c0f8530 msgr2=0x7fa84c0fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:09.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.940+0000 7fa854000700 1 -- 172.21.15.81:0/2989369437 shutdown_connections 2024-04-23T14:47:09.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.940+0000 7fa854000700 1 -- 172.21.15.81:0/2989369437 wait complete. 2024-04-23T14:47:09.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.941+0000 7fa854000700 1 Processor -- start 2024-04-23T14:47:09.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.941+0000 7fa854000700 1 -- start start 2024-04-23T14:47:09.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.941+0000 7fa854000700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa84c0fce40 0x7fa84c10da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:09.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.941+0000 7fa854000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa84c0fe040 0x7fa84c10dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:09.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.941+0000 7fa854000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84c10e660 con 0x7fa84c0fe040 2024-04-23T14:47:09.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.941+0000 7fa854000700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84c10ee00 con 0x7fa84c0fce40 2024-04-23T14:47:09.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.942+0000 7fa850c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa84c0fe040 0x7fa84c10dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:09.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.942+0000 7fa850c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa84c0fe040 0x7fa84c10dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56430/0 (socket says 172.21.15.81:56430) 2024-04-23T14:47:09.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.942+0000 7fa850c00700 1 -- 172.21.15.81:0/2776103103 learned_addr learned my addr 172.21.15.81:0/2776103103 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:47:09.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.942+0000 7fa851600700 1 --2- 172.21.15.81:0/2776103103 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa84c0fce40 0x7fa84c10da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:09.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.942+0000 7fa850c00700 1 -- 172.21.15.81:0/2776103103 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa84c0fce40 msgr2=0x7fa84c10da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:09.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.942+0000 7fa850c00700 1 --2- 172.21.15.81:0/2776103103 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa84c0fce40 0x7fa84c10da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:09.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.942+0000 7fa850c00700 1 -- 172.21.15.81:0/2776103103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa838005040 con 0x7fa84c0fe040 2024-04-23T14:47:09.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.943+0000 7fa850c00700 1 --2- 172.21.15.81:0/2776103103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa84c0fe040 0x7fa84c10dfd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa838009150 tx=0x7fa838009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:09.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.943+0000 7fa849600700 1 -- 172.21.15.81:0/2776103103 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa83800e040 con 0x7fa84c0fe040 2024-04-23T14:47:09.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.943+0000 7fa849600700 1 -- 172.21.15.81:0/2776103103 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa83800bbf0 con 0x7fa84c0fe040 2024-04-23T14:47:09.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.943+0000 7fa854000700 1 -- 172.21.15.81:0/2776103103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa84c10f080 con 0x7fa84c0fe040 2024-04-23T14:47:09.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.943+0000 7fa849600700 1 -- 172.21.15.81:0/2776103103 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa83801c630 con 0x7fa84c0fe040 2024-04-23T14:47:09.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.943+0000 7fa854000700 1 -- 172.21.15.81:0/2776103103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa84c10f640 con 0x7fa84c0fe040 2024-04-23T14:47:09.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.944+0000 7fa854000700 1 -- 172.21.15.81:0/2776103103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa84c05f5f0 con 0x7fa84c0fe040 2024-04-23T14:47:09.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.945+0000 7fa849600700 1 -- 172.21.15.81:0/2776103103 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fa83800bd60 con 0x7fa84c0fe040 2024-04-23T14:47:09.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.946+0000 7fa849600700 1 --2- 172.21.15.81:0/2776103103 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fa8340692b0 0x7fa83406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:09.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.946+0000 7fa849600700 1 -- 172.21.15.81:0/2776103103 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fa838088550 con 0x7fa84c0fe040 2024-04-23T14:47:09.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.947+0000 7fa851600700 1 --2- 172.21.15.81:0/2776103103 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fa8340692b0 0x7fa83406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:09.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.947+0000 7fa851600700 1 --2- 172.21.15.81:0/2776103103 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fa8340692b0 0x7fa83406b760 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa840006fd0 tx=0x7fa840008040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:09.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:09.951+0000 7fa849600700 1 -- 172.21.15.81:0/2776103103 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa838058410 con 0x7fa84c0fe040 2024-04-23T14:47:10.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.273+0000 7fa854000700 1 -- 172.21.15.81:0/2776103103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa84c04bed0 con 0x7fa84c0fe040 2024-04-23T14:47:10.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.274+0000 7fa849600700 1 -- 172.21.15.81:0/2776103103 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7fa838057fa0 con 0x7fa84c0fe040 2024-04-23T14:47:10.276 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:47:10.276 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-04-23T14:47:10.276 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 2 2024-04-23T14:47:10.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:47:10.277 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-04-23T14:47:10.277 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 2 2024-04-23T14:47:10.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:47:10.277 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-04-23T14:47:10.277 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 6 2024-04-23T14:47:10.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:47:10.277 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-04-23T14:47:10.277 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 4 2024-04-23T14:47:10.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:47:10.277 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-04-23T14:47:10.277 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 14 2024-04-23T14:47:10.277 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-23T14:47:10.278 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:47:10.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.277+0000 7fa854000700 1 -- 172.21.15.81:0/2776103103 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fa8340692b0 msgr2=0x7fa83406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:10.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.277+0000 7fa854000700 1 --2- 172.21.15.81:0/2776103103 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fa8340692b0 0x7fa83406b760 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa840006fd0 tx=0x7fa840008040 comp rx=0 tx=0).stop 2024-04-23T14:47:10.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.277+0000 7fa854000700 1 -- 172.21.15.81:0/2776103103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa84c0fe040 msgr2=0x7fa84c10dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:10.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.277+0000 7fa854000700 1 --2- 172.21.15.81:0/2776103103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa84c0fe040 0x7fa84c10dfd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa838009150 tx=0x7fa838009e30 comp rx=0 tx=0).stop 2024-04-23T14:47:10.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.278+0000 7fa854000700 1 -- 172.21.15.81:0/2776103103 shutdown_connections 2024-04-23T14:47:10.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.278+0000 7fa854000700 1 --2- 172.21.15.81:0/2776103103 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa84c0fce40 0x7fa84c10da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:10.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.278+0000 7fa854000700 1 --2- 172.21.15.81:0/2776103103 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fa8340692b0 0x7fa83406b760 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:10.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.278+0000 7fa854000700 1 --2- 172.21.15.81:0/2776103103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa84c0fe040 0x7fa84c10dfd0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:10.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.278+0000 7fa854000700 1 -- 172.21.15.81:0/2776103103 >> 172.21.15.81:0/2776103103 conn(0x7fa84c0f8530 msgr2=0x7fa84c0f9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:10.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.278+0000 7fa854000700 1 -- 172.21.15.81:0/2776103103 shutdown_connections 2024-04-23T14:47:10.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.278+0000 7fa854000700 1 -- 172.21.15.81:0/2776103103 wait complete. 2024-04-23T14:47:10.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.427+0000 7fa533200700 1 -- 172.21.15.81:0/21881833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa52c0ffde0 msgr2=0x7fa52c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:10.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.427+0000 7fa533200700 1 --2- 172.21.15.81:0/21881833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa52c0ffde0 0x7fa52c1021c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa51c004940 tx=0x7fa51c009e30 comp rx=0 tx=0).stop 2024-04-23T14:47:10.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.427+0000 7fa533200700 1 -- 172.21.15.81:0/21881833 shutdown_connections 2024-04-23T14:47:10.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.427+0000 7fa533200700 1 --2- 172.21.15.81:0/21881833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa52c0ffde0 0x7fa52c1021c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:10.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.427+0000 7fa533200700 1 --2- 172.21.15.81:0/21881833 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa52c066250 0x7fa52c0ff8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:10.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.427+0000 7fa533200700 1 -- 172.21.15.81:0/21881833 >> 172.21.15.81:0/21881833 conn(0x7fa52c0f7270 msgr2=0x7fa52c0f96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:10.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.427+0000 7fa533200700 1 -- 172.21.15.81:0/21881833 shutdown_connections 2024-04-23T14:47:10.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.427+0000 7fa533200700 1 -- 172.21.15.81:0/21881833 wait complete. 2024-04-23T14:47:10.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.428+0000 7fa533200700 1 Processor -- start 2024-04-23T14:47:10.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.428+0000 7fa533200700 1 -- start start 2024-04-23T14:47:10.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.428+0000 7fa533200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa52c066250 0x7fa52c10fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:10.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.428+0000 7fa533200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa52c0ffde0 0x7fa52c10ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:10.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.428+0000 7fa533200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52c110650 con 0x7fa52c066250 2024-04-23T14:47:10.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.428+0000 7fa533200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52c110e40 con 0x7fa52c0ffde0 2024-04-23T14:47:10.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.429+0000 7fa531e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa52c066250 0x7fa52c10fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:10.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.429+0000 7fa531e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa52c066250 0x7fa52c10fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56442/0 (socket says 172.21.15.81:56442) 2024-04-23T14:47:10.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.429+0000 7fa531e00700 1 -- 172.21.15.81:0/3546169222 learned_addr learned my addr 172.21.15.81:0/3546169222 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:47:10.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.429+0000 7fa531e00700 1 -- 172.21.15.81:0/3546169222 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa52c0ffde0 msgr2=0x7fa52c10ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:10.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.429+0000 7fa531e00700 1 --2- 172.21.15.81:0/3546169222 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa52c0ffde0 0x7fa52c10ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:10.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.429+0000 7fa531e00700 1 -- 172.21.15.81:0/3546169222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa51c005040 con 0x7fa52c066250 2024-04-23T14:47:10.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.430+0000 7fa531e00700 1 --2- 172.21.15.81:0/3546169222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa52c066250 0x7fa52c10fa80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa52000b790 tx=0x7fa520009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:10.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.430+0000 7fa526000700 1 -- 172.21.15.81:0/3546169222 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa52000f6f0 con 0x7fa52c066250 2024-04-23T14:47:10.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.430+0000 7fa526000700 1 -- 172.21.15.81:0/3546169222 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa52000fd20 con 0x7fa52c066250 2024-04-23T14:47:10.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.430+0000 7fa526000700 1 -- 172.21.15.81:0/3546169222 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5200103a0 con 0x7fa52c066250 2024-04-23T14:47:10.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.430+0000 7fa533200700 1 -- 172.21.15.81:0/3546169222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa52c111120 con 0x7fa52c066250 2024-04-23T14:47:10.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.430+0000 7fa533200700 1 -- 172.21.15.81:0/3546169222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa52c1116e0 con 0x7fa52c066250 2024-04-23T14:47:10.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.432+0000 7fa533200700 1 -- 172.21.15.81:0/3546169222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa52c05f5f0 con 0x7fa52c066250 2024-04-23T14:47:10.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.432+0000 7fa526000700 1 -- 172.21.15.81:0/3546169222 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fa520011400 con 0x7fa52c066250 2024-04-23T14:47:10.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.433+0000 7fa526000700 1 --2- 172.21.15.81:0/3546169222 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fa5140692b0 0x7fa51406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:10.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.433+0000 7fa526000700 1 -- 172.21.15.81:0/3546169222 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fa520086ff0 con 0x7fa52c066250 2024-04-23T14:47:10.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.434+0000 7fa531400700 1 --2- 172.21.15.81:0/3546169222 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fa5140692b0 0x7fa51406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:10.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.434+0000 7fa531400700 1 --2- 172.21.15.81:0/3546169222 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fa5140692b0 0x7fa51406b760 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa51c004f90 tx=0x7fa51c009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:10.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.438+0000 7fa526000700 1 -- 172.21.15.81:0/3546169222 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa520056d20 con 0x7fa52c066250 2024-04-23T14:47:10.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.752+0000 7fa533200700 1 -- 172.21.15.81:0/3546169222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa52c1057a0 con 0x7fa52c066250 2024-04-23T14:47:10.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.753+0000 7fa526000700 1 -- 172.21.15.81:0/3546169222 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1837 (secure 0 0 0) 0x7fa5200568b0 con 0x7fa52c066250 2024-04-23T14:47:10.755 INFO:teuthology.orchestra.run.smithi081.stdout:e18 2024-04-23T14:47:10.755 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-23T14:47:10.755 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:47:10.755 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-04-23T14:47:10.755 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:47:10.755 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-04-23T14:47:10.755 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-04-23T14:47:10.755 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 17 2024-04-23T14:47:10.755 INFO:teuthology.orchestra.run.smithi081.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-23T14:47:10.755 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-04-23T14:45:51.264703+0000 2024-04-23T14:47:10.755 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-04-23T14:46:12.782992+0000 2024-04-23T14:47:10.755 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-04-23T14:47:10.755 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-04-23T14:47:10.756 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-04-23T14:47:10.756 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-04-23T14:47:10.756 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-04-23T14:47:10.756 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-04-23T14:47:10.756 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-04-23T14:47:10.756 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 47 2024-04-23T14:47:10.756 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:47:10.756 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 1 2024-04-23T14:47:10.756 INFO:teuthology.orchestra.run.smithi081.stdout:in 0 2024-04-23T14:47:10.756 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=14472} 2024-04-23T14:47:10.756 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-04-23T14:47:10.756 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-04-23T14:47:10.756 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-04-23T14:47:10.756 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-04-23T14:47:10.757 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-04-23T14:47:10.757 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-04-23T14:47:10.757 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-04-23T14:47:10.757 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-04-23T14:47:10.757 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.vcoywg{0:14472} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.81:6828/2563365650,v1:172.21.15.81:6829/2563365650] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:47:10.757 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.wydgcg{0:14482} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.81:6826/759909104,v1:172.21.15.81:6827/759909104] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:47:10.757 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:47:10.757 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:47:10.757 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-04-23T14:47:10.757 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:47:10.757 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.vynkxn{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.156:6826/1794690362,v1:172.21.15.156:6827/1794690362] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:47:10.757 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.rhbtxt{-1:24263} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.156:6824/3854041261,v1:172.21.15.156:6825/3854041261] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:47:10.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.756+0000 7fa533200700 1 -- 172.21.15.81:0/3546169222 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fa5140692b0 msgr2=0x7fa51406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:10.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.756+0000 7fa533200700 1 --2- 172.21.15.81:0/3546169222 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fa5140692b0 0x7fa51406b760 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa51c004f90 tx=0x7fa51c009e30 comp rx=0 tx=0).stop 2024-04-23T14:47:10.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.756+0000 7fa533200700 1 -- 172.21.15.81:0/3546169222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa52c066250 msgr2=0x7fa52c10fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:10.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.756+0000 7fa533200700 1 --2- 172.21.15.81:0/3546169222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa52c066250 0x7fa52c10fa80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa52000b790 tx=0x7fa520009220 comp rx=0 tx=0).stop 2024-04-23T14:47:10.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.756+0000 7fa533200700 1 -- 172.21.15.81:0/3546169222 shutdown_connections 2024-04-23T14:47:10.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.756+0000 7fa533200700 1 --2- 172.21.15.81:0/3546169222 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fa5140692b0 0x7fa51406b760 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:10.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.756+0000 7fa533200700 1 --2- 172.21.15.81:0/3546169222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa52c066250 0x7fa52c10fa80 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:10.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.756+0000 7fa533200700 1 --2- 172.21.15.81:0/3546169222 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa52c0ffde0 0x7fa52c10ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:10.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.756+0000 7fa533200700 1 -- 172.21.15.81:0/3546169222 >> 172.21.15.81:0/3546169222 conn(0x7fa52c0f7270 msgr2=0x7fa52c1001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:10.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.756+0000 7fa533200700 1 -- 172.21.15.81:0/3546169222 shutdown_connections 2024-04-23T14:47:10.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.756+0000 7fa533200700 1 -- 172.21.15.81:0/3546169222 wait complete. 2024-04-23T14:47:10.760 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 18 2024-04-23T14:47:10.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.916+0000 7f897d600700 1 -- 172.21.15.81:0/1407174067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8978066c80 msgr2=0x7f89780ff880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:10.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.916+0000 7f897d600700 1 --2- 172.21.15.81:0/1407174067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8978066c80 0x7f89780ff880 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8968004940 tx=0x7f8968009e30 comp rx=0 tx=0).stop 2024-04-23T14:47:10.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.917+0000 7f897d600700 1 -- 172.21.15.81:0/1407174067 shutdown_connections 2024-04-23T14:47:10.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.917+0000 7f897d600700 1 --2- 172.21.15.81:0/1407174067 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89780ffdc0 0x7f89781021a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:10.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.917+0000 7f897d600700 1 --2- 172.21.15.81:0/1407174067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8978066c80 0x7f89780ff880 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:10.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.917+0000 7f897d600700 1 -- 172.21.15.81:0/1407174067 >> 172.21.15.81:0/1407174067 conn(0x7f89780f7290 msgr2=0x7f89780f96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:10.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.917+0000 7f897d600700 1 -- 172.21.15.81:0/1407174067 shutdown_connections 2024-04-23T14:47:10.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.917+0000 7f897d600700 1 -- 172.21.15.81:0/1407174067 wait complete. 2024-04-23T14:47:10.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.919+0000 7f897d600700 1 Processor -- start 2024-04-23T14:47:10.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.919+0000 7f897d600700 1 -- start start 2024-04-23T14:47:10.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.920+0000 7f897d600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8978066c80 0x7f897810d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:10.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.920+0000 7f897d600700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89780ffdc0 0x7f897810dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:10.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.920+0000 7f897d600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897810e360 con 0x7f8978066c80 2024-04-23T14:47:10.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.920+0000 7f897d600700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897810ebb0 con 0x7f89780ffdc0 2024-04-23T14:47:10.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.920+0000 7f8977e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8978066c80 0x7f897810d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:10.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.920+0000 7f8977e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8978066c80 0x7f897810d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56460/0 (socket says 172.21.15.81:56460) 2024-04-23T14:47:10.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.920+0000 7f8977e00700 1 -- 172.21.15.81:0/2127711811 learned_addr learned my addr 172.21.15.81:0/2127711811 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:47:10.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.920+0000 7f8977400700 1 --2- 172.21.15.81:0/2127711811 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89780ffdc0 0x7f897810dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:10.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.921+0000 7f8977e00700 1 -- 172.21.15.81:0/2127711811 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89780ffdc0 msgr2=0x7f897810dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:10.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.921+0000 7f8977e00700 1 --2- 172.21.15.81:0/2127711811 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89780ffdc0 0x7f897810dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:10.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.921+0000 7f8977e00700 1 -- 172.21.15.81:0/2127711811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8968005040 con 0x7f8978066c80 2024-04-23T14:47:10.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.921+0000 7f8977e00700 1 --2- 172.21.15.81:0/2127711811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8978066c80 0x7f897810d820 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f896800b0d0 tx=0x7f8968009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:10.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.921+0000 7f896fe00700 1 -- 172.21.15.81:0/2127711811 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f896800e070 con 0x7f8978066c80 2024-04-23T14:47:10.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.921+0000 7f896fe00700 1 -- 172.21.15.81:0/2127711811 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f896800b410 con 0x7f8978066c80 2024-04-23T14:47:10.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.921+0000 7f897d600700 1 -- 172.21.15.81:0/2127711811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f897810ee30 con 0x7f8978066c80 2024-04-23T14:47:10.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.921+0000 7f896fe00700 1 -- 172.21.15.81:0/2127711811 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8968012600 con 0x7f8978066c80 2024-04-23T14:47:10.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.922+0000 7f897d600700 1 -- 172.21.15.81:0/2127711811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f897810f370 con 0x7f8978066c80 2024-04-23T14:47:10.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.923+0000 7f897d600700 1 -- 172.21.15.81:0/2127711811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89780faf30 con 0x7f8978066c80 2024-04-23T14:47:10.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.924+0000 7f896fe00700 1 -- 172.21.15.81:0/2127711811 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f896800ba60 con 0x7f8978066c80 2024-04-23T14:47:10.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.925+0000 7f896fe00700 1 --2- 172.21.15.81:0/2127711811 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f895c0692a0 0x7f895c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:10.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.926+0000 7f896fe00700 1 -- 172.21.15.81:0/2127711811 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f8968087f10 con 0x7f8978066c80 2024-04-23T14:47:10.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.926+0000 7f8977400700 1 --2- 172.21.15.81:0/2127711811 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f895c0692a0 0x7f895c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:10.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.927+0000 7f8977400700 1 --2- 172.21.15.81:0/2127711811 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f895c0692a0 0x7f895c06b750 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8964004600 tx=0x7f896400b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:10.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:10.931+0000 7f896fe00700 1 -- 172.21.15.81:0/2127711811 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f8968057d20 con 0x7f8978066c80 2024-04-23T14:47:11.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:10 smithi156 ceph-mon[32341]: from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:47:11.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:10 smithi156 ceph-mon[32341]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:47:11.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:10 smithi156 ceph-mon[32341]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:47:11.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:10 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/2776103103' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:47:11.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:10 smithi081 ceph-mon[25540]: from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:47:11.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:10 smithi081 ceph-mon[25540]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:47:11.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:10 smithi081 ceph-mon[25540]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:47:11.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:10 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/2776103103' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:47:11.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.237+0000 7f897d600700 1 -- 172.21.15.81:0/2127711811 --> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f897810f760 con 0x7f895c0692a0 2024-04-23T14:47:11.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.240+0000 7f896fe00700 1 -- 172.21.15.81:0/2127711811 <== mgr.14210 v2:172.21.15.81:6800/1053506915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f897810f760 con 0x7f895c0692a0 2024-04-23T14:47:11.242 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:47:11.242 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0", 2024-04-23T14:47:11.242 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-04-23T14:47:11.242 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-23T14:47:11.242 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [], 2024-04-23T14:47:11.242 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "", 2024-04-23T14:47:11.243 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 image", 2024-04-23T14:47:11.243 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-04-23T14:47:11.243 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:47:11.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.243+0000 7f897d600700 1 -- 172.21.15.81:0/2127711811 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f895c0692a0 msgr2=0x7f895c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:11.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.243+0000 7f897d600700 1 --2- 172.21.15.81:0/2127711811 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f895c0692a0 0x7f895c06b750 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8964004600 tx=0x7f896400b040 comp rx=0 tx=0).stop 2024-04-23T14:47:11.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.243+0000 7f897d600700 1 -- 172.21.15.81:0/2127711811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8978066c80 msgr2=0x7f897810d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:11.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.243+0000 7f897d600700 1 --2- 172.21.15.81:0/2127711811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8978066c80 0x7f897810d820 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f896800b0d0 tx=0x7f8968009e30 comp rx=0 tx=0).stop 2024-04-23T14:47:11.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.244+0000 7f897d600700 1 -- 172.21.15.81:0/2127711811 shutdown_connections 2024-04-23T14:47:11.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.244+0000 7f897d600700 1 --2- 172.21.15.81:0/2127711811 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f895c0692a0 0x7f895c06b750 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:11.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.244+0000 7f897d600700 1 --2- 172.21.15.81:0/2127711811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8978066c80 0x7f897810d820 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:11.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.244+0000 7f897d600700 1 --2- 172.21.15.81:0/2127711811 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89780ffdc0 0x7f897810dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:11.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.244+0000 7f897d600700 1 -- 172.21.15.81:0/2127711811 >> 172.21.15.81:0/2127711811 conn(0x7f89780f7290 msgr2=0x7f89780f76b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:11.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.244+0000 7f897d600700 1 -- 172.21.15.81:0/2127711811 shutdown_connections 2024-04-23T14:47:11.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.244+0000 7f897d600700 1 -- 172.21.15.81:0/2127711811 wait complete. 2024-04-23T14:47:11.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.405+0000 7fe4efe00700 1 -- 172.21.15.81:0/4102301688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4f00fbb10 msgr2=0x7fe4f00fbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:11.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.405+0000 7fe4efe00700 1 --2- 172.21.15.81:0/4102301688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4f00fbb10 0x7fe4f00fbf20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0004940 tx=0x7fe4e0009e30 comp rx=0 tx=0).stop 2024-04-23T14:47:11.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.405+0000 7fe4efe00700 1 -- 172.21.15.81:0/4102301688 shutdown_connections 2024-04-23T14:47:11.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.405+0000 7fe4efe00700 1 --2- 172.21.15.81:0/4102301688 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4f00fcdc0 0x7fe4f00fd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:11.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.405+0000 7fe4efe00700 1 --2- 172.21.15.81:0/4102301688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4f00fbb10 0x7fe4f00fbf20 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:11.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.405+0000 7fe4efe00700 1 -- 172.21.15.81:0/4102301688 >> 172.21.15.81:0/4102301688 conn(0x7fe4f00f7270 msgr2=0x7fe4f00f96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:11.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.405+0000 7fe4efe00700 1 -- 172.21.15.81:0/4102301688 shutdown_connections 2024-04-23T14:47:11.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.405+0000 7fe4efe00700 1 -- 172.21.15.81:0/4102301688 wait complete. 2024-04-23T14:47:11.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.406+0000 7fe4efe00700 1 Processor -- start 2024-04-23T14:47:11.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.406+0000 7fe4efe00700 1 -- start start 2024-04-23T14:47:11.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.407+0000 7fe4efe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4f00fbb10 0x7fe4f010d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:11.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.407+0000 7fe4efe00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4f00fcdc0 0x7fe4f010ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:11.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.407+0000 7fe4efe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f010e3c0 con 0x7fe4f00fbb10 2024-04-23T14:47:11.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.407+0000 7fe4efe00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f010ec10 con 0x7fe4f00fcdc0 2024-04-23T14:47:11.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.407+0000 7fe4eea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4f00fbb10 0x7fe4f010d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:11.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.407+0000 7fe4eea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4f00fbb10 0x7fe4f010d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56472/0 (socket says 172.21.15.81:56472) 2024-04-23T14:47:11.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.407+0000 7fe4eea00700 1 -- 172.21.15.81:0/2430182006 learned_addr learned my addr 172.21.15.81:0/2430182006 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:47:11.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.407+0000 7fe4ee000700 1 --2- 172.21.15.81:0/2430182006 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4f00fcdc0 0x7fe4f010ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:11.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.407+0000 7fe4eea00700 1 -- 172.21.15.81:0/2430182006 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4f00fcdc0 msgr2=0x7fe4f010ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:11.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.407+0000 7fe4eea00700 1 --2- 172.21.15.81:0/2430182006 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4f00fcdc0 0x7fe4f010ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:11.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.407+0000 7fe4eea00700 1 -- 172.21.15.81:0/2430182006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e0005040 con 0x7fe4f00fbb10 2024-04-23T14:47:11.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.408+0000 7fe4eea00700 1 --2- 172.21.15.81:0/2430182006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4f00fbb10 0x7fe4f010d880 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0009150 tx=0x7fe4e0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:11.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.408+0000 7fe4e6a00700 1 -- 172.21.15.81:0/2430182006 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4e000e040 con 0x7fe4f00fbb10 2024-04-23T14:47:11.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.408+0000 7fe4e6a00700 1 -- 172.21.15.81:0/2430182006 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe4e000bbf0 con 0x7fe4f00fbb10 2024-04-23T14:47:11.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.408+0000 7fe4e6a00700 1 -- 172.21.15.81:0/2430182006 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4e001c630 con 0x7fe4f00fbb10 2024-04-23T14:47:11.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.408+0000 7fe4efe00700 1 -- 172.21.15.81:0/2430182006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4f010ee90 con 0x7fe4f00fbb10 2024-04-23T14:47:11.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.408+0000 7fe4efe00700 1 -- 172.21.15.81:0/2430182006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f010f3d0 con 0x7fe4f00fbb10 2024-04-23T14:47:11.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.409+0000 7fe4efe00700 1 -- 172.21.15.81:0/2430182006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4f005f5f0 con 0x7fe4f00fbb10 2024-04-23T14:47:11.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.411+0000 7fe4e6a00700 1 -- 172.21.15.81:0/2430182006 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fe4e000bd60 con 0x7fe4f00fbb10 2024-04-23T14:47:11.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.412+0000 7fe4e6a00700 1 --2- 172.21.15.81:0/2430182006 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fe4d40692b0 0x7fe4d406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:11.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.412+0000 7fe4e6a00700 1 -- 172.21.15.81:0/2430182006 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe4e0088540 con 0x7fe4f00fbb10 2024-04-23T14:47:11.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.413+0000 7fe4ee000700 1 --2- 172.21.15.81:0/2430182006 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fe4d40692b0 0x7fe4d406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:11.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.413+0000 7fe4ee000700 1 --2- 172.21.15.81:0/2430182006 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fe4d40692b0 0x7fe4d406b760 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc004d60 tx=0x7fe4dc00b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:11.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.417+0000 7fe4e6a00700 1 -- 172.21.15.81:0/2430182006 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe4e0058350 con 0x7fe4f00fbb10 2024-04-23T14:47:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.780+0000 7fe4efe00700 1 -- 172.21.15.81:0/2430182006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe4f004bed0 con 0x7fe4f00fbb10 2024-04-23T14:47:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.781+0000 7fe4e6a00700 1 -- 172.21.15.81:0/2430182006 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fe4e0057ee0 con 0x7fe4f00fbb10 2024-04-23T14:47:11.783 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-04-23T14:47:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.784+0000 7fe4efe00700 1 -- 172.21.15.81:0/2430182006 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fe4d40692b0 msgr2=0x7fe4d406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.784+0000 7fe4efe00700 1 --2- 172.21.15.81:0/2430182006 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fe4d40692b0 0x7fe4d406b760 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc004d60 tx=0x7fe4dc00b040 comp rx=0 tx=0).stop 2024-04-23T14:47:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.784+0000 7fe4efe00700 1 -- 172.21.15.81:0/2430182006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4f00fbb10 msgr2=0x7fe4f010d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.784+0000 7fe4efe00700 1 --2- 172.21.15.81:0/2430182006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4f00fbb10 0x7fe4f010d880 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0009150 tx=0x7fe4e0009e30 comp rx=0 tx=0).stop 2024-04-23T14:47:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.784+0000 7fe4efe00700 1 -- 172.21.15.81:0/2430182006 shutdown_connections 2024-04-23T14:47:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.784+0000 7fe4efe00700 1 --2- 172.21.15.81:0/2430182006 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fe4d40692b0 0x7fe4d406b760 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.784+0000 7fe4efe00700 1 --2- 172.21.15.81:0/2430182006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4f00fbb10 0x7fe4f010d880 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.784+0000 7fe4efe00700 1 --2- 172.21.15.81:0/2430182006 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4f00fcdc0 0x7fe4f010ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.784+0000 7fe4efe00700 1 -- 172.21.15.81:0/2430182006 >> 172.21.15.81:0/2430182006 conn(0x7fe4f00f7270 msgr2=0x7fe4f00f8980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.785+0000 7fe4efe00700 1 -- 172.21.15.81:0/2430182006 shutdown_connections 2024-04-23T14:47:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:11.785+0000 7fe4efe00700 1 -- 172.21.15.81:0/2430182006 wait complete. 2024-04-23T14:47:12.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:11 smithi156 ceph-mon[32341]: pgmap v259: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:47:12.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:11 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/3546169222' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:47:12.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:11 smithi081 ceph-mon[25540]: pgmap v259: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:47:12.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:11 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/3546169222' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:47:13.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:12 smithi156 ceph-mon[32341]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:47:13.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:12 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/2430182006' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:47:13.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:12 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:47:13.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:12 smithi081 ceph-mon[25540]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:47:13.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:12 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/2430182006' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:47:13.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:12 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:47:14.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:13 smithi156 ceph-mon[32341]: pgmap v260: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:47:14.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:13 smithi081 ceph-mon[25540]: pgmap v260: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:47:16.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:15 smithi156 ceph-mon[32341]: pgmap v261: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:47:16.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:15 smithi081 ceph-mon[25540]: pgmap v261: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:47:18.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:17 smithi156 ceph-mon[32341]: pgmap v262: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:47:18.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:17 smithi081 ceph-mon[25540]: pgmap v262: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:47:20.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:19 smithi156 ceph-mon[32341]: pgmap v263: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-23T14:47:20.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:19 smithi081 ceph-mon[25540]: pgmap v263: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-23T14:47:22.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:21 smithi156 ceph-mon[32341]: pgmap v264: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-23T14:47:22.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:21 smithi081 ceph-mon[25540]: pgmap v264: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-23T14:47:24.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:23 smithi156 ceph-mon[32341]: pgmap v265: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 341 B/s wr, 2 op/s 2024-04-23T14:47:24.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:23 smithi081 ceph-mon[25540]: pgmap v265: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 341 B/s wr, 2 op/s 2024-04-23T14:47:26.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:25 smithi156 ceph-mon[32341]: pgmap v266: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 341 B/s wr, 2 op/s 2024-04-23T14:47:26.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:25 smithi081 ceph-mon[25540]: pgmap v266: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 341 B/s wr, 2 op/s 2024-04-23T14:47:28.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:27 smithi156 ceph-mon[32341]: pgmap v267: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 597 B/s wr, 3 op/s 2024-04-23T14:47:28.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:27 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:47:28.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:27 smithi081 ceph-mon[25540]: pgmap v267: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 597 B/s wr, 3 op/s 2024-04-23T14:47:28.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:27 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:47:30.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:29 smithi081 ceph-mon[25540]: pgmap v268: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 597 B/s wr, 2 op/s 2024-04-23T14:47:30.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:29 smithi156 ceph-mon[32341]: pgmap v268: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 597 B/s wr, 2 op/s 2024-04-23T14:47:32.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:31 smithi156 ceph-mon[32341]: pgmap v269: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 597 B/s wr, 3 op/s 2024-04-23T14:47:32.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:31 smithi081 ceph-mon[25540]: pgmap v269: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 597 B/s wr, 3 op/s 2024-04-23T14:47:34.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:33 smithi156 ceph-mon[32341]: pgmap v270: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 682 B/s wr, 3 op/s 2024-04-23T14:47:34.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:33 smithi081 ceph-mon[25540]: pgmap v270: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 682 B/s wr, 3 op/s 2024-04-23T14:47:36.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:35 smithi156 ceph-mon[32341]: pgmap v271: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 341 B/s wr, 2 op/s 2024-04-23T14:47:36.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:35 smithi081 ceph-mon[25540]: pgmap v271: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 341 B/s wr, 2 op/s 2024-04-23T14:47:38.241 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:37 smithi081 ceph-mon[25540]: pgmap v272: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-23T14:47:38.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:37 smithi156 ceph-mon[32341]: pgmap v272: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-23T14:47:39.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:38 smithi156 ceph-mon[32341]: pgmap v273: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-04-23T14:47:39.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:38 smithi081 ceph-mon[25540]: pgmap v273: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-04-23T14:47:41.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:41 smithi156 ceph-mon[32341]: pgmap v274: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-04-23T14:47:41.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:41 smithi081 ceph-mon[25540]: pgmap v274: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-04-23T14:47:41.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:41.975+0000 7f7589a00700 1 -- 172.21.15.81:0/3395633141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75840ff000 msgr2=0x7f75840ff410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:41.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:41.975+0000 7f7589a00700 1 --2- 172.21.15.81:0/3395633141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75840ff000 0x7f75840ff410 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7574004940 tx=0x7f7574009e30 comp rx=0 tx=0).stop 2024-04-23T14:47:41.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:41.975+0000 7f7589a00700 1 -- 172.21.15.81:0/3395633141 shutdown_connections 2024-04-23T14:47:41.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:41.975+0000 7f7589a00700 1 --2- 172.21.15.81:0/3395633141 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75841002b0 0x7f7584100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:41.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:41.975+0000 7f7589a00700 1 --2- 172.21.15.81:0/3395633141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75840ff000 0x7f75840ff410 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:41.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:41.975+0000 7f7589a00700 1 -- 172.21.15.81:0/3395633141 >> 172.21.15.81:0/3395633141 conn(0x7f75840fa950 msgr2=0x7f75840fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:41.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:41.975+0000 7f7589a00700 1 -- 172.21.15.81:0/3395633141 shutdown_connections 2024-04-23T14:47:41.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:41.975+0000 7f7589a00700 1 -- 172.21.15.81:0/3395633141 wait complete. 2024-04-23T14:47:41.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:41.976+0000 7f7589a00700 1 Processor -- start 2024-04-23T14:47:41.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:41.976+0000 7f7589a00700 1 -- start start 2024-04-23T14:47:41.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:41.977+0000 7f7589a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75840ff000 0x7f758410fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:41.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:41.977+0000 7f7589a00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75841002b0 0x7f7584110160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:41.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:41.977+0000 7f7589a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7584110760 con 0x7f75840ff000 2024-04-23T14:47:41.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:41.977+0000 7f7589a00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7584110fb0 con 0x7f75841002b0 2024-04-23T14:47:41.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:41.977+0000 7f7582a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75840ff000 0x7f758410fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:41.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:41.977+0000 7f7582a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75840ff000 0x7f758410fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55068/0 (socket says 172.21.15.81:55068) 2024-04-23T14:47:41.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:41.977+0000 7f7582a00700 1 -- 172.21.15.81:0/3256863221 learned_addr learned my addr 172.21.15.81:0/3256863221 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:47:41.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:41.978+0000 7f7582000700 1 --2- 172.21.15.81:0/3256863221 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75841002b0 0x7f7584110160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:41.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:41.978+0000 7f7582a00700 1 -- 172.21.15.81:0/3256863221 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75841002b0 msgr2=0x7f7584110160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:41.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:41.978+0000 7f7582a00700 1 --2- 172.21.15.81:0/3256863221 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75841002b0 0x7f7584110160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:41.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:41.978+0000 7f7582a00700 1 -- 172.21.15.81:0/3256863221 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7574005040 con 0x7f75840ff000 2024-04-23T14:47:41.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:41.978+0000 7f7582a00700 1 --2- 172.21.15.81:0/3256863221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75840ff000 0x7f758410fc20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f757400b3b0 tx=0x7f7574009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:41.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:41.979+0000 7f757aa00700 1 -- 172.21.15.81:0/3256863221 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f757400e040 con 0x7f75840ff000 2024-04-23T14:47:41.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:41.979+0000 7f7589a00700 1 -- 172.21.15.81:0/3256863221 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7584111230 con 0x7f75840ff000 2024-04-23T14:47:41.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:41.979+0000 7f757aa00700 1 -- 172.21.15.81:0/3256863221 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7574004290 con 0x7f75840ff000 2024-04-23T14:47:41.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:41.979+0000 7f7589a00700 1 -- 172.21.15.81:0/3256863221 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7584111770 con 0x7f75840ff000 2024-04-23T14:47:41.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:41.979+0000 7f757aa00700 1 -- 172.21.15.81:0/3256863221 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f757401c630 con 0x7f75840ff000 2024-04-23T14:47:41.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:41.981+0000 7f7589a00700 1 -- 172.21.15.81:0/3256863221 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f758405f5f0 con 0x7f75840ff000 2024-04-23T14:47:41.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:41.983+0000 7f757aa00700 1 -- 172.21.15.81:0/3256863221 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f757401c8f0 con 0x7f75840ff000 2024-04-23T14:47:41.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:41.984+0000 7f757aa00700 1 --2- 172.21.15.81:0/3256863221 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f75680692b0 0x7f756806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:41.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:41.984+0000 7f757aa00700 1 -- 172.21.15.81:0/3256863221 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f7574088b10 con 0x7f75840ff000 2024-04-23T14:47:41.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:41.985+0000 7f7582000700 1 --2- 172.21.15.81:0/3256863221 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f75680692b0 0x7f756806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:41.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:41.985+0000 7f7582000700 1 --2- 172.21.15.81:0/3256863221 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f75680692b0 0x7f756806b760 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7570004990 tx=0x7f7570009ee0 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:41.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:41.991+0000 7f757aa00700 1 -- 172.21.15.81:0/3256863221 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7574058860 con 0x7f75840ff000 2024-04-23T14:47:42.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.277+0000 7f7589a00700 1 -- 172.21.15.81:0/3256863221 --> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7584111bb0 con 0x7f75680692b0 2024-04-23T14:47:42.278 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:42 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:47:42.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.278+0000 7f757aa00700 1 -- 172.21.15.81:0/3256863221 <== mgr.14210 v2:172.21.15.81:6800/1053506915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f7584111bb0 con 0x7f75680692b0 2024-04-23T14:47:42.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.282+0000 7f7589a00700 1 -- 172.21.15.81:0/3256863221 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f75680692b0 msgr2=0x7f756806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:42.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.282+0000 7f7589a00700 1 --2- 172.21.15.81:0/3256863221 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f75680692b0 0x7f756806b760 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7570004990 tx=0x7f7570009ee0 comp rx=0 tx=0).stop 2024-04-23T14:47:42.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.282+0000 7f7589a00700 1 -- 172.21.15.81:0/3256863221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75840ff000 msgr2=0x7f758410fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:42.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.282+0000 7f7589a00700 1 --2- 172.21.15.81:0/3256863221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75840ff000 0x7f758410fc20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f757400b3b0 tx=0x7f7574009e30 comp rx=0 tx=0).stop 2024-04-23T14:47:42.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.282+0000 7f7589a00700 1 -- 172.21.15.81:0/3256863221 shutdown_connections 2024-04-23T14:47:42.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.282+0000 7f7589a00700 1 --2- 172.21.15.81:0/3256863221 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f75680692b0 0x7f756806b760 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:42.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.282+0000 7f7589a00700 1 --2- 172.21.15.81:0/3256863221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75840ff000 0x7f758410fc20 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:42.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.282+0000 7f7589a00700 1 --2- 172.21.15.81:0/3256863221 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75841002b0 0x7f7584110160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:42.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.282+0000 7f7589a00700 1 -- 172.21.15.81:0/3256863221 >> 172.21.15.81:0/3256863221 conn(0x7f75840fa950 msgr2=0x7f75840fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:42.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.283+0000 7f7589a00700 1 -- 172.21.15.81:0/3256863221 shutdown_connections 2024-04-23T14:47:42.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.283+0000 7f7589a00700 1 -- 172.21.15.81:0/3256863221 wait complete. 2024-04-23T14:47:42.299 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-04-23T14:47:42.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.439+0000 7f63f5200700 1 -- 172.21.15.81:0/1036025088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63f00fee00 msgr2=0x7f63f00ff210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:42.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.439+0000 7f63f5200700 1 --2- 172.21.15.81:0/1036025088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63f00fee00 0x7f63f00ff210 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f63e0004940 tx=0x7f63e0009e30 comp rx=0 tx=0).stop 2024-04-23T14:47:42.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.439+0000 7f63f5200700 1 -- 172.21.15.81:0/1036025088 shutdown_connections 2024-04-23T14:47:42.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.439+0000 7f63f5200700 1 --2- 172.21.15.81:0/1036025088 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63f00ff750 0x7f63f01000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:42.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.439+0000 7f63f5200700 1 --2- 172.21.15.81:0/1036025088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63f00fee00 0x7f63f00ff210 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:42.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.439+0000 7f63f5200700 1 -- 172.21.15.81:0/1036025088 >> 172.21.15.81:0/1036025088 conn(0x7f63f00fa5d0 msgr2=0x7f63f00fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:42.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.440+0000 7f63f5200700 1 -- 172.21.15.81:0/1036025088 shutdown_connections 2024-04-23T14:47:42.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.440+0000 7f63f5200700 1 -- 172.21.15.81:0/1036025088 wait complete. 2024-04-23T14:47:42.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.440+0000 7f63f5200700 1 Processor -- start 2024-04-23T14:47:42.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.441+0000 7f63f5200700 1 -- start start 2024-04-23T14:47:42.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.441+0000 7f63f5200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63f00fee00 0x7f63f010faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:42.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.441+0000 7f63f5200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63f00ff750 0x7f63f010ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:42.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.441+0000 7f63f5200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f01105e0 con 0x7f63f00ff750 2024-04-23T14:47:42.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.441+0000 7f63f5200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f0110e30 con 0x7f63f00fee00 2024-04-23T14:47:42.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.441+0000 7f63e7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63f00ff750 0x7f63f010ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:42.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.441+0000 7f63e7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63f00ff750 0x7f63f010ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55098/0 (socket says 172.21.15.81:55098) 2024-04-23T14:47:42.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.441+0000 7f63e7e00700 1 -- 172.21.15.81:0/185323166 learned_addr learned my addr 172.21.15.81:0/185323166 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:47:42.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.442+0000 7f63ef400700 1 --2- 172.21.15.81:0/185323166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63f00fee00 0x7f63f010faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:42.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.442+0000 7f63e7e00700 1 -- 172.21.15.81:0/185323166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63f00fee00 msgr2=0x7f63f010faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:42.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.442+0000 7f63e7e00700 1 --2- 172.21.15.81:0/185323166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63f00fee00 0x7f63f010faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:42.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.442+0000 7f63e7e00700 1 -- 172.21.15.81:0/185323166 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e0005040 con 0x7f63f00ff750 2024-04-23T14:47:42.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.442+0000 7f63e7e00700 1 --2- 172.21.15.81:0/185323166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63f00ff750 0x7f63f010ffe0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f63d8002a50 tx=0x7f63d8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:42.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.443+0000 7f63e7400700 1 -- 172.21.15.81:0/185323166 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63d8007cc0 con 0x7f63f00ff750 2024-04-23T14:47:42.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.443+0000 7f63e7400700 1 -- 172.21.15.81:0/185323166 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f63d800f040 con 0x7f63f00ff750 2024-04-23T14:47:42.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.443+0000 7f63e7400700 1 -- 172.21.15.81:0/185323166 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63d800d9c0 con 0x7f63f00ff750 2024-04-23T14:47:42.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.443+0000 7f63f5200700 1 -- 172.21.15.81:0/185323166 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63f0111110 con 0x7f63f00ff750 2024-04-23T14:47:42.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.443+0000 7f63f5200700 1 -- 172.21.15.81:0/185323166 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63f0111650 con 0x7f63f00ff750 2024-04-23T14:47:42.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.444+0000 7f63f5200700 1 -- 172.21.15.81:0/185323166 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63f005f5f0 con 0x7f63f00ff750 2024-04-23T14:47:42.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.446+0000 7f63e7400700 1 -- 172.21.15.81:0/185323166 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f63d8009730 con 0x7f63f00ff750 2024-04-23T14:47:42.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.447+0000 7f63e7400700 1 --2- 172.21.15.81:0/185323166 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f63d40692b0 0x7f63d406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:42.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.447+0000 7f63e7400700 1 -- 172.21.15.81:0/185323166 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f63d8086e90 con 0x7f63f00ff750 2024-04-23T14:47:42.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.447+0000 7f63ef400700 1 --2- 172.21.15.81:0/185323166 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f63d40692b0 0x7f63d406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:42.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.448+0000 7f63ef400700 1 --2- 172.21.15.81:0/185323166 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f63d40692b0 0x7f63d406b760 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f63e000b3b0 tx=0x7f63e0009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:42.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.455+0000 7f63e7400700 1 -- 172.21.15.81:0/185323166 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f63d8056b60 con 0x7f63f00ff750 2024-04-23T14:47:42.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:42 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:47:42.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.693+0000 7f63f5200700 1 -- 172.21.15.81:0/185323166 --> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f63f0111a40 con 0x7f63d40692b0 2024-04-23T14:47:42.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.695+0000 7f63e7400700 1 -- 172.21.15.81:0/185323166 <== mgr.14210 v2:172.21.15.81:6800/1053506915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f63f0111a40 con 0x7f63d40692b0 2024-04-23T14:47:42.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.698+0000 7f63f5200700 1 -- 172.21.15.81:0/185323166 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f63d40692b0 msgr2=0x7f63d406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:42.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.698+0000 7f63f5200700 1 --2- 172.21.15.81:0/185323166 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f63d40692b0 0x7f63d406b760 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f63e000b3b0 tx=0x7f63e0009e30 comp rx=0 tx=0).stop 2024-04-23T14:47:42.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.698+0000 7f63f5200700 1 -- 172.21.15.81:0/185323166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63f00ff750 msgr2=0x7f63f010ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:42.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.698+0000 7f63f5200700 1 --2- 172.21.15.81:0/185323166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63f00ff750 0x7f63f010ffe0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f63d8002a50 tx=0x7f63d8004600 comp rx=0 tx=0).stop 2024-04-23T14:47:42.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.698+0000 7f63f5200700 1 -- 172.21.15.81:0/185323166 shutdown_connections 2024-04-23T14:47:42.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.698+0000 7f63f5200700 1 --2- 172.21.15.81:0/185323166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63f00fee00 0x7f63f010faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:42.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.698+0000 7f63f5200700 1 --2- 172.21.15.81:0/185323166 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f63d40692b0 0x7f63d406b760 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:42.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.698+0000 7f63f5200700 1 --2- 172.21.15.81:0/185323166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63f00ff750 0x7f63f010ffe0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:42.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.698+0000 7f63f5200700 1 -- 172.21.15.81:0/185323166 >> 172.21.15.81:0/185323166 conn(0x7f63f00fa5d0 msgr2=0x7f63f00fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:42.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.698+0000 7f63f5200700 1 -- 172.21.15.81:0/185323166 shutdown_connections 2024-04-23T14:47:42.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.699+0000 7f63f5200700 1 -- 172.21.15.81:0/185323166 wait complete. 2024-04-23T14:47:42.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.854+0000 7f56e3200700 1 -- 172.21.15.81:0/90911499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56dc0708f0 msgr2=0x7f56dc070d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:42.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.854+0000 7f56e3200700 1 --2- 172.21.15.81:0/90911499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56dc0708f0 0x7f56dc070d60 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f56cc004940 tx=0x7f56cc009e30 comp rx=0 tx=0).stop 2024-04-23T14:47:42.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.854+0000 7f56e3200700 1 -- 172.21.15.81:0/90911499 shutdown_connections 2024-04-23T14:47:42.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.854+0000 7f56e3200700 1 --2- 172.21.15.81:0/90911499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56dc0708f0 0x7f56dc070d60 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:42.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.854+0000 7f56e3200700 1 --2- 172.21.15.81:0/90911499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56dc071ea0 0x7f56dc0703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:42.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.854+0000 7f56e3200700 1 -- 172.21.15.81:0/90911499 >> 172.21.15.81:0/90911499 conn(0x7f56dc0f83d0 msgr2=0x7f56dc0fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:42.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.854+0000 7f56e3200700 1 -- 172.21.15.81:0/90911499 shutdown_connections 2024-04-23T14:47:42.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.854+0000 7f56e3200700 1 -- 172.21.15.81:0/90911499 wait complete. 2024-04-23T14:47:42.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.855+0000 7f56e3200700 1 Processor -- start 2024-04-23T14:47:42.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.855+0000 7f56e3200700 1 -- start start 2024-04-23T14:47:42.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.856+0000 7f56e3200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56dc0708f0 0x7f56dc113f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:42.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.856+0000 7f56e3200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56dc071ea0 0x7f56dc114440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:42.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.856+0000 7f56e3200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc114a40 con 0x7f56dc0708f0 2024-04-23T14:47:42.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.856+0000 7f56e3200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc115180 con 0x7f56dc071ea0 2024-04-23T14:47:42.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.856+0000 7f56e1e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56dc0708f0 0x7f56dc113f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:42.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.856+0000 7f56e1e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56dc0708f0 0x7f56dc113f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55126/0 (socket says 172.21.15.81:55126) 2024-04-23T14:47:42.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.856+0000 7f56e1e00700 1 -- 172.21.15.81:0/2060503062 learned_addr learned my addr 172.21.15.81:0/2060503062 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:47:42.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.856+0000 7f56e1400700 1 --2- 172.21.15.81:0/2060503062 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56dc071ea0 0x7f56dc114440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:42.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.856+0000 7f56e1e00700 1 -- 172.21.15.81:0/2060503062 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56dc071ea0 msgr2=0x7f56dc114440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:42.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.856+0000 7f56e1e00700 1 --2- 172.21.15.81:0/2060503062 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56dc071ea0 0x7f56dc114440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:42.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.857+0000 7f56e1e00700 1 -- 172.21.15.81:0/2060503062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56cc005040 con 0x7f56dc0708f0 2024-04-23T14:47:42.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.857+0000 7f56e1e00700 1 --2- 172.21.15.81:0/2060503062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56dc0708f0 0x7f56dc113f00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f56d0002a80 tx=0x7f56d0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:42.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.857+0000 7f56d6000700 1 -- 172.21.15.81:0/2060503062 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56d0007cc0 con 0x7f56dc0708f0 2024-04-23T14:47:42.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.857+0000 7f56d6000700 1 -- 172.21.15.81:0/2060503062 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f56d000f040 con 0x7f56dc0708f0 2024-04-23T14:47:42.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.857+0000 7f56d6000700 1 -- 172.21.15.81:0/2060503062 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56d000dad0 con 0x7f56dc0708f0 2024-04-23T14:47:42.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.857+0000 7f56e3200700 1 -- 172.21.15.81:0/2060503062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56dc115460 con 0x7f56dc0708f0 2024-04-23T14:47:42.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.857+0000 7f56e3200700 1 -- 172.21.15.81:0/2060503062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56dc115a20 con 0x7f56dc0708f0 2024-04-23T14:47:42.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.859+0000 7f56e3200700 1 -- 172.21.15.81:0/2060503062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56dc05f5f0 con 0x7f56dc0708f0 2024-04-23T14:47:42.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.860+0000 7f56d6000700 1 -- 172.21.15.81:0/2060503062 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f56d000dc30 con 0x7f56dc0708f0 2024-04-23T14:47:42.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.861+0000 7f56d6000700 1 --2- 172.21.15.81:0/2060503062 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f56c40692b0 0x7f56c406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:42.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.861+0000 7f56d6000700 1 -- 172.21.15.81:0/2060503062 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f56d0086f70 con 0x7f56dc0708f0 2024-04-23T14:47:42.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.861+0000 7f56e1400700 1 --2- 172.21.15.81:0/2060503062 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f56c40692b0 0x7f56c406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:42.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.862+0000 7f56e1400700 1 --2- 172.21.15.81:0/2060503062 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f56c40692b0 0x7f56c406b760 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f56cc00b3b0 tx=0x7f56cc009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:42.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:42.868+0000 7f56d6000700 1 -- 172.21.15.81:0/2060503062 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f56d0056c40 con 0x7f56dc0708f0 2024-04-23T14:47:43.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.109+0000 7f56e3200700 1 -- 172.21.15.81:0/2060503062 --> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f56dc115da0 con 0x7f56c40692b0 2024-04-23T14:47:43.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.126+0000 7f56d6000700 1 -- 172.21.15.81:0/2060503062 <== mgr.14210 v2:172.21.15.81:6800/1053506915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f56dc115da0 con 0x7f56c40692b0 2024-04-23T14:47:43.127 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-23T14:47:43.127 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (7m) 74s ago 8m 13.4M - 0.25.0 c8568f914cd2 730d7164defb 2024-04-23T14:47:43.127 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (9m) 74s ago 9m 6660k - 17.2.7-884-g70d0cb4b cafd8ddac8fa 6ae90c81b232 2024-04-23T14:47:43.127 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi156 smithi156 running (7m) 80s ago 7m 6660k - 17.2.7-884-g70d0cb4b cafd8ddac8fa ecc141919f37 2024-04-23T14:47:43.128 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (6m) 74s ago 8m 74.6M - 9.4.7 954c08fa6188 96965e7e10cc 2024-04-23T14:47:43.128 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.vcoywg smithi081 running (98s) 74s ago 97s 12.8M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 2ca7601ab60f 2024-04-23T14:47:43.128 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.wydgcg smithi081 running (107s) 74s ago 107s 11.6M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 58eb1a961b61 2024-04-23T14:47:43.128 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.rhbtxt smithi156 running (103s) 80s ago 103s 10.4M - 17.2.7-884-g70d0cb4b cafd8ddac8fa db3cb5034381 2024-04-23T14:47:43.128 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.vynkxn smithi156 running (94s) 80s ago 94s 10.4M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 1c8f2219e7fd 2024-04-23T14:47:43.128 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.ldghvq smithi081 *:9283 running (10m) 74s ago 10m 482M - 17.2.7-884-g70d0cb4b cafd8ddac8fa b3d1da9bbf01 2024-04-23T14:47:43.128 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi156.ounwyj smithi156 *:8443,9283 running (7m) 80s ago 7m 432M - 17.2.7-884-g70d0cb4b cafd8ddac8fa e41b78b84933 2024-04-23T14:47:43.128 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (10m) 74s ago 10m 44.6M 2048M 17.2.7-884-g70d0cb4b cafd8ddac8fa 6e43d934b336 2024-04-23T14:47:43.128 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi156 smithi156 running (7m) 80s ago 7m 34.3M 2048M 17.2.7-884-g70d0cb4b cafd8ddac8fa d9127540d3bb 2024-04-23T14:47:43.128 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (8m) 74s ago 8m 7759k - 1.5.0 0da6a335fe13 06716415b80c 2024-04-23T14:47:43.128 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi156 smithi156 *:9100 running (7m) 80s ago 7m 7532k - 1.5.0 0da6a335fe13 2d9e680be69f 2024-04-23T14:47:43.128 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (6m) 74s ago 6m 46.6M 4288M 17.2.7-884-g70d0cb4b cafd8ddac8fa 272ca032bec1 2024-04-23T14:47:43.128 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (5m) 74s ago 5m 44.7M 4288M 17.2.7-884-g70d0cb4b cafd8ddac8fa ee6d0c8af6ed 2024-04-23T14:47:43.128 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (5m) 74s ago 5m 45.0M 4288M 17.2.7-884-g70d0cb4b cafd8ddac8fa c26c640828a2 2024-04-23T14:47:43.129 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi156 running (4m) 80s ago 4m 43.8M 5312M 17.2.7-884-g70d0cb4b cafd8ddac8fa c1c261b1ee90 2024-04-23T14:47:43.129 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi156 running (4m) 80s ago 4m 40.4M 5312M 17.2.7-884-g70d0cb4b cafd8ddac8fa 83f996ee64de 2024-04-23T14:47:43.129 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi156 running (3m) 80s ago 3m 40.8M 5312M 17.2.7-884-g70d0cb4b cafd8ddac8fa b754244bef18 2024-04-23T14:47:43.129 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (6m) 74s ago 8m 46.0M - 2.43.0 a07b618ecd1d 1779b897e5df 2024-04-23T14:47:43.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.130+0000 7f56e3200700 1 -- 172.21.15.81:0/2060503062 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f56c40692b0 msgr2=0x7f56c406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:43.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.130+0000 7f56e3200700 1 --2- 172.21.15.81:0/2060503062 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f56c40692b0 0x7f56c406b760 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f56cc00b3b0 tx=0x7f56cc009e30 comp rx=0 tx=0).stop 2024-04-23T14:47:43.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.130+0000 7f56e3200700 1 -- 172.21.15.81:0/2060503062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56dc0708f0 msgr2=0x7f56dc113f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:43.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.130+0000 7f56e3200700 1 --2- 172.21.15.81:0/2060503062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56dc0708f0 0x7f56dc113f00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f56d0002a80 tx=0x7f56d0004600 comp rx=0 tx=0).stop 2024-04-23T14:47:43.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.130+0000 7f56e3200700 1 -- 172.21.15.81:0/2060503062 shutdown_connections 2024-04-23T14:47:43.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.130+0000 7f56e3200700 1 --2- 172.21.15.81:0/2060503062 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f56c40692b0 0x7f56c406b760 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:43.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.130+0000 7f56e3200700 1 --2- 172.21.15.81:0/2060503062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56dc0708f0 0x7f56dc113f00 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:43.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.130+0000 7f56e3200700 1 --2- 172.21.15.81:0/2060503062 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56dc071ea0 0x7f56dc114440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:43.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.130+0000 7f56e3200700 1 -- 172.21.15.81:0/2060503062 >> 172.21.15.81:0/2060503062 conn(0x7f56dc0f83d0 msgr2=0x7f56dc0f9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:43.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.130+0000 7f56e3200700 1 -- 172.21.15.81:0/2060503062 shutdown_connections 2024-04-23T14:47:43.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.131+0000 7f56e3200700 1 -- 172.21.15.81:0/2060503062 wait complete. 2024-04-23T14:47:43.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.295+0000 7fa3f4600700 1 -- 172.21.15.81:0/2848166201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3ec0fcef0 msgr2=0x7fa3ec0fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:43.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.295+0000 7fa3f4600700 1 --2- 172.21.15.81:0/2848166201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3ec0fcef0 0x7fa3ec0fd320 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0004940 tx=0x7fa3e0009e30 comp rx=0 tx=0).stop 2024-04-23T14:47:43.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.295+0000 7fa3f4600700 1 -- 172.21.15.81:0/2848166201 shutdown_connections 2024-04-23T14:47:43.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.295+0000 7fa3f4600700 1 --2- 172.21.15.81:0/2848166201 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3ec0fe0e0 0x7fa3ec0fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:43.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.295+0000 7fa3f4600700 1 --2- 172.21.15.81:0/2848166201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3ec0fcef0 0x7fa3ec0fd320 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:43.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.295+0000 7fa3f4600700 1 -- 172.21.15.81:0/2848166201 >> 172.21.15.81:0/2848166201 conn(0x7fa3ec0f8530 msgr2=0x7fa3ec0fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:43.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.295+0000 7fa3f4600700 1 -- 172.21.15.81:0/2848166201 shutdown_connections 2024-04-23T14:47:43.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.295+0000 7fa3f4600700 1 -- 172.21.15.81:0/2848166201 wait complete. 2024-04-23T14:47:43.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.296+0000 7fa3f4600700 1 Processor -- start 2024-04-23T14:47:43.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.296+0000 7fa3f4600700 1 -- start start 2024-04-23T14:47:43.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.297+0000 7fa3f4600700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3ec0fcef0 0x7fa3ec114080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:43.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.297+0000 7fa3f4600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3ec0fe0e0 0x7fa3ec1145c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:43.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.297+0000 7fa3f4600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec114bc0 con 0x7fa3ec0fe0e0 2024-04-23T14:47:43.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.297+0000 7fa3f4600700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec115410 con 0x7fa3ec0fcef0 2024-04-23T14:47:43.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.297+0000 7fa3f1200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3ec0fe0e0 0x7fa3ec1145c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:43.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.298+0000 7fa3f1200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3ec0fe0e0 0x7fa3ec1145c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55142/0 (socket says 172.21.15.81:55142) 2024-04-23T14:47:43.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.298+0000 7fa3f1200700 1 -- 172.21.15.81:0/1513531021 learned_addr learned my addr 172.21.15.81:0/1513531021 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:47:43.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.298+0000 7fa3f1c00700 1 --2- 172.21.15.81:0/1513531021 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3ec0fcef0 0x7fa3ec114080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:43.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.298+0000 7fa3f1200700 1 -- 172.21.15.81:0/1513531021 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3ec0fcef0 msgr2=0x7fa3ec114080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:43.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.298+0000 7fa3f1200700 1 --2- 172.21.15.81:0/1513531021 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3ec0fcef0 0x7fa3ec114080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:43.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.298+0000 7fa3f1200700 1 -- 172.21.15.81:0/1513531021 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e0005040 con 0x7fa3ec0fe0e0 2024-04-23T14:47:43.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.298+0000 7fa3f1200700 1 --2- 172.21.15.81:0/1513531021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3ec0fe0e0 0x7fa3ec1145c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8002a50 tx=0x7fa3d80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:43.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.299+0000 7fa3e9600700 1 -- 172.21.15.81:0/1513531021 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3d8007cc0 con 0x7fa3ec0fe0e0 2024-04-23T14:47:43.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.299+0000 7fa3e9600700 1 -- 172.21.15.81:0/1513531021 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa3d800f040 con 0x7fa3ec0fe0e0 2024-04-23T14:47:43.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.299+0000 7fa3e9600700 1 -- 172.21.15.81:0/1513531021 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3d800da30 con 0x7fa3ec0fe0e0 2024-04-23T14:47:43.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.299+0000 7fa3f4600700 1 -- 172.21.15.81:0/1513531021 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3ec1156f0 con 0x7fa3ec0fe0e0 2024-04-23T14:47:43.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.299+0000 7fa3f4600700 1 -- 172.21.15.81:0/1513531021 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3ec115c30 con 0x7fa3ec0fe0e0 2024-04-23T14:47:43.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.300+0000 7fa3f4600700 1 -- 172.21.15.81:0/1513531021 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3ec05f5f0 con 0x7fa3ec0fe0e0 2024-04-23T14:47:43.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.302+0000 7fa3e9600700 1 -- 172.21.15.81:0/1513531021 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fa3d800db90 con 0x7fa3ec0fe0e0 2024-04-23T14:47:43.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.303+0000 7fa3e9600700 1 --2- 172.21.15.81:0/1513531021 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fa3d40692b0 0x7fa3d406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:43.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.303+0000 7fa3e9600700 1 -- 172.21.15.81:0/1513531021 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fa3d8086ec0 con 0x7fa3ec0fe0e0 2024-04-23T14:47:43.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.304+0000 7fa3f1c00700 1 --2- 172.21.15.81:0/1513531021 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fa3d40692b0 0x7fa3d406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:43.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.305+0000 7fa3f1c00700 1 --2- 172.21.15.81:0/1513531021 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fa3d40692b0 0x7fa3d406b760 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa3e000b3b0 tx=0x7fa3e0009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:43.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.308+0000 7fa3e9600700 1 -- 172.21.15.81:0/1513531021 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa3d8056c30 con 0x7fa3ec0fe0e0 2024-04-23T14:47:43.472 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:43 smithi081 ceph-mon[25540]: pgmap v275: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-04-23T14:47:43.472 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:43 smithi081 ceph-mon[25540]: from='client.14582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:47:43.472 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:43 smithi081 ceph-mon[25540]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:47:43.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:43 smithi156 ceph-mon[32341]: pgmap v275: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-04-23T14:47:43.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:43 smithi156 ceph-mon[32341]: from='client.14582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:47:43.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:43 smithi156 ceph-mon[32341]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:47:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.637+0000 7fa3f4600700 1 -- 172.21.15.81:0/1513531021 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa3ec0717f0 con 0x7fa3ec0fe0e0 2024-04-23T14:47:43.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.638+0000 7fa3e9600700 1 -- 172.21.15.81:0/1513531021 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7fa3d80567c0 con 0x7fa3ec0fe0e0 2024-04-23T14:47:43.639 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:47:43.639 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-04-23T14:47:43.639 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 2 2024-04-23T14:47:43.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:47:43.639 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-04-23T14:47:43.639 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 2 2024-04-23T14:47:43.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:47:43.640 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-04-23T14:47:43.640 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 6 2024-04-23T14:47:43.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:47:43.640 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-04-23T14:47:43.640 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 4 2024-04-23T14:47:43.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:47:43.640 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-04-23T14:47:43.640 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 14 2024-04-23T14:47:43.640 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-23T14:47:43.640 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:47:43.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.642+0000 7fa3f4600700 1 -- 172.21.15.81:0/1513531021 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fa3d40692b0 msgr2=0x7fa3d406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:43.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.642+0000 7fa3f4600700 1 --2- 172.21.15.81:0/1513531021 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fa3d40692b0 0x7fa3d406b760 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa3e000b3b0 tx=0x7fa3e0009e30 comp rx=0 tx=0).stop 2024-04-23T14:47:43.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.642+0000 7fa3f4600700 1 -- 172.21.15.81:0/1513531021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3ec0fe0e0 msgr2=0x7fa3ec1145c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:43.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.642+0000 7fa3f4600700 1 --2- 172.21.15.81:0/1513531021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3ec0fe0e0 0x7fa3ec1145c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8002a50 tx=0x7fa3d80046b0 comp rx=0 tx=0).stop 2024-04-23T14:47:43.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.642+0000 7fa3f4600700 1 -- 172.21.15.81:0/1513531021 shutdown_connections 2024-04-23T14:47:43.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.642+0000 7fa3f4600700 1 --2- 172.21.15.81:0/1513531021 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3ec0fcef0 0x7fa3ec114080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:43.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.642+0000 7fa3f4600700 1 --2- 172.21.15.81:0/1513531021 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fa3d40692b0 0x7fa3d406b760 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:43.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.642+0000 7fa3f4600700 1 --2- 172.21.15.81:0/1513531021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3ec0fe0e0 0x7fa3ec1145c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:43.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.642+0000 7fa3f4600700 1 -- 172.21.15.81:0/1513531021 >> 172.21.15.81:0/1513531021 conn(0x7fa3ec0f8530 msgr2=0x7fa3ec0f9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:43.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.643+0000 7fa3f4600700 1 -- 172.21.15.81:0/1513531021 shutdown_connections 2024-04-23T14:47:43.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.643+0000 7fa3f4600700 1 -- 172.21.15.81:0/1513531021 wait complete. 2024-04-23T14:47:43.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.791+0000 7f15c4000700 1 -- 172.21.15.81:0/2923153852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15bc071e20 msgr2=0x7f15bc070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:43.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.791+0000 7f15c4000700 1 --2- 172.21.15.81:0/2923153852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15bc071e20 0x7f15bc070330 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f15b0004940 tx=0x7f15b0009e30 comp rx=0 tx=0).stop 2024-04-23T14:47:43.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.791+0000 7f15c4000700 1 -- 172.21.15.81:0/2923153852 shutdown_connections 2024-04-23T14:47:43.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.791+0000 7f15c4000700 1 --2- 172.21.15.81:0/2923153852 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15bc070870 0x7f15bc070ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:43.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.791+0000 7f15c4000700 1 --2- 172.21.15.81:0/2923153852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15bc071e20 0x7f15bc070330 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:43.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.791+0000 7f15c4000700 1 -- 172.21.15.81:0/2923153852 >> 172.21.15.81:0/2923153852 conn(0x7f15bc0f8590 msgr2=0x7f15bc0fa9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:43.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.791+0000 7f15c4000700 1 -- 172.21.15.81:0/2923153852 shutdown_connections 2024-04-23T14:47:43.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.792+0000 7f15c4000700 1 -- 172.21.15.81:0/2923153852 wait complete. 2024-04-23T14:47:43.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.792+0000 7f15c4000700 1 Processor -- start 2024-04-23T14:47:43.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.793+0000 7f15c4000700 1 -- start start 2024-04-23T14:47:43.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.793+0000 7f15c4000700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15bc070870 0x7f15bc10fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:43.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.793+0000 7f15c4000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15bc071e20 0x7f15bc110190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:43.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.793+0000 7f15c4000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc110790 con 0x7f15bc071e20 2024-04-23T14:47:43.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.793+0000 7f15c4000700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc110fe0 con 0x7f15bc070870 2024-04-23T14:47:43.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.793+0000 7f15c0c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15bc071e20 0x7f15bc110190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:43.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.793+0000 7f15c0c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15bc071e20 0x7f15bc110190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55150/0 (socket says 172.21.15.81:55150) 2024-04-23T14:47:43.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.793+0000 7f15c0c00700 1 -- 172.21.15.81:0/1786776499 learned_addr learned my addr 172.21.15.81:0/1786776499 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:47:43.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.794+0000 7f15c0c00700 1 -- 172.21.15.81:0/1786776499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15bc070870 msgr2=0x7f15bc10fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:43.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.794+0000 7f15c0c00700 1 --2- 172.21.15.81:0/1786776499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15bc070870 0x7f15bc10fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:43.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.794+0000 7f15c0c00700 1 -- 172.21.15.81:0/1786776499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b0005040 con 0x7f15bc071e20 2024-04-23T14:47:43.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.794+0000 7f15c0c00700 1 --2- 172.21.15.81:0/1786776499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15bc071e20 0x7f15bc110190 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f15a8002a50 tx=0x7f15a80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:43.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.795+0000 7f15b9600700 1 -- 172.21.15.81:0/1786776499 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15a8007cc0 con 0x7f15bc071e20 2024-04-23T14:47:43.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.795+0000 7f15b9600700 1 -- 172.21.15.81:0/1786776499 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f15a800f040 con 0x7f15bc071e20 2024-04-23T14:47:43.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.795+0000 7f15c4000700 1 -- 172.21.15.81:0/1786776499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15bc1112c0 con 0x7f15bc071e20 2024-04-23T14:47:43.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.795+0000 7f15c4000700 1 -- 172.21.15.81:0/1786776499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15bc111800 con 0x7f15bc071e20 2024-04-23T14:47:43.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.795+0000 7f15b9600700 1 -- 172.21.15.81:0/1786776499 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15a8009640 con 0x7f15bc071e20 2024-04-23T14:47:43.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.796+0000 7f15c4000700 1 -- 172.21.15.81:0/1786776499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15bc05f5f0 con 0x7f15bc071e20 2024-04-23T14:47:43.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.797+0000 7f15b9600700 1 -- 172.21.15.81:0/1786776499 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f15a80097a0 con 0x7f15bc071e20 2024-04-23T14:47:43.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.799+0000 7f15b9600700 1 --2- 172.21.15.81:0/1786776499 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f15a40692a0 0x7f15a406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:43.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.799+0000 7f15b9600700 1 -- 172.21.15.81:0/1786776499 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f15a8086f10 con 0x7f15bc071e20 2024-04-23T14:47:43.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.799+0000 7f15c1600700 1 --2- 172.21.15.81:0/1786776499 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f15a40692a0 0x7f15a406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:43.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.800+0000 7f15c1600700 1 --2- 172.21.15.81:0/1786776499 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f15a40692a0 0x7f15a406b750 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f15b0004f90 tx=0x7f15b0009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:43.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:43.803+0000 7f15b9600700 1 -- 172.21.15.81:0/1786776499 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f15a8056c80 con 0x7f15bc071e20 2024-04-23T14:47:44.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.120+0000 7f15c4000700 1 -- 172.21.15.81:0/1786776499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f15bc111bf0 con 0x7f15bc071e20 2024-04-23T14:47:44.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.120+0000 7f15b9600700 1 -- 172.21.15.81:0/1786776499 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1837 (secure 0 0 0) 0x7f15a8056810 con 0x7f15bc071e20 2024-04-23T14:47:44.121 INFO:teuthology.orchestra.run.smithi081.stdout:e18 2024-04-23T14:47:44.121 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-23T14:47:44.122 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:47:44.122 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-04-23T14:47:44.122 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:47:44.122 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-04-23T14:47:44.122 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-04-23T14:47:44.122 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 17 2024-04-23T14:47:44.122 INFO:teuthology.orchestra.run.smithi081.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-23T14:47:44.122 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-04-23T14:45:51.264703+0000 2024-04-23T14:47:44.122 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-04-23T14:46:12.782992+0000 2024-04-23T14:47:44.123 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-04-23T14:47:44.123 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-04-23T14:47:44.123 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-04-23T14:47:44.123 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-04-23T14:47:44.123 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-04-23T14:47:44.123 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-04-23T14:47:44.123 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-04-23T14:47:44.123 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 47 2024-04-23T14:47:44.123 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:47:44.124 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 1 2024-04-23T14:47:44.124 INFO:teuthology.orchestra.run.smithi081.stdout:in 0 2024-04-23T14:47:44.124 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=14472} 2024-04-23T14:47:44.124 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-04-23T14:47:44.124 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-04-23T14:47:44.124 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-04-23T14:47:44.124 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-04-23T14:47:44.124 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-04-23T14:47:44.125 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-04-23T14:47:44.125 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-04-23T14:47:44.125 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-04-23T14:47:44.125 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.vcoywg{0:14472} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.81:6828/2563365650,v1:172.21.15.81:6829/2563365650] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:47:44.125 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.wydgcg{0:14482} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.81:6826/759909104,v1:172.21.15.81:6827/759909104] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:47:44.125 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:47:44.125 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:47:44.125 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-04-23T14:47:44.125 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:47:44.126 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.vynkxn{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.156:6826/1794690362,v1:172.21.15.156:6827/1794690362] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:47:44.126 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.rhbtxt{-1:24263} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.156:6824/3854041261,v1:172.21.15.156:6825/3854041261] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:47:44.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.123+0000 7f15c4000700 1 -- 172.21.15.81:0/1786776499 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f15a40692a0 msgr2=0x7f15a406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:44.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.123+0000 7f15c4000700 1 --2- 172.21.15.81:0/1786776499 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f15a40692a0 0x7f15a406b750 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f15b0004f90 tx=0x7f15b0009e30 comp rx=0 tx=0).stop 2024-04-23T14:47:44.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.123+0000 7f15c4000700 1 -- 172.21.15.81:0/1786776499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15bc071e20 msgr2=0x7f15bc110190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:44.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.123+0000 7f15c4000700 1 --2- 172.21.15.81:0/1786776499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15bc071e20 0x7f15bc110190 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f15a8002a50 tx=0x7f15a80046b0 comp rx=0 tx=0).stop 2024-04-23T14:47:44.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.123+0000 7f15c4000700 1 -- 172.21.15.81:0/1786776499 shutdown_connections 2024-04-23T14:47:44.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.123+0000 7f15c4000700 1 --2- 172.21.15.81:0/1786776499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15bc070870 0x7f15bc10fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:44.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.123+0000 7f15c4000700 1 --2- 172.21.15.81:0/1786776499 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f15a40692a0 0x7f15a406b750 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:44.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.123+0000 7f15c4000700 1 --2- 172.21.15.81:0/1786776499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15bc071e20 0x7f15bc110190 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:44.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.123+0000 7f15c4000700 1 -- 172.21.15.81:0/1786776499 >> 172.21.15.81:0/1786776499 conn(0x7f15bc0f8590 msgr2=0x7f15bc0f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:44.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.123+0000 7f15c4000700 1 -- 172.21.15.81:0/1786776499 shutdown_connections 2024-04-23T14:47:44.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.123+0000 7f15c4000700 1 -- 172.21.15.81:0/1786776499 wait complete. 2024-04-23T14:47:44.128 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 18 2024-04-23T14:47:44.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.276+0000 7f429d400700 1 -- 172.21.15.81:0/2664931472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42980fcff0 msgr2=0x7f42980fd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:44.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.276+0000 7f429d400700 1 --2- 172.21.15.81:0/2664931472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42980fcff0 0x7f42980fd460 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4284004940 tx=0x7f4284009e30 comp rx=0 tx=0).stop 2024-04-23T14:47:44.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.277+0000 7f429d400700 1 -- 172.21.15.81:0/2664931472 shutdown_connections 2024-04-23T14:47:44.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.277+0000 7f429d400700 1 --2- 172.21.15.81:0/2664931472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42980fcff0 0x7f42980fd460 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:44.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.277+0000 7f429d400700 1 --2- 172.21.15.81:0/2664931472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42980fbd40 0x7f42980fc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:44.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.277+0000 7f429d400700 1 -- 172.21.15.81:0/2664931472 >> 172.21.15.81:0/2664931472 conn(0x7f42980f74c0 msgr2=0x7f42980f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:44.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.277+0000 7f429d400700 1 -- 172.21.15.81:0/2664931472 shutdown_connections 2024-04-23T14:47:44.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.277+0000 7f429d400700 1 -- 172.21.15.81:0/2664931472 wait complete. 2024-04-23T14:47:44.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.278+0000 7f429d400700 1 Processor -- start 2024-04-23T14:47:44.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.278+0000 7f429d400700 1 -- start start 2024-04-23T14:47:44.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.278+0000 7f429d400700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42980fbd40 0x7f4298104ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:44.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.278+0000 7f429d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42980fcff0 0x7f4298105400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:44.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.278+0000 7f429d400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4298105a50 con 0x7f42980fcff0 2024-04-23T14:47:44.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.278+0000 7f429d400700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42981062a0 con 0x7f42980fbd40 2024-04-23T14:47:44.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.279+0000 7f4296800700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42980fbd40 0x7f4298104ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:44.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.279+0000 7f4295e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42980fcff0 0x7f4298105400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:44.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.279+0000 7f4296800700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42980fbd40 0x7f4298104ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.81:55020/0 (socket says 172.21.15.81:55020) 2024-04-23T14:47:44.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.279+0000 7f4296800700 1 -- 172.21.15.81:0/3504443957 learned_addr learned my addr 172.21.15.81:0/3504443957 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:47:44.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.279+0000 7f4295e00700 1 -- 172.21.15.81:0/3504443957 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42980fbd40 msgr2=0x7f4298104ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:44.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.279+0000 7f4295e00700 1 --2- 172.21.15.81:0/3504443957 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42980fbd40 0x7f4298104ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:44.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.279+0000 7f4295e00700 1 -- 172.21.15.81:0/3504443957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4284005040 con 0x7f42980fcff0 2024-04-23T14:47:44.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.279+0000 7f4296800700 1 --2- 172.21.15.81:0/3504443957 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42980fbd40 0x7f4298104ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T14:47:44.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.280+0000 7f4295e00700 1 --2- 172.21.15.81:0/3504443957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42980fcff0 0x7f4298105400 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f428400b0d0 tx=0x7f4284009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:44.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.280+0000 7f428ea00700 1 -- 172.21.15.81:0/3504443957 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f428400e070 con 0x7f42980fcff0 2024-04-23T14:47:44.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.280+0000 7f428ea00700 1 -- 172.21.15.81:0/3504443957 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f428400b410 con 0x7f42980fcff0 2024-04-23T14:47:44.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.280+0000 7f428ea00700 1 -- 172.21.15.81:0/3504443957 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4284012600 con 0x7f42980fcff0 2024-04-23T14:47:44.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.280+0000 7f429d400700 1 -- 172.21.15.81:0/3504443957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4298106520 con 0x7f42980fcff0 2024-04-23T14:47:44.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.280+0000 7f429d400700 1 -- 172.21.15.81:0/3504443957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4298106ae0 con 0x7f42980fcff0 2024-04-23T14:47:44.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.282+0000 7f4283e00700 1 -- 172.21.15.81:0/3504443957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f429805f5f0 con 0x7f42980fcff0 2024-04-23T14:47:44.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.283+0000 7f428ea00700 1 -- 172.21.15.81:0/3504443957 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f428400baa0 con 0x7f42980fcff0 2024-04-23T14:47:44.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.284+0000 7f428ea00700 1 --2- 172.21.15.81:0/3504443957 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f427c0692a0 0x7f427c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:44.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.284+0000 7f428ea00700 1 -- 172.21.15.81:0/3504443957 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f4284087a10 con 0x7f42980fcff0 2024-04-23T14:47:44.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.284+0000 7f4296800700 1 --2- 172.21.15.81:0/3504443957 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f427c0692a0 0x7f427c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:44.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.285+0000 7f4296800700 1 --2- 172.21.15.81:0/3504443957 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f427c0692a0 0x7f427c06b750 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4298104c50 tx=0x7f428800b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:44.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.288+0000 7f428ea00700 1 -- 172.21.15.81:0/3504443957 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f4284053d90 con 0x7f42980fcff0 2024-04-23T14:47:44.409 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:44 smithi081 ceph-mon[25540]: from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:47:44.409 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:44 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/1513531021' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:47:44.409 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:44 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/1786776499' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:47:44.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.529+0000 7f4283e00700 1 -- 172.21.15.81:0/3504443957 --> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f42981037e0 con 0x7f427c0692a0 2024-04-23T14:47:44.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.531+0000 7f428ea00700 1 -- 172.21.15.81:0/3504443957 <== mgr.14210 v2:172.21.15.81:6800/1053506915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f42981037e0 con 0x7f427c0692a0 2024-04-23T14:47:44.532 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:47:44.532 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0", 2024-04-23T14:47:44.532 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-04-23T14:47:44.532 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-23T14:47:44.532 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [], 2024-04-23T14:47:44.532 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "", 2024-04-23T14:47:44.532 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:d44fddd910b5e94da0f2357af4be37d7bd495ae0 image", 2024-04-23T14:47:44.532 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-04-23T14:47:44.533 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:47:44.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.534+0000 7f4283e00700 1 -- 172.21.15.81:0/3504443957 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f427c0692a0 msgr2=0x7f427c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:44.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.534+0000 7f4283e00700 1 --2- 172.21.15.81:0/3504443957 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f427c0692a0 0x7f427c06b750 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4298104c50 tx=0x7f428800b040 comp rx=0 tx=0).stop 2024-04-23T14:47:44.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.534+0000 7f4283e00700 1 -- 172.21.15.81:0/3504443957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42980fcff0 msgr2=0x7f4298105400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:44.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.534+0000 7f4283e00700 1 --2- 172.21.15.81:0/3504443957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42980fcff0 0x7f4298105400 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f428400b0d0 tx=0x7f4284009e30 comp rx=0 tx=0).stop 2024-04-23T14:47:44.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.534+0000 7f4283e00700 1 -- 172.21.15.81:0/3504443957 shutdown_connections 2024-04-23T14:47:44.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.534+0000 7f4283e00700 1 --2- 172.21.15.81:0/3504443957 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42980fbd40 0x7f4298104ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:44.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.534+0000 7f4283e00700 1 --2- 172.21.15.81:0/3504443957 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f427c0692a0 0x7f427c06b750 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:44.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.534+0000 7f4283e00700 1 --2- 172.21.15.81:0/3504443957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42980fcff0 0x7f4298105400 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:44.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.534+0000 7f4283e00700 1 -- 172.21.15.81:0/3504443957 >> 172.21.15.81:0/3504443957 conn(0x7f42980f74c0 msgr2=0x7f42980f8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:44.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.534+0000 7f4283e00700 1 -- 172.21.15.81:0/3504443957 shutdown_connections 2024-04-23T14:47:44.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.534+0000 7f4283e00700 1 -- 172.21.15.81:0/3504443957 wait complete. 2024-04-23T14:47:44.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:44 smithi156 ceph-mon[32341]: from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:47:44.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:44 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/1513531021' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:47:44.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:44 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/1786776499' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:47:44.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.699+0000 7fb4d2400700 1 -- 172.21.15.81:0/3018804653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4cc0ff750 msgr2=0x7fb4cc1000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:44.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.699+0000 7fb4d2400700 1 --2- 172.21.15.81:0/3018804653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4cc0ff750 0x7fb4cc1000b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8004940 tx=0x7fb4b8009e30 comp rx=0 tx=0).stop 2024-04-23T14:47:44.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.700+0000 7fb4d2400700 1 -- 172.21.15.81:0/3018804653 shutdown_connections 2024-04-23T14:47:44.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.700+0000 7fb4d2400700 1 --2- 172.21.15.81:0/3018804653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4cc0ff750 0x7fb4cc1000b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:44.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.700+0000 7fb4d2400700 1 --2- 172.21.15.81:0/3018804653 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4cc0fee00 0x7fb4cc0ff210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:44.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.700+0000 7fb4d2400700 1 -- 172.21.15.81:0/3018804653 >> 172.21.15.81:0/3018804653 conn(0x7fb4cc0fa5d0 msgr2=0x7fb4cc0fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:44.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.700+0000 7fb4d2400700 1 -- 172.21.15.81:0/3018804653 shutdown_connections 2024-04-23T14:47:44.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.700+0000 7fb4d2400700 1 -- 172.21.15.81:0/3018804653 wait complete. 2024-04-23T14:47:44.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.701+0000 7fb4d2400700 1 Processor -- start 2024-04-23T14:47:44.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.701+0000 7fb4d2400700 1 -- start start 2024-04-23T14:47:44.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.702+0000 7fb4d2400700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4cc0fee00 0x7fb4cc10fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:44.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.702+0000 7fb4d2400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4cc0ff750 0x7fb4cc10fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:44.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.702+0000 7fb4d2400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4cc1105f0 con 0x7fb4cc0ff750 2024-04-23T14:47:44.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.702+0000 7fb4d2400700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4cc110e40 con 0x7fb4cc0fee00 2024-04-23T14:47:44.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.702+0000 7fb4d1000700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4cc0fee00 0x7fb4cc10fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:44.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.702+0000 7fb4d1000700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4cc0fee00 0x7fb4cc10fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.81:55026/0 (socket says 172.21.15.81:55026) 2024-04-23T14:47:44.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.702+0000 7fb4d1000700 1 -- 172.21.15.81:0/300326988 learned_addr learned my addr 172.21.15.81:0/300326988 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:47:44.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.703+0000 7fb4cbe00700 1 --2- 172.21.15.81:0/300326988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4cc0ff750 0x7fb4cc10fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:44.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.703+0000 7fb4d1000700 1 -- 172.21.15.81:0/300326988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4cc0ff750 msgr2=0x7fb4cc10fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:44.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.703+0000 7fb4d1000700 1 --2- 172.21.15.81:0/300326988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4cc0ff750 0x7fb4cc10fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:44.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.703+0000 7fb4d1000700 1 -- 172.21.15.81:0/300326988 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b8005040 con 0x7fb4cc0fee00 2024-04-23T14:47:44.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.703+0000 7fb4cbe00700 1 --2- 172.21.15.81:0/300326988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4cc0ff750 0x7fb4cc10fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:47:44.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.703+0000 7fb4d1000700 1 --2- 172.21.15.81:0/300326988 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4cc0fee00 0x7fb4cc10fab0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb4c0002a80 tx=0x7fb4c0004600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:44.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.704+0000 7fb4c8c00700 1 -- 172.21.15.81:0/300326988 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4c0007cc0 con 0x7fb4cc0fee00 2024-04-23T14:47:44.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.704+0000 7fb4c8c00700 1 -- 172.21.15.81:0/300326988 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb4c000f040 con 0x7fb4cc0fee00 2024-04-23T14:47:44.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.704+0000 7fb4d2400700 1 -- 172.21.15.81:0/300326988 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4cc111120 con 0x7fb4cc0fee00 2024-04-23T14:47:44.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.704+0000 7fb4c8c00700 1 -- 172.21.15.81:0/300326988 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4c000dae0 con 0x7fb4cc0fee00 2024-04-23T14:47:44.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.704+0000 7fb4d2400700 1 -- 172.21.15.81:0/300326988 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4cc111660 con 0x7fb4cc0fee00 2024-04-23T14:47:44.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.705+0000 7fb4d2400700 1 -- 172.21.15.81:0/300326988 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4cc05f5f0 con 0x7fb4cc0fee00 2024-04-23T14:47:44.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.707+0000 7fb4c8c00700 1 -- 172.21.15.81:0/300326988 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fb4c000dc40 con 0x7fb4cc0fee00 2024-04-23T14:47:44.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.708+0000 7fb4c8c00700 1 --2- 172.21.15.81:0/300326988 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fb4b4069370 0x7fb4b406b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:47:44.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.708+0000 7fb4c8c00700 1 -- 172.21.15.81:0/300326988 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fb4c0086e60 con 0x7fb4cc0fee00 2024-04-23T14:47:44.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.709+0000 7fb4cbe00700 1 --2- 172.21.15.81:0/300326988 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fb4b4069370 0x7fb4b406b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:47:44.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.710+0000 7fb4cbe00700 1 --2- 172.21.15.81:0/300326988 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fb4b4069370 0x7fb4b406b820 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb4b800b970 tx=0x7fb4b8009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:47:44.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:44.717+0000 7fb4c8c00700 1 -- 172.21.15.81:0/300326988 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fb4c0056b30 con 0x7fb4cc0fee00 2024-04-23T14:47:45.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:45.194+0000 7fb4d2400700 1 -- 172.21.15.81:0/300326988 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb4cc107920 con 0x7fb4cc0fee00 2024-04-23T14:47:45.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:45.195+0000 7fb4c8c00700 1 -- 172.21.15.81:0/300326988 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fb4c00566c0 con 0x7fb4cc0fee00 2024-04-23T14:47:45.196 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-04-23T14:47:45.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:45.198+0000 7fb4d2400700 1 -- 172.21.15.81:0/300326988 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fb4b4069370 msgr2=0x7fb4b406b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:45.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:45.198+0000 7fb4d2400700 1 --2- 172.21.15.81:0/300326988 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fb4b4069370 0x7fb4b406b820 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb4b800b970 tx=0x7fb4b8009e30 comp rx=0 tx=0).stop 2024-04-23T14:47:45.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:45.199+0000 7fb4d2400700 1 -- 172.21.15.81:0/300326988 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4cc0fee00 msgr2=0x7fb4cc10fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:47:45.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:45.199+0000 7fb4d2400700 1 --2- 172.21.15.81:0/300326988 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4cc0fee00 0x7fb4cc10fab0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb4c0002a80 tx=0x7fb4c0004600 comp rx=0 tx=0).stop 2024-04-23T14:47:45.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:45.199+0000 7fb4d2400700 1 -- 172.21.15.81:0/300326988 shutdown_connections 2024-04-23T14:47:45.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:45.199+0000 7fb4d2400700 1 --2- 172.21.15.81:0/300326988 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4cc0fee00 0x7fb4cc10fab0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:45.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:45.199+0000 7fb4d2400700 1 --2- 172.21.15.81:0/300326988 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7fb4b4069370 0x7fb4b406b820 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:45.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:45.199+0000 7fb4d2400700 1 --2- 172.21.15.81:0/300326988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4cc0ff750 0x7fb4cc10fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:47:45.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:45.199+0000 7fb4d2400700 1 -- 172.21.15.81:0/300326988 >> 172.21.15.81:0/300326988 conn(0x7fb4cc0fa5d0 msgr2=0x7fb4cc0fbcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:47:45.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:45.199+0000 7fb4d2400700 1 -- 172.21.15.81:0/300326988 shutdown_connections 2024-04-23T14:47:45.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:47:45.199+0000 7fb4d2400700 1 -- 172.21.15.81:0/300326988 wait complete. 2024-04-23T14:47:45.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:45 smithi156 ceph-mon[32341]: pgmap v276: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:47:45.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:45 smithi156 ceph-mon[32341]: from='client.14602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:47:45.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:45 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:47:45.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:45 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:47:45.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:45 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:47:45.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:45 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/300326988' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:47:45.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:45 smithi081 ceph-mon[25540]: pgmap v276: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:47:45.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:45 smithi081 ceph-mon[25540]: from='client.14602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:47:45.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:45 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:47:45.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:45 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:47:45.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:45 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:47:45.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:45 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/300326988' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:47:46.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:46 smithi156 ceph-mon[32341]: Upgrade: Target is version 19.0.0-3126-gd44fddd9 (unknown) 2024-04-23T14:47:46.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:46 smithi156 ceph-mon[32341]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, digests ['quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd'] 2024-04-23T14:47:46.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:46 smithi156 ceph-mon[32341]: Upgrade: Need to upgrade myself (mgr.smithi081.ldghvq) 2024-04-23T14:47:46.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:46 smithi156 ceph-mon[32341]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd on smithi156 2024-04-23T14:47:46.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:46 smithi081 ceph-mon[25540]: Upgrade: Target is version 19.0.0-3126-gd44fddd9 (unknown) 2024-04-23T14:47:46.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:46 smithi081 ceph-mon[25540]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, digests ['quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd'] 2024-04-23T14:47:46.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:46 smithi081 ceph-mon[25540]: Upgrade: Need to upgrade myself (mgr.smithi081.ldghvq) 2024-04-23T14:47:46.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:46 smithi081 ceph-mon[25540]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd on smithi156 2024-04-23T14:47:47.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:47 smithi156 ceph-mon[32341]: pgmap v277: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:47:47.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:47 smithi081 ceph-mon[25540]: pgmap v277: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:47:49.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:49 smithi156 ceph-mon[32341]: pgmap v278: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:47:49.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:49 smithi081 ceph-mon[25540]: pgmap v278: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:47:51.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:51 smithi156 ceph-mon[32341]: pgmap v279: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:47:51.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:51 smithi081 ceph-mon[25540]: pgmap v279: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:47:53.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:53 smithi156 ceph-mon[32341]: pgmap v280: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:47:53.672 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:53 smithi081 ceph-mon[25540]: pgmap v280: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:47:55.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:55 smithi156 ceph-mon[32341]: pgmap v281: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:47:55.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:55 smithi081 ceph-mon[25540]: pgmap v281: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:47:57.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:57 smithi156 ceph-mon[32341]: pgmap v282: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:47:57.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:57 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:47:57.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:57 smithi081 ceph-mon[25540]: pgmap v282: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:47:57.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:57 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:47:59.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:47:59 smithi156 ceph-mon[32341]: pgmap v283: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:47:59.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:47:59 smithi081 ceph-mon[25540]: pgmap v283: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:48:01.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:01 smithi156 ceph-mon[32341]: pgmap v284: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:48:01.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:01 smithi081 ceph-mon[25540]: pgmap v284: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:48:03.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:03 smithi156 ceph-mon[32341]: pgmap v285: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:48:03.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:03 smithi081 ceph-mon[25540]: pgmap v285: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:48:05.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:05 smithi156 ceph-mon[32341]: pgmap v286: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:48:05.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:05 smithi081 ceph-mon[25540]: pgmap v286: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:48:07.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:07 smithi156 ceph-mon[32341]: pgmap v287: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:48:07.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:07 smithi081 ceph-mon[25540]: pgmap v287: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:48:09.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:09 smithi081 ceph-mon[25540]: pgmap v288: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:48:09.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:09 smithi156 ceph-mon[32341]: pgmap v288: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:48:11.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:11 smithi081 ceph-mon[25540]: pgmap v289: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:48:11.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:11 smithi156 ceph-mon[32341]: pgmap v289: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:48:12.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:12 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:48:12.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:12 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:48:13.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:13 smithi081 ceph-mon[25540]: pgmap v290: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:48:13.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:13 smithi156 ceph-mon[32341]: pgmap v290: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:48:15.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.363+0000 7f1434e00700 1 -- 172.21.15.81:0/1371310423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14300fdee0 msgr2=0x7f14300fe350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:15.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.363+0000 7f1434e00700 1 --2- 172.21.15.81:0/1371310423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14300fdee0 0x7f14300fe350 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f141c004940 tx=0x7f141c009e30 comp rx=0 tx=0).stop 2024-04-23T14:48:15.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.363+0000 7f1434e00700 1 -- 172.21.15.81:0/1371310423 shutdown_connections 2024-04-23T14:48:15.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.363+0000 7f1434e00700 1 --2- 172.21.15.81:0/1371310423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14300fdee0 0x7f14300fe350 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:15.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.363+0000 7f1434e00700 1 --2- 172.21.15.81:0/1371310423 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14300fcc30 0x7f14300fd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:15.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.363+0000 7f1434e00700 1 -- 172.21.15.81:0/1371310423 >> 172.21.15.81:0/1371310423 conn(0x7f14300f83d0 msgr2=0x7f14300fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:15.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.363+0000 7f1434e00700 1 -- 172.21.15.81:0/1371310423 shutdown_connections 2024-04-23T14:48:15.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.363+0000 7f1434e00700 1 -- 172.21.15.81:0/1371310423 wait complete. 2024-04-23T14:48:15.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.364+0000 7f1434e00700 1 Processor -- start 2024-04-23T14:48:15.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.364+0000 7f1434e00700 1 -- start start 2024-04-23T14:48:15.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.364+0000 7f1434e00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14300fcc30 0x7f143010d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:15.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.364+0000 7f1434e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14300fdee0 0x7f143010ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:15.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.364+0000 7f1434e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143010e3d0 con 0x7f14300fdee0 2024-04-23T14:48:15.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.364+0000 7f1434e00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143010ec20 con 0x7f14300fcc30 2024-04-23T14:48:15.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.365+0000 7f142ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14300fdee0 0x7f143010ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:15.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.365+0000 7f142ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14300fdee0 0x7f143010ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35860/0 (socket says 172.21.15.81:35860) 2024-04-23T14:48:15.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.365+0000 7f142ea00700 1 -- 172.21.15.81:0/3053394890 learned_addr learned my addr 172.21.15.81:0/3053394890 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:48:15.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.365+0000 7f142f400700 1 --2- 172.21.15.81:0/3053394890 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14300fcc30 0x7f143010d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:15.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.365+0000 7f142ea00700 1 -- 172.21.15.81:0/3053394890 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14300fcc30 msgr2=0x7f143010d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:15.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.365+0000 7f142ea00700 1 --2- 172.21.15.81:0/3053394890 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14300fcc30 0x7f143010d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:15.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.365+0000 7f142ea00700 1 -- 172.21.15.81:0/3053394890 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141c005040 con 0x7f14300fdee0 2024-04-23T14:48:15.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.365+0000 7f142ea00700 1 --2- 172.21.15.81:0/3053394890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14300fdee0 0x7f143010ddd0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f141c00b3b0 tx=0x7f141c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:15.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.366+0000 7f1427400700 1 -- 172.21.15.81:0/3053394890 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f141c00e040 con 0x7f14300fdee0 2024-04-23T14:48:15.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.366+0000 7f1427400700 1 -- 172.21.15.81:0/3053394890 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f141c004290 con 0x7f14300fdee0 2024-04-23T14:48:15.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.366+0000 7f1434e00700 1 -- 172.21.15.81:0/3053394890 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f143010eea0 con 0x7f14300fdee0 2024-04-23T14:48:15.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.366+0000 7f1427400700 1 -- 172.21.15.81:0/3053394890 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f141c01c3f0 con 0x7f14300fdee0 2024-04-23T14:48:15.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.366+0000 7f1434e00700 1 -- 172.21.15.81:0/3053394890 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f143010f3e0 con 0x7f14300fdee0 2024-04-23T14:48:15.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.367+0000 7f1434e00700 1 -- 172.21.15.81:0/3053394890 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f143005f5f0 con 0x7f14300fdee0 2024-04-23T14:48:15.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.368+0000 7f1427400700 1 -- 172.21.15.81:0/3053394890 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f141c00bbf0 con 0x7f14300fdee0 2024-04-23T14:48:15.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.368+0000 7f1427400700 1 --2- 172.21.15.81:0/3053394890 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f14140692b0 0x7f141406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:15.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.369+0000 7f1427400700 1 -- 172.21.15.81:0/3053394890 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f141c088590 con 0x7f14300fdee0 2024-04-23T14:48:15.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.369+0000 7f142f400700 1 --2- 172.21.15.81:0/3053394890 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f14140692b0 0x7f141406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:15.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.370+0000 7f142f400700 1 --2- 172.21.15.81:0/3053394890 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f14140692b0 0x7f141406b760 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1420004f40 tx=0x7f142000b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:15.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.374+0000 7f1427400700 1 -- 172.21.15.81:0/3053394890 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f141c058260 con 0x7f14300fdee0 2024-04-23T14:48:15.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:15 smithi081 ceph-mon[25540]: pgmap v291: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:48:15.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.605+0000 7f1434e00700 1 -- 172.21.15.81:0/3053394890 --> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f143010f6c0 con 0x7f14140692b0 2024-04-23T14:48:15.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.607+0000 7f1427400700 1 -- 172.21.15.81:0/3053394890 <== mgr.14210 v2:172.21.15.81:6800/1053506915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f143010f6c0 con 0x7f14140692b0 2024-04-23T14:48:15.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.609+0000 7f1434e00700 1 -- 172.21.15.81:0/3053394890 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f14140692b0 msgr2=0x7f141406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:15.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.609+0000 7f1434e00700 1 --2- 172.21.15.81:0/3053394890 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f14140692b0 0x7f141406b760 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1420004f40 tx=0x7f142000b040 comp rx=0 tx=0).stop 2024-04-23T14:48:15.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.609+0000 7f1434e00700 1 -- 172.21.15.81:0/3053394890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14300fdee0 msgr2=0x7f143010ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:15.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.609+0000 7f1434e00700 1 --2- 172.21.15.81:0/3053394890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14300fdee0 0x7f143010ddd0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f141c00b3b0 tx=0x7f141c009e30 comp rx=0 tx=0).stop 2024-04-23T14:48:15.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.610+0000 7f1434e00700 1 -- 172.21.15.81:0/3053394890 shutdown_connections 2024-04-23T14:48:15.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.610+0000 7f1434e00700 1 --2- 172.21.15.81:0/3053394890 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14300fcc30 0x7f143010d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:15.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.610+0000 7f1434e00700 1 --2- 172.21.15.81:0/3053394890 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f14140692b0 0x7f141406b760 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:15.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.610+0000 7f1434e00700 1 --2- 172.21.15.81:0/3053394890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14300fdee0 0x7f143010ddd0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:15.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.610+0000 7f1434e00700 1 -- 172.21.15.81:0/3053394890 >> 172.21.15.81:0/3053394890 conn(0x7f14300f83d0 msgr2=0x7f14300f9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:15.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.610+0000 7f1434e00700 1 -- 172.21.15.81:0/3053394890 shutdown_connections 2024-04-23T14:48:15.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.610+0000 7f1434e00700 1 -- 172.21.15.81:0/3053394890 wait complete. 2024-04-23T14:48:15.626 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-04-23T14:48:15.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.751+0000 7f15c1e00700 1 -- 172.21.15.81:0/3008200560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15bc1046d0 msgr2=0x7f15bc104b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:15.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.751+0000 7f15c1e00700 1 --2- 172.21.15.81:0/3008200560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15bc1046d0 0x7f15bc104b40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f15a8004940 tx=0x7f15a8009e30 comp rx=0 tx=0).stop 2024-04-23T14:48:15.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.752+0000 7f15c1e00700 1 -- 172.21.15.81:0/3008200560 shutdown_connections 2024-04-23T14:48:15.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.752+0000 7f15c1e00700 1 --2- 172.21.15.81:0/3008200560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15bc1046d0 0x7f15bc104b40 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:15.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.752+0000 7f15c1e00700 1 --2- 172.21.15.81:0/3008200560 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15bc103420 0x7f15bc103830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:15.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.752+0000 7f15c1e00700 1 -- 172.21.15.81:0/3008200560 >> 172.21.15.81:0/3008200560 conn(0x7f15bc072640 msgr2=0x7f15bc074a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:15.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.752+0000 7f15c1e00700 1 -- 172.21.15.81:0/3008200560 shutdown_connections 2024-04-23T14:48:15.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.752+0000 7f15c1e00700 1 -- 172.21.15.81:0/3008200560 wait complete. 2024-04-23T14:48:15.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.752+0000 7f15c1e00700 1 Processor -- start 2024-04-23T14:48:15.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.753+0000 7f15c1e00700 1 -- start start 2024-04-23T14:48:15.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.753+0000 7f15c1e00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15bc103420 0x7f15bc113f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:15.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.753+0000 7f15c1e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15bc1046d0 0x7f15bc114490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:15.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.753+0000 7f15c1e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc114a90 con 0x7f15bc1046d0 2024-04-23T14:48:15.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.753+0000 7f15c1e00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc114c00 con 0x7f15bc103420 2024-04-23T14:48:15.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.753+0000 7f15ba000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15bc1046d0 0x7f15bc114490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:15.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.753+0000 7f15ba000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15bc1046d0 0x7f15bc114490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35878/0 (socket says 172.21.15.81:35878) 2024-04-23T14:48:15.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.753+0000 7f15ba000700 1 -- 172.21.15.81:0/1835816640 learned_addr learned my addr 172.21.15.81:0/1835816640 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:48:15.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.753+0000 7f15baa00700 1 --2- 172.21.15.81:0/1835816640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15bc103420 0x7f15bc113f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:15.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.754+0000 7f15ba000700 1 -- 172.21.15.81:0/1835816640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15bc103420 msgr2=0x7f15bc113f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:15.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.754+0000 7f15ba000700 1 --2- 172.21.15.81:0/1835816640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15bc103420 0x7f15bc113f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:15.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.754+0000 7f15ba000700 1 -- 172.21.15.81:0/1835816640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a8005040 con 0x7f15bc1046d0 2024-04-23T14:48:15.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.754+0000 7f15ba000700 1 --2- 172.21.15.81:0/1835816640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15bc1046d0 0x7f15bc114490 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f15a800b3b0 tx=0x7f15a8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:15.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.754+0000 7f15b2a00700 1 -- 172.21.15.81:0/1835816640 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15a800e040 con 0x7f15bc1046d0 2024-04-23T14:48:15.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.754+0000 7f15b2a00700 1 -- 172.21.15.81:0/1835816640 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f15a8004290 con 0x7f15bc1046d0 2024-04-23T14:48:15.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.754+0000 7f15b2a00700 1 -- 172.21.15.81:0/1835816640 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15a801c3f0 con 0x7f15bc1046d0 2024-04-23T14:48:15.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.754+0000 7f15c1e00700 1 -- 172.21.15.81:0/1835816640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15bc119600 con 0x7f15bc1046d0 2024-04-23T14:48:15.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.755+0000 7f15c1e00700 1 -- 172.21.15.81:0/1835816640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15bc119bc0 con 0x7f15bc1046d0 2024-04-23T14:48:15.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.756+0000 7f15c1e00700 1 -- 172.21.15.81:0/1835816640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15bc04c710 con 0x7f15bc1046d0 2024-04-23T14:48:15.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.756+0000 7f15b2a00700 1 -- 172.21.15.81:0/1835816640 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f15a800bbf0 con 0x7f15bc1046d0 2024-04-23T14:48:15.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.758+0000 7f15b2a00700 1 --2- 172.21.15.81:0/1835816640 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f15a00692a0 0x7f15a006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:15.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.758+0000 7f15b2a00700 1 -- 172.21.15.81:0/1835816640 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f15a8088510 con 0x7f15bc1046d0 2024-04-23T14:48:15.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.758+0000 7f15baa00700 1 --2- 172.21.15.81:0/1835816640 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f15a00692a0 0x7f15a006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:15.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.759+0000 7f15baa00700 1 --2- 172.21.15.81:0/1835816640 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f15a00692a0 0x7f15a006b750 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f15ac004f40 tx=0x7f15ac00b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:15.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.762+0000 7f15b2a00700 1 -- 172.21.15.81:0/1835816640 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f15a8058260 con 0x7f15bc1046d0 2024-04-23T14:48:15.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:15 smithi156 ceph-mon[32341]: pgmap v291: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:48:15.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.984+0000 7f15c1e00700 1 -- 172.21.15.81:0/1835816640 --> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f15bc108a10 con 0x7f15a00692a0 2024-04-23T14:48:15.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.988+0000 7f15b2a00700 1 -- 172.21.15.81:0/1835816640 <== mgr.14210 v2:172.21.15.81:6800/1053506915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f15bc108a10 con 0x7f15a00692a0 2024-04-23T14:48:15.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.990+0000 7f15c1e00700 1 -- 172.21.15.81:0/1835816640 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f15a00692a0 msgr2=0x7f15a006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:15.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.990+0000 7f15c1e00700 1 --2- 172.21.15.81:0/1835816640 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f15a00692a0 0x7f15a006b750 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f15ac004f40 tx=0x7f15ac00b040 comp rx=0 tx=0).stop 2024-04-23T14:48:15.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.990+0000 7f15c1e00700 1 -- 172.21.15.81:0/1835816640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15bc1046d0 msgr2=0x7f15bc114490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:15.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.990+0000 7f15c1e00700 1 --2- 172.21.15.81:0/1835816640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15bc1046d0 0x7f15bc114490 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f15a800b3b0 tx=0x7f15a8009e30 comp rx=0 tx=0).stop 2024-04-23T14:48:15.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.990+0000 7f15c1e00700 1 -- 172.21.15.81:0/1835816640 shutdown_connections 2024-04-23T14:48:15.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.990+0000 7f15c1e00700 1 --2- 172.21.15.81:0/1835816640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15bc103420 0x7f15bc113f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:15.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.991+0000 7f15c1e00700 1 --2- 172.21.15.81:0/1835816640 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f15a00692a0 0x7f15a006b750 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:15.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.991+0000 7f15c1e00700 1 --2- 172.21.15.81:0/1835816640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15bc1046d0 0x7f15bc114490 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:15.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.991+0000 7f15c1e00700 1 -- 172.21.15.81:0/1835816640 >> 172.21.15.81:0/1835816640 conn(0x7f15bc072640 msgr2=0x7f15bc073d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:15.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.991+0000 7f15c1e00700 1 -- 172.21.15.81:0/1835816640 shutdown_connections 2024-04-23T14:48:15.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:15.991+0000 7f15c1e00700 1 -- 172.21.15.81:0/1835816640 wait complete. 2024-04-23T14:48:16.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.145+0000 7f0377400700 1 -- 172.21.15.81:0/87388468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0370071f50 msgr2=0x7f0370070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:16.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.145+0000 7f0377400700 1 --2- 172.21.15.81:0/87388468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0370071f50 0x7f0370070460 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0364004940 tx=0x7f0364009e30 comp rx=0 tx=0).stop 2024-04-23T14:48:16.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.145+0000 7f0377400700 1 -- 172.21.15.81:0/87388468 shutdown_connections 2024-04-23T14:48:16.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.145+0000 7f0377400700 1 --2- 172.21.15.81:0/87388468 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f03700709a0 0x7f0370070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:16.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.145+0000 7f0377400700 1 --2- 172.21.15.81:0/87388468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0370071f50 0x7f0370070460 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:16.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.145+0000 7f0377400700 1 -- 172.21.15.81:0/87388468 >> 172.21.15.81:0/87388468 conn(0x7f03700f8530 msgr2=0x7f03700fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:16.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.145+0000 7f0377400700 1 -- 172.21.15.81:0/87388468 shutdown_connections 2024-04-23T14:48:16.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.145+0000 7f0377400700 1 -- 172.21.15.81:0/87388468 wait complete. 2024-04-23T14:48:16.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.146+0000 7f0377400700 1 Processor -- start 2024-04-23T14:48:16.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.146+0000 7f0377400700 1 -- start start 2024-04-23T14:48:16.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.147+0000 7f0377400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03700709a0 0x7f037010fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:16.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.147+0000 7f0377400700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0370071f50 0x7f0370110270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:16.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.147+0000 7f0377400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0370110870 con 0x7f03700709a0 2024-04-23T14:48:16.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.147+0000 7f0377400700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0370110fb0 con 0x7f0370071f50 2024-04-23T14:48:16.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.147+0000 7f0374a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03700709a0 0x7f037010fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:16.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.147+0000 7f0374a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03700709a0 0x7f037010fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35892/0 (socket says 172.21.15.81:35892) 2024-04-23T14:48:16.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.147+0000 7f0374a00700 1 -- 172.21.15.81:0/4215976691 learned_addr learned my addr 172.21.15.81:0/4215976691 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:48:16.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.147+0000 7f036fe00700 1 --2- 172.21.15.81:0/4215976691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0370071f50 0x7f0370110270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:16.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.148+0000 7f0374a00700 1 -- 172.21.15.81:0/4215976691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0370071f50 msgr2=0x7f0370110270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:16.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.148+0000 7f0374a00700 1 --2- 172.21.15.81:0/4215976691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0370071f50 0x7f0370110270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:16.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.148+0000 7f0374a00700 1 -- 172.21.15.81:0/4215976691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0364005040 con 0x7f03700709a0 2024-04-23T14:48:16.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.148+0000 7f036fe00700 1 --2- 172.21.15.81:0/4215976691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0370071f50 0x7f0370110270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:48:16.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.148+0000 7f0374a00700 1 --2- 172.21.15.81:0/4215976691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03700709a0 0x7f037010fd30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f036400b970 tx=0x7f0364009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:16.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.148+0000 7f036cc00700 1 -- 172.21.15.81:0/4215976691 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f036400e040 con 0x7f03700709a0 2024-04-23T14:48:16.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.148+0000 7f036cc00700 1 -- 172.21.15.81:0/4215976691 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0364004290 con 0x7f03700709a0 2024-04-23T14:48:16.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.148+0000 7f0377400700 1 -- 172.21.15.81:0/4215976691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0370111230 con 0x7f03700709a0 2024-04-23T14:48:16.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.148+0000 7f036cc00700 1 -- 172.21.15.81:0/4215976691 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f036401c630 con 0x7f03700709a0 2024-04-23T14:48:16.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.148+0000 7f0377400700 1 -- 172.21.15.81:0/4215976691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03701117f0 con 0x7f03700709a0 2024-04-23T14:48:16.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.149+0000 7f0377400700 1 -- 172.21.15.81:0/4215976691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f037005f5f0 con 0x7f03700709a0 2024-04-23T14:48:16.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.150+0000 7f036cc00700 1 -- 172.21.15.81:0/4215976691 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f0364013420 con 0x7f03700709a0 2024-04-23T14:48:16.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.151+0000 7f036cc00700 1 --2- 172.21.15.81:0/4215976691 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f03580692b0 0x7f035806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:16.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.151+0000 7f036cc00700 1 -- 172.21.15.81:0/4215976691 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f0364088580 con 0x7f03700709a0 2024-04-23T14:48:16.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.152+0000 7f036fe00700 1 --2- 172.21.15.81:0/4215976691 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f03580692b0 0x7f035806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:16.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.152+0000 7f036fe00700 1 --2- 172.21.15.81:0/4215976691 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f03580692b0 0x7f035806b760 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f035c009fd0 tx=0x7f035c009ee0 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:16.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.156+0000 7f036cc00700 1 -- 172.21.15.81:0/4215976691 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f03640582d0 con 0x7f03700709a0 2024-04-23T14:48:16.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.372+0000 7f0377400700 1 -- 172.21.15.81:0/4215976691 --> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0370111b70 con 0x7f03580692b0 2024-04-23T14:48:16.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.390+0000 7f036cc00700 1 -- 172.21.15.81:0/4215976691 <== mgr.14210 v2:172.21.15.81:6800/1053506915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f0370111b70 con 0x7f03580692b0 2024-04-23T14:48:16.392 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-23T14:48:16.393 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (7m) 107s ago 9m 13.4M - 0.25.0 c8568f914cd2 730d7164defb 2024-04-23T14:48:16.393 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (9m) 107s ago 9m 6660k - 17.2.7-884-g70d0cb4b cafd8ddac8fa 6ae90c81b232 2024-04-23T14:48:16.393 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi156 smithi156 running (8m) 113s ago 8m 6660k - 17.2.7-884-g70d0cb4b cafd8ddac8fa ecc141919f37 2024-04-23T14:48:16.393 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (7m) 107s ago 8m 74.6M - 9.4.7 954c08fa6188 96965e7e10cc 2024-04-23T14:48:16.393 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.vcoywg smithi081 running (2m) 107s ago 2m 12.8M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 2ca7601ab60f 2024-04-23T14:48:16.393 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.wydgcg smithi081 running (2m) 107s ago 2m 11.6M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 58eb1a961b61 2024-04-23T14:48:16.393 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.rhbtxt smithi156 running (2m) 113s ago 2m 10.4M - 17.2.7-884-g70d0cb4b cafd8ddac8fa db3cb5034381 2024-04-23T14:48:16.393 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.vynkxn smithi156 running (2m) 113s ago 2m 10.4M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 1c8f2219e7fd 2024-04-23T14:48:16.393 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.ldghvq smithi081 *:9283 running (11m) 107s ago 11m 482M - 17.2.7-884-g70d0cb4b cafd8ddac8fa b3d1da9bbf01 2024-04-23T14:48:16.393 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi156.ounwyj smithi156 *:8443,9283 running (8m) 113s ago 8m 432M - 17.2.7-884-g70d0cb4b cafd8ddac8fa e41b78b84933 2024-04-23T14:48:16.393 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (11m) 107s ago 11m 44.6M 2048M 17.2.7-884-g70d0cb4b cafd8ddac8fa 6e43d934b336 2024-04-23T14:48:16.393 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi156 smithi156 running (8m) 113s ago 8m 34.3M 2048M 17.2.7-884-g70d0cb4b cafd8ddac8fa d9127540d3bb 2024-04-23T14:48:16.393 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (9m) 107s ago 9m 7759k - 1.5.0 0da6a335fe13 06716415b80c 2024-04-23T14:48:16.393 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi156 smithi156 *:9100 running (8m) 113s ago 8m 7532k - 1.5.0 0da6a335fe13 2d9e680be69f 2024-04-23T14:48:16.394 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (7m) 107s ago 7m 46.6M 4288M 17.2.7-884-g70d0cb4b cafd8ddac8fa 272ca032bec1 2024-04-23T14:48:16.394 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (6m) 107s ago 6m 44.7M 4288M 17.2.7-884-g70d0cb4b cafd8ddac8fa ee6d0c8af6ed 2024-04-23T14:48:16.394 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (5m) 107s ago 5m 45.0M 4288M 17.2.7-884-g70d0cb4b cafd8ddac8fa c26c640828a2 2024-04-23T14:48:16.394 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi156 running (5m) 113s ago 5m 43.8M 5312M 17.2.7-884-g70d0cb4b cafd8ddac8fa c1c261b1ee90 2024-04-23T14:48:16.394 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi156 running (4m) 113s ago 4m 40.4M 5312M 17.2.7-884-g70d0cb4b cafd8ddac8fa 83f996ee64de 2024-04-23T14:48:16.394 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi156 running (4m) 113s ago 4m 40.8M 5312M 17.2.7-884-g70d0cb4b cafd8ddac8fa b754244bef18 2024-04-23T14:48:16.394 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (7m) 107s ago 8m 46.0M - 2.43.0 a07b618ecd1d 1779b897e5df 2024-04-23T14:48:16.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.392+0000 7f0377400700 1 -- 172.21.15.81:0/4215976691 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f03580692b0 msgr2=0x7f035806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:16.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.392+0000 7f0377400700 1 --2- 172.21.15.81:0/4215976691 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f03580692b0 0x7f035806b760 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f035c009fd0 tx=0x7f035c009ee0 comp rx=0 tx=0).stop 2024-04-23T14:48:16.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.392+0000 7f0377400700 1 -- 172.21.15.81:0/4215976691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03700709a0 msgr2=0x7f037010fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:16.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.392+0000 7f0377400700 1 --2- 172.21.15.81:0/4215976691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03700709a0 0x7f037010fd30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f036400b970 tx=0x7f0364009e30 comp rx=0 tx=0).stop 2024-04-23T14:48:16.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.393+0000 7f0377400700 1 -- 172.21.15.81:0/4215976691 shutdown_connections 2024-04-23T14:48:16.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.393+0000 7f0377400700 1 --2- 172.21.15.81:0/4215976691 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f03580692b0 0x7f035806b760 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:16.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.393+0000 7f0377400700 1 --2- 172.21.15.81:0/4215976691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03700709a0 0x7f037010fd30 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:16.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.393+0000 7f0377400700 1 --2- 172.21.15.81:0/4215976691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0370071f50 0x7f0370110270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:16.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.393+0000 7f0377400700 1 -- 172.21.15.81:0/4215976691 >> 172.21.15.81:0/4215976691 conn(0x7f03700f8530 msgr2=0x7f03700f9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:16.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.393+0000 7f0377400700 1 -- 172.21.15.81:0/4215976691 shutdown_connections 2024-04-23T14:48:16.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.393+0000 7f0377400700 1 -- 172.21.15.81:0/4215976691 wait complete. 2024-04-23T14:48:16.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.538+0000 7ff21b600700 1 -- 172.21.15.81:0/868251045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff214071ea0 msgr2=0x7ff2140703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:16.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.538+0000 7ff21b600700 1 --2- 172.21.15.81:0/868251045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff214071ea0 0x7ff2140703b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff208004940 tx=0x7ff208009e30 comp rx=0 tx=0).stop 2024-04-23T14:48:16.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.538+0000 7ff21b600700 1 -- 172.21.15.81:0/868251045 shutdown_connections 2024-04-23T14:48:16.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.538+0000 7ff21b600700 1 --2- 172.21.15.81:0/868251045 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff2140708f0 0x7ff214070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:16.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.538+0000 7ff21b600700 1 --2- 172.21.15.81:0/868251045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff214071ea0 0x7ff2140703b0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:16.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.538+0000 7ff21b600700 1 -- 172.21.15.81:0/868251045 >> 172.21.15.81:0/868251045 conn(0x7ff2140f8530 msgr2=0x7ff2140fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:16.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.539+0000 7ff21b600700 1 -- 172.21.15.81:0/868251045 shutdown_connections 2024-04-23T14:48:16.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.539+0000 7ff21b600700 1 -- 172.21.15.81:0/868251045 wait complete. 2024-04-23T14:48:16.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.539+0000 7ff21b600700 1 Processor -- start 2024-04-23T14:48:16.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.540+0000 7ff21b600700 1 -- start start 2024-04-23T14:48:16.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.540+0000 7ff21b600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2140708f0 0x7ff214113fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:16.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.540+0000 7ff21b600700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff214071ea0 0x7ff214114500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:16.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.540+0000 7ff21b600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff214114b00 con 0x7ff2140708f0 2024-04-23T14:48:16.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.540+0000 7ff21b600700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff214115350 con 0x7ff214071ea0 2024-04-23T14:48:16.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.540+0000 7ff218c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2140708f0 0x7ff214113fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:16.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.540+0000 7ff218c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2140708f0 0x7ff214113fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35912/0 (socket says 172.21.15.81:35912) 2024-04-23T14:48:16.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.540+0000 7ff218c00700 1 -- 172.21.15.81:0/1724324998 learned_addr learned my addr 172.21.15.81:0/1724324998 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:48:16.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.540+0000 7ff213e00700 1 --2- 172.21.15.81:0/1724324998 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff214071ea0 0x7ff214114500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:16.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.541+0000 7ff218c00700 1 -- 172.21.15.81:0/1724324998 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff214071ea0 msgr2=0x7ff214114500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:16.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.541+0000 7ff218c00700 1 --2- 172.21.15.81:0/1724324998 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff214071ea0 0x7ff214114500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:16.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.541+0000 7ff218c00700 1 -- 172.21.15.81:0/1724324998 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff208005040 con 0x7ff2140708f0 2024-04-23T14:48:16.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.541+0000 7ff218c00700 1 --2- 172.21.15.81:0/1724324998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2140708f0 0x7ff214113fc0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff20800b0d0 tx=0x7ff208009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:16.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.541+0000 7ff210c00700 1 -- 172.21.15.81:0/1724324998 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff20800e070 con 0x7ff2140708f0 2024-04-23T14:48:16.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.541+0000 7ff210c00700 1 -- 172.21.15.81:0/1724324998 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff208013de0 con 0x7ff2140708f0 2024-04-23T14:48:16.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.541+0000 7ff21b600700 1 -- 172.21.15.81:0/1724324998 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2141155d0 con 0x7ff2140708f0 2024-04-23T14:48:16.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.541+0000 7ff210c00700 1 -- 172.21.15.81:0/1724324998 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff20800be30 con 0x7ff2140708f0 2024-04-23T14:48:16.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.542+0000 7ff21b600700 1 -- 172.21.15.81:0/1724324998 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff214115b10 con 0x7ff2140708f0 2024-04-23T14:48:16.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.543+0000 7ff21b600700 1 -- 172.21.15.81:0/1724324998 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff21405f5f0 con 0x7ff2140708f0 2024-04-23T14:48:16.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.544+0000 7ff210c00700 1 -- 172.21.15.81:0/1724324998 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7ff20800b680 con 0x7ff2140708f0 2024-04-23T14:48:16.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.545+0000 7ff210c00700 1 --2- 172.21.15.81:0/1724324998 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7ff1fc0692b0 0x7ff1fc06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:16.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.545+0000 7ff210c00700 1 -- 172.21.15.81:0/1724324998 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff208087ff0 con 0x7ff2140708f0 2024-04-23T14:48:16.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.545+0000 7ff213e00700 1 --2- 172.21.15.81:0/1724324998 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7ff1fc0692b0 0x7ff1fc06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:16.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.546+0000 7ff213e00700 1 --2- 172.21.15.81:0/1724324998 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7ff1fc0692b0 0x7ff1fc06b760 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff200009b80 tx=0x7ff20000b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:16.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.549+0000 7ff210c00700 1 -- 172.21.15.81:0/1724324998 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff208057d00 con 0x7ff2140708f0 2024-04-23T14:48:16.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:16 smithi081 ceph-mon[25540]: from='client.14608 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:48:16.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:16 smithi156 ceph-mon[32341]: from='client.14608 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:48:16.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.850+0000 7ff21b600700 1 -- 172.21.15.81:0/1724324998 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff21410bef0 con 0x7ff2140708f0 2024-04-23T14:48:16.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.851+0000 7ff210c00700 1 -- 172.21.15.81:0/1724324998 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7ff208057890 con 0x7ff2140708f0 2024-04-23T14:48:16.853 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:48:16.853 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-04-23T14:48:16.853 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 2 2024-04-23T14:48:16.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:48:16.853 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-04-23T14:48:16.854 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 2 2024-04-23T14:48:16.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:48:16.854 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-04-23T14:48:16.854 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 6 2024-04-23T14:48:16.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:48:16.854 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-04-23T14:48:16.854 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 4 2024-04-23T14:48:16.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:48:16.854 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-04-23T14:48:16.854 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 14 2024-04-23T14:48:16.854 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-23T14:48:16.854 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:48:16.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.854+0000 7ff21b600700 1 -- 172.21.15.81:0/1724324998 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7ff1fc0692b0 msgr2=0x7ff1fc06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:16.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.854+0000 7ff21b600700 1 --2- 172.21.15.81:0/1724324998 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7ff1fc0692b0 0x7ff1fc06b760 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff200009b80 tx=0x7ff20000b040 comp rx=0 tx=0).stop 2024-04-23T14:48:16.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.854+0000 7ff21b600700 1 -- 172.21.15.81:0/1724324998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2140708f0 msgr2=0x7ff214113fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:16.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.854+0000 7ff21b600700 1 --2- 172.21.15.81:0/1724324998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2140708f0 0x7ff214113fc0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff20800b0d0 tx=0x7ff208009e30 comp rx=0 tx=0).stop 2024-04-23T14:48:16.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.855+0000 7ff21b600700 1 -- 172.21.15.81:0/1724324998 shutdown_connections 2024-04-23T14:48:16.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.855+0000 7ff21b600700 1 --2- 172.21.15.81:0/1724324998 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7ff1fc0692b0 0x7ff1fc06b760 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:16.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.855+0000 7ff21b600700 1 --2- 172.21.15.81:0/1724324998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2140708f0 0x7ff214113fc0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:16.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.855+0000 7ff21b600700 1 --2- 172.21.15.81:0/1724324998 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff214071ea0 0x7ff214114500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:16.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.855+0000 7ff21b600700 1 -- 172.21.15.81:0/1724324998 >> 172.21.15.81:0/1724324998 conn(0x7ff2140f8530 msgr2=0x7ff2140f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:16.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.855+0000 7ff21b600700 1 -- 172.21.15.81:0/1724324998 shutdown_connections 2024-04-23T14:48:16.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.855+0000 7ff21b600700 1 -- 172.21.15.81:0/1724324998 wait complete. 2024-04-23T14:48:16.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.993+0000 7f8182800700 1 -- 172.21.15.81:0/269672283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f817c071e50 msgr2=0x7f817c070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:16.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.993+0000 7f8182800700 1 --2- 172.21.15.81:0/269672283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f817c071e50 0x7f817c070350 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f816c004940 tx=0x7f816c009e30 comp rx=0 tx=0).stop 2024-04-23T14:48:16.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.993+0000 7f8182800700 1 -- 172.21.15.81:0/269672283 shutdown_connections 2024-04-23T14:48:16.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.993+0000 7f8182800700 1 --2- 172.21.15.81:0/269672283 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f817c070890 0x7f817c070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:16.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.993+0000 7f8182800700 1 --2- 172.21.15.81:0/269672283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f817c071e50 0x7f817c070350 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:16.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.993+0000 7f8182800700 1 -- 172.21.15.81:0/269672283 >> 172.21.15.81:0/269672283 conn(0x7f817c0f8540 msgr2=0x7f817c0fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:16.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.993+0000 7f8182800700 1 -- 172.21.15.81:0/269672283 shutdown_connections 2024-04-23T14:48:16.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.993+0000 7f8182800700 1 -- 172.21.15.81:0/269672283 wait complete. 2024-04-23T14:48:16.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.994+0000 7f8182800700 1 Processor -- start 2024-04-23T14:48:16.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.994+0000 7f8182800700 1 -- start start 2024-04-23T14:48:16.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.994+0000 7f8182800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f817c070890 0x7f817c10fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:16.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.994+0000 7f8182800700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f817c071e50 0x7f817c110260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:16.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.994+0000 7f8182800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817c110860 con 0x7f817c070890 2024-04-23T14:48:16.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.994+0000 7f8182800700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817c110fa0 con 0x7f817c071e50 2024-04-23T14:48:16.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.995+0000 7f817b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f817c070890 0x7f817c10fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:16.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.995+0000 7f817b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f817c070890 0x7f817c10fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35934/0 (socket says 172.21.15.81:35934) 2024-04-23T14:48:16.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.995+0000 7f817b400700 1 -- 172.21.15.81:0/1561718748 learned_addr learned my addr 172.21.15.81:0/1561718748 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:48:16.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.995+0000 7f817aa00700 1 --2- 172.21.15.81:0/1561718748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f817c071e50 0x7f817c110260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:16.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.995+0000 7f817b400700 1 -- 172.21.15.81:0/1561718748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f817c071e50 msgr2=0x7f817c110260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:16.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.995+0000 7f817b400700 1 --2- 172.21.15.81:0/1561718748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f817c071e50 0x7f817c110260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:16.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.995+0000 7f817b400700 1 -- 172.21.15.81:0/1561718748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f816c005040 con 0x7f817c070890 2024-04-23T14:48:16.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.995+0000 7f817aa00700 1 --2- 172.21.15.81:0/1561718748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f817c071e50 0x7f817c110260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:48:16.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.995+0000 7f817b400700 1 --2- 172.21.15.81:0/1561718748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f817c070890 0x7f817c10fd20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f816c00b970 tx=0x7f816c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:16.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.996+0000 7f8173400700 1 -- 172.21.15.81:0/1561718748 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f816c00e040 con 0x7f817c070890 2024-04-23T14:48:16.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.996+0000 7f8173400700 1 -- 172.21.15.81:0/1561718748 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f816c004290 con 0x7f817c070890 2024-04-23T14:48:16.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.996+0000 7f8182800700 1 -- 172.21.15.81:0/1561718748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f817c111220 con 0x7f817c070890 2024-04-23T14:48:16.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.996+0000 7f8173400700 1 -- 172.21.15.81:0/1561718748 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f816c01c630 con 0x7f817c070890 2024-04-23T14:48:16.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.996+0000 7f8182800700 1 -- 172.21.15.81:0/1561718748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f817c1117e0 con 0x7f817c070890 2024-04-23T14:48:17.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.997+0000 7f8182800700 1 -- 172.21.15.81:0/1561718748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f817c05f5f0 con 0x7f817c070890 2024-04-23T14:48:17.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:16.999+0000 7f8173400700 1 -- 172.21.15.81:0/1561718748 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f816c00bbf0 con 0x7f817c070890 2024-04-23T14:48:17.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.000+0000 7f8173400700 1 --2- 172.21.15.81:0/1561718748 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f81600692b0 0x7f816006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:17.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.000+0000 7f8173400700 1 -- 172.21.15.81:0/1561718748 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f816c088690 con 0x7f817c070890 2024-04-23T14:48:17.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.000+0000 7f817aa00700 1 --2- 172.21.15.81:0/1561718748 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f81600692b0 0x7f816006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:17.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.001+0000 7f817aa00700 1 --2- 172.21.15.81:0/1561718748 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f81600692b0 0x7f816006b760 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8168009fd0 tx=0x7f816800b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:17.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.009+0000 7f8173400700 1 -- 172.21.15.81:0/1561718748 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f816c058360 con 0x7f817c070890 2024-04-23T14:48:17.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.250+0000 7f8182800700 1 -- 172.21.15.81:0/1561718748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f817c111b60 con 0x7f817c070890 2024-04-23T14:48:17.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.251+0000 7f8173400700 1 -- 172.21.15.81:0/1561718748 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1837 (secure 0 0 0) 0x7f816c013e60 con 0x7f817c070890 2024-04-23T14:48:17.254 INFO:teuthology.orchestra.run.smithi081.stdout:e18 2024-04-23T14:48:17.254 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-23T14:48:17.254 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:48:17.254 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-04-23T14:48:17.254 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:48:17.254 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-04-23T14:48:17.254 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-04-23T14:48:17.254 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 17 2024-04-23T14:48:17.254 INFO:teuthology.orchestra.run.smithi081.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-23T14:48:17.254 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-04-23T14:45:51.264703+0000 2024-04-23T14:48:17.255 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-04-23T14:46:12.782992+0000 2024-04-23T14:48:17.255 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-04-23T14:48:17.255 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-04-23T14:48:17.255 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-04-23T14:48:17.255 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-04-23T14:48:17.255 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-04-23T14:48:17.255 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-04-23T14:48:17.255 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-04-23T14:48:17.255 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 47 2024-04-23T14:48:17.255 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:48:17.255 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 1 2024-04-23T14:48:17.255 INFO:teuthology.orchestra.run.smithi081.stdout:in 0 2024-04-23T14:48:17.255 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=14472} 2024-04-23T14:48:17.255 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-04-23T14:48:17.255 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-04-23T14:48:17.255 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-04-23T14:48:17.256 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-04-23T14:48:17.256 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-04-23T14:48:17.256 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-04-23T14:48:17.256 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-04-23T14:48:17.256 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-04-23T14:48:17.256 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.vcoywg{0:14472} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.81:6828/2563365650,v1:172.21.15.81:6829/2563365650] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:48:17.256 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.wydgcg{0:14482} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.81:6826/759909104,v1:172.21.15.81:6827/759909104] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:48:17.256 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:48:17.256 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:48:17.256 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-04-23T14:48:17.256 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:48:17.256 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.vynkxn{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.156:6826/1794690362,v1:172.21.15.156:6827/1794690362] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:48:17.256 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.rhbtxt{-1:24263} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.156:6824/3854041261,v1:172.21.15.156:6825/3854041261] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:48:17.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.253+0000 7f8182800700 1 -- 172.21.15.81:0/1561718748 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f81600692b0 msgr2=0x7f816006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:17.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.253+0000 7f8182800700 1 --2- 172.21.15.81:0/1561718748 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f81600692b0 0x7f816006b760 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8168009fd0 tx=0x7f816800b040 comp rx=0 tx=0).stop 2024-04-23T14:48:17.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.253+0000 7f8182800700 1 -- 172.21.15.81:0/1561718748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f817c070890 msgr2=0x7f817c10fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:17.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.253+0000 7f8182800700 1 --2- 172.21.15.81:0/1561718748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f817c070890 0x7f817c10fd20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f816c00b970 tx=0x7f816c009e30 comp rx=0 tx=0).stop 2024-04-23T14:48:17.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.254+0000 7f8182800700 1 -- 172.21.15.81:0/1561718748 shutdown_connections 2024-04-23T14:48:17.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.254+0000 7f8182800700 1 --2- 172.21.15.81:0/1561718748 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f81600692b0 0x7f816006b760 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:17.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.254+0000 7f8182800700 1 --2- 172.21.15.81:0/1561718748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f817c070890 0x7f817c10fd20 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:17.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.254+0000 7f8182800700 1 --2- 172.21.15.81:0/1561718748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f817c071e50 0x7f817c110260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:17.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.254+0000 7f8182800700 1 -- 172.21.15.81:0/1561718748 >> 172.21.15.81:0/1561718748 conn(0x7f817c0f8540 msgr2=0x7f817c0f9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:17.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.254+0000 7f8182800700 1 -- 172.21.15.81:0/1561718748 shutdown_connections 2024-04-23T14:48:17.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.254+0000 7f8182800700 1 -- 172.21.15.81:0/1561718748 wait complete. 2024-04-23T14:48:17.258 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 18 2024-04-23T14:48:17.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.402+0000 7f7963c00700 1 -- 172.21.15.81:0/284403157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f795c0fe0e0 msgr2=0x7f795c0fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:17.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.402+0000 7f7963c00700 1 --2- 172.21.15.81:0/284403157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f795c0fe0e0 0x7f795c0fe550 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7948004940 tx=0x7f7948009e30 comp rx=0 tx=0).stop 2024-04-23T14:48:17.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.402+0000 7f7963c00700 1 -- 172.21.15.81:0/284403157 shutdown_connections 2024-04-23T14:48:17.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.402+0000 7f7963c00700 1 --2- 172.21.15.81:0/284403157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f795c0fe0e0 0x7f795c0fe550 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:17.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.402+0000 7f7963c00700 1 --2- 172.21.15.81:0/284403157 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f795c0fcef0 0x7f795c0fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:17.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.402+0000 7f7963c00700 1 -- 172.21.15.81:0/284403157 >> 172.21.15.81:0/284403157 conn(0x7f795c0f8530 msgr2=0x7f795c0fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:17.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.402+0000 7f7963c00700 1 -- 172.21.15.81:0/284403157 shutdown_connections 2024-04-23T14:48:17.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.402+0000 7f7963c00700 1 -- 172.21.15.81:0/284403157 wait complete. 2024-04-23T14:48:17.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.403+0000 7f7963c00700 1 Processor -- start 2024-04-23T14:48:17.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.404+0000 7f7963c00700 1 -- start start 2024-04-23T14:48:17.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.404+0000 7f7963c00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f795c0fcef0 0x7f795c10da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:17.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.404+0000 7f7963c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f795c0fe0e0 0x7f795c10df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:17.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.404+0000 7f7963c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795c10e550 con 0x7f795c0fe0e0 2024-04-23T14:48:17.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.404+0000 7f7963c00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795c10eda0 con 0x7f795c0fcef0 2024-04-23T14:48:17.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.404+0000 7f795be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f795c0fe0e0 0x7f795c10df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:17.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.404+0000 7f795be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f795c0fe0e0 0x7f795c10df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35942/0 (socket says 172.21.15.81:35942) 2024-04-23T14:48:17.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.404+0000 7f795be00700 1 -- 172.21.15.81:0/1012075337 learned_addr learned my addr 172.21.15.81:0/1012075337 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:48:17.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.404+0000 7f7961200700 1 --2- 172.21.15.81:0/1012075337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f795c0fcef0 0x7f795c10da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:17.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.405+0000 7f795be00700 1 -- 172.21.15.81:0/1012075337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f795c0fcef0 msgr2=0x7f795c10da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:17.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.405+0000 7f795be00700 1 --2- 172.21.15.81:0/1012075337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f795c0fcef0 0x7f795c10da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:17.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.405+0000 7f795be00700 1 -- 172.21.15.81:0/1012075337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7948005040 con 0x7f795c0fe0e0 2024-04-23T14:48:17.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.405+0000 7f795be00700 1 --2- 172.21.15.81:0/1012075337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f795c0fe0e0 0x7f795c10df50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f794800b0d0 tx=0x7f7948009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:17.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.405+0000 7f7958c00700 1 -- 172.21.15.81:0/1012075337 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f794800e070 con 0x7f795c0fe0e0 2024-04-23T14:48:17.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.405+0000 7f7958c00700 1 -- 172.21.15.81:0/1012075337 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f794801d460 con 0x7f795c0fe0e0 2024-04-23T14:48:17.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.405+0000 7f7958c00700 1 -- 172.21.15.81:0/1012075337 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f794800b610 con 0x7f795c0fe0e0 2024-04-23T14:48:17.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.405+0000 7f7963c00700 1 -- 172.21.15.81:0/1012075337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f795c10f020 con 0x7f795c0fe0e0 2024-04-23T14:48:17.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.405+0000 7f7963c00700 1 -- 172.21.15.81:0/1012075337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f795c10f560 con 0x7f795c0fe0e0 2024-04-23T14:48:17.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.407+0000 7f7963c00700 1 -- 172.21.15.81:0/1012075337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f795c05f5f0 con 0x7f795c0fe0e0 2024-04-23T14:48:17.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.408+0000 7f7958c00700 1 -- 172.21.15.81:0/1012075337 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f794801d5d0 con 0x7f795c0fe0e0 2024-04-23T14:48:17.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.408+0000 7f7958c00700 1 --2- 172.21.15.81:0/1012075337 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f79440692b0 0x7f794406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:17.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.409+0000 7f7958c00700 1 -- 172.21.15.81:0/1012075337 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f7948088150 con 0x7f795c0fe0e0 2024-04-23T14:48:17.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.409+0000 7f7961200700 1 --2- 172.21.15.81:0/1012075337 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f79440692b0 0x7f794406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:17.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.410+0000 7f7961200700 1 --2- 172.21.15.81:0/1012075337 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f79440692b0 0x7f794406b760 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7950009b80 tx=0x7f795000b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:17.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.413+0000 7f7958c00700 1 -- 172.21.15.81:0/1012075337 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7948057f70 con 0x7f795c0fe0e0 2024-04-23T14:48:17.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:17 smithi081 ceph-mon[25540]: from='client.14612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:48:17.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:17 smithi081 ceph-mon[25540]: pgmap v292: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:48:17.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:17 smithi081 ceph-mon[25540]: from='client.14616 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:48:17.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:17 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/1724324998' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:48:17.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:17 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/1561718748' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:48:17.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.632+0000 7f7963c00700 1 -- 172.21.15.81:0/1012075337 --> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f795c10f8b0 con 0x7f79440692b0 2024-04-23T14:48:17.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.634+0000 7f7958c00700 1 -- 172.21.15.81:0/1012075337 <== mgr.14210 v2:172.21.15.81:6800/1053506915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f795c10f8b0 con 0x7f79440692b0 2024-04-23T14:48:17.635 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:48:17.635 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd", 2024-04-23T14:48:17.635 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-04-23T14:48:17.636 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-23T14:48:17.636 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [], 2024-04-23T14:48:17.636 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "0/21 daemons upgraded", 2024-04-23T14:48:17.636 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd image on host smithi156", 2024-04-23T14:48:17.636 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-04-23T14:48:17.636 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:48:17.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.636+0000 7f7963c00700 1 -- 172.21.15.81:0/1012075337 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f79440692b0 msgr2=0x7f794406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:17.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.636+0000 7f7963c00700 1 --2- 172.21.15.81:0/1012075337 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f79440692b0 0x7f794406b760 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7950009b80 tx=0x7f795000b040 comp rx=0 tx=0).stop 2024-04-23T14:48:17.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.636+0000 7f7963c00700 1 -- 172.21.15.81:0/1012075337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f795c0fe0e0 msgr2=0x7f795c10df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:17.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.636+0000 7f7963c00700 1 --2- 172.21.15.81:0/1012075337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f795c0fe0e0 0x7f795c10df50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f794800b0d0 tx=0x7f7948009e30 comp rx=0 tx=0).stop 2024-04-23T14:48:17.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.636+0000 7f7963c00700 1 -- 172.21.15.81:0/1012075337 shutdown_connections 2024-04-23T14:48:17.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.636+0000 7f7963c00700 1 --2- 172.21.15.81:0/1012075337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f795c0fcef0 0x7f795c10da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:17.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.636+0000 7f7963c00700 1 --2- 172.21.15.81:0/1012075337 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f79440692b0 0x7f794406b760 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:17.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.636+0000 7f7963c00700 1 --2- 172.21.15.81:0/1012075337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f795c0fe0e0 0x7f795c10df50 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:17.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.636+0000 7f7963c00700 1 -- 172.21.15.81:0/1012075337 >> 172.21.15.81:0/1012075337 conn(0x7f795c0f8530 msgr2=0x7f795c0f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:17.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.636+0000 7f7963c00700 1 -- 172.21.15.81:0/1012075337 shutdown_connections 2024-04-23T14:48:17.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.637+0000 7f7963c00700 1 -- 172.21.15.81:0/1012075337 wait complete. 2024-04-23T14:48:17.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:17 smithi156 ceph-mon[32341]: from='client.14612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:48:17.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:17 smithi156 ceph-mon[32341]: pgmap v292: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:48:17.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:17 smithi156 ceph-mon[32341]: from='client.14616 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:48:17.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:17 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/1724324998' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:48:17.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:17 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/1561718748' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:48:17.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.786+0000 7f813fe00700 1 -- 172.21.15.81:0/345879968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8140071ea0 msgr2=0x7f81400703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:17.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.786+0000 7f813fe00700 1 --2- 172.21.15.81:0/345879968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8140071ea0 0x7f81400703b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8130004940 tx=0x7f8130009e30 comp rx=0 tx=0).stop 2024-04-23T14:48:17.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.786+0000 7f813fe00700 1 -- 172.21.15.81:0/345879968 shutdown_connections 2024-04-23T14:48:17.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.786+0000 7f813fe00700 1 --2- 172.21.15.81:0/345879968 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81400708f0 0x7f8140070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:17.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.786+0000 7f813fe00700 1 --2- 172.21.15.81:0/345879968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8140071ea0 0x7f81400703b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:17.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.786+0000 7f813fe00700 1 -- 172.21.15.81:0/345879968 >> 172.21.15.81:0/345879968 conn(0x7f81400f83d0 msgr2=0x7f81400fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:17.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.786+0000 7f813fe00700 1 -- 172.21.15.81:0/345879968 shutdown_connections 2024-04-23T14:48:17.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.786+0000 7f813fe00700 1 -- 172.21.15.81:0/345879968 wait complete. 2024-04-23T14:48:17.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.787+0000 7f813fe00700 1 Processor -- start 2024-04-23T14:48:17.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.787+0000 7f813fe00700 1 -- start start 2024-04-23T14:48:17.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.787+0000 7f813fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81400708f0 0x7f814010fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:17.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.787+0000 7f813fe00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8140071ea0 0x7f8140110040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:17.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.787+0000 7f813fe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8140110640 con 0x7f81400708f0 2024-04-23T14:48:17.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.787+0000 7f813fe00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8140110e90 con 0x7f8140071ea0 2024-04-23T14:48:17.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.787+0000 7f813ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81400708f0 0x7f814010fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:17.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.787+0000 7f813ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81400708f0 0x7f814010fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35960/0 (socket says 172.21.15.81:35960) 2024-04-23T14:48:17.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.787+0000 7f813ea00700 1 -- 172.21.15.81:0/1062579754 learned_addr learned my addr 172.21.15.81:0/1062579754 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:48:17.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.787+0000 7f813e000700 1 --2- 172.21.15.81:0/1062579754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8140071ea0 0x7f8140110040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:17.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.788+0000 7f813ea00700 1 -- 172.21.15.81:0/1062579754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8140071ea0 msgr2=0x7f8140110040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:17.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.788+0000 7f813ea00700 1 --2- 172.21.15.81:0/1062579754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8140071ea0 0x7f8140110040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:17.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.788+0000 7f813ea00700 1 -- 172.21.15.81:0/1062579754 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8130005040 con 0x7f81400708f0 2024-04-23T14:48:17.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.788+0000 7f813ea00700 1 --2- 172.21.15.81:0/1062579754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81400708f0 0x7f814010fb00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f813000b970 tx=0x7f8130009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:17.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.788+0000 7f8136a00700 1 -- 172.21.15.81:0/1062579754 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f813000e040 con 0x7f81400708f0 2024-04-23T14:48:17.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.788+0000 7f8136a00700 1 -- 172.21.15.81:0/1062579754 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f813000bbf0 con 0x7f81400708f0 2024-04-23T14:48:17.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.788+0000 7f813fe00700 1 -- 172.21.15.81:0/1062579754 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8140111110 con 0x7f81400708f0 2024-04-23T14:48:17.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.789+0000 7f8136a00700 1 -- 172.21.15.81:0/1062579754 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f813001c3f0 con 0x7f81400708f0 2024-04-23T14:48:17.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.789+0000 7f813fe00700 1 -- 172.21.15.81:0/1062579754 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8140111650 con 0x7f81400708f0 2024-04-23T14:48:17.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.790+0000 7f813fe00700 1 -- 172.21.15.81:0/1062579754 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f814005f5f0 con 0x7f81400708f0 2024-04-23T14:48:17.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.791+0000 7f8136a00700 1 -- 172.21.15.81:0/1062579754 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f813000bd60 con 0x7f81400708f0 2024-04-23T14:48:17.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.792+0000 7f8136a00700 1 --2- 172.21.15.81:0/1062579754 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f81240692b0 0x7f812406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:17.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.792+0000 7f8136a00700 1 -- 172.21.15.81:0/1062579754 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f81300884c0 con 0x7f81400708f0 2024-04-23T14:48:17.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.793+0000 7f813e000700 1 --2- 172.21.15.81:0/1062579754 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f81240692b0 0x7f812406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:17.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.793+0000 7f813e000700 1 --2- 172.21.15.81:0/1062579754 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f81240692b0 0x7f812406b760 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f812c004f40 tx=0x7f812c00b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:17.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:17.797+0000 7f8136a00700 1 -- 172.21.15.81:0/1062579754 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f81300582c0 con 0x7f81400708f0 2024-04-23T14:48:18.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:18.090+0000 7f813fe00700 1 -- 172.21.15.81:0/1062579754 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8140111a40 con 0x7f81400708f0 2024-04-23T14:48:18.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:18.091+0000 7f8136a00700 1 -- 172.21.15.81:0/1062579754 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f8130057e50 con 0x7f81400708f0 2024-04-23T14:48:18.093 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-04-23T14:48:18.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:18.093+0000 7f813fe00700 1 -- 172.21.15.81:0/1062579754 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f81240692b0 msgr2=0x7f812406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:18.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:18.093+0000 7f813fe00700 1 --2- 172.21.15.81:0/1062579754 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f81240692b0 0x7f812406b760 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f812c004f40 tx=0x7f812c00b040 comp rx=0 tx=0).stop 2024-04-23T14:48:18.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:18.093+0000 7f813fe00700 1 -- 172.21.15.81:0/1062579754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81400708f0 msgr2=0x7f814010fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:18.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:18.093+0000 7f813fe00700 1 --2- 172.21.15.81:0/1062579754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81400708f0 0x7f814010fb00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f813000b970 tx=0x7f8130009e30 comp rx=0 tx=0).stop 2024-04-23T14:48:18.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:18.093+0000 7f813fe00700 1 -- 172.21.15.81:0/1062579754 shutdown_connections 2024-04-23T14:48:18.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:18.093+0000 7f813fe00700 1 --2- 172.21.15.81:0/1062579754 >> [v2:172.21.15.81:6800/1053506915,v1:172.21.15.81:6801/1053506915] conn(0x7f81240692b0 0x7f812406b760 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:18.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:18.093+0000 7f813fe00700 1 --2- 172.21.15.81:0/1062579754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81400708f0 0x7f814010fb00 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:18.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:18.093+0000 7f813fe00700 1 --2- 172.21.15.81:0/1062579754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8140071ea0 0x7f8140110040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:18.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:18.093+0000 7f813fe00700 1 -- 172.21.15.81:0/1062579754 >> 172.21.15.81:0/1062579754 conn(0x7f81400f83d0 msgr2=0x7f81400f9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:18.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:18.094+0000 7f813fe00700 1 -- 172.21.15.81:0/1062579754 shutdown_connections 2024-04-23T14:48:18.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:18.094+0000 7f813fe00700 1 -- 172.21.15.81:0/1062579754 wait complete. 2024-04-23T14:48:18.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:18 smithi081 ceph-mon[25540]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:48:18.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:18 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/1062579754' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:48:18.612 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:18 smithi156 ceph-mon[32341]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:48:18.612 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:18 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/1062579754' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:48:18.934 INFO:tasks.workunit.client.0.smithi081.stderr:Updating files: 61% (7562/12271) Updating files: 62% (7609/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-23T14:48:19.351 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:19 smithi156 ceph-mon[32341]: pgmap v293: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:48:19.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:19 smithi081 ceph-mon[25540]: pgmap v293: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:48:19.914 INFO:tasks.workunit.client.0.smithi081.stderr:Note: switching to 'd44fddd910b5e94da0f2357af4be37d7bd495ae0'. 2024-04-23T14:48:19.914 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-04-23T14:48:19.915 INFO:tasks.workunit.client.0.smithi081.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-23T14:48:19.915 INFO:tasks.workunit.client.0.smithi081.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-23T14:48:19.915 INFO:tasks.workunit.client.0.smithi081.stderr:state without impacting any branches by switching back to a branch. 2024-04-23T14:48:19.915 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-04-23T14:48:19.915 INFO:tasks.workunit.client.0.smithi081.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-23T14:48:19.915 INFO:tasks.workunit.client.0.smithi081.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-23T14:48:19.916 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-04-23T14:48:19.916 INFO:tasks.workunit.client.0.smithi081.stderr: git switch -c 2024-04-23T14:48:19.916 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-04-23T14:48:19.916 INFO:tasks.workunit.client.0.smithi081.stderr:Or undo this operation with: 2024-04-23T14:48:19.916 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-04-23T14:48:19.916 INFO:tasks.workunit.client.0.smithi081.stderr: git switch - 2024-04-23T14:48:19.916 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-04-23T14:48:19.917 INFO:tasks.workunit.client.0.smithi081.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-23T14:48:19.917 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-04-23T14:48:19.917 INFO:tasks.workunit.client.0.smithi081.stderr:HEAD is now at d44fddd910b DNM: trigger builds again 2024-04-23T14:48:19.928 DEBUG:teuthology.orchestra.run.smithi081:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-23T14:48:20.031 INFO:tasks.workunit.client.0.smithi081.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-23T14:48:20.038 INFO:tasks.workunit.client.0.smithi081.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-23T14:48:20.038 INFO:tasks.workunit.client.0.smithi081.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-23T14:48:20.942 INFO:tasks.workunit.client.0.smithi081.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-23T14:48:21.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:20 smithi156 ceph-mon[32341]: Upgrade: Updating mgr.smithi156.ounwyj 2024-04-23T14:48:21.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:20 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:48:21.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:20 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi156.ounwyj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-23T14:48:21.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:20 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-23T14:48:21.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:20 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:48:21.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:20 smithi156 ceph-mon[32341]: Deploying daemon mgr.smithi156.ounwyj on smithi156 2024-04-23T14:48:21.053 INFO:tasks.workunit.client.0.smithi081.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-23T14:48:21.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:20 smithi081 ceph-mon[25540]: Upgrade: Updating mgr.smithi156.ounwyj 2024-04-23T14:48:21.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:20 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:48:21.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:20 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi156.ounwyj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-23T14:48:21.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:20 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-23T14:48:21.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:20 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:48:21.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:20 smithi081 ceph-mon[25540]: Deploying daemon mgr.smithi156.ounwyj on smithi156 2024-04-23T14:48:21.138 INFO:tasks.workunit.client.0.smithi081.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-23T14:48:21.143 INFO:tasks.workunit.client.0.smithi081.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-23T14:48:21.143 INFO:tasks.workunit.client.0.smithi081.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-23T14:48:21.216 INFO:tasks.workunit.client.0.smithi081.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-23T14:48:21.227 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-23T14:48:21.227 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-23T14:48:21.275 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-23T14:48:21.276 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-23T14:48:21.276 DEBUG:teuthology.orchestra.run.smithi081:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d44fddd910b5e94da0f2357af4be37d7bd495ae0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-23T14:48:21.391 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir -p fsstress 2024-04-23T14:48:21.396 INFO:tasks.workunit.client.0.smithi081.stderr:+ pushd fsstress 2024-04-23T14:48:21.396 INFO:tasks.workunit.client.0.smithi081.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-23T14:48:21.396 INFO:tasks.workunit.client.0.smithi081.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-23T14:48:21.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:21 smithi156 ceph-mon[32341]: pgmap v294: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:48:22.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:21 smithi081 ceph-mon[25540]: pgmap v294: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:48:22.264 INFO:tasks.workunit.client.0.smithi081.stderr:+ tar xzf ltp-full.tgz 2024-04-23T14:48:23.935 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:23 smithi156 ceph-mon[32341]: pgmap v295: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:48:24.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:23 smithi081 ceph-mon[25540]: pgmap v295: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:48:26.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:25 smithi156 ceph-mon[32341]: pgmap v296: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:48:26.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:25 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:48:26.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:25 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:48:26.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:25 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:48:26.051 INFO:tasks.workunit.client.1.smithi156.stderr:Updating files: 56% (6959/12271) Updating files: 57% (6995/12271) Updating files: 58% (7118/12271) Updating files: 59% (7240/12271) Updating files: 60% (7363/12271) Updating files: 61% (7486/12271) Updating files: 62% (7609/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 93% (11450/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-23T14:48:26.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:25 smithi081 ceph-mon[25540]: pgmap v296: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:48:26.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:25 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:48:26.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:25 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:48:26.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:25 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:48:26.637 INFO:tasks.workunit.client.1.smithi156.stderr:Note: switching to 'd44fddd910b5e94da0f2357af4be37d7bd495ae0'. 2024-04-23T14:48:26.637 INFO:tasks.workunit.client.1.smithi156.stderr: 2024-04-23T14:48:26.637 INFO:tasks.workunit.client.1.smithi156.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-23T14:48:26.637 INFO:tasks.workunit.client.1.smithi156.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-23T14:48:26.637 INFO:tasks.workunit.client.1.smithi156.stderr:state without impacting any branches by switching back to a branch. 2024-04-23T14:48:26.637 INFO:tasks.workunit.client.1.smithi156.stderr: 2024-04-23T14:48:26.637 INFO:tasks.workunit.client.1.smithi156.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-23T14:48:26.637 INFO:tasks.workunit.client.1.smithi156.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-23T14:48:26.637 INFO:tasks.workunit.client.1.smithi156.stderr: 2024-04-23T14:48:26.637 INFO:tasks.workunit.client.1.smithi156.stderr: git switch -c 2024-04-23T14:48:26.637 INFO:tasks.workunit.client.1.smithi156.stderr: 2024-04-23T14:48:26.638 INFO:tasks.workunit.client.1.smithi156.stderr:Or undo this operation with: 2024-04-23T14:48:26.638 INFO:tasks.workunit.client.1.smithi156.stderr: 2024-04-23T14:48:26.638 INFO:tasks.workunit.client.1.smithi156.stderr: git switch - 2024-04-23T14:48:26.638 INFO:tasks.workunit.client.1.smithi156.stderr: 2024-04-23T14:48:26.638 INFO:tasks.workunit.client.1.smithi156.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-23T14:48:26.638 INFO:tasks.workunit.client.1.smithi156.stderr: 2024-04-23T14:48:26.638 INFO:tasks.workunit.client.1.smithi156.stderr:HEAD is now at d44fddd910b DNM: trigger builds again 2024-04-23T14:48:26.651 DEBUG:teuthology.orchestra.run.smithi156:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-04-23T14:48:26.738 INFO:tasks.workunit.client.1.smithi156.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-23T14:48:26.745 INFO:tasks.workunit.client.1.smithi156.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-04-23T14:48:26.745 INFO:tasks.workunit.client.1.smithi156.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-23T14:48:27.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:26 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:48:27.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:26 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:48:27.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:26 smithi156 ceph-mon[32341]: pgmap v297: 65 pgs: 65 active+clean; 5.7 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 437 KiB/s rd, 445 KiB/s wr, 3 op/s 2024-04-23T14:48:27.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:26 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:48:27.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:26 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:48:27.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:26 smithi081 ceph-mon[25540]: pgmap v297: 65 pgs: 65 active+clean; 5.7 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 437 KiB/s rd, 445 KiB/s wr, 3 op/s 2024-04-23T14:48:28.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:28 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:48:28.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:28 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:48:29.146 INFO:tasks.workunit.client.1.smithi156.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-23T14:48:29.283 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:29 smithi156 ceph-mon[32341]: pgmap v298: 65 pgs: 65 active+clean; 6.0 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 437 KiB/s rd, 479 KiB/s wr, 8 op/s 2024-04-23T14:48:29.300 INFO:tasks.workunit.client.1.smithi156.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-23T14:48:29.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:29 smithi081 ceph-mon[25540]: pgmap v298: 65 pgs: 65 active+clean; 6.0 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 437 KiB/s rd, 479 KiB/s wr, 8 op/s 2024-04-23T14:48:29.383 INFO:tasks.workunit.client.1.smithi156.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-04-23T14:48:29.389 INFO:tasks.workunit.client.1.smithi156.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-04-23T14:48:29.389 INFO:tasks.workunit.client.1.smithi156.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-23T14:48:29.465 INFO:tasks.workunit.client.1.smithi156.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-04-23T14:48:29.475 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-04-23T14:48:29.475 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-04-23T14:48:29.516 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-04-23T14:48:29.517 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-23T14:48:29.517 DEBUG:teuthology.orchestra.run.smithi156:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d44fddd910b5e94da0f2357af4be37d7bd495ae0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-04-23T14:48:29.624 INFO:tasks.workunit.client.1.smithi156.stderr:+ mkdir -p fsstress 2024-04-23T14:48:29.630 INFO:tasks.workunit.client.1.smithi156.stderr:+ pushd fsstress 2024-04-23T14:48:29.630 INFO:tasks.workunit.client.1.smithi156.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-23T14:48:29.631 INFO:tasks.workunit.client.1.smithi156.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-23T14:48:30.797 INFO:tasks.workunit.client.1.smithi156.stderr:+ tar xzf ltp-full.tgz 2024-04-23T14:48:31.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:31 smithi156 ceph-mon[32341]: pgmap v299: 65 pgs: 65 active+clean; 22 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 779 KiB/s rd, 1.8 MiB/s wr, 47 op/s 2024-04-23T14:48:31.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:31 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:48:31.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:31 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:48:31.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:31 smithi081 ceph-mon[25540]: pgmap v299: 65 pgs: 65 active+clean; 22 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 779 KiB/s rd, 1.8 MiB/s wr, 47 op/s 2024-04-23T14:48:31.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:31 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:48:31.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:31 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:48:33.191 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:32 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:48:33.191 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:32 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:48:33.192 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:32 smithi156 ceph-mon[32341]: pgmap v300: 65 pgs: 65 active+clean; 25 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 2.1 MiB/s wr, 55 op/s 2024-04-23T14:48:33.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:32 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:48:33.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:32 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:48:33.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:32 smithi081 ceph-mon[25540]: pgmap v300: 65 pgs: 65 active+clean; 25 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 2.1 MiB/s wr, 55 op/s 2024-04-23T14:48:35.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:35 smithi156 ceph-mon[32341]: pgmap v301: 65 pgs: 65 active+clean; 32 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 106 op/s 2024-04-23T14:48:35.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:35 smithi156 ceph-mon[32341]: Standby manager daemon smithi156.ounwyj restarted 2024-04-23T14:48:35.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:35 smithi156 ceph-mon[32341]: Standby manager daemon smithi156.ounwyj started 2024-04-23T14:48:35.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:35 smithi156 ceph-mon[32341]: from='mgr.? 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi156.ounwyj/crt"}]: dispatch 2024-04-23T14:48:35.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:35 smithi156 ceph-mon[32341]: from='mgr.? 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-23T14:48:35.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:35 smithi156 ceph-mon[32341]: from='mgr.? 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi156.ounwyj/key"}]: dispatch 2024-04-23T14:48:35.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:35 smithi156 ceph-mon[32341]: from='mgr.? 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-23T14:48:35.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:35 smithi081 ceph-mon[25540]: pgmap v301: 65 pgs: 65 active+clean; 32 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 106 op/s 2024-04-23T14:48:35.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:35 smithi081 ceph-mon[25540]: Standby manager daemon smithi156.ounwyj restarted 2024-04-23T14:48:35.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:35 smithi081 ceph-mon[25540]: Standby manager daemon smithi156.ounwyj started 2024-04-23T14:48:35.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:35 smithi081 ceph-mon[25540]: from='mgr.? 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi156.ounwyj/crt"}]: dispatch 2024-04-23T14:48:35.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:35 smithi081 ceph-mon[25540]: from='mgr.? 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-23T14:48:35.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:35 smithi081 ceph-mon[25540]: from='mgr.? 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi156.ounwyj/key"}]: dispatch 2024-04-23T14:48:35.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:35 smithi081 ceph-mon[25540]: from='mgr.? 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-23T14:48:36.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:36 smithi156 ceph-mon[32341]: mgrmap e20: smithi081.ldghvq(active, since 8m), standbys: smithi156.ounwyj 2024-04-23T14:48:36.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:36 smithi081 ceph-mon[25540]: mgrmap e20: smithi081.ldghvq(active, since 8m), standbys: smithi156.ounwyj 2024-04-23T14:48:37.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:37 smithi156 ceph-mon[32341]: pgmap v302: 65 pgs: 65 active+clean; 45 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.9 MiB/s wr, 204 op/s 2024-04-23T14:48:37.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:37 smithi081 ceph-mon[25540]: pgmap v302: 65 pgs: 65 active+clean; 45 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.9 MiB/s wr, 204 op/s 2024-04-23T14:48:39.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:39 smithi156 ceph-mon[32341]: pgmap v303: 65 pgs: 65 active+clean; 49 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 3.8 MiB/s wr, 211 op/s 2024-04-23T14:48:39.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:39 smithi081 ceph-mon[25540]: pgmap v303: 65 pgs: 65 active+clean; 49 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 3.8 MiB/s wr, 211 op/s 2024-04-23T14:48:41.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:41 smithi156 ceph-mon[32341]: pgmap v304: 65 pgs: 65 active+clean; 55 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 4.3 MiB/s wr, 245 op/s 2024-04-23T14:48:41.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:41 smithi081 ceph-mon[25540]: pgmap v304: 65 pgs: 65 active+clean; 55 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 4.3 MiB/s wr, 245 op/s 2024-04-23T14:48:42.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:42 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:48:42.632 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:42 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:48:43.559 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:43 smithi156 ceph-mon[32341]: pgmap v305: 65 pgs: 65 active+clean; 62 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 3.5 MiB/s wr, 223 op/s 2024-04-23T14:48:43.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:43 smithi081 ceph-mon[25540]: pgmap v305: 65 pgs: 65 active+clean; 62 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 3.5 MiB/s wr, 223 op/s 2024-04-23T14:48:45.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:45 smithi081 ceph-mon[25540]: pgmap v306: 65 pgs: 65 active+clean; 65 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 3.4 MiB/s wr, 240 op/s 2024-04-23T14:48:45.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:45 smithi156 ceph-mon[32341]: pgmap v306: 65 pgs: 65 active+clean; 65 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 3.4 MiB/s wr, 240 op/s 2024-04-23T14:48:47.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:47 smithi156 ceph-mon[32341]: pgmap v307: 65 pgs: 65 active+clean; 72 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 243 op/s 2024-04-23T14:48:47.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:47 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:48:47.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:47 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:48:47.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:47 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:48:47.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:47 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:48:47.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:47 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:48:47.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:47 smithi081 ceph-mon[25540]: pgmap v307: 65 pgs: 65 active+clean; 72 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 243 op/s 2024-04-23T14:48:47.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:47 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:48:47.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:47 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:48:47.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:47 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:48:47.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:47 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:48:47.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:47 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' 2024-04-23T14:48:48.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.287+0000 7f7b3e200700 1 -- 172.21.15.81:0/1534703984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b380709a0 msgr2=0x7f7b38070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:48.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.287+0000 7f7b3e200700 1 --2- 172.21.15.81:0/1534703984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b380709a0 0x7f7b38070e10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7b24004940 tx=0x7f7b24009e30 comp rx=0 tx=0).stop 2024-04-23T14:48:48.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.287+0000 7f7b3e200700 1 -- 172.21.15.81:0/1534703984 shutdown_connections 2024-04-23T14:48:48.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.287+0000 7f7b3e200700 1 --2- 172.21.15.81:0/1534703984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b380709a0 0x7f7b38070e10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:48.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.287+0000 7f7b3e200700 1 --2- 172.21.15.81:0/1534703984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b38071f50 0x7f7b38070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:48.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.287+0000 7f7b3e200700 1 -- 172.21.15.81:0/1534703984 >> 172.21.15.81:0/1534703984 conn(0x7f7b380f8530 msgr2=0x7f7b380fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:48.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.287+0000 7f7b3e200700 1 -- 172.21.15.81:0/1534703984 shutdown_connections 2024-04-23T14:48:48.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.287+0000 7f7b3e200700 1 -- 172.21.15.81:0/1534703984 wait complete. 2024-04-23T14:48:48.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.288+0000 7f7b3e200700 1 Processor -- start 2024-04-23T14:48:48.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.288+0000 7f7b3e200700 1 -- start start 2024-04-23T14:48:48.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.289+0000 7f7b3e200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b380709a0 0x7f7b38107630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:48.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.290+0000 7f7b3e200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b38071f50 0x7f7b38107b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:48.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.290+0000 7f7b3e200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b38109220 con 0x7f7b380709a0 2024-04-23T14:48:48.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.290+0000 7f7b3e200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b38109360 con 0x7f7b38071f50 2024-04-23T14:48:48.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.290+0000 7f7b37400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b380709a0 0x7f7b38107630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:48.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.290+0000 7f7b36a00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b38071f50 0x7f7b38107b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:48.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.290+0000 7f7b37400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b380709a0 0x7f7b38107630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56526/0 (socket says 172.21.15.81:56526) 2024-04-23T14:48:48.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.290+0000 7f7b37400700 1 -- 172.21.15.81:0/3277692511 learned_addr learned my addr 172.21.15.81:0/3277692511 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:48:48.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.290+0000 7f7b36a00700 1 -- 172.21.15.81:0/3277692511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b380709a0 msgr2=0x7f7b38107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:48.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.290+0000 7f7b36a00700 1 --2- 172.21.15.81:0/3277692511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b380709a0 0x7f7b38107630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:48.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.290+0000 7f7b36a00700 1 -- 172.21.15.81:0/3277692511 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b24005040 con 0x7f7b38071f50 2024-04-23T14:48:48.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.291+0000 7f7b36a00700 1 --2- 172.21.15.81:0/3277692511 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b38071f50 0x7f7b38107b70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7b2400b0d0 tx=0x7f7b24009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:48.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.291+0000 7f7b2f400700 1 -- 172.21.15.81:0/3277692511 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b2400e070 con 0x7f7b38071f50 2024-04-23T14:48:48.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.291+0000 7f7b2f400700 1 -- 172.21.15.81:0/3277692511 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7b2400b410 con 0x7f7b38071f50 2024-04-23T14:48:48.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.291+0000 7f7b3e200700 1 -- 172.21.15.81:0/3277692511 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b38108170 con 0x7f7b38071f50 2024-04-23T14:48:48.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.292+0000 7f7b2f400700 1 -- 172.21.15.81:0/3277692511 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b24012600 con 0x7f7b38071f50 2024-04-23T14:48:48.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.292+0000 7f7b3e200700 1 -- 172.21.15.81:0/3277692511 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b381225c0 con 0x7f7b38071f50 2024-04-23T14:48:48.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.293+0000 7f7b3e200700 1 -- 172.21.15.81:0/3277692511 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b3805f5f0 con 0x7f7b38071f50 2024-04-23T14:48:48.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.293+0000 7f7b2f400700 1 -- 172.21.15.81:0/3277692511 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 21) v1 ==== 46089+0+0 (secure 0 0 0) 0x7f7b24012760 con 0x7f7b38071f50 2024-04-23T14:48:48.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.294+0000 7f7b2f400700 1 -- 172.21.15.81:0/3277692511 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f7b2404d300 con 0x7f7b38071f50 2024-04-23T14:48:48.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.300+0000 7f7b2f400700 1 -- 172.21.15.81:0/3277692511 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7b24024e10 con 0x7f7b38071f50 2024-04-23T14:48:48.568 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:48 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:48:48.569 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:48 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mgr fail", "who": "smithi081.ldghvq"}]: dispatch 2024-04-23T14:48:48.569 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:48 smithi081 ceph-mon[25540]: Activating manager daemon smithi156.ounwyj 2024-04-23T14:48:48.569 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:48 smithi081 ceph-mon[25540]: osdmap e48: 6 total, 6 up, 6 in 2024-04-23T14:48:48.569 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:48 smithi081 ceph-mon[25540]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "mgr fail", "who": "smithi081.ldghvq"}]': finished 2024-04-23T14:48:48.569 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:48 smithi081 ceph-mon[25540]: mgrmap e21: smithi156.ounwyj(active, starting, since 0.0175222s) 2024-04-23T14:48:48.569 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:48 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "mon metadata", "id": "smithi081"}]: dispatch 2024-04-23T14:48:48.569 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:48 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2024-04-23T14:48:48.569 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:48 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi081.vcoywg"}]: dispatch 2024-04-23T14:48:48.569 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:48 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi081.wydgcg"}]: dispatch 2024-04-23T14:48:48.569 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:48 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi156.vynkxn"}]: dispatch 2024-04-23T14:48:48.569 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:48 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi156.rhbtxt"}]: dispatch 2024-04-23T14:48:48.569 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:48 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "mgr metadata", "who": "smithi156.ounwyj", "id": "smithi156.ounwyj"}]: dispatch 2024-04-23T14:48:48.569 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:48 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:48:48.569 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:48 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T14:48:48.570 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:48 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T14:48:48.570 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:48 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T14:48:48.570 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:48 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T14:48:48.570 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:48 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T14:48:48.570 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:48 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-23T14:48:48.570 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:48 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-23T14:48:48.570 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:48 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-23T14:48:48.570 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:48 smithi081 ceph-mon[25540]: Manager daemon smithi156.ounwyj is now available 2024-04-23T14:48:48.570 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:48 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:48:48.570 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:48 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:48:48.570 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:48 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi156.ounwyj/mirror_snapshot_schedule"}]: dispatch 2024-04-23T14:48:48.570 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:48 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi156.ounwyj/mirror_snapshot_schedule"}]: dispatch 2024-04-23T14:48:48.570 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:48 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi156.ounwyj/trash_purge_schedule"}]: dispatch 2024-04-23T14:48:48.570 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:48 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi156.ounwyj/trash_purge_schedule"}]: dispatch 2024-04-23T14:48:48.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.712+0000 7f7b2f400700 1 -- 172.21.15.81:0/3277692511 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mgrmap(e 22) v1 ==== 46216+0+0 (secure 0 0 0) 0x7f7b2400baa0 con 0x7f7b38071f50 2024-04-23T14:48:48.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.712+0000 7f7b2f400700 1 --2- 172.21.15.81:0/3277692511 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f7b1c03e180 0x7f7b1c040560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:48.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.712+0000 7f7b2f400700 1 -- 172.21.15.81:0/3277692511 --> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b1c040aa0 con 0x7f7b1c03e180 2024-04-23T14:48:48.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.723+0000 7f7b37400700 1 --2- 172.21.15.81:0/3277692511 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f7b1c03e180 0x7f7b1c040560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:48.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.726+0000 7f7b37400700 1 --2- 172.21.15.81:0/3277692511 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f7b1c03e180 0x7f7b1c040560 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7b38108ea0 tx=0x7f7b2800b040 comp rx=0 tx=0).ready entity=mgr.24373 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:48.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.730+0000 7f7b2f400700 1 -- 172.21.15.81:0/3277692511 <== mgr.24373 v2:172.21.15.156:6828/100981835 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f7b1c040aa0 con 0x7f7b1c03e180 2024-04-23T14:48:48.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.733+0000 7f7b3e200700 1 -- 172.21.15.81:0/3277692511 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f7b1c03e180 msgr2=0x7f7b1c040560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:48.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.733+0000 7f7b3e200700 1 --2- 172.21.15.81:0/3277692511 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f7b1c03e180 0x7f7b1c040560 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7b38108ea0 tx=0x7f7b2800b040 comp rx=0 tx=0).stop 2024-04-23T14:48:48.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.733+0000 7f7b3e200700 1 -- 172.21.15.81:0/3277692511 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b38071f50 msgr2=0x7f7b38107b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:48.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.733+0000 7f7b3e200700 1 --2- 172.21.15.81:0/3277692511 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b38071f50 0x7f7b38107b70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7b2400b0d0 tx=0x7f7b24009e30 comp rx=0 tx=0).stop 2024-04-23T14:48:48.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.734+0000 7f7b3e200700 1 -- 172.21.15.81:0/3277692511 shutdown_connections 2024-04-23T14:48:48.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.734+0000 7f7b3e200700 1 --2- 172.21.15.81:0/3277692511 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f7b1c03e180 0x7f7b1c040560 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:48.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.734+0000 7f7b3e200700 1 --2- 172.21.15.81:0/3277692511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b380709a0 0x7f7b38107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:48.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.734+0000 7f7b3e200700 1 --2- 172.21.15.81:0/3277692511 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b38071f50 0x7f7b38107b70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:48.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.734+0000 7f7b3e200700 1 -- 172.21.15.81:0/3277692511 >> 172.21.15.81:0/3277692511 conn(0x7f7b380f8530 msgr2=0x7f7b380f9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:48.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.734+0000 7f7b3e200700 1 -- 172.21.15.81:0/3277692511 shutdown_connections 2024-04-23T14:48:48.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.734+0000 7f7b3e200700 1 -- 172.21.15.81:0/3277692511 wait complete. 2024-04-23T14:48:48.756 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-04-23T14:48:48.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:48 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:48:48.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:48 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mgr fail", "who": "smithi081.ldghvq"}]: dispatch 2024-04-23T14:48:48.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:48 smithi156 ceph-mon[32341]: Activating manager daemon smithi156.ounwyj 2024-04-23T14:48:48.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:48 smithi156 ceph-mon[32341]: osdmap e48: 6 total, 6 up, 6 in 2024-04-23T14:48:48.788 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:48 smithi156 ceph-mon[32341]: from='mgr.14210 172.21.15.81:0/325650364' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "mgr fail", "who": "smithi081.ldghvq"}]': finished 2024-04-23T14:48:48.788 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:48 smithi156 ceph-mon[32341]: mgrmap e21: smithi156.ounwyj(active, starting, since 0.0175222s) 2024-04-23T14:48:48.788 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:48 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "mon metadata", "id": "smithi081"}]: dispatch 2024-04-23T14:48:48.788 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:48 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2024-04-23T14:48:48.788 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:48 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi081.vcoywg"}]: dispatch 2024-04-23T14:48:48.788 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:48 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi081.wydgcg"}]: dispatch 2024-04-23T14:48:48.788 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:48 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi156.vynkxn"}]: dispatch 2024-04-23T14:48:48.788 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:48 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi156.rhbtxt"}]: dispatch 2024-04-23T14:48:48.788 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:48 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "mgr metadata", "who": "smithi156.ounwyj", "id": "smithi156.ounwyj"}]: dispatch 2024-04-23T14:48:48.788 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:48 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:48:48.788 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:48 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T14:48:48.788 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:48 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T14:48:48.788 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:48 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T14:48:48.789 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:48 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T14:48:48.789 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:48 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T14:48:48.789 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:48 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-23T14:48:48.789 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:48 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-23T14:48:48.789 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:48 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-23T14:48:48.789 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:48 smithi156 ceph-mon[32341]: Manager daemon smithi156.ounwyj is now available 2024-04-23T14:48:48.789 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:48 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:48:48.789 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:48 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:48:48.789 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:48 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi156.ounwyj/mirror_snapshot_schedule"}]: dispatch 2024-04-23T14:48:48.789 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:48 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi156.ounwyj/mirror_snapshot_schedule"}]: dispatch 2024-04-23T14:48:48.789 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:48 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi156.ounwyj/trash_purge_schedule"}]: dispatch 2024-04-23T14:48:48.789 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:48 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi156.ounwyj/trash_purge_schedule"}]: dispatch 2024-04-23T14:48:48.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.959+0000 7f577f000700 1 -- 172.21.15.81:0/2348755672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57780fded0 msgr2=0x7f57780fe340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:48.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.959+0000 7f577f000700 1 --2- 172.21.15.81:0/2348755672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57780fded0 0x7f57780fe340 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5764004940 tx=0x7f5764009e30 comp rx=0 tx=0).stop 2024-04-23T14:48:48.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.959+0000 7f577f000700 1 -- 172.21.15.81:0/2348755672 shutdown_connections 2024-04-23T14:48:48.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.959+0000 7f577f000700 1 --2- 172.21.15.81:0/2348755672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57780fded0 0x7f57780fe340 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:48.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.959+0000 7f577f000700 1 --2- 172.21.15.81:0/2348755672 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57780fcc20 0x7f57780fd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:48.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.959+0000 7f577f000700 1 -- 172.21.15.81:0/2348755672 >> 172.21.15.81:0/2348755672 conn(0x7f57780f83a0 msgr2=0x7f57780fa7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:48.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.960+0000 7f577f000700 1 -- 172.21.15.81:0/2348755672 shutdown_connections 2024-04-23T14:48:48.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.960+0000 7f577f000700 1 -- 172.21.15.81:0/2348755672 wait complete. 2024-04-23T14:48:48.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.961+0000 7f577f000700 1 Processor -- start 2024-04-23T14:48:48.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.961+0000 7f577f000700 1 -- start start 2024-04-23T14:48:48.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.961+0000 7f577f000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57780fcc20 0x7f577810fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:48.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.961+0000 7f577f000700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57780fded0 0x7f577810ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:48.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.961+0000 7f577f000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5778110640 con 0x7f57780fcc20 2024-04-23T14:48:48.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.961+0000 7f577f000700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5778110e30 con 0x7f57780fded0 2024-04-23T14:48:48.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.962+0000 7f577dc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57780fcc20 0x7f577810fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:48.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.962+0000 7f577dc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57780fcc20 0x7f577810fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56534/0 (socket says 172.21.15.81:56534) 2024-04-23T14:48:48.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.962+0000 7f577dc00700 1 -- 172.21.15.81:0/4267722697 learned_addr learned my addr 172.21.15.81:0/4267722697 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:48:48.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.962+0000 7f577d200700 1 --2- 172.21.15.81:0/4267722697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57780fded0 0x7f577810ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:48.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.962+0000 7f577dc00700 1 -- 172.21.15.81:0/4267722697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57780fded0 msgr2=0x7f577810ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:48.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.962+0000 7f577dc00700 1 --2- 172.21.15.81:0/4267722697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57780fded0 0x7f577810ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:48.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.962+0000 7f577dc00700 1 -- 172.21.15.81:0/4267722697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5764005040 con 0x7f57780fcc20 2024-04-23T14:48:48.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.962+0000 7f577d200700 1 --2- 172.21.15.81:0/4267722697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57780fded0 0x7f577810ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:48:48.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.963+0000 7f577dc00700 1 --2- 172.21.15.81:0/4267722697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57780fcc20 0x7f577810fa70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f576c00b790 tx=0x7f576c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:48.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.963+0000 7f5775600700 1 -- 172.21.15.81:0/4267722697 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f576c00f770 con 0x7f57780fcc20 2024-04-23T14:48:48.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.963+0000 7f5775600700 1 -- 172.21.15.81:0/4267722697 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f576c00fda0 con 0x7f57780fcc20 2024-04-23T14:48:48.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.963+0000 7f5775600700 1 -- 172.21.15.81:0/4267722697 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f576c00d310 con 0x7f57780fcc20 2024-04-23T14:48:48.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.963+0000 7f577f000700 1 -- 172.21.15.81:0/4267722697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5778111110 con 0x7f57780fcc20 2024-04-23T14:48:48.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.963+0000 7f577f000700 1 -- 172.21.15.81:0/4267722697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57781116d0 con 0x7f57780fcc20 2024-04-23T14:48:48.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.965+0000 7f577f000700 1 -- 172.21.15.81:0/4267722697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5778101860 con 0x7f57780fcc20 2024-04-23T14:48:48.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.965+0000 7f5775600700 1 -- 172.21.15.81:0/4267722697 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) v1 ==== 46216+0+0 (secure 0 0 0) 0x7f576c010420 con 0x7f57780fcc20 2024-04-23T14:48:48.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.966+0000 7f5775600700 1 --2- 172.21.15.81:0/4267722697 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f5760039050 0x7f576003b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:48.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.966+0000 7f5775600700 1 -- 172.21.15.81:0/4267722697 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f576c04cbd0 con 0x7f57780fcc20 2024-04-23T14:48:48.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.967+0000 7f577d200700 1 --2- 172.21.15.81:0/4267722697 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f5760039050 0x7f576003b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:48.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.968+0000 7f577d200700 1 --2- 172.21.15.81:0/4267722697 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f5760039050 0x7f576003b500 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f576400b020 tx=0x7f5764009e30 comp rx=0 tx=0).ready entity=mgr.24373 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:48.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:48.972+0000 7f5775600700 1 -- 172.21.15.81:0/4267722697 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f576c00e2e0 con 0x7f57780fcc20 2024-04-23T14:48:49.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.376+0000 7f577f000700 1 -- 172.21.15.81:0/4267722697 --> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f57781119b0 con 0x7f5760039050 2024-04-23T14:48:49.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.386+0000 7f5775600700 1 -- 172.21.15.81:0/4267722697 <== mgr.24373 v2:172.21.15.156:6828/100981835 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f57781119b0 con 0x7f5760039050 2024-04-23T14:48:49.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.388+0000 7f577f000700 1 -- 172.21.15.81:0/4267722697 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f5760039050 msgr2=0x7f576003b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:49.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.388+0000 7f577f000700 1 --2- 172.21.15.81:0/4267722697 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f5760039050 0x7f576003b500 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f576400b020 tx=0x7f5764009e30 comp rx=0 tx=0).stop 2024-04-23T14:48:49.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.388+0000 7f577f000700 1 -- 172.21.15.81:0/4267722697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57780fcc20 msgr2=0x7f577810fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:49.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.388+0000 7f577f000700 1 --2- 172.21.15.81:0/4267722697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57780fcc20 0x7f577810fa70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f576c00b790 tx=0x7f576c009250 comp rx=0 tx=0).stop 2024-04-23T14:48:49.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.389+0000 7f577f000700 1 -- 172.21.15.81:0/4267722697 shutdown_connections 2024-04-23T14:48:49.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.389+0000 7f577f000700 1 --2- 172.21.15.81:0/4267722697 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f5760039050 0x7f576003b500 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:49.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.389+0000 7f577f000700 1 --2- 172.21.15.81:0/4267722697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57780fcc20 0x7f577810fa70 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:49.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.389+0000 7f577f000700 1 --2- 172.21.15.81:0/4267722697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57780fded0 0x7f577810ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:49.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.389+0000 7f577f000700 1 -- 172.21.15.81:0/4267722697 >> 172.21.15.81:0/4267722697 conn(0x7f57780f83a0 msgr2=0x7f57780f9980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:49.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.389+0000 7f577f000700 1 -- 172.21.15.81:0/4267722697 shutdown_connections 2024-04-23T14:48:49.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.389+0000 7f577f000700 1 -- 172.21.15.81:0/4267722697 wait complete. 2024-04-23T14:48:49.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.543+0000 7f877ae00700 1 -- 172.21.15.81:0/2425845596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87740ff750 msgr2=0x7f87741000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:49.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.543+0000 7f877ae00700 1 --2- 172.21.15.81:0/2425845596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87740ff750 0x7f87741000b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8760004940 tx=0x7f8760009e30 comp rx=0 tx=0).stop 2024-04-23T14:48:49.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.543+0000 7f877ae00700 1 -- 172.21.15.81:0/2425845596 shutdown_connections 2024-04-23T14:48:49.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.543+0000 7f877ae00700 1 --2- 172.21.15.81:0/2425845596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87740ff750 0x7f87741000b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:49.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.543+0000 7f877ae00700 1 --2- 172.21.15.81:0/2425845596 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87740fee00 0x7f87740ff210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:49.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.543+0000 7f877ae00700 1 -- 172.21.15.81:0/2425845596 >> 172.21.15.81:0/2425845596 conn(0x7f87740fa5d0 msgr2=0x7f87740fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:49.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.544+0000 7f877ae00700 1 -- 172.21.15.81:0/2425845596 shutdown_connections 2024-04-23T14:48:49.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.544+0000 7f877ae00700 1 -- 172.21.15.81:0/2425845596 wait complete. 2024-04-23T14:48:49.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.545+0000 7f877ae00700 1 Processor -- start 2024-04-23T14:48:49.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.545+0000 7f877ae00700 1 -- start start 2024-04-23T14:48:49.551 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:49 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:48:49.551 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:49 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:48:49.551 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:49 smithi081 ceph-mon[25540]: Deploying cephadm binary to smithi156 2024-04-23T14:48:49.551 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:49 smithi081 ceph-mon[25540]: Deploying cephadm binary to smithi081 2024-04-23T14:48:49.551 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:49 smithi081 ceph-mon[25540]: mgrmap e22: smithi156.ounwyj(active, since 1.01517s) 2024-04-23T14:48:49.551 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:49 smithi081 ceph-mon[25540]: from='client.24401 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:48:49.552 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:49 smithi081 ceph-mon[25540]: pgmap v3: 65 pgs: 65 active+clean; 93 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-04-23T14:48:49.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.545+0000 7f877ae00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87740fee00 0x7f877410fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:49.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.546+0000 7f877ae00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87740ff750 0x7f877410ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:49.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.546+0000 7f877ae00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8774110560 con 0x7f87740fee00 2024-04-23T14:48:49.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.546+0000 7f877ae00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8774110db0 con 0x7f87740ff750 2024-04-23T14:48:49.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.546+0000 7f8779a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87740fee00 0x7f877410fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:49.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.546+0000 7f8779a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87740fee00 0x7f877410fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56552/0 (socket says 172.21.15.81:56552) 2024-04-23T14:48:49.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.546+0000 7f8779a00700 1 -- 172.21.15.81:0/1299075544 learned_addr learned my addr 172.21.15.81:0/1299075544 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:48:49.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.546+0000 7f8779000700 1 --2- 172.21.15.81:0/1299075544 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87740ff750 0x7f877410ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:49.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.547+0000 7f8779a00700 1 -- 172.21.15.81:0/1299075544 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87740ff750 msgr2=0x7f877410ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:49.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.547+0000 7f8779a00700 1 --2- 172.21.15.81:0/1299075544 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87740ff750 0x7f877410ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:49.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.547+0000 7f8779a00700 1 -- 172.21.15.81:0/1299075544 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8760005040 con 0x7f87740fee00 2024-04-23T14:48:49.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.547+0000 7f8779a00700 1 --2- 172.21.15.81:0/1299075544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87740fee00 0x7f877410fa20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f876800eb70 tx=0x7f876800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:49.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.547+0000 7f8771600700 1 -- 172.21.15.81:0/1299075544 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8768007cc0 con 0x7f87740fee00 2024-04-23T14:48:49.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.547+0000 7f8771600700 1 -- 172.21.15.81:0/1299075544 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f876800f040 con 0x7f87740fee00 2024-04-23T14:48:49.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.547+0000 7f877ae00700 1 -- 172.21.15.81:0/1299075544 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8774111030 con 0x7f87740fee00 2024-04-23T14:48:49.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.548+0000 7f8771600700 1 -- 172.21.15.81:0/1299075544 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f876800cb20 con 0x7f87740fee00 2024-04-23T14:48:49.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.548+0000 7f877ae00700 1 -- 172.21.15.81:0/1299075544 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8774111570 con 0x7f87740fee00 2024-04-23T14:48:49.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.549+0000 7f877ae00700 1 -- 172.21.15.81:0/1299075544 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f877405f5f0 con 0x7f87740fee00 2024-04-23T14:48:49.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.550+0000 7f8771600700 1 -- 172.21.15.81:0/1299075544 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) v1 ==== 46216+0+0 (secure 0 0 0) 0x7f876800cc80 con 0x7f87740fee00 2024-04-23T14:48:49.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.550+0000 7f8771600700 1 --2- 172.21.15.81:0/1299075544 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f875c039060 0x7f875c03b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:49.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.550+0000 7f8771600700 1 -- 172.21.15.81:0/1299075544 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f876804c600 con 0x7f87740fee00 2024-04-23T14:48:49.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.551+0000 7f8779000700 1 --2- 172.21.15.81:0/1299075544 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f875c039060 0x7f875c03b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:49.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.552+0000 7f8779000700 1 --2- 172.21.15.81:0/1299075544 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f875c039060 0x7f875c03b510 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8760013870 tx=0x7f8760009e30 comp rx=0 tx=0).ready entity=mgr.24373 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:49.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.557+0000 7f8771600700 1 -- 172.21.15.81:0/1299075544 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f8768012db0 con 0x7f87740fee00 2024-04-23T14:48:49.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.718+0000 7f8771600700 1 -- 172.21.15.81:0/1299075544 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 23) v1 ==== 46410+0+0 (secure 0 0 0) 0x7f8768012340 con 0x7f87740fee00 2024-04-23T14:48:49.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:49 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:48:49.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:49 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:48:49.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:49 smithi156 ceph-mon[32341]: Deploying cephadm binary to smithi156 2024-04-23T14:48:49.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:49 smithi156 ceph-mon[32341]: Deploying cephadm binary to smithi081 2024-04-23T14:48:49.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:49 smithi156 ceph-mon[32341]: mgrmap e22: smithi156.ounwyj(active, since 1.01517s) 2024-04-23T14:48:49.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:49 smithi156 ceph-mon[32341]: from='client.24401 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:48:49.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:49 smithi156 ceph-mon[32341]: pgmap v3: 65 pgs: 65 active+clean; 93 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-04-23T14:48:49.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.839+0000 7f877ae00700 1 -- 172.21.15.81:0/1299075544 --> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8774111950 con 0x7f875c039060 2024-04-23T14:48:49.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.864+0000 7f8771600700 1 -- 172.21.15.81:0/1299075544 <== mgr.24373 v2:172.21.15.156:6828/100981835 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f8774111950 con 0x7f875c039060 2024-04-23T14:48:49.866 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-23T14:48:49.867 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (8m) 2m ago 9m 13.4M - 0.25.0 c8568f914cd2 730d7164defb 2024-04-23T14:48:49.867 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (10m) 2m ago 10m 6660k - 17.2.7-884-g70d0cb4b cafd8ddac8fa 6ae90c81b232 2024-04-23T14:48:49.867 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi156 smithi156 running (8m) 19s ago 8m 6660k - 17.2.7-884-g70d0cb4b cafd8ddac8fa ecc141919f37 2024-04-23T14:48:49.867 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (7m) 2m ago 9m 74.6M - 9.4.7 954c08fa6188 96965e7e10cc 2024-04-23T14:48:49.867 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.vcoywg smithi081 running (2m) 2m ago 2m 12.8M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 2ca7601ab60f 2024-04-23T14:48:49.867 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.wydgcg smithi081 running (2m) 2m ago 2m 11.6M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 58eb1a961b61 2024-04-23T14:48:49.867 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.rhbtxt smithi156 running (2m) 19s ago 2m 11.1M - 17.2.7-884-g70d0cb4b cafd8ddac8fa db3cb5034381 2024-04-23T14:48:49.867 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.vynkxn smithi156 running (2m) 19s ago 2m 11.1M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 1c8f2219e7fd 2024-04-23T14:48:49.867 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.ldghvq smithi081 *:9283 running (11m) 2m ago 11m 482M - 17.2.7-884-g70d0cb4b cafd8ddac8fa b3d1da9bbf01 2024-04-23T14:48:49.867 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi156.ounwyj smithi156 *:8443,9283 running (25s) 19s ago 8m 50.6M - 19.0.0-3126-gd44fddd9 76e77f280c74 4aef254a3b16 2024-04-23T14:48:49.867 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (11m) 2m ago 11m 44.6M 2048M 17.2.7-884-g70d0cb4b cafd8ddac8fa 6e43d934b336 2024-04-23T14:48:49.867 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi156 smithi156 running (8m) 19s ago 8m 35.0M 2048M 17.2.7-884-g70d0cb4b cafd8ddac8fa d9127540d3bb 2024-04-23T14:48:49.867 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (10m) 2m ago 10m 7759k - 1.5.0 0da6a335fe13 06716415b80c 2024-04-23T14:48:49.867 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi156 smithi156 *:9100 running (8m) 19s ago 8m 7717k - 1.5.0 0da6a335fe13 2d9e680be69f 2024-04-23T14:48:49.868 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (7m) 2m ago 7m 46.6M 4288M 17.2.7-884-g70d0cb4b cafd8ddac8fa 272ca032bec1 2024-04-23T14:48:49.868 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (7m) 2m ago 7m 44.7M 4288M 17.2.7-884-g70d0cb4b cafd8ddac8fa ee6d0c8af6ed 2024-04-23T14:48:49.868 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (6m) 2m ago 6m 45.0M 4288M 17.2.7-884-g70d0cb4b cafd8ddac8fa c26c640828a2 2024-04-23T14:48:49.868 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi156 running (5m) 19s ago 5m 47.7M 5312M 17.2.7-884-g70d0cb4b cafd8ddac8fa c1c261b1ee90 2024-04-23T14:48:49.868 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi156 running (5m) 19s ago 5m 47.7M 5312M 17.2.7-884-g70d0cb4b cafd8ddac8fa 83f996ee64de 2024-04-23T14:48:49.868 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi156 running (4m) 19s ago 4m 46.7M 5312M 17.2.7-884-g70d0cb4b cafd8ddac8fa b754244bef18 2024-04-23T14:48:49.868 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (7m) 2m ago 9m 46.0M - 2.43.0 a07b618ecd1d 1779b897e5df 2024-04-23T14:48:49.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.868+0000 7f877ae00700 1 -- 172.21.15.81:0/1299075544 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f875c039060 msgr2=0x7f875c03b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:49.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.868+0000 7f877ae00700 1 --2- 172.21.15.81:0/1299075544 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f875c039060 0x7f875c03b510 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8760013870 tx=0x7f8760009e30 comp rx=0 tx=0).stop 2024-04-23T14:48:49.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.868+0000 7f877ae00700 1 -- 172.21.15.81:0/1299075544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87740fee00 msgr2=0x7f877410fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:49.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.868+0000 7f877ae00700 1 --2- 172.21.15.81:0/1299075544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87740fee00 0x7f877410fa20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f876800eb70 tx=0x7f876800b040 comp rx=0 tx=0).stop 2024-04-23T14:48:49.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.868+0000 7f877ae00700 1 -- 172.21.15.81:0/1299075544 shutdown_connections 2024-04-23T14:48:49.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.868+0000 7f877ae00700 1 --2- 172.21.15.81:0/1299075544 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f875c039060 0x7f875c03b510 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:49.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.868+0000 7f877ae00700 1 --2- 172.21.15.81:0/1299075544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87740fee00 0x7f877410fa20 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:49.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.868+0000 7f877ae00700 1 --2- 172.21.15.81:0/1299075544 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87740ff750 0x7f877410ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:49.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.868+0000 7f877ae00700 1 -- 172.21.15.81:0/1299075544 >> 172.21.15.81:0/1299075544 conn(0x7f87740fa5d0 msgr2=0x7f87740fbc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:49.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.869+0000 7f877ae00700 1 -- 172.21.15.81:0/1299075544 shutdown_connections 2024-04-23T14:48:49.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:49.869+0000 7f877ae00700 1 -- 172.21.15.81:0/1299075544 wait complete. 2024-04-23T14:48:50.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.058+0000 7f1832a00700 1 -- 172.21.15.81:0/3497637246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f182c071e40 msgr2=0x7f182c070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:50.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.058+0000 7f1832a00700 1 --2- 172.21.15.81:0/3497637246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f182c071e40 0x7f182c070350 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1820004940 tx=0x7f1820009e30 comp rx=0 tx=0).stop 2024-04-23T14:48:50.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.059+0000 7f1832a00700 1 -- 172.21.15.81:0/3497637246 shutdown_connections 2024-04-23T14:48:50.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.059+0000 7f1832a00700 1 --2- 172.21.15.81:0/3497637246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f182c070890 0x7f182c070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:50.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.059+0000 7f1832a00700 1 --2- 172.21.15.81:0/3497637246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f182c071e40 0x7f182c070350 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:50.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.059+0000 7f1832a00700 1 -- 172.21.15.81:0/3497637246 >> 172.21.15.81:0/3497637246 conn(0x7f182c0f83d0 msgr2=0x7f182c0fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:50.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.059+0000 7f1832a00700 1 -- 172.21.15.81:0/3497637246 shutdown_connections 2024-04-23T14:48:50.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.060+0000 7f1832a00700 1 -- 172.21.15.81:0/3497637246 wait complete. 2024-04-23T14:48:50.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.061+0000 7f1832a00700 1 Processor -- start 2024-04-23T14:48:50.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.061+0000 7f1832a00700 1 -- start start 2024-04-23T14:48:50.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.061+0000 7f1832a00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f182c070890 0x7f182c10fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:50.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.061+0000 7f1832a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f182c071e40 0x7f182c110000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:50.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.061+0000 7f1832a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182c110600 con 0x7f182c071e40 2024-04-23T14:48:50.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.061+0000 7f1832a00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182c110e50 con 0x7f182c070890 2024-04-23T14:48:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.062+0000 7f1830c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f182c071e40 0x7f182c110000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.062+0000 7f1830c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f182c071e40 0x7f182c110000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56568/0 (socket says 172.21.15.81:56568) 2024-04-23T14:48:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.062+0000 7f1830c00700 1 -- 172.21.15.81:0/1302887314 learned_addr learned my addr 172.21.15.81:0/1302887314 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:48:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.062+0000 7f1831600700 1 --2- 172.21.15.81:0/1302887314 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f182c070890 0x7f182c10fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.062+0000 7f1830c00700 1 -- 172.21.15.81:0/1302887314 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f182c070890 msgr2=0x7f182c10fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.062+0000 7f1830c00700 1 --2- 172.21.15.81:0/1302887314 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f182c070890 0x7f182c10fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.062+0000 7f1830c00700 1 -- 172.21.15.81:0/1302887314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1820005040 con 0x7f182c071e40 2024-04-23T14:48:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.062+0000 7f1831600700 1 --2- 172.21.15.81:0/1302887314 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f182c070890 0x7f182c10fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:48:50.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.063+0000 7f1830c00700 1 --2- 172.21.15.81:0/1302887314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f182c071e40 0x7f182c110000 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1818002a50 tx=0x7f18180046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:50.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.063+0000 7f1829600700 1 -- 172.21.15.81:0/1302887314 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1818007cc0 con 0x7f182c071e40 2024-04-23T14:48:50.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.063+0000 7f1832a00700 1 -- 172.21.15.81:0/1302887314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f182c111130 con 0x7f182c071e40 2024-04-23T14:48:50.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.063+0000 7f1829600700 1 -- 172.21.15.81:0/1302887314 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f181800f040 con 0x7f182c071e40 2024-04-23T14:48:50.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.063+0000 7f1829600700 1 -- 172.21.15.81:0/1302887314 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1818009640 con 0x7f182c071e40 2024-04-23T14:48:50.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.063+0000 7f1832a00700 1 -- 172.21.15.81:0/1302887314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f182c111670 con 0x7f182c071e40 2024-04-23T14:48:50.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.065+0000 7f1829600700 1 -- 172.21.15.81:0/1302887314 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) v1 ==== 46410+0+0 (secure 0 0 0) 0x7f18180097a0 con 0x7f182c071e40 2024-04-23T14:48:50.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.066+0000 7f1832a00700 1 -- 172.21.15.81:0/1302887314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f182c05f5f0 con 0x7f182c071e40 2024-04-23T14:48:50.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.066+0000 7f1829600700 1 --2- 172.21.15.81:0/1302887314 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f1814039310 0x7f181403b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:50.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.066+0000 7f1829600700 1 -- 172.21.15.81:0/1302887314 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f181804ce90 con 0x7f182c071e40 2024-04-23T14:48:50.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.067+0000 7f1831600700 1 --2- 172.21.15.81:0/1302887314 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f1814039310 0x7f181403b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:50.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.068+0000 7f1831600700 1 --2- 172.21.15.81:0/1302887314 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f1814039310 0x7f181403b7c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1820009fd0 tx=0x7f1820009e30 comp rx=0 tx=0).ready entity=mgr.24373 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:50.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.072+0000 7f1829600700 1 -- 172.21.15.81:0/1302887314 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f181801c400 con 0x7f182c071e40 2024-04-23T14:48:50.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.489+0000 7f1832a00700 1 -- 172.21.15.81:0/1302887314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f182c111a30 con 0x7f182c071e40 2024-04-23T14:48:50.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.490+0000 7f1829600700 1 -- 172.21.15.81:0/1302887314 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f18180112f0 con 0x7f182c071e40 2024-04-23T14:48:50.492 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:48:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-04-23T14:48:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 2 2024-04-23T14:48:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:48:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-04-23T14:48:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 1 2024-04-23T14:48:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:48:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-04-23T14:48:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 6 2024-04-23T14:48:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:48:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-04-23T14:48:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 4 2024-04-23T14:48:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:48:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-04-23T14:48:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 12, 2024-04-23T14:48:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 1 2024-04-23T14:48:50.493 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-23T14:48:50.493 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:48:50.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.493+0000 7f1832a00700 1 -- 172.21.15.81:0/1302887314 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f1814039310 msgr2=0x7f181403b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:50.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.493+0000 7f1832a00700 1 --2- 172.21.15.81:0/1302887314 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f1814039310 0x7f181403b7c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1820009fd0 tx=0x7f1820009e30 comp rx=0 tx=0).stop 2024-04-23T14:48:50.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.493+0000 7f1832a00700 1 -- 172.21.15.81:0/1302887314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f182c071e40 msgr2=0x7f182c110000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:50.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.493+0000 7f1832a00700 1 --2- 172.21.15.81:0/1302887314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f182c071e40 0x7f182c110000 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1818002a50 tx=0x7f18180046b0 comp rx=0 tx=0).stop 2024-04-23T14:48:50.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.494+0000 7f1832a00700 1 -- 172.21.15.81:0/1302887314 shutdown_connections 2024-04-23T14:48:50.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.494+0000 7f1832a00700 1 --2- 172.21.15.81:0/1302887314 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f1814039310 0x7f181403b7c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:50.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.494+0000 7f1832a00700 1 --2- 172.21.15.81:0/1302887314 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f182c070890 0x7f182c10fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:50.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.494+0000 7f1832a00700 1 --2- 172.21.15.81:0/1302887314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f182c071e40 0x7f182c110000 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:50.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.494+0000 7f1832a00700 1 -- 172.21.15.81:0/1302887314 >> 172.21.15.81:0/1302887314 conn(0x7f182c0f83d0 msgr2=0x7f182c0f9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:50.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.494+0000 7f1832a00700 1 -- 172.21.15.81:0/1302887314 shutdown_connections 2024-04-23T14:48:50.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.494+0000 7f1832a00700 1 -- 172.21.15.81:0/1302887314 wait complete. 2024-04-23T14:48:50.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.661+0000 7f1329600700 1 -- 172.21.15.81:0/4079594249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13240662f0 msgr2=0x7f13240ffa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:50.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.661+0000 7f1329600700 1 --2- 172.21.15.81:0/4079594249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13240662f0 0x7f13240ffa30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1314004940 tx=0x7f1314009e30 comp rx=0 tx=0).stop 2024-04-23T14:48:50.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.661+0000 7f1329600700 1 -- 172.21.15.81:0/4079594249 shutdown_connections 2024-04-23T14:48:50.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.661+0000 7f1329600700 1 --2- 172.21.15.81:0/4079594249 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13240fff70 0x7f1324102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:50.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.661+0000 7f1329600700 1 --2- 172.21.15.81:0/4079594249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13240662f0 0x7f13240ffa30 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:50.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.661+0000 7f1329600700 1 -- 172.21.15.81:0/4079594249 >> 172.21.15.81:0/4079594249 conn(0x7f13240f74c0 msgr2=0x7f13240f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:50.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.661+0000 7f1329600700 1 -- 172.21.15.81:0/4079594249 shutdown_connections 2024-04-23T14:48:50.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.661+0000 7f1329600700 1 -- 172.21.15.81:0/4079594249 wait complete. 2024-04-23T14:48:50.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.662+0000 7f1329600700 1 Processor -- start 2024-04-23T14:48:50.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.662+0000 7f1329600700 1 -- start start 2024-04-23T14:48:50.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.663+0000 7f1329600700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13240662f0 0x7f132410fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:50.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.663+0000 7f1329600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13240fff70 0x7f1324110190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:50.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.663+0000 7f1329600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1324110790 con 0x7f13240fff70 2024-04-23T14:48:50.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.663+0000 7f1329600700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1324110fe0 con 0x7f13240662f0 2024-04-23T14:48:50.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.663+0000 7f1322000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13240fff70 0x7f1324110190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:50.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.663+0000 7f1322000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13240fff70 0x7f1324110190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56594/0 (socket says 172.21.15.81:56594) 2024-04-23T14:48:50.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.663+0000 7f1322000700 1 -- 172.21.15.81:0/4071214602 learned_addr learned my addr 172.21.15.81:0/4071214602 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:48:50.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.663+0000 7f1322a00700 1 --2- 172.21.15.81:0/4071214602 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13240662f0 0x7f132410fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:50.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.664+0000 7f1322000700 1 -- 172.21.15.81:0/4071214602 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13240662f0 msgr2=0x7f132410fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:50.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.664+0000 7f1322000700 1 --2- 172.21.15.81:0/4071214602 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13240662f0 0x7f132410fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:50.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.664+0000 7f1322000700 1 -- 172.21.15.81:0/4071214602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1314005040 con 0x7f13240fff70 2024-04-23T14:48:50.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.664+0000 7f1322000700 1 --2- 172.21.15.81:0/4071214602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13240fff70 0x7f1324110190 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1310002a50 tx=0x7f13100046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:50.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.664+0000 7f131aa00700 1 -- 172.21.15.81:0/4071214602 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1310007cc0 con 0x7f13240fff70 2024-04-23T14:48:50.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.664+0000 7f131aa00700 1 -- 172.21.15.81:0/4071214602 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f131000f040 con 0x7f13240fff70 2024-04-23T14:48:50.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.664+0000 7f1329600700 1 -- 172.21.15.81:0/4071214602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13241112c0 con 0x7f13240fff70 2024-04-23T14:48:50.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.664+0000 7f131aa00700 1 -- 172.21.15.81:0/4071214602 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1310009640 con 0x7f13240fff70 2024-04-23T14:48:50.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.665+0000 7f1329600700 1 -- 172.21.15.81:0/4071214602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1324111800 con 0x7f13240fff70 2024-04-23T14:48:50.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.666+0000 7f1329600700 1 -- 172.21.15.81:0/4071214602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13240f8ff0 con 0x7f13240fff70 2024-04-23T14:48:50.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.666+0000 7f131aa00700 1 -- 172.21.15.81:0/4071214602 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) v1 ==== 46410+0+0 (secure 0 0 0) 0x7f13100097c0 con 0x7f13240fff70 2024-04-23T14:48:50.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.667+0000 7f131aa00700 1 --2- 172.21.15.81:0/4071214602 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f13080392c0 0x7f130803b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:50.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.667+0000 7f131aa00700 1 -- 172.21.15.81:0/4071214602 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f131004cdd0 con 0x7f13240fff70 2024-04-23T14:48:50.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.668+0000 7f1322a00700 1 --2- 172.21.15.81:0/4071214602 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f13080392c0 0x7f130803b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:50.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.668+0000 7f1322a00700 1 --2- 172.21.15.81:0/4071214602 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f13080392c0 0x7f130803b770 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f131400b970 tx=0x7f1314009e30 comp rx=0 tx=0).ready entity=mgr.24373 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:50.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:50.675+0000 7f131aa00700 1 -- 172.21.15.81:0/4071214602 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f131001c400 con 0x7f13240fff70 2024-04-23T14:48:50.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:50 smithi081 ceph-mon[25540]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:48:50.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:50 smithi081 ceph-mon[25540]: mgrmap e23: smithi156.ounwyj(active, since 2s) 2024-04-23T14:48:50.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:50 smithi081 ceph-mon[25540]: pgmap v4: 65 pgs: 65 active+clean; 93 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-04-23T14:48:50.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:50 smithi081 ceph-mon[25540]: [23/Apr/2024:14:48:49] ENGINE Bus STARTING 2024-04-23T14:48:50.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:50 smithi081 ceph-mon[25540]: from='client.14662 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:48:50.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:50 smithi081 ceph-mon[25540]: [23/Apr/2024:14:48:49] ENGINE Serving on http://172.21.15.156:8765 2024-04-23T14:48:50.828 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:50 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/1302887314' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:48:51.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:50 smithi156 ceph-mon[32341]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:48:51.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:50 smithi156 ceph-mon[32341]: mgrmap e23: smithi156.ounwyj(active, since 2s) 2024-04-23T14:48:51.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:50 smithi156 ceph-mon[32341]: pgmap v4: 65 pgs: 65 active+clean; 93 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-04-23T14:48:51.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:50 smithi156 ceph-mon[32341]: [23/Apr/2024:14:48:49] ENGINE Bus STARTING 2024-04-23T14:48:51.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:50 smithi156 ceph-mon[32341]: from='client.14662 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:48:51.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:50 smithi156 ceph-mon[32341]: [23/Apr/2024:14:48:49] ENGINE Serving on http://172.21.15.156:8765 2024-04-23T14:48:51.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:50 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/1302887314' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:48:51.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.085+0000 7f1329600700 1 -- 172.21.15.81:0/4071214602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f132405f5f0 con 0x7f13240fff70 2024-04-23T14:48:51.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.086+0000 7f131aa00700 1 -- 172.21.15.81:0/4071214602 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1837 (secure 0 0 0) 0x7f13100112f0 con 0x7f13240fff70 2024-04-23T14:48:51.088 INFO:teuthology.orchestra.run.smithi081.stdout:e18 2024-04-23T14:48:51.088 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-23T14:48:51.088 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:48:51.088 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-04-23T14:48:51.088 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:48:51.088 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-04-23T14:48:51.088 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-04-23T14:48:51.088 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 17 2024-04-23T14:48:51.089 INFO:teuthology.orchestra.run.smithi081.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-23T14:48:51.089 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-04-23T14:45:51.264703+0000 2024-04-23T14:48:51.089 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-04-23T14:46:12.782992+0000 2024-04-23T14:48:51.089 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-04-23T14:48:51.089 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-04-23T14:48:51.089 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-04-23T14:48:51.089 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-04-23T14:48:51.089 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-04-23T14:48:51.089 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-04-23T14:48:51.089 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-04-23T14:48:51.090 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 47 2024-04-23T14:48:51.090 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:48:51.090 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 1 2024-04-23T14:48:51.090 INFO:teuthology.orchestra.run.smithi081.stdout:in 0 2024-04-23T14:48:51.090 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=14472} 2024-04-23T14:48:51.090 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-04-23T14:48:51.090 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-04-23T14:48:51.090 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-04-23T14:48:51.090 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-04-23T14:48:51.090 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-04-23T14:48:51.090 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-04-23T14:48:51.091 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-04-23T14:48:51.091 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-04-23T14:48:51.091 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.vcoywg{0:14472} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.81:6828/2563365650,v1:172.21.15.81:6829/2563365650] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:48:51.091 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.wydgcg{0:14482} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.81:6826/759909104,v1:172.21.15.81:6827/759909104] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:48:51.091 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:48:51.091 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:48:51.091 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-04-23T14:48:51.091 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:48:51.091 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.vynkxn{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.156:6826/1794690362,v1:172.21.15.156:6827/1794690362] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:48:51.091 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.rhbtxt{-1:24263} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.156:6824/3854041261,v1:172.21.15.156:6825/3854041261] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:48:51.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.088+0000 7f1329600700 1 -- 172.21.15.81:0/4071214602 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f13080392c0 msgr2=0x7f130803b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:51.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.088+0000 7f1329600700 1 --2- 172.21.15.81:0/4071214602 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f13080392c0 0x7f130803b770 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f131400b970 tx=0x7f1314009e30 comp rx=0 tx=0).stop 2024-04-23T14:48:51.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.088+0000 7f1329600700 1 -- 172.21.15.81:0/4071214602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13240fff70 msgr2=0x7f1324110190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:51.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.088+0000 7f1329600700 1 --2- 172.21.15.81:0/4071214602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13240fff70 0x7f1324110190 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1310002a50 tx=0x7f13100046b0 comp rx=0 tx=0).stop 2024-04-23T14:48:51.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.089+0000 7f1329600700 1 -- 172.21.15.81:0/4071214602 shutdown_connections 2024-04-23T14:48:51.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.089+0000 7f1329600700 1 --2- 172.21.15.81:0/4071214602 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f13080392c0 0x7f130803b770 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:51.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.089+0000 7f1329600700 1 --2- 172.21.15.81:0/4071214602 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13240662f0 0x7f132410fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:51.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.089+0000 7f1329600700 1 --2- 172.21.15.81:0/4071214602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13240fff70 0x7f1324110190 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:51.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.089+0000 7f1329600700 1 -- 172.21.15.81:0/4071214602 >> 172.21.15.81:0/4071214602 conn(0x7f13240f74c0 msgr2=0x7f13240fbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:51.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.089+0000 7f1329600700 1 -- 172.21.15.81:0/4071214602 shutdown_connections 2024-04-23T14:48:51.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.089+0000 7f1329600700 1 -- 172.21.15.81:0/4071214602 wait complete. 2024-04-23T14:48:51.093 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 18 2024-04-23T14:48:51.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.286+0000 7fc887200700 1 -- 172.21.15.81:0/3131351885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc888071e40 msgr2=0x7fc888070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:51.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.286+0000 7fc887200700 1 --2- 172.21.15.81:0/3131351885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc888071e40 0x7fc888070350 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc878004940 tx=0x7fc878009e30 comp rx=0 tx=0).stop 2024-04-23T14:48:51.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.286+0000 7fc887200700 1 -- 172.21.15.81:0/3131351885 shutdown_connections 2024-04-23T14:48:51.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.286+0000 7fc887200700 1 --2- 172.21.15.81:0/3131351885 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc888070890 0x7fc888070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:51.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.286+0000 7fc887200700 1 --2- 172.21.15.81:0/3131351885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc888071e40 0x7fc888070350 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:51.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.287+0000 7fc887200700 1 -- 172.21.15.81:0/3131351885 >> 172.21.15.81:0/3131351885 conn(0x7fc8880f8390 msgr2=0x7fc8880fa7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:51.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.287+0000 7fc887200700 1 -- 172.21.15.81:0/3131351885 shutdown_connections 2024-04-23T14:48:51.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.287+0000 7fc887200700 1 -- 172.21.15.81:0/3131351885 wait complete. 2024-04-23T14:48:51.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.288+0000 7fc887200700 1 Processor -- start 2024-04-23T14:48:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.288+0000 7fc887200700 1 -- start start 2024-04-23T14:48:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.288+0000 7fc887200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc888070890 0x7fc88810fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.288+0000 7fc887200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc888071e40 0x7fc88810fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.288+0000 7fc887200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8881105f0 con 0x7fc888070890 2024-04-23T14:48:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.288+0000 7fc887200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc888110e40 con 0x7fc888071e40 2024-04-23T14:48:51.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.289+0000 7fc885e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc888070890 0x7fc88810fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:51.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.289+0000 7fc885e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc888070890 0x7fc88810fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56600/0 (socket says 172.21.15.81:56600) 2024-04-23T14:48:51.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.289+0000 7fc885e00700 1 -- 172.21.15.81:0/1513189292 learned_addr learned my addr 172.21.15.81:0/1513189292 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:48:51.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.289+0000 7fc885e00700 1 -- 172.21.15.81:0/1513189292 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc888071e40 msgr2=0x7fc88810fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:51.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.289+0000 7fc885e00700 1 --2- 172.21.15.81:0/1513189292 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc888071e40 0x7fc88810fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:51.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.289+0000 7fc885e00700 1 -- 172.21.15.81:0/1513189292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc878005040 con 0x7fc888070890 2024-04-23T14:48:51.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.289+0000 7fc885e00700 1 --2- 172.21.15.81:0/1513189292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc888070890 0x7fc88810fab0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc878000c00 tx=0x7fc878009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:51.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.290+0000 7fc87e000700 1 -- 172.21.15.81:0/1513189292 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc87800e040 con 0x7fc888070890 2024-04-23T14:48:51.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.290+0000 7fc87e000700 1 -- 172.21.15.81:0/1513189292 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc87800bcc0 con 0x7fc888070890 2024-04-23T14:48:51.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.290+0000 7fc887200700 1 -- 172.21.15.81:0/1513189292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8881110c0 con 0x7fc888070890 2024-04-23T14:48:51.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.290+0000 7fc87e000700 1 -- 172.21.15.81:0/1513189292 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc87801c630 con 0x7fc888070890 2024-04-23T14:48:51.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.290+0000 7fc887200700 1 -- 172.21.15.81:0/1513189292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc888111600 con 0x7fc888070890 2024-04-23T14:48:51.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.291+0000 7fc887200700 1 -- 172.21.15.81:0/1513189292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc88805f5f0 con 0x7fc888070890 2024-04-23T14:48:51.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.292+0000 7fc87e000700 1 -- 172.21.15.81:0/1513189292 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) v1 ==== 46410+0+0 (secure 0 0 0) 0x7fc878013980 con 0x7fc888070890 2024-04-23T14:48:51.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.292+0000 7fc87e000700 1 --2- 172.21.15.81:0/1513189292 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fc86c0392c0 0x7fc86c03b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:51.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.292+0000 7fc87e000700 1 -- 172.21.15.81:0/1513189292 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fc87804e1d0 con 0x7fc888070890 2024-04-23T14:48:51.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.293+0000 7fc885400700 1 --2- 172.21.15.81:0/1513189292 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fc86c0392c0 0x7fc86c03b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:51.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.294+0000 7fc885400700 1 --2- 172.21.15.81:0/1513189292 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fc86c0392c0 0x7fc86c03b770 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc874004d00 tx=0x7fc874009ce0 comp rx=0 tx=0).ready entity=mgr.24373 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:51.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.302+0000 7fc87e000700 1 -- 172.21.15.81:0/1513189292 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7fc878011550 con 0x7fc888070890 2024-04-23T14:48:51.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.656+0000 7fc887200700 1 -- 172.21.15.81:0/1513189292 --> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc888111aa0 con 0x7fc86c0392c0 2024-04-23T14:48:51.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.663+0000 7fc87e000700 1 -- 172.21.15.81:0/1513189292 <== mgr.24373 v2:172.21.15.156:6828/100981835 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fc888111aa0 con 0x7fc86c0392c0 2024-04-23T14:48:51.664 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:48:51.664 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd", 2024-04-23T14:48:51.664 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-04-23T14:48:51.665 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-23T14:48:51.665 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [], 2024-04-23T14:48:51.665 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "1/21 daemons upgraded", 2024-04-23T14:48:51.665 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "", 2024-04-23T14:48:51.665 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-04-23T14:48:51.665 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:48:51.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.666+0000 7fc887200700 1 -- 172.21.15.81:0/1513189292 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fc86c0392c0 msgr2=0x7fc86c03b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:51.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.666+0000 7fc887200700 1 --2- 172.21.15.81:0/1513189292 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fc86c0392c0 0x7fc86c03b770 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc874004d00 tx=0x7fc874009ce0 comp rx=0 tx=0).stop 2024-04-23T14:48:51.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.666+0000 7fc887200700 1 -- 172.21.15.81:0/1513189292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc888070890 msgr2=0x7fc88810fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:51.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.666+0000 7fc887200700 1 --2- 172.21.15.81:0/1513189292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc888070890 0x7fc88810fab0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc878000c00 tx=0x7fc878009e30 comp rx=0 tx=0).stop 2024-04-23T14:48:51.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.667+0000 7fc887200700 1 -- 172.21.15.81:0/1513189292 shutdown_connections 2024-04-23T14:48:51.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.667+0000 7fc887200700 1 --2- 172.21.15.81:0/1513189292 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fc86c0392c0 0x7fc86c03b770 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:51.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.667+0000 7fc887200700 1 --2- 172.21.15.81:0/1513189292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc888070890 0x7fc88810fab0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:51.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.667+0000 7fc887200700 1 --2- 172.21.15.81:0/1513189292 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc888071e40 0x7fc88810fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:51.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.667+0000 7fc887200700 1 -- 172.21.15.81:0/1513189292 >> 172.21.15.81:0/1513189292 conn(0x7fc8880f8390 msgr2=0x7fc8880f9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:51.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.667+0000 7fc887200700 1 -- 172.21.15.81:0/1513189292 shutdown_connections 2024-04-23T14:48:51.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.667+0000 7fc887200700 1 -- 172.21.15.81:0/1513189292 wait complete. 2024-04-23T14:48:51.807 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:51 smithi081 ceph-mon[25540]: [23/Apr/2024:14:48:50] ENGINE Serving on https://172.21.15.156:7150 2024-04-23T14:48:51.808 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:51 smithi081 ceph-mon[25540]: [23/Apr/2024:14:48:50] ENGINE Bus STARTED 2024-04-23T14:48:51.808 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:51 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/4071214602' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:48:51.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.844+0000 7fb4a8400700 1 -- 172.21.15.81:0/2139018530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4a00fe0e0 msgr2=0x7fb4a00fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:51.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.844+0000 7fb4a8400700 1 --2- 172.21.15.81:0/2139018530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4a00fe0e0 0x7fb4a00fe550 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb48c004940 tx=0x7fb48c009e30 comp rx=0 tx=0).stop 2024-04-23T14:48:51.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.844+0000 7fb4a8400700 1 -- 172.21.15.81:0/2139018530 shutdown_connections 2024-04-23T14:48:51.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.845+0000 7fb4a8400700 1 --2- 172.21.15.81:0/2139018530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4a00fe0e0 0x7fb4a00fe550 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:51.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.845+0000 7fb4a8400700 1 --2- 172.21.15.81:0/2139018530 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4a00fcef0 0x7fb4a00fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:51.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.845+0000 7fb4a8400700 1 -- 172.21.15.81:0/2139018530 >> 172.21.15.81:0/2139018530 conn(0x7fb4a00f8530 msgr2=0x7fb4a00fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:51.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.845+0000 7fb4a8400700 1 -- 172.21.15.81:0/2139018530 shutdown_connections 2024-04-23T14:48:51.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.845+0000 7fb4a8400700 1 -- 172.21.15.81:0/2139018530 wait complete. 2024-04-23T14:48:51.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.846+0000 7fb4a8400700 1 Processor -- start 2024-04-23T14:48:51.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.846+0000 7fb4a8400700 1 -- start start 2024-04-23T14:48:51.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.846+0000 7fb4a8400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4a00fcef0 0x7fb4a010fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:51.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.846+0000 7fb4a8400700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4a00fe0e0 0x7fb4a0110110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:51.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.846+0000 7fb4a8400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a0110710 con 0x7fb4a00fcef0 2024-04-23T14:48:51.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.846+0000 7fb4a8400700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a0110f60 con 0x7fb4a00fe0e0 2024-04-23T14:48:51.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.847+0000 7fb4a5a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4a00fcef0 0x7fb4a010fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:51.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.847+0000 7fb4a5a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4a00fcef0 0x7fb4a010fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56618/0 (socket says 172.21.15.81:56618) 2024-04-23T14:48:51.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.847+0000 7fb4a5a00700 1 -- 172.21.15.81:0/2593551474 learned_addr learned my addr 172.21.15.81:0/2593551474 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:48:51.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.847+0000 7fb4a5a00700 1 -- 172.21.15.81:0/2593551474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4a00fe0e0 msgr2=0x7fb4a0110110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:51.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.847+0000 7fb4a5a00700 1 --2- 172.21.15.81:0/2593551474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4a00fe0e0 0x7fb4a0110110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:51.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.847+0000 7fb4a5a00700 1 -- 172.21.15.81:0/2593551474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb48c005040 con 0x7fb4a00fcef0 2024-04-23T14:48:51.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.848+0000 7fb4a5a00700 1 --2- 172.21.15.81:0/2593551474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4a00fcef0 0x7fb4a010fbd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb49400eb70 tx=0x7fb49400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:51.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.848+0000 7fb49d600700 1 -- 172.21.15.81:0/2593551474 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb494007cc0 con 0x7fb4a00fcef0 2024-04-23T14:48:51.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.848+0000 7fb49d600700 1 -- 172.21.15.81:0/2593551474 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb49400f040 con 0x7fb4a00fcef0 2024-04-23T14:48:51.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.848+0000 7fb49d600700 1 -- 172.21.15.81:0/2593551474 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb49400cbd0 con 0x7fb4a00fcef0 2024-04-23T14:48:51.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.848+0000 7fb4a8400700 1 -- 172.21.15.81:0/2593551474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4a01111e0 con 0x7fb4a00fcef0 2024-04-23T14:48:51.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.848+0000 7fb4a8400700 1 -- 172.21.15.81:0/2593551474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4a01116d0 con 0x7fb4a00fcef0 2024-04-23T14:48:51.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.849+0000 7fb4a8400700 1 -- 172.21.15.81:0/2593551474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4a0101a70 con 0x7fb4a00fcef0 2024-04-23T14:48:51.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.850+0000 7fb49d600700 1 -- 172.21.15.81:0/2593551474 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) v1 ==== 46568+0+0 (secure 0 0 0) 0x7fb49400cd30 con 0x7fb4a00fcef0 2024-04-23T14:48:51.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.850+0000 7fb49d600700 1 --2- 172.21.15.81:0/2593551474 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fb488039480 0x7fb48803b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:48:51.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.850+0000 7fb49d600700 1 -- 172.21.15.81:0/2593551474 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fb49404cd90 con 0x7fb4a00fcef0 2024-04-23T14:48:51.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.851+0000 7fb4a5000700 1 --2- 172.21.15.81:0/2593551474 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fb488039480 0x7fb48803b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:48:51.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.852+0000 7fb4a5000700 1 --2- 172.21.15.81:0/2593551474 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fb488039480 0x7fb48803b930 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb48c013870 tx=0x7fb48c009e30 comp rx=0 tx=0).ready entity=mgr.24373 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:48:51.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:51.856+0000 7fb49d600700 1 -- 172.21.15.81:0/2593551474 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7fb494012db0 con 0x7fb4a00fcef0 2024-04-23T14:48:52.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:51 smithi156 ceph-mon[32341]: [23/Apr/2024:14:48:50] ENGINE Serving on https://172.21.15.156:7150 2024-04-23T14:48:52.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:51 smithi156 ceph-mon[32341]: [23/Apr/2024:14:48:50] ENGINE Bus STARTED 2024-04-23T14:48:52.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:51 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/4071214602' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:48:52.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:52.329+0000 7fb4a8400700 1 -- 172.21.15.81:0/2593551474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb4a0105b30 con 0x7fb4a00fcef0 2024-04-23T14:48:52.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:52.329+0000 7fb49d600700 1 -- 172.21.15.81:0/2593551474 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fb4a0105b30 con 0x7fb4a00fcef0 2024-04-23T14:48:52.331 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-04-23T14:48:52.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:52.333+0000 7fb4a8400700 1 -- 172.21.15.81:0/2593551474 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fb488039480 msgr2=0x7fb48803b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:52.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:52.333+0000 7fb4a8400700 1 --2- 172.21.15.81:0/2593551474 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fb488039480 0x7fb48803b930 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb48c013870 tx=0x7fb48c009e30 comp rx=0 tx=0).stop 2024-04-23T14:48:52.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:52.333+0000 7fb4a8400700 1 -- 172.21.15.81:0/2593551474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4a00fcef0 msgr2=0x7fb4a010fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:48:52.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:52.333+0000 7fb4a8400700 1 --2- 172.21.15.81:0/2593551474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4a00fcef0 0x7fb4a010fbd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb49400eb70 tx=0x7fb49400b040 comp rx=0 tx=0).stop 2024-04-23T14:48:52.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:52.333+0000 7fb4a8400700 1 -- 172.21.15.81:0/2593551474 shutdown_connections 2024-04-23T14:48:52.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:52.333+0000 7fb4a8400700 1 --2- 172.21.15.81:0/2593551474 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fb488039480 0x7fb48803b930 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:52.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:52.333+0000 7fb4a8400700 1 --2- 172.21.15.81:0/2593551474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4a00fcef0 0x7fb4a010fbd0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:52.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:52.333+0000 7fb4a8400700 1 --2- 172.21.15.81:0/2593551474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4a00fe0e0 0x7fb4a0110110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:48:52.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:52.333+0000 7fb4a8400700 1 -- 172.21.15.81:0/2593551474 >> 172.21.15.81:0/2593551474 conn(0x7fb4a00f8530 msgr2=0x7fb4a00f9b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:48:52.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:52.333+0000 7fb4a8400700 1 -- 172.21.15.81:0/2593551474 shutdown_connections 2024-04-23T14:48:52.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:48:52.334+0000 7fb4a8400700 1 -- 172.21.15.81:0/2593551474 wait complete. 2024-04-23T14:48:52.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:52 smithi081 ceph-mon[25540]: from='client.14678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:48:52.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:52 smithi081 ceph-mon[25540]: pgmap v5: 65 pgs: 65 active+clean; 93 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-04-23T14:48:52.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:52 smithi081 ceph-mon[25540]: mgrmap e24: smithi156.ounwyj(active, since 4s) 2024-04-23T14:48:52.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:52 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/2593551474' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:48:53.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:52 smithi156 ceph-mon[32341]: from='client.14678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:48:53.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:52 smithi156 ceph-mon[32341]: pgmap v5: 65 pgs: 65 active+clean; 93 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-04-23T14:48:53.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:52 smithi156 ceph-mon[32341]: mgrmap e24: smithi156.ounwyj(active, since 4s) 2024-04-23T14:48:53.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:52 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/2593551474' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:48:55.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:54 smithi156 ceph-mon[32341]: pgmap v6: 65 pgs: 65 active+clean; 96 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 342 KiB/s rd, 825 KiB/s wr, 96 op/s 2024-04-23T14:48:55.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:54 smithi081 ceph-mon[25540]: pgmap v6: 65 pgs: 65 active+clean; 96 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 342 KiB/s rd, 825 KiB/s wr, 96 op/s 2024-04-23T14:48:56.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:56 smithi081 ceph-mon[25540]: pgmap v7: 65 pgs: 65 active+clean; 111 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 304 op/s 2024-04-23T14:48:57.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:56 smithi156 ceph-mon[32341]: pgmap v7: 65 pgs: 65 active+clean; 111 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 304 op/s 2024-04-23T14:48:58.987 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:58 smithi081 ceph-mon[25540]: pgmap v8: 65 pgs: 65 active+clean; 111 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 2.2 MiB/s wr, 237 op/s 2024-04-23T14:48:58.987 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:58 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:48:58.987 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:58 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:48:59.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:58 smithi156 ceph-mon[32341]: pgmap v8: 65 pgs: 65 active+clean; 111 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 2.2 MiB/s wr, 237 op/s 2024-04-23T14:48:59.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:58 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:48:59.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:58 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:00.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:59 smithi156 ceph-mon[32341]: Standby manager daemon smithi081.ldghvq started 2024-04-23T14:49:00.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:59 smithi156 ceph-mon[32341]: from='mgr.? 172.21.15.81:0/1657501818' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi081.ldghvq/crt"}]: dispatch 2024-04-23T14:49:00.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:59 smithi156 ceph-mon[32341]: from='mgr.? 172.21.15.81:0/1657501818' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-23T14:49:00.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:59 smithi156 ceph-mon[32341]: from='mgr.? 172.21.15.81:0/1657501818' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi081.ldghvq/key"}]: dispatch 2024-04-23T14:49:00.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:48:59 smithi156 ceph-mon[32341]: from='mgr.? 172.21.15.81:0/1657501818' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-23T14:49:00.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:59 smithi081 ceph-mon[25540]: Standby manager daemon smithi081.ldghvq started 2024-04-23T14:49:00.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:59 smithi081 ceph-mon[25540]: from='mgr.? 172.21.15.81:0/1657501818' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi081.ldghvq/crt"}]: dispatch 2024-04-23T14:49:00.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:59 smithi081 ceph-mon[25540]: from='mgr.? 172.21.15.81:0/1657501818' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-23T14:49:00.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:59 smithi081 ceph-mon[25540]: from='mgr.? 172.21.15.81:0/1657501818' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi081.ldghvq/key"}]: dispatch 2024-04-23T14:49:00.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:48:59 smithi081 ceph-mon[25540]: from='mgr.? 172.21.15.81:0/1657501818' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-23T14:49:01.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:00 smithi156 ceph-mon[32341]: pgmap v9: 65 pgs: 65 active+clean; 128 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.4 MiB/s wr, 295 op/s 2024-04-23T14:49:01.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:00 smithi156 ceph-mon[32341]: mgrmap e25: smithi156.ounwyj(active, since 12s), standbys: smithi081.ldghvq 2024-04-23T14:49:01.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:00 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "mgr metadata", "who": "smithi081.ldghvq", "id": "smithi081.ldghvq"}]: dispatch 2024-04-23T14:49:01.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:00 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:01.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:00 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:01.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:00 smithi081 ceph-mon[25540]: pgmap v9: 65 pgs: 65 active+clean; 128 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.4 MiB/s wr, 295 op/s 2024-04-23T14:49:01.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:00 smithi081 ceph-mon[25540]: mgrmap e25: smithi156.ounwyj(active, since 12s), standbys: smithi081.ldghvq 2024-04-23T14:49:01.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:00 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "mgr metadata", "who": "smithi081.ldghvq", "id": "smithi081.ldghvq"}]: dispatch 2024-04-23T14:49:01.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:00 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:01.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:00 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:03.016 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:02 smithi156 ceph-mon[32341]: pgmap v10: 65 pgs: 65 active+clean; 128 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 3.1 MiB/s wr, 271 op/s 2024-04-23T14:49:03.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:02 smithi081 ceph-mon[25540]: pgmap v10: 65 pgs: 65 active+clean; 128 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 3.1 MiB/s wr, 271 op/s 2024-04-23T14:49:04.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:03 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:49:04.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:03 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:49:05.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:04 smithi156 ceph-mon[32341]: pgmap v11: 65 pgs: 65 active+clean; 137 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 3.9 MiB/s wr, 329 op/s 2024-04-23T14:49:05.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:04 smithi081 ceph-mon[25540]: pgmap v11: 65 pgs: 65 active+clean; 137 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 3.9 MiB/s wr, 329 op/s 2024-04-23T14:49:07.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:06 smithi081 ceph-mon[25540]: pgmap v12: 65 pgs: 65 active+clean; 149 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.6 MiB/s wr, 448 op/s 2024-04-23T14:49:07.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:06 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:07.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:06 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:07.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:06 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:49:07.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:06 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:49:07.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:06 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:49:07.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:06 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:49:07.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:06 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:49:07.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:06 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:49:07.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:06 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:07.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:06 smithi156 ceph-mon[32341]: pgmap v12: 65 pgs: 65 active+clean; 149 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.6 MiB/s wr, 448 op/s 2024-04-23T14:49:07.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:06 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:07.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:06 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:07.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:06 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:49:07.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:06 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:49:07.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:06 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:49:07.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:06 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:49:07.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:06 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:49:07.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:06 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:49:07.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:06 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:08.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:07 smithi081 ceph-mon[25540]: Adjusting osd_memory_target on smithi156 to 2581M 2024-04-23T14:49:08.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:07 smithi156 ceph-mon[32341]: Adjusting osd_memory_target on smithi156 to 2581M 2024-04-23T14:49:09.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:08 smithi081 ceph-mon[25540]: pgmap v13: 65 pgs: 65 active+clean; 149 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 310 op/s 2024-04-23T14:49:09.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:08 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:09.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:08 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:09.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:08 smithi156 ceph-mon[32341]: pgmap v13: 65 pgs: 65 active+clean; 149 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 310 op/s 2024-04-23T14:49:09.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:08 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:09.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:08 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:11.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:10 smithi156 ceph-mon[32341]: pgmap v14: 65 pgs: 65 active+clean; 158 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 4.1 MiB/s wr, 323 op/s 2024-04-23T14:49:11.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:10 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:11.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:10 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:11.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:10 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:49:11.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:10 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:49:11.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:10 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:49:11.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:10 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:49:11.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:10 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:49:11.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:10 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:49:11.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:10 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:11.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:10 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:49:11.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:10 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:49:11.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:10 smithi081 ceph-mon[25540]: pgmap v14: 65 pgs: 65 active+clean; 158 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 4.1 MiB/s wr, 323 op/s 2024-04-23T14:49:11.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:10 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:11.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:10 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:11.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:10 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:49:11.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:10 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:49:11.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:10 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:49:11.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:10 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:49:11.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:10 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:49:11.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:10 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T14:49:11.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:10 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:11.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:10 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:49:11.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:10 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:49:12.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:11 smithi156 ceph-mon[32341]: Adjusting osd_memory_target on smithi081 to 1557M 2024-04-23T14:49:12.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:11 smithi156 ceph-mon[32341]: Updating smithi081:/etc/ceph/ceph.conf 2024-04-23T14:49:12.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:11 smithi156 ceph-mon[32341]: Updating smithi156:/etc/ceph/ceph.conf 2024-04-23T14:49:12.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:11 smithi156 ceph-mon[32341]: Updating smithi081:/var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:49:12.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:11 smithi081 ceph-mon[25540]: Adjusting osd_memory_target on smithi081 to 1557M 2024-04-23T14:49:12.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:11 smithi081 ceph-mon[25540]: Updating smithi081:/etc/ceph/ceph.conf 2024-04-23T14:49:12.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:11 smithi081 ceph-mon[25540]: Updating smithi156:/etc/ceph/ceph.conf 2024-04-23T14:49:12.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:11 smithi081 ceph-mon[25540]: Updating smithi081:/var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:49:13.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:12 smithi156 ceph-mon[32341]: Updating smithi156:/var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:49:13.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:12 smithi156 ceph-mon[32341]: pgmap v15: 65 pgs: 65 active+clean; 158 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 2.6 MiB/s wr, 229 op/s 2024-04-23T14:49:13.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:12 smithi156 ceph-mon[32341]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-04-23T14:49:13.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:12 smithi156 ceph-mon[32341]: Updating smithi156:/etc/ceph/ceph.client.admin.keyring 2024-04-23T14:49:13.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:12 smithi081 ceph-mon[25540]: Updating smithi156:/var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:49:13.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:12 smithi081 ceph-mon[25540]: pgmap v15: 65 pgs: 65 active+clean; 158 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 2.6 MiB/s wr, 229 op/s 2024-04-23T14:49:13.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:12 smithi081 ceph-mon[25540]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-04-23T14:49:13.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:12 smithi081 ceph-mon[25540]: Updating smithi156:/etc/ceph/ceph.client.admin.keyring 2024-04-23T14:49:14.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:14 smithi081 ceph-mon[25540]: Updating smithi081:/var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T14:49:14.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:14 smithi081 ceph-mon[25540]: Updating smithi156:/var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T14:49:14.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:14 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:14.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:14 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:14.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:14 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:14.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:14 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:14.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:14 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:14.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:14 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:14.329 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:14 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:14.329 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:14 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:14.329 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:14 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:14.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:14 smithi156 ceph-mon[32341]: Updating smithi081:/var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T14:49:14.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:14 smithi156 ceph-mon[32341]: Updating smithi156:/var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T14:49:14.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:14 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:14.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:14 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:14.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:14 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:14.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:14 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:14.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:14 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:14.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:14 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:14.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:14 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:14.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:14 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:14.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:14 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:15.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:15 smithi081 ceph-mon[25540]: Reconfiguring node-exporter.smithi081 (dependencies changed)... 2024-04-23T14:49:15.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:15 smithi081 ceph-mon[25540]: Reconfiguring daemon node-exporter.smithi081 on smithi081 2024-04-23T14:49:15.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:15 smithi081 ceph-mon[25540]: pgmap v16: 65 pgs: 65 active+clean; 158 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 2.6 MiB/s wr, 229 op/s 2024-04-23T14:49:15.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:15 smithi156 ceph-mon[32341]: Reconfiguring node-exporter.smithi081 (dependencies changed)... 2024-04-23T14:49:15.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:15 smithi156 ceph-mon[32341]: Reconfiguring daemon node-exporter.smithi081 on smithi081 2024-04-23T14:49:15.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:15 smithi156 ceph-mon[32341]: pgmap v16: 65 pgs: 65 active+clean; 158 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 2.6 MiB/s wr, 229 op/s 2024-04-23T14:49:15.605 INFO:tasks.workunit.client.0.smithi081.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-23T14:49:15.635 INFO:tasks.workunit.client.0.smithi081.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-23T14:49:15.635 INFO:tasks.workunit.client.0.smithi081.stderr:+ make 2024-04-23T14:49:17.244 INFO:tasks.workunit.client.0.smithi081.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-23T14:49:17.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:17 smithi081 ceph-mon[25540]: pgmap v17: 65 pgs: 65 active+clean; 168 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 2.7 MiB/s wr, 179 op/s 2024-04-23T14:49:17.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:17 smithi156 ceph-mon[32341]: pgmap v17: 65 pgs: 65 active+clean; 168 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 2.7 MiB/s wr, 179 op/s 2024-04-23T14:49:17.639 INFO:tasks.workunit.client.0.smithi081.stderr:++ readlink -f fsstress 2024-04-23T14:49:17.641 INFO:tasks.workunit.client.0.smithi081.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-23T14:49:17.641 INFO:tasks.workunit.client.0.smithi081.stderr:+ popd 2024-04-23T14:49:17.641 INFO:tasks.workunit.client.0.smithi081.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-23T14:49:17.642 INFO:tasks.workunit.client.0.smithi081.stderr:+ popd 2024-04-23T14:49:17.642 INFO:tasks.workunit.client.0.smithi081.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-23T14:49:17.642 INFO:tasks.workunit.client.0.smithi081.stderr:++ mktemp -d -p . 2024-04-23T14:49:17.647 INFO:tasks.workunit.client.0.smithi081.stderr:+ T=./tmp.RSOKr1HZk5 2024-04-23T14:49:17.647 INFO:tasks.workunit.client.0.smithi081.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.RSOKr1HZk5 -l 1 -n 1000 -p 10 -v 2024-04-23T14:49:17.653 INFO:tasks.workunit.client.0.smithi081.stdout:seed = 1714303342 2024-04-23T14:49:17.662 INFO:tasks.workunit.client.0.smithi081.stdout:0/0: write - no filename 2024-04-23T14:49:17.662 INFO:tasks.workunit.client.0.smithi081.stdout:0/1: dwrite - no filename 2024-04-23T14:49:17.662 INFO:tasks.workunit.client.0.smithi081.stdout:0/2: getdents . 0 2024-04-23T14:49:17.662 INFO:tasks.workunit.client.0.smithi081.stdout:0/3: getdents . 0 2024-04-23T14:49:17.663 INFO:tasks.workunit.client.0.smithi081.stdout:0/4: dwrite - no filename 2024-04-23T14:49:17.663 INFO:tasks.workunit.client.0.smithi081.stdout:0/5: rename - no filename 2024-04-23T14:49:17.663 INFO:tasks.workunit.client.0.smithi081.stdout:0/6: chown . 420207676 1 2024-04-23T14:49:17.663 INFO:tasks.workunit.client.0.smithi081.stdout:0/7: stat - no entries 2024-04-23T14:49:17.663 INFO:tasks.workunit.client.0.smithi081.stdout:0/8: read - no filename 2024-04-23T14:49:17.665 INFO:tasks.workunit.client.0.smithi081.stdout:1/0: dread - no filename 2024-04-23T14:49:17.665 INFO:tasks.workunit.client.0.smithi081.stdout:1/1: fsync - no filename 2024-04-23T14:49:17.668 INFO:tasks.workunit.client.0.smithi081.stdout:0/9: creat f0 x:0 0 0 2024-04-23T14:49:17.668 INFO:tasks.workunit.client.0.smithi081.stdout:0/10: dread - f0 zero size 2024-04-23T14:49:17.668 INFO:tasks.workunit.client.0.smithi081.stdout:0/11: truncate f0 297472 0 2024-04-23T14:49:17.668 INFO:tasks.workunit.client.0.smithi081.stdout:0/12: fdatasync f0 0 2024-04-23T14:49:17.671 INFO:tasks.workunit.client.0.smithi081.stdout:2/0: truncate - no filename 2024-04-23T14:49:17.673 INFO:tasks.workunit.client.0.smithi081.stdout:1/2: creat f0 x:0 0 0 2024-04-23T14:49:17.674 INFO:tasks.workunit.client.0.smithi081.stdout:1/3: write f0 [789104,53909] 0 2024-04-23T14:49:17.675 INFO:tasks.workunit.client.0.smithi081.stdout:0/13: dread f0 [0,4194304] 0 2024-04-23T14:49:17.675 INFO:tasks.workunit.client.0.smithi081.stdout:3/0: fsync - no filename 2024-04-23T14:49:17.675 INFO:tasks.workunit.client.0.smithi081.stdout:3/1: fdatasync - no filename 2024-04-23T14:49:17.675 INFO:tasks.workunit.client.0.smithi081.stdout:3/2: dread - no filename 2024-04-23T14:49:17.675 INFO:tasks.workunit.client.0.smithi081.stdout:3/3: rmdir - no directory 2024-04-23T14:49:17.675 INFO:tasks.workunit.client.0.smithi081.stdout:3/4: dwrite - no filename 2024-04-23T14:49:17.675 INFO:tasks.workunit.client.0.smithi081.stdout:2/1: mknod c0 0 2024-04-23T14:49:17.684 INFO:tasks.workunit.client.0.smithi081.stdout:3/5: creat f0 x:0 0 0 2024-04-23T14:49:17.685 INFO:tasks.workunit.client.0.smithi081.stdout:3/6: dread - f0 zero size 2024-04-23T14:49:17.685 INFO:tasks.workunit.client.0.smithi081.stdout:3/7: dread - f0 zero size 2024-04-23T14:49:17.687 INFO:tasks.workunit.client.0.smithi081.stdout:2/2: mkdir d1 0 2024-04-23T14:49:17.687 INFO:tasks.workunit.client.0.smithi081.stdout:2/3: truncate - no filename 2024-04-23T14:49:17.688 INFO:tasks.workunit.client.0.smithi081.stdout:2/4: rename d1 to d1/d2 22 2024-04-23T14:49:17.692 INFO:tasks.workunit.client.0.smithi081.stdout:4/0: creat f0 x:0 0 0 2024-04-23T14:49:17.693 INFO:tasks.workunit.client.0.smithi081.stdout:4/1: write f0 [897933,41984] 0 2024-04-23T14:49:17.695 INFO:tasks.workunit.client.0.smithi081.stdout:3/8: symlink l1 0 2024-04-23T14:49:17.698 INFO:tasks.workunit.client.0.smithi081.stdout:2/5: creat d1/f3 x:0 0 0 2024-04-23T14:49:17.701 INFO:tasks.workunit.client.0.smithi081.stdout:6/0: fsync - no filename 2024-04-23T14:49:17.702 INFO:tasks.workunit.client.0.smithi081.stdout:6/1: truncate - no filename 2024-04-23T14:49:17.702 INFO:tasks.workunit.client.0.smithi081.stdout:6/2: link - no file 2024-04-23T14:49:17.704 INFO:tasks.workunit.client.0.smithi081.stdout:5/0: creat f0 x:0 0 0 2024-04-23T14:49:17.704 INFO:tasks.workunit.client.0.smithi081.stdout:5/1: rmdir - no directory 2024-04-23T14:49:17.704 INFO:tasks.workunit.client.0.smithi081.stdout:5/2: write f0 [685812,102700] 0 2024-04-23T14:49:17.704 INFO:tasks.workunit.client.0.smithi081.stdout:5/3: chown f0 7801919 1 2024-04-23T14:49:17.704 INFO:tasks.workunit.client.0.smithi081.stdout:5/4: creat f1 x:0 0 0 2024-04-23T14:49:17.705 INFO:tasks.workunit.client.0.smithi081.stdout:5/5: write f1 [237596,100915] 0 2024-04-23T14:49:17.706 INFO:tasks.workunit.client.0.smithi081.stdout:4/2: mkdir d1 0 2024-04-23T14:49:17.707 INFO:tasks.workunit.client.0.smithi081.stdout:4/3: chown f0 858978 1 2024-04-23T14:49:17.707 INFO:tasks.workunit.client.0.smithi081.stdout:4/4: chown f0 5 1 2024-04-23T14:49:17.707 INFO:tasks.workunit.client.0.smithi081.stdout:4/5: write f0 [1702763,83808] 0 2024-04-23T14:49:17.708 INFO:tasks.workunit.client.0.smithi081.stdout:3/9: link l1 l2 0 2024-04-23T14:49:17.710 INFO:tasks.workunit.client.0.smithi081.stdout:2/6: unlink c0 0 2024-04-23T14:49:17.714 INFO:tasks.workunit.client.0.smithi081.stdout:7/0: chown . 105860 1 2024-04-23T14:49:17.716 INFO:tasks.workunit.client.0.smithi081.stdout:6/3: creat f0 x:0 0 0 2024-04-23T14:49:17.717 INFO:tasks.workunit.client.0.smithi081.stdout:6/4: write f0 [408449,92215] 0 2024-04-23T14:49:17.723 INFO:tasks.workunit.client.0.smithi081.stdout:5/6: symlink l2 0 2024-04-23T14:49:17.725 INFO:tasks.workunit.client.0.smithi081.stdout:4/6: symlink d1/l2 0 2024-04-23T14:49:17.730 INFO:tasks.workunit.client.0.smithi081.stdout:3/10: rename f0 to f3 0 2024-04-23T14:49:17.732 INFO:tasks.workunit.client.0.smithi081.stdout:7/1: creat f0 x:0 0 0 2024-04-23T14:49:17.734 INFO:tasks.workunit.client.0.smithi081.stdout:8/0: read - no filename 2024-04-23T14:49:17.734 INFO:tasks.workunit.client.0.smithi081.stdout:8/1: write - no filename 2024-04-23T14:49:17.735 INFO:tasks.workunit.client.0.smithi081.stdout:6/5: mkdir d1 0 2024-04-23T14:49:17.737 INFO:tasks.workunit.client.0.smithi081.stdout:4/7: mkdir d1/d3 0 2024-04-23T14:49:17.738 INFO:tasks.workunit.client.0.smithi081.stdout:3/11: mkdir d4 0 2024-04-23T14:49:17.739 INFO:tasks.workunit.client.0.smithi081.stdout:3/12: dread - f3 zero size 2024-04-23T14:49:17.745 INFO:tasks.workunit.client.0.smithi081.stdout:8/2: creat f0 x:0 0 0 2024-04-23T14:49:17.745 INFO:tasks.workunit.client.0.smithi081.stdout:8/3: creat f1 x:0 0 0 2024-04-23T14:49:17.751 INFO:tasks.workunit.client.0.smithi081.stdout:9/0: creat f0 x:0 0 0 2024-04-23T14:49:17.752 INFO:tasks.workunit.client.0.smithi081.stdout:9/1: creat f1 x:0 0 0 2024-04-23T14:49:17.760 INFO:tasks.workunit.client.0.smithi081.stdout:8/4: rename f0 to f2 0 2024-04-23T14:49:17.765 INFO:tasks.workunit.client.0.smithi081.stdout:9/2: symlink l2 0 2024-04-23T14:49:17.767 INFO:tasks.workunit.client.0.smithi081.stdout:8/5: mkdir d3 0 2024-04-23T14:49:17.767 INFO:tasks.workunit.client.0.smithi081.stdout:8/6: write f1 [920322,127021] 0 2024-04-23T14:49:17.786 INFO:tasks.workunit.client.0.smithi081.stdout:9/3: mkdir d3 0 2024-04-23T14:49:17.786 INFO:tasks.workunit.client.0.smithi081.stdout:9/4: dread - f1 zero size 2024-04-23T14:49:17.786 INFO:tasks.workunit.client.0.smithi081.stdout:9/5: dread - f1 zero size 2024-04-23T14:49:17.787 INFO:tasks.workunit.client.0.smithi081.stdout:9/6: write f0 [471988,120853] 0 2024-04-23T14:49:17.799 INFO:tasks.workunit.client.0.smithi081.stdout:9/7: mknod d3/c4 0 2024-04-23T14:49:17.876 INFO:tasks.workunit.client.0.smithi081.stdout:2/7: dwrite d1/f3 [0,4194304] 0 2024-04-23T14:49:17.911 INFO:tasks.workunit.client.0.smithi081.stdout:1/4: dwrite f0 [0,4194304] 0 2024-04-23T14:49:18.033 INFO:tasks.workunit.client.0.smithi081.stdout:7/2: dwrite f0 [0,4194304] 0 2024-04-23T14:49:18.096 INFO:tasks.workunit.client.0.smithi081.stdout:6/6: dread f0 [0,4194304] 0 2024-04-23T14:49:18.157 INFO:tasks.workunit.client.0.smithi081.stdout:3/13: dwrite f3 [0,4194304] 0 2024-04-23T14:49:18.248 INFO:tasks.workunit.client.0.smithi081.stdout:0/14: fsync f0 0 2024-04-23T14:49:18.276 INFO:tasks.workunit.client.0.smithi081.stdout:2/8: fsync d1/f3 0 2024-04-23T14:49:18.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:18 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:18.329 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:18 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:18.329 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:18 smithi081 ceph-mon[25540]: Reconfiguring alertmanager.smithi081 (dependencies changed)... 2024-04-23T14:49:18.329 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:18 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:49:18.406 INFO:tasks.workunit.client.0.smithi081.stdout:1/5: dwrite f0 [0,4194304] 0 2024-04-23T14:49:18.428 INFO:tasks.workunit.client.0.smithi081.stdout:5/7: dwrite f0 [0,4194304] 0 2024-04-23T14:49:18.428 INFO:tasks.workunit.client.0.smithi081.stdout:5/8: rmdir - no directory 2024-04-23T14:49:18.473 INFO:tasks.workunit.client.0.smithi081.stdout:1/6: write f0 [788556,70811] 0 2024-04-23T14:49:18.473 INFO:tasks.workunit.client.0.smithi081.stdout:1/7: creat f1 x:0 0 0 2024-04-23T14:49:18.512 INFO:tasks.workunit.client.0.smithi081.stdout:2/9: dread d1/f3 [0,4194304] 0 2024-04-23T14:49:18.519 INFO:tasks.workunit.client.0.smithi081.stdout:1/8: dread f0 [0,4194304] 0 2024-04-23T14:49:18.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:18 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:18.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:18 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:18.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:18 smithi156 ceph-mon[32341]: Reconfiguring alertmanager.smithi081 (dependencies changed)... 2024-04-23T14:49:18.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:18 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:49:18.657 INFO:tasks.workunit.client.0.smithi081.stdout:4/8: truncate f0 1718974 0 2024-04-23T14:49:18.902 INFO:tasks.workunit.client.0.smithi081.stdout:6/7: mkdir d1/d2 0 2024-04-23T14:49:19.002 INFO:tasks.workunit.client.0.smithi081.stdout:3/14: stat l2 0 2024-04-23T14:49:19.023 INFO:tasks.workunit.client.0.smithi081.stdout:3/15: dread f3 [0,4194304] 0 2024-04-23T14:49:19.209 INFO:tasks.workunit.client.0.smithi081.stdout:0/15: symlink l1 0 2024-04-23T14:49:19.308 INFO:tasks.workunit.client.0.smithi081.stdout:0/16: dwrite f0 [0,4194304] 0 2024-04-23T14:49:19.366 INFO:tasks.workunit.client.0.smithi081.stdout:0/17: dwrite f0 [0,4194304] 0 2024-04-23T14:49:19.366 INFO:tasks.workunit.client.0.smithi081.stdout:0/18: fdatasync f0 0 2024-04-23T14:49:19.366 INFO:tasks.workunit.client.0.smithi081.stdout:0/19: truncate f0 4922064 0 2024-04-23T14:49:19.547 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:19 smithi156 ceph-mon[32341]: Reconfiguring daemon alertmanager.smithi081 on smithi081 2024-04-23T14:49:19.547 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:19 smithi156 ceph-mon[32341]: pgmap v18: 65 pgs: 65 active+clean; 168 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 20 op/s 2024-04-23T14:49:19.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:19 smithi081 ceph-mon[25540]: Reconfiguring daemon alertmanager.smithi081 on smithi081 2024-04-23T14:49:19.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:19 smithi081 ceph-mon[25540]: pgmap v18: 65 pgs: 65 active+clean; 168 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 20 op/s 2024-04-23T14:49:20.868 INFO:tasks.workunit.client.0.smithi081.stdout:5/9: rename f0 to f3 0 2024-04-23T14:49:20.869 INFO:tasks.workunit.client.0.smithi081.stdout:5/10: fdatasync f1 0 2024-04-23T14:49:20.869 INFO:tasks.workunit.client.0.smithi081.stdout:5/11: creat f4 x:0 0 0 2024-04-23T14:49:20.869 INFO:tasks.workunit.client.0.smithi081.stdout:5/12: chown f3 128506 1 2024-04-23T14:49:21.507 INFO:tasks.workunit.client.0.smithi081.stdout:7/3: getdents . 0 2024-04-23T14:49:21.508 INFO:tasks.workunit.client.0.smithi081.stdout:7/4: write f0 [5068597,63285] 0 2024-04-23T14:49:21.508 INFO:tasks.workunit.client.0.smithi081.stdout:7/5: getdents . 0 2024-04-23T14:49:21.514 INFO:tasks.workunit.client.0.smithi081.stdout:7/6: fsync f0 0 2024-04-23T14:49:21.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:21 smithi156 ceph-mon[32341]: pgmap v19: 65 pgs: 65 active+clean; 222 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 3.5 MiB/s rd, 6.4 MiB/s wr, 320 op/s 2024-04-23T14:49:21.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:21 smithi081 ceph-mon[25540]: pgmap v19: 65 pgs: 65 active+clean; 222 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 3.5 MiB/s rd, 6.4 MiB/s wr, 320 op/s 2024-04-23T14:49:21.631 INFO:tasks.workunit.client.0.smithi081.stdout:2/10: truncate d1/f3 1753117 0 2024-04-23T14:49:22.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.500+0000 7f6b96e00700 1 -- 172.21.15.81:0/346975607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b900fbb10 msgr2=0x7f6b900fbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:22.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.500+0000 7f6b96e00700 1 --2- 172.21.15.81:0/346975607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b900fbb10 0x7f6b900fbf20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6b84004940 tx=0x7f6b84009e30 comp rx=0 tx=0).stop 2024-04-23T14:49:22.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.500+0000 7f6b96e00700 1 -- 172.21.15.81:0/346975607 shutdown_connections 2024-04-23T14:49:22.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.500+0000 7f6b96e00700 1 --2- 172.21.15.81:0/346975607 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b900fcdc0 0x7f6b900fd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:22.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.500+0000 7f6b96e00700 1 --2- 172.21.15.81:0/346975607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b900fbb10 0x7f6b900fbf20 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:22.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.500+0000 7f6b96e00700 1 -- 172.21.15.81:0/346975607 >> 172.21.15.81:0/346975607 conn(0x7f6b900f7270 msgr2=0x7f6b900f96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:22.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.500+0000 7f6b96e00700 1 -- 172.21.15.81:0/346975607 shutdown_connections 2024-04-23T14:49:22.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.500+0000 7f6b96e00700 1 -- 172.21.15.81:0/346975607 wait complete. 2024-04-23T14:49:22.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.502+0000 7f6b96e00700 1 Processor -- start 2024-04-23T14:49:22.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.502+0000 7f6b96e00700 1 -- start start 2024-04-23T14:49:22.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.503+0000 7f6b96e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b900fbb10 0x7f6b9010c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:22.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.503+0000 7f6b96e00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b900fcdc0 0x7f6b9010cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:22.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.503+0000 7f6b96e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9010d330 con 0x7f6b900fbb10 2024-04-23T14:49:22.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.503+0000 7f6b96e00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9010db20 con 0x7f6b900fcdc0 2024-04-23T14:49:22.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.503+0000 7f6b95a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b900fbb10 0x7f6b9010c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:22.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.503+0000 7f6b95a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b900fbb10 0x7f6b9010c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54310/0 (socket says 172.21.15.81:54310) 2024-04-23T14:49:22.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.503+0000 7f6b95a00700 1 -- 172.21.15.81:0/3886605208 learned_addr learned my addr 172.21.15.81:0/3886605208 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:49:22.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.503+0000 7f6b95000700 1 --2- 172.21.15.81:0/3886605208 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b900fcdc0 0x7f6b9010cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:22.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.503+0000 7f6b95a00700 1 -- 172.21.15.81:0/3886605208 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b900fcdc0 msgr2=0x7f6b9010cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:22.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.503+0000 7f6b95a00700 1 --2- 172.21.15.81:0/3886605208 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b900fcdc0 0x7f6b9010cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:22.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.504+0000 7f6b95a00700 1 -- 172.21.15.81:0/3886605208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b84005040 con 0x7f6b900fbb10 2024-04-23T14:49:22.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.504+0000 7f6b95a00700 1 --2- 172.21.15.81:0/3886605208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b900fbb10 0x7f6b9010c760 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6b84009150 tx=0x7f6b84009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:22.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.504+0000 7f6b8d600700 1 -- 172.21.15.81:0/3886605208 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b8400e040 con 0x7f6b900fbb10 2024-04-23T14:49:22.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.504+0000 7f6b8d600700 1 -- 172.21.15.81:0/3886605208 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6b8400bbf0 con 0x7f6b900fbb10 2024-04-23T14:49:22.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.504+0000 7f6b96e00700 1 -- 172.21.15.81:0/3886605208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b9010dda0 con 0x7f6b900fbb10 2024-04-23T14:49:22.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.504+0000 7f6b8d600700 1 -- 172.21.15.81:0/3886605208 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b8401c630 con 0x7f6b900fbb10 2024-04-23T14:49:22.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.505+0000 7f6b96e00700 1 -- 172.21.15.81:0/3886605208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b9010e360 con 0x7f6b900fbb10 2024-04-23T14:49:22.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.506+0000 7f6b82a00700 1 -- 172.21.15.81:0/3886605208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b6c0052b0 con 0x7f6b900fbb10 2024-04-23T14:49:22.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.508+0000 7f6b8d600700 1 -- 172.21.15.81:0/3886605208 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f6b8400bd60 con 0x7f6b900fbb10 2024-04-23T14:49:22.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.509+0000 7f6b8d600700 1 --2- 172.21.15.81:0/3886605208 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f6b7806df00 0x7f6b780703b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:22.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.509+0000 7f6b8d600700 1 -- 172.21.15.81:0/3886605208 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f6b8408bee0 con 0x7f6b900fbb10 2024-04-23T14:49:22.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.510+0000 7f6b95000700 1 --2- 172.21.15.81:0/3886605208 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f6b7806df00 0x7f6b780703b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:22.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.511+0000 7f6b95000700 1 --2- 172.21.15.81:0/3886605208 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f6b7806df00 0x7f6b780703b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c006fd0 tx=0x7f6b7c008040 comp rx=0 tx=0).ready entity=mgr.24373 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:22.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.516+0000 7f6b8d600700 1 -- 172.21.15.81:0/3886605208 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f6b84059080 con 0x7f6b900fbb10 2024-04-23T14:49:22.580 INFO:tasks.workunit.client.0.smithi081.stdout:4/9: mkdir d1/d4 0 2024-04-23T14:49:22.582 INFO:tasks.workunit.client.0.smithi081.stdout:6/8: mkdir d1/d3 0 2024-04-23T14:49:22.585 INFO:tasks.workunit.client.0.smithi081.stdout:3/16: mknod d4/c5 0 2024-04-23T14:49:22.590 INFO:tasks.workunit.client.0.smithi081.stdout:0/20: link l1 l2 0 2024-04-23T14:49:22.650 INFO:tasks.workunit.client.0.smithi081.stdout:5/13: symlink l5 0 2024-04-23T14:49:22.654 INFO:tasks.workunit.client.0.smithi081.stdout:7/7: mknod c1 0 2024-04-23T14:49:22.660 INFO:tasks.workunit.client.0.smithi081.stdout:4/10: rename d1/l2 to d1/d4/l5 0 2024-04-23T14:49:22.661 INFO:tasks.workunit.client.0.smithi081.stdout:6/9: mkdir d1/d3/d4 0 2024-04-23T14:49:22.663 INFO:tasks.workunit.client.0.smithi081.stdout:3/17: truncate f3 1226878 0 2024-04-23T14:49:22.666 INFO:tasks.workunit.client.0.smithi081.stdout:5/14: mknod c6 0 2024-04-23T14:49:22.668 INFO:tasks.workunit.client.0.smithi081.stdout:7/8: creat f2 x:0 0 0 2024-04-23T14:49:22.671 INFO:tasks.workunit.client.0.smithi081.stdout:6/10: dread f0 [0,4194304] 0 2024-04-23T14:49:22.671 INFO:tasks.workunit.client.0.smithi081.stdout:6/11: rename d1 to d1/d2/d5 22 2024-04-23T14:49:22.672 INFO:tasks.workunit.client.0.smithi081.stdout:4/11: creat d1/d3/f6 x:0 0 0 2024-04-23T14:49:22.676 INFO:tasks.workunit.client.0.smithi081.stdout:3/18: creat d4/f6 x:0 0 0 2024-04-23T14:49:22.676 INFO:tasks.workunit.client.0.smithi081.stdout:3/19: chown l1 247923352 1 2024-04-23T14:49:22.680 INFO:tasks.workunit.client.0.smithi081.stdout:5/15: mkdir d7 0 2024-04-23T14:49:22.680 INFO:tasks.workunit.client.0.smithi081.stdout:5/16: getdents d7 0 2024-04-23T14:49:22.684 INFO:tasks.workunit.client.0.smithi081.stdout:7/9: mkdir d3 0 2024-04-23T14:49:22.684 INFO:tasks.workunit.client.0.smithi081.stdout:7/10: truncate f2 639835 0 2024-04-23T14:49:22.684 INFO:tasks.workunit.client.0.smithi081.stdout:7/11: chown d3 453100 1 2024-04-23T14:49:22.684 INFO:tasks.workunit.client.0.smithi081.stdout:7/12: fdatasync f2 0 2024-04-23T14:49:22.684 INFO:tasks.workunit.client.0.smithi081.stdout:7/13: chown c1 1072 1 2024-04-23T14:49:22.684 INFO:tasks.workunit.client.0.smithi081.stdout:7/14: fdatasync f0 0 2024-04-23T14:49:22.687 INFO:tasks.workunit.client.0.smithi081.stdout:7/15: mkdir d3/d4 0 2024-04-23T14:49:22.689 INFO:tasks.workunit.client.0.smithi081.stdout:7/16: write f2 [253217,97518] 0 2024-04-23T14:49:22.695 INFO:tasks.workunit.client.0.smithi081.stdout:7/17: creat d3/f5 x:0 0 0 2024-04-23T14:49:22.701 INFO:tasks.workunit.client.0.smithi081.stdout:5/17: write f3 [1549473,115786] 0 2024-04-23T14:49:22.702 INFO:tasks.workunit.client.0.smithi081.stdout:5/18: dread - f4 zero size 2024-04-23T14:49:22.728 INFO:tasks.workunit.client.0.smithi081.stdout:5/19: dread f3 [0,4194304] 0 2024-04-23T14:49:22.778 INFO:tasks.workunit.client.0.smithi081.stdout:7/18: dwrite d3/f5 [0,4194304] 0 2024-04-23T14:49:22.784 INFO:tasks.workunit.client.0.smithi081.stdout:7/19: creat d3/d4/f6 x:0 0 0 2024-04-23T14:49:22.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.808+0000 7f6b82a00700 1 -- 172.21.15.81:0/3886605208 --> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b6c000bc0 con 0x7f6b7806df00 2024-04-23T14:49:22.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.812+0000 7f6b8d600700 1 -- 172.21.15.81:0/3886605208 <== mgr.24373 v2:172.21.15.156:6828/100981835 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f6b6c000bc0 con 0x7f6b7806df00 2024-04-23T14:49:22.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.814+0000 7f6b82a00700 1 -- 172.21.15.81:0/3886605208 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f6b7806df00 msgr2=0x7f6b780703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:22.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.814+0000 7f6b82a00700 1 --2- 172.21.15.81:0/3886605208 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f6b7806df00 0x7f6b780703b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c006fd0 tx=0x7f6b7c008040 comp rx=0 tx=0).stop 2024-04-23T14:49:22.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.815+0000 7f6b82a00700 1 -- 172.21.15.81:0/3886605208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b900fbb10 msgr2=0x7f6b9010c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:22.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.815+0000 7f6b82a00700 1 --2- 172.21.15.81:0/3886605208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b900fbb10 0x7f6b9010c760 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6b84009150 tx=0x7f6b84009e30 comp rx=0 tx=0).stop 2024-04-23T14:49:22.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.815+0000 7f6b82a00700 1 -- 172.21.15.81:0/3886605208 shutdown_connections 2024-04-23T14:49:22.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.815+0000 7f6b82a00700 1 --2- 172.21.15.81:0/3886605208 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f6b7806df00 0x7f6b780703b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:22.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.815+0000 7f6b82a00700 1 --2- 172.21.15.81:0/3886605208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b900fbb10 0x7f6b9010c760 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:22.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.815+0000 7f6b82a00700 1 --2- 172.21.15.81:0/3886605208 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b900fcdc0 0x7f6b9010cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:22.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.815+0000 7f6b82a00700 1 -- 172.21.15.81:0/3886605208 >> 172.21.15.81:0/3886605208 conn(0x7f6b900f7270 msgr2=0x7f6b900f88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:22.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.815+0000 7f6b82a00700 1 -- 172.21.15.81:0/3886605208 shutdown_connections 2024-04-23T14:49:22.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:22.815+0000 7f6b82a00700 1 -- 172.21.15.81:0/3886605208 wait complete. 2024-04-23T14:49:22.820 INFO:tasks.workunit.client.0.smithi081.stdout:5/20: dwrite f4 [0,4194304] 0 2024-04-23T14:49:22.820 INFO:tasks.workunit.client.0.smithi081.stdout:5/21: stat l5 0 2024-04-23T14:49:22.831 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-04-23T14:49:22.833 INFO:tasks.workunit.client.0.smithi081.stdout:5/22: rmdir d7 0 2024-04-23T14:49:22.884 INFO:tasks.workunit.client.0.smithi081.stdout:1/9: fsync f1 0 2024-04-23T14:49:22.888 INFO:tasks.workunit.client.0.smithi081.stdout:1/10: getdents . 0 2024-04-23T14:49:22.888 INFO:tasks.workunit.client.0.smithi081.stdout:1/11: truncate f1 36531 0 2024-04-23T14:49:22.893 INFO:tasks.workunit.client.0.smithi081.stdout:5/23: dwrite f1 [0,4194304] 0 2024-04-23T14:49:22.893 INFO:tasks.workunit.client.0.smithi081.stdout:5/24: chown l5 12 1 2024-04-23T14:49:22.893 INFO:tasks.workunit.client.0.smithi081.stdout:5/25: chown c6 7099124 1 2024-04-23T14:49:22.893 INFO:tasks.workunit.client.0.smithi081.stdout:5/26: creat f8 x:0 0 0 2024-04-23T14:49:22.899 INFO:tasks.workunit.client.0.smithi081.stdout:1/12: dread f1 [0,4194304] 0 2024-04-23T14:49:22.899 INFO:tasks.workunit.client.0.smithi081.stdout:1/13: fsync f1 0 2024-04-23T14:49:22.906 INFO:tasks.workunit.client.0.smithi081.stdout:1/14: mknod c2 0 2024-04-23T14:49:22.909 INFO:tasks.workunit.client.0.smithi081.stdout:1/15: mkdir d3 0 2024-04-23T14:49:22.927 INFO:tasks.workunit.client.0.smithi081.stdout:5/27: write f1 [2673229,45280] 0 2024-04-23T14:49:22.927 INFO:tasks.workunit.client.0.smithi081.stdout:5/28: creat f9 x:0 0 0 2024-04-23T14:49:22.927 INFO:tasks.workunit.client.0.smithi081.stdout:5/29: truncate f8 911440 0 2024-04-23T14:49:22.931 INFO:tasks.workunit.client.0.smithi081.stdout:5/30: fdatasync f1 0 2024-04-23T14:49:23.001 INFO:tasks.workunit.client.0.smithi081.stdout:1/16: dwrite f0 [4194304,4194304] 0 2024-04-23T14:49:23.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.011+0000 7f3eb3e00700 1 -- 172.21.15.81:0/1174619329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eb40fd250 msgr2=0x7f3eb40fd660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:23.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.011+0000 7f3eb3e00700 1 --2- 172.21.15.81:0/1174619329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eb40fd250 0x7f3eb40fd660 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4004940 tx=0x7f3ea4009e30 comp rx=0 tx=0).stop 2024-04-23T14:49:23.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.011+0000 7f3eb3e00700 1 -- 172.21.15.81:0/1174619329 shutdown_connections 2024-04-23T14:49:23.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.011+0000 7f3eb3e00700 1 --2- 172.21.15.81:0/1174619329 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3eb40fdba0 0x7f3eb41044f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:23.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.011+0000 7f3eb3e00700 1 --2- 172.21.15.81:0/1174619329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eb40fd250 0x7f3eb40fd660 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:23.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.011+0000 7f3eb3e00700 1 -- 172.21.15.81:0/1174619329 >> 172.21.15.81:0/1174619329 conn(0x7f3eb40f6a00 msgr2=0x7f3eb40f8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:23.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.011+0000 7f3eb3e00700 1 -- 172.21.15.81:0/1174619329 shutdown_connections 2024-04-23T14:49:23.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.012+0000 7f3eb3e00700 1 -- 172.21.15.81:0/1174619329 wait complete. 2024-04-23T14:49:23.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.012+0000 7f3eb3e00700 1 Processor -- start 2024-04-23T14:49:23.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.012+0000 7f3eb3e00700 1 -- start start 2024-04-23T14:49:23.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.013+0000 7f3eb3e00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3eb40fd250 0x7f3eb410fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:23.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.013+0000 7f3eb3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eb40fdba0 0x7f3eb4110000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:23.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.013+0000 7f3eb3e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb4110690 con 0x7f3eb40fdba0 2024-04-23T14:49:23.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.013+0000 7f3eb3e00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb4110e80 con 0x7f3eb40fd250 2024-04-23T14:49:23.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.013+0000 7f3eb2000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eb40fdba0 0x7f3eb4110000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:23.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.013+0000 7f3eb2000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eb40fdba0 0x7f3eb4110000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54326/0 (socket says 172.21.15.81:54326) 2024-04-23T14:49:23.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.013+0000 7f3eb2000700 1 -- 172.21.15.81:0/2580437624 learned_addr learned my addr 172.21.15.81:0/2580437624 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:49:23.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.013+0000 7f3eb2a00700 1 --2- 172.21.15.81:0/2580437624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3eb40fd250 0x7f3eb410fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:23.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.014+0000 7f3eb2000700 1 -- 172.21.15.81:0/2580437624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3eb40fd250 msgr2=0x7f3eb410fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:23.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.014+0000 7f3eb2000700 1 --2- 172.21.15.81:0/2580437624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3eb40fd250 0x7f3eb410fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:23.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.014+0000 7f3eb2000700 1 -- 172.21.15.81:0/2580437624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea4005040 con 0x7f3eb40fdba0 2024-04-23T14:49:23.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.014+0000 7f3eb2000700 1 --2- 172.21.15.81:0/2580437624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eb40fdba0 0x7f3eb4110000 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3ea000b790 tx=0x7f3ea0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:23.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.014+0000 7f3eaaa00700 1 -- 172.21.15.81:0/2580437624 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ea000f770 con 0x7f3eb40fdba0 2024-04-23T14:49:23.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.014+0000 7f3eaaa00700 1 -- 172.21.15.81:0/2580437624 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3ea000fda0 con 0x7f3eb40fdba0 2024-04-23T14:49:23.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.014+0000 7f3eaaa00700 1 -- 172.21.15.81:0/2580437624 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ea000d310 con 0x7f3eb40fdba0 2024-04-23T14:49:23.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.014+0000 7f3eb3e00700 1 -- 172.21.15.81:0/2580437624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eb4111160 con 0x7f3eb40fdba0 2024-04-23T14:49:23.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.014+0000 7f3eb3e00700 1 -- 172.21.15.81:0/2580437624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eb4111720 con 0x7f3eb40fdba0 2024-04-23T14:49:23.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.015+0000 7f3eb3e00700 1 -- 172.21.15.81:0/2580437624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eb405f5f0 con 0x7f3eb40fdba0 2024-04-23T14:49:23.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.016+0000 7f3eaaa00700 1 -- 172.21.15.81:0/2580437624 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f3ea0010420 con 0x7f3eb40fdba0 2024-04-23T14:49:23.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.017+0000 7f3eaaa00700 1 --2- 172.21.15.81:0/2580437624 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f3e9806bcf0 0x7f3e9806e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:23.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.017+0000 7f3eaaa00700 1 -- 172.21.15.81:0/2580437624 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f3ea008a8c0 con 0x7f3eb40fdba0 2024-04-23T14:49:23.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.018+0000 7f3eb2a00700 1 --2- 172.21.15.81:0/2580437624 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f3e9806bcf0 0x7f3e9806e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:23.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.019+0000 7f3eb2a00700 1 --2- 172.21.15.81:0/2580437624 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f3e9806bcf0 0x7f3e9806e1a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400b3b0 tx=0x7f3ea4009e30 comp rx=0 tx=0).ready entity=mgr.24373 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:23.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.022+0000 7f3eaaa00700 1 -- 172.21.15.81:0/2580437624 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f3ea0057b80 con 0x7f3eb40fdba0 2024-04-23T14:49:23.159 INFO:tasks.workunit.client.0.smithi081.stdout:1/17: creat d3/f4 x:0 0 0 2024-04-23T14:49:23.159 INFO:tasks.workunit.client.0.smithi081.stdout:1/18: creat d3/f5 x:0 0 0 2024-04-23T14:49:23.167 INFO:tasks.workunit.client.0.smithi081.stdout:1/19: dread f1 [0,4194304] 0 2024-04-23T14:49:23.171 INFO:tasks.workunit.client.0.smithi081.stdout:1/20: link f1 d3/f6 0 2024-04-23T14:49:23.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.336+0000 7f3eb3e00700 1 -- 172.21.15.81:0/2580437624 --> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3eb4111a60 con 0x7f3e9806bcf0 2024-04-23T14:49:23.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.339+0000 7f3eaaa00700 1 -- 172.21.15.81:0/2580437624 <== mgr.24373 v2:172.21.15.156:6828/100981835 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f3eb4111a60 con 0x7f3e9806bcf0 2024-04-23T14:49:23.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.343+0000 7f3eb3e00700 1 -- 172.21.15.81:0/2580437624 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f3e9806bcf0 msgr2=0x7f3e9806e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:23.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.343+0000 7f3eb3e00700 1 --2- 172.21.15.81:0/2580437624 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f3e9806bcf0 0x7f3e9806e1a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400b3b0 tx=0x7f3ea4009e30 comp rx=0 tx=0).stop 2024-04-23T14:49:23.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.343+0000 7f3eb3e00700 1 -- 172.21.15.81:0/2580437624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eb40fdba0 msgr2=0x7f3eb4110000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:23.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.343+0000 7f3eb3e00700 1 --2- 172.21.15.81:0/2580437624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eb40fdba0 0x7f3eb4110000 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3ea000b790 tx=0x7f3ea0009250 comp rx=0 tx=0).stop 2024-04-23T14:49:23.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.343+0000 7f3eb3e00700 1 -- 172.21.15.81:0/2580437624 shutdown_connections 2024-04-23T14:49:23.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.343+0000 7f3eb3e00700 1 --2- 172.21.15.81:0/2580437624 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f3e9806bcf0 0x7f3e9806e1a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:23.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.343+0000 7f3eb3e00700 1 --2- 172.21.15.81:0/2580437624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3eb40fd250 0x7f3eb410fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:23.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.343+0000 7f3eb3e00700 1 --2- 172.21.15.81:0/2580437624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eb40fdba0 0x7f3eb4110000 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:23.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.343+0000 7f3eb3e00700 1 -- 172.21.15.81:0/2580437624 >> 172.21.15.81:0/2580437624 conn(0x7f3eb40f6a00 msgr2=0x7f3eb40f6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:23.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.344+0000 7f3eb3e00700 1 -- 172.21.15.81:0/2580437624 shutdown_connections 2024-04-23T14:49:23.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.344+0000 7f3eb3e00700 1 -- 172.21.15.81:0/2580437624 wait complete. 2024-04-23T14:49:23.382 INFO:tasks.workunit.client.0.smithi081.stdout:2/11: rename d1/f3 to d1/f4 0 2024-04-23T14:49:23.382 INFO:tasks.workunit.client.0.smithi081.stdout:2/12: creat d1/f5 x:0 0 0 2024-04-23T14:49:23.398 INFO:tasks.workunit.client.0.smithi081.stdout:2/13: dread d1/f4 [0,4194304] 0 2024-04-23T14:49:23.398 INFO:tasks.workunit.client.0.smithi081.stdout:2/14: stat d1/f4 0 2024-04-23T14:49:23.454 INFO:tasks.workunit.client.0.smithi081.stdout:2/15: dwrite d1/f4 [0,4194304] 0 2024-04-23T14:49:23.454 INFO:tasks.workunit.client.0.smithi081.stdout:2/16: creat d1/f6 x:0 0 0 2024-04-23T14:49:23.454 INFO:tasks.workunit.client.0.smithi081.stdout:2/17: dread - d1/f6 zero size 2024-04-23T14:49:23.464 INFO:tasks.workunit.client.0.smithi081.stdout:2/18: symlink d1/l7 0 2024-04-23T14:49:23.488 INFO:tasks.workunit.client.0.smithi081.stdout:2/19: dread d1/f4 [0,4194304] 0 2024-04-23T14:49:23.488 INFO:tasks.workunit.client.0.smithi081.stdout:2/20: creat d1/f8 x:0 0 0 2024-04-23T14:49:23.493 INFO:tasks.workunit.client.0.smithi081.stdout:2/21: mknod d1/c9 0 2024-04-23T14:49:23.494 INFO:tasks.workunit.client.0.smithi081.stdout:2/22: creat d1/fa x:0 0 0 2024-04-23T14:49:23.494 INFO:tasks.workunit.client.0.smithi081.stdout:2/23: creat d1/fb x:0 0 0 2024-04-23T14:49:23.494 INFO:tasks.workunit.client.0.smithi081.stdout:2/24: creat d1/fc x:0 0 0 2024-04-23T14:49:23.494 INFO:tasks.workunit.client.0.smithi081.stdout:2/25: creat d1/fd x:0 0 0 2024-04-23T14:49:23.494 INFO:tasks.workunit.client.0.smithi081.stdout:2/26: chown d1/l7 0 1 2024-04-23T14:49:23.494 INFO:tasks.workunit.client.0.smithi081.stdout:2/27: write d1/fb [402240,54417] 0 2024-04-23T14:49:23.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.524+0000 7fb533200700 1 -- 172.21.15.81:0/94374346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5340fcc30 msgr2=0x7fb5340fd040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:23.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.524+0000 7fb533200700 1 --2- 172.21.15.81:0/94374346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5340fcc30 0x7fb5340fd040 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb524004940 tx=0x7fb524009e30 comp rx=0 tx=0).stop 2024-04-23T14:49:23.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.524+0000 7fb533200700 1 -- 172.21.15.81:0/94374346 shutdown_connections 2024-04-23T14:49:23.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.524+0000 7fb533200700 1 --2- 172.21.15.81:0/94374346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5340fdee0 0x7fb5340fe350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:23.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.524+0000 7fb533200700 1 --2- 172.21.15.81:0/94374346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5340fcc30 0x7fb5340fd040 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:23.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.524+0000 7fb533200700 1 -- 172.21.15.81:0/94374346 >> 172.21.15.81:0/94374346 conn(0x7fb5340f83d0 msgr2=0x7fb5340fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:23.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.524+0000 7fb533200700 1 -- 172.21.15.81:0/94374346 shutdown_connections 2024-04-23T14:49:23.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.524+0000 7fb533200700 1 -- 172.21.15.81:0/94374346 wait complete. 2024-04-23T14:49:23.526 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:23 smithi081 ceph-mon[25540]: pgmap v20: 65 pgs: 65 active+clean; 222 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 5.6 MiB/s wr, 307 op/s 2024-04-23T14:49:23.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.525+0000 7fb533200700 1 Processor -- start 2024-04-23T14:49:23.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.526+0000 7fb533200700 1 -- start start 2024-04-23T14:49:23.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.526+0000 7fb533200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5340fcc30 0x7fb53410d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:23.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.526+0000 7fb533200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5340fdee0 0x7fb53410dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:23.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.526+0000 7fb533200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53410e420 con 0x7fb5340fdee0 2024-04-23T14:49:23.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.526+0000 7fb533200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53410ec10 con 0x7fb5340fcc30 2024-04-23T14:49:23.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.526+0000 7fb531400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5340fdee0 0x7fb53410dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:23.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.527+0000 7fb531400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5340fdee0 0x7fb53410dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54348/0 (socket says 172.21.15.81:54348) 2024-04-23T14:49:23.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.527+0000 7fb531400700 1 -- 172.21.15.81:0/630085362 learned_addr learned my addr 172.21.15.81:0/630085362 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:49:23.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.527+0000 7fb531e00700 1 --2- 172.21.15.81:0/630085362 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5340fcc30 0x7fb53410d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:23.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.527+0000 7fb531400700 1 -- 172.21.15.81:0/630085362 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5340fcc30 msgr2=0x7fb53410d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:23.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.527+0000 7fb531400700 1 --2- 172.21.15.81:0/630085362 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5340fcc30 0x7fb53410d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:23.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.527+0000 7fb531400700 1 -- 172.21.15.81:0/630085362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb524005040 con 0x7fb5340fdee0 2024-04-23T14:49:23.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.527+0000 7fb531e00700 1 --2- 172.21.15.81:0/630085362 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5340fcc30 0x7fb53410d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:49:23.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.527+0000 7fb531400700 1 --2- 172.21.15.81:0/630085362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5340fdee0 0x7fb53410dd90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb52000b790 tx=0x7fb520009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:23.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.528+0000 7fb52a000700 1 -- 172.21.15.81:0/630085362 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb52000f770 con 0x7fb5340fdee0 2024-04-23T14:49:23.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.528+0000 7fb52a000700 1 -- 172.21.15.81:0/630085362 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb52000fda0 con 0x7fb5340fdee0 2024-04-23T14:49:23.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.528+0000 7fb52a000700 1 -- 172.21.15.81:0/630085362 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb52000d310 con 0x7fb5340fdee0 2024-04-23T14:49:23.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.528+0000 7fb533200700 1 -- 172.21.15.81:0/630085362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb53410eef0 con 0x7fb5340fdee0 2024-04-23T14:49:23.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.528+0000 7fb533200700 1 -- 172.21.15.81:0/630085362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb53410f4b0 con 0x7fb5340fdee0 2024-04-23T14:49:23.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.529+0000 7fb533200700 1 -- 172.21.15.81:0/630085362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb53405f5f0 con 0x7fb5340fdee0 2024-04-23T14:49:23.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.531+0000 7fb52a000700 1 -- 172.21.15.81:0/630085362 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7fb520010420 con 0x7fb5340fdee0 2024-04-23T14:49:23.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.532+0000 7fb52a000700 1 --2- 172.21.15.81:0/630085362 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fb51806bcf0 0x7fb51806e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:23.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.532+0000 7fb52a000700 1 -- 172.21.15.81:0/630085362 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fb52008a970 con 0x7fb5340fdee0 2024-04-23T14:49:23.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:23 smithi156 ceph-mon[32341]: pgmap v20: 65 pgs: 65 active+clean; 222 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 5.6 MiB/s wr, 307 op/s 2024-04-23T14:49:23.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.537+0000 7fb52a000700 1 -- 172.21.15.81:0/630085362 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7fb520057b70 con 0x7fb5340fdee0 2024-04-23T14:49:23.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:23.847+0000 7fb533200700 1 -- 172.21.15.81:0/630085362 --> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb53410f830 con 0x7fb51806bcf0 2024-04-23T14:49:23.944 INFO:tasks.workunit.client.0.smithi081.stdout:7/20: truncate f0 189391 0 2024-04-23T14:49:23.950 INFO:tasks.workunit.client.0.smithi081.stdout:6/12: rename d1/d3 to d1/d2/d6 0 2024-04-23T14:49:23.952 INFO:tasks.workunit.client.0.smithi081.stdout:3/20: write f3 [2082228,12492] 0 2024-04-23T14:49:23.955 INFO:tasks.workunit.client.0.smithi081.stdout:4/12: rename d1/d3/f6 to d1/d4/f7 0 2024-04-23T14:49:23.955 INFO:tasks.workunit.client.0.smithi081.stdout:4/13: creat d1/d3/f8 x:0 0 0 2024-04-23T14:49:23.955 INFO:tasks.workunit.client.0.smithi081.stdout:4/14: chown d1/d3 2 1 2024-04-23T14:49:23.955 INFO:tasks.workunit.client.0.smithi081.stdout:6/13: mknod d1/d2/d6/c7 0 2024-04-23T14:49:23.961 INFO:tasks.workunit.client.0.smithi081.stdout:4/15: creat d1/f9 x:0 0 0 2024-04-23T14:49:23.961 INFO:tasks.workunit.client.0.smithi081.stdout:4/16: readlink d1/d4/l5 0 2024-04-23T14:49:23.964 INFO:tasks.workunit.client.0.smithi081.stdout:6/14: unlink d1/d2/d6/c7 0 2024-04-23T14:49:23.964 INFO:tasks.workunit.client.0.smithi081.stdout:6/15: stat f0 0 2024-04-23T14:49:23.967 INFO:tasks.workunit.client.0.smithi081.stdout:0/21: truncate f0 298852 0 2024-04-23T14:49:23.971 INFO:tasks.workunit.client.0.smithi081.stdout:4/17: link d1/f9 d1/fa 0 2024-04-23T14:49:23.971 INFO:tasks.workunit.client.0.smithi081.stdout:4/18: truncate d1/d3/f8 413886 0 2024-04-23T14:49:23.972 INFO:tasks.workunit.client.0.smithi081.stdout:6/16: mkdir d1/d2/d6/d8 0 2024-04-23T14:49:23.974 INFO:tasks.workunit.client.0.smithi081.stdout:4/19: symlink d1/d3/lb 0 2024-04-23T14:49:23.989 INFO:tasks.workunit.client.0.smithi081.stdout:4/20: dread f0 [0,4194304] 0 2024-04-23T14:49:23.989 INFO:tasks.workunit.client.0.smithi081.stdout:6/17: dread f0 [0,4194304] 0 2024-04-23T14:49:23.989 INFO:tasks.workunit.client.0.smithi081.stdout:6/18: stat d1 0 2024-04-23T14:49:24.020 INFO:tasks.workunit.client.0.smithi081.stdout:4/21: write f0 [701067,90105] 0 2024-04-23T14:49:24.066 INFO:tasks.workunit.client.0.smithi081.stdout:6/19: dwrite f0 [0,4194304] 0 2024-04-23T14:49:24.114 INFO:tasks.workunit.client.0.smithi081.stdout:6/20: dwrite f0 [0,4194304] 0 2024-04-23T14:49:24.114 INFO:tasks.workunit.client.0.smithi081.stdout:6/21: readlink - no filename 2024-04-23T14:49:24.181 INFO:tasks.workunit.client.0.smithi081.stdout:5/31: fsync f8 0 2024-04-23T14:49:24.210 INFO:tasks.workunit.client.0.smithi081.stdout:5/32: dread f3 [0,4194304] 0 2024-04-23T14:49:24.270 INFO:tasks.workunit.client.0.smithi081.stdout:1/21: truncate f0 6627584 0 2024-04-23T14:49:24.270 INFO:tasks.workunit.client.0.smithi081.stdout:1/22: creat d3/f7 x:0 0 0 2024-04-23T14:49:24.476 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:24 smithi081 ceph-mon[25540]: from='client.14686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:49:24.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:24 smithi156 ceph-mon[32341]: from='client.14686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:49:24.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.596+0000 7fb531e00700 1 --2- 172.21.15.81:0/630085362 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fb51806bcf0 0x7fb51806e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:24.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.599+0000 7fb531e00700 1 --2- 172.21.15.81:0/630085362 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fb51806bcf0 0x7fb51806e1a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb52400b7a0 tx=0x7fb524009e30 comp rx=0 tx=0).ready entity=mgr.24373 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:24.615 INFO:tasks.workunit.client.0.smithi081.stdout:2/28: dwrite d1/f4 [4194304,4194304] 0 2024-04-23T14:49:24.615 INFO:tasks.workunit.client.0.smithi081.stdout:2/29: creat d1/fe x:0 0 0 2024-04-23T14:49:24.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.632+0000 7fb52a000700 1 -- 172.21.15.81:0/630085362 <== mgr.24373 v2:172.21.15.156:6828/100981835 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fb53410f830 con 0x7fb51806bcf0 2024-04-23T14:49:24.633 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-23T14:49:24.633 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (8m) 16s ago 10m 13.8M - 0.25.0 c8568f914cd2 730d7164defb 2024-04-23T14:49:24.633 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (10m) 16s ago 10m 6660k - 17.2.7-884-g70d0cb4b cafd8ddac8fa 6ae90c81b232 2024-04-23T14:49:24.633 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi156 smithi156 running (9m) 26s ago 9m 6660k - 17.2.7-884-g70d0cb4b cafd8ddac8fa ecc141919f37 2024-04-23T14:49:24.633 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (8m) 16s ago 10m 74.2M - 9.4.7 954c08fa6188 96965e7e10cc 2024-04-23T14:49:24.633 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.vcoywg smithi081 running (3m) 16s ago 3m 125M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 2ca7601ab60f 2024-04-23T14:49:24.634 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.wydgcg smithi081 running (3m) 16s ago 3m 68.8M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 58eb1a961b61 2024-04-23T14:49:24.634 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.rhbtxt smithi156 running (3m) 26s ago 3m 11.8M - 17.2.7-884-g70d0cb4b cafd8ddac8fa db3cb5034381 2024-04-23T14:49:24.634 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.vynkxn smithi156 running (3m) 26s ago 3m 11.8M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 1c8f2219e7fd 2024-04-23T14:49:24.634 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.ldghvq smithi081 *:9283 running (12m) 16s ago 12m 306M - 17.2.7-884-g70d0cb4b cafd8ddac8fa b3d1da9bbf01 2024-04-23T14:49:24.634 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi156.ounwyj smithi156 *:8443,9283 running (60s) 26s ago 9m 489M - 19.0.0-3126-gd44fddd9 76e77f280c74 4aef254a3b16 2024-04-23T14:49:24.634 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (12m) 16s ago 12m 49.1M 2048M 17.2.7-884-g70d0cb4b cafd8ddac8fa 6e43d934b336 2024-04-23T14:49:24.634 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi156 smithi156 running (9m) 26s ago 9m 38.8M 2048M 17.2.7-884-g70d0cb4b cafd8ddac8fa d9127540d3bb 2024-04-23T14:49:24.634 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 starting - - - - 2024-04-23T14:49:24.634 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi156 smithi156 *:9100 running (9m) 26s ago 9m 7658k - 1.5.0 0da6a335fe13 2d9e680be69f 2024-04-23T14:49:24.634 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (8m) 16s ago 8m 92.2M 1557M 17.2.7-884-g70d0cb4b cafd8ddac8fa 272ca032bec1 2024-04-23T14:49:24.634 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (7m) 16s ago 7m 96.6M 1557M 17.2.7-884-g70d0cb4b cafd8ddac8fa ee6d0c8af6ed 2024-04-23T14:49:24.634 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (7m) 16s ago 6m 84.9M 1557M 17.2.7-884-g70d0cb4b cafd8ddac8fa c26c640828a2 2024-04-23T14:49:24.634 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi156 running (6m) 26s ago 6m 96.9M 2581M 17.2.7-884-g70d0cb4b cafd8ddac8fa c1c261b1ee90 2024-04-23T14:49:24.634 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi156 running (5m) 26s ago 5m 89.7M 2581M 17.2.7-884-g70d0cb4b cafd8ddac8fa 83f996ee64de 2024-04-23T14:49:24.635 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi156 running (5m) 26s ago 5m 87.1M 2581M 17.2.7-884-g70d0cb4b cafd8ddac8fa b754244bef18 2024-04-23T14:49:24.635 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (8m) 16s ago 9m 50.3M - 2.43.0 a07b618ecd1d 1779b897e5df 2024-04-23T14:49:24.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.637+0000 7fb533200700 1 -- 172.21.15.81:0/630085362 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fb51806bcf0 msgr2=0x7fb51806e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:24.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.637+0000 7fb533200700 1 --2- 172.21.15.81:0/630085362 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fb51806bcf0 0x7fb51806e1a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb52400b7a0 tx=0x7fb524009e30 comp rx=0 tx=0).stop 2024-04-23T14:49:24.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.637+0000 7fb533200700 1 -- 172.21.15.81:0/630085362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5340fdee0 msgr2=0x7fb53410dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:24.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.637+0000 7fb533200700 1 --2- 172.21.15.81:0/630085362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5340fdee0 0x7fb53410dd90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb52000b790 tx=0x7fb520009250 comp rx=0 tx=0).stop 2024-04-23T14:49:24.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.637+0000 7fb533200700 1 -- 172.21.15.81:0/630085362 shutdown_connections 2024-04-23T14:49:24.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.637+0000 7fb533200700 1 --2- 172.21.15.81:0/630085362 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fb51806bcf0 0x7fb51806e1a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:24.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.637+0000 7fb533200700 1 --2- 172.21.15.81:0/630085362 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5340fcc30 0x7fb53410d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:24.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.637+0000 7fb533200700 1 --2- 172.21.15.81:0/630085362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5340fdee0 0x7fb53410dd90 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:24.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.637+0000 7fb533200700 1 -- 172.21.15.81:0/630085362 >> 172.21.15.81:0/630085362 conn(0x7fb5340f83d0 msgr2=0x7fb5340f9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:24.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.637+0000 7fb533200700 1 -- 172.21.15.81:0/630085362 shutdown_connections 2024-04-23T14:49:24.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.638+0000 7fb533200700 1 -- 172.21.15.81:0/630085362 wait complete. 2024-04-23T14:49:24.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.813+0000 7fe05de00700 1 -- 172.21.15.81:0/4102708555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0580fcef0 msgr2=0x7fe0580fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:24.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.813+0000 7fe05de00700 1 --2- 172.21.15.81:0/4102708555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0580fcef0 0x7fe0580fd320 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe048004940 tx=0x7fe048009e30 comp rx=0 tx=0).stop 2024-04-23T14:49:24.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.813+0000 7fe05de00700 1 -- 172.21.15.81:0/4102708555 shutdown_connections 2024-04-23T14:49:24.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.813+0000 7fe05de00700 1 --2- 172.21.15.81:0/4102708555 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0580fe0e0 0x7fe0580fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:24.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.813+0000 7fe05de00700 1 --2- 172.21.15.81:0/4102708555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0580fcef0 0x7fe0580fd320 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:24.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.813+0000 7fe05de00700 1 -- 172.21.15.81:0/4102708555 >> 172.21.15.81:0/4102708555 conn(0x7fe0580f8530 msgr2=0x7fe0580fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:24.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.813+0000 7fe05de00700 1 -- 172.21.15.81:0/4102708555 shutdown_connections 2024-04-23T14:49:24.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.813+0000 7fe05de00700 1 -- 172.21.15.81:0/4102708555 wait complete. 2024-04-23T14:49:24.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.814+0000 7fe05de00700 1 Processor -- start 2024-04-23T14:49:24.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.814+0000 7fe05de00700 1 -- start start 2024-04-23T14:49:24.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.815+0000 7fe05de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0580fcef0 0x7fe05810da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:24.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.815+0000 7fe05de00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0580fe0e0 0x7fe05810df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:24.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.815+0000 7fe05de00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05810e600 con 0x7fe0580fcef0 2024-04-23T14:49:24.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.815+0000 7fe05de00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05810edf0 con 0x7fe0580fe0e0 2024-04-23T14:49:24.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.815+0000 7fe056a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0580fcef0 0x7fe05810da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:24.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.815+0000 7fe056a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0580fcef0 0x7fe05810da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56384/0 (socket says 172.21.15.81:56384) 2024-04-23T14:49:24.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.815+0000 7fe056a00700 1 -- 172.21.15.81:0/657727503 learned_addr learned my addr 172.21.15.81:0/657727503 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:49:24.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.815+0000 7fe056000700 1 --2- 172.21.15.81:0/657727503 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0580fe0e0 0x7fe05810df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:24.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.815+0000 7fe056a00700 1 -- 172.21.15.81:0/657727503 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0580fe0e0 msgr2=0x7fe05810df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:24.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.815+0000 7fe056a00700 1 --2- 172.21.15.81:0/657727503 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0580fe0e0 0x7fe05810df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:24.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.816+0000 7fe056a00700 1 -- 172.21.15.81:0/657727503 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe048005040 con 0x7fe0580fcef0 2024-04-23T14:49:24.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.816+0000 7fe056000700 1 --2- 172.21.15.81:0/657727503 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0580fe0e0 0x7fe05810df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:49:24.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.816+0000 7fe056a00700 1 --2- 172.21.15.81:0/657727503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0580fcef0 0x7fe05810da30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe04800b970 tx=0x7fe048009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:24.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.816+0000 7fe04ea00700 1 -- 172.21.15.81:0/657727503 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe04800e040 con 0x7fe0580fcef0 2024-04-23T14:49:24.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.816+0000 7fe04ea00700 1 -- 172.21.15.81:0/657727503 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe04800bbf0 con 0x7fe0580fcef0 2024-04-23T14:49:24.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.816+0000 7fe05de00700 1 -- 172.21.15.81:0/657727503 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe05810f070 con 0x7fe0580fcef0 2024-04-23T14:49:24.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.816+0000 7fe04ea00700 1 -- 172.21.15.81:0/657727503 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe04801c630 con 0x7fe0580fcef0 2024-04-23T14:49:24.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.816+0000 7fe05de00700 1 -- 172.21.15.81:0/657727503 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe05810f630 con 0x7fe0580fcef0 2024-04-23T14:49:24.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.818+0000 7fe05de00700 1 -- 172.21.15.81:0/657727503 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe05805f5f0 con 0x7fe0580fcef0 2024-04-23T14:49:24.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.819+0000 7fe04ea00700 1 -- 172.21.15.81:0/657727503 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7fe04800bd60 con 0x7fe0580fcef0 2024-04-23T14:49:24.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.820+0000 7fe04ea00700 1 --2- 172.21.15.81:0/657727503 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fe03c06bcf0 0x7fe03c06e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:24.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.820+0000 7fe04ea00700 1 -- 172.21.15.81:0/657727503 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fe04808bea0 con 0x7fe0580fcef0 2024-04-23T14:49:24.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.821+0000 7fe056000700 1 --2- 172.21.15.81:0/657727503 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fe03c06bcf0 0x7fe03c06e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:24.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.822+0000 7fe056000700 1 --2- 172.21.15.81:0/657727503 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fe03c06bcf0 0x7fe03c06e1a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe044006fd0 tx=0x7fe044008040 comp rx=0 tx=0).ready entity=mgr.24373 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:24.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:24.825+0000 7fe04ea00700 1 -- 172.21.15.81:0/657727503 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7fe048059040 con 0x7fe0580fcef0 2024-04-23T14:49:25.133 INFO:tasks.workunit.client.0.smithi081.stdout:7/21: write f0 [771653,22418] 0 2024-04-23T14:49:25.158 INFO:tasks.workunit.client.0.smithi081.stdout:3/21: truncate f3 882129 0 2024-04-23T14:49:25.159 INFO:tasks.workunit.client.0.smithi081.stdout:3/22: write d4/f6 [116271,35554] 0 2024-04-23T14:49:25.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.240+0000 7fe05de00700 1 -- 172.21.15.81:0/657727503 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe05810f880 con 0x7fe0580fcef0 2024-04-23T14:49:25.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.242+0000 7fe04ea00700 1 -- 172.21.15.81:0/657727503 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7fe048058bd0 con 0x7fe0580fcef0 2024-04-23T14:49:25.243 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:49:25.243 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-04-23T14:49:25.243 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 2 2024-04-23T14:49:25.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:49:25.243 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-04-23T14:49:25.243 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 1, 2024-04-23T14:49:25.243 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 1 2024-04-23T14:49:25.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:49:25.243 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-04-23T14:49:25.243 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 6 2024-04-23T14:49:25.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:49:25.244 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-04-23T14:49:25.244 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 4 2024-04-23T14:49:25.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:49:25.244 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-04-23T14:49:25.244 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 13, 2024-04-23T14:49:25.244 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 1 2024-04-23T14:49:25.244 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-23T14:49:25.244 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:49:25.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.246+0000 7fe05de00700 1 -- 172.21.15.81:0/657727503 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fe03c06bcf0 msgr2=0x7fe03c06e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:25.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.246+0000 7fe05de00700 1 --2- 172.21.15.81:0/657727503 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fe03c06bcf0 0x7fe03c06e1a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe044006fd0 tx=0x7fe044008040 comp rx=0 tx=0).stop 2024-04-23T14:49:25.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.246+0000 7fe05de00700 1 -- 172.21.15.81:0/657727503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0580fcef0 msgr2=0x7fe05810da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:25.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.246+0000 7fe05de00700 1 --2- 172.21.15.81:0/657727503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0580fcef0 0x7fe05810da30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe04800b970 tx=0x7fe048009e30 comp rx=0 tx=0).stop 2024-04-23T14:49:25.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.247+0000 7fe05de00700 1 -- 172.21.15.81:0/657727503 shutdown_connections 2024-04-23T14:49:25.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.247+0000 7fe05de00700 1 --2- 172.21.15.81:0/657727503 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fe03c06bcf0 0x7fe03c06e1a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:25.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.247+0000 7fe05de00700 1 --2- 172.21.15.81:0/657727503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0580fcef0 0x7fe05810da30 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:25.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.247+0000 7fe05de00700 1 --2- 172.21.15.81:0/657727503 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0580fe0e0 0x7fe05810df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:25.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.247+0000 7fe05de00700 1 -- 172.21.15.81:0/657727503 >> 172.21.15.81:0/657727503 conn(0x7fe0580f8530 msgr2=0x7fe0580f9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:25.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.247+0000 7fe05de00700 1 -- 172.21.15.81:0/657727503 shutdown_connections 2024-04-23T14:49:25.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.247+0000 7fe05de00700 1 -- 172.21.15.81:0/657727503 wait complete. 2024-04-23T14:49:25.255 INFO:tasks.workunit.client.0.smithi081.stdout:0/22: dwrite f0 [0,4194304] 0 2024-04-23T14:49:25.287 INFO:tasks.workunit.client.0.smithi081.stdout:0/23: write f0 [1306675,76103] 0 2024-04-23T14:49:25.288 INFO:tasks.workunit.client.0.smithi081.stdout:0/24: write f0 [2529493,25357] 0 2024-04-23T14:49:25.288 INFO:tasks.workunit.client.0.smithi081.stdout:0/25: truncate f0 4291128 0 2024-04-23T14:49:25.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.450+0000 7f925b200700 1 -- 172.21.15.81:0/626216201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f925c066b60 msgr2=0x7f925c0ff840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:25.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.450+0000 7f925b200700 1 --2- 172.21.15.81:0/626216201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f925c066b60 0x7f925c0ff840 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f924c004940 tx=0x7f924c009e30 comp rx=0 tx=0).stop 2024-04-23T14:49:25.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.451+0000 7f925b200700 1 -- 172.21.15.81:0/626216201 shutdown_connections 2024-04-23T14:49:25.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.451+0000 7f925b200700 1 --2- 172.21.15.81:0/626216201 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f925c0ffd80 0x7f925c102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:25.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.451+0000 7f925b200700 1 --2- 172.21.15.81:0/626216201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f925c066b60 0x7f925c0ff840 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:25.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.451+0000 7f925b200700 1 -- 172.21.15.81:0/626216201 >> 172.21.15.81:0/626216201 conn(0x7f925c0f7290 msgr2=0x7f925c0f96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:25.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.451+0000 7f925b200700 1 -- 172.21.15.81:0/626216201 shutdown_connections 2024-04-23T14:49:25.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.451+0000 7f925b200700 1 -- 172.21.15.81:0/626216201 wait complete. 2024-04-23T14:49:25.453 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:25 smithi081 ceph-mon[25540]: from='client.14690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:49:25.453 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:25 smithi081 ceph-mon[25540]: pgmap v21: 65 pgs: 65 active+clean; 228 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 6.4 MiB/s wr, 348 op/s 2024-04-23T14:49:25.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.452+0000 7f925b200700 1 Processor -- start 2024-04-23T14:49:25.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.453+0000 7f925b200700 1 -- start start 2024-04-23T14:49:25.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.453+0000 7f925b200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f925c066b60 0x7f925c113f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:25.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.453+0000 7f925b200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f925c0ffd80 0x7f925c1144b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:25.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.453+0000 7f925b200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925c1151d0 con 0x7f925c066b60 2024-04-23T14:49:25.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.453+0000 7f925b200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925c115340 con 0x7f925c0ffd80 2024-04-23T14:49:25.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.453+0000 7f9259e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f925c066b60 0x7f925c113f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:25.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.453+0000 7f9259e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f925c066b60 0x7f925c113f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56406/0 (socket says 172.21.15.81:56406) 2024-04-23T14:49:25.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.453+0000 7f9259e00700 1 -- 172.21.15.81:0/1641324904 learned_addr learned my addr 172.21.15.81:0/1641324904 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:49:25.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.454+0000 7f9259e00700 1 -- 172.21.15.81:0/1641324904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f925c0ffd80 msgr2=0x7f925c1144b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:25.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.454+0000 7f9259e00700 1 --2- 172.21.15.81:0/1641324904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f925c0ffd80 0x7f925c1144b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:25.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.454+0000 7f9259e00700 1 -- 172.21.15.81:0/1641324904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f924c005040 con 0x7f925c066b60 2024-04-23T14:49:25.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.454+0000 7f9259e00700 1 --2- 172.21.15.81:0/1641324904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f925c066b60 0x7f925c113f70 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f924c00b970 tx=0x7f924c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:25.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.454+0000 7f9252000700 1 -- 172.21.15.81:0/1641324904 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f924c00e040 con 0x7f925c066b60 2024-04-23T14:49:25.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.455+0000 7f9252000700 1 -- 172.21.15.81:0/1641324904 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f924c004290 con 0x7f925c066b60 2024-04-23T14:49:25.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.455+0000 7f9252000700 1 -- 172.21.15.81:0/1641324904 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f924c01c630 con 0x7f925c066b60 2024-04-23T14:49:25.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.455+0000 7f925b200700 1 -- 172.21.15.81:0/1641324904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f925c1155c0 con 0x7f925c066b60 2024-04-23T14:49:25.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.455+0000 7f925b200700 1 -- 172.21.15.81:0/1641324904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f925c115b30 con 0x7f925c066b60 2024-04-23T14:49:25.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.456+0000 7f925b200700 1 -- 172.21.15.81:0/1641324904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f925c05f5f0 con 0x7f925c066b60 2024-04-23T14:49:25.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.459+0000 7f9252000700 1 -- 172.21.15.81:0/1641324904 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f924c00bbf0 con 0x7f925c066b60 2024-04-23T14:49:25.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.459+0000 7f9252000700 1 --2- 172.21.15.81:0/1641324904 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f924006bcf0 0x7f924006e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:25.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.460+0000 7f9252000700 1 -- 172.21.15.81:0/1641324904 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f924c08c070 con 0x7f925c066b60 2024-04-23T14:49:25.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.461+0000 7f9259400700 1 --2- 172.21.15.81:0/1641324904 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f924006bcf0 0x7f924006e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:25.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.463+0000 7f9259400700 1 --2- 172.21.15.81:0/1641324904 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f924006bcf0 0x7f924006e1a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9248006fd0 tx=0x7f9248006db0 comp rx=0 tx=0).ready entity=mgr.24373 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:25.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.463+0000 7f9252000700 1 -- 172.21.15.81:0/1641324904 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f924c059160 con 0x7f925c066b60 2024-04-23T14:49:25.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:25 smithi156 ceph-mon[32341]: from='client.14690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:49:25.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:25 smithi156 ceph-mon[32341]: pgmap v21: 65 pgs: 65 active+clean; 228 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 6.4 MiB/s wr, 348 op/s 2024-04-23T14:49:25.590 INFO:tasks.workunit.client.0.smithi081.stdout:4/22: mkdir d1/d4/dc 0 2024-04-23T14:49:25.594 INFO:tasks.workunit.client.0.smithi081.stdout:6/22: symlink d1/l9 0 2024-04-23T14:49:25.594 INFO:tasks.workunit.client.0.smithi081.stdout:6/23: stat f0 0 2024-04-23T14:49:25.594 INFO:tasks.workunit.client.0.smithi081.stdout:6/24: rename d1/d2 to d1/d2/d6/d8/da 22 2024-04-23T14:49:25.594 INFO:tasks.workunit.client.0.smithi081.stdout:6/25: fdatasync f0 0 2024-04-23T14:49:25.596 INFO:tasks.workunit.client.0.smithi081.stdout:5/33: symlink la 0 2024-04-23T14:49:25.596 INFO:tasks.workunit.client.0.smithi081.stdout:5/34: stat f8 0 2024-04-23T14:49:25.596 INFO:tasks.workunit.client.0.smithi081.stdout:5/35: chown l5 20951978 1 2024-04-23T14:49:25.603 INFO:tasks.workunit.client.0.smithi081.stdout:2/30: mknod d1/cf 0 2024-04-23T14:49:25.603 INFO:tasks.workunit.client.0.smithi081.stdout:2/31: read - d1/fc zero size 2024-04-23T14:49:25.603 INFO:tasks.workunit.client.0.smithi081.stdout:2/32: chown d1/fc 55763462 1 2024-04-23T14:49:25.603 INFO:tasks.workunit.client.0.smithi081.stdout:2/33: write d1/fa [349738,4513] 0 2024-04-23T14:49:25.604 INFO:tasks.workunit.client.0.smithi081.stdout:2/34: dread - d1/fe zero size 2024-04-23T14:49:25.606 INFO:tasks.workunit.client.0.smithi081.stdout:3/23: mkdir d4/d7 0 2024-04-23T14:49:25.606 INFO:tasks.workunit.client.0.smithi081.stdout:3/24: truncate d4/f6 232279 0 2024-04-23T14:49:25.619 INFO:tasks.workunit.client.0.smithi081.stdout:0/26: symlink l3 0 2024-04-23T14:49:25.621 INFO:tasks.workunit.client.0.smithi081.stdout:4/23: symlink d1/d3/ld 0 2024-04-23T14:49:25.622 INFO:tasks.workunit.client.0.smithi081.stdout:4/24: stat d1/f9 0 2024-04-23T14:49:25.622 INFO:tasks.workunit.client.0.smithi081.stdout:4/25: creat d1/d3/fe x:0 0 0 2024-04-23T14:49:25.622 INFO:tasks.workunit.client.0.smithi081.stdout:4/26: creat d1/ff x:0 0 0 2024-04-23T14:49:25.622 INFO:tasks.workunit.client.0.smithi081.stdout:6/26: creat d1/d2/d6/d4/fb x:0 0 0 2024-04-23T14:49:25.623 INFO:tasks.workunit.client.0.smithi081.stdout:5/36: symlink lb 0 2024-04-23T14:49:25.626 INFO:tasks.workunit.client.0.smithi081.stdout:2/35: mknod d1/c10 0 2024-04-23T14:49:25.627 INFO:tasks.workunit.client.0.smithi081.stdout:7/22: rmdir d3/d4 39 2024-04-23T14:49:25.627 INFO:tasks.workunit.client.0.smithi081.stdout:0/27: fdatasync f0 0 2024-04-23T14:49:25.631 INFO:tasks.workunit.client.0.smithi081.stdout:3/25: symlink d4/d7/l8 0 2024-04-23T14:49:25.631 INFO:tasks.workunit.client.0.smithi081.stdout:3/26: chown l2 0 1 2024-04-23T14:49:25.646 INFO:tasks.workunit.client.0.smithi081.stdout:6/27: unlink d1/d2/d6/d4/fb 0 2024-04-23T14:49:25.646 INFO:tasks.workunit.client.0.smithi081.stdout:5/37: symlink lc 0 2024-04-23T14:49:25.647 INFO:tasks.workunit.client.0.smithi081.stdout:7/23: write d3/f5 [2101638,42417] 0 2024-04-23T14:49:25.647 INFO:tasks.workunit.client.0.smithi081.stdout:7/24: chown c1 53244 1 2024-04-23T14:49:25.655 INFO:tasks.workunit.client.0.smithi081.stdout:7/25: unlink c1 0 2024-04-23T14:49:25.655 INFO:tasks.workunit.client.0.smithi081.stdout:7/26: write d3/d4/f6 [196759,62170] 0 2024-04-23T14:49:25.659 INFO:tasks.workunit.client.0.smithi081.stdout:7/27: unlink f0 0 2024-04-23T14:49:25.659 INFO:tasks.workunit.client.0.smithi081.stdout:7/28: chown d3/d4/f6 48171054 1 2024-04-23T14:49:25.662 INFO:tasks.workunit.client.0.smithi081.stdout:7/29: write d3/d4/f6 [145934,127288] 0 2024-04-23T14:49:25.663 INFO:tasks.workunit.client.0.smithi081.stdout:5/38: dread f4 [0,4194304] 0 2024-04-23T14:49:25.667 INFO:tasks.workunit.client.0.smithi081.stdout:7/30: link d3/f5 d3/f7 0 2024-04-23T14:49:25.669 INFO:tasks.workunit.client.0.smithi081.stdout:7/31: creat d3/d4/f8 x:0 0 0 2024-04-23T14:49:25.669 INFO:tasks.workunit.client.0.smithi081.stdout:7/32: fdatasync f2 0 2024-04-23T14:49:25.673 INFO:tasks.workunit.client.0.smithi081.stdout:7/33: rename d3/f7 to d3/d4/f9 0 2024-04-23T14:49:25.674 INFO:tasks.workunit.client.0.smithi081.stdout:7/34: creat d3/d4/fa x:0 0 0 2024-04-23T14:49:25.677 INFO:tasks.workunit.client.0.smithi081.stdout:6/28: dread f0 [0,4194304] 0 2024-04-23T14:49:25.737 INFO:tasks.workunit.client.0.smithi081.stdout:7/35: dwrite d3/d4/f8 [0,4194304] 0 2024-04-23T14:49:25.784 INFO:tasks.workunit.client.0.smithi081.stdout:4/27: dwrite f0 [0,4194304] 0 2024-04-23T14:49:25.787 INFO:tasks.workunit.client.0.smithi081.stdout:7/36: link d3/d4/f8 d3/fb 0 2024-04-23T14:49:25.789 INFO:tasks.workunit.client.0.smithi081.stdout:4/28: unlink d1/d3/ld 0 2024-04-23T14:49:25.789 INFO:tasks.workunit.client.0.smithi081.stdout:4/29: chown d1/f9 3368445 1 2024-04-23T14:49:25.835 INFO:tasks.workunit.client.0.smithi081.stdout:7/37: dwrite d3/d4/f9 [0,4194304] 0 2024-04-23T14:49:25.837 INFO:tasks.workunit.client.0.smithi081.stdout:7/38: mknod d3/cc 0 2024-04-23T14:49:25.837 INFO:tasks.workunit.client.0.smithi081.stdout:7/39: creat d3/d4/fd x:0 0 0 2024-04-23T14:49:25.845 INFO:tasks.workunit.client.0.smithi081.stdout:4/30: dwrite d1/fa [0,4194304] 0 2024-04-23T14:49:25.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.846+0000 7f925b200700 1 -- 172.21.15.81:0/1641324904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f925c105790 con 0x7f925c066b60 2024-04-23T14:49:25.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.846+0000 7f9252000700 1 -- 172.21.15.81:0/1641324904 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1837 (secure 0 0 0) 0x7f924c013e60 con 0x7f925c066b60 2024-04-23T14:49:25.847 INFO:tasks.workunit.client.0.smithi081.stdout:7/40: dread f2 [0,4194304] 0 2024-04-23T14:49:25.847 INFO:teuthology.orchestra.run.smithi081.stdout:e18 2024-04-23T14:49:25.847 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-23T14:49:25.848 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:49:25.848 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-04-23T14:49:25.848 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:49:25.848 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-04-23T14:49:25.848 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-04-23T14:49:25.848 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 17 2024-04-23T14:49:25.848 INFO:teuthology.orchestra.run.smithi081.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-23T14:49:25.848 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-04-23T14:45:51.264703+0000 2024-04-23T14:49:25.848 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-04-23T14:46:12.782992+0000 2024-04-23T14:49:25.848 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-04-23T14:49:25.848 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-04-23T14:49:25.848 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-04-23T14:49:25.849 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-04-23T14:49:25.849 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-04-23T14:49:25.849 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-04-23T14:49:25.849 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-04-23T14:49:25.849 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 47 2024-04-23T14:49:25.849 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:49:25.849 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 1 2024-04-23T14:49:25.849 INFO:teuthology.orchestra.run.smithi081.stdout:in 0 2024-04-23T14:49:25.849 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=14472} 2024-04-23T14:49:25.849 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-04-23T14:49:25.849 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-04-23T14:49:25.849 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-04-23T14:49:25.849 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-04-23T14:49:25.850 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-04-23T14:49:25.850 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-04-23T14:49:25.850 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-04-23T14:49:25.850 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-04-23T14:49:25.850 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.vcoywg{0:14472} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.81:6828/2563365650,v1:172.21.15.81:6829/2563365650] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:49:25.850 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.wydgcg{0:14482} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.81:6826/759909104,v1:172.21.15.81:6827/759909104] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:49:25.850 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:49:25.850 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:49:25.850 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-04-23T14:49:25.850 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:49:25.850 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.vynkxn{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.156:6826/1794690362,v1:172.21.15.156:6827/1794690362] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:49:25.850 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.rhbtxt{-1:24263} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.156:6824/3854041261,v1:172.21.15.156:6825/3854041261] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:49:25.851 INFO:tasks.workunit.client.0.smithi081.stdout:4/31: creat d1/d4/f10 x:0 0 0 2024-04-23T14:49:25.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.850+0000 7f925b200700 1 -- 172.21.15.81:0/1641324904 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f924006bcf0 msgr2=0x7f924006e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:25.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.850+0000 7f925b200700 1 --2- 172.21.15.81:0/1641324904 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f924006bcf0 0x7f924006e1a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9248006fd0 tx=0x7f9248006db0 comp rx=0 tx=0).stop 2024-04-23T14:49:25.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.850+0000 7f925b200700 1 -- 172.21.15.81:0/1641324904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f925c066b60 msgr2=0x7f925c113f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:25.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.850+0000 7f925b200700 1 --2- 172.21.15.81:0/1641324904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f925c066b60 0x7f925c113f70 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f924c00b970 tx=0x7f924c009e30 comp rx=0 tx=0).stop 2024-04-23T14:49:25.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.851+0000 7f925b200700 1 -- 172.21.15.81:0/1641324904 shutdown_connections 2024-04-23T14:49:25.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.851+0000 7f925b200700 1 --2- 172.21.15.81:0/1641324904 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f924006bcf0 0x7f924006e1a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:25.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.851+0000 7f925b200700 1 --2- 172.21.15.81:0/1641324904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f925c066b60 0x7f925c113f70 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:25.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.851+0000 7f925b200700 1 --2- 172.21.15.81:0/1641324904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f925c0ffd80 0x7f925c1144b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:25.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.851+0000 7f925b200700 1 -- 172.21.15.81:0/1641324904 >> 172.21.15.81:0/1641324904 conn(0x7f925c0f7290 msgr2=0x7f925c100150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:25.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.851+0000 7f925b200700 1 -- 172.21.15.81:0/1641324904 shutdown_connections 2024-04-23T14:49:25.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:25.851+0000 7f925b200700 1 -- 172.21.15.81:0/1641324904 wait complete. 2024-04-23T14:49:25.853 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 18 2024-04-23T14:49:25.915 INFO:tasks.workunit.client.0.smithi081.stdout:7/41: dwrite d3/d4/fa [0,4194304] 0 2024-04-23T14:49:26.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.016+0000 7f8648200700 1 -- 172.21.15.81:0/2598690963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86401046d0 msgr2=0x7f8640104b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:26.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.016+0000 7f8648200700 1 --2- 172.21.15.81:0/2598690963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86401046d0 0x7f8640104b40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f862c004940 tx=0x7f862c009e30 comp rx=0 tx=0).stop 2024-04-23T14:49:26.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.017+0000 7f8648200700 1 -- 172.21.15.81:0/2598690963 shutdown_connections 2024-04-23T14:49:26.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.017+0000 7f8648200700 1 --2- 172.21.15.81:0/2598690963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86401046d0 0x7f8640104b40 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:26.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.017+0000 7f8648200700 1 --2- 172.21.15.81:0/2598690963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8640103420 0x7f8640103830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:26.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.017+0000 7f8648200700 1 -- 172.21.15.81:0/2598690963 >> 172.21.15.81:0/2598690963 conn(0x7f8640072640 msgr2=0x7f8640074a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:26.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.017+0000 7f8648200700 1 -- 172.21.15.81:0/2598690963 shutdown_connections 2024-04-23T14:49:26.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.017+0000 7f8648200700 1 -- 172.21.15.81:0/2598690963 wait complete. 2024-04-23T14:49:26.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.018+0000 7f8648200700 1 Processor -- start 2024-04-23T14:49:26.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.018+0000 7f8648200700 1 -- start start 2024-04-23T14:49:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.019+0000 7f8648200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8640103420 0x7f8640113f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.019+0000 7f8648200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86401046d0 0x7f8640114490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.019+0000 7f8648200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8640114a90 con 0x7f86401046d0 2024-04-23T14:49:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.019+0000 7f8648200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8640114c00 con 0x7f8640103420 2024-04-23T14:49:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.019+0000 7f8644e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86401046d0 0x7f8640114490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.019+0000 7f8644e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86401046d0 0x7f8640114490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56424/0 (socket says 172.21.15.81:56424) 2024-04-23T14:49:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.019+0000 7f8644e00700 1 -- 172.21.15.81:0/2252401837 learned_addr learned my addr 172.21.15.81:0/2252401837 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:49:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.019+0000 7f8645800700 1 --2- 172.21.15.81:0/2252401837 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8640103420 0x7f8640113f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:26.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.020+0000 7f8644e00700 1 -- 172.21.15.81:0/2252401837 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8640103420 msgr2=0x7f8640113f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:26.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.020+0000 7f8644e00700 1 --2- 172.21.15.81:0/2252401837 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8640103420 0x7f8640113f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:26.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.020+0000 7f8644e00700 1 -- 172.21.15.81:0/2252401837 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f862c005040 con 0x7f86401046d0 2024-04-23T14:49:26.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.020+0000 7f8644e00700 1 --2- 172.21.15.81:0/2252401837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86401046d0 0x7f8640114490 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f862c00b3b0 tx=0x7f862c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:26.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.020+0000 7f863d600700 1 -- 172.21.15.81:0/2252401837 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f862c00e040 con 0x7f86401046d0 2024-04-23T14:49:26.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.021+0000 7f863d600700 1 -- 172.21.15.81:0/2252401837 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f862c004290 con 0x7f86401046d0 2024-04-23T14:49:26.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.021+0000 7f863d600700 1 -- 172.21.15.81:0/2252401837 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f862c01c630 con 0x7f86401046d0 2024-04-23T14:49:26.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.021+0000 7f8648200700 1 -- 172.21.15.81:0/2252401837 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8640119600 con 0x7f86401046d0 2024-04-23T14:49:26.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.021+0000 7f8648200700 1 -- 172.21.15.81:0/2252401837 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8640119bc0 con 0x7f86401046d0 2024-04-23T14:49:26.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.022+0000 7f8648200700 1 -- 172.21.15.81:0/2252401837 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f864004c710 con 0x7f86401046d0 2024-04-23T14:49:26.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.024+0000 7f863d600700 1 -- 172.21.15.81:0/2252401837 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f862c00bbf0 con 0x7f86401046d0 2024-04-23T14:49:26.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.025+0000 7f863d600700 1 --2- 172.21.15.81:0/2252401837 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f862806bd00 0x7f862806e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:26.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.025+0000 7f863d600700 1 -- 172.21.15.81:0/2252401837 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f862c08be70 con 0x7f86401046d0 2024-04-23T14:49:26.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.026+0000 7f8645800700 1 --2- 172.21.15.81:0/2252401837 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f862806bd00 0x7f862806e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:26.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.027+0000 7f8645800700 1 --2- 172.21.15.81:0/2252401837 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f862806bd00 0x7f862806e1b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8634004d60 tx=0x7f863400b040 comp rx=0 tx=0).ready entity=mgr.24373 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:26.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.030+0000 7f863d600700 1 -- 172.21.15.81:0/2252401837 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f862c059020 con 0x7f86401046d0 2024-04-23T14:49:26.130 INFO:tasks.workunit.client.0.smithi081.stdout:3/27: dwrite f3 [0,4194304] 0 2024-04-23T14:49:26.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.327+0000 7f8648200700 1 -- 172.21.15.81:0/2252401837 --> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f86401089f0 con 0x7f862806bd00 2024-04-23T14:49:26.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.330+0000 7f863d600700 1 -- 172.21.15.81:0/2252401837 <== mgr.24373 v2:172.21.15.156:6828/100981835 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f86401089f0 con 0x7f862806bd00 2024-04-23T14:49:26.331 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:49:26.331 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd", 2024-04-23T14:49:26.331 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-04-23T14:49:26.331 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-23T14:49:26.331 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [], 2024-04-23T14:49:26.331 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "1/21 daemons upgraded", 2024-04-23T14:49:26.331 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "", 2024-04-23T14:49:26.332 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-04-23T14:49:26.332 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:49:26.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.333+0000 7f8648200700 1 -- 172.21.15.81:0/2252401837 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f862806bd00 msgr2=0x7f862806e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:26.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.333+0000 7f8648200700 1 --2- 172.21.15.81:0/2252401837 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f862806bd00 0x7f862806e1b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8634004d60 tx=0x7f863400b040 comp rx=0 tx=0).stop 2024-04-23T14:49:26.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.333+0000 7f8648200700 1 -- 172.21.15.81:0/2252401837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86401046d0 msgr2=0x7f8640114490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:26.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.333+0000 7f8648200700 1 --2- 172.21.15.81:0/2252401837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86401046d0 0x7f8640114490 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f862c00b3b0 tx=0x7f862c009e30 comp rx=0 tx=0).stop 2024-04-23T14:49:26.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.333+0000 7f8648200700 1 -- 172.21.15.81:0/2252401837 shutdown_connections 2024-04-23T14:49:26.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.333+0000 7f8648200700 1 --2- 172.21.15.81:0/2252401837 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f862806bd00 0x7f862806e1b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:26.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.333+0000 7f8648200700 1 --2- 172.21.15.81:0/2252401837 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8640103420 0x7f8640113f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:26.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.333+0000 7f8648200700 1 --2- 172.21.15.81:0/2252401837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86401046d0 0x7f8640114490 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:26.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.333+0000 7f8648200700 1 -- 172.21.15.81:0/2252401837 >> 172.21.15.81:0/2252401837 conn(0x7f8640072640 msgr2=0x7f8640073d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:26.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.334+0000 7f8648200700 1 -- 172.21.15.81:0/2252401837 shutdown_connections 2024-04-23T14:49:26.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.334+0000 7f8648200700 1 -- 172.21.15.81:0/2252401837 wait complete. 2024-04-23T14:49:26.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.487+0000 7f8190a00700 1 -- 172.21.15.81:0/719118103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f818c0662f0 msgr2=0x7f818c0ffa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:26.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.487+0000 7f8190a00700 1 --2- 172.21.15.81:0/719118103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f818c0662f0 0x7f818c0ffa30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f817c004940 tx=0x7f817c009e30 comp rx=0 tx=0).stop 2024-04-23T14:49:26.488 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:26 smithi081 ceph-mon[25540]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:49:26.488 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:26 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/657727503' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:49:26.488 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:26 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/1641324904' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:49:26.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.487+0000 7f8190a00700 1 -- 172.21.15.81:0/719118103 shutdown_connections 2024-04-23T14:49:26.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.487+0000 7f8190a00700 1 --2- 172.21.15.81:0/719118103 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f818c0fff70 0x7f818c102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:26.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.487+0000 7f8190a00700 1 --2- 172.21.15.81:0/719118103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f818c0662f0 0x7f818c0ffa30 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:26.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.487+0000 7f8190a00700 1 -- 172.21.15.81:0/719118103 >> 172.21.15.81:0/719118103 conn(0x7f818c0f74c0 msgr2=0x7f818c0f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:26.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.488+0000 7f8190a00700 1 -- 172.21.15.81:0/719118103 shutdown_connections 2024-04-23T14:49:26.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.488+0000 7f8190a00700 1 -- 172.21.15.81:0/719118103 wait complete. 2024-04-23T14:49:26.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.488+0000 7f8190a00700 1 Processor -- start 2024-04-23T14:49:26.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.489+0000 7f8190a00700 1 -- start start 2024-04-23T14:49:26.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.489+0000 7f8190a00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f818c0662f0 0x7f818c10fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:26.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.489+0000 7f8190a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f818c0fff70 0x7f818c1101e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:26.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.489+0000 7f8190a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818c110870 con 0x7f818c0fff70 2024-04-23T14:49:26.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.489+0000 7f8190a00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818c111010 con 0x7f818c0662f0 2024-04-23T14:49:26.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.489+0000 7f8189400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f818c0fff70 0x7f818c1101e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:26.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.490+0000 7f8189400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f818c0fff70 0x7f818c1101e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56436/0 (socket says 172.21.15.81:56436) 2024-04-23T14:49:26.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.490+0000 7f8189400700 1 -- 172.21.15.81:0/719668115 learned_addr learned my addr 172.21.15.81:0/719668115 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:49:26.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.490+0000 7f8189e00700 1 --2- 172.21.15.81:0/719668115 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f818c0662f0 0x7f818c10fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:26.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.490+0000 7f8189400700 1 -- 172.21.15.81:0/719668115 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f818c0662f0 msgr2=0x7f818c10fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:26.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.490+0000 7f8189400700 1 --2- 172.21.15.81:0/719668115 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f818c0662f0 0x7f818c10fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:26.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.490+0000 7f8189400700 1 -- 172.21.15.81:0/719668115 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f817c005040 con 0x7f818c0fff70 2024-04-23T14:49:26.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.490+0000 7f8189400700 1 --2- 172.21.15.81:0/719668115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f818c0fff70 0x7f818c1101e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f817800b790 tx=0x7f8178009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:26.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.491+0000 7f8182000700 1 -- 172.21.15.81:0/719668115 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f817800f770 con 0x7f818c0fff70 2024-04-23T14:49:26.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.491+0000 7f8182000700 1 -- 172.21.15.81:0/719668115 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f817800fda0 con 0x7f818c0fff70 2024-04-23T14:49:26.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.491+0000 7f8190a00700 1 -- 172.21.15.81:0/719668115 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f818c1112f0 con 0x7f818c0fff70 2024-04-23T14:49:26.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.491+0000 7f8182000700 1 -- 172.21.15.81:0/719668115 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f817800d310 con 0x7f818c0fff70 2024-04-23T14:49:26.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.491+0000 7f8190a00700 1 -- 172.21.15.81:0/719668115 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f818c1118b0 con 0x7f818c0fff70 2024-04-23T14:49:26.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.492+0000 7f8190a00700 1 -- 172.21.15.81:0/719668115 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f818c05f5f0 con 0x7f818c0fff70 2024-04-23T14:49:26.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.494+0000 7f8182000700 1 -- 172.21.15.81:0/719668115 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f8178010420 con 0x7f818c0fff70 2024-04-23T14:49:26.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.495+0000 7f8182000700 1 --2- 172.21.15.81:0/719668115 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f817006bcf0 0x7f817006e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:26.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.495+0000 7f8182000700 1 -- 172.21.15.81:0/719668115 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f817808aa60 con 0x7f818c0fff70 2024-04-23T14:49:26.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.495+0000 7f8189e00700 1 --2- 172.21.15.81:0/719668115 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f817006bcf0 0x7f817006e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:26.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.497+0000 7f8189e00700 1 --2- 172.21.15.81:0/719668115 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f817006bcf0 0x7f817006e1a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f817c009fd0 tx=0x7f817c009e30 comp rx=0 tx=0).ready entity=mgr.24373 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:26.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.501+0000 7f8182000700 1 -- 172.21.15.81:0/719668115 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f8178057be0 con 0x7f818c0fff70 2024-04-23T14:49:26.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:26 smithi156 ceph-mon[32341]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:49:26.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:26 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/657727503' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:49:26.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:26 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/1641324904' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:49:26.557 INFO:tasks.workunit.client.0.smithi081.stdout:1/23: rmdir d3 39 2024-04-23T14:49:26.560 INFO:tasks.workunit.client.0.smithi081.stdout:1/24: symlink d3/l8 0 2024-04-23T14:49:26.561 INFO:tasks.workunit.client.0.smithi081.stdout:3/28: getdents d4 0 2024-04-23T14:49:26.565 INFO:tasks.workunit.client.0.smithi081.stdout:1/25: creat d3/f9 x:0 0 0 2024-04-23T14:49:26.571 INFO:tasks.workunit.client.0.smithi081.stdout:0/28: getdents . 0 2024-04-23T14:49:26.575 INFO:tasks.workunit.client.0.smithi081.stdout:0/29: creat f4 x:0 0 0 2024-04-23T14:49:26.577 INFO:tasks.workunit.client.0.smithi081.stdout:0/30: fsync f0 0 2024-04-23T14:49:26.584 INFO:tasks.workunit.client.0.smithi081.stdout:0/31: unlink f4 0 2024-04-23T14:49:26.586 INFO:tasks.workunit.client.0.smithi081.stdout:0/32: creat f5 x:0 0 0 2024-04-23T14:49:26.586 INFO:tasks.workunit.client.0.smithi081.stdout:0/33: write f5 [495235,3646] 0 2024-04-23T14:49:26.589 INFO:tasks.workunit.client.0.smithi081.stdout:0/34: readlink l3 0 2024-04-23T14:49:26.593 INFO:tasks.workunit.client.0.smithi081.stdout:0/35: mkdir d6 0 2024-04-23T14:49:26.593 INFO:tasks.workunit.client.0.smithi081.stdout:0/36: mkdir d6/d7 0 2024-04-23T14:49:26.602 INFO:tasks.workunit.client.0.smithi081.stdout:6/29: truncate f0 269099 0 2024-04-23T14:49:26.602 INFO:tasks.workunit.client.0.smithi081.stdout:6/30: chown d1/d2 1555774 1 2024-04-23T14:49:26.613 INFO:tasks.workunit.client.0.smithi081.stdout:7/42: rmdir d3/d4 39 2024-04-23T14:49:26.616 INFO:tasks.workunit.client.0.smithi081.stdout:7/43: mknod d3/ce 0 2024-04-23T14:49:26.658 INFO:tasks.workunit.client.0.smithi081.stdout:3/29: dwrite f3 [4194304,4194304] 0 2024-04-23T14:49:26.662 INFO:tasks.workunit.client.0.smithi081.stdout:3/30: creat d4/d7/f9 x:0 0 0 2024-04-23T14:49:26.663 INFO:tasks.workunit.client.0.smithi081.stdout:7/44: dread d3/fb [0,4194304] 0 2024-04-23T14:49:26.668 INFO:tasks.workunit.client.0.smithi081.stdout:3/31: rename d4/d7/l8 to d4/la 0 2024-04-23T14:49:26.673 INFO:tasks.workunit.client.0.smithi081.stdout:1/26: dwrite f1 [0,4194304] 0 2024-04-23T14:49:26.675 INFO:tasks.workunit.client.0.smithi081.stdout:7/45: dread d3/d4/f6 [0,4194304] 0 2024-04-23T14:49:26.689 INFO:tasks.workunit.client.0.smithi081.stdout:0/37: dwrite f5 [0,4194304] 0 2024-04-23T14:49:26.696 INFO:tasks.workunit.client.0.smithi081.stdout:0/38: rmdir d6/d7 0 2024-04-23T14:49:26.710 INFO:tasks.workunit.client.0.smithi081.stdout:0/39: dread f0 [0,4194304] 0 2024-04-23T14:49:26.710 INFO:tasks.workunit.client.0.smithi081.stdout:0/40: chown l3 8428833 1 2024-04-23T14:49:26.729 INFO:tasks.workunit.client.0.smithi081.stdout:0/41: dread f0 [0,4194304] 0 2024-04-23T14:49:26.730 INFO:tasks.workunit.client.0.smithi081.stdout:0/42: rename d6 to d6/d8 22 2024-04-23T14:49:26.750 INFO:tasks.workunit.client.0.smithi081.stdout:0/43: dread f0 [0,4194304] 0 2024-04-23T14:49:26.753 INFO:tasks.workunit.client.0.smithi081.stdout:0/44: unlink f0 0 2024-04-23T14:49:26.803 INFO:tasks.workunit.client.0.smithi081.stdout:9/8: sync 2024-04-23T14:49:26.803 INFO:tasks.workunit.client.0.smithi081.stdout:8/7: sync 2024-04-23T14:49:26.808 INFO:tasks.workunit.client.0.smithi081.stdout:9/9: mkdir d3/d5 0 2024-04-23T14:49:26.809 INFO:tasks.workunit.client.0.smithi081.stdout:9/10: getdents d3/d5 0 2024-04-23T14:49:26.811 INFO:tasks.workunit.client.0.smithi081.stdout:9/11: creat d3/d5/f6 x:0 0 0 2024-04-23T14:49:26.813 INFO:tasks.workunit.client.0.smithi081.stdout:9/12: mknod d3/d5/c7 0 2024-04-23T14:49:26.819 INFO:tasks.workunit.client.0.smithi081.stdout:9/13: creat d3/f8 x:0 0 0 2024-04-23T14:49:26.819 INFO:tasks.workunit.client.0.smithi081.stdout:9/14: chown d3/d5 444 1 2024-04-23T14:49:26.824 INFO:tasks.workunit.client.0.smithi081.stdout:9/15: link f1 d3/f9 0 2024-04-23T14:49:26.828 INFO:tasks.workunit.client.0.smithi081.stdout:9/16: mkdir d3/d5/da 0 2024-04-23T14:49:26.828 INFO:tasks.workunit.client.0.smithi081.stdout:9/17: truncate d3/d5/f6 146009 0 2024-04-23T14:49:26.830 INFO:tasks.workunit.client.0.smithi081.stdout:9/18: symlink d3/lb 0 2024-04-23T14:49:26.830 INFO:tasks.workunit.client.0.smithi081.stdout:9/19: dread - f1 zero size 2024-04-23T14:49:26.837 INFO:tasks.workunit.client.0.smithi081.stdout:9/20: rename f0 to d3/d5/da/fc 0 2024-04-23T14:49:26.837 INFO:tasks.workunit.client.0.smithi081.stdout:9/21: creat d3/d5/fd x:0 0 0 2024-04-23T14:49:26.837 INFO:tasks.workunit.client.0.smithi081.stdout:9/22: fdatasync d3/d5/f6 0 2024-04-23T14:49:26.844 INFO:tasks.workunit.client.0.smithi081.stdout:9/23: mkdir d3/de 0 2024-04-23T14:49:26.854 INFO:tasks.workunit.client.0.smithi081.stdout:8/8: dwrite f1 [0,4194304] 0 2024-04-23T14:49:26.855 INFO:tasks.workunit.client.0.smithi081.stdout:8/9: chown f2 11396 1 2024-04-23T14:49:26.897 INFO:tasks.workunit.client.0.smithi081.stdout:9/24: dwrite d3/d5/f6 [0,4194304] 0 2024-04-23T14:49:26.897 INFO:tasks.workunit.client.0.smithi081.stdout:9/25: read - d3/f8 zero size 2024-04-23T14:49:26.897 INFO:tasks.workunit.client.0.smithi081.stdout:9/26: rename d3/d5/da to d3/d5/da/df 22 2024-04-23T14:49:26.900 INFO:tasks.workunit.client.0.smithi081.stdout:9/27: rename d3/d5/fd to d3/de/f10 0 2024-04-23T14:49:26.900 INFO:tasks.workunit.client.0.smithi081.stdout:9/28: dread - d3/f8 zero size 2024-04-23T14:49:26.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.932+0000 7f8190a00700 1 -- 172.21.15.81:0/719668115 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f818c04bed0 con 0x7f818c0fff70 2024-04-23T14:49:26.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.933+0000 7f8182000700 1 -- 172.21.15.81:0/719668115 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f8178057770 con 0x7f818c0fff70 2024-04-23T14:49:26.933 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-04-23T14:49:26.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.936+0000 7f8190a00700 1 -- 172.21.15.81:0/719668115 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f817006bcf0 msgr2=0x7f817006e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:26.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.936+0000 7f8190a00700 1 --2- 172.21.15.81:0/719668115 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f817006bcf0 0x7f817006e1a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f817c009fd0 tx=0x7f817c009e30 comp rx=0 tx=0).stop 2024-04-23T14:49:26.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.936+0000 7f8190a00700 1 -- 172.21.15.81:0/719668115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f818c0fff70 msgr2=0x7f818c1101e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:26.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.936+0000 7f8190a00700 1 --2- 172.21.15.81:0/719668115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f818c0fff70 0x7f818c1101e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f817800b790 tx=0x7f8178009250 comp rx=0 tx=0).stop 2024-04-23T14:49:26.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.936+0000 7f8190a00700 1 -- 172.21.15.81:0/719668115 shutdown_connections 2024-04-23T14:49:26.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.936+0000 7f8190a00700 1 --2- 172.21.15.81:0/719668115 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f817006bcf0 0x7f817006e1a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:26.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.936+0000 7f8190a00700 1 --2- 172.21.15.81:0/719668115 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f818c0662f0 0x7f818c10fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:26.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.936+0000 7f8190a00700 1 --2- 172.21.15.81:0/719668115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f818c0fff70 0x7f818c1101e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:26.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.936+0000 7f8190a00700 1 -- 172.21.15.81:0/719668115 >> 172.21.15.81:0/719668115 conn(0x7f818c0f74c0 msgr2=0x7f818c0fbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:26.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.936+0000 7f8190a00700 1 -- 172.21.15.81:0/719668115 shutdown_connections 2024-04-23T14:49:26.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:26.936+0000 7f8190a00700 1 -- 172.21.15.81:0/719668115 wait complete. 2024-04-23T14:49:26.958 INFO:tasks.workunit.client.0.smithi081.stdout:2/36: rmdir d1 39 2024-04-23T14:49:26.959 INFO:tasks.workunit.client.0.smithi081.stdout:2/37: fsync d1/f6 0 2024-04-23T14:49:26.959 INFO:tasks.workunit.client.0.smithi081.stdout:2/38: stat d1/cf 0 2024-04-23T14:49:26.962 INFO:tasks.workunit.client.0.smithi081.stdout:2/39: truncate d1/fa 252516 0 2024-04-23T14:49:26.966 INFO:tasks.workunit.client.0.smithi081.stdout:2/40: getdents d1 0 2024-04-23T14:49:26.966 INFO:tasks.workunit.client.0.smithi081.stdout:2/41: dread - d1/f5 zero size 2024-04-23T14:49:26.969 INFO:tasks.workunit.client.0.smithi081.stdout:2/42: mkdir d1/d11 0 2024-04-23T14:49:26.984 INFO:tasks.workunit.client.0.smithi081.stdout:7/46: getdents d3 0 2024-04-23T14:49:26.986 INFO:tasks.workunit.client.0.smithi081.stdout:7/47: truncate d3/d4/f9 1015332 0 2024-04-23T14:49:26.987 INFO:tasks.workunit.client.0.smithi081.stdout:7/48: rmdir d3 39 2024-04-23T14:49:27.023 INFO:tasks.workunit.client.0.smithi081.stdout:6/31: dwrite f0 [0,4194304] 0 2024-04-23T14:49:27.030 INFO:tasks.workunit.client.0.smithi081.stdout:6/32: unlink f0 0 2024-04-23T14:49:27.030 INFO:tasks.workunit.client.0.smithi081.stdout:6/33: fsync - no filename 2024-04-23T14:49:27.030 INFO:tasks.workunit.client.0.smithi081.stdout:6/34: readlink d1/l9 0 2024-04-23T14:49:27.030 INFO:tasks.workunit.client.0.smithi081.stdout:6/35: chown d1/d2 286 1 2024-04-23T14:49:27.041 INFO:tasks.workunit.client.0.smithi081.stdout:3/32: truncate f3 954087 0 2024-04-23T14:49:27.045 INFO:tasks.workunit.client.0.smithi081.stdout:3/33: rmdir d4 39 2024-04-23T14:49:27.049 INFO:tasks.workunit.client.0.smithi081.stdout:3/34: mknod d4/d7/cb 0 2024-04-23T14:49:27.050 INFO:tasks.workunit.client.0.smithi081.stdout:0/45: getdents d6 0 2024-04-23T14:49:27.053 INFO:tasks.workunit.client.0.smithi081.stdout:3/35: mkdir d4/dc 0 2024-04-23T14:49:27.060 INFO:tasks.workunit.client.0.smithi081.stdout:7/49: dwrite f2 [0,4194304] 0 2024-04-23T14:49:27.060 INFO:tasks.workunit.client.0.smithi081.stdout:3/36: dread d4/f6 [0,4194304] 0 2024-04-23T14:49:27.073 INFO:tasks.workunit.client.0.smithi081.stdout:7/50: dread d3/fb [0,4194304] 0 2024-04-23T14:49:27.073 INFO:tasks.workunit.client.0.smithi081.stdout:7/51: stat d3/d4 0 2024-04-23T14:49:27.112 INFO:tasks.workunit.client.0.smithi081.stdout:0/46: readlink l1 0 2024-04-23T14:49:27.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:27 smithi081 ceph-mon[25540]: pgmap v22: 65 pgs: 65 active+clean; 256 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 5.1 MiB/s rd, 9.1 MiB/s wr, 483 op/s 2024-04-23T14:49:27.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:27 smithi081 ceph-mon[25540]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:49:27.333 INFO:tasks.workunit.client.0.smithi081.stdout:7/52: symlink d3/lf 0 2024-04-23T14:49:27.338 INFO:tasks.workunit.client.0.smithi081.stdout:0/47: creat d6/f9 x:0 0 0 2024-04-23T14:49:27.338 INFO:tasks.workunit.client.0.smithi081.stdout:0/48: fsync f5 0 2024-04-23T14:49:27.439 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:27 smithi156 ceph-mon[32341]: pgmap v22: 65 pgs: 65 active+clean; 256 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 5.1 MiB/s rd, 9.1 MiB/s wr, 483 op/s 2024-04-23T14:49:27.439 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:27 smithi156 ceph-mon[32341]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:49:27.439 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:27 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/719668115' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:49:27.665 INFO:tasks.workunit.client.0.smithi081.stdout:8/10: dwrite f1 [4194304,4194304] 0 2024-04-23T14:49:27.666 INFO:tasks.workunit.client.0.smithi081.stdout:8/11: stat f2 0 2024-04-23T14:49:27.688 INFO:tasks.workunit.client.0.smithi081.stdout:2/43: dread d1/fa [0,4194304] 0 2024-04-23T14:49:27.688 INFO:tasks.workunit.client.0.smithi081.stdout:2/44: chown d1/d11 0 1 2024-04-23T14:49:27.692 INFO:tasks.workunit.client.0.smithi081.stdout:2/45: truncate d1/fc 524686 0 2024-04-23T14:49:27.695 INFO:tasks.workunit.client.0.smithi081.stdout:8/12: dread f1 [0,4194304] 0 2024-04-23T14:49:27.695 INFO:tasks.workunit.client.0.smithi081.stdout:2/46: write d1/fd [251600,81067] 0 2024-04-23T14:49:27.705 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:27 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/719668115' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:49:27.723 INFO:tasks.workunit.client.0.smithi081.stdout:8/13: dread f1 [0,4194304] 0 2024-04-23T14:49:27.740 INFO:tasks.workunit.client.0.smithi081.stdout:3/37: dread f3 [0,4194304] 0 2024-04-23T14:49:27.747 INFO:tasks.workunit.client.0.smithi081.stdout:0/49: truncate f5 3882510 0 2024-04-23T14:49:27.750 INFO:tasks.workunit.client.0.smithi081.stdout:3/38: symlink d4/dc/ld 0 2024-04-23T14:49:27.750 INFO:tasks.workunit.client.0.smithi081.stdout:3/39: fdatasync d4/d7/f9 0 2024-04-23T14:49:27.751 INFO:tasks.workunit.client.0.smithi081.stdout:0/50: chown l2 252719 1 2024-04-23T14:49:27.755 INFO:tasks.workunit.client.0.smithi081.stdout:3/40: mknod d4/ce 0 2024-04-23T14:49:27.755 INFO:tasks.workunit.client.0.smithi081.stdout:3/41: chown d4/dc/ld 24519141 1 2024-04-23T14:49:27.755 INFO:tasks.workunit.client.0.smithi081.stdout:3/42: stat d4/dc/ld 0 2024-04-23T14:49:27.759 INFO:tasks.workunit.client.0.smithi081.stdout:0/51: symlink d6/la 0 2024-04-23T14:49:27.813 INFO:tasks.workunit.client.0.smithi081.stdout:8/14: dwrite f1 [4194304,4194304] 0 2024-04-23T14:49:27.813 INFO:tasks.workunit.client.0.smithi081.stdout:8/15: write f2 [411420,93370] 0 2024-04-23T14:49:27.818 INFO:tasks.workunit.client.0.smithi081.stdout:8/16: creat d3/f4 x:0 0 0 2024-04-23T14:49:27.818 INFO:tasks.workunit.client.0.smithi081.stdout:8/17: creat d3/f5 x:0 0 0 2024-04-23T14:49:27.870 INFO:tasks.workunit.client.0.smithi081.stdout:1/27: sync 2024-04-23T14:49:27.871 INFO:tasks.workunit.client.0.smithi081.stdout:6/36: sync 2024-04-23T14:49:27.871 INFO:tasks.workunit.client.0.smithi081.stdout:4/32: sync 2024-04-23T14:49:27.871 INFO:tasks.workunit.client.0.smithi081.stdout:6/37: fdatasync - no filename 2024-04-23T14:49:27.871 INFO:tasks.workunit.client.0.smithi081.stdout:9/29: sync 2024-04-23T14:49:27.871 INFO:tasks.workunit.client.0.smithi081.stdout:7/53: sync 2024-04-23T14:49:27.871 INFO:tasks.workunit.client.0.smithi081.stdout:5/39: sync 2024-04-23T14:49:27.871 INFO:tasks.workunit.client.0.smithi081.stdout:4/33: stat d1/d3/fe 0 2024-04-23T14:49:27.871 INFO:tasks.workunit.client.0.smithi081.stdout:1/28: fdatasync f0 0 2024-04-23T14:49:27.871 INFO:tasks.workunit.client.0.smithi081.stdout:9/30: fsync d3/d5/da/fc 0 2024-04-23T14:49:27.871 INFO:tasks.workunit.client.0.smithi081.stdout:1/29: dread - d3/f4 zero size 2024-04-23T14:49:27.871 INFO:tasks.workunit.client.0.smithi081.stdout:5/40: creat fd x:0 0 0 2024-04-23T14:49:27.871 INFO:tasks.workunit.client.0.smithi081.stdout:5/41: creat fe x:0 0 0 2024-04-23T14:49:27.874 INFO:tasks.workunit.client.0.smithi081.stdout:3/43: getdents d4/dc 0 2024-04-23T14:49:27.875 INFO:tasks.workunit.client.0.smithi081.stdout:3/44: read d4/f6 [208949,6610] 0 2024-04-23T14:49:27.875 INFO:tasks.workunit.client.0.smithi081.stdout:3/45: fdatasync d4/f6 0 2024-04-23T14:49:27.877 INFO:tasks.workunit.client.0.smithi081.stdout:3/46: read d4/f6 [42600,90272] 0 2024-04-23T14:49:27.877 INFO:tasks.workunit.client.0.smithi081.stdout:3/47: stat f3 0 2024-04-23T14:49:27.877 INFO:tasks.workunit.client.0.smithi081.stdout:3/48: write d4/f6 [952441,674] 0 2024-04-23T14:49:27.877 INFO:tasks.workunit.client.0.smithi081.stdout:3/49: dread - d4/d7/f9 zero size 2024-04-23T14:49:27.879 INFO:tasks.workunit.client.0.smithi081.stdout:6/38: symlink d1/lc 0 2024-04-23T14:49:27.879 INFO:tasks.workunit.client.0.smithi081.stdout:6/39: dread - no filename 2024-04-23T14:49:27.879 INFO:tasks.workunit.client.0.smithi081.stdout:6/40: write - no filename 2024-04-23T14:49:27.882 INFO:tasks.workunit.client.0.smithi081.stdout:8/18: dwrite d3/f5 [0,4194304] 0 2024-04-23T14:49:27.882 INFO:tasks.workunit.client.0.smithi081.stdout:4/34: truncate d1/fa 1476898 0 2024-04-23T14:49:27.885 INFO:tasks.workunit.client.0.smithi081.stdout:1/30: truncate d3/f6 3439925 0 2024-04-23T14:49:27.892 INFO:tasks.workunit.client.0.smithi081.stdout:3/50: mkdir d4/d7/df 0 2024-04-23T14:49:27.895 INFO:tasks.workunit.client.0.smithi081.stdout:6/41: mknod d1/cd 0 2024-04-23T14:49:27.899 INFO:tasks.workunit.client.0.smithi081.stdout:7/54: write d3/fb [3174974,118337] 0 2024-04-23T14:49:27.906 INFO:tasks.workunit.client.0.smithi081.stdout:8/19: symlink d3/l6 0 2024-04-23T14:49:27.913 INFO:tasks.workunit.client.0.smithi081.stdout:4/35: mkdir d1/d4/d11 0 2024-04-23T14:49:27.913 INFO:tasks.workunit.client.0.smithi081.stdout:4/36: creat d1/f12 x:0 0 0 2024-04-23T14:49:27.913 INFO:tasks.workunit.client.0.smithi081.stdout:4/37: dread - d1/d4/f10 zero size 2024-04-23T14:49:27.918 INFO:tasks.workunit.client.0.smithi081.stdout:5/42: rename fe to ff 0 2024-04-23T14:49:27.921 INFO:tasks.workunit.client.0.smithi081.stdout:3/51: mkdir d4/dc/d10 0 2024-04-23T14:49:27.927 INFO:tasks.workunit.client.0.smithi081.stdout:6/42: creat d1/fe x:0 0 0 2024-04-23T14:49:27.927 INFO:tasks.workunit.client.0.smithi081.stdout:6/43: write d1/fe [525237,46321] 0 2024-04-23T14:49:27.927 INFO:tasks.workunit.client.0.smithi081.stdout:6/44: chown d1/d2/d6 171640 1 2024-04-23T14:49:27.928 INFO:tasks.workunit.client.0.smithi081.stdout:8/20: read f1 [7070566,76269] 0 2024-04-23T14:49:27.932 INFO:tasks.workunit.client.0.smithi081.stdout:9/31: dwrite d3/f8 [0,4194304] 0 2024-04-23T14:49:27.933 INFO:tasks.workunit.client.0.smithi081.stdout:1/31: getdents d3 0 2024-04-23T14:49:27.935 INFO:tasks.workunit.client.0.smithi081.stdout:5/43: symlink l10 0 2024-04-23T14:49:27.935 INFO:tasks.workunit.client.0.smithi081.stdout:5/44: creat f11 x:0 0 0 2024-04-23T14:49:27.935 INFO:tasks.workunit.client.0.smithi081.stdout:5/45: creat f12 x:0 0 0 2024-04-23T14:49:27.935 INFO:tasks.workunit.client.0.smithi081.stdout:5/46: fdatasync f11 0 2024-04-23T14:49:27.937 INFO:tasks.workunit.client.0.smithi081.stdout:3/52: link d4/la d4/l11 0 2024-04-23T14:49:27.939 INFO:tasks.workunit.client.0.smithi081.stdout:8/21: mknod d3/c7 0 2024-04-23T14:49:27.943 INFO:tasks.workunit.client.0.smithi081.stdout:7/55: dwrite d3/f5 [0,4194304] 0 2024-04-23T14:49:27.944 INFO:tasks.workunit.client.0.smithi081.stdout:7/56: fdatasync d3/d4/f9 0 2024-04-23T14:49:27.944 INFO:tasks.workunit.client.0.smithi081.stdout:7/57: write d3/d4/f8 [3337171,5424] 0 2024-04-23T14:49:27.944 INFO:tasks.workunit.client.0.smithi081.stdout:7/58: read d3/d4/f6 [198840,7228] 0 2024-04-23T14:49:27.948 INFO:tasks.workunit.client.0.smithi081.stdout:9/32: link d3/d5/f6 d3/f11 0 2024-04-23T14:49:27.948 INFO:tasks.workunit.client.0.smithi081.stdout:9/33: truncate f1 1014989 0 2024-04-23T14:49:27.948 INFO:tasks.workunit.client.0.smithi081.stdout:9/34: fdatasync d3/de/f10 0 2024-04-23T14:49:27.948 INFO:tasks.workunit.client.0.smithi081.stdout:9/35: chown d3/c4 29006702 1 2024-04-23T14:49:27.948 INFO:tasks.workunit.client.0.smithi081.stdout:9/36: truncate d3/f8 4859178 0 2024-04-23T14:49:27.950 INFO:tasks.workunit.client.0.smithi081.stdout:1/32: creat d3/fa x:0 0 0 2024-04-23T14:49:27.954 INFO:tasks.workunit.client.0.smithi081.stdout:8/22: dread f1 [4194304,4194304] 0 2024-04-23T14:49:27.954 INFO:tasks.workunit.client.0.smithi081.stdout:8/23: fsync f2 0 2024-04-23T14:49:27.956 INFO:tasks.workunit.client.0.smithi081.stdout:5/47: mknod c13 0 2024-04-23T14:49:27.964 INFO:tasks.workunit.client.0.smithi081.stdout:7/59: unlink d3/d4/f6 0 2024-04-23T14:49:27.965 INFO:tasks.workunit.client.0.smithi081.stdout:9/37: link d3/c4 d3/d5/c12 0 2024-04-23T14:49:27.965 INFO:tasks.workunit.client.0.smithi081.stdout:9/38: stat d3/d5 0 2024-04-23T14:49:27.975 INFO:tasks.workunit.client.0.smithi081.stdout:5/48: dread f3 [0,4194304] 0 2024-04-23T14:49:27.984 INFO:tasks.workunit.client.0.smithi081.stdout:8/24: dread d3/f5 [0,4194304] 0 2024-04-23T14:49:27.985 INFO:tasks.workunit.client.0.smithi081.stdout:1/33: symlink d3/lb 0 2024-04-23T14:49:27.994 INFO:tasks.workunit.client.0.smithi081.stdout:1/34: truncate d3/f9 530365 0 2024-04-23T14:49:27.994 INFO:tasks.workunit.client.0.smithi081.stdout:6/45: dwrite d1/fe [0,4194304] 0 2024-04-23T14:49:27.997 INFO:tasks.workunit.client.0.smithi081.stdout:8/25: truncate d3/f5 3621287 0 2024-04-23T14:49:28.000 INFO:tasks.workunit.client.0.smithi081.stdout:4/38: dread d1/f9 [0,4194304] 0 2024-04-23T14:49:28.001 INFO:tasks.workunit.client.0.smithi081.stdout:9/39: dwrite f1 [0,4194304] 0 2024-04-23T14:49:28.005 INFO:tasks.workunit.client.0.smithi081.stdout:6/46: mkdir d1/d2/d6/d8/df 0 2024-04-23T14:49:28.007 INFO:tasks.workunit.client.0.smithi081.stdout:8/26: symlink d3/l8 0 2024-04-23T14:49:28.007 INFO:tasks.workunit.client.0.smithi081.stdout:8/27: chown d3/f4 214812092 1 2024-04-23T14:49:28.009 INFO:tasks.workunit.client.0.smithi081.stdout:4/39: unlink f0 0 2024-04-23T14:49:28.013 INFO:tasks.workunit.client.0.smithi081.stdout:3/53: dwrite d4/f6 [0,4194304] 0 2024-04-23T14:49:28.015 INFO:tasks.workunit.client.0.smithi081.stdout:9/40: mknod d3/d5/da/c13 0 2024-04-23T14:49:28.017 INFO:tasks.workunit.client.0.smithi081.stdout:1/35: mkdir d3/dc 0 2024-04-23T14:49:28.018 INFO:tasks.workunit.client.0.smithi081.stdout:6/47: mknod d1/d2/c10 0 2024-04-23T14:49:28.018 INFO:tasks.workunit.client.0.smithi081.stdout:6/48: chown d1/l9 91088 1 2024-04-23T14:49:28.019 INFO:tasks.workunit.client.0.smithi081.stdout:8/28: unlink d3/c7 0 2024-04-23T14:49:28.025 INFO:tasks.workunit.client.0.smithi081.stdout:3/54: rename d4/d7/f9 to d4/f12 0 2024-04-23T14:49:28.026 INFO:tasks.workunit.client.0.smithi081.stdout:3/55: chown l1 56300731 1 2024-04-23T14:49:28.030 INFO:tasks.workunit.client.0.smithi081.stdout:9/41: dread f1 [0,4194304] 0 2024-04-23T14:49:28.031 INFO:tasks.workunit.client.0.smithi081.stdout:8/29: dread f2 [0,4194304] 0 2024-04-23T14:49:28.034 INFO:tasks.workunit.client.0.smithi081.stdout:4/40: rmdir d1 39 2024-04-23T14:49:28.040 INFO:tasks.workunit.client.0.smithi081.stdout:3/56: link d4/la d4/d7/l13 0 2024-04-23T14:49:28.040 INFO:tasks.workunit.client.0.smithi081.stdout:3/57: dread - d4/f12 zero size 2024-04-23T14:49:28.043 INFO:tasks.workunit.client.0.smithi081.stdout:1/36: rename d3/lb to d3/ld 0 2024-04-23T14:49:28.043 INFO:tasks.workunit.client.0.smithi081.stdout:1/37: chown c2 220 1 2024-04-23T14:49:28.045 INFO:tasks.workunit.client.0.smithi081.stdout:4/41: getdents d1/d4 0 2024-04-23T14:49:28.048 INFO:tasks.workunit.client.0.smithi081.stdout:4/42: write d1/d3/f8 [9100,9704] 0 2024-04-23T14:49:28.049 INFO:tasks.workunit.client.0.smithi081.stdout:5/49: getdents . 0 2024-04-23T14:49:28.053 INFO:tasks.workunit.client.0.smithi081.stdout:1/38: write d3/f6 [4214349,129288] 0 2024-04-23T14:49:28.056 INFO:tasks.workunit.client.0.smithi081.stdout:5/50: rename ff to f14 0 2024-04-23T14:49:28.056 INFO:tasks.workunit.client.0.smithi081.stdout:5/51: rmdir - no directory 2024-04-23T14:49:28.062 INFO:tasks.workunit.client.0.smithi081.stdout:3/58: read f3 [711113,42238] 0 2024-04-23T14:49:28.071 INFO:tasks.workunit.client.0.smithi081.stdout:2/47: sync 2024-04-23T14:49:28.072 INFO:tasks.workunit.client.0.smithi081.stdout:2/48: write d1/fc [753455,100418] 0 2024-04-23T14:49:28.074 INFO:tasks.workunit.client.0.smithi081.stdout:7/60: getdents d3/d4 0 2024-04-23T14:49:28.075 INFO:tasks.workunit.client.0.smithi081.stdout:9/42: dwrite d3/f8 [4194304,4194304] 0 2024-04-23T14:49:28.076 INFO:tasks.workunit.client.0.smithi081.stdout:9/43: write d3/d5/f6 [4467566,129607] 0 2024-04-23T14:49:28.088 INFO:tasks.workunit.client.0.smithi081.stdout:8/30: dwrite d3/f4 [0,4194304] 0 2024-04-23T14:49:28.088 INFO:tasks.workunit.client.0.smithi081.stdout:8/31: creat d3/f9 x:0 0 0 2024-04-23T14:49:28.090 INFO:tasks.workunit.client.0.smithi081.stdout:1/39: mknod d3/ce 0 2024-04-23T14:49:28.091 INFO:tasks.workunit.client.0.smithi081.stdout:0/52: sync 2024-04-23T14:49:28.096 INFO:tasks.workunit.client.0.smithi081.stdout:2/49: link d1/f6 d1/d11/f12 0 2024-04-23T14:49:28.096 INFO:tasks.workunit.client.0.smithi081.stdout:2/50: chown d1/d11 28 1 2024-04-23T14:49:28.097 INFO:tasks.workunit.client.0.smithi081.stdout:6/49: rename d1/d2/d6 to d1/d11 0 2024-04-23T14:49:28.097 INFO:tasks.workunit.client.0.smithi081.stdout:0/53: rename d6 to d6/db 22 2024-04-23T14:49:28.097 INFO:tasks.workunit.client.0.smithi081.stdout:0/54: readlink d6/la 0 2024-04-23T14:49:28.097 INFO:tasks.workunit.client.0.smithi081.stdout:6/50: rename d1/d11 to d1/d11/d8/d12 22 2024-04-23T14:49:28.098 INFO:tasks.workunit.client.0.smithi081.stdout:6/51: fdatasync d1/fe 0 2024-04-23T14:49:28.098 INFO:tasks.workunit.client.0.smithi081.stdout:0/55: write d6/f9 [756506,106656] 0 2024-04-23T14:49:28.100 INFO:tasks.workunit.client.0.smithi081.stdout:0/56: read d6/f9 [402611,32832] 0 2024-04-23T14:49:28.103 INFO:tasks.workunit.client.0.smithi081.stdout:8/32: mknod d3/ca 0 2024-04-23T14:49:28.105 INFO:tasks.workunit.client.0.smithi081.stdout:1/40: symlink d3/dc/lf 0 2024-04-23T14:49:28.109 INFO:tasks.workunit.client.0.smithi081.stdout:6/52: rename d1/d11/d4 to d1/d11/d13 0 2024-04-23T14:49:28.113 INFO:tasks.workunit.client.0.smithi081.stdout:8/33: symlink d3/lb 0 2024-04-23T14:49:28.116 INFO:tasks.workunit.client.0.smithi081.stdout:6/53: symlink d1/l14 0 2024-04-23T14:49:28.118 INFO:tasks.workunit.client.0.smithi081.stdout:3/59: getdents d4 0 2024-04-23T14:49:28.119 INFO:tasks.workunit.client.0.smithi081.stdout:0/57: getdents d6 0 2024-04-23T14:49:28.123 INFO:tasks.workunit.client.0.smithi081.stdout:8/34: mknod d3/cc 0 2024-04-23T14:49:28.123 INFO:tasks.workunit.client.0.smithi081.stdout:8/35: creat d3/fd x:0 0 0 2024-04-23T14:49:28.125 INFO:tasks.workunit.client.0.smithi081.stdout:1/41: mkdir d3/d10 0 2024-04-23T14:49:28.129 INFO:tasks.workunit.client.0.smithi081.stdout:6/54: mknod d1/d2/c15 0 2024-04-23T14:49:28.129 INFO:tasks.workunit.client.0.smithi081.stdout:6/55: readlink d1/l14 0 2024-04-23T14:49:28.136 INFO:tasks.workunit.client.0.smithi081.stdout:0/58: rename l2 to d6/lc 0 2024-04-23T14:49:28.139 INFO:tasks.workunit.client.0.smithi081.stdout:1/42: symlink d3/d10/l11 0 2024-04-23T14:49:28.141 INFO:tasks.workunit.client.0.smithi081.stdout:5/52: fsync f14 0 2024-04-23T14:49:28.143 INFO:tasks.workunit.client.0.smithi081.stdout:3/60: write d4/f6 [1937924,36065] 0 2024-04-23T14:49:28.144 INFO:tasks.workunit.client.0.smithi081.stdout:1/43: mkdir d3/dc/d12 0 2024-04-23T14:49:28.148 INFO:tasks.workunit.client.0.smithi081.stdout:5/53: chown f3 0 1 2024-04-23T14:49:28.152 INFO:tasks.workunit.client.0.smithi081.stdout:1/44: creat d3/d10/f13 x:0 0 0 2024-04-23T14:49:28.153 INFO:tasks.workunit.client.0.smithi081.stdout:5/54: chown lb 2047965754 1 2024-04-23T14:49:28.160 INFO:tasks.workunit.client.0.smithi081.stdout:1/45: dread d3/f9 [0,4194304] 0 2024-04-23T14:49:28.162 INFO:tasks.workunit.client.0.smithi081.stdout:5/55: link l5 l15 0 2024-04-23T14:49:28.171 INFO:tasks.workunit.client.0.smithi081.stdout:1/46: dread d3/f9 [0,4194304] 0 2024-04-23T14:49:28.195 INFO:tasks.workunit.client.0.smithi081.stdout:1/47: write f1 [3323608,122304] 0 2024-04-23T14:49:28.196 INFO:tasks.workunit.client.0.smithi081.stdout:1/48: rename d3/dc/d12 to d3/dc/d12/d14 22 2024-04-23T14:49:28.202 INFO:tasks.workunit.client.0.smithi081.stdout:2/51: dwrite d1/f6 [0,4194304] 0 2024-04-23T14:49:28.212 INFO:tasks.workunit.client.0.smithi081.stdout:2/52: link d1/fc d1/d11/f13 0 2024-04-23T14:49:28.216 INFO:tasks.workunit.client.0.smithi081.stdout:1/49: rename d3/dc to d3/d15 0 2024-04-23T14:49:28.217 INFO:tasks.workunit.client.0.smithi081.stdout:2/53: chown d1/c10 290 1 2024-04-23T14:49:28.219 INFO:tasks.workunit.client.0.smithi081.stdout:1/50: mknod d3/d15/c16 0 2024-04-23T14:49:28.220 INFO:tasks.workunit.client.0.smithi081.stdout:2/54: chown d1/fe 224417572 1 2024-04-23T14:49:28.222 INFO:tasks.workunit.client.0.smithi081.stdout:1/51: mkdir d3/d15/d17 0 2024-04-23T14:49:28.225 INFO:tasks.workunit.client.0.smithi081.stdout:8/36: dread d3/f4 [0,4194304] 0 2024-04-23T14:49:28.225 INFO:tasks.workunit.client.0.smithi081.stdout:8/37: chown d3/fd 74 1 2024-04-23T14:49:28.226 INFO:tasks.workunit.client.0.smithi081.stdout:8/38: read - d3/fd zero size 2024-04-23T14:49:28.226 INFO:tasks.workunit.client.0.smithi081.stdout:1/52: rename d3/d10/l11 to d3/d10/l18 0 2024-04-23T14:49:28.228 INFO:tasks.workunit.client.0.smithi081.stdout:1/53: symlink d3/d15/d17/l19 0 2024-04-23T14:49:28.228 INFO:tasks.workunit.client.0.smithi081.stdout:1/54: write f0 [7530286,120574] 0 2024-04-23T14:49:28.231 INFO:tasks.workunit.client.0.smithi081.stdout:6/56: dwrite d1/fe [0,4194304] 0 2024-04-23T14:49:28.244 INFO:tasks.workunit.client.0.smithi081.stdout:9/44: dwrite f1 [4194304,4194304] 0 2024-04-23T14:49:28.246 INFO:tasks.workunit.client.0.smithi081.stdout:9/45: mkdir d3/de/d14 0 2024-04-23T14:49:28.246 INFO:tasks.workunit.client.0.smithi081.stdout:9/46: truncate d3/de/f10 301938 0 2024-04-23T14:49:28.246 INFO:tasks.workunit.client.0.smithi081.stdout:9/47: write d3/de/f10 [1012159,46968] 0 2024-04-23T14:49:28.248 INFO:tasks.workunit.client.0.smithi081.stdout:8/39: dread d3/f4 [0,4194304] 0 2024-04-23T14:49:28.248 INFO:tasks.workunit.client.0.smithi081.stdout:3/61: dwrite f3 [0,4194304] 0 2024-04-23T14:49:28.248 INFO:tasks.workunit.client.0.smithi081.stdout:3/62: dread - d4/f12 zero size 2024-04-23T14:49:28.248 INFO:tasks.workunit.client.0.smithi081.stdout:2/55: fsync d1/fc 0 2024-04-23T14:49:28.250 INFO:tasks.workunit.client.0.smithi081.stdout:9/48: link d3/lb d3/de/l15 0 2024-04-23T14:49:28.250 INFO:tasks.workunit.client.0.smithi081.stdout:9/49: chown d3 0 1 2024-04-23T14:49:28.252 INFO:tasks.workunit.client.0.smithi081.stdout:8/40: symlink d3/le 0 2024-04-23T14:49:28.255 INFO:tasks.workunit.client.0.smithi081.stdout:3/63: truncate d4/f6 2368493 0 2024-04-23T14:49:28.263 INFO:tasks.workunit.client.0.smithi081.stdout:3/64: rename d4/ce to d4/dc/d10/c14 0 2024-04-23T14:49:28.267 INFO:tasks.workunit.client.0.smithi081.stdout:5/56: dwrite fd [0,4194304] 0 2024-04-23T14:49:28.267 INFO:tasks.workunit.client.0.smithi081.stdout:9/50: dread d3/f9 [0,4194304] 0 2024-04-23T14:49:28.267 INFO:tasks.workunit.client.0.smithi081.stdout:9/51: creat d3/d5/f16 x:0 0 0 2024-04-23T14:49:28.278 INFO:tasks.workunit.client.0.smithi081.stdout:1/55: dwrite d3/f5 [0,4194304] 0 2024-04-23T14:49:28.279 INFO:tasks.workunit.client.0.smithi081.stdout:2/56: read d1/f4 [4544592,72842] 0 2024-04-23T14:49:28.284 INFO:tasks.workunit.client.0.smithi081.stdout:8/41: getdents d3 0 2024-04-23T14:49:28.286 INFO:tasks.workunit.client.0.smithi081.stdout:2/57: getdents d1 0 2024-04-23T14:49:28.286 INFO:tasks.workunit.client.0.smithi081.stdout:2/58: write d1/f5 [4838,2897] 0 2024-04-23T14:49:28.289 INFO:tasks.workunit.client.0.smithi081.stdout:8/42: creat d3/ff x:0 0 0 2024-04-23T14:49:28.292 INFO:tasks.workunit.client.0.smithi081.stdout:5/57: dread fd [0,4194304] 0 2024-04-23T14:49:28.293 INFO:tasks.workunit.client.0.smithi081.stdout:6/57: dwrite d1/fe [0,4194304] 0 2024-04-23T14:49:28.294 INFO:tasks.workunit.client.0.smithi081.stdout:2/59: truncate d1/d11/f12 3761551 0 2024-04-23T14:49:28.294 INFO:tasks.workunit.client.0.smithi081.stdout:2/60: chown d1/fd 2115199 1 2024-04-23T14:49:28.295 INFO:tasks.workunit.client.0.smithi081.stdout:2/61: read d1/f5 [6798,42053] 0 2024-04-23T14:49:28.296 INFO:tasks.workunit.client.0.smithi081.stdout:8/43: unlink d3/le 0 2024-04-23T14:49:28.296 INFO:tasks.workunit.client.0.smithi081.stdout:8/44: write d3/ff [16542,107860] 0 2024-04-23T14:49:28.298 INFO:tasks.workunit.client.0.smithi081.stdout:1/56: dread d3/f5 [0,4194304] 0 2024-04-23T14:49:28.302 INFO:tasks.workunit.client.0.smithi081.stdout:6/58: mkdir d1/d11/d13/d16 0 2024-04-23T14:49:28.305 INFO:tasks.workunit.client.0.smithi081.stdout:2/62: truncate d1/fa 165284 0 2024-04-23T14:49:28.307 INFO:tasks.workunit.client.0.smithi081.stdout:1/57: mkdir d3/d15/d12/d1a 0 2024-04-23T14:49:28.310 INFO:tasks.workunit.client.0.smithi081.stdout:1/58: readlink d3/l8 0 2024-04-23T14:49:28.313 INFO:tasks.workunit.client.0.smithi081.stdout:1/59: truncate d3/f7 165745 0 2024-04-23T14:49:28.313 INFO:tasks.workunit.client.0.smithi081.stdout:1/60: readlink d3/d10/l18 0 2024-04-23T14:49:28.320 INFO:tasks.workunit.client.0.smithi081.stdout:8/45: rmdir d3 39 2024-04-23T14:49:28.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:28 smithi081 ceph-mon[25540]: pgmap v23: 65 pgs: 65 active+clean; 256 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 4.6 MiB/s rd, 8.3 MiB/s wr, 474 op/s 2024-04-23T14:49:28.327 INFO:tasks.workunit.client.0.smithi081.stdout:1/61: mkdir d3/d1b 0 2024-04-23T14:49:28.327 INFO:tasks.workunit.client.0.smithi081.stdout:1/62: chown d3/d15/d17/l19 10834 1 2024-04-23T14:49:28.328 INFO:tasks.workunit.client.0.smithi081.stdout:1/63: write d3/d10/f13 [1008218,41743] 0 2024-04-23T14:49:28.328 INFO:tasks.workunit.client.0.smithi081.stdout:1/64: write f0 [3130331,130255] 0 2024-04-23T14:49:28.328 INFO:tasks.workunit.client.0.smithi081.stdout:1/65: chown f1 536797 1 2024-04-23T14:49:28.329 INFO:tasks.workunit.client.0.smithi081.stdout:2/63: fsync d1/fa 0 2024-04-23T14:49:28.329 INFO:tasks.workunit.client.0.smithi081.stdout:2/64: chown d1/fa 0 1 2024-04-23T14:49:28.330 INFO:tasks.workunit.client.0.smithi081.stdout:8/46: getdents d3 0 2024-04-23T14:49:28.339 INFO:tasks.workunit.client.0.smithi081.stdout:8/47: rmdir d3 39 2024-04-23T14:49:28.339 INFO:tasks.workunit.client.0.smithi081.stdout:8/48: chown d3/f4 0 1 2024-04-23T14:49:28.339 INFO:tasks.workunit.client.0.smithi081.stdout:1/66: rename d3/f4 to d3/d15/d12/f1c 0 2024-04-23T14:49:28.339 INFO:tasks.workunit.client.0.smithi081.stdout:1/67: chown d3/ld 837946 1 2024-04-23T14:49:28.343 INFO:tasks.workunit.client.0.smithi081.stdout:3/65: truncate d4/f6 354449 0 2024-04-23T14:49:28.343 INFO:tasks.workunit.client.0.smithi081.stdout:3/66: dread - d4/f12 zero size 2024-04-23T14:49:28.343 INFO:tasks.workunit.client.0.smithi081.stdout:3/67: readlink d4/d7/l13 0 2024-04-23T14:49:28.343 INFO:tasks.workunit.client.0.smithi081.stdout:9/52: dwrite d3/de/f10 [0,4194304] 0 2024-04-23T14:49:28.396 INFO:tasks.workunit.client.0.smithi081.stdout:6/59: dwrite d1/fe [4194304,4194304] 0 2024-04-23T14:49:28.402 INFO:tasks.workunit.client.0.smithi081.stdout:5/58: dwrite f3 [0,4194304] 0 2024-04-23T14:49:28.402 INFO:tasks.workunit.client.0.smithi081.stdout:5/59: dread - f14 zero size 2024-04-23T14:49:28.403 INFO:tasks.workunit.client.0.smithi081.stdout:6/60: rmdir d1/d11/d8/df 0 2024-04-23T14:49:28.405 INFO:tasks.workunit.client.0.smithi081.stdout:5/60: getdents . 0 2024-04-23T14:49:28.407 INFO:tasks.workunit.client.0.smithi081.stdout:2/65: dwrite d1/f8 [0,4194304] 0 2024-04-23T14:49:28.411 INFO:tasks.workunit.client.0.smithi081.stdout:8/49: dwrite d3/f5 [4194304,4194304] 0 2024-04-23T14:49:28.419 INFO:tasks.workunit.client.0.smithi081.stdout:3/68: truncate d4/f6 662025 0 2024-04-23T14:49:28.422 INFO:tasks.workunit.client.0.smithi081.stdout:8/50: unlink d3/f9 0 2024-04-23T14:49:28.424 INFO:tasks.workunit.client.0.smithi081.stdout:9/53: dwrite d3/d5/da/fc [0,4194304] 0 2024-04-23T14:49:28.433 INFO:tasks.workunit.client.0.smithi081.stdout:5/61: dread f1 [0,4194304] 0 2024-04-23T14:49:28.433 INFO:tasks.workunit.client.0.smithi081.stdout:5/62: write f9 [206008,91660] 0 2024-04-23T14:49:28.433 INFO:tasks.workunit.client.0.smithi081.stdout:5/63: chown lb 0 1 2024-04-23T14:49:28.433 INFO:tasks.workunit.client.0.smithi081.stdout:5/64: chown f1 193214670 1 2024-04-23T14:49:28.433 INFO:tasks.workunit.client.0.smithi081.stdout:5/65: readlink la 0 2024-04-23T14:49:28.438 INFO:tasks.workunit.client.0.smithi081.stdout:9/54: creat d3/d5/da/f17 x:0 0 0 2024-04-23T14:49:28.455 INFO:tasks.workunit.client.0.smithi081.stdout:6/61: write d1/fe [2684147,25141] 0 2024-04-23T14:49:28.456 INFO:tasks.workunit.client.0.smithi081.stdout:6/62: write d1/fe [1828250,19578] 0 2024-04-23T14:49:28.456 INFO:tasks.workunit.client.0.smithi081.stdout:6/63: readlink d1/l9 0 2024-04-23T14:49:28.456 INFO:tasks.workunit.client.0.smithi081.stdout:6/64: creat d1/f17 x:0 0 0 2024-04-23T14:49:28.456 INFO:tasks.workunit.client.0.smithi081.stdout:6/65: truncate d1/fe 9120892 0 2024-04-23T14:49:28.457 INFO:tasks.workunit.client.0.smithi081.stdout:1/68: dwrite d3/f6 [0,4194304] 0 2024-04-23T14:49:28.457 INFO:tasks.workunit.client.0.smithi081.stdout:1/69: chown d3/d15/lf 2 1 2024-04-23T14:49:28.457 INFO:tasks.workunit.client.0.smithi081.stdout:1/70: chown f0 3542291 1 2024-04-23T14:49:28.457 INFO:tasks.workunit.client.0.smithi081.stdout:1/71: chown d3/d10 30325 1 2024-04-23T14:49:28.457 INFO:tasks.workunit.client.0.smithi081.stdout:1/72: chown d3/l8 31867550 1 2024-04-23T14:49:28.458 INFO:tasks.workunit.client.0.smithi081.stdout:1/73: write d3/f9 [513518,49454] 0 2024-04-23T14:49:28.460 INFO:tasks.workunit.client.0.smithi081.stdout:9/55: mknod d3/de/c18 0 2024-04-23T14:49:28.461 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:28 smithi156 ceph-mon[32341]: pgmap v23: 65 pgs: 65 active+clean; 256 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 4.6 MiB/s rd, 8.3 MiB/s wr, 474 op/s 2024-04-23T14:49:28.465 INFO:tasks.workunit.client.0.smithi081.stdout:9/56: creat d3/de/f19 x:0 0 0 2024-04-23T14:49:28.481 INFO:tasks.workunit.client.0.smithi081.stdout:8/51: dwrite d3/ff [0,4194304] 0 2024-04-23T14:49:28.487 INFO:tasks.workunit.client.0.smithi081.stdout:1/74: dread d3/f6 [0,4194304] 0 2024-04-23T14:49:28.487 INFO:tasks.workunit.client.0.smithi081.stdout:1/75: read d3/f9 [366133,6871] 0 2024-04-23T14:49:28.487 INFO:tasks.workunit.client.0.smithi081.stdout:1/76: write d3/f7 [943428,62525] 0 2024-04-23T14:49:28.487 INFO:tasks.workunit.client.0.smithi081.stdout:1/77: stat d3/d15/d12/d1a 0 2024-04-23T14:49:28.488 INFO:tasks.workunit.client.0.smithi081.stdout:5/66: dread f1 [0,4194304] 0 2024-04-23T14:49:28.490 INFO:tasks.workunit.client.0.smithi081.stdout:1/78: mkdir d3/d15/d1d 0 2024-04-23T14:49:28.492 INFO:tasks.workunit.client.0.smithi081.stdout:8/52: getdents d3 0 2024-04-23T14:49:28.493 INFO:tasks.workunit.client.0.smithi081.stdout:2/66: dwrite d1/d11/f12 [0,4194304] 0 2024-04-23T14:49:28.494 INFO:tasks.workunit.client.0.smithi081.stdout:1/79: mkdir d3/d10/d1e 0 2024-04-23T14:49:28.497 INFO:tasks.workunit.client.0.smithi081.stdout:8/53: unlink d3/fd 0 2024-04-23T14:49:28.500 INFO:tasks.workunit.client.0.smithi081.stdout:5/67: mknod c16 0 2024-04-23T14:49:28.502 INFO:tasks.workunit.client.0.smithi081.stdout:2/67: symlink d1/d11/l14 0 2024-04-23T14:49:28.508 INFO:tasks.workunit.client.0.smithi081.stdout:2/68: mknod d1/d11/c15 0 2024-04-23T14:49:28.509 INFO:tasks.workunit.client.0.smithi081.stdout:5/68: mkdir d17 0 2024-04-23T14:49:28.511 INFO:tasks.workunit.client.0.smithi081.stdout:1/80: dread d3/f6 [0,4194304] 0 2024-04-23T14:49:28.511 INFO:tasks.workunit.client.0.smithi081.stdout:1/81: fsync d3/d10/f13 0 2024-04-23T14:49:28.516 INFO:tasks.workunit.client.0.smithi081.stdout:9/57: rename d3/d5/da to d3/d1a 0 2024-04-23T14:49:28.516 INFO:tasks.workunit.client.0.smithi081.stdout:2/69: mknod d1/d11/c16 0 2024-04-23T14:49:28.520 INFO:tasks.workunit.client.0.smithi081.stdout:2/70: symlink d1/l17 0 2024-04-23T14:49:28.522 INFO:tasks.workunit.client.0.smithi081.stdout:8/54: dread d3/f4 [0,4194304] 0 2024-04-23T14:49:28.522 INFO:tasks.workunit.client.0.smithi081.stdout:8/55: write f1 [4369567,54060] 0 2024-04-23T14:49:28.523 INFO:tasks.workunit.client.0.smithi081.stdout:3/69: truncate f3 1647375 0 2024-04-23T14:49:28.523 INFO:tasks.workunit.client.0.smithi081.stdout:3/70: write d4/f12 [51746,57268] 0 2024-04-23T14:49:28.525 INFO:tasks.workunit.client.0.smithi081.stdout:2/71: unlink d1/l17 0 2024-04-23T14:49:28.525 INFO:tasks.workunit.client.0.smithi081.stdout:2/72: truncate d1/fb 1389276 0 2024-04-23T14:49:28.529 INFO:tasks.workunit.client.0.smithi081.stdout:3/71: creat d4/dc/d10/f15 x:0 0 0 2024-04-23T14:49:28.530 INFO:tasks.workunit.client.0.smithi081.stdout:2/73: mknod d1/d11/c18 0 2024-04-23T14:49:28.532 INFO:tasks.workunit.client.0.smithi081.stdout:3/72: unlink d4/dc/d10/c14 0 2024-04-23T14:49:28.533 INFO:tasks.workunit.client.0.smithi081.stdout:2/74: symlink d1/l19 0 2024-04-23T14:49:28.535 INFO:tasks.workunit.client.0.smithi081.stdout:3/73: symlink d4/d7/l16 0 2024-04-23T14:49:28.538 INFO:tasks.workunit.client.0.smithi081.stdout:2/75: symlink d1/d11/l1a 0 2024-04-23T14:49:28.541 INFO:tasks.workunit.client.0.smithi081.stdout:3/74: creat d4/f17 x:0 0 0 2024-04-23T14:49:28.542 INFO:tasks.workunit.client.0.smithi081.stdout:3/75: creat d4/dc/d10/f18 x:0 0 0 2024-04-23T14:49:28.543 INFO:tasks.workunit.client.0.smithi081.stdout:3/76: truncate d4/dc/d10/f15 312233 0 2024-04-23T14:49:28.544 INFO:tasks.workunit.client.0.smithi081.stdout:2/76: symlink d1/l1b 0 2024-04-23T14:49:28.554 INFO:tasks.workunit.client.0.smithi081.stdout:3/77: link d4/f6 d4/d7/df/f19 0 2024-04-23T14:49:28.571 INFO:tasks.workunit.client.0.smithi081.stdout:8/56: getdents d3 0 2024-04-23T14:49:28.576 INFO:tasks.workunit.client.0.smithi081.stdout:8/57: creat d3/f10 x:0 0 0 2024-04-23T14:49:28.587 INFO:tasks.workunit.client.0.smithi081.stdout:5/69: dwrite f11 [0,4194304] 0 2024-04-23T14:49:28.589 INFO:tasks.workunit.client.0.smithi081.stdout:2/77: dwrite d1/d11/f12 [0,4194304] 0 2024-04-23T14:49:28.600 INFO:tasks.workunit.client.0.smithi081.stdout:2/78: creat d1/f1c x:0 0 0 2024-04-23T14:49:28.614 INFO:tasks.workunit.client.0.smithi081.stdout:5/70: dread f4 [0,4194304] 0 2024-04-23T14:49:28.614 INFO:tasks.workunit.client.0.smithi081.stdout:9/58: dwrite d3/de/f10 [0,4194304] 0 2024-04-23T14:49:28.615 INFO:tasks.workunit.client.0.smithi081.stdout:1/82: dwrite d3/f9 [0,4194304] 0 2024-04-23T14:49:28.621 INFO:tasks.workunit.client.0.smithi081.stdout:5/71: mkdir d17/d18 0 2024-04-23T14:49:28.621 INFO:tasks.workunit.client.0.smithi081.stdout:5/72: truncate f14 253075 0 2024-04-23T14:49:28.621 INFO:tasks.workunit.client.0.smithi081.stdout:5/73: write f14 [488149,66094] 0 2024-04-23T14:49:28.623 INFO:tasks.workunit.client.0.smithi081.stdout:3/78: dwrite d4/f12 [0,4194304] 0 2024-04-23T14:49:28.623 INFO:tasks.workunit.client.0.smithi081.stdout:3/79: stat d4/d7/df 0 2024-04-23T14:49:28.624 INFO:tasks.workunit.client.0.smithi081.stdout:9/59: mknod d3/de/c1b 0 2024-04-23T14:49:28.628 INFO:tasks.workunit.client.0.smithi081.stdout:1/83: creat d3/d15/f1f x:0 0 0 2024-04-23T14:49:28.628 INFO:tasks.workunit.client.0.smithi081.stdout:1/84: chown d3/d15/d17/l19 338 1 2024-04-23T14:49:28.632 INFO:tasks.workunit.client.0.smithi081.stdout:5/74: rename f3 to d17/d18/f19 0 2024-04-23T14:49:28.644 INFO:tasks.workunit.client.0.smithi081.stdout:3/80: rmdir d4/dc/d10 39 2024-04-23T14:49:28.647 INFO:tasks.workunit.client.0.smithi081.stdout:3/81: truncate d4/f6 546841 0 2024-04-23T14:49:28.647 INFO:tasks.workunit.client.0.smithi081.stdout:9/60: dread d3/de/f10 [0,4194304] 0 2024-04-23T14:49:28.649 INFO:tasks.workunit.client.0.smithi081.stdout:9/61: creat d3/de/f1c x:0 0 0 2024-04-23T14:49:28.655 INFO:tasks.workunit.client.0.smithi081.stdout:8/58: dwrite d3/f4 [0,4194304] 0 2024-04-23T14:49:28.655 INFO:tasks.workunit.client.0.smithi081.stdout:2/79: dwrite d1/fe [0,4194304] 0 2024-04-23T14:49:28.669 INFO:tasks.workunit.client.0.smithi081.stdout:5/75: dread f1 [0,4194304] 0 2024-04-23T14:49:28.673 INFO:tasks.workunit.client.0.smithi081.stdout:2/80: write d1/f4 [2697231,13892] 0 2024-04-23T14:49:28.674 INFO:tasks.workunit.client.0.smithi081.stdout:1/85: dwrite d3/f6 [4194304,4194304] 0 2024-04-23T14:49:28.688 INFO:tasks.workunit.client.0.smithi081.stdout:2/81: write d1/f8 [3592336,39049] 0 2024-04-23T14:49:28.689 INFO:tasks.workunit.client.0.smithi081.stdout:3/82: dwrite d4/dc/d10/f18 [0,4194304] 0 2024-04-23T14:49:28.715 INFO:tasks.workunit.client.0.smithi081.stdout:8/59: unlink d3/lb 0 2024-04-23T14:49:28.724 INFO:tasks.workunit.client.0.smithi081.stdout:1/86: rmdir d3/d10/d1e 0 2024-04-23T14:49:28.731 INFO:tasks.workunit.client.0.smithi081.stdout:2/82: symlink d1/l1d 0 2024-04-23T14:49:28.739 INFO:tasks.workunit.client.0.smithi081.stdout:5/76: link c13 d17/c1a 0 2024-04-23T14:49:28.739 INFO:tasks.workunit.client.0.smithi081.stdout:5/77: chown c13 1373544594 1 2024-04-23T14:49:28.743 INFO:tasks.workunit.client.0.smithi081.stdout:2/83: mkdir d1/d1e 0 2024-04-23T14:49:28.747 INFO:tasks.workunit.client.0.smithi081.stdout:2/84: rename d1/d11/c15 to d1/d11/c1f 0 2024-04-23T14:49:28.751 INFO:tasks.workunit.client.0.smithi081.stdout:1/87: dread f1 [4194304,4194304] 0 2024-04-23T14:49:28.752 INFO:tasks.workunit.client.0.smithi081.stdout:2/85: creat d1/d11/f20 x:0 0 0 2024-04-23T14:49:28.756 INFO:tasks.workunit.client.0.smithi081.stdout:1/88: creat d3/d15/d17/f20 x:0 0 0 2024-04-23T14:49:28.756 INFO:tasks.workunit.client.0.smithi081.stdout:1/89: fsync d3/f5 0 2024-04-23T14:49:28.758 INFO:tasks.workunit.client.0.smithi081.stdout:2/86: mkdir d1/d11/d21 0 2024-04-23T14:49:28.758 INFO:tasks.workunit.client.0.smithi081.stdout:5/78: dread f4 [0,4194304] 0 2024-04-23T14:49:28.759 INFO:tasks.workunit.client.0.smithi081.stdout:1/90: mknod d3/d1b/c21 0 2024-04-23T14:49:28.762 INFO:tasks.workunit.client.0.smithi081.stdout:2/87: mkdir d1/d11/d21/d22 0 2024-04-23T14:49:28.763 INFO:tasks.workunit.client.0.smithi081.stdout:5/79: rmdir d17/d18 39 2024-04-23T14:49:28.765 INFO:tasks.workunit.client.0.smithi081.stdout:1/91: rename d3/d15/lf to d3/d10/l22 0 2024-04-23T14:49:28.768 INFO:tasks.workunit.client.0.smithi081.stdout:2/88: mknod d1/d11/c23 0 2024-04-23T14:49:28.768 INFO:tasks.workunit.client.0.smithi081.stdout:2/89: write d1/f1c [473948,18085] 0 2024-04-23T14:49:28.772 INFO:tasks.workunit.client.0.smithi081.stdout:5/80: rename f11 to d17/f1b 0 2024-04-23T14:49:28.775 INFO:tasks.workunit.client.0.smithi081.stdout:1/92: creat d3/d15/d12/d1a/f23 x:0 0 0 2024-04-23T14:49:28.776 INFO:tasks.workunit.client.0.smithi081.stdout:2/90: mknod d1/c24 0 2024-04-23T14:49:28.778 INFO:tasks.workunit.client.0.smithi081.stdout:5/81: symlink d17/l1c 0 2024-04-23T14:49:28.784 INFO:tasks.workunit.client.0.smithi081.stdout:5/82: creat d17/f1d x:0 0 0 2024-04-23T14:49:28.784 INFO:tasks.workunit.client.0.smithi081.stdout:5/83: read f1 [1747862,23041] 0 2024-04-23T14:49:28.784 INFO:tasks.workunit.client.0.smithi081.stdout:5/84: creat d17/f1e x:0 0 0 2024-04-23T14:49:28.784 INFO:tasks.workunit.client.0.smithi081.stdout:5/85: dread - d17/f1d zero size 2024-04-23T14:49:28.788 INFO:tasks.workunit.client.0.smithi081.stdout:2/91: dread d1/fa [0,4194304] 0 2024-04-23T14:49:28.788 INFO:tasks.workunit.client.0.smithi081.stdout:2/92: readlink d1/d11/l14 0 2024-04-23T14:49:28.788 INFO:tasks.workunit.client.0.smithi081.stdout:2/93: read d1/f8 [517781,32270] 0 2024-04-23T14:49:28.788 INFO:tasks.workunit.client.0.smithi081.stdout:2/94: creat d1/d11/f25 x:0 0 0 2024-04-23T14:49:28.788 INFO:tasks.workunit.client.0.smithi081.stdout:2/95: readlink d1/l1d 0 2024-04-23T14:49:28.788 INFO:tasks.workunit.client.0.smithi081.stdout:2/96: getdents d1/d11/d21/d22 0 2024-04-23T14:49:28.789 INFO:tasks.workunit.client.0.smithi081.stdout:2/97: write d1/f5 [748865,72815] 0 2024-04-23T14:49:28.789 INFO:tasks.workunit.client.0.smithi081.stdout:2/98: creat d1/d11/f26 x:0 0 0 2024-04-23T14:49:28.793 INFO:tasks.workunit.client.0.smithi081.stdout:5/86: mkdir d17/d1f 0 2024-04-23T14:49:28.797 INFO:tasks.workunit.client.0.smithi081.stdout:1/93: write d3/f6 [3336154,12989] 0 2024-04-23T14:49:28.800 INFO:tasks.workunit.client.0.smithi081.stdout:2/99: link d1/d11/c23 d1/d1e/c27 0 2024-04-23T14:49:28.807 INFO:tasks.workunit.client.0.smithi081.stdout:5/87: dread fd [0,4194304] 0 2024-04-23T14:49:28.810 INFO:tasks.workunit.client.0.smithi081.stdout:8/60: dwrite f1 [4194304,4194304] 0 2024-04-23T14:49:28.812 INFO:tasks.workunit.client.0.smithi081.stdout:2/100: dread d1/fc [0,4194304] 0 2024-04-23T14:49:28.813 INFO:tasks.workunit.client.0.smithi081.stdout:2/101: write d1/d11/f26 [247257,127620] 0 2024-04-23T14:49:28.813 INFO:tasks.workunit.client.0.smithi081.stdout:2/102: creat d1/d11/f28 x:0 0 0 2024-04-23T14:49:28.813 INFO:tasks.workunit.client.0.smithi081.stdout:2/103: read - d1/d11/f28 zero size 2024-04-23T14:49:28.816 INFO:tasks.workunit.client.0.smithi081.stdout:3/83: dwrite d4/f6 [0,4194304] 0 2024-04-23T14:49:28.829 INFO:tasks.workunit.client.0.smithi081.stdout:8/61: dread d3/ff [0,4194304] 0 2024-04-23T14:49:28.829 INFO:tasks.workunit.client.0.smithi081.stdout:8/62: write d3/f10 [317293,2681] 0 2024-04-23T14:49:28.830 INFO:tasks.workunit.client.0.smithi081.stdout:5/88: write d17/f1b [3454089,430] 0 2024-04-23T14:49:28.834 INFO:tasks.workunit.client.0.smithi081.stdout:1/94: mknod d3/d15/d17/c24 0 2024-04-23T14:49:28.843 INFO:tasks.workunit.client.0.smithi081.stdout:2/104: stat d1/d11/c1f 0 2024-04-23T14:49:28.843 INFO:tasks.workunit.client.0.smithi081.stdout:2/105: creat d1/d11/f29 x:0 0 0 2024-04-23T14:49:28.858 INFO:tasks.workunit.client.0.smithi081.stdout:3/84: mkdir d4/d7/d1a 0 2024-04-23T14:49:28.859 INFO:tasks.workunit.client.0.smithi081.stdout:3/85: truncate d4/d7/df/f19 4768679 0 2024-04-23T14:49:28.860 INFO:tasks.workunit.client.0.smithi081.stdout:8/63: mkdir d3/d11 0 2024-04-23T14:49:28.871 INFO:tasks.workunit.client.0.smithi081.stdout:5/89: dread d17/d18/f19 [0,4194304] 0 2024-04-23T14:49:28.871 INFO:tasks.workunit.client.0.smithi081.stdout:2/106: creat d1/d11/d21/f2a x:0 0 0 2024-04-23T14:49:28.871 INFO:tasks.workunit.client.0.smithi081.stdout:2/107: stat d1/d11/f13 0 2024-04-23T14:49:28.871 INFO:tasks.workunit.client.0.smithi081.stdout:2/108: write d1/f8 [608409,16922] 0 2024-04-23T14:49:28.871 INFO:tasks.workunit.client.0.smithi081.stdout:2/109: chown d1/d11/d21 552112 1 2024-04-23T14:49:28.871 INFO:tasks.workunit.client.0.smithi081.stdout:2/110: creat d1/f2b x:0 0 0 2024-04-23T14:49:28.875 INFO:tasks.workunit.client.0.smithi081.stdout:3/86: creat d4/d7/df/f1b x:0 0 0 2024-04-23T14:49:28.875 INFO:tasks.workunit.client.0.smithi081.stdout:3/87: chown d4/dc/ld 64659703 1 2024-04-23T14:49:28.880 INFO:tasks.workunit.client.0.smithi081.stdout:8/64: write f1 [4332552,78145] 0 2024-04-23T14:49:28.881 INFO:tasks.workunit.client.0.smithi081.stdout:2/111: symlink d1/l2c 0 2024-04-23T14:49:28.883 INFO:tasks.workunit.client.0.smithi081.stdout:1/95: dwrite d3/f6 [0,4194304] 0 2024-04-23T14:49:28.885 INFO:tasks.workunit.client.0.smithi081.stdout:3/88: mknod d4/d7/df/c1c 0 2024-04-23T14:49:28.885 INFO:tasks.workunit.client.0.smithi081.stdout:3/89: dread - d4/f17 zero size 2024-04-23T14:49:28.885 INFO:tasks.workunit.client.0.smithi081.stdout:3/90: write d4/f17 [517916,80806] 0 2024-04-23T14:49:28.887 INFO:tasks.workunit.client.0.smithi081.stdout:8/65: link d3/ca d3/d11/c12 0 2024-04-23T14:49:28.893 INFO:tasks.workunit.client.0.smithi081.stdout:2/112: symlink d1/d11/d21/d22/l2d 0 2024-04-23T14:49:28.900 INFO:tasks.workunit.client.0.smithi081.stdout:8/66: rename d3/ca to d3/c13 0 2024-04-23T14:49:28.914 INFO:tasks.workunit.client.0.smithi081.stdout:4/43: sync 2024-04-23T14:49:28.915 INFO:tasks.workunit.client.0.smithi081.stdout:9/62: sync 2024-04-23T14:49:28.915 INFO:tasks.workunit.client.0.smithi081.stdout:4/44: chown d1/d4/f7 14 1 2024-04-23T14:49:28.916 INFO:tasks.workunit.client.0.smithi081.stdout:0/59: sync 2024-04-23T14:49:28.916 INFO:tasks.workunit.client.0.smithi081.stdout:0/60: fdatasync f5 0 2024-04-23T14:49:28.916 INFO:tasks.workunit.client.0.smithi081.stdout:4/45: write d1/ff [893421,72181] 0 2024-04-23T14:49:28.916 INFO:tasks.workunit.client.0.smithi081.stdout:7/61: sync 2024-04-23T14:49:28.916 INFO:tasks.workunit.client.0.smithi081.stdout:6/66: sync 2024-04-23T14:49:28.916 INFO:tasks.workunit.client.0.smithi081.stdout:7/62: fsync f2 0 2024-04-23T14:49:28.916 INFO:tasks.workunit.client.0.smithi081.stdout:6/67: creat d1/f18 x:0 0 0 2024-04-23T14:49:28.917 INFO:tasks.workunit.client.0.smithi081.stdout:6/68: write d1/f18 [262846,21278] 0 2024-04-23T14:49:28.917 INFO:tasks.workunit.client.0.smithi081.stdout:3/91: read d4/f6 [1748421,52614] 0 2024-04-23T14:49:28.920 INFO:tasks.workunit.client.0.smithi081.stdout:0/61: creat d6/fd x:0 0 0 2024-04-23T14:49:28.920 INFO:tasks.workunit.client.0.smithi081.stdout:0/62: creat d6/fe x:0 0 0 2024-04-23T14:49:28.920 INFO:tasks.workunit.client.0.smithi081.stdout:4/46: write d1/ff [10071,47982] 0 2024-04-23T14:49:28.920 INFO:tasks.workunit.client.0.smithi081.stdout:4/47: getdents d1/d4 0 2024-04-23T14:49:28.925 INFO:tasks.workunit.client.0.smithi081.stdout:7/63: creat d3/f10 x:0 0 0 2024-04-23T14:49:28.925 INFO:tasks.workunit.client.0.smithi081.stdout:7/64: chown d3/d4/f9 14354 1 2024-04-23T14:49:28.927 INFO:tasks.workunit.client.0.smithi081.stdout:4/48: symlink d1/d4/l13 0 2024-04-23T14:49:28.927 INFO:tasks.workunit.client.0.smithi081.stdout:4/49: write d1/d3/f8 [88765,10770] 0 2024-04-23T14:49:28.927 INFO:tasks.workunit.client.0.smithi081.stdout:4/50: chown d1/d4/l13 2146909296 1 2024-04-23T14:49:28.927 INFO:tasks.workunit.client.0.smithi081.stdout:4/51: write d1/ff [797012,52847] 0 2024-04-23T14:49:28.927 INFO:tasks.workunit.client.0.smithi081.stdout:4/52: chown d1/fa 3475 1 2024-04-23T14:49:28.933 INFO:tasks.workunit.client.0.smithi081.stdout:7/65: truncate d3/d4/f9 2990634 0 2024-04-23T14:49:28.933 INFO:tasks.workunit.client.0.smithi081.stdout:7/66: chown d3/fb 56100774 1 2024-04-23T14:49:28.933 INFO:tasks.workunit.client.0.smithi081.stdout:7/67: dread - d3/d4/fd zero size 2024-04-23T14:49:28.934 INFO:tasks.workunit.client.0.smithi081.stdout:4/53: creat d1/d4/dc/f14 x:0 0 0 2024-04-23T14:49:28.939 INFO:tasks.workunit.client.0.smithi081.stdout:9/63: write d3/de/f10 [1367686,43358] 0 2024-04-23T14:49:28.939 INFO:tasks.workunit.client.0.smithi081.stdout:7/68: mkdir d3/d11 0 2024-04-23T14:49:28.939 INFO:tasks.workunit.client.0.smithi081.stdout:5/90: dwrite d17/f1e [0,4194304] 0 2024-04-23T14:49:28.939 INFO:tasks.workunit.client.0.smithi081.stdout:4/54: mknod d1/d4/dc/c15 0 2024-04-23T14:49:28.939 INFO:tasks.workunit.client.0.smithi081.stdout:4/55: write d1/d3/f8 [174727,29801] 0 2024-04-23T14:49:28.939 INFO:tasks.workunit.client.0.smithi081.stdout:4/56: chown d1/d4/dc/c15 6512960 1 2024-04-23T14:49:28.945 INFO:tasks.workunit.client.0.smithi081.stdout:7/69: unlink d3/d4/fa 0 2024-04-23T14:49:28.945 INFO:tasks.workunit.client.0.smithi081.stdout:7/70: rename d3 to d3/d12 22 2024-04-23T14:49:28.947 INFO:tasks.workunit.client.0.smithi081.stdout:5/91: truncate d17/d18/f19 1648465 0 2024-04-23T14:49:28.949 INFO:tasks.workunit.client.0.smithi081.stdout:7/71: mknod d3/c13 0 2024-04-23T14:49:28.951 INFO:tasks.workunit.client.0.smithi081.stdout:3/92: getdents d4/d7/df 0 2024-04-23T14:49:28.953 INFO:tasks.workunit.client.0.smithi081.stdout:5/92: rmdir d17/d18 39 2024-04-23T14:49:28.953 INFO:tasks.workunit.client.0.smithi081.stdout:5/93: write f1 [4786760,123693] 0 2024-04-23T14:49:28.953 INFO:tasks.workunit.client.0.smithi081.stdout:5/94: write f1 [5365354,17940] 0 2024-04-23T14:49:28.956 INFO:tasks.workunit.client.0.smithi081.stdout:7/72: truncate d3/fb 183944 0 2024-04-23T14:49:28.959 INFO:tasks.workunit.client.0.smithi081.stdout:5/95: rename la to d17/l20 0 2024-04-23T14:49:28.960 INFO:tasks.workunit.client.0.smithi081.stdout:9/64: dread d3/d1a/fc [0,4194304] 0 2024-04-23T14:49:28.962 INFO:tasks.workunit.client.0.smithi081.stdout:6/69: dread d1/fe [0,4194304] 0 2024-04-23T14:49:28.963 INFO:tasks.workunit.client.0.smithi081.stdout:7/73: mknod d3/d11/c14 0 2024-04-23T14:49:28.970 INFO:tasks.workunit.client.0.smithi081.stdout:6/70: creat d1/d11/d13/d16/f19 x:0 0 0 2024-04-23T14:49:28.970 INFO:tasks.workunit.client.0.smithi081.stdout:6/71: stat d1/d2/c15 0 2024-04-23T14:49:28.971 INFO:tasks.workunit.client.0.smithi081.stdout:7/74: mkdir d3/d11/d15 0 2024-04-23T14:49:28.996 INFO:tasks.workunit.client.0.smithi081.stdout:9/65: write d3/f11 [3393476,57259] 0 2024-04-23T14:49:28.999 INFO:tasks.workunit.client.0.smithi081.stdout:5/96: rmdir d17 39 2024-04-23T14:49:29.001 INFO:tasks.workunit.client.0.smithi081.stdout:9/66: mkdir d3/de/d1d 0 2024-04-23T14:49:29.001 INFO:tasks.workunit.client.0.smithi081.stdout:9/67: chown d3/c4 87257384 1 2024-04-23T14:49:29.002 INFO:tasks.workunit.client.0.smithi081.stdout:9/68: read - d3/d1a/f17 zero size 2024-04-23T14:49:29.005 INFO:tasks.workunit.client.0.smithi081.stdout:9/69: creat d3/de/d1d/f1e x:0 0 0 2024-04-23T14:49:29.006 INFO:tasks.workunit.client.0.smithi081.stdout:7/75: dread d3/fb [0,4194304] 0 2024-04-23T14:49:29.006 INFO:tasks.workunit.client.0.smithi081.stdout:7/76: dread - d3/f10 zero size 2024-04-23T14:49:29.007 INFO:tasks.workunit.client.0.smithi081.stdout:9/70: symlink d3/de/d1d/l1f 0 2024-04-23T14:49:29.011 INFO:tasks.workunit.client.0.smithi081.stdout:0/63: dwrite d6/fe [0,4194304] 0 2024-04-23T14:49:29.011 INFO:tasks.workunit.client.0.smithi081.stdout:0/64: write d6/f9 [1557210,20705] 0 2024-04-23T14:49:29.011 INFO:tasks.workunit.client.0.smithi081.stdout:1/96: dwrite d3/d10/f13 [0,4194304] 0 2024-04-23T14:49:29.011 INFO:tasks.workunit.client.0.smithi081.stdout:1/97: write d3/fa [727534,52464] 0 2024-04-23T14:49:29.015 INFO:tasks.workunit.client.0.smithi081.stdout:7/77: rename d3/ce to d3/d11/c16 0 2024-04-23T14:49:29.015 INFO:tasks.workunit.client.0.smithi081.stdout:7/78: chown d3/f10 1837 1 2024-04-23T14:49:29.019 INFO:tasks.workunit.client.0.smithi081.stdout:8/67: dread d3/f10 [0,4194304] 0 2024-04-23T14:49:29.024 INFO:tasks.workunit.client.0.smithi081.stdout:7/79: dread d3/d4/f8 [0,4194304] 0 2024-04-23T14:49:29.031 INFO:tasks.workunit.client.0.smithi081.stdout:1/98: mkdir d3/d15/d17/d25 0 2024-04-23T14:49:29.031 INFO:tasks.workunit.client.0.smithi081.stdout:1/99: chown d3/d15/d12 604942 1 2024-04-23T14:49:29.032 INFO:tasks.workunit.client.0.smithi081.stdout:5/97: write d17/f1e [3257911,106411] 0 2024-04-23T14:49:29.034 INFO:tasks.workunit.client.0.smithi081.stdout:4/57: dwrite d1/f12 [0,4194304] 0 2024-04-23T14:49:29.037 INFO:tasks.workunit.client.0.smithi081.stdout:8/68: symlink d3/d11/l14 0 2024-04-23T14:49:29.037 INFO:tasks.workunit.client.0.smithi081.stdout:7/80: mknod d3/d4/c17 0 2024-04-23T14:49:29.037 INFO:tasks.workunit.client.0.smithi081.stdout:8/69: write f2 [1255676,32194] 0 2024-04-23T14:49:29.044 INFO:tasks.workunit.client.0.smithi081.stdout:6/72: dwrite d1/d11/d13/d16/f19 [0,4194304] 0 2024-04-23T14:49:29.047 INFO:tasks.workunit.client.0.smithi081.stdout:1/100: mkdir d3/d15/d17/d26 0 2024-04-23T14:49:29.062 INFO:tasks.workunit.client.0.smithi081.stdout:7/81: creat d3/d11/f18 x:0 0 0 2024-04-23T14:49:29.063 INFO:tasks.workunit.client.0.smithi081.stdout:8/70: symlink d3/l15 0 2024-04-23T14:49:29.063 INFO:tasks.workunit.client.0.smithi081.stdout:8/71: chown d3/l15 706490114 1 2024-04-23T14:49:29.063 INFO:tasks.workunit.client.0.smithi081.stdout:1/101: write f0 [4396087,90431] 0 2024-04-23T14:49:29.063 INFO:tasks.workunit.client.0.smithi081.stdout:1/102: creat d3/d15/d17/f27 x:0 0 0 2024-04-23T14:49:29.063 INFO:tasks.workunit.client.0.smithi081.stdout:1/103: fdatasync d3/d15/d12/f1c 0 2024-04-23T14:49:29.063 INFO:tasks.workunit.client.0.smithi081.stdout:1/104: write d3/d15/d12/d1a/f23 [509812,19007] 0 2024-04-23T14:49:29.067 INFO:tasks.workunit.client.0.smithi081.stdout:6/73: symlink d1/d11/d8/l1a 0 2024-04-23T14:49:29.068 INFO:tasks.workunit.client.0.smithi081.stdout:6/74: chown d1/f18 113906 1 2024-04-23T14:49:29.068 INFO:tasks.workunit.client.0.smithi081.stdout:6/75: write d1/fe [10036224,127203] 0 2024-04-23T14:49:29.068 INFO:tasks.workunit.client.0.smithi081.stdout:6/76: chown d1/d2/c15 49961 1 2024-04-23T14:49:29.068 INFO:tasks.workunit.client.0.smithi081.stdout:8/72: symlink d3/l16 0 2024-04-23T14:49:29.076 INFO:tasks.workunit.client.0.smithi081.stdout:9/71: write d3/f8 [7919812,29270] 0 2024-04-23T14:49:29.086 INFO:tasks.workunit.client.0.smithi081.stdout:0/65: dwrite f5 [0,4194304] 0 2024-04-23T14:49:29.089 INFO:tasks.workunit.client.0.smithi081.stdout:0/66: creat d6/ff x:0 0 0 2024-04-23T14:49:29.096 INFO:tasks.workunit.client.0.smithi081.stdout:4/58: dwrite d1/d4/f10 [0,4194304] 0 2024-04-23T14:49:29.097 INFO:tasks.workunit.client.0.smithi081.stdout:5/98: dwrite d17/f1e [0,4194304] 0 2024-04-23T14:49:29.097 INFO:tasks.workunit.client.0.smithi081.stdout:5/99: chown l10 59913282 1 2024-04-23T14:49:29.098 INFO:tasks.workunit.client.0.smithi081.stdout:9/72: dread d3/f8 [4194304,4194304] 0 2024-04-23T14:49:29.110 INFO:tasks.workunit.client.0.smithi081.stdout:5/100: dread d17/f1e [0,4194304] 0 2024-04-23T14:49:29.149 INFO:tasks.workunit.client.0.smithi081.stdout:0/67: dwrite d6/ff [0,4194304] 0 2024-04-23T14:49:29.210 INFO:tasks.workunit.client.0.smithi081.stdout:1/105: truncate d3/d10/f13 2356306 0 2024-04-23T14:49:29.210 INFO:tasks.workunit.client.0.smithi081.stdout:1/106: chown d3/f7 172728338 1 2024-04-23T14:49:29.212 INFO:tasks.workunit.client.0.smithi081.stdout:6/77: mkdir d1/d11/d13/d16/d1b 0 2024-04-23T14:49:29.215 INFO:tasks.workunit.client.0.smithi081.stdout:8/73: mknod d3/c17 0 2024-04-23T14:49:29.242 INFO:tasks.workunit.client.0.smithi081.stdout:4/59: mkdir d1/d16 0 2024-04-23T14:49:29.246 INFO:tasks.workunit.client.0.smithi081.stdout:9/73: link d3/de/f10 d3/de/d1d/f20 0 2024-04-23T14:49:29.246 INFO:tasks.workunit.client.0.smithi081.stdout:9/74: creat d3/d5/f21 x:0 0 0 2024-04-23T14:49:29.246 INFO:tasks.workunit.client.0.smithi081.stdout:9/75: fdatasync f1 0 2024-04-23T14:49:29.249 INFO:tasks.workunit.client.0.smithi081.stdout:6/78: dread d1/fe [4194304,4194304] 0 2024-04-23T14:49:29.249 INFO:tasks.workunit.client.0.smithi081.stdout:6/79: write d1/f17 [401413,104630] 0 2024-04-23T14:49:29.250 INFO:tasks.workunit.client.0.smithi081.stdout:5/101: rename f1 to d17/f21 0 2024-04-23T14:49:29.258 INFO:tasks.workunit.client.0.smithi081.stdout:0/68: truncate d6/fe 211894 0 2024-04-23T14:49:29.258 INFO:tasks.workunit.client.0.smithi081.stdout:0/69: creat d6/f10 x:0 0 0 2024-04-23T14:49:29.258 INFO:tasks.workunit.client.0.smithi081.stdout:1/107: mknod d3/d15/d12/d1a/c28 0 2024-04-23T14:49:29.259 INFO:tasks.workunit.client.0.smithi081.stdout:1/108: fdatasync d3/d15/d12/f1c 0 2024-04-23T14:49:29.262 INFO:tasks.workunit.client.0.smithi081.stdout:0/70: dread - d6/f10 zero size 2024-04-23T14:49:29.263 INFO:tasks.workunit.client.0.smithi081.stdout:8/74: symlink d3/l18 0 2024-04-23T14:49:29.268 INFO:tasks.workunit.client.0.smithi081.stdout:4/60: unlink d1/d4/f7 0 2024-04-23T14:49:29.268 INFO:tasks.workunit.client.0.smithi081.stdout:4/61: chown d1 980 1 2024-04-23T14:49:29.268 INFO:tasks.workunit.client.0.smithi081.stdout:4/62: chown d1/ff 139 1 2024-04-23T14:49:29.279 INFO:tasks.workunit.client.0.smithi081.stdout:0/71: dread d6/f9 [0,4194304] 0 2024-04-23T14:49:29.283 INFO:tasks.workunit.client.0.smithi081.stdout:8/75: creat d3/d11/f19 x:0 0 0 2024-04-23T14:49:29.283 INFO:tasks.workunit.client.0.smithi081.stdout:8/76: chown d3/l6 351743754 1 2024-04-23T14:49:29.286 INFO:tasks.workunit.client.0.smithi081.stdout:4/63: mknod d1/c17 0 2024-04-23T14:49:29.309 INFO:tasks.workunit.client.0.smithi081.stdout:8/77: mkdir d3/d1a 0 2024-04-23T14:49:29.312 INFO:tasks.workunit.client.0.smithi081.stdout:4/64: unlink d1/ff 0 2024-04-23T14:49:29.315 INFO:tasks.workunit.client.0.smithi081.stdout:9/76: dwrite d3/d5/f16 [0,4194304] 0 2024-04-23T14:49:29.317 INFO:tasks.workunit.client.0.smithi081.stdout:9/77: mkdir d3/de/d22 0 2024-04-23T14:49:29.318 INFO:tasks.workunit.client.0.smithi081.stdout:9/78: stat l2 0 2024-04-23T14:49:29.318 INFO:tasks.workunit.client.0.smithi081.stdout:9/79: chown l2 908613 1 2024-04-23T14:49:29.318 INFO:tasks.workunit.client.0.smithi081.stdout:9/80: write d3/de/f19 [601150,39544] 0 2024-04-23T14:49:29.318 INFO:tasks.workunit.client.0.smithi081.stdout:9/81: readlink d3/lb 0 2024-04-23T14:49:29.318 INFO:tasks.workunit.client.0.smithi081.stdout:0/72: rmdir d6 39 2024-04-23T14:49:29.323 INFO:tasks.workunit.client.0.smithi081.stdout:9/82: getdents d3/d5 0 2024-04-23T14:49:29.327 INFO:tasks.workunit.client.0.smithi081.stdout:5/102: dwrite d17/f21 [4194304,4194304] 0 2024-04-23T14:49:29.328 INFO:tasks.workunit.client.0.smithi081.stdout:6/80: truncate d1/fe 4915096 0 2024-04-23T14:49:29.328 INFO:tasks.workunit.client.0.smithi081.stdout:9/83: truncate d3/de/f10 849259 0 2024-04-23T14:49:29.328 INFO:tasks.workunit.client.0.smithi081.stdout:6/81: chown d1/d11/d13 124616776 1 2024-04-23T14:49:29.330 INFO:tasks.workunit.client.0.smithi081.stdout:5/103: creat d17/d1f/f22 x:0 0 0 2024-04-23T14:49:29.330 INFO:tasks.workunit.client.0.smithi081.stdout:8/78: read f1 [4161915,12012] 0 2024-04-23T14:49:29.331 INFO:tasks.workunit.client.0.smithi081.stdout:6/82: mkdir d1/d11/d1c 0 2024-04-23T14:49:29.333 INFO:tasks.workunit.client.0.smithi081.stdout:9/84: creat d3/de/d14/f23 x:0 0 0 2024-04-23T14:49:29.336 INFO:tasks.workunit.client.0.smithi081.stdout:5/104: link f9 d17/d1f/f23 0 2024-04-23T14:49:29.337 INFO:tasks.workunit.client.0.smithi081.stdout:5/105: dread - f12 zero size 2024-04-23T14:49:29.338 INFO:tasks.workunit.client.0.smithi081.stdout:6/83: creat d1/d2/f1d x:0 0 0 2024-04-23T14:49:29.339 INFO:tasks.workunit.client.0.smithi081.stdout:6/84: stat d1/d2 0 2024-04-23T14:49:29.339 INFO:tasks.workunit.client.0.smithi081.stdout:6/85: creat d1/d11/d13/d16/f1e x:0 0 0 2024-04-23T14:49:29.339 INFO:tasks.workunit.client.0.smithi081.stdout:6/86: chown d1/l14 149 1 2024-04-23T14:49:29.342 INFO:tasks.workunit.client.0.smithi081.stdout:9/85: link d3/d5/f21 d3/de/f24 0 2024-04-23T14:49:29.342 INFO:tasks.workunit.client.0.smithi081.stdout:8/79: getdents d3/d11 0 2024-04-23T14:49:29.347 INFO:tasks.workunit.client.0.smithi081.stdout:9/86: mkdir d3/de/d25 0 2024-04-23T14:49:29.350 INFO:tasks.workunit.client.0.smithi081.stdout:8/80: mknod d3/d1a/c1b 0 2024-04-23T14:49:29.353 INFO:tasks.workunit.client.0.smithi081.stdout:8/81: rmdir d3/d11 39 2024-04-23T14:49:29.354 INFO:tasks.workunit.client.0.smithi081.stdout:8/82: write d3/d11/f19 [87415,105471] 0 2024-04-23T14:49:29.354 INFO:tasks.workunit.client.0.smithi081.stdout:8/83: readlink d3/l16 0 2024-04-23T14:49:29.357 INFO:tasks.workunit.client.0.smithi081.stdout:8/84: unlink d3/l8 0 2024-04-23T14:49:29.359 INFO:tasks.workunit.client.0.smithi081.stdout:8/85: mknod d3/d11/c1c 0 2024-04-23T14:49:29.364 INFO:tasks.workunit.client.0.smithi081.stdout:8/86: creat d3/d11/f1d x:0 0 0 2024-04-23T14:49:29.370 INFO:tasks.workunit.client.0.smithi081.stdout:5/106: getdents d17/d1f 0 2024-04-23T14:49:29.379 INFO:tasks.workunit.client.0.smithi081.stdout:5/107: dread d17/d18/f19 [0,4194304] 0 2024-04-23T14:49:29.383 INFO:tasks.workunit.client.0.smithi081.stdout:5/108: mknod d17/d1f/c24 0 2024-04-23T14:49:29.383 INFO:tasks.workunit.client.0.smithi081.stdout:5/109: chown fd 2145 1 2024-04-23T14:49:29.388 INFO:tasks.workunit.client.0.smithi081.stdout:8/87: write d3/ff [1529763,67027] 0 2024-04-23T14:49:29.390 INFO:tasks.workunit.client.0.smithi081.stdout:5/110: rmdir d17 39 2024-04-23T14:49:29.393 INFO:tasks.workunit.client.0.smithi081.stdout:5/111: creat d17/d1f/f25 x:0 0 0 2024-04-23T14:49:29.397 INFO:tasks.workunit.client.0.smithi081.stdout:5/112: rename d17/f1e to d17/f26 0 2024-04-23T14:49:29.400 INFO:tasks.workunit.client.0.smithi081.stdout:9/87: dwrite f1 [0,4194304] 0 2024-04-23T14:49:29.402 INFO:tasks.workunit.client.0.smithi081.stdout:6/87: dwrite d1/d2/f1d [0,4194304] 0 2024-04-23T14:49:29.410 INFO:tasks.workunit.client.0.smithi081.stdout:6/88: truncate d1/d11/d13/d16/f19 3822746 0 2024-04-23T14:49:29.420 INFO:tasks.workunit.client.0.smithi081.stdout:6/89: symlink d1/d11/l1f 0 2024-04-23T14:49:29.423 INFO:tasks.workunit.client.0.smithi081.stdout:6/90: mknod d1/d11/d13/d16/c20 0 2024-04-23T14:49:29.423 INFO:tasks.workunit.client.0.smithi081.stdout:6/91: creat d1/d2/f21 x:0 0 0 2024-04-23T14:49:29.427 INFO:tasks.workunit.client.0.smithi081.stdout:6/92: rename d1/cd to d1/d11/d13/c22 0 2024-04-23T14:49:29.430 INFO:tasks.workunit.client.0.smithi081.stdout:6/93: truncate d1/fe 1180348 0 2024-04-23T14:49:29.430 INFO:tasks.workunit.client.0.smithi081.stdout:6/94: chown d1/d11/l1f 1 1 2024-04-23T14:49:29.450 INFO:tasks.workunit.client.0.smithi081.stdout:9/88: write d3/f9 [8043064,58166] 0 2024-04-23T14:49:29.451 INFO:tasks.workunit.client.0.smithi081.stdout:9/89: truncate d3/de/f10 1065689 0 2024-04-23T14:49:29.454 INFO:tasks.workunit.client.0.smithi081.stdout:6/95: read d1/d2/f1d [3780847,47430] 0 2024-04-23T14:49:29.459 INFO:tasks.workunit.client.0.smithi081.stdout:8/88: dwrite d3/f10 [0,4194304] 0 2024-04-23T14:49:29.459 INFO:tasks.workunit.client.0.smithi081.stdout:8/89: fdatasync d3/d11/f19 0 2024-04-23T14:49:29.473 INFO:tasks.workunit.client.0.smithi081.stdout:9/90: truncate d3/f9 3534161 0 2024-04-23T14:49:29.473 INFO:tasks.workunit.client.0.smithi081.stdout:8/90: write d3/f10 [1383648,16281] 0 2024-04-23T14:49:29.476 INFO:tasks.workunit.client.0.smithi081.stdout:9/91: mknod d3/de/d22/c26 0 2024-04-23T14:49:29.476 INFO:tasks.workunit.client.0.smithi081.stdout:9/92: chown d3/d5/c7 398003 1 2024-04-23T14:49:29.476 INFO:tasks.workunit.client.0.smithi081.stdout:9/93: creat d3/de/f27 x:0 0 0 2024-04-23T14:49:29.477 INFO:tasks.workunit.client.0.smithi081.stdout:8/91: creat d3/d1a/f1e x:0 0 0 2024-04-23T14:49:29.480 INFO:tasks.workunit.client.0.smithi081.stdout:9/94: symlink d3/de/l28 0 2024-04-23T14:49:29.482 INFO:tasks.workunit.client.0.smithi081.stdout:8/92: symlink d3/l1f 0 2024-04-23T14:49:29.488 INFO:tasks.workunit.client.0.smithi081.stdout:8/93: truncate d3/ff 1912731 0 2024-04-23T14:49:29.503 INFO:tasks.workunit.client.0.smithi081.stdout:6/96: dwrite d1/d11/d13/d16/f1e [0,4194304] 0 2024-04-23T14:49:29.508 INFO:tasks.workunit.client.0.smithi081.stdout:6/97: truncate d1/f17 144864 0 2024-04-23T14:49:29.510 INFO:tasks.workunit.client.0.smithi081.stdout:8/94: write d3/f5 [2901692,83460] 0 2024-04-23T14:49:29.516 INFO:tasks.workunit.client.0.smithi081.stdout:8/95: link d3/d11/f19 d3/f20 0 2024-04-23T14:49:29.516 INFO:tasks.workunit.client.0.smithi081.stdout:8/96: stat d3/d11/f19 0 2024-04-23T14:49:29.516 INFO:tasks.workunit.client.0.smithi081.stdout:8/97: stat d3/d11 0 2024-04-23T14:49:29.534 INFO:tasks.workunit.client.0.smithi081.stdout:6/98: dread d1/d11/d13/d16/f19 [0,4194304] 0 2024-04-23T14:49:29.534 INFO:tasks.workunit.client.0.smithi081.stdout:9/95: dwrite d3/de/d1d/f20 [0,4194304] 0 2024-04-23T14:49:29.534 INFO:tasks.workunit.client.0.smithi081.stdout:9/96: write d3/de/f19 [748275,85281] 0 2024-04-23T14:49:29.541 INFO:tasks.workunit.client.0.smithi081.stdout:8/98: dread d3/f5 [0,4194304] 0 2024-04-23T14:49:29.541 INFO:tasks.workunit.client.0.smithi081.stdout:8/99: write d3/f20 [524837,25129] 0 2024-04-23T14:49:29.542 INFO:tasks.workunit.client.0.smithi081.stdout:9/97: rename d3/de/f19 to d3/de/d25/f29 0 2024-04-23T14:49:29.545 INFO:tasks.workunit.client.0.smithi081.stdout:6/99: write d1/d11/d13/d16/f19 [2086583,117621] 0 2024-04-23T14:49:29.549 INFO:tasks.workunit.client.0.smithi081.stdout:8/100: rename d3/cc to d3/d1a/c21 0 2024-04-23T14:49:29.549 INFO:tasks.workunit.client.0.smithi081.stdout:8/101: truncate d3/d11/f1d 485206 0 2024-04-23T14:49:29.549 INFO:tasks.workunit.client.0.smithi081.stdout:8/102: creat d3/d1a/f22 x:0 0 0 2024-04-23T14:49:29.551 INFO:tasks.workunit.client.0.smithi081.stdout:9/98: unlink l2 0 2024-04-23T14:49:29.551 INFO:tasks.workunit.client.0.smithi081.stdout:9/99: fsync d3/de/f10 0 2024-04-23T14:49:29.551 INFO:tasks.workunit.client.0.smithi081.stdout:9/100: dread - d3/de/d1d/f1e zero size 2024-04-23T14:49:29.551 INFO:tasks.workunit.client.0.smithi081.stdout:9/101: fdatasync d3/de/d14/f23 0 2024-04-23T14:49:29.551 INFO:tasks.workunit.client.0.smithi081.stdout:9/102: write d3/de/f27 [754312,112723] 0 2024-04-23T14:49:29.554 INFO:tasks.workunit.client.0.smithi081.stdout:6/100: creat d1/d11/d13/f23 x:0 0 0 2024-04-23T14:49:29.568 INFO:tasks.workunit.client.0.smithi081.stdout:9/103: dread d3/d5/f16 [0,4194304] 0 2024-04-23T14:49:29.570 INFO:tasks.workunit.client.0.smithi081.stdout:9/104: truncate d3/de/f10 89641 0 2024-04-23T14:49:29.570 INFO:tasks.workunit.client.0.smithi081.stdout:9/105: write d3/d5/f21 [239995,50679] 0 2024-04-23T14:49:29.570 INFO:tasks.workunit.client.0.smithi081.stdout:9/106: readlink d3/lb 0 2024-04-23T14:49:29.576 INFO:tasks.workunit.client.0.smithi081.stdout:7/82: sync 2024-04-23T14:49:29.578 INFO:tasks.workunit.client.0.smithi081.stdout:1/109: sync 2024-04-23T14:49:29.578 INFO:tasks.workunit.client.0.smithi081.stdout:1/110: write f0 [3297966,24023] 0 2024-04-23T14:49:29.578 INFO:tasks.workunit.client.0.smithi081.stdout:3/93: sync 2024-04-23T14:49:29.579 INFO:tasks.workunit.client.0.smithi081.stdout:2/113: sync 2024-04-23T14:49:29.579 INFO:tasks.workunit.client.0.smithi081.stdout:2/114: write d1/fd [1083712,101079] 0 2024-04-23T14:49:29.584 INFO:tasks.workunit.client.0.smithi081.stdout:3/94: mknod d4/d7/d1a/c1d 0 2024-04-23T14:49:29.585 INFO:tasks.workunit.client.0.smithi081.stdout:7/83: dread d3/d4/f8 [0,4194304] 0 2024-04-23T14:49:29.587 INFO:tasks.workunit.client.0.smithi081.stdout:2/115: symlink d1/d11/d21/d22/l2e 0 2024-04-23T14:49:29.588 INFO:tasks.workunit.client.0.smithi081.stdout:1/111: rename d3/d10/l22 to d3/l29 0 2024-04-23T14:49:29.591 INFO:tasks.workunit.client.0.smithi081.stdout:3/95: mkdir d4/dc/d10/d1e 0 2024-04-23T14:49:29.592 INFO:tasks.workunit.client.0.smithi081.stdout:3/96: write d4/f6 [4662447,74721] 0 2024-04-23T14:49:29.593 INFO:tasks.workunit.client.0.smithi081.stdout:7/84: truncate d3/f5 2586927 0 2024-04-23T14:49:29.593 INFO:tasks.workunit.client.0.smithi081.stdout:7/85: fdatasync f2 0 2024-04-23T14:49:29.596 INFO:tasks.workunit.client.0.smithi081.stdout:2/116: truncate d1/d11/f12 372073 0 2024-04-23T14:49:29.596 INFO:tasks.workunit.client.0.smithi081.stdout:2/117: dread - d1/d11/f28 zero size 2024-04-23T14:49:29.599 INFO:tasks.workunit.client.0.smithi081.stdout:1/112: mkdir d3/d15/d12/d1a/d2a 0 2024-04-23T14:49:29.603 INFO:tasks.workunit.client.0.smithi081.stdout:3/97: unlink d4/dc/d10/f15 0 2024-04-23T14:49:29.604 INFO:tasks.workunit.client.0.smithi081.stdout:8/103: dwrite f2 [0,4194304] 0 2024-04-23T14:49:29.604 INFO:tasks.workunit.client.0.smithi081.stdout:6/101: dread d1/d11/d13/d16/f19 [0,4194304] 0 2024-04-23T14:49:29.605 INFO:tasks.workunit.client.0.smithi081.stdout:7/86: mkdir d3/d11/d15/d19 0 2024-04-23T14:49:29.607 INFO:tasks.workunit.client.0.smithi081.stdout:2/118: unlink d1/fd 0 2024-04-23T14:49:29.607 INFO:tasks.workunit.client.0.smithi081.stdout:2/119: write d1/f5 [837008,103400] 0 2024-04-23T14:49:29.607 INFO:tasks.workunit.client.0.smithi081.stdout:2/120: dread - d1/d11/f25 zero size 2024-04-23T14:49:29.607 INFO:tasks.workunit.client.0.smithi081.stdout:2/121: truncate d1/d11/f20 423356 0 2024-04-23T14:49:29.615 INFO:tasks.workunit.client.0.smithi081.stdout:1/113: mknod d3/d10/c2b 0 2024-04-23T14:49:29.615 INFO:tasks.workunit.client.0.smithi081.stdout:3/98: creat d4/dc/d10/f1f x:0 0 0 2024-04-23T14:49:29.615 INFO:tasks.workunit.client.0.smithi081.stdout:3/99: fdatasync f3 0 2024-04-23T14:49:29.619 INFO:tasks.workunit.client.0.smithi081.stdout:2/122: dread d1/d11/f13 [0,4194304] 0 2024-04-23T14:49:29.632 INFO:tasks.workunit.client.0.smithi081.stdout:9/107: dwrite d3/de/d25/f29 [0,4194304] 0 2024-04-23T14:49:29.636 INFO:tasks.workunit.client.0.smithi081.stdout:8/104: mknod d3/c23 0 2024-04-23T14:49:29.638 INFO:tasks.workunit.client.0.smithi081.stdout:6/102: symlink d1/d11/d8/l24 0 2024-04-23T14:49:29.643 INFO:tasks.workunit.client.0.smithi081.stdout:3/100: symlink d4/d7/d1a/l20 0 2024-04-23T14:49:29.644 INFO:tasks.workunit.client.0.smithi081.stdout:7/87: write d3/d4/f9 [165316,47774] 0 2024-04-23T14:49:29.645 INFO:tasks.workunit.client.0.smithi081.stdout:7/88: chown d3/d11/c14 150 1 2024-04-23T14:49:29.645 INFO:tasks.workunit.client.0.smithi081.stdout:7/89: readlink d3/lf 0 2024-04-23T14:49:29.646 INFO:tasks.workunit.client.0.smithi081.stdout:2/123: symlink d1/d11/d21/d22/l2f 0 2024-04-23T14:49:29.646 INFO:tasks.workunit.client.0.smithi081.stdout:2/124: fsync d1/fa 0 2024-04-23T14:49:29.648 INFO:tasks.workunit.client.0.smithi081.stdout:9/108: mknod d3/de/c2a 0 2024-04-23T14:49:29.648 INFO:tasks.workunit.client.0.smithi081.stdout:9/109: readlink d3/de/d1d/l1f 0 2024-04-23T14:49:29.649 INFO:tasks.workunit.client.0.smithi081.stdout:9/110: creat d3/de/d14/f2b x:0 0 0 2024-04-23T14:49:29.649 INFO:tasks.workunit.client.0.smithi081.stdout:9/111: creat d3/de/d14/f2c x:0 0 0 2024-04-23T14:49:29.652 INFO:tasks.workunit.client.0.smithi081.stdout:3/101: truncate d4/f12 651987 0 2024-04-23T14:49:29.652 INFO:tasks.workunit.client.0.smithi081.stdout:3/102: read - d4/d7/df/f1b zero size 2024-04-23T14:49:29.655 INFO:tasks.workunit.client.0.smithi081.stdout:7/90: truncate f2 9688 0 2024-04-23T14:49:29.664 INFO:tasks.workunit.client.0.smithi081.stdout:8/105: dread f2 [0,4194304] 0 2024-04-23T14:49:29.672 INFO:tasks.workunit.client.0.smithi081.stdout:2/125: rename d1/fc to d1/d1e/f30 0 2024-04-23T14:49:29.672 INFO:tasks.workunit.client.0.smithi081.stdout:2/126: write d1/fa [535558,49306] 0 2024-04-23T14:49:29.678 INFO:tasks.workunit.client.0.smithi081.stdout:4/65: sync 2024-04-23T14:49:29.681 INFO:tasks.workunit.client.0.smithi081.stdout:0/73: sync 2024-04-23T14:49:29.682 INFO:tasks.workunit.client.0.smithi081.stdout:8/106: symlink d3/l24 0 2024-04-23T14:49:29.682 INFO:tasks.workunit.client.0.smithi081.stdout:8/107: chown d3 283 1 2024-04-23T14:49:29.683 INFO:tasks.workunit.client.0.smithi081.stdout:2/127: symlink d1/l31 0 2024-04-23T14:49:29.683 INFO:tasks.workunit.client.0.smithi081.stdout:2/128: creat d1/f32 x:0 0 0 2024-04-23T14:49:29.687 INFO:tasks.workunit.client.0.smithi081.stdout:4/66: mknod d1/d4/c18 0 2024-04-23T14:49:29.694 INFO:tasks.workunit.client.0.smithi081.stdout:0/74: mkdir d6/d11 0 2024-04-23T14:49:29.694 INFO:tasks.workunit.client.0.smithi081.stdout:0/75: truncate d6/f10 938993 0 2024-04-23T14:49:29.694 INFO:tasks.workunit.client.0.smithi081.stdout:0/76: fdatasync d6/f10 0 2024-04-23T14:49:29.702 INFO:tasks.workunit.client.0.smithi081.stdout:1/114: dwrite d3/fa [0,4194304] 0 2024-04-23T14:49:29.715 INFO:tasks.workunit.client.0.smithi081.stdout:0/77: dread d6/f9 [0,4194304] 0 2024-04-23T14:49:29.715 INFO:tasks.workunit.client.0.smithi081.stdout:9/112: dwrite d3/de/d1d/f1e [0,4194304] 0 2024-04-23T14:49:29.715 INFO:tasks.workunit.client.0.smithi081.stdout:9/113: truncate d3/d1a/f17 107446 0 2024-04-23T14:49:29.716 INFO:tasks.workunit.client.0.smithi081.stdout:2/129: mkdir d1/d33 0 2024-04-23T14:49:29.723 INFO:tasks.workunit.client.0.smithi081.stdout:0/78: creat d6/d11/f12 x:0 0 0 2024-04-23T14:49:29.726 INFO:tasks.workunit.client.0.smithi081.stdout:4/67: dread d1/f12 [0,4194304] 0 2024-04-23T14:49:29.728 INFO:tasks.workunit.client.0.smithi081.stdout:1/115: dread d3/f6 [0,4194304] 0 2024-04-23T14:49:29.730 INFO:tasks.workunit.client.0.smithi081.stdout:0/79: write d6/fe [160074,57508] 0 2024-04-23T14:49:29.730 INFO:tasks.workunit.client.0.smithi081.stdout:0/80: dread - d6/fd zero size 2024-04-23T14:49:29.730 INFO:tasks.workunit.client.0.smithi081.stdout:0/81: creat d6/d11/f13 x:0 0 0 2024-04-23T14:49:29.731 INFO:tasks.workunit.client.0.smithi081.stdout:6/103: dwrite d1/f18 [0,4194304] 0 2024-04-23T14:49:29.732 INFO:tasks.workunit.client.0.smithi081.stdout:3/103: dwrite d4/d7/df/f1b [0,4194304] 0 2024-04-23T14:49:29.734 INFO:tasks.workunit.client.0.smithi081.stdout:9/114: mknod d3/de/c2d 0 2024-04-23T14:49:29.734 INFO:tasks.workunit.client.0.smithi081.stdout:7/91: dread f2 [0,4194304] 0 2024-04-23T14:49:29.736 INFO:tasks.workunit.client.0.smithi081.stdout:2/130: mkdir d1/d11/d21/d34 0 2024-04-23T14:49:29.742 INFO:tasks.workunit.client.0.smithi081.stdout:1/116: mknod d3/d15/d12/d1a/c2c 0 2024-04-23T14:49:29.744 INFO:tasks.workunit.client.0.smithi081.stdout:4/68: symlink d1/d3/l19 0 2024-04-23T14:49:29.747 INFO:tasks.workunit.client.0.smithi081.stdout:8/108: dwrite f1 [0,4194304] 0 2024-04-23T14:49:29.751 INFO:tasks.workunit.client.0.smithi081.stdout:0/82: mkdir d6/d11/d14 0 2024-04-23T14:49:29.774 INFO:tasks.workunit.client.0.smithi081.stdout:6/104: rename d1/d2/c10 to d1/d11/d13/d16/c25 0 2024-04-23T14:49:29.775 INFO:tasks.workunit.client.0.smithi081.stdout:3/104: symlink d4/dc/d10/d1e/l21 0 2024-04-23T14:49:29.778 INFO:tasks.workunit.client.0.smithi081.stdout:2/131: symlink d1/d11/d21/d22/l35 0 2024-04-23T14:49:29.778 INFO:tasks.workunit.client.0.smithi081.stdout:2/132: truncate d1/d11/f26 654108 0 2024-04-23T14:49:29.781 INFO:tasks.workunit.client.0.smithi081.stdout:8/109: truncate d3/d11/f19 51844 0 2024-04-23T14:49:29.781 INFO:tasks.workunit.client.0.smithi081.stdout:8/110: readlink d3/l24 0 2024-04-23T14:49:29.782 INFO:tasks.workunit.client.0.smithi081.stdout:8/111: fsync f2 0 2024-04-23T14:49:29.784 INFO:tasks.workunit.client.0.smithi081.stdout:0/83: rename d6/d11/f12 to d6/d11/d14/f15 0 2024-04-23T14:49:29.786 INFO:tasks.workunit.client.0.smithi081.stdout:6/105: creat d1/d11/d13/d16/d1b/f26 x:0 0 0 2024-04-23T14:49:29.788 INFO:tasks.workunit.client.0.smithi081.stdout:3/105: symlink d4/d7/df/l22 0 2024-04-23T14:49:29.788 INFO:tasks.workunit.client.0.smithi081.stdout:3/106: stat d4/f6 0 2024-04-23T14:49:29.791 INFO:tasks.workunit.client.0.smithi081.stdout:7/92: dread d3/f5 [0,4194304] 0 2024-04-23T14:49:29.791 INFO:tasks.workunit.client.0.smithi081.stdout:5/113: sync 2024-04-23T14:49:29.791 INFO:tasks.workunit.client.0.smithi081.stdout:5/114: dread - d17/f1d zero size 2024-04-23T14:49:29.792 INFO:tasks.workunit.client.0.smithi081.stdout:9/115: dwrite d3/d1a/f17 [0,4194304] 0 2024-04-23T14:49:29.792 INFO:tasks.workunit.client.0.smithi081.stdout:9/116: write d3/d5/f21 [1095960,2340] 0 2024-04-23T14:49:29.792 INFO:tasks.workunit.client.0.smithi081.stdout:4/69: getdents d1/d4/dc 0 2024-04-23T14:49:29.794 INFO:tasks.workunit.client.0.smithi081.stdout:8/112: truncate d3/f4 209017 0 2024-04-23T14:49:29.794 INFO:tasks.workunit.client.0.smithi081.stdout:8/113: chown d3/l6 129749 1 2024-04-23T14:49:29.794 INFO:tasks.workunit.client.0.smithi081.stdout:8/114: creat d3/f25 x:0 0 0 2024-04-23T14:49:29.799 INFO:tasks.workunit.client.0.smithi081.stdout:2/133: rename d1/l2c to d1/d11/d21/d34/l36 0 2024-04-23T14:49:29.800 INFO:tasks.workunit.client.0.smithi081.stdout:4/70: write d1/fa [857013,38787] 0 2024-04-23T14:49:29.800 INFO:tasks.workunit.client.0.smithi081.stdout:4/71: write d1/f9 [1467907,128918] 0 2024-04-23T14:49:29.801 INFO:tasks.workunit.client.0.smithi081.stdout:0/84: link d6/fe d6/d11/d14/f16 0 2024-04-23T14:49:29.805 INFO:tasks.workunit.client.0.smithi081.stdout:6/106: symlink d1/d11/d8/l27 0 2024-04-23T14:49:29.805 INFO:tasks.workunit.client.0.smithi081.stdout:6/107: fsync d1/d11/d13/d16/f1e 0 2024-04-23T14:49:29.805 INFO:tasks.workunit.client.0.smithi081.stdout:6/108: chown d1/l14 3 1 2024-04-23T14:49:29.806 INFO:tasks.workunit.client.0.smithi081.stdout:6/109: read d1/f17 [117115,110058] 0 2024-04-23T14:49:29.807 INFO:tasks.workunit.client.0.smithi081.stdout:3/107: mknod d4/d7/d1a/c23 0 2024-04-23T14:49:29.809 INFO:tasks.workunit.client.0.smithi081.stdout:7/93: mknod d3/c1a 0 2024-04-23T14:49:29.810 INFO:tasks.workunit.client.0.smithi081.stdout:1/117: dwrite d3/f7 [0,4194304] 0 2024-04-23T14:49:29.812 INFO:tasks.workunit.client.0.smithi081.stdout:0/85: dread d6/f9 [0,4194304] 0 2024-04-23T14:49:29.815 INFO:tasks.workunit.client.0.smithi081.stdout:5/115: mknod d17/d18/c27 0 2024-04-23T14:49:29.819 INFO:tasks.workunit.client.0.smithi081.stdout:8/115: link d3/d1a/c1b d3/d11/c26 0 2024-04-23T14:49:29.819 INFO:tasks.workunit.client.0.smithi081.stdout:8/116: creat d3/f27 x:0 0 0 2024-04-23T14:49:29.829 INFO:tasks.workunit.client.0.smithi081.stdout:4/72: mknod d1/d4/d11/c1a 0 2024-04-23T14:49:29.829 INFO:tasks.workunit.client.0.smithi081.stdout:6/110: symlink d1/d11/d13/d16/l28 0 2024-04-23T14:49:29.830 INFO:tasks.workunit.client.0.smithi081.stdout:3/108: link d4/la d4/dc/l24 0 2024-04-23T14:49:29.831 INFO:tasks.workunit.client.0.smithi081.stdout:0/86: write d6/ff [2814545,19874] 0 2024-04-23T14:49:29.836 INFO:tasks.workunit.client.0.smithi081.stdout:1/118: link d3/d15/d12/f1c d3/d15/d17/d26/f2d 0 2024-04-23T14:49:29.840 INFO:tasks.workunit.client.0.smithi081.stdout:5/116: symlink d17/d18/l28 0 2024-04-23T14:49:29.847 INFO:tasks.workunit.client.0.smithi081.stdout:0/87: mknod d6/d11/d14/c17 0 2024-04-23T14:49:29.847 INFO:tasks.workunit.client.0.smithi081.stdout:0/88: dread - d6/d11/f13 zero size 2024-04-23T14:49:29.847 INFO:tasks.workunit.client.0.smithi081.stdout:0/89: chown d6/d11/d14/f15 13177429 1 2024-04-23T14:49:29.848 INFO:tasks.workunit.client.0.smithi081.stdout:0/90: chown d6/d11/d14/c17 1517381248 1 2024-04-23T14:49:29.851 INFO:tasks.workunit.client.0.smithi081.stdout:1/119: mkdir d3/d15/d12/d2e 0 2024-04-23T14:49:29.851 INFO:tasks.workunit.client.0.smithi081.stdout:1/120: readlink d3/d10/l18 0 2024-04-23T14:49:29.851 INFO:tasks.workunit.client.0.smithi081.stdout:1/121: truncate d3/d15/d17/d26/f2d 481284 0 2024-04-23T14:49:29.851 INFO:tasks.workunit.client.0.smithi081.stdout:1/122: fsync d3/f6 0 2024-04-23T14:49:29.852 INFO:tasks.workunit.client.0.smithi081.stdout:1/123: truncate d3/f9 4009797 0 2024-04-23T14:49:29.854 INFO:tasks.workunit.client.0.smithi081.stdout:1/124: link d3/l8 d3/d15/d1d/l2f 0 2024-04-23T14:49:29.867 INFO:tasks.workunit.client.0.smithi081.stdout:2/134: write d1/fb [868811,64608] 0 2024-04-23T14:49:29.870 INFO:tasks.workunit.client.0.smithi081.stdout:2/135: creat d1/d33/f37 x:0 0 0 2024-04-23T14:49:29.873 INFO:tasks.workunit.client.0.smithi081.stdout:2/136: unlink d1/l7 0 2024-04-23T14:49:29.876 INFO:tasks.workunit.client.0.smithi081.stdout:2/137: link d1/f1c d1/d11/d21/d22/f38 0 2024-04-23T14:49:29.877 INFO:tasks.workunit.client.0.smithi081.stdout:2/138: write d1/d11/d21/d22/f38 [1212087,44578] 0 2024-04-23T14:49:29.879 INFO:tasks.workunit.client.0.smithi081.stdout:2/139: symlink d1/d1e/l39 0 2024-04-23T14:49:29.879 INFO:tasks.workunit.client.0.smithi081.stdout:5/117: write f4 [531919,57120] 0 2024-04-23T14:49:29.884 INFO:tasks.workunit.client.0.smithi081.stdout:5/118: mknod d17/d18/c29 0 2024-04-23T14:49:29.885 INFO:tasks.workunit.client.0.smithi081.stdout:5/119: truncate d17/d18/f19 1826203 0 2024-04-23T14:49:29.885 INFO:tasks.workunit.client.0.smithi081.stdout:5/120: write f12 [920072,41895] 0 2024-04-23T14:49:29.885 INFO:tasks.workunit.client.0.smithi081.stdout:5/121: chown d17/d18/c29 36937805 1 2024-04-23T14:49:29.886 INFO:tasks.workunit.client.0.smithi081.stdout:7/94: dwrite d3/f5 [0,4194304] 0 2024-04-23T14:49:29.887 INFO:tasks.workunit.client.0.smithi081.stdout:7/95: creat d3/d11/f1b x:0 0 0 2024-04-23T14:49:29.889 INFO:tasks.workunit.client.0.smithi081.stdout:2/140: mknod d1/d11/d21/d22/c3a 0 2024-04-23T14:49:29.889 INFO:tasks.workunit.client.0.smithi081.stdout:2/141: stat d1/d11/d21 0 2024-04-23T14:49:29.889 INFO:tasks.workunit.client.0.smithi081.stdout:2/142: creat d1/d11/d21/f3b x:0 0 0 2024-04-23T14:49:29.889 INFO:tasks.workunit.client.0.smithi081.stdout:2/143: creat d1/d11/f3c x:0 0 0 2024-04-23T14:49:29.894 INFO:tasks.workunit.client.0.smithi081.stdout:3/109: dwrite d4/dc/d10/f18 [0,4194304] 0 2024-04-23T14:49:29.895 INFO:tasks.workunit.client.0.smithi081.stdout:4/73: dwrite d1/d4/f10 [0,4194304] 0 2024-04-23T14:49:29.895 INFO:tasks.workunit.client.0.smithi081.stdout:4/74: chown d1/d3/f8 547318 1 2024-04-23T14:49:29.895 INFO:tasks.workunit.client.0.smithi081.stdout:4/75: chown d1/d4/d11/c1a 248940 1 2024-04-23T14:49:29.897 INFO:tasks.workunit.client.0.smithi081.stdout:4/76: write d1/fa [1880361,112921] 0 2024-04-23T14:49:29.897 INFO:tasks.workunit.client.0.smithi081.stdout:9/117: dwrite d3/de/f1c [0,4194304] 0 2024-04-23T14:49:29.898 INFO:tasks.workunit.client.0.smithi081.stdout:5/122: creat d17/f2a x:0 0 0 2024-04-23T14:49:29.898 INFO:tasks.workunit.client.0.smithi081.stdout:9/118: creat d3/de/f2e x:0 0 0 2024-04-23T14:49:29.898 INFO:tasks.workunit.client.0.smithi081.stdout:9/119: write d3/de/f2e [590415,103628] 0 2024-04-23T14:49:29.908 INFO:tasks.workunit.client.0.smithi081.stdout:8/117: dwrite d3/d11/f1d [0,4194304] 0 2024-04-23T14:49:29.911 INFO:tasks.workunit.client.0.smithi081.stdout:7/96: dread d3/d4/f9 [0,4194304] 0 2024-04-23T14:49:29.912 INFO:tasks.workunit.client.0.smithi081.stdout:2/144: symlink d1/d11/d21/d34/l3d 0 2024-04-23T14:49:29.919 INFO:tasks.workunit.client.0.smithi081.stdout:5/123: mknod d17/d18/c2b 0 2024-04-23T14:49:29.923 INFO:tasks.workunit.client.0.smithi081.stdout:1/125: dread d3/f9 [0,4194304] 0 2024-04-23T14:49:29.927 INFO:tasks.workunit.client.0.smithi081.stdout:9/120: mkdir d3/de/d1d/d2f 0 2024-04-23T14:49:29.931 INFO:tasks.workunit.client.0.smithi081.stdout:8/118: symlink d3/l28 0 2024-04-23T14:49:29.931 INFO:tasks.workunit.client.0.smithi081.stdout:8/119: readlink d3/l15 0 2024-04-23T14:49:29.936 INFO:tasks.workunit.client.0.smithi081.stdout:7/97: mknod d3/d4/c1c 0 2024-04-23T14:49:29.944 INFO:tasks.workunit.client.0.smithi081.stdout:2/145: rename d1/d11/d21/d34/l3d to d1/d1e/l3e 0 2024-04-23T14:49:29.950 INFO:tasks.workunit.client.0.smithi081.stdout:7/98: mkdir d3/d11/d15/d19/d1d 0 2024-04-23T14:49:29.953 INFO:tasks.workunit.client.0.smithi081.stdout:6/111: dwrite d1/d11/d13/d16/f1e [0,4194304] 0 2024-04-23T14:49:29.953 INFO:tasks.workunit.client.0.smithi081.stdout:6/112: readlink d1/d11/d13/d16/l28 0 2024-04-23T14:49:30.029 INFO:tasks.workunit.client.0.smithi081.stdout:7/99: mkdir d3/d11/d15/d19/d1d/d1e 0 2024-04-23T14:49:30.033 INFO:tasks.workunit.client.0.smithi081.stdout:6/113: creat d1/d11/d8/f29 x:0 0 0 2024-04-23T14:49:30.040 INFO:tasks.workunit.client.0.smithi081.stdout:8/120: dwrite d3/d11/f1d [0,4194304] 0 2024-04-23T14:49:30.043 INFO:tasks.workunit.client.0.smithi081.stdout:4/77: dwrite d1/d3/f8 [0,4194304] 0 2024-04-23T14:49:30.045 INFO:tasks.workunit.client.0.smithi081.stdout:0/91: dwrite d6/ff [0,4194304] 0 2024-04-23T14:49:30.045 INFO:tasks.workunit.client.0.smithi081.stdout:0/92: dread - d6/d11/f13 zero size 2024-04-23T14:49:30.045 INFO:tasks.workunit.client.0.smithi081.stdout:0/93: truncate d6/d11/f13 790830 0 2024-04-23T14:49:30.047 INFO:tasks.workunit.client.0.smithi081.stdout:6/114: unlink d1/d2/c15 0 2024-04-23T14:49:30.055 INFO:tasks.workunit.client.0.smithi081.stdout:2/146: dwrite d1/d11/d21/f3b [0,4194304] 0 2024-04-23T14:49:30.055 INFO:tasks.workunit.client.0.smithi081.stdout:2/147: chown d1/f6 151 1 2024-04-23T14:49:30.056 INFO:tasks.workunit.client.0.smithi081.stdout:5/124: dwrite d17/f1b [0,4194304] 0 2024-04-23T14:49:30.060 INFO:tasks.workunit.client.0.smithi081.stdout:1/126: dwrite d3/d15/d17/f27 [0,4194304] 0 2024-04-23T14:49:30.064 INFO:tasks.workunit.client.0.smithi081.stdout:5/125: write d17/d18/f19 [359389,120393] 0 2024-04-23T14:49:30.073 INFO:tasks.workunit.client.0.smithi081.stdout:0/94: stat l1 0 2024-04-23T14:49:30.087 INFO:tasks.workunit.client.0.smithi081.stdout:6/115: rename d1/d11/d13/d16/d1b/f26 to d1/f2a 0 2024-04-23T14:49:30.087 INFO:tasks.workunit.client.0.smithi081.stdout:6/116: creat d1/d11/d8/f2b x:0 0 0 2024-04-23T14:49:30.096 INFO:tasks.workunit.client.0.smithi081.stdout:2/148: symlink d1/d11/d21/l3f 0 2024-04-23T14:49:30.097 INFO:tasks.workunit.client.0.smithi081.stdout:2/149: read - d1/d11/f29 zero size 2024-04-23T14:49:30.097 INFO:tasks.workunit.client.0.smithi081.stdout:2/150: creat d1/d33/f40 x:0 0 0 2024-04-23T14:49:30.097 INFO:tasks.workunit.client.0.smithi081.stdout:2/151: truncate d1/d11/f28 304020 0 2024-04-23T14:49:30.097 INFO:tasks.workunit.client.0.smithi081.stdout:2/152: read - d1/d11/f3c zero size 2024-04-23T14:49:30.097 INFO:tasks.workunit.client.0.smithi081.stdout:3/110: dwrite d4/f6 [0,4194304] 0 2024-04-23T14:49:30.110 INFO:tasks.workunit.client.0.smithi081.stdout:1/127: creat d3/d15/d17/d25/f30 x:0 0 0 2024-04-23T14:49:30.116 INFO:tasks.workunit.client.0.smithi081.stdout:4/78: dwrite d1/d4/dc/f14 [0,4194304] 0 2024-04-23T14:49:30.116 INFO:tasks.workunit.client.0.smithi081.stdout:4/79: write d1/fa [166049,123989] 0 2024-04-23T14:49:30.118 INFO:tasks.workunit.client.0.smithi081.stdout:0/95: symlink d6/d11/l18 0 2024-04-23T14:49:30.126 INFO:tasks.workunit.client.0.smithi081.stdout:5/126: dwrite d17/d18/f19 [0,4194304] 0 2024-04-23T14:49:30.126 INFO:tasks.workunit.client.0.smithi081.stdout:5/127: creat d17/f2c x:0 0 0 2024-04-23T14:49:30.129 INFO:tasks.workunit.client.0.smithi081.stdout:8/121: dwrite f2 [0,4194304] 0 2024-04-23T14:49:30.130 INFO:tasks.workunit.client.0.smithi081.stdout:8/122: dread - d3/d1a/f22 zero size 2024-04-23T14:49:30.130 INFO:tasks.workunit.client.0.smithi081.stdout:8/123: dread - d3/f27 zero size 2024-04-23T14:49:30.130 INFO:tasks.workunit.client.0.smithi081.stdout:8/124: creat d3/d11/f29 x:0 0 0 2024-04-23T14:49:30.130 INFO:tasks.workunit.client.0.smithi081.stdout:3/111: mknod d4/dc/d10/c25 0 2024-04-23T14:49:30.132 INFO:tasks.workunit.client.0.smithi081.stdout:1/128: unlink d3/d15/f1f 0 2024-04-23T14:49:30.132 INFO:tasks.workunit.client.0.smithi081.stdout:1/129: fsync f0 0 2024-04-23T14:49:30.139 INFO:tasks.workunit.client.0.smithi081.stdout:1/130: dread d3/d15/d12/d1a/f23 [0,4194304] 0 2024-04-23T14:49:30.140 INFO:tasks.workunit.client.0.smithi081.stdout:1/131: write f0 [435134,35105] 0 2024-04-23T14:49:30.142 INFO:tasks.workunit.client.0.smithi081.stdout:5/128: write d17/f26 [951805,58278] 0 2024-04-23T14:49:30.142 INFO:tasks.workunit.client.0.smithi081.stdout:4/80: mknod d1/d16/c1b 0 2024-04-23T14:49:30.145 INFO:tasks.workunit.client.0.smithi081.stdout:0/96: unlink d6/d11/l18 0 2024-04-23T14:49:30.145 INFO:tasks.workunit.client.0.smithi081.stdout:0/97: write d6/d11/f13 [1065981,392] 0 2024-04-23T14:49:30.145 INFO:tasks.workunit.client.0.smithi081.stdout:0/98: stat d6/d11/d14/f16 0 2024-04-23T14:49:30.145 INFO:tasks.workunit.client.0.smithi081.stdout:0/99: dread - d6/d11/d14/f15 zero size 2024-04-23T14:49:30.145 INFO:tasks.workunit.client.0.smithi081.stdout:0/100: write d6/d11/d14/f15 [576255,125858] 0 2024-04-23T14:49:30.147 INFO:tasks.workunit.client.0.smithi081.stdout:6/117: truncate d1/d11/d13/d16/f1e 2509480 0 2024-04-23T14:49:30.147 INFO:tasks.workunit.client.0.smithi081.stdout:6/118: rename d1 to d1/d11/d2c 22 2024-04-23T14:49:30.147 INFO:tasks.workunit.client.0.smithi081.stdout:6/119: dread - d1/d11/d8/f29 zero size 2024-04-23T14:49:30.151 INFO:tasks.workunit.client.0.smithi081.stdout:8/125: dread d3/f5 [4194304,4194304] 0 2024-04-23T14:49:30.151 INFO:tasks.workunit.client.0.smithi081.stdout:8/126: truncate d3/f4 931386 0 2024-04-23T14:49:30.153 INFO:tasks.workunit.client.0.smithi081.stdout:7/100: truncate d3/f5 2317246 0 2024-04-23T14:49:30.158 INFO:tasks.workunit.client.0.smithi081.stdout:4/81: dread d1/f12 [0,4194304] 0 2024-04-23T14:49:30.162 INFO:tasks.workunit.client.0.smithi081.stdout:2/153: rmdir d1/d11/d21 39 2024-04-23T14:49:30.162 INFO:tasks.workunit.client.0.smithi081.stdout:2/154: dread - d1/d11/d21/f2a zero size 2024-04-23T14:49:30.162 INFO:tasks.workunit.client.0.smithi081.stdout:1/132: write d3/fa [3103286,79987] 0 2024-04-23T14:49:30.162 INFO:tasks.workunit.client.0.smithi081.stdout:2/155: chown d1/d11/d21 9382353 1 2024-04-23T14:49:30.165 INFO:tasks.workunit.client.0.smithi081.stdout:0/101: dread d6/d11/f13 [0,4194304] 0 2024-04-23T14:49:30.173 INFO:tasks.workunit.client.0.smithi081.stdout:5/129: unlink l2 0 2024-04-23T14:49:30.175 INFO:tasks.workunit.client.0.smithi081.stdout:6/120: symlink d1/l2d 0 2024-04-23T14:49:30.177 INFO:tasks.workunit.client.0.smithi081.stdout:8/127: stat d3/d11/c26 0 2024-04-23T14:49:30.177 INFO:tasks.workunit.client.0.smithi081.stdout:8/128: chown d3/l24 203676 1 2024-04-23T14:49:30.178 INFO:tasks.workunit.client.0.smithi081.stdout:7/101: mknod d3/d4/c1f 0 2024-04-23T14:49:30.180 INFO:tasks.workunit.client.0.smithi081.stdout:3/112: getdents d4/d7 0 2024-04-23T14:49:30.183 INFO:tasks.workunit.client.0.smithi081.stdout:4/82: symlink d1/d4/d11/l1c 0 2024-04-23T14:49:30.183 INFO:tasks.workunit.client.0.smithi081.stdout:4/83: chown d1/c17 17203 1 2024-04-23T14:49:30.185 INFO:tasks.workunit.client.0.smithi081.stdout:2/156: rmdir d1/d1e 39 2024-04-23T14:49:30.200 INFO:tasks.workunit.client.0.smithi081.stdout:1/133: dwrite d3/d15/d12/d1a/f23 [0,4194304] 0 2024-04-23T14:49:30.209 INFO:tasks.workunit.client.0.smithi081.stdout:0/102: mkdir d6/d11/d14/d19 0 2024-04-23T14:49:30.251 INFO:tasks.workunit.client.0.smithi081.stdout:2/157: dwrite d1/f32 [0,4194304] 0 2024-04-23T14:49:30.251 INFO:tasks.workunit.client.0.smithi081.stdout:2/158: readlink d1/d11/d21/d22/l2e 0 2024-04-23T14:49:30.251 INFO:tasks.workunit.client.0.smithi081.stdout:2/159: fsync d1/d11/d21/d22/f38 0 2024-04-23T14:49:30.256 INFO:tasks.workunit.client.0.smithi081.stdout:5/130: creat d17/d18/f2d x:0 0 0 2024-04-23T14:49:30.260 INFO:tasks.workunit.client.0.smithi081.stdout:6/121: mkdir d1/d11/d8/d2e 0 2024-04-23T14:49:30.262 INFO:tasks.workunit.client.0.smithi081.stdout:8/129: rename d3/d11/f19 to d3/f2a 0 2024-04-23T14:49:30.262 INFO:tasks.workunit.client.0.smithi081.stdout:8/130: write d3/f25 [440959,64786] 0 2024-04-23T14:49:30.265 INFO:tasks.workunit.client.0.smithi081.stdout:3/113: mknod d4/c26 0 2024-04-23T14:49:30.267 INFO:tasks.workunit.client.0.smithi081.stdout:0/103: dwrite d6/f9 [0,4194304] 0 2024-04-23T14:49:30.267 INFO:tasks.workunit.client.0.smithi081.stdout:0/104: dread - d6/fd zero size 2024-04-23T14:49:30.267 INFO:tasks.workunit.client.0.smithi081.stdout:0/105: fdatasync d6/ff 0 2024-04-23T14:49:30.267 INFO:tasks.workunit.client.0.smithi081.stdout:0/106: write d6/fd [779282,104575] 0 2024-04-23T14:49:30.267 INFO:tasks.workunit.client.0.smithi081.stdout:0/107: creat d6/d11/f1a x:0 0 0 2024-04-23T14:49:30.267 INFO:tasks.workunit.client.0.smithi081.stdout:0/108: write d6/f10 [1118437,23069] 0 2024-04-23T14:49:30.273 INFO:tasks.workunit.client.0.smithi081.stdout:1/134: creat d3/d15/d17/d26/f31 x:0 0 0 2024-04-23T14:49:30.273 INFO:tasks.workunit.client.0.smithi081.stdout:1/135: chown d3/l8 155 1 2024-04-23T14:49:30.297 INFO:tasks.workunit.client.0.smithi081.stdout:9/121: sync 2024-04-23T14:49:30.299 INFO:tasks.workunit.client.0.smithi081.stdout:8/131: mknod d3/d11/c2b 0 2024-04-23T14:49:30.301 INFO:tasks.workunit.client.0.smithi081.stdout:3/114: creat d4/d7/df/f27 x:0 0 0 2024-04-23T14:49:30.323 INFO:tasks.workunit.client.0.smithi081.stdout:0/109: mknod d6/d11/d14/d19/c1b 0 2024-04-23T14:49:30.333 INFO:tasks.workunit.client.0.smithi081.stdout:2/160: rmdir d1/d11 39 2024-04-23T14:49:30.337 INFO:tasks.workunit.client.0.smithi081.stdout:9/122: symlink d3/de/d22/l30 0 2024-04-23T14:49:30.337 INFO:tasks.workunit.client.0.smithi081.stdout:9/123: chown d3/d5 1 1 2024-04-23T14:49:30.337 INFO:tasks.workunit.client.0.smithi081.stdout:9/124: read d3/de/f27 [797488,91737] 0 2024-04-23T14:49:30.337 INFO:tasks.workunit.client.0.smithi081.stdout:9/125: dread - d3/de/d14/f2c zero size 2024-04-23T14:49:30.339 INFO:tasks.workunit.client.0.smithi081.stdout:5/131: rmdir d17/d1f 39 2024-04-23T14:49:30.339 INFO:tasks.workunit.client.0.smithi081.stdout:5/132: creat d17/d18/f2e x:0 0 0 2024-04-23T14:49:30.343 INFO:tasks.workunit.client.0.smithi081.stdout:3/115: creat d4/dc/f28 x:0 0 0 2024-04-23T14:49:30.345 INFO:tasks.workunit.client.0.smithi081.stdout:0/110: link d6/lc d6/l1c 0 2024-04-23T14:49:30.346 INFO:tasks.workunit.client.0.smithi081.stdout:1/136: getdents d3/d15 0 2024-04-23T14:49:30.349 INFO:tasks.workunit.client.0.smithi081.stdout:2/161: rename d1/d11/d21/d22/l35 to d1/d11/d21/l41 0 2024-04-23T14:49:30.349 INFO:tasks.workunit.client.0.smithi081.stdout:2/162: chown d1/d1e/c27 11344 1 2024-04-23T14:49:30.351 INFO:tasks.workunit.client.0.smithi081.stdout:9/126: creat d3/de/d1d/d2f/f31 x:0 0 0 2024-04-23T14:49:30.358 INFO:tasks.workunit.client.0.smithi081.stdout:5/133: link c16 d17/d1f/c2f 0 2024-04-23T14:49:30.359 INFO:tasks.workunit.client.0.smithi081.stdout:3/116: link d4/d7/d1a/c23 d4/d7/df/c29 0 2024-04-23T14:49:30.361 INFO:tasks.workunit.client.0.smithi081.stdout:0/111: symlink d6/d11/l1d 0 2024-04-23T14:49:30.365 INFO:tasks.workunit.client.0.smithi081.stdout:1/137: truncate f0 2864184 0 2024-04-23T14:49:30.367 INFO:tasks.workunit.client.0.smithi081.stdout:2/163: rename d1/d11/f3c to d1/d11/f42 0 2024-04-23T14:49:30.367 INFO:tasks.workunit.client.0.smithi081.stdout:2/164: fdatasync d1/d33/f37 0 2024-04-23T14:49:30.371 INFO:tasks.workunit.client.0.smithi081.stdout:9/127: rename d3/d1a/c13 to d3/c32 0 2024-04-23T14:49:30.371 INFO:tasks.workunit.client.0.smithi081.stdout:9/128: write d3/de/f2e [633236,25005] 0 2024-04-23T14:49:30.374 INFO:tasks.workunit.client.0.smithi081.stdout:3/117: creat d4/d7/f2a x:0 0 0 2024-04-23T14:49:30.377 INFO:tasks.workunit.client.0.smithi081.stdout:3/118: rename d4/la to d4/dc/d10/l2b 0 2024-04-23T14:49:30.377 INFO:tasks.workunit.client.0.smithi081.stdout:3/119: truncate d4/d7/df/f1b 5130098 0 2024-04-23T14:49:30.381 INFO:tasks.workunit.client.0.smithi081.stdout:3/120: mkdir d4/d7/d2c 0 2024-04-23T14:49:30.381 INFO:tasks.workunit.client.0.smithi081.stdout:3/121: chown d4/d7/df 30 1 2024-04-23T14:49:30.388 INFO:tasks.workunit.client.0.smithi081.stdout:0/112: dread f5 [0,4194304] 0 2024-04-23T14:49:30.394 INFO:tasks.workunit.client.0.smithi081.stdout:0/113: symlink d6/l1e 0 2024-04-23T14:49:30.410 INFO:tasks.workunit.client.0.smithi081.stdout:9/129: write d3/d1a/f17 [255209,18479] 0 2024-04-23T14:49:30.410 INFO:tasks.workunit.client.0.smithi081.stdout:9/130: chown d3/de 55303725 1 2024-04-23T14:49:30.413 INFO:tasks.workunit.client.0.smithi081.stdout:1/138: dwrite d3/d15/d12/f1c [0,4194304] 0 2024-04-23T14:49:30.413 INFO:tasks.workunit.client.0.smithi081.stdout:1/139: creat d3/d10/f32 x:0 0 0 2024-04-23T14:49:30.419 INFO:tasks.workunit.client.0.smithi081.stdout:4/84: rename d1/d16 to d1/d1d 0 2024-04-23T14:49:30.426 INFO:tasks.workunit.client.0.smithi081.stdout:8/132: dwrite d3/d11/f1d [4194304,4194304] 0 2024-04-23T14:49:30.431 INFO:tasks.workunit.client.0.smithi081.stdout:0/114: read d6/f9 [297020,37973] 0 2024-04-23T14:49:30.431 INFO:tasks.workunit.client.0.smithi081.stdout:0/115: write d6/d11/f13 [1556440,27420] 0 2024-04-23T14:49:30.431 INFO:tasks.workunit.client.0.smithi081.stdout:4/85: creat d1/f1e x:0 0 0 2024-04-23T14:49:30.431 INFO:tasks.workunit.client.0.smithi081.stdout:0/116: write d6/d11/d14/f16 [525087,57259] 0 2024-04-23T14:49:30.431 INFO:tasks.workunit.client.0.smithi081.stdout:4/86: chown d1/d4/dc/f14 204931 1 2024-04-23T14:49:30.431 INFO:tasks.workunit.client.0.smithi081.stdout:4/87: dread - d1/f1e zero size 2024-04-23T14:49:30.435 INFO:tasks.workunit.client.0.smithi081.stdout:2/165: dwrite d1/f5 [0,4194304] 0 2024-04-23T14:49:30.437 INFO:tasks.workunit.client.0.smithi081.stdout:1/140: dread d3/d15/d12/f1c [0,4194304] 0 2024-04-23T14:49:30.439 INFO:tasks.workunit.client.0.smithi081.stdout:2/166: write d1/f6 [71991,101742] 0 2024-04-23T14:49:30.439 INFO:tasks.workunit.client.0.smithi081.stdout:2/167: creat d1/f43 x:0 0 0 2024-04-23T14:49:30.445 INFO:tasks.workunit.client.0.smithi081.stdout:9/131: read f1 [819585,61533] 0 2024-04-23T14:49:30.446 INFO:tasks.workunit.client.0.smithi081.stdout:8/133: link d3/f25 d3/f2c 0 2024-04-23T14:49:30.446 INFO:tasks.workunit.client.0.smithi081.stdout:8/134: write f2 [5021271,2177] 0 2024-04-23T14:49:30.446 INFO:tasks.workunit.client.0.smithi081.stdout:0/117: unlink d6/d11/f1a 0 2024-04-23T14:49:30.446 INFO:tasks.workunit.client.0.smithi081.stdout:0/118: stat l3 0 2024-04-23T14:49:30.446 INFO:tasks.workunit.client.0.smithi081.stdout:0/119: write d6/fe [1084355,120668] 0 2024-04-23T14:49:30.447 INFO:tasks.workunit.client.0.smithi081.stdout:4/88: getdents d1/d4/d11 0 2024-04-23T14:49:30.459 INFO:tasks.workunit.client.0.smithi081.stdout:3/122: dwrite d4/d7/f2a [0,4194304] 0 2024-04-23T14:49:30.459 INFO:tasks.workunit.client.0.smithi081.stdout:3/123: chown d4/dc/d10/d1e 59045 1 2024-04-23T14:49:30.459 INFO:tasks.workunit.client.0.smithi081.stdout:3/124: stat d4/c5 0 2024-04-23T14:49:30.461 INFO:tasks.workunit.client.0.smithi081.stdout:2/168: dread d1/fe [0,4194304] 0 2024-04-23T14:49:30.464 INFO:tasks.workunit.client.0.smithi081.stdout:0/120: rename d6/fd to d6/d11/d14/d19/f1f 0 2024-04-23T14:49:30.464 INFO:tasks.workunit.client.0.smithi081.stdout:0/121: rename d6/d11/d14/d19 to d6/d11/d14/d19/d20 22 2024-04-23T14:49:30.467 INFO:tasks.workunit.client.0.smithi081.stdout:4/89: creat d1/d4/d11/f1f x:0 0 0 2024-04-23T14:49:30.467 INFO:tasks.workunit.client.0.smithi081.stdout:5/134: dwrite d17/f2a [0,4194304] 0 2024-04-23T14:49:30.467 INFO:tasks.workunit.client.0.smithi081.stdout:5/135: fdatasync d17/f26 0 2024-04-23T14:49:30.467 INFO:tasks.workunit.client.0.smithi081.stdout:5/136: write d17/d18/f2e [735801,12816] 0 2024-04-23T14:49:30.482 INFO:tasks.workunit.client.0.smithi081.stdout:2/169: symlink d1/d1e/l44 0 2024-04-23T14:49:30.488 INFO:tasks.workunit.client.0.smithi081.stdout:3/125: write d4/dc/d10/f18 [579683,42591] 0 2024-04-23T14:49:30.492 INFO:tasks.workunit.client.0.smithi081.stdout:4/90: unlink d1/d3/fe 0 2024-04-23T14:49:30.493 INFO:tasks.workunit.client.0.smithi081.stdout:4/91: chown d1/d4/dc/c15 7271011 1 2024-04-23T14:49:30.493 INFO:tasks.workunit.client.0.smithi081.stdout:4/92: truncate d1/d3/f8 4229209 0 2024-04-23T14:49:30.497 INFO:tasks.workunit.client.0.smithi081.stdout:9/132: dwrite d3/d5/f6 [0,4194304] 0 2024-04-23T14:49:30.497 INFO:tasks.workunit.client.0.smithi081.stdout:9/133: write d3/de/d1d/d2f/f31 [915843,81369] 0 2024-04-23T14:49:30.498 INFO:tasks.workunit.client.0.smithi081.stdout:9/134: chown d3/de/c1b 1 1 2024-04-23T14:49:30.498 INFO:tasks.workunit.client.0.smithi081.stdout:2/170: write d1/f32 [3902500,125807] 0 2024-04-23T14:49:30.498 INFO:tasks.workunit.client.0.smithi081.stdout:5/137: mknod d17/d18/c30 0 2024-04-23T14:49:30.499 INFO:tasks.workunit.client.0.smithi081.stdout:3/126: dread d4/f17 [0,4194304] 0 2024-04-23T14:49:30.508 INFO:tasks.workunit.client.0.smithi081.stdout:0/122: truncate d6/f9 3574353 0 2024-04-23T14:49:30.511 INFO:tasks.workunit.client.0.smithi081.stdout:4/93: read d1/d3/f8 [3470945,35255] 0 2024-04-23T14:49:30.512 INFO:tasks.workunit.client.0.smithi081.stdout:5/138: dread f8 [0,4194304] 0 2024-04-23T14:49:30.512 INFO:tasks.workunit.client.0.smithi081.stdout:9/135: mkdir d3/de/d25/d33 0 2024-04-23T14:49:30.512 INFO:tasks.workunit.client.0.smithi081.stdout:9/136: creat d3/de/d1d/d2f/f34 x:0 0 0 2024-04-23T14:49:30.516 INFO:tasks.workunit.client.0.smithi081.stdout:9/137: fsync d3/de/d1d/d2f/f31 0 2024-04-23T14:49:30.518 INFO:tasks.workunit.client.0.smithi081.stdout:3/127: rename d4/d7/d1a/l20 to d4/dc/l2d 0 2024-04-23T14:49:30.520 INFO:tasks.workunit.client.0.smithi081.stdout:0/123: symlink d6/l21 0 2024-04-23T14:49:30.520 INFO:tasks.workunit.client.0.smithi081.stdout:0/124: write d6/ff [4823511,72310] 0 2024-04-23T14:49:30.522 INFO:tasks.workunit.client.0.smithi081.stdout:1/141: write f0 [2776042,20270] 0 2024-04-23T14:49:30.522 INFO:tasks.workunit.client.0.smithi081.stdout:1/142: readlink d3/d10/l18 0 2024-04-23T14:49:30.529 INFO:tasks.workunit.client.0.smithi081.stdout:0/125: dread d6/d11/d14/d19/f1f [0,4194304] 0 2024-04-23T14:49:30.531 INFO:tasks.workunit.client.0.smithi081.stdout:2/171: rmdir d1/d33 39 2024-04-23T14:49:30.531 INFO:tasks.workunit.client.0.smithi081.stdout:2/172: write d1/d11/d21/f2a [131956,106807] 0 2024-04-23T14:49:30.531 INFO:tasks.workunit.client.0.smithi081.stdout:2/173: fsync d1/fa 0 2024-04-23T14:49:30.531 INFO:tasks.workunit.client.0.smithi081.stdout:2/174: write d1/d11/f12 [1070831,94000] 0 2024-04-23T14:49:30.539 INFO:tasks.workunit.client.0.smithi081.stdout:9/138: mknod d3/de/c35 0 2024-04-23T14:49:30.544 INFO:tasks.workunit.client.0.smithi081.stdout:3/128: unlink d4/dc/d10/d1e/l21 0 2024-04-23T14:49:30.551 INFO:tasks.workunit.client.0.smithi081.stdout:1/143: mknod d3/d15/d17/d26/c33 0 2024-04-23T14:49:30.554 INFO:tasks.workunit.client.0.smithi081.stdout:0/126: rename l1 to d6/d11/l22 0 2024-04-23T14:49:30.558 INFO:tasks.workunit.client.0.smithi081.stdout:3/129: mkdir d4/d7/d2e 0 2024-04-23T14:49:30.577 INFO:tasks.workunit.client.0.smithi081.stdout:5/139: dwrite f12 [0,4194304] 0 2024-04-23T14:49:30.583 INFO:tasks.workunit.client.0.smithi081.stdout:4/94: dwrite d1/fa [0,4194304] 0 2024-04-23T14:49:30.583 INFO:tasks.workunit.client.0.smithi081.stdout:2/175: dwrite d1/f2b [0,4194304] 0 2024-04-23T14:49:30.583 INFO:tasks.workunit.client.0.smithi081.stdout:2/176: truncate d1/f43 455860 0 2024-04-23T14:49:30.583 INFO:tasks.workunit.client.0.smithi081.stdout:2/177: stat d1/d11/d21 0 2024-04-23T14:49:30.583 INFO:tasks.workunit.client.0.smithi081.stdout:2/178: write d1/d11/f42 [209218,9197] 0 2024-04-23T14:49:30.584 INFO:tasks.workunit.client.0.smithi081.stdout:9/139: dwrite d3/d5/f6 [4194304,4194304] 0 2024-04-23T14:49:30.585 INFO:tasks.workunit.client.0.smithi081.stdout:5/140: creat d17/d1f/f31 x:0 0 0 2024-04-23T14:49:30.585 INFO:tasks.workunit.client.0.smithi081.stdout:5/141: creat d17/d18/f32 x:0 0 0 2024-04-23T14:49:30.591 INFO:tasks.workunit.client.0.smithi081.stdout:2/179: dread d1/d11/f28 [0,4194304] 0 2024-04-23T14:49:30.594 INFO:tasks.workunit.client.0.smithi081.stdout:4/95: rmdir d1/d4/dc 39 2024-04-23T14:49:30.600 INFO:tasks.workunit.client.0.smithi081.stdout:2/180: mkdir d1/d33/d45 0 2024-04-23T14:49:30.600 INFO:tasks.workunit.client.0.smithi081.stdout:2/181: fdatasync d1/f8 0 2024-04-23T14:49:30.622 INFO:tasks.workunit.client.0.smithi081.stdout:2/182: dread d1/fe [0,4194304] 0 2024-04-23T14:49:30.631 INFO:tasks.workunit.client.0.smithi081.stdout:2/183: creat d1/d33/d45/f46 x:0 0 0 2024-04-23T14:49:30.632 INFO:tasks.workunit.client.0.smithi081.stdout:0/127: dwrite d6/d11/d14/f16 [0,4194304] 0 2024-04-23T14:49:30.632 INFO:tasks.workunit.client.0.smithi081.stdout:0/128: fdatasync d6/fe 0 2024-04-23T14:49:30.641 INFO:tasks.workunit.client.0.smithi081.stdout:2/184: dread d1/fb [0,4194304] 0 2024-04-23T14:49:30.647 INFO:tasks.workunit.client.0.smithi081.stdout:2/185: dread d1/d11/f28 [0,4194304] 0 2024-04-23T14:49:30.649 INFO:tasks.workunit.client.0.smithi081.stdout:0/129: write d6/ff [1798292,43514] 0 2024-04-23T14:49:30.654 INFO:tasks.workunit.client.0.smithi081.stdout:2/186: truncate d1/f8 48741 0 2024-04-23T14:49:30.657 INFO:tasks.workunit.client.0.smithi081.stdout:5/142: dread f8 [0,4194304] 0 2024-04-23T14:49:30.657 INFO:tasks.workunit.client.0.smithi081.stdout:5/143: creat d17/d18/f33 x:0 0 0 2024-04-23T14:49:30.660 INFO:tasks.workunit.client.0.smithi081.stdout:5/144: creat d17/d18/f34 x:0 0 0 2024-04-23T14:49:30.660 INFO:tasks.workunit.client.0.smithi081.stdout:3/130: dwrite d4/f6 [0,4194304] 0 2024-04-23T14:49:30.661 INFO:tasks.workunit.client.0.smithi081.stdout:9/140: dwrite d3/d1a/fc [0,4194304] 0 2024-04-23T14:49:30.669 INFO:tasks.workunit.client.0.smithi081.stdout:5/145: link c16 d17/c35 0 2024-04-23T14:49:30.669 INFO:tasks.workunit.client.0.smithi081.stdout:5/146: fsync f8 0 2024-04-23T14:49:30.671 INFO:tasks.workunit.client.0.smithi081.stdout:3/131: link l1 d4/d7/d2c/l2f 0 2024-04-23T14:49:30.672 INFO:tasks.workunit.client.0.smithi081.stdout:0/130: write f5 [233624,2668] 0 2024-04-23T14:49:30.672 INFO:tasks.workunit.client.0.smithi081.stdout:0/131: chown d6/ff 278 1 2024-04-23T14:49:30.674 INFO:tasks.workunit.client.0.smithi081.stdout:4/96: dwrite d1/fa [4194304,4194304] 0 2024-04-23T14:49:30.686 INFO:tasks.workunit.client.0.smithi081.stdout:5/147: mkdir d17/d1f/d36 0 2024-04-23T14:49:30.687 INFO:tasks.workunit.client.0.smithi081.stdout:9/141: write d3/de/d1d/d2f/f31 [175145,13993] 0 2024-04-23T14:49:30.691 INFO:tasks.workunit.client.0.smithi081.stdout:3/132: mkdir d4/d7/df/d30 0 2024-04-23T14:49:30.691 INFO:tasks.workunit.client.0.smithi081.stdout:3/133: fdatasync d4/f6 0 2024-04-23T14:49:30.691 INFO:tasks.workunit.client.0.smithi081.stdout:3/134: dread - d4/dc/f28 zero size 2024-04-23T14:49:30.700 INFO:tasks.workunit.client.0.smithi081.stdout:4/97: creat d1/d1d/f20 x:0 0 0 2024-04-23T14:49:30.700 INFO:tasks.workunit.client.0.smithi081.stdout:4/98: chown d1/fa 2 1 2024-04-23T14:49:30.700 INFO:tasks.workunit.client.0.smithi081.stdout:4/99: fsync d1/d4/d11/f1f 0 2024-04-23T14:49:30.700 INFO:tasks.workunit.client.0.smithi081.stdout:4/100: chown d1/d3/lb 16520326 1 2024-04-23T14:49:30.705 INFO:tasks.workunit.client.0.smithi081.stdout:1/144: rmdir d3 39 2024-04-23T14:49:30.705 INFO:tasks.workunit.client.0.smithi081.stdout:1/145: stat d3/d15/d17/d25/f30 0 2024-04-23T14:49:30.705 INFO:tasks.workunit.client.0.smithi081.stdout:1/146: dread - d3/d10/f32 zero size 2024-04-23T14:49:30.708 INFO:tasks.workunit.client.0.smithi081.stdout:2/187: dwrite d1/f4 [0,4194304] 0 2024-04-23T14:49:30.711 INFO:tasks.workunit.client.0.smithi081.stdout:0/132: dwrite d6/d11/f13 [0,4194304] 0 2024-04-23T14:49:30.718 INFO:tasks.workunit.client.0.smithi081.stdout:5/148: unlink f9 0 2024-04-23T14:49:30.720 INFO:tasks.workunit.client.0.smithi081.stdout:5/149: write f14 [356031,118046] 0 2024-04-23T14:49:30.723 INFO:tasks.workunit.client.0.smithi081.stdout:9/142: mknod d3/de/d22/c36 0 2024-04-23T14:49:30.725 INFO:tasks.workunit.client.0.smithi081.stdout:2/188: creat d1/d11/d21/d34/f47 x:0 0 0 2024-04-23T14:49:30.726 INFO:tasks.workunit.client.0.smithi081.stdout:2/189: fdatasync d1/f8 0 2024-04-23T14:49:30.726 INFO:tasks.workunit.client.0.smithi081.stdout:2/190: chown d1/d11/l14 0 1 2024-04-23T14:49:30.726 INFO:tasks.workunit.client.0.smithi081.stdout:2/191: write d1/d11/f12 [1210973,77093] 0 2024-04-23T14:49:30.732 INFO:tasks.workunit.client.0.smithi081.stdout:0/133: mknod d6/d11/c23 0 2024-04-23T14:49:30.733 INFO:tasks.workunit.client.0.smithi081.stdout:5/150: dread f4 [0,4194304] 0 2024-04-23T14:49:30.735 INFO:tasks.workunit.client.0.smithi081.stdout:9/143: mknod d3/d1a/c37 0 2024-04-23T14:49:30.735 INFO:tasks.workunit.client.0.smithi081.stdout:9/144: stat d3/d1a 0 2024-04-23T14:49:30.735 INFO:tasks.workunit.client.0.smithi081.stdout:9/145: getdents d3/d5 0 2024-04-23T14:49:30.735 INFO:tasks.workunit.client.0.smithi081.stdout:9/146: fsync d3/f11 0 2024-04-23T14:49:30.741 INFO:tasks.workunit.client.0.smithi081.stdout:5/151: mkdir d17/d37 0 2024-04-23T14:49:30.745 INFO:tasks.workunit.client.0.smithi081.stdout:2/192: dread d1/f2b [0,4194304] 0 2024-04-23T14:49:30.745 INFO:tasks.workunit.client.0.smithi081.stdout:9/147: rename d3/f11 to d3/de/d14/f38 0 2024-04-23T14:49:30.745 INFO:tasks.workunit.client.0.smithi081.stdout:2/193: chown d1/d1e/l3e 7841 1 2024-04-23T14:49:30.749 INFO:tasks.workunit.client.0.smithi081.stdout:9/148: write d3/de/f24 [714753,118174] 0 2024-04-23T14:49:30.752 INFO:tasks.workunit.client.0.smithi081.stdout:4/101: dread d1/f9 [4194304,4194304] 0 2024-04-23T14:49:30.752 INFO:tasks.workunit.client.0.smithi081.stdout:4/102: dread - d1/f1e zero size 2024-04-23T14:49:30.754 INFO:tasks.workunit.client.0.smithi081.stdout:0/134: dread d6/f10 [0,4194304] 0 2024-04-23T14:49:30.758 INFO:tasks.workunit.client.0.smithi081.stdout:3/135: dwrite d4/dc/d10/f1f [0,4194304] 0 2024-04-23T14:49:30.763 INFO:tasks.workunit.client.0.smithi081.stdout:1/147: dread d3/f6 [0,4194304] 0 2024-04-23T14:49:30.767 INFO:tasks.workunit.client.0.smithi081.stdout:1/148: mkdir d3/d15/d12/d34 0 2024-04-23T14:49:30.767 INFO:tasks.workunit.client.0.smithi081.stdout:0/135: dread d6/d11/d14/f15 [0,4194304] 0 2024-04-23T14:49:30.768 INFO:tasks.workunit.client.0.smithi081.stdout:3/136: getdents d4/dc 0 2024-04-23T14:49:30.768 INFO:tasks.workunit.client.0.smithi081.stdout:3/137: write d4/dc/f28 [339406,31284] 0 2024-04-23T14:49:30.770 INFO:tasks.workunit.client.0.smithi081.stdout:0/136: truncate d6/d11/d14/f15 324523 0 2024-04-23T14:49:30.770 INFO:tasks.workunit.client.0.smithi081.stdout:0/137: write d6/f9 [3793881,130955] 0 2024-04-23T14:49:30.771 INFO:tasks.workunit.client.0.smithi081.stdout:4/103: dread d1/d4/dc/f14 [0,4194304] 0 2024-04-23T14:49:30.772 INFO:tasks.workunit.client.0.smithi081.stdout:1/149: mknod d3/d15/d17/d25/c35 0 2024-04-23T14:49:30.773 INFO:tasks.workunit.client.0.smithi081.stdout:3/138: mkdir d4/dc/d31 0 2024-04-23T14:49:30.774 INFO:tasks.workunit.client.0.smithi081.stdout:0/138: rename d6/d11/d14/d19 to d6/d11/d14/d24 0 2024-04-23T14:49:30.776 INFO:tasks.workunit.client.0.smithi081.stdout:3/139: mkdir d4/d7/d32 0 2024-04-23T14:49:30.778 INFO:tasks.workunit.client.0.smithi081.stdout:3/140: truncate f3 924882 0 2024-04-23T14:49:30.813 INFO:tasks.workunit.client.0.smithi081.stdout:5/152: dwrite d17/d1f/f22 [0,4194304] 0 2024-04-23T14:49:30.813 INFO:tasks.workunit.client.0.smithi081.stdout:5/153: fdatasync d17/d1f/f23 0 2024-04-23T14:49:30.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:30 smithi081 ceph-mon[25540]: pgmap v24: 65 pgs: 65 active+clean; 391 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 19 MiB/s rd, 26 MiB/s wr, 512 op/s 2024-04-23T14:49:30.853 INFO:tasks.workunit.client.0.smithi081.stdout:7/102: sync 2024-04-23T14:49:30.855 INFO:tasks.workunit.client.0.smithi081.stdout:4/104: dread d1/f9 [0,4194304] 0 2024-04-23T14:49:30.856 INFO:tasks.workunit.client.0.smithi081.stdout:9/149: getdents d3/de/d14 0 2024-04-23T14:49:30.856 INFO:tasks.workunit.client.0.smithi081.stdout:9/150: fdatasync d3/de/d14/f38 0 2024-04-23T14:49:30.860 INFO:tasks.workunit.client.0.smithi081.stdout:1/150: read d3/f5 [458053,130273] 0 2024-04-23T14:49:30.861 INFO:tasks.workunit.client.0.smithi081.stdout:2/194: dwrite d1/f1c [0,4194304] 0 2024-04-23T14:49:30.861 INFO:tasks.workunit.client.0.smithi081.stdout:9/151: creat d3/de/d22/f39 x:0 0 0 2024-04-23T14:49:30.873 INFO:tasks.workunit.client.0.smithi081.stdout:1/151: unlink d3/d15/d17/d26/c33 0 2024-04-23T14:49:30.873 INFO:tasks.workunit.client.0.smithi081.stdout:9/152: dread d3/de/d1d/f20 [0,4194304] 0 2024-04-23T14:49:30.873 INFO:tasks.workunit.client.0.smithi081.stdout:2/195: mkdir d1/d33/d45/d48 0 2024-04-23T14:49:30.876 INFO:tasks.workunit.client.0.smithi081.stdout:9/153: unlink d3/de/d22/c26 0 2024-04-23T14:49:30.881 INFO:tasks.workunit.client.0.smithi081.stdout:2/196: symlink d1/d1e/l49 0 2024-04-23T14:49:30.881 INFO:tasks.workunit.client.0.smithi081.stdout:4/105: write d1/fa [2776571,28188] 0 2024-04-23T14:49:30.881 INFO:tasks.workunit.client.0.smithi081.stdout:4/106: stat d1/d4/dc/c15 0 2024-04-23T14:49:30.881 INFO:tasks.workunit.client.0.smithi081.stdout:5/154: dwrite d17/f21 [0,4194304] 0 2024-04-23T14:49:30.890 INFO:tasks.workunit.client.0.smithi081.stdout:4/107: unlink d1/d3/lb 0 2024-04-23T14:49:30.891 INFO:tasks.workunit.client.0.smithi081.stdout:1/152: dread d3/f5 [0,4194304] 0 2024-04-23T14:49:30.893 INFO:tasks.workunit.client.0.smithi081.stdout:1/153: symlink d3/d15/d1d/l36 0 2024-04-23T14:49:30.895 INFO:tasks.workunit.client.0.smithi081.stdout:9/154: dread d3/f9 [0,4194304] 0 2024-04-23T14:49:30.895 INFO:tasks.workunit.client.0.smithi081.stdout:9/155: creat d3/f3a x:0 0 0 2024-04-23T14:49:30.895 INFO:tasks.workunit.client.0.smithi081.stdout:4/108: creat d1/d4/dc/f21 x:0 0 0 2024-04-23T14:49:30.895 INFO:tasks.workunit.client.0.smithi081.stdout:4/109: readlink d1/d4/d11/l1c 0 2024-04-23T14:49:30.896 INFO:tasks.workunit.client.0.smithi081.stdout:4/110: creat d1/d1d/f22 x:0 0 0 2024-04-23T14:49:30.896 INFO:tasks.workunit.client.0.smithi081.stdout:5/155: dread f14 [0,4194304] 0 2024-04-23T14:49:30.897 INFO:tasks.workunit.client.0.smithi081.stdout:1/154: symlink d3/d15/d17/d25/l37 0 2024-04-23T14:49:30.901 INFO:tasks.workunit.client.0.smithi081.stdout:8/135: sync 2024-04-23T14:49:30.901 INFO:tasks.workunit.client.0.smithi081.stdout:6/122: sync 2024-04-23T14:49:30.902 INFO:tasks.workunit.client.0.smithi081.stdout:8/136: chown d3/l1f 15 1 2024-04-23T14:49:30.902 INFO:tasks.workunit.client.0.smithi081.stdout:6/123: truncate d1/d2/f21 907858 0 2024-04-23T14:49:30.903 INFO:tasks.workunit.client.0.smithi081.stdout:4/111: creat d1/d4/f23 x:0 0 0 2024-04-23T14:49:30.903 INFO:tasks.workunit.client.0.smithi081.stdout:4/112: write d1/d4/f23 [505938,50150] 0 2024-04-23T14:49:30.906 INFO:tasks.workunit.client.0.smithi081.stdout:5/156: link d17/d18/f2d d17/f38 0 2024-04-23T14:49:30.907 INFO:tasks.workunit.client.0.smithi081.stdout:6/124: creat d1/d11/d8/d2e/f2f x:0 0 0 2024-04-23T14:49:30.911 INFO:tasks.workunit.client.0.smithi081.stdout:6/125: rename d1/d11/d8/f29 to d1/d11/d8/f30 0 2024-04-23T14:49:30.914 INFO:tasks.workunit.client.0.smithi081.stdout:5/157: creat d17/d1f/d36/f39 x:0 0 0 2024-04-23T14:49:30.915 INFO:tasks.workunit.client.0.smithi081.stdout:1/155: dread f1 [0,4194304] 0 2024-04-23T14:49:30.918 INFO:tasks.workunit.client.0.smithi081.stdout:3/141: dread f3 [0,4194304] 0 2024-04-23T14:49:30.918 INFO:tasks.workunit.client.0.smithi081.stdout:3/142: stat d4/d7/df/f1b 0 2024-04-23T14:49:30.918 INFO:tasks.workunit.client.0.smithi081.stdout:3/143: getdents d4/d7/df/d30 0 2024-04-23T14:49:30.918 INFO:tasks.workunit.client.0.smithi081.stdout:3/144: fsync d4/d7/df/f19 0 2024-04-23T14:49:30.920 INFO:tasks.workunit.client.0.smithi081.stdout:2/197: dread d1/f1c [0,4194304] 0 2024-04-23T14:49:30.920 INFO:tasks.workunit.client.0.smithi081.stdout:2/198: write d1/d11/f29 [155145,69777] 0 2024-04-23T14:49:30.920 INFO:tasks.workunit.client.0.smithi081.stdout:2/199: write d1/d11/d21/f3b [4251973,40021] 0 2024-04-23T14:49:30.920 INFO:tasks.workunit.client.0.smithi081.stdout:2/200: chown d1/d11/d21/d22/l2f 9184504 1 2024-04-23T14:49:30.921 INFO:tasks.workunit.client.0.smithi081.stdout:5/158: mkdir d17/d18/d3a 0 2024-04-23T14:49:30.923 INFO:tasks.workunit.client.0.smithi081.stdout:7/103: dwrite d3/d4/fd [0,4194304] 0 2024-04-23T14:49:30.926 INFO:tasks.workunit.client.0.smithi081.stdout:3/145: creat d4/d7/d32/f33 x:0 0 0 2024-04-23T14:49:30.926 INFO:tasks.workunit.client.0.smithi081.stdout:6/126: getdents d1/d11/d13/d16/d1b 0 2024-04-23T14:49:30.926 INFO:tasks.workunit.client.0.smithi081.stdout:3/146: fdatasync d4/dc/d10/f18 0 2024-04-23T14:49:30.926 INFO:tasks.workunit.client.0.smithi081.stdout:6/127: write d1/d11/d13/d16/f19 [3697750,73522] 0 2024-04-23T14:49:30.930 INFO:tasks.workunit.client.0.smithi081.stdout:2/201: rename d1/d11/f20 to d1/d33/d45/f4a 0 2024-04-23T14:49:30.930 INFO:tasks.workunit.client.0.smithi081.stdout:2/202: creat d1/d11/d21/d34/f4b x:0 0 0 2024-04-23T14:49:30.934 INFO:tasks.workunit.client.0.smithi081.stdout:5/159: symlink d17/d37/l3b 0 2024-04-23T14:49:30.953 INFO:tasks.workunit.client.0.smithi081.stdout:3/147: link d4/dc/d10/l2b d4/d7/df/d30/l34 0 2024-04-23T14:49:30.953 INFO:tasks.workunit.client.0.smithi081.stdout:3/148: creat d4/d7/df/f35 x:0 0 0 2024-04-23T14:49:30.960 INFO:tasks.workunit.client.0.smithi081.stdout:2/203: rename d1/d11/d21/d22/c3a to d1/c4c 0 2024-04-23T14:49:30.960 INFO:tasks.workunit.client.0.smithi081.stdout:2/204: creat d1/d33/d45/f4d x:0 0 0 2024-04-23T14:49:30.969 INFO:tasks.workunit.client.0.smithi081.stdout:2/205: mknod d1/d11/d21/d22/c4e 0 2024-04-23T14:49:30.969 INFO:tasks.workunit.client.0.smithi081.stdout:2/206: readlink d1/d1e/l39 0 2024-04-23T14:49:30.977 INFO:tasks.workunit.client.0.smithi081.stdout:3/149: write d4/d7/df/f19 [1466257,5403] 0 2024-04-23T14:49:30.977 INFO:tasks.workunit.client.0.smithi081.stdout:3/150: getdents d4/dc/d31 0 2024-04-23T14:49:30.981 INFO:tasks.workunit.client.0.smithi081.stdout:7/104: dwrite d3/f5 [0,4194304] 0 2024-04-23T14:49:30.991 INFO:tasks.workunit.client.0.smithi081.stdout:3/151: mknod d4/dc/d10/c36 0 2024-04-23T14:49:30.996 INFO:tasks.workunit.client.0.smithi081.stdout:3/152: unlink d4/d7/df/l22 0 2024-04-23T14:49:30.996 INFO:tasks.workunit.client.0.smithi081.stdout:3/153: chown d4/d7/df 3 1 2024-04-23T14:49:31.020 INFO:tasks.workunit.client.0.smithi081.stdout:8/137: dwrite d3/f27 [0,4194304] 0 2024-04-23T14:49:31.020 INFO:tasks.workunit.client.0.smithi081.stdout:8/138: stat d3/d11/f1d 0 2024-04-23T14:49:31.020 INFO:tasks.workunit.client.0.smithi081.stdout:8/139: write d3/f2a [64275,57891] 0 2024-04-23T14:49:31.021 INFO:tasks.workunit.client.0.smithi081.stdout:3/154: truncate d4/d7/f2a 4097335 0 2024-04-23T14:49:31.021 INFO:tasks.workunit.client.0.smithi081.stdout:3/155: chown d4/d7/cb 346 1 2024-04-23T14:49:31.025 INFO:tasks.workunit.client.0.smithi081.stdout:9/156: dwrite d3/f3a [0,4194304] 0 2024-04-23T14:49:31.025 INFO:tasks.workunit.client.0.smithi081.stdout:1/156: dwrite d3/f5 [0,4194304] 0 2024-04-23T14:49:31.029 INFO:tasks.workunit.client.0.smithi081.stdout:6/128: fsync d1/d11/d8/f30 0 2024-04-23T14:49:31.034 INFO:tasks.workunit.client.0.smithi081.stdout:8/140: unlink d3/f10 0 2024-04-23T14:49:31.038 INFO:tasks.workunit.client.0.smithi081.stdout:2/207: dwrite d1/d33/d45/f46 [0,4194304] 0 2024-04-23T14:49:31.038 INFO:tasks.workunit.client.0.smithi081.stdout:2/208: write d1/f6 [1746094,95515] 0 2024-04-23T14:49:31.038 INFO:tasks.workunit.client.0.smithi081.stdout:2/209: stat d1/fa 0 2024-04-23T14:49:31.041 INFO:tasks.workunit.client.0.smithi081.stdout:3/156: symlink d4/dc/d10/d1e/l37 0 2024-04-23T14:49:31.042 INFO:tasks.workunit.client.0.smithi081.stdout:3/157: write d4/dc/d10/f18 [1869747,4171] 0 2024-04-23T14:49:31.048 INFO:tasks.workunit.client.0.smithi081.stdout:4/113: dwrite d1/d4/d11/f1f [0,4194304] 0 2024-04-23T14:49:31.048 INFO:tasks.workunit.client.0.smithi081.stdout:1/157: unlink d3/ce 0 2024-04-23T14:49:31.048 INFO:tasks.workunit.client.0.smithi081.stdout:1/158: dread - d3/d10/f32 zero size 2024-04-23T14:49:31.048 INFO:tasks.workunit.client.0.smithi081.stdout:5/160: rmdir d17 39 2024-04-23T14:49:31.057 INFO:tasks.workunit.client.0.smithi081.stdout:7/105: dwrite d3/d11/f18 [0,4194304] 0 2024-04-23T14:49:31.057 INFO:tasks.workunit.client.0.smithi081.stdout:7/106: write d3/fb [185802,71857] 0 2024-04-23T14:49:31.057 INFO:tasks.workunit.client.0.smithi081.stdout:7/107: dread - d3/f10 zero size 2024-04-23T14:49:31.057 INFO:tasks.workunit.client.0.smithi081.stdout:7/108: fdatasync d3/f10 0 2024-04-23T14:49:31.064 INFO:tasks.workunit.client.0.smithi081.stdout:2/210: creat d1/d11/d21/f4f x:0 0 0 2024-04-23T14:49:31.064 INFO:tasks.workunit.client.0.smithi081.stdout:3/158: dread d4/dc/f28 [0,4194304] 0 2024-04-23T14:49:31.076 INFO:tasks.workunit.client.0.smithi081.stdout:1/159: rename d3/d15/d1d/l2f to d3/d1b/l38 0 2024-04-23T14:49:31.079 INFO:tasks.workunit.client.0.smithi081.stdout:8/141: dwrite d3/d1a/f1e [0,4194304] 0 2024-04-23T14:49:31.079 INFO:tasks.workunit.client.0.smithi081.stdout:8/142: read d3/f2a [98060,130057] 0 2024-04-23T14:49:31.081 INFO:tasks.workunit.client.0.smithi081.stdout:5/161: mkdir d17/d3c 0 2024-04-23T14:49:31.081 INFO:tasks.workunit.client.0.smithi081.stdout:5/162: write d17/d18/f32 [196424,98873] 0 2024-04-23T14:49:31.081 INFO:tasks.workunit.client.0.smithi081.stdout:2/211: dread d1/f2b [0,4194304] 0 2024-04-23T14:49:31.082 INFO:tasks.workunit.client.0.smithi081.stdout:8/143: write d3/f25 [204047,106189] 0 2024-04-23T14:49:31.082 INFO:tasks.workunit.client.0.smithi081.stdout:9/157: dwrite d3/f8 [0,4194304] 0 2024-04-23T14:49:31.082 INFO:tasks.workunit.client.0.smithi081.stdout:9/158: stat d3/d1a/f17 0 2024-04-23T14:49:31.093 INFO:tasks.workunit.client.0.smithi081.stdout:3/159: mkdir d4/dc/d10/d1e/d38 0 2024-04-23T14:49:31.097 INFO:tasks.workunit.client.0.smithi081.stdout:7/109: rename d3/d11/d15/d19/d1d to d3/d20 0 2024-04-23T14:49:31.098 INFO:tasks.workunit.client.0.smithi081.stdout:7/110: write d3/f10 [766345,124661] 0 2024-04-23T14:49:31.098 INFO:tasks.workunit.client.0.smithi081.stdout:7/111: fsync d3/d4/fd 0 2024-04-23T14:49:31.111 INFO:tasks.workunit.client.0.smithi081.stdout:6/129: rmdir d1/d11/d13/d16/d1b 0 2024-04-23T14:49:31.112 INFO:tasks.workunit.client.0.smithi081.stdout:5/163: write d17/d1f/f31 [613434,67094] 0 2024-04-23T14:49:31.112 INFO:tasks.workunit.client.0.smithi081.stdout:5/164: truncate d17/d18/f2d 75250 0 2024-04-23T14:49:31.113 INFO:tasks.workunit.client.0.smithi081.stdout:2/212: link d1/c24 d1/d11/d21/d22/c50 0 2024-04-23T14:49:31.117 INFO:tasks.workunit.client.0.smithi081.stdout:8/144: symlink d3/l2d 0 2024-04-23T14:49:31.117 INFO:tasks.workunit.client.0.smithi081.stdout:8/145: creat d3/d11/f2e x:0 0 0 2024-04-23T14:49:31.123 INFO:tasks.workunit.client.0.smithi081.stdout:3/160: mknod d4/d7/d2e/c39 0 2024-04-23T14:49:31.126 INFO:tasks.workunit.client.0.smithi081.stdout:7/112: unlink d3/d11/c16 0 2024-04-23T14:49:31.126 INFO:tasks.workunit.client.0.smithi081.stdout:4/114: dwrite d1/d4/d11/f1f [0,4194304] 0 2024-04-23T14:49:31.126 INFO:tasks.workunit.client.0.smithi081.stdout:7/113: stat d3/f10 0 2024-04-23T14:49:31.137 INFO:tasks.workunit.client.0.smithi081.stdout:8/146: write f1 [2763229,112542] 0 2024-04-23T14:49:31.140 INFO:tasks.workunit.client.0.smithi081.stdout:8/147: fsync d3/f25 0 2024-04-23T14:49:31.147 INFO:tasks.workunit.client.0.smithi081.stdout:6/130: symlink d1/d11/d13/d16/l31 0 2024-04-23T14:49:31.147 INFO:tasks.workunit.client.0.smithi081.stdout:9/159: dwrite d3/de/d22/f39 [0,4194304] 0 2024-04-23T14:49:31.147 INFO:tasks.workunit.client.0.smithi081.stdout:1/160: dwrite d3/d10/f32 [0,4194304] 0 2024-04-23T14:49:31.147 INFO:tasks.workunit.client.0.smithi081.stdout:1/161: stat d3/d15/d12/d1a/c28 0 2024-04-23T14:49:31.147 INFO:tasks.workunit.client.0.smithi081.stdout:1/162: write d3/f6 [9218520,107152] 0 2024-04-23T14:49:31.147 INFO:tasks.workunit.client.0.smithi081.stdout:3/161: dread d4/dc/d10/f1f [0,4194304] 0 2024-04-23T14:49:31.149 INFO:tasks.workunit.client.0.smithi081.stdout:5/165: rmdir d17/d37 39 2024-04-23T14:49:31.152 INFO:tasks.workunit.client.0.smithi081.stdout:2/213: creat d1/d33/d45/d48/f51 x:0 0 0 2024-04-23T14:49:31.159 INFO:tasks.workunit.client.0.smithi081.stdout:4/115: link d1/c17 d1/d1d/c24 0 2024-04-23T14:49:31.168 INFO:tasks.workunit.client.0.smithi081.stdout:8/148: truncate f2 2869273 0 2024-04-23T14:49:31.168 INFO:tasks.workunit.client.0.smithi081.stdout:8/149: fdatasync d3/d1a/f22 0 2024-04-23T14:49:31.168 INFO:tasks.workunit.client.0.smithi081.stdout:8/150: creat d3/f2f x:0 0 0 2024-04-23T14:49:31.168 INFO:tasks.workunit.client.0.smithi081.stdout:8/151: chown d3/d1a 153899965 1 2024-04-23T14:49:31.168 INFO:tasks.workunit.client.0.smithi081.stdout:8/152: readlink d3/l2d 0 2024-04-23T14:49:31.168 INFO:tasks.workunit.client.0.smithi081.stdout:8/153: creat d3/d1a/f30 x:0 0 0 2024-04-23T14:49:31.168 INFO:tasks.workunit.client.0.smithi081.stdout:8/154: creat d3/f31 x:0 0 0 2024-04-23T14:49:31.168 INFO:tasks.workunit.client.0.smithi081.stdout:8/155: dread - d3/d11/f2e zero size 2024-04-23T14:49:31.168 INFO:tasks.workunit.client.0.smithi081.stdout:8/156: stat d3/f2f 0 2024-04-23T14:49:31.180 INFO:tasks.workunit.client.0.smithi081.stdout:2/214: read d1/fb [985068,97524] 0 2024-04-23T14:49:31.180 INFO:tasks.workunit.client.0.smithi081.stdout:6/131: dread d1/d2/f1d [0,4194304] 0 2024-04-23T14:49:31.180 INFO:tasks.workunit.client.0.smithi081.stdout:6/132: fdatasync d1/d2/f1d 0 2024-04-23T14:49:31.180 INFO:tasks.workunit.client.0.smithi081.stdout:6/133: creat d1/d11/d13/d16/f32 x:0 0 0 2024-04-23T14:49:31.183 INFO:tasks.workunit.client.0.smithi081.stdout:9/160: rename d3/de/c2d to d3/de/d1d/c3b 0 2024-04-23T14:49:31.190 INFO:tasks.workunit.client.0.smithi081.stdout:3/162: creat d4/dc/d10/d1e/d38/f3a x:0 0 0 2024-04-23T14:49:31.190 INFO:tasks.workunit.client.0.smithi081.stdout:3/163: chown d4/d7/d2c 161555620 1 2024-04-23T14:49:31.190 INFO:tasks.workunit.client.0.smithi081.stdout:3/164: truncate d4/f17 1355611 0 2024-04-23T14:49:31.192 INFO:tasks.workunit.client.0.smithi081.stdout:5/166: stat d17/c1a 0 2024-04-23T14:49:31.195 INFO:tasks.workunit.client.0.smithi081.stdout:4/116: mknod d1/c25 0 2024-04-23T14:49:31.195 INFO:tasks.workunit.client.0.smithi081.stdout:4/117: dread - d1/d1d/f22 zero size 2024-04-23T14:49:31.197 INFO:tasks.workunit.client.0.smithi081.stdout:0/139: sync 2024-04-23T14:49:31.202 INFO:tasks.workunit.client.0.smithi081.stdout:8/157: symlink d3/d1a/l32 0 2024-04-23T14:49:31.202 INFO:tasks.workunit.client.0.smithi081.stdout:8/158: write d3/f31 [824118,26630] 0 2024-04-23T14:49:31.203 INFO:tasks.workunit.client.0.smithi081.stdout:1/163: dwrite d3/d15/d17/d26/f2d [0,4194304] 0 2024-04-23T14:49:31.204 INFO:tasks.workunit.client.0.smithi081.stdout:7/114: dwrite d3/d4/f9 [4194304,4194304] 0 2024-04-23T14:49:31.206 INFO:tasks.workunit.client.0.smithi081.stdout:2/215: mkdir d1/d11/d21/d52 0 2024-04-23T14:49:31.206 INFO:tasks.workunit.client.0.smithi081.stdout:6/134: truncate d1/d2/f21 626784 0 2024-04-23T14:49:31.214 INFO:tasks.workunit.client.0.smithi081.stdout:9/161: creat d3/de/d14/f3c x:0 0 0 2024-04-23T14:49:31.214 INFO:tasks.workunit.client.0.smithi081.stdout:9/162: fdatasync d3/d1a/f17 0 2024-04-23T14:49:31.215 INFO:tasks.workunit.client.0.smithi081.stdout:8/159: fsync f2 0 2024-04-23T14:49:31.215 INFO:tasks.workunit.client.0.smithi081.stdout:3/165: creat d4/dc/f3b x:0 0 0 2024-04-23T14:49:31.215 INFO:tasks.workunit.client.0.smithi081.stdout:3/166: dread - d4/dc/d10/d1e/d38/f3a zero size 2024-04-23T14:49:31.215 INFO:tasks.workunit.client.0.smithi081.stdout:3/167: write d4/dc/d10/d1e/d38/f3a [311900,11723] 0 2024-04-23T14:49:31.215 INFO:tasks.workunit.client.0.smithi081.stdout:4/118: link d1/d1d/f20 d1/d1d/f26 0 2024-04-23T14:49:31.216 INFO:tasks.workunit.client.0.smithi081.stdout:4/119: creat d1/d4/f27 x:0 0 0 2024-04-23T14:49:31.216 INFO:tasks.workunit.client.0.smithi081.stdout:4/120: write d1/fa [169701,118855] 0 2024-04-23T14:49:31.216 INFO:tasks.workunit.client.0.smithi081.stdout:4/121: chown d1/f9 2200 1 2024-04-23T14:49:31.216 INFO:tasks.workunit.client.0.smithi081.stdout:4/122: creat d1/d4/d11/f28 x:0 0 0 2024-04-23T14:49:31.217 INFO:tasks.workunit.client.0.smithi081.stdout:0/140: mkdir d6/d25 0 2024-04-23T14:49:31.222 INFO:tasks.workunit.client.0.smithi081.stdout:5/167: write d17/f2a [3032765,18757] 0 2024-04-23T14:49:31.224 INFO:tasks.workunit.client.0.smithi081.stdout:7/115: mkdir d3/d21 0 2024-04-23T14:49:31.227 INFO:tasks.workunit.client.0.smithi081.stdout:2/216: symlink d1/d1e/l53 0 2024-04-23T14:49:31.229 INFO:tasks.workunit.client.0.smithi081.stdout:8/160: mknod d3/c33 0 2024-04-23T14:49:31.232 INFO:tasks.workunit.client.0.smithi081.stdout:0/141: read d6/d11/d14/f15 [272359,92553] 0 2024-04-23T14:49:31.233 INFO:tasks.workunit.client.0.smithi081.stdout:3/168: mknod d4/d7/d32/c3c 0 2024-04-23T14:49:31.239 INFO:tasks.workunit.client.0.smithi081.stdout:3/169: write d4/f12 [335507,73001] 0 2024-04-23T14:49:31.239 INFO:tasks.workunit.client.0.smithi081.stdout:3/170: stat d4/d7/cb 0 2024-04-23T14:49:31.239 INFO:tasks.workunit.client.0.smithi081.stdout:3/171: truncate d4/f12 1383426 0 2024-04-23T14:49:31.249 INFO:tasks.workunit.client.0.smithi081.stdout:5/168: mkdir d17/d3d 0 2024-04-23T14:49:31.251 INFO:tasks.workunit.client.0.smithi081.stdout:6/135: dread d1/d2/f1d [0,4194304] 0 2024-04-23T14:49:31.253 INFO:tasks.workunit.client.0.smithi081.stdout:7/116: unlink d3/d4/c17 0 2024-04-23T14:49:31.255 INFO:tasks.workunit.client.0.smithi081.stdout:2/217: symlink d1/d11/d21/d22/l54 0 2024-04-23T14:49:31.262 INFO:tasks.workunit.client.0.smithi081.stdout:8/161: mkdir d3/d11/d34 0 2024-04-23T14:49:31.262 INFO:tasks.workunit.client.0.smithi081.stdout:8/162: creat d3/d11/f35 x:0 0 0 2024-04-23T14:49:31.268 INFO:tasks.workunit.client.0.smithi081.stdout:0/142: creat d6/d11/d14/f26 x:0 0 0 2024-04-23T14:49:31.268 INFO:tasks.workunit.client.0.smithi081.stdout:0/143: readlink d6/la 0 2024-04-23T14:49:31.275 INFO:tasks.workunit.client.0.smithi081.stdout:9/163: dwrite d3/d5/f21 [0,4194304] 0 2024-04-23T14:49:31.275 INFO:tasks.workunit.client.0.smithi081.stdout:9/164: chown d3/lb 80 1 2024-04-23T14:49:31.275 INFO:tasks.workunit.client.0.smithi081.stdout:9/165: chown d3/d5 1207083 1 2024-04-23T14:49:31.275 INFO:tasks.workunit.client.0.smithi081.stdout:9/166: chown d3/de/d1d/d2f 74 1 2024-04-23T14:49:31.275 INFO:tasks.workunit.client.0.smithi081.stdout:9/167: creat d3/de/d14/f3d x:0 0 0 2024-04-23T14:49:31.276 INFO:tasks.workunit.client.0.smithi081.stdout:3/172: mknod d4/d7/d2e/c3d 0 2024-04-23T14:49:31.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:30 smithi156 ceph-mon[32341]: pgmap v24: 65 pgs: 65 active+clean; 391 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 19 MiB/s rd, 26 MiB/s wr, 512 op/s 2024-04-23T14:49:31.287 INFO:tasks.workunit.client.0.smithi081.stdout:5/169: creat d17/d3c/f3e x:0 0 0 2024-04-23T14:49:31.291 INFO:tasks.workunit.client.0.smithi081.stdout:2/218: symlink d1/d11/d21/d34/l55 0 2024-04-23T14:49:31.291 INFO:tasks.workunit.client.0.smithi081.stdout:2/219: chown d1/d1e/l49 48 1 2024-04-23T14:49:31.293 INFO:tasks.workunit.client.0.smithi081.stdout:1/164: dwrite d3/d10/f32 [0,4194304] 0 2024-04-23T14:49:31.295 INFO:tasks.workunit.client.0.smithi081.stdout:8/163: unlink d3/d11/f29 0 2024-04-23T14:49:31.295 INFO:tasks.workunit.client.0.smithi081.stdout:8/164: truncate f2 3325835 0 2024-04-23T14:49:31.295 INFO:tasks.workunit.client.0.smithi081.stdout:8/165: write d3/d11/f2e [329192,73245] 0 2024-04-23T14:49:31.296 INFO:tasks.workunit.client.0.smithi081.stdout:0/144: dread d6/f10 [0,4194304] 0 2024-04-23T14:49:31.298 INFO:tasks.workunit.client.0.smithi081.stdout:4/123: rmdir d1/d4 39 2024-04-23T14:49:31.299 INFO:tasks.workunit.client.0.smithi081.stdout:4/124: creat d1/f29 x:0 0 0 2024-04-23T14:49:31.299 INFO:tasks.workunit.client.0.smithi081.stdout:4/125: chown d1/f29 274 1 2024-04-23T14:49:31.299 INFO:tasks.workunit.client.0.smithi081.stdout:4/126: chown d1/d1d/c1b 196235516 1 2024-04-23T14:49:31.324 INFO:tasks.workunit.client.0.smithi081.stdout:5/170: rename f8 to d17/d1f/d36/f3f 0 2024-04-23T14:49:31.324 INFO:tasks.workunit.client.0.smithi081.stdout:5/171: creat d17/d3c/f40 x:0 0 0 2024-04-23T14:49:31.324 INFO:tasks.workunit.client.0.smithi081.stdout:5/172: fdatasync d17/d18/f19 0 2024-04-23T14:49:31.326 INFO:tasks.workunit.client.0.smithi081.stdout:7/117: rmdir d3/d11 39 2024-04-23T14:49:31.327 INFO:tasks.workunit.client.0.smithi081.stdout:7/118: dread - d3/d11/f1b zero size 2024-04-23T14:49:31.328 INFO:tasks.workunit.client.0.smithi081.stdout:2/220: creat d1/d11/d21/d22/f56 x:0 0 0 2024-04-23T14:49:31.328 INFO:tasks.workunit.client.0.smithi081.stdout:2/221: chown d1/f6 1484653613 1 2024-04-23T14:49:31.330 INFO:tasks.workunit.client.0.smithi081.stdout:0/145: mknod d6/d11/d14/c27 0 2024-04-23T14:49:31.333 INFO:tasks.workunit.client.0.smithi081.stdout:3/173: dwrite d4/d7/d32/f33 [0,4194304] 0 2024-04-23T14:49:31.338 INFO:tasks.workunit.client.0.smithi081.stdout:4/127: creat d1/d3/f2a x:0 0 0 2024-04-23T14:49:31.348 INFO:tasks.workunit.client.0.smithi081.stdout:9/168: rmdir d3 39 2024-04-23T14:49:31.348 INFO:tasks.workunit.client.0.smithi081.stdout:9/169: readlink d3/lb 0 2024-04-23T14:49:31.348 INFO:tasks.workunit.client.0.smithi081.stdout:5/173: dread d17/f1b [0,4194304] 0 2024-04-23T14:49:31.352 INFO:tasks.workunit.client.0.smithi081.stdout:2/222: dread d1/f4 [4194304,4194304] 0 2024-04-23T14:49:31.352 INFO:tasks.workunit.client.0.smithi081.stdout:2/223: write d1/d33/d45/d48/f51 [455824,21010] 0 2024-04-23T14:49:31.352 INFO:tasks.workunit.client.0.smithi081.stdout:2/224: readlink d1/d1e/l3e 0 2024-04-23T14:49:31.352 INFO:tasks.workunit.client.0.smithi081.stdout:2/225: dread - d1/d33/f37 zero size 2024-04-23T14:49:31.354 INFO:tasks.workunit.client.0.smithi081.stdout:8/166: rename d3/f25 to d3/d11/d34/f36 0 2024-04-23T14:49:31.354 INFO:tasks.workunit.client.0.smithi081.stdout:8/167: creat d3/f37 x:0 0 0 2024-04-23T14:49:31.358 INFO:tasks.workunit.client.0.smithi081.stdout:0/146: link d6/d11/d14/f26 d6/d25/f28 0 2024-04-23T14:49:31.363 INFO:tasks.workunit.client.0.smithi081.stdout:5/174: mkdir d17/d3d/d41 0 2024-04-23T14:49:31.363 INFO:tasks.workunit.client.0.smithi081.stdout:5/175: getdents d17/d3d/d41 0 2024-04-23T14:49:31.365 INFO:tasks.workunit.client.0.smithi081.stdout:2/226: symlink d1/d11/d21/l57 0 2024-04-23T14:49:31.365 INFO:tasks.workunit.client.0.smithi081.stdout:2/227: chown d1/d11/c23 143680539 1 2024-04-23T14:49:31.374 INFO:tasks.workunit.client.0.smithi081.stdout:1/165: dwrite d3/d15/d17/d26/f31 [0,4194304] 0 2024-04-23T14:49:31.374 INFO:tasks.workunit.client.0.smithi081.stdout:1/166: chown d3/d15 1 1 2024-04-23T14:49:31.384 INFO:tasks.workunit.client.0.smithi081.stdout:1/167: link f0 d3/d1b/f39 0 2024-04-23T14:49:31.386 INFO:tasks.workunit.client.0.smithi081.stdout:7/119: rename d3/d4 to d3/d11/d15/d22 0 2024-04-23T14:49:31.386 INFO:tasks.workunit.client.0.smithi081.stdout:4/128: rename d1/d4 to d1/d4/dc/d2b 22 2024-04-23T14:49:31.386 INFO:tasks.workunit.client.0.smithi081.stdout:7/120: fsync d3/d11/f1b 0 2024-04-23T14:49:31.387 INFO:tasks.workunit.client.0.smithi081.stdout:5/176: mkdir d17/d1f/d42 0 2024-04-23T14:49:31.387 INFO:tasks.workunit.client.0.smithi081.stdout:5/177: chown d17/d18/c2b 476 1 2024-04-23T14:49:31.388 INFO:tasks.workunit.client.0.smithi081.stdout:1/168: symlink d3/d15/d17/d25/l3a 0 2024-04-23T14:49:31.388 INFO:tasks.workunit.client.0.smithi081.stdout:1/169: readlink d3/ld 0 2024-04-23T14:49:31.391 INFO:tasks.workunit.client.0.smithi081.stdout:4/129: link d1/d4/l13 d1/d4/dc/l2c 0 2024-04-23T14:49:31.397 INFO:tasks.workunit.client.0.smithi081.stdout:7/121: symlink d3/d11/d15/d19/l23 0 2024-04-23T14:49:31.397 INFO:tasks.workunit.client.0.smithi081.stdout:5/178: creat d17/d1f/d36/f43 x:0 0 0 2024-04-23T14:49:31.400 INFO:tasks.workunit.client.0.smithi081.stdout:1/170: mkdir d3/d15/d12/d3b 0 2024-04-23T14:49:31.400 INFO:tasks.workunit.client.0.smithi081.stdout:1/171: chown d3/d15/d12/d34 2658 1 2024-04-23T14:49:31.400 INFO:tasks.workunit.client.0.smithi081.stdout:1/172: read - d3/d15/d17/f20 zero size 2024-04-23T14:49:31.403 INFO:tasks.workunit.client.0.smithi081.stdout:5/179: write d17/d1f/f23 [307459,109002] 0 2024-04-23T14:49:31.403 INFO:tasks.workunit.client.0.smithi081.stdout:3/174: dwrite d4/d7/df/f19 [0,4194304] 0 2024-04-23T14:49:31.406 INFO:tasks.workunit.client.0.smithi081.stdout:2/228: dread d1/d11/d21/d22/f38 [0,4194304] 0 2024-04-23T14:49:31.411 INFO:tasks.workunit.client.0.smithi081.stdout:8/168: dwrite d3/f37 [0,4194304] 0 2024-04-23T14:49:31.414 INFO:tasks.workunit.client.0.smithi081.stdout:7/122: write d3/d11/d15/d22/fd [313731,35633] 0 2024-04-23T14:49:31.414 INFO:tasks.workunit.client.0.smithi081.stdout:3/175: rename f3 to d4/d7/d32/f3e 0 2024-04-23T14:49:31.414 INFO:tasks.workunit.client.0.smithi081.stdout:3/176: dread - d4/dc/f3b zero size 2024-04-23T14:49:31.414 INFO:tasks.workunit.client.0.smithi081.stdout:7/123: write d3/f10 [1140941,88243] 0 2024-04-23T14:49:31.414 INFO:tasks.workunit.client.0.smithi081.stdout:5/180: unlink d17/l1c 0 2024-04-23T14:49:31.414 INFO:tasks.workunit.client.0.smithi081.stdout:5/181: write d17/f38 [183045,76521] 0 2024-04-23T14:49:31.415 INFO:tasks.workunit.client.0.smithi081.stdout:3/177: read d4/f17 [728039,44767] 0 2024-04-23T14:49:31.419 INFO:tasks.workunit.client.0.smithi081.stdout:8/169: symlink d3/d1a/l38 0 2024-04-23T14:49:31.419 INFO:tasks.workunit.client.0.smithi081.stdout:8/170: write d3/d11/f1d [8791051,15056] 0 2024-04-23T14:49:31.419 INFO:tasks.workunit.client.0.smithi081.stdout:8/171: fdatasync d3/f2a 0 2024-04-23T14:49:31.419 INFO:tasks.workunit.client.0.smithi081.stdout:8/172: chown d3/ff 122 1 2024-04-23T14:49:31.422 INFO:tasks.workunit.client.0.smithi081.stdout:2/229: rename d1/l19 to d1/d33/l58 0 2024-04-23T14:49:31.422 INFO:tasks.workunit.client.0.smithi081.stdout:2/230: stat d1/d11/f42 0 2024-04-23T14:49:31.429 INFO:tasks.workunit.client.0.smithi081.stdout:9/170: dwrite d3/de/d1d/f20 [0,4194304] 0 2024-04-23T14:49:31.432 INFO:tasks.workunit.client.0.smithi081.stdout:7/124: mknod d3/d20/d1e/c24 0 2024-04-23T14:49:31.434 INFO:tasks.workunit.client.0.smithi081.stdout:5/182: symlink d17/d1f/d36/l44 0 2024-04-23T14:49:31.440 INFO:tasks.workunit.client.0.smithi081.stdout:0/147: fsync d6/d25/f28 0 2024-04-23T14:49:31.441 INFO:tasks.workunit.client.0.smithi081.stdout:0/148: fdatasync d6/d11/f13 0 2024-04-23T14:49:31.444 INFO:tasks.workunit.client.0.smithi081.stdout:8/173: mknod d3/d11/d34/c39 0 2024-04-23T14:49:31.447 INFO:tasks.workunit.client.0.smithi081.stdout:2/231: symlink d1/d11/d21/d52/l59 0 2024-04-23T14:49:31.447 INFO:tasks.workunit.client.0.smithi081.stdout:2/232: read d1/fb [859542,55306] 0 2024-04-23T14:49:31.447 INFO:tasks.workunit.client.0.smithi081.stdout:2/233: readlink d1/d11/d21/d22/l2e 0 2024-04-23T14:49:31.449 INFO:tasks.workunit.client.0.smithi081.stdout:9/171: getdents d3/de/d14 0 2024-04-23T14:49:31.453 INFO:tasks.workunit.client.0.smithi081.stdout:7/125: rename d3/c1a to d3/d11/d15/c25 0 2024-04-23T14:49:31.455 INFO:tasks.workunit.client.0.smithi081.stdout:4/130: dwrite d1/d1d/f20 [0,4194304] 0 2024-04-23T14:49:31.455 INFO:tasks.workunit.client.0.smithi081.stdout:4/131: dread - d1/d4/d11/f28 zero size 2024-04-23T14:49:31.455 INFO:tasks.workunit.client.0.smithi081.stdout:4/132: readlink d1/d4/d11/l1c 0 2024-04-23T14:49:31.456 INFO:tasks.workunit.client.0.smithi081.stdout:0/149: symlink d6/d11/d14/d24/l29 0 2024-04-23T14:49:31.456 INFO:tasks.workunit.client.0.smithi081.stdout:0/150: dread - d6/d11/d14/f26 zero size 2024-04-23T14:49:31.457 INFO:tasks.workunit.client.0.smithi081.stdout:0/151: write d6/f9 [1420609,19426] 0 2024-04-23T14:49:31.457 INFO:tasks.workunit.client.0.smithi081.stdout:0/152: write f5 [4432082,113288] 0 2024-04-23T14:49:31.460 INFO:tasks.workunit.client.0.smithi081.stdout:8/174: stat d3/c13 0 2024-04-23T14:49:31.460 INFO:tasks.workunit.client.0.smithi081.stdout:8/175: creat d3/d11/f3a x:0 0 0 2024-04-23T14:49:31.462 INFO:tasks.workunit.client.0.smithi081.stdout:2/234: mknod d1/d33/d45/d48/c5a 0 2024-04-23T14:49:31.463 INFO:tasks.workunit.client.0.smithi081.stdout:2/235: truncate d1/d11/d21/f2a 645843 0 2024-04-23T14:49:31.464 INFO:tasks.workunit.client.0.smithi081.stdout:9/172: dread d3/de/d1d/d2f/f31 [0,4194304] 0 2024-04-23T14:49:31.471 INFO:tasks.workunit.client.0.smithi081.stdout:4/133: getdents d1/d4/d11 0 2024-04-23T14:49:31.471 INFO:tasks.workunit.client.0.smithi081.stdout:4/134: read - d1/d4/dc/f21 zero size 2024-04-23T14:49:31.471 INFO:tasks.workunit.client.0.smithi081.stdout:3/178: dwrite d4/d7/d32/f3e [0,4194304] 0 2024-04-23T14:49:31.475 INFO:tasks.workunit.client.0.smithi081.stdout:5/183: dread f12 [0,4194304] 0 2024-04-23T14:49:31.477 INFO:tasks.workunit.client.0.smithi081.stdout:1/173: dwrite d3/f7 [0,4194304] 0 2024-04-23T14:49:31.477 INFO:tasks.workunit.client.0.smithi081.stdout:1/174: readlink d3/d15/d17/d25/l37 0 2024-04-23T14:49:31.477 INFO:tasks.workunit.client.0.smithi081.stdout:1/175: chown d3/d15/d12/d1a/c2c 5 1 2024-04-23T14:49:31.480 INFO:tasks.workunit.client.0.smithi081.stdout:7/126: dread d3/d11/f18 [0,4194304] 0 2024-04-23T14:49:31.483 INFO:tasks.workunit.client.0.smithi081.stdout:0/153: symlink d6/d11/l2a 0 2024-04-23T14:49:31.486 INFO:tasks.workunit.client.0.smithi081.stdout:8/176: mknod d3/d11/c3b 0 2024-04-23T14:49:31.488 INFO:tasks.workunit.client.0.smithi081.stdout:2/236: link d1/d11/c18 d1/d11/d21/c5b 0 2024-04-23T14:49:31.489 INFO:tasks.workunit.client.0.smithi081.stdout:5/184: write d17/f21 [5161246,392] 0 2024-04-23T14:49:31.492 INFO:tasks.workunit.client.0.smithi081.stdout:9/173: creat d3/de/d1d/f3e x:0 0 0 2024-04-23T14:49:31.514 INFO:tasks.workunit.client.0.smithi081.stdout:3/179: dwrite d4/d7/df/f35 [0,4194304] 0 2024-04-23T14:49:31.522 INFO:tasks.workunit.client.0.smithi081.stdout:7/127: symlink d3/l26 0 2024-04-23T14:49:31.522 INFO:tasks.workunit.client.0.smithi081.stdout:7/128: fdatasync d3/d11/f1b 0 2024-04-23T14:49:31.524 INFO:tasks.workunit.client.0.smithi081.stdout:8/177: mkdir d3/d3c 0 2024-04-23T14:49:31.524 INFO:tasks.workunit.client.0.smithi081.stdout:8/178: read - d3/d1a/f22 zero size 2024-04-23T14:49:31.527 INFO:tasks.workunit.client.0.smithi081.stdout:2/237: unlink d1/d11/d21/d22/f38 0 2024-04-23T14:49:31.531 INFO:tasks.workunit.client.0.smithi081.stdout:5/185: rename d17/f21 to d17/d3d/f45 0 2024-04-23T14:49:31.534 INFO:tasks.workunit.client.0.smithi081.stdout:9/174: creat d3/d5/f3f x:0 0 0 2024-04-23T14:49:31.536 INFO:tasks.workunit.client.0.smithi081.stdout:4/135: getdents d1/d1d 0 2024-04-23T14:49:31.536 INFO:tasks.workunit.client.0.smithi081.stdout:4/136: chown d1/d3 2520036 1 2024-04-23T14:49:31.541 INFO:tasks.workunit.client.0.smithi081.stdout:3/180: rename d4/d7/df/c29 to d4/d7/d2e/c3f 0 2024-04-23T14:49:31.545 INFO:tasks.workunit.client.0.smithi081.stdout:0/154: dwrite d6/ff [0,4194304] 0 2024-04-23T14:49:31.546 INFO:tasks.workunit.client.0.smithi081.stdout:5/186: mknod d17/d1f/d42/c46 0 2024-04-23T14:49:31.547 INFO:tasks.workunit.client.0.smithi081.stdout:5/187: write d17/d18/f33 [706157,111516] 0 2024-04-23T14:49:31.549 INFO:tasks.workunit.client.0.smithi081.stdout:9/175: symlink d3/de/d1d/d2f/l40 0 2024-04-23T14:49:31.549 INFO:tasks.workunit.client.0.smithi081.stdout:8/179: dread d3/d11/f1d [0,4194304] 0 2024-04-23T14:49:31.555 INFO:tasks.workunit.client.0.smithi081.stdout:2/238: rename d1/d11/d21/c5b to d1/d11/d21/d22/c5c 0 2024-04-23T14:49:31.555 INFO:tasks.workunit.client.0.smithi081.stdout:2/239: truncate d1/d11/d21/f4f 401274 0 2024-04-23T14:49:31.555 INFO:tasks.workunit.client.0.smithi081.stdout:2/240: write d1/d11/d21/d34/f4b [927757,99981] 0 2024-04-23T14:49:31.555 INFO:tasks.workunit.client.0.smithi081.stdout:2/241: dread - d1/d11/d21/d34/f47 zero size 2024-04-23T14:49:31.557 INFO:tasks.workunit.client.0.smithi081.stdout:0/155: creat d6/d11/d14/d24/f2b x:0 0 0 2024-04-23T14:49:31.558 INFO:tasks.workunit.client.0.smithi081.stdout:0/156: chown d6/d11/d14/d24/f2b 257360446 1 2024-04-23T14:49:31.560 INFO:tasks.workunit.client.0.smithi081.stdout:5/188: symlink d17/l47 0 2024-04-23T14:49:31.563 INFO:tasks.workunit.client.0.smithi081.stdout:9/176: unlink d3/de/d1d/f3e 0 2024-04-23T14:49:31.563 INFO:tasks.workunit.client.0.smithi081.stdout:9/177: chown d3/de/d1d/f1e 1 1 2024-04-23T14:49:31.564 INFO:tasks.workunit.client.0.smithi081.stdout:8/180: mknod d3/d11/c3d 0 2024-04-23T14:49:31.566 INFO:tasks.workunit.client.0.smithi081.stdout:4/137: rmdir d1/d3 39 2024-04-23T14:49:31.567 INFO:tasks.workunit.client.0.smithi081.stdout:2/242: symlink d1/d11/l5d 0 2024-04-23T14:49:31.568 INFO:tasks.workunit.client.0.smithi081.stdout:5/189: rmdir d17/d3d 39 2024-04-23T14:49:31.575 INFO:tasks.workunit.client.0.smithi081.stdout:7/129: dwrite d3/d11/d15/d22/f9 [4194304,4194304] 0 2024-04-23T14:49:31.579 INFO:tasks.workunit.client.0.smithi081.stdout:0/157: read d6/d11/d14/f16 [1433424,92537] 0 2024-04-23T14:49:31.579 INFO:tasks.workunit.client.0.smithi081.stdout:0/158: dread - d6/d11/d14/d24/f2b zero size 2024-04-23T14:49:31.579 INFO:tasks.workunit.client.0.smithi081.stdout:0/159: dread - d6/d25/f28 zero size 2024-04-23T14:49:31.580 INFO:tasks.workunit.client.0.smithi081.stdout:0/160: readlink d6/lc 0 2024-04-23T14:49:31.580 INFO:tasks.workunit.client.0.smithi081.stdout:0/161: write f5 [1608402,42928] 0 2024-04-23T14:49:31.583 INFO:tasks.workunit.client.0.smithi081.stdout:8/181: dread d3/d11/f2e [0,4194304] 0 2024-04-23T14:49:31.583 INFO:tasks.workunit.client.0.smithi081.stdout:8/182: dread - d3/d1a/f22 zero size 2024-04-23T14:49:31.583 INFO:tasks.workunit.client.0.smithi081.stdout:4/138: dread d1/d4/dc/f14 [0,4194304] 0 2024-04-23T14:49:31.593 INFO:tasks.workunit.client.0.smithi081.stdout:9/178: dread d3/d5/f6 [0,4194304] 0 2024-04-23T14:49:31.593 INFO:tasks.workunit.client.0.smithi081.stdout:9/179: stat d3/de/f27 0 2024-04-23T14:49:31.593 INFO:tasks.workunit.client.0.smithi081.stdout:9/180: creat d3/d5/f41 x:0 0 0 2024-04-23T14:49:31.593 INFO:tasks.workunit.client.0.smithi081.stdout:9/181: stat d3/d5 0 2024-04-23T14:49:31.594 INFO:tasks.workunit.client.0.smithi081.stdout:2/243: rmdir d1/d33 39 2024-04-23T14:49:31.597 INFO:tasks.workunit.client.0.smithi081.stdout:7/130: rename d3/d20/d1e/c24 to d3/d11/d15/d19/c27 0 2024-04-23T14:49:31.598 INFO:tasks.workunit.client.0.smithi081.stdout:7/131: write d3/d11/f1b [656770,119628] 0 2024-04-23T14:49:31.603 INFO:tasks.workunit.client.0.smithi081.stdout:0/162: dread d6/f9 [0,4194304] 0 2024-04-23T14:49:31.604 INFO:tasks.workunit.client.0.smithi081.stdout:4/139: dread d1/d4/d11/f1f [0,4194304] 0 2024-04-23T14:49:31.608 INFO:tasks.workunit.client.0.smithi081.stdout:2/244: rename d1/d11/f13 to d1/d33/f5e 0 2024-04-23T14:49:31.611 INFO:tasks.workunit.client.0.smithi081.stdout:0/163: mknod d6/d11/c2c 0 2024-04-23T14:49:31.611 INFO:tasks.workunit.client.0.smithi081.stdout:0/164: chown d6/d11/l22 1036111109 1 2024-04-23T14:49:31.614 INFO:tasks.workunit.client.0.smithi081.stdout:9/182: dread d3/d5/f16 [0,4194304] 0 2024-04-23T14:49:31.615 INFO:tasks.workunit.client.0.smithi081.stdout:2/245: link d1/d1e/c27 d1/c5f 0 2024-04-23T14:49:31.615 INFO:tasks.workunit.client.0.smithi081.stdout:2/246: stat d1/d11/d21/l57 0 2024-04-23T14:49:31.615 INFO:tasks.workunit.client.0.smithi081.stdout:2/247: write d1/f32 [2316253,108830] 0 2024-04-23T14:49:31.624 INFO:tasks.workunit.client.0.smithi081.stdout:3/181: dwrite d4/dc/d10/d1e/d38/f3a [0,4194304] 0 2024-04-23T14:49:31.629 INFO:tasks.workunit.client.0.smithi081.stdout:3/182: link d4/d7/cb d4/d7/c40 0 2024-04-23T14:49:31.636 INFO:tasks.workunit.client.0.smithi081.stdout:0/165: dread d6/fe [0,4194304] 0 2024-04-23T14:49:31.636 INFO:tasks.workunit.client.0.smithi081.stdout:4/140: write d1/d4/f10 [2976364,100941] 0 2024-04-23T14:49:31.636 INFO:tasks.workunit.client.0.smithi081.stdout:3/183: unlink d4/dc/d10/f18 0 2024-04-23T14:49:31.636 INFO:tasks.workunit.client.0.smithi081.stdout:3/184: chown d4/d7/df/c1c 61239622 1 2024-04-23T14:49:31.639 INFO:tasks.workunit.client.0.smithi081.stdout:8/183: dwrite d3/f2c [0,4194304] 0 2024-04-23T14:49:31.641 INFO:tasks.workunit.client.0.smithi081.stdout:3/185: mkdir d4/d41 0 2024-04-23T14:49:31.650 INFO:tasks.workunit.client.0.smithi081.stdout:3/186: mknod d4/d7/df/c42 0 2024-04-23T14:49:31.650 INFO:tasks.workunit.client.0.smithi081.stdout:3/187: fdatasync d4/d7/df/f27 0 2024-04-23T14:49:31.650 INFO:tasks.workunit.client.0.smithi081.stdout:5/190: dwrite d17/d18/f19 [4194304,4194304] 0 2024-04-23T14:49:31.651 INFO:tasks.workunit.client.0.smithi081.stdout:7/132: dwrite d3/f10 [0,4194304] 0 2024-04-23T14:49:31.652 INFO:tasks.workunit.client.0.smithi081.stdout:8/184: getdents d3/d1a 0 2024-04-23T14:49:31.655 INFO:tasks.workunit.client.0.smithi081.stdout:4/141: write d1/d1d/f26 [1202733,28407] 0 2024-04-23T14:49:31.656 INFO:tasks.workunit.client.0.smithi081.stdout:4/142: stat d1/d4 0 2024-04-23T14:49:31.661 INFO:tasks.workunit.client.0.smithi081.stdout:0/166: write d6/d11/f13 [3264815,99607] 0 2024-04-23T14:49:31.677 INFO:tasks.workunit.client.0.smithi081.stdout:5/191: write d17/d1f/f25 [630473,19893] 0 2024-04-23T14:49:31.684 INFO:tasks.workunit.client.0.smithi081.stdout:7/133: mknod d3/d11/d15/d22/c28 0 2024-04-23T14:49:31.684 INFO:tasks.workunit.client.0.smithi081.stdout:8/185: mkdir d3/d11/d3e 0 2024-04-23T14:49:31.685 INFO:tasks.workunit.client.0.smithi081.stdout:8/186: write d3/d11/f35 [714966,48765] 0 2024-04-23T14:49:31.687 INFO:tasks.workunit.client.0.smithi081.stdout:5/192: dread d17/d18/f32 [0,4194304] 0 2024-04-23T14:49:31.687 INFO:tasks.workunit.client.0.smithi081.stdout:5/193: getdents d17/d3d/d41 0 2024-04-23T14:49:31.694 INFO:tasks.workunit.client.0.smithi081.stdout:0/167: link d6/d11/d14/f26 d6/f2d 0 2024-04-23T14:49:31.707 INFO:tasks.workunit.client.0.smithi081.stdout:7/134: creat d3/d11/d15/d22/f29 x:0 0 0 2024-04-23T14:49:31.707 INFO:tasks.workunit.client.0.smithi081.stdout:7/135: chown d3/d11/d15/d19 24 1 2024-04-23T14:49:31.708 INFO:tasks.workunit.client.0.smithi081.stdout:8/187: mknod d3/d3c/c3f 0 2024-04-23T14:49:31.710 INFO:tasks.workunit.client.0.smithi081.stdout:4/143: dwrite d1/d4/dc/f14 [4194304,4194304] 0 2024-04-23T14:49:31.710 INFO:tasks.workunit.client.0.smithi081.stdout:4/144: chown d1/d1d/f26 0 1 2024-04-23T14:49:31.712 INFO:tasks.workunit.client.0.smithi081.stdout:0/168: creat d6/d25/f2e x:0 0 0 2024-04-23T14:49:31.712 INFO:tasks.workunit.client.0.smithi081.stdout:0/169: write d6/d25/f28 [815408,94396] 0 2024-04-23T14:49:31.712 INFO:tasks.workunit.client.0.smithi081.stdout:0/170: write d6/d11/d14/f26 [1917895,52592] 0 2024-04-23T14:49:31.713 INFO:tasks.workunit.client.0.smithi081.stdout:2/248: dwrite d1/d11/d21/d34/f4b [0,4194304] 0 2024-04-23T14:49:31.713 INFO:tasks.workunit.client.0.smithi081.stdout:7/136: rename d3/d11/d15/c25 to d3/d11/d15/d22/c2a 0 2024-04-23T14:49:31.715 INFO:tasks.workunit.client.0.smithi081.stdout:8/188: creat d3/d11/d34/f40 x:0 0 0 2024-04-23T14:49:31.718 INFO:tasks.workunit.client.0.smithi081.stdout:0/171: symlink d6/d25/l2f 0 2024-04-23T14:49:31.722 INFO:tasks.workunit.client.0.smithi081.stdout:9/183: dwrite d3/de/f27 [0,4194304] 0 2024-04-23T14:49:31.725 INFO:tasks.workunit.client.0.smithi081.stdout:7/137: symlink d3/d11/l2b 0 2024-04-23T14:49:31.728 INFO:tasks.workunit.client.0.smithi081.stdout:8/189: mknod d3/c41 0 2024-04-23T14:49:31.728 INFO:tasks.workunit.client.0.smithi081.stdout:8/190: write d3/ff [2898259,54220] 0 2024-04-23T14:49:31.729 INFO:tasks.workunit.client.0.smithi081.stdout:8/191: getdents d3/d1a 0 2024-04-23T14:49:31.729 INFO:tasks.workunit.client.0.smithi081.stdout:8/192: readlink d3/l6 0 2024-04-23T14:49:31.731 INFO:tasks.workunit.client.0.smithi081.stdout:0/172: write d6/f10 [478259,119659] 0 2024-04-23T14:49:31.744 INFO:tasks.workunit.client.0.smithi081.stdout:5/194: dwrite d17/d3c/f3e [0,4194304] 0 2024-04-23T14:49:31.749 INFO:tasks.workunit.client.0.smithi081.stdout:0/173: dread d6/d11/d14/f16 [0,4194304] 0 2024-04-23T14:49:31.768 INFO:tasks.workunit.client.0.smithi081.stdout:7/138: dwrite d3/f5 [0,4194304] 0 2024-04-23T14:49:31.768 INFO:tasks.workunit.client.0.smithi081.stdout:7/139: write d3/fb [240358,100934] 0 2024-04-23T14:49:31.786 INFO:tasks.workunit.client.0.smithi081.stdout:7/140: dread d3/d11/d15/d22/f9 [4194304,4194304] 0 2024-04-23T14:49:31.786 INFO:tasks.workunit.client.0.smithi081.stdout:7/141: truncate d3/fb 796337 0 2024-04-23T14:49:31.805 INFO:tasks.workunit.client.0.smithi081.stdout:0/174: dwrite d6/ff [0,4194304] 0 2024-04-23T14:49:31.810 INFO:tasks.workunit.client.0.smithi081.stdout:9/184: rename d3/de/f24 to d3/de/d1d/d2f/f42 0 2024-04-23T14:49:31.815 INFO:tasks.workunit.client.0.smithi081.stdout:5/195: creat d17/d18/f48 x:0 0 0 2024-04-23T14:49:31.819 INFO:tasks.workunit.client.0.smithi081.stdout:7/142: mkdir d3/d11/d2c 0 2024-04-23T14:49:31.821 INFO:tasks.workunit.client.0.smithi081.stdout:0/175: mknod d6/d11/d14/d24/c30 0 2024-04-23T14:49:31.821 INFO:tasks.workunit.client.0.smithi081.stdout:0/176: fdatasync d6/f10 0 2024-04-23T14:49:31.821 INFO:tasks.workunit.client.0.smithi081.stdout:0/177: fsync d6/d11/f13 0 2024-04-23T14:49:31.823 INFO:tasks.workunit.client.0.smithi081.stdout:8/193: rename f1 to d3/d3c/f42 0 2024-04-23T14:49:31.825 INFO:tasks.workunit.client.0.smithi081.stdout:9/185: rename d3/c4 to d3/c43 0 2024-04-23T14:49:31.825 INFO:tasks.workunit.client.0.smithi081.stdout:9/186: rename d3/de to d3/de/d1d/d44 22 2024-04-23T14:49:31.825 INFO:tasks.workunit.client.0.smithi081.stdout:9/187: truncate d3/de/d14/f2b 142592 0 2024-04-23T14:49:31.828 INFO:tasks.workunit.client.0.smithi081.stdout:7/143: creat d3/d20/f2d x:0 0 0 2024-04-23T14:49:31.828 INFO:tasks.workunit.client.0.smithi081.stdout:7/144: truncate f2 39602 0 2024-04-23T14:49:31.828 INFO:tasks.workunit.client.0.smithi081.stdout:7/145: chown d3/d11/d15/d22/f29 45 1 2024-04-23T14:49:31.829 INFO:tasks.workunit.client.0.smithi081.stdout:0/178: mknod d6/c31 0 2024-04-23T14:49:31.829 INFO:tasks.workunit.client.0.smithi081.stdout:0/179: chown d6/d11/c23 11036 1 2024-04-23T14:49:31.829 INFO:tasks.workunit.client.0.smithi081.stdout:5/196: truncate fd 4005228 0 2024-04-23T14:49:31.830 INFO:tasks.workunit.client.0.smithi081.stdout:7/146: mknod d3/d21/c2e 0 2024-04-23T14:49:31.832 INFO:tasks.workunit.client.0.smithi081.stdout:5/197: creat d17/d3d/f49 x:0 0 0 2024-04-23T14:49:31.837 INFO:tasks.workunit.client.0.smithi081.stdout:5/198: mkdir d17/d4a 0 2024-04-23T14:49:31.837 INFO:tasks.workunit.client.0.smithi081.stdout:5/199: fdatasync d17/d18/f19 0 2024-04-23T14:49:31.840 INFO:tasks.workunit.client.0.smithi081.stdout:5/200: write d17/d18/f2e [561579,59009] 0 2024-04-23T14:49:31.855 INFO:tasks.workunit.client.0.smithi081.stdout:1/176: sync 2024-04-23T14:49:31.855 INFO:tasks.workunit.client.0.smithi081.stdout:6/136: sync 2024-04-23T14:49:31.859 INFO:tasks.workunit.client.0.smithi081.stdout:1/177: mkdir d3/d15/d12/d2e/d3c 0 2024-04-23T14:49:31.859 INFO:tasks.workunit.client.0.smithi081.stdout:1/178: chown d3/fa 8774 1 2024-04-23T14:49:31.861 INFO:tasks.workunit.client.0.smithi081.stdout:6/137: mkdir d1/d11/d13/d33 0 2024-04-23T14:49:31.871 INFO:tasks.workunit.client.0.smithi081.stdout:6/138: symlink d1/d11/d8/d2e/l34 0 2024-04-23T14:49:31.871 INFO:tasks.workunit.client.0.smithi081.stdout:6/139: chown d1/d11/d13/c22 16111264 1 2024-04-23T14:49:31.871 INFO:tasks.workunit.client.0.smithi081.stdout:6/140: truncate d1/f17 221694 0 2024-04-23T14:49:31.871 INFO:tasks.workunit.client.0.smithi081.stdout:6/141: dread - d1/d11/d13/d16/f32 zero size 2024-04-23T14:49:31.873 INFO:tasks.workunit.client.0.smithi081.stdout:6/142: rename d1/d11/d13/c22 to d1/d11/d8/c35 0 2024-04-23T14:49:31.874 INFO:tasks.workunit.client.0.smithi081.stdout:6/143: symlink d1/l36 0 2024-04-23T14:49:31.877 INFO:tasks.workunit.client.0.smithi081.stdout:6/144: rename d1/d11/d13/d16/l28 to d1/d11/d8/l37 0 2024-04-23T14:49:31.877 INFO:tasks.workunit.client.0.smithi081.stdout:6/145: truncate d1/d11/d13/f23 680043 0 2024-04-23T14:49:31.877 INFO:tasks.workunit.client.0.smithi081.stdout:6/146: truncate d1/f2a 276887 0 2024-04-23T14:49:31.877 INFO:tasks.workunit.client.0.smithi081.stdout:6/147: readlink d1/d11/d8/l27 0 2024-04-23T14:49:31.877 INFO:tasks.workunit.client.0.smithi081.stdout:6/148: stat d1/d11/d13/d33 0 2024-04-23T14:49:31.877 INFO:tasks.workunit.client.0.smithi081.stdout:6/149: fsync d1/d11/d13/d16/f19 0 2024-04-23T14:49:31.882 INFO:tasks.workunit.client.0.smithi081.stdout:1/179: dread d3/f9 [0,4194304] 0 2024-04-23T14:49:31.891 INFO:tasks.workunit.client.0.smithi081.stdout:8/194: dwrite d3/d11/d34/f36 [0,4194304] 0 2024-04-23T14:49:31.891 INFO:tasks.workunit.client.0.smithi081.stdout:8/195: readlink d3/l2d 0 2024-04-23T14:49:31.905 INFO:tasks.workunit.client.0.smithi081.stdout:9/188: dwrite d3/de/d1d/d2f/f31 [0,4194304] 0 2024-04-23T14:49:31.912 INFO:tasks.workunit.client.0.smithi081.stdout:9/189: creat d3/de/d25/f45 x:0 0 0 2024-04-23T14:49:31.914 INFO:tasks.workunit.client.0.smithi081.stdout:1/180: dread d3/f5 [0,4194304] 0 2024-04-23T14:49:31.918 INFO:tasks.workunit.client.0.smithi081.stdout:7/147: dwrite d3/d11/d15/d22/fd [0,4194304] 0 2024-04-23T14:49:31.928 INFO:tasks.workunit.client.0.smithi081.stdout:1/181: rename d3/d10 to d3/d3d 0 2024-04-23T14:49:31.928 INFO:tasks.workunit.client.0.smithi081.stdout:1/182: readlink d3/d15/d17/d25/l3a 0 2024-04-23T14:49:31.930 INFO:tasks.workunit.client.0.smithi081.stdout:1/183: unlink f1 0 2024-04-23T14:49:31.934 INFO:tasks.workunit.client.0.smithi081.stdout:8/196: dwrite d3/d11/f3a [0,4194304] 0 2024-04-23T14:49:31.940 INFO:tasks.workunit.client.0.smithi081.stdout:7/148: dread d3/f10 [0,4194304] 0 2024-04-23T14:49:31.942 INFO:tasks.workunit.client.0.smithi081.stdout:7/149: link d3/cc d3/d11/d15/d19/c2f 0 2024-04-23T14:49:31.942 INFO:tasks.workunit.client.0.smithi081.stdout:7/150: chown d3/d11/d15/d22/c28 237230 1 2024-04-23T14:49:31.942 INFO:tasks.workunit.client.0.smithi081.stdout:7/151: creat d3/d20/f30 x:0 0 0 2024-04-23T14:49:31.942 INFO:tasks.workunit.client.0.smithi081.stdout:6/150: rmdir d1/d11/d8/d2e 39 2024-04-23T14:49:31.951 INFO:tasks.workunit.client.0.smithi081.stdout:1/184: read d3/d3d/f32 [2266233,103461] 0 2024-04-23T14:49:31.952 INFO:tasks.workunit.client.0.smithi081.stdout:7/152: rename d3/d11/d15/d22 to d3/d21/d31 0 2024-04-23T14:49:31.953 INFO:tasks.workunit.client.0.smithi081.stdout:7/153: chown d3/f10 621 1 2024-04-23T14:49:31.955 INFO:tasks.workunit.client.0.smithi081.stdout:1/185: rename d3/d15/d12/f1c to d3/d15/f3e 0 2024-04-23T14:49:31.959 INFO:tasks.workunit.client.0.smithi081.stdout:1/186: truncate d3/d3d/f32 3592983 0 2024-04-23T14:49:31.960 INFO:tasks.workunit.client.0.smithi081.stdout:1/187: dread - d3/d15/d17/f20 zero size 2024-04-23T14:49:31.961 INFO:tasks.workunit.client.0.smithi081.stdout:8/197: dread d3/d11/d34/f36 [0,4194304] 0 2024-04-23T14:49:31.994 INFO:tasks.workunit.client.0.smithi081.stdout:6/151: dwrite d1/d11/d13/d16/f1e [0,4194304] 0 2024-04-23T14:49:31.998 INFO:tasks.workunit.client.0.smithi081.stdout:6/152: rename d1/l14 to d1/l38 0 2024-04-23T14:49:31.998 INFO:tasks.workunit.client.0.smithi081.stdout:6/153: fsync d1/fe 0 2024-04-23T14:49:32.007 INFO:tasks.workunit.client.0.smithi081.stdout:3/188: sync 2024-04-23T14:49:32.010 INFO:tasks.workunit.client.0.smithi081.stdout:3/189: rename l2 to d4/d41/l43 0 2024-04-23T14:49:32.011 INFO:tasks.workunit.client.0.smithi081.stdout:6/154: dread d1/fe [0,4194304] 0 2024-04-23T14:49:32.016 INFO:tasks.workunit.client.0.smithi081.stdout:3/190: symlink d4/dc/d10/d1e/l44 0 2024-04-23T14:49:32.019 INFO:tasks.workunit.client.0.smithi081.stdout:1/188: dwrite d3/d15/d17/d26/f31 [4194304,4194304] 0 2024-04-23T14:49:32.024 INFO:tasks.workunit.client.0.smithi081.stdout:3/191: getdents d4/dc/d10/d1e/d38 0 2024-04-23T14:49:32.024 INFO:tasks.workunit.client.0.smithi081.stdout:3/192: creat d4/dc/f45 x:0 0 0 2024-04-23T14:49:32.030 INFO:tasks.workunit.client.0.smithi081.stdout:3/193: creat d4/d7/d2e/f46 x:0 0 0 2024-04-23T14:49:32.032 INFO:tasks.workunit.client.0.smithi081.stdout:8/198: dwrite d3/d11/d34/f36 [0,4194304] 0 2024-04-23T14:49:32.032 INFO:tasks.workunit.client.0.smithi081.stdout:7/154: dwrite d3/f5 [4194304,4194304] 0 2024-04-23T14:49:32.035 INFO:tasks.workunit.client.0.smithi081.stdout:3/194: mkdir d4/dc/d10/d47 0 2024-04-23T14:49:32.039 INFO:tasks.workunit.client.0.smithi081.stdout:7/155: creat d3/d11/d2c/f32 x:0 0 0 2024-04-23T14:49:32.041 INFO:tasks.workunit.client.0.smithi081.stdout:3/195: symlink d4/d7/d2c/l48 0 2024-04-23T14:49:32.047 INFO:tasks.workunit.client.0.smithi081.stdout:7/156: rename d3/d11/d15/d19 to d3/d21/d31/d33 0 2024-04-23T14:49:32.047 INFO:tasks.workunit.client.0.smithi081.stdout:7/157: write d3/fb [931930,12082] 0 2024-04-23T14:49:32.047 INFO:tasks.workunit.client.0.smithi081.stdout:7/158: write d3/d20/f30 [765620,80379] 0 2024-04-23T14:49:32.047 INFO:tasks.workunit.client.0.smithi081.stdout:7/159: chown d3/d11/f18 606599 1 2024-04-23T14:49:32.048 INFO:tasks.workunit.client.0.smithi081.stdout:8/199: write d3/f5 [6825386,97061] 0 2024-04-23T14:49:32.049 INFO:tasks.workunit.client.0.smithi081.stdout:8/200: stat d3/d1a/f1e 0 2024-04-23T14:49:32.058 INFO:tasks.workunit.client.0.smithi081.stdout:1/189: stat d3 0 2024-04-23T14:49:32.064 INFO:tasks.workunit.client.0.smithi081.stdout:7/160: dread d3/d11/f18 [0,4194304] 0 2024-04-23T14:49:32.068 INFO:tasks.workunit.client.0.smithi081.stdout:3/196: rename d4/dc/d10/d1e to d4/d7/d49 0 2024-04-23T14:49:32.068 INFO:tasks.workunit.client.0.smithi081.stdout:3/197: fsync d4/dc/d10/f1f 0 2024-04-23T14:49:32.068 INFO:tasks.workunit.client.0.smithi081.stdout:7/161: stat d3/d21/d31/d33/c2f 0 2024-04-23T14:49:32.071 INFO:tasks.workunit.client.0.smithi081.stdout:7/162: unlink d3/d11/c14 0 2024-04-23T14:49:32.081 INFO:tasks.workunit.client.0.smithi081.stdout:1/190: dread d3/fa [0,4194304] 0 2024-04-23T14:49:32.081 INFO:tasks.workunit.client.0.smithi081.stdout:2/249: sync 2024-04-23T14:49:32.081 INFO:tasks.workunit.client.0.smithi081.stdout:4/145: sync 2024-04-23T14:49:32.081 INFO:tasks.workunit.client.0.smithi081.stdout:2/250: dread - d1/d11/d21/d22/f56 zero size 2024-04-23T14:49:32.081 INFO:tasks.workunit.client.0.smithi081.stdout:2/251: chown d1/d33 841687 1 2024-04-23T14:49:32.081 INFO:tasks.workunit.client.0.smithi081.stdout:2/252: read - d1/d33/f37 zero size 2024-04-23T14:49:32.082 INFO:tasks.workunit.client.0.smithi081.stdout:4/146: write d1/d4/f23 [1477812,51640] 0 2024-04-23T14:49:32.083 INFO:tasks.workunit.client.0.smithi081.stdout:4/147: creat d1/d3/f2d x:0 0 0 2024-04-23T14:49:32.084 INFO:tasks.workunit.client.0.smithi081.stdout:2/253: truncate d1/d11/d21/f3b 2852223 0 2024-04-23T14:49:32.086 INFO:tasks.workunit.client.0.smithi081.stdout:4/148: mknod d1/d4/dc/c2e 0 2024-04-23T14:49:32.090 INFO:tasks.workunit.client.0.smithi081.stdout:4/149: rename d1/d4/d11/l1c to d1/d1d/l2f 0 2024-04-23T14:49:32.090 INFO:tasks.workunit.client.0.smithi081.stdout:4/150: fdatasync d1/d4/f27 0 2024-04-23T14:49:32.092 INFO:tasks.workunit.client.0.smithi081.stdout:4/151: creat d1/d1d/f30 x:0 0 0 2024-04-23T14:49:32.092 INFO:tasks.workunit.client.0.smithi081.stdout:4/152: creat d1/f31 x:0 0 0 2024-04-23T14:49:32.115 INFO:tasks.workunit.client.0.smithi081.stdout:7/163: truncate d3/d21/d31/f9 1079643 0 2024-04-23T14:49:32.115 INFO:tasks.workunit.client.0.smithi081.stdout:7/164: creat d3/d11/d2c/f34 x:0 0 0 2024-04-23T14:49:32.115 INFO:tasks.workunit.client.0.smithi081.stdout:4/153: dread d1/d1d/f20 [0,4194304] 0 2024-04-23T14:49:32.119 INFO:tasks.workunit.client.0.smithi081.stdout:7/165: symlink d3/d21/l35 0 2024-04-23T14:49:32.121 INFO:tasks.workunit.client.0.smithi081.stdout:4/154: mknod d1/d1d/c32 0 2024-04-23T14:49:32.123 INFO:tasks.workunit.client.0.smithi081.stdout:3/198: dwrite d4/dc/f45 [0,4194304] 0 2024-04-23T14:49:32.123 INFO:tasks.workunit.client.0.smithi081.stdout:3/199: fsync d4/f6 0 2024-04-23T14:49:32.129 INFO:tasks.workunit.client.0.smithi081.stdout:3/200: creat d4/dc/d10/d47/f4a x:0 0 0 2024-04-23T14:49:32.129 INFO:tasks.workunit.client.0.smithi081.stdout:3/201: chown d4/d7/df/d30/l34 3186 1 2024-04-23T14:49:32.133 INFO:tasks.workunit.client.0.smithi081.stdout:1/191: dwrite d3/f5 [0,4194304] 0 2024-04-23T14:49:32.133 INFO:tasks.workunit.client.0.smithi081.stdout:2/254: dread d1/f1c [0,4194304] 0 2024-04-23T14:49:32.134 INFO:tasks.workunit.client.0.smithi081.stdout:2/255: truncate d1/d11/d21/f3b 3873944 0 2024-04-23T14:49:32.134 INFO:tasks.workunit.client.0.smithi081.stdout:3/202: symlink d4/d41/l4b 0 2024-04-23T14:49:32.137 INFO:tasks.workunit.client.0.smithi081.stdout:2/256: rename d1/d11/d21/d22/f56 to d1/d33/d45/d48/f60 0 2024-04-23T14:49:32.137 INFO:tasks.workunit.client.0.smithi081.stdout:2/257: write d1/d11/d21/f3b [4404674,39207] 0 2024-04-23T14:49:32.137 INFO:tasks.workunit.client.0.smithi081.stdout:2/258: rename d1/d11/d21/d52 to d1/d11/d21/d52/d61 22 2024-04-23T14:49:32.145 INFO:tasks.workunit.client.0.smithi081.stdout:2/259: mknod d1/d33/d45/d48/c62 0 2024-04-23T14:49:32.145 INFO:tasks.workunit.client.0.smithi081.stdout:2/260: fsync d1/d33/d45/d48/f51 0 2024-04-23T14:49:32.145 INFO:tasks.workunit.client.0.smithi081.stdout:2/261: chown d1/d11 2 1 2024-04-23T14:49:32.145 INFO:tasks.workunit.client.0.smithi081.stdout:2/262: chown d1/d33/d45/d48/f60 4387 1 2024-04-23T14:49:32.145 INFO:tasks.workunit.client.0.smithi081.stdout:2/263: write d1/d33/d45/d48/f51 [1051586,68706] 0 2024-04-23T14:49:32.148 INFO:tasks.workunit.client.0.smithi081.stdout:2/264: unlink d1/d11/l14 0 2024-04-23T14:49:32.148 INFO:tasks.workunit.client.0.smithi081.stdout:2/265: creat d1/d11/d21/d22/f63 x:0 0 0 2024-04-23T14:49:32.157 INFO:tasks.workunit.client.0.smithi081.stdout:1/192: dread d3/d3d/f32 [0,4194304] 0 2024-04-23T14:49:32.185 INFO:tasks.workunit.client.0.smithi081.stdout:1/193: dread d3/d15/f3e [0,4194304] 0 2024-04-23T14:49:32.190 INFO:tasks.workunit.client.0.smithi081.stdout:7/166: dwrite d3/d20/f2d [0,4194304] 0 2024-04-23T14:49:32.190 INFO:tasks.workunit.client.0.smithi081.stdout:1/194: rename d3/d15/f3e to d3/d1b/f3f 0 2024-04-23T14:49:32.190 INFO:tasks.workunit.client.0.smithi081.stdout:1/195: chown d3/d15/d17 179795 1 2024-04-23T14:49:32.190 INFO:tasks.workunit.client.0.smithi081.stdout:1/196: fdatasync d3/d15/d17/d26/f31 0 2024-04-23T14:49:32.190 INFO:tasks.workunit.client.0.smithi081.stdout:1/197: write d3/d1b/f39 [2202336,37187] 0 2024-04-23T14:49:32.191 INFO:tasks.workunit.client.0.smithi081.stdout:3/203: dwrite d4/d7/df/f35 [4194304,4194304] 0 2024-04-23T14:49:32.192 INFO:tasks.workunit.client.0.smithi081.stdout:7/167: creat d3/f36 x:0 0 0 2024-04-23T14:49:32.193 INFO:tasks.workunit.client.0.smithi081.stdout:1/198: truncate d3/d15/d17/d26/f2d 329471 0 2024-04-23T14:49:32.195 INFO:tasks.workunit.client.0.smithi081.stdout:3/204: creat d4/d7/df/d30/f4c x:0 0 0 2024-04-23T14:49:32.195 INFO:tasks.workunit.client.0.smithi081.stdout:3/205: chown d4/dc/d10/l2b 376 1 2024-04-23T14:49:32.197 INFO:tasks.workunit.client.0.smithi081.stdout:1/199: getdents d3/d15/d12 0 2024-04-23T14:49:32.197 INFO:tasks.workunit.client.0.smithi081.stdout:1/200: stat d3/d15/d17/l19 0 2024-04-23T14:49:32.199 INFO:tasks.workunit.client.0.smithi081.stdout:4/155: dwrite d1/f12 [0,4194304] 0 2024-04-23T14:49:32.202 INFO:tasks.workunit.client.0.smithi081.stdout:2/266: dwrite d1/fe [0,4194304] 0 2024-04-23T14:49:32.202 INFO:tasks.workunit.client.0.smithi081.stdout:2/267: truncate d1/d11/d21/d22/f63 639670 0 2024-04-23T14:49:32.207 INFO:tasks.workunit.client.0.smithi081.stdout:7/168: write d3/d20/f2d [3076727,113246] 0 2024-04-23T14:49:32.215 INFO:tasks.workunit.client.0.smithi081.stdout:3/206: dread d4/d7/d49/d38/f3a [0,4194304] 0 2024-04-23T14:49:32.216 INFO:tasks.workunit.client.0.smithi081.stdout:2/268: rename d1/fa to d1/d11/f64 0 2024-04-23T14:49:32.216 INFO:tasks.workunit.client.0.smithi081.stdout:2/269: chown d1/d11/c23 270452 1 2024-04-23T14:49:32.221 INFO:tasks.workunit.client.0.smithi081.stdout:7/169: symlink d3/d21/d31/d33/l37 0 2024-04-23T14:49:32.221 INFO:tasks.workunit.client.0.smithi081.stdout:7/170: stat d3/lf 0 2024-04-23T14:49:32.222 INFO:tasks.workunit.client.0.smithi081.stdout:3/207: symlink d4/l4d 0 2024-04-23T14:49:32.222 INFO:tasks.workunit.client.0.smithi081.stdout:3/208: fdatasync d4/f17 0 2024-04-23T14:49:32.231 INFO:tasks.workunit.client.0.smithi081.stdout:7/171: dread d3/f10 [0,4194304] 0 2024-04-23T14:49:32.242 INFO:tasks.workunit.client.0.smithi081.stdout:4/156: dwrite d1/f9 [8388608,4194304] 0 2024-04-23T14:49:32.254 INFO:tasks.workunit.client.0.smithi081.stdout:3/209: dwrite d4/dc/f28 [0,4194304] 0 2024-04-23T14:49:32.254 INFO:tasks.workunit.client.0.smithi081.stdout:3/210: truncate d4/f12 1860603 0 2024-04-23T14:49:32.256 INFO:tasks.workunit.client.0.smithi081.stdout:4/157: write d1/d4/d11/f1f [3393301,113313] 0 2024-04-23T14:49:32.256 INFO:tasks.workunit.client.0.smithi081.stdout:4/158: write d1/d4/d11/f1f [3399188,8517] 0 2024-04-23T14:49:32.262 INFO:tasks.workunit.client.0.smithi081.stdout:3/211: unlink d4/d7/d49/l37 0 2024-04-23T14:49:32.262 INFO:tasks.workunit.client.0.smithi081.stdout:3/212: chown d4/l11 250890 1 2024-04-23T14:49:32.264 INFO:tasks.workunit.client.0.smithi081.stdout:1/201: dread d3/d1b/f3f [0,4194304] 0 2024-04-23T14:49:32.266 INFO:tasks.workunit.client.0.smithi081.stdout:4/159: getdents d1/d4/d11 0 2024-04-23T14:49:32.268 INFO:tasks.workunit.client.0.smithi081.stdout:1/202: unlink d3/d15/d17/d25/f30 0 2024-04-23T14:49:32.270 INFO:tasks.workunit.client.0.smithi081.stdout:1/203: truncate d3/d15/d17/d26/f31 5763262 0 2024-04-23T14:49:32.272 INFO:tasks.workunit.client.0.smithi081.stdout:1/204: rmdir d3/d15 39 2024-04-23T14:49:32.283 INFO:tasks.workunit.client.0.smithi081.stdout:7/172: truncate d3/d20/f2d 1779889 0 2024-04-23T14:49:32.285 INFO:tasks.workunit.client.0.smithi081.stdout:7/173: creat d3/d21/d31/f38 x:0 0 0 2024-04-23T14:49:32.288 INFO:tasks.workunit.client.0.smithi081.stdout:7/174: mknod d3/d21/d31/c39 0 2024-04-23T14:49:32.292 INFO:tasks.workunit.client.0.smithi081.stdout:7/175: link d3/f5 d3/d21/d31/f3a 0 2024-04-23T14:49:32.298 INFO:tasks.workunit.client.0.smithi081.stdout:7/176: rename d3/fb to d3/d21/d31/d33/f3b 0 2024-04-23T14:49:32.328 INFO:tasks.workunit.client.0.smithi081.stdout:1/205: dwrite d3/f6 [4194304,4194304] 0 2024-04-23T14:49:32.328 INFO:tasks.workunit.client.0.smithi081.stdout:1/206: fdatasync d3/d15/d17/d26/f2d 0 2024-04-23T14:49:32.328 INFO:tasks.workunit.client.0.smithi081.stdout:1/207: readlink d3/d15/d17/d25/l3a 0 2024-04-23T14:49:32.328 INFO:tasks.workunit.client.0.smithi081.stdout:1/208: write d3/d1b/f39 [2698911,81093] 0 2024-04-23T14:49:32.329 INFO:tasks.workunit.client.0.smithi081.stdout:1/209: write d3/fa [957895,101089] 0 2024-04-23T14:49:32.332 INFO:tasks.workunit.client.0.smithi081.stdout:1/210: chown d3/l29 1 1 2024-04-23T14:49:32.336 INFO:tasks.workunit.client.0.smithi081.stdout:0/180: sync 2024-04-23T14:49:32.336 INFO:tasks.workunit.client.0.smithi081.stdout:0/181: write d6/d11/d14/f16 [4088776,81912] 0 2024-04-23T14:49:32.336 INFO:tasks.workunit.client.0.smithi081.stdout:0/182: creat d6/d25/f32 x:0 0 0 2024-04-23T14:49:32.336 INFO:tasks.workunit.client.0.smithi081.stdout:5/201: sync 2024-04-23T14:49:32.336 INFO:tasks.workunit.client.0.smithi081.stdout:5/202: readlink lc 0 2024-04-23T14:49:32.336 INFO:tasks.workunit.client.0.smithi081.stdout:9/190: sync 2024-04-23T14:49:32.337 INFO:tasks.workunit.client.0.smithi081.stdout:9/191: write d3/de/d1d/f20 [5138142,29014] 0 2024-04-23T14:49:32.340 INFO:tasks.workunit.client.0.smithi081.stdout:9/192: read d3/de/d14/f2b [90330,90313] 0 2024-04-23T14:49:32.341 INFO:tasks.workunit.client.0.smithi081.stdout:9/193: fsync d3/de/d14/f2c 0 2024-04-23T14:49:32.346 INFO:tasks.workunit.client.0.smithi081.stdout:5/203: symlink d17/d1f/d42/l4b 0 2024-04-23T14:49:32.346 INFO:tasks.workunit.client.0.smithi081.stdout:5/204: write d17/f26 [3118831,32947] 0 2024-04-23T14:49:32.346 INFO:tasks.workunit.client.0.smithi081.stdout:0/183: rmdir d6/d11/d14 39 2024-04-23T14:49:32.346 INFO:tasks.workunit.client.0.smithi081.stdout:0/184: write d6/d11/d14/d24/f2b [770665,72485] 0 2024-04-23T14:49:32.349 INFO:tasks.workunit.client.0.smithi081.stdout:0/185: mknod d6/d11/d14/c33 0 2024-04-23T14:49:32.351 INFO:tasks.workunit.client.0.smithi081.stdout:5/205: symlink d17/d1f/l4c 0 2024-04-23T14:49:32.352 INFO:tasks.workunit.client.0.smithi081.stdout:5/206: chown d17/d3c/f3e 1128 1 2024-04-23T14:49:32.352 INFO:tasks.workunit.client.0.smithi081.stdout:5/207: read - d17/d1f/d36/f43 zero size 2024-04-23T14:49:32.352 INFO:tasks.workunit.client.0.smithi081.stdout:5/208: chown d17/d1f/d36/f39 198041846 1 2024-04-23T14:49:32.352 INFO:tasks.workunit.client.0.smithi081.stdout:5/209: chown d17/d4a 134962964 1 2024-04-23T14:49:32.352 INFO:tasks.workunit.client.0.smithi081.stdout:5/210: chown f4 4 1 2024-04-23T14:49:32.356 INFO:tasks.workunit.client.0.smithi081.stdout:0/186: mknod d6/d11/d14/d24/c34 0 2024-04-23T14:49:32.357 INFO:tasks.workunit.client.0.smithi081.stdout:0/187: write d6/d11/d14/d24/f1f [637626,17128] 0 2024-04-23T14:49:32.358 INFO:tasks.workunit.client.0.smithi081.stdout:1/211: dread d3/f5 [0,4194304] 0 2024-04-23T14:49:32.359 INFO:tasks.workunit.client.0.smithi081.stdout:5/211: unlink c16 0 2024-04-23T14:49:32.373 INFO:tasks.workunit.client.0.smithi081.stdout:0/188: unlink d6/d11/d14/d24/f2b 0 2024-04-23T14:49:32.376 INFO:tasks.workunit.client.0.smithi081.stdout:1/212: creat d3/d15/d12/f40 x:0 0 0 2024-04-23T14:49:32.378 INFO:tasks.workunit.client.0.smithi081.stdout:5/212: symlink d17/d1f/d42/l4d 0 2024-04-23T14:49:32.378 INFO:tasks.workunit.client.0.smithi081.stdout:5/213: fsync d17/d1f/d36/f39 0 2024-04-23T14:49:32.378 INFO:tasks.workunit.client.0.smithi081.stdout:5/214: fsync d17/f1d 0 2024-04-23T14:49:32.381 INFO:tasks.workunit.client.0.smithi081.stdout:0/189: mkdir d6/d11/d14/d24/d35 0 2024-04-23T14:49:32.384 INFO:tasks.workunit.client.0.smithi081.stdout:1/213: getdents d3 0 2024-04-23T14:49:32.384 INFO:tasks.workunit.client.0.smithi081.stdout:1/214: readlink d3/ld 0 2024-04-23T14:49:32.385 INFO:tasks.workunit.client.0.smithi081.stdout:1/215: write d3/d15/d17/d26/f2d [56182,90328] 0 2024-04-23T14:49:32.387 INFO:tasks.workunit.client.0.smithi081.stdout:5/215: mkdir d17/d37/d4e 0 2024-04-23T14:49:32.390 INFO:tasks.workunit.client.0.smithi081.stdout:0/190: rename d6/l1c to d6/d11/d14/l36 0 2024-04-23T14:49:32.393 INFO:tasks.workunit.client.0.smithi081.stdout:1/216: rename d3/d15/d12/d2e/d3c to d3/d3d/d41 0 2024-04-23T14:49:32.395 INFO:tasks.workunit.client.0.smithi081.stdout:9/194: dwrite d3/de/d22/f39 [0,4194304] 0 2024-04-23T14:49:32.395 INFO:tasks.workunit.client.0.smithi081.stdout:9/195: fsync d3/de/d25/f45 0 2024-04-23T14:49:32.395 INFO:tasks.workunit.client.0.smithi081.stdout:9/196: creat d3/d5/f46 x:0 0 0 2024-04-23T14:49:32.395 INFO:tasks.workunit.client.0.smithi081.stdout:9/197: dread - d3/de/d1d/d2f/f34 zero size 2024-04-23T14:49:32.398 INFO:tasks.workunit.client.0.smithi081.stdout:0/191: mkdir d6/d37 0 2024-04-23T14:49:32.403 INFO:tasks.workunit.client.0.smithi081.stdout:0/192: write d6/d25/f28 [1889734,84208] 0 2024-04-23T14:49:32.407 INFO:tasks.workunit.client.0.smithi081.stdout:0/193: write d6/d11/d14/f26 [2142888,83946] 0 2024-04-23T14:49:32.412 INFO:tasks.workunit.client.0.smithi081.stdout:9/198: read d3/de/f10 [1219336,100053] 0 2024-04-23T14:49:32.412 INFO:tasks.workunit.client.0.smithi081.stdout:9/199: write d3/de/d14/f3c [292411,88563] 0 2024-04-23T14:49:32.412 INFO:tasks.workunit.client.0.smithi081.stdout:9/200: fdatasync d3/de/d14/f23 0 2024-04-23T14:49:32.414 INFO:tasks.workunit.client.0.smithi081.stdout:1/217: dread d3/d1b/f3f [0,4194304] 0 2024-04-23T14:49:32.414 INFO:tasks.workunit.client.0.smithi081.stdout:9/201: mkdir d3/de/d47 0 2024-04-23T14:49:32.418 INFO:tasks.workunit.client.0.smithi081.stdout:1/218: rmdir d3/d15 39 2024-04-23T14:49:32.434 INFO:tasks.workunit.client.0.smithi081.stdout:9/202: dread d3/d5/f21 [0,4194304] 0 2024-04-23T14:49:32.447 INFO:tasks.workunit.client.0.smithi081.stdout:0/194: dread d6/f10 [0,4194304] 0 2024-04-23T14:49:32.447 INFO:tasks.workunit.client.0.smithi081.stdout:0/195: dread - d6/d25/f2e zero size 2024-04-23T14:49:32.447 INFO:tasks.workunit.client.0.smithi081.stdout:0/196: write d6/d11/d14/f16 [5233380,114836] 0 2024-04-23T14:49:32.448 INFO:tasks.workunit.client.0.smithi081.stdout:0/197: unlink l3 0 2024-04-23T14:49:32.453 INFO:tasks.workunit.client.0.smithi081.stdout:5/216: dwrite d17/d18/f33 [0,4194304] 0 2024-04-23T14:49:32.455 INFO:tasks.workunit.client.0.smithi081.stdout:9/203: write d3/f3a [3716860,55570] 0 2024-04-23T14:49:32.455 INFO:tasks.workunit.client.0.smithi081.stdout:0/198: rename d6/d11/f13 to d6/d37/f38 0 2024-04-23T14:49:32.458 INFO:tasks.workunit.client.0.smithi081.stdout:5/217: mkdir d17/d4f 0 2024-04-23T14:49:32.460 INFO:tasks.workunit.client.0.smithi081.stdout:9/204: symlink d3/d5/l48 0 2024-04-23T14:49:32.460 INFO:tasks.workunit.client.0.smithi081.stdout:9/205: readlink d3/de/d1d/d2f/l40 0 2024-04-23T14:49:32.460 INFO:tasks.workunit.client.0.smithi081.stdout:9/206: stat d3/d5/f46 0 2024-04-23T14:49:32.461 INFO:tasks.workunit.client.0.smithi081.stdout:0/199: truncate d6/f9 1051050 0 2024-04-23T14:49:32.461 INFO:tasks.workunit.client.0.smithi081.stdout:0/200: chown d6/d11/l1d 446 1 2024-04-23T14:49:32.463 INFO:tasks.workunit.client.0.smithi081.stdout:9/207: rename d3/de/d25/f29 to d3/de/d47/f49 0 2024-04-23T14:49:32.465 INFO:tasks.workunit.client.0.smithi081.stdout:5/218: creat d17/d1f/d42/f50 x:0 0 0 2024-04-23T14:49:32.465 INFO:tasks.workunit.client.0.smithi081.stdout:5/219: creat d17/d3d/f51 x:0 0 0 2024-04-23T14:49:32.467 INFO:tasks.workunit.client.0.smithi081.stdout:0/201: rmdir d6/d11/d14/d24 39 2024-04-23T14:49:32.467 INFO:tasks.workunit.client.0.smithi081.stdout:0/202: dread - d6/d25/f32 zero size 2024-04-23T14:49:32.469 INFO:tasks.workunit.client.0.smithi081.stdout:0/203: getdents d6/d11/d14 0 2024-04-23T14:49:32.482 INFO:tasks.workunit.client.0.smithi081.stdout:9/208: dread d3/de/d14/f3c [0,4194304] 0 2024-04-23T14:49:32.486 INFO:tasks.workunit.client.0.smithi081.stdout:9/209: creat d3/f4a x:0 0 0 2024-04-23T14:49:32.490 INFO:tasks.workunit.client.0.smithi081.stdout:9/210: unlink d3/de/d14/f2b 0 2024-04-23T14:49:32.494 INFO:tasks.workunit.client.0.smithi081.stdout:9/211: creat d3/de/f4b x:0 0 0 2024-04-23T14:49:32.498 INFO:tasks.workunit.client.0.smithi081.stdout:9/212: mknod d3/de/d25/c4c 0 2024-04-23T14:49:32.498 INFO:tasks.workunit.client.0.smithi081.stdout:9/213: readlink d3/lb 0 2024-04-23T14:49:32.499 INFO:tasks.workunit.client.0.smithi081.stdout:1/219: dwrite d3/d1b/f39 [0,4194304] 0 2024-04-23T14:49:32.516 INFO:tasks.workunit.client.0.smithi081.stdout:9/214: link d3/de/l15 d3/de/d22/l4d 0 2024-04-23T14:49:32.516 INFO:tasks.workunit.client.0.smithi081.stdout:9/215: dread - d3/f4a zero size 2024-04-23T14:49:32.517 INFO:tasks.workunit.client.0.smithi081.stdout:1/220: truncate d3/f7 3676068 0 2024-04-23T14:49:32.519 INFO:tasks.workunit.client.0.smithi081.stdout:1/221: rmdir d3/d1b 39 2024-04-23T14:49:32.519 INFO:tasks.workunit.client.0.smithi081.stdout:1/222: truncate d3/d15/d12/f40 206151 0 2024-04-23T14:49:32.521 INFO:tasks.workunit.client.0.smithi081.stdout:5/220: dwrite d17/d1f/f23 [0,4194304] 0 2024-04-23T14:49:32.521 INFO:tasks.workunit.client.0.smithi081.stdout:1/223: getdents d3/d15/d17/d25 0 2024-04-23T14:49:32.524 INFO:tasks.workunit.client.0.smithi081.stdout:1/224: creat d3/d3d/d41/f42 x:0 0 0 2024-04-23T14:49:32.524 INFO:tasks.workunit.client.0.smithi081.stdout:1/225: fdatasync d3/d1b/f3f 0 2024-04-23T14:49:32.527 INFO:tasks.workunit.client.0.smithi081.stdout:1/226: creat d3/d1b/f43 x:0 0 0 2024-04-23T14:49:32.529 INFO:tasks.workunit.client.0.smithi081.stdout:0/204: truncate d6/d11/d14/f26 2032935 0 2024-04-23T14:49:32.531 INFO:tasks.workunit.client.0.smithi081.stdout:1/227: symlink d3/l44 0 2024-04-23T14:49:32.531 INFO:tasks.workunit.client.0.smithi081.stdout:1/228: stat d3/d15/d12/f40 0 2024-04-23T14:49:32.534 INFO:tasks.workunit.client.0.smithi081.stdout:0/205: symlink d6/d37/l39 0 2024-04-23T14:49:32.538 INFO:tasks.workunit.client.0.smithi081.stdout:1/229: creat d3/d15/d12/d1a/d2a/f45 x:0 0 0 2024-04-23T14:49:32.546 INFO:tasks.workunit.client.0.smithi081.stdout:1/230: truncate d3/d3d/f32 3225291 0 2024-04-23T14:49:32.546 INFO:tasks.workunit.client.0.smithi081.stdout:1/231: chown d3/f5 595958 1 2024-04-23T14:49:32.546 INFO:tasks.workunit.client.0.smithi081.stdout:1/232: chown d3/d3d 32009 1 2024-04-23T14:49:32.546 INFO:tasks.workunit.client.0.smithi081.stdout:1/233: write d3/d15/d12/d1a/d2a/f45 [370451,28896] 0 2024-04-23T14:49:32.549 INFO:tasks.workunit.client.0.smithi081.stdout:5/221: write d17/d1f/f22 [3660378,100224] 0 2024-04-23T14:49:32.560 INFO:tasks.workunit.client.0.smithi081.stdout:9/216: dwrite d3/de/f4b [0,4194304] 0 2024-04-23T14:49:32.560 INFO:tasks.workunit.client.0.smithi081.stdout:9/217: write d3/f4a [37229,79360] 0 2024-04-23T14:49:32.565 INFO:tasks.workunit.client.0.smithi081.stdout:1/234: dread d3/f6 [4194304,4194304] 0 2024-04-23T14:49:32.565 INFO:tasks.workunit.client.0.smithi081.stdout:1/235: fdatasync d3/d1b/f39 0 2024-04-23T14:49:32.565 INFO:tasks.workunit.client.0.smithi081.stdout:1/236: write d3/d15/d12/d1a/d2a/f45 [1023046,6841] 0 2024-04-23T14:49:32.565 INFO:tasks.workunit.client.0.smithi081.stdout:1/237: chown d3/f5 0 1 2024-04-23T14:49:32.565 INFO:tasks.workunit.client.0.smithi081.stdout:1/238: fdatasync d3/f6 0 2024-04-23T14:49:32.574 INFO:tasks.workunit.client.0.smithi081.stdout:9/218: rmdir d3/de/d1d 39 2024-04-23T14:49:32.586 INFO:tasks.workunit.client.0.smithi081.stdout:1/239: write d3/f5 [1753059,116539] 0 2024-04-23T14:49:32.588 INFO:tasks.workunit.client.0.smithi081.stdout:9/219: dread f1 [0,4194304] 0 2024-04-23T14:49:32.590 INFO:tasks.workunit.client.0.smithi081.stdout:1/240: unlink d3/d15/d12/d1a/f23 0 2024-04-23T14:49:32.590 INFO:tasks.workunit.client.0.smithi081.stdout:1/241: creat d3/d15/d12/d1a/d2a/f46 x:0 0 0 2024-04-23T14:49:32.593 INFO:tasks.workunit.client.0.smithi081.stdout:0/206: getdents d6/d37 0 2024-04-23T14:49:32.598 INFO:tasks.workunit.client.0.smithi081.stdout:1/242: link d3/d15/d17/f20 d3/f47 0 2024-04-23T14:49:32.598 INFO:tasks.workunit.client.0.smithi081.stdout:1/243: readlink d3/l44 0 2024-04-23T14:49:32.598 INFO:tasks.workunit.client.0.smithi081.stdout:1/244: write d3/f7 [4122200,76606] 0 2024-04-23T14:49:32.599 INFO:tasks.workunit.client.0.smithi081.stdout:0/207: symlink d6/d37/l3a 0 2024-04-23T14:49:32.604 INFO:tasks.workunit.client.0.smithi081.stdout:6/155: sync 2024-04-23T14:49:32.604 INFO:tasks.workunit.client.0.smithi081.stdout:8/201: sync 2024-04-23T14:49:32.605 INFO:tasks.workunit.client.0.smithi081.stdout:1/245: dread d3/d15/d12/f40 [0,4194304] 0 2024-04-23T14:49:32.605 INFO:tasks.workunit.client.0.smithi081.stdout:1/246: dread - d3/d15/d12/d1a/d2a/f46 zero size 2024-04-23T14:49:32.606 INFO:tasks.workunit.client.0.smithi081.stdout:9/220: read d3/d5/f6 [6877931,51126] 0 2024-04-23T14:49:32.607 INFO:tasks.workunit.client.0.smithi081.stdout:9/221: write d3/de/d14/f2c [431804,113722] 0 2024-04-23T14:49:32.607 INFO:tasks.workunit.client.0.smithi081.stdout:9/222: fsync d3/d5/f21 0 2024-04-23T14:49:32.608 INFO:tasks.workunit.client.0.smithi081.stdout:6/156: symlink d1/d2/l39 0 2024-04-23T14:49:32.608 INFO:tasks.workunit.client.0.smithi081.stdout:6/157: stat d1/lc 0 2024-04-23T14:49:32.608 INFO:tasks.workunit.client.0.smithi081.stdout:5/222: dwrite d17/f1b [0,4194304] 0 2024-04-23T14:49:32.608 INFO:tasks.workunit.client.0.smithi081.stdout:5/223: dread - d17/d1f/d42/f50 zero size 2024-04-23T14:49:32.610 INFO:tasks.workunit.client.0.smithi081.stdout:8/202: creat d3/d3c/f43 x:0 0 0 2024-04-23T14:49:32.614 INFO:tasks.workunit.client.0.smithi081.stdout:1/247: rename d3/f9 to d3/d15/d12/d1a/f48 0 2024-04-23T14:49:32.634 INFO:tasks.workunit.client.0.smithi081.stdout:6/158: symlink d1/d11/d1c/l3a 0 2024-04-23T14:49:32.636 INFO:tasks.workunit.client.0.smithi081.stdout:8/203: creat d3/d11/d3e/f44 x:0 0 0 2024-04-23T14:49:32.641 INFO:tasks.workunit.client.0.smithi081.stdout:9/223: rename d3/de/d1d/d2f/f34 to d3/f4e 0 2024-04-23T14:49:32.644 INFO:tasks.workunit.client.0.smithi081.stdout:1/248: symlink d3/d15/d12/d3b/l49 0 2024-04-23T14:49:32.646 INFO:tasks.workunit.client.0.smithi081.stdout:6/159: link d1/f2a d1/d11/d1c/f3b 0 2024-04-23T14:49:32.646 INFO:tasks.workunit.client.0.smithi081.stdout:6/160: write d1/d2/f21 [1367006,124606] 0 2024-04-23T14:49:32.646 INFO:tasks.workunit.client.0.smithi081.stdout:6/161: write d1/f2a [972341,24820] 0 2024-04-23T14:49:32.648 INFO:tasks.workunit.client.0.smithi081.stdout:9/224: creat d3/d1a/f4f x:0 0 0 2024-04-23T14:49:32.648 INFO:tasks.workunit.client.0.smithi081.stdout:9/225: truncate d3/d1a/f4f 307596 0 2024-04-23T14:49:32.648 INFO:tasks.workunit.client.0.smithi081.stdout:9/226: fdatasync d3/d1a/f17 0 2024-04-23T14:49:32.652 INFO:tasks.workunit.client.0.smithi081.stdout:9/227: truncate d3/de/f1c 3833359 0 2024-04-23T14:49:32.656 INFO:tasks.workunit.client.0.smithi081.stdout:1/249: rename d3/d1b to d3/d3d/d41/d4a 0 2024-04-23T14:49:32.656 INFO:tasks.workunit.client.0.smithi081.stdout:0/208: dwrite d6/d11/d14/f26 [0,4194304] 0 2024-04-23T14:49:32.659 INFO:tasks.workunit.client.0.smithi081.stdout:0/209: write d6/d11/d14/f15 [531121,59807] 0 2024-04-23T14:49:32.659 INFO:tasks.workunit.client.0.smithi081.stdout:0/210: fsync d6/d11/d14/d24/f1f 0 2024-04-23T14:49:32.659 INFO:tasks.workunit.client.0.smithi081.stdout:6/162: rename d1/d11/d8/f30 to d1/d11/d13/f3c 0 2024-04-23T14:49:32.661 INFO:tasks.workunit.client.0.smithi081.stdout:8/204: dread d3/d11/f3a [0,4194304] 0 2024-04-23T14:49:32.661 INFO:tasks.workunit.client.0.smithi081.stdout:5/224: dwrite d17/d3d/f49 [0,4194304] 0 2024-04-23T14:49:32.661 INFO:tasks.workunit.client.0.smithi081.stdout:8/205: write d3/d11/d34/f40 [215386,127803] 0 2024-04-23T14:49:32.662 INFO:tasks.workunit.client.0.smithi081.stdout:1/250: rename d3/f6 to d3/d15/d12/d34/f4b 0 2024-04-23T14:49:32.664 INFO:tasks.workunit.client.0.smithi081.stdout:6/163: mknod d1/d11/d1c/c3d 0 2024-04-23T14:49:32.664 INFO:tasks.workunit.client.0.smithi081.stdout:6/164: creat d1/d11/d13/f3e x:0 0 0 2024-04-23T14:49:32.667 INFO:tasks.workunit.client.0.smithi081.stdout:0/211: dread d6/f9 [0,4194304] 0 2024-04-23T14:49:32.668 INFO:tasks.workunit.client.0.smithi081.stdout:0/212: chown d6/l21 1 1 2024-04-23T14:49:32.669 INFO:tasks.workunit.client.0.smithi081.stdout:5/225: symlink d17/d1f/d36/l52 0 2024-04-23T14:49:32.671 INFO:tasks.workunit.client.0.smithi081.stdout:8/206: symlink d3/d1a/l45 0 2024-04-23T14:49:32.671 INFO:tasks.workunit.client.0.smithi081.stdout:8/207: chown d3/f2f 346 1 2024-04-23T14:49:32.674 INFO:tasks.workunit.client.0.smithi081.stdout:1/251: symlink d3/d15/d12/d1a/d2a/l4c 0 2024-04-23T14:49:32.678 INFO:tasks.workunit.client.0.smithi081.stdout:6/165: symlink d1/d11/d1c/l3f 0 2024-04-23T14:49:32.680 INFO:tasks.workunit.client.0.smithi081.stdout:0/213: symlink d6/d11/d14/l3b 0 2024-04-23T14:49:32.680 INFO:tasks.workunit.client.0.smithi081.stdout:0/214: rename d6 to d6/d11/d14/d24/d3c 22 2024-04-23T14:49:32.680 INFO:tasks.workunit.client.0.smithi081.stdout:0/215: write d6/d11/d14/f16 [3980956,29366] 0 2024-04-23T14:49:32.682 INFO:tasks.workunit.client.0.smithi081.stdout:6/166: mknod d1/d11/d13/d33/c40 0 2024-04-23T14:49:32.683 INFO:tasks.workunit.client.0.smithi081.stdout:2/270: sync 2024-04-23T14:49:32.683 INFO:tasks.workunit.client.0.smithi081.stdout:3/213: sync 2024-04-23T14:49:32.683 INFO:tasks.workunit.client.0.smithi081.stdout:7/177: sync 2024-04-23T14:49:32.684 INFO:tasks.workunit.client.0.smithi081.stdout:4/160: sync 2024-04-23T14:49:32.685 INFO:tasks.workunit.client.0.smithi081.stdout:5/226: dread f12 [0,4194304] 0 2024-04-23T14:49:32.687 INFO:tasks.workunit.client.0.smithi081.stdout:0/216: stat d6/d11/d14/l36 0 2024-04-23T14:49:32.692 INFO:tasks.workunit.client.0.smithi081.stdout:4/161: symlink d1/d4/l33 0 2024-04-23T14:49:32.692 INFO:tasks.workunit.client.0.smithi081.stdout:4/162: dread - d1/f29 zero size 2024-04-23T14:49:32.695 INFO:tasks.workunit.client.0.smithi081.stdout:5/227: mknod d17/d3d/c53 0 2024-04-23T14:49:32.697 INFO:tasks.workunit.client.0.smithi081.stdout:4/163: creat d1/d4/dc/f34 x:0 0 0 2024-04-23T14:49:32.700 INFO:tasks.workunit.client.0.smithi081.stdout:5/228: symlink d17/d3c/l54 0 2024-04-23T14:49:32.704 INFO:tasks.workunit.client.0.smithi081.stdout:4/164: rename d1/d4/dc/c2e to d1/d1d/c35 0 2024-04-23T14:49:32.704 INFO:tasks.workunit.client.0.smithi081.stdout:4/165: creat d1/d3/f36 x:0 0 0 2024-04-23T14:49:32.704 INFO:tasks.workunit.client.0.smithi081.stdout:4/166: fdatasync d1/d3/f2a 0 2024-04-23T14:49:32.704 INFO:tasks.workunit.client.0.smithi081.stdout:4/167: chown d1/d4/f27 29979459 1 2024-04-23T14:49:32.708 INFO:tasks.workunit.client.0.smithi081.stdout:5/229: mkdir d17/d3c/d55 0 2024-04-23T14:49:32.708 INFO:tasks.workunit.client.0.smithi081.stdout:5/230: chown d17/c35 4000 1 2024-04-23T14:49:32.715 INFO:tasks.workunit.client.0.smithi081.stdout:8/208: dread d3/f37 [0,4194304] 0 2024-04-23T14:49:32.716 INFO:tasks.workunit.client.0.smithi081.stdout:5/231: symlink d17/d18/d3a/l56 0 2024-04-23T14:49:32.716 INFO:tasks.workunit.client.0.smithi081.stdout:5/232: write d17/d1f/f22 [2292949,23762] 0 2024-04-23T14:49:32.717 INFO:tasks.workunit.client.0.smithi081.stdout:5/233: getdents d17/d3c/d55 0 2024-04-23T14:49:32.718 INFO:tasks.workunit.client.0.smithi081.stdout:6/167: fsync d1/d11/d13/f3e 0 2024-04-23T14:49:32.718 INFO:tasks.workunit.client.0.smithi081.stdout:6/168: creat d1/d11/d8/f41 x:0 0 0 2024-04-23T14:49:32.718 INFO:tasks.workunit.client.0.smithi081.stdout:6/169: chown d1/f17 530902978 1 2024-04-23T14:49:32.724 INFO:tasks.workunit.client.0.smithi081.stdout:5/234: mknod d17/d3d/d41/c57 0 2024-04-23T14:49:32.728 INFO:tasks.workunit.client.0.smithi081.stdout:8/209: rmdir d3/d11/d3e 39 2024-04-23T14:49:32.731 INFO:tasks.workunit.client.0.smithi081.stdout:4/168: write d1/fa [12024575,55972] 0 2024-04-23T14:49:32.731 INFO:tasks.workunit.client.0.smithi081.stdout:4/169: chown d1/d4/dc/f34 7256248 1 2024-04-23T14:49:32.734 INFO:tasks.workunit.client.0.smithi081.stdout:8/210: rename d3/d1a/l45 to d3/d11/d3e/l46 0 2024-04-23T14:49:32.735 INFO:tasks.workunit.client.0.smithi081.stdout:7/178: dread d3/f10 [0,4194304] 0 2024-04-23T14:49:32.735 INFO:tasks.workunit.client.0.smithi081.stdout:7/179: stat d3/d11/d15 0 2024-04-23T14:49:32.736 INFO:tasks.workunit.client.0.smithi081.stdout:5/235: rmdir d17/d1f/d36 39 2024-04-23T14:49:32.739 INFO:tasks.workunit.client.0.smithi081.stdout:4/170: symlink d1/d4/l37 0 2024-04-23T14:49:32.741 INFO:tasks.workunit.client.0.smithi081.stdout:8/211: symlink d3/d3c/l47 0 2024-04-23T14:49:32.741 INFO:tasks.workunit.client.0.smithi081.stdout:8/212: fdatasync f2 0 2024-04-23T14:49:32.741 INFO:tasks.workunit.client.0.smithi081.stdout:8/213: chown d3/c23 1631 1 2024-04-23T14:49:32.742 INFO:tasks.workunit.client.0.smithi081.stdout:8/214: chown d3/d3c 1115 1 2024-04-23T14:49:32.744 INFO:tasks.workunit.client.0.smithi081.stdout:7/180: creat d3/d11/d15/f3c x:0 0 0 2024-04-23T14:49:32.745 INFO:tasks.workunit.client.0.smithi081.stdout:7/181: creat d3/d11/d2c/f3d x:0 0 0 2024-04-23T14:49:32.745 INFO:tasks.workunit.client.0.smithi081.stdout:7/182: readlink d3/d21/l35 0 2024-04-23T14:49:32.750 INFO:tasks.workunit.client.0.smithi081.stdout:4/171: creat d1/d4/f38 x:0 0 0 2024-04-23T14:49:32.750 INFO:tasks.workunit.client.0.smithi081.stdout:8/215: mkdir d3/d11/d48 0 2024-04-23T14:49:32.752 INFO:tasks.workunit.client.0.smithi081.stdout:3/214: write d4/f6 [2655145,73445] 0 2024-04-23T14:49:32.752 INFO:tasks.workunit.client.0.smithi081.stdout:3/215: chown d4/d7/f2a 16 1 2024-04-23T14:49:32.754 INFO:tasks.workunit.client.0.smithi081.stdout:3/216: write d4/d7/d32/f33 [4696382,84989] 0 2024-04-23T14:49:32.759 INFO:tasks.workunit.client.0.smithi081.stdout:7/183: unlink d3/f5 0 2024-04-23T14:49:32.759 INFO:tasks.workunit.client.0.smithi081.stdout:4/172: mkdir d1/d1d/d39 0 2024-04-23T14:49:32.759 INFO:tasks.workunit.client.0.smithi081.stdout:4/173: truncate d1/d4/f10 5136786 0 2024-04-23T14:49:32.760 INFO:tasks.workunit.client.0.smithi081.stdout:4/174: write d1/d3/f2a [836127,87288] 0 2024-04-23T14:49:32.760 INFO:tasks.workunit.client.0.smithi081.stdout:4/175: write d1/d4/d11/f1f [4538186,55699] 0 2024-04-23T14:49:32.761 INFO:tasks.workunit.client.0.smithi081.stdout:4/176: creat d1/f3a x:0 0 0 2024-04-23T14:49:32.761 INFO:tasks.workunit.client.0.smithi081.stdout:8/216: symlink d3/d11/d48/l49 0 2024-04-23T14:49:32.768 INFO:tasks.workunit.client.0.smithi081.stdout:6/170: truncate d1/d11/d1c/f3b 537442 0 2024-04-23T14:49:32.774 INFO:tasks.workunit.client.0.smithi081.stdout:4/177: rename d1/d3/f2d to d1/d1d/d39/f3b 0 2024-04-23T14:49:32.776 INFO:tasks.workunit.client.0.smithi081.stdout:6/171: rmdir d1/d11/d8/d2e 39 2024-04-23T14:49:32.779 INFO:tasks.workunit.client.0.smithi081.stdout:7/184: dread d3/d21/d31/f8 [0,4194304] 0 2024-04-23T14:49:32.779 INFO:tasks.workunit.client.0.smithi081.stdout:4/178: creat d1/d1d/d39/f3c x:0 0 0 2024-04-23T14:49:32.779 INFO:tasks.workunit.client.0.smithi081.stdout:4/179: write d1/f31 [932257,52237] 0 2024-04-23T14:49:32.779 INFO:tasks.workunit.client.0.smithi081.stdout:4/180: chown d1/d4/c18 1042 1 2024-04-23T14:49:32.782 INFO:tasks.workunit.client.0.smithi081.stdout:7/185: symlink d3/d20/d1e/l3e 0 2024-04-23T14:49:32.782 INFO:tasks.workunit.client.0.smithi081.stdout:4/181: symlink d1/d4/d11/l3d 0 2024-04-23T14:49:32.784 INFO:tasks.workunit.client.0.smithi081.stdout:1/252: dwrite d3/fa [0,4194304] 0 2024-04-23T14:49:32.790 INFO:tasks.workunit.client.0.smithi081.stdout:4/182: link d1/d4/d11/f1f d1/d1d/f3e 0 2024-04-23T14:49:32.791 INFO:tasks.workunit.client.0.smithi081.stdout:4/183: chown d1/d4/f27 7 1 2024-04-23T14:49:32.791 INFO:tasks.workunit.client.0.smithi081.stdout:4/184: creat d1/d1d/f3f x:0 0 0 2024-04-23T14:49:32.792 INFO:tasks.workunit.client.0.smithi081.stdout:7/186: dread d3/d21/d31/d33/f3b [0,4194304] 0 2024-04-23T14:49:32.796 INFO:tasks.workunit.client.0.smithi081.stdout:4/185: rename d1/d4/l37 to d1/d1d/d39/l40 0 2024-04-23T14:49:32.797 INFO:tasks.workunit.client.0.smithi081.stdout:9/228: write d3/de/f1c [1375546,111345] 0 2024-04-23T14:49:32.797 INFO:tasks.workunit.client.0.smithi081.stdout:9/229: chown d3/de/d14/f23 1 1 2024-04-23T14:49:32.798 INFO:tasks.workunit.client.0.smithi081.stdout:0/217: dwrite f5 [4194304,4194304] 0 2024-04-23T14:49:32.798 INFO:tasks.workunit.client.0.smithi081.stdout:0/218: chown d6/d25 6765703 1 2024-04-23T14:49:32.803 INFO:tasks.workunit.client.0.smithi081.stdout:7/187: unlink d3/c13 0 2024-04-23T14:49:32.804 INFO:tasks.workunit.client.0.smithi081.stdout:4/186: link d1/f1e d1/d3/f41 0 2024-04-23T14:49:32.804 INFO:tasks.workunit.client.0.smithi081.stdout:4/187: creat d1/d1d/f42 x:0 0 0 2024-04-23T14:49:32.804 INFO:tasks.workunit.client.0.smithi081.stdout:4/188: dread - d1/f3a zero size 2024-04-23T14:49:32.804 INFO:tasks.workunit.client.0.smithi081.stdout:5/236: dwrite d17/d18/f34 [0,4194304] 0 2024-04-23T14:49:32.807 INFO:tasks.workunit.client.0.smithi081.stdout:1/253: write d3/fa [719330,12300] 0 2024-04-23T14:49:32.815 INFO:tasks.workunit.client.0.smithi081.stdout:6/172: write d1/d11/d1c/f3b [1565563,45520] 0 2024-04-23T14:49:32.821 INFO:tasks.workunit.client.0.smithi081.stdout:4/189: creat d1/d4/d11/f43 x:0 0 0 2024-04-23T14:49:32.821 INFO:tasks.workunit.client.0.smithi081.stdout:9/230: dread d3/de/d1d/f20 [0,4194304] 0 2024-04-23T14:49:32.822 INFO:tasks.workunit.client.0.smithi081.stdout:9/231: write d3/de/d14/f23 [227218,97839] 0 2024-04-23T14:49:32.822 INFO:tasks.workunit.client.0.smithi081.stdout:9/232: stat d3/de/d22/c36 0 2024-04-23T14:49:32.822 INFO:tasks.workunit.client.0.smithi081.stdout:9/233: stat d3/d1a 0 2024-04-23T14:49:32.822 INFO:tasks.workunit.client.0.smithi081.stdout:9/234: write d3/f3a [1463684,93315] 0 2024-04-23T14:49:32.823 INFO:tasks.workunit.client.0.smithi081.stdout:7/188: rmdir d3/d21/d31 39 2024-04-23T14:49:32.823 INFO:tasks.workunit.client.0.smithi081.stdout:7/189: creat d3/d20/f3f x:0 0 0 2024-04-23T14:49:32.826 INFO:tasks.workunit.client.0.smithi081.stdout:8/217: dwrite d3/d11/f35 [0,4194304] 0 2024-04-23T14:49:32.833 INFO:tasks.workunit.client.0.smithi081.stdout:3/217: dwrite d4/dc/f28 [0,4194304] 0 2024-04-23T14:49:32.835 INFO:tasks.workunit.client.0.smithi081.stdout:9/235: truncate d3/d1a/f17 2177236 0 2024-04-23T14:49:32.836 INFO:tasks.workunit.client.0.smithi081.stdout:9/236: write d3/d5/f41 [881378,116700] 0 2024-04-23T14:49:32.842 INFO:tasks.workunit.client.0.smithi081.stdout:7/190: creat d3/d21/d31/f40 x:0 0 0 2024-04-23T14:49:32.850 INFO:tasks.workunit.client.0.smithi081.stdout:8/218: link d3/d11/d3e/f44 d3/f4a 0 2024-04-23T14:49:32.864 INFO:tasks.workunit.client.0.smithi081.stdout:3/218: creat d4/d7/d2c/f4e x:0 0 0 2024-04-23T14:49:32.865 INFO:tasks.workunit.client.0.smithi081.stdout:9/237: unlink d3/de/f4b 0 2024-04-23T14:49:32.867 INFO:tasks.workunit.client.0.smithi081.stdout:8/219: dread d3/f5 [0,4194304] 0 2024-04-23T14:49:32.867 INFO:tasks.workunit.client.0.smithi081.stdout:6/173: dread d1/d11/d13/d16/f1e [0,4194304] 0 2024-04-23T14:49:32.869 INFO:tasks.workunit.client.0.smithi081.stdout:3/219: link d4/l4d d4/d7/df/l4f 0 2024-04-23T14:49:32.870 INFO:tasks.workunit.client.0.smithi081.stdout:5/237: dwrite f4 [4194304,4194304] 0 2024-04-23T14:49:32.872 INFO:tasks.workunit.client.0.smithi081.stdout:9/238: mknod d3/d1a/c50 0 2024-04-23T14:49:32.875 INFO:tasks.workunit.client.0.smithi081.stdout:8/220: creat d3/d11/d48/f4b x:0 0 0 2024-04-23T14:49:32.879 INFO:tasks.workunit.client.0.smithi081.stdout:5/238: mknod d17/c58 0 2024-04-23T14:49:32.882 INFO:tasks.workunit.client.0.smithi081.stdout:9/239: rmdir d3/de/d25/d33 0 2024-04-23T14:49:32.882 INFO:tasks.workunit.client.0.smithi081.stdout:9/240: write d3/d5/f41 [1073539,85697] 0 2024-04-23T14:49:32.884 INFO:tasks.workunit.client.0.smithi081.stdout:8/221: truncate d3/f2c 333663 0 2024-04-23T14:49:32.887 INFO:tasks.workunit.client.0.smithi081.stdout:8/222: mknod d3/c4c 0 2024-04-23T14:49:32.890 INFO:tasks.workunit.client.0.smithi081.stdout:8/223: symlink d3/d11/d48/l4d 0 2024-04-23T14:49:32.890 INFO:tasks.workunit.client.0.smithi081.stdout:8/224: readlink d3/l6 0 2024-04-23T14:49:32.904 INFO:tasks.workunit.client.0.smithi081.stdout:3/220: rename d4/d7/d2c to d4/dc/d50 0 2024-04-23T14:49:32.904 INFO:tasks.workunit.client.0.smithi081.stdout:3/221: chown d4/dc/d10/c36 15 1 2024-04-23T14:49:32.907 INFO:tasks.workunit.client.0.smithi081.stdout:7/191: dwrite d3/d11/f1b [0,4194304] 0 2024-04-23T14:49:32.916 INFO:tasks.workunit.client.0.smithi081.stdout:7/192: mkdir d3/d21/d41 0 2024-04-23T14:49:32.916 INFO:tasks.workunit.client.0.smithi081.stdout:7/193: creat d3/d11/d15/f42 x:0 0 0 2024-04-23T14:49:32.916 INFO:tasks.workunit.client.0.smithi081.stdout:7/194: truncate d3/d20/f30 1060406 0 2024-04-23T14:49:32.916 INFO:tasks.workunit.client.0.smithi081.stdout:7/195: readlink d3/d11/l2b 0 2024-04-23T14:49:32.917 INFO:tasks.workunit.client.0.smithi081.stdout:4/190: dwrite d1/d4/dc/f21 [0,4194304] 0 2024-04-23T14:49:32.918 INFO:tasks.workunit.client.0.smithi081.stdout:4/191: chown d1/d4/f10 24 1 2024-04-23T14:49:32.918 INFO:tasks.workunit.client.0.smithi081.stdout:4/192: fdatasync d1/d1d/f3e 0 2024-04-23T14:49:32.918 INFO:tasks.workunit.client.0.smithi081.stdout:4/193: readlink d1/d3/l19 0 2024-04-23T14:49:32.940 INFO:tasks.workunit.client.0.smithi081.stdout:8/225: dwrite d3/f37 [0,4194304] 0 2024-04-23T14:49:32.968 INFO:tasks.workunit.client.0.smithi081.stdout:5/239: write f4 [5786452,123357] 0 2024-04-23T14:49:32.968 INFO:tasks.workunit.client.0.smithi081.stdout:5/240: dread - d17/d3d/f51 zero size 2024-04-23T14:49:32.968 INFO:tasks.workunit.client.0.smithi081.stdout:6/174: dwrite d1/d11/d8/f2b [0,4194304] 0 2024-04-23T14:49:32.982 INFO:tasks.workunit.client.0.smithi081.stdout:5/241: mkdir d17/d1f/d36/d59 0 2024-04-23T14:49:32.983 INFO:tasks.workunit.client.0.smithi081.stdout:5/242: write d17/d1f/f31 [1720275,49151] 0 2024-04-23T14:49:32.986 INFO:tasks.workunit.client.0.smithi081.stdout:8/226: dwrite d3/d11/f3a [0,4194304] 0 2024-04-23T14:49:32.986 INFO:tasks.workunit.client.0.smithi081.stdout:4/194: dwrite d1/d1d/f42 [0,4194304] 0 2024-04-23T14:49:32.991 INFO:tasks.workunit.client.0.smithi081.stdout:6/175: dread d1/d11/d8/f2b [0,4194304] 0 2024-04-23T14:49:32.991 INFO:tasks.workunit.client.0.smithi081.stdout:9/241: dwrite d3/de/d14/f3c [0,4194304] 0 2024-04-23T14:49:32.992 INFO:tasks.workunit.client.0.smithi081.stdout:6/176: chown d1/d11/d8/l24 4 1 2024-04-23T14:49:32.992 INFO:tasks.workunit.client.0.smithi081.stdout:9/242: write d3/de/d25/f45 [267511,42177] 0 2024-04-23T14:49:32.992 INFO:tasks.workunit.client.0.smithi081.stdout:6/177: creat d1/d11/d8/f42 x:0 0 0 2024-04-23T14:49:32.992 INFO:tasks.workunit.client.0.smithi081.stdout:5/243: dread d17/d1f/d36/f3f [0,4194304] 0 2024-04-23T14:49:32.995 INFO:tasks.workunit.client.0.smithi081.stdout:8/227: dread d3/d11/d34/f40 [0,4194304] 0 2024-04-23T14:49:32.995 INFO:tasks.workunit.client.0.smithi081.stdout:8/228: readlink d3/d1a/l38 0 2024-04-23T14:49:32.999 INFO:tasks.workunit.client.0.smithi081.stdout:6/178: truncate d1/d11/d13/d16/f1e 1409978 0 2024-04-23T14:49:32.999 INFO:tasks.workunit.client.0.smithi081.stdout:6/179: fsync d1/d11/d13/f3c 0 2024-04-23T14:49:33.000 INFO:tasks.workunit.client.0.smithi081.stdout:5/244: symlink d17/l5a 0 2024-04-23T14:49:33.003 INFO:tasks.workunit.client.0.smithi081.stdout:8/229: rename d3/d11/d48/l49 to d3/d11/d48/l4e 0 2024-04-23T14:49:33.003 INFO:tasks.workunit.client.0.smithi081.stdout:9/243: dread f1 [0,4194304] 0 2024-04-23T14:49:33.005 INFO:tasks.workunit.client.0.smithi081.stdout:6/180: creat d1/d11/f43 x:0 0 0 2024-04-23T14:49:33.007 INFO:tasks.workunit.client.0.smithi081.stdout:5/245: link f14 d17/d4a/f5b 0 2024-04-23T14:49:33.009 INFO:tasks.workunit.client.0.smithi081.stdout:8/230: mkdir d3/d11/d4f 0 2024-04-23T14:49:33.011 INFO:tasks.workunit.client.0.smithi081.stdout:9/244: rename d3/f3a to d3/de/d22/f51 0 2024-04-23T14:49:33.011 INFO:tasks.workunit.client.0.smithi081.stdout:9/245: creat d3/d1a/f52 x:0 0 0 2024-04-23T14:49:33.014 INFO:tasks.workunit.client.0.smithi081.stdout:6/181: symlink d1/d11/d1c/l44 0 2024-04-23T14:49:33.014 INFO:tasks.workunit.client.0.smithi081.stdout:6/182: dread - d1/d11/d13/f3c zero size 2024-04-23T14:49:33.014 INFO:tasks.workunit.client.0.smithi081.stdout:6/183: chown d1/d11/d1c/l3a 28377 1 2024-04-23T14:49:33.017 INFO:tasks.workunit.client.0.smithi081.stdout:5/246: symlink d17/d4a/l5c 0 2024-04-23T14:49:33.017 INFO:tasks.workunit.client.0.smithi081.stdout:5/247: dread - d17/d1f/d42/f50 zero size 2024-04-23T14:49:33.017 INFO:tasks.workunit.client.0.smithi081.stdout:8/231: mknod d3/d11/d3e/c50 0 2024-04-23T14:49:33.022 INFO:tasks.workunit.client.0.smithi081.stdout:5/248: symlink d17/d3c/d55/l5d 0 2024-04-23T14:49:33.022 INFO:tasks.workunit.client.0.smithi081.stdout:5/249: dread - d17/d1f/d36/f43 zero size 2024-04-23T14:49:33.024 INFO:tasks.workunit.client.0.smithi081.stdout:4/195: dwrite d1/fa [12582912,4194304] 0 2024-04-23T14:49:33.024 INFO:tasks.workunit.client.0.smithi081.stdout:4/196: write d1/d3/f2a [948577,49984] 0 2024-04-23T14:49:33.024 INFO:tasks.workunit.client.0.smithi081.stdout:4/197: fdatasync d1/d4/d11/f28 0 2024-04-23T14:49:33.024 INFO:tasks.workunit.client.0.smithi081.stdout:4/198: creat d1/f44 x:0 0 0 2024-04-23T14:49:33.024 INFO:tasks.workunit.client.0.smithi081.stdout:4/199: chown d1/d1d/c1b 40080 1 2024-04-23T14:49:33.024 INFO:tasks.workunit.client.0.smithi081.stdout:4/200: chown d1/d4/l33 1642 1 2024-04-23T14:49:33.025 INFO:tasks.workunit.client.0.smithi081.stdout:5/250: creat d17/d3d/d41/f5e x:0 0 0 2024-04-23T14:49:33.026 INFO:tasks.workunit.client.0.smithi081.stdout:5/251: dread - d17/f2c zero size 2024-04-23T14:49:33.026 INFO:tasks.workunit.client.0.smithi081.stdout:5/252: chown d17/l20 0 1 2024-04-23T14:49:33.027 INFO:tasks.workunit.client.0.smithi081.stdout:6/184: dread d1/d2/f21 [0,4194304] 0 2024-04-23T14:49:33.027 INFO:tasks.workunit.client.0.smithi081.stdout:6/185: chown d1/d11/d8/d2e/f2f 24 1 2024-04-23T14:49:33.045 INFO:tasks.workunit.client.0.smithi081.stdout:9/246: dread d3/de/d1d/d2f/f42 [0,4194304] 0 2024-04-23T14:49:33.047 INFO:tasks.workunit.client.0.smithi081.stdout:4/201: link d1/c25 d1/d4/dc/c45 0 2024-04-23T14:49:33.047 INFO:tasks.workunit.client.0.smithi081.stdout:4/202: fdatasync d1/d1d/f20 0 2024-04-23T14:49:33.050 INFO:tasks.workunit.client.0.smithi081.stdout:5/253: mkdir d17/d18/d3a/d5f 0 2024-04-23T14:49:33.051 INFO:tasks.workunit.client.0.smithi081.stdout:5/254: chown d17/d18 2786107 1 2024-04-23T14:49:33.054 INFO:tasks.workunit.client.0.smithi081.stdout:4/203: unlink d1/d1d/c1b 0 2024-04-23T14:49:33.054 INFO:tasks.workunit.client.0.smithi081.stdout:4/204: rename d1/d4/d11 to d1/d4/d11/d46 22 2024-04-23T14:49:33.055 INFO:tasks.workunit.client.0.smithi081.stdout:5/255: creat d17/d18/d3a/d5f/f60 x:0 0 0 2024-04-23T14:49:33.055 INFO:tasks.workunit.client.0.smithi081.stdout:5/256: readlink lb 0 2024-04-23T14:49:33.057 INFO:tasks.workunit.client.0.smithi081.stdout:4/205: read d1/f31 [848896,90195] 0 2024-04-23T14:49:33.057 INFO:tasks.workunit.client.0.smithi081.stdout:4/206: creat d1/d1d/f47 x:0 0 0 2024-04-23T14:49:33.058 INFO:tasks.workunit.client.0.smithi081.stdout:4/207: creat d1/d1d/d39/f48 x:0 0 0 2024-04-23T14:49:33.058 INFO:tasks.workunit.client.0.smithi081.stdout:4/208: read - d1/d1d/f30 zero size 2024-04-23T14:49:33.060 INFO:tasks.workunit.client.0.smithi081.stdout:8/232: dwrite d3/d3c/f43 [0,4194304] 0 2024-04-23T14:49:33.060 INFO:tasks.workunit.client.0.smithi081.stdout:8/233: write d3/d11/d3e/f44 [828158,38511] 0 2024-04-23T14:49:33.067 INFO:tasks.workunit.client.0.smithi081.stdout:4/209: symlink d1/l49 0 2024-04-23T14:49:33.073 INFO:tasks.workunit.client.0.smithi081.stdout:4/210: symlink d1/d4/l4a 0 2024-04-23T14:49:33.074 INFO:tasks.workunit.client.0.smithi081.stdout:8/234: getdents d3/d11/d34 0 2024-04-23T14:49:33.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:32 smithi081 ceph-mon[25540]: pgmap v25: 65 pgs: 65 active+clean; 391 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 17 MiB/s rd, 22 MiB/s wr, 213 op/s 2024-04-23T14:49:33.076 INFO:tasks.workunit.client.0.smithi081.stdout:4/211: symlink d1/d1d/l4b 0 2024-04-23T14:49:33.078 INFO:tasks.workunit.client.0.smithi081.stdout:8/235: creat d3/d1a/f51 x:0 0 0 2024-04-23T14:49:33.078 INFO:tasks.workunit.client.0.smithi081.stdout:8/236: chown d3/d11/d3e/l46 125255 1 2024-04-23T14:49:33.081 INFO:tasks.workunit.client.0.smithi081.stdout:6/186: dwrite d1/d11/d8/f42 [0,4194304] 0 2024-04-23T14:49:33.081 INFO:tasks.workunit.client.0.smithi081.stdout:8/237: link d3/d11/d34/f36 d3/d3c/f52 0 2024-04-23T14:49:33.086 INFO:tasks.workunit.client.0.smithi081.stdout:6/187: symlink d1/d2/l45 0 2024-04-23T14:49:33.094 INFO:tasks.workunit.client.0.smithi081.stdout:9/247: dwrite d3/de/d14/f3c [0,4194304] 0 2024-04-23T14:49:33.094 INFO:tasks.workunit.client.0.smithi081.stdout:9/248: dread - d3/d1a/f52 zero size 2024-04-23T14:49:33.094 INFO:tasks.workunit.client.0.smithi081.stdout:9/249: rename d3/de/d1d/d2f to d3/de/d1d/d2f/d53 22 2024-04-23T14:49:33.097 INFO:tasks.workunit.client.0.smithi081.stdout:4/212: dread d1/d3/f8 [0,4194304] 0 2024-04-23T14:49:33.097 INFO:tasks.workunit.client.0.smithi081.stdout:4/213: stat d1/fa 0 2024-04-23T14:49:33.097 INFO:tasks.workunit.client.0.smithi081.stdout:6/188: dread d1/d11/d13/f23 [0,4194304] 0 2024-04-23T14:49:33.098 INFO:tasks.workunit.client.0.smithi081.stdout:6/189: truncate d1/d11/d1c/f3b 2246472 0 2024-04-23T14:49:33.098 INFO:tasks.workunit.client.0.smithi081.stdout:9/250: mkdir d3/de/d1d/d54 0 2024-04-23T14:49:33.099 INFO:tasks.workunit.client.0.smithi081.stdout:9/251: stat d3/d5/f3f 0 2024-04-23T14:49:33.123 INFO:tasks.workunit.client.0.smithi081.stdout:4/214: rmdir d1 39 2024-04-23T14:49:33.123 INFO:tasks.workunit.client.0.smithi081.stdout:4/215: stat d1/d1d 0 2024-04-23T14:49:33.123 INFO:tasks.workunit.client.0.smithi081.stdout:4/216: write d1/d1d/d39/f3c [958314,28161] 0 2024-04-23T14:49:33.124 INFO:tasks.workunit.client.0.smithi081.stdout:4/217: truncate d1/d1d/f47 513739 0 2024-04-23T14:49:33.125 INFO:tasks.workunit.client.0.smithi081.stdout:9/252: rmdir d3/d5 39 2024-04-23T14:49:33.128 INFO:tasks.workunit.client.0.smithi081.stdout:4/218: link d1/d4/dc/f14 d1/d1d/d39/f4c 0 2024-04-23T14:49:33.151 INFO:tasks.workunit.client.0.smithi081.stdout:8/238: dwrite d3/d11/d34/f40 [0,4194304] 0 2024-04-23T14:49:33.153 INFO:tasks.workunit.client.0.smithi081.stdout:6/190: dwrite d1/d11/d13/d16/f19 [0,4194304] 0 2024-04-23T14:49:33.153 INFO:tasks.workunit.client.0.smithi081.stdout:9/253: dread d3/f8 [0,4194304] 0 2024-04-23T14:49:33.167 INFO:tasks.workunit.client.0.smithi081.stdout:8/239: write d3/d11/f3a [767625,89041] 0 2024-04-23T14:49:33.167 INFO:tasks.workunit.client.0.smithi081.stdout:8/240: dread - d3/d1a/f22 zero size 2024-04-23T14:49:33.167 INFO:tasks.workunit.client.0.smithi081.stdout:8/241: creat d3/d1a/f53 x:0 0 0 2024-04-23T14:49:33.167 INFO:tasks.workunit.client.0.smithi081.stdout:8/242: stat d3/d1a/f53 0 2024-04-23T14:49:33.167 INFO:tasks.workunit.client.0.smithi081.stdout:8/243: readlink d3/l1f 0 2024-04-23T14:49:33.177 INFO:tasks.workunit.client.0.smithi081.stdout:9/254: dread d3/de/d14/f3c [0,4194304] 0 2024-04-23T14:49:33.178 INFO:tasks.workunit.client.0.smithi081.stdout:9/255: fsync d3/de/d1d/d2f/f31 0 2024-04-23T14:49:33.188 INFO:tasks.workunit.client.0.smithi081.stdout:6/191: dwrite d1/d11/d13/f3e [0,4194304] 0 2024-04-23T14:49:33.278 INFO:tasks.workunit.client.0.smithi081.stdout:8/244: symlink d3/d11/d48/l54 0 2024-04-23T14:49:33.282 INFO:tasks.workunit.client.0.smithi081.stdout:9/256: mknod d3/de/d25/c55 0 2024-04-23T14:49:33.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:32 smithi156 ceph-mon[32341]: pgmap v25: 65 pgs: 65 active+clean; 391 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 17 MiB/s rd, 22 MiB/s wr, 213 op/s 2024-04-23T14:49:33.296 INFO:tasks.workunit.client.0.smithi081.stdout:6/192: mkdir d1/d11/d13/d46 0 2024-04-23T14:49:33.296 INFO:tasks.workunit.client.0.smithi081.stdout:6/193: readlink d1/d11/d1c/l3f 0 2024-04-23T14:49:33.297 INFO:tasks.workunit.client.0.smithi081.stdout:6/194: write d1/d11/d13/d16/f1e [2144936,4276] 0 2024-04-23T14:49:33.297 INFO:tasks.workunit.client.0.smithi081.stdout:6/195: chown d1/d11/d13/d16 0 1 2024-04-23T14:49:33.306 INFO:tasks.workunit.client.0.smithi081.stdout:8/245: creat d3/d11/d34/f55 x:0 0 0 2024-04-23T14:49:33.311 INFO:tasks.workunit.client.0.smithi081.stdout:9/257: mknod d3/de/c56 0 2024-04-23T14:49:33.316 INFO:tasks.workunit.client.0.smithi081.stdout:6/196: symlink d1/d11/d13/d46/l47 0 2024-04-23T14:49:33.329 INFO:tasks.workunit.client.0.smithi081.stdout:8/246: dread d3/f2c [0,4194304] 0 2024-04-23T14:49:33.329 INFO:tasks.workunit.client.0.smithi081.stdout:8/247: creat d3/d1a/f56 x:0 0 0 2024-04-23T14:49:33.337 INFO:tasks.workunit.client.0.smithi081.stdout:8/248: link d3/d3c/f52 d3/d11/d34/f57 0 2024-04-23T14:49:33.338 INFO:tasks.workunit.client.0.smithi081.stdout:8/249: readlink d3/d11/d48/l54 0 2024-04-23T14:49:33.338 INFO:tasks.workunit.client.0.smithi081.stdout:8/250: read - d3/d1a/f51 zero size 2024-04-23T14:49:33.341 INFO:tasks.workunit.client.0.smithi081.stdout:8/251: mkdir d3/d11/d4f/d58 0 2024-04-23T14:49:33.343 INFO:tasks.workunit.client.0.smithi081.stdout:9/258: dread d3/d5/f21 [0,4194304] 0 2024-04-23T14:49:33.343 INFO:tasks.workunit.client.0.smithi081.stdout:9/259: stat d3/de/d22 0 2024-04-23T14:49:33.346 INFO:tasks.workunit.client.0.smithi081.stdout:8/252: mknod d3/d1a/c59 0 2024-04-23T14:49:33.350 INFO:tasks.workunit.client.0.smithi081.stdout:9/260: creat d3/de/d14/f57 x:0 0 0 2024-04-23T14:49:33.353 INFO:tasks.workunit.client.0.smithi081.stdout:8/253: symlink d3/d11/d4f/d58/l5a 0 2024-04-23T14:49:33.358 INFO:tasks.workunit.client.0.smithi081.stdout:9/261: rename d3/d5/f46 to d3/de/d1d/d2f/f58 0 2024-04-23T14:49:33.362 INFO:tasks.workunit.client.0.smithi081.stdout:8/254: mknod d3/d3c/c5b 0 2024-04-23T14:49:33.362 INFO:tasks.workunit.client.0.smithi081.stdout:8/255: creat d3/f5c x:0 0 0 2024-04-23T14:49:33.362 INFO:tasks.workunit.client.0.smithi081.stdout:8/256: dread - d3/d1a/f53 zero size 2024-04-23T14:49:33.434 INFO:tasks.workunit.client.0.smithi081.stdout:6/197: dwrite d1/d11/d13/d16/f19 [0,4194304] 0 2024-04-23T14:49:33.435 INFO:tasks.workunit.client.0.smithi081.stdout:6/198: symlink d1/d11/d8/d2e/l48 0 2024-04-23T14:49:33.440 INFO:tasks.workunit.client.0.smithi081.stdout:9/262: dwrite d3/de/d22/f51 [4194304,4194304] 0 2024-04-23T14:49:33.443 INFO:tasks.workunit.client.0.smithi081.stdout:9/263: rename d3/de/d14/f23 to d3/de/d25/f59 0 2024-04-23T14:49:33.443 INFO:tasks.workunit.client.0.smithi081.stdout:9/264: write d3/de/d22/f51 [1049291,18213] 0 2024-04-23T14:49:33.453 INFO:tasks.workunit.client.0.smithi081.stdout:8/257: dwrite d3/d1a/f51 [0,4194304] 0 2024-04-23T14:49:33.457 INFO:tasks.workunit.client.0.smithi081.stdout:6/199: write d1/f18 [122536,4175] 0 2024-04-23T14:49:33.465 INFO:tasks.workunit.client.0.smithi081.stdout:8/258: link d3/d11/d34/f55 d3/d11/d3e/f5d 0 2024-04-23T14:49:33.468 INFO:tasks.workunit.client.0.smithi081.stdout:6/200: mkdir d1/d2/d49 0 2024-04-23T14:49:33.489 INFO:tasks.workunit.client.0.smithi081.stdout:1/254: sync 2024-04-23T14:49:33.489 INFO:tasks.workunit.client.0.smithi081.stdout:0/219: sync 2024-04-23T14:49:33.493 INFO:tasks.workunit.client.0.smithi081.stdout:2/271: sync 2024-04-23T14:49:33.493 INFO:tasks.workunit.client.0.smithi081.stdout:2/272: write d1/d11/f64 [1151256,94902] 0 2024-04-23T14:49:33.506 INFO:tasks.workunit.client.0.smithi081.stdout:0/220: creat d6/d11/d14/d24/d35/f3d x:0 0 0 2024-04-23T14:49:33.510 INFO:tasks.workunit.client.0.smithi081.stdout:1/255: creat d3/d15/d17/d25/f4d x:0 0 0 2024-04-23T14:49:33.510 INFO:tasks.workunit.client.0.smithi081.stdout:1/256: readlink d3/l8 0 2024-04-23T14:49:33.514 INFO:tasks.workunit.client.0.smithi081.stdout:9/265: dwrite d3/de/d22/f39 [0,4194304] 0 2024-04-23T14:49:33.519 INFO:tasks.workunit.client.0.smithi081.stdout:2/273: write d1/d33/d45/f46 [2334019,73632] 0 2024-04-23T14:49:33.519 INFO:tasks.workunit.client.0.smithi081.stdout:2/274: truncate d1/d11/d21/f4f 702139 0 2024-04-23T14:49:33.524 INFO:tasks.workunit.client.0.smithi081.stdout:8/259: dwrite d3/ff [0,4194304] 0 2024-04-23T14:49:33.524 INFO:tasks.workunit.client.0.smithi081.stdout:8/260: creat d3/f5e x:0 0 0 2024-04-23T14:49:33.526 INFO:tasks.workunit.client.0.smithi081.stdout:5/257: sync 2024-04-23T14:49:33.526 INFO:tasks.workunit.client.0.smithi081.stdout:6/201: rmdir d1/d11 39 2024-04-23T14:49:33.526 INFO:tasks.workunit.client.0.smithi081.stdout:3/222: sync 2024-04-23T14:49:33.526 INFO:tasks.workunit.client.0.smithi081.stdout:6/202: readlink d1/lc 0 2024-04-23T14:49:33.526 INFO:tasks.workunit.client.0.smithi081.stdout:7/196: sync 2024-04-23T14:49:33.533 INFO:tasks.workunit.client.0.smithi081.stdout:9/266: truncate d3/de/f10 530217 0 2024-04-23T14:49:33.534 INFO:tasks.workunit.client.0.smithi081.stdout:8/261: symlink d3/d11/d4f/l5f 0 2024-04-23T14:49:33.547 INFO:tasks.workunit.client.0.smithi081.stdout:3/223: unlink d4/f12 0 2024-04-23T14:49:33.548 INFO:tasks.workunit.client.0.smithi081.stdout:6/203: symlink d1/d11/d8/l4a 0 2024-04-23T14:49:33.548 INFO:tasks.workunit.client.0.smithi081.stdout:6/204: truncate d1/d11/d8/f2b 4867148 0 2024-04-23T14:49:33.550 INFO:tasks.workunit.client.0.smithi081.stdout:7/197: creat d3/d21/d41/f43 x:0 0 0 2024-04-23T14:49:33.551 INFO:tasks.workunit.client.0.smithi081.stdout:7/198: chown d3/d21/d31 109376 1 2024-04-23T14:49:33.551 INFO:tasks.workunit.client.0.smithi081.stdout:4/219: sync 2024-04-23T14:49:33.570 INFO:tasks.workunit.client.0.smithi081.stdout:5/258: rmdir d17/d1f/d42 39 2024-04-23T14:49:33.573 INFO:tasks.workunit.client.0.smithi081.stdout:3/224: mkdir d4/d7/d49/d51 0 2024-04-23T14:49:33.573 INFO:tasks.workunit.client.0.smithi081.stdout:3/225: creat d4/dc/f52 x:0 0 0 2024-04-23T14:49:33.573 INFO:tasks.workunit.client.0.smithi081.stdout:3/226: fdatasync d4/d7/df/f19 0 2024-04-23T14:49:33.579 INFO:tasks.workunit.client.0.smithi081.stdout:6/205: getdents d1/d11/d13 0 2024-04-23T14:49:33.585 INFO:tasks.workunit.client.0.smithi081.stdout:4/220: getdents d1/d1d 0 2024-04-23T14:49:33.592 INFO:tasks.workunit.client.0.smithi081.stdout:6/206: mknod d1/d11/d8/c4b 0 2024-04-23T14:49:33.592 INFO:tasks.workunit.client.0.smithi081.stdout:6/207: write d1/d11/d8/d2e/f2f [188795,89274] 0 2024-04-23T14:49:33.594 INFO:tasks.workunit.client.0.smithi081.stdout:2/275: dwrite d1/d33/f5e [0,4194304] 0 2024-04-23T14:49:33.594 INFO:tasks.workunit.client.0.smithi081.stdout:2/276: stat d1/d11/d21/d34 0 2024-04-23T14:49:33.595 INFO:tasks.workunit.client.0.smithi081.stdout:2/277: chown d1/cf 1512197 1 2024-04-23T14:49:33.595 INFO:tasks.workunit.client.0.smithi081.stdout:1/257: dwrite d3/d3d/d41/d4a/f39 [4194304,4194304] 0 2024-04-23T14:49:33.597 INFO:tasks.workunit.client.0.smithi081.stdout:4/221: mknod d1/d4/dc/c4d 0 2024-04-23T14:49:33.597 INFO:tasks.workunit.client.0.smithi081.stdout:5/259: write d17/d18/f19 [5516402,31300] 0 2024-04-23T14:49:33.598 INFO:tasks.workunit.client.0.smithi081.stdout:8/262: dwrite d3/d11/d34/f55 [0,4194304] 0 2024-04-23T14:49:33.598 INFO:tasks.workunit.client.0.smithi081.stdout:8/263: rename d3 to d3/d11/d34/d60 22 2024-04-23T14:49:33.598 INFO:tasks.workunit.client.0.smithi081.stdout:8/264: chown d3/d1a/c59 13891 1 2024-04-23T14:49:33.600 INFO:tasks.workunit.client.0.smithi081.stdout:2/278: fdatasync d1/d33/d45/f46 0 2024-04-23T14:49:33.601 INFO:tasks.workunit.client.0.smithi081.stdout:6/208: creat d1/d11/d13/d16/f4c x:0 0 0 2024-04-23T14:49:33.607 INFO:tasks.workunit.client.0.smithi081.stdout:3/227: write d4/d7/d32/f33 [161353,49667] 0 2024-04-23T14:49:33.610 INFO:tasks.workunit.client.0.smithi081.stdout:9/267: dwrite d3/de/d14/f38 [4194304,4194304] 0 2024-04-23T14:49:33.611 INFO:tasks.workunit.client.0.smithi081.stdout:4/222: truncate d1/f12 3937541 0 2024-04-23T14:49:33.611 INFO:tasks.workunit.client.0.smithi081.stdout:4/223: dread - d1/f3a zero size 2024-04-23T14:49:33.616 INFO:tasks.workunit.client.0.smithi081.stdout:1/258: dread d3/d15/d17/f27 [0,4194304] 0 2024-04-23T14:49:33.621 INFO:tasks.workunit.client.0.smithi081.stdout:5/260: getdents d17/d37 0 2024-04-23T14:49:33.622 INFO:tasks.workunit.client.0.smithi081.stdout:5/261: write f4 [9431263,78613] 0 2024-04-23T14:49:33.622 INFO:tasks.workunit.client.0.smithi081.stdout:5/262: readlink d17/d18/l28 0 2024-04-23T14:49:33.622 INFO:tasks.workunit.client.0.smithi081.stdout:5/263: dread - d17/d18/f48 zero size 2024-04-23T14:49:33.623 INFO:tasks.workunit.client.0.smithi081.stdout:2/279: symlink d1/d11/d21/d34/l65 0 2024-04-23T14:49:33.625 INFO:tasks.workunit.client.0.smithi081.stdout:8/265: dread d3/f5 [4194304,4194304] 0 2024-04-23T14:49:33.625 INFO:tasks.workunit.client.0.smithi081.stdout:8/266: stat d3/d1a/f51 0 2024-04-23T14:49:33.625 INFO:tasks.workunit.client.0.smithi081.stdout:8/267: fdatasync d3/d1a/f53 0 2024-04-23T14:49:33.626 INFO:tasks.workunit.client.0.smithi081.stdout:6/209: mknod d1/c4d 0 2024-04-23T14:49:33.632 INFO:tasks.workunit.client.0.smithi081.stdout:3/228: unlink d4/d7/f2a 0 2024-04-23T14:49:33.632 INFO:tasks.workunit.client.0.smithi081.stdout:7/199: dwrite d3/d21/d31/f38 [0,4194304] 0 2024-04-23T14:49:33.632 INFO:tasks.workunit.client.0.smithi081.stdout:7/200: write d3/d21/d41/f43 [775101,105890] 0 2024-04-23T14:49:33.633 INFO:tasks.workunit.client.0.smithi081.stdout:4/224: dread d1/d1d/f26 [0,4194304] 0 2024-04-23T14:49:33.634 INFO:tasks.workunit.client.0.smithi081.stdout:9/268: symlink d3/de/d25/l5a 0 2024-04-23T14:49:33.634 INFO:tasks.workunit.client.0.smithi081.stdout:9/269: readlink d3/de/d25/l5a 0 2024-04-23T14:49:33.637 INFO:tasks.workunit.client.0.smithi081.stdout:1/259: symlink d3/d3d/d41/l4e 0 2024-04-23T14:49:33.640 INFO:tasks.workunit.client.0.smithi081.stdout:5/264: rmdir d17/d18/d3a 39 2024-04-23T14:49:33.640 INFO:tasks.workunit.client.0.smithi081.stdout:5/265: write d17/d18/f2e [719802,47461] 0 2024-04-23T14:49:33.641 INFO:tasks.workunit.client.0.smithi081.stdout:5/266: write d17/d4a/f5b [473594,104351] 0 2024-04-23T14:49:33.641 INFO:tasks.workunit.client.0.smithi081.stdout:5/267: write d17/d3c/f3e [4991782,5060] 0 2024-04-23T14:49:33.641 INFO:tasks.workunit.client.0.smithi081.stdout:5/268: readlink lc 0 2024-04-23T14:49:33.646 INFO:tasks.workunit.client.0.smithi081.stdout:2/280: creat d1/d1e/f66 x:0 0 0 2024-04-23T14:49:33.664 INFO:tasks.workunit.client.0.smithi081.stdout:3/229: mkdir d4/d7/d49/d51/d53 0 2024-04-23T14:49:33.667 INFO:tasks.workunit.client.0.smithi081.stdout:4/225: link d1/d4/dc/c45 d1/d3/c4e 0 2024-04-23T14:49:33.668 INFO:tasks.workunit.client.0.smithi081.stdout:9/270: unlink d3/de/c56 0 2024-04-23T14:49:33.672 INFO:tasks.workunit.client.0.smithi081.stdout:1/260: symlink d3/d3d/d41/d4a/l4f 0 2024-04-23T14:49:33.683 INFO:tasks.workunit.client.0.smithi081.stdout:7/201: write d3/d21/d31/fd [1950298,129888] 0 2024-04-23T14:49:33.683 INFO:tasks.workunit.client.0.smithi081.stdout:2/281: dread d1/d33/d45/f46 [0,4194304] 0 2024-04-23T14:49:33.684 INFO:tasks.workunit.client.0.smithi081.stdout:3/230: symlink d4/d7/l54 0 2024-04-23T14:49:33.686 INFO:tasks.workunit.client.0.smithi081.stdout:4/226: mkdir d1/d4f 0 2024-04-23T14:49:33.692 INFO:tasks.workunit.client.0.smithi081.stdout:7/202: mknod d3/d11/d15/c44 0 2024-04-23T14:49:33.696 INFO:tasks.workunit.client.0.smithi081.stdout:3/231: unlink d4/d41/l4b 0 2024-04-23T14:49:33.703 INFO:tasks.workunit.client.0.smithi081.stdout:5/269: rename d17/d18/d3a/d5f to d17/d4f/d61 0 2024-04-23T14:49:33.703 INFO:tasks.workunit.client.0.smithi081.stdout:8/268: dwrite d3/d1a/f22 [0,4194304] 0 2024-04-23T14:49:33.703 INFO:tasks.workunit.client.0.smithi081.stdout:8/269: readlink d3/d11/d4f/l5f 0 2024-04-23T14:49:33.704 INFO:tasks.workunit.client.0.smithi081.stdout:8/270: fdatasync d3/d1a/f51 0 2024-04-23T14:49:33.704 INFO:tasks.workunit.client.0.smithi081.stdout:8/271: chown d3/c23 29 1 2024-04-23T14:49:33.708 INFO:tasks.workunit.client.0.smithi081.stdout:2/282: read d1/f4 [3024052,38462] 0 2024-04-23T14:49:33.715 INFO:tasks.workunit.client.0.smithi081.stdout:7/203: write d3/d21/d31/f3a [1718427,65403] 0 2024-04-23T14:49:33.727 INFO:tasks.workunit.client.0.smithi081.stdout:8/272: symlink d3/l61 0 2024-04-23T14:49:33.730 INFO:tasks.workunit.client.0.smithi081.stdout:9/271: dwrite d3/de/f2e [0,4194304] 0 2024-04-23T14:49:33.732 INFO:tasks.workunit.client.0.smithi081.stdout:2/283: mknod d1/d11/d21/d22/c67 0 2024-04-23T14:49:33.732 INFO:tasks.workunit.client.0.smithi081.stdout:2/284: chown d1/d11/d21/f3b 944 1 2024-04-23T14:49:33.732 INFO:tasks.workunit.client.0.smithi081.stdout:2/285: dread - d1/d33/f40 zero size 2024-04-23T14:49:33.732 INFO:tasks.workunit.client.0.smithi081.stdout:2/286: stat d1/d11/d21 0 2024-04-23T14:49:33.757 INFO:tasks.workunit.client.0.smithi081.stdout:9/272: write d3/de/f2e [3610933,15011] 0 2024-04-23T14:49:33.765 INFO:tasks.workunit.client.0.smithi081.stdout:4/227: getdents d1 0 2024-04-23T14:49:33.765 INFO:tasks.workunit.client.0.smithi081.stdout:4/228: fdatasync d1/f3a 0 2024-04-23T14:49:33.766 INFO:tasks.workunit.client.0.smithi081.stdout:4/229: read d1/d1d/f20 [1049167,108416] 0 2024-04-23T14:49:33.766 INFO:tasks.workunit.client.0.smithi081.stdout:4/230: chown d1/f31 52 1 2024-04-23T14:49:33.766 INFO:tasks.workunit.client.0.smithi081.stdout:4/231: write d1/fa [17250005,67807] 0 2024-04-23T14:49:33.771 INFO:tasks.workunit.client.0.smithi081.stdout:7/204: dread d3/d21/d31/f3a [0,4194304] 0 2024-04-23T14:49:33.773 INFO:tasks.workunit.client.0.smithi081.stdout:4/232: getdents d1/d4/d11 0 2024-04-23T14:49:33.773 INFO:tasks.workunit.client.0.smithi081.stdout:4/233: fdatasync d1/d1d/d39/f48 0 2024-04-23T14:49:33.786 INFO:tasks.workunit.client.0.smithi081.stdout:5/270: dwrite d17/f2c [0,4194304] 0 2024-04-23T14:49:33.798 INFO:tasks.workunit.client.0.smithi081.stdout:1/261: dwrite d3/f7 [0,4194304] 0 2024-04-23T14:49:33.800 INFO:tasks.workunit.client.0.smithi081.stdout:3/232: dwrite d4/dc/d10/d47/f4a [0,4194304] 0 2024-04-23T14:49:33.801 INFO:tasks.workunit.client.0.smithi081.stdout:3/233: readlink d4/dc/d10/l2b 0 2024-04-23T14:49:33.801 INFO:tasks.workunit.client.0.smithi081.stdout:1/262: creat d3/d15/d12/d2e/f50 x:0 0 0 2024-04-23T14:49:33.801 INFO:tasks.workunit.client.0.smithi081.stdout:1/263: write d3/fa [2914326,105045] 0 2024-04-23T14:49:33.810 INFO:tasks.workunit.client.0.smithi081.stdout:3/234: rename d4/dc/d10/f1f to d4/dc/f55 0 2024-04-23T14:49:33.810 INFO:tasks.workunit.client.0.smithi081.stdout:4/234: dread d1/f9 [0,4194304] 0 2024-04-23T14:49:33.811 INFO:tasks.workunit.client.0.smithi081.stdout:8/273: dwrite d3/d11/f3a [4194304,4194304] 0 2024-04-23T14:49:33.812 INFO:tasks.workunit.client.0.smithi081.stdout:1/264: creat d3/f51 x:0 0 0 2024-04-23T14:49:33.815 INFO:tasks.workunit.client.0.smithi081.stdout:3/235: mknod d4/d41/c56 0 2024-04-23T14:49:33.818 INFO:tasks.workunit.client.0.smithi081.stdout:4/235: mknod d1/d1d/d39/c50 0 2024-04-23T14:49:33.819 INFO:tasks.workunit.client.0.smithi081.stdout:2/287: dwrite d1/d33/f37 [0,4194304] 0 2024-04-23T14:49:33.828 INFO:tasks.workunit.client.0.smithi081.stdout:2/288: rename d1/d11/l5d to d1/d1e/l68 0 2024-04-23T14:49:33.829 INFO:tasks.workunit.client.0.smithi081.stdout:2/289: chown d1/d11/f12 1676300775 1 2024-04-23T14:49:33.829 INFO:tasks.workunit.client.0.smithi081.stdout:2/290: creat d1/d11/d21/d22/f69 x:0 0 0 2024-04-23T14:49:33.830 INFO:tasks.workunit.client.0.smithi081.stdout:1/265: dread d3/d15/d12/d34/f4b [0,4194304] 0 2024-04-23T14:49:33.830 INFO:tasks.workunit.client.0.smithi081.stdout:5/271: dwrite d17/d1f/d36/f3f [0,4194304] 0 2024-04-23T14:49:33.835 INFO:tasks.workunit.client.0.smithi081.stdout:2/291: mknod d1/d1e/c6a 0 2024-04-23T14:49:33.840 INFO:tasks.workunit.client.0.smithi081.stdout:5/272: rmdir d17/d3c/d55 39 2024-04-23T14:49:33.842 INFO:tasks.workunit.client.0.smithi081.stdout:1/266: mknod d3/d3d/c52 0 2024-04-23T14:49:33.844 INFO:tasks.workunit.client.0.smithi081.stdout:2/292: mknod d1/d1e/c6b 0 2024-04-23T14:49:33.844 INFO:tasks.workunit.client.0.smithi081.stdout:2/293: creat d1/d1e/f6c x:0 0 0 2024-04-23T14:49:33.846 INFO:tasks.workunit.client.0.smithi081.stdout:5/273: rmdir d17/d4a 39 2024-04-23T14:49:33.846 INFO:tasks.workunit.client.0.smithi081.stdout:5/274: dread - d17/d1f/d42/f50 zero size 2024-04-23T14:49:33.846 INFO:tasks.workunit.client.0.smithi081.stdout:5/275: fsync d17/d1f/d42/f50 0 2024-04-23T14:49:33.848 INFO:tasks.workunit.client.0.smithi081.stdout:1/267: mknod d3/d15/d12/d34/c53 0 2024-04-23T14:49:33.849 INFO:tasks.workunit.client.0.smithi081.stdout:1/268: creat d3/d15/d12/f54 x:0 0 0 2024-04-23T14:49:33.849 INFO:tasks.workunit.client.0.smithi081.stdout:1/269: fdatasync d3/d3d/d41/d4a/f3f 0 2024-04-23T14:49:33.854 INFO:tasks.workunit.client.0.smithi081.stdout:5/276: rmdir d17/d4f/d61 39 2024-04-23T14:49:33.854 INFO:tasks.workunit.client.0.smithi081.stdout:5/277: getdents d17/d1f/d36/d59 0 2024-04-23T14:49:33.854 INFO:tasks.workunit.client.0.smithi081.stdout:8/274: dwrite d3/f37 [0,4194304] 0 2024-04-23T14:49:33.858 INFO:tasks.workunit.client.0.smithi081.stdout:1/270: mknod d3/d15/d12/d1a/c55 0 2024-04-23T14:49:33.858 INFO:tasks.workunit.client.0.smithi081.stdout:1/271: dread - d3/d15/d12/d1a/d2a/f46 zero size 2024-04-23T14:49:33.859 INFO:tasks.workunit.client.0.smithi081.stdout:2/294: getdents d1/d33/d45 0 2024-04-23T14:49:33.861 INFO:tasks.workunit.client.0.smithi081.stdout:5/278: mknod d17/d3d/c62 0 2024-04-23T14:49:33.864 INFO:tasks.workunit.client.0.smithi081.stdout:1/272: link d3/d3d/l18 d3/d15/d17/l56 0 2024-04-23T14:49:33.867 INFO:tasks.workunit.client.0.smithi081.stdout:2/295: creat d1/d33/f6d x:0 0 0 2024-04-23T14:49:33.873 INFO:tasks.workunit.client.0.smithi081.stdout:1/273: symlink d3/d15/l57 0 2024-04-23T14:49:33.873 INFO:tasks.workunit.client.0.smithi081.stdout:2/296: mkdir d1/d33/d45/d6e 0 2024-04-23T14:49:33.873 INFO:tasks.workunit.client.0.smithi081.stdout:2/297: write d1/d33/d45/d48/f51 [2087388,6432] 0 2024-04-23T14:49:33.876 INFO:tasks.workunit.client.0.smithi081.stdout:5/279: dread d17/d3c/f3e [0,4194304] 0 2024-04-23T14:49:33.876 INFO:tasks.workunit.client.0.smithi081.stdout:5/280: fdatasync d17/d3d/f45 0 2024-04-23T14:49:33.877 INFO:tasks.workunit.client.0.smithi081.stdout:2/298: mknod d1/d11/c6f 0 2024-04-23T14:49:33.877 INFO:tasks.workunit.client.0.smithi081.stdout:2/299: truncate d1/f43 1002956 0 2024-04-23T14:49:33.887 INFO:tasks.workunit.client.0.smithi081.stdout:2/300: dread d1/d11/f29 [0,4194304] 0 2024-04-23T14:49:33.888 INFO:tasks.workunit.client.0.smithi081.stdout:2/301: dread - d1/d1e/f66 zero size 2024-04-23T14:49:33.892 INFO:tasks.workunit.client.0.smithi081.stdout:2/302: truncate d1/f32 142232 0 2024-04-23T14:49:33.893 INFO:tasks.workunit.client.0.smithi081.stdout:2/303: write d1/d33/d45/f4a [396063,19046] 0 2024-04-23T14:49:33.893 INFO:tasks.workunit.client.0.smithi081.stdout:2/304: dread - d1/d33/f6d zero size 2024-04-23T14:49:33.895 INFO:tasks.workunit.client.0.smithi081.stdout:2/305: rmdir d1/d11/d21/d52 39 2024-04-23T14:49:33.900 INFO:tasks.workunit.client.0.smithi081.stdout:5/281: dread d17/d3d/f45 [0,4194304] 0 2024-04-23T14:49:33.902 INFO:tasks.workunit.client.0.smithi081.stdout:5/282: creat d17/d1f/d36/d59/f63 x:0 0 0 2024-04-23T14:49:33.905 INFO:tasks.workunit.client.0.smithi081.stdout:5/283: mkdir d17/d3c/d55/d64 0 2024-04-23T14:49:33.923 INFO:tasks.workunit.client.0.smithi081.stdout:2/306: dread d1/d33/f37 [0,4194304] 0 2024-04-23T14:49:33.926 INFO:tasks.workunit.client.0.smithi081.stdout:2/307: creat d1/d11/d21/d52/f70 x:0 0 0 2024-04-23T14:49:33.946 INFO:tasks.workunit.client.0.smithi081.stdout:8/275: dwrite d3/d11/f3a [8388608,4194304] 0 2024-04-23T14:49:33.956 INFO:tasks.workunit.client.0.smithi081.stdout:8/276: rename d3/c13 to d3/d11/c62 0 2024-04-23T14:49:33.959 INFO:tasks.workunit.client.0.smithi081.stdout:5/284: dwrite d17/d18/f2e [0,4194304] 0 2024-04-23T14:49:33.960 INFO:tasks.workunit.client.0.smithi081.stdout:8/277: mkdir d3/d11/d3e/d63 0 2024-04-23T14:49:33.960 INFO:tasks.workunit.client.0.smithi081.stdout:8/278: write d3/f5e [464511,82097] 0 2024-04-23T14:49:33.960 INFO:tasks.workunit.client.0.smithi081.stdout:8/279: chown d3/c4c 1 1 2024-04-23T14:49:33.960 INFO:tasks.workunit.client.0.smithi081.stdout:8/280: fdatasync f2 0 2024-04-23T14:49:33.963 INFO:tasks.workunit.client.0.smithi081.stdout:2/308: dread d1/fe [0,4194304] 0 2024-04-23T14:49:33.965 INFO:tasks.workunit.client.0.smithi081.stdout:8/281: unlink d3/d11/c2b 0 2024-04-23T14:49:33.967 INFO:tasks.workunit.client.0.smithi081.stdout:1/274: dwrite d3/d15/d12/f54 [0,4194304] 0 2024-04-23T14:49:33.967 INFO:tasks.workunit.client.0.smithi081.stdout:1/275: write d3/fa [1004188,119895] 0 2024-04-23T14:49:33.976 INFO:tasks.workunit.client.0.smithi081.stdout:8/282: mknod d3/d11/d4f/d58/c64 0 2024-04-23T14:49:33.983 INFO:tasks.workunit.client.0.smithi081.stdout:1/276: mkdir d3/d15/d17/d58 0 2024-04-23T14:49:33.986 INFO:tasks.workunit.client.0.smithi081.stdout:2/309: getdents d1/d33 0 2024-04-23T14:49:33.987 INFO:tasks.workunit.client.0.smithi081.stdout:5/285: dread d17/d18/f33 [0,4194304] 0 2024-04-23T14:49:33.991 INFO:tasks.workunit.client.0.smithi081.stdout:8/283: rename d3/d11/d34/f36 to d3/d11/d4f/f65 0 2024-04-23T14:49:33.991 INFO:tasks.workunit.client.0.smithi081.stdout:8/284: read - d3/d1a/f56 zero size 2024-04-23T14:49:33.991 INFO:tasks.workunit.client.0.smithi081.stdout:8/285: readlink d3/l28 0 2024-04-23T14:49:33.993 INFO:tasks.workunit.client.0.smithi081.stdout:1/277: symlink d3/l59 0 2024-04-23T14:49:33.993 INFO:tasks.workunit.client.0.smithi081.stdout:1/278: chown d3/d15 772175576 1 2024-04-23T14:49:33.993 INFO:tasks.workunit.client.0.smithi081.stdout:1/279: truncate d3/d3d/d41/d4a/f43 198877 0 2024-04-23T14:49:33.995 INFO:tasks.workunit.client.0.smithi081.stdout:2/310: creat d1/d33/f71 x:0 0 0 2024-04-23T14:49:33.997 INFO:tasks.workunit.client.0.smithi081.stdout:2/311: write d1/d11/d21/f4f [247942,105589] 0 2024-04-23T14:49:33.997 INFO:tasks.workunit.client.0.smithi081.stdout:2/312: write d1/d11/f26 [1018143,117548] 0 2024-04-23T14:49:33.997 INFO:tasks.workunit.client.0.smithi081.stdout:2/313: dread - d1/d11/d21/d52/f70 zero size 2024-04-23T14:49:33.998 INFO:tasks.workunit.client.0.smithi081.stdout:8/286: mkdir d3/d11/d4f/d66 0 2024-04-23T14:49:34.002 INFO:tasks.workunit.client.0.smithi081.stdout:1/280: link d3/d15/d12/d1a/f48 d3/d15/d17/d26/f5a 0 2024-04-23T14:49:34.009 INFO:tasks.workunit.client.0.smithi081.stdout:1/281: link d3/d3d/f13 d3/d3d/d41/f5b 0 2024-04-23T14:49:34.010 INFO:tasks.workunit.client.0.smithi081.stdout:1/282: dread - d3/d15/d12/d2e/f50 zero size 2024-04-23T14:49:34.018 INFO:tasks.workunit.client.0.smithi081.stdout:1/283: rmdir d3/d15/d12/d1a/d2a 39 2024-04-23T14:49:34.041 INFO:tasks.workunit.client.0.smithi081.stdout:5/286: dwrite f4 [8388608,4194304] 0 2024-04-23T14:49:34.046 INFO:tasks.workunit.client.0.smithi081.stdout:5/287: mkdir d17/d65 0 2024-04-23T14:49:34.046 INFO:tasks.workunit.client.0.smithi081.stdout:5/288: creat d17/d3d/d41/f66 x:0 0 0 2024-04-23T14:49:34.047 INFO:tasks.workunit.client.0.smithi081.stdout:5/289: truncate d17/d18/f2e 5240200 0 2024-04-23T14:49:34.047 INFO:tasks.workunit.client.0.smithi081.stdout:5/290: fdatasync d17/d3d/d41/f5e 0 2024-04-23T14:49:34.047 INFO:tasks.workunit.client.0.smithi081.stdout:5/291: write d17/d4f/d61/f60 [942845,117702] 0 2024-04-23T14:49:34.051 INFO:tasks.workunit.client.0.smithi081.stdout:5/292: mknod d17/d4f/d61/c67 0 2024-04-23T14:49:34.064 INFO:tasks.workunit.client.0.smithi081.stdout:0/221: sync 2024-04-23T14:49:34.066 INFO:tasks.workunit.client.0.smithi081.stdout:0/222: fdatasync d6/d37/f38 0 2024-04-23T14:49:34.075 INFO:tasks.workunit.client.0.smithi081.stdout:2/314: dwrite d1/d11/f64 [0,4194304] 0 2024-04-23T14:49:34.125 INFO:tasks.workunit.client.0.smithi081.stdout:8/287: dwrite d3/f5e [0,4194304] 0 2024-04-23T14:49:34.126 INFO:tasks.workunit.client.0.smithi081.stdout:8/288: fsync f2 0 2024-04-23T14:49:34.126 INFO:tasks.workunit.client.0.smithi081.stdout:8/289: creat d3/d11/f67 x:0 0 0 2024-04-23T14:49:34.130 INFO:tasks.workunit.client.0.smithi081.stdout:8/290: truncate d3/d11/f1d 1907250 0 2024-04-23T14:49:34.131 INFO:tasks.workunit.client.0.smithi081.stdout:8/291: write d3/f2a [118895,26535] 0 2024-04-23T14:49:34.131 INFO:tasks.workunit.client.0.smithi081.stdout:8/292: stat d3/d1a/l38 0 2024-04-23T14:49:34.132 INFO:tasks.workunit.client.0.smithi081.stdout:8/293: getdents d3/d11/d4f/d58 0 2024-04-23T14:49:34.132 INFO:tasks.workunit.client.0.smithi081.stdout:0/223: dwrite d6/d11/d14/f16 [0,4194304] 0 2024-04-23T14:49:34.132 INFO:tasks.workunit.client.0.smithi081.stdout:0/224: readlink d6/d11/l1d 0 2024-04-23T14:49:34.132 INFO:tasks.workunit.client.0.smithi081.stdout:0/225: creat d6/d11/d14/d24/d35/f3e x:0 0 0 2024-04-23T14:49:34.152 INFO:tasks.workunit.client.0.smithi081.stdout:8/294: rmdir d3/d3c 39 2024-04-23T14:49:34.152 INFO:tasks.workunit.client.0.smithi081.stdout:8/295: creat d3/d11/d34/f68 x:0 0 0 2024-04-23T14:49:34.152 INFO:tasks.workunit.client.0.smithi081.stdout:8/296: fsync d3/d1a/f30 0 2024-04-23T14:49:34.174 INFO:tasks.workunit.client.0.smithi081.stdout:8/297: write d3/f5e [4830918,30241] 0 2024-04-23T14:49:34.183 INFO:tasks.workunit.client.0.smithi081.stdout:0/226: dwrite d6/f10 [0,4194304] 0 2024-04-23T14:49:34.187 INFO:tasks.workunit.client.0.smithi081.stdout:0/227: mkdir d6/d11/d14/d24/d35/d3f 0 2024-04-23T14:49:34.209 INFO:tasks.workunit.client.0.smithi081.stdout:8/298: dwrite d3/d1a/f53 [0,4194304] 0 2024-04-23T14:49:34.209 INFO:tasks.workunit.client.0.smithi081.stdout:8/299: creat d3/d11/d48/f69 x:0 0 0 2024-04-23T14:49:34.221 INFO:tasks.workunit.client.0.smithi081.stdout:0/228: truncate d6/f10 3028373 0 2024-04-23T14:49:34.282 INFO:tasks.workunit.client.0.smithi081.stdout:0/229: dwrite d6/f10 [0,4194304] 0 2024-04-23T14:49:34.282 INFO:tasks.workunit.client.0.smithi081.stdout:0/230: creat d6/d11/f40 x:0 0 0 2024-04-23T14:49:34.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:33 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:49:34.311 INFO:tasks.workunit.client.0.smithi081.stdout:0/231: read d6/fe [1575149,12143] 0 2024-04-23T14:49:34.314 INFO:tasks.workunit.client.0.smithi081.stdout:0/232: readlink d6/d37/l39 0 2024-04-23T14:49:34.319 INFO:tasks.workunit.client.0.smithi081.stdout:0/233: rmdir d6/d25 39 2024-04-23T14:49:34.320 INFO:tasks.workunit.client.0.smithi081.stdout:0/234: write d6/d25/f32 [414106,88456] 0 2024-04-23T14:49:34.322 INFO:tasks.workunit.client.0.smithi081.stdout:0/235: truncate d6/d11/d14/f26 287958 0 2024-04-23T14:49:34.324 INFO:tasks.workunit.client.0.smithi081.stdout:0/236: mkdir d6/d11/d14/d41 0 2024-04-23T14:49:34.324 INFO:tasks.workunit.client.0.smithi081.stdout:0/237: stat d6/d11/d14/d24/d35/f3d 0 2024-04-23T14:49:34.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:33 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:49:34.331 INFO:tasks.workunit.client.0.smithi081.stdout:0/238: read d6/d11/d14/f16 [5070077,73004] 0 2024-04-23T14:49:34.333 INFO:tasks.workunit.client.0.smithi081.stdout:0/239: rmdir d6/d25 39 2024-04-23T14:49:34.334 INFO:tasks.workunit.client.0.smithi081.stdout:6/210: sync 2024-04-23T14:49:34.334 INFO:tasks.workunit.client.0.smithi081.stdout:6/211: stat d1/d11/d13/f3c 0 2024-04-23T14:49:34.336 INFO:tasks.workunit.client.0.smithi081.stdout:0/240: mknod d6/d25/c42 0 2024-04-23T14:49:34.337 INFO:tasks.workunit.client.0.smithi081.stdout:0/241: write d6/d25/f32 [1245049,46418] 0 2024-04-23T14:49:34.337 INFO:tasks.workunit.client.0.smithi081.stdout:0/242: readlink d6/d11/d14/l3b 0 2024-04-23T14:49:34.339 INFO:tasks.workunit.client.0.smithi081.stdout:6/212: creat d1/d11/d13/f4e x:0 0 0 2024-04-23T14:49:34.339 INFO:tasks.workunit.client.0.smithi081.stdout:6/213: readlink d1/d11/d8/d2e/l34 0 2024-04-23T14:49:34.343 INFO:tasks.workunit.client.0.smithi081.stdout:0/243: rename d6/fe to d6/d11/d14/d41/f43 0 2024-04-23T14:49:34.346 INFO:tasks.workunit.client.0.smithi081.stdout:6/214: creat d1/d11/f4f x:0 0 0 2024-04-23T14:49:34.351 INFO:tasks.workunit.client.0.smithi081.stdout:0/244: mkdir d6/d11/d14/d24/d35/d3f/d44 0 2024-04-23T14:49:34.354 INFO:tasks.workunit.client.0.smithi081.stdout:6/215: truncate d1/fe 292018 0 2024-04-23T14:49:34.354 INFO:tasks.workunit.client.0.smithi081.stdout:6/216: fdatasync d1/d11/d13/f3e 0 2024-04-23T14:49:34.357 INFO:tasks.workunit.client.0.smithi081.stdout:0/245: creat d6/d25/f45 x:0 0 0 2024-04-23T14:49:34.361 INFO:tasks.workunit.client.0.smithi081.stdout:0/246: rmdir d6/d11/d14 39 2024-04-23T14:49:34.366 INFO:tasks.workunit.client.0.smithi081.stdout:0/247: mknod d6/d11/d14/c46 0 2024-04-23T14:49:34.368 INFO:tasks.workunit.client.0.smithi081.stdout:0/248: rename d6/d11/d14/d24/f1f to d6/d11/d14/d24/d35/f47 0 2024-04-23T14:49:34.372 INFO:tasks.workunit.client.0.smithi081.stdout:9/273: sync 2024-04-23T14:49:34.372 INFO:tasks.workunit.client.0.smithi081.stdout:0/249: write d6/d25/f28 [125912,20704] 0 2024-04-23T14:49:34.375 INFO:tasks.workunit.client.0.smithi081.stdout:9/274: mkdir d3/de/d1d/d5b 0 2024-04-23T14:49:34.378 INFO:tasks.workunit.client.0.smithi081.stdout:0/250: symlink d6/d11/d14/d24/d35/l48 0 2024-04-23T14:49:34.378 INFO:tasks.workunit.client.0.smithi081.stdout:0/251: chown d6/d11/l2a 20829 1 2024-04-23T14:49:34.378 INFO:tasks.workunit.client.0.smithi081.stdout:0/252: chown d6/d11/d14/d41/f43 2 1 2024-04-23T14:49:34.381 INFO:tasks.workunit.client.0.smithi081.stdout:9/275: creat d3/de/d1d/d5b/f5c x:0 0 0 2024-04-23T14:49:34.382 INFO:tasks.workunit.client.0.smithi081.stdout:9/276: write d3/de/d25/f45 [605905,93856] 0 2024-04-23T14:49:34.383 INFO:tasks.workunit.client.0.smithi081.stdout:6/217: write d1/d11/d13/f3e [39354,25059] 0 2024-04-23T14:49:34.383 INFO:tasks.workunit.client.0.smithi081.stdout:6/218: stat d1/d11/d13/d16/c20 0 2024-04-23T14:49:34.383 INFO:tasks.workunit.client.0.smithi081.stdout:6/219: readlink d1/d11/d8/d2e/l34 0 2024-04-23T14:49:34.383 INFO:tasks.workunit.client.0.smithi081.stdout:6/220: truncate d1/d11/f4f 713935 0 2024-04-23T14:49:34.383 INFO:tasks.workunit.client.0.smithi081.stdout:6/221: stat d1/d11/l1f 0 2024-04-23T14:49:34.386 INFO:tasks.workunit.client.0.smithi081.stdout:9/277: creat d3/de/d22/f5d x:0 0 0 2024-04-23T14:49:34.395 INFO:tasks.workunit.client.0.smithi081.stdout:6/222: mknod d1/d11/c50 0 2024-04-23T14:49:34.404 INFO:tasks.workunit.client.0.smithi081.stdout:6/223: rename d1/d11/d13/d33 to d1/d51 0 2024-04-23T14:49:34.409 INFO:tasks.workunit.client.0.smithi081.stdout:0/253: rmdir d6/d11/d14/d24/d35 39 2024-04-23T14:49:34.412 INFO:tasks.workunit.client.0.smithi081.stdout:0/254: mknod d6/d11/c49 0 2024-04-23T14:49:34.412 INFO:tasks.workunit.client.0.smithi081.stdout:0/255: chown d6/d11/d14/c46 445651 1 2024-04-23T14:49:34.412 INFO:tasks.workunit.client.0.smithi081.stdout:9/278: rmdir d3/de/d1d/d5b 39 2024-04-23T14:49:34.415 INFO:tasks.workunit.client.0.smithi081.stdout:0/256: creat d6/d11/d14/d24/d35/d3f/f4a x:0 0 0 2024-04-23T14:49:34.418 INFO:tasks.workunit.client.0.smithi081.stdout:9/279: unlink d3/de/f10 0 2024-04-23T14:49:34.420 INFO:tasks.workunit.client.0.smithi081.stdout:0/257: rmdir d6/d37 39 2024-04-23T14:49:34.424 INFO:tasks.workunit.client.0.smithi081.stdout:0/258: rename d6/d11/d14/f16 to d6/d11/d14/d24/f4b 0 2024-04-23T14:49:34.424 INFO:tasks.workunit.client.0.smithi081.stdout:0/259: read d6/d11/d14/f15 [24176,367] 0 2024-04-23T14:49:34.428 INFO:tasks.workunit.client.0.smithi081.stdout:0/260: mknod d6/d25/c4c 0 2024-04-23T14:49:34.435 INFO:tasks.workunit.client.0.smithi081.stdout:6/224: write d1/d11/d13/d16/f19 [1287209,40270] 0 2024-04-23T14:49:34.436 INFO:tasks.workunit.client.0.smithi081.stdout:0/261: unlink d6/d11/d14/f15 0 2024-04-23T14:49:34.441 INFO:tasks.workunit.client.0.smithi081.stdout:6/225: mkdir d1/d2/d49/d52 0 2024-04-23T14:49:34.443 INFO:tasks.workunit.client.0.smithi081.stdout:0/262: unlink d6/lc 0 2024-04-23T14:49:34.444 INFO:tasks.workunit.client.0.smithi081.stdout:9/280: dread d3/d5/f16 [0,4194304] 0 2024-04-23T14:49:34.445 INFO:tasks.workunit.client.0.smithi081.stdout:9/281: chown d3/f4e 3 1 2024-04-23T14:49:34.450 INFO:tasks.workunit.client.0.smithi081.stdout:6/226: unlink d1/d11/d1c/l3f 0 2024-04-23T14:49:34.451 INFO:tasks.workunit.client.0.smithi081.stdout:6/227: write d1/f17 [1118531,15475] 0 2024-04-23T14:49:34.454 INFO:tasks.workunit.client.0.smithi081.stdout:6/228: unlink d1/d11/d13/d16/f19 0 2024-04-23T14:49:34.457 INFO:tasks.workunit.client.0.smithi081.stdout:6/229: creat d1/d2/f53 x:0 0 0 2024-04-23T14:49:34.460 INFO:tasks.workunit.client.0.smithi081.stdout:6/230: mkdir d1/d51/d54 0 2024-04-23T14:49:34.463 INFO:tasks.workunit.client.0.smithi081.stdout:0/263: dread d6/d11/d14/d24/f4b [0,4194304] 0 2024-04-23T14:49:34.463 INFO:tasks.workunit.client.0.smithi081.stdout:0/264: write d6/d11/d14/d24/f4b [5893090,14493] 0 2024-04-23T14:49:34.465 INFO:tasks.workunit.client.0.smithi081.stdout:0/265: mkdir d6/d37/d4d 0 2024-04-23T14:49:34.474 INFO:tasks.workunit.client.0.smithi081.stdout:0/266: creat d6/d37/f4e x:0 0 0 2024-04-23T14:49:34.482 INFO:tasks.workunit.client.0.smithi081.stdout:0/267: creat d6/f4f x:0 0 0 2024-04-23T14:49:34.482 INFO:tasks.workunit.client.0.smithi081.stdout:0/268: chown f5 7214479 1 2024-04-23T14:49:34.483 INFO:tasks.workunit.client.0.smithi081.stdout:0/269: truncate d6/d25/f2e 203134 0 2024-04-23T14:49:34.483 INFO:tasks.workunit.client.0.smithi081.stdout:0/270: write d6/d11/d14/d24/d35/f47 [1170585,1091] 0 2024-04-23T14:49:34.483 INFO:tasks.workunit.client.0.smithi081.stdout:0/271: creat d6/f50 x:0 0 0 2024-04-23T14:49:34.483 INFO:tasks.workunit.client.0.smithi081.stdout:0/272: creat d6/d25/f51 x:0 0 0 2024-04-23T14:49:34.493 INFO:tasks.workunit.client.0.smithi081.stdout:6/231: dread d1/d2/f1d [0,4194304] 0 2024-04-23T14:49:34.495 INFO:tasks.workunit.client.0.smithi081.stdout:6/232: mknod d1/d2/d49/d52/c55 0 2024-04-23T14:49:34.497 INFO:tasks.workunit.client.0.smithi081.stdout:6/233: symlink d1/d11/d13/d46/l56 0 2024-04-23T14:49:34.498 INFO:tasks.workunit.client.0.smithi081.stdout:0/273: read d6/ff [3538210,119871] 0 2024-04-23T14:49:34.498 INFO:tasks.workunit.client.0.smithi081.stdout:0/274: readlink d6/d11/d14/d24/l29 0 2024-04-23T14:49:34.499 INFO:tasks.workunit.client.0.smithi081.stdout:6/234: mknod d1/d2/d49/c57 0 2024-04-23T14:49:34.499 INFO:tasks.workunit.client.0.smithi081.stdout:6/235: fdatasync d1/d11/d8/f42 0 2024-04-23T14:49:34.502 INFO:tasks.workunit.client.0.smithi081.stdout:6/236: read d1/d11/d13/f23 [545323,15500] 0 2024-04-23T14:49:34.504 INFO:tasks.workunit.client.0.smithi081.stdout:6/237: mkdir d1/d11/d8/d2e/d58 0 2024-04-23T14:49:34.504 INFO:tasks.workunit.client.0.smithi081.stdout:6/238: write d1/d11/d13/f3c [839643,82152] 0 2024-04-23T14:49:34.505 INFO:tasks.workunit.client.0.smithi081.stdout:7/205: sync 2024-04-23T14:49:34.505 INFO:tasks.workunit.client.0.smithi081.stdout:3/236: sync 2024-04-23T14:49:34.505 INFO:tasks.workunit.client.0.smithi081.stdout:4/236: sync 2024-04-23T14:49:34.505 INFO:tasks.workunit.client.0.smithi081.stdout:4/237: write d1/f31 [1207139,46483] 0 2024-04-23T14:49:34.507 INFO:tasks.workunit.client.0.smithi081.stdout:6/239: unlink d1/d2/l39 0 2024-04-23T14:49:34.509 INFO:tasks.workunit.client.0.smithi081.stdout:4/238: creat d1/d1d/f51 x:0 0 0 2024-04-23T14:49:34.509 INFO:tasks.workunit.client.0.smithi081.stdout:4/239: chown d1/d1d/f30 232850400 1 2024-04-23T14:49:34.509 INFO:tasks.workunit.client.0.smithi081.stdout:4/240: creat d1/d1d/f52 x:0 0 0 2024-04-23T14:49:34.509 INFO:tasks.workunit.client.0.smithi081.stdout:4/241: chown d1/d4/dc/c15 0 1 2024-04-23T14:49:34.509 INFO:tasks.workunit.client.0.smithi081.stdout:4/242: readlink d1/d4/l13 0 2024-04-23T14:49:34.512 INFO:tasks.workunit.client.0.smithi081.stdout:6/240: mkdir d1/d11/d8/d2e/d59 0 2024-04-23T14:49:34.518 INFO:tasks.workunit.client.0.smithi081.stdout:6/241: mkdir d1/d2/d5a 0 2024-04-23T14:49:34.518 INFO:tasks.workunit.client.0.smithi081.stdout:6/242: getdents d1/d51/d54 0 2024-04-23T14:49:34.522 INFO:tasks.workunit.client.0.smithi081.stdout:6/243: creat d1/d11/d8/d2e/f5b x:0 0 0 2024-04-23T14:49:34.522 INFO:tasks.workunit.client.0.smithi081.stdout:6/244: fdatasync d1/d11/d13/d16/f32 0 2024-04-23T14:49:34.528 INFO:tasks.workunit.client.0.smithi081.stdout:9/282: dwrite d3/de/d1d/d2f/f31 [0,4194304] 0 2024-04-23T14:49:34.541 INFO:tasks.workunit.client.0.smithi081.stdout:9/283: mkdir d3/de/d14/d5e 0 2024-04-23T14:49:34.544 INFO:tasks.workunit.client.0.smithi081.stdout:0/275: dread d6/d11/d14/d24/d35/f47 [0,4194304] 0 2024-04-23T14:49:34.547 INFO:tasks.workunit.client.0.smithi081.stdout:9/284: creat d3/de/d1d/d54/f5f x:0 0 0 2024-04-23T14:49:34.548 INFO:tasks.workunit.client.0.smithi081.stdout:6/245: dread d1/f17 [0,4194304] 0 2024-04-23T14:49:34.548 INFO:tasks.workunit.client.0.smithi081.stdout:6/246: chown d1/d11/d13/d46/l56 1936333 1 2024-04-23T14:49:34.548 INFO:tasks.workunit.client.0.smithi081.stdout:6/247: creat d1/d11/f5c x:0 0 0 2024-04-23T14:49:34.548 INFO:tasks.workunit.client.0.smithi081.stdout:6/248: write d1/d11/d8/d2e/f5b [216330,65601] 0 2024-04-23T14:49:34.552 INFO:tasks.workunit.client.0.smithi081.stdout:0/276: mknod d6/d11/d14/d24/c52 0 2024-04-23T14:49:34.552 INFO:tasks.workunit.client.0.smithi081.stdout:0/277: fsync d6/d25/f51 0 2024-04-23T14:49:34.555 INFO:tasks.workunit.client.0.smithi081.stdout:3/237: dwrite d4/d7/d32/f3e [0,4194304] 0 2024-04-23T14:49:34.555 INFO:tasks.workunit.client.0.smithi081.stdout:3/238: chown d4/f17 63018 1 2024-04-23T14:49:34.555 INFO:tasks.workunit.client.0.smithi081.stdout:9/285: dread d3/f4a [0,4194304] 0 2024-04-23T14:49:34.555 INFO:tasks.workunit.client.0.smithi081.stdout:6/249: unlink d1/d11/d1c/l44 0 2024-04-23T14:49:34.559 INFO:tasks.workunit.client.0.smithi081.stdout:6/250: fdatasync d1/d11/d13/f23 0 2024-04-23T14:49:34.559 INFO:tasks.workunit.client.0.smithi081.stdout:0/278: mkdir d6/d53 0 2024-04-23T14:49:34.559 INFO:tasks.workunit.client.0.smithi081.stdout:0/279: readlink d6/d11/l22 0 2024-04-23T14:49:34.559 INFO:tasks.workunit.client.0.smithi081.stdout:0/280: write d6/d11/d14/d24/d35/d3f/f4a [711915,55427] 0 2024-04-23T14:49:34.559 INFO:tasks.workunit.client.0.smithi081.stdout:0/281: write d6/f4f [683951,96323] 0 2024-04-23T14:49:34.561 INFO:tasks.workunit.client.0.smithi081.stdout:4/243: dwrite d1/f9 [4194304,4194304] 0 2024-04-23T14:49:34.563 INFO:tasks.workunit.client.0.smithi081.stdout:3/239: rename d4/d7/l54 to d4/d7/d1a/l57 0 2024-04-23T14:49:34.563 INFO:tasks.workunit.client.0.smithi081.stdout:3/240: fdatasync d4/dc/f45 0 2024-04-23T14:49:34.563 INFO:tasks.workunit.client.0.smithi081.stdout:0/282: fsync d6/d11/d14/d41/f43 0 2024-04-23T14:49:34.565 INFO:tasks.workunit.client.0.smithi081.stdout:9/286: dread - d3/de/d1d/d2f/f58 zero size 2024-04-23T14:49:34.565 INFO:tasks.workunit.client.0.smithi081.stdout:9/287: readlink d3/de/d22/l4d 0 2024-04-23T14:49:34.565 INFO:tasks.workunit.client.0.smithi081.stdout:9/288: write d3/f9 [3085162,53628] 0 2024-04-23T14:49:34.568 INFO:tasks.workunit.client.0.smithi081.stdout:7/206: dwrite d3/d21/d31/fd [0,4194304] 0 2024-04-23T14:49:34.568 INFO:tasks.workunit.client.0.smithi081.stdout:7/207: write f2 [649503,98287] 0 2024-04-23T14:49:34.568 INFO:tasks.workunit.client.0.smithi081.stdout:7/208: chown d3/lf 9673539 1 2024-04-23T14:49:34.568 INFO:tasks.workunit.client.0.smithi081.stdout:4/244: link d1/d1d/d39/f3c d1/d1d/d39/f53 0 2024-04-23T14:49:34.569 INFO:tasks.workunit.client.0.smithi081.stdout:4/245: chown d1/d1d/f47 23 1 2024-04-23T14:49:34.570 INFO:tasks.workunit.client.0.smithi081.stdout:3/241: mknod d4/d7/df/c58 0 2024-04-23T14:49:34.575 INFO:tasks.workunit.client.0.smithi081.stdout:0/283: unlink d6/d25/c4c 0 2024-04-23T14:49:34.575 INFO:tasks.workunit.client.0.smithi081.stdout:0/284: write d6/d25/f2e [269634,25347] 0 2024-04-23T14:49:34.575 INFO:tasks.workunit.client.0.smithi081.stdout:0/285: truncate d6/f9 1190932 0 2024-04-23T14:49:34.578 INFO:tasks.workunit.client.0.smithi081.stdout:9/289: write d3/de/d1d/d5b/f5c [960867,12728] 0 2024-04-23T14:49:34.583 INFO:tasks.workunit.client.0.smithi081.stdout:7/209: write d3/d21/d31/f8 [1064966,128358] 0 2024-04-23T14:49:34.583 INFO:tasks.workunit.client.0.smithi081.stdout:7/210: creat d3/d20/f45 x:0 0 0 2024-04-23T14:49:34.585 INFO:tasks.workunit.client.0.smithi081.stdout:4/246: getdents d1/d3 0 2024-04-23T14:49:34.585 INFO:tasks.workunit.client.0.smithi081.stdout:4/247: write d1/d1d/f26 [1614053,103382] 0 2024-04-23T14:49:34.589 INFO:tasks.workunit.client.0.smithi081.stdout:0/286: creat d6/d11/d14/f54 x:0 0 0 2024-04-23T14:49:34.590 INFO:tasks.workunit.client.0.smithi081.stdout:9/290: link d3/d5/f21 d3/de/d25/f60 0 2024-04-23T14:49:34.598 INFO:tasks.workunit.client.0.smithi081.stdout:4/248: rename d1/d4/dc/c45 to d1/d1d/c54 0 2024-04-23T14:49:34.599 INFO:tasks.workunit.client.0.smithi081.stdout:0/287: creat d6/d37/d4d/f55 x:0 0 0 2024-04-23T14:49:34.602 INFO:tasks.workunit.client.0.smithi081.stdout:9/291: mkdir d3/de/d61 0 2024-04-23T14:49:34.617 INFO:tasks.workunit.client.0.smithi081.stdout:4/249: symlink d1/d1d/d39/l55 0 2024-04-23T14:49:34.620 INFO:tasks.workunit.client.0.smithi081.stdout:0/288: link d6/d11/l1d d6/d37/d4d/l56 0 2024-04-23T14:49:34.621 INFO:tasks.workunit.client.0.smithi081.stdout:0/289: chown d6/d11/d14/c27 2541 1 2024-04-23T14:49:34.621 INFO:tasks.workunit.client.0.smithi081.stdout:0/290: dread - d6/d37/d4d/f55 zero size 2024-04-23T14:49:34.621 INFO:tasks.workunit.client.0.smithi081.stdout:0/291: dread - d6/d11/d14/d24/d35/f3e zero size 2024-04-23T14:49:34.621 INFO:tasks.workunit.client.0.smithi081.stdout:2/315: sync 2024-04-23T14:49:34.621 INFO:tasks.workunit.client.0.smithi081.stdout:1/284: sync 2024-04-23T14:49:34.622 INFO:tasks.workunit.client.0.smithi081.stdout:5/293: sync 2024-04-23T14:49:34.622 INFO:tasks.workunit.client.0.smithi081.stdout:5/294: write d17/d1f/f31 [1874848,12124] 0 2024-04-23T14:49:34.622 INFO:tasks.workunit.client.0.smithi081.stdout:8/300: sync 2024-04-23T14:49:34.629 INFO:tasks.workunit.client.0.smithi081.stdout:9/292: unlink d3/d1a/f4f 0 2024-04-23T14:49:34.629 INFO:tasks.workunit.client.0.smithi081.stdout:5/295: write d17/f38 [64356,28418] 0 2024-04-23T14:49:34.629 INFO:tasks.workunit.client.0.smithi081.stdout:0/292: creat d6/d11/d14/d24/f57 x:0 0 0 2024-04-23T14:49:34.630 INFO:tasks.workunit.client.0.smithi081.stdout:8/301: creat d3/d11/d4f/f6a x:0 0 0 2024-04-23T14:49:34.631 INFO:tasks.workunit.client.0.smithi081.stdout:1/285: dread d3/d3d/d41/d4a/f43 [0,4194304] 0 2024-04-23T14:49:34.634 INFO:tasks.workunit.client.0.smithi081.stdout:2/316: dread d1/fb [0,4194304] 0 2024-04-23T14:49:34.643 INFO:tasks.workunit.client.0.smithi081.stdout:8/302: rename d3/l18 to d3/d11/d3e/l6b 0 2024-04-23T14:49:34.643 INFO:tasks.workunit.client.0.smithi081.stdout:1/286: mkdir d3/d15/d12/d34/d5c 0 2024-04-23T14:49:34.646 INFO:tasks.workunit.client.0.smithi081.stdout:5/296: write d17/d1f/f23 [3605691,111837] 0 2024-04-23T14:49:34.646 INFO:tasks.workunit.client.0.smithi081.stdout:5/297: stat d17/d18/f32 0 2024-04-23T14:49:34.652 INFO:tasks.workunit.client.0.smithi081.stdout:2/317: unlink d1/d11/f64 0 2024-04-23T14:49:34.654 INFO:tasks.workunit.client.0.smithi081.stdout:7/211: rmdir d3 39 2024-04-23T14:49:34.660 INFO:tasks.workunit.client.0.smithi081.stdout:1/287: unlink d3/d3d/l18 0 2024-04-23T14:49:34.661 INFO:tasks.workunit.client.0.smithi081.stdout:1/288: chown d3/d15/d17/d25/f4d 1929320134 1 2024-04-23T14:49:34.661 INFO:tasks.workunit.client.0.smithi081.stdout:1/289: chown d3/d15/d12/d1a/f48 6315551 1 2024-04-23T14:49:34.666 INFO:tasks.workunit.client.0.smithi081.stdout:1/290: mkdir d3/d15/d5d 0 2024-04-23T14:49:34.666 INFO:tasks.workunit.client.0.smithi081.stdout:2/318: fdatasync d1/d33/d45/f4d 0 2024-04-23T14:49:34.667 INFO:tasks.workunit.client.0.smithi081.stdout:5/298: creat d17/d4f/f68 x:0 0 0 2024-04-23T14:49:34.667 INFO:tasks.workunit.client.0.smithi081.stdout:1/291: fdatasync d3/d3d/d41/f5b 0 2024-04-23T14:49:34.667 INFO:tasks.workunit.client.0.smithi081.stdout:1/292: write d3/d15/d17/f20 [460747,59214] 0 2024-04-23T14:49:34.667 INFO:tasks.workunit.client.0.smithi081.stdout:1/293: readlink d3/d15/d17/l19 0 2024-04-23T14:49:34.671 INFO:tasks.workunit.client.0.smithi081.stdout:5/299: link d17/c35 d17/d4f/d61/c69 0 2024-04-23T14:49:34.672 INFO:tasks.workunit.client.0.smithi081.stdout:5/300: creat d17/d3d/d41/f6a x:0 0 0 2024-04-23T14:49:34.672 INFO:tasks.workunit.client.0.smithi081.stdout:5/301: write d17/d1f/f23 [2430238,81935] 0 2024-04-23T14:49:34.678 INFO:tasks.workunit.client.0.smithi081.stdout:8/303: write d3/d3c/f43 [1736231,79118] 0 2024-04-23T14:49:34.684 INFO:tasks.workunit.client.0.smithi081.stdout:8/304: mkdir d3/d11/d4f/d6c 0 2024-04-23T14:49:34.684 INFO:tasks.workunit.client.0.smithi081.stdout:8/305: stat d3/l16 0 2024-04-23T14:49:34.684 INFO:tasks.workunit.client.0.smithi081.stdout:8/306: fsync d3/d11/d34/f68 0 2024-04-23T14:49:34.685 INFO:tasks.workunit.client.0.smithi081.stdout:8/307: symlink d3/d11/d3e/d63/l6d 0 2024-04-23T14:49:34.685 INFO:tasks.workunit.client.0.smithi081.stdout:8/308: getdents d3/d11/d4f/d58 0 2024-04-23T14:49:34.685 INFO:tasks.workunit.client.0.smithi081.stdout:8/309: chown d3/d11/d3e/l6b 5491 1 2024-04-23T14:49:34.690 INFO:tasks.workunit.client.0.smithi081.stdout:0/293: dwrite d6/d37/d4d/f55 [0,4194304] 0 2024-04-23T14:49:34.697 INFO:tasks.workunit.client.0.smithi081.stdout:8/310: dread d3/d11/f2e [0,4194304] 0 2024-04-23T14:49:34.697 INFO:tasks.workunit.client.0.smithi081.stdout:0/294: mkdir d6/d25/d58 0 2024-04-23T14:49:34.697 INFO:tasks.workunit.client.0.smithi081.stdout:0/295: readlink d6/d37/l39 0 2024-04-23T14:49:34.697 INFO:tasks.workunit.client.0.smithi081.stdout:0/296: truncate d6/d25/f45 649426 0 2024-04-23T14:49:34.701 INFO:tasks.workunit.client.0.smithi081.stdout:0/297: fdatasync d6/d11/d14/d41/f43 0 2024-04-23T14:49:34.701 INFO:tasks.workunit.client.0.smithi081.stdout:0/298: fsync d6/f50 0 2024-04-23T14:49:34.701 INFO:tasks.workunit.client.0.smithi081.stdout:0/299: fdatasync d6/f2d 0 2024-04-23T14:49:34.705 INFO:tasks.workunit.client.0.smithi081.stdout:0/300: dread d6/d11/d14/d24/d35/d3f/f4a [0,4194304] 0 2024-04-23T14:49:34.705 INFO:tasks.workunit.client.0.smithi081.stdout:0/301: truncate d6/f10 4227922 0 2024-04-23T14:49:34.707 INFO:tasks.workunit.client.0.smithi081.stdout:0/302: mkdir d6/d11/d14/d24/d35/d59 0 2024-04-23T14:49:34.709 INFO:tasks.workunit.client.0.smithi081.stdout:5/302: dread d17/d1f/d36/f3f [0,4194304] 0 2024-04-23T14:49:34.710 INFO:tasks.workunit.client.0.smithi081.stdout:7/212: dwrite d3/f36 [0,4194304] 0 2024-04-23T14:49:34.710 INFO:tasks.workunit.client.0.smithi081.stdout:7/213: stat d3/d11/d15 0 2024-04-23T14:49:34.717 INFO:tasks.workunit.client.0.smithi081.stdout:8/311: dread d3/d1a/f51 [0,4194304] 0 2024-04-23T14:49:34.722 INFO:tasks.workunit.client.0.smithi081.stdout:7/214: getdents d3/d21/d41 0 2024-04-23T14:49:34.722 INFO:tasks.workunit.client.0.smithi081.stdout:7/215: stat d3/d11/f1b 0 2024-04-23T14:49:34.725 INFO:tasks.workunit.client.0.smithi081.stdout:8/312: link d3/c33 d3/d11/d4f/d6c/c6e 0 2024-04-23T14:49:34.727 INFO:tasks.workunit.client.0.smithi081.stdout:5/303: getdents d17/d3c 0 2024-04-23T14:49:34.727 INFO:tasks.workunit.client.0.smithi081.stdout:5/304: dread - d17/d4f/f68 zero size 2024-04-23T14:49:34.728 INFO:tasks.workunit.client.0.smithi081.stdout:7/216: stat d3/d21/d31/f9 0 2024-04-23T14:49:34.729 INFO:tasks.workunit.client.0.smithi081.stdout:2/319: rmdir d1 39 2024-04-23T14:49:34.732 INFO:tasks.workunit.client.0.smithi081.stdout:8/313: unlink d3/f27 0 2024-04-23T14:49:34.735 INFO:tasks.workunit.client.0.smithi081.stdout:5/305: link d17/d3c/d55/l5d d17/d4f/d61/l6b 0 2024-04-23T14:49:34.735 INFO:tasks.workunit.client.0.smithi081.stdout:5/306: fdatasync d17/d3d/d41/f5e 0 2024-04-23T14:49:34.736 INFO:tasks.workunit.client.0.smithi081.stdout:1/294: rename d3/d15 to d3/d3d/d41/d5e 0 2024-04-23T14:49:34.737 INFO:tasks.workunit.client.0.smithi081.stdout:1/295: write d3/d3d/d41/d5e/d12/d1a/d2a/f45 [1114978,97617] 0 2024-04-23T14:49:34.738 INFO:tasks.workunit.client.0.smithi081.stdout:7/217: unlink d3/d11/d15/f42 0 2024-04-23T14:49:34.740 INFO:tasks.workunit.client.0.smithi081.stdout:2/320: creat d1/d11/d21/d34/f72 x:0 0 0 2024-04-23T14:49:34.741 INFO:tasks.workunit.client.0.smithi081.stdout:5/307: creat d17/d4f/d61/f6c x:0 0 0 2024-04-23T14:49:34.744 INFO:tasks.workunit.client.0.smithi081.stdout:1/296: creat d3/d3d/d41/f5f x:0 0 0 2024-04-23T14:49:34.744 INFO:tasks.workunit.client.0.smithi081.stdout:1/297: write d3/d3d/d41/d5e/d17/d25/f4d [950092,3716] 0 2024-04-23T14:49:34.745 INFO:tasks.workunit.client.0.smithi081.stdout:7/218: mknod d3/d21/c46 0 2024-04-23T14:49:34.748 INFO:tasks.workunit.client.0.smithi081.stdout:1/298: link d3/d3d/c2b d3/d3d/d41/d5e/d12/d3b/c60 0 2024-04-23T14:49:34.751 INFO:tasks.workunit.client.0.smithi081.stdout:7/219: unlink d3/d11/l2b 0 2024-04-23T14:49:34.754 INFO:tasks.workunit.client.0.smithi081.stdout:7/220: truncate d3/d21/d31/fd 3866199 0 2024-04-23T14:49:34.756 INFO:tasks.workunit.client.0.smithi081.stdout:7/221: symlink d3/d21/d31/l47 0 2024-04-23T14:49:34.756 INFO:tasks.workunit.client.0.smithi081.stdout:7/222: write d3/d20/f2d [2225839,106333] 0 2024-04-23T14:49:34.758 INFO:tasks.workunit.client.0.smithi081.stdout:7/223: unlink d3/lf 0 2024-04-23T14:49:34.758 INFO:tasks.workunit.client.0.smithi081.stdout:7/224: rename d3/d21/d41 to d3/d21/d41/d48 22 2024-04-23T14:49:34.758 INFO:tasks.workunit.client.0.smithi081.stdout:7/225: fdatasync d3/d21/d31/fd 0 2024-04-23T14:49:34.758 INFO:tasks.workunit.client.0.smithi081.stdout:7/226: chown d3/d20/f45 457673656 1 2024-04-23T14:49:34.761 INFO:tasks.workunit.client.0.smithi081.stdout:7/227: rename d3/d11/f18 to d3/f49 0 2024-04-23T14:49:34.762 INFO:tasks.workunit.client.0.smithi081.stdout:7/228: getdents d3/d21/d41 0 2024-04-23T14:49:34.762 INFO:tasks.workunit.client.0.smithi081.stdout:2/321: dread d1/d33/f5e [0,4194304] 0 2024-04-23T14:49:34.766 INFO:tasks.workunit.client.0.smithi081.stdout:7/229: creat d3/d21/f4a x:0 0 0 2024-04-23T14:49:34.766 INFO:tasks.workunit.client.0.smithi081.stdout:7/230: truncate d3/d21/d31/f8 1493619 0 2024-04-23T14:49:34.766 INFO:tasks.workunit.client.0.smithi081.stdout:7/231: write d3/f10 [4903550,38548] 0 2024-04-23T14:49:34.772 INFO:tasks.workunit.client.0.smithi081.stdout:2/322: link d1/d11/f26 d1/d11/d21/d34/f73 0 2024-04-23T14:49:34.782 INFO:tasks.workunit.client.0.smithi081.stdout:0/303: dwrite d6/d11/d14/d41/f43 [0,4194304] 0 2024-04-23T14:49:34.782 INFO:tasks.workunit.client.0.smithi081.stdout:0/304: write d6/f9 [511373,121136] 0 2024-04-23T14:49:34.782 INFO:tasks.workunit.client.0.smithi081.stdout:0/305: chown d6/d25/f51 2724 1 2024-04-23T14:49:34.782 INFO:tasks.workunit.client.0.smithi081.stdout:0/306: truncate d6/d37/f4e 161322 0 2024-04-23T14:49:34.784 INFO:tasks.workunit.client.0.smithi081.stdout:2/323: mknod d1/d33/d45/c74 0 2024-04-23T14:49:34.787 INFO:tasks.workunit.client.0.smithi081.stdout:9/293: dwrite d3/de/d22/f51 [8388608,4194304] 0 2024-04-23T14:49:34.787 INFO:tasks.workunit.client.0.smithi081.stdout:8/314: write d3/d11/d34/f40 [2964787,4132] 0 2024-04-23T14:49:34.787 INFO:tasks.workunit.client.0.smithi081.stdout:6/251: dwrite d1/d11/f5c [0,4194304] 0 2024-04-23T14:49:34.793 INFO:tasks.workunit.client.0.smithi081.stdout:7/232: mkdir d3/d21/d31/d33/d4b 0 2024-04-23T14:49:34.796 INFO:tasks.workunit.client.0.smithi081.stdout:0/307: rename d6/l1e to d6/d11/d14/d24/d35/d59/l5a 0 2024-04-23T14:49:34.798 INFO:tasks.workunit.client.0.smithi081.stdout:2/324: creat d1/d11/d21/d52/f75 x:0 0 0 2024-04-23T14:49:34.800 INFO:tasks.workunit.client.0.smithi081.stdout:1/299: dread d3/d3d/d41/d5e/d17/d25/f4d [0,4194304] 0 2024-04-23T14:49:34.800 INFO:tasks.workunit.client.0.smithi081.stdout:1/300: fsync d3/d3d/d41/d5e/d17/f27 0 2024-04-23T14:49:34.800 INFO:tasks.workunit.client.0.smithi081.stdout:1/301: truncate d3/d3d/d41/d5e/d12/f40 652960 0 2024-04-23T14:49:34.805 INFO:tasks.workunit.client.0.smithi081.stdout:5/308: dwrite d17/d18/f33 [0,4194304] 0 2024-04-23T14:49:34.805 INFO:tasks.workunit.client.0.smithi081.stdout:5/309: creat d17/d1f/d36/d59/f6d x:0 0 0 2024-04-23T14:49:34.810 INFO:tasks.workunit.client.0.smithi081.stdout:6/252: dread d1/d11/d8/f42 [0,4194304] 0 2024-04-23T14:49:34.821 INFO:tasks.workunit.client.0.smithi081.stdout:8/315: unlink d3/d1a/f56 0 2024-04-23T14:49:34.837 INFO:tasks.workunit.client.0.smithi081.stdout:0/308: dwrite d6/d25/f45 [0,4194304] 0 2024-04-23T14:49:34.837 INFO:tasks.workunit.client.0.smithi081.stdout:8/316: dread d3/d11/f1d [0,4194304] 0 2024-04-23T14:49:34.840 INFO:tasks.workunit.client.0.smithi081.stdout:7/233: rename d3/d20/d1e to d3/d21/d31/d33/d4b/d4c 0 2024-04-23T14:49:34.840 INFO:tasks.workunit.client.0.smithi081.stdout:7/234: readlink d3/d21/d31/d33/l37 0 2024-04-23T14:49:34.840 INFO:tasks.workunit.client.0.smithi081.stdout:2/325: dread - d1/d33/f6d zero size 2024-04-23T14:49:34.840 INFO:tasks.workunit.client.0.smithi081.stdout:7/235: truncate d3/d21/d31/fd 4569259 0 2024-04-23T14:49:34.842 INFO:tasks.workunit.client.0.smithi081.stdout:1/302: creat d3/d3d/d41/d5e/d17/d58/f61 x:0 0 0 2024-04-23T14:49:34.842 INFO:tasks.workunit.client.0.smithi081.stdout:1/303: chown d3/d3d/d41/d4a/c21 3790644 1 2024-04-23T14:49:34.846 INFO:tasks.workunit.client.0.smithi081.stdout:5/310: creat d17/d37/f6e x:0 0 0 2024-04-23T14:49:34.853 INFO:tasks.workunit.client.0.smithi081.stdout:6/253: creat d1/d51/f5d x:0 0 0 2024-04-23T14:49:34.854 INFO:tasks.workunit.client.0.smithi081.stdout:9/294: mkdir d3/de/d1d/d62 0 2024-04-23T14:49:34.854 INFO:tasks.workunit.client.0.smithi081.stdout:9/295: write d3/de/d14/f38 [9175594,84866] 0 2024-04-23T14:49:34.861 INFO:tasks.workunit.client.0.smithi081.stdout:2/326: rename d1/d11/f28 to d1/d11/d21/d34/f76 0 2024-04-23T14:49:34.861 INFO:tasks.workunit.client.0.smithi081.stdout:2/327: dread - d1/d33/d45/f4d zero size 2024-04-23T14:49:34.863 INFO:tasks.workunit.client.0.smithi081.stdout:7/236: mknod d3/d21/d41/c4d 0 2024-04-23T14:49:34.863 INFO:tasks.workunit.client.0.smithi081.stdout:7/237: readlink d3/d21/l35 0 2024-04-23T14:49:34.864 INFO:tasks.workunit.client.0.smithi081.stdout:1/304: chown d3/d3d/d41/d5e/d17/d26/f31 256484 1 2024-04-23T14:49:34.866 INFO:tasks.workunit.client.0.smithi081.stdout:5/311: creat d17/d3c/f6f x:0 0 0 2024-04-23T14:49:34.873 INFO:tasks.workunit.client.0.smithi081.stdout:6/254: symlink d1/d11/d13/d46/l5e 0 2024-04-23T14:49:34.875 INFO:tasks.workunit.client.0.smithi081.stdout:2/328: mkdir d1/d11/d21/d22/d77 0 2024-04-23T14:49:34.879 INFO:tasks.workunit.client.0.smithi081.stdout:7/238: mknod d3/d21/d41/c4e 0 2024-04-23T14:49:34.885 INFO:tasks.workunit.client.0.smithi081.stdout:1/305: dread f0 [0,4194304] 0 2024-04-23T14:49:34.885 INFO:tasks.workunit.client.0.smithi081.stdout:1/306: write d3/d3d/d41/f5f [349328,13552] 0 2024-04-23T14:49:34.895 INFO:tasks.workunit.client.0.smithi081.stdout:7/239: dread d3/d21/d31/d33/f3b [0,4194304] 0 2024-04-23T14:49:34.895 INFO:tasks.workunit.client.0.smithi081.stdout:9/296: dread d3/de/d1d/d2f/f31 [0,4194304] 0 2024-04-23T14:49:34.899 INFO:tasks.workunit.client.0.smithi081.stdout:6/255: write d1/d11/d8/f2b [2801573,96201] 0 2024-04-23T14:49:34.900 INFO:tasks.workunit.client.0.smithi081.stdout:5/312: write d17/d18/f19 [499426,120037] 0 2024-04-23T14:49:34.900 INFO:tasks.workunit.client.0.smithi081.stdout:8/317: dwrite d3/d11/d3e/f44 [0,4194304] 0 2024-04-23T14:49:34.902 INFO:tasks.workunit.client.0.smithi081.stdout:1/307: unlink d3/d3d/d41/d5e/d17/c24 0 2024-04-23T14:49:34.905 INFO:tasks.workunit.client.0.smithi081.stdout:0/309: dwrite d6/d37/f4e [0,4194304] 0 2024-04-23T14:49:34.905 INFO:tasks.workunit.client.0.smithi081.stdout:0/310: write d6/d11/d14/d24/d35/f3e [426103,10271] 0 2024-04-23T14:49:34.908 INFO:tasks.workunit.client.0.smithi081.stdout:6/256: mkdir d1/d2/d49/d52/d5f 0 2024-04-23T14:49:34.909 INFO:tasks.workunit.client.0.smithi081.stdout:8/318: dread d3/d11/d34/f57 [0,4194304] 0 2024-04-23T14:49:34.914 INFO:tasks.workunit.client.0.smithi081.stdout:9/297: unlink d3/de/d1d/f1e 0 2024-04-23T14:49:34.914 INFO:tasks.workunit.client.0.smithi081.stdout:8/319: read d3/f4 [155505,109233] 0 2024-04-23T14:49:34.914 INFO:tasks.workunit.client.0.smithi081.stdout:8/320: chown d3/d11/c3d 399150 1 2024-04-23T14:49:34.933 INFO:tasks.workunit.client.0.smithi081.stdout:6/257: symlink d1/d2/d5a/l60 0 2024-04-23T14:49:34.933 INFO:tasks.workunit.client.0.smithi081.stdout:6/258: fdatasync d1/d11/d13/f4e 0 2024-04-23T14:49:34.939 INFO:tasks.workunit.client.0.smithi081.stdout:9/298: getdents d3/de/d47 0 2024-04-23T14:49:34.939 INFO:tasks.workunit.client.0.smithi081.stdout:9/299: creat d3/d1a/f63 x:0 0 0 2024-04-23T14:49:34.939 INFO:tasks.workunit.client.0.smithi081.stdout:9/300: creat d3/de/f64 x:0 0 0 2024-04-23T14:49:34.939 INFO:tasks.workunit.client.0.smithi081.stdout:9/301: chown d3/de/d25/l5a 25 1 2024-04-23T14:49:34.945 INFO:tasks.workunit.client.0.smithi081.stdout:5/313: getdents d17/d3c 0 2024-04-23T14:49:34.950 INFO:tasks.workunit.client.0.smithi081.stdout:5/314: dread d17/d18/f2e [4194304,4194304] 0 2024-04-23T14:49:34.955 INFO:tasks.workunit.client.0.smithi081.stdout:7/240: dwrite d3/d21/f4a [0,4194304] 0 2024-04-23T14:49:34.955 INFO:tasks.workunit.client.0.smithi081.stdout:9/302: rename d3/de/d1d/d2f to d3/de/d14/d5e/d65 0 2024-04-23T14:49:34.955 INFO:tasks.workunit.client.0.smithi081.stdout:9/303: stat d3/de/d25 0 2024-04-23T14:49:34.955 INFO:tasks.workunit.client.0.smithi081.stdout:9/304: creat d3/de/d1d/d54/f66 x:0 0 0 2024-04-23T14:49:34.956 INFO:tasks.workunit.client.0.smithi081.stdout:9/305: read - d3/de/d1d/d54/f5f zero size 2024-04-23T14:49:34.956 INFO:tasks.workunit.client.0.smithi081.stdout:9/306: chown d3/de/d25/f60 438798175 1 2024-04-23T14:49:34.972 INFO:tasks.workunit.client.0.smithi081.stdout:7/241: mkdir d3/d21/d31/d33/d4b/d4c/d4f 0 2024-04-23T14:49:34.972 INFO:tasks.workunit.client.0.smithi081.stdout:7/242: truncate d3/d21/d31/f40 764619 0 2024-04-23T14:49:34.972 INFO:tasks.workunit.client.0.smithi081.stdout:7/243: dread - d3/d11/d2c/f34 zero size 2024-04-23T14:49:34.984 INFO:tasks.workunit.client.0.smithi081.stdout:8/321: dwrite d3/d11/f1d [0,4194304] 0 2024-04-23T14:49:34.984 INFO:tasks.workunit.client.0.smithi081.stdout:1/308: dwrite d3/f5 [0,4194304] 0 2024-04-23T14:49:34.984 INFO:tasks.workunit.client.0.smithi081.stdout:1/309: chown d3/d3d/d41/d5e/d17/d26/f31 2711190 1 2024-04-23T14:49:34.984 INFO:tasks.workunit.client.0.smithi081.stdout:5/315: dread f12 [0,4194304] 0 2024-04-23T14:49:34.984 INFO:tasks.workunit.client.0.smithi081.stdout:0/311: dwrite d6/d11/d14/d24/d35/f3d [0,4194304] 0 2024-04-23T14:49:34.984 INFO:tasks.workunit.client.0.smithi081.stdout:0/312: stat d6/d11/d14/f26 0 2024-04-23T14:49:34.987 INFO:tasks.workunit.client.0.smithi081.stdout:8/322: rename d3/d11/f67 to d3/f6f 0 2024-04-23T14:49:34.992 INFO:tasks.workunit.client.0.smithi081.stdout:6/259: dwrite d1/d11/f43 [0,4194304] 0 2024-04-23T14:49:34.994 INFO:tasks.workunit.client.0.smithi081.stdout:7/244: write d3/f10 [2826238,34937] 0 2024-04-23T14:49:34.995 INFO:tasks.workunit.client.0.smithi081.stdout:1/310: creat d3/d3d/d41/d5e/d12/d3b/f62 x:0 0 0 2024-04-23T14:49:34.996 INFO:tasks.workunit.client.0.smithi081.stdout:2/329: dwrite d1/f32 [0,4194304] 0 2024-04-23T14:49:35.000 INFO:tasks.workunit.client.0.smithi081.stdout:7/245: write d3/d21/d31/f3a [1070941,130276] 0 2024-04-23T14:49:35.000 INFO:tasks.workunit.client.0.smithi081.stdout:7/246: write d3/d20/f3f [69392,10474] 0 2024-04-23T14:49:35.000 INFO:tasks.workunit.client.0.smithi081.stdout:7/247: fdatasync d3/d11/d2c/f34 0 2024-04-23T14:49:35.000 INFO:tasks.workunit.client.0.smithi081.stdout:7/248: chown d3/d11/d2c 1 1 2024-04-23T14:49:35.001 INFO:tasks.workunit.client.0.smithi081.stdout:5/316: symlink d17/d4f/d61/l70 0 2024-04-23T14:49:35.020 INFO:tasks.workunit.client.0.smithi081.stdout:1/311: creat d3/d3d/d41/d5e/d17/d58/f63 x:0 0 0 2024-04-23T14:49:35.023 INFO:tasks.workunit.client.0.smithi081.stdout:2/330: symlink d1/d11/d21/l78 0 2024-04-23T14:49:35.031 INFO:tasks.workunit.client.0.smithi081.stdout:5/317: creat d17/d18/d3a/f71 x:0 0 0 2024-04-23T14:49:35.034 INFO:tasks.workunit.client.0.smithi081.stdout:0/313: rename d6/d11/d14/d24/d35 to d6/d11/d14/d41/d5b 0 2024-04-23T14:49:35.038 INFO:tasks.workunit.client.0.smithi081.stdout:6/260: dwrite d1/d11/f4f [0,4194304] 0 2024-04-23T14:49:35.039 INFO:tasks.workunit.client.0.smithi081.stdout:1/312: link d3/d3d/d41/d5e/d17/d26/f2d d3/d3d/d41/d5e/d12/d3b/f64 0 2024-04-23T14:49:35.044 INFO:tasks.workunit.client.0.smithi081.stdout:2/331: truncate d1/f2b 542988 0 2024-04-23T14:49:35.044 INFO:tasks.workunit.client.0.smithi081.stdout:8/323: dwrite d3/d3c/f42 [0,4194304] 0 2024-04-23T14:49:35.044 INFO:tasks.workunit.client.0.smithi081.stdout:8/324: readlink d3/l1f 0 2024-04-23T14:49:35.044 INFO:tasks.workunit.client.0.smithi081.stdout:7/249: mkdir d3/d21/d31/d50 0 2024-04-23T14:49:35.053 INFO:tasks.workunit.client.0.smithi081.stdout:6/261: creat d1/d11/d8/d2e/d58/f61 x:0 0 0 2024-04-23T14:49:35.053 INFO:tasks.workunit.client.0.smithi081.stdout:6/262: creat d1/d11/f62 x:0 0 0 2024-04-23T14:49:35.055 INFO:tasks.workunit.client.0.smithi081.stdout:0/314: write d6/d37/d4d/f55 [2913269,125233] 0 2024-04-23T14:49:35.059 INFO:tasks.workunit.client.0.smithi081.stdout:8/325: symlink d3/d1a/l70 0 2024-04-23T14:49:35.061 INFO:tasks.workunit.client.0.smithi081.stdout:2/332: dread d1/fe [0,4194304] 0 2024-04-23T14:49:35.061 INFO:tasks.workunit.client.0.smithi081.stdout:2/333: stat d1/d11/d21/d22/c67 0 2024-04-23T14:49:35.063 INFO:tasks.workunit.client.0.smithi081.stdout:7/250: rename d3/f49 to d3/d11/d15/f51 0 2024-04-23T14:49:35.063 INFO:tasks.workunit.client.0.smithi081.stdout:7/251: dread - d3/d11/d15/f3c zero size 2024-04-23T14:49:35.065 INFO:tasks.workunit.client.0.smithi081.stdout:1/313: dread d3/f7 [0,4194304] 0 2024-04-23T14:49:35.070 INFO:tasks.workunit.client.0.smithi081.stdout:6/263: mknod d1/d11/d1c/c63 0 2024-04-23T14:49:35.075 INFO:tasks.workunit.client.0.smithi081.stdout:2/334: creat d1/d33/f79 x:0 0 0 2024-04-23T14:49:35.077 INFO:tasks.workunit.client.0.smithi081.stdout:0/315: read d6/d11/d14/d41/d5b/f3d [2337994,115485] 0 2024-04-23T14:49:35.079 INFO:tasks.workunit.client.0.smithi081.stdout:7/252: dread d3/d21/d31/f9 [0,4194304] 0 2024-04-23T14:49:35.079 INFO:tasks.workunit.client.0.smithi081.stdout:1/314: creat d3/d3d/d41/d5e/d12/d1a/f65 x:0 0 0 2024-04-23T14:49:35.080 INFO:tasks.workunit.client.0.smithi081.stdout:6/264: getdents d1/d11/d13/d46 0 2024-04-23T14:49:35.086 INFO:tasks.workunit.client.0.smithi081.stdout:7/253: mkdir d3/d21/d31/d33/d52 0 2024-04-23T14:49:35.088 INFO:tasks.workunit.client.0.smithi081.stdout:6/265: creat d1/d2/d49/d52/f64 x:0 0 0 2024-04-23T14:49:35.093 INFO:tasks.workunit.client.0.smithi081.stdout:7/254: creat d3/d11/d2c/f53 x:0 0 0 2024-04-23T14:49:35.093 INFO:tasks.workunit.client.0.smithi081.stdout:7/255: dread - d3/d20/f45 zero size 2024-04-23T14:49:35.095 INFO:tasks.workunit.client.0.smithi081.stdout:1/315: dread d3/d3d/d41/d5e/d17/d25/f4d [0,4194304] 0 2024-04-23T14:49:35.098 INFO:tasks.workunit.client.0.smithi081.stdout:1/316: symlink d3/d3d/d41/d4a/l66 0 2024-04-23T14:49:35.098 INFO:tasks.workunit.client.0.smithi081.stdout:1/317: creat d3/d3d/d41/d5e/d17/d58/f67 x:0 0 0 2024-04-23T14:49:35.098 INFO:tasks.workunit.client.0.smithi081.stdout:1/318: write d3/f5 [4819915,6286] 0 2024-04-23T14:49:35.104 INFO:tasks.workunit.client.0.smithi081.stdout:7/256: dread f2 [0,4194304] 0 2024-04-23T14:49:35.108 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:34 smithi081 ceph-mon[25540]: pgmap v26: 65 pgs: 65 active+clean; 492 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 29 MiB/s rd, 35 MiB/s wr, 224 op/s 2024-04-23T14:49:35.113 INFO:tasks.workunit.client.0.smithi081.stdout:5/318: dwrite d17/d1f/f23 [0,4194304] 0 2024-04-23T14:49:35.122 INFO:tasks.workunit.client.0.smithi081.stdout:7/257: rename d3/d21/d31/c1f to d3/d21/c54 0 2024-04-23T14:49:35.135 INFO:tasks.workunit.client.0.smithi081.stdout:2/335: dwrite d1/f5 [0,4194304] 0 2024-04-23T14:49:35.142 INFO:tasks.workunit.client.0.smithi081.stdout:2/336: symlink d1/d11/l7a 0 2024-04-23T14:49:35.143 INFO:tasks.workunit.client.0.smithi081.stdout:2/337: dread - d1/d11/d21/d52/f70 zero size 2024-04-23T14:49:35.143 INFO:tasks.workunit.client.0.smithi081.stdout:2/338: chown d1/d33/d45/c74 1 1 2024-04-23T14:49:35.143 INFO:tasks.workunit.client.0.smithi081.stdout:2/339: creat d1/d11/d21/d52/f7b x:0 0 0 2024-04-23T14:49:35.144 INFO:tasks.workunit.client.0.smithi081.stdout:0/316: dwrite d6/d25/f45 [0,4194304] 0 2024-04-23T14:49:35.144 INFO:tasks.workunit.client.0.smithi081.stdout:0/317: write d6/f9 [1995492,41043] 0 2024-04-23T14:49:35.144 INFO:tasks.workunit.client.0.smithi081.stdout:8/326: dwrite d3/d11/d48/f69 [0,4194304] 0 2024-04-23T14:49:35.145 INFO:tasks.workunit.client.0.smithi081.stdout:6/266: rmdir d1/d2/d49/d52 39 2024-04-23T14:49:35.155 INFO:tasks.workunit.client.0.smithi081.stdout:2/340: rmdir d1/d1e 39 2024-04-23T14:49:35.158 INFO:tasks.workunit.client.0.smithi081.stdout:2/341: dread d1/fb [0,4194304] 0 2024-04-23T14:49:35.161 INFO:tasks.workunit.client.0.smithi081.stdout:0/318: truncate d6/d37/f38 2560397 0 2024-04-23T14:49:35.161 INFO:tasks.workunit.client.0.smithi081.stdout:0/319: truncate d6/d11/d14/d24/f57 499414 0 2024-04-23T14:49:35.164 INFO:tasks.workunit.client.0.smithi081.stdout:8/327: creat d3/d11/d3e/d63/f71 x:0 0 0 2024-04-23T14:49:35.165 INFO:tasks.workunit.client.0.smithi081.stdout:2/342: creat d1/d33/d45/f7c x:0 0 0 2024-04-23T14:49:35.165 INFO:tasks.workunit.client.0.smithi081.stdout:2/343: chown d1/d11/d21/d22/l2d 25 1 2024-04-23T14:49:35.174 INFO:tasks.workunit.client.0.smithi081.stdout:6/267: write d1/d11/f5c [3104701,112704] 0 2024-04-23T14:49:35.175 INFO:tasks.workunit.client.0.smithi081.stdout:7/258: dwrite d3/d11/d15/f51 [0,4194304] 0 2024-04-23T14:49:35.175 INFO:tasks.workunit.client.0.smithi081.stdout:7/259: chown d3/f36 1474 1 2024-04-23T14:49:35.175 INFO:tasks.workunit.client.0.smithi081.stdout:7/260: chown d3/d11/d15/f3c 428 1 2024-04-23T14:49:35.176 INFO:tasks.workunit.client.0.smithi081.stdout:1/319: dwrite d3/d3d/f32 [0,4194304] 0 2024-04-23T14:49:35.181 INFO:tasks.workunit.client.0.smithi081.stdout:0/320: dread d6/f9 [0,4194304] 0 2024-04-23T14:49:35.181 INFO:tasks.workunit.client.0.smithi081.stdout:6/268: truncate d1/d11/d1c/f3b 1100455 0 2024-04-23T14:49:35.181 INFO:tasks.workunit.client.0.smithi081.stdout:2/344: write d1/d33/f5e [1193422,78632] 0 2024-04-23T14:49:35.182 INFO:tasks.workunit.client.0.smithi081.stdout:2/345: stat d1/d11/d21/d52/l59 0 2024-04-23T14:49:35.182 INFO:tasks.workunit.client.0.smithi081.stdout:8/328: write d3/d1a/f22 [3894457,57710] 0 2024-04-23T14:49:35.182 INFO:tasks.workunit.client.0.smithi081.stdout:8/329: chown d3/d1a/l32 3503368 1 2024-04-23T14:49:35.185 INFO:tasks.workunit.client.0.smithi081.stdout:1/320: mknod d3/d3d/d41/d5e/d12/d1a/c68 0 2024-04-23T14:49:35.186 INFO:tasks.workunit.client.0.smithi081.stdout:6/269: read d1/d11/d8/d2e/f2f [180589,12508] 0 2024-04-23T14:49:35.186 INFO:tasks.workunit.client.0.smithi081.stdout:6/270: fsync d1/d2/f53 0 2024-04-23T14:49:35.188 INFO:tasks.workunit.client.0.smithi081.stdout:0/321: creat d6/d37/f5c x:0 0 0 2024-04-23T14:49:35.191 INFO:tasks.workunit.client.0.smithi081.stdout:7/261: getdents d3/d11/d2c 0 2024-04-23T14:49:35.191 INFO:tasks.workunit.client.0.smithi081.stdout:7/262: creat d3/d21/f55 x:0 0 0 2024-04-23T14:49:35.197 INFO:tasks.workunit.client.0.smithi081.stdout:1/321: mknod d3/d3d/d41/d5e/d12/d1a/d2a/c69 0 2024-04-23T14:49:35.199 INFO:tasks.workunit.client.0.smithi081.stdout:2/346: write d1/f5 [2414674,129081] 0 2024-04-23T14:49:35.206 INFO:tasks.workunit.client.0.smithi081.stdout:8/330: dread d3/ff [0,4194304] 0 2024-04-23T14:49:35.206 INFO:tasks.workunit.client.0.smithi081.stdout:8/331: dread - d3/d11/d3e/d63/f71 zero size 2024-04-23T14:49:35.206 INFO:tasks.workunit.client.0.smithi081.stdout:8/332: creat d3/d11/d34/f72 x:0 0 0 2024-04-23T14:49:35.206 INFO:tasks.workunit.client.0.smithi081.stdout:7/263: mkdir d3/d11/d56 0 2024-04-23T14:49:35.209 INFO:tasks.workunit.client.0.smithi081.stdout:0/322: write d6/d37/f4e [1014070,70935] 0 2024-04-23T14:49:35.209 INFO:tasks.workunit.client.0.smithi081.stdout:1/322: mknod d3/d3d/d41/d5e/d17/d58/c6a 0 2024-04-23T14:49:35.228 INFO:tasks.workunit.client.0.smithi081.stdout:7/264: write d3/d21/d31/fd [1215462,103134] 0 2024-04-23T14:49:35.240 INFO:tasks.workunit.client.0.smithi081.stdout:2/347: rmdir d1/d11/d21/d22/d77 0 2024-04-23T14:49:35.263 INFO:tasks.workunit.client.0.smithi081.stdout:9/307: sync 2024-04-23T14:49:35.263 INFO:tasks.workunit.client.0.smithi081.stdout:3/242: sync 2024-04-23T14:49:35.263 INFO:tasks.workunit.client.0.smithi081.stdout:3/243: chown d4/d7/d1a 1039175 1 2024-04-23T14:49:35.263 INFO:tasks.workunit.client.0.smithi081.stdout:3/244: read d4/d7/df/f19 [304954,60064] 0 2024-04-23T14:49:35.263 INFO:tasks.workunit.client.0.smithi081.stdout:4/250: sync 2024-04-23T14:49:35.263 INFO:tasks.workunit.client.0.smithi081.stdout:8/333: link d3/f2a d3/d11/d3e/d63/f73 0 2024-04-23T14:49:35.282 INFO:tasks.workunit.client.0.smithi081.stdout:7/265: dwrite d3/f36 [0,4194304] 0 2024-04-23T14:49:35.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:34 smithi156 ceph-mon[32341]: pgmap v26: 65 pgs: 65 active+clean; 492 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 29 MiB/s rd, 35 MiB/s wr, 224 op/s 2024-04-23T14:49:35.293 INFO:tasks.workunit.client.0.smithi081.stdout:8/334: write d3/d3c/f42 [3566637,9001] 0 2024-04-23T14:49:35.303 INFO:tasks.workunit.client.0.smithi081.stdout:2/348: dwrite d1/fb [0,4194304] 0 2024-04-23T14:49:35.316 INFO:tasks.workunit.client.0.smithi081.stdout:7/266: write d3/d11/f1b [1107729,80731] 0 2024-04-23T14:49:35.322 INFO:tasks.workunit.client.0.smithi081.stdout:0/323: dwrite d6/d37/f4e [0,4194304] 0 2024-04-23T14:49:35.325 INFO:tasks.workunit.client.0.smithi081.stdout:9/308: dwrite d3/de/d22/f39 [0,4194304] 0 2024-04-23T14:49:35.325 INFO:tasks.workunit.client.0.smithi081.stdout:9/309: stat d3/d5/f16 0 2024-04-23T14:49:35.325 INFO:tasks.workunit.client.0.smithi081.stdout:9/310: chown d3/de/d14/f38 180820 1 2024-04-23T14:49:35.336 INFO:tasks.workunit.client.0.smithi081.stdout:9/311: dread d3/d1a/fc [0,4194304] 0 2024-04-23T14:49:35.336 INFO:tasks.workunit.client.0.smithi081.stdout:9/312: truncate d3/d1a/f52 75610 0 2024-04-23T14:49:35.350 INFO:tasks.workunit.client.0.smithi081.stdout:4/251: symlink d1/d4/dc/l56 0 2024-04-23T14:49:35.353 INFO:tasks.workunit.client.0.smithi081.stdout:6/271: rename d1/d11 to d1/d51/d65 0 2024-04-23T14:49:35.359 INFO:tasks.workunit.client.0.smithi081.stdout:8/335: getdents d3/d11/d3e 0 2024-04-23T14:49:35.363 INFO:tasks.workunit.client.0.smithi081.stdout:2/349: dread - d1/d33/f40 zero size 2024-04-23T14:49:35.374 INFO:tasks.workunit.client.0.smithi081.stdout:4/252: truncate d1/d1d/d39/f53 341299 0 2024-04-23T14:49:35.376 INFO:tasks.workunit.client.0.smithi081.stdout:6/272: mkdir d1/d51/d65/d1c/d66 0 2024-04-23T14:49:35.377 INFO:tasks.workunit.client.0.smithi081.stdout:8/336: symlink d3/d11/d3e/l74 0 2024-04-23T14:49:35.385 INFO:tasks.workunit.client.0.smithi081.stdout:4/253: creat d1/d3/f57 x:0 0 0 2024-04-23T14:49:35.385 INFO:tasks.workunit.client.0.smithi081.stdout:4/254: fdatasync d1/d1d/f20 0 2024-04-23T14:49:35.386 INFO:tasks.workunit.client.0.smithi081.stdout:6/273: symlink d1/l67 0 2024-04-23T14:49:35.390 INFO:tasks.workunit.client.0.smithi081.stdout:8/337: link d3/d11/d4f/f65 d3/d11/d3e/d63/f75 0 2024-04-23T14:49:35.391 INFO:tasks.workunit.client.0.smithi081.stdout:8/338: truncate d3/d11/d3e/d63/f71 704023 0 2024-04-23T14:49:35.391 INFO:tasks.workunit.client.0.smithi081.stdout:8/339: chown d3/d11/d3e/d63/f71 1 1 2024-04-23T14:49:35.413 INFO:tasks.workunit.client.0.smithi081.stdout:8/340: write d3/d1a/f51 [1254199,71438] 0 2024-04-23T14:49:35.422 INFO:tasks.workunit.client.0.smithi081.stdout:8/341: dread d3/d11/d3e/d63/f75 [0,4194304] 0 2024-04-23T14:49:35.422 INFO:tasks.workunit.client.0.smithi081.stdout:4/255: dread d1/d1d/f20 [0,4194304] 0 2024-04-23T14:49:35.422 INFO:tasks.workunit.client.0.smithi081.stdout:8/342: chown d3/f5c 20434 1 2024-04-23T14:49:35.434 INFO:tasks.workunit.client.0.smithi081.stdout:4/256: dread d1/d4/f23 [0,4194304] 0 2024-04-23T14:49:35.437 INFO:tasks.workunit.client.0.smithi081.stdout:4/257: rename d1/d4/d11/f1f to d1/d1d/d39/f58 0 2024-04-23T14:49:35.438 INFO:tasks.workunit.client.0.smithi081.stdout:6/274: dwrite d1/d51/d65/d13/d16/f32 [0,4194304] 0 2024-04-23T14:49:35.439 INFO:tasks.workunit.client.0.smithi081.stdout:2/350: mknod d1/d11/d21/c7d 0 2024-04-23T14:49:35.440 INFO:tasks.workunit.client.0.smithi081.stdout:4/258: mkdir d1/d1d/d59 0 2024-04-23T14:49:35.445 INFO:tasks.workunit.client.0.smithi081.stdout:6/275: creat d1/d51/d65/d8/d2e/d59/f68 x:0 0 0 2024-04-23T14:49:35.446 INFO:tasks.workunit.client.0.smithi081.stdout:2/351: mknod d1/d33/d45/d6e/c7e 0 2024-04-23T14:49:35.449 INFO:tasks.workunit.client.0.smithi081.stdout:4/259: rename d1/d1d/f47 to d1/d1d/d59/f5a 0 2024-04-23T14:49:35.451 INFO:tasks.workunit.client.0.smithi081.stdout:6/276: symlink d1/d2/d49/d52/d5f/l69 0 2024-04-23T14:49:35.451 INFO:tasks.workunit.client.0.smithi081.stdout:6/277: write d1/d51/d65/d8/d2e/d58/f61 [725175,88920] 0 2024-04-23T14:49:35.451 INFO:tasks.workunit.client.0.smithi081.stdout:6/278: write d1/d51/d65/d8/d2e/d59/f68 [494249,66243] 0 2024-04-23T14:49:35.451 INFO:tasks.workunit.client.0.smithi081.stdout:6/279: fdatasync d1/d51/d65/d8/d2e/f2f 0 2024-04-23T14:49:35.451 INFO:tasks.workunit.client.0.smithi081.stdout:6/280: readlink d1/d51/d65/d8/d2e/l34 0 2024-04-23T14:49:35.457 INFO:tasks.workunit.client.0.smithi081.stdout:4/260: getdents d1/d4/dc 0 2024-04-23T14:49:35.460 INFO:tasks.workunit.client.0.smithi081.stdout:6/281: creat d1/d51/d65/f6a x:0 0 0 2024-04-23T14:49:35.468 INFO:tasks.workunit.client.0.smithi081.stdout:4/261: creat d1/f5b x:0 0 0 2024-04-23T14:49:35.468 INFO:tasks.workunit.client.0.smithi081.stdout:4/262: chown d1/d4/dc/f14 0 1 2024-04-23T14:49:35.469 INFO:tasks.workunit.client.0.smithi081.stdout:9/313: mkdir d3/d67 0 2024-04-23T14:49:35.469 INFO:tasks.workunit.client.0.smithi081.stdout:9/314: getdents d3/d67 0 2024-04-23T14:49:35.469 INFO:tasks.workunit.client.0.smithi081.stdout:9/315: getdents d3/de/d1d/d62 0 2024-04-23T14:49:35.470 INFO:tasks.workunit.client.0.smithi081.stdout:4/263: mknod d1/d1d/d59/c5c 0 2024-04-23T14:49:35.470 INFO:tasks.workunit.client.0.smithi081.stdout:4/264: dread - d1/d1d/f3f zero size 2024-04-23T14:49:35.470 INFO:tasks.workunit.client.0.smithi081.stdout:4/265: fdatasync d1/d4/f10 0 2024-04-23T14:49:35.471 INFO:tasks.workunit.client.0.smithi081.stdout:2/352: creat d1/f7f x:0 0 0 2024-04-23T14:49:35.472 INFO:tasks.workunit.client.0.smithi081.stdout:2/353: write d1/d33/f40 [925547,101842] 0 2024-04-23T14:49:35.474 INFO:tasks.workunit.client.0.smithi081.stdout:4/266: creat d1/d4/f5d x:0 0 0 2024-04-23T14:49:35.474 INFO:tasks.workunit.client.0.smithi081.stdout:4/267: chown d1/d4/l5 55 1 2024-04-23T14:49:35.477 INFO:tasks.workunit.client.0.smithi081.stdout:4/268: mknod d1/d4/d11/c5e 0 2024-04-23T14:49:35.482 INFO:tasks.workunit.client.0.smithi081.stdout:1/323: link d3/f47 d3/f6b 0 2024-04-23T14:49:35.485 INFO:tasks.workunit.client.0.smithi081.stdout:1/324: mknod d3/d3d/d41/d5e/d5d/c6c 0 2024-04-23T14:49:35.485 INFO:tasks.workunit.client.0.smithi081.stdout:1/325: readlink d3/d3d/d41/d5e/d1d/l36 0 2024-04-23T14:49:35.485 INFO:tasks.workunit.client.0.smithi081.stdout:1/326: write d3/d3d/d41/d5e/d12/f54 [4407909,24828] 0 2024-04-23T14:49:35.487 INFO:tasks.workunit.client.0.smithi081.stdout:1/327: mknod d3/d3d/d41/d5e/d17/d26/c6d 0 2024-04-23T14:49:35.491 INFO:tasks.workunit.client.0.smithi081.stdout:1/328: creat d3/d3d/d41/d5e/d17/d25/f6e x:0 0 0 2024-04-23T14:49:35.506 INFO:tasks.workunit.client.0.smithi081.stdout:8/343: creat d3/f76 x:0 0 0 2024-04-23T14:49:35.509 INFO:tasks.workunit.client.0.smithi081.stdout:8/344: mknod d3/d1a/c77 0 2024-04-23T14:49:35.514 INFO:tasks.workunit.client.0.smithi081.stdout:8/345: mkdir d3/d11/d3e/d63/d78 0 2024-04-23T14:49:35.514 INFO:tasks.workunit.client.0.smithi081.stdout:9/316: rmdir d3/de/d61 0 2024-04-23T14:49:35.514 INFO:tasks.workunit.client.0.smithi081.stdout:9/317: fsync d3/d5/f3f 0 2024-04-23T14:49:35.516 INFO:tasks.workunit.client.0.smithi081.stdout:7/267: rmdir d3/d11/d2c 39 2024-04-23T14:49:35.519 INFO:tasks.workunit.client.0.smithi081.stdout:8/346: creat d3/d11/d4f/d66/f79 x:0 0 0 2024-04-23T14:49:35.522 INFO:tasks.workunit.client.0.smithi081.stdout:6/282: dwrite d1/d51/d65/d8/d2e/d58/f61 [0,4194304] 0 2024-04-23T14:49:35.522 INFO:tasks.workunit.client.0.smithi081.stdout:7/268: creat d3/d21/d31/d33/d4b/f57 x:0 0 0 2024-04-23T14:49:35.524 INFO:tasks.workunit.client.0.smithi081.stdout:8/347: mknod d3/d11/d3e/d63/c7a 0 2024-04-23T14:49:35.525 INFO:tasks.workunit.client.0.smithi081.stdout:8/348: write d3/d11/d34/f40 [3881230,116866] 0 2024-04-23T14:49:35.525 INFO:tasks.workunit.client.0.smithi081.stdout:8/349: readlink d3/l2d 0 2024-04-23T14:49:35.529 INFO:tasks.workunit.client.0.smithi081.stdout:6/283: creat d1/d51/d54/f6b x:0 0 0 2024-04-23T14:49:35.531 INFO:tasks.workunit.client.0.smithi081.stdout:7/269: creat d3/d21/d31/d50/f58 x:0 0 0 2024-04-23T14:49:35.532 INFO:tasks.workunit.client.0.smithi081.stdout:8/350: symlink d3/d1a/l7b 0 2024-04-23T14:49:35.533 INFO:tasks.workunit.client.0.smithi081.stdout:9/318: write d3/de/d14/f3c [3444348,81953] 0 2024-04-23T14:49:35.536 INFO:tasks.workunit.client.0.smithi081.stdout:7/270: creat d3/d21/d31/d33/d52/f59 x:0 0 0 2024-04-23T14:49:35.536 INFO:tasks.workunit.client.0.smithi081.stdout:7/271: chown d3/d20/f3f 577 1 2024-04-23T14:49:35.536 INFO:tasks.workunit.client.0.smithi081.stdout:7/272: write d3/d20/f45 [1003585,76958] 0 2024-04-23T14:49:35.539 INFO:tasks.workunit.client.0.smithi081.stdout:8/351: rename d3/ff to d3/d11/d34/f7c 0 2024-04-23T14:49:35.549 INFO:tasks.workunit.client.0.smithi081.stdout:2/354: dwrite d1/d11/f42 [0,4194304] 0 2024-04-23T14:49:35.549 INFO:tasks.workunit.client.0.smithi081.stdout:2/355: fdatasync d1/d11/d21/d34/f4b 0 2024-04-23T14:49:35.549 INFO:tasks.workunit.client.0.smithi081.stdout:2/356: dread - d1/d1e/f6c zero size 2024-04-23T14:49:35.549 INFO:tasks.workunit.client.0.smithi081.stdout:2/357: chown d1/d11/d21/d22/l2d 301 1 2024-04-23T14:49:35.550 INFO:tasks.workunit.client.0.smithi081.stdout:2/358: write d1/d11/d21/d22/f69 [528025,75763] 0 2024-04-23T14:49:35.550 INFO:tasks.workunit.client.0.smithi081.stdout:9/319: mkdir d3/de/d1d/d54/d68 0 2024-04-23T14:49:35.550 INFO:tasks.workunit.client.0.smithi081.stdout:6/284: dread d1/f18 [0,4194304] 0 2024-04-23T14:49:35.550 INFO:tasks.workunit.client.0.smithi081.stdout:8/352: rename d3/d11/d3e/l6b to d3/d11/d48/l7d 0 2024-04-23T14:49:35.550 INFO:tasks.workunit.client.0.smithi081.stdout:8/353: write d3/d11/d4f/f65 [398428,17663] 0 2024-04-23T14:49:35.551 INFO:tasks.workunit.client.0.smithi081.stdout:7/273: dread d3/d21/d31/fd [0,4194304] 0 2024-04-23T14:49:35.553 INFO:tasks.workunit.client.0.smithi081.stdout:8/354: write d3/d11/f2e [21520,41643] 0 2024-04-23T14:49:35.553 INFO:tasks.workunit.client.0.smithi081.stdout:8/355: read - d3/f5c zero size 2024-04-23T14:49:35.559 INFO:tasks.workunit.client.0.smithi081.stdout:2/359: mknod d1/d33/d45/d48/c80 0 2024-04-23T14:49:35.559 INFO:tasks.workunit.client.0.smithi081.stdout:7/274: mkdir d3/d21/d31/d50/d5a 0 2024-04-23T14:49:35.559 INFO:tasks.workunit.client.0.smithi081.stdout:8/356: mkdir d3/d11/d48/d7e 0 2024-04-23T14:49:35.565 INFO:tasks.workunit.client.0.smithi081.stdout:1/329: dwrite d3/d3d/d41/d5e/d17/d25/f6e [0,4194304] 0 2024-04-23T14:49:35.565 INFO:tasks.workunit.client.0.smithi081.stdout:7/275: rename d3/l26 to d3/d21/d31/d33/d4b/d4c/l5b 0 2024-04-23T14:49:35.586 INFO:tasks.workunit.client.0.smithi081.stdout:7/276: creat d3/d11/d15/f5c x:0 0 0 2024-04-23T14:49:35.589 INFO:tasks.workunit.client.0.smithi081.stdout:7/277: link d3/d21/f4a d3/d21/d31/d33/d4b/d4c/f5d 0 2024-04-23T14:49:35.595 INFO:tasks.workunit.client.0.smithi081.stdout:1/330: rename d3/d3d/d41/d5e/d12/d3b to d3/d3d/d6f 0 2024-04-23T14:49:35.598 INFO:tasks.workunit.client.0.smithi081.stdout:5/319: sync 2024-04-23T14:49:35.605 INFO:tasks.workunit.client.0.smithi081.stdout:1/331: mkdir d3/d3d/d41/d5e/d12/d1a/d2a/d70 0 2024-04-23T14:49:35.609 INFO:tasks.workunit.client.0.smithi081.stdout:9/320: dwrite d3/de/d25/f60 [0,4194304] 0 2024-04-23T14:49:35.609 INFO:tasks.workunit.client.0.smithi081.stdout:8/357: dread d3/d1a/f22 [0,4194304] 0 2024-04-23T14:49:35.609 INFO:tasks.workunit.client.0.smithi081.stdout:8/358: creat d3/d1a/f7f x:0 0 0 2024-04-23T14:49:35.610 INFO:tasks.workunit.client.0.smithi081.stdout:5/320: getdents d17/d3c/d55 0 2024-04-23T14:49:35.614 INFO:tasks.workunit.client.0.smithi081.stdout:5/321: write f12 [4991876,83345] 0 2024-04-23T14:49:35.614 INFO:tasks.workunit.client.0.smithi081.stdout:5/322: stat d17/d4f/d61/l70 0 2024-04-23T14:49:35.614 INFO:tasks.workunit.client.0.smithi081.stdout:2/360: dwrite d1/d11/d21/d22/f63 [0,4194304] 0 2024-04-23T14:49:35.617 INFO:tasks.workunit.client.0.smithi081.stdout:0/324: sync 2024-04-23T14:49:35.618 INFO:tasks.workunit.client.0.smithi081.stdout:3/245: sync 2024-04-23T14:49:35.621 INFO:tasks.workunit.client.0.smithi081.stdout:8/359: link f2 d3/d11/f80 0 2024-04-23T14:49:35.629 INFO:tasks.workunit.client.0.smithi081.stdout:8/360: dread d3/d11/d3e/d63/f71 [0,4194304] 0 2024-04-23T14:49:35.629 INFO:tasks.workunit.client.0.smithi081.stdout:1/332: write f0 [7080702,76902] 0 2024-04-23T14:49:35.635 INFO:tasks.workunit.client.0.smithi081.stdout:9/321: mknod d3/de/d1d/c69 0 2024-04-23T14:49:35.638 INFO:tasks.workunit.client.0.smithi081.stdout:0/325: truncate d6/f4f 135113 0 2024-04-23T14:49:35.638 INFO:tasks.workunit.client.0.smithi081.stdout:0/326: creat d6/d11/d14/d24/f5d x:0 0 0 2024-04-23T14:49:35.638 INFO:tasks.workunit.client.0.smithi081.stdout:0/327: dread - d6/f50 zero size 2024-04-23T14:49:35.638 INFO:tasks.workunit.client.0.smithi081.stdout:0/328: readlink d6/d11/d14/d24/l29 0 2024-04-23T14:49:35.647 INFO:tasks.workunit.client.0.smithi081.stdout:1/333: creat d3/d3d/f71 x:0 0 0 2024-04-23T14:49:35.647 INFO:tasks.workunit.client.0.smithi081.stdout:9/322: rename d3/de/f27 to d3/de/d1d/d54/f6a 0 2024-04-23T14:49:35.650 INFO:tasks.workunit.client.0.smithi081.stdout:3/246: write d4/d7/df/f1b [579149,60882] 0 2024-04-23T14:49:35.658 INFO:tasks.workunit.client.0.smithi081.stdout:0/329: mknod d6/d37/d4d/c5e 0 2024-04-23T14:49:35.658 INFO:tasks.workunit.client.0.smithi081.stdout:6/285: dwrite d1/d2/f1d [0,4194304] 0 2024-04-23T14:49:35.658 INFO:tasks.workunit.client.0.smithi081.stdout:6/286: read d1/d51/d65/f5c [141459,60992] 0 2024-04-23T14:49:35.671 INFO:tasks.workunit.client.0.smithi081.stdout:8/361: write d3/d11/d34/f55 [1079016,4368] 0 2024-04-23T14:49:35.671 INFO:tasks.workunit.client.0.smithi081.stdout:8/362: chown d3/d11/c26 14138205 1 2024-04-23T14:49:35.682 INFO:tasks.workunit.client.0.smithi081.stdout:8/363: mknod d3/d11/d4f/d6c/c81 0 2024-04-23T14:49:35.683 INFO:tasks.workunit.client.0.smithi081.stdout:2/361: dwrite d1/d11/f26 [0,4194304] 0 2024-04-23T14:49:35.691 INFO:tasks.workunit.client.0.smithi081.stdout:6/287: write d1/d51/d65/d8/f42 [3080682,32490] 0 2024-04-23T14:49:35.692 INFO:tasks.workunit.client.0.smithi081.stdout:0/330: write d6/f10 [312212,116070] 0 2024-04-23T14:49:35.694 INFO:tasks.workunit.client.0.smithi081.stdout:2/362: link d1/d1e/l53 d1/d11/d21/d34/l81 0 2024-04-23T14:49:35.696 INFO:tasks.workunit.client.0.smithi081.stdout:1/334: dread d3/d3d/d41/d5e/d17/d26/f5a [0,4194304] 0 2024-04-23T14:49:35.696 INFO:tasks.workunit.client.0.smithi081.stdout:6/288: rmdir d1/d2/d49 39 2024-04-23T14:49:35.698 INFO:tasks.workunit.client.0.smithi081.stdout:0/331: mknod d6/d11/d14/d41/d5b/c5f 0 2024-04-23T14:49:35.698 INFO:tasks.workunit.client.0.smithi081.stdout:0/332: write d6/d25/f28 [544044,77832] 0 2024-04-23T14:49:35.702 INFO:tasks.workunit.client.0.smithi081.stdout:9/323: dread d3/de/d22/f39 [0,4194304] 0 2024-04-23T14:49:35.702 INFO:tasks.workunit.client.0.smithi081.stdout:2/363: unlink d1/d11/d21/d22/l2e 0 2024-04-23T14:49:35.705 INFO:tasks.workunit.client.0.smithi081.stdout:1/335: creat d3/d3d/d41/d5e/d17/d26/f72 x:0 0 0 2024-04-23T14:49:35.705 INFO:tasks.workunit.client.0.smithi081.stdout:1/336: fsync d3/f6b 0 2024-04-23T14:49:35.706 INFO:tasks.workunit.client.0.smithi081.stdout:8/364: dread f2 [0,4194304] 0 2024-04-23T14:49:35.707 INFO:tasks.workunit.client.0.smithi081.stdout:6/289: symlink d1/d51/d65/d8/d2e/l6c 0 2024-04-23T14:49:35.707 INFO:tasks.workunit.client.0.smithi081.stdout:6/290: truncate d1/d51/f5d 439299 0 2024-04-23T14:49:35.708 INFO:tasks.workunit.client.0.smithi081.stdout:6/291: creat d1/d2/f6d x:0 0 0 2024-04-23T14:49:35.708 INFO:tasks.workunit.client.0.smithi081.stdout:6/292: readlink d1/d51/d65/d13/d46/l47 0 2024-04-23T14:49:35.708 INFO:tasks.workunit.client.0.smithi081.stdout:6/293: write d1/f2a [1241835,120978] 0 2024-04-23T14:49:35.708 INFO:tasks.workunit.client.0.smithi081.stdout:5/323: dwrite d17/f1b [0,4194304] 0 2024-04-23T14:49:35.712 INFO:tasks.workunit.client.0.smithi081.stdout:9/324: dread d3/de/d25/f45 [0,4194304] 0 2024-04-23T14:49:35.712 INFO:tasks.workunit.client.0.smithi081.stdout:2/364: rename d1/d11/c1f to d1/d11/d21/d52/c82 0 2024-04-23T14:49:35.712 INFO:tasks.workunit.client.0.smithi081.stdout:2/365: read d1/f4 [7384164,49962] 0 2024-04-23T14:49:35.714 INFO:tasks.workunit.client.0.smithi081.stdout:8/365: dread d3/f4 [0,4194304] 0 2024-04-23T14:49:35.714 INFO:tasks.workunit.client.0.smithi081.stdout:1/337: truncate d3/f7 2196084 0 2024-04-23T14:49:35.720 INFO:tasks.workunit.client.0.smithi081.stdout:6/294: mkdir d1/d51/d65/d1c/d6e 0 2024-04-23T14:49:35.720 INFO:tasks.workunit.client.0.smithi081.stdout:6/295: truncate d1/d2/f6d 92617 0 2024-04-23T14:49:35.722 INFO:tasks.workunit.client.0.smithi081.stdout:9/325: link d3/de/d14/d5e/d65/f58 d3/de/d14/f6b 0 2024-04-23T14:49:35.724 INFO:tasks.workunit.client.0.smithi081.stdout:2/366: mknod d1/d33/d45/d48/c83 0 2024-04-23T14:49:35.724 INFO:tasks.workunit.client.0.smithi081.stdout:2/367: dread - d1/d11/f25 zero size 2024-04-23T14:49:35.724 INFO:tasks.workunit.client.0.smithi081.stdout:2/368: readlink d1/d11/d21/l41 0 2024-04-23T14:49:35.727 INFO:tasks.workunit.client.0.smithi081.stdout:1/338: unlink d3/d3d/d41/d4a/l66 0 2024-04-23T14:49:35.735 INFO:tasks.workunit.client.0.smithi081.stdout:2/369: creat d1/d1e/f84 x:0 0 0 2024-04-23T14:49:35.739 INFO:tasks.workunit.client.0.smithi081.stdout:1/339: creat d3/d3d/d41/d5e/d1d/f73 x:0 0 0 2024-04-23T14:49:35.739 INFO:tasks.workunit.client.0.smithi081.stdout:1/340: write d3/f5 [5444356,29476] 0 2024-04-23T14:49:35.739 INFO:tasks.workunit.client.0.smithi081.stdout:1/341: creat d3/d3d/d41/d5e/d17/d25/f74 x:0 0 0 2024-04-23T14:49:35.739 INFO:tasks.workunit.client.0.smithi081.stdout:1/342: dread - d3/d3d/d41/d5e/d17/d26/f72 zero size 2024-04-23T14:49:35.750 INFO:tasks.workunit.client.0.smithi081.stdout:0/333: write d6/d11/d14/d41/f43 [1178601,84840] 0 2024-04-23T14:49:35.751 INFO:tasks.workunit.client.0.smithi081.stdout:1/343: rmdir d3/d3d/d41/d5e/d12/d34/d5c 0 2024-04-23T14:49:35.753 INFO:tasks.workunit.client.0.smithi081.stdout:1/344: link d3/d3d/d41/d5e/d17/d58/f63 d3/d3d/d41/d5e/d12/d1a/d2a/f75 0 2024-04-23T14:49:35.753 INFO:tasks.workunit.client.0.smithi081.stdout:1/345: fsync d3/d3d/d41/d5e/d17/d58/f61 0 2024-04-23T14:49:35.763 INFO:tasks.workunit.client.0.smithi081.stdout:5/324: dwrite d17/d1f/d42/f50 [0,4194304] 0 2024-04-23T14:49:35.770 INFO:tasks.workunit.client.0.smithi081.stdout:5/325: symlink d17/d37/l72 0 2024-04-23T14:49:35.770 INFO:tasks.workunit.client.0.smithi081.stdout:5/326: readlink d17/d37/l3b 0 2024-04-23T14:49:35.774 INFO:tasks.workunit.client.0.smithi081.stdout:6/296: dwrite d1/d2/d49/d52/f64 [0,4194304] 0 2024-04-23T14:49:35.780 INFO:tasks.workunit.client.0.smithi081.stdout:2/370: dwrite d1/f2b [0,4194304] 0 2024-04-23T14:49:35.781 INFO:tasks.workunit.client.0.smithi081.stdout:2/371: creat d1/f85 x:0 0 0 2024-04-23T14:49:35.784 INFO:tasks.workunit.client.0.smithi081.stdout:9/326: rename d3/de/d14/d5e/d65 to d3/d1a/d6c 0 2024-04-23T14:49:35.784 INFO:tasks.workunit.client.0.smithi081.stdout:9/327: read d3/de/d14/f3c [2883259,115315] 0 2024-04-23T14:49:35.786 INFO:tasks.workunit.client.0.smithi081.stdout:6/297: mknod d1/d51/d65/d8/d2e/c6f 0 2024-04-23T14:49:35.808 INFO:tasks.workunit.client.0.smithi081.stdout:2/372: rename d1/d33/d45/d48/f60 to d1/d11/d21/d34/f86 0 2024-04-23T14:49:35.808 INFO:tasks.workunit.client.0.smithi081.stdout:2/373: creat d1/f87 x:0 0 0 2024-04-23T14:49:35.808 INFO:tasks.workunit.client.0.smithi081.stdout:2/374: fdatasync d1/d11/f26 0 2024-04-23T14:49:35.808 INFO:tasks.workunit.client.0.smithi081.stdout:1/346: dwrite d3/d3d/d41/d5e/d17/d58/f61 [0,4194304] 0 2024-04-23T14:49:35.811 INFO:tasks.workunit.client.0.smithi081.stdout:9/328: symlink d3/de/d1d/d62/l6d 0 2024-04-23T14:49:35.811 INFO:tasks.workunit.client.0.smithi081.stdout:6/298: dread d1/d51/d65/f4f [0,4194304] 0 2024-04-23T14:49:35.819 INFO:tasks.workunit.client.0.smithi081.stdout:2/375: truncate d1/fe 2420342 0 2024-04-23T14:49:35.821 INFO:tasks.workunit.client.0.smithi081.stdout:1/347: rmdir d3/d3d/d41/d5e/d12 39 2024-04-23T14:49:35.821 INFO:tasks.workunit.client.0.smithi081.stdout:1/348: write d3/d3d/d41/d5e/d12/f40 [1675849,52953] 0 2024-04-23T14:49:35.822 INFO:tasks.workunit.client.0.smithi081.stdout:0/334: dwrite d6/d11/d14/d24/f57 [0,4194304] 0 2024-04-23T14:49:35.822 INFO:tasks.workunit.client.0.smithi081.stdout:0/335: dread - d6/d25/f51 zero size 2024-04-23T14:49:35.823 INFO:tasks.workunit.client.0.smithi081.stdout:9/329: symlink d3/de/d1d/d62/l6e 0 2024-04-23T14:49:35.825 INFO:tasks.workunit.client.0.smithi081.stdout:6/299: symlink d1/d2/d5a/l70 0 2024-04-23T14:49:35.825 INFO:tasks.workunit.client.0.smithi081.stdout:6/300: creat d1/d51/f71 x:0 0 0 2024-04-23T14:49:35.827 INFO:tasks.workunit.client.0.smithi081.stdout:2/376: fdatasync d1/d33/f37 0 2024-04-23T14:49:35.829 INFO:tasks.workunit.client.0.smithi081.stdout:1/349: unlink d3/d3d/d41/d4a/c21 0 2024-04-23T14:49:35.834 INFO:tasks.workunit.client.0.smithi081.stdout:0/336: creat d6/d37/f60 x:0 0 0 2024-04-23T14:49:35.837 INFO:tasks.workunit.client.0.smithi081.stdout:9/330: mknod d3/de/d1d/d5b/c6f 0 2024-04-23T14:49:35.837 INFO:tasks.workunit.client.0.smithi081.stdout:9/331: dread - d3/f4e zero size 2024-04-23T14:49:35.838 INFO:tasks.workunit.client.0.smithi081.stdout:5/327: getdents d17/d37 0 2024-04-23T14:49:35.839 INFO:tasks.workunit.client.0.smithi081.stdout:5/328: chown d17/d3c/d55 43054430 1 2024-04-23T14:49:35.841 INFO:tasks.workunit.client.0.smithi081.stdout:6/301: mknod d1/c72 0 2024-04-23T14:49:35.842 INFO:tasks.workunit.client.0.smithi081.stdout:6/302: write d1/d51/d65/d13/f23 [1366615,98184] 0 2024-04-23T14:49:35.842 INFO:tasks.workunit.client.0.smithi081.stdout:2/377: mknod d1/d11/d21/d34/c88 0 2024-04-23T14:49:35.847 INFO:tasks.workunit.client.0.smithi081.stdout:1/350: link d3/l59 d3/d3d/d41/d5e/d17/d25/l76 0 2024-04-23T14:49:35.854 INFO:tasks.workunit.client.0.smithi081.stdout:5/329: unlink d17/d1f/d36/d59/f6d 0 2024-04-23T14:49:35.854 INFO:tasks.workunit.client.0.smithi081.stdout:5/330: creat d17/d3d/d41/f73 x:0 0 0 2024-04-23T14:49:35.855 INFO:tasks.workunit.client.0.smithi081.stdout:6/303: creat d1/d51/d65/d1c/f73 x:0 0 0 2024-04-23T14:49:35.858 INFO:tasks.workunit.client.0.smithi081.stdout:0/337: write d6/d37/f4e [2871297,868] 0 2024-04-23T14:49:35.860 INFO:tasks.workunit.client.0.smithi081.stdout:9/332: getdents d3/de/d14 0 2024-04-23T14:49:35.865 INFO:tasks.workunit.client.0.smithi081.stdout:5/331: rmdir d17/d3c 39 2024-04-23T14:49:35.867 INFO:tasks.workunit.client.0.smithi081.stdout:6/304: getdents d1/d2/d49/d52/d5f 0 2024-04-23T14:49:35.869 INFO:tasks.workunit.client.0.smithi081.stdout:0/338: mkdir d6/d11/d14/d41/d5b/d61 0 2024-04-23T14:49:35.872 INFO:tasks.workunit.client.0.smithi081.stdout:9/333: unlink d3/d5/f21 0 2024-04-23T14:49:35.880 INFO:tasks.workunit.client.0.smithi081.stdout:6/305: mknod d1/d51/d65/d13/d46/c74 0 2024-04-23T14:49:35.880 INFO:tasks.workunit.client.0.smithi081.stdout:0/339: rename d6/d11/d14/d24/c30 to d6/c62 0 2024-04-23T14:49:35.886 INFO:tasks.workunit.client.0.smithi081.stdout:9/334: mknod d3/de/d1d/d54/d68/c70 0 2024-04-23T14:49:35.888 INFO:tasks.workunit.client.0.smithi081.stdout:5/332: getdents d17/d4f/d61 0 2024-04-23T14:49:35.891 INFO:tasks.workunit.client.0.smithi081.stdout:6/306: creat d1/d51/d65/d13/d16/f75 x:0 0 0 2024-04-23T14:49:35.891 INFO:tasks.workunit.client.0.smithi081.stdout:6/307: chown d1/d51/d65/d13/d46/l56 7092 1 2024-04-23T14:49:35.891 INFO:tasks.workunit.client.0.smithi081.stdout:6/308: write d1/d51/d65/d8/d2e/f2f [595524,39502] 0 2024-04-23T14:49:35.891 INFO:tasks.workunit.client.0.smithi081.stdout:6/309: write d1/d51/d65/d8/d2e/f2f [1431864,96338] 0 2024-04-23T14:49:35.891 INFO:tasks.workunit.client.0.smithi081.stdout:6/310: truncate d1/d51/f5d 757062 0 2024-04-23T14:49:35.891 INFO:tasks.workunit.client.0.smithi081.stdout:6/311: readlink d1/d51/d65/d8/d2e/l6c 0 2024-04-23T14:49:35.895 INFO:tasks.workunit.client.0.smithi081.stdout:5/333: creat d17/d1f/f74 x:0 0 0 2024-04-23T14:49:35.898 INFO:tasks.workunit.client.0.smithi081.stdout:6/312: link d1/d51/c40 d1/d51/d65/d8/d2e/d58/c76 0 2024-04-23T14:49:35.901 INFO:tasks.workunit.client.0.smithi081.stdout:6/313: read d1/f17 [212649,13440] 0 2024-04-23T14:49:35.902 INFO:tasks.workunit.client.0.smithi081.stdout:0/340: dread d6/f10 [0,4194304] 0 2024-04-23T14:49:35.902 INFO:tasks.workunit.client.0.smithi081.stdout:0/341: fdatasync d6/f2d 0 2024-04-23T14:49:35.906 INFO:tasks.workunit.client.0.smithi081.stdout:2/378: dwrite d1/f8 [0,4194304] 0 2024-04-23T14:49:35.906 INFO:tasks.workunit.client.0.smithi081.stdout:2/379: chown d1/d11/d21/d34 923640 1 2024-04-23T14:49:35.907 INFO:tasks.workunit.client.0.smithi081.stdout:5/334: creat d17/d3c/d55/d64/f75 x:0 0 0 2024-04-23T14:49:35.910 INFO:tasks.workunit.client.0.smithi081.stdout:0/342: mknod d6/d25/c63 0 2024-04-23T14:49:35.910 INFO:tasks.workunit.client.0.smithi081.stdout:4/269: sync 2024-04-23T14:49:35.911 INFO:tasks.workunit.client.0.smithi081.stdout:4/270: chown d1/d4/f10 198 1 2024-04-23T14:49:35.912 INFO:tasks.workunit.client.0.smithi081.stdout:2/380: mkdir d1/d89 0 2024-04-23T14:49:35.913 INFO:tasks.workunit.client.0.smithi081.stdout:0/343: mknod d6/c64 0 2024-04-23T14:49:35.916 INFO:tasks.workunit.client.0.smithi081.stdout:2/381: unlink d1/d33/d45/d6e/c7e 0 2024-04-23T14:49:35.916 INFO:tasks.workunit.client.0.smithi081.stdout:2/382: write d1/d33/d45/f46 [297085,16530] 0 2024-04-23T14:49:35.919 INFO:tasks.workunit.client.0.smithi081.stdout:0/344: link d6/d11/d14/d24/l29 d6/d25/l65 0 2024-04-23T14:49:35.922 INFO:tasks.workunit.client.0.smithi081.stdout:2/383: dread d1/d11/d21/f2a [0,4194304] 0 2024-04-23T14:49:35.923 INFO:tasks.workunit.client.0.smithi081.stdout:0/345: symlink d6/l66 0 2024-04-23T14:49:35.923 INFO:tasks.workunit.client.0.smithi081.stdout:1/351: dwrite d3/d3d/d41/d5e/d17/d26/f31 [4194304,4194304] 0 2024-04-23T14:49:35.933 INFO:tasks.workunit.client.0.smithi081.stdout:0/346: rename d6/d11/d14/d41/d5b/d61 to d6/d37/d67 0 2024-04-23T14:49:35.936 INFO:tasks.workunit.client.0.smithi081.stdout:0/347: mkdir d6/d11/d14/d41/d5b/d59/d68 0 2024-04-23T14:49:35.939 INFO:tasks.workunit.client.0.smithi081.stdout:0/348: mkdir d6/d69 0 2024-04-23T14:49:35.939 INFO:tasks.workunit.client.0.smithi081.stdout:0/349: write d6/d11/d14/d41/f43 [4232490,113257] 0 2024-04-23T14:49:35.943 INFO:tasks.workunit.client.0.smithi081.stdout:0/350: unlink d6/d25/f28 0 2024-04-23T14:49:35.944 INFO:tasks.workunit.client.0.smithi081.stdout:0/351: chown d6/c64 39737079 1 2024-04-23T14:49:35.954 INFO:tasks.workunit.client.0.smithi081.stdout:0/352: unlink d6/d11/d14/d24/l29 0 2024-04-23T14:49:35.954 INFO:tasks.workunit.client.0.smithi081.stdout:0/353: stat d6/d11/f40 0 2024-04-23T14:49:35.954 INFO:tasks.workunit.client.0.smithi081.stdout:9/335: rmdir d3/de/d1d/d54 39 2024-04-23T14:49:35.954 INFO:tasks.workunit.client.0.smithi081.stdout:9/336: fsync d3/de/d22/f39 0 2024-04-23T14:49:35.959 INFO:tasks.workunit.client.0.smithi081.stdout:5/335: read d17/d1f/f23 [1164783,81265] 0 2024-04-23T14:49:35.959 INFO:tasks.workunit.client.0.smithi081.stdout:5/336: truncate d17/d18/f48 59952 0 2024-04-23T14:49:35.969 INFO:tasks.workunit.client.0.smithi081.stdout:2/384: dread d1/f5 [0,4194304] 0 2024-04-23T14:49:35.969 INFO:tasks.workunit.client.0.smithi081.stdout:2/385: dread - d1/d1e/f6c zero size 2024-04-23T14:49:35.974 INFO:tasks.workunit.client.0.smithi081.stdout:6/314: dwrite d1/d2/d49/d52/f64 [4194304,4194304] 0 2024-04-23T14:49:35.974 INFO:tasks.workunit.client.0.smithi081.stdout:6/315: chown d1/d51/d65/d13/f23 11 1 2024-04-23T14:49:35.987 INFO:tasks.workunit.client.0.smithi081.stdout:5/337: link l10 d17/d4a/l76 0 2024-04-23T14:49:35.991 INFO:tasks.workunit.client.0.smithi081.stdout:6/316: creat d1/d51/d65/d13/f77 x:0 0 0 2024-04-23T14:49:35.991 INFO:tasks.workunit.client.0.smithi081.stdout:6/317: dread - d1/d51/d65/d13/d16/f75 zero size 2024-04-23T14:49:35.991 INFO:tasks.workunit.client.0.smithi081.stdout:2/386: write d1/f32 [3333540,72712] 0 2024-04-23T14:49:35.994 INFO:tasks.workunit.client.0.smithi081.stdout:1/352: dwrite d3/d3d/d41/d4a/f43 [0,4194304] 0 2024-04-23T14:49:35.998 INFO:tasks.workunit.client.0.smithi081.stdout:1/353: mkdir d3/d3d/d41/d4a/d77 0 2024-04-23T14:49:36.014 INFO:tasks.workunit.client.0.smithi081.stdout:4/271: dwrite d1/f5b [0,4194304] 0 2024-04-23T14:49:36.014 INFO:tasks.workunit.client.0.smithi081.stdout:4/272: truncate d1/d1d/f26 4680038 0 2024-04-23T14:49:36.047 INFO:tasks.workunit.client.0.smithi081.stdout:2/387: dwrite d1/f5 [0,4194304] 0 2024-04-23T14:49:36.048 INFO:tasks.workunit.client.0.smithi081.stdout:6/318: dwrite d1/d51/d65/d13/f3e [0,4194304] 0 2024-04-23T14:49:36.048 INFO:tasks.workunit.client.0.smithi081.stdout:6/319: readlink d1/d2/l45 0 2024-04-23T14:49:36.049 INFO:tasks.workunit.client.0.smithi081.stdout:0/354: dwrite d6/d11/d14/d24/f5d [0,4194304] 0 2024-04-23T14:49:36.104 INFO:tasks.workunit.client.0.smithi081.stdout:2/388: dwrite d1/d11/f26 [0,4194304] 0 2024-04-23T14:49:36.120 INFO:tasks.workunit.client.0.smithi081.stdout:6/320: mkdir d1/d51/d65/d78 0 2024-04-23T14:49:36.122 INFO:tasks.workunit.client.0.smithi081.stdout:0/355: link d6/d11/c2c d6/d25/c6a 0 2024-04-23T14:49:36.122 INFO:tasks.workunit.client.0.smithi081.stdout:0/356: fsync d6/d11/d14/f26 0 2024-04-23T14:49:36.128 INFO:tasks.workunit.client.0.smithi081.stdout:2/389: link d1/d33/d45/d48/c80 d1/d89/c8a 0 2024-04-23T14:49:36.131 INFO:tasks.workunit.client.0.smithi081.stdout:1/354: rmdir d3/d3d/d41/d5e/d17/d25 39 2024-04-23T14:49:36.137 INFO:tasks.workunit.client.0.smithi081.stdout:0/357: dread d6/d11/d14/d41/d5b/f47 [0,4194304] 0 2024-04-23T14:49:36.137 INFO:tasks.workunit.client.0.smithi081.stdout:0/358: fsync d6/d11/d14/d41/d5b/f3e 0 2024-04-23T14:49:36.138 INFO:tasks.workunit.client.0.smithi081.stdout:6/321: creat d1/d51/d65/d1c/d6e/f79 x:0 0 0 2024-04-23T14:49:36.138 INFO:tasks.workunit.client.0.smithi081.stdout:6/322: truncate d1/d51/d65/d13/f23 1617006 0 2024-04-23T14:49:36.138 INFO:tasks.workunit.client.0.smithi081.stdout:6/323: chown d1/d51/d65/d1c 1771524670 1 2024-04-23T14:49:36.144 INFO:tasks.workunit.client.0.smithi081.stdout:1/355: creat d3/d3d/d41/d5e/d17/f78 x:0 0 0 2024-04-23T14:49:36.144 INFO:tasks.workunit.client.0.smithi081.stdout:1/356: fsync d3/d3d/d41/d5e/d12/f40 0 2024-04-23T14:49:36.145 INFO:tasks.workunit.client.0.smithi081.stdout:1/357: chown d3/d3d/f32 346351487 1 2024-04-23T14:49:36.150 INFO:tasks.workunit.client.0.smithi081.stdout:2/390: getdents d1/d1e 0 2024-04-23T14:49:36.150 INFO:tasks.workunit.client.0.smithi081.stdout:2/391: readlink d1/d1e/l44 0 2024-04-23T14:49:36.152 INFO:tasks.workunit.client.0.smithi081.stdout:8/366: sync 2024-04-23T14:49:36.152 INFO:tasks.workunit.client.0.smithi081.stdout:3/247: sync 2024-04-23T14:49:36.152 INFO:tasks.workunit.client.0.smithi081.stdout:7/278: sync 2024-04-23T14:49:36.152 INFO:tasks.workunit.client.0.smithi081.stdout:1/358: dread d3/d3d/d6f/f64 [0,4194304] 0 2024-04-23T14:49:36.155 INFO:tasks.workunit.client.0.smithi081.stdout:3/248: write d4/dc/d50/f4e [987641,87661] 0 2024-04-23T14:49:36.155 INFO:tasks.workunit.client.0.smithi081.stdout:3/249: dread - d4/d7/d2e/f46 zero size 2024-04-23T14:49:36.155 INFO:tasks.workunit.client.0.smithi081.stdout:2/392: mkdir d1/d11/d21/d52/d8b 0 2024-04-23T14:49:36.159 INFO:tasks.workunit.client.0.smithi081.stdout:8/367: rename d3/d3c/l47 to d3/d11/d4f/d6c/l82 0 2024-04-23T14:49:36.163 INFO:tasks.workunit.client.0.smithi081.stdout:9/337: mkdir d3/d1a/d6c/d71 0 2024-04-23T14:49:36.167 INFO:tasks.workunit.client.0.smithi081.stdout:1/359: symlink d3/d3d/d41/d5e/d12/l79 0 2024-04-23T14:49:36.170 INFO:tasks.workunit.client.0.smithi081.stdout:2/393: link d1/d11/d21/d22/l2f d1/d89/l8c 0 2024-04-23T14:49:36.174 INFO:tasks.workunit.client.0.smithi081.stdout:8/368: unlink d3/f76 0 2024-04-23T14:49:36.177 INFO:tasks.workunit.client.0.smithi081.stdout:9/338: mkdir d3/de/d14/d5e/d72 0 2024-04-23T14:49:36.178 INFO:tasks.workunit.client.0.smithi081.stdout:9/339: readlink d3/de/d25/l5a 0 2024-04-23T14:49:36.185 INFO:tasks.workunit.client.0.smithi081.stdout:1/360: mkdir d3/d3d/d7a 0 2024-04-23T14:49:36.185 INFO:tasks.workunit.client.0.smithi081.stdout:1/361: dread - d3/d3d/d41/d5e/d17/d25/f74 zero size 2024-04-23T14:49:36.192 INFO:tasks.workunit.client.0.smithi081.stdout:2/394: mknod d1/d89/c8d 0 2024-04-23T14:49:36.193 INFO:tasks.workunit.client.0.smithi081.stdout:3/250: write d4/dc/d10/d47/f4a [915509,21648] 0 2024-04-23T14:49:36.194 INFO:tasks.workunit.client.0.smithi081.stdout:1/362: dread d3/d3d/d41/d4a/f3f [0,4194304] 0 2024-04-23T14:49:36.194 INFO:tasks.workunit.client.0.smithi081.stdout:1/363: readlink d3/d3d/d41/d4a/l4f 0 2024-04-23T14:49:36.197 INFO:tasks.workunit.client.0.smithi081.stdout:8/369: link d3/d11/d4f/d6c/c81 d3/d11/d48/d7e/c83 0 2024-04-23T14:49:36.204 INFO:tasks.workunit.client.0.smithi081.stdout:2/395: dread d1/fe [0,4194304] 0 2024-04-23T14:49:36.209 INFO:tasks.workunit.client.0.smithi081.stdout:6/324: dwrite d1/d2/d49/d52/f64 [4194304,4194304] 0 2024-04-23T14:49:36.210 INFO:tasks.workunit.client.0.smithi081.stdout:8/370: creat d3/d3c/f84 x:0 0 0 2024-04-23T14:49:36.213 INFO:tasks.workunit.client.0.smithi081.stdout:2/396: dread d1/f43 [0,4194304] 0 2024-04-23T14:49:36.214 INFO:tasks.workunit.client.0.smithi081.stdout:9/340: mkdir d3/de/d1d/d73 0 2024-04-23T14:49:36.214 INFO:tasks.workunit.client.0.smithi081.stdout:9/341: stat d3/d1a/fc 0 2024-04-23T14:49:36.217 INFO:tasks.workunit.client.0.smithi081.stdout:0/359: dwrite d6/d11/d14/d41/d5b/f47 [0,4194304] 0 2024-04-23T14:49:36.217 INFO:tasks.workunit.client.0.smithi081.stdout:0/360: chown d6/d69 12347 1 2024-04-23T14:49:36.217 INFO:tasks.workunit.client.0.smithi081.stdout:0/361: read d6/d37/f38 [2138167,110454] 0 2024-04-23T14:49:36.217 INFO:tasks.workunit.client.0.smithi081.stdout:1/364: symlink d3/d3d/d41/d5e/d17/l7b 0 2024-04-23T14:49:36.217 INFO:tasks.workunit.client.0.smithi081.stdout:1/365: write d3/d3d/d41/d5e/d17/d58/f63 [764437,37127] 0 2024-04-23T14:49:36.235 INFO:tasks.workunit.client.0.smithi081.stdout:8/371: symlink d3/d11/d3e/d63/d78/l85 0 2024-04-23T14:49:36.241 INFO:tasks.workunit.client.0.smithi081.stdout:0/362: fdatasync d6/d25/f32 0 2024-04-23T14:49:36.241 INFO:tasks.workunit.client.0.smithi081.stdout:0/363: stat d6/d11/f40 0 2024-04-23T14:49:36.243 INFO:tasks.workunit.client.0.smithi081.stdout:1/366: link d3/d3d/d41/d5e/d17/d25/c35 d3/d3d/d41/d5e/d17/d26/c7c 0 2024-04-23T14:49:36.247 INFO:tasks.workunit.client.0.smithi081.stdout:0/364: mkdir d6/d11/d14/d24/d6b 0 2024-04-23T14:49:36.255 INFO:tasks.workunit.client.0.smithi081.stdout:3/251: dwrite d4/d7/d49/d38/f3a [4194304,4194304] 0 2024-04-23T14:49:36.255 INFO:tasks.workunit.client.0.smithi081.stdout:1/367: creat d3/d3d/d41/d5e/d12/d34/f7d x:0 0 0 2024-04-23T14:49:36.255 INFO:tasks.workunit.client.0.smithi081.stdout:1/368: write d3/d3d/d41/d5e/d12/f40 [2677071,77730] 0 2024-04-23T14:49:36.274 INFO:tasks.workunit.client.0.smithi081.stdout:1/369: dread d3/d3d/d41/f5b [0,4194304] 0 2024-04-23T14:49:36.275 INFO:tasks.workunit.client.0.smithi081.stdout:2/397: dwrite d1/d33/d45/f4d [0,4194304] 0 2024-04-23T14:49:36.275 INFO:tasks.workunit.client.0.smithi081.stdout:2/398: stat d1/d11/d21/d52/d8b 0 2024-04-23T14:49:36.276 INFO:tasks.workunit.client.0.smithi081.stdout:9/342: dwrite d3/de/d25/f45 [0,4194304] 0 2024-04-23T14:49:36.287 INFO:tasks.workunit.client.0.smithi081.stdout:1/370: rename d3/l44 to d3/d3d/d41/d5e/d17/d26/l7e 0 2024-04-23T14:49:36.296 INFO:tasks.workunit.client.0.smithi081.stdout:1/371: dread d3/d3d/d41/d5e/d17/d25/f4d [0,4194304] 0 2024-04-23T14:49:36.296 INFO:tasks.workunit.client.0.smithi081.stdout:2/399: creat d1/d33/d45/d6e/f8e x:0 0 0 2024-04-23T14:49:36.301 INFO:tasks.workunit.client.0.smithi081.stdout:2/400: unlink d1/d1e/c27 0 2024-04-23T14:49:36.305 INFO:tasks.workunit.client.0.smithi081.stdout:0/365: dwrite d6/d11/f40 [0,4194304] 0 2024-04-23T14:49:36.305 INFO:tasks.workunit.client.0.smithi081.stdout:0/366: dread - d6/d37/f60 zero size 2024-04-23T14:49:36.306 INFO:tasks.workunit.client.0.smithi081.stdout:2/401: getdents d1/d33/d45/d48 0 2024-04-23T14:49:36.306 INFO:tasks.workunit.client.0.smithi081.stdout:0/367: write d6/f50 [204553,49301] 0 2024-04-23T14:49:36.309 INFO:tasks.workunit.client.0.smithi081.stdout:1/372: rename d3/d3d/d41/d5e/d12/d34 to d3/d3d/d41/d5e/d17/d58/d7f 0 2024-04-23T14:49:36.314 INFO:tasks.workunit.client.0.smithi081.stdout:3/252: dwrite d4/d7/df/f27 [0,4194304] 0 2024-04-23T14:49:36.315 INFO:tasks.workunit.client.0.smithi081.stdout:2/402: mkdir d1/d11/d21/d52/d8b/d8f 0 2024-04-23T14:49:36.315 INFO:tasks.workunit.client.0.smithi081.stdout:2/403: chown d1/d11/d21/d34/l55 21719985 1 2024-04-23T14:49:36.324 INFO:tasks.workunit.client.0.smithi081.stdout:3/253: mknod d4/d7/df/c59 0 2024-04-23T14:49:36.334 INFO:tasks.workunit.client.0.smithi081.stdout:2/404: dread d1/d33/f5e [0,4194304] 0 2024-04-23T14:49:36.334 INFO:tasks.workunit.client.0.smithi081.stdout:2/405: fsync d1/d11/d21/d34/f72 0 2024-04-23T14:49:36.338 INFO:tasks.workunit.client.0.smithi081.stdout:2/406: unlink d1/f8 0 2024-04-23T14:49:36.338 INFO:tasks.workunit.client.0.smithi081.stdout:2/407: stat d1/d11/l1a 0 2024-04-23T14:49:36.389 INFO:tasks.workunit.client.0.smithi081.stdout:0/368: dwrite d6/d25/f32 [0,4194304] 0 2024-04-23T14:49:36.389 INFO:tasks.workunit.client.0.smithi081.stdout:3/254: dwrite d4/d7/d32/f3e [0,4194304] 0 2024-04-23T14:49:36.389 INFO:tasks.workunit.client.0.smithi081.stdout:3/255: chown d4/d7/d32/f3e 64381492 1 2024-04-23T14:49:36.393 INFO:tasks.workunit.client.0.smithi081.stdout:0/369: creat d6/d11/d14/d41/d5b/d3f/f6c x:0 0 0 2024-04-23T14:49:36.413 INFO:tasks.workunit.client.0.smithi081.stdout:1/373: dwrite d3/fa [0,4194304] 0 2024-04-23T14:49:36.427 INFO:tasks.workunit.client.0.smithi081.stdout:3/256: dwrite d4/d7/d2e/f46 [0,4194304] 0 2024-04-23T14:49:36.430 INFO:tasks.workunit.client.0.smithi081.stdout:3/257: mkdir d4/dc/d10/d5a 0 2024-04-23T14:49:36.430 INFO:tasks.workunit.client.0.smithi081.stdout:3/258: fsync d4/d7/df/f1b 0 2024-04-23T14:49:36.431 INFO:tasks.workunit.client.0.smithi081.stdout:1/374: write d3/d3d/d41/d5e/d17/f27 [2660541,48597] 0 2024-04-23T14:49:36.431 INFO:tasks.workunit.client.0.smithi081.stdout:3/259: creat d4/f5b x:0 0 0 2024-04-23T14:49:36.432 INFO:tasks.workunit.client.0.smithi081.stdout:1/375: truncate d3/f5 4685558 0 2024-04-23T14:49:36.433 INFO:tasks.workunit.client.0.smithi081.stdout:3/260: creat d4/dc/f5c x:0 0 0 2024-04-23T14:49:36.433 INFO:tasks.workunit.client.0.smithi081.stdout:3/261: write d4/d7/d32/f33 [2650614,113341] 0 2024-04-23T14:49:36.440 INFO:tasks.workunit.client.0.smithi081.stdout:1/376: rmdir d3/d3d/d41/d5e/d17/d58 39 2024-04-23T14:49:36.443 INFO:tasks.workunit.client.0.smithi081.stdout:0/370: dwrite d6/d37/d4d/f55 [0,4194304] 0 2024-04-23T14:49:36.443 INFO:tasks.workunit.client.0.smithi081.stdout:0/371: creat d6/d11/d14/d24/f6d x:0 0 0 2024-04-23T14:49:36.443 INFO:tasks.workunit.client.0.smithi081.stdout:0/372: chown d6/d11/d14/c17 246 1 2024-04-23T14:49:36.447 INFO:tasks.workunit.client.0.smithi081.stdout:1/377: mknod d3/d3d/d41/d4a/d77/c80 0 2024-04-23T14:49:36.453 INFO:tasks.workunit.client.0.smithi081.stdout:0/373: symlink d6/d37/d67/l6e 0 2024-04-23T14:49:36.457 INFO:tasks.workunit.client.0.smithi081.stdout:1/378: fdatasync d3/d3d/d41/d5e/d17/f20 0 2024-04-23T14:49:36.457 INFO:tasks.workunit.client.0.smithi081.stdout:1/379: stat d3/d3d/d41/d4a/d77/c80 0 2024-04-23T14:49:36.459 INFO:tasks.workunit.client.0.smithi081.stdout:0/374: creat d6/d69/f6f x:0 0 0 2024-04-23T14:49:36.465 INFO:tasks.workunit.client.0.smithi081.stdout:0/375: rmdir d6/d53 0 2024-04-23T14:49:36.478 INFO:tasks.workunit.client.0.smithi081.stdout:3/262: dwrite d4/d7/df/f27 [0,4194304] 0 2024-04-23T14:49:36.508 INFO:tasks.workunit.client.0.smithi081.stdout:5/338: sync 2024-04-23T14:49:36.510 INFO:tasks.workunit.client.0.smithi081.stdout:3/263: write d4/d7/df/f27 [3919724,6744] 0 2024-04-23T14:49:36.510 INFO:tasks.workunit.client.0.smithi081.stdout:3/264: chown d4/d7/df/c58 211 1 2024-04-23T14:49:36.510 INFO:tasks.workunit.client.0.smithi081.stdout:3/265: chown d4/d7/d2e/f46 5 1 2024-04-23T14:49:36.510 INFO:tasks.workunit.client.0.smithi081.stdout:3/266: truncate d4/dc/f52 958481 0 2024-04-23T14:49:36.514 INFO:tasks.workunit.client.0.smithi081.stdout:1/380: dwrite d3/d3d/d41/d4a/f43 [0,4194304] 0 2024-04-23T14:49:36.515 INFO:tasks.workunit.client.0.smithi081.stdout:5/339: rmdir d17/d18/d3a 39 2024-04-23T14:49:36.518 INFO:tasks.workunit.client.0.smithi081.stdout:5/340: creat d17/d3d/d41/f77 x:0 0 0 2024-04-23T14:49:36.518 INFO:tasks.workunit.client.0.smithi081.stdout:5/341: fdatasync d17/d3d/f51 0 2024-04-23T14:49:36.520 INFO:tasks.workunit.client.0.smithi081.stdout:1/381: truncate d3/d3d/f32 1105316 0 2024-04-23T14:49:36.520 INFO:tasks.workunit.client.0.smithi081.stdout:1/382: readlink d3/d3d/d41/d5e/d17/d25/l3a 0 2024-04-23T14:49:36.521 INFO:tasks.workunit.client.0.smithi081.stdout:1/383: chown d3/d3d/d41/d5e/d12/d1a/c28 441479 1 2024-04-23T14:49:36.524 INFO:tasks.workunit.client.0.smithi081.stdout:1/384: mknod d3/d3d/d41/d4a/c81 0 2024-04-23T14:49:36.524 INFO:tasks.workunit.client.0.smithi081.stdout:1/385: chown d3/d3d/d41/d5e/d12/d1a/c28 5092 1 2024-04-23T14:49:36.541 INFO:tasks.workunit.client.0.smithi081.stdout:0/376: dwrite d6/d11/d14/f54 [0,4194304] 0 2024-04-23T14:49:36.550 INFO:tasks.workunit.client.0.smithi081.stdout:0/377: dread d6/f4f [0,4194304] 0 2024-04-23T14:49:36.550 INFO:tasks.workunit.client.0.smithi081.stdout:0/378: chown d6/f10 5008404 1 2024-04-23T14:49:36.552 INFO:tasks.workunit.client.0.smithi081.stdout:1/386: rmdir d3/d3d/d41/d4a 39 2024-04-23T14:49:36.552 INFO:tasks.workunit.client.0.smithi081.stdout:1/387: readlink d3/d3d/d41/d5e/d1d/l36 0 2024-04-23T14:49:36.555 INFO:tasks.workunit.client.0.smithi081.stdout:1/388: creat d3/d3d/d41/d4a/d77/f82 x:0 0 0 2024-04-23T14:49:36.555 INFO:tasks.workunit.client.0.smithi081.stdout:1/389: dread - d3/d3d/d41/d5e/d17/d25/f74 zero size 2024-04-23T14:49:36.556 INFO:tasks.workunit.client.0.smithi081.stdout:1/390: creat d3/d3d/d41/d5e/d12/d1a/d2a/f83 x:0 0 0 2024-04-23T14:49:36.557 INFO:tasks.workunit.client.0.smithi081.stdout:3/267: dwrite d4/dc/f55 [0,4194304] 0 2024-04-23T14:49:36.557 INFO:tasks.workunit.client.0.smithi081.stdout:5/342: dwrite d17/d3c/d55/d64/f75 [0,4194304] 0 2024-04-23T14:49:36.560 INFO:tasks.workunit.client.0.smithi081.stdout:1/391: creat d3/d3d/d41/d5e/d12/d1a/d2a/d70/f84 x:0 0 0 2024-04-23T14:49:36.563 INFO:tasks.workunit.client.0.smithi081.stdout:7/279: sync 2024-04-23T14:49:36.563 INFO:tasks.workunit.client.0.smithi081.stdout:4/273: sync 2024-04-23T14:49:36.568 INFO:tasks.workunit.client.0.smithi081.stdout:0/379: write d6/d11/f40 [1654840,67341] 0 2024-04-23T14:49:36.570 INFO:tasks.workunit.client.0.smithi081.stdout:5/343: symlink d17/d65/l78 0 2024-04-23T14:49:36.570 INFO:tasks.workunit.client.0.smithi081.stdout:5/344: write d17/d3d/d41/f66 [51405,99533] 0 2024-04-23T14:49:36.578 INFO:tasks.workunit.client.0.smithi081.stdout:1/392: truncate d3/d3d/d41/d4a/f43 515195 0 2024-04-23T14:49:36.578 INFO:tasks.workunit.client.0.smithi081.stdout:1/393: fdatasync d3/d3d/d41/d5e/d12/d1a/d2a/d70/f84 0 2024-04-23T14:49:36.578 INFO:tasks.workunit.client.0.smithi081.stdout:1/394: write d3/f47 [1222801,88859] 0 2024-04-23T14:49:36.578 INFO:tasks.workunit.client.0.smithi081.stdout:1/395: fdatasync d3/d3d/d41/d5e/d12/d1a/d2a/f75 0 2024-04-23T14:49:36.582 INFO:tasks.workunit.client.0.smithi081.stdout:7/280: truncate d3/d20/f2d 1872705 0 2024-04-23T14:49:36.585 INFO:tasks.workunit.client.0.smithi081.stdout:4/274: symlink d1/l5f 0 2024-04-23T14:49:36.588 INFO:tasks.workunit.client.0.smithi081.stdout:0/380: mkdir d6/d11/d14/d70 0 2024-04-23T14:49:36.589 INFO:tasks.workunit.client.0.smithi081.stdout:8/372: sync 2024-04-23T14:49:36.589 INFO:tasks.workunit.client.0.smithi081.stdout:2/408: sync 2024-04-23T14:49:36.589 INFO:tasks.workunit.client.0.smithi081.stdout:6/325: sync 2024-04-23T14:49:36.589 INFO:tasks.workunit.client.0.smithi081.stdout:9/343: sync 2024-04-23T14:49:36.593 INFO:tasks.workunit.client.0.smithi081.stdout:1/396: mknod d3/d3d/d41/d5e/d1d/c85 0 2024-04-23T14:49:36.593 INFO:tasks.workunit.client.0.smithi081.stdout:1/397: chown d3/d3d/d41/d5e/d17/d58/f67 601871271 1 2024-04-23T14:49:36.597 INFO:tasks.workunit.client.0.smithi081.stdout:7/281: link d3/d21/d41/c4e d3/d21/d31/d50/d5a/c5e 0 2024-04-23T14:49:36.597 INFO:tasks.workunit.client.0.smithi081.stdout:7/282: fsync d3/f36 0 2024-04-23T14:49:36.598 INFO:tasks.workunit.client.0.smithi081.stdout:7/283: write d3/d21/d31/fd [2918312,115323] 0 2024-04-23T14:49:36.601 INFO:tasks.workunit.client.0.smithi081.stdout:4/275: getdents d1/d4/d11 0 2024-04-23T14:49:36.604 INFO:tasks.workunit.client.0.smithi081.stdout:0/381: mkdir d6/d37/d4d/d71 0 2024-04-23T14:49:36.604 INFO:tasks.workunit.client.0.smithi081.stdout:0/382: fdatasync d6/ff 0 2024-04-23T14:49:36.604 INFO:tasks.workunit.client.0.smithi081.stdout:0/383: chown d6 27443456 1 2024-04-23T14:49:36.606 INFO:tasks.workunit.client.0.smithi081.stdout:8/373: mkdir d3/d11/d86 0 2024-04-23T14:49:36.609 INFO:tasks.workunit.client.0.smithi081.stdout:9/344: mknod d3/de/d1d/d54/c74 0 2024-04-23T14:49:36.612 INFO:tasks.workunit.client.0.smithi081.stdout:6/326: creat d1/d51/d65/d13/d46/f7a x:0 0 0 2024-04-23T14:49:36.615 INFO:tasks.workunit.client.0.smithi081.stdout:5/345: getdents d17/d1f 0 2024-04-23T14:49:36.619 INFO:tasks.workunit.client.0.smithi081.stdout:1/398: dread d3/d3d/d41/d5e/d17/f20 [0,4194304] 0 2024-04-23T14:49:36.622 INFO:tasks.workunit.client.0.smithi081.stdout:8/374: mkdir d3/d11/d4f/d58/d87 0 2024-04-23T14:49:36.629 INFO:tasks.workunit.client.0.smithi081.stdout:5/346: link d17/d1f/d36/f43 d17/d1f/d36/d59/f79 0 2024-04-23T14:49:36.630 INFO:tasks.workunit.client.0.smithi081.stdout:1/399: rmdir d3/d3d/d41/d5e/d12 39 2024-04-23T14:49:36.630 INFO:tasks.workunit.client.0.smithi081.stdout:1/400: readlink d3/d3d/d41/l4e 0 2024-04-23T14:49:36.633 INFO:tasks.workunit.client.0.smithi081.stdout:8/375: mkdir d3/d11/d86/d88 0 2024-04-23T14:49:36.633 INFO:tasks.workunit.client.0.smithi081.stdout:8/376: fdatasync d3/d11/d4f/d66/f79 0 2024-04-23T14:49:36.633 INFO:tasks.workunit.client.0.smithi081.stdout:8/377: creat d3/d3c/f89 x:0 0 0 2024-04-23T14:49:36.633 INFO:tasks.workunit.client.0.smithi081.stdout:8/378: chown d3/l16 1 1 2024-04-23T14:49:36.636 INFO:tasks.workunit.client.0.smithi081.stdout:9/345: rename d3/de/d1d/l1f to d3/de/d1d/d54/l75 0 2024-04-23T14:49:36.644 INFO:tasks.workunit.client.0.smithi081.stdout:3/268: dwrite d4/d7/df/f35 [4194304,4194304] 0 2024-04-23T14:49:36.645 INFO:tasks.workunit.client.0.smithi081.stdout:1/401: write d3/f7 [430646,73165] 0 2024-04-23T14:49:36.645 INFO:tasks.workunit.client.0.smithi081.stdout:1/402: creat d3/d3d/d41/d5e/d12/d1a/f86 x:0 0 0 2024-04-23T14:49:36.645 INFO:tasks.workunit.client.0.smithi081.stdout:5/347: mkdir d17/d3d/d7a 0 2024-04-23T14:49:36.652 INFO:tasks.workunit.client.0.smithi081.stdout:5/348: write d17/d1f/d36/f43 [997458,50326] 0 2024-04-23T14:49:36.661 INFO:tasks.workunit.client.0.smithi081.stdout:1/403: write d3/d3d/d41/f5b [1869113,102568] 0 2024-04-23T14:49:36.683 INFO:tasks.workunit.client.0.smithi081.stdout:6/327: dwrite d1/d51/d65/f5c [0,4194304] 0 2024-04-23T14:49:36.691 INFO:tasks.workunit.client.0.smithi081.stdout:0/384: dwrite d6/d37/f60 [0,4194304] 0 2024-04-23T14:49:36.695 INFO:tasks.workunit.client.0.smithi081.stdout:0/385: creat d6/d37/d4d/d71/f72 x:0 0 0 2024-04-23T14:49:36.695 INFO:tasks.workunit.client.0.smithi081.stdout:0/386: chown f5 4 1 2024-04-23T14:49:36.695 INFO:tasks.workunit.client.0.smithi081.stdout:0/387: fdatasync d6/d11/d14/d24/f5d 0 2024-04-23T14:49:36.695 INFO:tasks.workunit.client.0.smithi081.stdout:0/388: chown d6/c64 78 1 2024-04-23T14:49:36.695 INFO:tasks.workunit.client.0.smithi081.stdout:0/389: creat d6/d11/d14/f73 x:0 0 0 2024-04-23T14:49:36.696 INFO:tasks.workunit.client.0.smithi081.stdout:3/269: dread d4/d7/d32/f33 [0,4194304] 0 2024-04-23T14:49:36.696 INFO:tasks.workunit.client.0.smithi081.stdout:3/270: dread - d4/dc/f3b zero size 2024-04-23T14:49:36.696 INFO:tasks.workunit.client.0.smithi081.stdout:3/271: fsync d4/dc/f45 0 2024-04-23T14:49:36.696 INFO:tasks.workunit.client.0.smithi081.stdout:3/272: fsync d4/d7/d49/d38/f3a 0 2024-04-23T14:49:36.696 INFO:tasks.workunit.client.0.smithi081.stdout:3/273: chown d4/dc/d10/l2b 255 1 2024-04-23T14:49:36.696 INFO:tasks.workunit.client.0.smithi081.stdout:3/274: write d4/d7/df/f27 [1663688,130758] 0 2024-04-23T14:49:36.697 INFO:tasks.workunit.client.0.smithi081.stdout:9/346: dwrite d3/d5/f16 [0,4194304] 0 2024-04-23T14:49:36.697 INFO:tasks.workunit.client.0.smithi081.stdout:6/328: dread d1/d51/d65/d13/f23 [0,4194304] 0 2024-04-23T14:49:36.698 INFO:tasks.workunit.client.0.smithi081.stdout:0/390: creat d6/d11/d14/d41/d5b/d59/d68/f74 x:0 0 0 2024-04-23T14:49:36.698 INFO:tasks.workunit.client.0.smithi081.stdout:0/391: readlink d6/l66 0 2024-04-23T14:49:36.702 INFO:tasks.workunit.client.0.smithi081.stdout:8/379: dwrite d3/d1a/f1e [0,4194304] 0 2024-04-23T14:49:36.703 INFO:tasks.workunit.client.0.smithi081.stdout:9/347: unlink d3/de/d14/f57 0 2024-04-23T14:49:36.715 INFO:tasks.workunit.client.0.smithi081.stdout:6/329: mkdir d1/d51/d7b 0 2024-04-23T14:49:36.715 INFO:tasks.workunit.client.0.smithi081.stdout:8/380: rmdir d3/d11/d3e 39 2024-04-23T14:49:36.715 INFO:tasks.workunit.client.0.smithi081.stdout:9/348: mkdir d3/de/d76 0 2024-04-23T14:49:36.715 INFO:tasks.workunit.client.0.smithi081.stdout:9/349: fdatasync d3/de/d14/f38 0 2024-04-23T14:49:36.715 INFO:tasks.workunit.client.0.smithi081.stdout:9/350: chown d3/de/d1d 110060034 1 2024-04-23T14:49:36.716 INFO:tasks.workunit.client.0.smithi081.stdout:1/404: dread d3/f7 [0,4194304] 0 2024-04-23T14:49:36.716 INFO:tasks.workunit.client.0.smithi081.stdout:9/351: mkdir d3/d67/d77 0 2024-04-23T14:49:36.716 INFO:tasks.workunit.client.0.smithi081.stdout:9/352: chown d3/de/d14/d5e/d72 18 1 2024-04-23T14:49:36.717 INFO:tasks.workunit.client.0.smithi081.stdout:8/381: getdents d3/d11/d48 0 2024-04-23T14:49:36.721 INFO:tasks.workunit.client.0.smithi081.stdout:1/405: rename d3/d3d/d41/d5e/d12/d1a/d2a/l4c to d3/d3d/d41/l87 0 2024-04-23T14:49:36.723 INFO:tasks.workunit.client.0.smithi081.stdout:8/382: symlink d3/d11/d4f/d58/l8a 0 2024-04-23T14:49:36.732 INFO:tasks.workunit.client.0.smithi081.stdout:5/349: dwrite d17/d4a/f5b [0,4194304] 0 2024-04-23T14:49:36.733 INFO:tasks.workunit.client.0.smithi081.stdout:3/275: dread d4/d7/df/f35 [0,4194304] 0 2024-04-23T14:49:36.736 INFO:tasks.workunit.client.0.smithi081.stdout:1/406: symlink d3/d3d/d41/d5e/d12/d2e/l88 0 2024-04-23T14:49:36.740 INFO:tasks.workunit.client.0.smithi081.stdout:8/383: mkdir d3/d11/d34/d8b 0 2024-04-23T14:49:36.740 INFO:tasks.workunit.client.0.smithi081.stdout:8/384: read - d3/d11/d34/f72 zero size 2024-04-23T14:49:36.750 INFO:tasks.workunit.client.0.smithi081.stdout:3/276: getdents d4/dc/d50 0 2024-04-23T14:49:36.751 INFO:tasks.workunit.client.0.smithi081.stdout:3/277: chown d4/dc/d10/d47/f4a 29391 1 2024-04-23T14:49:36.752 INFO:tasks.workunit.client.0.smithi081.stdout:1/407: rmdir d3/d3d/d41/d5e 39 2024-04-23T14:49:36.752 INFO:tasks.workunit.client.0.smithi081.stdout:1/408: fdatasync d3/d3d/d41/d5e/d12/f54 0 2024-04-23T14:49:36.752 INFO:tasks.workunit.client.0.smithi081.stdout:1/409: fsync d3/d3d/d41/d4a/d77/f82 0 2024-04-23T14:49:36.752 INFO:tasks.workunit.client.0.smithi081.stdout:1/410: creat d3/d3d/d41/d5e/d12/d1a/d2a/f89 x:0 0 0 2024-04-23T14:49:36.754 INFO:tasks.workunit.client.0.smithi081.stdout:8/385: mkdir d3/d11/d86/d88/d8c 0 2024-04-23T14:49:36.755 INFO:tasks.workunit.client.0.smithi081.stdout:0/392: dwrite d6/d11/d14/d24/f5d [0,4194304] 0 2024-04-23T14:49:36.758 INFO:tasks.workunit.client.0.smithi081.stdout:3/278: symlink d4/dc/d31/l5d 0 2024-04-23T14:49:36.764 INFO:tasks.workunit.client.0.smithi081.stdout:1/411: symlink d3/d3d/d41/d5e/d17/d58/d7f/l8a 0 2024-04-23T14:49:36.764 INFO:tasks.workunit.client.0.smithi081.stdout:6/330: dwrite d1/d2/f6d [0,4194304] 0 2024-04-23T14:49:36.764 INFO:tasks.workunit.client.0.smithi081.stdout:1/412: dread - d3/d3d/d41/d5e/d17/d25/f74 zero size 2024-04-23T14:49:36.764 INFO:tasks.workunit.client.0.smithi081.stdout:1/413: read - d3/d3d/d41/d5e/d17/d58/f67 zero size 2024-04-23T14:49:36.764 INFO:tasks.workunit.client.0.smithi081.stdout:1/414: chown d3/d3d/d41/d5e/d1d/c85 9 1 2024-04-23T14:49:36.793 INFO:tasks.workunit.client.0.smithi081.stdout:0/393: dread d6/d11/d14/d24/f57 [0,4194304] 0 2024-04-23T14:49:36.794 INFO:tasks.workunit.client.1.smithi156.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-23T14:49:36.794 INFO:tasks.workunit.client.1.smithi156.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-23T14:49:36.795 INFO:tasks.workunit.client.1.smithi156.stderr:+ make 2024-04-23T14:49:36.795 INFO:tasks.workunit.client.0.smithi081.stdout:0/394: symlink d6/d11/d14/d41/l75 0 2024-04-23T14:49:36.795 INFO:tasks.workunit.client.0.smithi081.stdout:0/395: readlink d6/l66 0 2024-04-23T14:49:36.795 INFO:tasks.workunit.client.0.smithi081.stdout:0/396: fsync d6/f9 0 2024-04-23T14:49:36.798 INFO:tasks.workunit.client.0.smithi081.stdout:0/397: unlink d6/d11/d14/d24/f5d 0 2024-04-23T14:49:36.806 INFO:tasks.workunit.client.0.smithi081.stdout:0/398: rename d6/d25/d58 to d6/d11/d14/d41/d5b/d3f/d44/d76 0 2024-04-23T14:49:36.806 INFO:tasks.workunit.client.0.smithi081.stdout:0/399: chown d6/d37/d67/l6e 54 1 2024-04-23T14:49:36.808 INFO:tasks.workunit.client.0.smithi081.stdout:6/331: write d1/d51/d65/d8/d2e/d58/f61 [3905680,26842] 0 2024-04-23T14:49:36.808 INFO:tasks.workunit.client.0.smithi081.stdout:5/350: dwrite d17/f26 [0,4194304] 0 2024-04-23T14:49:36.815 INFO:tasks.workunit.client.0.smithi081.stdout:6/332: mknod d1/c7c 0 2024-04-23T14:49:36.815 INFO:tasks.workunit.client.0.smithi081.stdout:8/386: dwrite d3/d11/d34/f68 [0,4194304] 0 2024-04-23T14:49:36.818 INFO:tasks.workunit.client.0.smithi081.stdout:5/351: link d17/d4a/l76 d17/d4f/l7b 0 2024-04-23T14:49:36.839 INFO:tasks.workunit.client.0.smithi081.stdout:0/400: write d6/d37/d4d/f55 [3133378,40113] 0 2024-04-23T14:49:36.839 INFO:tasks.workunit.client.0.smithi081.stdout:6/333: unlink d1/d51/d65/d8/d2e/l34 0 2024-04-23T14:49:36.839 INFO:tasks.workunit.client.0.smithi081.stdout:5/352: unlink d17/d4f/d61/l70 0 2024-04-23T14:49:36.839 INFO:tasks.workunit.client.0.smithi081.stdout:6/334: stat d1/d51/d65/d8/d2e/c6f 0 2024-04-23T14:49:36.839 INFO:tasks.workunit.client.0.smithi081.stdout:5/353: creat d17/d4f/f7c x:0 0 0 2024-04-23T14:49:36.839 INFO:tasks.workunit.client.0.smithi081.stdout:1/415: dwrite d3/d3d/d41/d5e/d17/d26/f72 [0,4194304] 0 2024-04-23T14:49:36.839 INFO:tasks.workunit.client.0.smithi081.stdout:8/387: write d3/d1a/f1e [3679279,5576] 0 2024-04-23T14:49:36.840 INFO:tasks.workunit.client.0.smithi081.stdout:3/279: dwrite d4/f5b [0,4194304] 0 2024-04-23T14:49:36.843 INFO:tasks.workunit.client.0.smithi081.stdout:5/354: creat d17/d3c/d55/f7d x:0 0 0 2024-04-23T14:49:36.844 INFO:tasks.workunit.client.0.smithi081.stdout:8/388: creat d3/d11/d48/f8d x:0 0 0 2024-04-23T14:49:36.845 INFO:tasks.workunit.client.0.smithi081.stdout:8/389: fsync d3/d3c/f89 0 2024-04-23T14:49:36.848 INFO:tasks.workunit.client.0.smithi081.stdout:3/280: link d4/d7/d49/d38/f3a d4/d7/df/f5e 0 2024-04-23T14:49:36.850 INFO:tasks.workunit.client.0.smithi081.stdout:5/355: rename d17/d4f/d61/f60 to d17/d65/f7e 0 2024-04-23T14:49:36.850 INFO:tasks.workunit.client.0.smithi081.stdout:5/356: write d17/d4f/f7c [394438,93150] 0 2024-04-23T14:49:36.851 INFO:tasks.workunit.client.0.smithi081.stdout:8/390: creat d3/d11/d3e/d63/d78/f8e x:0 0 0 2024-04-23T14:49:36.851 INFO:tasks.workunit.client.0.smithi081.stdout:8/391: rename d3/d3c to d3/d3c/d8f 22 2024-04-23T14:49:36.852 INFO:tasks.workunit.client.0.smithi081.stdout:5/357: creat d17/d1f/f7f x:0 0 0 2024-04-23T14:49:36.852 INFO:tasks.workunit.client.0.smithi081.stdout:5/358: chown d17/d1f/d42 62 1 2024-04-23T14:49:36.854 INFO:tasks.workunit.client.0.smithi081.stdout:8/392: rmdir d3/d11/d86/d88/d8c 0 2024-04-23T14:49:36.855 INFO:tasks.workunit.client.0.smithi081.stdout:5/359: rmdir d17/d65 39 2024-04-23T14:49:36.855 INFO:tasks.workunit.client.0.smithi081.stdout:5/360: chown d17/d4a/l76 1023089 1 2024-04-23T14:49:36.857 INFO:tasks.workunit.client.0.smithi081.stdout:0/401: dread f5 [0,4194304] 0 2024-04-23T14:49:36.858 INFO:tasks.workunit.client.0.smithi081.stdout:8/393: rename d3/f5e to d3/d11/d86/d88/f90 0 2024-04-23T14:49:36.858 INFO:tasks.workunit.client.0.smithi081.stdout:1/416: dread d3/d3d/d41/d5e/d12/d1a/d2a/f75 [0,4194304] 0 2024-04-23T14:49:36.861 INFO:tasks.workunit.client.0.smithi081.stdout:0/402: mknod d6/d11/d14/d41/d5b/d3f/d44/d76/c77 0 2024-04-23T14:49:36.863 INFO:tasks.workunit.client.0.smithi081.stdout:8/394: symlink d3/d11/d34/d8b/l91 0 2024-04-23T14:49:36.868 INFO:tasks.workunit.client.0.smithi081.stdout:5/361: getdents d17/d18 0 2024-04-23T14:49:36.871 INFO:tasks.workunit.client.0.smithi081.stdout:0/403: mkdir d6/d11/d14/d41/d5b/d3f/d44/d78 0 2024-04-23T14:49:36.873 INFO:tasks.workunit.client.0.smithi081.stdout:3/281: dread d4/d7/df/f5e [0,4194304] 0 2024-04-23T14:49:36.880 INFO:tasks.workunit.client.0.smithi081.stdout:1/417: dread d3/d3d/d41/d5e/d17/f27 [0,4194304] 0 2024-04-23T14:49:36.882 INFO:tasks.workunit.client.0.smithi081.stdout:0/404: write d6/d25/f2e [538693,38191] 0 2024-04-23T14:49:36.884 INFO:tasks.workunit.client.0.smithi081.stdout:3/282: symlink d4/d7/d1a/l5f 0 2024-04-23T14:49:36.898 INFO:tasks.workunit.client.0.smithi081.stdout:1/418: dread d3/f7 [0,4194304] 0 2024-04-23T14:49:36.898 INFO:tasks.workunit.client.0.smithi081.stdout:1/419: stat d3/d3d/d41/d5e/d12/d1a/c2c 0 2024-04-23T14:49:36.900 INFO:tasks.workunit.client.0.smithi081.stdout:1/420: creat d3/d3d/d41/d5e/d12/d2e/f8b x:0 0 0 2024-04-23T14:49:36.906 INFO:tasks.workunit.client.1.smithi156.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-23T14:49:36.908 INFO:tasks.workunit.client.0.smithi081.stdout:6/335: dwrite d1/d51/d65/f4f [4194304,4194304] 0 2024-04-23T14:49:36.909 INFO:tasks.workunit.client.0.smithi081.stdout:6/336: write d1/d51/d65/f62 [413920,127133] 0 2024-04-23T14:49:36.911 INFO:tasks.workunit.client.0.smithi081.stdout:6/337: mkdir d1/d51/d65/d1c/d6e/d7d 0 2024-04-23T14:49:36.912 INFO:tasks.workunit.client.0.smithi081.stdout:6/338: mknod d1/d51/d65/d8/d2e/c7e 0 2024-04-23T14:49:36.912 INFO:tasks.workunit.client.0.smithi081.stdout:6/339: fdatasync d1/fe 0 2024-04-23T14:49:36.916 INFO:tasks.workunit.client.0.smithi081.stdout:3/283: dread d4/d7/d2e/f46 [0,4194304] 0 2024-04-23T14:49:36.916 INFO:tasks.workunit.client.0.smithi081.stdout:3/284: truncate d4/f17 2177117 0 2024-04-23T14:49:36.917 INFO:tasks.workunit.client.0.smithi081.stdout:1/421: dread d3/d3d/d41/d5e/d12/f54 [0,4194304] 0 2024-04-23T14:49:36.917 INFO:tasks.workunit.client.0.smithi081.stdout:1/422: write d3/d3d/d41/d5e/d12/d1a/f65 [648845,111627] 0 2024-04-23T14:49:36.919 INFO:tasks.workunit.client.0.smithi081.stdout:6/340: dread d1/d51/f5d [0,4194304] 0 2024-04-23T14:49:36.922 INFO:tasks.workunit.client.0.smithi081.stdout:3/285: mknod d4/c60 0 2024-04-23T14:49:36.925 INFO:tasks.workunit.client.0.smithi081.stdout:8/395: dwrite d3/d11/d3e/f44 [0,4194304] 0 2024-04-23T14:49:36.941 INFO:tasks.workunit.client.0.smithi081.stdout:8/396: dread d3/d1a/f51 [0,4194304] 0 2024-04-23T14:49:36.941 INFO:tasks.workunit.client.0.smithi081.stdout:8/397: fsync d3/d3c/f43 0 2024-04-23T14:49:36.992 INFO:tasks.workunit.client.0.smithi081.stdout:8/398: dwrite d3/d11/d4f/f65 [0,4194304] 0 2024-04-23T14:49:36.994 INFO:tasks.workunit.client.0.smithi081.stdout:8/399: truncate d3/d1a/f22 4067699 0 2024-04-23T14:49:36.996 INFO:tasks.workunit.client.0.smithi081.stdout:8/400: link f2 d3/d1a/f92 0 2024-04-23T14:49:36.996 INFO:tasks.workunit.client.0.smithi081.stdout:8/401: chown d3/d3c/f43 26615046 1 2024-04-23T14:49:36.998 INFO:tasks.workunit.client.0.smithi081.stdout:8/402: mknod d3/d11/d4f/d6c/c93 0 2024-04-23T14:49:36.998 INFO:tasks.workunit.client.0.smithi081.stdout:8/403: creat d3/d11/d3e/d63/f94 x:0 0 0 2024-04-23T14:49:37.008 INFO:tasks.workunit.client.0.smithi081.stdout:6/341: dwrite d1/d2/d49/d52/f64 [8388608,4194304] 0 2024-04-23T14:49:37.009 INFO:tasks.workunit.client.0.smithi081.stdout:6/342: mknod d1/d2/c7f 0 2024-04-23T14:49:37.010 INFO:tasks.workunit.client.0.smithi081.stdout:8/404: dread f2 [0,4194304] 0 2024-04-23T14:49:37.011 INFO:tasks.workunit.client.0.smithi081.stdout:6/343: mkdir d1/d51/d65/d8/d2e/d59/d80 0 2024-04-23T14:49:37.011 INFO:tasks.workunit.client.0.smithi081.stdout:6/344: chown d1/c4d 107687 1 2024-04-23T14:49:37.016 INFO:tasks.workunit.client.0.smithi081.stdout:2/409: sync 2024-04-23T14:49:37.027 INFO:tasks.workunit.client.0.smithi081.stdout:8/405: write d3/d11/d34/f68 [1790599,14186] 0 2024-04-23T14:49:37.030 INFO:tasks.workunit.client.0.smithi081.stdout:8/406: unlink d3/d1a/f22 0 2024-04-23T14:49:37.033 INFO:tasks.workunit.client.0.smithi081.stdout:8/407: creat d3/d11/d48/d7e/f95 x:0 0 0 2024-04-23T14:49:37.033 INFO:tasks.workunit.client.0.smithi081.stdout:8/408: fdatasync d3/d11/d4f/d66/f79 0 2024-04-23T14:49:37.033 INFO:tasks.workunit.client.0.smithi081.stdout:8/409: chown d3/d11/d3e/d63/c7a 16056 1 2024-04-23T14:49:37.034 INFO:tasks.workunit.client.0.smithi081.stdout:6/345: dread d1/d51/d65/d8/f2b [0,4194304] 0 2024-04-23T14:49:37.044 INFO:tasks.workunit.client.0.smithi081.stdout:8/410: write d3/d11/f80 [1565075,116969] 0 2024-04-23T14:49:37.044 INFO:tasks.workunit.client.0.smithi081.stdout:8/411: write d3/d11/f2e [1261119,108974] 0 2024-04-23T14:49:37.044 INFO:tasks.workunit.client.0.smithi081.stdout:8/412: stat d3/f2f 0 2024-04-23T14:49:37.044 INFO:tasks.workunit.client.0.smithi081.stdout:8/413: chown d3/d3c/f43 59 1 2024-04-23T14:49:37.065 INFO:tasks.workunit.client.0.smithi081.stdout:8/414: dread d3/f5 [4194304,4194304] 0 2024-04-23T14:49:37.065 INFO:tasks.workunit.client.0.smithi081.stdout:8/415: chown d3/f4a 556927 1 2024-04-23T14:49:37.106 INFO:tasks.workunit.client.0.smithi081.stdout:6/346: dwrite d1/d51/d65/d8/d2e/f2f [0,4194304] 0 2024-04-23T14:49:37.107 INFO:tasks.workunit.client.0.smithi081.stdout:6/347: write d1/d51/d54/f6b [436814,43165] 0 2024-04-23T14:49:37.107 INFO:tasks.workunit.client.0.smithi081.stdout:6/348: write d1/d51/d65/d13/d16/f4c [315595,122357] 0 2024-04-23T14:49:37.107 INFO:tasks.workunit.client.0.smithi081.stdout:6/349: fdatasync d1/d2/f53 0 2024-04-23T14:49:37.110 INFO:tasks.workunit.client.0.smithi081.stdout:6/350: mknod d1/d51/d65/d8/d2e/d59/c81 0 2024-04-23T14:49:37.110 INFO:tasks.workunit.client.0.smithi081.stdout:8/416: dwrite d3/f2c [0,4194304] 0 2024-04-23T14:49:37.110 INFO:tasks.workunit.client.0.smithi081.stdout:8/417: dread - d3/d1a/f30 zero size 2024-04-23T14:49:37.119 INFO:tasks.workunit.client.0.smithi081.stdout:6/351: rename d1/d51/d65/d1c/c3d to d1/c82 0 2024-04-23T14:49:37.119 INFO:tasks.workunit.client.0.smithi081.stdout:6/352: fdatasync d1/d51/d65/d8/d2e/f2f 0 2024-04-23T14:49:37.121 INFO:tasks.workunit.client.0.smithi081.stdout:8/418: rename d3/d11/d3e/d63/f71 to d3/d11/d3e/f96 0 2024-04-23T14:49:37.147 INFO:tasks.workunit.client.0.smithi081.stdout:8/419: dread d3/d3c/f52 [0,4194304] 0 2024-04-23T14:49:37.148 INFO:tasks.workunit.client.0.smithi081.stdout:8/420: rmdir d3/d11/d86 39 2024-04-23T14:49:37.148 INFO:tasks.workunit.client.0.smithi081.stdout:8/421: readlink d3/d11/d48/l54 0 2024-04-23T14:49:37.159 INFO:tasks.workunit.client.0.smithi081.stdout:8/422: rmdir d3 39 2024-04-23T14:49:37.161 INFO:tasks.workunit.client.0.smithi081.stdout:8/423: creat d3/d3c/f97 x:0 0 0 2024-04-23T14:49:37.170 INFO:tasks.workunit.client.0.smithi081.stdout:7/284: sync 2024-04-23T14:49:37.173 INFO:tasks.workunit.client.0.smithi081.stdout:7/285: rename d3/d21/d31/d33/l23 to d3/d20/l5f 0 2024-04-23T14:49:37.185 INFO:tasks.workunit.client.0.smithi081.stdout:8/424: dread d3/d11/d34/f7c [0,4194304] 0 2024-04-23T14:49:37.188 INFO:tasks.workunit.client.0.smithi081.stdout:8/425: rmdir d3/d11/d4f/d58/d87 0 2024-04-23T14:49:37.190 INFO:tasks.workunit.client.0.smithi081.stdout:8/426: mknod d3/d11/d48/d7e/c98 0 2024-04-23T14:49:37.191 INFO:tasks.workunit.client.0.smithi081.stdout:8/427: getdents d3/d11/d34/d8b 0 2024-04-23T14:49:37.192 INFO:tasks.workunit.client.0.smithi081.stdout:8/428: write d3/d11/d3e/f96 [874051,19044] 0 2024-04-23T14:49:37.192 INFO:tasks.workunit.client.0.smithi081.stdout:8/429: truncate d3/f6f 106914 0 2024-04-23T14:49:37.195 INFO:tasks.workunit.client.0.smithi081.stdout:8/430: truncate d3/d11/f80 1145756 0 2024-04-23T14:49:37.195 INFO:tasks.workunit.client.0.smithi081.stdout:8/431: fsync d3/f37 0 2024-04-23T14:49:37.197 INFO:tasks.workunit.client.0.smithi081.stdout:8/432: rmdir d3/d11/d3e/d63/d78 39 2024-04-23T14:49:37.197 INFO:tasks.workunit.client.0.smithi081.stdout:8/433: chown d3/d1a/f30 309736 1 2024-04-23T14:49:37.199 INFO:tasks.workunit.client.0.smithi081.stdout:8/434: creat d3/d11/d4f/d58/f99 x:0 0 0 2024-04-23T14:49:37.200 INFO:tasks.workunit.client.0.smithi081.stdout:8/435: stat d3/d11/d4f/f65 0 2024-04-23T14:49:37.200 INFO:tasks.workunit.client.0.smithi081.stdout:8/436: write d3/d11/d3e/d63/f73 [756134,109741] 0 2024-04-23T14:49:37.205 INFO:tasks.workunit.client.0.smithi081.stdout:6/353: dwrite d1/d51/d65/d8/f41 [0,4194304] 0 2024-04-23T14:49:37.209 INFO:tasks.workunit.client.0.smithi081.stdout:6/354: unlink d1/d51/d65/d13/d16/l31 0 2024-04-23T14:49:37.210 INFO:tasks.workunit.client.0.smithi081.stdout:6/355: mknod d1/c83 0 2024-04-23T14:49:37.220 INFO:tasks.workunit.client.0.smithi081.stdout:6/356: write d1/d51/d65/d13/d16/f1e [37491,59799] 0 2024-04-23T14:49:37.222 INFO:tasks.workunit.client.0.smithi081.stdout:6/357: creat d1/d51/d65/d8/d2e/d58/f84 x:0 0 0 2024-04-23T14:49:37.226 INFO:tasks.workunit.client.0.smithi081.stdout:6/358: getdents d1/d51/d65/d13/d16 0 2024-04-23T14:49:37.227 INFO:tasks.workunit.client.0.smithi081.stdout:8/437: write d3/d3c/f52 [3047372,115462] 0 2024-04-23T14:49:37.233 INFO:tasks.workunit.client.0.smithi081.stdout:8/438: creat d3/d11/f9a x:0 0 0 2024-04-23T14:49:37.235 INFO:tasks.workunit.client.0.smithi081.stdout:8/439: link d3/d11/d34/f57 d3/d11/d34/d8b/f9b 0 2024-04-23T14:49:37.235 INFO:tasks.workunit.client.0.smithi081.stdout:8/440: chown d3/d3c/f84 60384 1 2024-04-23T14:49:37.236 INFO:tasks.workunit.client.0.smithi081.stdout:8/441: dread - d3/d11/d48/d7e/f95 zero size 2024-04-23T14:49:37.238 INFO:tasks.workunit.client.0.smithi081.stdout:8/442: rename d3/d1a/f7f to d3/d11/d86/f9c 0 2024-04-23T14:49:37.238 INFO:tasks.workunit.client.0.smithi081.stdout:8/443: dread - d3/f5c zero size 2024-04-23T14:49:37.238 INFO:tasks.workunit.client.0.smithi081.stdout:8/444: truncate d3/d11/d34/f72 83480 0 2024-04-23T14:49:37.253 INFO:tasks.workunit.client.0.smithi081.stdout:7/286: dwrite d3/d11/d2c/f34 [0,4194304] 0 2024-04-23T14:49:37.269 INFO:tasks.workunit.client.0.smithi081.stdout:7/287: read d3/d21/d31/f38 [3277295,60686] 0 2024-04-23T14:49:37.279 INFO:tasks.workunit.client.0.smithi081.stdout:8/445: dread d3/d11/d34/f7c [0,4194304] 0 2024-04-23T14:49:37.280 INFO:tasks.workunit.client.0.smithi081.stdout:7/288: dread d3/d21/d31/f8 [0,4194304] 0 2024-04-23T14:49:37.280 INFO:tasks.workunit.client.0.smithi081.stdout:7/289: fdatasync d3/d20/f2d 0 2024-04-23T14:49:37.280 INFO:tasks.workunit.client.0.smithi081.stdout:8/446: creat d3/f9d x:0 0 0 2024-04-23T14:49:37.280 INFO:tasks.workunit.client.0.smithi081.stdout:8/447: dread - d3/f2f zero size 2024-04-23T14:49:37.283 INFO:tasks.workunit.client.0.smithi081.stdout:2/410: sync 2024-04-23T14:49:37.283 INFO:tasks.workunit.client.0.smithi081.stdout:5/362: sync 2024-04-23T14:49:37.283 INFO:tasks.workunit.client.0.smithi081.stdout:0/405: sync 2024-04-23T14:49:37.283 INFO:tasks.workunit.client.0.smithi081.stdout:3/286: sync 2024-04-23T14:49:37.283 INFO:tasks.workunit.client.0.smithi081.stdout:0/406: write d6/d25/f32 [4514971,96218] 0 2024-04-23T14:49:37.284 INFO:tasks.workunit.client.0.smithi081.stdout:0/407: stat d6/c31 0 2024-04-23T14:49:37.284 INFO:tasks.workunit.client.0.smithi081.stdout:1/423: sync 2024-04-23T14:49:37.284 INFO:tasks.workunit.client.0.smithi081.stdout:0/408: truncate d6/d37/d4d/d71/f72 830430 0 2024-04-23T14:49:37.284 INFO:tasks.workunit.client.0.smithi081.stdout:0/409: stat d6/d25 0 2024-04-23T14:49:37.284 INFO:tasks.workunit.client.0.smithi081.stdout:4/276: sync 2024-04-23T14:49:37.284 INFO:tasks.workunit.client.0.smithi081.stdout:9/353: sync 2024-04-23T14:49:37.284 INFO:tasks.workunit.client.0.smithi081.stdout:4/277: dread - d1/d1d/f22 zero size 2024-04-23T14:49:37.284 INFO:tasks.workunit.client.0.smithi081.stdout:9/354: dread - d3/de/d1d/d54/f66 zero size 2024-04-23T14:49:37.284 INFO:tasks.workunit.client.0.smithi081.stdout:2/411: creat d1/d33/f90 x:0 0 0 2024-04-23T14:49:37.284 INFO:tasks.workunit.client.0.smithi081.stdout:3/287: symlink d4/dc/l61 0 2024-04-23T14:49:37.285 INFO:tasks.workunit.client.0.smithi081.stdout:3/288: fsync d4/d7/d32/f3e 0 2024-04-23T14:49:37.285 INFO:tasks.workunit.client.0.smithi081.stdout:3/289: chown d4/dc/d50/f4e 0 1 2024-04-23T14:49:37.285 INFO:tasks.workunit.client.0.smithi081.stdout:1/424: mknod d3/d3d/d41/d5e/c8c 0 2024-04-23T14:49:37.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:36 smithi156 ceph-mon[32341]: pgmap v27: 65 pgs: 65 active+clean; 773 MiB data, 3.9 GiB used, 532 GiB / 536 GiB avail; 69 MiB/s rd, 77 MiB/s wr, 267 op/s 2024-04-23T14:49:37.295 INFO:tasks.workunit.client.0.smithi081.stdout:0/410: symlink d6/d11/d14/d41/d5b/d3f/d44/d76/l79 0 2024-04-23T14:49:37.295 INFO:tasks.workunit.client.0.smithi081.stdout:0/411: write d6/d11/d14/d41/f43 [2911373,75209] 0 2024-04-23T14:49:37.295 INFO:tasks.workunit.client.0.smithi081.stdout:4/278: mknod d1/d4/d11/c60 0 2024-04-23T14:49:37.295 INFO:tasks.workunit.client.0.smithi081.stdout:4/279: creat d1/f61 x:0 0 0 2024-04-23T14:49:37.295 INFO:tasks.workunit.client.0.smithi081.stdout:4/280: chown d1/d1d 26436839 1 2024-04-23T14:49:37.295 INFO:tasks.workunit.client.0.smithi081.stdout:4/281: readlink d1/d1d/d39/l55 0 2024-04-23T14:49:37.295 INFO:tasks.workunit.client.0.smithi081.stdout:9/355: mknod d3/de/d22/c78 0 2024-04-23T14:49:37.295 INFO:tasks.workunit.client.0.smithi081.stdout:4/282: creat d1/f62 x:0 0 0 2024-04-23T14:49:37.295 INFO:tasks.workunit.client.0.smithi081.stdout:7/290: dread d3/d21/d41/f43 [0,4194304] 0 2024-04-23T14:49:37.295 INFO:tasks.workunit.client.0.smithi081.stdout:3/290: creat d4/d7/d49/d51/f62 x:0 0 0 2024-04-23T14:49:37.296 INFO:tasks.workunit.client.0.smithi081.stdout:6/359: dwrite d1/d51/d65/d13/f3c [0,4194304] 0 2024-04-23T14:49:37.296 INFO:tasks.workunit.client.0.smithi081.stdout:6/360: chown d1/l2d 178 1 2024-04-23T14:49:37.308 INFO:tasks.workunit.client.0.smithi081.stdout:0/412: dread d6/f4f [0,4194304] 0 2024-04-23T14:49:37.308 INFO:tasks.workunit.client.0.smithi081.stdout:0/413: write d6/d37/f5c [682198,108707] 0 2024-04-23T14:49:37.308 INFO:tasks.workunit.client.0.smithi081.stdout:3/291: creat d4/dc/d31/f63 x:0 0 0 2024-04-23T14:49:37.308 INFO:tasks.workunit.client.0.smithi081.stdout:3/292: chown d4/d7/d1a/c1d 3 1 2024-04-23T14:49:37.313 INFO:tasks.workunit.client.0.smithi081.stdout:4/283: rename d1/f62 to d1/d4/f63 0 2024-04-23T14:49:37.321 INFO:tasks.workunit.client.0.smithi081.stdout:0/414: dread d6/f9 [0,4194304] 0 2024-04-23T14:49:37.321 INFO:tasks.workunit.client.0.smithi081.stdout:0/415: read - d6/d11/d14/d24/f6d zero size 2024-04-23T14:49:37.323 INFO:tasks.workunit.client.0.smithi081.stdout:0/416: link d6/d11/c23 d6/d37/c7a 0 2024-04-23T14:49:37.323 INFO:tasks.workunit.client.0.smithi081.stdout:0/417: write d6/d11/d14/d41/d5b/d59/d68/f74 [329775,84385] 0 2024-04-23T14:49:37.323 INFO:tasks.workunit.client.0.smithi081.stdout:0/418: readlink d6/d11/d14/d41/d5b/d3f/d44/d76/l79 0 2024-04-23T14:49:37.325 INFO:tasks.workunit.client.0.smithi081.stdout:0/419: symlink d6/d37/l7b 0 2024-04-23T14:49:37.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:36 smithi081 ceph-mon[25540]: pgmap v27: 65 pgs: 65 active+clean; 773 MiB data, 3.9 GiB used, 532 GiB / 536 GiB avail; 69 MiB/s rd, 77 MiB/s wr, 267 op/s 2024-04-23T14:49:37.342 INFO:tasks.workunit.client.1.smithi156.stderr:++ readlink -f fsstress 2024-04-23T14:49:37.344 INFO:tasks.workunit.client.1.smithi156.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-23T14:49:37.344 INFO:tasks.workunit.client.1.smithi156.stderr:+ popd 2024-04-23T14:49:37.344 INFO:tasks.workunit.client.1.smithi156.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-23T14:49:37.344 INFO:tasks.workunit.client.1.smithi156.stderr:+ popd 2024-04-23T14:49:37.345 INFO:tasks.workunit.client.1.smithi156.stdout:~/cephtest/mnt.1/client.1/tmp 2024-04-23T14:49:37.346 INFO:tasks.workunit.client.1.smithi156.stderr:++ mktemp -d -p . 2024-04-23T14:49:37.356 INFO:tasks.workunit.client.1.smithi156.stderr:+ T=./tmp.gnYReM5lR9 2024-04-23T14:49:37.356 INFO:tasks.workunit.client.1.smithi156.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.gnYReM5lR9 -l 1 -n 1000 -p 10 -v 2024-04-23T14:49:37.362 INFO:tasks.workunit.client.0.smithi081.stdout:0/420: dread d6/d11/d14/f54 [0,4194304] 0 2024-04-23T14:49:37.363 INFO:tasks.workunit.client.1.smithi156.stdout:seed = 1713521124 2024-04-23T14:49:37.364 INFO:tasks.workunit.client.0.smithi081.stdout:0/421: unlink d6/d11/c2c 0 2024-04-23T14:49:37.367 INFO:tasks.workunit.client.0.smithi081.stdout:0/422: symlink d6/d11/d14/d41/l7c 0 2024-04-23T14:49:37.370 INFO:tasks.workunit.client.1.smithi156.stdout:1/0: rename - no filename 2024-04-23T14:49:37.370 INFO:tasks.workunit.client.1.smithi156.stdout:1/1: write - no filename 2024-04-23T14:49:37.370 INFO:tasks.workunit.client.1.smithi156.stdout:1/2: write - no filename 2024-04-23T14:49:37.370 INFO:tasks.workunit.client.1.smithi156.stdout:1/3: rename - no filename 2024-04-23T14:49:37.370 INFO:tasks.workunit.client.1.smithi156.stdout:1/4: write - no filename 2024-04-23T14:49:37.370 INFO:tasks.workunit.client.1.smithi156.stdout:1/5: rename - no filename 2024-04-23T14:49:37.370 INFO:tasks.workunit.client.1.smithi156.stdout:1/6: getdents . 0 2024-04-23T14:49:37.370 INFO:tasks.workunit.client.1.smithi156.stdout:1/7: dread - no filename 2024-04-23T14:49:37.370 INFO:tasks.workunit.client.1.smithi156.stdout:1/8: getdents . 0 2024-04-23T14:49:37.371 INFO:tasks.workunit.client.1.smithi156.stdout:8/0: write - no filename 2024-04-23T14:49:37.372 INFO:tasks.workunit.client.1.smithi156.stdout:8/1: dread - no filename 2024-04-23T14:49:37.372 INFO:tasks.workunit.client.1.smithi156.stdout:8/2: truncate - no filename 2024-04-23T14:49:37.372 INFO:tasks.workunit.client.1.smithi156.stdout:8/3: getdents . 0 2024-04-23T14:49:37.372 INFO:tasks.workunit.client.1.smithi156.stdout:1/9: symlink l0 0 2024-04-23T14:49:37.373 INFO:tasks.workunit.client.1.smithi156.stdout:2/0: read - no filename 2024-04-23T14:49:37.373 INFO:tasks.workunit.client.1.smithi156.stdout:2/1: chown . 370695212 1 2024-04-23T14:49:37.374 INFO:tasks.workunit.client.0.smithi081.stdout:2/412: dwrite d1/d11/d21/d52/f70 [0,4194304] 0 2024-04-23T14:49:37.374 INFO:tasks.workunit.client.0.smithi081.stdout:4/284: read d1/d4/dc/f21 [2228014,123106] 0 2024-04-23T14:49:37.374 INFO:tasks.workunit.client.0.smithi081.stdout:3/293: write d4/d7/df/f5e [498202,35678] 0 2024-04-23T14:49:37.374 INFO:tasks.workunit.client.0.smithi081.stdout:3/294: fsync d4/dc/f45 0 2024-04-23T14:49:37.374 INFO:tasks.workunit.client.0.smithi081.stdout:3/295: fdatasync d4/dc/f28 0 2024-04-23T14:49:37.375 INFO:tasks.workunit.client.1.smithi156.stdout:8/4: symlink l0 0 2024-04-23T14:49:37.375 INFO:tasks.workunit.client.0.smithi081.stdout:8/448: dwrite d3/f31 [0,4194304] 0 2024-04-23T14:49:37.375 INFO:tasks.workunit.client.0.smithi081.stdout:8/449: dread - d3/f9d zero size 2024-04-23T14:49:37.377 INFO:tasks.workunit.client.1.smithi156.stdout:1/10: rename l0 to l1 0 2024-04-23T14:49:37.377 INFO:tasks.workunit.client.1.smithi156.stdout:1/11: write - no filename 2024-04-23T14:49:37.377 INFO:tasks.workunit.client.1.smithi156.stdout:1/12: write - no filename 2024-04-23T14:49:37.377 INFO:tasks.workunit.client.1.smithi156.stdout:1/13: write - no filename 2024-04-23T14:49:37.380 INFO:tasks.workunit.client.1.smithi156.stdout:2/2: creat f0 x:0 0 0 2024-04-23T14:49:37.380 INFO:tasks.workunit.client.1.smithi156.stdout:3/0: dwrite - no filename 2024-04-23T14:49:37.380 INFO:tasks.workunit.client.1.smithi156.stdout:3/1: dwrite - no filename 2024-04-23T14:49:37.380 INFO:tasks.workunit.client.1.smithi156.stdout:2/3: dread - f0 zero size 2024-04-23T14:49:37.381 INFO:tasks.workunit.client.0.smithi081.stdout:8/450: creat d3/d11/d48/d7e/f9e x:0 0 0 2024-04-23T14:49:37.384 INFO:tasks.workunit.client.1.smithi156.stdout:0/0: rmdir - no directory 2024-04-23T14:49:37.384 INFO:tasks.workunit.client.1.smithi156.stdout:0/1: dread - no filename 2024-04-23T14:49:37.384 INFO:tasks.workunit.client.1.smithi156.stdout:0/2: write - no filename 2024-04-23T14:49:37.384 INFO:tasks.workunit.client.1.smithi156.stdout:0/3: dwrite - no filename 2024-04-23T14:49:37.384 INFO:tasks.workunit.client.1.smithi156.stdout:0/4: dwrite - no filename 2024-04-23T14:49:37.384 INFO:tasks.workunit.client.1.smithi156.stdout:0/5: dread - no filename 2024-04-23T14:49:37.384 INFO:tasks.workunit.client.1.smithi156.stdout:0/6: truncate - no filename 2024-04-23T14:49:37.384 INFO:tasks.workunit.client.1.smithi156.stdout:0/7: stat - no entries 2024-04-23T14:49:37.385 INFO:tasks.workunit.client.1.smithi156.stdout:3/2: symlink l0 0 2024-04-23T14:49:37.385 INFO:tasks.workunit.client.1.smithi156.stdout:3/3: fsync - no filename 2024-04-23T14:49:37.385 INFO:tasks.workunit.client.1.smithi156.stdout:3/4: chown l0 606815079 1 2024-04-23T14:49:37.385 INFO:tasks.workunit.client.1.smithi156.stdout:3/5: write - no filename 2024-04-23T14:49:37.385 INFO:tasks.workunit.client.1.smithi156.stdout:3/6: stat l0 0 2024-04-23T14:49:37.385 INFO:tasks.workunit.client.1.smithi156.stdout:3/7: rmdir - no directory 2024-04-23T14:49:37.385 INFO:tasks.workunit.client.1.smithi156.stdout:3/8: dwrite - no filename 2024-04-23T14:49:37.385 INFO:tasks.workunit.client.1.smithi156.stdout:3/9: fsync - no filename 2024-04-23T14:49:37.385 INFO:tasks.workunit.client.1.smithi156.stdout:3/10: fsync - no filename 2024-04-23T14:49:37.385 INFO:tasks.workunit.client.1.smithi156.stdout:3/11: rmdir - no directory 2024-04-23T14:49:37.385 INFO:tasks.workunit.client.1.smithi156.stdout:3/12: write - no filename 2024-04-23T14:49:37.385 INFO:tasks.workunit.client.1.smithi156.stdout:3/13: write - no filename 2024-04-23T14:49:37.387 INFO:tasks.workunit.client.0.smithi081.stdout:7/291: dwrite d3/f36 [0,4194304] 0 2024-04-23T14:49:37.387 INFO:tasks.workunit.client.1.smithi156.stdout:4/0: fdatasync - no filename 2024-04-23T14:49:37.388 INFO:tasks.workunit.client.1.smithi156.stdout:4/1: dwrite - no filename 2024-04-23T14:49:37.388 INFO:tasks.workunit.client.1.smithi156.stdout:4/2: dwrite - no filename 2024-04-23T14:49:37.388 INFO:tasks.workunit.client.1.smithi156.stdout:4/3: dwrite - no filename 2024-04-23T14:49:37.389 INFO:tasks.workunit.client.1.smithi156.stdout:0/8: mkdir d0 0 2024-04-23T14:49:37.389 INFO:tasks.workunit.client.1.smithi156.stdout:0/9: write - no filename 2024-04-23T14:49:37.390 INFO:tasks.workunit.client.0.smithi081.stdout:8/451: symlink d3/d11/d4f/d6c/l9f 0 2024-04-23T14:49:37.390 INFO:tasks.workunit.client.1.smithi156.stdout:3/14: creat f1 x:0 0 0 2024-04-23T14:49:37.391 INFO:tasks.workunit.client.1.smithi156.stdout:6/0: truncate - no filename 2024-04-23T14:49:37.391 INFO:tasks.workunit.client.1.smithi156.stdout:6/1: chown . 68745503 1 2024-04-23T14:49:37.394 INFO:tasks.workunit.client.1.smithi156.stdout:4/4: mkdir d0 0 2024-04-23T14:49:37.395 INFO:tasks.workunit.client.0.smithi081.stdout:0/423: dread d6/d11/d14/d41/d5b/f3d [0,4194304] 0 2024-04-23T14:49:37.398 INFO:tasks.workunit.client.0.smithi081.stdout:8/452: mkdir d3/d11/d3e/d63/d78/da0 0 2024-04-23T14:49:37.398 INFO:tasks.workunit.client.0.smithi081.stdout:9/356: dwrite d3/de/d1d/f20 [0,4194304] 0 2024-04-23T14:49:37.398 INFO:tasks.workunit.client.1.smithi156.stdout:0/10: mkdir d0/d1 0 2024-04-23T14:49:37.400 INFO:tasks.workunit.client.0.smithi081.stdout:8/453: mknod d3/d11/d3e/ca1 0 2024-04-23T14:49:37.401 INFO:tasks.workunit.client.1.smithi156.stdout:7/0: read - no filename 2024-04-23T14:49:37.401 INFO:tasks.workunit.client.1.smithi156.stdout:7/1: write - no filename 2024-04-23T14:49:37.401 INFO:tasks.workunit.client.1.smithi156.stdout:7/2: write - no filename 2024-04-23T14:49:37.401 INFO:tasks.workunit.client.1.smithi156.stdout:7/3: dread - no filename 2024-04-23T14:49:37.401 INFO:tasks.workunit.client.1.smithi156.stdout:7/4: link - no file 2024-04-23T14:49:37.401 INFO:tasks.workunit.client.1.smithi156.stdout:7/5: dwrite - no filename 2024-04-23T14:49:37.401 INFO:tasks.workunit.client.1.smithi156.stdout:7/6: write - no filename 2024-04-23T14:49:37.402 INFO:tasks.workunit.client.1.smithi156.stdout:6/2: symlink l0 0 2024-04-23T14:49:37.405 INFO:tasks.workunit.client.0.smithi081.stdout:7/292: dread d3/d20/f2d [0,4194304] 0 2024-04-23T14:49:37.405 INFO:tasks.workunit.client.0.smithi081.stdout:7/293: truncate d3/d11/d2c/f32 161447 0 2024-04-23T14:49:37.405 INFO:tasks.workunit.client.0.smithi081.stdout:7/294: truncate d3/d11/d15/f5c 319496 0 2024-04-23T14:49:37.405 INFO:tasks.workunit.client.0.smithi081.stdout:8/454: rmdir d3/d11/d4f 39 2024-04-23T14:49:37.406 INFO:tasks.workunit.client.0.smithi081.stdout:7/295: creat d3/d21/d31/d33/d4b/f60 x:0 0 0 2024-04-23T14:49:37.406 INFO:tasks.workunit.client.0.smithi081.stdout:7/296: stat d3/d21/d31/d50/f58 0 2024-04-23T14:49:37.406 INFO:tasks.workunit.client.0.smithi081.stdout:7/297: fsync d3/d11/d2c/f3d 0 2024-04-23T14:49:37.411 INFO:tasks.workunit.client.1.smithi156.stdout:4/5: symlink d0/l1 0 2024-04-23T14:49:37.411 INFO:tasks.workunit.client.1.smithi156.stdout:4/6: chown d0 20854599 1 2024-04-23T14:49:37.411 INFO:tasks.workunit.client.1.smithi156.stdout:0/11: creat d0/d1/f2 x:0 0 0 2024-04-23T14:49:37.411 INFO:tasks.workunit.client.1.smithi156.stdout:0/12: dread - d0/d1/f2 zero size 2024-04-23T14:49:37.411 INFO:tasks.workunit.client.1.smithi156.stdout:0/13: dread - d0/d1/f2 zero size 2024-04-23T14:49:37.411 INFO:tasks.workunit.client.1.smithi156.stdout:0/14: dread - d0/d1/f2 zero size 2024-04-23T14:49:37.411 INFO:tasks.workunit.client.1.smithi156.stdout:0/15: creat d0/d1/f3 x:0 0 0 2024-04-23T14:49:37.412 INFO:tasks.workunit.client.0.smithi081.stdout:4/285: dread d1/d3/f8 [0,4194304] 0 2024-04-23T14:49:37.412 INFO:tasks.workunit.client.0.smithi081.stdout:1/425: dwrite d3/d3d/d6f/f62 [0,4194304] 0 2024-04-23T14:49:37.412 INFO:tasks.workunit.client.0.smithi081.stdout:9/357: dread d3/d1a/f52 [0,4194304] 0 2024-04-23T14:49:37.412 INFO:tasks.workunit.client.1.smithi156.stdout:7/7: symlink l0 0 2024-04-23T14:49:37.412 INFO:tasks.workunit.client.1.smithi156.stdout:7/8: fdatasync - no filename 2024-04-23T14:49:37.414 INFO:tasks.workunit.client.0.smithi081.stdout:8/455: unlink d3/f6f 0 2024-04-23T14:49:37.418 INFO:tasks.workunit.client.1.smithi156.stdout:8/5: getdents . 0 2024-04-23T14:49:37.424 INFO:tasks.workunit.client.1.smithi156.stdout:1/14: rename l1 to l2 0 2024-04-23T14:49:37.424 INFO:tasks.workunit.client.1.smithi156.stdout:1/15: dwrite - no filename 2024-04-23T14:49:37.425 INFO:tasks.workunit.client.1.smithi156.stdout:1/16: chown l2 326100 1 2024-04-23T14:49:37.429 INFO:tasks.workunit.client.1.smithi156.stdout:4/7: creat d0/f2 x:0 0 0 2024-04-23T14:49:37.429 INFO:tasks.workunit.client.1.smithi156.stdout:4/8: creat d0/f3 x:0 0 0 2024-04-23T14:49:37.433 INFO:tasks.workunit.client.0.smithi081.stdout:1/426: dread f0 [0,4194304] 0 2024-04-23T14:49:37.434 INFO:tasks.workunit.client.0.smithi081.stdout:1/427: write d3/d3d/d41/f42 [728246,46320] 0 2024-04-23T14:49:37.434 INFO:tasks.workunit.client.0.smithi081.stdout:1/428: fsync d3/d3d/d41/f5f 0 2024-04-23T14:49:37.442 INFO:tasks.workunit.client.0.smithi081.stdout:4/286: unlink d1/d1d/d39/l55 0 2024-04-23T14:49:37.443 INFO:tasks.workunit.client.0.smithi081.stdout:4/287: readlink d1/d4/d11/l3d 0 2024-04-23T14:49:37.444 INFO:tasks.workunit.client.0.smithi081.stdout:2/413: dwrite d1/d33/d45/d6e/f8e [0,4194304] 0 2024-04-23T14:49:37.454 INFO:tasks.workunit.client.0.smithi081.stdout:9/358: fdatasync d3/d1a/d6c/f31 0 2024-04-23T14:49:37.454 INFO:tasks.workunit.client.0.smithi081.stdout:9/359: chown d3/de/d22 501122 1 2024-04-23T14:49:37.455 INFO:tasks.workunit.client.1.smithi156.stdout:7/9: creat f1 x:0 0 0 2024-04-23T14:49:37.455 INFO:tasks.workunit.client.1.smithi156.stdout:7/10: write f1 [54876,92298] 0 2024-04-23T14:49:37.458 INFO:tasks.workunit.client.0.smithi081.stdout:8/456: creat d3/d11/d34/fa2 x:0 0 0 2024-04-23T14:49:37.458 INFO:tasks.workunit.client.1.smithi156.stdout:8/6: symlink l1 0 2024-04-23T14:49:37.458 INFO:tasks.workunit.client.1.smithi156.stdout:8/7: dwrite - no filename 2024-04-23T14:49:37.462 INFO:tasks.workunit.client.0.smithi081.stdout:2/414: write d1/d33/d45/d48/f51 [31957,66704] 0 2024-04-23T14:49:37.462 INFO:tasks.workunit.client.0.smithi081.stdout:2/415: chown d1/f85 16170 1 2024-04-23T14:49:37.464 INFO:tasks.workunit.client.1.smithi156.stdout:5/0: symlink l0 0 2024-04-23T14:49:37.464 INFO:tasks.workunit.client.1.smithi156.stdout:5/1: fdatasync - no filename 2024-04-23T14:49:37.466 INFO:tasks.workunit.client.0.smithi081.stdout:1/429: mkdir d3/d3d/d41/d5e/d17/d26/d8d 0 2024-04-23T14:49:37.467 INFO:tasks.workunit.client.1.smithi156.stdout:9/0: write - no filename 2024-04-23T14:49:37.470 INFO:tasks.workunit.client.0.smithi081.stdout:4/288: mknod d1/c64 0 2024-04-23T14:49:37.470 INFO:tasks.workunit.client.0.smithi081.stdout:4/289: fdatasync d1/d3/f36 0 2024-04-23T14:49:37.470 INFO:tasks.workunit.client.1.smithi156.stdout:1/17: creat f3 x:0 0 0 2024-04-23T14:49:37.470 INFO:tasks.workunit.client.1.smithi156.stdout:1/18: dread - f3 zero size 2024-04-23T14:49:37.471 INFO:tasks.workunit.client.1.smithi156.stdout:1/19: fdatasync f3 0 2024-04-23T14:49:37.473 INFO:tasks.workunit.client.1.smithi156.stdout:4/9: mknod d0/c4 0 2024-04-23T14:49:37.476 INFO:tasks.workunit.client.0.smithi081.stdout:8/457: rename d3/d11/d48/d7e/c98 to d3/d11/d48/ca3 0 2024-04-23T14:49:37.477 INFO:tasks.workunit.client.0.smithi081.stdout:9/360: symlink d3/de/d1d/d54/l79 0 2024-04-23T14:49:37.477 INFO:tasks.workunit.client.0.smithi081.stdout:8/458: write d3/f4 [1742459,82311] 0 2024-04-23T14:49:37.478 INFO:tasks.workunit.client.0.smithi081.stdout:3/296: dwrite d4/dc/f52 [0,4194304] 0 2024-04-23T14:49:37.479 INFO:tasks.workunit.client.0.smithi081.stdout:2/416: creat d1/d11/d21/d52/d8b/f91 x:0 0 0 2024-04-23T14:49:37.483 INFO:tasks.workunit.client.0.smithi081.stdout:7/298: write d3/d21/d31/d33/d4b/d4c/f5d [1891596,124451] 0 2024-04-23T14:49:37.484 INFO:tasks.workunit.client.0.smithi081.stdout:8/459: unlink d3/f37 0 2024-04-23T14:49:37.492 INFO:tasks.workunit.client.0.smithi081.stdout:3/297: mkdir d4/d7/df/d30/d64 0 2024-04-23T14:49:37.492 INFO:tasks.workunit.client.0.smithi081.stdout:3/298: chown d4/d7/df/c59 122287842 1 2024-04-23T14:49:37.507 INFO:tasks.workunit.client.1.smithi156.stdout:8/8: creat f2 x:0 0 0 2024-04-23T14:49:37.507 INFO:tasks.workunit.client.1.smithi156.stdout:9/1: creat f0 x:0 0 0 2024-04-23T14:49:37.511 INFO:tasks.workunit.client.1.smithi156.stdout:7/11: mknod c2 0 2024-04-23T14:49:37.511 INFO:tasks.workunit.client.1.smithi156.stdout:7/12: rmdir - no directory 2024-04-23T14:49:37.511 INFO:tasks.workunit.client.1.smithi156.stdout:7/13: chown c2 34536596 1 2024-04-23T14:49:37.511 INFO:tasks.workunit.client.1.smithi156.stdout:7/14: truncate f1 573957 0 2024-04-23T14:49:37.511 INFO:tasks.workunit.client.1.smithi156.stdout:5/2: mkdir d1 0 2024-04-23T14:49:37.511 INFO:tasks.workunit.client.1.smithi156.stdout:5/3: dread - no filename 2024-04-23T14:49:37.512 INFO:tasks.workunit.client.0.smithi081.stdout:7/299: mknod d3/d11/d15/c61 0 2024-04-23T14:49:37.512 INFO:tasks.workunit.client.0.smithi081.stdout:7/300: creat d3/d21/d31/d50/f62 x:0 0 0 2024-04-23T14:49:37.512 INFO:tasks.workunit.client.0.smithi081.stdout:7/301: readlink d3/d21/d31/l47 0 2024-04-23T14:49:37.512 INFO:tasks.workunit.client.0.smithi081.stdout:7/302: readlink d3/d21/d31/d33/l37 0 2024-04-23T14:49:37.512 INFO:tasks.workunit.client.0.smithi081.stdout:7/303: dread - d3/d21/d31/d50/f62 zero size 2024-04-23T14:49:37.512 INFO:tasks.workunit.client.0.smithi081.stdout:1/430: rmdir d3/d3d/d41/d5e/d12/d2e 39 2024-04-23T14:49:37.512 INFO:tasks.workunit.client.1.smithi156.stdout:5/4: rename d1 to d1/d2 22 2024-04-23T14:49:37.512 INFO:tasks.workunit.client.1.smithi156.stdout:5/5: read - no filename 2024-04-23T14:49:37.513 INFO:tasks.workunit.client.1.smithi156.stdout:5/6: write - no filename 2024-04-23T14:49:37.513 INFO:tasks.workunit.client.1.smithi156.stdout:5/7: chown l0 44817625 1 2024-04-23T14:49:37.513 INFO:tasks.workunit.client.1.smithi156.stdout:5/8: readlink l0 0 2024-04-23T14:49:37.517 INFO:tasks.workunit.client.0.smithi081.stdout:3/299: creat d4/d7/d49/d38/f65 x:0 0 0 2024-04-23T14:49:37.519 INFO:tasks.workunit.client.0.smithi081.stdout:8/460: rename d3/d11/d3e/l74 to d3/d11/d3e/d63/d78/da0/la4 0 2024-04-23T14:49:37.519 INFO:tasks.workunit.client.0.smithi081.stdout:8/461: chown d3/d11/d4f/f6a 98 1 2024-04-23T14:49:37.519 INFO:tasks.workunit.client.0.smithi081.stdout:8/462: dread - d3/d3c/f97 zero size 2024-04-23T14:49:37.519 INFO:tasks.workunit.client.0.smithi081.stdout:3/300: read d4/d7/df/f27 [2890166,98643] 0 2024-04-23T14:49:37.519 INFO:tasks.workunit.client.0.smithi081.stdout:8/463: write d3/d11/d34/d8b/f9b [161252,112371] 0 2024-04-23T14:49:37.523 INFO:tasks.workunit.client.0.smithi081.stdout:1/431: link d3/d3d/d41/d5e/d17/d25/f4d d3/d3d/d41/d5e/d12/d1a/d2a/f8e 0 2024-04-23T14:49:37.524 INFO:tasks.workunit.client.0.smithi081.stdout:8/464: getdents d3/d11/d3e/d63 0 2024-04-23T14:49:37.527 INFO:tasks.workunit.client.0.smithi081.stdout:3/301: creat d4/d41/f66 x:0 0 0 2024-04-23T14:49:37.527 INFO:tasks.workunit.client.0.smithi081.stdout:3/302: creat d4/d41/f67 x:0 0 0 2024-04-23T14:49:37.527 INFO:tasks.workunit.client.0.smithi081.stdout:3/303: chown d4/d7/df/d30/d64 50089031 1 2024-04-23T14:49:37.538 INFO:tasks.workunit.client.1.smithi156.stdout:1/20: unlink f3 0 2024-04-23T14:49:37.538 INFO:tasks.workunit.client.1.smithi156.stdout:1/21: dread - no filename 2024-04-23T14:49:37.538 INFO:tasks.workunit.client.1.smithi156.stdout:1/22: read - no filename 2024-04-23T14:49:37.538 INFO:tasks.workunit.client.1.smithi156.stdout:1/23: readlink l2 0 2024-04-23T14:49:37.538 INFO:tasks.workunit.client.1.smithi156.stdout:1/24: fsync - no filename 2024-04-23T14:49:37.538 INFO:tasks.workunit.client.1.smithi156.stdout:1/25: write - no filename 2024-04-23T14:49:37.538 INFO:tasks.workunit.client.1.smithi156.stdout:1/26: chown l2 3452 1 2024-04-23T14:49:37.538 INFO:tasks.workunit.client.1.smithi156.stdout:1/27: creat f4 x:0 0 0 2024-04-23T14:49:37.539 INFO:tasks.workunit.client.1.smithi156.stdout:1/28: fdatasync f4 0 2024-04-23T14:49:37.539 INFO:tasks.workunit.client.1.smithi156.stdout:1/29: dread - f4 zero size 2024-04-23T14:49:37.539 INFO:tasks.workunit.client.1.smithi156.stdout:4/10: symlink d0/l5 0 2024-04-23T14:49:37.539 INFO:tasks.workunit.client.1.smithi156.stdout:4/11: dread - d0/f2 zero size 2024-04-23T14:49:37.539 INFO:tasks.workunit.client.1.smithi156.stdout:4/12: creat d0/f6 x:0 0 0 2024-04-23T14:49:37.540 INFO:tasks.workunit.client.0.smithi081.stdout:1/432: creat d3/d3d/d7a/f8f x:0 0 0 2024-04-23T14:49:37.553 INFO:tasks.workunit.client.1.smithi156.stdout:2/4: dwrite f0 [0,4194304] 0 2024-04-23T14:49:37.553 INFO:tasks.workunit.client.1.smithi156.stdout:2/5: rmdir - no directory 2024-04-23T14:49:37.553 INFO:tasks.workunit.client.1.smithi156.stdout:2/6: rmdir - no directory 2024-04-23T14:49:37.557 INFO:tasks.workunit.client.0.smithi081.stdout:8/465: truncate d3/d11/d86/d88/f90 4511532 0 2024-04-23T14:49:37.557 INFO:tasks.workunit.client.0.smithi081.stdout:8/466: write d3/f2f [489550,69973] 0 2024-04-23T14:49:37.584 INFO:tasks.workunit.client.1.smithi156.stdout:3/15: dwrite f1 [0,4194304] 0 2024-04-23T14:49:37.598 INFO:tasks.workunit.client.1.smithi156.stdout:5/9: mkdir d1/d3 0 2024-04-23T14:49:37.629 INFO:tasks.workunit.client.1.smithi156.stdout:2/7: mkdir d1 0 2024-04-23T14:49:37.645 INFO:tasks.workunit.client.0.smithi081.stdout:0/424: dwrite d6/f4f [0,4194304] 0 2024-04-23T14:49:37.656 INFO:tasks.workunit.client.1.smithi156.stdout:5/10: link l0 d1/l4 0 2024-04-23T14:49:37.666 INFO:tasks.workunit.client.0.smithi081.stdout:0/425: rename d6/d11/d14/d70 to d6/d37/d67/d7d 0 2024-04-23T14:49:37.685 INFO:tasks.workunit.client.1.smithi156.stdout:2/8: rmdir d1 0 2024-04-23T14:49:37.711 INFO:tasks.workunit.client.0.smithi081.stdout:7/304: dwrite d3/d11/d15/f5c [0,4194304] 0 2024-04-23T14:49:37.749 INFO:tasks.workunit.client.0.smithi081.stdout:0/426: dread d6/d11/f40 [0,4194304] 0 2024-04-23T14:49:37.749 INFO:tasks.workunit.client.1.smithi156.stdout:5/11: creat d1/d3/f5 x:0 0 0 2024-04-23T14:49:37.749 INFO:tasks.workunit.client.1.smithi156.stdout:5/12: dread - d1/d3/f5 zero size 2024-04-23T14:49:37.756 INFO:tasks.workunit.client.0.smithi081.stdout:0/427: link d6/d11/f40 d6/d37/f7e 0 2024-04-23T14:49:37.756 INFO:tasks.workunit.client.0.smithi081.stdout:0/428: fsync d6/d11/d14/d41/d5b/f3d 0 2024-04-23T14:49:37.756 INFO:tasks.workunit.client.0.smithi081.stdout:0/429: chown d6 274012263 1 2024-04-23T14:49:37.759 INFO:tasks.workunit.client.0.smithi081.stdout:0/430: symlink d6/d11/d14/d41/d5b/d3f/d44/l7f 0 2024-04-23T14:49:37.768 INFO:tasks.workunit.client.0.smithi081.stdout:0/431: mknod d6/d11/d14/d41/d5b/d3f/d44/c80 0 2024-04-23T14:49:37.802 INFO:tasks.workunit.client.0.smithi081.stdout:7/305: dread d3/d21/d31/f38 [0,4194304] 0 2024-04-23T14:49:37.802 INFO:tasks.workunit.client.0.smithi081.stdout:7/306: fdatasync d3/f10 0 2024-04-23T14:49:37.810 INFO:tasks.workunit.client.0.smithi081.stdout:7/307: mkdir d3/d21/d31/d63 0 2024-04-23T14:49:37.814 INFO:tasks.workunit.client.0.smithi081.stdout:7/308: rename d3/d21/d31/d33/d4b/d4c/l3e to d3/d21/d31/l64 0 2024-04-23T14:49:37.819 INFO:tasks.workunit.client.0.smithi081.stdout:8/467: dwrite d3/d3c/f97 [0,4194304] 0 2024-04-23T14:49:37.819 INFO:tasks.workunit.client.0.smithi081.stdout:7/309: unlink d3/d21/d41/c4e 0 2024-04-23T14:49:37.825 INFO:tasks.workunit.client.0.smithi081.stdout:8/468: creat d3/d11/d86/d88/fa5 x:0 0 0 2024-04-23T14:49:37.825 INFO:tasks.workunit.client.0.smithi081.stdout:8/469: chown d3/d3c 228067380 1 2024-04-23T14:49:37.852 INFO:tasks.workunit.client.0.smithi081.stdout:1/433: dwrite d3/f51 [0,4194304] 0 2024-04-23T14:49:37.852 INFO:tasks.workunit.client.0.smithi081.stdout:1/434: chown d3/d3d/d41/d5e/d12/d1a/c68 580 1 2024-04-23T14:49:37.859 INFO:tasks.workunit.client.0.smithi081.stdout:1/435: mkdir d3/d3d/d90 0 2024-04-23T14:49:37.859 INFO:tasks.workunit.client.0.smithi081.stdout:1/436: truncate d3/d3d/d41/d5e/d17/d58/f63 1803578 0 2024-04-23T14:49:37.862 INFO:tasks.workunit.client.1.smithi156.stdout:7/15: fdatasync f1 0 2024-04-23T14:49:37.910 INFO:tasks.workunit.client.0.smithi081.stdout:4/290: dwrite d1/d1d/f22 [0,4194304] 0 2024-04-23T14:49:37.916 INFO:tasks.workunit.client.0.smithi081.stdout:4/291: link d1/d4/dc/f34 d1/d1d/d59/f65 0 2024-04-23T14:49:37.920 INFO:tasks.workunit.client.0.smithi081.stdout:4/292: rename d1/c25 to d1/c66 0 2024-04-23T14:49:37.920 INFO:tasks.workunit.client.0.smithi081.stdout:4/293: dread - d1/f44 zero size 2024-04-23T14:49:37.921 INFO:tasks.workunit.client.0.smithi081.stdout:1/437: write d3/fa [3428313,95957] 0 2024-04-23T14:49:37.921 INFO:tasks.workunit.client.0.smithi081.stdout:4/294: rmdir d1/d1d/d59 39 2024-04-23T14:49:37.922 INFO:tasks.workunit.client.0.smithi081.stdout:4/295: readlink d1/d3/l19 0 2024-04-23T14:49:37.926 INFO:tasks.workunit.client.0.smithi081.stdout:1/438: creat d3/d3d/d41/d5e/d17/d58/d7f/f91 x:0 0 0 2024-04-23T14:49:37.929 INFO:tasks.workunit.client.0.smithi081.stdout:1/439: chown d3/l59 67007922 1 2024-04-23T14:49:37.932 INFO:tasks.workunit.client.0.smithi081.stdout:4/296: creat d1/d4/d11/f67 x:0 0 0 2024-04-23T14:49:37.932 INFO:tasks.workunit.client.0.smithi081.stdout:4/297: write d1/d1d/f30 [210767,94528] 0 2024-04-23T14:49:37.960 INFO:tasks.workunit.client.0.smithi081.stdout:1/440: dread d3/d3d/d41/d5e/d17/f20 [0,4194304] 0 2024-04-23T14:49:37.960 INFO:tasks.workunit.client.0.smithi081.stdout:1/441: dread - d3/d3d/d41/d5e/d12/d1a/d2a/d70/f84 zero size 2024-04-23T14:49:37.960 INFO:tasks.workunit.client.0.smithi081.stdout:1/442: stat d3/d3d/d41/d4a/f43 0 2024-04-23T14:49:37.960 INFO:tasks.workunit.client.0.smithi081.stdout:1/443: readlink d3/d3d/d41/d4a/l38 0 2024-04-23T14:49:37.960 INFO:tasks.workunit.client.0.smithi081.stdout:1/444: fsync d3/d3d/d41/d5e/d12/d1a/d2a/f46 0 2024-04-23T14:49:37.962 INFO:tasks.workunit.client.0.smithi081.stdout:1/445: mkdir d3/d3d/d41/d92 0 2024-04-23T14:49:37.962 INFO:tasks.workunit.client.0.smithi081.stdout:1/446: truncate d3/d3d/f32 1259258 0 2024-04-23T14:49:37.964 INFO:tasks.workunit.client.0.smithi081.stdout:1/447: truncate d3/d3d/d41/d5e/d17/d26/f72 3390729 0 2024-04-23T14:49:37.966 INFO:tasks.workunit.client.0.smithi081.stdout:1/448: symlink d3/d3d/d41/d5e/d17/d26/l93 0 2024-04-23T14:49:37.966 INFO:tasks.workunit.client.0.smithi081.stdout:1/449: chown d3/d3d/d41/d5e/d17/d58 185032181 1 2024-04-23T14:49:37.979 INFO:tasks.workunit.client.0.smithi081.stdout:8/470: dread d3/d11/f3a [4194304,4194304] 0 2024-04-23T14:49:37.979 INFO:tasks.workunit.client.0.smithi081.stdout:8/471: stat d3/d11/d3e/d63/f75 0 2024-04-23T14:49:37.981 INFO:tasks.workunit.client.0.smithi081.stdout:8/472: unlink d3/d3c/f43 0 2024-04-23T14:49:37.984 INFO:tasks.workunit.client.0.smithi081.stdout:8/473: link d3/d11/d3e/f44 d3/d11/d34/d8b/fa6 0 2024-04-23T14:49:37.986 INFO:tasks.workunit.client.0.smithi081.stdout:8/474: mkdir d3/d11/d86/d88/da7 0 2024-04-23T14:49:37.986 INFO:tasks.workunit.client.0.smithi081.stdout:8/475: chown d3/d11/d86/d88 514398 1 2024-04-23T14:49:37.986 INFO:tasks.workunit.client.0.smithi081.stdout:8/476: write d3/d11/f1d [4982753,45408] 0 2024-04-23T14:49:37.986 INFO:tasks.workunit.client.0.smithi081.stdout:8/477: fdatasync d3/f31 0 2024-04-23T14:49:37.990 INFO:tasks.workunit.client.1.smithi156.stdout:3/16: dread f1 [0,4194304] 0 2024-04-23T14:49:37.998 INFO:tasks.workunit.client.1.smithi156.stdout:1/30: dwrite f4 [0,4194304] 0 2024-04-23T14:49:38.019 INFO:tasks.workunit.client.0.smithi081.stdout:0/432: dread d6/d11/d14/d41/d5b/f47 [0,4194304] 0 2024-04-23T14:49:38.019 INFO:tasks.workunit.client.0.smithi081.stdout:0/433: write d6/d11/d14/d41/f43 [4392510,45069] 0 2024-04-23T14:49:38.101 INFO:tasks.workunit.client.0.smithi081.stdout:9/361: dwrite d3/de/f1c [0,4194304] 0 2024-04-23T14:49:38.101 INFO:tasks.workunit.client.0.smithi081.stdout:9/362: write d3/d5/f3f [679708,97364] 0 2024-04-23T14:49:38.101 INFO:tasks.workunit.client.0.smithi081.stdout:9/363: fsync d3/d5/f16 0 2024-04-23T14:49:38.120 INFO:tasks.workunit.client.1.smithi156.stdout:4/13: dwrite d0/f2 [0,4194304] 0 2024-04-23T14:49:38.121 INFO:tasks.workunit.client.1.smithi156.stdout:4/14: dread - d0/f3 zero size 2024-04-23T14:49:38.121 INFO:tasks.workunit.client.1.smithi156.stdout:4/15: write d0/f6 [198936,35790] 0 2024-04-23T14:49:38.144 INFO:tasks.workunit.client.0.smithi081.stdout:4/298: dwrite d1/f5b [4194304,4194304] 0 2024-04-23T14:49:38.145 INFO:tasks.workunit.client.0.smithi081.stdout:4/299: creat d1/d4/f68 x:0 0 0 2024-04-23T14:49:38.152 INFO:tasks.workunit.client.0.smithi081.stdout:4/300: mknod d1/d4f/c69 0 2024-04-23T14:49:38.153 INFO:tasks.workunit.client.0.smithi081.stdout:4/301: write d1/fa [17574814,98974] 0 2024-04-23T14:49:38.169 INFO:tasks.workunit.client.0.smithi081.stdout:9/364: dread d3/f8 [0,4194304] 0 2024-04-23T14:49:38.247 INFO:tasks.workunit.client.0.smithi081.stdout:9/365: dread f1 [0,4194304] 0 2024-04-23T14:49:38.247 INFO:tasks.workunit.client.0.smithi081.stdout:9/366: dread - d3/de/d22/f5d zero size 2024-04-23T14:49:38.251 INFO:tasks.workunit.client.0.smithi081.stdout:1/450: write d3/d3d/d41/d5e/d17/d25/f6e [2821361,108696] 0 2024-04-23T14:49:38.252 INFO:tasks.workunit.client.0.smithi081.stdout:1/451: fsync d3/d3d/d41/d5e/d17/f20 0 2024-04-23T14:49:38.255 INFO:tasks.workunit.client.0.smithi081.stdout:9/367: mknod d3/d67/c7a 0 2024-04-23T14:49:38.295 INFO:tasks.workunit.client.0.smithi081.stdout:4/302: dread d1/f9 [0,4194304] 0 2024-04-23T14:49:38.295 INFO:tasks.workunit.client.0.smithi081.stdout:4/303: fsync d1/d1d/d39/f3b 0 2024-04-23T14:49:38.298 INFO:tasks.workunit.client.1.smithi156.stdout:1/31: dread f4 [0,4194304] 0 2024-04-23T14:49:38.330 INFO:tasks.workunit.client.0.smithi081.stdout:4/304: dread d1/d3/f8 [0,4194304] 0 2024-04-23T14:49:38.334 INFO:tasks.workunit.client.0.smithi081.stdout:4/305: link d1/d4/f23 d1/d4/dc/f6a 0 2024-04-23T14:49:38.339 INFO:tasks.workunit.client.1.smithi156.stdout:7/16: symlink l3 0 2024-04-23T14:49:38.340 INFO:tasks.workunit.client.1.smithi156.stdout:7/17: rmdir - no directory 2024-04-23T14:49:38.340 INFO:tasks.workunit.client.1.smithi156.stdout:7/18: readlink l0 0 2024-04-23T14:49:38.349 INFO:tasks.workunit.client.1.smithi156.stdout:1/32: dread f4 [0,4194304] 0 2024-04-23T14:49:38.350 INFO:tasks.workunit.client.1.smithi156.stdout:7/19: read f1 [502630,86513] 0 2024-04-23T14:49:38.351 INFO:tasks.workunit.client.1.smithi156.stdout:5/13: dwrite d1/d3/f5 [0,4194304] 0 2024-04-23T14:49:38.380 INFO:tasks.workunit.client.1.smithi156.stdout:2/9: dread f0 [0,4194304] 0 2024-04-23T14:49:38.381 INFO:tasks.workunit.client.1.smithi156.stdout:2/10: fsync f0 0 2024-04-23T14:49:38.381 INFO:tasks.workunit.client.1.smithi156.stdout:2/11: chown f0 59671 1 2024-04-23T14:49:38.381 INFO:tasks.workunit.client.1.smithi156.stdout:2/12: chown f0 46 1 2024-04-23T14:49:38.381 INFO:tasks.workunit.client.1.smithi156.stdout:2/13: creat f2 x:0 0 0 2024-04-23T14:49:38.381 INFO:tasks.workunit.client.1.smithi156.stdout:2/14: dread - f2 zero size 2024-04-23T14:49:38.381 INFO:tasks.workunit.client.1.smithi156.stdout:2/15: dread - f2 zero size 2024-04-23T14:49:38.381 INFO:tasks.workunit.client.1.smithi156.stdout:2/16: chown f2 0 1 2024-04-23T14:49:38.391 INFO:tasks.workunit.client.0.smithi081.stdout:1/452: dwrite d3/d3d/d41/d5e/d12/d1a/d2a/f46 [0,4194304] 0 2024-04-23T14:49:38.405 INFO:tasks.workunit.client.0.smithi081.stdout:1/453: symlink d3/d3d/d41/d5e/d17/l94 0 2024-04-23T14:49:38.406 INFO:tasks.workunit.client.0.smithi081.stdout:1/454: creat d3/d3d/d41/d5e/d12/d1a/d2a/d70/f95 x:0 0 0 2024-04-23T14:49:38.406 INFO:tasks.workunit.client.0.smithi081.stdout:1/455: write d3/d3d/d41/d5e/d17/d58/d7f/f7d [82485,43593] 0 2024-04-23T14:49:38.411 INFO:tasks.workunit.client.0.smithi081.stdout:1/456: rename d3/d3d/d7a/f8f to d3/d3d/d41/d5e/d12/f96 0 2024-04-23T14:49:38.465 INFO:tasks.workunit.client.0.smithi081.stdout:4/306: dread d1/d1d/f26 [0,4194304] 0 2024-04-23T14:49:38.465 INFO:tasks.workunit.client.0.smithi081.stdout:4/307: rename d1/d1d to d1/d1d/d6b 22 2024-04-23T14:49:38.529 INFO:tasks.workunit.client.0.smithi081.stdout:8/478: dwrite d3/d11/d48/d7e/f95 [0,4194304] 0 2024-04-23T14:49:38.539 INFO:tasks.workunit.client.0.smithi081.stdout:8/479: symlink d3/d11/d4f/d58/la8 0 2024-04-23T14:49:38.539 INFO:tasks.workunit.client.0.smithi081.stdout:8/480: chown d3/f5 180 1 2024-04-23T14:49:38.539 INFO:tasks.workunit.client.0.smithi081.stdout:8/481: fdatasync d3/d11/d34/fa2 0 2024-04-23T14:49:38.539 INFO:tasks.workunit.client.0.smithi081.stdout:8/482: write d3/f4a [4359428,17455] 0 2024-04-23T14:49:38.564 INFO:tasks.workunit.client.0.smithi081.stdout:3/304: dwrite d4/d7/d32/f33 [0,4194304] 0 2024-04-23T14:49:38.574 INFO:tasks.workunit.client.1.smithi156.stdout:5/14: dwrite d1/d3/f5 [0,4194304] 0 2024-04-23T14:49:38.574 INFO:tasks.workunit.client.1.smithi156.stdout:5/15: chown l0 13 1 2024-04-23T14:49:38.590 INFO:tasks.workunit.client.0.smithi081.stdout:3/305: write d4/d7/d2e/f46 [543386,58769] 0 2024-04-23T14:49:38.602 INFO:tasks.workunit.client.0.smithi081.stdout:3/306: link d4/d7/df/c1c d4/d7/d49/d38/c68 0 2024-04-23T14:49:38.621 INFO:tasks.workunit.client.1.smithi156.stdout:5/16: dread d1/d3/f5 [0,4194304] 0 2024-04-23T14:49:38.645 INFO:tasks.workunit.client.0.smithi081.stdout:4/308: dwrite d1/d1d/f52 [0,4194304] 0 2024-04-23T14:49:38.652 INFO:tasks.workunit.client.0.smithi081.stdout:4/309: link d1/c64 d1/d1d/d39/c6c 0 2024-04-23T14:49:38.653 INFO:tasks.workunit.client.0.smithi081.stdout:9/368: dwrite d3/de/f1c [0,4194304] 0 2024-04-23T14:49:38.657 INFO:tasks.workunit.client.0.smithi081.stdout:9/369: mkdir d3/de/d1d/d5b/d7b 0 2024-04-23T14:49:38.662 INFO:tasks.workunit.client.0.smithi081.stdout:8/483: dwrite d3/d11/d3e/d63/f75 [0,4194304] 0 2024-04-23T14:49:38.662 INFO:tasks.workunit.client.0.smithi081.stdout:8/484: fsync d3/f2a 0 2024-04-23T14:49:38.662 INFO:tasks.workunit.client.0.smithi081.stdout:8/485: creat d3/d3c/fa9 x:0 0 0 2024-04-23T14:49:38.680 INFO:tasks.workunit.client.0.smithi081.stdout:8/486: creat d3/d11/d4f/faa x:0 0 0 2024-04-23T14:49:38.709 INFO:tasks.workunit.client.0.smithi081.stdout:8/487: dread d3/d11/d48/d7e/f95 [0,4194304] 0 2024-04-23T14:49:38.711 INFO:tasks.workunit.client.0.smithi081.stdout:8/488: mkdir d3/d11/d34/dab 0 2024-04-23T14:49:38.725 INFO:tasks.workunit.client.0.smithi081.stdout:8/489: dread d3/f20 [0,4194304] 0 2024-04-23T14:49:38.725 INFO:tasks.workunit.client.0.smithi081.stdout:8/490: stat d3/d11/d4f 0 2024-04-23T14:49:38.725 INFO:tasks.workunit.client.0.smithi081.stdout:8/491: fsync d3/d1a/f92 0 2024-04-23T14:49:38.725 INFO:tasks.workunit.client.0.smithi081.stdout:8/492: write d3/d1a/f92 [1836458,21621] 0 2024-04-23T14:49:38.726 INFO:tasks.workunit.client.0.smithi081.stdout:8/493: chown d3/d11/d3e/d63/d78/da0 36300286 1 2024-04-23T14:49:38.726 INFO:tasks.workunit.client.0.smithi081.stdout:9/370: dwrite d3/d1a/d6c/f31 [0,4194304] 0 2024-04-23T14:49:38.733 INFO:tasks.workunit.client.0.smithi081.stdout:3/307: dwrite d4/d41/f66 [0,4194304] 0 2024-04-23T14:49:38.741 INFO:tasks.workunit.client.0.smithi081.stdout:3/308: mknod d4/d7/d2e/c69 0 2024-04-23T14:49:38.743 INFO:tasks.workunit.client.0.smithi081.stdout:9/371: getdents d3/d1a 0 2024-04-23T14:49:38.745 INFO:tasks.workunit.client.0.smithi081.stdout:9/372: creat d3/de/d1d/d54/d68/f7c x:0 0 0 2024-04-23T14:49:38.746 INFO:tasks.workunit.client.0.smithi081.stdout:9/373: write d3/f8 [8866248,55816] 0 2024-04-23T14:49:38.747 INFO:tasks.workunit.client.0.smithi081.stdout:9/374: rmdir d3/d1a/d6c 39 2024-04-23T14:49:38.749 INFO:tasks.workunit.client.0.smithi081.stdout:9/375: creat d3/de/d76/f7d x:0 0 0 2024-04-23T14:49:38.753 INFO:tasks.workunit.client.0.smithi081.stdout:0/434: dread d6/d11/d14/d24/f4b [0,4194304] 0 2024-04-23T14:49:38.753 INFO:tasks.workunit.client.0.smithi081.stdout:9/376: link d3/d1a/d6c/f58 d3/de/d1d/d54/d68/f7e 0 2024-04-23T14:49:38.757 INFO:tasks.workunit.client.0.smithi081.stdout:0/435: symlink d6/l81 0 2024-04-23T14:49:38.757 INFO:tasks.workunit.client.0.smithi081.stdout:0/436: readlink d6/l21 0 2024-04-23T14:49:38.760 INFO:tasks.workunit.client.0.smithi081.stdout:0/437: mknod d6/d11/d14/d41/d5b/d3f/d44/d76/c82 0 2024-04-23T14:49:38.767 INFO:tasks.workunit.client.0.smithi081.stdout:3/309: write d4/d7/df/f35 [2795887,125109] 0 2024-04-23T14:49:38.777 INFO:tasks.workunit.client.0.smithi081.stdout:3/310: truncate d4/d7/d49/d38/f3a 279218 0 2024-04-23T14:49:38.781 INFO:tasks.workunit.client.0.smithi081.stdout:3/311: unlink d4/dc/ld 0 2024-04-23T14:49:38.784 INFO:tasks.workunit.client.0.smithi081.stdout:0/438: dread d6/d11/d14/d41/d5b/f47 [0,4194304] 0 2024-04-23T14:49:38.789 INFO:tasks.workunit.client.0.smithi081.stdout:3/312: mkdir d4/d7/d32/d6a 0 2024-04-23T14:49:38.789 INFO:tasks.workunit.client.0.smithi081.stdout:0/439: truncate d6/d25/f2e 1459863 0 2024-04-23T14:49:38.818 INFO:tasks.workunit.client.0.smithi081.stdout:0/440: dread d6/d11/d14/d24/f57 [0,4194304] 0 2024-04-23T14:49:38.818 INFO:tasks.workunit.client.0.smithi081.stdout:0/441: readlink d6/l21 0 2024-04-23T14:49:38.821 INFO:tasks.workunit.client.0.smithi081.stdout:0/442: mkdir d6/d11/d14/d41/d5b/d3f/d44/d78/d83 0 2024-04-23T14:49:38.821 INFO:tasks.workunit.client.0.smithi081.stdout:0/443: chown d6/d11/d14/d41/d5b/c5f 11491230 1 2024-04-23T14:49:38.825 INFO:tasks.workunit.client.0.smithi081.stdout:0/444: mkdir d6/d11/d14/d41/d5b/d3f/d44/d78/d84 0 2024-04-23T14:49:38.845 INFO:tasks.workunit.client.0.smithi081.stdout:0/445: write d6/d11/d14/d41/d5b/f47 [1622150,51981] 0 2024-04-23T14:49:38.852 INFO:tasks.workunit.client.0.smithi081.stdout:9/377: dwrite d3/de/d1d/d54/f5f [0,4194304] 0 2024-04-23T14:49:38.867 INFO:tasks.workunit.client.0.smithi081.stdout:3/313: dwrite d4/dc/f28 [0,4194304] 0 2024-04-23T14:49:38.868 INFO:tasks.workunit.client.0.smithi081.stdout:3/314: chown d4/d7/df/d30/l34 0 1 2024-04-23T14:49:38.870 INFO:tasks.workunit.client.0.smithi081.stdout:8/494: fsync d3/d11/d34/fa2 0 2024-04-23T14:49:38.871 INFO:tasks.workunit.client.0.smithi081.stdout:8/495: creat d3/fac x:0 0 0 2024-04-23T14:49:38.871 INFO:tasks.workunit.client.0.smithi081.stdout:8/496: chown d3/d11/d48/d7e/f9e 22 1 2024-04-23T14:49:38.871 INFO:tasks.workunit.client.0.smithi081.stdout:8/497: dread - d3/d3c/f84 zero size 2024-04-23T14:49:38.882 INFO:tasks.workunit.client.0.smithi081.stdout:9/378: creat d3/de/d1d/d5b/f7f x:0 0 0 2024-04-23T14:49:38.882 INFO:tasks.workunit.client.0.smithi081.stdout:3/315: rename d4/dc/d50/l48 to d4/d7/d49/d51/l6b 0 2024-04-23T14:49:38.882 INFO:tasks.workunit.client.0.smithi081.stdout:0/446: mkdir d6/d37/d85 0 2024-04-23T14:49:38.892 INFO:tasks.workunit.client.1.smithi156.stdout:8/9: getdents . 0 2024-04-23T14:49:38.893 INFO:tasks.workunit.client.1.smithi156.stdout:8/10: rmdir - no directory 2024-04-23T14:49:38.893 INFO:tasks.workunit.client.1.smithi156.stdout:8/11: chown l0 64983 1 2024-04-23T14:49:38.897 INFO:tasks.workunit.client.0.smithi081.stdout:9/379: dread d3/f9 [0,4194304] 0 2024-04-23T14:49:38.907 INFO:tasks.workunit.client.1.smithi156.stdout:9/2: getdents . 0 2024-04-23T14:49:38.907 INFO:tasks.workunit.client.1.smithi156.stdout:9/3: dread - f0 zero size 2024-04-23T14:49:38.908 INFO:tasks.workunit.client.0.smithi081.stdout:7/310: rmdir d3/d11/d15 39 2024-04-23T14:49:38.908 INFO:tasks.workunit.client.0.smithi081.stdout:7/311: write d3/d21/d31/d33/d4b/f60 [608706,2130] 0 2024-04-23T14:49:38.912 INFO:tasks.workunit.client.0.smithi081.stdout:8/498: getdents d3/d11/d3e/d63/d78/da0 0 2024-04-23T14:49:38.917 INFO:tasks.workunit.client.0.smithi081.stdout:8/499: link d3/d11/d34/c39 d3/d11/d4f/cad 0 2024-04-23T14:49:38.917 INFO:tasks.workunit.client.0.smithi081.stdout:8/500: getdents d3/d11/d34/dab 0 2024-04-23T14:49:38.922 INFO:tasks.workunit.client.0.smithi081.stdout:8/501: link d3/d3c/f97 d3/d11/d86/d88/da7/fae 0 2024-04-23T14:49:38.935 INFO:tasks.workunit.client.1.smithi156.stdout:3/17: link l0 l2 0 2024-04-23T14:49:38.943 INFO:tasks.workunit.client.0.smithi081.stdout:0/447: dwrite d6/d11/d14/d24/f6d [0,4194304] 0 2024-04-23T14:49:38.943 INFO:tasks.workunit.client.0.smithi081.stdout:0/448: read - d6/d69/f6f zero size 2024-04-23T14:49:38.950 INFO:tasks.workunit.client.0.smithi081.stdout:0/449: link d6/d11/d14/d41/d5b/f3d d6/d11/d14/d41/d5b/d3f/d44/f86 0 2024-04-23T14:49:38.955 INFO:tasks.workunit.client.0.smithi081.stdout:0/450: unlink d6/d11/f40 0 2024-04-23T14:49:38.955 INFO:tasks.workunit.client.0.smithi081.stdout:0/451: write d6/d11/d14/d41/d5b/f3d [2029833,75979] 0 2024-04-23T14:49:38.955 INFO:tasks.workunit.client.0.smithi081.stdout:0/452: fdatasync d6/d25/f32 0 2024-04-23T14:49:38.957 INFO:tasks.workunit.client.0.smithi081.stdout:0/453: mknod d6/d11/d14/d41/d5b/d3f/d44/d78/d83/c87 0 2024-04-23T14:49:38.959 INFO:tasks.workunit.client.0.smithi081.stdout:0/454: chown d6/d25/c63 301037448 1 2024-04-23T14:49:38.962 INFO:tasks.workunit.client.0.smithi081.stdout:0/455: rename d6/d11/d14/c33 to d6/d69/c88 0 2024-04-23T14:49:38.964 INFO:tasks.workunit.client.0.smithi081.stdout:0/456: symlink d6/d37/d67/l89 0 2024-04-23T14:49:38.965 INFO:tasks.workunit.client.1.smithi156.stdout:3/18: dread f1 [0,4194304] 0 2024-04-23T14:49:38.965 INFO:tasks.workunit.client.1.smithi156.stdout:3/19: truncate f1 4852708 0 2024-04-23T14:49:38.965 INFO:tasks.workunit.client.1.smithi156.stdout:3/20: creat f3 x:0 0 0 2024-04-23T14:49:38.965 INFO:tasks.workunit.client.1.smithi156.stdout:3/21: write f3 [22644,107197] 0 2024-04-23T14:49:38.966 INFO:tasks.workunit.client.0.smithi081.stdout:0/457: truncate d6/d25/f51 909864 0 2024-04-23T14:49:38.968 INFO:tasks.workunit.client.0.smithi081.stdout:0/458: rename d6/l81 to d6/l8a 0 2024-04-23T14:49:38.970 INFO:tasks.workunit.client.0.smithi081.stdout:0/459: creat d6/d37/d85/f8b x:0 0 0 2024-04-23T14:49:38.974 INFO:tasks.workunit.client.0.smithi081.stdout:0/460: unlink d6/l21 0 2024-04-23T14:49:38.976 INFO:tasks.workunit.client.0.smithi081.stdout:0/461: symlink d6/d11/d14/d41/d5b/d3f/l8c 0 2024-04-23T14:49:38.977 INFO:tasks.workunit.client.0.smithi081.stdout:8/502: read d3/d11/f2e [1218488,61622] 0 2024-04-23T14:49:38.977 INFO:tasks.workunit.client.0.smithi081.stdout:8/503: truncate d3/d11/d48/f8d 787806 0 2024-04-23T14:49:38.981 INFO:tasks.workunit.client.0.smithi081.stdout:8/504: rename d3/d11/d3e/d63/l6d to d3/d11/d86/d88/laf 0 2024-04-23T14:49:38.981 INFO:tasks.workunit.client.0.smithi081.stdout:8/505: read d3/d11/d34/f68 [1968520,78964] 0 2024-04-23T14:49:38.985 INFO:tasks.workunit.client.0.smithi081.stdout:9/380: dwrite d3/d1a/f63 [0,4194304] 0 2024-04-23T14:49:38.994 INFO:tasks.workunit.client.0.smithi081.stdout:9/381: chown d3/d1a/d6c/d71 9 1 2024-04-23T14:49:39.001 INFO:tasks.workunit.client.0.smithi081.stdout:9/382: symlink d3/d1a/d6c/d71/l80 0 2024-04-23T14:49:39.003 INFO:tasks.workunit.client.0.smithi081.stdout:6/361: sync 2024-04-23T14:49:39.009 INFO:tasks.workunit.client.0.smithi081.stdout:9/383: getdents d3/de/d25 0 2024-04-23T14:49:39.017 INFO:tasks.workunit.client.0.smithi081.stdout:5/363: sync 2024-04-23T14:49:39.017 INFO:tasks.workunit.client.0.smithi081.stdout:5/364: fsync d17/d18/f19 0 2024-04-23T14:49:39.019 INFO:tasks.workunit.client.0.smithi081.stdout:7/312: dwrite d3/d11/f1b [4194304,4194304] 0 2024-04-23T14:49:39.068 INFO:tasks.workunit.client.0.smithi081.stdout:7/313: write d3/d21/d31/f29 [529080,128092] 0 2024-04-23T14:49:39.068 INFO:tasks.workunit.client.0.smithi081.stdout:7/314: truncate d3/d21/d41/f43 1859205 0 2024-04-23T14:49:39.069 INFO:tasks.workunit.client.0.smithi081.stdout:9/384: dwrite d3/de/d14/f3c [4194304,4194304] 0 2024-04-23T14:49:39.069 INFO:tasks.workunit.client.0.smithi081.stdout:9/385: readlink d3/lb 0 2024-04-23T14:49:39.070 INFO:tasks.workunit.client.0.smithi081.stdout:9/386: stat d3/d67/c7a 0 2024-04-23T14:49:39.070 INFO:tasks.workunit.client.0.smithi081.stdout:9/387: readlink d3/d5/l48 0 2024-04-23T14:49:39.071 INFO:tasks.workunit.client.0.smithi081.stdout:0/462: dwrite d6/d11/d14/d41/d5b/d59/d68/f74 [0,4194304] 0 2024-04-23T14:49:39.074 INFO:tasks.workunit.client.0.smithi081.stdout:5/365: dread d17/d3c/d55/d64/f75 [0,4194304] 0 2024-04-23T14:49:39.074 INFO:tasks.workunit.client.0.smithi081.stdout:5/366: truncate fd 4200065 0 2024-04-23T14:49:39.076 INFO:tasks.workunit.client.0.smithi081.stdout:7/315: creat d3/f65 x:0 0 0 2024-04-23T14:49:39.083 INFO:tasks.workunit.client.0.smithi081.stdout:8/506: dwrite d3/d11/d4f/f65 [0,4194304] 0 2024-04-23T14:49:39.086 INFO:tasks.workunit.client.0.smithi081.stdout:9/388: truncate d3/de/d22/f39 2075292 0 2024-04-23T14:49:39.090 INFO:tasks.workunit.client.1.smithi156.stdout:3/22: dwrite f3 [0,4194304] 0 2024-04-23T14:49:39.092 INFO:tasks.workunit.client.0.smithi081.stdout:0/463: rmdir d6/d11/d14/d41 39 2024-04-23T14:49:39.094 INFO:tasks.workunit.client.0.smithi081.stdout:5/367: mknod d17/d4f/c80 0 2024-04-23T14:49:39.095 INFO:tasks.workunit.client.0.smithi081.stdout:5/368: readlink l10 0 2024-04-23T14:49:39.103 INFO:tasks.workunit.client.0.smithi081.stdout:9/389: symlink d3/de/d1d/d73/l81 0 2024-04-23T14:49:39.103 INFO:tasks.workunit.client.0.smithi081.stdout:9/390: chown d3/c32 31696 1 2024-04-23T14:49:39.103 INFO:tasks.workunit.client.0.smithi081.stdout:0/464: unlink d6/d11/c49 0 2024-04-23T14:49:39.103 INFO:tasks.workunit.client.0.smithi081.stdout:8/507: write d3/d11/d34/f57 [908149,87090] 0 2024-04-23T14:49:39.104 INFO:tasks.workunit.client.0.smithi081.stdout:8/508: chown d3/d3c/f89 1 1 2024-04-23T14:49:39.112 INFO:tasks.workunit.client.0.smithi081.stdout:0/465: truncate d6/ff 3749509 0 2024-04-23T14:49:39.112 INFO:tasks.workunit.client.0.smithi081.stdout:0/466: stat d6/d11/d14/d41 0 2024-04-23T14:49:39.115 INFO:tasks.workunit.client.0.smithi081.stdout:8/509: mknod d3/d3c/cb0 0 2024-04-23T14:49:39.116 INFO:tasks.workunit.client.0.smithi081.stdout:8/510: read d3/d11/d3e/f5d [98181,8943] 0 2024-04-23T14:49:39.116 INFO:tasks.workunit.client.0.smithi081.stdout:9/391: write d3/de/d1d/d54/f6a [3595470,120898] 0 2024-04-23T14:49:39.116 INFO:tasks.workunit.client.0.smithi081.stdout:9/392: chown d3/de/d76/f7d 8 1 2024-04-23T14:49:39.117 INFO:tasks.workunit.client.0.smithi081.stdout:9/393: write d3/de/d25/f59 [50696,13310] 0 2024-04-23T14:49:39.120 INFO:tasks.workunit.client.0.smithi081.stdout:0/467: getdents d6/d25 0 2024-04-23T14:49:39.120 INFO:tasks.workunit.client.0.smithi081.stdout:8/511: symlink d3/lb1 0 2024-04-23T14:49:39.124 INFO:tasks.workunit.client.0.smithi081.stdout:8/512: stat d3/d11/d34/c39 0 2024-04-23T14:49:39.124 INFO:tasks.workunit.client.0.smithi081.stdout:8/513: dread - d3/d3c/f89 zero size 2024-04-23T14:49:39.141 INFO:tasks.workunit.client.0.smithi081.stdout:0/468: dread d6/d25/f45 [0,4194304] 0 2024-04-23T14:49:39.144 INFO:tasks.workunit.client.0.smithi081.stdout:9/394: dread d3/de/d14/f38 [0,4194304] 0 2024-04-23T14:49:39.144 INFO:tasks.workunit.client.0.smithi081.stdout:9/395: read d3/f8 [7077869,52008] 0 2024-04-23T14:49:39.144 INFO:tasks.workunit.client.0.smithi081.stdout:9/396: readlink d3/de/l28 0 2024-04-23T14:49:39.144 INFO:tasks.workunit.client.0.smithi081.stdout:9/397: chown d3/de/d25/f59 950 1 2024-04-23T14:49:39.161 INFO:tasks.workunit.client.0.smithi081.stdout:5/369: dwrite f12 [0,4194304] 0 2024-04-23T14:49:39.161 INFO:tasks.workunit.client.0.smithi081.stdout:5/370: readlink d17/l20 0 2024-04-23T14:49:39.168 INFO:tasks.workunit.client.0.smithi081.stdout:5/371: rename d17/d1f/d36/f3f to d17/d3c/f81 0 2024-04-23T14:49:39.168 INFO:tasks.workunit.client.0.smithi081.stdout:5/372: creat d17/d3d/d41/f82 x:0 0 0 2024-04-23T14:49:39.168 INFO:tasks.workunit.client.0.smithi081.stdout:5/373: dread - d17/f1d zero size 2024-04-23T14:49:39.173 INFO:tasks.workunit.client.0.smithi081.stdout:5/374: symlink d17/d37/l83 0 2024-04-23T14:49:39.173 INFO:tasks.workunit.client.0.smithi081.stdout:5/375: fsync d17/d1f/d36/d59/f79 0 2024-04-23T14:49:39.178 INFO:tasks.workunit.client.0.smithi081.stdout:5/376: creat d17/d4f/d61/f84 x:0 0 0 2024-04-23T14:49:39.189 INFO:tasks.workunit.client.0.smithi081.stdout:8/514: dwrite d3/d11/d34/f40 [4194304,4194304] 0 2024-04-23T14:49:39.189 INFO:tasks.workunit.client.0.smithi081.stdout:8/515: readlink d3/d11/d48/l7d 0 2024-04-23T14:49:39.198 INFO:tasks.workunit.client.0.smithi081.stdout:9/398: dwrite d3/f4e [0,4194304] 0 2024-04-23T14:49:39.198 INFO:tasks.workunit.client.0.smithi081.stdout:9/399: dread - d3/d1a/d6c/f58 zero size 2024-04-23T14:49:39.198 INFO:tasks.workunit.client.0.smithi081.stdout:9/400: fsync d3/de/d25/f45 0 2024-04-23T14:49:39.198 INFO:tasks.workunit.client.0.smithi081.stdout:9/401: fdatasync d3/de/d25/f45 0 2024-04-23T14:49:39.198 INFO:tasks.workunit.client.0.smithi081.stdout:9/402: fsync d3/de/d25/f60 0 2024-04-23T14:49:39.198 INFO:tasks.workunit.client.0.smithi081.stdout:9/403: chown d3/de/d25/f45 125 1 2024-04-23T14:49:39.205 INFO:tasks.workunit.client.0.smithi081.stdout:9/404: mkdir d3/de/d1d/d54/d68/d82 0 2024-04-23T14:49:39.208 INFO:tasks.workunit.client.0.smithi081.stdout:9/405: symlink d3/de/d25/l83 0 2024-04-23T14:49:39.208 INFO:tasks.workunit.client.0.smithi081.stdout:9/406: readlink d3/de/l28 0 2024-04-23T14:49:39.208 INFO:tasks.workunit.client.0.smithi081.stdout:9/407: write d3/d5/f41 [1837696,17438] 0 2024-04-23T14:49:39.216 INFO:tasks.workunit.client.0.smithi081.stdout:8/516: write d3/f4a [238083,57311] 0 2024-04-23T14:49:39.223 INFO:tasks.workunit.client.0.smithi081.stdout:8/517: creat d3/d11/d86/fb2 x:0 0 0 2024-04-23T14:49:39.223 INFO:tasks.workunit.client.0.smithi081.stdout:8/518: write d3/d11/d34/fa2 [641030,97692] 0 2024-04-23T14:49:39.241 INFO:tasks.workunit.client.0.smithi081.stdout:9/408: dread d3/de/d22/f51 [0,4194304] 0 2024-04-23T14:49:39.241 INFO:tasks.workunit.client.0.smithi081.stdout:9/409: chown d3/d67/c7a 1571668 1 2024-04-23T14:49:39.248 INFO:tasks.workunit.client.0.smithi081.stdout:9/410: rename d3/de/d22/f51 to d3/de/f84 0 2024-04-23T14:49:39.248 INFO:tasks.workunit.client.0.smithi081.stdout:9/411: symlink d3/de/d47/l85 0 2024-04-23T14:49:39.248 INFO:tasks.workunit.client.0.smithi081.stdout:8/519: dread d3/f2c [0,4194304] 0 2024-04-23T14:49:39.250 INFO:tasks.workunit.client.0.smithi081.stdout:9/412: symlink d3/l86 0 2024-04-23T14:49:39.250 INFO:tasks.workunit.client.0.smithi081.stdout:9/413: dread - d3/de/d1d/d54/f66 zero size 2024-04-23T14:49:39.253 INFO:tasks.workunit.client.0.smithi081.stdout:5/377: dwrite d17/d1f/d36/d59/f63 [0,4194304] 0 2024-04-23T14:49:39.253 INFO:tasks.workunit.client.0.smithi081.stdout:5/378: creat d17/d1f/d36/d59/f85 x:0 0 0 2024-04-23T14:49:39.253 INFO:tasks.workunit.client.0.smithi081.stdout:8/520: rename d3/f2a to d3/d11/d4f/d58/fb3 0 2024-04-23T14:49:39.253 INFO:tasks.workunit.client.0.smithi081.stdout:8/521: fdatasync d3/d3c/f97 0 2024-04-23T14:49:39.254 INFO:tasks.workunit.client.0.smithi081.stdout:9/414: creat d3/de/d14/d5e/f87 x:0 0 0 2024-04-23T14:49:39.261 INFO:tasks.workunit.client.0.smithi081.stdout:5/379: truncate d17/d3c/d55/d64/f75 509150 0 2024-04-23T14:49:39.261 INFO:tasks.workunit.client.0.smithi081.stdout:5/380: readlink d17/d4f/d61/l6b 0 2024-04-23T14:49:39.261 INFO:tasks.workunit.client.0.smithi081.stdout:5/381: creat d17/d3c/d55/f86 x:0 0 0 2024-04-23T14:49:39.267 INFO:tasks.workunit.client.0.smithi081.stdout:8/522: creat d3/d11/d4f/d6c/fb4 x:0 0 0 2024-04-23T14:49:39.272 INFO:tasks.workunit.client.0.smithi081.stdout:8/523: creat d3/d11/d3e/fb5 x:0 0 0 2024-04-23T14:49:39.272 INFO:tasks.workunit.client.0.smithi081.stdout:8/524: creat d3/d11/d34/fb6 x:0 0 0 2024-04-23T14:49:39.282 INFO:tasks.workunit.client.0.smithi081.stdout:5/382: dread d17/f2c [0,4194304] 0 2024-04-23T14:49:39.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:38 smithi156 ceph-mon[32341]: pgmap v28: 65 pgs: 65 active+clean; 773 MiB data, 3.9 GiB used, 532 GiB / 536 GiB avail; 67 MiB/s rd, 74 MiB/s wr, 132 op/s 2024-04-23T14:49:39.311 INFO:tasks.workunit.client.0.smithi081.stdout:5/383: write d17/d3d/f49 [2944643,115176] 0 2024-04-23T14:49:39.313 INFO:tasks.workunit.client.0.smithi081.stdout:9/415: dwrite d3/de/d14/f3d [0,4194304] 0 2024-04-23T14:49:39.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:38 smithi081 ceph-mon[25540]: pgmap v28: 65 pgs: 65 active+clean; 773 MiB data, 3.9 GiB used, 532 GiB / 536 GiB avail; 67 MiB/s rd, 74 MiB/s wr, 132 op/s 2024-04-23T14:49:39.333 INFO:tasks.workunit.client.0.smithi081.stdout:8/525: dwrite d3/d11/d48/f8d [0,4194304] 0 2024-04-23T14:49:39.334 INFO:tasks.workunit.client.0.smithi081.stdout:5/384: write d17/d1f/d42/f50 [901378,65868] 0 2024-04-23T14:49:39.334 INFO:tasks.workunit.client.0.smithi081.stdout:5/385: dread - d17/d37/f6e zero size 2024-04-23T14:49:39.346 INFO:tasks.workunit.client.0.smithi081.stdout:5/386: mknod d17/d4a/c87 0 2024-04-23T14:49:39.350 INFO:tasks.workunit.client.0.smithi081.stdout:5/387: unlink c6 0 2024-04-23T14:49:39.383 INFO:tasks.workunit.client.0.smithi081.stdout:8/526: dwrite d3/d3c/f52 [0,4194304] 0 2024-04-23T14:49:39.383 INFO:tasks.workunit.client.0.smithi081.stdout:8/527: fdatasync d3/d11/d4f/f65 0 2024-04-23T14:49:39.384 INFO:tasks.workunit.client.0.smithi081.stdout:8/528: write d3/d11/d34/f55 [532648,79816] 0 2024-04-23T14:49:39.386 INFO:tasks.workunit.client.0.smithi081.stdout:8/529: symlink d3/d11/d3e/lb7 0 2024-04-23T14:49:39.388 INFO:tasks.workunit.client.0.smithi081.stdout:8/530: getdents d3/d11/d48 0 2024-04-23T14:49:39.411 INFO:tasks.workunit.client.0.smithi081.stdout:8/531: dread d3/f31 [0,4194304] 0 2024-04-23T14:49:39.411 INFO:tasks.workunit.client.0.smithi081.stdout:8/532: truncate d3/d1a/f1e 4377110 0 2024-04-23T14:49:39.415 INFO:tasks.workunit.client.0.smithi081.stdout:8/533: rename d3/d11/f1d to d3/d1a/fb8 0 2024-04-23T14:49:39.418 INFO:tasks.workunit.client.0.smithi081.stdout:8/534: unlink d3/d11/d4f/d6c/l82 0 2024-04-23T14:49:39.426 INFO:tasks.workunit.client.0.smithi081.stdout:5/388: dwrite f14 [0,4194304] 0 2024-04-23T14:49:39.426 INFO:tasks.workunit.client.0.smithi081.stdout:8/535: dread d3/d11/d4f/d58/fb3 [0,4194304] 0 2024-04-23T14:49:39.426 INFO:tasks.workunit.client.0.smithi081.stdout:8/536: creat d3/d11/d4f/fb9 x:0 0 0 2024-04-23T14:49:39.426 INFO:tasks.workunit.client.0.smithi081.stdout:8/537: chown d3/d11/d34/d8b/f9b 5251251 1 2024-04-23T14:49:39.429 INFO:tasks.workunit.client.0.smithi081.stdout:5/389: creat d17/d3c/f88 x:0 0 0 2024-04-23T14:49:39.429 INFO:tasks.workunit.client.0.smithi081.stdout:5/390: truncate d17/d3d/f45 8593473 0 2024-04-23T14:49:39.471 INFO:tasks.workunit.client.1.smithi156.stdout:4/16: mknod d0/c7 0 2024-04-23T14:49:39.491 INFO:tasks.workunit.client.0.smithi081.stdout:8/538: dwrite d3/d11/f9a [0,4194304] 0 2024-04-23T14:49:39.503 INFO:tasks.workunit.client.1.smithi156.stdout:4/17: write d0/f2 [2895804,127329] 0 2024-04-23T14:49:39.503 INFO:tasks.workunit.client.1.smithi156.stdout:4/18: chown d0/c4 61 1 2024-04-23T14:49:39.518 INFO:tasks.workunit.client.0.smithi081.stdout:8/539: dread d3/d11/d3e/f44 [0,4194304] 0 2024-04-23T14:49:39.518 INFO:tasks.workunit.client.0.smithi081.stdout:8/540: creat d3/fba x:0 0 0 2024-04-23T14:49:39.518 INFO:tasks.workunit.client.0.smithi081.stdout:8/541: readlink d3/d11/d4f/d58/l5a 0 2024-04-23T14:49:39.518 INFO:tasks.workunit.client.0.smithi081.stdout:8/542: creat d3/d11/d3e/fbb x:0 0 0 2024-04-23T14:49:39.518 INFO:tasks.workunit.client.0.smithi081.stdout:8/543: chown d3/d11/d3e/d63/d78/l85 159000 1 2024-04-23T14:49:39.518 INFO:tasks.workunit.client.0.smithi081.stdout:8/544: chown d3/d11/f2e 53248 1 2024-04-23T14:49:39.522 INFO:tasks.workunit.client.0.smithi081.stdout:8/545: unlink d3/d11/d48/l4e 0 2024-04-23T14:49:39.524 INFO:tasks.workunit.client.0.smithi081.stdout:8/546: rename d3/c17 to d3/d11/d4f/d66/cbc 0 2024-04-23T14:49:39.527 INFO:tasks.workunit.client.0.smithi081.stdout:8/547: truncate d3/d11/d86/d88/f90 3010143 0 2024-04-23T14:49:39.527 INFO:tasks.workunit.client.0.smithi081.stdout:8/548: chown d3/d11/d4f/d66 578482451 1 2024-04-23T14:49:39.530 INFO:tasks.workunit.client.0.smithi081.stdout:8/549: unlink d3/f5c 0 2024-04-23T14:49:39.530 INFO:tasks.workunit.client.0.smithi081.stdout:8/550: creat d3/d11/d3e/fbd x:0 0 0 2024-04-23T14:49:39.540 INFO:tasks.workunit.client.0.smithi081.stdout:8/551: dread d3/d11/d3e/f96 [0,4194304] 0 2024-04-23T14:49:39.540 INFO:tasks.workunit.client.0.smithi081.stdout:8/552: chown d3/d11/d48/f8d 18465 1 2024-04-23T14:49:39.540 INFO:tasks.workunit.client.0.smithi081.stdout:8/553: fsync d3/f9d 0 2024-04-23T14:49:39.596 INFO:tasks.workunit.client.0.smithi081.stdout:8/554: dwrite d3/d11/d3e/d63/d78/f8e [0,4194304] 0 2024-04-23T14:49:39.596 INFO:tasks.workunit.client.0.smithi081.stdout:8/555: write d3/d11/d34/f55 [4127152,75205] 0 2024-04-23T14:49:39.627 INFO:tasks.workunit.client.0.smithi081.stdout:8/556: write d3/d1a/f53 [3571714,39352] 0 2024-04-23T14:49:39.665 INFO:tasks.workunit.client.0.smithi081.stdout:8/557: dwrite d3/d11/d48/f8d [0,4194304] 0 2024-04-23T14:49:39.665 INFO:tasks.workunit.client.0.smithi081.stdout:8/558: creat d3/d11/d86/d88/fbe x:0 0 0 2024-04-23T14:49:39.684 INFO:tasks.workunit.client.0.smithi081.stdout:8/559: dread d3/d11/d3e/d63/d78/f8e [0,4194304] 0 2024-04-23T14:49:39.684 INFO:tasks.workunit.client.0.smithi081.stdout:8/560: chown d3/l61 2 1 2024-04-23T14:49:39.685 INFO:tasks.workunit.client.0.smithi081.stdout:8/561: readlink d3/l61 0 2024-04-23T14:49:39.685 INFO:tasks.workunit.client.0.smithi081.stdout:8/562: creat d3/d11/d4f/d58/fbf x:0 0 0 2024-04-23T14:49:39.685 INFO:tasks.workunit.client.0.smithi081.stdout:8/563: fdatasync d3/d11/d4f/d58/fb3 0 2024-04-23T14:49:39.685 INFO:tasks.workunit.client.0.smithi081.stdout:8/564: readlink d3/d11/d48/l4d 0 2024-04-23T14:49:39.685 INFO:tasks.workunit.client.0.smithi081.stdout:8/565: readlink d3/d1a/l32 0 2024-04-23T14:49:39.689 INFO:tasks.workunit.client.0.smithi081.stdout:8/566: rename d3/d11/d4f/d6c/l9f to d3/d11/d86/lc0 0 2024-04-23T14:49:39.689 INFO:tasks.workunit.client.0.smithi081.stdout:8/567: readlink d3/l24 0 2024-04-23T14:49:39.759 INFO:tasks.workunit.client.0.smithi081.stdout:8/568: dwrite d3/d11/d4f/d58/fb3 [0,4194304] 0 2024-04-23T14:49:39.813 INFO:tasks.workunit.client.0.smithi081.stdout:1/457: rmdir d3/d3d/d41/d5e/d12/d1a 39 2024-04-23T14:49:39.820 INFO:tasks.workunit.client.0.smithi081.stdout:1/458: unlink d3/d3d/d41/d5e/d17/d26/f2d 0 2024-04-23T14:49:39.822 INFO:tasks.workunit.client.0.smithi081.stdout:8/569: dwrite d3/d11/f35 [4194304,4194304] 0 2024-04-23T14:49:39.825 INFO:tasks.workunit.client.0.smithi081.stdout:1/459: mkdir d3/d3d/d41/d5e/d12/d1a/d2a/d97 0 2024-04-23T14:49:39.826 INFO:tasks.workunit.client.0.smithi081.stdout:1/460: fsync d3/f47 0 2024-04-23T14:49:39.826 INFO:tasks.workunit.client.0.smithi081.stdout:1/461: stat d3/d3d/d41/d5e/d5d 0 2024-04-23T14:49:39.826 INFO:tasks.workunit.client.0.smithi081.stdout:1/462: chown d3/d3d/d41/d5e/d17/d25/f6e 18 1 2024-04-23T14:49:39.829 INFO:tasks.workunit.client.0.smithi081.stdout:8/570: mkdir d3/d11/d48/dc1 0 2024-04-23T14:49:39.831 INFO:tasks.workunit.client.0.smithi081.stdout:1/463: rmdir d3/d3d/d41/d4a 39 2024-04-23T14:49:39.831 INFO:tasks.workunit.client.0.smithi081.stdout:1/464: fsync d3/d3d/d41/d5e/d12/d1a/f65 0 2024-04-23T14:49:39.833 INFO:tasks.workunit.client.0.smithi081.stdout:8/571: creat d3/d11/d48/fc2 x:0 0 0 2024-04-23T14:49:39.834 INFO:tasks.workunit.client.0.smithi081.stdout:1/465: readlink d3/d3d/d41/d5e/d17/l19 0 2024-04-23T14:49:39.834 INFO:tasks.workunit.client.0.smithi081.stdout:1/466: write d3/f7 [52169,109754] 0 2024-04-23T14:49:39.836 INFO:tasks.workunit.client.0.smithi081.stdout:8/572: symlink d3/d11/d3e/d63/lc3 0 2024-04-23T14:49:39.840 INFO:tasks.workunit.client.0.smithi081.stdout:1/467: rename d3/d3d/d6f/f64 to d3/d3d/d41/d4a/d77/f98 0 2024-04-23T14:49:39.843 INFO:tasks.workunit.client.0.smithi081.stdout:8/573: unlink d3/lb1 0 2024-04-23T14:49:39.843 INFO:tasks.workunit.client.0.smithi081.stdout:8/574: chown d3/d11/l14 2338 1 2024-04-23T14:49:39.843 INFO:tasks.workunit.client.0.smithi081.stdout:8/575: chown d3/d11/d48/l54 11 1 2024-04-23T14:49:39.846 INFO:tasks.workunit.client.0.smithi081.stdout:8/576: rename d3/d11/d48/l54 to d3/d11/d48/dc1/lc4 0 2024-04-23T14:49:39.846 INFO:tasks.workunit.client.0.smithi081.stdout:8/577: chown d3/d11/d3e/fb5 413 1 2024-04-23T14:49:39.849 INFO:tasks.workunit.client.0.smithi081.stdout:8/578: mknod d3/d11/d3e/d63/d78/cc5 0 2024-04-23T14:49:39.925 INFO:tasks.workunit.client.0.smithi081.stdout:1/468: dwrite d3/d3d/d41/d5e/d12/d1a/d2a/f83 [0,4194304] 0 2024-04-23T14:49:39.938 INFO:tasks.workunit.client.0.smithi081.stdout:1/469: rename d3/d3d/d41/d5e/d17/d58/f63 to d3/d3d/d41/d5e/d17/d58/f99 0 2024-04-23T14:49:39.943 INFO:tasks.workunit.client.0.smithi081.stdout:1/470: rename d3/d3d/d41/d5e/d1d/f73 to d3/d3d/d6f/f9a 0 2024-04-23T14:49:39.943 INFO:tasks.workunit.client.0.smithi081.stdout:1/471: fdatasync d3/d3d/d41/d5e/d12/d1a/f86 0 2024-04-23T14:49:39.990 INFO:tasks.workunit.client.0.smithi081.stdout:2/417: sync 2024-04-23T14:49:39.991 INFO:tasks.workunit.client.0.smithi081.stdout:2/418: creat d1/f92 x:0 0 0 2024-04-23T14:49:40.002 INFO:tasks.workunit.client.0.smithi081.stdout:2/419: truncate d1/f5 1359331 0 2024-04-23T14:49:40.012 INFO:tasks.workunit.client.0.smithi081.stdout:2/420: mkdir d1/d11/d21/d52/d8b/d8f/d93 0 2024-04-23T14:49:40.040 INFO:tasks.workunit.client.0.smithi081.stdout:1/472: dwrite d3/d3d/d41/d5e/d12/d1a/d2a/f75 [0,4194304] 0 2024-04-23T14:49:40.040 INFO:tasks.workunit.client.0.smithi081.stdout:1/473: write d3/d3d/f13 [2734180,74046] 0 2024-04-23T14:49:40.048 INFO:tasks.workunit.client.0.smithi081.stdout:4/310: getdents d1/d1d/d39 0 2024-04-23T14:49:40.048 INFO:tasks.workunit.client.0.smithi081.stdout:4/311: readlink d1/d4/l33 0 2024-04-23T14:49:40.089 INFO:tasks.workunit.client.0.smithi081.stdout:2/421: dwrite d1/d11/d21/d34/f76 [0,4194304] 0 2024-04-23T14:49:40.089 INFO:tasks.workunit.client.0.smithi081.stdout:2/422: readlink d1/d89/l8c 0 2024-04-23T14:49:40.096 INFO:tasks.workunit.client.0.smithi081.stdout:4/312: dwrite d1/d1d/d59/f5a [0,4194304] 0 2024-04-23T14:49:40.096 INFO:tasks.workunit.client.0.smithi081.stdout:4/313: fsync d1/d1d/f22 0 2024-04-23T14:49:40.096 INFO:tasks.workunit.client.0.smithi081.stdout:4/314: truncate d1/d4/f63 905385 0 2024-04-23T14:49:40.096 INFO:tasks.workunit.client.0.smithi081.stdout:4/315: creat d1/d4/d11/f6d x:0 0 0 2024-04-23T14:49:40.096 INFO:tasks.workunit.client.0.smithi081.stdout:4/316: readlink d1/d4/dc/l56 0 2024-04-23T14:49:40.115 INFO:tasks.workunit.client.0.smithi081.stdout:1/474: dwrite d3/f47 [0,4194304] 0 2024-04-23T14:49:40.115 INFO:tasks.workunit.client.0.smithi081.stdout:1/475: chown d3/d3d/d41/d4a 21255402 1 2024-04-23T14:49:40.115 INFO:tasks.workunit.client.0.smithi081.stdout:1/476: stat d3/d3d/d41/d5e/d17/d58/d7f/c53 0 2024-04-23T14:49:40.118 INFO:tasks.workunit.client.0.smithi081.stdout:4/317: creat d1/d4/dc/f6e x:0 0 0 2024-04-23T14:49:40.128 INFO:tasks.workunit.client.0.smithi081.stdout:4/318: mkdir d1/d4/d6f 0 2024-04-23T14:49:40.133 INFO:tasks.workunit.client.0.smithi081.stdout:1/477: symlink d3/d3d/d41/d5e/d17/l9b 0 2024-04-23T14:49:40.133 INFO:tasks.workunit.client.0.smithi081.stdout:1/478: write d3/d3d/f13 [3484065,6877] 0 2024-04-23T14:49:40.137 INFO:tasks.workunit.client.0.smithi081.stdout:3/316: write d4/d41/f66 [4244961,84968] 0 2024-04-23T14:49:40.137 INFO:tasks.workunit.client.0.smithi081.stdout:3/317: truncate d4/dc/f5c 860834 0 2024-04-23T14:49:40.141 INFO:tasks.workunit.client.0.smithi081.stdout:1/479: rename d3/f6b to d3/d3d/d41/f9c 0 2024-04-23T14:49:40.141 INFO:tasks.workunit.client.0.smithi081.stdout:1/480: read - d3/d3d/d41/d5e/d12/d1a/d2a/d70/f84 zero size 2024-04-23T14:49:40.148 INFO:tasks.workunit.client.0.smithi081.stdout:2/423: dwrite d1/d11/d21/d52/d8b/f91 [0,4194304] 0 2024-04-23T14:49:40.155 INFO:tasks.workunit.client.0.smithi081.stdout:2/424: mknod d1/d11/d21/d22/c94 0 2024-04-23T14:49:40.155 INFO:tasks.workunit.client.0.smithi081.stdout:2/425: fdatasync d1/d33/d45/f4a 0 2024-04-23T14:49:40.161 INFO:tasks.workunit.client.0.smithi081.stdout:3/318: dread d4/f6 [0,4194304] 0 2024-04-23T14:49:40.161 INFO:tasks.workunit.client.0.smithi081.stdout:3/319: readlink d4/d7/l13 0 2024-04-23T14:49:40.161 INFO:tasks.workunit.client.0.smithi081.stdout:3/320: stat d4/c26 0 2024-04-23T14:49:40.162 INFO:tasks.workunit.client.0.smithi081.stdout:2/426: mkdir d1/d33/d95 0 2024-04-23T14:49:40.165 INFO:tasks.workunit.client.0.smithi081.stdout:3/321: mkdir d4/d7/d49/d51/d53/d6c 0 2024-04-23T14:49:40.165 INFO:tasks.workunit.client.0.smithi081.stdout:3/322: stat d4/f6 0 2024-04-23T14:49:40.169 INFO:tasks.workunit.client.0.smithi081.stdout:4/319: dwrite d1/d4/f10 [4194304,4194304] 0 2024-04-23T14:49:40.170 INFO:tasks.workunit.client.0.smithi081.stdout:3/323: stat d4/dc/l24 0 2024-04-23T14:49:40.170 INFO:tasks.workunit.client.0.smithi081.stdout:3/324: creat d4/dc/d10/d47/f6d x:0 0 0 2024-04-23T14:49:40.176 INFO:tasks.workunit.client.0.smithi081.stdout:4/320: mkdir d1/d4/d6f/d70 0 2024-04-23T14:49:40.176 INFO:tasks.workunit.client.0.smithi081.stdout:4/321: creat d1/d3/f71 x:0 0 0 2024-04-23T14:49:40.176 INFO:tasks.workunit.client.0.smithi081.stdout:4/322: write d1/f44 [1016745,7165] 0 2024-04-23T14:49:40.179 INFO:tasks.workunit.client.0.smithi081.stdout:3/325: mknod d4/d7/df/d30/d64/c6e 0 2024-04-23T14:49:40.180 INFO:tasks.workunit.client.0.smithi081.stdout:3/326: chown d4/d7/df/d30/d64/c6e 10 1 2024-04-23T14:49:40.244 INFO:tasks.workunit.client.0.smithi081.stdout:4/323: dwrite d1/f44 [0,4194304] 0 2024-04-23T14:49:40.295 INFO:tasks.workunit.client.0.smithi081.stdout:4/324: mknod d1/d1d/d39/c72 0 2024-04-23T14:49:40.295 INFO:tasks.workunit.client.0.smithi081.stdout:4/325: chown d1/l49 7453 1 2024-04-23T14:49:40.296 INFO:tasks.workunit.client.1.smithi156.stdout:7/20: symlink l4 0 2024-04-23T14:49:40.296 INFO:tasks.workunit.client.1.smithi156.stdout:7/21: read f1 [322661,24342] 0 2024-04-23T14:49:40.296 INFO:tasks.workunit.client.1.smithi156.stdout:7/22: fdatasync f1 0 2024-04-23T14:49:40.299 INFO:tasks.workunit.client.0.smithi081.stdout:4/326: link d1/d1d/d39/f4c d1/d1d/d39/f73 0 2024-04-23T14:49:40.301 INFO:tasks.workunit.client.0.smithi081.stdout:0/469: unlink d6/d69/c88 0 2024-04-23T14:49:40.305 INFO:tasks.workunit.client.0.smithi081.stdout:4/327: dread d1/d1d/d39/f53 [0,4194304] 0 2024-04-23T14:49:40.403 INFO:tasks.workunit.client.0.smithi081.stdout:9/416: dwrite d3/d1a/f63 [4194304,4194304] 0 2024-04-23T14:49:40.404 INFO:tasks.workunit.client.0.smithi081.stdout:9/417: creat d3/de/d1d/d54/d68/f88 x:0 0 0 2024-04-23T14:49:40.424 INFO:tasks.workunit.client.0.smithi081.stdout:5/391: getdents d17/d3d/d41 0 2024-04-23T14:49:40.452 INFO:tasks.workunit.client.0.smithi081.stdout:9/418: dwrite d3/d5/f16 [0,4194304] 0 2024-04-23T14:49:40.453 INFO:tasks.workunit.client.1.smithi156.stdout:1/33: dwrite f4 [4194304,4194304] 0 2024-04-23T14:49:40.453 INFO:tasks.workunit.client.1.smithi156.stdout:1/34: chown f4 475119879 1 2024-04-23T14:49:40.478 INFO:tasks.workunit.client.0.smithi081.stdout:9/419: fsync d3/de/f84 0 2024-04-23T14:49:40.493 INFO:tasks.workunit.client.0.smithi081.stdout:9/420: dread d3/de/d22/f39 [0,4194304] 0 2024-04-23T14:49:40.498 INFO:tasks.workunit.client.0.smithi081.stdout:9/421: creat d3/de/d1d/d54/f89 x:0 0 0 2024-04-23T14:49:40.499 INFO:tasks.workunit.client.0.smithi081.stdout:9/422: fsync d3/de/d1d/d54/d68/f7e 0 2024-04-23T14:49:40.499 INFO:tasks.workunit.client.0.smithi081.stdout:9/423: write d3/d1a/d6c/f31 [4812138,119349] 0 2024-04-23T14:49:40.499 INFO:tasks.workunit.client.0.smithi081.stdout:9/424: chown d3/de/d25/c4c 142535591 1 2024-04-23T14:49:40.499 INFO:tasks.workunit.client.0.smithi081.stdout:9/425: creat d3/de/d1d/d54/d68/f8a x:0 0 0 2024-04-23T14:49:40.519 INFO:tasks.workunit.client.1.smithi156.stdout:1/35: dwrite f4 [0,4194304] 0 2024-04-23T14:49:40.585 INFO:tasks.workunit.client.1.smithi156.stdout:1/36: dwrite f4 [4194304,4194304] 0 2024-04-23T14:49:40.650 INFO:tasks.workunit.client.1.smithi156.stdout:1/37: dwrite f4 [4194304,4194304] 0 2024-04-23T14:49:40.678 INFO:tasks.workunit.client.1.smithi156.stdout:1/38: read f4 [6340118,49969] 0 2024-04-23T14:49:40.702 INFO:tasks.workunit.client.1.smithi156.stdout:1/39: dread f4 [4194304,4194304] 0 2024-04-23T14:49:40.728 INFO:tasks.workunit.client.1.smithi156.stdout:1/40: dread f4 [4194304,4194304] 0 2024-04-23T14:49:40.751 INFO:tasks.workunit.client.1.smithi156.stdout:5/17: rmdir d1 39 2024-04-23T14:49:40.751 INFO:tasks.workunit.client.1.smithi156.stdout:5/18: creat d1/d3/f6 x:0 0 0 2024-04-23T14:49:40.774 INFO:tasks.workunit.client.0.smithi081.stdout:8/579: unlink d3/d11/d4f/d66/cbc 0 2024-04-23T14:49:40.775 INFO:tasks.workunit.client.0.smithi081.stdout:8/580: write d3/d3c/f89 [681160,62787] 0 2024-04-23T14:49:40.778 INFO:tasks.workunit.client.0.smithi081.stdout:8/581: mkdir d3/dc6 0 2024-04-23T14:49:40.778 INFO:tasks.workunit.client.0.smithi081.stdout:8/582: creat d3/d11/d34/fc7 x:0 0 0 2024-04-23T14:49:40.778 INFO:tasks.workunit.client.0.smithi081.stdout:8/583: write d3/d11/d34/fb6 [39208,48556] 0 2024-04-23T14:49:40.778 INFO:tasks.workunit.client.0.smithi081.stdout:8/584: dread - d3/fba zero size 2024-04-23T14:49:40.784 INFO:tasks.workunit.client.0.smithi081.stdout:8/585: symlink d3/d11/d86/d88/da7/lc8 0 2024-04-23T14:49:40.785 INFO:tasks.workunit.client.0.smithi081.stdout:8/586: dread - d3/d11/d48/d7e/f9e zero size 2024-04-23T14:49:40.851 INFO:tasks.workunit.client.0.smithi081.stdout:8/587: dwrite d3/d11/d34/f40 [0,4194304] 0 2024-04-23T14:49:40.853 INFO:tasks.workunit.client.0.smithi081.stdout:8/588: creat d3/dc6/fc9 x:0 0 0 2024-04-23T14:49:40.921 INFO:tasks.workunit.client.0.smithi081.stdout:8/589: unlink d3/d11/d86/lc0 0 2024-04-23T14:49:41.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:40 smithi081 ceph-mon[25540]: pgmap v29: 65 pgs: 65 active+clean; 1.1 GiB data, 4.9 GiB used, 532 GiB / 536 GiB avail; 110 MiB/s rd, 123 MiB/s wr, 514 op/s 2024-04-23T14:49:41.207 INFO:tasks.workunit.client.0.smithi081.stdout:1/481: write d3/d3d/d41/d5e/d17/d58/f99 [5217958,74119] 0 2024-04-23T14:49:41.207 INFO:tasks.workunit.client.0.smithi081.stdout:1/482: chown d3/d3d/d41/d5e/d12/f54 23 1 2024-04-23T14:49:41.272 INFO:tasks.workunit.client.0.smithi081.stdout:1/483: dwrite d3/d3d/d41/d5e/d12/d2e/f8b [0,4194304] 0 2024-04-23T14:49:41.272 INFO:tasks.workunit.client.0.smithi081.stdout:1/484: write d3/d3d/d41/f42 [886950,114082] 0 2024-04-23T14:49:41.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:40 smithi156 ceph-mon[32341]: pgmap v29: 65 pgs: 65 active+clean; 1.1 GiB data, 4.9 GiB used, 532 GiB / 536 GiB avail; 110 MiB/s rd, 123 MiB/s wr, 514 op/s 2024-04-23T14:49:41.291 INFO:tasks.workunit.client.0.smithi081.stdout:2/427: rename d1/d11/d21/d22 to d1/d33/d45/d6e/d96 0 2024-04-23T14:49:41.297 INFO:tasks.workunit.client.0.smithi081.stdout:3/327: rename d4/dc/f5c to d4/d7/f6f 0 2024-04-23T14:49:41.300 INFO:tasks.workunit.client.0.smithi081.stdout:2/428: getdents d1/d11 0 2024-04-23T14:49:41.304 INFO:tasks.workunit.client.0.smithi081.stdout:3/328: unlink d4/dc/f28 0 2024-04-23T14:49:41.311 INFO:tasks.workunit.client.0.smithi081.stdout:0/470: rename d6/d37/d4d/l56 to d6/d11/d14/d41/d5b/d3f/d44/d76/l8d 0 2024-04-23T14:49:41.311 INFO:tasks.workunit.client.0.smithi081.stdout:0/471: fdatasync d6/f10 0 2024-04-23T14:49:41.311 INFO:tasks.workunit.client.0.smithi081.stdout:2/429: stat d1/d11/c18 0 2024-04-23T14:49:41.315 INFO:tasks.workunit.client.0.smithi081.stdout:3/329: symlink d4/d7/df/d30/d64/l70 0 2024-04-23T14:49:41.315 INFO:tasks.workunit.client.0.smithi081.stdout:3/330: chown l1 2751830 1 2024-04-23T14:49:41.319 INFO:tasks.workunit.client.0.smithi081.stdout:4/328: rename d1/d4/dc/f34 to d1/d4/f74 0 2024-04-23T14:49:41.319 INFO:tasks.workunit.client.0.smithi081.stdout:4/329: write d1/d1d/d59/f65 [170281,23543] 0 2024-04-23T14:49:41.319 INFO:tasks.workunit.client.0.smithi081.stdout:0/472: truncate d6/f9 256317 0 2024-04-23T14:49:41.320 INFO:tasks.workunit.client.0.smithi081.stdout:1/485: dwrite f0 [0,4194304] 0 2024-04-23T14:49:41.320 INFO:tasks.workunit.client.0.smithi081.stdout:1/486: dread - d3/d3d/d41/d5e/d17/d25/f74 zero size 2024-04-23T14:49:41.324 INFO:tasks.workunit.client.0.smithi081.stdout:3/331: mkdir d4/d7/d1a/d71 0 2024-04-23T14:49:41.328 INFO:tasks.workunit.client.0.smithi081.stdout:0/473: write d6/d37/d4d/d71/f72 [397427,106686] 0 2024-04-23T14:49:41.331 INFO:tasks.workunit.client.0.smithi081.stdout:4/330: truncate d1/d3/f8 605681 0 2024-04-23T14:49:41.338 INFO:tasks.workunit.client.0.smithi081.stdout:2/430: dread d1/d33/d45/f4d [0,4194304] 0 2024-04-23T14:49:41.344 INFO:tasks.workunit.client.0.smithi081.stdout:0/474: mkdir d6/d11/d14/d41/d5b/d59/d8e 0 2024-04-23T14:49:41.344 INFO:tasks.workunit.client.0.smithi081.stdout:0/475: write d6/d11/d14/d41/d5b/d3f/d44/f86 [50529,69765] 0 2024-04-23T14:49:41.346 INFO:tasks.workunit.client.0.smithi081.stdout:4/331: mkdir d1/d4/d11/d75 0 2024-04-23T14:49:41.348 INFO:tasks.workunit.client.0.smithi081.stdout:4/332: creat d1/d4/f76 x:0 0 0 2024-04-23T14:49:41.357 INFO:tasks.workunit.client.0.smithi081.stdout:3/332: dread d4/d7/df/f27 [0,4194304] 0 2024-04-23T14:49:41.361 INFO:tasks.workunit.client.0.smithi081.stdout:0/476: fsync d6/d37/f7e 0 2024-04-23T14:49:41.374 INFO:tasks.workunit.client.0.smithi081.stdout:4/333: getdents d1 0 2024-04-23T14:49:41.394 INFO:tasks.workunit.client.0.smithi081.stdout:3/333: dread d4/dc/f55 [0,4194304] 0 2024-04-23T14:49:41.403 INFO:tasks.workunit.client.0.smithi081.stdout:0/477: dread d6/d37/f60 [0,4194304] 0 2024-04-23T14:49:41.407 INFO:tasks.workunit.client.0.smithi081.stdout:0/478: creat d6/d11/d14/d41/d5b/d3f/d44/f8f x:0 0 0 2024-04-23T14:49:41.407 INFO:tasks.workunit.client.0.smithi081.stdout:0/479: chown d6/d11/d14/d41/d5b/f47 12 1 2024-04-23T14:49:41.410 INFO:tasks.workunit.client.0.smithi081.stdout:0/480: truncate d6/d11/d14/d41/f43 4337695 0 2024-04-23T14:49:41.410 INFO:tasks.workunit.client.0.smithi081.stdout:0/481: chown d6/d11/d14/d41/l7c 90572971 1 2024-04-23T14:49:41.418 INFO:tasks.workunit.client.0.smithi081.stdout:0/482: creat d6/d37/d67/d7d/f90 x:0 0 0 2024-04-23T14:49:41.418 INFO:tasks.workunit.client.0.smithi081.stdout:0/483: chown d6/d37/d67 1400682989 1 2024-04-23T14:49:41.433 INFO:tasks.workunit.client.0.smithi081.stdout:4/334: dwrite d1/d4/d11/f43 [0,4194304] 0 2024-04-23T14:49:41.433 INFO:tasks.workunit.client.0.smithi081.stdout:4/335: fsync d1/d4/f5d 0 2024-04-23T14:49:41.456 INFO:tasks.workunit.client.0.smithi081.stdout:0/484: dread d6/d25/f32 [0,4194304] 0 2024-04-23T14:49:41.466 INFO:tasks.workunit.client.0.smithi081.stdout:0/485: dread d6/d25/f51 [0,4194304] 0 2024-04-23T14:49:41.490 INFO:tasks.workunit.client.0.smithi081.stdout:4/336: dwrite d1/d1d/d59/f65 [0,4194304] 0 2024-04-23T14:49:41.490 INFO:tasks.workunit.client.0.smithi081.stdout:0/486: dread d6/d11/d14/f54 [0,4194304] 0 2024-04-23T14:49:41.491 INFO:tasks.workunit.client.0.smithi081.stdout:4/337: write d1/d1d/f51 [491493,37269] 0 2024-04-23T14:49:41.524 INFO:tasks.workunit.client.0.smithi081.stdout:4/338: dwrite d1/d1d/f22 [0,4194304] 0 2024-04-23T14:49:41.524 INFO:tasks.workunit.client.0.smithi081.stdout:4/339: fdatasync d1/d1d/d39/f53 0 2024-04-23T14:49:41.525 INFO:tasks.workunit.client.0.smithi081.stdout:4/340: fdatasync d1/d1d/d39/f3b 0 2024-04-23T14:49:41.525 INFO:tasks.workunit.client.0.smithi081.stdout:4/341: write d1/d4/f68 [825019,47298] 0 2024-04-23T14:49:41.647 INFO:tasks.workunit.client.1.smithi156.stdout:0/16: rename d0/d1 to d0/d4 0 2024-04-23T14:49:41.647 INFO:tasks.workunit.client.1.smithi156.stdout:0/17: readlink - no filename 2024-04-23T14:49:41.647 INFO:tasks.workunit.client.1.smithi156.stdout:0/18: chown d0/d4/f3 180678396 1 2024-04-23T14:49:41.647 INFO:tasks.workunit.client.1.smithi156.stdout:0/19: fdatasync d0/d4/f2 0 2024-04-23T14:49:41.647 INFO:tasks.workunit.client.1.smithi156.stdout:0/20: dread - d0/d4/f3 zero size 2024-04-23T14:49:41.647 INFO:tasks.workunit.client.1.smithi156.stdout:0/21: dread - d0/d4/f2 zero size 2024-04-23T14:49:41.950 INFO:tasks.workunit.client.1.smithi156.stdout:8/12: rename l1 to l3 0 2024-04-23T14:49:41.952 INFO:tasks.workunit.client.1.smithi156.stdout:9/4: unlink f0 0 2024-04-23T14:49:41.955 INFO:tasks.workunit.client.1.smithi156.stdout:4/19: mkdir d0/d8 0 2024-04-23T14:49:42.002 INFO:tasks.workunit.client.1.smithi156.stdout:7/23: rename f1 to f5 0 2024-04-23T14:49:42.003 INFO:tasks.workunit.client.1.smithi156.stdout:2/17: getdents . 0 2024-04-23T14:49:42.007 INFO:tasks.workunit.client.1.smithi156.stdout:1/41: rename l2 to l5 0 2024-04-23T14:49:42.007 INFO:tasks.workunit.client.1.smithi156.stdout:5/19: symlink d1/d3/l7 0 2024-04-23T14:49:42.008 INFO:tasks.workunit.client.1.smithi156.stdout:8/13: mknod c4 0 2024-04-23T14:49:42.009 INFO:tasks.workunit.client.1.smithi156.stdout:9/5: mkdir d1 0 2024-04-23T14:49:42.012 INFO:tasks.workunit.client.1.smithi156.stdout:4/20: link d0/c7 d0/c9 0 2024-04-23T14:49:42.012 INFO:tasks.workunit.client.1.smithi156.stdout:4/21: write d0/f3 [704187,91183] 0 2024-04-23T14:49:42.013 INFO:tasks.workunit.client.1.smithi156.stdout:5/20: stat l0 0 2024-04-23T14:49:42.015 INFO:tasks.workunit.client.1.smithi156.stdout:8/14: mkdir d5 0 2024-04-23T14:49:42.015 INFO:tasks.workunit.client.1.smithi156.stdout:9/6: mkdir d1/d2 0 2024-04-23T14:49:42.015 INFO:tasks.workunit.client.1.smithi156.stdout:9/7: fsync - no filename 2024-04-23T14:49:42.015 INFO:tasks.workunit.client.1.smithi156.stdout:9/8: read - no filename 2024-04-23T14:49:42.015 INFO:tasks.workunit.client.1.smithi156.stdout:9/9: truncate - no filename 2024-04-23T14:49:42.015 INFO:tasks.workunit.client.1.smithi156.stdout:9/10: unlink - no file 2024-04-23T14:49:42.016 INFO:tasks.workunit.client.1.smithi156.stdout:9/11: readlink - no filename 2024-04-23T14:49:42.018 INFO:tasks.workunit.client.1.smithi156.stdout:4/22: mknod d0/ca 0 2024-04-23T14:49:42.019 INFO:tasks.workunit.client.1.smithi156.stdout:7/24: dread f5 [0,4194304] 0 2024-04-23T14:49:42.020 INFO:tasks.workunit.client.1.smithi156.stdout:8/15: rename f2 to d5/f6 0 2024-04-23T14:49:42.020 INFO:tasks.workunit.client.1.smithi156.stdout:9/12: rename d1/d2 to d1/d2/d3 22 2024-04-23T14:49:42.020 INFO:tasks.workunit.client.1.smithi156.stdout:9/13: fdatasync - no filename 2024-04-23T14:49:42.021 INFO:tasks.workunit.client.1.smithi156.stdout:4/23: link d0/f2 d0/d8/fb 0 2024-04-23T14:49:42.023 INFO:tasks.workunit.client.1.smithi156.stdout:8/16: rename c4 to d5/c7 0 2024-04-23T14:49:42.023 INFO:tasks.workunit.client.1.smithi156.stdout:8/17: fdatasync d5/f6 0 2024-04-23T14:49:42.024 INFO:tasks.workunit.client.1.smithi156.stdout:9/14: mkdir d1/d2/d4 0 2024-04-23T14:49:42.024 INFO:tasks.workunit.client.1.smithi156.stdout:9/15: readlink - no filename 2024-04-23T14:49:42.027 INFO:tasks.workunit.client.1.smithi156.stdout:9/16: mknod d1/d2/d4/c5 0 2024-04-23T14:49:42.027 INFO:tasks.workunit.client.1.smithi156.stdout:9/17: dread - no filename 2024-04-23T14:49:42.028 INFO:tasks.workunit.client.1.smithi156.stdout:9/18: unlink d1/d2/d4/c5 0 2024-04-23T14:49:42.030 INFO:tasks.workunit.client.1.smithi156.stdout:9/19: mknod d1/d2/c6 0 2024-04-23T14:49:42.031 INFO:tasks.workunit.client.1.smithi156.stdout:9/20: dread - no filename 2024-04-23T14:49:42.031 INFO:tasks.workunit.client.1.smithi156.stdout:9/21: stat d1/d2 0 2024-04-23T14:49:42.036 INFO:tasks.workunit.client.1.smithi156.stdout:7/25: dread f5 [0,4194304] 0 2024-04-23T14:49:42.037 INFO:tasks.workunit.client.1.smithi156.stdout:7/26: chown l0 119 1 2024-04-23T14:49:42.060 INFO:tasks.workunit.client.1.smithi156.stdout:5/21: dread d1/d3/f5 [0,4194304] 0 2024-04-23T14:49:42.060 INFO:tasks.workunit.client.1.smithi156.stdout:5/22: creat d1/d3/f8 x:0 0 0 2024-04-23T14:49:42.067 INFO:tasks.workunit.client.1.smithi156.stdout:5/23: rename d1/d3/f6 to d1/f9 0 2024-04-23T14:49:42.070 INFO:tasks.workunit.client.1.smithi156.stdout:5/24: unlink d1/d3/f8 0 2024-04-23T14:49:42.089 INFO:tasks.workunit.client.0.smithi081.stdout:5/392: rename d17/d3d/c53 to d17/c89 0 2024-04-23T14:49:42.091 INFO:tasks.workunit.client.0.smithi081.stdout:8/590: rename d3/d11/d48/l7d to d3/d11/d34/dab/lca 0 2024-04-23T14:49:42.091 INFO:tasks.workunit.client.0.smithi081.stdout:8/591: chown d3/d3c/cb0 33348 1 2024-04-23T14:49:42.094 INFO:tasks.workunit.client.0.smithi081.stdout:4/342: rename d1/d4/l33 to d1/d4/d6f/l77 0 2024-04-23T14:49:42.094 INFO:tasks.workunit.client.0.smithi081.stdout:4/343: write d1/d3/f71 [740324,103886] 0 2024-04-23T14:49:42.104 INFO:tasks.workunit.client.0.smithi081.stdout:5/393: dread d17/d3d/f49 [0,4194304] 0 2024-04-23T14:49:42.106 INFO:tasks.workunit.client.0.smithi081.stdout:5/394: getdents d17/d4f 0 2024-04-23T14:49:42.106 INFO:tasks.workunit.client.0.smithi081.stdout:5/395: readlink l10 0 2024-04-23T14:49:42.106 INFO:tasks.workunit.client.0.smithi081.stdout:5/396: stat d17/l47 0 2024-04-23T14:49:42.108 INFO:tasks.workunit.client.0.smithi081.stdout:5/397: symlink d17/d4f/d61/l8a 0 2024-04-23T14:49:42.111 INFO:tasks.workunit.client.0.smithi081.stdout:5/398: unlink d17/d4f/d61/f6c 0 2024-04-23T14:49:42.113 INFO:tasks.workunit.client.0.smithi081.stdout:5/399: mknod d17/c8b 0 2024-04-23T14:49:42.115 INFO:tasks.workunit.client.0.smithi081.stdout:5/400: creat d17/d4a/f8c x:0 0 0 2024-04-23T14:49:42.134 INFO:tasks.workunit.client.1.smithi156.stdout:2/18: dwrite f0 [0,4194304] 0 2024-04-23T14:49:42.145 INFO:tasks.workunit.client.0.smithi081.stdout:6/362: sync 2024-04-23T14:49:42.145 INFO:tasks.workunit.client.0.smithi081.stdout:7/316: sync 2024-04-23T14:49:42.145 INFO:tasks.workunit.client.0.smithi081.stdout:6/363: chown d1/d51/d65/d8 1 1 2024-04-23T14:49:42.145 INFO:tasks.workunit.client.0.smithi081.stdout:7/317: mknod d3/d20/c66 0 2024-04-23T14:49:42.175 INFO:tasks.workunit.client.0.smithi081.stdout:4/344: dwrite d1/fa [8388608,4194304] 0 2024-04-23T14:49:42.176 INFO:tasks.workunit.client.0.smithi081.stdout:4/345: chown d1/d1d/f42 5823916 1 2024-04-23T14:49:42.176 INFO:tasks.workunit.client.0.smithi081.stdout:4/346: chown d1/d4/d11/f6d 24020 1 2024-04-23T14:49:42.176 INFO:tasks.workunit.client.0.smithi081.stdout:4/347: read - d1/f1e zero size 2024-04-23T14:49:42.182 INFO:tasks.workunit.client.0.smithi081.stdout:4/348: dread d1/d1d/d39/f53 [0,4194304] 0 2024-04-23T14:49:42.182 INFO:tasks.workunit.client.0.smithi081.stdout:4/349: chown d1/d1d/d39/f3b 3605752 1 2024-04-23T14:49:42.182 INFO:tasks.workunit.client.0.smithi081.stdout:4/350: fsync d1/fa 0 2024-04-23T14:49:42.182 INFO:tasks.workunit.client.0.smithi081.stdout:6/364: dwrite d1/d51/d65/d13/f4e [0,4194304] 0 2024-04-23T14:49:42.183 INFO:tasks.workunit.client.0.smithi081.stdout:6/365: write d1/d51/d65/d13/d16/f1e [2900179,96776] 0 2024-04-23T14:49:42.185 INFO:tasks.workunit.client.0.smithi081.stdout:6/366: mknod d1/d51/d65/d1c/c85 0 2024-04-23T14:49:42.186 INFO:tasks.workunit.client.0.smithi081.stdout:6/367: creat d1/d51/d65/f86 x:0 0 0 2024-04-23T14:49:42.212 INFO:tasks.workunit.client.0.smithi081.stdout:0/487: creat d6/d11/d14/f91 x:0 0 0 2024-04-23T14:49:42.212 INFO:tasks.workunit.client.0.smithi081.stdout:0/488: write d6/d37/f38 [1998496,67467] 0 2024-04-23T14:49:42.222 INFO:tasks.workunit.client.0.smithi081.stdout:0/489: dread d6/d11/d14/d41/d5b/f3e [0,4194304] 0 2024-04-23T14:49:42.222 INFO:tasks.workunit.client.0.smithi081.stdout:0/490: chown d6/d11/d14/d41/d5b/f3d 420593568 1 2024-04-23T14:49:42.222 INFO:tasks.workunit.client.0.smithi081.stdout:0/491: truncate d6/f4f 2980843 0 2024-04-23T14:49:42.224 INFO:tasks.workunit.client.0.smithi081.stdout:0/492: creat d6/d37/d67/f92 x:0 0 0 2024-04-23T14:49:42.225 INFO:tasks.workunit.client.0.smithi081.stdout:0/493: read d6/f2d [27032,26417] 0 2024-04-23T14:49:42.226 INFO:tasks.workunit.client.0.smithi081.stdout:0/494: rename d6/d11/d14/d24/f57 to d6/d11/d14/d41/d5b/d59/d8e/f93 0 2024-04-23T14:49:42.228 INFO:tasks.workunit.client.0.smithi081.stdout:0/495: creat d6/d37/d67/d7d/f94 x:0 0 0 2024-04-23T14:49:42.229 INFO:tasks.workunit.client.0.smithi081.stdout:0/496: mknod d6/d11/d14/d41/d5b/d3f/d44/d78/c95 0 2024-04-23T14:49:42.230 INFO:tasks.workunit.client.0.smithi081.stdout:0/497: symlink d6/d11/d14/d41/d5b/d59/d8e/l96 0 2024-04-23T14:49:42.234 INFO:tasks.workunit.client.0.smithi081.stdout:9/426: rmdir d3/de/d1d/d54 39 2024-04-23T14:49:42.239 INFO:tasks.workunit.client.1.smithi156.stdout:4/24: dwrite d0/f6 [0,4194304] 0 2024-04-23T14:49:42.262 INFO:tasks.workunit.client.0.smithi081.stdout:8/592: dwrite d3/d11/d4f/f65 [0,4194304] 0 2024-04-23T14:49:42.263 INFO:tasks.workunit.client.0.smithi081.stdout:8/593: getdents d3/d1a 0 2024-04-23T14:49:42.266 INFO:tasks.workunit.client.1.smithi156.stdout:5/25: dwrite d1/f9 [0,4194304] 0 2024-04-23T14:49:42.266 INFO:tasks.workunit.client.1.smithi156.stdout:5/26: creat d1/d3/fa x:0 0 0 2024-04-23T14:49:42.275 INFO:tasks.workunit.client.0.smithi081.stdout:5/401: dwrite d17/d37/f6e [0,4194304] 0 2024-04-23T14:49:42.275 INFO:tasks.workunit.client.0.smithi081.stdout:5/402: fsync d17/d1f/f25 0 2024-04-23T14:49:42.275 INFO:tasks.workunit.client.0.smithi081.stdout:5/403: chown d17/d1f/d36/f43 4665 1 2024-04-23T14:49:42.275 INFO:tasks.workunit.client.0.smithi081.stdout:5/404: chown d17/d18/c27 278844089 1 2024-04-23T14:49:42.276 INFO:tasks.workunit.client.1.smithi156.stdout:2/19: dwrite f2 [0,4194304] 0 2024-04-23T14:49:42.276 INFO:tasks.workunit.client.1.smithi156.stdout:2/20: fsync f0 0 2024-04-23T14:49:42.276 INFO:tasks.workunit.client.1.smithi156.stdout:2/21: fsync f2 0 2024-04-23T14:49:42.278 INFO:tasks.workunit.client.0.smithi081.stdout:6/368: dwrite d1/d51/d65/f4f [4194304,4194304] 0 2024-04-23T14:49:42.278 INFO:tasks.workunit.client.0.smithi081.stdout:6/369: chown d1/d51/d65/f6a 36047 1 2024-04-23T14:49:42.278 INFO:tasks.workunit.client.0.smithi081.stdout:6/370: write d1/d51/d65/d13/d16/f1e [2921020,58013] 0 2024-04-23T14:49:42.281 INFO:tasks.workunit.client.1.smithi156.stdout:2/22: symlink l3 0 2024-04-23T14:49:42.281 INFO:tasks.workunit.client.1.smithi156.stdout:2/23: fdatasync f0 0 2024-04-23T14:49:42.282 INFO:tasks.workunit.client.0.smithi081.stdout:4/351: dwrite d1/d1d/f3f [0,4194304] 0 2024-04-23T14:49:42.282 INFO:tasks.workunit.client.0.smithi081.stdout:4/352: truncate d1/d1d/f30 530126 0 2024-04-23T14:49:42.284 INFO:tasks.workunit.client.0.smithi081.stdout:4/353: creat d1/d4/dc/f78 x:0 0 0 2024-04-23T14:49:42.284 INFO:tasks.workunit.client.0.smithi081.stdout:4/354: fdatasync d1/d1d/f42 0 2024-04-23T14:49:42.284 INFO:tasks.workunit.client.0.smithi081.stdout:4/355: getdents d1/d4/d6f/d70 0 2024-04-23T14:49:42.284 INFO:tasks.workunit.client.0.smithi081.stdout:4/356: chown d1/d4/l13 40517810 1 2024-04-23T14:49:42.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:41 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:42.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:41 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:42.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:41 smithi156 ceph-mon[32341]: Reconfiguring grafana.smithi081 (dependencies changed)... 2024-04-23T14:49:42.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:41 smithi156 ceph-mon[32341]: Reconfiguring daemon grafana.smithi081 on smithi081 2024-04-23T14:49:42.287 INFO:tasks.workunit.client.0.smithi081.stdout:6/371: creat d1/d51/d7b/f87 x:0 0 0 2024-04-23T14:49:42.287 INFO:tasks.workunit.client.0.smithi081.stdout:6/372: write d1/d51/d65/d13/d16/f75 [591636,27750] 0 2024-04-23T14:49:42.292 INFO:tasks.workunit.client.1.smithi156.stdout:2/24: mkdir d4 0 2024-04-23T14:49:42.297 INFO:tasks.workunit.client.1.smithi156.stdout:2/25: link l3 d4/l5 0 2024-04-23T14:49:42.297 INFO:tasks.workunit.client.0.smithi081.stdout:6/373: dread d1/d51/f5d [0,4194304] 0 2024-04-23T14:49:42.298 INFO:tasks.workunit.client.1.smithi156.stdout:2/26: symlink d4/l6 0 2024-04-23T14:49:42.300 INFO:tasks.workunit.client.0.smithi081.stdout:9/427: dwrite d3/f9 [0,4194304] 0 2024-04-23T14:49:42.300 INFO:tasks.workunit.client.0.smithi081.stdout:6/374: truncate d1/d2/f6d 2196248 0 2024-04-23T14:49:42.301 INFO:tasks.workunit.client.1.smithi156.stdout:2/27: stat l3 0 2024-04-23T14:49:42.301 INFO:tasks.workunit.client.1.smithi156.stdout:2/28: chown d4 79378480 1 2024-04-23T14:49:42.301 INFO:tasks.workunit.client.1.smithi156.stdout:2/29: truncate f0 5112145 0 2024-04-23T14:49:42.304 INFO:tasks.workunit.client.0.smithi081.stdout:9/428: rename d3/de/d47/l85 to d3/de/d1d/d5b/d7b/l8b 0 2024-04-23T14:49:42.308 INFO:tasks.workunit.client.1.smithi156.stdout:2/30: link f0 d4/f7 0 2024-04-23T14:49:42.310 INFO:tasks.workunit.client.1.smithi156.stdout:2/31: creat d4/f8 x:0 0 0 2024-04-23T14:49:42.311 INFO:tasks.workunit.client.0.smithi081.stdout:6/375: mknod d1/d51/d65/d8/d2e/d59/c88 0 2024-04-23T14:49:42.312 INFO:tasks.workunit.client.0.smithi081.stdout:6/376: symlink d1/d51/d65/d13/d46/l89 0 2024-04-23T14:49:42.315 INFO:tasks.workunit.client.0.smithi081.stdout:6/377: link d1/d51/d65/c50 d1/d51/d65/d8/d2e/d58/c8a 0 2024-04-23T14:49:42.318 INFO:tasks.workunit.client.0.smithi081.stdout:6/378: unlink d1/d2/d49/d52/d5f/l69 0 2024-04-23T14:49:42.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:41 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:42.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:41 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:49:42.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:41 smithi081 ceph-mon[25540]: Reconfiguring grafana.smithi081 (dependencies changed)... 2024-04-23T14:49:42.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:41 smithi081 ceph-mon[25540]: Reconfiguring daemon grafana.smithi081 on smithi081 2024-04-23T14:49:42.333 INFO:tasks.workunit.client.0.smithi081.stdout:4/357: dwrite d1/d1d/f22 [0,4194304] 0 2024-04-23T14:49:42.367 INFO:tasks.workunit.client.0.smithi081.stdout:5/405: dwrite d17/d3c/d55/f7d [0,4194304] 0 2024-04-23T14:49:42.367 INFO:tasks.workunit.client.0.smithi081.stdout:5/406: dread - d17/d3c/f88 zero size 2024-04-23T14:49:42.367 INFO:tasks.workunit.client.0.smithi081.stdout:5/407: dread - d17/d3d/f51 zero size 2024-04-23T14:49:42.367 INFO:tasks.workunit.client.0.smithi081.stdout:5/408: creat d17/d4f/d61/f8d x:0 0 0 2024-04-23T14:49:42.368 INFO:tasks.workunit.client.1.smithi156.stdout:5/27: dwrite d1/d3/f5 [4194304,4194304] 0 2024-04-23T14:49:42.370 INFO:tasks.workunit.client.0.smithi081.stdout:9/429: dwrite f1 [4194304,4194304] 0 2024-04-23T14:49:42.371 INFO:tasks.workunit.client.0.smithi081.stdout:5/409: mkdir d17/d18/d3a/d8e 0 2024-04-23T14:49:42.371 INFO:tasks.workunit.client.0.smithi081.stdout:5/410: fsync d17/d3c/d55/f7d 0 2024-04-23T14:49:42.373 INFO:tasks.workunit.client.0.smithi081.stdout:9/430: mkdir d3/de/d25/d8c 0 2024-04-23T14:49:42.377 INFO:tasks.workunit.client.0.smithi081.stdout:4/358: dread d1/d1d/d59/f65 [0,4194304] 0 2024-04-23T14:49:42.377 INFO:tasks.workunit.client.0.smithi081.stdout:4/359: chown d1/d4f 105 1 2024-04-23T14:49:42.377 INFO:tasks.workunit.client.0.smithi081.stdout:9/431: truncate d3/f8 5598625 0 2024-04-23T14:49:42.377 INFO:tasks.workunit.client.0.smithi081.stdout:4/360: creat d1/d4/d11/f79 x:0 0 0 2024-04-23T14:49:42.385 INFO:tasks.workunit.client.0.smithi081.stdout:6/379: dwrite d1/d51/f5d [0,4194304] 0 2024-04-23T14:49:42.385 INFO:tasks.workunit.client.0.smithi081.stdout:6/380: write d1/d51/d65/d1c/f3b [2285072,113891] 0 2024-04-23T14:49:42.391 INFO:tasks.workunit.client.0.smithi081.stdout:6/381: mknod d1/d51/d65/d1c/d66/c8b 0 2024-04-23T14:49:42.392 INFO:tasks.workunit.client.0.smithi081.stdout:6/382: creat d1/d51/d54/f8c x:0 0 0 2024-04-23T14:49:42.392 INFO:tasks.workunit.client.0.smithi081.stdout:6/383: write d1/d2/f21 [1665907,37604] 0 2024-04-23T14:49:42.392 INFO:tasks.workunit.client.0.smithi081.stdout:6/384: chown d1/d51/d65/f6a 225564431 1 2024-04-23T14:49:42.397 INFO:tasks.workunit.client.0.smithi081.stdout:5/411: dread d17/d18/f19 [4194304,4194304] 0 2024-04-23T14:49:42.397 INFO:tasks.workunit.client.0.smithi081.stdout:5/412: fsync d17/d65/f7e 0 2024-04-23T14:49:42.397 INFO:tasks.workunit.client.0.smithi081.stdout:5/413: truncate d17/d3d/d41/f77 489125 0 2024-04-23T14:49:42.397 INFO:tasks.workunit.client.0.smithi081.stdout:9/432: dread d3/d1a/fc [0,4194304] 0 2024-04-23T14:49:42.397 INFO:tasks.workunit.client.0.smithi081.stdout:9/433: dread - d3/d1a/d6c/f58 zero size 2024-04-23T14:49:42.397 INFO:tasks.workunit.client.0.smithi081.stdout:9/434: chown d3/f4a 501844892 1 2024-04-23T14:49:42.397 INFO:tasks.workunit.client.0.smithi081.stdout:9/435: getdents d3/de/d25/d8c 0 2024-04-23T14:49:42.399 INFO:tasks.workunit.client.0.smithi081.stdout:9/436: mknod d3/c8d 0 2024-04-23T14:49:42.399 INFO:tasks.workunit.client.0.smithi081.stdout:9/437: stat d3/de/d1d/d54/l79 0 2024-04-23T14:49:42.420 INFO:tasks.workunit.client.0.smithi081.stdout:6/385: dread d1/d51/d65/d8/d2e/d59/f68 [0,4194304] 0 2024-04-23T14:49:42.432 INFO:tasks.workunit.client.0.smithi081.stdout:9/438: dread d3/de/d22/f39 [0,4194304] 0 2024-04-23T14:49:42.434 INFO:tasks.workunit.client.0.smithi081.stdout:9/439: creat d3/de/d25/f8e x:0 0 0 2024-04-23T14:49:42.434 INFO:tasks.workunit.client.0.smithi081.stdout:9/440: write d3/de/d1d/d54/d68/f7e [684029,68662] 0 2024-04-23T14:49:42.438 INFO:tasks.workunit.client.0.smithi081.stdout:9/441: write d3/d1a/d6c/f42 [5016749,46539] 0 2024-04-23T14:49:42.442 INFO:tasks.workunit.client.0.smithi081.stdout:5/414: dwrite d17/d18/f34 [0,4194304] 0 2024-04-23T14:49:42.443 INFO:tasks.workunit.client.0.smithi081.stdout:6/386: dread d1/d51/d65/d8/d2e/d58/f61 [0,4194304] 0 2024-04-23T14:49:42.447 INFO:tasks.workunit.client.0.smithi081.stdout:5/415: rename d17/d3d/d41/f77 to d17/d4a/f8f 0 2024-04-23T14:49:42.449 INFO:tasks.workunit.client.0.smithi081.stdout:6/387: creat d1/d51/d65/d8/d2e/d59/d80/f8d x:0 0 0 2024-04-23T14:49:42.450 INFO:tasks.workunit.client.0.smithi081.stdout:6/388: fdatasync d1/f17 0 2024-04-23T14:49:42.453 INFO:tasks.workunit.client.0.smithi081.stdout:5/416: creat d17/d18/d3a/d8e/f90 x:0 0 0 2024-04-23T14:49:42.457 INFO:tasks.workunit.client.0.smithi081.stdout:6/389: mkdir d1/d2/d8e 0 2024-04-23T14:49:42.458 INFO:tasks.workunit.client.0.smithi081.stdout:6/390: chown d1/d51/d65/d13/f3e 415801 1 2024-04-23T14:49:42.459 INFO:tasks.workunit.client.0.smithi081.stdout:5/417: rename d17/d18/l28 to d17/d37/d4e/l91 0 2024-04-23T14:49:42.462 INFO:tasks.workunit.client.0.smithi081.stdout:5/418: unlink d17/d1f/d36/d59/f79 0 2024-04-23T14:49:42.465 INFO:tasks.workunit.client.0.smithi081.stdout:5/419: symlink d17/d1f/d36/d59/l92 0 2024-04-23T14:49:42.471 INFO:tasks.workunit.client.0.smithi081.stdout:5/420: creat d17/d3d/d41/f93 x:0 0 0 2024-04-23T14:49:42.473 INFO:tasks.workunit.client.0.smithi081.stdout:5/421: mknod d17/d3d/c94 0 2024-04-23T14:49:42.499 INFO:tasks.workunit.client.0.smithi081.stdout:6/391: dread d1/d51/d65/d8/f2b [0,4194304] 0 2024-04-23T14:49:42.501 INFO:tasks.workunit.client.0.smithi081.stdout:6/392: rename d1/d2/d49/d52/f64 to d1/d2/f8f 0 2024-04-23T14:49:42.501 INFO:tasks.workunit.client.0.smithi081.stdout:6/393: truncate d1/d51/d65/d8/f41 4208528 0 2024-04-23T14:49:42.501 INFO:tasks.workunit.client.0.smithi081.stdout:6/394: dread - d1/d51/d65/d1c/f73 zero size 2024-04-23T14:49:42.505 INFO:tasks.workunit.client.0.smithi081.stdout:9/442: dwrite d3/d5/f6 [0,4194304] 0 2024-04-23T14:49:42.505 INFO:tasks.workunit.client.0.smithi081.stdout:9/443: chown d3/d1a/d6c 734836 1 2024-04-23T14:49:42.526 INFO:tasks.workunit.client.0.smithi081.stdout:6/395: dread d1/f2a [0,4194304] 0 2024-04-23T14:49:42.542 INFO:tasks.workunit.client.0.smithi081.stdout:6/396: dread d1/d51/d65/f43 [0,4194304] 0 2024-04-23T14:49:42.545 INFO:tasks.workunit.client.0.smithi081.stdout:6/397: mkdir d1/d51/d65/d8/d2e/d59/d80/d90 0 2024-04-23T14:49:42.545 INFO:tasks.workunit.client.0.smithi081.stdout:6/398: truncate d1/fe 1069810 0 2024-04-23T14:49:42.546 INFO:tasks.workunit.client.0.smithi081.stdout:6/399: mkdir d1/d51/d7b/d91 0 2024-04-23T14:49:42.555 INFO:tasks.workunit.client.0.smithi081.stdout:9/444: fdatasync d3/d1a/d6c/f42 0 2024-04-23T14:49:42.556 INFO:tasks.workunit.client.0.smithi081.stdout:5/422: dwrite d17/f2c [0,4194304] 0 2024-04-23T14:49:42.556 INFO:tasks.workunit.client.0.smithi081.stdout:5/423: fsync d17/d3c/f81 0 2024-04-23T14:49:42.556 INFO:tasks.workunit.client.0.smithi081.stdout:5/424: read - d17/d1f/f74 zero size 2024-04-23T14:49:42.566 INFO:tasks.workunit.client.0.smithi081.stdout:9/445: symlink d3/l8f 0 2024-04-23T14:49:42.606 INFO:tasks.workunit.client.1.smithi156.stdout:7/27: unlink f5 0 2024-04-23T14:49:42.606 INFO:tasks.workunit.client.1.smithi156.stdout:7/28: creat f6 x:0 0 0 2024-04-23T14:49:42.607 INFO:tasks.workunit.client.1.smithi156.stdout:7/29: readlink l0 0 2024-04-23T14:49:42.607 INFO:tasks.workunit.client.1.smithi156.stdout:7/30: truncate f6 1047715 0 2024-04-23T14:49:42.608 INFO:tasks.workunit.client.1.smithi156.stdout:3/23: truncate f1 4436708 0 2024-04-23T14:49:42.611 INFO:tasks.workunit.client.1.smithi156.stdout:8/18: rename d5/f6 to d5/f8 0 2024-04-23T14:49:42.611 INFO:tasks.workunit.client.1.smithi156.stdout:8/19: stat l0 0 2024-04-23T14:49:42.611 INFO:tasks.workunit.client.1.smithi156.stdout:1/42: truncate f4 5405441 0 2024-04-23T14:49:42.612 INFO:tasks.workunit.client.1.smithi156.stdout:4/25: rmdir d0 39 2024-04-23T14:49:42.612 INFO:tasks.workunit.client.1.smithi156.stdout:8/20: write d5/f8 [188383,123809] 0 2024-04-23T14:49:42.612 INFO:tasks.workunit.client.1.smithi156.stdout:4/26: write d0/f2 [2011475,73965] 0 2024-04-23T14:49:42.612 INFO:tasks.workunit.client.1.smithi156.stdout:4/27: write d0/f3 [1392919,41205] 0 2024-04-23T14:49:42.613 INFO:tasks.workunit.client.1.smithi156.stdout:7/31: symlink l7 0 2024-04-23T14:49:42.613 INFO:tasks.workunit.client.1.smithi156.stdout:7/32: chown l4 22 1 2024-04-23T14:49:42.616 INFO:tasks.workunit.client.1.smithi156.stdout:4/28: unlink d0/f6 0 2024-04-23T14:49:42.617 INFO:tasks.workunit.client.1.smithi156.stdout:4/29: rename d0/d8/fb to d0/d8/fc 0 2024-04-23T14:49:42.621 INFO:tasks.workunit.client.0.smithi081.stdout:5/425: dwrite d17/d1f/d42/f50 [4194304,4194304] 0 2024-04-23T14:49:42.621 INFO:tasks.workunit.client.0.smithi081.stdout:5/426: rename d17/d1f/d42 to d17/d1f/d42/d95 22 2024-04-23T14:49:42.621 INFO:tasks.workunit.client.0.smithi081.stdout:8/594: mknod d3/d11/d4f/ccb 0 2024-04-23T14:49:42.621 INFO:tasks.workunit.client.0.smithi081.stdout:8/595: stat d3/d11/d3e/d63/c7a 0 2024-04-23T14:49:42.623 INFO:tasks.workunit.client.0.smithi081.stdout:5/427: symlink d17/d3d/d7a/l96 0 2024-04-23T14:49:42.625 INFO:tasks.workunit.client.0.smithi081.stdout:5/428: creat d17/d1f/d42/f97 x:0 0 0 2024-04-23T14:49:42.626 INFO:tasks.workunit.client.0.smithi081.stdout:8/596: truncate d3/d11/d34/d8b/fa6 936906 0 2024-04-23T14:49:42.626 INFO:tasks.workunit.client.0.smithi081.stdout:8/597: truncate d3/d11/d86/d88/fbe 635834 0 2024-04-23T14:49:42.626 INFO:tasks.workunit.client.0.smithi081.stdout:8/598: fsync d3/d11/d3e/f5d 0 2024-04-23T14:49:42.636 INFO:tasks.workunit.client.0.smithi081.stdout:8/599: mknod d3/d11/d3e/d63/d78/da0/ccc 0 2024-04-23T14:49:42.640 INFO:tasks.workunit.client.0.smithi081.stdout:3/334: creat d4/d7/df/f72 x:0 0 0 2024-04-23T14:49:42.642 INFO:tasks.workunit.client.0.smithi081.stdout:3/335: unlink d4/d7/d49/d38/f3a 0 2024-04-23T14:49:42.642 INFO:tasks.workunit.client.0.smithi081.stdout:3/336: readlink d4/dc/l2d 0 2024-04-23T14:49:42.642 INFO:tasks.workunit.client.0.smithi081.stdout:3/337: truncate d4/d7/d49/d38/f65 482475 0 2024-04-23T14:49:42.643 INFO:tasks.workunit.client.0.smithi081.stdout:4/361: mkdir d1/d7a 0 2024-04-23T14:49:42.645 INFO:tasks.workunit.client.0.smithi081.stdout:3/338: creat d4/d7/d49/d51/d53/d6c/f73 x:0 0 0 2024-04-23T14:49:42.662 INFO:tasks.workunit.client.1.smithi156.stdout:5/28: truncate d1/f9 533709 0 2024-04-23T14:49:42.664 INFO:tasks.workunit.client.1.smithi156.stdout:5/29: rmdir d1 39 2024-04-23T14:49:42.671 INFO:tasks.workunit.client.0.smithi081.stdout:4/362: getdents d1/d4/dc 0 2024-04-23T14:49:42.676 INFO:tasks.workunit.client.1.smithi156.stdout:6/3: sync 2024-04-23T14:49:42.677 INFO:tasks.workunit.client.1.smithi156.stdout:6/4: write - no filename 2024-04-23T14:49:42.677 INFO:tasks.workunit.client.1.smithi156.stdout:6/5: readlink l0 0 2024-04-23T14:49:42.677 INFO:tasks.workunit.client.1.smithi156.stdout:6/6: fdatasync - no filename 2024-04-23T14:49:42.677 INFO:tasks.workunit.client.1.smithi156.stdout:6/7: write - no filename 2024-04-23T14:49:42.683 INFO:tasks.workunit.client.1.smithi156.stdout:6/8: rename l0 to l1 0 2024-04-23T14:49:42.683 INFO:tasks.workunit.client.1.smithi156.stdout:6/9: fdatasync - no filename 2024-04-23T14:49:42.688 INFO:tasks.workunit.client.1.smithi156.stdout:6/10: symlink l2 0 2024-04-23T14:49:42.690 INFO:tasks.workunit.client.1.smithi156.stdout:6/11: mkdir d3 0 2024-04-23T14:49:42.691 INFO:tasks.workunit.client.1.smithi156.stdout:6/12: fsync - no filename 2024-04-23T14:49:42.694 INFO:tasks.workunit.client.1.smithi156.stdout:6/13: stat l1 0 2024-04-23T14:49:42.694 INFO:tasks.workunit.client.1.smithi156.stdout:6/14: dwrite - no filename 2024-04-23T14:49:42.694 INFO:tasks.workunit.client.1.smithi156.stdout:6/15: write - no filename 2024-04-23T14:49:42.694 INFO:tasks.workunit.client.1.smithi156.stdout:6/16: stat d3 0 2024-04-23T14:49:42.694 INFO:tasks.workunit.client.1.smithi156.stdout:6/17: chown l2 791573942 1 2024-04-23T14:49:42.694 INFO:tasks.workunit.client.1.smithi156.stdout:6/18: rename d3 to d3/d4 22 2024-04-23T14:49:42.694 INFO:tasks.workunit.client.1.smithi156.stdout:6/19: chown l1 6008777 1 2024-04-23T14:49:42.695 INFO:tasks.workunit.client.0.smithi081.stdout:8/600: dwrite d3/f31 [0,4194304] 0 2024-04-23T14:49:42.698 INFO:tasks.workunit.client.0.smithi081.stdout:8/601: mknod d3/d1a/ccd 0 2024-04-23T14:49:42.710 INFO:tasks.workunit.client.0.smithi081.stdout:9/446: write d3/f8 [3432144,18482] 0 2024-04-23T14:49:42.711 INFO:tasks.workunit.client.0.smithi081.stdout:6/400: truncate d1/d2/f21 983800 0 2024-04-23T14:49:42.713 INFO:tasks.workunit.client.0.smithi081.stdout:9/447: getdents d3/de/d14 0 2024-04-23T14:49:42.716 INFO:tasks.workunit.client.0.smithi081.stdout:6/401: symlink d1/d2/d8e/l92 0 2024-04-23T14:49:42.716 INFO:tasks.workunit.client.0.smithi081.stdout:6/402: readlink d1/d51/d65/d8/l4a 0 2024-04-23T14:49:42.719 INFO:tasks.workunit.client.0.smithi081.stdout:9/448: rename d3/d1a/d6c/d71 to d3/de/d1d/d5b/d7b/d90 0 2024-04-23T14:49:42.720 INFO:tasks.workunit.client.0.smithi081.stdout:9/449: dread - d3/de/d25/f8e zero size 2024-04-23T14:49:42.723 INFO:tasks.workunit.client.0.smithi081.stdout:9/450: symlink d3/de/d14/d5e/l91 0 2024-04-23T14:49:42.723 INFO:tasks.workunit.client.0.smithi081.stdout:9/451: chown d3/de 2880826 1 2024-04-23T14:49:42.728 INFO:tasks.workunit.client.0.smithi081.stdout:6/403: getdents d1/d51/d65/d1c/d6e 0 2024-04-23T14:49:42.728 INFO:tasks.workunit.client.1.smithi156.stdout:5/30: read d1/d3/f5 [1459627,55826] 0 2024-04-23T14:49:42.729 INFO:tasks.workunit.client.0.smithi081.stdout:6/404: link d1/d51/d65/f6a d1/d51/d65/d1c/d66/f93 0 2024-04-23T14:49:42.729 INFO:tasks.workunit.client.0.smithi081.stdout:6/405: readlink d1/d2/d5a/l60 0 2024-04-23T14:49:42.730 INFO:tasks.workunit.client.1.smithi156.stdout:8/21: dwrite d5/f8 [0,4194304] 0 2024-04-23T14:49:42.731 INFO:tasks.workunit.client.0.smithi081.stdout:3/339: dwrite d4/dc/f52 [0,4194304] 0 2024-04-23T14:49:42.734 INFO:tasks.workunit.client.1.smithi156.stdout:8/22: fsync d5/f8 0 2024-04-23T14:49:42.743 INFO:tasks.workunit.client.1.smithi156.stdout:8/23: unlink d5/c7 0 2024-04-23T14:49:42.743 INFO:tasks.workunit.client.0.smithi081.stdout:5/429: rmdir d17/d1f/d42 39 2024-04-23T14:49:42.746 INFO:tasks.workunit.client.0.smithi081.stdout:3/340: getdents d4/dc/d31 0 2024-04-23T14:49:42.746 INFO:tasks.workunit.client.0.smithi081.stdout:3/341: chown d4/d7/df/d30/d64 52798 1 2024-04-23T14:49:42.747 INFO:tasks.workunit.client.1.smithi156.stdout:8/24: mkdir d5/d9 0 2024-04-23T14:49:42.748 INFO:tasks.workunit.client.0.smithi081.stdout:9/452: write d3/d1a/d6c/f31 [1414530,28530] 0 2024-04-23T14:49:42.748 INFO:tasks.workunit.client.0.smithi081.stdout:9/453: readlink d3/de/d25/l5a 0 2024-04-23T14:49:42.750 INFO:tasks.workunit.client.0.smithi081.stdout:4/363: dwrite d1/d4/f5d [0,4194304] 0 2024-04-23T14:49:42.752 INFO:tasks.workunit.client.0.smithi081.stdout:5/430: symlink d17/d18/d3a/d8e/l98 0 2024-04-23T14:49:42.758 INFO:tasks.workunit.client.0.smithi081.stdout:5/431: rename d17/d1f/d36/d59/l92 to d17/d65/l99 0 2024-04-23T14:49:42.758 INFO:tasks.workunit.client.0.smithi081.stdout:5/432: chown d17/d37/f6e 58760 1 2024-04-23T14:49:42.758 INFO:tasks.workunit.client.0.smithi081.stdout:5/433: fdatasync d17/d1f/f31 0 2024-04-23T14:49:42.758 INFO:tasks.workunit.client.0.smithi081.stdout:5/434: chown d17/l5a 0 1 2024-04-23T14:49:42.758 INFO:tasks.workunit.client.1.smithi156.stdout:7/33: dwrite f6 [0,4194304] 0 2024-04-23T14:49:42.758 INFO:tasks.workunit.client.1.smithi156.stdout:7/34: fdatasync f6 0 2024-04-23T14:49:42.762 INFO:tasks.workunit.client.0.smithi081.stdout:8/602: dwrite d3/d11/d4f/d58/f99 [0,4194304] 0 2024-04-23T14:49:42.762 INFO:tasks.workunit.client.0.smithi081.stdout:8/603: creat d3/d11/d4f/d58/fce x:0 0 0 2024-04-23T14:49:42.768 INFO:tasks.workunit.client.0.smithi081.stdout:0/498: truncate d6/d11/d14/d24/f4b 1478045 0 2024-04-23T14:49:42.773 INFO:tasks.workunit.client.1.smithi156.stdout:5/31: fsync d1/f9 0 2024-04-23T14:49:42.773 INFO:tasks.workunit.client.1.smithi156.stdout:0/22: sync 2024-04-23T14:49:42.773 INFO:tasks.workunit.client.1.smithi156.stdout:9/22: sync 2024-04-23T14:49:42.773 INFO:tasks.workunit.client.1.smithi156.stdout:5/32: rename d1/d3 to d1/d3/db 22 2024-04-23T14:49:42.773 INFO:tasks.workunit.client.1.smithi156.stdout:2/32: sync 2024-04-23T14:49:42.775 INFO:tasks.workunit.client.0.smithi081.stdout:4/364: write d1/d1d/f52 [2042037,36004] 0 2024-04-23T14:49:42.775 INFO:tasks.workunit.client.1.smithi156.stdout:1/43: dread f4 [0,4194304] 0 2024-04-23T14:49:42.779 INFO:tasks.workunit.client.1.smithi156.stdout:3/24: dread f1 [0,4194304] 0 2024-04-23T14:49:42.779 INFO:tasks.workunit.client.1.smithi156.stdout:4/30: dwrite d0/d8/fc [0,4194304] 0 2024-04-23T14:49:42.785 INFO:tasks.workunit.client.1.smithi156.stdout:0/23: mkdir d0/d5 0 2024-04-23T14:49:42.786 INFO:tasks.workunit.client.0.smithi081.stdout:0/499: dread d6/d11/d14/d41/d5b/d3f/f4a [0,4194304] 0 2024-04-23T14:49:42.786 INFO:tasks.workunit.client.0.smithi081.stdout:0/500: chown d6/d37/f60 16612 1 2024-04-23T14:49:42.788 INFO:tasks.workunit.client.1.smithi156.stdout:4/31: dread d0/f3 [0,4194304] 0 2024-04-23T14:49:42.797 INFO:tasks.workunit.client.1.smithi156.stdout:9/23: symlink d1/d2/l7 0 2024-04-23T14:49:42.805 INFO:tasks.workunit.client.1.smithi156.stdout:5/33: mknod d1/cc 0 2024-04-23T14:49:42.805 INFO:tasks.workunit.client.1.smithi156.stdout:5/34: creat d1/d3/fd x:0 0 0 2024-04-23T14:49:42.807 INFO:tasks.workunit.client.0.smithi081.stdout:0/501: dread d6/f4f [0,4194304] 0 2024-04-23T14:49:42.807 INFO:tasks.workunit.client.1.smithi156.stdout:3/25: dread f3 [0,4194304] 0 2024-04-23T14:49:42.808 INFO:tasks.workunit.client.1.smithi156.stdout:3/26: truncate f1 4448425 0 2024-04-23T14:49:42.811 INFO:tasks.workunit.client.1.smithi156.stdout:1/44: unlink f4 0 2024-04-23T14:49:42.812 INFO:tasks.workunit.client.1.smithi156.stdout:1/45: dwrite - no filename 2024-04-23T14:49:42.812 INFO:tasks.workunit.client.1.smithi156.stdout:1/46: chown l5 0 1 2024-04-23T14:49:42.813 INFO:tasks.workunit.client.0.smithi081.stdout:8/604: write d3/d11/d34/f57 [563945,126862] 0 2024-04-23T14:49:42.815 INFO:tasks.workunit.client.0.smithi081.stdout:6/406: link d1/d2/f21 d1/d51/d65/d8/d2e/d59/f94 0 2024-04-23T14:49:42.816 INFO:tasks.workunit.client.0.smithi081.stdout:0/502: creat d6/d37/d67/f97 x:0 0 0 2024-04-23T14:49:42.821 INFO:tasks.workunit.client.1.smithi156.stdout:0/24: unlink d0/d4/f2 0 2024-04-23T14:49:42.821 INFO:tasks.workunit.client.1.smithi156.stdout:0/25: stat d0/d4/f3 0 2024-04-23T14:49:42.822 INFO:tasks.workunit.client.0.smithi081.stdout:0/503: truncate d6/d37/f60 2365911 0 2024-04-23T14:49:42.822 INFO:tasks.workunit.client.1.smithi156.stdout:4/32: creat d0/d8/fd x:0 0 0 2024-04-23T14:49:42.825 INFO:tasks.workunit.client.0.smithi081.stdout:6/407: dread d1/f2a [0,4194304] 0 2024-04-23T14:49:42.829 INFO:tasks.workunit.client.1.smithi156.stdout:9/24: unlink d1/d2/c6 0 2024-04-23T14:49:42.832 INFO:tasks.workunit.client.1.smithi156.stdout:8/25: truncate d5/f8 332927 0 2024-04-23T14:49:42.836 INFO:tasks.workunit.client.0.smithi081.stdout:4/365: dwrite d1/d1d/d39/f3c [0,4194304] 0 2024-04-23T14:49:42.836 INFO:tasks.workunit.client.0.smithi081.stdout:4/366: creat d1/d3/f7b x:0 0 0 2024-04-23T14:49:42.837 INFO:tasks.workunit.client.0.smithi081.stdout:0/504: mknod d6/d11/d14/d41/d5b/d59/d8e/c98 0 2024-04-23T14:49:42.837 INFO:tasks.workunit.client.1.smithi156.stdout:5/35: mknod d1/d3/ce 0 2024-04-23T14:49:42.837 INFO:tasks.workunit.client.1.smithi156.stdout:5/36: dread - d1/d3/fa zero size 2024-04-23T14:49:42.837 INFO:tasks.workunit.client.1.smithi156.stdout:5/37: truncate d1/f9 726549 0 2024-04-23T14:49:42.837 INFO:tasks.workunit.client.1.smithi156.stdout:5/38: dread - d1/d3/fa zero size 2024-04-23T14:49:42.838 INFO:tasks.workunit.client.0.smithi081.stdout:6/408: dread d1/d51/d65/d8/d2e/d59/f94 [0,4194304] 0 2024-04-23T14:49:42.838 INFO:tasks.workunit.client.1.smithi156.stdout:2/33: rmdir d4 39 2024-04-23T14:49:42.839 INFO:tasks.workunit.client.1.smithi156.stdout:2/34: write d4/f8 [841857,81979] 0 2024-04-23T14:49:42.841 INFO:tasks.workunit.client.1.smithi156.stdout:3/27: mkdir d4 0 2024-04-23T14:49:42.842 INFO:tasks.workunit.client.0.smithi081.stdout:3/342: dwrite d4/dc/d10/d47/f6d [0,4194304] 0 2024-04-23T14:49:42.842 INFO:tasks.workunit.client.0.smithi081.stdout:3/343: write d4/d41/f67 [672841,35494] 0 2024-04-23T14:49:42.847 INFO:tasks.workunit.client.1.smithi156.stdout:1/47: link l5 l6 0 2024-04-23T14:49:42.847 INFO:tasks.workunit.client.1.smithi156.stdout:1/48: dwrite - no filename 2024-04-23T14:49:42.847 INFO:tasks.workunit.client.1.smithi156.stdout:1/49: truncate - no filename 2024-04-23T14:49:42.847 INFO:tasks.workunit.client.1.smithi156.stdout:1/50: dwrite - no filename 2024-04-23T14:49:42.847 INFO:tasks.workunit.client.1.smithi156.stdout:1/51: read - no filename 2024-04-23T14:49:42.854 INFO:tasks.workunit.client.0.smithi081.stdout:4/367: mknod d1/c7c 0 2024-04-23T14:49:42.854 INFO:tasks.workunit.client.0.smithi081.stdout:4/368: dread - d1/d4/dc/f78 zero size 2024-04-23T14:49:42.857 INFO:tasks.workunit.client.1.smithi156.stdout:3/28: write f1 [1960939,103357] 0 2024-04-23T14:49:42.858 INFO:tasks.workunit.client.1.smithi156.stdout:0/26: link d0/d4/f3 d0/d5/f6 0 2024-04-23T14:49:42.859 INFO:tasks.workunit.client.0.smithi081.stdout:2/431: sync 2024-04-23T14:49:42.859 INFO:tasks.workunit.client.0.smithi081.stdout:2/432: chown d1/d33/d45/d6e/d96/f63 123002936 1 2024-04-23T14:49:42.860 INFO:tasks.workunit.client.0.smithi081.stdout:7/318: sync 2024-04-23T14:49:42.862 INFO:tasks.workunit.client.0.smithi081.stdout:1/487: sync 2024-04-23T14:49:42.864 INFO:tasks.workunit.client.0.smithi081.stdout:0/505: rename d6/d11/d14/d41/d5b/d3f/d44/d76/l79 to d6/d11/d14/d41/d5b/d3f/d44/d78/d84/l99 0 2024-04-23T14:49:42.866 INFO:tasks.workunit.client.0.smithi081.stdout:5/435: dwrite d17/d3c/d55/f7d [0,4194304] 0 2024-04-23T14:49:42.868 INFO:tasks.workunit.client.1.smithi156.stdout:4/33: dwrite d0/d8/fd [0,4194304] 0 2024-04-23T14:49:42.870 INFO:tasks.workunit.client.0.smithi081.stdout:9/454: dwrite d3/de/d1d/d54/f6a [0,4194304] 0 2024-04-23T14:49:42.870 INFO:tasks.workunit.client.0.smithi081.stdout:9/455: fsync d3/d1a/d6c/f42 0 2024-04-23T14:49:42.870 INFO:tasks.workunit.client.0.smithi081.stdout:9/456: chown d3/d5/c7 1271957 1 2024-04-23T14:49:42.871 INFO:tasks.workunit.client.1.smithi156.stdout:9/25: creat d1/d2/d4/f8 x:0 0 0 2024-04-23T14:49:42.871 INFO:tasks.workunit.client.1.smithi156.stdout:9/26: dread - d1/d2/d4/f8 zero size 2024-04-23T14:49:42.876 INFO:tasks.workunit.client.1.smithi156.stdout:8/26: unlink l3 0 2024-04-23T14:49:42.880 INFO:tasks.workunit.client.1.smithi156.stdout:5/39: link d1/l4 d1/lf 0 2024-04-23T14:49:42.882 INFO:tasks.workunit.client.0.smithi081.stdout:3/344: creat d4/dc/d31/f74 x:0 0 0 2024-04-23T14:49:42.884 INFO:tasks.workunit.client.1.smithi156.stdout:2/35: unlink l3 0 2024-04-23T14:49:42.884 INFO:tasks.workunit.client.0.smithi081.stdout:2/433: dread d1/d11/d21/d52/d8b/f91 [0,4194304] 0 2024-04-23T14:49:42.886 INFO:tasks.workunit.client.0.smithi081.stdout:4/369: symlink d1/d1d/d59/l7d 0 2024-04-23T14:49:42.891 INFO:tasks.workunit.client.1.smithi156.stdout:1/52: link l5 l7 0 2024-04-23T14:49:42.891 INFO:tasks.workunit.client.1.smithi156.stdout:1/53: chown l5 6209 1 2024-04-23T14:49:42.891 INFO:tasks.workunit.client.1.smithi156.stdout:1/54: dread - no filename 2024-04-23T14:49:42.895 INFO:tasks.workunit.client.0.smithi081.stdout:1/488: write d3/d3d/d41/d5e/d12/d1a/d2a/f83 [4061420,93095] 0 2024-04-23T14:49:42.895 INFO:tasks.workunit.client.0.smithi081.stdout:7/319: symlink d3/d11/l67 0 2024-04-23T14:49:42.895 INFO:tasks.workunit.client.0.smithi081.stdout:8/605: truncate d3/d3c/f52 218256 0 2024-04-23T14:49:42.895 INFO:tasks.workunit.client.1.smithi156.stdout:6/20: sync 2024-04-23T14:49:42.898 INFO:tasks.workunit.client.0.smithi081.stdout:6/409: rename d1/d51/d65/d1c/c85 to d1/d51/d65/d13/c95 0 2024-04-23T14:49:42.898 INFO:tasks.workunit.client.0.smithi081.stdout:6/410: chown d1/d2/d5a/l60 243542 1 2024-04-23T14:49:42.899 INFO:tasks.workunit.client.1.smithi156.stdout:5/40: fsync d1/d3/fd 0 2024-04-23T14:49:42.904 INFO:tasks.workunit.client.0.smithi081.stdout:5/436: mkdir d17/d1f/d36/d9a 0 2024-04-23T14:49:42.907 INFO:tasks.workunit.client.1.smithi156.stdout:0/27: creat d0/f7 x:0 0 0 2024-04-23T14:49:42.908 INFO:tasks.workunit.client.1.smithi156.stdout:7/35: sync 2024-04-23T14:49:42.908 INFO:tasks.workunit.client.1.smithi156.stdout:7/36: creat f8 x:0 0 0 2024-04-23T14:49:42.908 INFO:tasks.workunit.client.0.smithi081.stdout:2/434: mkdir d1/d33/d45/d6e/d97 0 2024-04-23T14:49:42.910 INFO:tasks.workunit.client.1.smithi156.stdout:2/36: dread f2 [0,4194304] 0 2024-04-23T14:49:42.920 INFO:tasks.workunit.client.1.smithi156.stdout:8/27: symlink d5/d9/la 0 2024-04-23T14:49:42.920 INFO:tasks.workunit.client.0.smithi081.stdout:9/457: dwrite d3/de/d47/f49 [0,4194304] 0 2024-04-23T14:49:42.921 INFO:tasks.workunit.client.0.smithi081.stdout:7/320: creat d3/d11/d15/f68 x:0 0 0 2024-04-23T14:49:42.923 INFO:tasks.workunit.client.0.smithi081.stdout:8/606: symlink d3/d1a/lcf 0 2024-04-23T14:49:42.923 INFO:tasks.workunit.client.0.smithi081.stdout:8/607: chown d3/d11/d86/d88/da7/fae 20553868 1 2024-04-23T14:49:42.923 INFO:tasks.workunit.client.0.smithi081.stdout:8/608: stat d3/l6 0 2024-04-23T14:49:42.924 INFO:tasks.workunit.client.1.smithi156.stdout:1/55: symlink l8 0 2024-04-23T14:49:42.931 INFO:tasks.workunit.client.0.smithi081.stdout:1/489: read d3/d3d/d41/d5e/d12/d1a/f48 [221809,22392] 0 2024-04-23T14:49:42.931 INFO:tasks.workunit.client.0.smithi081.stdout:0/506: rename d6/d11/d14/l36 to d6/d11/d14/d41/d5b/d59/l9a 0 2024-04-23T14:49:42.931 INFO:tasks.workunit.client.0.smithi081.stdout:0/507: truncate d6/ff 4751096 0 2024-04-23T14:49:42.931 INFO:tasks.workunit.client.0.smithi081.stdout:0/508: creat d6/d11/d14/d41/d5b/d3f/d44/f9b x:0 0 0 2024-04-23T14:49:42.931 INFO:tasks.workunit.client.1.smithi156.stdout:6/21: mknod d3/c5 0 2024-04-23T14:49:42.931 INFO:tasks.workunit.client.1.smithi156.stdout:6/22: dread - no filename 2024-04-23T14:49:42.931 INFO:tasks.workunit.client.1.smithi156.stdout:6/23: dread - no filename 2024-04-23T14:49:42.937 INFO:tasks.workunit.client.0.smithi081.stdout:8/609: dread f2 [0,4194304] 0 2024-04-23T14:49:42.938 INFO:tasks.workunit.client.0.smithi081.stdout:5/437: dread d17/d18/f19 [0,4194304] 0 2024-04-23T14:49:42.938 INFO:tasks.workunit.client.0.smithi081.stdout:6/411: unlink d1/c4d 0 2024-04-23T14:49:42.939 INFO:tasks.workunit.client.1.smithi156.stdout:0/28: getdents d0/d5 0 2024-04-23T14:49:42.940 INFO:tasks.workunit.client.1.smithi156.stdout:3/29: dwrite f1 [0,4194304] 0 2024-04-23T14:49:42.942 INFO:tasks.workunit.client.0.smithi081.stdout:4/370: dwrite d1/d4/f63 [0,4194304] 0 2024-04-23T14:49:42.948 INFO:tasks.workunit.client.0.smithi081.stdout:2/435: creat d1/d1e/f98 x:0 0 0 2024-04-23T14:49:42.950 INFO:tasks.workunit.client.0.smithi081.stdout:1/490: read d3/d3d/d6f/f62 [2998716,52200] 0 2024-04-23T14:49:42.951 INFO:tasks.workunit.client.0.smithi081.stdout:9/458: stat d3/de/d1d/d54/l75 0 2024-04-23T14:49:42.952 INFO:tasks.workunit.client.1.smithi156.stdout:5/41: dwrite d1/d3/f5 [8388608,4194304] 0 2024-04-23T14:49:42.953 INFO:tasks.workunit.client.1.smithi156.stdout:7/37: rename l4 to l9 0 2024-04-23T14:49:42.954 INFO:tasks.workunit.client.0.smithi081.stdout:7/321: link d3/d11/d15/f3c d3/d21/d31/d63/f69 0 2024-04-23T14:49:42.960 INFO:tasks.workunit.client.0.smithi081.stdout:3/345: rename d4/d7/d1a/c23 to d4/d7/d49/d51/d53/d6c/c75 0 2024-04-23T14:49:42.962 INFO:tasks.workunit.client.0.smithi081.stdout:8/610: creat d3/d11/fd0 x:0 0 0 2024-04-23T14:49:42.964 INFO:tasks.workunit.client.1.smithi156.stdout:8/28: symlink d5/lb 0 2024-04-23T14:49:42.965 INFO:tasks.workunit.client.0.smithi081.stdout:5/438: mkdir d17/d1f/d42/d9b 0 2024-04-23T14:49:42.967 INFO:tasks.workunit.client.1.smithi156.stdout:1/56: rename l5 to l9 0 2024-04-23T14:49:42.967 INFO:tasks.workunit.client.1.smithi156.stdout:1/57: rmdir - no directory 2024-04-23T14:49:42.969 INFO:tasks.workunit.client.0.smithi081.stdout:0/509: read d6/d37/f7e [1658764,109539] 0 2024-04-23T14:49:42.969 INFO:tasks.workunit.client.0.smithi081.stdout:0/510: write d6/d11/d14/d41/d5b/d3f/d44/f86 [2675113,97892] 0 2024-04-23T14:49:42.969 INFO:tasks.workunit.client.0.smithi081.stdout:6/412: creat d1/d51/d65/d1c/d66/f96 x:0 0 0 2024-04-23T14:49:42.971 INFO:tasks.workunit.client.1.smithi156.stdout:6/24: mknod d3/c6 0 2024-04-23T14:49:42.971 INFO:tasks.workunit.client.1.smithi156.stdout:6/25: rename d3 to d3/d7 22 2024-04-23T14:49:42.977 INFO:tasks.workunit.client.1.smithi156.stdout:8/29: dread d5/f8 [0,4194304] 0 2024-04-23T14:49:42.981 INFO:tasks.workunit.client.0.smithi081.stdout:4/371: creat d1/d4/d6f/d70/f7e x:0 0 0 2024-04-23T14:49:42.985 INFO:tasks.workunit.client.0.smithi081.stdout:2/436: mknod d1/d33/d45/c99 0 2024-04-23T14:49:42.985 INFO:tasks.workunit.client.0.smithi081.stdout:5/439: write d17/f1b [1274214,92780] 0 2024-04-23T14:49:42.985 INFO:tasks.workunit.client.0.smithi081.stdout:5/440: creat d17/d1f/d36/d59/f9c x:0 0 0 2024-04-23T14:49:42.985 INFO:tasks.workunit.client.0.smithi081.stdout:5/441: fsync d17/d37/f6e 0 2024-04-23T14:49:42.986 INFO:tasks.workunit.client.0.smithi081.stdout:1/491: mkdir d3/d3d/d41/d5e/d9d 0 2024-04-23T14:49:42.986 INFO:tasks.workunit.client.0.smithi081.stdout:1/492: chown d3/d3d/d41/d5e/d17/f78 298 1 2024-04-23T14:49:42.990 INFO:tasks.workunit.client.1.smithi156.stdout:5/42: link d1/cc d1/c10 0 2024-04-23T14:49:42.992 INFO:tasks.workunit.client.1.smithi156.stdout:7/38: mknod ca 0 2024-04-23T14:49:42.992 INFO:tasks.workunit.client.1.smithi156.stdout:7/39: rmdir - no directory 2024-04-23T14:49:42.993 INFO:tasks.workunit.client.0.smithi081.stdout:7/322: mknod d3/d21/d31/d33/c6a 0 2024-04-23T14:49:42.995 INFO:tasks.workunit.client.1.smithi156.stdout:1/58: rename l7 to la 0 2024-04-23T14:49:42.995 INFO:tasks.workunit.client.1.smithi156.stdout:1/59: truncate - no filename 2024-04-23T14:49:42.998 INFO:tasks.workunit.client.1.smithi156.stdout:6/26: creat d3/f8 x:0 0 0 2024-04-23T14:49:43.000 INFO:tasks.workunit.client.0.smithi081.stdout:8/611: creat d3/d11/d3e/fd1 x:0 0 0 2024-04-23T14:49:43.001 INFO:tasks.workunit.client.1.smithi156.stdout:0/29: rename d0/d5 to d0/d8 0 2024-04-23T14:49:43.002 INFO:tasks.workunit.client.0.smithi081.stdout:0/511: symlink d6/d37/d4d/l9c 0 2024-04-23T14:49:43.003 INFO:tasks.workunit.client.0.smithi081.stdout:2/437: write d1/d11/f26 [2466187,19047] 0 2024-04-23T14:49:43.005 INFO:tasks.workunit.client.1.smithi156.stdout:5/43: mkdir d1/d11 0 2024-04-23T14:49:43.005 INFO:tasks.workunit.client.1.smithi156.stdout:5/44: stat d1/d3 0 2024-04-23T14:49:43.008 INFO:tasks.workunit.client.0.smithi081.stdout:6/413: rename d1/d51/d65/d8/d2e/d58/f84 to d1/d51/d7b/d91/f97 0 2024-04-23T14:49:43.009 INFO:tasks.workunit.client.0.smithi081.stdout:4/372: rmdir d1/d4/dc 39 2024-04-23T14:49:43.015 INFO:tasks.workunit.client.0.smithi081.stdout:5/442: rename d17/c1a to d17/c9d 0 2024-04-23T14:49:43.015 INFO:tasks.workunit.client.0.smithi081.stdout:3/346: write d4/d7/df/f35 [4444211,9473] 0 2024-04-23T14:49:43.015 INFO:tasks.workunit.client.0.smithi081.stdout:3/347: readlink d4/dc/l2d 0 2024-04-23T14:49:43.017 INFO:tasks.workunit.client.1.smithi156.stdout:1/60: mkdir db 0 2024-04-23T14:49:43.017 INFO:tasks.workunit.client.1.smithi156.stdout:6/27: mknod d3/c9 0 2024-04-23T14:49:43.017 INFO:tasks.workunit.client.0.smithi081.stdout:1/493: rmdir d3/d3d/d41/d5e/d17/d26/d8d 0 2024-04-23T14:49:43.017 INFO:tasks.workunit.client.0.smithi081.stdout:1/494: chown d3/d3d/d41/d5e/d17/d58/f99 977 1 2024-04-23T14:49:43.019 INFO:tasks.workunit.client.0.smithi081.stdout:9/459: symlink d3/d1a/d6c/l92 0 2024-04-23T14:49:43.022 INFO:tasks.workunit.client.0.smithi081.stdout:7/323: link d3/d21/d31/f29 d3/d21/d41/f6b 0 2024-04-23T14:49:43.022 INFO:tasks.workunit.client.0.smithi081.stdout:7/324: stat d3/d21/d31 0 2024-04-23T14:49:43.023 INFO:tasks.workunit.client.1.smithi156.stdout:1/61: mknod db/cc 0 2024-04-23T14:49:43.025 INFO:tasks.workunit.client.1.smithi156.stdout:7/40: dread f6 [0,4194304] 0 2024-04-23T14:49:43.025 INFO:tasks.workunit.client.1.smithi156.stdout:7/41: truncate f8 738253 0 2024-04-23T14:49:43.029 INFO:tasks.workunit.client.1.smithi156.stdout:7/42: write f8 [669000,110933] 0 2024-04-23T14:49:43.029 INFO:tasks.workunit.client.1.smithi156.stdout:2/37: rename d4/l5 to d4/l9 0 2024-04-23T14:49:43.029 INFO:tasks.workunit.client.1.smithi156.stdout:7/43: rmdir - no directory 2024-04-23T14:49:43.030 INFO:tasks.workunit.client.1.smithi156.stdout:7/44: stat ca 0 2024-04-23T14:49:43.030 INFO:tasks.workunit.client.1.smithi156.stdout:6/28: mkdir d3/da 0 2024-04-23T14:49:43.030 INFO:tasks.workunit.client.1.smithi156.stdout:6/29: creat d3/fb x:0 0 0 2024-04-23T14:49:43.032 INFO:tasks.workunit.client.1.smithi156.stdout:5/45: write d1/d3/f5 [5008007,96710] 0 2024-04-23T14:49:43.035 INFO:tasks.workunit.client.1.smithi156.stdout:1/62: link l8 db/ld 0 2024-04-23T14:49:43.037 INFO:tasks.workunit.client.0.smithi081.stdout:2/438: link d1/d33/d45/f4d d1/d11/d21/d34/f9a 0 2024-04-23T14:49:43.038 INFO:tasks.workunit.client.1.smithi156.stdout:8/30: dwrite d5/f8 [0,4194304] 0 2024-04-23T14:49:43.046 INFO:tasks.workunit.client.0.smithi081.stdout:8/612: dwrite d3/d11/d34/f57 [0,4194304] 0 2024-04-23T14:49:43.054 INFO:tasks.workunit.client.0.smithi081.stdout:6/414: unlink d1/d51/f71 0 2024-04-23T14:49:43.054 INFO:tasks.workunit.client.0.smithi081.stdout:6/415: write d1/d51/d65/d8/d2e/d58/f61 [4999528,7481] 0 2024-04-23T14:49:43.056 INFO:tasks.workunit.client.1.smithi156.stdout:6/30: symlink d3/lc 0 2024-04-23T14:49:43.057 INFO:tasks.workunit.client.1.smithi156.stdout:6/31: creat d3/fd x:0 0 0 2024-04-23T14:49:43.057 INFO:tasks.workunit.client.0.smithi081.stdout:5/443: fsync d17/d1f/d36/d59/f9c 0 2024-04-23T14:49:43.057 INFO:tasks.workunit.client.0.smithi081.stdout:5/444: fsync d17/d1f/d36/f39 0 2024-04-23T14:49:43.058 INFO:tasks.workunit.client.0.smithi081.stdout:2/439: write d1/d33/d45/f4d [1866169,19959] 0 2024-04-23T14:49:43.058 INFO:tasks.workunit.client.0.smithi081.stdout:2/440: write d1/d11/d21/d34/f72 [835320,13176] 0 2024-04-23T14:49:43.058 INFO:tasks.workunit.client.0.smithi081.stdout:2/441: fdatasync d1/d11/d21/d34/f86 0 2024-04-23T14:49:43.061 INFO:tasks.workunit.client.0.smithi081.stdout:4/373: link d1/fa d1/d4/d11/f7f 0 2024-04-23T14:49:43.061 INFO:tasks.workunit.client.0.smithi081.stdout:4/374: creat d1/d4/d11/f80 x:0 0 0 2024-04-23T14:49:43.062 INFO:tasks.workunit.client.1.smithi156.stdout:0/30: dwrite d0/d4/f3 [0,4194304] 0 2024-04-23T14:49:43.062 INFO:tasks.workunit.client.1.smithi156.stdout:0/31: chown d0/d8/f6 1810208816 1 2024-04-23T14:49:43.063 INFO:tasks.workunit.client.1.smithi156.stdout:1/63: symlink db/le 0 2024-04-23T14:49:43.064 INFO:tasks.workunit.client.1.smithi156.stdout:1/64: dread - no filename 2024-04-23T14:49:43.064 INFO:tasks.workunit.client.1.smithi156.stdout:1/65: dwrite - no filename 2024-04-23T14:49:43.064 INFO:tasks.workunit.client.1.smithi156.stdout:1/66: dread - no filename 2024-04-23T14:49:43.071 INFO:tasks.workunit.client.0.smithi081.stdout:4/375: dread d1/d3/f8 [0,4194304] 0 2024-04-23T14:49:43.072 INFO:tasks.workunit.client.1.smithi156.stdout:8/31: creat d5/fc x:0 0 0 2024-04-23T14:49:43.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:42 smithi081 ceph-mon[25540]: pgmap v30: 65 pgs: 65 active+clean; 1.1 GiB data, 4.9 GiB used, 532 GiB / 536 GiB avail; 95 MiB/s rd, 105 MiB/s wr, 476 op/s 2024-04-23T14:49:43.078 INFO:tasks.workunit.client.1.smithi156.stdout:7/45: getdents . 0 2024-04-23T14:49:43.079 INFO:tasks.workunit.client.0.smithi081.stdout:1/495: unlink d3/d3d/d41/f5b 0 2024-04-23T14:49:43.080 INFO:tasks.workunit.client.0.smithi081.stdout:1/496: chown d3/d3d/d41/d5e/d17/d25/l3a 10 1 2024-04-23T14:49:43.080 INFO:tasks.workunit.client.0.smithi081.stdout:1/497: write d3/d3d/d41/d5e/d17/f78 [362960,60794] 0 2024-04-23T14:49:43.080 INFO:tasks.workunit.client.0.smithi081.stdout:1/498: fsync d3/d3d/d41/d5e/d12/d1a/d2a/d70/f84 0 2024-04-23T14:49:43.081 INFO:tasks.workunit.client.0.smithi081.stdout:9/460: symlink d3/d5/l93 0 2024-04-23T14:49:43.081 INFO:tasks.workunit.client.0.smithi081.stdout:9/461: getdents d3/de/d25/d8c 0 2024-04-23T14:49:43.081 INFO:tasks.workunit.client.0.smithi081.stdout:9/462: truncate d3/f4a 1131748 0 2024-04-23T14:49:43.082 INFO:tasks.workunit.client.0.smithi081.stdout:7/325: getdents d3/d21/d31/d63 0 2024-04-23T14:49:43.086 INFO:tasks.workunit.client.0.smithi081.stdout:6/416: mkdir d1/d2/d8e/d98 0 2024-04-23T14:49:43.090 INFO:tasks.workunit.client.0.smithi081.stdout:5/445: unlink d17/d4a/c87 0 2024-04-23T14:49:43.092 INFO:tasks.workunit.client.0.smithi081.stdout:2/442: symlink d1/d33/d45/d6e/l9b 0 2024-04-23T14:49:43.095 INFO:tasks.workunit.client.1.smithi156.stdout:5/46: dread d1/d3/f5 [4194304,4194304] 0 2024-04-23T14:49:43.095 INFO:tasks.workunit.client.1.smithi156.stdout:5/47: dread - d1/d3/fa zero size 2024-04-23T14:49:43.098 INFO:tasks.workunit.client.1.smithi156.stdout:0/32: rmdir d0/d8 39 2024-04-23T14:49:43.100 INFO:tasks.workunit.client.0.smithi081.stdout:4/376: rmdir d1/d7a 0 2024-04-23T14:49:43.100 INFO:tasks.workunit.client.0.smithi081.stdout:4/377: dread - d1/f1e zero size 2024-04-23T14:49:43.101 INFO:tasks.workunit.client.1.smithi156.stdout:1/67: creat db/ff x:0 0 0 2024-04-23T14:49:43.103 INFO:tasks.workunit.client.0.smithi081.stdout:1/499: symlink d3/d3d/d41/d5e/d12/l9e 0 2024-04-23T14:49:43.103 INFO:tasks.workunit.client.0.smithi081.stdout:1/500: fsync d3/d3d/d41/d5e/d12/d1a/f86 0 2024-04-23T14:49:43.103 INFO:tasks.workunit.client.0.smithi081.stdout:1/501: read d3/fa [1640159,102051] 0 2024-04-23T14:49:43.107 INFO:tasks.workunit.client.1.smithi156.stdout:2/38: mknod d4/ca 0 2024-04-23T14:49:43.111 INFO:tasks.workunit.client.0.smithi081.stdout:9/463: truncate d3/de/f84 11226950 0 2024-04-23T14:49:43.114 INFO:tasks.workunit.client.1.smithi156.stdout:4/34: sync 2024-04-23T14:49:43.117 INFO:tasks.workunit.client.1.smithi156.stdout:6/32: unlink d3/fb 0 2024-04-23T14:49:43.117 INFO:tasks.workunit.client.1.smithi156.stdout:9/27: sync 2024-04-23T14:49:43.118 INFO:tasks.workunit.client.1.smithi156.stdout:7/46: dread f6 [0,4194304] 0 2024-04-23T14:49:43.118 INFO:tasks.workunit.client.1.smithi156.stdout:9/28: write d1/d2/d4/f8 [219311,71126] 0 2024-04-23T14:49:43.118 INFO:tasks.workunit.client.0.smithi081.stdout:0/512: dwrite d6/d37/d85/f8b [0,4194304] 0 2024-04-23T14:49:43.118 INFO:tasks.workunit.client.0.smithi081.stdout:0/513: dread - d6/d11/d14/f91 zero size 2024-04-23T14:49:43.118 INFO:tasks.workunit.client.0.smithi081.stdout:6/417: creat d1/d2/f99 x:0 0 0 2024-04-23T14:49:43.122 INFO:tasks.workunit.client.0.smithi081.stdout:5/446: mkdir d17/d1f/d42/d9b/d9e 0 2024-04-23T14:49:43.122 INFO:tasks.workunit.client.0.smithi081.stdout:5/447: fdatasync d17/d1f/d36/f39 0 2024-04-23T14:49:43.124 INFO:tasks.workunit.client.0.smithi081.stdout:8/613: dwrite d3/d11/d34/fb6 [0,4194304] 0 2024-04-23T14:49:43.126 INFO:tasks.workunit.client.0.smithi081.stdout:5/448: write d17/d18/f48 [57396,70685] 0 2024-04-23T14:49:43.127 INFO:tasks.workunit.client.1.smithi156.stdout:5/48: mknod d1/d11/c12 0 2024-04-23T14:49:43.127 INFO:tasks.workunit.client.1.smithi156.stdout:5/49: dread - d1/d3/fa zero size 2024-04-23T14:49:43.127 INFO:tasks.workunit.client.1.smithi156.stdout:2/39: write f2 [1263452,101724] 0 2024-04-23T14:49:43.127 INFO:tasks.workunit.client.1.smithi156.stdout:5/50: truncate d1/d3/fd 706295 0 2024-04-23T14:49:43.128 INFO:tasks.workunit.client.1.smithi156.stdout:0/33: mknod d0/c9 0 2024-04-23T14:49:43.131 INFO:tasks.workunit.client.1.smithi156.stdout:1/68: mknod db/c10 0 2024-04-23T14:49:43.131 INFO:tasks.workunit.client.0.smithi081.stdout:9/464: dread d3/d1a/d6c/f58 [0,4194304] 0 2024-04-23T14:49:43.131 INFO:tasks.workunit.client.0.smithi081.stdout:9/465: chown d3/c43 81013600 1 2024-04-23T14:49:43.134 INFO:tasks.workunit.client.1.smithi156.stdout:4/35: write d0/f2 [2129009,111347] 0 2024-04-23T14:49:43.135 INFO:tasks.workunit.client.0.smithi081.stdout:4/378: rename d1/c66 to d1/d4/c81 0 2024-04-23T14:49:43.138 INFO:tasks.workunit.client.1.smithi156.stdout:6/33: creat d3/da/fe x:0 0 0 2024-04-23T14:49:43.138 INFO:tasks.workunit.client.1.smithi156.stdout:6/34: readlink l2 0 2024-04-23T14:49:43.138 INFO:tasks.workunit.client.1.smithi156.stdout:6/35: dread - d3/fd zero size 2024-04-23T14:49:43.138 INFO:tasks.workunit.client.0.smithi081.stdout:4/379: write d1/d4/f68 [25475,121231] 0 2024-04-23T14:49:43.138 INFO:tasks.workunit.client.1.smithi156.stdout:7/47: truncate f8 93230 0 2024-04-23T14:49:43.147 INFO:tasks.workunit.client.1.smithi156.stdout:9/29: mknod d1/c9 0 2024-04-23T14:49:43.147 INFO:tasks.workunit.client.1.smithi156.stdout:3/30: sync 2024-04-23T14:49:43.147 INFO:tasks.workunit.client.1.smithi156.stdout:9/30: write d1/d2/d4/f8 [1062961,11146] 0 2024-04-23T14:49:43.148 INFO:tasks.workunit.client.1.smithi156.stdout:9/31: rename d1 to d1/da 22 2024-04-23T14:49:43.148 INFO:tasks.workunit.client.1.smithi156.stdout:9/32: chown d1/d2 27538308 1 2024-04-23T14:49:43.149 INFO:tasks.workunit.client.1.smithi156.stdout:2/40: write d4/f8 [1831430,50930] 0 2024-04-23T14:49:43.151 INFO:tasks.workunit.client.1.smithi156.stdout:2/41: write d4/f8 [1009311,26684] 0 2024-04-23T14:49:43.151 INFO:tasks.workunit.client.1.smithi156.stdout:2/42: write f2 [4748770,38620] 0 2024-04-23T14:49:43.154 INFO:tasks.workunit.client.1.smithi156.stdout:5/51: creat d1/d11/f13 x:0 0 0 2024-04-23T14:49:43.155 INFO:tasks.workunit.client.1.smithi156.stdout:5/52: write d1/d3/fd [844614,22412] 0 2024-04-23T14:49:43.155 INFO:tasks.workunit.client.1.smithi156.stdout:5/53: chown d1 255455 1 2024-04-23T14:49:43.158 INFO:tasks.workunit.client.1.smithi156.stdout:0/34: symlink d0/d4/la 0 2024-04-23T14:49:43.161 INFO:tasks.workunit.client.0.smithi081.stdout:0/514: mknod d6/d11/d14/d41/d5b/d3f/d44/d76/c9d 0 2024-04-23T14:49:43.164 INFO:tasks.workunit.client.1.smithi156.stdout:4/36: mknod d0/d8/ce 0 2024-04-23T14:49:43.167 INFO:tasks.workunit.client.1.smithi156.stdout:6/36: mknod d3/cf 0 2024-04-23T14:49:43.167 INFO:tasks.workunit.client.1.smithi156.stdout:6/37: dread - d3/fd zero size 2024-04-23T14:49:43.167 INFO:tasks.workunit.client.1.smithi156.stdout:8/32: dwrite d5/f8 [0,4194304] 0 2024-04-23T14:49:43.168 INFO:tasks.workunit.client.1.smithi156.stdout:7/48: creat fb x:0 0 0 2024-04-23T14:49:43.168 INFO:tasks.workunit.client.0.smithi081.stdout:3/348: dwrite d4/d7/df/d30/f4c [0,4194304] 0 2024-04-23T14:49:43.173 INFO:tasks.workunit.client.0.smithi081.stdout:5/449: link d17/d18/f34 d17/d1f/d36/d9a/f9f 0 2024-04-23T14:49:43.173 INFO:tasks.workunit.client.1.smithi156.stdout:3/31: write f1 [3242326,99131] 0 2024-04-23T14:49:43.173 INFO:tasks.workunit.client.1.smithi156.stdout:9/33: mknod d1/cb 0 2024-04-23T14:49:43.173 INFO:tasks.workunit.client.1.smithi156.stdout:3/32: stat f3 0 2024-04-23T14:49:43.175 INFO:tasks.workunit.client.1.smithi156.stdout:5/54: symlink d1/d3/l14 0 2024-04-23T14:49:43.175 INFO:tasks.workunit.client.1.smithi156.stdout:5/55: dread - d1/d11/f13 zero size 2024-04-23T14:49:43.176 INFO:tasks.workunit.client.0.smithi081.stdout:9/466: creat d3/de/d1d/d73/f94 x:0 0 0 2024-04-23T14:49:43.177 INFO:tasks.workunit.client.0.smithi081.stdout:2/443: dwrite d1/d11/d21/f2a [0,4194304] 0 2024-04-23T14:49:43.177 INFO:tasks.workunit.client.0.smithi081.stdout:2/444: chown d1/d1e/l53 18283 1 2024-04-23T14:49:43.179 INFO:tasks.workunit.client.0.smithi081.stdout:1/502: dwrite d3/d3d/d41/d5e/d12/d1a/d2a/f83 [0,4194304] 0 2024-04-23T14:49:43.185 INFO:tasks.workunit.client.0.smithi081.stdout:0/515: link d6/d37/d4d/c5e d6/d11/d14/d41/d5b/d59/d8e/c9e 0 2024-04-23T14:49:43.185 INFO:tasks.workunit.client.0.smithi081.stdout:0/516: chown d6/d11/d14/d41/d5b/d59/d68/f74 66307 1 2024-04-23T14:49:43.185 INFO:tasks.workunit.client.0.smithi081.stdout:0/517: chown d6/d11/d14/d41/d5b/d3f/d44/d76 604 1 2024-04-23T14:49:43.186 INFO:tasks.workunit.client.1.smithi156.stdout:4/37: unlink d0/f2 0 2024-04-23T14:49:43.186 INFO:tasks.workunit.client.1.smithi156.stdout:7/49: mkdir dc 0 2024-04-23T14:49:43.189 INFO:tasks.workunit.client.1.smithi156.stdout:1/69: rmdir db 39 2024-04-23T14:49:43.189 INFO:tasks.workunit.client.1.smithi156.stdout:1/70: truncate db/ff 821130 0 2024-04-23T14:49:43.201 INFO:tasks.workunit.client.0.smithi081.stdout:3/349: creat d4/d7/d1a/d71/f76 x:0 0 0 2024-04-23T14:49:43.205 INFO:tasks.workunit.client.0.smithi081.stdout:8/614: getdents d3/d11/d86 0 2024-04-23T14:49:43.205 INFO:tasks.workunit.client.0.smithi081.stdout:8/615: fsync d3/d11/d3e/f44 0 2024-04-23T14:49:43.205 INFO:tasks.workunit.client.0.smithi081.stdout:8/616: creat d3/dc6/fd2 x:0 0 0 2024-04-23T14:49:43.205 INFO:tasks.workunit.client.0.smithi081.stdout:8/617: write d3/d11/d34/f55 [431376,38242] 0 2024-04-23T14:49:43.208 INFO:tasks.workunit.client.0.smithi081.stdout:8/618: chown d3/d11/d34/d8b/f9b 548293938 1 2024-04-23T14:49:43.208 INFO:tasks.workunit.client.0.smithi081.stdout:3/350: dread d4/d7/f6f [0,4194304] 0 2024-04-23T14:49:43.211 INFO:tasks.workunit.client.1.smithi156.stdout:4/38: truncate d0/d8/fd 381274 0 2024-04-23T14:49:43.212 INFO:tasks.workunit.client.1.smithi156.stdout:5/56: write d1/d3/fd [571250,94462] 0 2024-04-23T14:49:43.215 INFO:tasks.workunit.client.1.smithi156.stdout:9/34: write d1/d2/d4/f8 [39047,34488] 0 2024-04-23T14:49:43.216 INFO:tasks.workunit.client.1.smithi156.stdout:8/33: dwrite d5/fc [0,4194304] 0 2024-04-23T14:49:43.226 INFO:tasks.workunit.client.1.smithi156.stdout:7/50: creat dc/fd x:0 0 0 2024-04-23T14:49:43.227 INFO:tasks.workunit.client.1.smithi156.stdout:7/51: dread - fb zero size 2024-04-23T14:49:43.229 INFO:tasks.workunit.client.1.smithi156.stdout:1/71: creat db/f11 x:0 0 0 2024-04-23T14:49:43.231 INFO:tasks.workunit.client.0.smithi081.stdout:9/467: mknod d3/de/d76/c95 0 2024-04-23T14:49:43.231 INFO:tasks.workunit.client.0.smithi081.stdout:9/468: chown d3/d5/l48 762942872 1 2024-04-23T14:49:43.231 INFO:tasks.workunit.client.0.smithi081.stdout:5/450: creat d17/fa0 x:0 0 0 2024-04-23T14:49:43.231 INFO:tasks.workunit.client.0.smithi081.stdout:9/469: creat d3/de/d14/d5e/f96 x:0 0 0 2024-04-23T14:49:43.231 INFO:tasks.workunit.client.1.smithi156.stdout:0/35: dwrite d0/d4/f3 [0,4194304] 0 2024-04-23T14:49:43.246 INFO:tasks.workunit.client.1.smithi156.stdout:6/38: dwrite d3/fd [0,4194304] 0 2024-04-23T14:49:43.247 INFO:tasks.workunit.client.1.smithi156.stdout:6/39: dread - d3/da/fe zero size 2024-04-23T14:49:43.247 INFO:tasks.workunit.client.0.smithi081.stdout:0/518: truncate d6/d37/f7e 2370587 0 2024-04-23T14:49:43.247 INFO:tasks.workunit.client.0.smithi081.stdout:0/519: chown d6/d37/d67/f92 5 1 2024-04-23T14:49:43.247 INFO:tasks.workunit.client.1.smithi156.stdout:9/35: fsync d1/d2/d4/f8 0 2024-04-23T14:49:43.250 INFO:tasks.workunit.client.1.smithi156.stdout:0/36: dread d0/d8/f6 [0,4194304] 0 2024-04-23T14:49:43.250 INFO:tasks.workunit.client.1.smithi156.stdout:0/37: fsync d0/d4/f3 0 2024-04-23T14:49:43.252 INFO:tasks.workunit.client.0.smithi081.stdout:4/380: dwrite d1/d4/d11/f28 [0,4194304] 0 2024-04-23T14:49:43.253 INFO:tasks.workunit.client.0.smithi081.stdout:1/503: dwrite d3/d3d/f32 [0,4194304] 0 2024-04-23T14:49:43.254 INFO:tasks.workunit.client.0.smithi081.stdout:1/504: stat d3/d3d/d41/d4a/d77/f82 0 2024-04-23T14:49:43.257 INFO:tasks.workunit.client.0.smithi081.stdout:3/351: write d4/d7/df/f27 [243602,10323] 0 2024-04-23T14:49:43.266 INFO:tasks.workunit.client.0.smithi081.stdout:5/451: unlink d17/f2a 0 2024-04-23T14:49:43.270 INFO:tasks.workunit.client.1.smithi156.stdout:5/57: symlink d1/l15 0 2024-04-23T14:49:43.271 INFO:tasks.workunit.client.0.smithi081.stdout:8/619: dwrite d3/f5 [0,4194304] 0 2024-04-23T14:49:43.271 INFO:tasks.workunit.client.1.smithi156.stdout:0/38: write d0/d8/f6 [371357,26533] 0 2024-04-23T14:49:43.272 INFO:tasks.workunit.client.0.smithi081.stdout:9/470: stat d3/d1a/d6c/l40 0 2024-04-23T14:49:43.272 INFO:tasks.workunit.client.0.smithi081.stdout:9/471: chown d3/de/d1d/d5b/d7b/d90 19 1 2024-04-23T14:49:43.272 INFO:tasks.workunit.client.0.smithi081.stdout:9/472: fdatasync d3/de/d1d/d5b/f5c 0 2024-04-23T14:49:43.275 INFO:tasks.workunit.client.1.smithi156.stdout:3/33: truncate f1 3072046 0 2024-04-23T14:49:43.285 INFO:tasks.workunit.client.1.smithi156.stdout:7/52: rename l0 to dc/le 0 2024-04-23T14:49:43.285 INFO:tasks.workunit.client.1.smithi156.stdout:1/72: rename db to db/d12 22 2024-04-23T14:49:43.285 INFO:tasks.workunit.client.1.smithi156.stdout:7/53: read - fb zero size 2024-04-23T14:49:43.285 INFO:tasks.workunit.client.1.smithi156.stdout:5/58: rename d1/d11 to d1/d11/d16 22 2024-04-23T14:49:43.285 INFO:tasks.workunit.client.1.smithi156.stdout:1/73: truncate db/f11 303065 0 2024-04-23T14:49:43.285 INFO:tasks.workunit.client.1.smithi156.stdout:7/54: chown dc 0 1 2024-04-23T14:49:43.285 INFO:tasks.workunit.client.1.smithi156.stdout:7/55: dread - dc/fd zero size 2024-04-23T14:49:43.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:42 smithi156 ceph-mon[32341]: pgmap v30: 65 pgs: 65 active+clean; 1.1 GiB data, 4.9 GiB used, 532 GiB / 536 GiB avail; 95 MiB/s rd, 105 MiB/s wr, 476 op/s 2024-04-23T14:49:43.287 INFO:tasks.workunit.client.0.smithi081.stdout:4/381: unlink d1/d4/f68 0 2024-04-23T14:49:43.299 INFO:tasks.workunit.client.0.smithi081.stdout:1/505: creat d3/d3d/f9f x:0 0 0 2024-04-23T14:49:43.300 INFO:tasks.workunit.client.1.smithi156.stdout:7/56: dread f6 [0,4194304] 0 2024-04-23T14:49:43.304 INFO:tasks.workunit.client.0.smithi081.stdout:2/445: dwrite d1/d33/d45/f7c [0,4194304] 0 2024-04-23T14:49:43.304 INFO:tasks.workunit.client.0.smithi081.stdout:5/452: link d17/d3c/f40 d17/d3d/fa1 0 2024-04-23T14:49:43.305 INFO:tasks.workunit.client.0.smithi081.stdout:5/453: write d17/d4f/d61/f8d [611104,87495] 0 2024-04-23T14:49:43.307 INFO:tasks.workunit.client.1.smithi156.stdout:5/59: dread d1/d3/fd [0,4194304] 0 2024-04-23T14:49:43.307 INFO:tasks.workunit.client.1.smithi156.stdout:6/40: dwrite d3/f8 [0,4194304] 0 2024-04-23T14:49:43.307 INFO:tasks.workunit.client.1.smithi156.stdout:5/60: write d1/d3/fa [296575,43286] 0 2024-04-23T14:49:43.307 INFO:tasks.workunit.client.1.smithi156.stdout:5/61: chown d1/d3 1621269 1 2024-04-23T14:49:43.308 INFO:tasks.workunit.client.0.smithi081.stdout:8/620: mknod d3/d11/d48/cd3 0 2024-04-23T14:49:43.316 INFO:tasks.workunit.client.0.smithi081.stdout:9/473: symlink d3/d1a/l97 0 2024-04-23T14:49:43.317 INFO:tasks.workunit.client.0.smithi081.stdout:1/506: mkdir d3/d3d/d41/d5e/da0 0 2024-04-23T14:49:43.317 INFO:tasks.workunit.client.1.smithi156.stdout:9/36: mkdir d1/d2/d4/dc 0 2024-04-23T14:49:43.317 INFO:tasks.workunit.client.1.smithi156.stdout:4/39: rmdir d0/d8 39 2024-04-23T14:49:43.317 INFO:tasks.workunit.client.1.smithi156.stdout:9/37: chown d1/d2 2334741 1 2024-04-23T14:49:43.319 INFO:tasks.workunit.client.1.smithi156.stdout:0/39: rename d0/d4/la to d0/d4/lb 0 2024-04-23T14:49:43.323 INFO:tasks.workunit.client.1.smithi156.stdout:0/40: fsync d0/d4/f3 0 2024-04-23T14:49:43.327 INFO:tasks.workunit.client.1.smithi156.stdout:3/34: symlink d4/l5 0 2024-04-23T14:49:43.328 INFO:tasks.workunit.client.0.smithi081.stdout:3/352: rename d4/d7/df/c58 to d4/d7/d49/d51/d53/c77 0 2024-04-23T14:49:43.331 INFO:tasks.workunit.client.1.smithi156.stdout:8/34: rmdir d5 39 2024-04-23T14:49:43.332 INFO:tasks.workunit.client.1.smithi156.stdout:8/35: fdatasync d5/f8 0 2024-04-23T14:49:43.335 INFO:tasks.workunit.client.0.smithi081.stdout:0/520: dwrite d6/ff [0,4194304] 0 2024-04-23T14:49:43.335 INFO:tasks.workunit.client.0.smithi081.stdout:0/521: dread - d6/d11/d14/d41/d5b/d3f/d44/f8f zero size 2024-04-23T14:49:43.337 INFO:tasks.workunit.client.1.smithi156.stdout:7/57: rename l9 to dc/lf 0 2024-04-23T14:49:43.337 INFO:tasks.workunit.client.1.smithi156.stdout:2/43: sync 2024-04-23T14:49:43.338 INFO:tasks.workunit.client.0.smithi081.stdout:2/446: link d1/f6 d1/d1e/f9c 0 2024-04-23T14:49:43.339 INFO:tasks.workunit.client.0.smithi081.stdout:1/507: write d3/d3d/d41/d5e/d17/d58/f61 [3008259,123322] 0 2024-04-23T14:49:43.339 INFO:tasks.workunit.client.0.smithi081.stdout:2/447: write d1/d11/d21/d34/f9a [1176253,66544] 0 2024-04-23T14:49:43.339 INFO:tasks.workunit.client.0.smithi081.stdout:3/353: dread d4/d41/f67 [0,4194304] 0 2024-04-23T14:49:43.342 INFO:tasks.workunit.client.0.smithi081.stdout:5/454: mknod d17/d3c/ca2 0 2024-04-23T14:49:43.343 INFO:tasks.workunit.client.0.smithi081.stdout:8/621: dread d3/d11/d34/f7c [0,4194304] 0 2024-04-23T14:49:43.345 INFO:tasks.workunit.client.1.smithi156.stdout:7/58: dread f8 [0,4194304] 0 2024-04-23T14:49:43.345 INFO:tasks.workunit.client.1.smithi156.stdout:7/59: creat dc/f10 x:0 0 0 2024-04-23T14:49:43.345 INFO:tasks.workunit.client.1.smithi156.stdout:7/60: readlink l3 0 2024-04-23T14:49:43.346 INFO:tasks.workunit.client.0.smithi081.stdout:4/382: dwrite d1/f5b [4194304,4194304] 0 2024-04-23T14:49:43.346 INFO:tasks.workunit.client.0.smithi081.stdout:4/383: creat d1/d3/f82 x:0 0 0 2024-04-23T14:49:43.349 INFO:tasks.workunit.client.1.smithi156.stdout:4/40: truncate d0/d8/fd 741993 0 2024-04-23T14:49:43.358 INFO:tasks.workunit.client.0.smithi081.stdout:1/508: rename d3/l59 to d3/d3d/d41/d5e/d12/d2e/la1 0 2024-04-23T14:49:43.359 INFO:tasks.workunit.client.1.smithi156.stdout:7/61: rename dc/fd to dc/f11 0 2024-04-23T14:49:43.360 INFO:tasks.workunit.client.1.smithi156.stdout:4/41: mkdir d0/df 0 2024-04-23T14:49:43.360 INFO:tasks.workunit.client.1.smithi156.stdout:8/36: dread d5/f8 [0,4194304] 0 2024-04-23T14:49:43.363 INFO:tasks.workunit.client.1.smithi156.stdout:1/74: dwrite db/ff [0,4194304] 0 2024-04-23T14:49:43.363 INFO:tasks.workunit.client.1.smithi156.stdout:1/75: chown l9 8083010 1 2024-04-23T14:49:43.367 INFO:tasks.workunit.client.0.smithi081.stdout:3/354: unlink d4/d7/d32/c3c 0 2024-04-23T14:49:43.368 INFO:tasks.workunit.client.0.smithi081.stdout:3/355: readlink d4/dc/d31/l5d 0 2024-04-23T14:49:43.368 INFO:tasks.workunit.client.0.smithi081.stdout:3/356: dread - d4/d7/d49/d51/d53/d6c/f73 zero size 2024-04-23T14:49:43.371 INFO:tasks.workunit.client.0.smithi081.stdout:5/455: mkdir d17/d1f/d42/d9b/d9e/da3 0 2024-04-23T14:49:43.373 INFO:tasks.workunit.client.1.smithi156.stdout:2/44: symlink d4/lb 0 2024-04-23T14:49:43.377 INFO:tasks.workunit.client.1.smithi156.stdout:4/42: link d0/c7 d0/c10 0 2024-04-23T14:49:43.377 INFO:tasks.workunit.client.1.smithi156.stdout:4/43: truncate d0/d8/fd 1537505 0 2024-04-23T14:49:43.377 INFO:tasks.workunit.client.0.smithi081.stdout:8/622: mknod d3/d11/d86/d88/da7/cd4 0 2024-04-23T14:49:43.377 INFO:tasks.workunit.client.1.smithi156.stdout:1/76: write db/ff [3094107,17510] 0 2024-04-23T14:49:43.380 INFO:tasks.workunit.client.1.smithi156.stdout:8/37: creat d5/d9/fd x:0 0 0 2024-04-23T14:49:43.385 INFO:tasks.workunit.client.0.smithi081.stdout:0/522: getdents d6/d11/d14 0 2024-04-23T14:49:43.385 INFO:tasks.workunit.client.1.smithi156.stdout:3/35: dwrite f3 [0,4194304] 0 2024-04-23T14:49:43.390 INFO:tasks.workunit.client.0.smithi081.stdout:4/384: rename d1/d4/d11/f67 to d1/d4/dc/f83 0 2024-04-23T14:49:43.393 INFO:tasks.workunit.client.1.smithi156.stdout:2/45: chown d4/f7 268440710 1 2024-04-23T14:49:43.393 INFO:tasks.workunit.client.1.smithi156.stdout:3/36: dread f1 [0,4194304] 0 2024-04-23T14:49:43.394 INFO:tasks.workunit.client.0.smithi081.stdout:5/456: mkdir d17/d37/da4 0 2024-04-23T14:49:43.395 INFO:tasks.workunit.client.0.smithi081.stdout:5/457: dread - d17/d3d/d41/f82 zero size 2024-04-23T14:49:43.396 INFO:tasks.workunit.client.1.smithi156.stdout:9/38: dwrite d1/d2/d4/f8 [0,4194304] 0 2024-04-23T14:49:43.396 INFO:tasks.workunit.client.1.smithi156.stdout:9/39: rename d1 to d1/d2/d4/dc/dd 22 2024-04-23T14:49:43.396 INFO:tasks.workunit.client.1.smithi156.stdout:4/44: truncate d0/d8/fc 5226089 0 2024-04-23T14:49:43.398 INFO:tasks.workunit.client.0.smithi081.stdout:0/523: mknod d6/d37/d85/c9f 0 2024-04-23T14:49:43.398 INFO:tasks.workunit.client.0.smithi081.stdout:0/524: fdatasync d6/d37/d85/f8b 0 2024-04-23T14:49:43.399 INFO:tasks.workunit.client.0.smithi081.stdout:2/448: dwrite d1/d11/d21/d34/f72 [0,4194304] 0 2024-04-23T14:49:43.399 INFO:tasks.workunit.client.0.smithi081.stdout:2/449: stat d1/d11/f12 0 2024-04-23T14:49:43.399 INFO:tasks.workunit.client.0.smithi081.stdout:2/450: truncate d1/d11/d21/d52/f7b 282186 0 2024-04-23T14:49:43.399 INFO:tasks.workunit.client.0.smithi081.stdout:2/451: chown d1/d33/d45/d6e/d96/l54 473512 1 2024-04-23T14:49:43.400 INFO:tasks.workunit.client.1.smithi156.stdout:1/77: mkdir db/d13 0 2024-04-23T14:49:43.400 INFO:tasks.workunit.client.1.smithi156.stdout:1/78: readlink l8 0 2024-04-23T14:49:43.400 INFO:tasks.workunit.client.0.smithi081.stdout:5/458: mkdir d17/d1f/da5 0 2024-04-23T14:49:43.400 INFO:tasks.workunit.client.0.smithi081.stdout:5/459: write d17/d18/d3a/f71 [540054,92295] 0 2024-04-23T14:49:43.403 INFO:tasks.workunit.client.1.smithi156.stdout:9/40: creat d1/fe x:0 0 0 2024-04-23T14:49:43.411 INFO:tasks.workunit.client.1.smithi156.stdout:2/46: rename d4/f8 to d4/fc 0 2024-04-23T14:49:43.417 INFO:tasks.workunit.client.0.smithi081.stdout:5/460: rename d17/d3d/d41/f93 to d17/d3d/d7a/fa6 0 2024-04-23T14:49:43.418 INFO:tasks.workunit.client.0.smithi081.stdout:4/385: dread d1/d4/d11/f7f [4194304,4194304] 0 2024-04-23T14:49:43.418 INFO:tasks.workunit.client.0.smithi081.stdout:4/386: chown d1/d3/l19 193119 1 2024-04-23T14:49:43.420 INFO:tasks.workunit.client.1.smithi156.stdout:2/47: creat d4/fd x:0 0 0 2024-04-23T14:49:43.422 INFO:tasks.workunit.client.1.smithi156.stdout:7/62: dwrite f8 [0,4194304] 0 2024-04-23T14:49:43.422 INFO:tasks.workunit.client.0.smithi081.stdout:0/525: rmdir d6/d37/d4d/d71 39 2024-04-23T14:49:43.422 INFO:tasks.workunit.client.0.smithi081.stdout:0/526: chown d6/d11/d14/d41/d5b/d59/d68 87 1 2024-04-23T14:49:43.422 INFO:tasks.workunit.client.0.smithi081.stdout:8/623: dwrite d3/d11/d3e/d63/f94 [0,4194304] 0 2024-04-23T14:49:43.423 INFO:tasks.workunit.client.0.smithi081.stdout:8/624: write d3/fac [701694,62383] 0 2024-04-23T14:49:43.427 INFO:tasks.workunit.client.1.smithi156.stdout:4/45: rmdir d0 39 2024-04-23T14:49:43.427 INFO:tasks.workunit.client.1.smithi156.stdout:4/46: chown d0/l5 0 1 2024-04-23T14:49:43.428 INFO:tasks.workunit.client.0.smithi081.stdout:5/461: mknod d17/d65/ca7 0 2024-04-23T14:49:43.432 INFO:tasks.workunit.client.1.smithi156.stdout:1/79: dread db/f11 [0,4194304] 0 2024-04-23T14:49:43.439 INFO:tasks.workunit.client.0.smithi081.stdout:0/527: getdents d6/d11/d14/d41/d5b/d3f/d44/d78/d83 0 2024-04-23T14:49:43.444 INFO:tasks.workunit.client.0.smithi081.stdout:5/462: truncate f12 4601525 0 2024-04-23T14:49:43.444 INFO:tasks.workunit.client.0.smithi081.stdout:5/463: stat d17/d18/f32 0 2024-04-23T14:49:43.444 INFO:tasks.workunit.client.0.smithi081.stdout:5/464: write d17/f38 [717912,8184] 0 2024-04-23T14:49:43.455 INFO:tasks.workunit.client.0.smithi081.stdout:5/465: rmdir d17/d65 39 2024-04-23T14:49:43.455 INFO:tasks.workunit.client.0.smithi081.stdout:5/466: chown d17/d4a 5930745 1 2024-04-23T14:49:43.461 INFO:tasks.workunit.client.1.smithi156.stdout:2/48: rename d4/fc to d4/fe 0 2024-04-23T14:49:43.473 INFO:tasks.workunit.client.0.smithi081.stdout:0/528: dread d6/d37/f5c [0,4194304] 0 2024-04-23T14:49:43.473 INFO:tasks.workunit.client.0.smithi081.stdout:0/529: creat d6/d69/fa0 x:0 0 0 2024-04-23T14:49:43.474 INFO:tasks.workunit.client.1.smithi156.stdout:3/37: dwrite f1 [0,4194304] 0 2024-04-23T14:49:43.474 INFO:tasks.workunit.client.1.smithi156.stdout:3/38: fsync f3 0 2024-04-23T14:49:43.475 INFO:tasks.workunit.client.1.smithi156.stdout:8/38: dwrite d5/fc [4194304,4194304] 0 2024-04-23T14:49:43.477 INFO:tasks.workunit.client.0.smithi081.stdout:0/530: truncate d6/d11/d14/d41/d5b/d59/d68/f74 4105818 0 2024-04-23T14:49:43.477 INFO:tasks.workunit.client.0.smithi081.stdout:4/387: dread d1/d4/dc/f21 [0,4194304] 0 2024-04-23T14:49:43.480 INFO:tasks.workunit.client.0.smithi081.stdout:0/531: rmdir d6/d11/d14/d41/d5b/d3f/d44/d78/d84 39 2024-04-23T14:49:43.484 INFO:tasks.workunit.client.1.smithi156.stdout:2/49: write d4/f7 [1424354,35857] 0 2024-04-23T14:49:43.484 INFO:tasks.workunit.client.0.smithi081.stdout:8/625: dwrite d3/d11/d4f/d66/f79 [0,4194304] 0 2024-04-23T14:49:43.485 INFO:tasks.workunit.client.1.smithi156.stdout:8/39: rmdir d5/d9 39 2024-04-23T14:49:43.485 INFO:tasks.workunit.client.0.smithi081.stdout:4/388: mknod d1/d4/c84 0 2024-04-23T14:49:43.486 INFO:tasks.workunit.client.0.smithi081.stdout:0/532: mkdir d6/d11/d14/d41/da1 0 2024-04-23T14:49:43.486 INFO:tasks.workunit.client.0.smithi081.stdout:0/533: chown d6/d37/d4d/f55 840 1 2024-04-23T14:49:43.489 INFO:tasks.workunit.client.1.smithi156.stdout:1/80: dwrite db/ff [4194304,4194304] 0 2024-04-23T14:49:43.492 INFO:tasks.workunit.client.1.smithi156.stdout:2/50: rename d4/fd to d4/ff 0 2024-04-23T14:49:43.498 INFO:tasks.workunit.client.0.smithi081.stdout:8/626: mkdir d3/d11/d86/d88/dd5 0 2024-04-23T14:49:43.505 INFO:tasks.workunit.client.1.smithi156.stdout:3/39: read f3 [1829725,24161] 0 2024-04-23T14:49:43.508 INFO:tasks.workunit.client.0.smithi081.stdout:4/389: unlink d1/d1d/f42 0 2024-04-23T14:49:43.512 INFO:tasks.workunit.client.1.smithi156.stdout:5/62: sync 2024-04-23T14:49:43.512 INFO:tasks.workunit.client.1.smithi156.stdout:0/41: sync 2024-04-23T14:49:43.512 INFO:tasks.workunit.client.1.smithi156.stdout:5/63: stat d1/d3/fa 0 2024-04-23T14:49:43.514 INFO:tasks.workunit.client.1.smithi156.stdout:6/41: sync 2024-04-23T14:49:43.515 INFO:tasks.workunit.client.1.smithi156.stdout:8/40: write d5/f8 [3892471,10631] 0 2024-04-23T14:49:43.515 INFO:tasks.workunit.client.1.smithi156.stdout:8/41: chown d5/f8 555 1 2024-04-23T14:49:43.515 INFO:tasks.workunit.client.1.smithi156.stdout:8/42: chown d5 6203 1 2024-04-23T14:49:43.515 INFO:tasks.workunit.client.0.smithi081.stdout:4/390: creat d1/d1d/d59/f85 x:0 0 0 2024-04-23T14:49:43.515 INFO:tasks.workunit.client.0.smithi081.stdout:4/391: write d1/d1d/f20 [3573358,107032] 0 2024-04-23T14:49:43.517 INFO:tasks.workunit.client.0.smithi081.stdout:8/627: dread d3/d3c/f89 [0,4194304] 0 2024-04-23T14:49:43.519 INFO:tasks.workunit.client.1.smithi156.stdout:7/63: dwrite dc/f10 [0,4194304] 0 2024-04-23T14:49:43.519 INFO:tasks.workunit.client.1.smithi156.stdout:7/64: write fb [878948,95811] 0 2024-04-23T14:49:43.520 INFO:tasks.workunit.client.0.smithi081.stdout:5/467: dwrite d17/d4f/f7c [0,4194304] 0 2024-04-23T14:49:43.520 INFO:tasks.workunit.client.0.smithi081.stdout:5/468: write d17/d3d/d41/f6a [625517,54021] 0 2024-04-23T14:49:43.521 INFO:tasks.workunit.client.1.smithi156.stdout:5/64: mkdir d1/d17 0 2024-04-23T14:49:43.521 INFO:tasks.workunit.client.1.smithi156.stdout:3/40: truncate f1 1805813 0 2024-04-23T14:49:43.521 INFO:tasks.workunit.client.0.smithi081.stdout:2/452: dwrite d1/d1e/f98 [0,4194304] 0 2024-04-23T14:49:43.523 INFO:tasks.workunit.client.1.smithi156.stdout:4/47: dwrite d0/d8/fd [0,4194304] 0 2024-04-23T14:49:43.523 INFO:tasks.workunit.client.1.smithi156.stdout:6/42: mkdir d3/da/d10 0 2024-04-23T14:49:43.524 INFO:tasks.workunit.client.0.smithi081.stdout:8/628: link d3/d11/d3e/d63/d78/f8e d3/fd6 0 2024-04-23T14:49:43.526 INFO:tasks.workunit.client.0.smithi081.stdout:4/392: mkdir d1/d1d/d59/d86 0 2024-04-23T14:49:43.526 INFO:tasks.workunit.client.1.smithi156.stdout:8/43: unlink d5/fc 0 2024-04-23T14:49:43.528 INFO:tasks.workunit.client.1.smithi156.stdout:5/65: dread d1/f9 [0,4194304] 0 2024-04-23T14:49:43.528 INFO:tasks.workunit.client.1.smithi156.stdout:5/66: read d1/d3/f5 [3354075,39281] 0 2024-04-23T14:49:43.530 INFO:tasks.workunit.client.1.smithi156.stdout:2/51: rmdir d4 39 2024-04-23T14:49:43.536 INFO:tasks.workunit.client.0.smithi081.stdout:8/629: rename d3/d11/d3e/d63/d78/f8e to d3/d11/d4f/d58/fd7 0 2024-04-23T14:49:43.539 INFO:tasks.workunit.client.0.smithi081.stdout:4/393: mkdir d1/d4f/d87 0 2024-04-23T14:49:43.541 INFO:tasks.workunit.client.1.smithi156.stdout:6/43: write d3/f8 [3242387,114584] 0 2024-04-23T14:49:43.546 INFO:tasks.workunit.client.0.smithi081.stdout:2/453: dread d1/d33/d45/d6e/f8e [0,4194304] 0 2024-04-23T14:49:43.547 INFO:tasks.workunit.client.0.smithi081.stdout:2/454: creat d1/d33/d45/d6e/f9d x:0 0 0 2024-04-23T14:49:43.548 INFO:tasks.workunit.client.0.smithi081.stdout:2/455: readlink d1/d11/d21/d52/l59 0 2024-04-23T14:49:43.548 INFO:tasks.workunit.client.0.smithi081.stdout:2/456: readlink d1/d1e/l68 0 2024-04-23T14:49:43.549 INFO:tasks.workunit.client.1.smithi156.stdout:7/65: read dc/f10 [1550428,81095] 0 2024-04-23T14:49:43.549 INFO:tasks.workunit.client.1.smithi156.stdout:7/66: chown dc/f10 66 1 2024-04-23T14:49:43.549 INFO:tasks.workunit.client.1.smithi156.stdout:4/48: rmdir d0 39 2024-04-23T14:49:43.549 INFO:tasks.workunit.client.1.smithi156.stdout:8/44: symlink d5/d9/le 0 2024-04-23T14:49:43.549 INFO:tasks.workunit.client.1.smithi156.stdout:8/45: chown d5/f8 3671528 1 2024-04-23T14:49:43.549 INFO:tasks.workunit.client.1.smithi156.stdout:8/46: chown d5/d9/le 358 1 2024-04-23T14:49:43.549 INFO:tasks.workunit.client.1.smithi156.stdout:3/41: truncate f3 963135 0 2024-04-23T14:49:43.550 INFO:tasks.workunit.client.0.smithi081.stdout:4/394: rmdir d1/d1d/d39 39 2024-04-23T14:49:43.551 INFO:tasks.workunit.client.0.smithi081.stdout:4/395: chown d1/d1d/d39/c72 1 1 2024-04-23T14:49:43.551 INFO:tasks.workunit.client.1.smithi156.stdout:2/52: dread d4/fe [0,4194304] 0 2024-04-23T14:49:43.551 INFO:tasks.workunit.client.1.smithi156.stdout:2/53: write d4/f7 [1816788,22612] 0 2024-04-23T14:49:43.552 INFO:tasks.workunit.client.0.smithi081.stdout:5/469: dread d17/d1f/d36/d59/f63 [0,4194304] 0 2024-04-23T14:49:43.552 INFO:tasks.workunit.client.0.smithi081.stdout:5/470: chown d17/d1f/d36/d9a 237970976 1 2024-04-23T14:49:43.552 INFO:tasks.workunit.client.1.smithi156.stdout:5/67: mkdir d1/d11/d18 0 2024-04-23T14:49:43.552 INFO:tasks.workunit.client.1.smithi156.stdout:5/68: write d1/d3/f5 [4597859,10048] 0 2024-04-23T14:49:43.557 INFO:tasks.workunit.client.0.smithi081.stdout:2/457: unlink d1/d11/d21/l78 0 2024-04-23T14:49:43.559 INFO:tasks.workunit.client.1.smithi156.stdout:7/67: link dc/lf dc/l12 0 2024-04-23T14:49:43.560 INFO:tasks.workunit.client.0.smithi081.stdout:8/630: dread d3/d11/d86/d88/da7/fae [0,4194304] 0 2024-04-23T14:49:43.561 INFO:tasks.workunit.client.1.smithi156.stdout:5/69: dread d1/d3/fa [0,4194304] 0 2024-04-23T14:49:43.562 INFO:tasks.workunit.client.1.smithi156.stdout:6/44: write d3/fd [1462190,35632] 0 2024-04-23T14:49:43.562 INFO:tasks.workunit.client.1.smithi156.stdout:6/45: creat d3/f11 x:0 0 0 2024-04-23T14:49:43.565 INFO:tasks.workunit.client.0.smithi081.stdout:4/396: creat d1/d4/d11/d75/f88 x:0 0 0 2024-04-23T14:49:43.565 INFO:tasks.workunit.client.0.smithi081.stdout:4/397: chown d1/d4f 83098 1 2024-04-23T14:49:43.565 INFO:tasks.workunit.client.0.smithi081.stdout:5/471: mkdir d17/d1f/d36/d59/da8 0 2024-04-23T14:49:43.566 INFO:tasks.workunit.client.0.smithi081.stdout:5/472: write d17/d3d/d41/f5e [222726,107994] 0 2024-04-23T14:49:43.567 INFO:tasks.workunit.client.0.smithi081.stdout:4/398: write d1/d4/dc/f83 [203950,112575] 0 2024-04-23T14:49:43.569 INFO:tasks.workunit.client.0.smithi081.stdout:2/458: symlink d1/d33/d45/d48/l9e 0 2024-04-23T14:49:43.573 INFO:tasks.workunit.client.0.smithi081.stdout:8/631: rename d3/d11/fd0 to d3/d11/d4f/fd8 0 2024-04-23T14:49:43.578 INFO:tasks.workunit.client.1.smithi156.stdout:5/70: mkdir d1/d11/d18/d19 0 2024-04-23T14:49:43.585 INFO:tasks.workunit.client.0.smithi081.stdout:4/399: mkdir d1/d3/d89 0 2024-04-23T14:49:43.585 INFO:tasks.workunit.client.1.smithi156.stdout:9/41: sync 2024-04-23T14:49:43.590 INFO:tasks.workunit.client.1.smithi156.stdout:6/46: creat d3/da/d10/f12 x:0 0 0 2024-04-23T14:49:43.590 INFO:tasks.workunit.client.1.smithi156.stdout:6/47: stat d3/c5 0 2024-04-23T14:49:43.592 INFO:tasks.workunit.client.0.smithi081.stdout:4/400: getdents d1/d4f 0 2024-04-23T14:49:43.595 INFO:tasks.workunit.client.1.smithi156.stdout:2/54: rename d4/ff to d4/f10 0 2024-04-23T14:49:43.597 INFO:tasks.workunit.client.0.smithi081.stdout:2/459: mkdir d1/d33/d9f 0 2024-04-23T14:49:43.601 INFO:tasks.workunit.client.1.smithi156.stdout:7/68: getdents dc 0 2024-04-23T14:49:43.602 INFO:tasks.workunit.client.1.smithi156.stdout:7/69: write f8 [4503795,37801] 0 2024-04-23T14:49:43.602 INFO:tasks.workunit.client.0.smithi081.stdout:4/401: truncate d1/f44 3212757 0 2024-04-23T14:49:43.603 INFO:tasks.workunit.client.1.smithi156.stdout:4/49: rename d0/d8/ce to d0/df/c11 0 2024-04-23T14:49:43.603 INFO:tasks.workunit.client.1.smithi156.stdout:4/50: readlink d0/l5 0 2024-04-23T14:49:43.604 INFO:tasks.workunit.client.0.smithi081.stdout:5/473: dread d17/f2c [0,4194304] 0 2024-04-23T14:49:43.605 INFO:tasks.workunit.client.1.smithi156.stdout:5/71: truncate d1/d3/fa 228644 0 2024-04-23T14:49:43.609 INFO:tasks.workunit.client.1.smithi156.stdout:9/42: link d1/fe d1/d2/d4/ff 0 2024-04-23T14:49:43.609 INFO:tasks.workunit.client.1.smithi156.stdout:9/43: chown d1/d2/d4/f8 3325 1 2024-04-23T14:49:43.609 INFO:tasks.workunit.client.1.smithi156.stdout:6/48: mknod d3/da/d10/c13 0 2024-04-23T14:49:43.609 INFO:tasks.workunit.client.1.smithi156.stdout:6/49: creat d3/da/d10/f14 x:0 0 0 2024-04-23T14:49:43.612 INFO:tasks.workunit.client.1.smithi156.stdout:2/55: chown d4/l6 1803927 1 2024-04-23T14:49:43.613 INFO:tasks.workunit.client.1.smithi156.stdout:7/70: stat dc/lf 0 2024-04-23T14:49:43.614 INFO:tasks.workunit.client.1.smithi156.stdout:8/47: dwrite d5/d9/fd [0,4194304] 0 2024-04-23T14:49:43.615 INFO:tasks.workunit.client.1.smithi156.stdout:8/48: chown l0 128 1 2024-04-23T14:49:43.617 INFO:tasks.workunit.client.1.smithi156.stdout:3/42: rename l0 to d4/l6 0 2024-04-23T14:49:43.622 INFO:tasks.workunit.client.1.smithi156.stdout:4/51: mknod d0/df/c12 0 2024-04-23T14:49:43.622 INFO:tasks.workunit.client.1.smithi156.stdout:4/52: fsync d0/f3 0 2024-04-23T14:49:43.622 INFO:tasks.workunit.client.0.smithi081.stdout:4/402: write d1/d4/f5d [3693914,49823] 0 2024-04-23T14:49:43.628 INFO:tasks.workunit.client.1.smithi156.stdout:7/71: mknod dc/c13 0 2024-04-23T14:49:43.628 INFO:tasks.workunit.client.1.smithi156.stdout:7/72: truncate dc/f11 809799 0 2024-04-23T14:49:43.628 INFO:tasks.workunit.client.0.smithi081.stdout:4/403: rmdir d1 39 2024-04-23T14:49:43.633 INFO:tasks.workunit.client.0.smithi081.stdout:4/404: getdents d1/d1d/d59 0 2024-04-23T14:49:43.633 INFO:tasks.workunit.client.0.smithi081.stdout:4/405: stat d1/d1d/f51 0 2024-04-23T14:49:43.636 INFO:tasks.workunit.client.0.smithi081.stdout:4/406: creat d1/f8a x:0 0 0 2024-04-23T14:49:43.637 INFO:tasks.workunit.client.0.smithi081.stdout:4/407: mkdir d1/d8b 0 2024-04-23T14:49:43.639 INFO:tasks.workunit.client.1.smithi156.stdout:8/49: truncate d5/f8 2149942 0 2024-04-23T14:49:43.639 INFO:tasks.workunit.client.1.smithi156.stdout:9/44: getdents d1/d2 0 2024-04-23T14:49:43.640 INFO:tasks.workunit.client.0.smithi081.stdout:8/632: dwrite d3/f2c [0,4194304] 0 2024-04-23T14:49:43.641 INFO:tasks.workunit.client.1.smithi156.stdout:2/56: link d4/ca d4/c11 0 2024-04-23T14:49:43.641 INFO:tasks.workunit.client.1.smithi156.stdout:2/57: chown d4/ca 935828702 1 2024-04-23T14:49:43.642 INFO:tasks.workunit.client.1.smithi156.stdout:8/50: creat d5/d9/ff x:0 0 0 2024-04-23T14:49:43.643 INFO:tasks.workunit.client.1.smithi156.stdout:4/53: mknod d0/d8/c13 0 2024-04-23T14:49:43.643 INFO:tasks.workunit.client.0.smithi081.stdout:8/633: mknod d3/d11/d4f/d6c/cd9 0 2024-04-23T14:49:43.643 INFO:tasks.workunit.client.0.smithi081.stdout:8/634: write d3/d3c/fa9 [980607,52834] 0 2024-04-23T14:49:43.646 INFO:tasks.workunit.client.1.smithi156.stdout:5/72: dread d1/d3/fd [0,4194304] 0 2024-04-23T14:49:43.649 INFO:tasks.workunit.client.1.smithi156.stdout:2/58: rename d4/l9 to d4/l12 0 2024-04-23T14:49:43.650 INFO:tasks.workunit.client.1.smithi156.stdout:5/73: getdents d1/d11 0 2024-04-23T14:49:43.651 INFO:tasks.workunit.client.1.smithi156.stdout:2/59: mkdir d4/d13 0 2024-04-23T14:49:43.652 INFO:tasks.workunit.client.1.smithi156.stdout:2/60: fdatasync f2 0 2024-04-23T14:49:43.661 INFO:tasks.workunit.client.1.smithi156.stdout:9/45: dread d1/d2/d4/f8 [0,4194304] 0 2024-04-23T14:49:43.661 INFO:tasks.workunit.client.1.smithi156.stdout:9/46: read - d1/fe zero size 2024-04-23T14:49:43.661 INFO:tasks.workunit.client.1.smithi156.stdout:6/50: dwrite d3/da/d10/f14 [0,4194304] 0 2024-04-23T14:49:43.665 INFO:tasks.workunit.client.1.smithi156.stdout:5/74: dread d1/d3/fd [0,4194304] 0 2024-04-23T14:49:43.665 INFO:tasks.workunit.client.1.smithi156.stdout:5/75: getdents d1/d11 0 2024-04-23T14:49:43.665 INFO:tasks.workunit.client.1.smithi156.stdout:5/76: read d1/d3/fd [817882,71612] 0 2024-04-23T14:49:43.665 INFO:tasks.workunit.client.1.smithi156.stdout:5/77: write d1/d3/fa [374637,35239] 0 2024-04-23T14:49:43.667 INFO:tasks.workunit.client.0.smithi081.stdout:8/635: dread d3/f31 [0,4194304] 0 2024-04-23T14:49:43.668 INFO:tasks.workunit.client.1.smithi156.stdout:9/47: mknod d1/d2/c10 0 2024-04-23T14:49:43.669 INFO:tasks.workunit.client.0.smithi081.stdout:8/636: rename d3/f9d to d3/d11/d3e/d63/d78/fda 0 2024-04-23T14:49:43.676 INFO:tasks.workunit.client.1.smithi156.stdout:6/51: read d3/da/d10/f14 [2477058,80653] 0 2024-04-23T14:49:43.677 INFO:tasks.workunit.client.1.smithi156.stdout:6/52: mknod d3/da/d10/c15 0 2024-04-23T14:49:43.679 INFO:tasks.workunit.client.1.smithi156.stdout:6/53: mkdir d3/d16 0 2024-04-23T14:49:43.679 INFO:tasks.workunit.client.1.smithi156.stdout:6/54: write d3/fd [3532934,116238] 0 2024-04-23T14:49:43.679 INFO:tasks.workunit.client.1.smithi156.stdout:6/55: chown d3/c9 4758474 1 2024-04-23T14:49:43.681 INFO:tasks.workunit.client.1.smithi156.stdout:6/56: mknod d3/da/d10/c17 0 2024-04-23T14:49:43.681 INFO:tasks.workunit.client.1.smithi156.stdout:6/57: fdatasync d3/da/d10/f12 0 2024-04-23T14:49:43.681 INFO:tasks.workunit.client.1.smithi156.stdout:6/58: truncate d3/da/d10/f12 17134 0 2024-04-23T14:49:43.743 INFO:tasks.workunit.client.1.smithi156.stdout:9/48: dwrite d1/fe [0,4194304] 0 2024-04-23T14:49:43.750 INFO:tasks.workunit.client.1.smithi156.stdout:5/78: dwrite d1/d3/fa [0,4194304] 0 2024-04-23T14:49:43.752 INFO:tasks.workunit.client.1.smithi156.stdout:5/79: getdents d1 0 2024-04-23T14:49:43.754 INFO:tasks.workunit.client.1.smithi156.stdout:5/80: creat d1/d17/f1a x:0 0 0 2024-04-23T14:49:43.755 INFO:tasks.workunit.client.1.smithi156.stdout:5/81: symlink d1/d17/l1b 0 2024-04-23T14:49:43.778 INFO:tasks.workunit.client.1.smithi156.stdout:5/82: write d1/d3/f5 [10680401,109185] 0 2024-04-23T14:49:43.778 INFO:tasks.workunit.client.1.smithi156.stdout:5/83: truncate d1/d3/fd 1531003 0 2024-04-23T14:49:43.781 INFO:tasks.workunit.client.1.smithi156.stdout:5/84: symlink d1/d11/l1c 0 2024-04-23T14:49:43.783 INFO:tasks.workunit.client.1.smithi156.stdout:5/85: symlink d1/d11/d18/d19/l1d 0 2024-04-23T14:49:43.783 INFO:tasks.workunit.client.1.smithi156.stdout:5/86: write d1/d17/f1a [984670,45219] 0 2024-04-23T14:49:43.783 INFO:tasks.workunit.client.1.smithi156.stdout:5/87: stat d1 0 2024-04-23T14:49:43.783 INFO:tasks.workunit.client.1.smithi156.stdout:5/88: chown d1/d11/l1c 2452 1 2024-04-23T14:49:43.786 INFO:tasks.workunit.client.1.smithi156.stdout:5/89: rename d1/f9 to d1/d3/f1e 0 2024-04-23T14:49:43.809 INFO:tasks.workunit.client.1.smithi156.stdout:3/43: unlink d4/l6 0 2024-04-23T14:49:43.812 INFO:tasks.workunit.client.0.smithi081.stdout:4/408: truncate d1/d1d/f20 666160 0 2024-04-23T14:49:43.812 INFO:tasks.workunit.client.0.smithi081.stdout:4/409: fsync d1/f29 0 2024-04-23T14:49:43.812 INFO:tasks.workunit.client.0.smithi081.stdout:4/410: chown d1/d4/dc/f6a 165 1 2024-04-23T14:49:43.813 INFO:tasks.workunit.client.0.smithi081.stdout:4/411: dread - d1/d3/f41 zero size 2024-04-23T14:49:43.814 INFO:tasks.workunit.client.1.smithi156.stdout:5/90: read d1/d3/fa [893726,124315] 0 2024-04-23T14:49:43.814 INFO:tasks.workunit.client.1.smithi156.stdout:5/91: fsync d1/d11/f13 0 2024-04-23T14:49:43.817 INFO:tasks.workunit.client.1.smithi156.stdout:3/44: symlink d4/l7 0 2024-04-23T14:49:43.819 INFO:tasks.workunit.client.1.smithi156.stdout:5/92: mknod d1/d3/c1f 0 2024-04-23T14:49:43.820 INFO:tasks.workunit.client.1.smithi156.stdout:3/45: rename d4/l7 to d4/l8 0 2024-04-23T14:49:43.821 INFO:tasks.workunit.client.1.smithi156.stdout:3/46: write f3 [1514213,88649] 0 2024-04-23T14:49:43.822 INFO:tasks.workunit.client.1.smithi156.stdout:5/93: mkdir d1/d3/d20 0 2024-04-23T14:49:43.825 INFO:tasks.workunit.client.1.smithi156.stdout:0/42: sync 2024-04-23T14:49:43.826 INFO:tasks.workunit.client.1.smithi156.stdout:0/43: write d0/d8/f6 [2322711,63814] 0 2024-04-23T14:49:43.828 INFO:tasks.workunit.client.0.smithi081.stdout:4/412: dread d1/f12 [0,4194304] 0 2024-04-23T14:49:43.830 INFO:tasks.workunit.client.1.smithi156.stdout:1/81: sync 2024-04-23T14:49:43.837 INFO:tasks.workunit.client.1.smithi156.stdout:8/51: getdents d5/d9 0 2024-04-23T14:49:43.838 INFO:tasks.workunit.client.1.smithi156.stdout:8/52: mkdir d5/d9/d10 0 2024-04-23T14:49:43.840 INFO:tasks.workunit.client.1.smithi156.stdout:8/53: creat d5/d9/d10/f11 x:0 0 0 2024-04-23T14:49:43.840 INFO:tasks.workunit.client.1.smithi156.stdout:8/54: creat d5/d9/d10/f12 x:0 0 0 2024-04-23T14:49:43.840 INFO:tasks.workunit.client.1.smithi156.stdout:8/55: chown d5/d9/d10 250377 1 2024-04-23T14:49:43.843 INFO:tasks.workunit.client.1.smithi156.stdout:8/56: creat d5/d9/f13 x:0 0 0 2024-04-23T14:49:43.845 INFO:tasks.workunit.client.1.smithi156.stdout:8/57: link d5/f8 d5/f14 0 2024-04-23T14:49:43.848 INFO:tasks.workunit.client.1.smithi156.stdout:3/47: dread f1 [0,4194304] 0 2024-04-23T14:49:43.848 INFO:tasks.workunit.client.1.smithi156.stdout:6/59: truncate d3/fd 371040 0 2024-04-23T14:49:43.848 INFO:tasks.workunit.client.0.smithi081.stdout:8/637: dwrite d3/d11/d3e/fbb [0,4194304] 0 2024-04-23T14:49:43.849 INFO:tasks.workunit.client.1.smithi156.stdout:8/58: rename d5/d9/ff to d5/f15 0 2024-04-23T14:49:43.851 INFO:tasks.workunit.client.1.smithi156.stdout:9/49: dwrite d1/d2/d4/f8 [0,4194304] 0 2024-04-23T14:49:43.860 INFO:tasks.workunit.client.1.smithi156.stdout:1/82: dread db/ff [4194304,4194304] 0 2024-04-23T14:49:43.860 INFO:tasks.workunit.client.1.smithi156.stdout:3/48: dread f1 [0,4194304] 0 2024-04-23T14:49:43.861 INFO:tasks.workunit.client.1.smithi156.stdout:1/83: symlink db/d13/l14 0 2024-04-23T14:49:43.861 INFO:tasks.workunit.client.1.smithi156.stdout:1/84: truncate db/f11 1137433 0 2024-04-23T14:49:43.861 INFO:tasks.workunit.client.1.smithi156.stdout:1/85: chown db/ld 4027442 1 2024-04-23T14:49:43.872 INFO:tasks.workunit.client.0.smithi081.stdout:8/638: dread d3/d11/d48/f69 [0,4194304] 0 2024-04-23T14:49:43.879 INFO:tasks.workunit.client.0.smithi081.stdout:4/413: dwrite d1/f1e [0,4194304] 0 2024-04-23T14:49:43.883 INFO:tasks.workunit.client.1.smithi156.stdout:9/50: dread d1/d2/d4/f8 [0,4194304] 0 2024-04-23T14:49:43.884 INFO:tasks.workunit.client.1.smithi156.stdout:0/44: dwrite d0/f7 [0,4194304] 0 2024-04-23T14:49:43.884 INFO:tasks.workunit.client.0.smithi081.stdout:4/414: truncate d1/d1d/f52 2586691 0 2024-04-23T14:49:43.888 INFO:tasks.workunit.client.0.smithi081.stdout:4/415: truncate d1/d1d/d39/f3c 1170478 0 2024-04-23T14:49:43.889 INFO:tasks.workunit.client.0.smithi081.stdout:4/416: write d1/fa [108308,5388] 0 2024-04-23T14:49:43.894 INFO:tasks.workunit.client.0.smithi081.stdout:4/417: mkdir d1/d3/d8c 0 2024-04-23T14:49:43.894 INFO:tasks.workunit.client.0.smithi081.stdout:4/418: write d1/d4/f38 [853766,37013] 0 2024-04-23T14:49:43.895 INFO:tasks.workunit.client.1.smithi156.stdout:9/51: write d1/d2/d4/f8 [2809139,45369] 0 2024-04-23T14:49:43.896 INFO:tasks.workunit.client.1.smithi156.stdout:9/52: write d1/d2/d4/f8 [512588,79942] 0 2024-04-23T14:49:43.896 INFO:tasks.workunit.client.1.smithi156.stdout:9/53: fdatasync d1/d2/d4/ff 0 2024-04-23T14:49:43.897 INFO:tasks.workunit.client.1.smithi156.stdout:0/45: rmdir d0 39 2024-04-23T14:49:43.899 INFO:tasks.workunit.client.1.smithi156.stdout:9/54: rename d1/d2/c10 to d1/d2/c11 0 2024-04-23T14:49:43.900 INFO:tasks.workunit.client.1.smithi156.stdout:0/46: rmdir d0/d8 39 2024-04-23T14:49:43.903 INFO:tasks.workunit.client.1.smithi156.stdout:0/47: symlink d0/d8/lc 0 2024-04-23T14:49:43.909 INFO:tasks.workunit.client.1.smithi156.stdout:1/86: rename db/d13 to db/d15 0 2024-04-23T14:49:43.909 INFO:tasks.workunit.client.1.smithi156.stdout:1/87: readlink db/ld 0 2024-04-23T14:49:43.912 INFO:tasks.workunit.client.1.smithi156.stdout:0/48: link d0/d4/lb d0/d8/ld 0 2024-04-23T14:49:43.918 INFO:tasks.workunit.client.1.smithi156.stdout:7/73: dwrite f8 [0,4194304] 0 2024-04-23T14:49:43.920 INFO:tasks.workunit.client.1.smithi156.stdout:8/59: truncate d5/f14 10622 0 2024-04-23T14:49:43.920 INFO:tasks.workunit.client.1.smithi156.stdout:6/60: dread d3/fd [0,4194304] 0 2024-04-23T14:49:43.920 INFO:tasks.workunit.client.1.smithi156.stdout:6/61: creat d3/da/f18 x:0 0 0 2024-04-23T14:49:43.920 INFO:tasks.workunit.client.1.smithi156.stdout:6/62: readlink d3/lc 0 2024-04-23T14:49:43.927 INFO:tasks.workunit.client.1.smithi156.stdout:3/49: dwrite f3 [0,4194304] 0 2024-04-23T14:49:43.929 INFO:tasks.workunit.client.1.smithi156.stdout:7/74: creat dc/f14 x:0 0 0 2024-04-23T14:49:43.931 INFO:tasks.workunit.client.1.smithi156.stdout:8/60: rename l0 to d5/l16 0 2024-04-23T14:49:43.943 INFO:tasks.workunit.client.1.smithi156.stdout:8/61: symlink d5/d9/d10/l17 0 2024-04-23T14:49:43.943 INFO:tasks.workunit.client.1.smithi156.stdout:4/54: sync 2024-04-23T14:49:43.943 INFO:tasks.workunit.client.1.smithi156.stdout:4/55: chown d0/l5 3347 1 2024-04-23T14:49:43.944 INFO:tasks.workunit.client.1.smithi156.stdout:2/61: sync 2024-04-23T14:49:43.944 INFO:tasks.workunit.client.1.smithi156.stdout:1/88: write db/ff [6372617,100609] 0 2024-04-23T14:49:43.944 INFO:tasks.workunit.client.1.smithi156.stdout:2/62: fdatasync f0 0 2024-04-23T14:49:43.946 INFO:tasks.workunit.client.0.smithi081.stdout:8/639: dwrite d3/d11/d48/f69 [0,4194304] 0 2024-04-23T14:49:43.952 INFO:tasks.workunit.client.1.smithi156.stdout:2/63: rename d4/f10 to d4/d13/f14 0 2024-04-23T14:49:43.952 INFO:tasks.workunit.client.1.smithi156.stdout:2/64: write d4/d13/f14 [914112,88635] 0 2024-04-23T14:49:43.952 INFO:tasks.workunit.client.1.smithi156.stdout:2/65: write d4/fe [2045556,82807] 0 2024-04-23T14:49:43.952 INFO:tasks.workunit.client.1.smithi156.stdout:4/56: creat d0/df/f14 x:0 0 0 2024-04-23T14:49:43.953 INFO:tasks.workunit.client.1.smithi156.stdout:4/57: write d0/df/f14 [970536,67804] 0 2024-04-23T14:49:43.953 INFO:tasks.workunit.client.1.smithi156.stdout:5/94: dwrite d1/d3/f5 [8388608,4194304] 0 2024-04-23T14:49:43.953 INFO:tasks.workunit.client.1.smithi156.stdout:0/49: dread d0/d8/f6 [0,4194304] 0 2024-04-23T14:49:43.966 INFO:tasks.workunit.client.1.smithi156.stdout:3/50: truncate f3 942452 0 2024-04-23T14:49:43.973 INFO:tasks.workunit.client.0.smithi081.stdout:4/419: dwrite d1/f8a [0,4194304] 0 2024-04-23T14:49:43.973 INFO:tasks.workunit.client.0.smithi081.stdout:4/420: chown d1/d4/f76 18 1 2024-04-23T14:49:43.973 INFO:tasks.workunit.client.1.smithi156.stdout:8/62: write d5/d9/fd [123694,117443] 0 2024-04-23T14:49:43.974 INFO:tasks.workunit.client.0.smithi081.stdout:4/421: truncate d1/d1d/d39/f3b 256171 0 2024-04-23T14:49:43.974 INFO:tasks.workunit.client.0.smithi081.stdout:4/422: truncate d1/d4/dc/f6e 8367 0 2024-04-23T14:49:43.975 INFO:tasks.workunit.client.0.smithi081.stdout:4/423: write d1/d1d/d39/f48 [999212,49618] 0 2024-04-23T14:49:43.975 INFO:tasks.workunit.client.1.smithi156.stdout:8/63: mknod d5/c18 0 2024-04-23T14:49:43.985 INFO:tasks.workunit.client.1.smithi156.stdout:8/64: mkdir d5/d19 0 2024-04-23T14:49:43.986 INFO:tasks.workunit.client.0.smithi081.stdout:4/424: dread d1/d4/f23 [0,4194304] 0 2024-04-23T14:49:43.987 INFO:tasks.workunit.client.1.smithi156.stdout:8/65: creat d5/f1a x:0 0 0 2024-04-23T14:49:43.988 INFO:tasks.workunit.client.1.smithi156.stdout:3/51: write f3 [959,103259] 0 2024-04-23T14:49:43.989 INFO:tasks.workunit.client.1.smithi156.stdout:7/75: dread dc/f11 [0,4194304] 0 2024-04-23T14:49:43.989 INFO:tasks.workunit.client.1.smithi156.stdout:7/76: chown l7 215808 1 2024-04-23T14:49:43.990 INFO:tasks.workunit.client.1.smithi156.stdout:8/66: link d5/l16 d5/d9/l1b 0 2024-04-23T14:49:43.990 INFO:tasks.workunit.client.1.smithi156.stdout:3/52: symlink d4/l9 0 2024-04-23T14:49:43.992 INFO:tasks.workunit.client.1.smithi156.stdout:3/53: mkdir d4/da 0 2024-04-23T14:49:43.992 INFO:tasks.workunit.client.1.smithi156.stdout:0/50: read d0/f7 [146937,2249] 0 2024-04-23T14:49:43.993 INFO:tasks.workunit.client.1.smithi156.stdout:0/51: chown d0/d4/lb 2 1 2024-04-23T14:49:43.993 INFO:tasks.workunit.client.1.smithi156.stdout:5/95: write d1/d3/fd [1446899,112150] 0 2024-04-23T14:49:43.993 INFO:tasks.workunit.client.1.smithi156.stdout:5/96: stat d1/d3/l14 0 2024-04-23T14:49:43.995 INFO:tasks.workunit.client.1.smithi156.stdout:3/54: mkdir d4/db 0 2024-04-23T14:49:43.996 INFO:tasks.workunit.client.1.smithi156.stdout:8/67: truncate d5/d9/fd 1104521 0 2024-04-23T14:49:43.996 INFO:tasks.workunit.client.1.smithi156.stdout:0/52: creat d0/d4/fe x:0 0 0 2024-04-23T14:49:43.997 INFO:tasks.workunit.client.1.smithi156.stdout:8/68: dread - d5/f1a zero size 2024-04-23T14:49:43.997 INFO:tasks.workunit.client.1.smithi156.stdout:8/69: chown d5/f8 15 1 2024-04-23T14:49:43.997 INFO:tasks.workunit.client.1.smithi156.stdout:0/53: creat d0/d4/ff x:0 0 0 2024-04-23T14:49:43.997 INFO:tasks.workunit.client.1.smithi156.stdout:9/55: dwrite d1/fe [0,4194304] 0 2024-04-23T14:49:43.997 INFO:tasks.workunit.client.1.smithi156.stdout:8/70: creat d5/f1c x:0 0 0 2024-04-23T14:49:43.997 INFO:tasks.workunit.client.1.smithi156.stdout:9/56: chown d1 746536076 1 2024-04-23T14:49:43.997 INFO:tasks.workunit.client.1.smithi156.stdout:8/71: dread - d5/f1a zero size 2024-04-23T14:49:43.997 INFO:tasks.workunit.client.1.smithi156.stdout:8/72: stat d5 0 2024-04-23T14:49:43.997 INFO:tasks.workunit.client.1.smithi156.stdout:8/73: dread - d5/d9/d10/f12 zero size 2024-04-23T14:49:43.998 INFO:tasks.workunit.client.1.smithi156.stdout:5/97: rename d1/l15 to d1/d3/l21 0 2024-04-23T14:49:43.999 INFO:tasks.workunit.client.1.smithi156.stdout:5/98: read d1/d3/f5 [842774,67080] 0 2024-04-23T14:49:44.002 INFO:tasks.workunit.client.1.smithi156.stdout:4/58: fsync d0/df/f14 0 2024-04-23T14:49:44.005 INFO:tasks.workunit.client.1.smithi156.stdout:9/57: mknod d1/d2/c12 0 2024-04-23T14:49:44.005 INFO:tasks.workunit.client.1.smithi156.stdout:8/74: mkdir d5/d9/d10/d1d 0 2024-04-23T14:49:44.005 INFO:tasks.workunit.client.1.smithi156.stdout:0/54: symlink d0/d4/l10 0 2024-04-23T14:49:44.007 INFO:tasks.workunit.client.0.smithi081.stdout:4/425: dread d1/d1d/d39/f73 [4194304,4194304] 0 2024-04-23T14:49:44.007 INFO:tasks.workunit.client.0.smithi081.stdout:8/640: dwrite d3/f2c [0,4194304] 0 2024-04-23T14:49:44.009 INFO:tasks.workunit.client.1.smithi156.stdout:5/99: truncate d1/d3/fa 2220531 0 2024-04-23T14:49:44.011 INFO:tasks.workunit.client.1.smithi156.stdout:5/100: read d1/d3/f5 [5015421,34171] 0 2024-04-23T14:49:44.011 INFO:tasks.workunit.client.0.smithi081.stdout:4/426: mkdir d1/d1d/d39/d8d 0 2024-04-23T14:49:44.013 INFO:tasks.workunit.client.1.smithi156.stdout:9/58: creat d1/d2/f13 x:0 0 0 2024-04-23T14:49:44.015 INFO:tasks.workunit.client.1.smithi156.stdout:0/55: mkdir d0/d4/d11 0 2024-04-23T14:49:44.016 INFO:tasks.workunit.client.0.smithi081.stdout:4/427: symlink d1/d4/d11/l8e 0 2024-04-23T14:49:44.018 INFO:tasks.workunit.client.1.smithi156.stdout:3/55: rename l2 to d4/db/lc 0 2024-04-23T14:49:44.018 INFO:tasks.workunit.client.1.smithi156.stdout:3/56: readlink d4/db/lc 0 2024-04-23T14:49:44.020 INFO:tasks.workunit.client.1.smithi156.stdout:5/101: creat d1/d11/f22 x:0 0 0 2024-04-23T14:49:44.021 INFO:tasks.workunit.client.1.smithi156.stdout:9/59: mknod d1/d2/d4/dc/c14 0 2024-04-23T14:49:44.022 INFO:tasks.workunit.client.1.smithi156.stdout:9/60: chown d1/d2/f13 0 1 2024-04-23T14:49:44.025 INFO:tasks.workunit.client.1.smithi156.stdout:5/102: mkdir d1/d3/d20/d23 0 2024-04-23T14:49:44.025 INFO:tasks.workunit.client.1.smithi156.stdout:4/59: rename d0/c7 to d0/d8/c15 0 2024-04-23T14:49:44.027 INFO:tasks.workunit.client.1.smithi156.stdout:3/57: truncate f1 1447093 0 2024-04-23T14:49:44.029 INFO:tasks.workunit.client.1.smithi156.stdout:5/103: mkdir d1/d3/d24 0 2024-04-23T14:49:44.030 INFO:tasks.workunit.client.1.smithi156.stdout:1/89: dwrite db/ff [8388608,4194304] 0 2024-04-23T14:49:44.030 INFO:tasks.workunit.client.1.smithi156.stdout:7/77: dread dc/f10 [0,4194304] 0 2024-04-23T14:49:44.030 INFO:tasks.workunit.client.1.smithi156.stdout:7/78: readlink dc/lf 0 2024-04-23T14:49:44.030 INFO:tasks.workunit.client.1.smithi156.stdout:7/79: creat dc/f15 x:0 0 0 2024-04-23T14:49:44.030 INFO:tasks.workunit.client.1.smithi156.stdout:7/80: stat dc 0 2024-04-23T14:49:44.030 INFO:tasks.workunit.client.1.smithi156.stdout:7/81: fdatasync fb 0 2024-04-23T14:49:44.031 INFO:tasks.workunit.client.1.smithi156.stdout:7/82: write dc/f10 [1873691,77414] 0 2024-04-23T14:49:44.031 INFO:tasks.workunit.client.1.smithi156.stdout:6/63: dwrite d3/fd [0,4194304] 0 2024-04-23T14:49:44.033 INFO:tasks.workunit.client.1.smithi156.stdout:4/60: creat d0/f16 x:0 0 0 2024-04-23T14:49:44.036 INFO:tasks.workunit.client.1.smithi156.stdout:9/61: write d1/d2/d4/ff [4140851,60162] 0 2024-04-23T14:49:44.037 INFO:tasks.workunit.client.1.smithi156.stdout:9/62: write d1/fe [1820610,72475] 0 2024-04-23T14:49:44.039 INFO:tasks.workunit.client.1.smithi156.stdout:2/66: dwrite f0 [0,4194304] 0 2024-04-23T14:49:44.043 INFO:tasks.workunit.client.0.smithi081.stdout:4/428: write d1/d1d/d59/f5a [683568,41877] 0 2024-04-23T14:49:44.044 INFO:tasks.workunit.client.1.smithi156.stdout:0/56: dread d0/d8/f6 [0,4194304] 0 2024-04-23T14:49:44.045 INFO:tasks.workunit.client.1.smithi156.stdout:6/64: mkdir d3/d19 0 2024-04-23T14:49:44.045 INFO:tasks.workunit.client.0.smithi081.stdout:4/429: truncate d1/f44 1226678 0 2024-04-23T14:49:44.046 INFO:tasks.workunit.client.1.smithi156.stdout:1/90: getdents db 0 2024-04-23T14:49:44.046 INFO:tasks.workunit.client.1.smithi156.stdout:5/104: fsync d1/d3/fa 0 2024-04-23T14:49:44.046 INFO:tasks.workunit.client.1.smithi156.stdout:5/105: readlink d1/lf 0 2024-04-23T14:49:44.046 INFO:tasks.workunit.client.1.smithi156.stdout:5/106: creat d1/d3/f25 x:0 0 0 2024-04-23T14:49:44.046 INFO:tasks.workunit.client.1.smithi156.stdout:5/107: stat d1/d11/c12 0 2024-04-23T14:49:44.046 INFO:tasks.workunit.client.1.smithi156.stdout:4/61: rename d0/f16 to d0/df/f17 0 2024-04-23T14:49:44.047 INFO:tasks.workunit.client.1.smithi156.stdout:4/62: write d0/d8/fc [5367188,122615] 0 2024-04-23T14:49:44.047 INFO:tasks.workunit.client.0.smithi081.stdout:4/430: mkdir d1/d8f 0 2024-04-23T14:49:44.050 INFO:tasks.workunit.client.0.smithi081.stdout:4/431: rename d1/d3/f7b to d1/d1d/d39/d8d/f90 0 2024-04-23T14:49:44.053 INFO:tasks.workunit.client.1.smithi156.stdout:9/63: link d1/c9 d1/d2/c15 0 2024-04-23T14:49:44.056 INFO:tasks.workunit.client.1.smithi156.stdout:2/67: unlink d4/fe 0 2024-04-23T14:49:44.057 INFO:tasks.workunit.client.0.smithi081.stdout:4/432: link d1/d1d/f22 d1/d4/d6f/f91 0 2024-04-23T14:49:44.060 INFO:tasks.workunit.client.0.smithi081.stdout:4/433: creat d1/d8b/f92 x:0 0 0 2024-04-23T14:49:44.066 INFO:tasks.workunit.client.1.smithi156.stdout:6/65: link d3/f8 d3/da/f1a 0 2024-04-23T14:49:44.066 INFO:tasks.workunit.client.1.smithi156.stdout:6/66: chown d3/c6 10796 1 2024-04-23T14:49:44.066 INFO:tasks.workunit.client.1.smithi156.stdout:6/67: write d3/da/fe [669841,26991] 0 2024-04-23T14:49:44.067 INFO:tasks.workunit.client.0.smithi081.stdout:8/641: dwrite d3/d11/d34/f7c [0,4194304] 0 2024-04-23T14:49:44.067 INFO:tasks.workunit.client.1.smithi156.stdout:1/91: creat db/f16 x:0 0 0 2024-04-23T14:49:44.071 INFO:tasks.workunit.client.1.smithi156.stdout:5/108: mknod d1/d11/d18/d19/c26 0 2024-04-23T14:49:44.087 INFO:tasks.workunit.client.1.smithi156.stdout:0/57: getdents d0/d4 0 2024-04-23T14:49:44.090 INFO:tasks.workunit.client.1.smithi156.stdout:1/92: getdents db/d15 0 2024-04-23T14:49:44.090 INFO:tasks.workunit.client.1.smithi156.stdout:1/93: creat db/f17 x:0 0 0 2024-04-23T14:49:44.091 INFO:tasks.workunit.client.1.smithi156.stdout:9/64: getdents d1/d2/d4 0 2024-04-23T14:49:44.097 INFO:tasks.workunit.client.1.smithi156.stdout:2/68: rename f0 to d4/f15 0 2024-04-23T14:49:44.097 INFO:tasks.workunit.client.1.smithi156.stdout:0/58: creat d0/d8/f12 x:0 0 0 2024-04-23T14:49:44.102 INFO:tasks.workunit.client.1.smithi156.stdout:1/94: rename db/f16 to db/f18 0 2024-04-23T14:49:44.102 INFO:tasks.workunit.client.1.smithi156.stdout:1/95: creat db/f19 x:0 0 0 2024-04-23T14:49:44.105 INFO:tasks.workunit.client.1.smithi156.stdout:6/68: rename d3/f11 to d3/da/d10/f1b 0 2024-04-23T14:49:44.109 INFO:tasks.workunit.client.1.smithi156.stdout:1/96: mknod db/c1a 0 2024-04-23T14:49:44.111 INFO:tasks.workunit.client.1.smithi156.stdout:9/65: rename d1/c9 to d1/d2/d4/dc/c16 0 2024-04-23T14:49:44.111 INFO:tasks.workunit.client.1.smithi156.stdout:9/66: dread - d1/d2/f13 zero size 2024-04-23T14:49:44.111 INFO:tasks.workunit.client.1.smithi156.stdout:6/69: mknod d3/d16/c1c 0 2024-04-23T14:49:44.115 INFO:tasks.workunit.client.0.smithi081.stdout:4/434: dwrite d1/d4/d11/f80 [0,4194304] 0 2024-04-23T14:49:44.115 INFO:tasks.workunit.client.1.smithi156.stdout:9/67: truncate d1/d2/d4/ff 1777231 0 2024-04-23T14:49:44.115 INFO:tasks.workunit.client.1.smithi156.stdout:9/68: readlink d1/d2/l7 0 2024-04-23T14:49:44.117 INFO:tasks.workunit.client.1.smithi156.stdout:6/70: unlink d3/da/d10/f12 0 2024-04-23T14:49:44.119 INFO:tasks.workunit.client.1.smithi156.stdout:0/59: getdents d0/d8 0 2024-04-23T14:49:44.122 INFO:tasks.workunit.client.1.smithi156.stdout:0/60: mkdir d0/d4/d11/d13 0 2024-04-23T14:49:44.123 INFO:tasks.workunit.client.1.smithi156.stdout:0/61: write d0/d4/ff [914552,104622] 0 2024-04-23T14:49:44.124 INFO:tasks.workunit.client.1.smithi156.stdout:0/62: mkdir d0/d4/d14 0 2024-04-23T14:49:44.126 INFO:tasks.workunit.client.1.smithi156.stdout:0/63: creat d0/f15 x:0 0 0 2024-04-23T14:49:44.126 INFO:tasks.workunit.client.1.smithi156.stdout:0/64: dread - d0/f15 zero size 2024-04-23T14:49:44.126 INFO:tasks.workunit.client.1.smithi156.stdout:2/69: dread d4/f7 [0,4194304] 0 2024-04-23T14:49:44.126 INFO:tasks.workunit.client.1.smithi156.stdout:0/65: rmdir d0/d8 39 2024-04-23T14:49:44.128 INFO:tasks.workunit.client.1.smithi156.stdout:2/70: creat d4/f16 x:0 0 0 2024-04-23T14:49:44.128 INFO:tasks.workunit.client.1.smithi156.stdout:2/71: chown d4/f15 1630 1 2024-04-23T14:49:44.128 INFO:tasks.workunit.client.1.smithi156.stdout:2/72: fdatasync d4/f15 0 2024-04-23T14:49:44.128 INFO:tasks.workunit.client.1.smithi156.stdout:2/73: readlink d4/l12 0 2024-04-23T14:49:44.128 INFO:tasks.workunit.client.0.smithi081.stdout:9/474: sync 2024-04-23T14:49:44.129 INFO:tasks.workunit.client.0.smithi081.stdout:7/326: sync 2024-04-23T14:49:44.129 INFO:tasks.workunit.client.0.smithi081.stdout:2/460: sync 2024-04-23T14:49:44.129 INFO:tasks.workunit.client.0.smithi081.stdout:2/461: readlink d1/d11/l7a 0 2024-04-23T14:49:44.129 INFO:tasks.workunit.client.0.smithi081.stdout:2/462: chown d1/d33/d45/d6e/d97 126072864 1 2024-04-23T14:49:44.129 INFO:tasks.workunit.client.1.smithi156.stdout:0/66: mkdir d0/d16 0 2024-04-23T14:49:44.129 INFO:tasks.workunit.client.1.smithi156.stdout:2/74: creat d4/f17 x:0 0 0 2024-04-23T14:49:44.130 INFO:tasks.workunit.client.1.smithi156.stdout:2/75: fdatasync d4/f16 0 2024-04-23T14:49:44.130 INFO:tasks.workunit.client.1.smithi156.stdout:2/76: fsync f2 0 2024-04-23T14:49:44.131 INFO:tasks.workunit.client.0.smithi081.stdout:7/327: creat d3/d21/d31/d63/f6c x:0 0 0 2024-04-23T14:49:44.132 INFO:tasks.workunit.client.1.smithi156.stdout:0/67: creat d0/d4/d11/d13/f17 x:0 0 0 2024-04-23T14:49:44.132 INFO:tasks.workunit.client.1.smithi156.stdout:0/68: write d0/d8/f12 [938548,122822] 0 2024-04-23T14:49:44.132 INFO:tasks.workunit.client.1.smithi156.stdout:0/69: chown d0/d8/ld 2 1 2024-04-23T14:49:44.133 INFO:tasks.workunit.client.0.smithi081.stdout:0/534: sync 2024-04-23T14:49:44.133 INFO:tasks.workunit.client.0.smithi081.stdout:5/474: sync 2024-04-23T14:49:44.136 INFO:tasks.workunit.client.0.smithi081.stdout:1/509: sync 2024-04-23T14:49:44.136 INFO:tasks.workunit.client.0.smithi081.stdout:3/357: sync 2024-04-23T14:49:44.136 INFO:tasks.workunit.client.0.smithi081.stdout:6/418: sync 2024-04-23T14:49:44.140 INFO:tasks.workunit.client.0.smithi081.stdout:2/463: rename d1/d33/f6d to d1/d89/fa0 0 2024-04-23T14:49:44.140 INFO:tasks.workunit.client.0.smithi081.stdout:2/464: creat d1/d11/d21/d52/fa1 x:0 0 0 2024-04-23T14:49:44.140 INFO:tasks.workunit.client.0.smithi081.stdout:8/642: dwrite d3/d11/d4f/fd8 [0,4194304] 0 2024-04-23T14:49:44.140 INFO:tasks.workunit.client.0.smithi081.stdout:8/643: chown d3/d11/d86/d88/da7 108495 1 2024-04-23T14:49:44.140 INFO:tasks.workunit.client.0.smithi081.stdout:2/465: write d1/d33/f37 [4805793,29877] 0 2024-04-23T14:49:44.141 INFO:tasks.workunit.client.0.smithi081.stdout:0/535: mknod d6/d11/d14/d41/ca2 0 2024-04-23T14:49:44.141 INFO:tasks.workunit.client.1.smithi156.stdout:2/77: creat d4/d13/f18 x:0 0 0 2024-04-23T14:49:44.141 INFO:tasks.workunit.client.1.smithi156.stdout:1/97: fsync db/f19 0 2024-04-23T14:49:44.141 INFO:tasks.workunit.client.1.smithi156.stdout:2/78: chown d4/f7 1685209066 1 2024-04-23T14:49:44.141 INFO:tasks.workunit.client.1.smithi156.stdout:1/98: readlink db/le 0 2024-04-23T14:49:44.141 INFO:tasks.workunit.client.1.smithi156.stdout:5/109: dwrite d1/d3/f5 [8388608,4194304] 0 2024-04-23T14:49:44.141 INFO:tasks.workunit.client.1.smithi156.stdout:7/83: dwrite fb [0,4194304] 0 2024-04-23T14:49:44.145 INFO:tasks.workunit.client.0.smithi081.stdout:1/510: creat d3/d3d/d41/d5e/da0/fa2 x:0 0 0 2024-04-23T14:49:44.148 INFO:tasks.workunit.client.1.smithi156.stdout:1/99: mknod db/c1b 0 2024-04-23T14:49:44.148 INFO:tasks.workunit.client.1.smithi156.stdout:3/58: read f1 [542691,26819] 0 2024-04-23T14:49:44.149 INFO:tasks.workunit.client.1.smithi156.stdout:9/69: fsync d1/fe 0 2024-04-23T14:49:44.151 INFO:tasks.workunit.client.0.smithi081.stdout:7/328: dread d3/d21/d31/d33/f3b [0,4194304] 0 2024-04-23T14:49:44.151 INFO:tasks.workunit.client.0.smithi081.stdout:7/329: chown d3/d21/c54 260 1 2024-04-23T14:49:44.151 INFO:tasks.workunit.client.0.smithi081.stdout:7/330: fsync d3/d21/d41/f6b 0 2024-04-23T14:49:44.152 INFO:tasks.workunit.client.0.smithi081.stdout:7/331: chown d3/d21/d31/d33/d4b/d4c/d4f 1 1 2024-04-23T14:49:44.152 INFO:tasks.workunit.client.1.smithi156.stdout:0/70: dread d0/d8/f6 [0,4194304] 0 2024-04-23T14:49:44.152 INFO:tasks.workunit.client.1.smithi156.stdout:0/71: getdents d0/d8 0 2024-04-23T14:49:44.155 INFO:tasks.workunit.client.0.smithi081.stdout:2/466: mkdir d1/d11/d21/d52/da2 0 2024-04-23T14:49:44.156 INFO:tasks.workunit.client.1.smithi156.stdout:5/110: rmdir d1/d3/d20/d23 0 2024-04-23T14:49:44.158 INFO:tasks.workunit.client.1.smithi156.stdout:5/111: write d1/d3/f5 [8339860,59936] 0 2024-04-23T14:49:44.158 INFO:tasks.workunit.client.0.smithi081.stdout:0/536: symlink d6/d11/d14/d24/la3 0 2024-04-23T14:49:44.159 INFO:tasks.workunit.client.1.smithi156.stdout:7/84: symlink dc/l16 0 2024-04-23T14:49:44.160 INFO:tasks.workunit.client.1.smithi156.stdout:7/85: fsync f6 0 2024-04-23T14:49:44.165 INFO:tasks.workunit.client.1.smithi156.stdout:1/100: rmdir db/d15 39 2024-04-23T14:49:44.166 INFO:tasks.workunit.client.1.smithi156.stdout:1/101: creat db/f1c x:0 0 0 2024-04-23T14:49:44.167 INFO:tasks.workunit.client.0.smithi081.stdout:9/475: symlink d3/de/d1d/l98 0 2024-04-23T14:49:44.167 INFO:tasks.workunit.client.0.smithi081.stdout:1/511: creat d3/d3d/d41/d5e/d12/d1a/d2a/fa3 x:0 0 0 2024-04-23T14:49:44.167 INFO:tasks.workunit.client.0.smithi081.stdout:5/475: write d17/d3c/f81 [3931744,103953] 0 2024-04-23T14:49:44.167 INFO:tasks.workunit.client.1.smithi156.stdout:4/63: dwrite d0/d8/fc [0,4194304] 0 2024-04-23T14:49:44.168 INFO:tasks.workunit.client.1.smithi156.stdout:3/59: mkdir d4/db/dd 0 2024-04-23T14:49:44.168 INFO:tasks.workunit.client.1.smithi156.stdout:3/60: fdatasync f1 0 2024-04-23T14:49:44.168 INFO:tasks.workunit.client.1.smithi156.stdout:3/61: stat d4/da 0 2024-04-23T14:49:44.168 INFO:tasks.workunit.client.1.smithi156.stdout:3/62: write f1 [1497774,19873] 0 2024-04-23T14:49:44.169 INFO:tasks.workunit.client.0.smithi081.stdout:7/332: truncate d3/d11/d2c/f32 1172686 0 2024-04-23T14:49:44.171 INFO:tasks.workunit.client.1.smithi156.stdout:9/70: mkdir d1/d2/d4/d17 0 2024-04-23T14:49:44.172 INFO:tasks.workunit.client.1.smithi156.stdout:9/71: creat d1/d2/f18 x:0 0 0 2024-04-23T14:49:44.174 INFO:tasks.workunit.client.1.smithi156.stdout:6/71: dwrite d3/da/d10/f1b [0,4194304] 0 2024-04-23T14:49:44.174 INFO:tasks.workunit.client.1.smithi156.stdout:5/112: mkdir d1/d11/d27 0 2024-04-23T14:49:44.178 INFO:tasks.workunit.client.0.smithi081.stdout:0/537: creat d6/d11/d14/d41/d5b/fa4 x:0 0 0 2024-04-23T14:49:44.178 INFO:tasks.workunit.client.0.smithi081.stdout:0/538: fdatasync f5 0 2024-04-23T14:49:44.179 INFO:tasks.workunit.client.0.smithi081.stdout:0/539: fdatasync d6/d11/d14/d41/d5b/d3f/d44/f9b 0 2024-04-23T14:49:44.183 INFO:tasks.workunit.client.1.smithi156.stdout:7/86: write fb [2698429,31136] 0 2024-04-23T14:49:44.184 INFO:tasks.workunit.client.0.smithi081.stdout:1/512: rename d3/f7 to d3/d3d/d41/d5e/d5d/fa4 0 2024-04-23T14:49:44.184 INFO:tasks.workunit.client.0.smithi081.stdout:1/513: chown d3/d3d/d41/d5e/d12/l9e 4142 1 2024-04-23T14:49:44.184 INFO:tasks.workunit.client.0.smithi081.stdout:1/514: read - d3/d3d/d41/d5e/d12/d2e/f50 zero size 2024-04-23T14:49:44.186 INFO:tasks.workunit.client.0.smithi081.stdout:9/476: mknod d3/de/d1d/d73/c99 0 2024-04-23T14:49:44.190 INFO:tasks.workunit.client.0.smithi081.stdout:1/515: read d3/d3d/d41/d5e/d12/d1a/d2a/f45 [119561,123545] 0 2024-04-23T14:49:44.190 INFO:tasks.workunit.client.0.smithi081.stdout:1/516: chown d3/d3d 408926949 1 2024-04-23T14:49:44.190 INFO:tasks.workunit.client.0.smithi081.stdout:3/358: dread d4/f5b [0,4194304] 0 2024-04-23T14:49:44.190 INFO:tasks.workunit.client.0.smithi081.stdout:5/476: creat d17/d1f/d36/d59/da8/fa9 x:0 0 0 2024-04-23T14:49:44.194 INFO:tasks.workunit.client.0.smithi081.stdout:4/435: dwrite d1/d1d/f3e [0,4194304] 0 2024-04-23T14:49:44.195 INFO:tasks.workunit.client.0.smithi081.stdout:4/436: chown d1/d4/d6f/f91 53757 1 2024-04-23T14:49:44.198 INFO:tasks.workunit.client.0.smithi081.stdout:7/333: creat d3/d21/d41/f6d x:0 0 0 2024-04-23T14:49:44.201 INFO:tasks.workunit.client.0.smithi081.stdout:2/467: mkdir d1/d33/da3 0 2024-04-23T14:49:44.202 INFO:tasks.workunit.client.1.smithi156.stdout:9/72: mkdir d1/d2/d4/d19 0 2024-04-23T14:49:44.209 INFO:tasks.workunit.client.0.smithi081.stdout:8/644: dwrite d3/d11/d48/fc2 [0,4194304] 0 2024-04-23T14:49:44.211 INFO:tasks.workunit.client.1.smithi156.stdout:6/72: mkdir d3/da/d1d 0 2024-04-23T14:49:44.212 INFO:tasks.workunit.client.1.smithi156.stdout:5/113: creat d1/d11/d18/f28 x:0 0 0 2024-04-23T14:49:44.213 INFO:tasks.workunit.client.0.smithi081.stdout:9/477: symlink d3/de/d1d/d54/d68/l9a 0 2024-04-23T14:49:44.213 INFO:tasks.workunit.client.0.smithi081.stdout:9/478: readlink d3/lb 0 2024-04-23T14:49:44.213 INFO:tasks.workunit.client.1.smithi156.stdout:1/102: unlink db/f1c 0 2024-04-23T14:49:44.213 INFO:tasks.workunit.client.1.smithi156.stdout:5/114: readlink d1/d3/l14 0 2024-04-23T14:49:44.215 INFO:tasks.workunit.client.0.smithi081.stdout:3/359: symlink d4/l78 0 2024-04-23T14:49:44.215 INFO:tasks.workunit.client.0.smithi081.stdout:1/517: dread d3/d3d/d41/d5e/d12/d1a/d2a/f46 [0,4194304] 0 2024-04-23T14:49:44.215 INFO:tasks.workunit.client.0.smithi081.stdout:4/437: rmdir d1/d1d/d39/d8d 39 2024-04-23T14:49:44.215 INFO:tasks.workunit.client.0.smithi081.stdout:1/518: chown d3/d3d/d41/d5e/d17/d58/c6a 29621 1 2024-04-23T14:49:44.215 INFO:tasks.workunit.client.0.smithi081.stdout:5/477: mkdir d17/d37/da4/daa 0 2024-04-23T14:49:44.216 INFO:tasks.workunit.client.0.smithi081.stdout:5/478: creat d17/d4f/d61/fab x:0 0 0 2024-04-23T14:49:44.216 INFO:tasks.workunit.client.0.smithi081.stdout:5/479: chown d17/fa0 44415995 1 2024-04-23T14:49:44.218 INFO:tasks.workunit.client.1.smithi156.stdout:4/64: getdents d0/df 0 2024-04-23T14:49:44.221 INFO:tasks.workunit.client.0.smithi081.stdout:2/468: unlink d1/l31 0 2024-04-23T14:49:44.221 INFO:tasks.workunit.client.0.smithi081.stdout:2/469: readlink d1/d11/d21/l3f 0 2024-04-23T14:49:44.225 INFO:tasks.workunit.client.1.smithi156.stdout:3/63: dwrite f3 [0,4194304] 0 2024-04-23T14:49:44.226 INFO:tasks.workunit.client.1.smithi156.stdout:9/73: creat d1/d2/d4/f1a x:0 0 0 2024-04-23T14:49:44.230 INFO:tasks.workunit.client.1.smithi156.stdout:5/115: dread d1/d3/fd [0,4194304] 0 2024-04-23T14:49:44.230 INFO:tasks.workunit.client.1.smithi156.stdout:5/116: chown d1/d11/c12 1 1 2024-04-23T14:49:44.232 INFO:tasks.workunit.client.0.smithi081.stdout:0/540: getdents d6/d11/d14/d41/d5b/d59/d68 0 2024-04-23T14:49:44.238 INFO:tasks.workunit.client.0.smithi081.stdout:9/479: creat d3/de/d1d/d54/f9b x:0 0 0 2024-04-23T14:49:44.239 INFO:tasks.workunit.client.0.smithi081.stdout:2/470: creat d1/d33/d45/d6e/d97/fa4 x:0 0 0 2024-04-23T14:49:44.242 INFO:tasks.workunit.client.0.smithi081.stdout:0/541: mknod d6/d11/d14/d41/d5b/ca5 0 2024-04-23T14:49:44.243 INFO:tasks.workunit.client.0.smithi081.stdout:9/480: creat d3/de/d47/f9c x:0 0 0 2024-04-23T14:49:44.245 INFO:tasks.workunit.client.1.smithi156.stdout:6/73: mkdir d3/d16/d1e 0 2024-04-23T14:49:44.246 INFO:tasks.workunit.client.0.smithi081.stdout:2/471: mknod d1/d33/d45/d6e/d97/ca5 0 2024-04-23T14:49:44.246 INFO:tasks.workunit.client.0.smithi081.stdout:2/472: chown d1/d11/c6f 4 1 2024-04-23T14:49:44.248 INFO:tasks.workunit.client.1.smithi156.stdout:4/65: read d0/d8/fc [727439,39813] 0 2024-04-23T14:49:44.249 INFO:tasks.workunit.client.1.smithi156.stdout:9/74: symlink d1/l1b 0 2024-04-23T14:49:44.253 INFO:tasks.workunit.client.1.smithi156.stdout:5/117: truncate d1/d3/fa 1825182 0 2024-04-23T14:49:44.253 INFO:tasks.workunit.client.1.smithi156.stdout:6/74: rename l2 to d3/l1f 0 2024-04-23T14:49:44.253 INFO:tasks.workunit.client.1.smithi156.stdout:9/75: rename d1/d2/d4 to d1/d2/d4/d1c 22 2024-04-23T14:49:44.253 INFO:tasks.workunit.client.0.smithi081.stdout:4/438: write d1/f8a [1600276,131037] 0 2024-04-23T14:49:44.255 INFO:tasks.workunit.client.1.smithi156.stdout:5/118: truncate d1/d3/f1e 257212 0 2024-04-23T14:49:44.255 INFO:tasks.workunit.client.1.smithi156.stdout:5/119: creat d1/d11/f29 x:0 0 0 2024-04-23T14:49:44.256 INFO:tasks.workunit.client.1.smithi156.stdout:6/75: creat d3/d16/d1e/f20 x:0 0 0 2024-04-23T14:49:44.256 INFO:tasks.workunit.client.1.smithi156.stdout:7/87: dwrite f8 [0,4194304] 0 2024-04-23T14:49:44.257 INFO:tasks.workunit.client.0.smithi081.stdout:4/439: rename d1/d4/f23 to d1/d8f/f93 0 2024-04-23T14:49:44.258 INFO:tasks.workunit.client.1.smithi156.stdout:2/79: dwrite d4/d13/f18 [0,4194304] 0 2024-04-23T14:49:44.260 INFO:tasks.workunit.client.0.smithi081.stdout:1/519: write d3/d3d/d41/f42 [685332,125296] 0 2024-04-23T14:49:44.260 INFO:tasks.workunit.client.1.smithi156.stdout:9/76: creat d1/d2/d4/d19/f1d x:0 0 0 2024-04-23T14:49:44.260 INFO:tasks.workunit.client.1.smithi156.stdout:9/77: write d1/d2/f18 [847646,92215] 0 2024-04-23T14:49:44.261 INFO:tasks.workunit.client.0.smithi081.stdout:3/360: read d4/d7/df/d30/f4c [3815090,32533] 0 2024-04-23T14:49:44.264 INFO:tasks.workunit.client.0.smithi081.stdout:7/334: dwrite d3/d11/d2c/f53 [0,4194304] 0 2024-04-23T14:49:44.267 INFO:tasks.workunit.client.0.smithi081.stdout:4/440: mkdir d1/d8f/d94 0 2024-04-23T14:49:44.268 INFO:tasks.workunit.client.1.smithi156.stdout:5/120: rmdir d1/d11/d18/d19 39 2024-04-23T14:49:44.268 INFO:tasks.workunit.client.1.smithi156.stdout:5/121: dread - d1/d11/d18/f28 zero size 2024-04-23T14:49:44.271 INFO:tasks.workunit.client.1.smithi156.stdout:6/76: creat d3/da/d1d/f21 x:0 0 0 2024-04-23T14:49:44.271 INFO:tasks.workunit.client.1.smithi156.stdout:6/77: read d3/f8 [2762171,104358] 0 2024-04-23T14:49:44.272 INFO:tasks.workunit.client.0.smithi081.stdout:1/520: rename d3/d3d/d41/d5e/d17/d26/l7e to d3/d3d/d41/d5e/d12/d2e/la5 0 2024-04-23T14:49:44.273 INFO:tasks.workunit.client.1.smithi156.stdout:9/78: dread d1/d2/d4/ff [0,4194304] 0 2024-04-23T14:49:44.273 INFO:tasks.workunit.client.1.smithi156.stdout:9/79: fdatasync d1/d2/d4/ff 0 2024-04-23T14:49:44.275 INFO:tasks.workunit.client.1.smithi156.stdout:7/88: rename dc/f10 to dc/f17 0 2024-04-23T14:49:44.280 INFO:tasks.workunit.client.0.smithi081.stdout:5/480: dwrite d17/d1f/f22 [0,4194304] 0 2024-04-23T14:49:44.280 INFO:tasks.workunit.client.0.smithi081.stdout:8/645: dwrite d3/d3c/f84 [0,4194304] 0 2024-04-23T14:49:44.283 INFO:tasks.workunit.client.1.smithi156.stdout:1/103: getdents db 0 2024-04-23T14:49:44.285 INFO:tasks.workunit.client.0.smithi081.stdout:3/361: creat d4/dc/d10/f79 x:0 0 0 2024-04-23T14:49:44.286 INFO:tasks.workunit.client.0.smithi081.stdout:3/362: truncate d4/d41/f66 5327936 0 2024-04-23T14:49:44.290 INFO:tasks.workunit.client.1.smithi156.stdout:2/80: mkdir d4/d13/d19 0 2024-04-23T14:49:44.292 INFO:tasks.workunit.client.1.smithi156.stdout:2/81: fdatasync d4/d13/f14 0 2024-04-23T14:49:44.293 INFO:tasks.workunit.client.1.smithi156.stdout:6/78: link d3/da/d10/c15 d3/da/c22 0 2024-04-23T14:49:44.293 INFO:tasks.workunit.client.1.smithi156.stdout:6/79: truncate d3/da/f18 468558 0 2024-04-23T14:49:44.293 INFO:tasks.workunit.client.1.smithi156.stdout:6/80: write d3/da/d10/f14 [2435699,56634] 0 2024-04-23T14:49:44.301 INFO:tasks.workunit.client.0.smithi081.stdout:3/363: creat d4/d7/d32/d6a/f7a x:0 0 0 2024-04-23T14:49:44.301 INFO:tasks.workunit.client.0.smithi081.stdout:1/521: rmdir d3/d3d/d41/d4a/d77 39 2024-04-23T14:49:44.303 INFO:tasks.workunit.client.0.smithi081.stdout:8/646: getdents d3/d11/d34 0 2024-04-23T14:49:44.304 INFO:tasks.workunit.client.0.smithi081.stdout:8/647: fdatasync d3/fba 0 2024-04-23T14:49:44.308 INFO:tasks.workunit.client.0.smithi081.stdout:1/522: rmdir d3/d3d/d41/d5e/d12/d1a/d2a/d97 0 2024-04-23T14:49:44.309 INFO:tasks.workunit.client.0.smithi081.stdout:8/648: unlink d3/d11/d86/d88/da7/fae 0 2024-04-23T14:49:44.310 INFO:tasks.workunit.client.0.smithi081.stdout:3/364: getdents d4/d7/d49/d38 0 2024-04-23T14:49:44.312 INFO:tasks.workunit.client.0.smithi081.stdout:1/523: mkdir d3/d3d/d41/d92/da6 0 2024-04-23T14:49:44.313 INFO:tasks.workunit.client.0.smithi081.stdout:8/649: mkdir d3/d3c/ddb 0 2024-04-23T14:49:44.313 INFO:tasks.workunit.client.0.smithi081.stdout:8/650: dread - d3/d11/d4f/f6a zero size 2024-04-23T14:49:44.314 INFO:tasks.workunit.client.0.smithi081.stdout:3/365: stat d4/d7/c40 0 2024-04-23T14:49:44.316 INFO:tasks.workunit.client.0.smithi081.stdout:1/524: creat d3/d3d/d6f/fa7 x:0 0 0 2024-04-23T14:49:44.318 INFO:tasks.workunit.client.0.smithi081.stdout:3/366: mknod d4/c7b 0 2024-04-23T14:49:44.318 INFO:tasks.workunit.client.1.smithi156.stdout:7/89: rmdir dc 39 2024-04-23T14:49:44.318 INFO:tasks.workunit.client.1.smithi156.stdout:7/90: write dc/f15 [99726,76854] 0 2024-04-23T14:49:44.319 INFO:tasks.workunit.client.1.smithi156.stdout:0/72: dwrite d0/d8/f6 [4194304,4194304] 0 2024-04-23T14:49:44.319 INFO:tasks.workunit.client.1.smithi156.stdout:0/73: chown d0/f7 29 1 2024-04-23T14:49:44.321 INFO:tasks.workunit.client.1.smithi156.stdout:7/91: rename dc/l16 to dc/l18 0 2024-04-23T14:49:44.321 INFO:tasks.workunit.client.1.smithi156.stdout:7/92: readlink dc/l12 0 2024-04-23T14:49:44.324 INFO:tasks.workunit.client.1.smithi156.stdout:0/74: link d0/c9 d0/d4/c18 0 2024-04-23T14:49:44.324 INFO:tasks.workunit.client.1.smithi156.stdout:0/75: write d0/d4/d11/d13/f17 [402043,102565] 0 2024-04-23T14:49:44.324 INFO:tasks.workunit.client.1.smithi156.stdout:0/76: chown d0/d4/fe 55668842 1 2024-04-23T14:49:44.324 INFO:tasks.workunit.client.1.smithi156.stdout:0/77: creat d0/f19 x:0 0 0 2024-04-23T14:49:44.324 INFO:tasks.workunit.client.1.smithi156.stdout:0/78: chown d0/d4/f3 1356627701 1 2024-04-23T14:49:44.325 INFO:tasks.workunit.client.1.smithi156.stdout:0/79: creat d0/f1a x:0 0 0 2024-04-23T14:49:44.325 INFO:tasks.workunit.client.1.smithi156.stdout:0/80: stat d0/d16 0 2024-04-23T14:49:44.325 INFO:tasks.workunit.client.1.smithi156.stdout:7/93: rmdir dc 39 2024-04-23T14:49:44.329 INFO:tasks.workunit.client.1.smithi156.stdout:0/81: mkdir d0/d4/d14/d1b 0 2024-04-23T14:49:44.331 INFO:tasks.workunit.client.1.smithi156.stdout:7/94: rename dc/f15 to dc/f19 0 2024-04-23T14:49:44.331 INFO:tasks.workunit.client.1.smithi156.stdout:7/95: readlink dc/le 0 2024-04-23T14:49:44.332 INFO:tasks.workunit.client.0.smithi081.stdout:1/525: dread d3/d3d/d41/d5e/d17/f20 [0,4194304] 0 2024-04-23T14:49:44.332 INFO:tasks.workunit.client.1.smithi156.stdout:0/82: link d0/d8/f12 d0/d8/f1c 0 2024-04-23T14:49:44.333 INFO:tasks.workunit.client.1.smithi156.stdout:0/83: dread - d0/f15 zero size 2024-04-23T14:49:44.333 INFO:tasks.workunit.client.1.smithi156.stdout:7/96: symlink dc/l1a 0 2024-04-23T14:49:44.334 INFO:tasks.workunit.client.0.smithi081.stdout:1/526: symlink d3/d3d/d90/la8 0 2024-04-23T14:49:44.339 INFO:tasks.workunit.client.1.smithi156.stdout:8/75: sync 2024-04-23T14:49:44.339 INFO:tasks.workunit.client.1.smithi156.stdout:0/84: rename d0/d4/d11/d13 to d0/d8/d1d 0 2024-04-23T14:49:44.339 INFO:tasks.workunit.client.1.smithi156.stdout:8/76: write d5/d9/f13 [931677,55431] 0 2024-04-23T14:49:44.345 INFO:tasks.workunit.client.1.smithi156.stdout:8/77: getdents d5/d9 0 2024-04-23T14:49:44.345 INFO:tasks.workunit.client.1.smithi156.stdout:8/78: getdents d5/d9/d10/d1d 0 2024-04-23T14:49:44.345 INFO:tasks.workunit.client.1.smithi156.stdout:8/79: dread - d5/f1a zero size 2024-04-23T14:49:44.357 INFO:tasks.workunit.client.1.smithi156.stdout:8/80: mknod d5/d9/d10/c1e 0 2024-04-23T14:49:44.360 INFO:tasks.workunit.client.1.smithi156.stdout:7/97: write f8 [475857,110198] 0 2024-04-23T14:49:44.376 INFO:tasks.workunit.client.0.smithi081.stdout:9/481: dwrite d3/de/d14/d5e/f96 [0,4194304] 0 2024-04-23T14:49:44.376 INFO:tasks.workunit.client.0.smithi081.stdout:9/482: chown d3/de/d1d/d62/l6d 130212 1 2024-04-23T14:49:44.376 INFO:tasks.workunit.client.0.smithi081.stdout:9/483: read d3/de/d14/f6b [743879,82922] 0 2024-04-23T14:49:44.380 INFO:tasks.workunit.client.0.smithi081.stdout:1/527: write d3/f51 [1628737,130062] 0 2024-04-23T14:49:44.386 INFO:tasks.workunit.client.1.smithi156.stdout:5/122: dwrite d1/d3/fa [0,4194304] 0 2024-04-23T14:49:44.387 INFO:tasks.workunit.client.0.smithi081.stdout:2/473: dwrite d1/d11/d21/d34/f72 [0,4194304] 0 2024-04-23T14:49:44.387 INFO:tasks.workunit.client.0.smithi081.stdout:8/651: dread d3/d3c/f84 [0,4194304] 0 2024-04-23T14:49:44.387 INFO:tasks.workunit.client.0.smithi081.stdout:8/652: readlink d3/d11/d86/d88/da7/lc8 0 2024-04-23T14:49:44.388 INFO:tasks.workunit.client.0.smithi081.stdout:1/528: creat d3/d3d/d41/d5e/d17/fa9 x:0 0 0 2024-04-23T14:49:44.388 INFO:tasks.workunit.client.0.smithi081.stdout:1/529: chown d3/d3d/d41/d5e/da0/fa2 262 1 2024-04-23T14:49:44.388 INFO:tasks.workunit.client.0.smithi081.stdout:1/530: write d3/d3d/d41/d5e/d17/d58/f67 [59523,1200] 0 2024-04-23T14:49:44.390 INFO:tasks.workunit.client.0.smithi081.stdout:3/367: dwrite d4/d7/df/f19 [4194304,4194304] 0 2024-04-23T14:49:44.390 INFO:tasks.workunit.client.0.smithi081.stdout:3/368: dread - d4/d7/d1a/d71/f76 zero size 2024-04-23T14:49:44.390 INFO:tasks.workunit.client.0.smithi081.stdout:3/369: fsync d4/dc/d50/f4e 0 2024-04-23T14:49:44.395 INFO:tasks.workunit.client.1.smithi156.stdout:5/123: unlink d1/d11/f22 0 2024-04-23T14:49:44.395 INFO:tasks.workunit.client.1.smithi156.stdout:5/124: dread - d1/d11/f29 zero size 2024-04-23T14:49:44.397 INFO:tasks.workunit.client.0.smithi081.stdout:1/531: rename d3/d3d/f71 to d3/d3d/faa 0 2024-04-23T14:49:44.397 INFO:tasks.workunit.client.0.smithi081.stdout:1/532: truncate d3/d3d/d41/d5e/d12/d1a/d2a/fa3 127755 0 2024-04-23T14:49:44.398 INFO:tasks.workunit.client.0.smithi081.stdout:3/370: chown d4/d7/df/c59 330870606 1 2024-04-23T14:49:44.398 INFO:tasks.workunit.client.1.smithi156.stdout:3/64: dwrite f3 [4194304,4194304] 0 2024-04-23T14:49:44.399 INFO:tasks.workunit.client.1.smithi156.stdout:3/65: write f1 [2190193,96530] 0 2024-04-23T14:49:44.399 INFO:tasks.workunit.client.1.smithi156.stdout:3/66: stat d4/db/dd 0 2024-04-23T14:49:44.400 INFO:tasks.workunit.client.1.smithi156.stdout:2/82: dwrite d4/f7 [4194304,4194304] 0 2024-04-23T14:49:44.401 INFO:tasks.workunit.client.1.smithi156.stdout:5/125: mknod d1/d11/d18/d19/c2a 0 2024-04-23T14:49:44.405 INFO:tasks.workunit.client.1.smithi156.stdout:1/104: dwrite db/f19 [0,4194304] 0 2024-04-23T14:49:44.405 INFO:tasks.workunit.client.1.smithi156.stdout:4/66: dwrite d0/d8/fd [0,4194304] 0 2024-04-23T14:49:44.414 INFO:tasks.workunit.client.1.smithi156.stdout:2/83: creat d4/d13/d19/f1a x:0 0 0 2024-04-23T14:49:44.426 INFO:tasks.workunit.client.0.smithi081.stdout:2/474: dread d1/d11/f12 [0,4194304] 0 2024-04-23T14:49:44.426 INFO:tasks.workunit.client.0.smithi081.stdout:2/475: chown d1/d89/c8d 3902606 1 2024-04-23T14:49:44.426 INFO:tasks.workunit.client.0.smithi081.stdout:2/476: chown d1/d11/d21/d34/f86 84292 1 2024-04-23T14:49:44.431 INFO:tasks.workunit.client.0.smithi081.stdout:9/484: dwrite d3/d5/f16 [4194304,4194304] 0 2024-04-23T14:49:44.433 INFO:tasks.workunit.client.1.smithi156.stdout:2/84: dread d4/d13/f18 [0,4194304] 0 2024-04-23T14:49:44.433 INFO:tasks.workunit.client.1.smithi156.stdout:2/85: readlink d4/lb 0 2024-04-23T14:49:44.433 INFO:tasks.workunit.client.1.smithi156.stdout:2/86: fdatasync d4/d13/d19/f1a 0 2024-04-23T14:49:44.439 INFO:tasks.workunit.client.0.smithi081.stdout:8/653: rmdir d3 39 2024-04-23T14:49:44.441 INFO:tasks.workunit.client.1.smithi156.stdout:8/81: dwrite d5/d9/fd [0,4194304] 0 2024-04-23T14:49:44.444 INFO:tasks.workunit.client.0.smithi081.stdout:1/533: rename d3/d3d/d41/d5e/d17/l9b to d3/d3d/d41/d4a/lab 0 2024-04-23T14:49:44.444 INFO:tasks.workunit.client.0.smithi081.stdout:1/534: chown d3/d3d/d6f/l49 62055156 1 2024-04-23T14:49:44.445 INFO:tasks.workunit.client.1.smithi156.stdout:2/87: truncate d4/f7 4529755 0 2024-04-23T14:49:44.446 INFO:tasks.workunit.client.0.smithi081.stdout:3/371: creat d4/dc/d10/d5a/f7c x:0 0 0 2024-04-23T14:49:44.447 INFO:tasks.workunit.client.1.smithi156.stdout:8/82: creat d5/d9/f1f x:0 0 0 2024-04-23T14:49:44.449 INFO:tasks.workunit.client.0.smithi081.stdout:2/477: creat d1/d11/d21/d52/d8b/d8f/d93/fa6 x:0 0 0 2024-04-23T14:49:44.449 INFO:tasks.workunit.client.0.smithi081.stdout:2/478: rename d1/d11 to d1/d11/d21/d52/d8b/d8f/da7 22 2024-04-23T14:49:44.450 INFO:tasks.workunit.client.0.smithi081.stdout:2/479: truncate d1/d11/f25 28806 0 2024-04-23T14:49:44.450 INFO:tasks.workunit.client.0.smithi081.stdout:2/480: truncate d1/d33/d45/f4a 1274506 0 2024-04-23T14:49:44.450 INFO:tasks.workunit.client.0.smithi081.stdout:2/481: creat d1/d11/d21/d52/d8b/fa8 x:0 0 0 2024-04-23T14:49:44.450 INFO:tasks.workunit.client.0.smithi081.stdout:2/482: creat d1/d11/d21/d34/fa9 x:0 0 0 2024-04-23T14:49:44.458 INFO:tasks.workunit.client.1.smithi156.stdout:2/88: read d4/d13/f18 [3608668,112382] 0 2024-04-23T14:49:44.458 INFO:tasks.workunit.client.1.smithi156.stdout:2/89: chown d4/d13/d19 2 1 2024-04-23T14:49:44.458 INFO:tasks.workunit.client.1.smithi156.stdout:2/90: truncate d4/f16 365862 0 2024-04-23T14:49:44.462 INFO:tasks.workunit.client.0.smithi081.stdout:8/654: link d3/d3c/cb0 d3/d11/d86/cdc 0 2024-04-23T14:49:44.462 INFO:tasks.workunit.client.0.smithi081.stdout:8/655: chown d3/d11/d86/d88 7058 1 2024-04-23T14:49:44.462 INFO:tasks.workunit.client.1.smithi156.stdout:8/83: creat d5/d9/d10/d1d/f20 x:0 0 0 2024-04-23T14:49:44.464 INFO:tasks.workunit.client.0.smithi081.stdout:1/535: symlink d3/d3d/d7a/lac 0 2024-04-23T14:49:44.464 INFO:tasks.workunit.client.1.smithi156.stdout:5/126: dread d1/d3/f1e [0,4194304] 0 2024-04-23T14:49:44.465 INFO:tasks.workunit.client.0.smithi081.stdout:3/372: link d4/c26 d4/d7/c7d 0 2024-04-23T14:49:44.465 INFO:tasks.workunit.client.0.smithi081.stdout:3/373: stat d4/d7/c40 0 2024-04-23T14:49:44.465 INFO:tasks.workunit.client.0.smithi081.stdout:3/374: creat d4/d7/d32/d6a/f7e x:0 0 0 2024-04-23T14:49:44.465 INFO:tasks.workunit.client.0.smithi081.stdout:3/375: chown d4/d7/d49 217996 1 2024-04-23T14:49:44.465 INFO:tasks.workunit.client.0.smithi081.stdout:3/376: write d4/dc/d31/f74 [301116,127889] 0 2024-04-23T14:49:44.469 INFO:tasks.workunit.client.1.smithi156.stdout:0/85: dwrite d0/f15 [0,4194304] 0 2024-04-23T14:49:44.469 INFO:tasks.workunit.client.1.smithi156.stdout:0/86: chown d0/d4/fe 32032577 1 2024-04-23T14:49:44.470 INFO:tasks.workunit.client.1.smithi156.stdout:2/91: mknod d4/c1b 0 2024-04-23T14:49:44.471 INFO:tasks.workunit.client.1.smithi156.stdout:3/67: dwrite f3 [0,4194304] 0 2024-04-23T14:49:44.474 INFO:tasks.workunit.client.0.smithi081.stdout:8/656: truncate d3/d11/d48/d7e/f95 2460684 0 2024-04-23T14:49:44.474 INFO:tasks.workunit.client.0.smithi081.stdout:8/657: chown d3/d11/d3e/fd1 974093692 1 2024-04-23T14:49:44.477 INFO:tasks.workunit.client.1.smithi156.stdout:6/81: dread d3/da/fe [0,4194304] 0 2024-04-23T14:49:44.479 INFO:tasks.workunit.client.0.smithi081.stdout:1/536: rename d3/d3d/d41/d5e/d17/d58/d7f/l8a to d3/d3d/d6f/lad 0 2024-04-23T14:49:44.479 INFO:tasks.workunit.client.0.smithi081.stdout:1/537: stat d3/d3d/d41/f42 0 2024-04-23T14:49:44.481 INFO:tasks.workunit.client.1.smithi156.stdout:5/127: rename d1/d11/c12 to d1/d11/d18/d19/c2b 0 2024-04-23T14:49:44.482 INFO:tasks.workunit.client.1.smithi156.stdout:0/87: mkdir d0/d4/d14/d1b/d1e 0 2024-04-23T14:49:44.482 INFO:tasks.workunit.client.1.smithi156.stdout:2/92: symlink d4/d13/d19/l1c 0 2024-04-23T14:49:44.482 INFO:tasks.workunit.client.1.smithi156.stdout:2/93: write d4/d13/f18 [609600,81241] 0 2024-04-23T14:49:44.482 INFO:tasks.workunit.client.0.smithi081.stdout:8/658: rmdir d3/d11/d48/dc1 39 2024-04-23T14:49:44.484 INFO:tasks.workunit.client.0.smithi081.stdout:1/538: creat d3/d3d/d41/fae x:0 0 0 2024-04-23T14:49:44.486 INFO:tasks.workunit.client.0.smithi081.stdout:9/485: dwrite d3/de/d1d/d54/f89 [0,4194304] 0 2024-04-23T14:49:44.487 INFO:tasks.workunit.client.1.smithi156.stdout:1/105: dwrite db/f17 [0,4194304] 0 2024-04-23T14:49:44.487 INFO:tasks.workunit.client.0.smithi081.stdout:9/486: write d3/de/d1d/d54/d68/f7e [977158,84450] 0 2024-04-23T14:49:44.487 INFO:tasks.workunit.client.0.smithi081.stdout:9/487: truncate d3/de/d1d/d54/f89 4558308 0 2024-04-23T14:49:44.490 INFO:tasks.workunit.client.0.smithi081.stdout:3/377: rename d4/d7/d49/d38 to d4/d7/d7f 0 2024-04-23T14:49:44.490 INFO:tasks.workunit.client.0.smithi081.stdout:3/378: fsync d4/dc/d31/f63 0 2024-04-23T14:49:44.490 INFO:tasks.workunit.client.1.smithi156.stdout:6/82: creat d3/d16/f23 x:0 0 0 2024-04-23T14:49:44.490 INFO:tasks.workunit.client.1.smithi156.stdout:6/83: write d3/f8 [401353,25136] 0 2024-04-23T14:49:44.492 INFO:tasks.workunit.client.0.smithi081.stdout:8/659: truncate d3/f31 126461 0 2024-04-23T14:49:44.492 INFO:tasks.workunit.client.1.smithi156.stdout:0/88: creat d0/d4/d14/f1f x:0 0 0 2024-04-23T14:49:44.494 INFO:tasks.workunit.client.1.smithi156.stdout:5/128: creat d1/d11/d27/f2c x:0 0 0 2024-04-23T14:49:44.498 INFO:tasks.workunit.client.1.smithi156.stdout:2/94: rename d4/d13/f18 to d4/d13/f1d 0 2024-04-23T14:49:44.498 INFO:tasks.workunit.client.1.smithi156.stdout:2/95: dread - d4/d13/d19/f1a zero size 2024-04-23T14:49:44.499 INFO:tasks.workunit.client.0.smithi081.stdout:8/660: truncate d3/d11/f3a 8486028 0 2024-04-23T14:49:44.499 INFO:tasks.workunit.client.0.smithi081.stdout:8/661: fdatasync d3/d11/f2e 0 2024-04-23T14:49:44.501 INFO:tasks.workunit.client.1.smithi156.stdout:7/98: dwrite f6 [0,4194304] 0 2024-04-23T14:49:44.501 INFO:tasks.workunit.client.1.smithi156.stdout:7/99: chown dc/le 144643261 1 2024-04-23T14:49:44.501 INFO:tasks.workunit.client.1.smithi156.stdout:7/100: fsync dc/f14 0 2024-04-23T14:49:44.502 INFO:tasks.workunit.client.0.smithi081.stdout:2/483: dwrite d1/d11/d21/d34/f76 [0,4194304] 0 2024-04-23T14:49:44.506 INFO:tasks.workunit.client.1.smithi156.stdout:3/68: getdents d4 0 2024-04-23T14:49:44.506 INFO:tasks.workunit.client.1.smithi156.stdout:3/69: write f1 [2734065,124225] 0 2024-04-23T14:49:44.507 INFO:tasks.workunit.client.0.smithi081.stdout:8/662: truncate d3/d11/d3e/fbb 2940072 0 2024-04-23T14:49:44.507 INFO:tasks.workunit.client.0.smithi081.stdout:8/663: getdents d3/d11/d34 0 2024-04-23T14:49:44.508 INFO:tasks.workunit.client.0.smithi081.stdout:2/484: dread d1/f43 [0,4194304] 0 2024-04-23T14:49:44.509 INFO:tasks.workunit.client.1.smithi156.stdout:8/84: dwrite d5/d9/f13 [0,4194304] 0 2024-04-23T14:49:44.511 INFO:tasks.workunit.client.1.smithi156.stdout:3/70: fsync f1 0 2024-04-23T14:49:44.512 INFO:tasks.workunit.client.0.smithi081.stdout:8/664: mknod d3/d3c/ddb/cdd 0 2024-04-23T14:49:44.514 INFO:tasks.workunit.client.1.smithi156.stdout:1/106: mknod db/c1d 0 2024-04-23T14:49:44.514 INFO:tasks.workunit.client.1.smithi156.stdout:1/107: getdents db/d15 0 2024-04-23T14:49:44.517 INFO:tasks.workunit.client.0.smithi081.stdout:2/485: rename d1/d11/d21/d52/l59 to d1/laa 0 2024-04-23T14:49:44.520 INFO:tasks.workunit.client.0.smithi081.stdout:8/665: getdents d3/d11/d86/d88 0 2024-04-23T14:49:44.522 INFO:tasks.workunit.client.1.smithi156.stdout:0/89: creat d0/d4/f20 x:0 0 0 2024-04-23T14:49:44.523 INFO:tasks.workunit.client.1.smithi156.stdout:0/90: readlink d0/d4/lb 0 2024-04-23T14:49:44.523 INFO:tasks.workunit.client.1.smithi156.stdout:0/91: write d0/d8/d1d/f17 [1331887,110835] 0 2024-04-23T14:49:44.526 INFO:tasks.workunit.client.1.smithi156.stdout:5/129: getdents d1 0 2024-04-23T14:49:44.532 INFO:tasks.workunit.client.0.smithi081.stdout:8/666: truncate d3/d11/d34/f7c 504642 0 2024-04-23T14:49:44.533 INFO:tasks.workunit.client.1.smithi156.stdout:2/96: rename f2 to d4/d13/d19/f1e 0 2024-04-23T14:49:44.533 INFO:tasks.workunit.client.1.smithi156.stdout:2/97: write d4/d13/d19/f1a [623349,41652] 0 2024-04-23T14:49:44.534 INFO:tasks.workunit.client.0.smithi081.stdout:2/486: dread d1/f32 [0,4194304] 0 2024-04-23T14:49:44.534 INFO:tasks.workunit.client.0.smithi081.stdout:2/487: dread - d1/d11/d21/d34/fa9 zero size 2024-04-23T14:49:44.539 INFO:tasks.workunit.client.0.smithi081.stdout:8/667: creat d3/fde x:0 0 0 2024-04-23T14:49:44.540 INFO:tasks.workunit.client.0.smithi081.stdout:8/668: write d3/d11/d3e/fbd [458589,71202] 0 2024-04-23T14:49:44.545 INFO:tasks.workunit.client.1.smithi156.stdout:7/101: rename dc/l12 to dc/l1b 0 2024-04-23T14:49:44.550 INFO:tasks.workunit.client.0.smithi081.stdout:9/488: dwrite d3/d1a/fc [0,4194304] 0 2024-04-23T14:49:44.569 INFO:tasks.workunit.client.1.smithi156.stdout:8/85: mkdir d5/d9/d10/d1d/d21 0 2024-04-23T14:49:44.569 INFO:tasks.workunit.client.1.smithi156.stdout:8/86: chown d5/d9/d10/d1d/f20 477986 1 2024-04-23T14:49:44.569 INFO:tasks.workunit.client.1.smithi156.stdout:8/87: chown d5/l16 8313 1 2024-04-23T14:49:44.570 INFO:tasks.workunit.client.1.smithi156.stdout:3/71: mknod d4/da/ce 0 2024-04-23T14:49:44.570 INFO:tasks.workunit.client.1.smithi156.stdout:8/88: fdatasync d5/d9/f13 0 2024-04-23T14:49:44.570 INFO:tasks.workunit.client.1.smithi156.stdout:1/108: mknod db/d15/c1e 0 2024-04-23T14:49:44.570 INFO:tasks.workunit.client.1.smithi156.stdout:8/89: chown d5/d9/d10/f11 106 1 2024-04-23T14:49:44.570 INFO:tasks.workunit.client.1.smithi156.stdout:1/109: chown db/f18 4495967 1 2024-04-23T14:49:44.570 INFO:tasks.workunit.client.1.smithi156.stdout:5/130: mknod d1/d3/d20/c2d 0 2024-04-23T14:49:44.570 INFO:tasks.workunit.client.1.smithi156.stdout:5/131: fdatasync d1/d17/f1a 0 2024-04-23T14:49:44.570 INFO:tasks.workunit.client.1.smithi156.stdout:5/132: dread - d1/d11/d27/f2c zero size 2024-04-23T14:49:44.570 INFO:tasks.workunit.client.1.smithi156.stdout:5/133: readlink d1/lf 0 2024-04-23T14:49:44.570 INFO:tasks.workunit.client.1.smithi156.stdout:6/84: truncate d3/f8 2975332 0 2024-04-23T14:49:44.571 INFO:tasks.workunit.client.0.smithi081.stdout:2/488: rename d1/d89 to d1/d11/dab 0 2024-04-23T14:49:44.574 INFO:tasks.workunit.client.1.smithi156.stdout:1/110: mkdir db/d1f 0 2024-04-23T14:49:44.577 INFO:tasks.workunit.client.0.smithi081.stdout:9/489: rename d3/d5/c12 to d3/d67/c9d 0 2024-04-23T14:49:44.577 INFO:tasks.workunit.client.0.smithi081.stdout:9/490: stat d3/d67/c7a 0 2024-04-23T14:49:44.579 INFO:tasks.workunit.client.1.smithi156.stdout:5/134: link d1/d11/d18/f28 d1/d17/f2e 0 2024-04-23T14:49:44.583 INFO:tasks.workunit.client.1.smithi156.stdout:0/92: dwrite d0/d4/ff [0,4194304] 0 2024-04-23T14:49:44.583 INFO:tasks.workunit.client.1.smithi156.stdout:6/85: symlink d3/da/d10/l24 0 2024-04-23T14:49:44.583 INFO:tasks.workunit.client.1.smithi156.stdout:2/98: symlink d4/l1f 0 2024-04-23T14:49:44.585 INFO:tasks.workunit.client.1.smithi156.stdout:6/86: write d3/da/f18 [442929,45493] 0 2024-04-23T14:49:44.585 INFO:tasks.workunit.client.1.smithi156.stdout:6/87: write d3/d16/d1e/f20 [329533,54194] 0 2024-04-23T14:49:44.585 INFO:tasks.workunit.client.1.smithi156.stdout:6/88: chown d3/d16/d1e 790000 1 2024-04-23T14:49:44.587 INFO:tasks.workunit.client.0.smithi081.stdout:9/491: creat d3/d1a/f9e x:0 0 0 2024-04-23T14:49:44.587 INFO:tasks.workunit.client.0.smithi081.stdout:9/492: read - d3/de/d25/f8e zero size 2024-04-23T14:49:44.594 INFO:tasks.workunit.client.1.smithi156.stdout:5/135: mknod d1/d11/d18/c2f 0 2024-04-23T14:49:44.594 INFO:tasks.workunit.client.1.smithi156.stdout:5/136: fdatasync d1/d3/f25 0 2024-04-23T14:49:44.594 INFO:tasks.workunit.client.1.smithi156.stdout:5/137: chown d1/d3/d20/c2d 6 1 2024-04-23T14:49:44.594 INFO:tasks.workunit.client.1.smithi156.stdout:5/138: dread - d1/d11/d18/f28 zero size 2024-04-23T14:49:44.597 INFO:tasks.workunit.client.1.smithi156.stdout:0/93: stat d0/d4/c18 0 2024-04-23T14:49:44.597 INFO:tasks.workunit.client.1.smithi156.stdout:0/94: fdatasync d0/f1a 0 2024-04-23T14:49:44.600 INFO:tasks.workunit.client.0.smithi081.stdout:2/489: dread d1/d11/d21/d34/f73 [0,4194304] 0 2024-04-23T14:49:44.601 INFO:tasks.workunit.client.0.smithi081.stdout:3/379: dwrite d4/d7/f6f [0,4194304] 0 2024-04-23T14:49:44.603 INFO:tasks.workunit.client.1.smithi156.stdout:2/99: rename d4/d13/f1d to d4/d13/f20 0 2024-04-23T14:49:44.603 INFO:tasks.workunit.client.1.smithi156.stdout:6/89: mknod d3/c25 0 2024-04-23T14:49:44.603 INFO:tasks.workunit.client.1.smithi156.stdout:6/90: chown d3/c5 854 1 2024-04-23T14:49:44.603 INFO:tasks.workunit.client.1.smithi156.stdout:0/95: truncate d0/d8/f12 473949 0 2024-04-23T14:49:44.604 INFO:tasks.workunit.client.1.smithi156.stdout:6/91: chown d3/da/d10/c17 17723027 1 2024-04-23T14:49:44.605 INFO:tasks.workunit.client.1.smithi156.stdout:3/72: truncate f1 1840556 0 2024-04-23T14:49:44.608 INFO:tasks.workunit.client.1.smithi156.stdout:1/111: getdents db/d15 0 2024-04-23T14:49:44.610 INFO:tasks.workunit.client.1.smithi156.stdout:2/100: truncate d4/d13/f20 3124365 0 2024-04-23T14:49:44.611 INFO:tasks.workunit.client.0.smithi081.stdout:3/380: getdents d4/dc/d10 0 2024-04-23T14:49:44.611 INFO:tasks.workunit.client.0.smithi081.stdout:3/381: creat d4/d7/df/d30/f80 x:0 0 0 2024-04-23T14:49:44.614 INFO:tasks.workunit.client.1.smithi156.stdout:9/80: sync 2024-04-23T14:49:44.614 INFO:tasks.workunit.client.1.smithi156.stdout:4/67: sync 2024-04-23T14:49:44.614 INFO:tasks.workunit.client.1.smithi156.stdout:4/68: truncate d0/df/f17 653369 0 2024-04-23T14:49:44.614 INFO:tasks.workunit.client.1.smithi156.stdout:4/69: fsync d0/df/f14 0 2024-04-23T14:49:44.614 INFO:tasks.workunit.client.1.smithi156.stdout:9/81: write d1/d2/f13 [661189,92482] 0 2024-04-23T14:49:44.614 INFO:tasks.workunit.client.1.smithi156.stdout:9/82: fsync d1/d2/d4/f8 0 2024-04-23T14:49:44.622 INFO:tasks.workunit.client.1.smithi156.stdout:8/90: read d5/d9/fd [3386581,56492] 0 2024-04-23T14:49:44.622 INFO:tasks.workunit.client.1.smithi156.stdout:1/112: mknod db/c20 0 2024-04-23T14:49:44.622 INFO:tasks.workunit.client.1.smithi156.stdout:6/92: symlink d3/da/d1d/l26 0 2024-04-23T14:49:44.623 INFO:tasks.workunit.client.1.smithi156.stdout:7/102: dwrite dc/f19 [0,4194304] 0 2024-04-23T14:49:44.623 INFO:tasks.workunit.client.1.smithi156.stdout:7/103: chown dc/le 994964 1 2024-04-23T14:49:44.624 INFO:tasks.workunit.client.0.smithi081.stdout:8/669: dwrite d3/d11/d4f/f6a [0,4194304] 0 2024-04-23T14:49:44.624 INFO:tasks.workunit.client.1.smithi156.stdout:3/73: truncate f3 4207181 0 2024-04-23T14:49:44.625 INFO:tasks.workunit.client.0.smithi081.stdout:2/490: write d1/d33/d45/d6e/d96/f63 [849438,125953] 0 2024-04-23T14:49:44.625 INFO:tasks.workunit.client.1.smithi156.stdout:4/70: creat d0/d8/f18 x:0 0 0 2024-04-23T14:49:44.625 INFO:tasks.workunit.client.1.smithi156.stdout:4/71: fsync d0/f3 0 2024-04-23T14:49:44.632 INFO:tasks.workunit.client.1.smithi156.stdout:2/101: mkdir d4/d21 0 2024-04-23T14:49:44.634 INFO:tasks.workunit.client.1.smithi156.stdout:6/93: rename d3/d19 to d3/da/d1d/d27 0 2024-04-23T14:49:44.635 INFO:tasks.workunit.client.1.smithi156.stdout:6/94: creat d3/da/f28 x:0 0 0 2024-04-23T14:49:44.636 INFO:tasks.workunit.client.0.smithi081.stdout:9/493: dwrite d3/f9 [4194304,4194304] 0 2024-04-23T14:49:44.636 INFO:tasks.workunit.client.0.smithi081.stdout:8/670: creat d3/d11/d86/fdf x:0 0 0 2024-04-23T14:49:44.636 INFO:tasks.workunit.client.0.smithi081.stdout:8/671: readlink d3/d11/d4f/d58/l8a 0 2024-04-23T14:49:44.637 INFO:tasks.workunit.client.1.smithi156.stdout:0/96: write d0/d4/ff [3229618,32785] 0 2024-04-23T14:49:44.638 INFO:tasks.workunit.client.1.smithi156.stdout:7/104: creat dc/f1c x:0 0 0 2024-04-23T14:49:44.639 INFO:tasks.workunit.client.1.smithi156.stdout:4/72: mkdir d0/df/d19 0 2024-04-23T14:49:44.641 INFO:tasks.workunit.client.0.smithi081.stdout:2/491: mknod d1/d33/d45/d48/cac 0 2024-04-23T14:49:44.642 INFO:tasks.workunit.client.0.smithi081.stdout:2/492: write d1/d11/d21/d34/f47 [791638,78759] 0 2024-04-23T14:49:44.647 INFO:tasks.workunit.client.0.smithi081.stdout:8/672: getdents d3/d11/d3e/d63/d78/da0 0 2024-04-23T14:49:44.650 INFO:tasks.workunit.client.0.smithi081.stdout:9/494: rmdir d3/d5 39 2024-04-23T14:49:44.650 INFO:tasks.workunit.client.0.smithi081.stdout:9/495: rename d3/de/d1d to d3/de/d1d/d62/d9f 22 2024-04-23T14:49:44.650 INFO:tasks.workunit.client.1.smithi156.stdout:0/97: mknod d0/d4/c21 0 2024-04-23T14:49:44.652 INFO:tasks.workunit.client.1.smithi156.stdout:4/73: unlink d0/df/c12 0 2024-04-23T14:49:44.653 INFO:tasks.workunit.client.0.smithi081.stdout:8/673: mkdir d3/d11/d86/d88/da7/de0 0 2024-04-23T14:49:44.653 INFO:tasks.workunit.client.0.smithi081.stdout:8/674: write d3/d11/d48/d7e/f9e [139191,27194] 0 2024-04-23T14:49:44.653 INFO:tasks.workunit.client.0.smithi081.stdout:8/675: readlink d3/d11/d3e/d63/d78/l85 0 2024-04-23T14:49:44.655 INFO:tasks.workunit.client.1.smithi156.stdout:2/102: mknod d4/c22 0 2024-04-23T14:49:44.656 INFO:tasks.workunit.client.1.smithi156.stdout:2/103: creat d4/d13/f23 x:0 0 0 2024-04-23T14:49:44.656 INFO:tasks.workunit.client.0.smithi081.stdout:9/496: rmdir d3/de/d1d/d54/d68/d82 0 2024-04-23T14:49:44.657 INFO:tasks.workunit.client.0.smithi081.stdout:8/676: rmdir d3/d11/d4f 39 2024-04-23T14:49:44.657 INFO:tasks.workunit.client.0.smithi081.stdout:2/493: dread d1/d11/f12 [0,4194304] 0 2024-04-23T14:49:44.657 INFO:tasks.workunit.client.0.smithi081.stdout:2/494: truncate d1/d11/d21/f3b 5254006 0 2024-04-23T14:49:44.659 INFO:tasks.workunit.client.1.smithi156.stdout:2/104: creat d4/f24 x:0 0 0 2024-04-23T14:49:44.659 INFO:tasks.workunit.client.1.smithi156.stdout:2/105: write d4/d13/f20 [1227707,67069] 0 2024-04-23T14:49:44.661 INFO:tasks.workunit.client.0.smithi081.stdout:9/497: mknod d3/de/d1d/d62/ca0 0 2024-04-23T14:49:44.661 INFO:tasks.workunit.client.0.smithi081.stdout:8/677: creat d3/d1a/fe1 x:0 0 0 2024-04-23T14:49:44.661 INFO:tasks.workunit.client.0.smithi081.stdout:8/678: fsync d3/d11/d34/fa2 0 2024-04-23T14:49:44.661 INFO:tasks.workunit.client.0.smithi081.stdout:8/679: write d3/d11/d34/f72 [336164,74553] 0 2024-04-23T14:49:44.661 INFO:tasks.workunit.client.0.smithi081.stdout:8/680: chown d3/d11/d3e/lb7 1831 1 2024-04-23T14:49:44.672 INFO:tasks.workunit.client.0.smithi081.stdout:8/681: rename d3/d11/d86/fb2 to d3/d11/d48/fe2 0 2024-04-23T14:49:44.701 INFO:tasks.workunit.client.0.smithi081.stdout:8/682: dread d3/d1a/fb8 [0,4194304] 0 2024-04-23T14:49:44.702 INFO:tasks.workunit.client.0.smithi081.stdout:8/683: mknod d3/d11/d34/d8b/ce3 0 2024-04-23T14:49:44.705 INFO:tasks.workunit.client.1.smithi156.stdout:5/139: dwrite d1/d11/d27/f2c [0,4194304] 0 2024-04-23T14:49:44.705 INFO:tasks.workunit.client.1.smithi156.stdout:5/140: read - d1/d3/f25 zero size 2024-04-23T14:49:44.705 INFO:tasks.workunit.client.1.smithi156.stdout:3/74: dread f3 [0,4194304] 0 2024-04-23T14:49:44.707 INFO:tasks.workunit.client.0.smithi081.stdout:8/684: mkdir d3/d11/d48/d7e/de4 0 2024-04-23T14:49:44.709 INFO:tasks.workunit.client.0.smithi081.stdout:6/419: sync 2024-04-23T14:49:44.709 INFO:tasks.workunit.client.0.smithi081.stdout:6/420: chown d1/d51/d65/d1c/d66/f96 21306 1 2024-04-23T14:49:44.709 INFO:tasks.workunit.client.0.smithi081.stdout:6/421: dread - d1/d51/d65/d13/f77 zero size 2024-04-23T14:49:44.715 INFO:tasks.workunit.client.1.smithi156.stdout:4/74: dread d0/df/f17 [0,4194304] 0 2024-04-23T14:49:44.716 INFO:tasks.workunit.client.1.smithi156.stdout:4/75: truncate d0/d8/f18 461770 0 2024-04-23T14:49:44.726 INFO:tasks.workunit.client.0.smithi081.stdout:6/422: dread d1/f2a [0,4194304] 0 2024-04-23T14:49:44.728 INFO:tasks.workunit.client.0.smithi081.stdout:6/423: truncate d1/d51/d65/f43 3029291 0 2024-04-23T14:49:44.732 INFO:tasks.workunit.client.1.smithi156.stdout:3/75: dread f3 [0,4194304] 0 2024-04-23T14:49:44.732 INFO:tasks.workunit.client.1.smithi156.stdout:3/76: write f1 [1970953,46120] 0 2024-04-23T14:49:44.734 INFO:tasks.workunit.client.1.smithi156.stdout:2/106: dwrite d4/f16 [0,4194304] 0 2024-04-23T14:49:44.736 INFO:tasks.workunit.client.1.smithi156.stdout:3/77: getdents d4/db 0 2024-04-23T14:49:44.739 INFO:tasks.workunit.client.1.smithi156.stdout:3/78: creat d4/da/ff x:0 0 0 2024-04-23T14:49:44.740 INFO:tasks.workunit.client.1.smithi156.stdout:3/79: getdents d4/db 0 2024-04-23T14:49:44.741 INFO:tasks.workunit.client.1.smithi156.stdout:6/95: dwrite d3/da/f28 [0,4194304] 0 2024-04-23T14:49:44.741 INFO:tasks.workunit.client.1.smithi156.stdout:6/96: write d3/f8 [546548,65864] 0 2024-04-23T14:49:44.742 INFO:tasks.workunit.client.0.smithi081.stdout:9/498: dwrite d3/de/d22/f39 [0,4194304] 0 2024-04-23T14:49:44.742 INFO:tasks.workunit.client.0.smithi081.stdout:9/499: stat d3/de/d1d/f20 0 2024-04-23T14:49:44.742 INFO:tasks.workunit.client.0.smithi081.stdout:9/500: chown d3/de/f1c 1 1 2024-04-23T14:49:44.742 INFO:tasks.workunit.client.0.smithi081.stdout:9/501: truncate d3/de/d22/f5d 50625 0 2024-04-23T14:49:44.743 INFO:tasks.workunit.client.1.smithi156.stdout:0/98: dwrite d0/d8/f12 [0,4194304] 0 2024-04-23T14:49:44.745 INFO:tasks.workunit.client.0.smithi081.stdout:2/495: dwrite d1/fe [0,4194304] 0 2024-04-23T14:49:44.745 INFO:tasks.workunit.client.0.smithi081.stdout:2/496: readlink d1/d11/dab/l8c 0 2024-04-23T14:49:44.746 INFO:tasks.workunit.client.0.smithi081.stdout:2/497: dread - d1/d11/d21/d34/f86 zero size 2024-04-23T14:49:44.746 INFO:tasks.workunit.client.0.smithi081.stdout:2/498: fdatasync d1/d1e/f84 0 2024-04-23T14:49:44.746 INFO:tasks.workunit.client.0.smithi081.stdout:2/499: dread - d1/d11/d21/d52/f75 zero size 2024-04-23T14:49:44.752 INFO:tasks.workunit.client.1.smithi156.stdout:6/97: mknod d3/c29 0 2024-04-23T14:49:44.757 INFO:tasks.workunit.client.0.smithi081.stdout:2/500: mkdir d1/d1e/dad 0 2024-04-23T14:49:44.759 INFO:tasks.workunit.client.0.smithi081.stdout:2/501: rmdir d1/d33/d45 39 2024-04-23T14:49:44.759 INFO:tasks.workunit.client.0.smithi081.stdout:2/502: dread - d1/d11/d21/d34/f86 zero size 2024-04-23T14:49:44.762 INFO:tasks.workunit.client.0.smithi081.stdout:2/503: rename d1/d33/d45/d6e/d96/c5c to d1/cae 0 2024-04-23T14:49:44.762 INFO:tasks.workunit.client.0.smithi081.stdout:2/504: truncate d1/d11/d21/d34/f47 1736207 0 2024-04-23T14:49:44.762 INFO:tasks.workunit.client.0.smithi081.stdout:2/505: write d1/d1e/f84 [937278,58605] 0 2024-04-23T14:49:44.763 INFO:tasks.workunit.client.0.smithi081.stdout:2/506: mknod d1/d11/d21/d52/caf 0 2024-04-23T14:49:44.763 INFO:tasks.workunit.client.0.smithi081.stdout:2/507: creat d1/d1e/fb0 x:0 0 0 2024-04-23T14:49:44.765 INFO:tasks.workunit.client.0.smithi081.stdout:2/508: truncate d1/d11/d21/d34/f4b 1152914 0 2024-04-23T14:49:44.772 INFO:tasks.workunit.client.1.smithi156.stdout:0/99: dread d0/d8/f12 [0,4194304] 0 2024-04-23T14:49:44.773 INFO:tasks.workunit.client.0.smithi081.stdout:2/509: dread d1/d11/f25 [0,4194304] 0 2024-04-23T14:49:44.773 INFO:tasks.workunit.client.0.smithi081.stdout:2/510: creat d1/d11/d21/d34/fb1 x:0 0 0 2024-04-23T14:49:44.774 INFO:tasks.workunit.client.0.smithi081.stdout:2/511: chown d1/f1c 10807 1 2024-04-23T14:49:44.774 INFO:tasks.workunit.client.0.smithi081.stdout:2/512: creat d1/d33/d45/d6e/d97/fb2 x:0 0 0 2024-04-23T14:49:44.774 INFO:tasks.workunit.client.1.smithi156.stdout:9/83: dwrite d1/d2/d4/f8 [0,4194304] 0 2024-04-23T14:49:44.774 INFO:tasks.workunit.client.1.smithi156.stdout:6/98: write d3/da/d10/f1b [2521885,77854] 0 2024-04-23T14:49:44.775 INFO:tasks.workunit.client.1.smithi156.stdout:9/84: creat d1/f1e x:0 0 0 2024-04-23T14:49:44.775 INFO:tasks.workunit.client.1.smithi156.stdout:4/76: dwrite d0/d8/f18 [0,4194304] 0 2024-04-23T14:49:44.775 INFO:tasks.workunit.client.1.smithi156.stdout:4/77: truncate d0/f3 1577574 0 2024-04-23T14:49:44.776 INFO:tasks.workunit.client.1.smithi156.stdout:4/78: creat d0/f1a x:0 0 0 2024-04-23T14:49:44.777 INFO:tasks.workunit.client.0.smithi081.stdout:6/424: write d1/d2/f6d [1882253,108696] 0 2024-04-23T14:49:44.779 INFO:tasks.workunit.client.0.smithi081.stdout:8/685: dwrite d3/d3c/fa9 [0,4194304] 0 2024-04-23T14:49:44.779 INFO:tasks.workunit.client.0.smithi081.stdout:8/686: fdatasync d3/f5 0 2024-04-23T14:49:44.780 INFO:tasks.workunit.client.0.smithi081.stdout:2/513: symlink d1/d11/d21/d52/d8b/lb3 0 2024-04-23T14:49:44.780 INFO:tasks.workunit.client.0.smithi081.stdout:2/514: write d1/d11/d21/d34/f73 [1550876,38996] 0 2024-04-23T14:49:44.780 INFO:tasks.workunit.client.0.smithi081.stdout:2/515: fdatasync d1/d1e/f9c 0 2024-04-23T14:49:44.780 INFO:tasks.workunit.client.0.smithi081.stdout:2/516: write d1/d33/d45/d6e/f9d [675655,58275] 0 2024-04-23T14:49:44.788 INFO:tasks.workunit.client.1.smithi156.stdout:9/85: truncate d1/fe 448645 0 2024-04-23T14:49:44.788 INFO:tasks.workunit.client.1.smithi156.stdout:9/86: truncate d1/d2/d4/f8 4941555 0 2024-04-23T14:49:44.793 INFO:tasks.workunit.client.1.smithi156.stdout:9/87: unlink d1/d2/d4/d19/f1d 0 2024-04-23T14:49:44.796 INFO:tasks.workunit.client.0.smithi081.stdout:8/687: mknod d3/d11/d4f/ce5 0 2024-04-23T14:49:44.799 INFO:tasks.workunit.client.0.smithi081.stdout:6/425: dread d1/f18 [0,4194304] 0 2024-04-23T14:49:44.799 INFO:tasks.workunit.client.0.smithi081.stdout:6/426: chown d1/d51/d65/d13/d16/f75 27644326 1 2024-04-23T14:49:44.800 INFO:tasks.workunit.client.0.smithi081.stdout:2/517: rename d1/d1e/f6c to d1/d33/d45/d6e/d97/fb4 0 2024-04-23T14:49:44.800 INFO:tasks.workunit.client.0.smithi081.stdout:2/518: read - d1/f85 zero size 2024-04-23T14:49:44.800 INFO:tasks.workunit.client.0.smithi081.stdout:2/519: write d1/f7f [806770,52110] 0 2024-04-23T14:49:44.803 INFO:tasks.workunit.client.0.smithi081.stdout:6/427: creat d1/d2/d8e/d98/f9a x:0 0 0 2024-04-23T14:49:44.803 INFO:tasks.workunit.client.0.smithi081.stdout:6/428: dread - d1/d2/d8e/d98/f9a zero size 2024-04-23T14:49:44.814 INFO:tasks.workunit.client.0.smithi081.stdout:2/520: mknod d1/d33/d45/d48/cb5 0 2024-04-23T14:49:44.814 INFO:tasks.workunit.client.0.smithi081.stdout:2/521: write d1/d33/d45/d6e/d96/f63 [933493,85996] 0 2024-04-23T14:49:44.814 INFO:tasks.workunit.client.0.smithi081.stdout:2/522: fsync d1/f87 0 2024-04-23T14:49:44.815 INFO:tasks.workunit.client.0.smithi081.stdout:9/502: dwrite d3/de/d1d/d54/f66 [0,4194304] 0 2024-04-23T14:49:44.815 INFO:tasks.workunit.client.0.smithi081.stdout:9/503: write d3/d5/f3f [709730,16022] 0 2024-04-23T14:49:44.818 INFO:tasks.workunit.client.1.smithi156.stdout:2/107: dwrite d4/d13/f14 [0,4194304] 0 2024-04-23T14:49:44.818 INFO:tasks.workunit.client.1.smithi156.stdout:2/108: creat d4/d13/f25 x:0 0 0 2024-04-23T14:49:44.820 INFO:tasks.workunit.client.0.smithi081.stdout:2/523: creat d1/d33/d45/d48/fb6 x:0 0 0 2024-04-23T14:49:44.820 INFO:tasks.workunit.client.0.smithi081.stdout:2/524: readlink d1/d11/d21/d34/l55 0 2024-04-23T14:49:44.829 INFO:tasks.workunit.client.1.smithi156.stdout:6/99: dwrite d3/da/f28 [4194304,4194304] 0 2024-04-23T14:49:44.830 INFO:tasks.workunit.client.0.smithi081.stdout:8/688: dread d3/d3c/f97 [0,4194304] 0 2024-04-23T14:49:44.831 INFO:tasks.workunit.client.1.smithi156.stdout:5/141: dwrite d1/d3/fd [0,4194304] 0 2024-04-23T14:49:44.831 INFO:tasks.workunit.client.1.smithi156.stdout:5/142: dread - d1/d11/f13 zero size 2024-04-23T14:49:44.831 INFO:tasks.workunit.client.1.smithi156.stdout:0/100: dwrite d0/d4/ff [0,4194304] 0 2024-04-23T14:49:44.835 INFO:tasks.workunit.client.0.smithi081.stdout:9/504: rmdir d3/de/d14/d5e 39 2024-04-23T14:49:44.837 INFO:tasks.workunit.client.1.smithi156.stdout:3/80: dread f1 [0,4194304] 0 2024-04-23T14:49:44.837 INFO:tasks.workunit.client.1.smithi156.stdout:3/81: readlink d4/l9 0 2024-04-23T14:49:44.837 INFO:tasks.workunit.client.1.smithi156.stdout:3/82: truncate f3 4627053 0 2024-04-23T14:49:44.839 INFO:tasks.workunit.client.1.smithi156.stdout:6/100: symlink d3/da/d1d/d27/l2a 0 2024-04-23T14:49:44.839 INFO:tasks.workunit.client.1.smithi156.stdout:6/101: chown d3/da 673 1 2024-04-23T14:49:44.840 INFO:tasks.workunit.client.1.smithi156.stdout:2/109: mkdir d4/d26 0 2024-04-23T14:49:44.843 INFO:tasks.workunit.client.0.smithi081.stdout:8/689: dread d3/d11/d3e/f96 [0,4194304] 0 2024-04-23T14:49:44.843 INFO:tasks.workunit.client.0.smithi081.stdout:8/690: dread - d3/d11/d4f/d58/fbf zero size 2024-04-23T14:49:44.843 INFO:tasks.workunit.client.0.smithi081.stdout:7/335: sync 2024-04-23T14:49:44.844 INFO:tasks.workunit.client.0.smithi081.stdout:5/481: sync 2024-04-23T14:49:44.845 INFO:tasks.workunit.client.0.smithi081.stdout:7/336: write d3/d21/d31/d63/f69 [57781,59935] 0 2024-04-23T14:49:44.845 INFO:tasks.workunit.client.1.smithi156.stdout:9/88: write d1/d2/d4/f8 [1189789,50487] 0 2024-04-23T14:49:44.846 INFO:tasks.workunit.client.0.smithi081.stdout:3/382: sync 2024-04-23T14:49:44.846 INFO:tasks.workunit.client.0.smithi081.stdout:3/383: readlink d4/d7/d1a/l5f 0 2024-04-23T14:49:44.847 INFO:tasks.workunit.client.0.smithi081.stdout:3/384: dread - d4/dc/d31/f63 zero size 2024-04-23T14:49:44.847 INFO:tasks.workunit.client.0.smithi081.stdout:3/385: fdatasync d4/d41/f66 0 2024-04-23T14:49:44.849 INFO:tasks.workunit.client.1.smithi156.stdout:9/89: read d1/d2/d4/f8 [4414094,16078] 0 2024-04-23T14:49:44.849 INFO:tasks.workunit.client.1.smithi156.stdout:9/90: dread - d1/d2/d4/f1a zero size 2024-04-23T14:49:44.849 INFO:tasks.workunit.client.1.smithi156.stdout:4/79: dwrite d0/d8/fc [0,4194304] 0 2024-04-23T14:49:44.851 INFO:tasks.workunit.client.0.smithi081.stdout:1/539: sync 2024-04-23T14:49:44.853 INFO:tasks.workunit.client.0.smithi081.stdout:7/337: write d3/d21/d31/f8 [1248625,45362] 0 2024-04-23T14:49:44.853 INFO:tasks.workunit.client.0.smithi081.stdout:7/338: write d3/d21/d31/d33/f3b [2539604,119413] 0 2024-04-23T14:49:44.856 INFO:tasks.workunit.client.0.smithi081.stdout:2/525: rmdir d1/d11/d21 39 2024-04-23T14:49:44.862 INFO:tasks.workunit.client.1.smithi156.stdout:9/91: dread d1/d2/f18 [0,4194304] 0 2024-04-23T14:49:44.862 INFO:tasks.workunit.client.1.smithi156.stdout:9/92: fsync d1/fe 0 2024-04-23T14:49:44.869 INFO:tasks.workunit.client.1.smithi156.stdout:3/83: unlink d4/l9 0 2024-04-23T14:49:44.874 INFO:tasks.workunit.client.0.smithi081.stdout:0/542: sync 2024-04-23T14:49:44.874 INFO:tasks.workunit.client.0.smithi081.stdout:4/441: sync 2024-04-23T14:49:44.874 INFO:tasks.workunit.client.0.smithi081.stdout:4/442: dread - d1/d3/f57 zero size 2024-04-23T14:49:44.877 INFO:tasks.workunit.client.1.smithi156.stdout:6/102: mkdir d3/da/d10/d2b 0 2024-04-23T14:49:44.879 INFO:tasks.workunit.client.0.smithi081.stdout:8/691: truncate d3/d11/d48/f8d 1392092 0 2024-04-23T14:49:44.880 INFO:tasks.workunit.client.0.smithi081.stdout:2/526: dread d1/d33/d45/d6e/f8e [0,4194304] 0 2024-04-23T14:49:44.882 INFO:tasks.workunit.client.1.smithi156.stdout:0/101: dwrite d0/d8/d1d/f17 [0,4194304] 0 2024-04-23T14:49:44.883 INFO:tasks.workunit.client.0.smithi081.stdout:5/482: symlink d17/d37/lac 0 2024-04-23T14:49:44.883 INFO:tasks.workunit.client.0.smithi081.stdout:5/483: write d17/d3d/f49 [2461629,110647] 0 2024-04-23T14:49:44.883 INFO:tasks.workunit.client.0.smithi081.stdout:5/484: fsync d17/d4f/d61/f84 0 2024-04-23T14:49:44.884 INFO:tasks.workunit.client.0.smithi081.stdout:3/386: mknod d4/d7/d32/c81 0 2024-04-23T14:49:44.889 INFO:tasks.workunit.client.0.smithi081.stdout:7/339: mkdir d3/d21/d31/d33/d4b/d6e 0 2024-04-23T14:49:44.889 INFO:tasks.workunit.client.1.smithi156.stdout:6/103: dread d3/da/d10/f14 [0,4194304] 0 2024-04-23T14:49:44.895 INFO:tasks.workunit.client.0.smithi081.stdout:4/443: rename d1/d3/f8 to d1/d4/d11/d75/f95 0 2024-04-23T14:49:44.898 INFO:tasks.workunit.client.0.smithi081.stdout:0/543: write d6/f4f [1520684,10326] 0 2024-04-23T14:49:44.898 INFO:tasks.workunit.client.0.smithi081.stdout:0/544: chown d6/d25/f51 1205 1 2024-04-23T14:49:44.898 INFO:tasks.workunit.client.1.smithi156.stdout:6/104: fsync d3/f8 0 2024-04-23T14:49:44.898 INFO:tasks.workunit.client.0.smithi081.stdout:8/692: mknod d3/d11/d4f/ce6 0 2024-04-23T14:49:44.899 INFO:tasks.workunit.client.0.smithi081.stdout:8/693: fsync d3/fba 0 2024-04-23T14:49:44.902 INFO:tasks.workunit.client.0.smithi081.stdout:6/429: dwrite d1/f18 [0,4194304] 0 2024-04-23T14:49:44.909 INFO:tasks.workunit.client.0.smithi081.stdout:5/485: rmdir d17/d37/d4e 39 2024-04-23T14:49:44.909 INFO:tasks.workunit.client.0.smithi081.stdout:5/486: fdatasync d17/d4f/d61/fab 0 2024-04-23T14:49:44.909 INFO:tasks.workunit.client.0.smithi081.stdout:5/487: chown d17/d1f/d42/c46 87687959 1 2024-04-23T14:49:44.910 INFO:tasks.workunit.client.1.smithi156.stdout:4/80: mkdir d0/df/d1b 0 2024-04-23T14:49:44.912 INFO:tasks.workunit.client.0.smithi081.stdout:7/340: creat d3/d21/d31/d33/f6f x:0 0 0 2024-04-23T14:49:44.915 INFO:tasks.workunit.client.1.smithi156.stdout:5/143: getdents d1/d11/d27 0 2024-04-23T14:49:44.919 INFO:tasks.workunit.client.1.smithi156.stdout:9/93: dwrite d1/d2/f18 [0,4194304] 0 2024-04-23T14:49:44.921 INFO:tasks.workunit.client.1.smithi156.stdout:3/84: unlink f1 0 2024-04-23T14:49:44.926 INFO:tasks.workunit.client.1.smithi156.stdout:4/81: write d0/d8/fd [2852589,115939] 0 2024-04-23T14:49:44.930 INFO:tasks.workunit.client.0.smithi081.stdout:1/540: dwrite d3/d3d/d41/d4a/d77/f98 [0,4194304] 0 2024-04-23T14:49:44.936 INFO:tasks.workunit.client.0.smithi081.stdout:4/444: symlink d1/d8f/l96 0 2024-04-23T14:49:44.940 INFO:tasks.workunit.client.0.smithi081.stdout:8/694: rmdir d3/d11/d4f/d58 39 2024-04-23T14:49:44.944 INFO:tasks.workunit.client.1.smithi156.stdout:0/102: mkdir d0/d4/d22 0 2024-04-23T14:49:44.944 INFO:tasks.workunit.client.1.smithi156.stdout:0/103: truncate d0/d4/d14/f1f 622135 0 2024-04-23T14:49:44.945 INFO:tasks.workunit.client.1.smithi156.stdout:0/104: readlink d0/d4/l10 0 2024-04-23T14:49:44.945 INFO:tasks.workunit.client.0.smithi081.stdout:6/430: creat d1/d51/d65/d78/f9b x:0 0 0 2024-04-23T14:49:44.947 INFO:tasks.workunit.client.1.smithi156.stdout:6/105: mknod d3/da/d1d/d27/c2c 0 2024-04-23T14:49:44.947 INFO:tasks.workunit.client.1.smithi156.stdout:6/106: write d3/da/d10/f14 [4499679,84716] 0 2024-04-23T14:49:44.952 INFO:tasks.workunit.client.0.smithi081.stdout:5/488: mknod d17/d1f/d36/d59/cad 0 2024-04-23T14:49:44.953 INFO:tasks.workunit.client.1.smithi156.stdout:2/110: dwrite d4/d13/f14 [4194304,4194304] 0 2024-04-23T14:49:44.953 INFO:tasks.workunit.client.1.smithi156.stdout:5/144: creat d1/f30 x:0 0 0 2024-04-23T14:49:44.955 INFO:tasks.workunit.client.0.smithi081.stdout:1/541: dread d3/d3d/d41/d5e/d12/d1a/f48 [0,4194304] 0 2024-04-23T14:49:44.955 INFO:tasks.workunit.client.0.smithi081.stdout:1/542: chown d3/d3d/d41/d5e/d17/d26/f72 688569864 1 2024-04-23T14:49:44.955 INFO:tasks.workunit.client.0.smithi081.stdout:0/545: mknod d6/d25/ca6 0 2024-04-23T14:49:44.956 INFO:tasks.workunit.client.1.smithi156.stdout:6/107: dread d3/da/fe [0,4194304] 0 2024-04-23T14:49:44.957 INFO:tasks.workunit.client.1.smithi156.stdout:7/105: sync 2024-04-23T14:49:44.958 INFO:tasks.workunit.client.0.smithi081.stdout:9/505: dwrite d3/de/d1d/d73/f94 [0,4194304] 0 2024-04-23T14:49:44.958 INFO:tasks.workunit.client.0.smithi081.stdout:2/527: dwrite d1/d1e/f9c [0,4194304] 0 2024-04-23T14:49:44.958 INFO:tasks.workunit.client.0.smithi081.stdout:3/387: dwrite d4/dc/f45 [0,4194304] 0 2024-04-23T14:49:44.961 INFO:tasks.workunit.client.1.smithi156.stdout:1/113: sync 2024-04-23T14:49:44.961 INFO:tasks.workunit.client.1.smithi156.stdout:8/91: sync 2024-04-23T14:49:44.963 INFO:tasks.workunit.client.1.smithi156.stdout:7/106: dread dc/f11 [0,4194304] 0 2024-04-23T14:49:44.963 INFO:tasks.workunit.client.1.smithi156.stdout:7/107: fdatasync dc/f19 0 2024-04-23T14:49:44.963 INFO:tasks.workunit.client.1.smithi156.stdout:7/108: fdatasync dc/f19 0 2024-04-23T14:49:44.963 INFO:tasks.workunit.client.1.smithi156.stdout:7/109: stat dc/le 0 2024-04-23T14:49:44.964 INFO:tasks.workunit.client.0.smithi081.stdout:8/695: rename d3/d1a/lcf to d3/d3c/ddb/le7 0 2024-04-23T14:49:44.968 INFO:tasks.workunit.client.0.smithi081.stdout:5/489: creat d17/d3d/d7a/fae x:0 0 0 2024-04-23T14:49:44.969 INFO:tasks.workunit.client.0.smithi081.stdout:5/490: dread - d17/d3d/f51 zero size 2024-04-23T14:49:44.969 INFO:tasks.workunit.client.0.smithi081.stdout:6/431: write d1/d51/d65/d13/f3c [581335,35211] 0 2024-04-23T14:49:44.969 INFO:tasks.workunit.client.0.smithi081.stdout:6/432: creat d1/d51/d65/d13/d46/f9c x:0 0 0 2024-04-23T14:49:44.975 INFO:tasks.workunit.client.1.smithi156.stdout:9/94: mkdir d1/d2/d4/d17/d1f 0 2024-04-23T14:49:44.977 INFO:tasks.workunit.client.1.smithi156.stdout:5/145: mknod d1/d11/c31 0 2024-04-23T14:49:44.977 INFO:tasks.workunit.client.1.smithi156.stdout:5/146: creat d1/d11/d18/f32 x:0 0 0 2024-04-23T14:49:44.977 INFO:tasks.workunit.client.1.smithi156.stdout:5/147: write d1/d17/f2e [266149,12614] 0 2024-04-23T14:49:44.977 INFO:tasks.workunit.client.1.smithi156.stdout:5/148: stat d1/d3/f25 0 2024-04-23T14:49:44.978 INFO:tasks.workunit.client.0.smithi081.stdout:1/543: getdents d3/d3d/d41/d5e/d12/d1a/d2a/d70 0 2024-04-23T14:49:44.978 INFO:tasks.workunit.client.0.smithi081.stdout:1/544: write d3/d3d/d41/d5e/da0/fa2 [457817,47100] 0 2024-04-23T14:49:44.980 INFO:tasks.workunit.client.1.smithi156.stdout:8/92: unlink d5/d9/d10/d1d/f20 0 2024-04-23T14:49:44.982 INFO:tasks.workunit.client.0.smithi081.stdout:7/341: dwrite d3/d21/d31/d33/d4b/f57 [0,4194304] 0 2024-04-23T14:49:44.983 INFO:tasks.workunit.client.1.smithi156.stdout:1/114: mkdir db/d21 0 2024-04-23T14:49:44.984 INFO:tasks.workunit.client.1.smithi156.stdout:1/115: write db/f11 [1276633,83845] 0 2024-04-23T14:49:44.985 INFO:tasks.workunit.client.0.smithi081.stdout:3/388: dread d4/dc/f52 [0,4194304] 0 2024-04-23T14:49:44.986 INFO:tasks.workunit.client.1.smithi156.stdout:7/110: mkdir dc/d1d 0 2024-04-23T14:49:44.986 INFO:tasks.workunit.client.1.smithi156.stdout:7/111: getdents dc/d1d 0 2024-04-23T14:49:44.988 INFO:tasks.workunit.client.1.smithi156.stdout:3/85: dwrite f3 [4194304,4194304] 0 2024-04-23T14:49:44.988 INFO:tasks.workunit.client.1.smithi156.stdout:3/86: fsync f3 0 2024-04-23T14:49:44.988 INFO:tasks.workunit.client.1.smithi156.stdout:3/87: write d4/da/ff [142330,111961] 0 2024-04-23T14:49:44.991 INFO:tasks.workunit.client.1.smithi156.stdout:0/105: getdents d0 0 2024-04-23T14:49:44.991 INFO:tasks.workunit.client.1.smithi156.stdout:9/95: mknod d1/d2/c20 0 2024-04-23T14:49:44.993 INFO:tasks.workunit.client.0.smithi081.stdout:2/528: rmdir d1/d11/d21/d52/da2 0 2024-04-23T14:49:44.993 INFO:tasks.workunit.client.1.smithi156.stdout:8/93: dread d5/f8 [0,4194304] 0 2024-04-23T14:49:44.994 INFO:tasks.workunit.client.1.smithi156.stdout:8/94: write d5/f15 [734426,3465] 0 2024-04-23T14:49:44.994 INFO:tasks.workunit.client.1.smithi156.stdout:2/111: symlink d4/l27 0 2024-04-23T14:49:45.003 INFO:tasks.workunit.client.1.smithi156.stdout:5/149: creat d1/d3/d20/f33 x:0 0 0 2024-04-23T14:49:45.003 INFO:tasks.workunit.client.1.smithi156.stdout:5/150: write d1/d3/d20/f33 [585498,87016] 0 2024-04-23T14:49:45.003 INFO:tasks.workunit.client.0.smithi081.stdout:0/546: rename d6/d11/d14/d24/c52 to d6/d11/ca7 0 2024-04-23T14:49:45.005 INFO:tasks.workunit.client.1.smithi156.stdout:1/116: truncate db/f19 1205666 0 2024-04-23T14:49:45.006 INFO:tasks.workunit.client.0.smithi081.stdout:5/491: mkdir d17/d1f/d36/daf 0 2024-04-23T14:49:45.007 INFO:tasks.workunit.client.0.smithi081.stdout:5/492: write d17/d3c/f40 [471600,63404] 0 2024-04-23T14:49:45.007 INFO:tasks.workunit.client.0.smithi081.stdout:5/493: fdatasync d17/d1f/f25 0 2024-04-23T14:49:45.010 INFO:tasks.workunit.client.1.smithi156.stdout:0/106: rename d0/d8/f1c to d0/d4/d14/f23 0 2024-04-23T14:49:45.013 INFO:tasks.workunit.client.1.smithi156.stdout:8/95: creat d5/d9/d10/d1d/d21/f22 x:0 0 0 2024-04-23T14:49:45.014 INFO:tasks.workunit.client.0.smithi081.stdout:6/433: getdents d1/d2/d49/d52 0 2024-04-23T14:49:45.018 INFO:tasks.workunit.client.1.smithi156.stdout:1/117: rmdir db 39 2024-04-23T14:49:45.018 INFO:tasks.workunit.client.1.smithi156.stdout:5/151: dread d1/d3/d20/f33 [0,4194304] 0 2024-04-23T14:49:45.018 INFO:tasks.workunit.client.1.smithi156.stdout:0/107: mkdir d0/d4/d22/d24 0 2024-04-23T14:49:45.019 INFO:tasks.workunit.client.0.smithi081.stdout:0/547: dread d6/d37/f7e [0,4194304] 0 2024-04-23T14:49:45.019 INFO:tasks.workunit.client.0.smithi081.stdout:0/548: fdatasync d6/d11/d14/d41/d5b/fa4 0 2024-04-23T14:49:45.019 INFO:tasks.workunit.client.0.smithi081.stdout:0/549: truncate d6/d11/d14/f54 4641531 0 2024-04-23T14:49:45.020 INFO:tasks.workunit.client.1.smithi156.stdout:8/96: unlink d5/f14 0 2024-04-23T14:49:45.021 INFO:tasks.workunit.client.0.smithi081.stdout:7/342: mknod d3/d21/d31/d63/c70 0 2024-04-23T14:49:45.024 INFO:tasks.workunit.client.0.smithi081.stdout:3/389: symlink d4/d7/d49/d51/d53/d6c/l82 0 2024-04-23T14:49:45.026 INFO:tasks.workunit.client.1.smithi156.stdout:2/112: mknod d4/c28 0 2024-04-23T14:49:45.027 INFO:tasks.workunit.client.1.smithi156.stdout:5/152: unlink d1/f30 0 2024-04-23T14:49:45.027 INFO:tasks.workunit.client.1.smithi156.stdout:5/153: getdents d1/d3/d24 0 2024-04-23T14:49:45.028 INFO:tasks.workunit.client.0.smithi081.stdout:2/529: creat d1/d11/dab/fb7 x:0 0 0 2024-04-23T14:49:45.031 INFO:tasks.workunit.client.0.smithi081.stdout:8/696: rmdir d3/d1a 39 2024-04-23T14:49:45.034 INFO:tasks.workunit.client.1.smithi156.stdout:8/97: rename d5/lb to d5/d9/d10/d1d/d21/l23 0 2024-04-23T14:49:45.036 INFO:tasks.workunit.client.0.smithi081.stdout:7/343: dread d3/d21/d41/f43 [0,4194304] 0 2024-04-23T14:49:45.036 INFO:tasks.workunit.client.1.smithi156.stdout:2/113: creat d4/f29 x:0 0 0 2024-04-23T14:49:45.038 INFO:tasks.workunit.client.0.smithi081.stdout:1/545: dread d3/d3d/f13 [0,4194304] 0 2024-04-23T14:49:45.039 INFO:tasks.workunit.client.1.smithi156.stdout:8/98: symlink d5/d19/l24 0 2024-04-23T14:49:45.040 INFO:tasks.workunit.client.0.smithi081.stdout:5/494: mknod d17/d1f/d36/d59/cb0 0 2024-04-23T14:49:45.040 INFO:tasks.workunit.client.0.smithi081.stdout:5/495: readlink l10 0 2024-04-23T14:49:45.042 INFO:tasks.workunit.client.0.smithi081.stdout:6/434: write d1/d2/f1d [1378224,78340] 0 2024-04-23T14:49:45.042 INFO:tasks.workunit.client.0.smithi081.stdout:6/435: creat d1/d51/d65/d8/d2e/d58/f9d x:0 0 0 2024-04-23T14:49:45.043 INFO:tasks.workunit.client.0.smithi081.stdout:0/550: unlink d6/d11/d14/d41/d5b/d59/l5a 0 2024-04-23T14:49:45.043 INFO:tasks.workunit.client.0.smithi081.stdout:0/551: chown d6/d25/f32 31 1 2024-04-23T14:49:45.043 INFO:tasks.workunit.client.0.smithi081.stdout:0/552: chown d6/d11/d14/d41/d5b 4 1 2024-04-23T14:49:45.044 INFO:tasks.workunit.client.0.smithi081.stdout:3/390: getdents d4/dc/d50 0 2024-04-23T14:49:45.050 INFO:tasks.workunit.client.0.smithi081.stdout:9/506: rename d3/de/d1d/d54/d68/f8a to d3/de/d1d/fa1 0 2024-04-23T14:49:45.053 INFO:tasks.workunit.client.0.smithi081.stdout:7/344: mkdir d3/d21/d31/d33/d4b/d71 0 2024-04-23T14:49:45.056 INFO:tasks.workunit.client.0.smithi081.stdout:6/436: unlink d1/d51/d65/d13/f23 0 2024-04-23T14:49:45.062 INFO:tasks.workunit.client.1.smithi156.stdout:6/108: dwrite d3/da/d1d/f21 [0,4194304] 0 2024-04-23T14:49:45.063 INFO:tasks.workunit.client.1.smithi156.stdout:6/109: creat d3/f2d x:0 0 0 2024-04-23T14:49:45.063 INFO:tasks.workunit.client.0.smithi081.stdout:0/553: symlink d6/d11/d14/d41/d5b/d59/d68/la8 0 2024-04-23T14:49:45.063 INFO:tasks.workunit.client.0.smithi081.stdout:2/530: rename d1/d33/d45/f4d to d1/d33/d9f/fb8 0 2024-04-23T14:49:45.065 INFO:tasks.workunit.client.1.smithi156.stdout:7/112: dwrite dc/f14 [0,4194304] 0 2024-04-23T14:49:45.065 INFO:tasks.workunit.client.1.smithi156.stdout:7/113: chown l7 324691 1 2024-04-23T14:49:45.066 INFO:tasks.workunit.client.1.smithi156.stdout:0/108: getdents d0/d4/d22 0 2024-04-23T14:49:45.066 INFO:tasks.workunit.client.1.smithi156.stdout:0/109: creat d0/d4/f25 x:0 0 0 2024-04-23T14:49:45.070 INFO:tasks.workunit.client.0.smithi081.stdout:5/496: rename d17/d37/da4/daa to d17/d1f/da5/db1 0 2024-04-23T14:49:45.070 INFO:tasks.workunit.client.0.smithi081.stdout:5/497: fsync d17/d4a/f8f 0 2024-04-23T14:49:45.070 INFO:tasks.workunit.client.0.smithi081.stdout:5/498: write d17/d1f/d42/f50 [8642807,65494] 0 2024-04-23T14:49:45.071 INFO:tasks.workunit.client.0.smithi081.stdout:6/437: dread d1/d2/f6d [0,4194304] 0 2024-04-23T14:49:45.071 INFO:tasks.workunit.client.1.smithi156.stdout:8/99: rename d5/f15 to d5/d9/d10/f25 0 2024-04-23T14:49:45.072 INFO:tasks.workunit.client.1.smithi156.stdout:8/100: creat d5/d9/f26 x:0 0 0 2024-04-23T14:49:45.072 INFO:tasks.workunit.client.1.smithi156.stdout:8/101: stat d5/d9/la 0 2024-04-23T14:49:45.085 INFO:tasks.workunit.client.0.smithi081.stdout:9/507: dread d3/de/d1d/d54/f89 [0,4194304] 0 2024-04-23T14:49:45.085 INFO:tasks.workunit.client.0.smithi081.stdout:9/508: write d3/de/d1d/d5b/f5c [1594479,15121] 0 2024-04-23T14:49:45.085 INFO:tasks.workunit.client.0.smithi081.stdout:5/499: mknod d17/d1f/d42/d9b/d9e/da3/cb2 0 2024-04-23T14:49:45.085 INFO:tasks.workunit.client.0.smithi081.stdout:9/509: creat d3/de/d1d/d73/fa2 x:0 0 0 2024-04-23T14:49:45.086 INFO:tasks.workunit.client.0.smithi081.stdout:2/531: dread d1/d33/d9f/fb8 [0,4194304] 0 2024-04-23T14:49:45.087 INFO:tasks.workunit.client.1.smithi156.stdout:4/82: dwrite d0/d8/fd [0,4194304] 0 2024-04-23T14:49:45.087 INFO:tasks.workunit.client.1.smithi156.stdout:4/83: chown d0/l5 5 1 2024-04-23T14:49:45.087 INFO:tasks.workunit.client.1.smithi156.stdout:7/114: unlink dc/l1a 0 2024-04-23T14:49:45.093 INFO:tasks.workunit.client.0.smithi081.stdout:6/438: creat d1/d2/d8e/f9e x:0 0 0 2024-04-23T14:49:45.096 INFO:tasks.workunit.client.0.smithi081.stdout:5/500: symlink d17/d3d/d41/lb3 0 2024-04-23T14:49:45.099 INFO:tasks.workunit.client.1.smithi156.stdout:0/110: unlink d0/d4/d14/f23 0 2024-04-23T14:49:45.100 INFO:tasks.workunit.client.0.smithi081.stdout:7/345: write d3/d20/f3f [37696,122590] 0 2024-04-23T14:49:45.102 INFO:tasks.workunit.client.1.smithi156.stdout:8/102: rename d5/f8 to d5/d9/d10/d1d/d21/f27 0 2024-04-23T14:49:45.105 INFO:tasks.workunit.client.0.smithi081.stdout:2/532: mknod d1/d11/dab/cb9 0 2024-04-23T14:49:45.105 INFO:tasks.workunit.client.0.smithi081.stdout:2/533: truncate d1/d33/d45/d6e/d97/fa4 760535 0 2024-04-23T14:49:45.107 INFO:tasks.workunit.client.0.smithi081.stdout:5/501: rename d17/d3d/d41/f82 to d17/fb4 0 2024-04-23T14:49:45.109 INFO:tasks.workunit.client.1.smithi156.stdout:0/111: getdents d0/d4/d11 0 2024-04-23T14:49:45.110 INFO:tasks.workunit.client.0.smithi081.stdout:5/502: creat d17/d1f/d36/fb5 x:0 0 0 2024-04-23T14:49:45.110 INFO:tasks.workunit.client.0.smithi081.stdout:5/503: chown d17/d4f/d61/f84 29195542 1 2024-04-23T14:49:45.112 INFO:tasks.workunit.client.0.smithi081.stdout:5/504: mknod d17/cb6 0 2024-04-23T14:49:45.115 INFO:tasks.workunit.client.0.smithi081.stdout:5/505: symlink d17/d1f/d42/d9b/d9e/da3/lb7 0 2024-04-23T14:49:45.115 INFO:tasks.workunit.client.0.smithi081.stdout:5/506: fdatasync d17/d1f/d36/d59/da8/fa9 0 2024-04-23T14:49:45.117 INFO:tasks.workunit.client.1.smithi156.stdout:4/84: dread d0/d8/fd [0,4194304] 0 2024-04-23T14:49:45.127 INFO:tasks.workunit.client.1.smithi156.stdout:4/85: dread d0/df/f17 [0,4194304] 0 2024-04-23T14:49:45.127 INFO:tasks.workunit.client.1.smithi156.stdout:9/96: dwrite d1/d2/d4/ff [0,4194304] 0 2024-04-23T14:49:45.129 INFO:tasks.workunit.client.0.smithi081.stdout:2/534: dread d1/d11/d21/d34/f72 [0,4194304] 0 2024-04-23T14:49:45.131 INFO:tasks.workunit.client.0.smithi081.stdout:8/697: dwrite d3/d11/d3e/d63/d78/fda [0,4194304] 0 2024-04-23T14:49:45.137 INFO:tasks.workunit.client.1.smithi156.stdout:2/114: dwrite d4/d13/f25 [0,4194304] 0 2024-04-23T14:49:45.140 INFO:tasks.workunit.client.0.smithi081.stdout:3/391: write d4/d7/d32/f3e [1533347,126147] 0 2024-04-23T14:49:45.141 INFO:tasks.workunit.client.0.smithi081.stdout:1/546: dwrite d3/d3d/d41/d5e/d17/fa9 [0,4194304] 0 2024-04-23T14:49:45.144 INFO:tasks.workunit.client.0.smithi081.stdout:8/698: write f2 [1419028,8281] 0 2024-04-23T14:49:45.146 INFO:tasks.workunit.client.0.smithi081.stdout:3/392: mkdir d4/d7/df/d30/d64/d83 0 2024-04-23T14:49:45.146 INFO:tasks.workunit.client.1.smithi156.stdout:3/88: dwrite f3 [4194304,4194304] 0 2024-04-23T14:49:45.149 INFO:tasks.workunit.client.1.smithi156.stdout:7/115: dread fb [0,4194304] 0 2024-04-23T14:49:45.149 INFO:tasks.workunit.client.0.smithi081.stdout:2/535: read d1/d11/d21/f2a [1643054,80144] 0 2024-04-23T14:49:45.150 INFO:tasks.workunit.client.0.smithi081.stdout:0/554: dwrite d6/d11/d14/f73 [0,4194304] 0 2024-04-23T14:49:45.151 INFO:tasks.workunit.client.0.smithi081.stdout:8/699: rename d3/d11/d3e/d63/d78/da0/ccc to d3/d11/d86/d88/ce8 0 2024-04-23T14:49:45.156 INFO:tasks.workunit.client.1.smithi156.stdout:1/118: dwrite db/f17 [0,4194304] 0 2024-04-23T14:49:45.158 INFO:tasks.workunit.client.1.smithi156.stdout:0/112: dread d0/f15 [0,4194304] 0 2024-04-23T14:49:45.159 INFO:tasks.workunit.client.1.smithi156.stdout:6/110: dwrite d3/fd [0,4194304] 0 2024-04-23T14:49:45.160 INFO:tasks.workunit.client.0.smithi081.stdout:2/536: dread d1/d11/d21/f4f [0,4194304] 0 2024-04-23T14:49:45.160 INFO:tasks.workunit.client.0.smithi081.stdout:2/537: dread - d1/d11/d21/d52/d8b/fa8 zero size 2024-04-23T14:49:45.160 INFO:tasks.workunit.client.0.smithi081.stdout:2/538: readlink d1/d1e/l53 0 2024-04-23T14:49:45.160 INFO:tasks.workunit.client.0.smithi081.stdout:2/539: write d1/d33/d45/d6e/d97/fb2 [408102,118238] 0 2024-04-23T14:49:45.164 INFO:tasks.workunit.client.0.smithi081.stdout:0/555: creat d6/d11/d14/d41/d5b/d59/d68/fa9 x:0 0 0 2024-04-23T14:49:45.164 INFO:tasks.workunit.client.0.smithi081.stdout:0/556: write d6/d11/d14/d41/d5b/f47 [4385707,90238] 0 2024-04-23T14:49:45.164 INFO:tasks.workunit.client.0.smithi081.stdout:0/557: fsync d6/d37/d67/d7d/f90 0 2024-04-23T14:49:45.165 INFO:tasks.workunit.client.0.smithi081.stdout:3/393: dread d4/d7/df/f27 [0,4194304] 0 2024-04-23T14:49:45.166 INFO:tasks.workunit.client.1.smithi156.stdout:7/116: getdents dc 0 2024-04-23T14:49:45.171 INFO:tasks.workunit.client.1.smithi156.stdout:1/119: creat db/d15/f22 x:0 0 0 2024-04-23T14:49:45.172 INFO:tasks.workunit.client.1.smithi156.stdout:1/120: chown la 5 1 2024-04-23T14:49:45.172 INFO:tasks.workunit.client.1.smithi156.stdout:1/121: creat db/d15/f23 x:0 0 0 2024-04-23T14:49:45.173 INFO:tasks.workunit.client.0.smithi081.stdout:8/700: rename d3/d11/d4f/d58/la8 to d3/d11/d48/le9 0 2024-04-23T14:49:45.174 INFO:tasks.workunit.client.1.smithi156.stdout:9/97: dread d1/d2/d4/ff [0,4194304] 0 2024-04-23T14:49:45.174 INFO:tasks.workunit.client.1.smithi156.stdout:5/154: dwrite d1/d3/f25 [0,4194304] 0 2024-04-23T14:49:45.176 INFO:tasks.workunit.client.0.smithi081.stdout:1/547: write d3/d3d/d41/d5e/d17/d58/d7f/f4b [1087761,80920] 0 2024-04-23T14:49:45.180 INFO:tasks.workunit.client.0.smithi081.stdout:3/394: dread - d4/d7/df/f72 zero size 2024-04-23T14:49:45.180 INFO:tasks.workunit.client.0.smithi081.stdout:3/395: write d4/d7/d32/f3e [881066,41164] 0 2024-04-23T14:49:45.184 INFO:tasks.workunit.client.1.smithi156.stdout:1/122: rename la to db/d21/l24 0 2024-04-23T14:49:45.187 INFO:tasks.workunit.client.0.smithi081.stdout:2/540: rename d1/d11/d21/d34/l36 to d1/d33/d95/lba 0 2024-04-23T14:49:45.192 INFO:tasks.workunit.client.1.smithi156.stdout:8/103: dwrite d5/d9/d10/f11 [0,4194304] 0 2024-04-23T14:49:45.192 INFO:tasks.workunit.client.1.smithi156.stdout:8/104: readlink d5/d9/l1b 0 2024-04-23T14:49:45.197 INFO:tasks.workunit.client.1.smithi156.stdout:2/115: read d4/f16 [1656306,26070] 0 2024-04-23T14:49:45.197 INFO:tasks.workunit.client.1.smithi156.stdout:2/116: dread - d4/f17 zero size 2024-04-23T14:49:45.204 INFO:tasks.workunit.client.1.smithi156.stdout:9/98: rmdir d1/d2/d4/d17 39 2024-04-23T14:49:45.211 INFO:tasks.workunit.client.1.smithi156.stdout:5/155: creat d1/d3/d24/f34 x:0 0 0 2024-04-23T14:49:45.215 INFO:tasks.workunit.client.0.smithi081.stdout:5/507: dwrite d17/d1f/d36/f43 [0,4194304] 0 2024-04-23T14:49:45.226 INFO:tasks.workunit.client.0.smithi081.stdout:8/701: dread d3/d11/d3e/f5d [0,4194304] 0 2024-04-23T14:49:45.227 INFO:tasks.workunit.client.0.smithi081.stdout:8/702: fdatasync d3/d11/d3e/d63/f94 0 2024-04-23T14:49:45.228 INFO:tasks.workunit.client.1.smithi156.stdout:4/86: dwrite d0/d8/f18 [0,4194304] 0 2024-04-23T14:49:45.235 INFO:tasks.workunit.client.0.smithi081.stdout:2/541: dread d1/f4 [0,4194304] 0 2024-04-23T14:49:45.235 INFO:tasks.workunit.client.0.smithi081.stdout:2/542: write d1/d33/d45/d6e/d96/f63 [44251,77111] 0 2024-04-23T14:49:45.235 INFO:tasks.workunit.client.0.smithi081.stdout:2/543: readlink d1/d11/d21/d34/l55 0 2024-04-23T14:49:45.242 INFO:tasks.workunit.client.1.smithi156.stdout:5/156: dread d1/d11/d27/f2c [0,4194304] 0 2024-04-23T14:49:45.251 INFO:tasks.workunit.client.1.smithi156.stdout:4/87: write d0/d8/fc [3329890,29269] 0 2024-04-23T14:49:45.257 INFO:tasks.workunit.client.0.smithi081.stdout:0/558: dwrite d6/d37/d67/f97 [0,4194304] 0 2024-04-23T14:49:45.261 INFO:tasks.workunit.client.0.smithi081.stdout:1/548: dwrite d3/d3d/d41/d5e/d12/f96 [0,4194304] 0 2024-04-23T14:49:45.261 INFO:tasks.workunit.client.1.smithi156.stdout:3/89: dwrite f3 [0,4194304] 0 2024-04-23T14:49:45.263 INFO:tasks.workunit.client.1.smithi156.stdout:0/113: dwrite d0/d4/f20 [0,4194304] 0 2024-04-23T14:49:45.263 INFO:tasks.workunit.client.1.smithi156.stdout:0/114: chown d0 0 1 2024-04-23T14:49:45.263 INFO:tasks.workunit.client.1.smithi156.stdout:0/115: fdatasync d0/d8/f12 0 2024-04-23T14:49:45.263 INFO:tasks.workunit.client.1.smithi156.stdout:0/116: getdents d0/d4/d11 0 2024-04-23T14:49:45.271 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:44 smithi081 ceph-mon[25540]: pgmap v31: 65 pgs: 65 active+clean; 1.1 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 102 MiB/s rd, 111 MiB/s wr, 483 op/s 2024-04-23T14:49:45.272 INFO:tasks.workunit.client.0.smithi081.stdout:9/510: dwrite d3/de/d22/f5d [0,4194304] 0 2024-04-23T14:49:45.272 INFO:tasks.workunit.client.0.smithi081.stdout:9/511: dread - d3/de/d25/f8e zero size 2024-04-23T14:49:45.278 INFO:tasks.workunit.client.1.smithi156.stdout:6/111: dwrite d3/f8 [0,4194304] 0 2024-04-23T14:49:45.279 INFO:tasks.workunit.client.1.smithi156.stdout:8/105: dwrite d5/d9/fd [0,4194304] 0 2024-04-23T14:49:45.279 INFO:tasks.workunit.client.1.smithi156.stdout:8/106: creat d5/f28 x:0 0 0 2024-04-23T14:49:45.285 INFO:tasks.workunit.client.1.smithi156.stdout:1/123: mkdir db/d25 0 2024-04-23T14:49:45.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:44 smithi156 ceph-mon[32341]: pgmap v31: 65 pgs: 65 active+clean; 1.1 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 102 MiB/s rd, 111 MiB/s wr, 483 op/s 2024-04-23T14:49:45.288 INFO:tasks.workunit.client.0.smithi081.stdout:5/508: dwrite d17/d1f/d36/d59/f9c [0,4194304] 0 2024-04-23T14:49:45.290 INFO:tasks.workunit.client.1.smithi156.stdout:6/112: dread d3/fd [0,4194304] 0 2024-04-23T14:49:45.290 INFO:tasks.workunit.client.1.smithi156.stdout:6/113: write d3/f8 [5240954,40828] 0 2024-04-23T14:49:45.301 INFO:tasks.workunit.client.0.smithi081.stdout:3/396: mkdir d4/d7/d49/d51/d84 0 2024-04-23T14:49:45.302 INFO:tasks.workunit.client.1.smithi156.stdout:2/117: mknod d4/d26/c2a 0 2024-04-23T14:49:45.306 INFO:tasks.workunit.client.1.smithi156.stdout:9/99: creat d1/d2/d4/d17/d1f/f21 x:0 0 0 2024-04-23T14:49:45.306 INFO:tasks.workunit.client.1.smithi156.stdout:9/100: dread - d1/d2/d4/d17/d1f/f21 zero size 2024-04-23T14:49:45.306 INFO:tasks.workunit.client.1.smithi156.stdout:9/101: stat d1/d2/d4/d17/d1f 0 2024-04-23T14:49:45.310 INFO:tasks.workunit.client.0.smithi081.stdout:8/703: symlink d3/d11/d3e/lea 0 2024-04-23T14:49:45.320 INFO:tasks.workunit.client.0.smithi081.stdout:2/544: symlink d1/d33/d9f/lbb 0 2024-04-23T14:49:45.321 INFO:tasks.workunit.client.1.smithi156.stdout:5/157: truncate d1/d11/d27/f2c 3941633 0 2024-04-23T14:49:45.321 INFO:tasks.workunit.client.1.smithi156.stdout:5/158: fsync d1/d11/d18/f32 0 2024-04-23T14:49:45.322 INFO:tasks.workunit.client.1.smithi156.stdout:5/159: chown d1/d11/d18/d19/c2a 154 1 2024-04-23T14:49:45.350 INFO:tasks.workunit.client.1.smithi156.stdout:3/90: dwrite d4/da/ff [0,4194304] 0 2024-04-23T14:49:45.361 INFO:tasks.workunit.client.1.smithi156.stdout:4/88: mkdir d0/df/d19/d1c 0 2024-04-23T14:49:45.375 INFO:tasks.workunit.client.1.smithi156.stdout:5/160: dwrite d1/d3/fa [0,4194304] 0 2024-04-23T14:49:45.378 INFO:tasks.workunit.client.1.smithi156.stdout:0/117: mknod d0/d8/d1d/c26 0 2024-04-23T14:49:45.393 INFO:tasks.workunit.client.1.smithi156.stdout:8/107: mkdir d5/d19/d29 0 2024-04-23T14:49:45.396 INFO:tasks.workunit.client.1.smithi156.stdout:1/124: truncate db/f19 663811 0 2024-04-23T14:49:45.396 INFO:tasks.workunit.client.1.smithi156.stdout:1/125: write db/d15/f23 [973337,4842] 0 2024-04-23T14:49:45.400 INFO:tasks.workunit.client.1.smithi156.stdout:6/114: symlink d3/da/d10/l2e 0 2024-04-23T14:49:45.400 INFO:tasks.workunit.client.1.smithi156.stdout:6/115: stat d3/c25 0 2024-04-23T14:49:45.405 INFO:tasks.workunit.client.1.smithi156.stdout:9/102: creat d1/d2/d4/dc/f22 x:0 0 0 2024-04-23T14:49:45.406 INFO:tasks.workunit.client.0.smithi081.stdout:1/549: mknod d3/d3d/d41/d5e/d12/d2e/caf 0 2024-04-23T14:49:45.406 INFO:tasks.workunit.client.0.smithi081.stdout:1/550: write d3/d3d/d41/d5e/d12/d1a/d2a/d70/f95 [530410,7902] 0 2024-04-23T14:49:45.420 INFO:tasks.workunit.client.1.smithi156.stdout:3/91: rename f3 to d4/f10 0 2024-04-23T14:49:45.420 INFO:tasks.workunit.client.1.smithi156.stdout:3/92: chown d4/f10 6493 1 2024-04-23T14:49:45.421 INFO:tasks.workunit.client.1.smithi156.stdout:3/93: chown d4/db/dd 42843094 1 2024-04-23T14:49:45.421 INFO:tasks.workunit.client.1.smithi156.stdout:3/94: chown d4/l8 497 1 2024-04-23T14:49:45.421 INFO:tasks.workunit.client.1.smithi156.stdout:4/89: link d0/d8/c15 d0/df/c1d 0 2024-04-23T14:49:45.421 INFO:tasks.workunit.client.1.smithi156.stdout:4/90: chown d0/df/d19/d1c 15 1 2024-04-23T14:49:45.421 INFO:tasks.workunit.client.1.smithi156.stdout:8/108: mknod d5/d9/c2a 0 2024-04-23T14:49:45.421 INFO:tasks.workunit.client.1.smithi156.stdout:8/109: dread - d5/f1a zero size 2024-04-23T14:49:45.422 INFO:tasks.workunit.client.1.smithi156.stdout:1/126: creat db/d25/f26 x:0 0 0 2024-04-23T14:49:45.422 INFO:tasks.workunit.client.1.smithi156.stdout:1/127: fdatasync db/d15/f22 0 2024-04-23T14:49:45.422 INFO:tasks.workunit.client.1.smithi156.stdout:1/128: dread - db/d25/f26 zero size 2024-04-23T14:49:45.422 INFO:tasks.workunit.client.1.smithi156.stdout:1/129: dread - db/d15/f22 zero size 2024-04-23T14:49:45.424 INFO:tasks.workunit.client.1.smithi156.stdout:9/103: mkdir d1/d2/d23 0 2024-04-23T14:49:45.424 INFO:tasks.workunit.client.1.smithi156.stdout:9/104: chown d1/d2 4897 1 2024-04-23T14:49:45.428 INFO:tasks.workunit.client.0.smithi081.stdout:3/397: mkdir d4/d7/d7f/d85 0 2024-04-23T14:49:45.429 INFO:tasks.workunit.client.1.smithi156.stdout:1/130: link db/ff db/f27 0 2024-04-23T14:49:45.431 INFO:tasks.workunit.client.0.smithi081.stdout:8/704: getdents d3/d11 0 2024-04-23T14:49:45.434 INFO:tasks.workunit.client.1.smithi156.stdout:4/91: rename d0/df/d19/d1c to d0/d8/d1e 0 2024-04-23T14:49:45.438 INFO:tasks.workunit.client.1.smithi156.stdout:1/131: mkdir db/d1f/d28 0 2024-04-23T14:49:45.449 INFO:tasks.workunit.client.0.smithi081.stdout:1/551: rename d3/d3d/d41/d5e/d12/d1a/d2a to d3/d3d/d41/d5e/d5d/db0 0 2024-04-23T14:49:45.449 INFO:tasks.workunit.client.0.smithi081.stdout:1/552: chown d3/d3d 137 1 2024-04-23T14:49:45.449 INFO:tasks.workunit.client.0.smithi081.stdout:1/553: chown d3/d3d/d41/d5e/d12/d1a/f86 2964294 1 2024-04-23T14:49:45.450 INFO:tasks.workunit.client.1.smithi156.stdout:8/110: read d5/d9/f13 [2812754,56442] 0 2024-04-23T14:49:45.450 INFO:tasks.workunit.client.1.smithi156.stdout:8/111: write d5/d9/d10/f25 [841803,124379] 0 2024-04-23T14:49:45.450 INFO:tasks.workunit.client.1.smithi156.stdout:5/161: dwrite d1/d11/f29 [0,4194304] 0 2024-04-23T14:49:45.450 INFO:tasks.workunit.client.1.smithi156.stdout:4/92: symlink d0/d8/l1f 0 2024-04-23T14:49:45.458 INFO:tasks.workunit.client.1.smithi156.stdout:8/112: mknod d5/d9/d10/d1d/d21/c2b 0 2024-04-23T14:49:45.460 INFO:tasks.workunit.client.0.smithi081.stdout:1/554: creat d3/d3d/d41/d5e/d12/d1a/fb1 x:0 0 0 2024-04-23T14:49:45.460 INFO:tasks.workunit.client.1.smithi156.stdout:9/105: dread d1/d2/f13 [0,4194304] 0 2024-04-23T14:49:45.460 INFO:tasks.workunit.client.1.smithi156.stdout:0/118: dwrite d0/d4/fe [0,4194304] 0 2024-04-23T14:49:45.462 INFO:tasks.workunit.client.0.smithi081.stdout:9/512: rmdir d3/d1a 39 2024-04-23T14:49:45.462 INFO:tasks.workunit.client.0.smithi081.stdout:9/513: write d3/de/d1d/fa1 [600385,109096] 0 2024-04-23T14:49:45.474 INFO:tasks.workunit.client.0.smithi081.stdout:9/514: truncate d3/d1a/d6c/f42 3195329 0 2024-04-23T14:49:45.474 INFO:tasks.workunit.client.0.smithi081.stdout:9/515: readlink d3/d1a/l97 0 2024-04-23T14:49:45.474 INFO:tasks.workunit.client.0.smithi081.stdout:9/516: creat d3/de/d1d/d5b/fa3 x:0 0 0 2024-04-23T14:49:45.474 INFO:tasks.workunit.client.0.smithi081.stdout:9/517: write d3/de/d1d/d54/d68/f7c [942371,102566] 0 2024-04-23T14:49:45.477 INFO:tasks.workunit.client.1.smithi156.stdout:5/162: symlink d1/d3/d20/l35 0 2024-04-23T14:49:45.477 INFO:tasks.workunit.client.1.smithi156.stdout:5/163: truncate d1/d3/d20/f33 1569033 0 2024-04-23T14:49:45.478 INFO:tasks.workunit.client.1.smithi156.stdout:4/93: rename d0/l5 to d0/d8/d1e/l20 0 2024-04-23T14:49:45.481 INFO:tasks.workunit.client.1.smithi156.stdout:6/116: dwrite d3/da/f1a [0,4194304] 0 2024-04-23T14:49:45.482 INFO:tasks.workunit.client.1.smithi156.stdout:6/117: write d3/f2d [702625,19744] 0 2024-04-23T14:49:45.482 INFO:tasks.workunit.client.1.smithi156.stdout:6/118: chown d3/da/d1d/f21 47342639 1 2024-04-23T14:49:45.482 INFO:tasks.workunit.client.1.smithi156.stdout:6/119: creat d3/d16/f2f x:0 0 0 2024-04-23T14:49:45.482 INFO:tasks.workunit.client.1.smithi156.stdout:6/120: creat d3/d16/f30 x:0 0 0 2024-04-23T14:49:45.482 INFO:tasks.workunit.client.1.smithi156.stdout:8/113: symlink d5/d9/d10/d1d/l2c 0 2024-04-23T14:49:45.483 INFO:tasks.workunit.client.1.smithi156.stdout:9/106: symlink d1/d2/d4/d17/l24 0 2024-04-23T14:49:45.485 INFO:tasks.workunit.client.1.smithi156.stdout:0/119: rmdir d0/d4/d22/d24 0 2024-04-23T14:49:45.486 INFO:tasks.workunit.client.0.smithi081.stdout:1/555: rename d3/d3d/d41/d4a/f43 to d3/fb2 0 2024-04-23T14:49:45.490 INFO:tasks.workunit.client.0.smithi081.stdout:3/398: dwrite d4/d7/d49/d51/d53/d6c/f73 [0,4194304] 0 2024-04-23T14:49:45.490 INFO:tasks.workunit.client.1.smithi156.stdout:5/164: creat d1/d11/d18/d19/f36 x:0 0 0 2024-04-23T14:49:45.490 INFO:tasks.workunit.client.0.smithi081.stdout:9/518: dread d3/f8 [0,4194304] 0 2024-04-23T14:49:45.499 INFO:tasks.workunit.client.1.smithi156.stdout:6/121: creat d3/da/d1d/d27/f31 x:0 0 0 2024-04-23T14:49:45.500 INFO:tasks.workunit.client.0.smithi081.stdout:9/519: truncate d3/de/d1d/d73/f94 2773299 0 2024-04-23T14:49:45.501 INFO:tasks.workunit.client.1.smithi156.stdout:9/107: symlink d1/d2/l25 0 2024-04-23T14:49:45.502 INFO:tasks.workunit.client.1.smithi156.stdout:0/120: symlink d0/d4/d11/l27 0 2024-04-23T14:49:45.505 INFO:tasks.workunit.client.1.smithi156.stdout:5/165: symlink d1/d17/l37 0 2024-04-23T14:49:45.508 INFO:tasks.workunit.client.1.smithi156.stdout:6/122: mknod d3/da/d1d/c32 0 2024-04-23T14:49:45.509 INFO:tasks.workunit.client.1.smithi156.stdout:9/108: unlink d1/d2/c12 0 2024-04-23T14:49:45.509 INFO:tasks.workunit.client.1.smithi156.stdout:9/109: dread - d1/f1e zero size 2024-04-23T14:49:45.509 INFO:tasks.workunit.client.1.smithi156.stdout:9/110: creat d1/d2/d4/d19/f26 x:0 0 0 2024-04-23T14:49:45.509 INFO:tasks.workunit.client.1.smithi156.stdout:9/111: write d1/d2/f13 [1707323,24627] 0 2024-04-23T14:49:45.511 INFO:tasks.workunit.client.1.smithi156.stdout:0/121: link d0/d8/d1d/c26 d0/d4/d14/c28 0 2024-04-23T14:49:45.512 INFO:tasks.workunit.client.1.smithi156.stdout:6/123: mknod d3/d16/d1e/c33 0 2024-04-23T14:49:45.516 INFO:tasks.workunit.client.1.smithi156.stdout:0/122: creat d0/d8/f29 x:0 0 0 2024-04-23T14:49:45.516 INFO:tasks.workunit.client.1.smithi156.stdout:0/123: write d0/d4/d14/f1f [1043272,18013] 0 2024-04-23T14:49:45.524 INFO:tasks.workunit.client.1.smithi156.stdout:0/124: truncate d0/f15 508558 0 2024-04-23T14:49:45.524 INFO:tasks.workunit.client.0.smithi081.stdout:3/399: symlink d4/dc/l86 0 2024-04-23T14:49:45.527 INFO:tasks.workunit.client.1.smithi156.stdout:5/166: dread d1/d3/f5 [8388608,4194304] 0 2024-04-23T14:49:45.528 INFO:tasks.workunit.client.1.smithi156.stdout:5/167: chown d1/d17/f2e 2 1 2024-04-23T14:49:45.528 INFO:tasks.workunit.client.1.smithi156.stdout:5/168: fsync d1/d17/f2e 0 2024-04-23T14:49:45.531 INFO:tasks.workunit.client.1.smithi156.stdout:7/117: sync 2024-04-23T14:49:45.536 INFO:tasks.workunit.client.1.smithi156.stdout:8/114: dwrite d5/d9/d10/f11 [0,4194304] 0 2024-04-23T14:49:45.536 INFO:tasks.workunit.client.1.smithi156.stdout:8/115: dread - d5/f1c zero size 2024-04-23T14:49:45.536 INFO:tasks.workunit.client.1.smithi156.stdout:8/116: write d5/d9/d10/f11 [4230232,11] 0 2024-04-23T14:49:45.539 INFO:tasks.workunit.client.1.smithi156.stdout:2/118: sync 2024-04-23T14:49:45.544 INFO:tasks.workunit.client.1.smithi156.stdout:2/119: link d4/c22 d4/c2b 0 2024-04-23T14:49:45.545 INFO:tasks.workunit.client.1.smithi156.stdout:4/94: rmdir d0/df/d19 0 2024-04-23T14:49:45.546 INFO:tasks.workunit.client.1.smithi156.stdout:2/120: link d4/l1f d4/d26/l2c 0 2024-04-23T14:49:45.563 INFO:tasks.workunit.client.1.smithi156.stdout:2/121: dread d4/d13/f20 [0,4194304] 0 2024-04-23T14:49:45.564 INFO:tasks.workunit.client.1.smithi156.stdout:2/122: chown d4/f16 110952289 1 2024-04-23T14:49:45.564 INFO:tasks.workunit.client.0.smithi081.stdout:2/545: creat d1/fbc x:0 0 0 2024-04-23T14:49:45.568 INFO:tasks.workunit.client.1.smithi156.stdout:2/123: truncate d4/d13/f14 6349659 0 2024-04-23T14:49:45.570 INFO:tasks.workunit.client.1.smithi156.stdout:2/124: mknod d4/d26/c2d 0 2024-04-23T14:49:45.570 INFO:tasks.workunit.client.1.smithi156.stdout:2/125: stat d4/f7 0 2024-04-23T14:49:45.573 INFO:tasks.workunit.client.0.smithi081.stdout:2/546: symlink d1/d11/d21/d52/d8b/d8f/lbd 0 2024-04-23T14:49:45.573 INFO:tasks.workunit.client.0.smithi081.stdout:2/547: write d1/d33/f79 [400757,80303] 0 2024-04-23T14:49:45.573 INFO:tasks.workunit.client.0.smithi081.stdout:2/548: creat d1/d33/d45/d48/fbe x:0 0 0 2024-04-23T14:49:45.584 INFO:tasks.workunit.client.1.smithi156.stdout:9/112: rmdir d1/d2 39 2024-04-23T14:49:45.585 INFO:tasks.workunit.client.1.smithi156.stdout:9/113: creat d1/d2/d23/f27 x:0 0 0 2024-04-23T14:49:45.586 INFO:tasks.workunit.client.1.smithi156.stdout:9/114: mkdir d1/d2/d28 0 2024-04-23T14:49:45.598 INFO:tasks.workunit.client.1.smithi156.stdout:7/118: dwrite dc/f19 [0,4194304] 0 2024-04-23T14:49:45.599 INFO:tasks.workunit.client.1.smithi156.stdout:1/132: dwrite db/f27 [0,4194304] 0 2024-04-23T14:49:45.601 INFO:tasks.workunit.client.0.smithi081.stdout:3/400: dwrite d4/dc/f45 [4194304,4194304] 0 2024-04-23T14:49:45.602 INFO:tasks.workunit.client.0.smithi081.stdout:3/401: write d4/dc/f3b [929429,23881] 0 2024-04-23T14:49:45.607 INFO:tasks.workunit.client.1.smithi156.stdout:6/124: dwrite d3/da/f1a [4194304,4194304] 0 2024-04-23T14:49:45.608 INFO:tasks.workunit.client.1.smithi156.stdout:5/169: dread d1/d3/fd [0,4194304] 0 2024-04-23T14:49:45.608 INFO:tasks.workunit.client.1.smithi156.stdout:0/125: dread d0/d4/d14/f1f [0,4194304] 0 2024-04-23T14:49:45.615 INFO:tasks.workunit.client.1.smithi156.stdout:1/133: symlink db/d15/l29 0 2024-04-23T14:49:45.615 INFO:tasks.workunit.client.1.smithi156.stdout:1/134: chown l8 201665431 1 2024-04-23T14:49:45.616 INFO:tasks.workunit.client.1.smithi156.stdout:6/125: rmdir d3/d16/d1e 39 2024-04-23T14:49:45.616 INFO:tasks.workunit.client.1.smithi156.stdout:6/126: chown d3/da/d1d/d27/l2a 254828402 1 2024-04-23T14:49:45.616 INFO:tasks.workunit.client.1.smithi156.stdout:8/117: dwrite d5/f1c [0,4194304] 0 2024-04-23T14:49:45.616 INFO:tasks.workunit.client.1.smithi156.stdout:8/118: chown d5/f1a 967455 1 2024-04-23T14:49:45.616 INFO:tasks.workunit.client.1.smithi156.stdout:6/127: creat d3/f34 x:0 0 0 2024-04-23T14:49:45.616 INFO:tasks.workunit.client.1.smithi156.stdout:6/128: truncate d3/da/d10/f14 5256261 0 2024-04-23T14:49:45.619 INFO:tasks.workunit.client.1.smithi156.stdout:1/135: mknod db/d15/c2a 0 2024-04-23T14:49:45.622 INFO:tasks.workunit.client.1.smithi156.stdout:4/95: dwrite d0/df/f17 [0,4194304] 0 2024-04-23T14:49:45.623 INFO:tasks.workunit.client.1.smithi156.stdout:4/96: fdatasync d0/d8/fc 0 2024-04-23T14:49:45.623 INFO:tasks.workunit.client.1.smithi156.stdout:6/129: dread d3/d16/d1e/f20 [0,4194304] 0 2024-04-23T14:49:45.623 INFO:tasks.workunit.client.1.smithi156.stdout:6/130: creat d3/da/d1d/f35 x:0 0 0 2024-04-23T14:49:45.624 INFO:tasks.workunit.client.1.smithi156.stdout:6/131: dread - d3/d16/f23 zero size 2024-04-23T14:49:45.624 INFO:tasks.workunit.client.1.smithi156.stdout:6/132: dread - d3/f34 zero size 2024-04-23T14:49:45.624 INFO:tasks.workunit.client.1.smithi156.stdout:8/119: symlink d5/d19/d29/l2d 0 2024-04-23T14:49:45.626 INFO:tasks.workunit.client.1.smithi156.stdout:0/126: rename d0/d8 to d0/d4/d14/d1b/d2a 0 2024-04-23T14:49:45.626 INFO:tasks.workunit.client.1.smithi156.stdout:0/127: fsync d0/d4/f3 0 2024-04-23T14:49:45.636 INFO:tasks.workunit.client.1.smithi156.stdout:4/97: mkdir d0/df/d21 0 2024-04-23T14:49:45.636 INFO:tasks.workunit.client.1.smithi156.stdout:8/120: creat d5/d19/d29/f2e x:0 0 0 2024-04-23T14:49:45.636 INFO:tasks.workunit.client.1.smithi156.stdout:3/95: sync 2024-04-23T14:49:45.645 INFO:tasks.workunit.client.0.smithi081.stdout:4/445: sync 2024-04-23T14:49:45.646 INFO:tasks.workunit.client.0.smithi081.stdout:6/439: sync 2024-04-23T14:49:45.646 INFO:tasks.workunit.client.0.smithi081.stdout:7/346: sync 2024-04-23T14:49:45.646 INFO:tasks.workunit.client.0.smithi081.stdout:4/446: creat d1/d1d/f97 x:0 0 0 2024-04-23T14:49:45.647 INFO:tasks.workunit.client.0.smithi081.stdout:7/347: rename d3/d21/d31/d63/f69 to d3/d11/d56/f72 0 2024-04-23T14:49:45.648 INFO:tasks.workunit.client.0.smithi081.stdout:7/348: symlink d3/d21/d31/d33/l73 0 2024-04-23T14:49:45.649 INFO:tasks.workunit.client.0.smithi081.stdout:7/349: write d3/d21/d41/f6b [937899,98557] 0 2024-04-23T14:49:45.651 INFO:tasks.workunit.client.1.smithi156.stdout:0/128: mkdir d0/d4/d14/d1b/d2b 0 2024-04-23T14:49:45.651 INFO:tasks.workunit.client.1.smithi156.stdout:6/133: rename d3/da/d1d/l26 to d3/da/l36 0 2024-04-23T14:49:45.651 INFO:tasks.workunit.client.1.smithi156.stdout:6/134: chown d3/cf 25 1 2024-04-23T14:49:45.656 INFO:tasks.workunit.client.0.smithi081.stdout:4/447: dread d1/d1d/d39/f48 [0,4194304] 0 2024-04-23T14:49:45.660 INFO:tasks.workunit.client.0.smithi081.stdout:3/402: dwrite d4/d41/f67 [0,4194304] 0 2024-04-23T14:49:45.663 INFO:tasks.workunit.client.1.smithi156.stdout:6/135: read d3/da/f1a [3054831,44716] 0 2024-04-23T14:49:45.663 INFO:tasks.workunit.client.1.smithi156.stdout:6/136: creat d3/d16/f37 x:0 0 0 2024-04-23T14:49:45.669 INFO:tasks.workunit.client.0.smithi081.stdout:6/440: dread d1/d2/f1d [0,4194304] 0 2024-04-23T14:49:45.669 INFO:tasks.workunit.client.1.smithi156.stdout:7/119: dread dc/f17 [0,4194304] 0 2024-04-23T14:49:45.669 INFO:tasks.workunit.client.1.smithi156.stdout:4/98: write d0/d8/f18 [3923577,100324] 0 2024-04-23T14:49:45.669 INFO:tasks.workunit.client.1.smithi156.stdout:6/137: truncate d3/f2d 129767 0 2024-04-23T14:49:45.670 INFO:tasks.workunit.client.1.smithi156.stdout:6/138: creat d3/da/f38 x:0 0 0 2024-04-23T14:49:45.670 INFO:tasks.workunit.client.1.smithi156.stdout:6/139: write d3/d16/f23 [45931,1292] 0 2024-04-23T14:49:45.674 INFO:tasks.workunit.client.0.smithi081.stdout:4/448: dread d1/d3/f2a [0,4194304] 0 2024-04-23T14:49:45.675 INFO:tasks.workunit.client.1.smithi156.stdout:2/126: dwrite d4/d13/f14 [0,4194304] 0 2024-04-23T14:49:45.680 INFO:tasks.workunit.client.0.smithi081.stdout:3/403: read d4/d41/f67 [1971790,64612] 0 2024-04-23T14:49:45.680 INFO:tasks.workunit.client.0.smithi081.stdout:3/404: write d4/d7/df/d30/f4c [211307,36845] 0 2024-04-23T14:49:45.681 INFO:tasks.workunit.client.1.smithi156.stdout:4/99: truncate d0/d8/fc 2121673 0 2024-04-23T14:49:45.690 INFO:tasks.workunit.client.1.smithi156.stdout:4/100: creat d0/d8/d1e/f22 x:0 0 0 2024-04-23T14:49:45.693 INFO:tasks.workunit.client.1.smithi156.stdout:7/120: dread dc/f17 [0,4194304] 0 2024-04-23T14:49:45.693 INFO:tasks.workunit.client.0.smithi081.stdout:3/405: unlink d4/d41/l43 0 2024-04-23T14:49:45.694 INFO:tasks.workunit.client.0.smithi081.stdout:3/406: fsync d4/dc/d10/f79 0 2024-04-23T14:49:45.697 INFO:tasks.workunit.client.1.smithi156.stdout:4/101: symlink d0/l23 0 2024-04-23T14:49:45.697 INFO:tasks.workunit.client.1.smithi156.stdout:4/102: dread - d0/d8/d1e/f22 zero size 2024-04-23T14:49:45.697 INFO:tasks.workunit.client.1.smithi156.stdout:4/103: chown d0/df/c11 8557 1 2024-04-23T14:49:45.699 INFO:tasks.workunit.client.0.smithi081.stdout:6/441: write d1/d2/f8f [2727178,91380] 0 2024-04-23T14:49:45.699 INFO:tasks.workunit.client.1.smithi156.stdout:3/96: write d4/da/ff [2204550,96310] 0 2024-04-23T14:49:45.701 INFO:tasks.workunit.client.0.smithi081.stdout:3/407: mknod d4/dc/d10/d5a/c87 0 2024-04-23T14:49:45.701 INFO:tasks.workunit.client.0.smithi081.stdout:3/408: fsync d4/f5b 0 2024-04-23T14:49:45.701 INFO:tasks.workunit.client.0.smithi081.stdout:3/409: creat d4/d7/d32/f88 x:0 0 0 2024-04-23T14:49:45.710 INFO:tasks.workunit.client.1.smithi156.stdout:9/115: dwrite d1/d2/d23/f27 [0,4194304] 0 2024-04-23T14:49:45.710 INFO:tasks.workunit.client.1.smithi156.stdout:1/136: dwrite db/d25/f26 [0,4194304] 0 2024-04-23T14:49:45.710 INFO:tasks.workunit.client.0.smithi081.stdout:4/449: dread d1/f12 [0,4194304] 0 2024-04-23T14:49:45.710 INFO:tasks.workunit.client.0.smithi081.stdout:4/450: truncate d1/d1d/f97 1028538 0 2024-04-23T14:49:45.711 INFO:tasks.workunit.client.1.smithi156.stdout:0/129: dread d0/d4/fe [0,4194304] 0 2024-04-23T14:49:45.712 INFO:tasks.workunit.client.0.smithi081.stdout:4/451: mknod d1/d4/d11/c98 0 2024-04-23T14:49:45.712 INFO:tasks.workunit.client.0.smithi081.stdout:4/452: read - d1/d4/d11/f79 zero size 2024-04-23T14:49:45.712 INFO:tasks.workunit.client.0.smithi081.stdout:4/453: chown d1/d4/d6f 21617166 1 2024-04-23T14:49:45.712 INFO:tasks.workunit.client.0.smithi081.stdout:4/454: write d1/d3/f57 [354403,88162] 0 2024-04-23T14:49:45.716 INFO:tasks.workunit.client.1.smithi156.stdout:9/116: mknod d1/d2/d4/dc/c29 0 2024-04-23T14:49:45.720 INFO:tasks.workunit.client.1.smithi156.stdout:1/137: rename l9 to db/d1f/d28/l2b 0 2024-04-23T14:49:45.721 INFO:tasks.workunit.client.1.smithi156.stdout:9/117: mkdir d1/d2/d4/d19/d2a 0 2024-04-23T14:49:45.721 INFO:tasks.workunit.client.1.smithi156.stdout:9/118: chown d1/d2/d4/d19 821100717 1 2024-04-23T14:49:45.722 INFO:tasks.workunit.client.1.smithi156.stdout:1/138: mknod db/d21/c2c 0 2024-04-23T14:49:45.724 INFO:tasks.workunit.client.1.smithi156.stdout:9/119: symlink d1/d2/l2b 0 2024-04-23T14:49:45.724 INFO:tasks.workunit.client.1.smithi156.stdout:9/120: chown d1/d2/d4/dc 32 1 2024-04-23T14:49:45.727 INFO:tasks.workunit.client.0.smithi081.stdout:6/442: dread d1/d51/d65/d8/f2b [0,4194304] 0 2024-04-23T14:49:45.730 INFO:tasks.workunit.client.0.smithi081.stdout:3/410: dread d4/d7/d32/f3e [0,4194304] 0 2024-04-23T14:49:45.730 INFO:tasks.workunit.client.0.smithi081.stdout:7/350: dwrite d3/d21/d31/d63/f6c [0,4194304] 0 2024-04-23T14:49:45.730 INFO:tasks.workunit.client.0.smithi081.stdout:7/351: truncate d3/d11/d56/f72 743047 0 2024-04-23T14:49:45.731 INFO:tasks.workunit.client.0.smithi081.stdout:7/352: write f2 [1068362,118354] 0 2024-04-23T14:49:45.731 INFO:tasks.workunit.client.0.smithi081.stdout:7/353: creat d3/d21/d31/d63/f74 x:0 0 0 2024-04-23T14:49:45.732 INFO:tasks.workunit.client.0.smithi081.stdout:6/443: rename d1/fe to d1/d51/d7b/d91/f9f 0 2024-04-23T14:49:45.735 INFO:tasks.workunit.client.0.smithi081.stdout:6/444: mkdir d1/d51/d65/d1c/d6e/da0 0 2024-04-23T14:49:45.736 INFO:tasks.workunit.client.0.smithi081.stdout:6/445: chown d1/d2/f99 0 1 2024-04-23T14:49:45.736 INFO:tasks.workunit.client.1.smithi156.stdout:0/130: dread d0/d4/f20 [0,4194304] 0 2024-04-23T14:49:45.736 INFO:tasks.workunit.client.1.smithi156.stdout:0/131: fdatasync d0/d4/d14/f1f 0 2024-04-23T14:49:45.738 INFO:tasks.workunit.client.0.smithi081.stdout:7/354: rename d3/d11/d15 to d3/d11/d2c/d75 0 2024-04-23T14:49:45.740 INFO:tasks.workunit.client.1.smithi156.stdout:5/170: dwrite d1/d3/d20/f33 [0,4194304] 0 2024-04-23T14:49:45.740 INFO:tasks.workunit.client.1.smithi156.stdout:5/171: chown d1/d17/l37 169309 1 2024-04-23T14:49:45.741 INFO:tasks.workunit.client.1.smithi156.stdout:1/139: dread db/d25/f26 [0,4194304] 0 2024-04-23T14:49:45.744 INFO:tasks.workunit.client.1.smithi156.stdout:8/121: dwrite d5/d9/d10/f12 [0,4194304] 0 2024-04-23T14:49:45.745 INFO:tasks.workunit.client.0.smithi081.stdout:4/455: dread d1/d1d/f3e [0,4194304] 0 2024-04-23T14:49:45.745 INFO:tasks.workunit.client.0.smithi081.stdout:4/456: fdatasync d1/d4/dc/f14 0 2024-04-23T14:49:45.745 INFO:tasks.workunit.client.0.smithi081.stdout:4/457: truncate d1/d4/d11/d75/f88 472860 0 2024-04-23T14:49:45.747 INFO:tasks.workunit.client.0.smithi081.stdout:7/355: mknod d3/d21/d31/d50/d5a/c76 0 2024-04-23T14:49:45.747 INFO:tasks.workunit.client.1.smithi156.stdout:7/121: truncate dc/f19 745418 0 2024-04-23T14:49:45.749 INFO:tasks.workunit.client.1.smithi156.stdout:2/127: dwrite d4/f29 [0,4194304] 0 2024-04-23T14:49:45.749 INFO:tasks.workunit.client.1.smithi156.stdout:8/122: getdents d5/d19 0 2024-04-23T14:49:45.751 INFO:tasks.workunit.client.0.smithi081.stdout:7/356: mkdir d3/d20/d77 0 2024-04-23T14:49:45.752 INFO:tasks.workunit.client.1.smithi156.stdout:5/172: read d1/d17/f1a [54366,24192] 0 2024-04-23T14:49:45.752 INFO:tasks.workunit.client.1.smithi156.stdout:6/140: dwrite d3/d16/f37 [0,4194304] 0 2024-04-23T14:49:45.752 INFO:tasks.workunit.client.1.smithi156.stdout:6/141: chown d3/da/d1d/d27/f31 599 1 2024-04-23T14:49:45.754 INFO:tasks.workunit.client.0.smithi081.stdout:7/357: write d3/d21/d31/f8 [3134094,55015] 0 2024-04-23T14:49:45.754 INFO:tasks.workunit.client.0.smithi081.stdout:7/358: chown d3/d21/d31/d33/d4b/d4c/f5d 0 1 2024-04-23T14:49:45.754 INFO:tasks.workunit.client.0.smithi081.stdout:7/359: chown d3/d21/d31/d33/d4b/d71 5351966 1 2024-04-23T14:49:45.755 INFO:tasks.workunit.client.1.smithi156.stdout:2/128: mknod d4/d13/c2e 0 2024-04-23T14:49:45.759 INFO:tasks.workunit.client.1.smithi156.stdout:5/173: rename d1/d3/d24/f34 to d1/f38 0 2024-04-23T14:49:45.760 INFO:tasks.workunit.client.1.smithi156.stdout:5/174: rename d1/d11/d18 to d1/d11/d18/d39 22 2024-04-23T14:49:45.760 INFO:tasks.workunit.client.1.smithi156.stdout:5/175: fdatasync d1/d17/f1a 0 2024-04-23T14:49:45.760 INFO:tasks.workunit.client.1.smithi156.stdout:2/129: mkdir d4/d21/d2f 0 2024-04-23T14:49:45.763 INFO:tasks.workunit.client.1.smithi156.stdout:3/97: dread d4/da/ff [0,4194304] 0 2024-04-23T14:49:45.763 INFO:tasks.workunit.client.1.smithi156.stdout:3/98: fdatasync d4/da/ff 0 2024-04-23T14:49:45.764 INFO:tasks.workunit.client.1.smithi156.stdout:6/142: rename d3/da/d10/f14 to d3/d16/f39 0 2024-04-23T14:49:45.766 INFO:tasks.workunit.client.1.smithi156.stdout:1/140: write db/d25/f26 [2994852,82750] 0 2024-04-23T14:49:45.766 INFO:tasks.workunit.client.1.smithi156.stdout:1/141: readlink db/d1f/d28/l2b 0 2024-04-23T14:49:45.769 INFO:tasks.workunit.client.1.smithi156.stdout:0/132: dread d0/d4/d14/d1b/d2a/f6 [4194304,4194304] 0 2024-04-23T14:49:45.769 INFO:tasks.workunit.client.1.smithi156.stdout:0/133: fdatasync d0/d4/d14/f1f 0 2024-04-23T14:49:45.769 INFO:tasks.workunit.client.1.smithi156.stdout:3/99: mknod d4/c11 0 2024-04-23T14:49:45.770 INFO:tasks.workunit.client.0.smithi081.stdout:6/446: dread d1/d51/d65/d13/f3e [0,4194304] 0 2024-04-23T14:49:45.770 INFO:tasks.workunit.client.0.smithi081.stdout:7/360: dread d3/d11/d2c/d75/f3c [0,4194304] 0 2024-04-23T14:49:45.771 INFO:tasks.workunit.client.1.smithi156.stdout:6/143: creat d3/da/f3a x:0 0 0 2024-04-23T14:49:45.771 INFO:tasks.workunit.client.1.smithi156.stdout:6/144: write d3/d16/f39 [4531725,40127] 0 2024-04-23T14:49:45.771 INFO:tasks.workunit.client.1.smithi156.stdout:2/130: dread d4/d13/d19/f1a [0,4194304] 0 2024-04-23T14:49:45.772 INFO:tasks.workunit.client.1.smithi156.stdout:1/142: mkdir db/d1f/d2d 0 2024-04-23T14:49:45.775 INFO:tasks.workunit.client.1.smithi156.stdout:0/134: rename d0/f19 to d0/d4/d14/d1b/d2a/f2c 0 2024-04-23T14:49:45.775 INFO:tasks.workunit.client.1.smithi156.stdout:0/135: chown d0/d4/d14/d1b/d2a 406 1 2024-04-23T14:49:45.775 INFO:tasks.workunit.client.1.smithi156.stdout:0/136: read - d0/d4/d14/d1b/d2a/f2c zero size 2024-04-23T14:49:45.775 INFO:tasks.workunit.client.1.smithi156.stdout:4/104: dwrite d0/f1a [0,4194304] 0 2024-04-23T14:49:45.775 INFO:tasks.workunit.client.0.smithi081.stdout:6/447: mkdir d1/d51/d65/d1c/d6e/da0/da1 0 2024-04-23T14:49:45.778 INFO:tasks.workunit.client.1.smithi156.stdout:5/176: dread d1/d17/f1a [0,4194304] 0 2024-04-23T14:49:45.778 INFO:tasks.workunit.client.1.smithi156.stdout:5/177: creat d1/d3/f3a x:0 0 0 2024-04-23T14:49:45.778 INFO:tasks.workunit.client.1.smithi156.stdout:2/131: link d4/d13/c2e d4/d26/c30 0 2024-04-23T14:49:45.778 INFO:tasks.workunit.client.1.smithi156.stdout:5/178: write d1/d3/f1e [814437,117898] 0 2024-04-23T14:49:45.780 INFO:tasks.workunit.client.0.smithi081.stdout:7/361: creat d3/d21/d31/d50/d5a/f78 x:0 0 0 2024-04-23T14:49:45.781 INFO:tasks.workunit.client.0.smithi081.stdout:4/458: dread d1/d4/f10 [0,4194304] 0 2024-04-23T14:49:45.781 INFO:tasks.workunit.client.0.smithi081.stdout:4/459: stat d1/d4/d11/f43 0 2024-04-23T14:49:45.784 INFO:tasks.workunit.client.1.smithi156.stdout:0/137: mkdir d0/d4/d14/d1b/d2a/d1d/d2d 0 2024-04-23T14:49:45.785 INFO:tasks.workunit.client.0.smithi081.stdout:7/362: creat d3/d21/f79 x:0 0 0 2024-04-23T14:49:45.785 INFO:tasks.workunit.client.0.smithi081.stdout:7/363: fdatasync d3/d11/d2c/d75/f3c 0 2024-04-23T14:49:45.785 INFO:tasks.workunit.client.0.smithi081.stdout:4/460: mkdir d1/d3/d8c/d99 0 2024-04-23T14:49:45.786 INFO:tasks.workunit.client.0.smithi081.stdout:4/461: chown d1/d4/l13 866811 1 2024-04-23T14:49:45.786 INFO:tasks.workunit.client.0.smithi081.stdout:4/462: creat d1/d1d/f9a x:0 0 0 2024-04-23T14:49:45.786 INFO:tasks.workunit.client.1.smithi156.stdout:4/105: rmdir d0/d8/d1e 39 2024-04-23T14:49:45.790 INFO:tasks.workunit.client.0.smithi081.stdout:4/463: link d1/d1d/f97 d1/d1d/d59/d86/f9b 0 2024-04-23T14:49:45.791 INFO:tasks.workunit.client.1.smithi156.stdout:2/132: creat d4/d21/f31 x:0 0 0 2024-04-23T14:49:45.791 INFO:tasks.workunit.client.1.smithi156.stdout:2/133: stat d4/f29 0 2024-04-23T14:49:45.793 INFO:tasks.workunit.client.0.smithi081.stdout:4/464: mkdir d1/d4/d6f/d70/d9c 0 2024-04-23T14:49:45.793 INFO:tasks.workunit.client.1.smithi156.stdout:5/179: truncate d1/d11/d27/f2c 2141720 0 2024-04-23T14:49:45.795 INFO:tasks.workunit.client.0.smithi081.stdout:7/364: dread d3/d11/d2c/d75/f3c [0,4194304] 0 2024-04-23T14:49:45.795 INFO:tasks.workunit.client.0.smithi081.stdout:7/365: write d3/d21/f55 [444505,46907] 0 2024-04-23T14:49:45.801 INFO:tasks.workunit.client.0.smithi081.stdout:4/465: write d1/d1d/d39/f48 [120315,6494] 0 2024-04-23T14:49:45.831 INFO:tasks.workunit.client.1.smithi156.stdout:2/134: fsync d4/d21/f31 0 2024-04-23T14:49:45.831 INFO:tasks.workunit.client.1.smithi156.stdout:2/135: stat d4/f7 0 2024-04-23T14:49:45.831 INFO:tasks.workunit.client.1.smithi156.stdout:2/136: read d4/f16 [617944,125868] 0 2024-04-23T14:49:45.831 INFO:tasks.workunit.client.1.smithi156.stdout:0/138: dread d0/d4/d14/d1b/d2a/d1d/f17 [0,4194304] 0 2024-04-23T14:49:45.838 INFO:tasks.workunit.client.1.smithi156.stdout:8/123: dwrite d5/d9/f1f [0,4194304] 0 2024-04-23T14:49:45.838 INFO:tasks.workunit.client.1.smithi156.stdout:5/180: dread d1/d3/f5 [0,4194304] 0 2024-04-23T14:49:45.838 INFO:tasks.workunit.client.1.smithi156.stdout:5/181: creat d1/d11/d18/d19/f3b x:0 0 0 2024-04-23T14:49:45.838 INFO:tasks.workunit.client.1.smithi156.stdout:5/182: creat d1/d3/d20/f3c x:0 0 0 2024-04-23T14:49:45.838 INFO:tasks.workunit.client.1.smithi156.stdout:8/124: creat d5/d9/d10/d1d/d21/f2f x:0 0 0 2024-04-23T14:49:45.839 INFO:tasks.workunit.client.1.smithi156.stdout:3/100: dwrite d4/f10 [8388608,4194304] 0 2024-04-23T14:49:45.841 INFO:tasks.workunit.client.1.smithi156.stdout:2/137: dread d4/d13/d19/f1a [0,4194304] 0 2024-04-23T14:49:45.847 INFO:tasks.workunit.client.1.smithi156.stdout:8/125: unlink d5/d9/f26 0 2024-04-23T14:49:45.847 INFO:tasks.workunit.client.1.smithi156.stdout:8/126: write d5/d9/d10/d1d/d21/f27 [966360,82346] 0 2024-04-23T14:49:45.847 INFO:tasks.workunit.client.1.smithi156.stdout:8/127: fsync d5/f1a 0 2024-04-23T14:49:45.848 INFO:tasks.workunit.client.0.smithi081.stdout:5/509: sync 2024-04-23T14:49:45.848 INFO:tasks.workunit.client.0.smithi081.stdout:8/705: sync 2024-04-23T14:49:45.848 INFO:tasks.workunit.client.0.smithi081.stdout:0/559: sync 2024-04-23T14:49:45.850 INFO:tasks.workunit.client.1.smithi156.stdout:2/138: rename d4/d26/l2c to d4/d13/l32 0 2024-04-23T14:49:45.850 INFO:tasks.workunit.client.1.smithi156.stdout:2/139: creat d4/d13/d19/f33 x:0 0 0 2024-04-23T14:49:45.850 INFO:tasks.workunit.client.1.smithi156.stdout:2/140: read - d4/f24 zero size 2024-04-23T14:49:45.850 INFO:tasks.workunit.client.1.smithi156.stdout:2/141: readlink d4/d13/l32 0 2024-04-23T14:49:45.852 INFO:tasks.workunit.client.0.smithi081.stdout:4/466: dwrite d1/d3/f71 [0,4194304] 0 2024-04-23T14:49:45.852 INFO:tasks.workunit.client.0.smithi081.stdout:4/467: stat d1/d1d/f52 0 2024-04-23T14:49:45.852 INFO:tasks.workunit.client.0.smithi081.stdout:4/468: write d1/d1d/f3e [5067433,92442] 0 2024-04-23T14:49:45.854 INFO:tasks.workunit.client.1.smithi156.stdout:5/183: dread d1/d11/d18/f28 [0,4194304] 0 2024-04-23T14:49:45.854 INFO:tasks.workunit.client.1.smithi156.stdout:5/184: creat d1/d3/d24/f3d x:0 0 0 2024-04-23T14:49:45.855 INFO:tasks.workunit.client.0.smithi081.stdout:0/560: mkdir d6/d11/d14/d41/da1/daa 0 2024-04-23T14:49:45.855 INFO:tasks.workunit.client.0.smithi081.stdout:8/706: link d3/f5 d3/d11/d48/d7e/feb 0 2024-04-23T14:49:45.855 INFO:tasks.workunit.client.0.smithi081.stdout:7/366: dwrite d3/d21/f4a [4194304,4194304] 0 2024-04-23T14:49:45.855 INFO:tasks.workunit.client.0.smithi081.stdout:7/367: readlink d3/d21/d31/l64 0 2024-04-23T14:49:45.860 INFO:tasks.workunit.client.1.smithi156.stdout:0/139: dread d0/d4/d14/d1b/d2a/d1d/f17 [0,4194304] 0 2024-04-23T14:49:45.861 INFO:tasks.workunit.client.1.smithi156.stdout:5/185: mkdir d1/d3/d20/d3e 0 2024-04-23T14:49:45.861 INFO:tasks.workunit.client.1.smithi156.stdout:5/186: chown d1/l4 941456 1 2024-04-23T14:49:45.861 INFO:tasks.workunit.client.1.smithi156.stdout:5/187: write d1/d11/d18/f32 [683075,62399] 0 2024-04-23T14:49:45.861 INFO:tasks.workunit.client.0.smithi081.stdout:5/510: rename d17/d1f/d36/f43 to d17/d1f/fb8 0 2024-04-23T14:49:45.862 INFO:tasks.workunit.client.1.smithi156.stdout:2/142: symlink d4/l34 0 2024-04-23T14:49:45.863 INFO:tasks.workunit.client.1.smithi156.stdout:0/140: symlink d0/d4/d11/l2e 0 2024-04-23T14:49:45.863 INFO:tasks.workunit.client.1.smithi156.stdout:0/141: chown d0/d4/d14/d1b/d2a/d1d/d2d 2071527 1 2024-04-23T14:49:45.863 INFO:tasks.workunit.client.1.smithi156.stdout:0/142: chown d0/d16 83 1 2024-04-23T14:49:45.866 INFO:tasks.workunit.client.1.smithi156.stdout:4/106: dwrite d0/d8/fd [0,4194304] 0 2024-04-23T14:49:45.866 INFO:tasks.workunit.client.1.smithi156.stdout:9/121: dwrite d1/d2/d4/d17/d1f/f21 [0,4194304] 0 2024-04-23T14:49:45.866 INFO:tasks.workunit.client.1.smithi156.stdout:8/128: dread d5/d9/d10/f12 [0,4194304] 0 2024-04-23T14:49:45.866 INFO:tasks.workunit.client.1.smithi156.stdout:8/129: chown d5/d9/d10/l17 3048 1 2024-04-23T14:49:45.866 INFO:tasks.workunit.client.0.smithi081.stdout:0/561: mknod d6/d37/d85/cab 0 2024-04-23T14:49:45.868 INFO:tasks.workunit.client.1.smithi156.stdout:5/188: fdatasync d1/d3/f1e 0 2024-04-23T14:49:45.870 INFO:tasks.workunit.client.1.smithi156.stdout:2/143: creat d4/d21/d2f/f35 x:0 0 0 2024-04-23T14:49:45.870 INFO:tasks.workunit.client.1.smithi156.stdout:0/143: creat d0/d4/d14/d1b/d2a/d1d/d2d/f2f x:0 0 0 2024-04-23T14:49:45.870 INFO:tasks.workunit.client.1.smithi156.stdout:0/144: getdents d0/d4/d14/d1b/d2b 0 2024-04-23T14:49:45.870 INFO:tasks.workunit.client.1.smithi156.stdout:0/145: readlink d0/d4/d14/d1b/d2a/lc 0 2024-04-23T14:49:45.870 INFO:tasks.workunit.client.1.smithi156.stdout:2/144: creat d4/d21/f36 x:0 0 0 2024-04-23T14:49:45.874 INFO:tasks.workunit.client.0.smithi081.stdout:8/707: creat d3/d1a/fec x:0 0 0 2024-04-23T14:49:45.874 INFO:tasks.workunit.client.1.smithi156.stdout:2/145: read - d4/d21/d2f/f35 zero size 2024-04-23T14:49:45.874 INFO:tasks.workunit.client.1.smithi156.stdout:2/146: truncate d4/d13/d19/f1a 1529089 0 2024-04-23T14:49:45.874 INFO:tasks.workunit.client.1.smithi156.stdout:2/147: creat d4/d21/f37 x:0 0 0 2024-04-23T14:49:45.874 INFO:tasks.workunit.client.1.smithi156.stdout:2/148: chown d4/d13/l32 10530 1 2024-04-23T14:49:45.874 INFO:tasks.workunit.client.1.smithi156.stdout:2/149: fsync d4/d13/f23 0 2024-04-23T14:49:45.874 INFO:tasks.workunit.client.0.smithi081.stdout:7/368: mknod d3/d21/d31/d33/c7a 0 2024-04-23T14:49:45.878 INFO:tasks.workunit.client.1.smithi156.stdout:3/101: truncate d4/da/ff 2119709 0 2024-04-23T14:49:45.883 INFO:tasks.workunit.client.1.smithi156.stdout:8/130: rename d5/f1a to d5/d19/d29/f30 0 2024-04-23T14:49:45.883 INFO:tasks.workunit.client.1.smithi156.stdout:8/131: truncate d5/d19/d29/f30 438728 0 2024-04-23T14:49:45.883 INFO:tasks.workunit.client.1.smithi156.stdout:8/132: dread - d5/d19/d29/f2e zero size 2024-04-23T14:49:45.886 INFO:tasks.workunit.client.1.smithi156.stdout:5/189: creat d1/f3f x:0 0 0 2024-04-23T14:49:45.888 INFO:tasks.workunit.client.1.smithi156.stdout:9/122: creat d1/d2/d4/d17/f2c x:0 0 0 2024-04-23T14:49:45.889 INFO:tasks.workunit.client.0.smithi081.stdout:8/708: truncate d3/d11/f80 978306 0 2024-04-23T14:49:45.892 INFO:tasks.workunit.client.0.smithi081.stdout:7/369: rmdir d3/d20 39 2024-04-23T14:49:45.893 INFO:tasks.workunit.client.1.smithi156.stdout:3/102: dread d4/f10 [4194304,4194304] 0 2024-04-23T14:49:45.893 INFO:tasks.workunit.client.1.smithi156.stdout:3/103: readlink d4/db/lc 0 2024-04-23T14:49:45.893 INFO:tasks.workunit.client.1.smithi156.stdout:3/104: creat d4/da/f12 x:0 0 0 2024-04-23T14:49:45.894 INFO:tasks.workunit.client.1.smithi156.stdout:2/150: mknod d4/d21/c38 0 2024-04-23T14:49:45.895 INFO:tasks.workunit.client.1.smithi156.stdout:2/151: chown d4/f15 795741 1 2024-04-23T14:49:45.896 INFO:tasks.workunit.client.0.smithi081.stdout:7/370: rename d3/d20/l5f to d3/l7b 0 2024-04-23T14:49:45.896 INFO:tasks.workunit.client.0.smithi081.stdout:0/562: mknod d6/d37/cac 0 2024-04-23T14:49:45.898 INFO:tasks.workunit.client.1.smithi156.stdout:4/107: mknod d0/d8/c24 0 2024-04-23T14:49:45.898 INFO:tasks.workunit.client.1.smithi156.stdout:1/143: write db/f19 [608054,56648] 0 2024-04-23T14:49:45.900 INFO:tasks.workunit.client.1.smithi156.stdout:8/133: dread d5/d9/fd [0,4194304] 0 2024-04-23T14:49:45.900 INFO:tasks.workunit.client.1.smithi156.stdout:8/134: readlink d5/d9/d10/d1d/d21/l23 0 2024-04-23T14:49:45.901 INFO:tasks.workunit.client.1.smithi156.stdout:7/122: dwrite fb [0,4194304] 0 2024-04-23T14:49:45.903 INFO:tasks.workunit.client.0.smithi081.stdout:0/563: creat d6/d11/d14/d24/d6b/fad x:0 0 0 2024-04-23T14:49:45.904 INFO:tasks.workunit.client.1.smithi156.stdout:2/152: dread d4/d13/d19/f1a [0,4194304] 0 2024-04-23T14:49:45.905 INFO:tasks.workunit.client.1.smithi156.stdout:2/153: write d4/f24 [1892,76483] 0 2024-04-23T14:49:45.913 INFO:tasks.workunit.client.1.smithi156.stdout:3/105: mkdir d4/da/d13 0 2024-04-23T14:49:45.913 INFO:tasks.workunit.client.1.smithi156.stdout:4/108: creat d0/df/f25 x:0 0 0 2024-04-23T14:49:45.913 INFO:tasks.workunit.client.1.smithi156.stdout:1/144: symlink db/d15/l2e 0 2024-04-23T14:49:45.913 INFO:tasks.workunit.client.1.smithi156.stdout:4/109: write d0/f3 [2392520,34091] 0 2024-04-23T14:49:45.925 INFO:tasks.workunit.client.0.smithi081.stdout:7/371: dread d3/f10 [0,4194304] 0 2024-04-23T14:49:45.929 INFO:tasks.workunit.client.0.smithi081.stdout:7/372: read d3/d21/d41/f6b [312534,53024] 0 2024-04-23T14:49:45.931 INFO:tasks.workunit.client.1.smithi156.stdout:3/106: dread d4/f10 [4194304,4194304] 0 2024-04-23T14:49:45.932 INFO:tasks.workunit.client.1.smithi156.stdout:5/190: read d1/d11/d27/f2c [781113,64381] 0 2024-04-23T14:49:45.932 INFO:tasks.workunit.client.1.smithi156.stdout:5/191: readlink d1/l4 0 2024-04-23T14:49:45.932 INFO:tasks.workunit.client.1.smithi156.stdout:5/192: readlink d1/d3/l14 0 2024-04-23T14:49:45.934 INFO:tasks.workunit.client.1.smithi156.stdout:2/154: dread d4/f16 [0,4194304] 0 2024-04-23T14:49:45.934 INFO:tasks.workunit.client.1.smithi156.stdout:2/155: stat d4/f7 0 2024-04-23T14:49:45.934 INFO:tasks.workunit.client.1.smithi156.stdout:2/156: write d4/f17 [160996,125702] 0 2024-04-23T14:49:45.938 INFO:tasks.workunit.client.0.smithi081.stdout:8/709: dwrite d3/d11/d34/d8b/fa6 [0,4194304] 0 2024-04-23T14:49:45.938 INFO:tasks.workunit.client.0.smithi081.stdout:8/710: readlink d3/d11/l14 0 2024-04-23T14:49:45.942 INFO:tasks.workunit.client.1.smithi156.stdout:3/107: write d4/f10 [5428378,60491] 0 2024-04-23T14:49:45.942 INFO:tasks.workunit.client.1.smithi156.stdout:3/108: write d4/f10 [7876831,108920] 0 2024-04-23T14:49:45.943 INFO:tasks.workunit.client.1.smithi156.stdout:3/109: write d4/da/f12 [391990,51451] 0 2024-04-23T14:49:45.943 INFO:tasks.workunit.client.1.smithi156.stdout:3/110: fsync d4/da/ff 0 2024-04-23T14:49:45.945 INFO:tasks.workunit.client.1.smithi156.stdout:0/146: dwrite d0/d4/f25 [0,4194304] 0 2024-04-23T14:49:45.949 INFO:tasks.workunit.client.1.smithi156.stdout:6/145: dwrite d3/f8 [4194304,4194304] 0 2024-04-23T14:49:45.949 INFO:tasks.workunit.client.0.smithi081.stdout:4/469: dwrite d1/d1d/d39/f73 [0,4194304] 0 2024-04-23T14:49:45.950 INFO:tasks.workunit.client.1.smithi156.stdout:5/193: write d1/d3/fa [814848,28397] 0 2024-04-23T14:49:45.962 INFO:tasks.workunit.client.1.smithi156.stdout:5/194: write d1/d3/f25 [2239661,8303] 0 2024-04-23T14:49:45.962 INFO:tasks.workunit.client.0.smithi081.stdout:5/511: dwrite d17/d3d/d7a/fa6 [0,4194304] 0 2024-04-23T14:49:46.002 INFO:tasks.workunit.client.1.smithi156.stdout:5/195: dwrite d1/d11/d18/d19/f36 [0,4194304] 0 2024-04-23T14:49:46.002 INFO:tasks.workunit.client.1.smithi156.stdout:5/196: creat d1/d3/f40 x:0 0 0 2024-04-23T14:49:46.006 INFO:tasks.workunit.client.1.smithi156.stdout:8/135: mknod d5/d9/d10/d1d/c31 0 2024-04-23T14:49:46.006 INFO:tasks.workunit.client.1.smithi156.stdout:8/136: creat d5/d9/f32 x:0 0 0 2024-04-23T14:49:46.009 INFO:tasks.workunit.client.1.smithi156.stdout:7/123: link dc/f1c dc/f1e 0 2024-04-23T14:49:46.009 INFO:tasks.workunit.client.1.smithi156.stdout:7/124: readlink dc/l18 0 2024-04-23T14:49:46.009 INFO:tasks.workunit.client.1.smithi156.stdout:7/125: dread - dc/f1e zero size 2024-04-23T14:49:46.009 INFO:tasks.workunit.client.1.smithi156.stdout:7/126: chown f8 56623 1 2024-04-23T14:49:46.009 INFO:tasks.workunit.client.1.smithi156.stdout:7/127: stat l7 0 2024-04-23T14:49:46.011 INFO:tasks.workunit.client.0.smithi081.stdout:7/373: mkdir d3/d21/d41/d7c 0 2024-04-23T14:49:46.014 INFO:tasks.workunit.client.1.smithi156.stdout:5/197: dread d1/d11/f29 [0,4194304] 0 2024-04-23T14:49:46.014 INFO:tasks.workunit.client.1.smithi156.stdout:5/198: stat d1/d11/f13 0 2024-04-23T14:49:46.015 INFO:tasks.workunit.client.0.smithi081.stdout:8/711: link d3/d11/d4f/ce6 d3/d3c/ddb/ced 0 2024-04-23T14:49:46.015 INFO:tasks.workunit.client.0.smithi081.stdout:8/712: fdatasync d3/d11/d86/fdf 0 2024-04-23T14:49:46.016 INFO:tasks.workunit.client.1.smithi156.stdout:4/110: mknod d0/df/d21/c26 0 2024-04-23T14:49:46.017 INFO:tasks.workunit.client.1.smithi156.stdout:4/111: write d0/d8/f18 [2451046,100633] 0 2024-04-23T14:49:46.017 INFO:tasks.workunit.client.1.smithi156.stdout:4/112: chown d0/c9 28747975 1 2024-04-23T14:49:46.028 INFO:tasks.workunit.client.0.smithi081.stdout:5/512: truncate d17/f2c 1707094 0 2024-04-23T14:49:46.057 INFO:tasks.workunit.client.0.smithi081.stdout:5/513: truncate d17/d18/d3a/d8e/f90 624933 0 2024-04-23T14:49:46.058 INFO:tasks.workunit.client.1.smithi156.stdout:3/111: mknod d4/da/c14 0 2024-04-23T14:49:46.058 INFO:tasks.workunit.client.1.smithi156.stdout:6/146: mkdir d3/da/d10/d2b/d3b 0 2024-04-23T14:49:46.060 INFO:tasks.workunit.client.0.smithi081.stdout:7/374: getdents d3/d21/d31/d33/d4b 0 2024-04-23T14:49:46.060 INFO:tasks.workunit.client.0.smithi081.stdout:8/713: rmdir d3/d11/d48 39 2024-04-23T14:49:46.060 INFO:tasks.workunit.client.0.smithi081.stdout:7/375: mknod d3/d21/d41/c7d 0 2024-04-23T14:49:46.060 INFO:tasks.workunit.client.0.smithi081.stdout:8/714: rmdir d3/d11/d48/dc1 39 2024-04-23T14:49:46.060 INFO:tasks.workunit.client.0.smithi081.stdout:8/715: chown d3/d11/d86/d88/da7/lc8 36 1 2024-04-23T14:49:46.060 INFO:tasks.workunit.client.0.smithi081.stdout:7/376: unlink d3/d21/d31/fd 0 2024-04-23T14:49:46.060 INFO:tasks.workunit.client.0.smithi081.stdout:7/377: fsync d3/d11/f1b 0 2024-04-23T14:49:46.060 INFO:tasks.workunit.client.0.smithi081.stdout:7/378: dread - d3/d21/d31/d63/f74 zero size 2024-04-23T14:49:46.060 INFO:tasks.workunit.client.0.smithi081.stdout:7/379: getdents d3/d20/d77 0 2024-04-23T14:49:46.060 INFO:tasks.workunit.client.0.smithi081.stdout:8/716: creat d3/d11/d4f/fee x:0 0 0 2024-04-23T14:49:46.060 INFO:tasks.workunit.client.0.smithi081.stdout:7/380: unlink d3/d20/f45 0 2024-04-23T14:49:46.060 INFO:tasks.workunit.client.0.smithi081.stdout:8/717: mknod d3/d11/d86/d88/dd5/cef 0 2024-04-23T14:49:46.060 INFO:tasks.workunit.client.0.smithi081.stdout:7/381: creat d3/d21/d31/d33/d4b/d71/f7e x:0 0 0 2024-04-23T14:49:46.061 INFO:tasks.workunit.client.0.smithi081.stdout:7/382: chown d3/d21/c2e 648 1 2024-04-23T14:49:46.061 INFO:tasks.workunit.client.0.smithi081.stdout:7/383: dread - d3/d21/d31/d50/f58 zero size 2024-04-23T14:49:46.061 INFO:tasks.workunit.client.0.smithi081.stdout:7/384: mkdir d3/d11/d56/d7f 0 2024-04-23T14:49:46.061 INFO:tasks.workunit.client.0.smithi081.stdout:7/385: creat d3/d21/d41/f80 x:0 0 0 2024-04-23T14:49:46.061 INFO:tasks.workunit.client.0.smithi081.stdout:7/386: creat d3/d21/d31/d33/d52/f81 x:0 0 0 2024-04-23T14:49:46.061 INFO:tasks.workunit.client.0.smithi081.stdout:7/387: rename d3/f65 to d3/d21/d31/d63/f82 0 2024-04-23T14:49:46.061 INFO:tasks.workunit.client.0.smithi081.stdout:7/388: truncate d3/d20/f30 56024 0 2024-04-23T14:49:46.061 INFO:tasks.workunit.client.0.smithi081.stdout:7/389: readlink d3/l7b 0 2024-04-23T14:49:46.064 INFO:tasks.workunit.client.0.smithi081.stdout:7/390: rename d3/d21/d31/d63/c70 to d3/d21/d31/d33/d4b/d4c/c83 0 2024-04-23T14:49:46.064 INFO:tasks.workunit.client.0.smithi081.stdout:7/391: write d3/d21/d31/d50/f62 [97053,13307] 0 2024-04-23T14:49:46.068 INFO:tasks.workunit.client.0.smithi081.stdout:7/392: unlink d3/d11/l67 0 2024-04-23T14:49:46.070 INFO:tasks.workunit.client.0.smithi081.stdout:8/718: dread d3/d11/d48/f69 [0,4194304] 0 2024-04-23T14:49:46.072 INFO:tasks.workunit.client.0.smithi081.stdout:9/520: sync 2024-04-23T14:49:46.072 INFO:tasks.workunit.client.0.smithi081.stdout:1/556: sync 2024-04-23T14:49:46.073 INFO:tasks.workunit.client.0.smithi081.stdout:9/521: creat d3/de/d47/fa4 x:0 0 0 2024-04-23T14:49:46.073 INFO:tasks.workunit.client.0.smithi081.stdout:9/522: stat d3/l8f 0 2024-04-23T14:49:46.073 INFO:tasks.workunit.client.0.smithi081.stdout:9/523: write d3/de/d25/f59 [1333724,69574] 0 2024-04-23T14:49:46.077 INFO:tasks.workunit.client.1.smithi156.stdout:8/137: rename d5/d9/d10/d1d/d21/f27 to d5/d9/d10/f33 0 2024-04-23T14:49:46.082 INFO:tasks.workunit.client.1.smithi156.stdout:7/128: symlink dc/l1f 0 2024-04-23T14:49:46.082 INFO:tasks.workunit.client.1.smithi156.stdout:7/129: fsync dc/f11 0 2024-04-23T14:49:46.082 INFO:tasks.workunit.client.1.smithi156.stdout:1/145: rmdir db/d25 39 2024-04-23T14:49:46.083 INFO:tasks.workunit.client.0.smithi081.stdout:1/557: mknod d3/d3d/d41/d5e/d17/cb3 0 2024-04-23T14:49:46.086 INFO:tasks.workunit.client.1.smithi156.stdout:4/113: mknod d0/c27 0 2024-04-23T14:49:46.086 INFO:tasks.workunit.client.1.smithi156.stdout:6/147: dread d3/d16/d1e/f20 [0,4194304] 0 2024-04-23T14:49:46.089 INFO:tasks.workunit.client.1.smithi156.stdout:2/157: mkdir d4/d39 0 2024-04-23T14:49:46.091 INFO:tasks.workunit.client.1.smithi156.stdout:3/112: mknod d4/db/c15 0 2024-04-23T14:49:46.093 INFO:tasks.workunit.client.0.smithi081.stdout:1/558: write d3/d3d/d41/d5e/d17/d25/f6e [724822,47818] 0 2024-04-23T14:49:46.094 INFO:tasks.workunit.client.0.smithi081.stdout:9/524: write d3/de/d25/f45 [1462204,110567] 0 2024-04-23T14:49:46.094 INFO:tasks.workunit.client.1.smithi156.stdout:7/130: mkdir dc/d1d/d20 0 2024-04-23T14:49:46.095 INFO:tasks.workunit.client.1.smithi156.stdout:1/146: mkdir db/d1f/d2f 0 2024-04-23T14:49:46.096 INFO:tasks.workunit.client.1.smithi156.stdout:1/147: chown db/c1a 123 1 2024-04-23T14:49:46.096 INFO:tasks.workunit.client.1.smithi156.stdout:6/148: dread d3/d16/f39 [4194304,4194304] 0 2024-04-23T14:49:46.098 INFO:tasks.workunit.client.0.smithi081.stdout:9/525: getdents d3/de/d14/d5e 0 2024-04-23T14:49:46.104 INFO:tasks.workunit.client.0.smithi081.stdout:5/514: dwrite d17/f1d [0,4194304] 0 2024-04-23T14:49:46.104 INFO:tasks.workunit.client.0.smithi081.stdout:5/515: fsync d17/d3c/f81 0 2024-04-23T14:49:46.104 INFO:tasks.workunit.client.0.smithi081.stdout:5/516: write d17/d1f/f74 [78300,117399] 0 2024-04-23T14:49:46.104 INFO:tasks.workunit.client.0.smithi081.stdout:5/517: readlink d17/d4f/l7b 0 2024-04-23T14:49:46.105 INFO:tasks.workunit.client.0.smithi081.stdout:5/518: creat d17/d4a/fb9 x:0 0 0 2024-04-23T14:49:46.105 INFO:tasks.workunit.client.1.smithi156.stdout:4/114: link d0/d8/c15 d0/d8/d1e/c28 0 2024-04-23T14:49:46.105 INFO:tasks.workunit.client.1.smithi156.stdout:2/158: symlink d4/d13/l3a 0 2024-04-23T14:49:46.106 INFO:tasks.workunit.client.1.smithi156.stdout:3/113: mknod d4/c16 0 2024-04-23T14:49:46.106 INFO:tasks.workunit.client.1.smithi156.stdout:7/131: mknod dc/d1d/d20/c21 0 2024-04-23T14:49:46.106 INFO:tasks.workunit.client.1.smithi156.stdout:7/132: readlink dc/l18 0 2024-04-23T14:49:46.106 INFO:tasks.workunit.client.1.smithi156.stdout:3/114: fdatasync d4/da/f12 0 2024-04-23T14:49:46.106 INFO:tasks.workunit.client.1.smithi156.stdout:3/115: stat d4/da 0 2024-04-23T14:49:46.106 INFO:tasks.workunit.client.1.smithi156.stdout:8/138: dread d5/d9/d10/f12 [0,4194304] 0 2024-04-23T14:49:46.106 INFO:tasks.workunit.client.1.smithi156.stdout:8/139: creat d5/d9/d10/f34 x:0 0 0 2024-04-23T14:49:46.108 INFO:tasks.workunit.client.1.smithi156.stdout:6/149: rename d3/f8 to d3/d16/f3c 0 2024-04-23T14:49:46.108 INFO:tasks.workunit.client.1.smithi156.stdout:6/150: getdents d3/da/d10/d2b/d3b 0 2024-04-23T14:49:46.114 INFO:tasks.workunit.client.1.smithi156.stdout:4/115: unlink d0/f1a 0 2024-04-23T14:49:46.117 INFO:tasks.workunit.client.1.smithi156.stdout:7/133: symlink dc/l22 0 2024-04-23T14:49:46.118 INFO:tasks.workunit.client.1.smithi156.stdout:7/134: chown ca 8963 1 2024-04-23T14:49:46.118 INFO:tasks.workunit.client.1.smithi156.stdout:7/135: dread - dc/f1c zero size 2024-04-23T14:49:46.118 INFO:tasks.workunit.client.1.smithi156.stdout:7/136: write dc/f1e [766326,94566] 0 2024-04-23T14:49:46.120 INFO:tasks.workunit.client.1.smithi156.stdout:3/116: mknod d4/c17 0 2024-04-23T14:49:46.120 INFO:tasks.workunit.client.0.smithi081.stdout:8/719: dread d3/d11/d48/d7e/feb [0,4194304] 0 2024-04-23T14:49:46.121 INFO:tasks.workunit.client.1.smithi156.stdout:8/140: creat d5/d19/f35 x:0 0 0 2024-04-23T14:49:46.124 INFO:tasks.workunit.client.1.smithi156.stdout:6/151: creat d3/d16/d1e/f3d x:0 0 0 2024-04-23T14:49:46.124 INFO:tasks.workunit.client.1.smithi156.stdout:6/152: creat d3/da/d10/f3e x:0 0 0 2024-04-23T14:49:46.126 INFO:tasks.workunit.client.1.smithi156.stdout:3/117: mknod d4/db/dd/c18 0 2024-04-23T14:49:46.128 INFO:tasks.workunit.client.1.smithi156.stdout:4/116: dread d0/d8/fc [0,4194304] 0 2024-04-23T14:49:46.130 INFO:tasks.workunit.client.1.smithi156.stdout:8/141: mkdir d5/d9/d36 0 2024-04-23T14:49:46.131 INFO:tasks.workunit.client.1.smithi156.stdout:8/142: readlink d5/d9/la 0 2024-04-23T14:49:46.131 INFO:tasks.workunit.client.1.smithi156.stdout:6/153: mknod d3/d16/c3f 0 2024-04-23T14:49:46.131 INFO:tasks.workunit.client.1.smithi156.stdout:6/154: readlink d3/da/d1d/d27/l2a 0 2024-04-23T14:49:46.131 INFO:tasks.workunit.client.1.smithi156.stdout:6/155: creat d3/da/d10/f40 x:0 0 0 2024-04-23T14:49:46.134 INFO:tasks.workunit.client.1.smithi156.stdout:4/117: rename d0/d8/l1f to d0/df/d1b/l29 0 2024-04-23T14:49:46.140 INFO:tasks.workunit.client.1.smithi156.stdout:6/156: mknod d3/d16/c41 0 2024-04-23T14:49:46.151 INFO:tasks.workunit.client.1.smithi156.stdout:7/137: write dc/f14 [356953,85786] 0 2024-04-23T14:49:46.151 INFO:tasks.workunit.client.1.smithi156.stdout:0/147: sync 2024-04-23T14:49:46.151 INFO:tasks.workunit.client.1.smithi156.stdout:9/123: sync 2024-04-23T14:49:46.154 INFO:tasks.workunit.client.0.smithi081.stdout:8/720: dread d3/d11/d4f/d58/f99 [0,4194304] 0 2024-04-23T14:49:46.155 INFO:tasks.workunit.client.0.smithi081.stdout:7/393: dwrite d3/d21/d31/f29 [0,4194304] 0 2024-04-23T14:49:46.156 INFO:tasks.workunit.client.0.smithi081.stdout:7/394: stat d3/d11/d2c/d75/f5c 0 2024-04-23T14:49:46.156 INFO:tasks.workunit.client.0.smithi081.stdout:7/395: dread - d3/d21/d31/d50/f58 zero size 2024-04-23T14:49:46.159 INFO:tasks.workunit.client.0.smithi081.stdout:8/721: mkdir d3/d11/d48/d7e/de4/df0 0 2024-04-23T14:49:46.159 INFO:tasks.workunit.client.0.smithi081.stdout:8/722: write d3/d11/d34/fa2 [1387604,81984] 0 2024-04-23T14:49:46.161 INFO:tasks.workunit.client.1.smithi156.stdout:9/124: mkdir d1/d2/d23/d2d 0 2024-04-23T14:49:46.161 INFO:tasks.workunit.client.1.smithi156.stdout:9/125: creat d1/f2e x:0 0 0 2024-04-23T14:49:46.164 INFO:tasks.workunit.client.1.smithi156.stdout:6/157: rmdir d3 39 2024-04-23T14:49:46.165 INFO:tasks.workunit.client.1.smithi156.stdout:6/158: write d3/da/d1d/d27/f31 [935401,43682] 0 2024-04-23T14:49:46.165 INFO:tasks.workunit.client.1.smithi156.stdout:9/126: mkdir d1/d2/d23/d2f 0 2024-04-23T14:49:46.166 INFO:tasks.workunit.client.1.smithi156.stdout:6/159: symlink d3/da/d1d/d27/l42 0 2024-04-23T14:49:46.167 INFO:tasks.workunit.client.0.smithi081.stdout:8/723: write d3/d1a/fb8 [4470606,95121] 0 2024-04-23T14:49:46.167 INFO:tasks.workunit.client.0.smithi081.stdout:8/724: write d3/d3c/f42 [5237544,48229] 0 2024-04-23T14:49:46.167 INFO:tasks.workunit.client.0.smithi081.stdout:9/526: dwrite d3/de/d25/f60 [0,4194304] 0 2024-04-23T14:49:46.168 INFO:tasks.workunit.client.1.smithi156.stdout:9/127: mkdir d1/d2/d4/d19/d2a/d30 0 2024-04-23T14:49:46.168 INFO:tasks.workunit.client.1.smithi156.stdout:9/128: truncate d1/d2/d4/f8 5827852 0 2024-04-23T14:49:46.168 INFO:tasks.workunit.client.1.smithi156.stdout:9/129: stat d1/d2/d4/f1a 0 2024-04-23T14:49:46.168 INFO:tasks.workunit.client.0.smithi081.stdout:1/559: dwrite d3/d3d/d41/d5e/d17/d25/f4d [0,4194304] 0 2024-04-23T14:49:46.170 INFO:tasks.workunit.client.0.smithi081.stdout:8/725: link d3/d11/d3e/d63/d78/da0/la4 d3/d11/d34/d8b/lf1 0 2024-04-23T14:49:46.172 INFO:tasks.workunit.client.0.smithi081.stdout:9/527: rename d3/de/d25/d8c to d3/d67/da5 0 2024-04-23T14:49:46.173 INFO:tasks.workunit.client.0.smithi081.stdout:7/396: dread d3/d21/d31/d33/d4b/f60 [0,4194304] 0 2024-04-23T14:49:46.173 INFO:tasks.workunit.client.0.smithi081.stdout:7/397: chown d3/d21/d31/d33/f3b 1 1 2024-04-23T14:49:46.173 INFO:tasks.workunit.client.0.smithi081.stdout:7/398: fdatasync d3/d11/d2c/d75/f3c 0 2024-04-23T14:49:46.173 INFO:tasks.workunit.client.0.smithi081.stdout:7/399: creat d3/d21/d31/d33/d4b/d71/f84 x:0 0 0 2024-04-23T14:49:46.179 INFO:tasks.workunit.client.1.smithi156.stdout:1/148: dwrite db/f11 [0,4194304] 0 2024-04-23T14:49:46.181 INFO:tasks.workunit.client.0.smithi081.stdout:9/528: creat d3/de/d1d/d5b/d7b/fa6 x:0 0 0 2024-04-23T14:49:46.189 INFO:tasks.workunit.client.0.smithi081.stdout:7/400: link d3/d21/d31/d33/d52/f81 d3/d21/d31/d33/d4b/d4c/f85 0 2024-04-23T14:49:46.189 INFO:tasks.workunit.client.0.smithi081.stdout:1/560: rename d3/d3d/d41/d5e/d5d/db0/d70/f95 to d3/d3d/d41/d5e/d12/d1a/fb4 0 2024-04-23T14:49:46.190 INFO:tasks.workunit.client.0.smithi081.stdout:8/726: write d3/d11/d4f/d66/f79 [3848382,39048] 0 2024-04-23T14:49:46.195 INFO:tasks.workunit.client.0.smithi081.stdout:7/401: creat d3/d11/d2c/d75/f86 x:0 0 0 2024-04-23T14:49:46.199 INFO:tasks.workunit.client.1.smithi156.stdout:1/149: mkdir db/d25/d30 0 2024-04-23T14:49:46.199 INFO:tasks.workunit.client.1.smithi156.stdout:1/150: readlink l6 0 2024-04-23T14:49:46.199 INFO:tasks.workunit.client.1.smithi156.stdout:1/151: write db/d15/f23 [1357629,119292] 0 2024-04-23T14:49:46.200 INFO:tasks.workunit.client.0.smithi081.stdout:8/727: creat d3/d11/d3e/d63/d78/da0/ff2 x:0 0 0 2024-04-23T14:49:46.204 INFO:tasks.workunit.client.0.smithi081.stdout:8/728: fsync d3/d3c/f42 0 2024-04-23T14:49:46.205 INFO:tasks.workunit.client.1.smithi156.stdout:3/118: dwrite d4/f10 [0,4194304] 0 2024-04-23T14:49:46.208 INFO:tasks.workunit.client.0.smithi081.stdout:9/529: dread d3/de/d47/f49 [0,4194304] 0 2024-04-23T14:49:46.208 INFO:tasks.workunit.client.1.smithi156.stdout:3/119: creat d4/db/dd/f19 x:0 0 0 2024-04-23T14:49:46.212 INFO:tasks.workunit.client.0.smithi081.stdout:1/561: write d3/d3d/d41/d5e/d17/d26/f31 [3380750,71518] 0 2024-04-23T14:49:46.219 INFO:tasks.workunit.client.1.smithi156.stdout:7/138: fdatasync dc/f1e 0 2024-04-23T14:49:46.222 INFO:tasks.workunit.client.1.smithi156.stdout:1/152: write db/f11 [468439,18128] 0 2024-04-23T14:49:46.226 INFO:tasks.workunit.client.1.smithi156.stdout:1/153: symlink db/d1f/d28/l31 0 2024-04-23T14:49:46.227 INFO:tasks.workunit.client.1.smithi156.stdout:1/154: dread - db/f18 zero size 2024-04-23T14:49:46.228 INFO:tasks.workunit.client.1.smithi156.stdout:1/155: creat db/d1f/d2f/f32 x:0 0 0 2024-04-23T14:49:46.233 INFO:tasks.workunit.client.1.smithi156.stdout:1/156: symlink db/d1f/d28/l33 0 2024-04-23T14:49:46.233 INFO:tasks.workunit.client.1.smithi156.stdout:7/139: dread dc/f1c [0,4194304] 0 2024-04-23T14:49:46.236 INFO:tasks.workunit.client.1.smithi156.stdout:3/120: dread d4/da/ff [0,4194304] 0 2024-04-23T14:49:46.236 INFO:tasks.workunit.client.1.smithi156.stdout:7/140: write dc/f1e [313398,4431] 0 2024-04-23T14:49:46.237 INFO:tasks.workunit.client.1.smithi156.stdout:8/143: dwrite d5/f28 [0,4194304] 0 2024-04-23T14:49:46.237 INFO:tasks.workunit.client.1.smithi156.stdout:8/144: creat d5/d9/d10/d1d/d21/f37 x:0 0 0 2024-04-23T14:49:46.237 INFO:tasks.workunit.client.1.smithi156.stdout:8/145: truncate d5/d9/d10/f34 371361 0 2024-04-23T14:49:46.237 INFO:tasks.workunit.client.1.smithi156.stdout:8/146: chown d5/f1c 8181 1 2024-04-23T14:49:46.238 INFO:tasks.workunit.client.0.smithi081.stdout:3/411: sync 2024-04-23T14:49:46.238 INFO:tasks.workunit.client.0.smithi081.stdout:2/549: sync 2024-04-23T14:49:46.239 INFO:tasks.workunit.client.1.smithi156.stdout:9/130: dwrite d1/d2/d4/f1a [0,4194304] 0 2024-04-23T14:49:46.240 INFO:tasks.workunit.client.0.smithi081.stdout:3/412: link d4/dc/l24 d4/d7/df/d30/d64/d83/l89 0 2024-04-23T14:49:46.240 INFO:tasks.workunit.client.0.smithi081.stdout:3/413: chown d4/d7/df/d30/f80 162 1 2024-04-23T14:49:46.241 INFO:tasks.workunit.client.1.smithi156.stdout:4/118: dwrite d0/d8/fd [0,4194304] 0 2024-04-23T14:49:46.242 INFO:tasks.workunit.client.1.smithi156.stdout:6/160: dwrite d3/da/d1d/d27/f31 [0,4194304] 0 2024-04-23T14:49:46.242 INFO:tasks.workunit.client.1.smithi156.stdout:6/161: readlink d3/l1f 0 2024-04-23T14:49:46.242 INFO:tasks.workunit.client.1.smithi156.stdout:0/148: dwrite d0/f1a [0,4194304] 0 2024-04-23T14:49:46.243 INFO:tasks.workunit.client.0.smithi081.stdout:2/550: getdents d1/d33/d45 0 2024-04-23T14:49:46.246 INFO:tasks.workunit.client.0.smithi081.stdout:9/530: dread d3/d1a/fc [0,4194304] 0 2024-04-23T14:49:46.251 INFO:tasks.workunit.client.1.smithi156.stdout:1/157: dread db/d15/f23 [0,4194304] 0 2024-04-23T14:49:46.254 INFO:tasks.workunit.client.0.smithi081.stdout:3/414: stat d4/d7/d7f/c68 0 2024-04-23T14:49:46.254 INFO:tasks.workunit.client.1.smithi156.stdout:7/141: creat dc/d1d/f23 x:0 0 0 2024-04-23T14:49:46.254 INFO:tasks.workunit.client.1.smithi156.stdout:7/142: write dc/f1c [633436,114555] 0 2024-04-23T14:49:46.255 INFO:tasks.workunit.client.0.smithi081.stdout:2/551: stat d1/d11/dab/l8c 0 2024-04-23T14:49:46.257 INFO:tasks.workunit.client.1.smithi156.stdout:3/121: read d4/f10 [2711782,100033] 0 2024-04-23T14:49:46.258 INFO:tasks.workunit.client.0.smithi081.stdout:9/531: creat d3/fa7 x:0 0 0 2024-04-23T14:49:46.260 INFO:tasks.workunit.client.0.smithi081.stdout:2/552: unlink d1/d33/d45/d48/c80 0 2024-04-23T14:49:46.260 INFO:tasks.workunit.client.0.smithi081.stdout:2/553: readlink d1/d1e/l53 0 2024-04-23T14:49:46.263 INFO:tasks.workunit.client.0.smithi081.stdout:9/532: link d3/d1a/f63 d3/d5/fa8 0 2024-04-23T14:49:46.264 INFO:tasks.workunit.client.1.smithi156.stdout:9/131: mknod d1/d2/d23/c31 0 2024-04-23T14:49:46.272 INFO:tasks.workunit.client.1.smithi156.stdout:4/119: mknod d0/df/d1b/c2a 0 2024-04-23T14:49:46.274 INFO:tasks.workunit.client.1.smithi156.stdout:1/158: dread db/f27 [8388608,4194304] 0 2024-04-23T14:49:46.274 INFO:tasks.workunit.client.1.smithi156.stdout:1/159: dread - db/f18 zero size 2024-04-23T14:49:46.277 INFO:tasks.workunit.client.1.smithi156.stdout:7/143: dread f8 [0,4194304] 0 2024-04-23T14:49:46.282 INFO:tasks.workunit.client.1.smithi156.stdout:6/162: symlink d3/da/d10/d2b/d3b/l43 0 2024-04-23T14:49:46.282 INFO:tasks.workunit.client.1.smithi156.stdout:3/122: creat d4/da/d13/f1a x:0 0 0 2024-04-23T14:49:46.282 INFO:tasks.workunit.client.1.smithi156.stdout:3/123: creat d4/db/dd/f1b x:0 0 0 2024-04-23T14:49:46.283 INFO:tasks.workunit.client.1.smithi156.stdout:6/163: rmdir d3/da/d10/d2b 39 2024-04-23T14:49:46.284 INFO:tasks.workunit.client.1.smithi156.stdout:4/120: dread d0/d8/fc [0,4194304] 0 2024-04-23T14:49:46.284 INFO:tasks.workunit.client.1.smithi156.stdout:3/124: symlink d4/l1c 0 2024-04-23T14:49:46.286 INFO:tasks.workunit.client.1.smithi156.stdout:6/164: unlink d3/f2d 0 2024-04-23T14:49:46.288 INFO:tasks.workunit.client.1.smithi156.stdout:6/165: symlink d3/da/d10/d2b/l44 0 2024-04-23T14:49:46.289 INFO:tasks.workunit.client.1.smithi156.stdout:6/166: mknod d3/c45 0 2024-04-23T14:49:46.291 INFO:tasks.workunit.client.1.smithi156.stdout:6/167: unlink l1 0 2024-04-23T14:49:46.292 INFO:tasks.workunit.client.1.smithi156.stdout:1/160: write db/f27 [12340098,53626] 0 2024-04-23T14:49:46.293 INFO:tasks.workunit.client.1.smithi156.stdout:6/168: read d3/d16/d1e/f20 [312517,70542] 0 2024-04-23T14:49:46.294 INFO:tasks.workunit.client.1.smithi156.stdout:1/161: rename db/d21 to db/d1f/d34 0 2024-04-23T14:49:46.301 INFO:tasks.workunit.client.1.smithi156.stdout:6/169: dread d3/d16/d1e/f20 [0,4194304] 0 2024-04-23T14:49:46.302 INFO:tasks.workunit.client.1.smithi156.stdout:1/162: dread db/f19 [0,4194304] 0 2024-04-23T14:49:46.302 INFO:tasks.workunit.client.1.smithi156.stdout:1/163: read - db/f18 zero size 2024-04-23T14:49:46.302 INFO:tasks.workunit.client.1.smithi156.stdout:1/164: chown db/d1f 448615387 1 2024-04-23T14:49:46.302 INFO:tasks.workunit.client.1.smithi156.stdout:1/165: chown db/d15 171102206 1 2024-04-23T14:49:46.302 INFO:tasks.workunit.client.1.smithi156.stdout:5/199: sync 2024-04-23T14:49:46.305 INFO:tasks.workunit.client.1.smithi156.stdout:5/200: truncate d1/d3/fa 3134932 0 2024-04-23T14:49:46.311 INFO:tasks.workunit.client.0.smithi081.stdout:1/562: dwrite d3/d3d/d41/d5e/d5d/db0/f83 [0,4194304] 0 2024-04-23T14:49:46.313 INFO:tasks.workunit.client.0.smithi081.stdout:1/563: truncate f0 6928423 0 2024-04-23T14:49:46.314 INFO:tasks.workunit.client.0.smithi081.stdout:1/564: mknod d3/d3d/d41/d5e/d17/d26/cb5 0 2024-04-23T14:49:46.322 INFO:tasks.workunit.client.0.smithi081.stdout:8/729: dwrite d3/d11/f9a [0,4194304] 0 2024-04-23T14:49:46.323 INFO:tasks.workunit.client.0.smithi081.stdout:8/730: fsync d3/d11/d4f/d58/fce 0 2024-04-23T14:49:46.323 INFO:tasks.workunit.client.0.smithi081.stdout:8/731: chown d3/d11/d4f/d58/l8a 114 1 2024-04-23T14:49:46.323 INFO:tasks.workunit.client.0.smithi081.stdout:8/732: fdatasync d3/f5 0 2024-04-23T14:49:46.327 INFO:tasks.workunit.client.0.smithi081.stdout:2/554: dwrite d1/f85 [0,4194304] 0 2024-04-23T14:49:46.328 INFO:tasks.workunit.client.0.smithi081.stdout:3/415: write d4/dc/f45 [7234849,2286] 0 2024-04-23T14:49:46.328 INFO:tasks.workunit.client.0.smithi081.stdout:8/733: stat d3/d11/d4f/d6c/c6e 0 2024-04-23T14:49:46.333 INFO:tasks.workunit.client.1.smithi156.stdout:0/149: dwrite d0/f1a [0,4194304] 0 2024-04-23T14:49:46.339 INFO:tasks.workunit.client.0.smithi081.stdout:1/565: dread d3/d3d/d41/d5e/d5d/db0/f8e [0,4194304] 0 2024-04-23T14:49:46.340 INFO:tasks.workunit.client.0.smithi081.stdout:8/734: mkdir d3/d3c/ddb/df3 0 2024-04-23T14:49:46.340 INFO:tasks.workunit.client.0.smithi081.stdout:8/735: fsync d3/fd6 0 2024-04-23T14:49:46.346 INFO:tasks.workunit.client.1.smithi156.stdout:2/159: sync 2024-04-23T14:49:46.346 INFO:tasks.workunit.client.0.smithi081.stdout:1/566: symlink d3/d3d/d41/d5e/d12/d1a/lb6 0 2024-04-23T14:49:46.347 INFO:tasks.workunit.client.0.smithi081.stdout:1/567: write d3/fa [1742535,66648] 0 2024-04-23T14:49:46.347 INFO:tasks.workunit.client.1.smithi156.stdout:0/150: dread d0/f15 [0,4194304] 0 2024-04-23T14:49:46.349 INFO:tasks.workunit.client.0.smithi081.stdout:8/736: rmdir d3 39 2024-04-23T14:49:46.351 INFO:tasks.workunit.client.1.smithi156.stdout:2/160: getdents d4/d26 0 2024-04-23T14:49:46.355 INFO:tasks.workunit.client.0.smithi081.stdout:9/533: dwrite d3/de/f1c [0,4194304] 0 2024-04-23T14:49:46.356 INFO:tasks.workunit.client.1.smithi156.stdout:7/144: dwrite dc/f14 [0,4194304] 0 2024-04-23T14:49:46.359 INFO:tasks.workunit.client.1.smithi156.stdout:0/151: symlink d0/d4/d14/d1b/d2b/l30 0 2024-04-23T14:49:46.360 INFO:tasks.workunit.client.1.smithi156.stdout:6/170: rename d3/da/d10 to d3/d16/d46 0 2024-04-23T14:49:46.362 INFO:tasks.workunit.client.1.smithi156.stdout:3/125: dwrite d4/db/dd/f19 [0,4194304] 0 2024-04-23T14:49:46.362 INFO:tasks.workunit.client.1.smithi156.stdout:3/126: write d4/db/dd/f1b [12426,125740] 0 2024-04-23T14:49:46.362 INFO:tasks.workunit.client.1.smithi156.stdout:9/132: dwrite d1/d2/d23/f27 [0,4194304] 0 2024-04-23T14:49:46.363 INFO:tasks.workunit.client.1.smithi156.stdout:9/133: read - d1/d2/d4/d19/f26 zero size 2024-04-23T14:49:46.364 INFO:tasks.workunit.client.1.smithi156.stdout:5/201: rename d1/d3/f40 to d1/d11/d18/f41 0 2024-04-23T14:49:46.368 INFO:tasks.workunit.client.1.smithi156.stdout:1/166: getdents db 0 2024-04-23T14:49:46.368 INFO:tasks.workunit.client.1.smithi156.stdout:1/167: fsync db/f17 0 2024-04-23T14:49:46.376 INFO:tasks.workunit.client.1.smithi156.stdout:3/127: mkdir d4/db/dd/d1d 0 2024-04-23T14:49:46.376 INFO:tasks.workunit.client.1.smithi156.stdout:3/128: chown d4 68032797 1 2024-04-23T14:49:46.376 INFO:tasks.workunit.client.1.smithi156.stdout:3/129: fdatasync d4/da/ff 0 2024-04-23T14:49:46.377 INFO:tasks.workunit.client.1.smithi156.stdout:2/161: rename d4/c1b to d4/d21/d2f/c3b 0 2024-04-23T14:49:46.377 INFO:tasks.workunit.client.1.smithi156.stdout:0/152: rename d0/d4 to d0/d4/d14/d1b/d2b/d31 22 2024-04-23T14:49:46.381 INFO:tasks.workunit.client.1.smithi156.stdout:1/168: symlink db/d1f/l35 0 2024-04-23T14:49:46.383 INFO:tasks.workunit.client.1.smithi156.stdout:5/202: getdents d1 0 2024-04-23T14:49:46.389 INFO:tasks.workunit.client.1.smithi156.stdout:2/162: mkdir d4/d26/d3c 0 2024-04-23T14:49:46.390 INFO:tasks.workunit.client.1.smithi156.stdout:1/169: creat db/d1f/d2d/f36 x:0 0 0 2024-04-23T14:49:46.391 INFO:tasks.workunit.client.1.smithi156.stdout:1/170: getdents db 0 2024-04-23T14:49:46.402 INFO:tasks.workunit.client.1.smithi156.stdout:2/163: link d4/l1f d4/d26/l3d 0 2024-04-23T14:49:46.410 INFO:tasks.workunit.client.1.smithi156.stdout:1/171: creat db/d1f/d28/f37 x:0 0 0 2024-04-23T14:49:46.410 INFO:tasks.workunit.client.1.smithi156.stdout:1/172: readlink l6 0 2024-04-23T14:49:46.410 INFO:tasks.workunit.client.1.smithi156.stdout:1/173: stat db/f18 0 2024-04-23T14:49:46.410 INFO:tasks.workunit.client.1.smithi156.stdout:9/134: write d1/d2/f18 [1779814,21049] 0 2024-04-23T14:49:46.413 INFO:tasks.workunit.client.1.smithi156.stdout:6/171: dread d3/d16/f37 [0,4194304] 0 2024-04-23T14:49:46.416 INFO:tasks.workunit.client.1.smithi156.stdout:9/135: link d1/d2/d4/dc/c14 d1/d2/c32 0 2024-04-23T14:49:46.420 INFO:tasks.workunit.client.1.smithi156.stdout:6/172: symlink d3/d16/d46/l47 0 2024-04-23T14:49:46.423 INFO:tasks.workunit.client.0.smithi081.stdout:8/737: dwrite d3/d11/d4f/d58/fd7 [0,4194304] 0 2024-04-23T14:49:46.423 INFO:tasks.workunit.client.0.smithi081.stdout:2/555: dwrite d1/d11/d21/d52/f75 [0,4194304] 0 2024-04-23T14:49:46.423 INFO:tasks.workunit.client.0.smithi081.stdout:3/416: dwrite d4/dc/f45 [4194304,4194304] 0 2024-04-23T14:49:46.423 INFO:tasks.workunit.client.0.smithi081.stdout:3/417: chown d4/d7/df/c59 92 1 2024-04-23T14:49:46.423 INFO:tasks.workunit.client.0.smithi081.stdout:3/418: chown d4/dc/f3b 220788410 1 2024-04-23T14:49:46.423 INFO:tasks.workunit.client.1.smithi156.stdout:2/164: rmdir d4/d21 39 2024-04-23T14:49:46.425 INFO:tasks.workunit.client.1.smithi156.stdout:4/121: sync 2024-04-23T14:49:46.425 INFO:tasks.workunit.client.0.smithi081.stdout:2/556: write d1/d33/d45/d6e/f9d [619091,57194] 0 2024-04-23T14:49:46.427 INFO:tasks.workunit.client.0.smithi081.stdout:9/534: dwrite d3/d1a/d6c/f42 [0,4194304] 0 2024-04-23T14:49:46.427 INFO:tasks.workunit.client.1.smithi156.stdout:8/147: sync 2024-04-23T14:49:46.430 INFO:tasks.workunit.client.0.smithi081.stdout:9/535: creat d3/de/d47/fa9 x:0 0 0 2024-04-23T14:49:46.431 INFO:tasks.workunit.client.1.smithi156.stdout:4/122: getdents d0/df/d1b 0 2024-04-23T14:49:46.431 INFO:tasks.workunit.client.1.smithi156.stdout:4/123: chown d0/l1 18952921 1 2024-04-23T14:49:46.435 INFO:tasks.workunit.client.0.smithi081.stdout:2/557: mknod d1/d1e/cbf 0 2024-04-23T14:49:46.435 INFO:tasks.workunit.client.1.smithi156.stdout:4/124: getdents d0/d8/d1e 0 2024-04-23T14:49:46.435 INFO:tasks.workunit.client.1.smithi156.stdout:4/125: chown d0/df/c11 3 1 2024-04-23T14:49:46.440 INFO:tasks.workunit.client.1.smithi156.stdout:4/126: mknod d0/c2b 0 2024-04-23T14:49:46.440 INFO:tasks.workunit.client.1.smithi156.stdout:4/127: chown d0/df/c1d 113379662 1 2024-04-23T14:49:46.441 INFO:tasks.workunit.client.1.smithi156.stdout:1/174: dread db/f11 [0,4194304] 0 2024-04-23T14:49:46.444 INFO:tasks.workunit.client.1.smithi156.stdout:1/175: mkdir db/d25/d30/d38 0 2024-04-23T14:49:46.448 INFO:tasks.workunit.client.0.smithi081.stdout:1/568: dwrite d3/d3d/d6f/f62 [0,4194304] 0 2024-04-23T14:49:46.448 INFO:tasks.workunit.client.0.smithi081.stdout:2/558: dread d1/d33/f79 [0,4194304] 0 2024-04-23T14:49:46.449 INFO:tasks.workunit.client.1.smithi156.stdout:3/130: dread d4/db/dd/f1b [0,4194304] 0 2024-04-23T14:49:46.452 INFO:tasks.workunit.client.1.smithi156.stdout:6/173: dread d3/da/d1d/f21 [0,4194304] 0 2024-04-23T14:49:46.452 INFO:tasks.workunit.client.1.smithi156.stdout:6/174: write d3/da/fe [1685023,68793] 0 2024-04-23T14:49:46.453 INFO:tasks.workunit.client.1.smithi156.stdout:1/176: unlink db/ld 0 2024-04-23T14:49:46.456 INFO:tasks.workunit.client.0.smithi081.stdout:9/536: write d3/de/d25/f60 [71092,60222] 0 2024-04-23T14:49:46.457 INFO:tasks.workunit.client.1.smithi156.stdout:7/145: dwrite f8 [0,4194304] 0 2024-04-23T14:49:46.457 INFO:tasks.workunit.client.1.smithi156.stdout:3/131: dread d4/db/dd/f1b [0,4194304] 0 2024-04-23T14:49:46.464 INFO:tasks.workunit.client.1.smithi156.stdout:6/175: mknod d3/d16/d46/c48 0 2024-04-23T14:49:46.465 INFO:tasks.workunit.client.1.smithi156.stdout:8/148: dread d5/d9/fd [0,4194304] 0 2024-04-23T14:49:46.466 INFO:tasks.workunit.client.1.smithi156.stdout:1/177: creat db/f39 x:0 0 0 2024-04-23T14:49:46.467 INFO:tasks.workunit.client.0.smithi081.stdout:1/569: mknod d3/d3d/d41/d5e/d1d/cb7 0 2024-04-23T14:49:46.469 INFO:tasks.workunit.client.0.smithi081.stdout:6/448: sync 2024-04-23T14:49:46.470 INFO:tasks.workunit.client.1.smithi156.stdout:3/132: getdents d4/da 0 2024-04-23T14:49:46.470 INFO:tasks.workunit.client.1.smithi156.stdout:8/149: mknod d5/d9/d10/d1d/c38 0 2024-04-23T14:49:46.471 INFO:tasks.workunit.client.0.smithi081.stdout:9/537: link d3/de/l15 d3/d1a/laa 0 2024-04-23T14:49:46.472 INFO:tasks.workunit.client.0.smithi081.stdout:1/570: symlink d3/d3d/d41/d5e/d12/d2e/lb8 0 2024-04-23T14:49:46.472 INFO:tasks.workunit.client.0.smithi081.stdout:1/571: truncate d3/d3d/d41/d5e/d17/f27 4404809 0 2024-04-23T14:49:46.472 INFO:tasks.workunit.client.0.smithi081.stdout:1/572: readlink d3/d3d/d41/d5e/d12/d2e/l88 0 2024-04-23T14:49:46.473 INFO:tasks.workunit.client.0.smithi081.stdout:3/419: dwrite d4/d7/d32/d6a/f7a [0,4194304] 0 2024-04-23T14:49:46.474 INFO:tasks.workunit.client.1.smithi156.stdout:0/153: dwrite d0/d4/d14/d1b/d2a/f29 [0,4194304] 0 2024-04-23T14:49:46.475 INFO:tasks.workunit.client.1.smithi156.stdout:3/133: unlink d4/db/dd/f19 0 2024-04-23T14:49:46.475 INFO:tasks.workunit.client.1.smithi156.stdout:3/134: stat d4/da/ce 0 2024-04-23T14:49:46.476 INFO:tasks.workunit.client.1.smithi156.stdout:8/150: mkdir d5/d39 0 2024-04-23T14:49:46.476 INFO:tasks.workunit.client.1.smithi156.stdout:8/151: chown d5/d9/d10/f11 1170 1 2024-04-23T14:49:46.477 INFO:tasks.workunit.client.0.smithi081.stdout:9/538: mkdir d3/de/d14/dab 0 2024-04-23T14:49:46.478 INFO:tasks.workunit.client.0.smithi081.stdout:9/539: fdatasync d3/f4a 0 2024-04-23T14:49:46.478 INFO:tasks.workunit.client.1.smithi156.stdout:8/152: readlink d5/d9/d10/l17 0 2024-04-23T14:49:46.480 INFO:tasks.workunit.client.0.smithi081.stdout:1/573: creat d3/d3d/d41/d5e/d9d/fb9 x:0 0 0 2024-04-23T14:49:46.488 INFO:tasks.workunit.client.0.smithi081.stdout:6/449: dread d1/d51/d65/d13/f3c [0,4194304] 0 2024-04-23T14:49:46.488 INFO:tasks.workunit.client.0.smithi081.stdout:6/450: chown d1/d51/d65/d8/d2e/d59 92 1 2024-04-23T14:49:46.491 INFO:tasks.workunit.client.1.smithi156.stdout:9/136: dread d1/d2/d4/ff [0,4194304] 0 2024-04-23T14:49:46.492 INFO:tasks.workunit.client.1.smithi156.stdout:5/203: dwrite d1/d3/f1e [0,4194304] 0 2024-04-23T14:49:46.492 INFO:tasks.workunit.client.1.smithi156.stdout:9/137: stat d1/d2/d4/d19 0 2024-04-23T14:49:46.492 INFO:tasks.workunit.client.0.smithi081.stdout:3/420: creat d4/d7/f8a x:0 0 0 2024-04-23T14:49:46.493 INFO:tasks.workunit.client.0.smithi081.stdout:7/402: sync 2024-04-23T14:49:46.494 INFO:tasks.workunit.client.0.smithi081.stdout:0/564: sync 2024-04-23T14:49:46.495 INFO:tasks.workunit.client.0.smithi081.stdout:5/519: sync 2024-04-23T14:49:46.495 INFO:tasks.workunit.client.0.smithi081.stdout:5/520: chown d17/d1f/d42/f50 8362 1 2024-04-23T14:49:46.495 INFO:tasks.workunit.client.0.smithi081.stdout:5/521: stat d17/d3c/ca2 0 2024-04-23T14:49:46.498 INFO:tasks.workunit.client.0.smithi081.stdout:2/559: dwrite d1/d11/d21/d34/f47 [0,4194304] 0 2024-04-23T14:49:46.499 INFO:tasks.workunit.client.0.smithi081.stdout:4/470: sync 2024-04-23T14:49:46.499 INFO:tasks.workunit.client.0.smithi081.stdout:4/471: getdents d1/d4f 0 2024-04-23T14:49:46.499 INFO:tasks.workunit.client.1.smithi156.stdout:0/154: symlink d0/d4/l32 0 2024-04-23T14:49:46.504 INFO:tasks.workunit.client.0.smithi081.stdout:6/451: unlink d1/d51/d65/d8/d2e/l6c 0 2024-04-23T14:49:46.504 INFO:tasks.workunit.client.0.smithi081.stdout:3/421: link d4/d7/d7f/f65 d4/d7/d2e/f8b 0 2024-04-23T14:49:46.504 INFO:tasks.workunit.client.1.smithi156.stdout:5/204: rename d1/lf to d1/d11/d18/d19/l42 0 2024-04-23T14:49:46.506 INFO:tasks.workunit.client.0.smithi081.stdout:5/522: mkdir d17/d4f/d61/dba 0 2024-04-23T14:49:46.506 INFO:tasks.workunit.client.1.smithi156.stdout:9/138: dread d1/d2/d4/d17/d1f/f21 [0,4194304] 0 2024-04-23T14:49:46.511 INFO:tasks.workunit.client.1.smithi156.stdout:0/155: mknod d0/d4/d14/d1b/d2b/c33 0 2024-04-23T14:49:46.511 INFO:tasks.workunit.client.1.smithi156.stdout:6/176: dwrite d3/da/d1d/d27/f31 [0,4194304] 0 2024-04-23T14:49:46.512 INFO:tasks.workunit.client.1.smithi156.stdout:9/139: symlink d1/d2/d4/d19/d2a/l33 0 2024-04-23T14:49:46.514 INFO:tasks.workunit.client.0.smithi081.stdout:4/472: truncate d1/d1d/d39/f4c 1747336 0 2024-04-23T14:49:46.516 INFO:tasks.workunit.client.0.smithi081.stdout:6/452: unlink d1/d51/d65/d8/d2e/d58/c8a 0 2024-04-23T14:49:46.518 INFO:tasks.workunit.client.1.smithi156.stdout:9/140: rename d1/d2/d4/d17/d1f/f21 to d1/d2/d4/d19/d2a/d30/f34 0 2024-04-23T14:49:46.519 INFO:tasks.workunit.client.0.smithi081.stdout:3/422: symlink d4/dc/d10/d5a/l8c 0 2024-04-23T14:49:46.519 INFO:tasks.workunit.client.0.smithi081.stdout:3/423: fdatasync d4/dc/d10/d47/f4a 0 2024-04-23T14:49:46.521 INFO:tasks.workunit.client.0.smithi081.stdout:4/473: truncate d1/f9 11247210 0 2024-04-23T14:49:46.522 INFO:tasks.workunit.client.0.smithi081.stdout:6/453: truncate d1/d51/d65/f4f 3658787 0 2024-04-23T14:49:46.524 INFO:tasks.workunit.client.0.smithi081.stdout:3/424: symlink d4/d7/d7f/d85/l8d 0 2024-04-23T14:49:46.525 INFO:tasks.workunit.client.0.smithi081.stdout:2/560: dread d1/f6 [0,4194304] 0 2024-04-23T14:49:46.527 INFO:tasks.workunit.client.0.smithi081.stdout:4/474: unlink d1/d1d/f3f 0 2024-04-23T14:49:46.535 INFO:tasks.workunit.client.0.smithi081.stdout:6/454: mknod d1/d2/d49/d52/ca2 0 2024-04-23T14:49:46.536 INFO:tasks.workunit.client.0.smithi081.stdout:6/455: write d1/d51/d65/d1c/f73 [459440,104004] 0 2024-04-23T14:49:46.536 INFO:tasks.workunit.client.0.smithi081.stdout:6/456: rename d1/d51 to d1/d51/d65/d8/da3 22 2024-04-23T14:49:46.538 INFO:tasks.workunit.client.0.smithi081.stdout:9/540: dread d3/de/d1d/d54/f6a [0,4194304] 0 2024-04-23T14:49:46.541 INFO:tasks.workunit.client.0.smithi081.stdout:3/425: creat d4/d7/d1a/f8e x:0 0 0 2024-04-23T14:49:46.542 INFO:tasks.workunit.client.0.smithi081.stdout:6/457: write d1/f17 [486414,11491] 0 2024-04-23T14:49:46.545 INFO:tasks.workunit.client.0.smithi081.stdout:4/475: truncate d1/d8f/f93 727605 0 2024-04-23T14:49:46.546 INFO:tasks.workunit.client.0.smithi081.stdout:3/426: creat d4/d7/d49/f8f x:0 0 0 2024-04-23T14:49:46.546 INFO:tasks.workunit.client.0.smithi081.stdout:3/427: truncate d4/d7/d1a/f8e 591752 0 2024-04-23T14:49:46.548 INFO:tasks.workunit.client.0.smithi081.stdout:3/428: truncate d4/d7/d1a/d71/f76 480135 0 2024-04-23T14:49:46.548 INFO:tasks.workunit.client.0.smithi081.stdout:6/458: mkdir d1/d51/d65/d8/da4 0 2024-04-23T14:49:46.549 INFO:tasks.workunit.client.0.smithi081.stdout:6/459: fsync d1/d51/d65/d13/f4e 0 2024-04-23T14:49:46.551 INFO:tasks.workunit.client.1.smithi156.stdout:0/156: write d0/d4/fe [3814982,76643] 0 2024-04-23T14:49:46.552 INFO:tasks.workunit.client.0.smithi081.stdout:5/523: dread d17/f2c [0,4194304] 0 2024-04-23T14:49:46.556 INFO:tasks.workunit.client.0.smithi081.stdout:2/561: rmdir d1/d33/d45/d48 39 2024-04-23T14:49:46.560 INFO:tasks.workunit.client.0.smithi081.stdout:9/541: dread d3/d1a/d6c/f31 [0,4194304] 0 2024-04-23T14:49:46.560 INFO:tasks.workunit.client.0.smithi081.stdout:4/476: mkdir d1/d4/d11/d9d 0 2024-04-23T14:49:46.566 INFO:tasks.workunit.client.0.smithi081.stdout:4/477: mknod d1/d1d/c9e 0 2024-04-23T14:49:46.567 INFO:tasks.workunit.client.1.smithi156.stdout:3/135: dwrite d4/da/f12 [0,4194304] 0 2024-04-23T14:49:46.567 INFO:tasks.workunit.client.1.smithi156.stdout:3/136: chown d4/da 211 1 2024-04-23T14:49:46.567 INFO:tasks.workunit.client.1.smithi156.stdout:3/137: chown d4/db/dd/f1b 40 1 2024-04-23T14:49:46.571 INFO:tasks.workunit.client.0.smithi081.stdout:3/429: dread d4/d7/d32/f3e [0,4194304] 0 2024-04-23T14:49:46.571 INFO:tasks.workunit.client.0.smithi081.stdout:3/430: fdatasync d4/dc/d50/f4e 0 2024-04-23T14:49:46.571 INFO:tasks.workunit.client.0.smithi081.stdout:3/431: write d4/d7/df/d30/f80 [925152,36873] 0 2024-04-23T14:49:46.574 INFO:tasks.workunit.client.1.smithi156.stdout:3/138: dread d4/db/dd/f1b [0,4194304] 0 2024-04-23T14:49:46.575 INFO:tasks.workunit.client.0.smithi081.stdout:4/478: creat d1/d4/d6f/f9f x:0 0 0 2024-04-23T14:49:46.575 INFO:tasks.workunit.client.0.smithi081.stdout:5/524: dread d17/d3c/d55/f7d [0,4194304] 0 2024-04-23T14:49:46.576 INFO:tasks.workunit.client.0.smithi081.stdout:1/574: dwrite d3/d3d/d41/d5e/d17/f20 [0,4194304] 0 2024-04-23T14:49:46.578 INFO:tasks.workunit.client.1.smithi156.stdout:4/128: dwrite d0/d8/fd [4194304,4194304] 0 2024-04-23T14:49:46.578 INFO:tasks.workunit.client.1.smithi156.stdout:2/165: dwrite d4/d13/f23 [0,4194304] 0 2024-04-23T14:49:46.581 INFO:tasks.workunit.client.0.smithi081.stdout:3/432: unlink d4/d7/d2e/c3f 0 2024-04-23T14:49:46.583 INFO:tasks.workunit.client.0.smithi081.stdout:5/525: truncate f4 3066088 0 2024-04-23T14:49:46.583 INFO:tasks.workunit.client.0.smithi081.stdout:1/575: mkdir d3/d3d/d41/d5e/d17/d58/d7f/dba 0 2024-04-23T14:49:46.585 INFO:tasks.workunit.client.0.smithi081.stdout:4/479: dread d1/d1d/f26 [0,4194304] 0 2024-04-23T14:49:46.585 INFO:tasks.workunit.client.1.smithi156.stdout:2/166: rename d4/d26/c2a to d4/d13/d19/c3e 0 2024-04-23T14:49:46.586 INFO:tasks.workunit.client.0.smithi081.stdout:3/433: stat d4/d7/df/f5e 0 2024-04-23T14:49:46.587 INFO:tasks.workunit.client.1.smithi156.stdout:4/129: rmdir d0/d8 39 2024-04-23T14:49:46.589 INFO:tasks.workunit.client.0.smithi081.stdout:5/526: mkdir d17/d1f/d42/dbb 0 2024-04-23T14:49:46.589 INFO:tasks.workunit.client.0.smithi081.stdout:5/527: truncate d17/d18/d3a/d8e/f90 1193341 0 2024-04-23T14:49:46.589 INFO:tasks.workunit.client.1.smithi156.stdout:5/205: dread d1/d3/fa [0,4194304] 0 2024-04-23T14:49:46.589 INFO:tasks.workunit.client.1.smithi156.stdout:5/206: write d1/d3/d24/f3d [246225,21603] 0 2024-04-23T14:49:46.590 INFO:tasks.workunit.client.1.smithi156.stdout:2/167: creat d4/d21/f3f x:0 0 0 2024-04-23T14:49:46.591 INFO:tasks.workunit.client.0.smithi081.stdout:0/565: dwrite d6/d37/f38 [0,4194304] 0 2024-04-23T14:49:46.591 INFO:tasks.workunit.client.0.smithi081.stdout:0/566: write d6/d11/d14/f26 [168610,11017] 0 2024-04-23T14:49:46.591 INFO:tasks.workunit.client.1.smithi156.stdout:8/153: write d5/f28 [2432617,108149] 0 2024-04-23T14:49:46.592 INFO:tasks.workunit.client.1.smithi156.stdout:6/177: dread d3/da/f18 [0,4194304] 0 2024-04-23T14:49:46.594 INFO:tasks.workunit.client.0.smithi081.stdout:4/480: creat d1/d4/dc/fa0 x:0 0 0 2024-04-23T14:49:46.594 INFO:tasks.workunit.client.0.smithi081.stdout:4/481: chown d1/d1d/d59/f85 71829963 1 2024-04-23T14:49:46.594 INFO:tasks.workunit.client.0.smithi081.stdout:4/482: readlink d1/d1d/d59/l7d 0 2024-04-23T14:49:46.594 INFO:tasks.workunit.client.0.smithi081.stdout:5/528: unlink d17/d3c/l54 0 2024-04-23T14:49:46.595 INFO:tasks.workunit.client.1.smithi156.stdout:5/207: mkdir d1/d3/d43 0 2024-04-23T14:49:46.595 INFO:tasks.workunit.client.1.smithi156.stdout:5/208: dread - d1/d11/d18/d19/f3b zero size 2024-04-23T14:49:46.599 INFO:tasks.workunit.client.1.smithi156.stdout:2/168: rename d4/l1f to d4/d13/l40 0 2024-04-23T14:49:46.599 INFO:tasks.workunit.client.1.smithi156.stdout:2/169: chown d4/d39 66762466 1 2024-04-23T14:49:46.601 INFO:tasks.workunit.client.0.smithi081.stdout:0/567: rename d6/d11/d14/d41/d5b/f3d to d6/d11/d14/d41/d5b/d3f/d44/d78/d84/fae 0 2024-04-23T14:49:46.601 INFO:tasks.workunit.client.0.smithi081.stdout:0/568: fsync d6/f9 0 2024-04-23T14:49:46.601 INFO:tasks.workunit.client.0.smithi081.stdout:0/569: chown d6/d11/d14/d41/d5b/d3f/d44/f8f 27743 1 2024-04-23T14:49:46.608 INFO:tasks.workunit.client.1.smithi156.stdout:8/154: write d5/d9/d10/f11 [3133947,47381] 0 2024-04-23T14:49:46.609 INFO:tasks.workunit.client.1.smithi156.stdout:8/155: write d5/d19/f35 [521547,37167] 0 2024-04-23T14:49:46.609 INFO:tasks.workunit.client.1.smithi156.stdout:1/178: dwrite db/f17 [0,4194304] 0 2024-04-23T14:49:46.609 INFO:tasks.workunit.client.1.smithi156.stdout:1/179: chown db/f11 876566 1 2024-04-23T14:49:46.609 INFO:tasks.workunit.client.1.smithi156.stdout:1/180: dread - db/d1f/d2d/f36 zero size 2024-04-23T14:49:46.609 INFO:tasks.workunit.client.1.smithi156.stdout:1/181: write db/d1f/d28/f37 [602942,74641] 0 2024-04-23T14:49:46.610 INFO:tasks.workunit.client.0.smithi081.stdout:4/483: symlink d1/d3/d8c/d99/la1 0 2024-04-23T14:49:46.611 INFO:tasks.workunit.client.0.smithi081.stdout:5/529: creat d17/d1f/d42/fbc x:0 0 0 2024-04-23T14:49:46.611 INFO:tasks.workunit.client.0.smithi081.stdout:5/530: fdatasync d17/d4f/f7c 0 2024-04-23T14:49:46.611 INFO:tasks.workunit.client.0.smithi081.stdout:3/434: dread d4/d41/f66 [0,4194304] 0 2024-04-23T14:49:46.611 INFO:tasks.workunit.client.0.smithi081.stdout:5/531: creat d17/d4a/fbd x:0 0 0 2024-04-23T14:49:46.611 INFO:tasks.workunit.client.0.smithi081.stdout:5/532: fdatasync d17/d1f/f74 0 2024-04-23T14:49:46.611 INFO:tasks.workunit.client.0.smithi081.stdout:5/533: readlink l15 0 2024-04-23T14:49:46.612 INFO:tasks.workunit.client.1.smithi156.stdout:2/170: symlink d4/d21/d2f/l41 0 2024-04-23T14:49:46.613 INFO:tasks.workunit.client.1.smithi156.stdout:1/182: mkdir db/d25/d30/d38/d3a 0 2024-04-23T14:49:46.614 INFO:tasks.workunit.client.0.smithi081.stdout:0/570: write d6/d11/d14/f26 [530143,108739] 0 2024-04-23T14:49:46.614 INFO:tasks.workunit.client.0.smithi081.stdout:0/571: rename d6/d11/d14/d41/d5b to d6/d11/d14/d41/d5b/d59/d8e/daf 22 2024-04-23T14:49:46.617 INFO:tasks.workunit.client.1.smithi156.stdout:2/171: mkdir d4/d21/d42 0 2024-04-23T14:49:46.618 INFO:tasks.workunit.client.1.smithi156.stdout:2/172: write d4/d13/f20 [3796745,30680] 0 2024-04-23T14:49:46.619 INFO:tasks.workunit.client.0.smithi081.stdout:2/562: dwrite d1/fe [4194304,4194304] 0 2024-04-23T14:49:46.621 INFO:tasks.workunit.client.1.smithi156.stdout:1/183: rename db/d1f/d2f/f32 to db/d25/f3b 0 2024-04-23T14:49:46.623 INFO:tasks.workunit.client.0.smithi081.stdout:5/534: creat d17/d3c/fbe x:0 0 0 2024-04-23T14:49:46.625 INFO:tasks.workunit.client.0.smithi081.stdout:0/572: mkdir d6/d11/db0 0 2024-04-23T14:49:46.626 INFO:tasks.workunit.client.0.smithi081.stdout:0/573: stat d6/l66 0 2024-04-23T14:49:46.631 INFO:tasks.workunit.client.0.smithi081.stdout:4/484: write d1/d3/f71 [2974162,34928] 0 2024-04-23T14:49:46.631 INFO:tasks.workunit.client.0.smithi081.stdout:4/485: fdatasync d1/f9 0 2024-04-23T14:49:46.631 INFO:tasks.workunit.client.1.smithi156.stdout:1/184: link db/d15/c1e db/d1f/d2f/c3c 0 2024-04-23T14:49:46.631 INFO:tasks.workunit.client.0.smithi081.stdout:6/460: write d1/d51/d7b/d91/f9f [661173,102612] 0 2024-04-23T14:49:46.632 INFO:tasks.workunit.client.0.smithi081.stdout:1/576: dwrite d3/d3d/d41/d5e/d17/d58/d7f/f4b [8388608,4194304] 0 2024-04-23T14:49:46.632 INFO:tasks.workunit.client.0.smithi081.stdout:2/563: mknod d1/d11/d21/d52/d8b/cc0 0 2024-04-23T14:49:46.632 INFO:tasks.workunit.client.0.smithi081.stdout:2/564: truncate d1/f92 305879 0 2024-04-23T14:49:46.632 INFO:tasks.workunit.client.0.smithi081.stdout:2/565: stat d1/d33/d45/d48/c62 0 2024-04-23T14:49:46.635 INFO:tasks.workunit.client.0.smithi081.stdout:3/435: getdents d4/d7/d49/d51 0 2024-04-23T14:49:46.642 INFO:tasks.workunit.client.0.smithi081.stdout:5/535: mknod d17/d1f/d36/d59/da8/cbf 0 2024-04-23T14:49:46.644 INFO:tasks.workunit.client.0.smithi081.stdout:0/574: fsync d6/d37/f4e 0 2024-04-23T14:49:46.645 INFO:tasks.workunit.client.0.smithi081.stdout:4/486: symlink d1/d4f/la2 0 2024-04-23T14:49:46.648 INFO:tasks.workunit.client.1.smithi156.stdout:9/141: dwrite d1/d2/d4/d19/f26 [0,4194304] 0 2024-04-23T14:49:46.648 INFO:tasks.workunit.client.1.smithi156.stdout:9/142: write d1/d2/f18 [2340303,108130] 0 2024-04-23T14:49:46.650 INFO:tasks.workunit.client.0.smithi081.stdout:6/461: rename d1/c82 to d1/d51/d54/ca5 0 2024-04-23T14:49:46.654 INFO:tasks.workunit.client.0.smithi081.stdout:1/577: unlink d3/d3d/d41/d5e/d17/d25/l3a 0 2024-04-23T14:49:46.658 INFO:tasks.workunit.client.1.smithi156.stdout:5/209: dread d1/d3/fd [0,4194304] 0 2024-04-23T14:49:46.659 INFO:tasks.workunit.client.0.smithi081.stdout:2/566: mknod d1/d11/cc1 0 2024-04-23T14:49:46.672 INFO:tasks.workunit.client.0.smithi081.stdout:5/536: link d17/cb6 d17/d1f/d42/d9b/cc0 0 2024-04-23T14:49:46.680 INFO:tasks.workunit.client.0.smithi081.stdout:4/487: rename d1/d1d/d59/d86 to d1/da3 0 2024-04-23T14:49:46.683 INFO:tasks.workunit.client.0.smithi081.stdout:6/462: mkdir d1/d51/da6 0 2024-04-23T14:49:46.687 INFO:tasks.workunit.client.1.smithi156.stdout:9/143: rmdir d1/d2/d4 39 2024-04-23T14:49:46.688 INFO:tasks.workunit.client.1.smithi156.stdout:9/144: readlink d1/d2/l2b 0 2024-04-23T14:49:46.688 INFO:tasks.workunit.client.0.smithi081.stdout:1/578: unlink d3/l29 0 2024-04-23T14:49:46.689 INFO:tasks.workunit.client.0.smithi081.stdout:1/579: truncate d3/d3d/d41/d4a/f3f 4996380 0 2024-04-23T14:49:46.690 INFO:tasks.workunit.client.1.smithi156.stdout:5/210: link d1/d17/l1b d1/d11/l44 0 2024-04-23T14:49:46.691 INFO:tasks.workunit.client.1.smithi156.stdout:6/178: dwrite d3/fd [0,4194304] 0 2024-04-23T14:49:46.693 INFO:tasks.workunit.client.0.smithi081.stdout:2/567: link d1/c4c d1/cc2 0 2024-04-23T14:49:46.696 INFO:tasks.workunit.client.0.smithi081.stdout:5/537: link d17/d3d/fa1 d17/d1f/d36/d59/fc1 0 2024-04-23T14:49:46.702 INFO:tasks.workunit.client.0.smithi081.stdout:6/463: creat d1/fa7 x:0 0 0 2024-04-23T14:49:46.702 INFO:tasks.workunit.client.0.smithi081.stdout:6/464: chown d1/d2/d8e/f9e 7222 1 2024-04-23T14:49:46.702 INFO:tasks.workunit.client.0.smithi081.stdout:6/465: dread - d1/d51/d65/d13/d46/f9c zero size 2024-04-23T14:49:46.702 INFO:tasks.workunit.client.0.smithi081.stdout:6/466: write d1/d51/d65/d8/d2e/d59/f68 [1332055,17626] 0 2024-04-23T14:49:46.702 INFO:tasks.workunit.client.1.smithi156.stdout:5/211: getdents d1/d3/d24 0 2024-04-23T14:49:46.708 INFO:tasks.workunit.client.1.smithi156.stdout:5/212: dread d1/d11/d18/f32 [0,4194304] 0 2024-04-23T14:49:46.709 INFO:tasks.workunit.client.1.smithi156.stdout:5/213: chown l0 0 1 2024-04-23T14:49:46.709 INFO:tasks.workunit.client.0.smithi081.stdout:1/580: mkdir d3/d3d/d41/d5e/da0/dbb 0 2024-04-23T14:49:46.709 INFO:tasks.workunit.client.0.smithi081.stdout:3/436: dwrite d4/d7/d2e/f46 [0,4194304] 0 2024-04-23T14:49:46.709 INFO:tasks.workunit.client.0.smithi081.stdout:3/437: chown d4/d7/d49/d51/d53/c77 474630 1 2024-04-23T14:49:46.709 INFO:tasks.workunit.client.0.smithi081.stdout:5/538: dread d17/d3d/d41/f6a [0,4194304] 0 2024-04-23T14:49:46.710 INFO:tasks.workunit.client.0.smithi081.stdout:2/568: creat d1/d11/d21/d52/d8b/d8f/fc3 x:0 0 0 2024-04-23T14:49:46.719 INFO:tasks.workunit.client.1.smithi156.stdout:8/156: dwrite d5/d9/d10/f11 [0,4194304] 0 2024-04-23T14:49:46.720 INFO:tasks.workunit.client.0.smithi081.stdout:0/575: dwrite d6/d11/d14/d41/f43 [0,4194304] 0 2024-04-23T14:49:46.720 INFO:tasks.workunit.client.0.smithi081.stdout:0/576: dread - d6/d37/d67/d7d/f90 zero size 2024-04-23T14:49:46.720 INFO:tasks.workunit.client.1.smithi156.stdout:1/185: dwrite db/d15/f23 [0,4194304] 0 2024-04-23T14:49:46.723 INFO:tasks.workunit.client.0.smithi081.stdout:5/539: mknod d17/cc2 0 2024-04-23T14:49:46.730 INFO:tasks.workunit.client.1.smithi156.stdout:5/214: write d1/d3/f1e [346482,17077] 0 2024-04-23T14:49:46.731 INFO:tasks.workunit.client.1.smithi156.stdout:7/146: sync 2024-04-23T14:49:46.735 INFO:tasks.workunit.client.0.smithi081.stdout:2/569: rename d1/d11/d21/d52/d8b/f91 to d1/d11/d21/fc4 0 2024-04-23T14:49:46.735 INFO:tasks.workunit.client.0.smithi081.stdout:0/577: rmdir d6/d11/d14 39 2024-04-23T14:49:46.735 INFO:tasks.workunit.client.0.smithi081.stdout:0/578: fsync d6/d25/f45 0 2024-04-23T14:49:46.735 INFO:tasks.workunit.client.0.smithi081.stdout:0/579: write d6/d11/d14/d41/d5b/d3f/d44/d78/d84/fae [3508805,46569] 0 2024-04-23T14:49:46.736 INFO:tasks.workunit.client.1.smithi156.stdout:8/157: unlink d5/d9/d10/d1d/d21/l23 0 2024-04-23T14:49:46.739 INFO:tasks.workunit.client.1.smithi156.stdout:1/186: dread db/f17 [0,4194304] 0 2024-04-23T14:49:46.741 INFO:tasks.workunit.client.1.smithi156.stdout:7/147: dread dc/f1c [0,4194304] 0 2024-04-23T14:49:46.750 INFO:tasks.workunit.client.1.smithi156.stdout:5/215: symlink d1/l45 0 2024-04-23T14:49:46.752 INFO:tasks.workunit.client.1.smithi156.stdout:1/187: rmdir db/d25/d30/d38 39 2024-04-23T14:49:46.752 INFO:tasks.workunit.client.0.smithi081.stdout:6/467: dread d1/d51/d65/d8/f42 [0,4194304] 0 2024-04-23T14:49:46.752 INFO:tasks.workunit.client.0.smithi081.stdout:0/580: dread d6/ff [0,4194304] 0 2024-04-23T14:49:46.756 INFO:tasks.workunit.client.1.smithi156.stdout:1/188: creat db/d25/f3d x:0 0 0 2024-04-23T14:49:46.758 INFO:tasks.workunit.client.0.smithi081.stdout:0/581: rename d6/d11/c23 to d6/d11/d14/d41/d5b/d3f/d44/d78/cb1 0 2024-04-23T14:49:46.761 INFO:tasks.workunit.client.0.smithi081.stdout:6/468: creat d1/d51/d65/d8/fa8 x:0 0 0 2024-04-23T14:49:46.762 INFO:tasks.workunit.client.1.smithi156.stdout:1/189: unlink db/f18 0 2024-04-23T14:49:46.767 INFO:tasks.workunit.client.0.smithi081.stdout:6/469: mkdir d1/d2/d8e/da9 0 2024-04-23T14:49:46.767 INFO:tasks.workunit.client.0.smithi081.stdout:6/470: creat d1/d51/d65/d8/d2e/d59/faa x:0 0 0 2024-04-23T14:49:46.769 INFO:tasks.workunit.client.1.smithi156.stdout:1/190: symlink db/d15/l3e 0 2024-04-23T14:49:46.769 INFO:tasks.workunit.client.1.smithi156.stdout:0/157: sync 2024-04-23T14:49:46.769 INFO:tasks.workunit.client.1.smithi156.stdout:4/130: sync 2024-04-23T14:49:46.769 INFO:tasks.workunit.client.1.smithi156.stdout:3/139: sync 2024-04-23T14:49:46.770 INFO:tasks.workunit.client.1.smithi156.stdout:4/131: chown d0/df/d21 199 1 2024-04-23T14:49:46.770 INFO:tasks.workunit.client.1.smithi156.stdout:3/140: dread - d4/da/d13/f1a zero size 2024-04-23T14:49:46.770 INFO:tasks.workunit.client.1.smithi156.stdout:3/141: chown d4/db/dd/f1b 299 1 2024-04-23T14:49:46.770 INFO:tasks.workunit.client.1.smithi156.stdout:3/142: getdents d4/da 0 2024-04-23T14:49:46.770 INFO:tasks.workunit.client.0.smithi081.stdout:0/582: mknod d6/d37/cb2 0 2024-04-23T14:49:46.771 INFO:tasks.workunit.client.0.smithi081.stdout:6/471: creat d1/d2/d49/d52/fab x:0 0 0 2024-04-23T14:49:46.771 INFO:tasks.workunit.client.0.smithi081.stdout:6/472: dread - d1/fa7 zero size 2024-04-23T14:49:46.771 INFO:tasks.workunit.client.0.smithi081.stdout:6/473: rename d1 to d1/d2/d8e/da9/dac 22 2024-04-23T14:49:46.771 INFO:tasks.workunit.client.1.smithi156.stdout:1/191: creat db/d1f/f3f x:0 0 0 2024-04-23T14:49:46.772 INFO:tasks.workunit.client.0.smithi081.stdout:0/583: mkdir d6/d11/d14/d24/db3 0 2024-04-23T14:49:46.774 INFO:tasks.workunit.client.0.smithi081.stdout:6/474: symlink d1/d51/d65/d1c/d66/lad 0 2024-04-23T14:49:46.776 INFO:tasks.workunit.client.0.smithi081.stdout:0/584: symlink d6/d37/d4d/d71/lb4 0 2024-04-23T14:49:46.777 INFO:tasks.workunit.client.1.smithi156.stdout:0/158: creat d0/d4/d22/f34 x:0 0 0 2024-04-23T14:49:46.777 INFO:tasks.workunit.client.1.smithi156.stdout:0/159: read - d0/d4/d14/d1b/d2a/f2c zero size 2024-04-23T14:49:46.777 INFO:tasks.workunit.client.1.smithi156.stdout:0/160: creat d0/d4/d14/f35 x:0 0 0 2024-04-23T14:49:46.778 INFO:tasks.workunit.client.0.smithi081.stdout:6/475: symlink d1/d2/d49/lae 0 2024-04-23T14:49:46.778 INFO:tasks.workunit.client.0.smithi081.stdout:0/585: symlink d6/d11/d14/d41/lb5 0 2024-04-23T14:49:46.780 INFO:tasks.workunit.client.0.smithi081.stdout:5/540: read d17/d3c/f3e [1530977,108486] 0 2024-04-23T14:49:46.780 INFO:tasks.workunit.client.0.smithi081.stdout:5/541: fsync f14 0 2024-04-23T14:49:46.781 INFO:tasks.workunit.client.1.smithi156.stdout:0/161: symlink d0/l36 0 2024-04-23T14:49:46.781 INFO:tasks.workunit.client.1.smithi156.stdout:0/162: chown d0/d4/d14/d1b/d2a 177415466 1 2024-04-23T14:49:46.784 INFO:tasks.workunit.client.0.smithi081.stdout:3/438: dwrite d4/dc/d10/d47/f4a [0,4194304] 0 2024-04-23T14:49:46.784 INFO:tasks.workunit.client.0.smithi081.stdout:6/476: rename d1/d51/d65/d13/d46/f9c to d1/d51/d65/d1c/d6e/d7d/faf 0 2024-04-23T14:49:46.787 INFO:tasks.workunit.client.1.smithi156.stdout:4/132: mkdir d0/d8/d2c 0 2024-04-23T14:49:46.788 INFO:tasks.workunit.client.0.smithi081.stdout:0/586: mkdir d6/d11/d14/d41/d5b/d59/db6 0 2024-04-23T14:49:46.789 INFO:tasks.workunit.client.0.smithi081.stdout:5/542: mkdir d17/d37/d4e/dc3 0 2024-04-23T14:49:46.789 INFO:tasks.workunit.client.0.smithi081.stdout:5/543: truncate d17/d18/f48 330643 0 2024-04-23T14:49:46.799 INFO:tasks.workunit.client.0.smithi081.stdout:1/581: dwrite d3/d3d/d41/d5e/d12/d2e/f50 [0,4194304] 0 2024-04-23T14:49:46.799 INFO:tasks.workunit.client.0.smithi081.stdout:1/582: chown d3/d3d/d41/d5e/d17/d25 383 1 2024-04-23T14:49:46.799 INFO:tasks.workunit.client.0.smithi081.stdout:1/583: chown d3 2233 1 2024-04-23T14:49:46.799 INFO:tasks.workunit.client.1.smithi156.stdout:3/143: write d4/f10 [10007230,63942] 0 2024-04-23T14:49:46.803 INFO:tasks.workunit.client.0.smithi081.stdout:0/587: creat d6/d11/d14/d41/d5b/d3f/d44/d78/fb7 x:0 0 0 2024-04-23T14:49:46.804 INFO:tasks.workunit.client.1.smithi156.stdout:4/133: mkdir d0/df/d1b/d2d 0 2024-04-23T14:49:46.805 INFO:tasks.workunit.client.0.smithi081.stdout:6/477: dread d1/d51/d65/d1c/f3b [0,4194304] 0 2024-04-23T14:49:46.805 INFO:tasks.workunit.client.0.smithi081.stdout:6/478: fdatasync d1/d51/d65/f6a 0 2024-04-23T14:49:46.805 INFO:tasks.workunit.client.0.smithi081.stdout:6/479: stat d1/d51/d65/d13/d46/l5e 0 2024-04-23T14:49:46.807 INFO:tasks.workunit.client.0.smithi081.stdout:2/570: dwrite d1/d11/d21/f2a [0,4194304] 0 2024-04-23T14:49:46.809 INFO:tasks.workunit.client.1.smithi156.stdout:4/134: unlink d0/d8/c13 0 2024-04-23T14:49:46.810 INFO:tasks.workunit.client.1.smithi156.stdout:3/144: rename d4/da to d4/db/dd/d1d/d1e 0 2024-04-23T14:49:46.812 INFO:tasks.workunit.client.0.smithi081.stdout:5/544: link d17/d18/f19 d17/d1f/d36/daf/fc4 0 2024-04-23T14:49:46.812 INFO:tasks.workunit.client.0.smithi081.stdout:1/584: creat d3/d3d/d41/d92/fbc x:0 0 0 2024-04-23T14:49:46.812 INFO:tasks.workunit.client.1.smithi156.stdout:5/216: dwrite d1/d3/f5 [8388608,4194304] 0 2024-04-23T14:49:46.815 INFO:tasks.workunit.client.1.smithi156.stdout:5/217: creat d1/d3/d20/d3e/f46 x:0 0 0 2024-04-23T14:49:46.816 INFO:tasks.workunit.client.1.smithi156.stdout:5/218: creat d1/d11/d18/f47 x:0 0 0 2024-04-23T14:49:46.816 INFO:tasks.workunit.client.1.smithi156.stdout:5/219: read d1/d3/f1e [3285693,122737] 0 2024-04-23T14:49:46.819 INFO:tasks.workunit.client.0.smithi081.stdout:2/571: fdatasync d1/d11/dab/fa0 0 2024-04-23T14:49:46.819 INFO:tasks.workunit.client.1.smithi156.stdout:5/220: symlink d1/d3/d24/l48 0 2024-04-23T14:49:46.820 INFO:tasks.workunit.client.0.smithi081.stdout:5/545: symlink d17/d37/d4e/dc3/lc5 0 2024-04-23T14:49:46.820 INFO:tasks.workunit.client.0.smithi081.stdout:1/585: symlink d3/d3d/d41/d5e/d12/d1a/lbd 0 2024-04-23T14:49:46.820 INFO:tasks.workunit.client.0.smithi081.stdout:1/586: fdatasync d3/d3d/d41/d5e/d17/d58/f67 0 2024-04-23T14:49:46.821 INFO:tasks.workunit.client.1.smithi156.stdout:5/221: rename d1/d11/d18/d19/f3b to d1/d3/f49 0 2024-04-23T14:49:46.824 INFO:tasks.workunit.client.1.smithi156.stdout:8/158: dwrite d5/f28 [0,4194304] 0 2024-04-23T14:49:46.827 INFO:tasks.workunit.client.1.smithi156.stdout:5/222: mknod d1/d17/c4a 0 2024-04-23T14:49:46.831 INFO:tasks.workunit.client.0.smithi081.stdout:2/572: mknod d1/d11/d21/d52/cc5 0 2024-04-23T14:49:46.836 INFO:tasks.workunit.client.0.smithi081.stdout:6/480: read d1/d51/d65/d13/d16/f32 [1779954,57964] 0 2024-04-23T14:49:46.837 INFO:tasks.workunit.client.1.smithi156.stdout:8/159: rename d5/d9/d10/d1d/c31 to d5/d19/c3a 0 2024-04-23T14:49:46.837 INFO:tasks.workunit.client.1.smithi156.stdout:5/223: truncate d1/d3/fd 4069115 0 2024-04-23T14:49:46.837 INFO:tasks.workunit.client.0.smithi081.stdout:6/481: dread - d1/d51/d65/d8/fa8 zero size 2024-04-23T14:49:46.837 INFO:tasks.workunit.client.0.smithi081.stdout:6/482: fsync d1/d51/d65/d8/f41 0 2024-04-23T14:49:46.838 INFO:tasks.workunit.client.0.smithi081.stdout:6/483: write d1/d51/d65/d8/d2e/d59/f94 [1000484,20587] 0 2024-04-23T14:49:46.838 INFO:tasks.workunit.client.0.smithi081.stdout:6/484: chown d1/d51/d65/d13/d16 4858310 1 2024-04-23T14:49:46.838 INFO:tasks.workunit.client.0.smithi081.stdout:1/587: symlink d3/d3d/d41/d5e/d17/d58/d7f/lbe 0 2024-04-23T14:49:46.838 INFO:tasks.workunit.client.0.smithi081.stdout:1/588: fdatasync d3/d3d/d41/d5e/d5d/db0/fa3 0 2024-04-23T14:49:46.839 INFO:tasks.workunit.client.1.smithi156.stdout:4/135: dread d0/f3 [0,4194304] 0 2024-04-23T14:49:46.840 INFO:tasks.workunit.client.0.smithi081.stdout:2/573: creat d1/d33/d95/fc6 x:0 0 0 2024-04-23T14:49:46.840 INFO:tasks.workunit.client.1.smithi156.stdout:1/192: dwrite db/d15/f22 [0,4194304] 0 2024-04-23T14:49:46.841 INFO:tasks.workunit.client.1.smithi156.stdout:1/193: write db/d25/f3d [631575,124042] 0 2024-04-23T14:49:46.841 INFO:tasks.workunit.client.1.smithi156.stdout:1/194: truncate db/d1f/d2d/f36 342727 0 2024-04-23T14:49:46.842 INFO:tasks.workunit.client.1.smithi156.stdout:5/224: rename d1/d11/d18/f41 to d1/d3/f4b 0 2024-04-23T14:49:46.846 INFO:tasks.workunit.client.1.smithi156.stdout:8/160: mknod d5/d9/d36/c3b 0 2024-04-23T14:49:46.846 INFO:tasks.workunit.client.1.smithi156.stdout:8/161: fsync d5/d9/d10/f11 0 2024-04-23T14:49:46.848 INFO:tasks.workunit.client.0.smithi081.stdout:6/485: symlink d1/d2/d8e/d98/lb0 0 2024-04-23T14:49:46.849 INFO:tasks.workunit.client.1.smithi156.stdout:4/136: creat d0/d8/d2c/f2e x:0 0 0 2024-04-23T14:49:46.849 INFO:tasks.workunit.client.1.smithi156.stdout:4/137: dread - d0/d8/d1e/f22 zero size 2024-04-23T14:49:46.850 INFO:tasks.workunit.client.0.smithi081.stdout:1/589: creat d3/d3d/d41/d5e/d12/fbf x:0 0 0 2024-04-23T14:49:46.851 INFO:tasks.workunit.client.1.smithi156.stdout:0/163: dwrite d0/d4/f3 [4194304,4194304] 0 2024-04-23T14:49:46.851 INFO:tasks.workunit.client.1.smithi156.stdout:7/148: dwrite dc/f11 [0,4194304] 0 2024-04-23T14:49:46.852 INFO:tasks.workunit.client.1.smithi156.stdout:7/149: write dc/d1d/f23 [81436,35785] 0 2024-04-23T14:49:46.852 INFO:tasks.workunit.client.0.smithi081.stdout:6/486: mkdir d1/d51/d65/d8/db1 0 2024-04-23T14:49:46.856 INFO:tasks.workunit.client.0.smithi081.stdout:1/590: mknod d3/d3d/d41/d5e/d5d/db0/cc0 0 2024-04-23T14:49:46.856 INFO:tasks.workunit.client.0.smithi081.stdout:1/591: write d3/d3d/d41/d5e/d17/d58/f67 [69422,53690] 0 2024-04-23T14:49:46.856 INFO:tasks.workunit.client.0.smithi081.stdout:1/592: write d3/d3d/d41/d5e/d12/f40 [2744312,46355] 0 2024-04-23T14:49:46.860 INFO:tasks.workunit.client.1.smithi156.stdout:8/162: dread d5/d9/d10/f33 [0,4194304] 0 2024-04-23T14:49:46.864 INFO:tasks.workunit.client.0.smithi081.stdout:0/588: dwrite d6/d11/d14/d41/d5b/fa4 [0,4194304] 0 2024-04-23T14:49:46.871 INFO:tasks.workunit.client.1.smithi156.stdout:3/145: rmdir d4 39 2024-04-23T14:49:46.874 INFO:tasks.workunit.client.0.smithi081.stdout:5/546: getdents d17/d37/d4e/dc3 0 2024-04-23T14:49:46.874 INFO:tasks.workunit.client.0.smithi081.stdout:5/547: chown d17/l5a 22493 1 2024-04-23T14:49:46.874 INFO:tasks.workunit.client.0.smithi081.stdout:3/439: dwrite d4/dc/d10/d5a/f7c [0,4194304] 0 2024-04-23T14:49:46.875 INFO:tasks.workunit.client.0.smithi081.stdout:5/548: creat d17/d1f/d36/fc6 x:0 0 0 2024-04-23T14:49:46.881 INFO:tasks.workunit.client.0.smithi081.stdout:0/589: mkdir d6/d11/d14/db8 0 2024-04-23T14:49:46.887 INFO:tasks.workunit.client.1.smithi156.stdout:7/150: mkdir dc/d1d/d24 0 2024-04-23T14:49:46.894 INFO:tasks.workunit.client.1.smithi156.stdout:1/195: rmdir db/d1f/d28 39 2024-04-23T14:49:46.895 INFO:tasks.workunit.client.0.smithi081.stdout:2/574: dread d1/d1e/f30 [0,4194304] 0 2024-04-23T14:49:46.896 INFO:tasks.workunit.client.1.smithi156.stdout:0/164: getdents d0/d4/d22 0 2024-04-23T14:49:46.897 INFO:tasks.workunit.client.1.smithi156.stdout:4/138: dread d0/d8/f18 [0,4194304] 0 2024-04-23T14:49:46.897 INFO:tasks.workunit.client.1.smithi156.stdout:4/139: write d0/d8/d2c/f2e [433222,16038] 0 2024-04-23T14:49:46.901 INFO:tasks.workunit.client.1.smithi156.stdout:3/146: creat d4/db/dd/d1d/d1e/d13/f1f x:0 0 0 2024-04-23T14:49:46.905 INFO:tasks.workunit.client.1.smithi156.stdout:7/151: mknod dc/d1d/d24/c25 0 2024-04-23T14:49:46.906 INFO:tasks.workunit.client.0.smithi081.stdout:3/440: getdents d4 0 2024-04-23T14:49:46.906 INFO:tasks.workunit.client.1.smithi156.stdout:1/196: mkdir db/d25/d30/d38/d40 0 2024-04-23T14:49:46.906 INFO:tasks.workunit.client.1.smithi156.stdout:1/197: readlink db/d1f/l35 0 2024-04-23T14:49:46.909 INFO:tasks.workunit.client.0.smithi081.stdout:6/487: dwrite d1/d51/d65/d8/d2e/f2f [0,4194304] 0 2024-04-23T14:49:46.909 INFO:tasks.workunit.client.0.smithi081.stdout:0/590: rename d6/d11/d14/f26 to d6/d11/d14/d41/d5b/d59/fb9 0 2024-04-23T14:49:46.909 INFO:tasks.workunit.client.0.smithi081.stdout:6/488: dread - d1/d2/d49/d52/fab zero size 2024-04-23T14:49:46.910 INFO:tasks.workunit.client.1.smithi156.stdout:0/165: mknod d0/d4/d14/d1b/d1e/c37 0 2024-04-23T14:49:46.912 INFO:tasks.workunit.client.0.smithi081.stdout:2/575: creat d1/d11/d21/fc7 x:0 0 0 2024-04-23T14:49:46.915 INFO:tasks.workunit.client.1.smithi156.stdout:5/225: dread d1/d3/fd [0,4194304] 0 2024-04-23T14:49:46.915 INFO:tasks.workunit.client.1.smithi156.stdout:5/226: creat d1/d3/d20/f4c x:0 0 0 2024-04-23T14:49:46.915 INFO:tasks.workunit.client.1.smithi156.stdout:5/227: creat d1/d11/f4d x:0 0 0 2024-04-23T14:49:46.915 INFO:tasks.workunit.client.1.smithi156.stdout:5/228: readlink d1/d3/d20/l35 0 2024-04-23T14:49:46.918 INFO:tasks.workunit.client.1.smithi156.stdout:4/140: creat d0/d8/f2f x:0 0 0 2024-04-23T14:49:46.927 INFO:tasks.workunit.client.0.smithi081.stdout:1/593: dwrite d3/f51 [0,4194304] 0 2024-04-23T14:49:46.931 INFO:tasks.workunit.client.1.smithi156.stdout:7/152: write f8 [500000,93727] 0 2024-04-23T14:49:46.936 INFO:tasks.workunit.client.1.smithi156.stdout:5/229: mkdir d1/d3/d43/d4e 0 2024-04-23T14:49:46.937 INFO:tasks.workunit.client.1.smithi156.stdout:8/163: dwrite d5/f1c [0,4194304] 0 2024-04-23T14:49:46.937 INFO:tasks.workunit.client.1.smithi156.stdout:6/179: sync 2024-04-23T14:49:46.937 INFO:tasks.workunit.client.1.smithi156.stdout:9/145: sync 2024-04-23T14:49:46.937 INFO:tasks.workunit.client.1.smithi156.stdout:3/147: mkdir d4/db/dd/d20 0 2024-04-23T14:49:46.937 INFO:tasks.workunit.client.1.smithi156.stdout:6/180: chown d3/da/d1d 30 1 2024-04-23T14:49:46.937 INFO:tasks.workunit.client.1.smithi156.stdout:2/173: sync 2024-04-23T14:49:46.940 INFO:tasks.workunit.client.0.smithi081.stdout:6/489: unlink d1/d51/d65/d8/l24 0 2024-04-23T14:49:46.941 INFO:tasks.workunit.client.0.smithi081.stdout:8/738: sync 2024-04-23T14:49:46.941 INFO:tasks.workunit.client.0.smithi081.stdout:2/576: unlink d1/d11/d21/d52/f7b 0 2024-04-23T14:49:46.942 INFO:tasks.workunit.client.1.smithi156.stdout:4/141: mkdir d0/d30 0 2024-04-23T14:49:46.942 INFO:tasks.workunit.client.1.smithi156.stdout:4/142: chown d0/d8/d2c/f2e 3354431 1 2024-04-23T14:49:46.943 INFO:tasks.workunit.client.0.smithi081.stdout:0/591: rename d6/d11/d14/d24/d6b/fad to d6/d25/fba 0 2024-04-23T14:49:46.944 INFO:tasks.workunit.client.0.smithi081.stdout:0/592: fsync d6/d37/d4d/f55 0 2024-04-23T14:49:46.944 INFO:tasks.workunit.client.0.smithi081.stdout:0/593: write f5 [3415734,72674] 0 2024-04-23T14:49:46.947 INFO:tasks.workunit.client.0.smithi081.stdout:1/594: write d3/d3d/d41/d5e/d17/d25/f4d [1029036,29477] 0 2024-04-23T14:49:46.949 INFO:tasks.workunit.client.1.smithi156.stdout:6/181: creat d3/d16/d46/d2b/f49 x:0 0 0 2024-04-23T14:49:46.949 INFO:tasks.workunit.client.1.smithi156.stdout:6/182: dread - d3/d16/f2f zero size 2024-04-23T14:49:46.950 INFO:tasks.workunit.client.1.smithi156.stdout:3/148: rename d4/db/lc to d4/db/dd/d1d/d1e/d13/l21 0 2024-04-23T14:49:46.950 INFO:tasks.workunit.client.1.smithi156.stdout:3/149: chown d4/db/dd/d20 23725 1 2024-04-23T14:49:46.952 INFO:tasks.workunit.client.0.smithi081.stdout:2/577: rename d1/d33/f79 to d1/d33/da3/fc8 0 2024-04-23T14:49:46.952 INFO:tasks.workunit.client.0.smithi081.stdout:2/578: creat d1/d33/d95/fc9 x:0 0 0 2024-04-23T14:49:46.953 INFO:tasks.workunit.client.1.smithi156.stdout:6/183: truncate d3/da/d1d/d27/f31 399661 0 2024-04-23T14:49:46.955 INFO:tasks.workunit.client.1.smithi156.stdout:3/150: truncate d4/db/dd/d1d/d1e/ff 248460 0 2024-04-23T14:49:46.957 INFO:tasks.workunit.client.1.smithi156.stdout:6/184: link d3/d16/c41 d3/d16/c4a 0 2024-04-23T14:49:46.958 INFO:tasks.workunit.client.1.smithi156.stdout:3/151: mknod d4/db/dd/d20/c22 0 2024-04-23T14:49:46.960 INFO:tasks.workunit.client.1.smithi156.stdout:6/185: rename d3/da/fe to d3/d16/d46/f4b 0 2024-04-23T14:49:46.961 INFO:tasks.workunit.client.0.smithi081.stdout:1/595: symlink d3/d3d/d41/d5e/d12/d2e/lc1 0 2024-04-23T14:49:46.963 INFO:tasks.workunit.client.1.smithi156.stdout:4/143: dread d0/d8/fc [0,4194304] 0 2024-04-23T14:49:46.963 INFO:tasks.workunit.client.1.smithi156.stdout:4/144: read - d0/d8/f2f zero size 2024-04-23T14:49:46.963 INFO:tasks.workunit.client.1.smithi156.stdout:6/186: mknod d3/da/d1d/d27/c4c 0 2024-04-23T14:49:46.965 INFO:tasks.workunit.client.1.smithi156.stdout:4/145: symlink d0/l31 0 2024-04-23T14:49:46.969 INFO:tasks.workunit.client.1.smithi156.stdout:6/187: creat d3/d16/d46/d2b/d3b/f4d x:0 0 0 2024-04-23T14:49:46.969 INFO:tasks.workunit.client.1.smithi156.stdout:6/188: write d3/d16/d46/f1b [4623566,61615] 0 2024-04-23T14:49:46.973 INFO:tasks.workunit.client.1.smithi156.stdout:4/146: rmdir d0/df/d1b 39 2024-04-23T14:49:46.975 INFO:tasks.workunit.client.1.smithi156.stdout:6/189: getdents d3/d16/d1e 0 2024-04-23T14:49:46.976 INFO:tasks.workunit.client.1.smithi156.stdout:4/147: symlink d0/d8/d2c/l32 0 2024-04-23T14:49:46.976 INFO:tasks.workunit.client.1.smithi156.stdout:6/190: write d3/d16/f23 [838508,105688] 0 2024-04-23T14:49:46.978 INFO:tasks.workunit.client.0.smithi081.stdout:1/596: symlink d3/d3d/d41/d5e/d17/lc2 0 2024-04-23T14:49:46.978 INFO:tasks.workunit.client.0.smithi081.stdout:1/597: dread - d3/d3d/d6f/f9a zero size 2024-04-23T14:49:46.979 INFO:tasks.workunit.client.1.smithi156.stdout:8/164: dread d5/d9/f13 [0,4194304] 0 2024-04-23T14:49:46.980 INFO:tasks.workunit.client.0.smithi081.stdout:4/488: sync 2024-04-23T14:49:46.980 INFO:tasks.workunit.client.0.smithi081.stdout:4/489: chown d1/d4/d6f/d70/f7e 63567 1 2024-04-23T14:49:46.980 INFO:tasks.workunit.client.0.smithi081.stdout:4/490: truncate d1/d1d/d39/f3c 1740526 0 2024-04-23T14:49:46.983 INFO:tasks.workunit.client.1.smithi156.stdout:6/191: truncate d3/d16/d46/f4b 1511725 0 2024-04-23T14:49:46.983 INFO:tasks.workunit.client.1.smithi156.stdout:6/192: stat d3/cf 0 2024-04-23T14:49:46.985 INFO:tasks.workunit.client.0.smithi081.stdout:9/542: sync 2024-04-23T14:49:46.986 INFO:tasks.workunit.client.0.smithi081.stdout:7/403: sync 2024-04-23T14:49:46.987 INFO:tasks.workunit.client.1.smithi156.stdout:8/165: symlink d5/d9/d10/l3c 0 2024-04-23T14:49:46.987 INFO:tasks.workunit.client.1.smithi156.stdout:8/166: fdatasync d5/d9/d10/d1d/d21/f37 0 2024-04-23T14:49:46.987 INFO:tasks.workunit.client.1.smithi156.stdout:8/167: chown d5/d19/d29/l2d 2555411 1 2024-04-23T14:49:46.990 INFO:tasks.workunit.client.0.smithi081.stdout:1/598: rename d3/d3d/d41/d4a/c81 to d3/d3d/d41/d92/cc3 0 2024-04-23T14:49:46.990 INFO:tasks.workunit.client.0.smithi081.stdout:4/491: creat d1/da3/fa4 x:0 0 0 2024-04-23T14:49:46.990 INFO:tasks.workunit.client.0.smithi081.stdout:4/492: fsync d1/f8a 0 2024-04-23T14:49:46.991 INFO:tasks.workunit.client.0.smithi081.stdout:3/441: dwrite d4/d7/d32/f88 [0,4194304] 0 2024-04-23T14:49:46.993 INFO:tasks.workunit.client.1.smithi156.stdout:8/168: unlink d5/d9/d10/l17 0 2024-04-23T14:49:46.998 INFO:tasks.workunit.client.0.smithi081.stdout:9/543: link d3/d5/f6 d3/de/d22/fac 0 2024-04-23T14:49:46.999 INFO:tasks.workunit.client.0.smithi081.stdout:9/544: creat d3/de/d76/fad x:0 0 0 2024-04-23T14:49:46.999 INFO:tasks.workunit.client.1.smithi156.stdout:6/193: write d3/da/d1d/f21 [418114,660] 0 2024-04-23T14:49:46.999 INFO:tasks.workunit.client.1.smithi156.stdout:8/169: truncate d5/d9/d10/f34 328012 0 2024-04-23T14:49:47.001 INFO:tasks.workunit.client.0.smithi081.stdout:7/404: rename d3/d21/d31/d33/d52/f81 to d3/d21/d31/d33/d4b/d6e/f87 0 2024-04-23T14:49:47.001 INFO:tasks.workunit.client.0.smithi081.stdout:7/405: write d3/d21/d31/d33/d4b/d71/f84 [869123,57481] 0 2024-04-23T14:49:47.001 INFO:tasks.workunit.client.0.smithi081.stdout:7/406: write d3/d20/f3f [971966,64780] 0 2024-04-23T14:49:47.003 INFO:tasks.workunit.client.1.smithi156.stdout:6/194: creat d3/f4e x:0 0 0 2024-04-23T14:49:47.004 INFO:tasks.workunit.client.1.smithi156.stdout:6/195: read d3/da/d1d/f21 [1051638,14128] 0 2024-04-23T14:49:47.004 INFO:tasks.workunit.client.1.smithi156.stdout:6/196: chown d3/f34 5335244 1 2024-04-23T14:49:47.004 INFO:tasks.workunit.client.0.smithi081.stdout:3/442: symlink d4/dc/l90 0 2024-04-23T14:49:47.007 INFO:tasks.workunit.client.0.smithi081.stdout:9/545: rename d3/de/d1d/d5b/f5c to d3/de/d1d/d5b/fae 0 2024-04-23T14:49:47.007 INFO:tasks.workunit.client.0.smithi081.stdout:9/546: write d3/d1a/d6c/f58 [1646131,68712] 0 2024-04-23T14:49:47.008 INFO:tasks.workunit.client.0.smithi081.stdout:9/547: write d3/d1a/f52 [668959,91265] 0 2024-04-23T14:49:47.010 INFO:tasks.workunit.client.1.smithi156.stdout:0/166: dread d0/d4/d14/d1b/d2a/f29 [0,4194304] 0 2024-04-23T14:49:47.010 INFO:tasks.workunit.client.1.smithi156.stdout:0/167: fsync d0/f7 0 2024-04-23T14:49:47.011 INFO:tasks.workunit.client.0.smithi081.stdout:4/493: rename d1/d4/d11/c1a to d1/d4f/d87/ca5 0 2024-04-23T14:49:47.013 INFO:tasks.workunit.client.0.smithi081.stdout:7/407: truncate d3/d11/d2c/f32 1931404 0 2024-04-23T14:49:47.015 INFO:tasks.workunit.client.0.smithi081.stdout:4/494: symlink d1/d4/la6 0 2024-04-23T14:49:47.015 INFO:tasks.workunit.client.0.smithi081.stdout:4/495: readlink d1/d1d/d59/l7d 0 2024-04-23T14:49:47.017 INFO:tasks.workunit.client.1.smithi156.stdout:6/197: creat d3/da/f4f x:0 0 0 2024-04-23T14:49:47.018 INFO:tasks.workunit.client.1.smithi156.stdout:6/198: fsync d3/d16/f39 0 2024-04-23T14:49:47.018 INFO:tasks.workunit.client.1.smithi156.stdout:6/199: write d3/da/f38 [585431,114270] 0 2024-04-23T14:49:47.021 INFO:tasks.workunit.client.0.smithi081.stdout:6/490: dwrite d1/d51/d65/f86 [0,4194304] 0 2024-04-23T14:49:47.022 INFO:tasks.workunit.client.0.smithi081.stdout:9/548: rmdir d3/de/d1d/d73 39 2024-04-23T14:49:47.022 INFO:tasks.workunit.client.0.smithi081.stdout:9/549: write d3/fa7 [455123,101915] 0 2024-04-23T14:49:47.022 INFO:tasks.workunit.client.0.smithi081.stdout:9/550: read d3/f8 [3004987,63992] 0 2024-04-23T14:49:47.022 INFO:tasks.workunit.client.0.smithi081.stdout:9/551: fsync d3/de/d1d/d5b/f7f 0 2024-04-23T14:49:47.023 INFO:tasks.workunit.client.1.smithi156.stdout:6/200: mknod d3/c50 0 2024-04-23T14:49:47.023 INFO:tasks.workunit.client.1.smithi156.stdout:6/201: write d3/d16/f2f [452932,117836] 0 2024-04-23T14:49:47.025 INFO:tasks.workunit.client.0.smithi081.stdout:2/579: dwrite d1/d33/f71 [0,4194304] 0 2024-04-23T14:49:47.030 INFO:tasks.workunit.client.0.smithi081.stdout:6/491: symlink d1/d51/d7b/d91/lb2 0 2024-04-23T14:49:47.030 INFO:tasks.workunit.client.0.smithi081.stdout:6/492: fsync d1/d2/f8f 0 2024-04-23T14:49:47.035 INFO:tasks.workunit.client.0.smithi081.stdout:6/493: mkdir d1/d51/d65/d8/d2e/d59/db3 0 2024-04-23T14:49:47.038 INFO:tasks.workunit.client.1.smithi156.stdout:7/153: dwrite dc/d1d/f23 [0,4194304] 0 2024-04-23T14:49:47.039 INFO:tasks.workunit.client.1.smithi156.stdout:7/154: fdatasync dc/f17 0 2024-04-23T14:49:47.041 INFO:tasks.workunit.client.0.smithi081.stdout:3/443: dread d4/d7/df/d30/f4c [0,4194304] 0 2024-04-23T14:49:47.041 INFO:tasks.workunit.client.0.smithi081.stdout:2/580: symlink d1/d33/lca 0 2024-04-23T14:49:47.041 INFO:tasks.workunit.client.0.smithi081.stdout:2/581: write d1/d11/d21/d52/d8b/fa8 [570589,87246] 0 2024-04-23T14:49:47.046 INFO:tasks.workunit.client.1.smithi156.stdout:2/174: dread d4/f15 [0,4194304] 0 2024-04-23T14:49:47.050 INFO:tasks.workunit.client.0.smithi081.stdout:6/494: rename d1/d51/d65/d1c/d66/f96 to d1/d2/d8e/d98/fb4 0 2024-04-23T14:49:47.050 INFO:tasks.workunit.client.0.smithi081.stdout:6/495: chown d1/d51/d65/d13/d46/c74 3064 1 2024-04-23T14:49:47.050 INFO:tasks.workunit.client.0.smithi081.stdout:6/496: dread - d1/d51/d54/f8c zero size 2024-04-23T14:49:47.052 INFO:tasks.workunit.client.0.smithi081.stdout:9/552: write d3/d5/fa8 [7201038,62247] 0 2024-04-23T14:49:47.055 INFO:tasks.workunit.client.0.smithi081.stdout:2/582: creat d1/d11/d21/d52/d8b/d8f/d93/fcb x:0 0 0 2024-04-23T14:49:47.055 INFO:tasks.workunit.client.1.smithi156.stdout:5/230: dwrite d1/d11/d18/f32 [0,4194304] 0 2024-04-23T14:49:47.056 INFO:tasks.workunit.client.1.smithi156.stdout:5/231: creat d1/d3/f4f x:0 0 0 2024-04-23T14:49:47.056 INFO:tasks.workunit.client.1.smithi156.stdout:1/198: dwrite db/d25/f3b [0,4194304] 0 2024-04-23T14:49:47.056 INFO:tasks.workunit.client.1.smithi156.stdout:1/199: fsync db/d25/f3b 0 2024-04-23T14:49:47.056 INFO:tasks.workunit.client.1.smithi156.stdout:1/200: creat db/d1f/f41 x:0 0 0 2024-04-23T14:49:47.058 INFO:tasks.workunit.client.1.smithi156.stdout:7/155: mkdir dc/d1d/d26 0 2024-04-23T14:49:47.063 INFO:tasks.workunit.client.1.smithi156.stdout:2/175: creat d4/d21/d42/f43 x:0 0 0 2024-04-23T14:49:47.064 INFO:tasks.workunit.client.0.smithi081.stdout:6/497: creat d1/d51/d65/d1c/d6e/da0/da1/fb5 x:0 0 0 2024-04-23T14:49:47.069 INFO:tasks.workunit.client.0.smithi081.stdout:2/583: creat d1/d33/fcc x:0 0 0 2024-04-23T14:49:47.073 INFO:tasks.workunit.client.0.smithi081.stdout:3/444: rename d4/d7/d49/d51/d53 to d4/d7/d7f/d91 0 2024-04-23T14:49:47.075 INFO:tasks.workunit.client.0.smithi081.stdout:2/584: getdents d1/d11/d21/d52/d8b 0 2024-04-23T14:49:47.078 INFO:tasks.workunit.client.0.smithi081.stdout:3/445: creat d4/d7/df/f92 x:0 0 0 2024-04-23T14:49:47.079 INFO:tasks.workunit.client.1.smithi156.stdout:7/156: dread dc/f19 [0,4194304] 0 2024-04-23T14:49:47.089 INFO:tasks.workunit.client.0.smithi081.stdout:6/498: rename d1/d51/d65/d8/c4b to d1/d51/d65/d8/da4/cb6 0 2024-04-23T14:49:47.089 INFO:tasks.workunit.client.0.smithi081.stdout:6/499: chown d1/d51/d65/f4f 431216472 1 2024-04-23T14:49:47.089 INFO:tasks.workunit.client.1.smithi156.stdout:1/201: mknod db/d1f/d34/c42 0 2024-04-23T14:49:47.089 INFO:tasks.workunit.client.1.smithi156.stdout:1/202: chown db/d25/d30/d38/d3a 94842010 1 2024-04-23T14:49:47.091 INFO:tasks.workunit.client.0.smithi081.stdout:1/599: dwrite d3/d3d/d41/d5e/d12/f54 [0,4194304] 0 2024-04-23T14:49:47.091 INFO:tasks.workunit.client.0.smithi081.stdout:1/600: fsync d3/d3d/d41/d5e/d12/d1a/fb4 0 2024-04-23T14:49:47.091 INFO:tasks.workunit.client.0.smithi081.stdout:3/446: unlink d4/d7/d7f/d91/d6c/c75 0 2024-04-23T14:49:47.098 INFO:tasks.workunit.client.1.smithi156.stdout:9/146: dwrite d1/d2/d4/d17/f2c [0,4194304] 0 2024-04-23T14:49:47.098 INFO:tasks.workunit.client.0.smithi081.stdout:2/585: symlink d1/d33/d45/d6e/d96/lcd 0 2024-04-23T14:49:47.100 INFO:tasks.workunit.client.1.smithi156.stdout:2/176: creat d4/d26/f44 x:0 0 0 2024-04-23T14:49:47.101 INFO:tasks.workunit.client.1.smithi156.stdout:0/168: dwrite d0/d4/f3 [0,4194304] 0 2024-04-23T14:49:47.106 INFO:tasks.workunit.client.1.smithi156.stdout:1/203: write db/f17 [3664857,1877] 0 2024-04-23T14:49:47.106 INFO:tasks.workunit.client.1.smithi156.stdout:1/204: fdatasync db/d1f/d28/f37 0 2024-04-23T14:49:47.106 INFO:tasks.workunit.client.1.smithi156.stdout:1/205: readlink db/d1f/d28/l2b 0 2024-04-23T14:49:47.106 INFO:tasks.workunit.client.1.smithi156.stdout:1/206: getdents db/d25/d30/d38/d3a 0 2024-04-23T14:49:47.107 INFO:tasks.workunit.client.0.smithi081.stdout:1/601: rename d3/d3d/d6f/l49 to d3/d3d/d41/d5e/d12/d2e/lc4 0 2024-04-23T14:49:47.108 INFO:tasks.workunit.client.1.smithi156.stdout:4/148: dwrite d0/f3 [0,4194304] 0 2024-04-23T14:49:47.108 INFO:tasks.workunit.client.1.smithi156.stdout:4/149: write d0/d8/f18 [2869530,54681] 0 2024-04-23T14:49:47.112 INFO:tasks.workunit.client.1.smithi156.stdout:6/202: dwrite d3/fd [0,4194304] 0 2024-04-23T14:49:47.116 INFO:tasks.workunit.client.0.smithi081.stdout:2/586: readlink d1/d11/dab/l8c 0 2024-04-23T14:49:47.119 INFO:tasks.workunit.client.1.smithi156.stdout:3/152: dwrite d4/db/dd/d1d/d1e/f12 [0,4194304] 0 2024-04-23T14:49:47.119 INFO:tasks.workunit.client.1.smithi156.stdout:3/153: write d4/db/dd/f1b [70842,27762] 0 2024-04-23T14:49:47.122 INFO:tasks.workunit.client.0.smithi081.stdout:4/496: dwrite d1/f44 [0,4194304] 0 2024-04-23T14:49:47.127 INFO:tasks.workunit.client.1.smithi156.stdout:5/232: dwrite d1/d17/f1a [0,4194304] 0 2024-04-23T14:49:47.127 INFO:tasks.workunit.client.1.smithi156.stdout:5/233: creat d1/d11/f50 x:0 0 0 2024-04-23T14:49:47.127 INFO:tasks.workunit.client.1.smithi156.stdout:5/234: creat d1/d11/f51 x:0 0 0 2024-04-23T14:49:47.130 INFO:tasks.workunit.client.0.smithi081.stdout:2/587: chown d1/d33/l58 156823 1 2024-04-23T14:49:47.131 INFO:tasks.workunit.client.0.smithi081.stdout:2/588: write d1/d33/d45/d6e/d97/fb4 [703742,113591] 0 2024-04-23T14:49:47.139 INFO:tasks.workunit.client.0.smithi081.stdout:1/602: write d3/d3d/d41/d5e/d5d/db0/f83 [1569679,109846] 0 2024-04-23T14:49:47.140 INFO:tasks.workunit.client.0.smithi081.stdout:4/497: rename d1/d1d/d39/c72 to d1/d1d/d39/ca7 0 2024-04-23T14:49:47.140 INFO:tasks.workunit.client.0.smithi081.stdout:4/498: creat d1/d4/d11/d75/fa8 x:0 0 0 2024-04-23T14:49:47.144 INFO:tasks.workunit.client.0.smithi081.stdout:7/408: dwrite d3/d11/d2c/d75/f51 [0,4194304] 0 2024-04-23T14:49:47.145 INFO:tasks.workunit.client.0.smithi081.stdout:6/500: dwrite d1/d51/d65/d13/d16/f1e [0,4194304] 0 2024-04-23T14:49:47.145 INFO:tasks.workunit.client.0.smithi081.stdout:6/501: dread - d1/d51/d65/d1c/d6e/f79 zero size 2024-04-23T14:49:47.145 INFO:tasks.workunit.client.1.smithi156.stdout:5/235: dread d1/d3/f25 [0,4194304] 0 2024-04-23T14:49:47.145 INFO:tasks.workunit.client.1.smithi156.stdout:7/157: creat dc/d1d/d24/f27 x:0 0 0 2024-04-23T14:49:47.149 INFO:tasks.workunit.client.1.smithi156.stdout:0/169: dwrite d0/d4/fe [4194304,4194304] 0 2024-04-23T14:49:47.150 INFO:tasks.workunit.client.1.smithi156.stdout:0/170: getdents d0/d4/d22 0 2024-04-23T14:49:47.150 INFO:tasks.workunit.client.1.smithi156.stdout:0/171: stat d0/d4/f20 0 2024-04-23T14:49:47.150 INFO:tasks.workunit.client.1.smithi156.stdout:0/172: readlink d0/d4/d14/d1b/d2a/lc 0 2024-04-23T14:49:47.150 INFO:tasks.workunit.client.0.smithi081.stdout:3/447: dwrite d4/d7/d32/d6a/f7e [0,4194304] 0 2024-04-23T14:49:47.151 INFO:tasks.workunit.client.1.smithi156.stdout:9/147: mkdir d1/d2/d28/d35 0 2024-04-23T14:49:47.153 INFO:tasks.workunit.client.0.smithi081.stdout:2/589: rename d1/fe to d1/d11/d21/d34/fce 0 2024-04-23T14:49:47.153 INFO:tasks.workunit.client.0.smithi081.stdout:2/590: fdatasync d1/f6 0 2024-04-23T14:49:47.153 INFO:tasks.workunit.client.1.smithi156.stdout:2/177: truncate d4/f29 600463 0 2024-04-23T14:49:47.155 INFO:tasks.workunit.client.1.smithi156.stdout:1/207: creat db/d25/d30/f43 x:0 0 0 2024-04-23T14:49:47.156 INFO:tasks.workunit.client.0.smithi081.stdout:1/603: link d3/d3d/d41/d5e/d12/d1a/f48 d3/d3d/d41/d5e/d12/d2e/fc5 0 2024-04-23T14:49:47.159 INFO:tasks.workunit.client.1.smithi156.stdout:4/150: creat d0/df/d21/f33 x:0 0 0 2024-04-23T14:49:47.161 INFO:tasks.workunit.client.0.smithi081.stdout:4/499: mkdir d1/d3/d89/da9 0 2024-04-23T14:49:47.161 INFO:tasks.workunit.client.0.smithi081.stdout:4/500: read d1/d4/f38 [865600,2784] 0 2024-04-23T14:49:47.161 INFO:tasks.workunit.client.0.smithi081.stdout:4/501: write d1/d3/f36 [45579,6318] 0 2024-04-23T14:49:47.162 INFO:tasks.workunit.client.1.smithi156.stdout:6/203: creat d3/da/d1d/d27/f51 x:0 0 0 2024-04-23T14:49:47.164 INFO:tasks.workunit.client.0.smithi081.stdout:7/409: creat d3/d11/d56/d7f/f88 x:0 0 0 2024-04-23T14:49:47.166 INFO:tasks.workunit.client.1.smithi156.stdout:9/148: dread d1/d2/d4/d19/d2a/d30/f34 [0,4194304] 0 2024-04-23T14:49:47.168 INFO:tasks.workunit.client.1.smithi156.stdout:4/151: dread d0/d8/d2c/f2e [0,4194304] 0 2024-04-23T14:49:47.168 INFO:tasks.workunit.client.1.smithi156.stdout:4/152: chown d0/df/d21/c26 1532563537 1 2024-04-23T14:49:47.169 INFO:tasks.workunit.client.0.smithi081.stdout:3/448: write d4/d7/d2e/f46 [53130,67796] 0 2024-04-23T14:49:47.169 INFO:tasks.workunit.client.0.smithi081.stdout:6/502: creat d1/d2/d49/fb7 x:0 0 0 2024-04-23T14:49:47.169 INFO:tasks.workunit.client.0.smithi081.stdout:1/604: dread d3/d3d/d41/d5e/d5d/db0/f75 [4194304,4194304] 0 2024-04-23T14:49:47.169 INFO:tasks.workunit.client.0.smithi081.stdout:1/605: fsync d3/d3d/d41/f9c 0 2024-04-23T14:49:47.169 INFO:tasks.workunit.client.0.smithi081.stdout:1/606: chown d3/d3d/d6f 1230893121 1 2024-04-23T14:49:47.169 INFO:tasks.workunit.client.0.smithi081.stdout:1/607: truncate d3/d3d/d41/d5e/d17/d58/f99 5909780 0 2024-04-23T14:49:47.169 INFO:tasks.workunit.client.1.smithi156.stdout:3/154: creat d4/db/dd/d20/f23 x:0 0 0 2024-04-23T14:49:47.185 INFO:tasks.workunit.client.0.smithi081.stdout:4/502: dread d1/d4/d11/f28 [0,4194304] 0 2024-04-23T14:49:47.185 INFO:tasks.workunit.client.0.smithi081.stdout:4/503: truncate d1/d3/f36 857928 0 2024-04-23T14:49:47.185 INFO:tasks.workunit.client.0.smithi081.stdout:7/410: truncate d3/d11/d56/f72 146728 0 2024-04-23T14:49:47.185 INFO:tasks.workunit.client.0.smithi081.stdout:7/411: chown d3/d21/d31/d33/d52/f59 186 1 2024-04-23T14:49:47.185 INFO:tasks.workunit.client.0.smithi081.stdout:7/412: chown d3/d21/d31/d33/d52 478392895 1 2024-04-23T14:49:47.185 INFO:tasks.workunit.client.0.smithi081.stdout:7/413: readlink d3/d21/d31/d33/d4b/d4c/l5b 0 2024-04-23T14:49:47.185 INFO:tasks.workunit.client.0.smithi081.stdout:7/414: fdatasync d3/d21/d31/d50/f62 0 2024-04-23T14:49:47.187 INFO:tasks.workunit.client.0.smithi081.stdout:6/503: mkdir d1/d51/d65/d8/d2e/d59/d80/db8 0 2024-04-23T14:49:47.193 INFO:tasks.workunit.client.0.smithi081.stdout:1/608: symlink d3/d3d/d41/d5e/d17/d25/lc6 0 2024-04-23T14:49:47.193 INFO:tasks.workunit.client.0.smithi081.stdout:1/609: dread - d3/d3d/d41/d5e/d9d/fb9 zero size 2024-04-23T14:49:47.198 INFO:tasks.workunit.client.0.smithi081.stdout:7/415: truncate d3/d21/d31/f40 338129 0 2024-04-23T14:49:47.200 INFO:tasks.workunit.client.1.smithi156.stdout:1/208: dwrite db/d25/f3d [0,4194304] 0 2024-04-23T14:49:47.201 INFO:tasks.workunit.client.1.smithi156.stdout:1/209: chown db/ff 1 1 2024-04-23T14:49:47.201 INFO:tasks.workunit.client.1.smithi156.stdout:1/210: stat db/d25/f3d 0 2024-04-23T14:49:47.201 INFO:tasks.workunit.client.1.smithi156.stdout:1/211: truncate db/d1f/f41 708881 0 2024-04-23T14:49:47.201 INFO:tasks.workunit.client.1.smithi156.stdout:1/212: write db/ff [10953160,76701] 0 2024-04-23T14:49:47.201 INFO:tasks.workunit.client.0.smithi081.stdout:6/504: creat d1/d51/d7b/d91/fb9 x:0 0 0 2024-04-23T14:49:47.203 INFO:tasks.workunit.client.0.smithi081.stdout:1/610: creat d3/d3d/d41/d5e/d17/d58/d7f/dba/fc7 x:0 0 0 2024-04-23T14:49:47.203 INFO:tasks.workunit.client.0.smithi081.stdout:1/611: chown d3/d3d/d41/d5e/d1d/c85 3435046 1 2024-04-23T14:49:47.206 INFO:tasks.workunit.client.0.smithi081.stdout:2/591: getdents d1/d11/d21/d34 0 2024-04-23T14:49:47.210 INFO:tasks.workunit.client.1.smithi156.stdout:5/236: mkdir d1/d11/d18/d52 0 2024-04-23T14:49:47.211 INFO:tasks.workunit.client.1.smithi156.stdout:5/237: truncate d1/d3/d20/f4c 43929 0 2024-04-23T14:49:47.217 INFO:tasks.workunit.client.0.smithi081.stdout:6/505: mknod d1/d51/d65/d8/d2e/d59/d80/d90/cba 0 2024-04-23T14:49:47.217 INFO:tasks.workunit.client.0.smithi081.stdout:1/612: rename d3/d3d/d41/d5e/d1d/l36 to d3/lc8 0 2024-04-23T14:49:47.217 INFO:tasks.workunit.client.0.smithi081.stdout:1/613: fsync d3/d3d/d41/d5e/d12/fbf 0 2024-04-23T14:49:47.221 INFO:tasks.workunit.client.0.smithi081.stdout:3/449: dwrite d4/dc/d31/f63 [0,4194304] 0 2024-04-23T14:49:47.222 INFO:tasks.workunit.client.1.smithi156.stdout:0/173: mknod d0/d4/d22/c38 0 2024-04-23T14:49:47.226 INFO:tasks.workunit.client.0.smithi081.stdout:2/592: creat d1/d33/fcf x:0 0 0 2024-04-23T14:49:47.229 INFO:tasks.workunit.client.1.smithi156.stdout:2/178: rename d4/d26/l3d to d4/d21/l45 0 2024-04-23T14:49:47.230 INFO:tasks.workunit.client.1.smithi156.stdout:2/179: write d4/f24 [630048,743] 0 2024-04-23T14:49:47.231 INFO:tasks.workunit.client.0.smithi081.stdout:7/416: getdents d3/d21/d31/d33/d52 0 2024-04-23T14:49:47.233 INFO:tasks.workunit.client.1.smithi156.stdout:9/149: creat d1/d2/d4/d17/d1f/f36 x:0 0 0 2024-04-23T14:49:47.233 INFO:tasks.workunit.client.1.smithi156.stdout:9/150: creat d1/d2/d4/d17/d1f/f37 x:0 0 0 2024-04-23T14:49:47.234 INFO:tasks.workunit.client.0.smithi081.stdout:1/614: symlink d3/d3d/d7a/lc9 0 2024-04-23T14:49:47.237 INFO:tasks.workunit.client.1.smithi156.stdout:4/153: mkdir d0/d30/d34 0 2024-04-23T14:49:47.237 INFO:tasks.workunit.client.1.smithi156.stdout:4/154: write d0/df/f25 [805602,15444] 0 2024-04-23T14:49:47.244 INFO:tasks.workunit.client.0.smithi081.stdout:3/450: mkdir d4/dc/d10/d5a/d93 0 2024-04-23T14:49:47.244 INFO:tasks.workunit.client.0.smithi081.stdout:3/451: chown d4/d7/df/f35 10110 1 2024-04-23T14:49:47.244 INFO:tasks.workunit.client.0.smithi081.stdout:3/452: creat d4/d7/d32/f94 x:0 0 0 2024-04-23T14:49:47.246 INFO:tasks.workunit.client.0.smithi081.stdout:7/417: symlink d3/d21/d31/d33/d4b/d71/l89 0 2024-04-23T14:49:47.247 INFO:tasks.workunit.client.0.smithi081.stdout:4/504: dwrite d1/d1d/d59/f5a [0,4194304] 0 2024-04-23T14:49:47.249 INFO:tasks.workunit.client.0.smithi081.stdout:1/615: truncate d3/d3d/f13 3223896 0 2024-04-23T14:49:47.249 INFO:tasks.workunit.client.0.smithi081.stdout:1/616: dread - d3/d3d/d41/d5e/d5d/db0/d70/f84 zero size 2024-04-23T14:49:47.250 INFO:tasks.workunit.client.1.smithi156.stdout:1/213: dwrite db/f11 [0,4194304] 0 2024-04-23T14:49:47.250 INFO:tasks.workunit.client.1.smithi156.stdout:1/214: fsync db/f11 0 2024-04-23T14:49:47.252 INFO:tasks.workunit.client.1.smithi156.stdout:7/158: truncate dc/d1d/f23 1005422 0 2024-04-23T14:49:47.252 INFO:tasks.workunit.client.1.smithi156.stdout:7/159: fsync dc/f17 0 2024-04-23T14:49:47.252 INFO:tasks.workunit.client.1.smithi156.stdout:7/160: readlink dc/l1b 0 2024-04-23T14:49:47.252 INFO:tasks.workunit.client.1.smithi156.stdout:7/161: chown dc/d1d/d20 221 1 2024-04-23T14:49:47.256 INFO:tasks.workunit.client.1.smithi156.stdout:2/180: truncate d4/d13/f23 1044694 0 2024-04-23T14:49:47.256 INFO:tasks.workunit.client.1.smithi156.stdout:2/181: write d4/f16 [870000,105744] 0 2024-04-23T14:49:47.259 INFO:tasks.workunit.client.0.smithi081.stdout:7/418: mknod d3/d20/c8a 0 2024-04-23T14:49:47.259 INFO:tasks.workunit.client.0.smithi081.stdout:7/419: fsync d3/d11/d2c/d75/f3c 0 2024-04-23T14:49:47.259 INFO:tasks.workunit.client.0.smithi081.stdout:7/420: chown d3/d11/d2c/d75/f51 10614455 1 2024-04-23T14:49:47.259 INFO:tasks.workunit.client.0.smithi081.stdout:7/421: chown d3/d11/d2c/d75/f5c 109086755 1 2024-04-23T14:49:47.260 INFO:tasks.workunit.client.1.smithi156.stdout:6/204: rename d3/d16/f23 to d3/d16/d1e/f52 0 2024-04-23T14:49:47.269 INFO:tasks.workunit.client.1.smithi156.stdout:7/162: dread dc/f19 [0,4194304] 0 2024-04-23T14:49:47.269 INFO:tasks.workunit.client.1.smithi156.stdout:7/163: chown dc/lf 1 1 2024-04-23T14:49:47.270 INFO:tasks.workunit.client.1.smithi156.stdout:7/164: stat dc/d1d/d24/f27 0 2024-04-23T14:49:47.270 INFO:tasks.workunit.client.1.smithi156.stdout:7/165: chown dc/l22 0 1 2024-04-23T14:49:47.270 INFO:tasks.workunit.client.1.smithi156.stdout:3/155: getdents d4/db/dd/d20 0 2024-04-23T14:49:47.270 INFO:tasks.workunit.client.1.smithi156.stdout:3/156: dread - d4/db/dd/d20/f23 zero size 2024-04-23T14:49:47.276 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:46 smithi081 ceph-mon[25540]: pgmap v32: 65 pgs: 65 active+clean; 1.3 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 117 MiB/s rd, 132 MiB/s wr, 537 op/s 2024-04-23T14:49:47.282 INFO:tasks.workunit.client.0.smithi081.stdout:6/506: dwrite d1/d51/f5d [0,4194304] 0 2024-04-23T14:49:47.285 INFO:tasks.workunit.client.1.smithi156.stdout:5/238: dwrite d1/d11/f51 [0,4194304] 0 2024-04-23T14:49:47.285 INFO:tasks.workunit.client.1.smithi156.stdout:5/239: read - d1/d3/f4f zero size 2024-04-23T14:49:47.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:46 smithi156 ceph-mon[32341]: pgmap v32: 65 pgs: 65 active+clean; 1.3 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 117 MiB/s rd, 132 MiB/s wr, 537 op/s 2024-04-23T14:49:47.290 INFO:tasks.workunit.client.1.smithi156.stdout:6/205: truncate d3/da/f28 7360792 0 2024-04-23T14:49:47.290 INFO:tasks.workunit.client.1.smithi156.stdout:7/166: write dc/f14 [2137589,29026] 0 2024-04-23T14:49:47.290 INFO:tasks.workunit.client.1.smithi156.stdout:7/167: creat dc/d1d/d24/f28 x:0 0 0 2024-04-23T14:49:47.290 INFO:tasks.workunit.client.1.smithi156.stdout:7/168: fdatasync f6 0 2024-04-23T14:49:47.290 INFO:tasks.workunit.client.1.smithi156.stdout:7/169: truncate dc/f19 781845 0 2024-04-23T14:49:47.293 INFO:tasks.workunit.client.1.smithi156.stdout:9/151: rename d1/d2/c15 to d1/d2/d4/c38 0 2024-04-23T14:49:47.297 INFO:tasks.workunit.client.1.smithi156.stdout:0/174: dwrite d0/d4/f25 [4194304,4194304] 0 2024-04-23T14:49:47.302 INFO:tasks.workunit.client.1.smithi156.stdout:3/157: link d4/db/dd/c18 d4/db/dd/c24 0 2024-04-23T14:49:47.311 INFO:tasks.workunit.client.0.smithi081.stdout:6/507: dread d1/d51/d65/d8/d2e/d59/f68 [0,4194304] 0 2024-04-23T14:49:47.311 INFO:tasks.workunit.client.0.smithi081.stdout:6/508: chown d1/d51/d65/d8/d2e 12826 1 2024-04-23T14:49:47.311 INFO:tasks.workunit.client.0.smithi081.stdout:6/509: chown d1/d51/d7b/d91 220341483 1 2024-04-23T14:49:47.312 INFO:tasks.workunit.client.0.smithi081.stdout:4/505: mkdir d1/d1d/daa 0 2024-04-23T14:49:47.312 INFO:tasks.workunit.client.0.smithi081.stdout:4/506: chown d1/d4f/d87/ca5 0 1 2024-04-23T14:49:47.315 INFO:tasks.workunit.client.1.smithi156.stdout:1/215: rmdir db/d15 39 2024-04-23T14:49:47.315 INFO:tasks.workunit.client.1.smithi156.stdout:6/206: creat d3/d16/d1e/f53 x:0 0 0 2024-04-23T14:49:47.315 INFO:tasks.workunit.client.1.smithi156.stdout:1/216: write db/ff [13163512,80881] 0 2024-04-23T14:49:47.315 INFO:tasks.workunit.client.1.smithi156.stdout:1/217: write db/d1f/f3f [165004,37439] 0 2024-04-23T14:49:47.315 INFO:tasks.workunit.client.1.smithi156.stdout:1/218: chown db/d1f/f3f 3 1 2024-04-23T14:49:47.315 INFO:tasks.workunit.client.1.smithi156.stdout:1/219: stat db/d15/l2e 0 2024-04-23T14:49:47.315 INFO:tasks.workunit.client.0.smithi081.stdout:7/422: dwrite d3/d21/f79 [0,4194304] 0 2024-04-23T14:49:47.316 INFO:tasks.workunit.client.1.smithi156.stdout:7/170: symlink dc/l29 0 2024-04-23T14:49:47.317 INFO:tasks.workunit.client.1.smithi156.stdout:8/170: sync 2024-04-23T14:49:47.319 INFO:tasks.workunit.client.1.smithi156.stdout:4/155: rename d0/d8/d2c/l32 to d0/d30/l35 0 2024-04-23T14:49:47.322 INFO:tasks.workunit.client.1.smithi156.stdout:4/156: write d0/d8/f2f [968824,4117] 0 2024-04-23T14:49:47.322 INFO:tasks.workunit.client.1.smithi156.stdout:4/157: stat d0/df/d1b/c2a 0 2024-04-23T14:49:47.326 INFO:tasks.workunit.client.0.smithi081.stdout:2/593: dwrite d1/f6 [0,4194304] 0 2024-04-23T14:49:47.331 INFO:tasks.workunit.client.0.smithi081.stdout:3/453: symlink d4/d7/df/l95 0 2024-04-23T14:49:47.331 INFO:tasks.workunit.client.0.smithi081.stdout:6/510: mkdir d1/d51/d65/d13/d16/dbb 0 2024-04-23T14:49:47.331 INFO:tasks.workunit.client.0.smithi081.stdout:6/511: readlink d1/d51/d65/d8/l1a 0 2024-04-23T14:49:47.331 INFO:tasks.workunit.client.1.smithi156.stdout:1/220: fdatasync db/d1f/f3f 0 2024-04-23T14:49:47.331 INFO:tasks.workunit.client.1.smithi156.stdout:1/221: read db/f17 [2651845,59056] 0 2024-04-23T14:49:47.337 INFO:tasks.workunit.client.1.smithi156.stdout:9/152: mkdir d1/d2/d23/d2d/d39 0 2024-04-23T14:49:47.337 INFO:tasks.workunit.client.1.smithi156.stdout:3/158: creat d4/db/dd/f25 x:0 0 0 2024-04-23T14:49:47.337 INFO:tasks.workunit.client.1.smithi156.stdout:3/159: creat d4/db/dd/f26 x:0 0 0 2024-04-23T14:49:47.337 INFO:tasks.workunit.client.1.smithi156.stdout:9/153: write d1/d2/d4/dc/f22 [1036937,116432] 0 2024-04-23T14:49:47.337 INFO:tasks.workunit.client.1.smithi156.stdout:3/160: write d4/db/dd/d1d/d1e/ff [404684,115892] 0 2024-04-23T14:49:47.338 INFO:tasks.workunit.client.0.smithi081.stdout:4/507: dread d1/d4/d6f/f91 [0,4194304] 0 2024-04-23T14:49:47.338 INFO:tasks.workunit.client.0.smithi081.stdout:4/508: chown d1/d4/dc 897825248 1 2024-04-23T14:49:47.346 INFO:tasks.workunit.client.1.smithi156.stdout:8/171: unlink d5/d19/l24 0 2024-04-23T14:49:47.348 INFO:tasks.workunit.client.1.smithi156.stdout:2/182: rename d4/d21/f36 to d4/d26/d3c/f46 0 2024-04-23T14:49:47.352 INFO:tasks.workunit.client.0.smithi081.stdout:9/553: sync 2024-04-23T14:49:47.353 INFO:tasks.workunit.client.0.smithi081.stdout:0/594: sync 2024-04-23T14:49:47.353 INFO:tasks.workunit.client.0.smithi081.stdout:0/595: rename d6 to d6/d11/d14/d41/d5b/dbb 22 2024-04-23T14:49:47.353 INFO:tasks.workunit.client.0.smithi081.stdout:2/594: creat d1/d11/d21/d34/fd0 x:0 0 0 2024-04-23T14:49:47.353 INFO:tasks.workunit.client.0.smithi081.stdout:1/617: getdents d3/d3d/d41/d5e/d12 0 2024-04-23T14:49:47.355 INFO:tasks.workunit.client.1.smithi156.stdout:0/175: dwrite d0/d4/d14/f35 [0,4194304] 0 2024-04-23T14:49:47.356 INFO:tasks.workunit.client.0.smithi081.stdout:4/509: link d1/da3/fa4 d1/d4/d6f/d70/d9c/fab 0 2024-04-23T14:49:47.356 INFO:tasks.workunit.client.0.smithi081.stdout:5/549: sync 2024-04-23T14:49:47.356 INFO:tasks.workunit.client.0.smithi081.stdout:8/739: sync 2024-04-23T14:49:47.356 INFO:tasks.workunit.client.0.smithi081.stdout:8/740: chown d3/d11/c3b 19047 1 2024-04-23T14:49:47.358 INFO:tasks.workunit.client.1.smithi156.stdout:9/154: rmdir d1/d2/d28 39 2024-04-23T14:49:47.358 INFO:tasks.workunit.client.1.smithi156.stdout:9/155: chown d1/d2/d4/d17/d1f/f36 1 1 2024-04-23T14:49:47.359 INFO:tasks.workunit.client.0.smithi081.stdout:6/512: dread d1/d51/d65/f4f [0,4194304] 0 2024-04-23T14:49:47.362 INFO:tasks.workunit.client.0.smithi081.stdout:0/596: creat d6/d11/d14/d41/d5b/d59/fbc x:0 0 0 2024-04-23T14:49:47.367 INFO:tasks.workunit.client.1.smithi156.stdout:3/161: mknod d4/db/dd/d1d/d1e/c27 0 2024-04-23T14:49:47.371 INFO:tasks.workunit.client.0.smithi081.stdout:1/618: link d3/d3d/d41/d5e/d17/d25/lc6 d3/d3d/d41/d5e/d1d/lca 0 2024-04-23T14:49:47.371 INFO:tasks.workunit.client.0.smithi081.stdout:1/619: chown d3/d3d/d41/d4a/d77/f98 2 1 2024-04-23T14:49:47.376 INFO:tasks.workunit.client.1.smithi156.stdout:9/156: dread d1/d2/d4/d19/d2a/d30/f34 [0,4194304] 0 2024-04-23T14:49:47.376 INFO:tasks.workunit.client.1.smithi156.stdout:7/171: rmdir dc/d1d/d24 39 2024-04-23T14:49:47.380 INFO:tasks.workunit.client.1.smithi156.stdout:6/207: write d3/da/f28 [39896,29676] 0 2024-04-23T14:49:47.386 INFO:tasks.workunit.client.1.smithi156.stdout:5/240: rename d1/d3/l14 to d1/d11/d18/d19/l53 0 2024-04-23T14:49:47.390 INFO:tasks.workunit.client.0.smithi081.stdout:0/597: write d6/d25/f45 [1031920,84534] 0 2024-04-23T14:49:47.391 INFO:tasks.workunit.client.0.smithi081.stdout:4/510: unlink d1/d8f/f93 0 2024-04-23T14:49:47.396 INFO:tasks.workunit.client.0.smithi081.stdout:5/550: symlink d17/d65/lc7 0 2024-04-23T14:49:47.399 INFO:tasks.workunit.client.0.smithi081.stdout:9/554: dread d3/d5/f6 [4194304,4194304] 0 2024-04-23T14:49:47.400 INFO:tasks.workunit.client.0.smithi081.stdout:9/555: truncate d3/de/d47/fa9 302728 0 2024-04-23T14:49:47.400 INFO:tasks.workunit.client.1.smithi156.stdout:8/172: dwrite d5/d9/d10/f33 [0,4194304] 0 2024-04-23T14:49:47.402 INFO:tasks.workunit.client.0.smithi081.stdout:3/454: dwrite d4/d7/d1a/d71/f76 [0,4194304] 0 2024-04-23T14:49:47.409 INFO:tasks.workunit.client.0.smithi081.stdout:6/513: creat d1/d51/d65/d1c/fbc x:0 0 0 2024-04-23T14:49:47.417 INFO:tasks.workunit.client.0.smithi081.stdout:5/551: write d17/d18/f2e [67071,66197] 0 2024-04-23T14:49:47.417 INFO:tasks.workunit.client.0.smithi081.stdout:5/552: readlink d17/d18/d3a/d8e/l98 0 2024-04-23T14:49:47.418 INFO:tasks.workunit.client.0.smithi081.stdout:1/620: creat d3/d3d/d41/d5e/d17/d58/fcb x:0 0 0 2024-04-23T14:49:47.418 INFO:tasks.workunit.client.0.smithi081.stdout:4/511: write d1/d1d/d39/f73 [1576344,70828] 0 2024-04-23T14:49:47.418 INFO:tasks.workunit.client.0.smithi081.stdout:4/512: chown d1/d1d/d59/c5c 1980 1 2024-04-23T14:49:47.418 INFO:tasks.workunit.client.0.smithi081.stdout:4/513: stat d1/d4/d11/f80 0 2024-04-23T14:49:47.418 INFO:tasks.workunit.client.0.smithi081.stdout:4/514: fdatasync d1/d1d/f97 0 2024-04-23T14:49:47.420 INFO:tasks.workunit.client.1.smithi156.stdout:0/176: truncate d0/f7 4009126 0 2024-04-23T14:49:47.422 INFO:tasks.workunit.client.1.smithi156.stdout:3/162: mknod d4/db/dd/d1d/d1e/d13/c28 0 2024-04-23T14:49:47.430 INFO:tasks.workunit.client.0.smithi081.stdout:8/741: dwrite d3/fd6 [0,4194304] 0 2024-04-23T14:49:47.432 INFO:tasks.workunit.client.0.smithi081.stdout:0/598: mkdir d6/d11/d14/d41/d5b/d59/d68/dbd 0 2024-04-23T14:49:47.432 INFO:tasks.workunit.client.1.smithi156.stdout:4/158: dwrite d0/f3 [0,4194304] 0 2024-04-23T14:49:47.433 INFO:tasks.workunit.client.1.smithi156.stdout:9/157: unlink d1/d2/d4/f1a 0 2024-04-23T14:49:47.433 INFO:tasks.workunit.client.0.smithi081.stdout:9/556: unlink d3/de/c2a 0 2024-04-23T14:49:47.433 INFO:tasks.workunit.client.0.smithi081.stdout:3/455: dread d4/d7/df/f27 [0,4194304] 0 2024-04-23T14:49:47.437 INFO:tasks.workunit.client.0.smithi081.stdout:2/595: dwrite d1/d11/d21/d52/d8b/d8f/d93/fa6 [0,4194304] 0 2024-04-23T14:49:47.438 INFO:tasks.workunit.client.1.smithi156.stdout:7/172: truncate dc/f11 1468405 0 2024-04-23T14:49:47.449 INFO:tasks.workunit.client.1.smithi156.stdout:6/208: rmdir d3/d16/d46 39 2024-04-23T14:49:47.449 INFO:tasks.workunit.client.1.smithi156.stdout:6/209: write d3/d16/d1e/f20 [1142405,67874] 0 2024-04-23T14:49:47.449 INFO:tasks.workunit.client.1.smithi156.stdout:6/210: chown d3/da/f18 16176492 1 2024-04-23T14:49:47.455 INFO:tasks.workunit.client.1.smithi156.stdout:5/241: dwrite d1/d3/f4f [0,4194304] 0 2024-04-23T14:49:47.457 INFO:tasks.workunit.client.1.smithi156.stdout:7/173: dread dc/f17 [0,4194304] 0 2024-04-23T14:49:47.471 INFO:tasks.workunit.client.1.smithi156.stdout:8/173: symlink d5/d19/l3d 0 2024-04-23T14:49:47.475 INFO:tasks.workunit.client.1.smithi156.stdout:2/183: rmdir d4/d26 39 2024-04-23T14:49:47.477 INFO:tasks.workunit.client.0.smithi081.stdout:3/456: write d4/dc/f55 [3945442,94988] 0 2024-04-23T14:49:47.477 INFO:tasks.workunit.client.0.smithi081.stdout:1/621: dwrite d3/d3d/d41/d4a/d77/f98 [0,4194304] 0 2024-04-23T14:49:47.486 INFO:tasks.workunit.client.1.smithi156.stdout:1/222: rmdir db/d25/d30/d38/d3a 0 2024-04-23T14:49:47.488 INFO:tasks.workunit.client.1.smithi156.stdout:1/223: fsync db/f17 0 2024-04-23T14:49:47.489 INFO:tasks.workunit.client.0.smithi081.stdout:8/742: creat d3/d11/d48/dc1/ff4 x:0 0 0 2024-04-23T14:49:47.489 INFO:tasks.workunit.client.0.smithi081.stdout:6/514: dwrite d1/d51/d7b/d91/fb9 [0,4194304] 0 2024-04-23T14:49:47.491 INFO:tasks.workunit.client.0.smithi081.stdout:0/599: rmdir d6/d37/d67 39 2024-04-23T14:49:47.494 INFO:tasks.workunit.client.0.smithi081.stdout:9/557: link d3/d5/f41 d3/d67/faf 0 2024-04-23T14:49:47.496 INFO:tasks.workunit.client.1.smithi156.stdout:2/184: read d4/f15 [3757263,53318] 0 2024-04-23T14:49:47.496 INFO:tasks.workunit.client.1.smithi156.stdout:0/177: symlink d0/d16/l39 0 2024-04-23T14:49:47.496 INFO:tasks.workunit.client.1.smithi156.stdout:0/178: chown d0/c9 9130916 1 2024-04-23T14:49:47.496 INFO:tasks.workunit.client.1.smithi156.stdout:3/163: mknod d4/db/c29 0 2024-04-23T14:49:47.496 INFO:tasks.workunit.client.1.smithi156.stdout:3/164: write d4/db/dd/d20/f23 [329700,6536] 0 2024-04-23T14:49:47.497 INFO:tasks.workunit.client.0.smithi081.stdout:5/553: dwrite d17/d3c/fbe [0,4194304] 0 2024-04-23T14:49:47.498 INFO:tasks.workunit.client.1.smithi156.stdout:9/158: unlink d1/f2e 0 2024-04-23T14:49:47.502 INFO:tasks.workunit.client.1.smithi156.stdout:4/159: dwrite d0/d8/d1e/f22 [0,4194304] 0 2024-04-23T14:49:47.505 INFO:tasks.workunit.client.0.smithi081.stdout:2/596: unlink d1/d33/fcc 0 2024-04-23T14:49:47.510 INFO:tasks.workunit.client.1.smithi156.stdout:5/242: symlink d1/d3/d24/l54 0 2024-04-23T14:49:47.511 INFO:tasks.workunit.client.0.smithi081.stdout:0/600: dread d6/d11/d14/f73 [0,4194304] 0 2024-04-23T14:49:47.517 INFO:tasks.workunit.client.1.smithi156.stdout:7/174: mkdir dc/d2a 0 2024-04-23T14:49:47.518 INFO:tasks.workunit.client.1.smithi156.stdout:7/175: readlink dc/l1b 0 2024-04-23T14:49:47.518 INFO:tasks.workunit.client.1.smithi156.stdout:7/176: write dc/f1c [1605302,40117] 0 2024-04-23T14:49:47.522 INFO:tasks.workunit.client.0.smithi081.stdout:3/457: unlink d4/dc/d10/d5a/l8c 0 2024-04-23T14:49:47.522 INFO:tasks.workunit.client.0.smithi081.stdout:3/458: creat d4/dc/d10/d47/f96 x:0 0 0 2024-04-23T14:49:47.524 INFO:tasks.workunit.client.0.smithi081.stdout:1/622: rmdir d3/d3d/d41/d5e/d17 39 2024-04-23T14:49:47.524 INFO:tasks.workunit.client.0.smithi081.stdout:1/623: readlink d3/d3d/d41/d5e/d12/d1a/lb6 0 2024-04-23T14:49:47.531 INFO:tasks.workunit.client.0.smithi081.stdout:8/743: stat d3/d11/d48/f8d 0 2024-04-23T14:49:47.534 INFO:tasks.workunit.client.0.smithi081.stdout:9/558: stat d3/c32 0 2024-04-23T14:49:47.534 INFO:tasks.workunit.client.0.smithi081.stdout:9/559: chown d3/de/d76 3 1 2024-04-23T14:49:47.537 INFO:tasks.workunit.client.1.smithi156.stdout:2/185: unlink d4/f15 0 2024-04-23T14:49:47.537 INFO:tasks.workunit.client.1.smithi156.stdout:2/186: write d4/d26/d3c/f46 [664618,108830] 0 2024-04-23T14:49:47.539 INFO:tasks.workunit.client.0.smithi081.stdout:5/554: mknod d17/d1f/d42/d9b/cc8 0 2024-04-23T14:49:47.541 INFO:tasks.workunit.client.0.smithi081.stdout:2/597: creat d1/d33/da3/fd1 x:0 0 0 2024-04-23T14:49:47.547 INFO:tasks.workunit.client.0.smithi081.stdout:0/601: unlink d6/d25/f32 0 2024-04-23T14:49:47.547 INFO:tasks.workunit.client.0.smithi081.stdout:0/602: chown d6/d11 2 1 2024-04-23T14:49:47.547 INFO:tasks.workunit.client.0.smithi081.stdout:0/603: truncate d6/d11/d14/d41/f43 4440510 0 2024-04-23T14:49:47.551 INFO:tasks.workunit.client.0.smithi081.stdout:4/515: rename d1/da3 to d1/d4/d11/d9d/dac 0 2024-04-23T14:49:47.551 INFO:tasks.workunit.client.0.smithi081.stdout:3/459: symlink d4/d7/d49/d51/d84/l97 0 2024-04-23T14:49:47.559 INFO:tasks.workunit.client.1.smithi156.stdout:9/159: symlink d1/d2/d4/d19/d2a/l3a 0 2024-04-23T14:49:47.560 INFO:tasks.workunit.client.1.smithi156.stdout:6/211: getdents d3/d16/d46/d2b 0 2024-04-23T14:49:47.562 INFO:tasks.workunit.client.1.smithi156.stdout:0/179: dwrite d0/d4/f3 [0,4194304] 0 2024-04-23T14:49:47.566 INFO:tasks.workunit.client.0.smithi081.stdout:8/744: unlink d3/d11/d48/f8d 0 2024-04-23T14:49:47.568 INFO:tasks.workunit.client.0.smithi081.stdout:4/516: dread d1/d1d/f52 [0,4194304] 0 2024-04-23T14:49:47.568 INFO:tasks.workunit.client.0.smithi081.stdout:4/517: write d1/d1d/d59/f85 [723119,1098] 0 2024-04-23T14:49:47.570 INFO:tasks.workunit.client.0.smithi081.stdout:9/560: link d3/de/c35 d3/d67/d77/cb0 0 2024-04-23T14:49:47.570 INFO:tasks.workunit.client.0.smithi081.stdout:9/561: creat d3/de/d1d/d5b/d7b/fb1 x:0 0 0 2024-04-23T14:49:47.572 INFO:tasks.workunit.client.1.smithi156.stdout:5/243: mknod d1/d11/d18/c55 0 2024-04-23T14:49:47.572 INFO:tasks.workunit.client.1.smithi156.stdout:9/160: unlink d1/d2/c20 0 2024-04-23T14:49:47.572 INFO:tasks.workunit.client.1.smithi156.stdout:5/244: write d1/d3/d24/f3d [1060556,89251] 0 2024-04-23T14:49:47.577 INFO:tasks.workunit.client.0.smithi081.stdout:2/598: creat d1/d33/d9f/fd2 x:0 0 0 2024-04-23T14:49:47.579 INFO:tasks.workunit.client.1.smithi156.stdout:1/224: dwrite db/d15/f23 [4194304,4194304] 0 2024-04-23T14:49:47.580 INFO:tasks.workunit.client.1.smithi156.stdout:1/225: write db/d25/d30/f43 [708256,44618] 0 2024-04-23T14:49:47.580 INFO:tasks.workunit.client.1.smithi156.stdout:1/226: readlink db/d1f/l35 0 2024-04-23T14:49:47.580 INFO:tasks.workunit.client.1.smithi156.stdout:1/227: stat db/d1f/f3f 0 2024-04-23T14:49:47.580 INFO:tasks.workunit.client.1.smithi156.stdout:1/228: write db/d25/d30/f43 [497474,116520] 0 2024-04-23T14:49:47.581 INFO:tasks.workunit.client.1.smithi156.stdout:1/229: write db/d25/d30/f43 [1632491,62082] 0 2024-04-23T14:49:47.582 INFO:tasks.workunit.client.0.smithi081.stdout:6/515: rename d1/fa7 to d1/d51/d65/d8/da4/fbd 0 2024-04-23T14:49:47.583 INFO:tasks.workunit.client.1.smithi156.stdout:6/212: link d3/l1f d3/da/d1d/l54 0 2024-04-23T14:49:47.583 INFO:tasks.workunit.client.1.smithi156.stdout:6/213: dread - d3/d16/d46/f40 zero size 2024-04-23T14:49:47.583 INFO:tasks.workunit.client.1.smithi156.stdout:6/214: fsync d3/da/f38 0 2024-04-23T14:49:47.583 INFO:tasks.workunit.client.1.smithi156.stdout:6/215: write d3/d16/d46/f1b [357588,106007] 0 2024-04-23T14:49:47.583 INFO:tasks.workunit.client.1.smithi156.stdout:6/216: write d3/da/f1a [521161,113905] 0 2024-04-23T14:49:47.583 INFO:tasks.workunit.client.1.smithi156.stdout:0/180: getdents d0/d4/d14/d1b/d2b 0 2024-04-23T14:49:47.583 INFO:tasks.workunit.client.1.smithi156.stdout:0/181: fdatasync d0/d4/fe 0 2024-04-23T14:49:47.585 INFO:tasks.workunit.client.0.smithi081.stdout:3/460: mknod d4/dc/d10/c98 0 2024-04-23T14:49:47.587 INFO:tasks.workunit.client.1.smithi156.stdout:5/245: creat d1/f56 x:0 0 0 2024-04-23T14:49:47.591 INFO:tasks.workunit.client.1.smithi156.stdout:2/187: dwrite d4/f29 [0,4194304] 0 2024-04-23T14:49:47.591 INFO:tasks.workunit.client.1.smithi156.stdout:1/230: creat db/d1f/d28/f44 x:0 0 0 2024-04-23T14:49:47.591 INFO:tasks.workunit.client.1.smithi156.stdout:1/231: chown db/f39 1617921 1 2024-04-23T14:49:47.593 INFO:tasks.workunit.client.1.smithi156.stdout:4/160: dwrite d0/d8/f2f [0,4194304] 0 2024-04-23T14:49:47.596 INFO:tasks.workunit.client.1.smithi156.stdout:6/217: mknod d3/da/d1d/d27/c55 0 2024-04-23T14:49:47.597 INFO:tasks.workunit.client.1.smithi156.stdout:6/218: write d3/da/d1d/f35 [375734,104080] 0 2024-04-23T14:49:47.600 INFO:tasks.workunit.client.1.smithi156.stdout:1/232: symlink db/d1f/d28/l45 0 2024-04-23T14:49:47.600 INFO:tasks.workunit.client.1.smithi156.stdout:1/233: fdatasync db/d1f/d2d/f36 0 2024-04-23T14:49:47.604 INFO:tasks.workunit.client.0.smithi081.stdout:2/599: dread d1/d33/f5e [0,4194304] 0 2024-04-23T14:49:47.604 INFO:tasks.workunit.client.0.smithi081.stdout:2/600: chown d1/d11/d21/d34/f4b 97 1 2024-04-23T14:49:47.605 INFO:tasks.workunit.client.1.smithi156.stdout:0/182: dread d0/d4/f25 [0,4194304] 0 2024-04-23T14:49:47.605 INFO:tasks.workunit.client.1.smithi156.stdout:0/183: stat d0/d4/d14/f1f 0 2024-04-23T14:49:47.608 INFO:tasks.workunit.client.1.smithi156.stdout:6/219: creat d3/da/d1d/f56 x:0 0 0 2024-04-23T14:49:47.610 INFO:tasks.workunit.client.1.smithi156.stdout:6/220: read d3/da/d1d/f35 [97352,27223] 0 2024-04-23T14:49:47.611 INFO:tasks.workunit.client.1.smithi156.stdout:1/234: symlink db/d25/d30/d38/l46 0 2024-04-23T14:49:47.612 INFO:tasks.workunit.client.1.smithi156.stdout:1/235: chown db/d1f/d34/c2c 2347 1 2024-04-23T14:49:47.612 INFO:tasks.workunit.client.0.smithi081.stdout:5/555: dread d17/d3c/fbe [0,4194304] 0 2024-04-23T14:49:47.615 INFO:tasks.workunit.client.1.smithi156.stdout:4/161: truncate d0/f3 1609297 0 2024-04-23T14:49:47.615 INFO:tasks.workunit.client.1.smithi156.stdout:4/162: truncate d0/df/f14 1091159 0 2024-04-23T14:49:47.617 INFO:tasks.workunit.client.0.smithi081.stdout:1/624: rmdir d3/d3d 39 2024-04-23T14:49:47.617 INFO:tasks.workunit.client.0.smithi081.stdout:1/625: write d3/d3d/d41/d4a/d77/f98 [5595596,115310] 0 2024-04-23T14:49:47.617 INFO:tasks.workunit.client.0.smithi081.stdout:1/626: chown d3 80200666 1 2024-04-23T14:49:47.618 INFO:tasks.workunit.client.1.smithi156.stdout:3/165: dwrite d4/db/dd/f26 [0,4194304] 0 2024-04-23T14:49:47.618 INFO:tasks.workunit.client.1.smithi156.stdout:3/166: fsync d4/db/dd/d1d/d1e/f12 0 2024-04-23T14:49:47.621 INFO:tasks.workunit.client.0.smithi081.stdout:4/518: creat d1/d1d/d39/d8d/fad x:0 0 0 2024-04-23T14:49:47.623 INFO:tasks.workunit.client.1.smithi156.stdout:5/246: read d1/d11/d18/f28 [11649,124574] 0 2024-04-23T14:49:47.623 INFO:tasks.workunit.client.1.smithi156.stdout:9/161: dread d1/d2/d4/dc/f22 [0,4194304] 0 2024-04-23T14:49:47.623 INFO:tasks.workunit.client.1.smithi156.stdout:6/221: mkdir d3/d16/d46/d2b/d3b/d57 0 2024-04-23T14:49:47.623 INFO:tasks.workunit.client.1.smithi156.stdout:6/222: dread - d3/d16/d46/f40 zero size 2024-04-23T14:49:47.623 INFO:tasks.workunit.client.1.smithi156.stdout:6/223: dread - d3/f34 zero size 2024-04-23T14:49:47.629 INFO:tasks.workunit.client.1.smithi156.stdout:1/236: truncate db/d1f/d28/f37 638936 0 2024-04-23T14:49:47.629 INFO:tasks.workunit.client.1.smithi156.stdout:1/237: chown db/cc 69 1 2024-04-23T14:49:47.629 INFO:tasks.workunit.client.1.smithi156.stdout:1/238: fsync db/d15/f22 0 2024-04-23T14:49:47.630 INFO:tasks.workunit.client.0.smithi081.stdout:9/562: mkdir d3/de/d1d/d5b/d7b/db2 0 2024-04-23T14:49:47.632 INFO:tasks.workunit.client.0.smithi081.stdout:7/423: sync 2024-04-23T14:49:47.633 INFO:tasks.workunit.client.0.smithi081.stdout:7/424: creat d3/d21/d31/d33/d4b/d71/f8b x:0 0 0 2024-04-23T14:49:47.636 INFO:tasks.workunit.client.1.smithi156.stdout:4/163: rmdir d0/df/d1b/d2d 0 2024-04-23T14:49:47.636 INFO:tasks.workunit.client.0.smithi081.stdout:7/425: write d3/d21/d31/d33/d4b/d6e/f87 [77234,33686] 0 2024-04-23T14:49:47.639 INFO:tasks.workunit.client.0.smithi081.stdout:6/516: symlink d1/d51/d65/d8/db1/lbe 0 2024-04-23T14:49:47.643 INFO:tasks.workunit.client.0.smithi081.stdout:0/604: rename d6/d37/f60 to d6/d11/db0/fbe 0 2024-04-23T14:49:47.647 INFO:tasks.workunit.client.0.smithi081.stdout:9/563: dread d3/de/d14/f3d [0,4194304] 0 2024-04-23T14:49:47.653 INFO:tasks.workunit.client.1.smithi156.stdout:3/167: creat d4/f2a x:0 0 0 2024-04-23T14:49:47.659 INFO:tasks.workunit.client.0.smithi081.stdout:7/426: write d3/d11/d2c/f53 [311211,2599] 0 2024-04-23T14:49:47.660 INFO:tasks.workunit.client.0.smithi081.stdout:7/427: truncate d3/d11/d2c/d75/f3c 798857 0 2024-04-23T14:49:47.660 INFO:tasks.workunit.client.1.smithi156.stdout:7/177: dwrite dc/f11 [0,4194304] 0 2024-04-23T14:49:47.661 INFO:tasks.workunit.client.1.smithi156.stdout:1/239: write db/d15/f22 [2682868,6749] 0 2024-04-23T14:49:47.663 INFO:tasks.workunit.client.0.smithi081.stdout:2/601: unlink d1/d33/d45/f46 0 2024-04-23T14:49:47.663 INFO:tasks.workunit.client.0.smithi081.stdout:2/602: write d1/f87 [650433,41463] 0 2024-04-23T14:49:47.668 INFO:tasks.workunit.client.0.smithi081.stdout:8/745: dwrite d3/d11/d34/f40 [0,4194304] 0 2024-04-23T14:49:47.670 INFO:tasks.workunit.client.0.smithi081.stdout:5/556: mkdir d17/d1f/d42/d9b/dc9 0 2024-04-23T14:49:47.670 INFO:tasks.workunit.client.0.smithi081.stdout:5/557: write d17/d18/d3a/f71 [1513899,40181] 0 2024-04-23T14:49:47.670 INFO:tasks.workunit.client.0.smithi081.stdout:5/558: fsync d17/d1f/f23 0 2024-04-23T14:49:47.673 INFO:tasks.workunit.client.1.smithi156.stdout:5/247: rename d1/d11/f50 to d1/d3/d24/f57 0 2024-04-23T14:49:47.673 INFO:tasks.workunit.client.1.smithi156.stdout:2/188: mknod d4/c47 0 2024-04-23T14:49:47.674 INFO:tasks.workunit.client.1.smithi156.stdout:7/178: mknod dc/d1d/d26/c2b 0 2024-04-23T14:49:47.674 INFO:tasks.workunit.client.1.smithi156.stdout:7/179: write dc/f17 [1688870,30103] 0 2024-04-23T14:49:47.678 INFO:tasks.workunit.client.1.smithi156.stdout:5/248: dread d1/d17/f2e [0,4194304] 0 2024-04-23T14:49:47.678 INFO:tasks.workunit.client.1.smithi156.stdout:5/249: chown d1/d11/d18/d19/c2a 303701 1 2024-04-23T14:49:47.678 INFO:tasks.workunit.client.1.smithi156.stdout:5/250: chown d1/d17/f2e 17070377 1 2024-04-23T14:49:47.679 INFO:tasks.workunit.client.0.smithi081.stdout:4/519: truncate d1/d3/f71 2594719 0 2024-04-23T14:49:47.681 INFO:tasks.workunit.client.1.smithi156.stdout:1/240: mkdir db/d1f/d2f/d47 0 2024-04-23T14:49:47.683 INFO:tasks.workunit.client.0.smithi081.stdout:7/428: dread d3/d11/f1b [0,4194304] 0 2024-04-23T14:49:47.685 INFO:tasks.workunit.client.1.smithi156.stdout:7/180: dread dc/f19 [0,4194304] 0 2024-04-23T14:49:47.687 INFO:tasks.workunit.client.1.smithi156.stdout:6/224: rmdir d3/d16/d1e 39 2024-04-23T14:49:47.687 INFO:tasks.workunit.client.1.smithi156.stdout:6/225: write d3/d16/d1e/f53 [636523,16801] 0 2024-04-23T14:49:47.689 INFO:tasks.workunit.client.0.smithi081.stdout:6/517: dread d1/d51/d65/d13/d16/f32 [0,4194304] 0 2024-04-23T14:49:47.689 INFO:tasks.workunit.client.0.smithi081.stdout:6/518: stat d1/d2/d49/c57 0 2024-04-23T14:49:47.690 INFO:tasks.workunit.client.1.smithi156.stdout:0/184: dwrite d0/d4/d14/d1b/d2a/f12 [0,4194304] 0 2024-04-23T14:49:47.693 INFO:tasks.workunit.client.0.smithi081.stdout:9/564: symlink d3/de/d1d/d5b/lb3 0 2024-04-23T14:49:47.701 INFO:tasks.workunit.client.0.smithi081.stdout:8/746: creat d3/d11/d3e/ff5 x:0 0 0 2024-04-23T14:49:47.704 INFO:tasks.workunit.client.0.smithi081.stdout:4/520: mknod d1/d3/cae 0 2024-04-23T14:49:47.718 INFO:tasks.workunit.client.0.smithi081.stdout:7/429: rename d3/d11/d2c/d75/f51 to d3/d21/d31/d33/d4b/d4c/d4f/f8c 0 2024-04-23T14:49:47.722 INFO:tasks.workunit.client.0.smithi081.stdout:1/627: dwrite d3/fa [0,4194304] 0 2024-04-23T14:49:47.724 INFO:tasks.workunit.client.1.smithi156.stdout:3/168: dwrite d4/db/dd/f25 [0,4194304] 0 2024-04-23T14:49:47.726 INFO:tasks.workunit.client.0.smithi081.stdout:6/519: rename d1/d51/d65/f5c to d1/d51/d65/fbf 0 2024-04-23T14:49:47.731 INFO:tasks.workunit.client.1.smithi156.stdout:9/162: dwrite d1/d2/d4/d19/d2a/d30/f34 [0,4194304] 0 2024-04-23T14:49:47.744 INFO:tasks.workunit.client.0.smithi081.stdout:2/603: getdents d1/d1e 0 2024-04-23T14:49:47.744 INFO:tasks.workunit.client.0.smithi081.stdout:2/604: chown d1/f1c 25673787 1 2024-04-23T14:49:47.745 INFO:tasks.workunit.client.0.smithi081.stdout:3/461: write d4/d7/d7f/f65 [1522476,98166] 0 2024-04-23T14:49:47.751 INFO:tasks.workunit.client.0.smithi081.stdout:9/565: creat d3/de/d1d/d73/fb4 x:0 0 0 2024-04-23T14:49:47.751 INFO:tasks.workunit.client.0.smithi081.stdout:1/628: write d3/d3d/d41/d5e/d17/d58/f99 [1270176,79853] 0 2024-04-23T14:49:47.751 INFO:tasks.workunit.client.0.smithi081.stdout:5/559: dwrite d17/d1f/d36/daf/fc4 [0,4194304] 0 2024-04-23T14:49:47.751 INFO:tasks.workunit.client.0.smithi081.stdout:5/560: creat d17/d1f/d36/fca x:0 0 0 2024-04-23T14:49:47.751 INFO:tasks.workunit.client.1.smithi156.stdout:6/226: write d3/fd [848808,2896] 0 2024-04-23T14:49:47.752 INFO:tasks.workunit.client.1.smithi156.stdout:6/227: write d3/da/d1d/f21 [5162644,34887] 0 2024-04-23T14:49:47.752 INFO:tasks.workunit.client.1.smithi156.stdout:6/228: write d3/d16/f39 [426848,49121] 0 2024-04-23T14:49:47.753 INFO:tasks.workunit.client.0.smithi081.stdout:7/430: symlink d3/d21/d31/d33/l8d 0 2024-04-23T14:49:47.753 INFO:tasks.workunit.client.0.smithi081.stdout:7/431: chown d3/d11/d2c/d75/c61 467904 1 2024-04-23T14:49:47.754 INFO:tasks.workunit.client.0.smithi081.stdout:7/432: read - d3/d21/d31/d33/d4b/d71/f8b zero size 2024-04-23T14:49:47.754 INFO:tasks.workunit.client.0.smithi081.stdout:7/433: read - d3/d21/d31/d63/f74 zero size 2024-04-23T14:49:47.754 INFO:tasks.workunit.client.1.smithi156.stdout:3/169: read d4/db/dd/d1d/d1e/f12 [322871,5693] 0 2024-04-23T14:49:47.754 INFO:tasks.workunit.client.1.smithi156.stdout:3/170: stat d4/c11 0 2024-04-23T14:49:47.754 INFO:tasks.workunit.client.1.smithi156.stdout:3/171: chown d4/db/c29 165980 1 2024-04-23T14:49:47.754 INFO:tasks.workunit.client.1.smithi156.stdout:3/172: readlink d4/l8 0 2024-04-23T14:49:47.754 INFO:tasks.workunit.client.1.smithi156.stdout:9/163: dread d1/d2/d4/ff [0,4194304] 0 2024-04-23T14:49:47.757 INFO:tasks.workunit.client.1.smithi156.stdout:2/189: dwrite d4/d26/f44 [0,4194304] 0 2024-04-23T14:49:47.760 INFO:tasks.workunit.client.1.smithi156.stdout:4/164: dwrite d0/d8/d2c/f2e [0,4194304] 0 2024-04-23T14:49:47.768 INFO:tasks.workunit.client.1.smithi156.stdout:1/241: truncate db/f27 672593 0 2024-04-23T14:49:47.771 INFO:tasks.workunit.client.0.smithi081.stdout:6/520: symlink d1/d51/d65/d1c/d6e/d7d/lc0 0 2024-04-23T14:49:47.771 INFO:tasks.workunit.client.0.smithi081.stdout:2/605: symlink d1/d11/d21/d34/ld3 0 2024-04-23T14:49:47.771 INFO:tasks.workunit.client.0.smithi081.stdout:6/521: write d1/d51/d65/d1c/d6e/d7d/faf [351211,72247] 0 2024-04-23T14:49:47.772 INFO:tasks.workunit.client.1.smithi156.stdout:3/173: mkdir d4/db/dd/d1d/d1e/d2b 0 2024-04-23T14:49:47.773 INFO:tasks.workunit.client.0.smithi081.stdout:3/462: chown d4/d7/df/f1b 1528 1 2024-04-23T14:49:47.773 INFO:tasks.workunit.client.0.smithi081.stdout:3/463: readlink d4/d7/d49/d51/d84/l97 0 2024-04-23T14:49:47.773 INFO:tasks.workunit.client.0.smithi081.stdout:3/464: read d4/dc/f55 [931431,2422] 0 2024-04-23T14:49:47.775 INFO:tasks.workunit.client.1.smithi156.stdout:9/164: unlink d1/d2/d4/dc/c16 0 2024-04-23T14:49:47.777 INFO:tasks.workunit.client.0.smithi081.stdout:8/747: dwrite d3/d11/d4f/d58/fd7 [0,4194304] 0 2024-04-23T14:49:47.777 INFO:tasks.workunit.client.0.smithi081.stdout:8/748: chown d3/d11/d4f/d6c/c93 7 1 2024-04-23T14:49:47.777 INFO:tasks.workunit.client.0.smithi081.stdout:8/749: dread - d3/dc6/fd2 zero size 2024-04-23T14:49:47.780 INFO:tasks.workunit.client.1.smithi156.stdout:7/181: dwrite dc/f11 [0,4194304] 0 2024-04-23T14:49:47.793 INFO:tasks.workunit.client.0.smithi081.stdout:9/566: dwrite d3/de/d14/f2c [0,4194304] 0 2024-04-23T14:49:47.802 INFO:tasks.workunit.client.0.smithi081.stdout:7/434: mkdir d3/d11/d2c/d75/d8e 0 2024-04-23T14:49:47.811 INFO:tasks.workunit.client.0.smithi081.stdout:1/629: dread d3/d3d/d41/d4a/f39 [0,4194304] 0 2024-04-23T14:49:47.811 INFO:tasks.workunit.client.0.smithi081.stdout:1/630: fdatasync d3/d3d/d41/f42 0 2024-04-23T14:49:47.813 INFO:tasks.workunit.client.0.smithi081.stdout:5/561: dwrite d17/d3d/d7a/fa6 [4194304,4194304] 0 2024-04-23T14:49:47.815 INFO:tasks.workunit.client.1.smithi156.stdout:6/229: dwrite d3/fd [4194304,4194304] 0 2024-04-23T14:49:47.815 INFO:tasks.workunit.client.1.smithi156.stdout:6/230: read - d3/d16/d46/f40 zero size 2024-04-23T14:49:47.815 INFO:tasks.workunit.client.1.smithi156.stdout:6/231: chown d3/d16/f3c 495234227 1 2024-04-23T14:49:47.818 INFO:tasks.workunit.client.1.smithi156.stdout:1/242: dwrite db/f17 [4194304,4194304] 0 2024-04-23T14:49:47.822 INFO:tasks.workunit.client.0.smithi081.stdout:3/465: mknod d4/d41/c99 0 2024-04-23T14:49:47.822 INFO:tasks.workunit.client.0.smithi081.stdout:3/466: chown d4/d7/df/f35 3526305 1 2024-04-23T14:49:47.822 INFO:tasks.workunit.client.0.smithi081.stdout:3/467: stat d4/dc/d10/c25 0 2024-04-23T14:49:47.823 INFO:tasks.workunit.client.0.smithi081.stdout:8/750: creat d3/d3c/ddb/df3/ff6 x:0 0 0 2024-04-23T14:49:47.832 INFO:tasks.workunit.client.0.smithi081.stdout:9/567: mkdir d3/de/d76/db5 0 2024-04-23T14:49:47.835 INFO:tasks.workunit.client.0.smithi081.stdout:7/435: creat d3/d21/d41/d7c/f8f x:0 0 0 2024-04-23T14:49:47.836 INFO:tasks.workunit.client.0.smithi081.stdout:4/521: rename d1/d3 to d1/d4/d6f/d70/daf 0 2024-04-23T14:49:47.836 INFO:tasks.workunit.client.1.smithi156.stdout:5/251: rmdir d1 39 2024-04-23T14:49:47.837 INFO:tasks.workunit.client.0.smithi081.stdout:6/522: getdents d1/d51/d65/d8/d2e 0 2024-04-23T14:49:47.837 INFO:tasks.workunit.client.0.smithi081.stdout:6/523: write d1/d51/d65/d1c/d6e/d7d/faf [1056683,101848] 0 2024-04-23T14:49:47.837 INFO:tasks.workunit.client.0.smithi081.stdout:6/524: dread - d1/d51/d54/f8c zero size 2024-04-23T14:49:47.837 INFO:tasks.workunit.client.1.smithi156.stdout:6/232: write d3/fd [5007756,71247] 0 2024-04-23T14:49:47.838 INFO:tasks.workunit.client.1.smithi156.stdout:4/165: mkdir d0/df/d21/d36 0 2024-04-23T14:49:47.838 INFO:tasks.workunit.client.1.smithi156.stdout:4/166: chown d0/d8/c24 127616604 1 2024-04-23T14:49:47.839 INFO:tasks.workunit.client.1.smithi156.stdout:4/167: stat d0/d8/fc 0 2024-04-23T14:49:47.839 INFO:tasks.workunit.client.0.smithi081.stdout:2/606: dwrite d1/d11/dab/fa0 [0,4194304] 0 2024-04-23T14:49:47.840 INFO:tasks.workunit.client.1.smithi156.stdout:0/185: rename d0/d4/d14/d1b to d0/d16/d3a 0 2024-04-23T14:49:47.840 INFO:tasks.workunit.client.1.smithi156.stdout:0/186: fsync d0/d4/d14/f35 0 2024-04-23T14:49:47.840 INFO:tasks.workunit.client.1.smithi156.stdout:0/187: truncate d0/d16/d3a/d2a/d1d/d2d/f2f 69999 0 2024-04-23T14:49:47.843 INFO:tasks.workunit.client.1.smithi156.stdout:9/165: creat d1/d2/d23/d2f/f3b x:0 0 0 2024-04-23T14:49:47.843 INFO:tasks.workunit.client.1.smithi156.stdout:8/174: sync 2024-04-23T14:49:47.845 INFO:tasks.workunit.client.1.smithi156.stdout:7/182: truncate fb 2788693 0 2024-04-23T14:49:47.848 INFO:tasks.workunit.client.0.smithi081.stdout:7/436: dread d3/d21/d31/d50/f62 [0,4194304] 0 2024-04-23T14:49:47.848 INFO:tasks.workunit.client.0.smithi081.stdout:9/568: truncate d3/d5/f41 59181 0 2024-04-23T14:49:47.848 INFO:tasks.workunit.client.1.smithi156.stdout:2/190: symlink d4/d21/d42/l48 0 2024-04-23T14:49:47.851 INFO:tasks.workunit.client.0.smithi081.stdout:5/562: getdents d17/d3c/d55/d64 0 2024-04-23T14:49:47.852 INFO:tasks.workunit.client.0.smithi081.stdout:4/522: write d1/d4/dc/f21 [1189839,33618] 0 2024-04-23T14:49:47.856 INFO:tasks.workunit.client.0.smithi081.stdout:6/525: rmdir d1/d51/d65/d13/d16/dbb 0 2024-04-23T14:49:47.862 INFO:tasks.workunit.client.0.smithi081.stdout:2/607: dread d1/d11/d21/d34/f76 [0,4194304] 0 2024-04-23T14:49:47.863 INFO:tasks.workunit.client.1.smithi156.stdout:4/168: read d0/d8/f2f [2961669,125078] 0 2024-04-23T14:49:47.864 INFO:tasks.workunit.client.1.smithi156.stdout:7/183: write dc/d1d/f23 [441957,93322] 0 2024-04-23T14:49:47.864 INFO:tasks.workunit.client.1.smithi156.stdout:1/243: mkdir db/d1f/d2d/d48 0 2024-04-23T14:49:47.864 INFO:tasks.workunit.client.1.smithi156.stdout:1/244: dread - db/d1f/d28/f44 zero size 2024-04-23T14:49:47.873 INFO:tasks.workunit.client.1.smithi156.stdout:5/252: rmdir d1/d11 39 2024-04-23T14:49:47.873 INFO:tasks.workunit.client.1.smithi156.stdout:5/253: chown d1/l4 31623109 1 2024-04-23T14:49:47.875 INFO:tasks.workunit.client.0.smithi081.stdout:3/468: dwrite d4/dc/d31/f74 [0,4194304] 0 2024-04-23T14:49:47.889 INFO:tasks.workunit.client.0.smithi081.stdout:9/569: write d3/de/d14/f3d [2700979,64018] 0 2024-04-23T14:49:47.890 INFO:tasks.workunit.client.1.smithi156.stdout:1/245: write db/d25/f3d [775454,84175] 0 2024-04-23T14:49:47.890 INFO:tasks.workunit.client.1.smithi156.stdout:3/174: rename d4/db/c15 to d4/db/dd/d1d/d1e/d13/c2c 0 2024-04-23T14:49:47.891 INFO:tasks.workunit.client.1.smithi156.stdout:6/233: creat d3/da/d1d/d27/f58 x:0 0 0 2024-04-23T14:49:47.891 INFO:tasks.workunit.client.1.smithi156.stdout:0/188: getdents d0 0 2024-04-23T14:49:47.892 INFO:tasks.workunit.client.1.smithi156.stdout:8/175: unlink d5/d9/d10/f25 0 2024-04-23T14:49:47.895 INFO:tasks.workunit.client.1.smithi156.stdout:2/191: creat d4/d21/d2f/f49 x:0 0 0 2024-04-23T14:49:47.899 INFO:tasks.workunit.client.1.smithi156.stdout:6/234: mkdir d3/da/d1d/d59 0 2024-04-23T14:49:47.899 INFO:tasks.workunit.client.1.smithi156.stdout:6/235: chown d3/f34 5 1 2024-04-23T14:49:47.899 INFO:tasks.workunit.client.1.smithi156.stdout:6/236: stat d3/da/d1d/f56 0 2024-04-23T14:49:47.903 INFO:tasks.workunit.client.1.smithi156.stdout:0/189: unlink d0/f7 0 2024-04-23T14:49:47.905 INFO:tasks.workunit.client.0.smithi081.stdout:7/437: symlink d3/d21/d31/d63/l90 0 2024-04-23T14:49:47.905 INFO:tasks.workunit.client.0.smithi081.stdout:7/438: stat d3/d21/d31/d33/l73 0 2024-04-23T14:49:47.905 INFO:tasks.workunit.client.0.smithi081.stdout:7/439: dread - d3/d21/d31/d33/d4b/d71/f8b zero size 2024-04-23T14:49:47.905 INFO:tasks.workunit.client.0.smithi081.stdout:7/440: chown d3/d20/c66 2462550 1 2024-04-23T14:49:47.906 INFO:tasks.workunit.client.0.smithi081.stdout:7/441: fdatasync d3/d21/d31/d50/d5a/f78 0 2024-04-23T14:49:47.908 INFO:tasks.workunit.client.0.smithi081.stdout:5/563: rmdir d17/d4f 39 2024-04-23T14:49:47.912 INFO:tasks.workunit.client.0.smithi081.stdout:4/523: rmdir d1/d4/d11/d9d/dac 39 2024-04-23T14:49:47.912 INFO:tasks.workunit.client.0.smithi081.stdout:4/524: fdatasync d1/d4/f38 0 2024-04-23T14:49:47.913 INFO:tasks.workunit.client.0.smithi081.stdout:4/525: write d1/d1d/d59/f85 [1360517,129244] 0 2024-04-23T14:49:47.913 INFO:tasks.workunit.client.1.smithi156.stdout:7/184: truncate fb 2600661 0 2024-04-23T14:49:47.913 INFO:tasks.workunit.client.1.smithi156.stdout:3/175: write d4/db/dd/f25 [1249189,40844] 0 2024-04-23T14:49:47.913 INFO:tasks.workunit.client.1.smithi156.stdout:3/176: truncate d4/db/dd/f26 4886094 0 2024-04-23T14:49:47.913 INFO:tasks.workunit.client.1.smithi156.stdout:6/237: creat d3/d16/f5a x:0 0 0 2024-04-23T14:49:47.914 INFO:tasks.workunit.client.1.smithi156.stdout:6/238: dread - d3/d16/d46/f40 zero size 2024-04-23T14:49:47.914 INFO:tasks.workunit.client.1.smithi156.stdout:6/239: dread - d3/da/d1d/d27/f51 zero size 2024-04-23T14:49:47.915 INFO:tasks.workunit.client.0.smithi081.stdout:6/526: mkdir d1/d51/d65/d1c/d6e/da0/da1/dc1 0 2024-04-23T14:49:47.917 INFO:tasks.workunit.client.0.smithi081.stdout:2/608: creat d1/d33/d45/fd4 x:0 0 0 2024-04-23T14:49:47.928 INFO:tasks.workunit.client.0.smithi081.stdout:1/631: dwrite d3/d3d/d41/d5e/d17/d58/f99 [4194304,4194304] 0 2024-04-23T14:49:47.931 INFO:tasks.workunit.client.1.smithi156.stdout:1/246: write db/f17 [6093539,104922] 0 2024-04-23T14:49:47.935 INFO:tasks.workunit.client.1.smithi156.stdout:8/176: rmdir d5/d9 39 2024-04-23T14:49:47.941 INFO:tasks.workunit.client.0.smithi081.stdout:5/564: creat d17/d1f/d42/d9b/d9e/da3/fcb x:0 0 0 2024-04-23T14:49:47.943 INFO:tasks.workunit.client.0.smithi081.stdout:4/526: symlink d1/d4/d6f/d70/daf/d8c/lb0 0 2024-04-23T14:49:47.950 INFO:tasks.workunit.client.0.smithi081.stdout:2/609: unlink d1/d11/d21/d34/f73 0 2024-04-23T14:49:47.950 INFO:tasks.workunit.client.0.smithi081.stdout:2/610: creat d1/d33/d45/fd5 x:0 0 0 2024-04-23T14:49:47.950 INFO:tasks.workunit.client.0.smithi081.stdout:2/611: fdatasync d1/d33/f71 0 2024-04-23T14:49:47.950 INFO:tasks.workunit.client.1.smithi156.stdout:4/169: dwrite d0/df/f14 [0,4194304] 0 2024-04-23T14:49:47.951 INFO:tasks.workunit.client.0.smithi081.stdout:3/469: dread d4/f5b [0,4194304] 0 2024-04-23T14:49:47.953 INFO:tasks.workunit.client.0.smithi081.stdout:1/632: creat d3/d3d/d41/fcc x:0 0 0 2024-04-23T14:49:47.957 INFO:tasks.workunit.client.0.smithi081.stdout:5/565: rmdir d17/d37 39 2024-04-23T14:49:47.958 INFO:tasks.workunit.client.1.smithi156.stdout:2/192: unlink d4/c11 0 2024-04-23T14:49:47.958 INFO:tasks.workunit.client.1.smithi156.stdout:7/185: rmdir dc/d1d/d24 39 2024-04-23T14:49:47.958 INFO:tasks.workunit.client.1.smithi156.stdout:6/240: symlink d3/d16/l5b 0 2024-04-23T14:49:47.959 INFO:tasks.workunit.client.0.smithi081.stdout:7/442: mknod d3/d21/d31/c91 0 2024-04-23T14:49:47.959 INFO:tasks.workunit.client.0.smithi081.stdout:8/751: dwrite d3/d11/d48/f4b [0,4194304] 0 2024-04-23T14:49:47.960 INFO:tasks.workunit.client.1.smithi156.stdout:8/177: creat d5/d9/d36/f3e x:0 0 0 2024-04-23T14:49:47.962 INFO:tasks.workunit.client.0.smithi081.stdout:4/527: getdents d1/d4/d11 0 2024-04-23T14:49:47.968 INFO:tasks.workunit.client.1.smithi156.stdout:2/193: write d4/d13/d19/f1e [403360,26600] 0 2024-04-23T14:49:47.972 INFO:tasks.workunit.client.0.smithi081.stdout:7/443: creat d3/d21/d31/d33/d4b/f92 x:0 0 0 2024-04-23T14:49:47.972 INFO:tasks.workunit.client.0.smithi081.stdout:7/444: truncate d3/d11/d56/d7f/f88 939539 0 2024-04-23T14:49:47.973 INFO:tasks.workunit.client.1.smithi156.stdout:7/186: rename dc/d1d/d26 to dc/d2c 0 2024-04-23T14:49:47.974 INFO:tasks.workunit.client.0.smithi081.stdout:8/752: truncate d3/f4a 3907260 0 2024-04-23T14:49:47.975 INFO:tasks.workunit.client.1.smithi156.stdout:8/178: symlink d5/l3f 0 2024-04-23T14:49:47.978 INFO:tasks.workunit.client.0.smithi081.stdout:4/528: unlink d1/d1d/c24 0 2024-04-23T14:49:47.980 INFO:tasks.workunit.client.0.smithi081.stdout:4/529: fdatasync d1/f29 0 2024-04-23T14:49:47.980 INFO:tasks.workunit.client.0.smithi081.stdout:5/566: getdents d17/d4f/d61 0 2024-04-23T14:49:47.980 INFO:tasks.workunit.client.0.smithi081.stdout:5/567: stat d17/d3d/d7a/fa6 0 2024-04-23T14:49:47.981 INFO:tasks.workunit.client.0.smithi081.stdout:1/633: read d3/d3d/d6f/f62 [3052669,66173] 0 2024-04-23T14:49:47.982 INFO:tasks.workunit.client.1.smithi156.stdout:6/241: read d3/d16/f37 [2858280,33680] 0 2024-04-23T14:49:47.982 INFO:tasks.workunit.client.1.smithi156.stdout:4/170: getdents d0/df 0 2024-04-23T14:49:47.984 INFO:tasks.workunit.client.0.smithi081.stdout:3/470: dread d4/d7/df/f5e [0,4194304] 0 2024-04-23T14:49:47.989 INFO:tasks.workunit.client.0.smithi081.stdout:9/570: dwrite d3/d5/f16 [8388608,4194304] 0 2024-04-23T14:49:47.989 INFO:tasks.workunit.client.0.smithi081.stdout:9/571: write d3/de/d1d/d5b/f7f [4897,36079] 0 2024-04-23T14:49:47.994 INFO:tasks.workunit.client.1.smithi156.stdout:9/166: write d1/d2/d4/d19/d2a/d30/f34 [151744,91716] 0 2024-04-23T14:49:47.994 INFO:tasks.workunit.client.1.smithi156.stdout:9/167: chown d1 70 1 2024-04-23T14:49:47.994 INFO:tasks.workunit.client.1.smithi156.stdout:9/168: chown d1/d2/l2b 57 1 2024-04-23T14:49:47.995 INFO:tasks.workunit.client.1.smithi156.stdout:5/254: dwrite d1/f3f [0,4194304] 0 2024-04-23T14:49:47.996 INFO:tasks.workunit.client.0.smithi081.stdout:8/753: rename d3/d11/d3e/d63/f73 to d3/d11/d34/dab/ff7 0 2024-04-23T14:49:47.996 INFO:tasks.workunit.client.0.smithi081.stdout:8/754: chown d3/d11/d48/d7e/de4 44524 1 2024-04-23T14:49:47.996 INFO:tasks.workunit.client.0.smithi081.stdout:8/755: chown d3/d11/d48/d7e/de4/df0 1841 1 2024-04-23T14:49:47.996 INFO:tasks.workunit.client.0.smithi081.stdout:6/527: rmdir d1/d2/d49/d52/d5f 0 2024-04-23T14:49:48.004 INFO:tasks.workunit.client.0.smithi081.stdout:5/568: mkdir d17/d3c/d55/d64/dcc 0 2024-04-23T14:49:48.008 INFO:tasks.workunit.client.1.smithi156.stdout:4/171: write d0/df/f14 [3859467,98808] 0 2024-04-23T14:49:48.011 INFO:tasks.workunit.client.0.smithi081.stdout:7/445: symlink d3/d21/d31/l93 0 2024-04-23T14:49:48.013 INFO:tasks.workunit.client.1.smithi156.stdout:7/187: link ca dc/d2a/c2d 0 2024-04-23T14:49:48.019 INFO:tasks.workunit.client.1.smithi156.stdout:3/177: dwrite d4/f2a [0,4194304] 0 2024-04-23T14:49:48.029 INFO:tasks.workunit.client.1.smithi156.stdout:8/179: creat d5/d9/d10/d1d/d21/f40 x:0 0 0 2024-04-23T14:49:48.029 INFO:tasks.workunit.client.1.smithi156.stdout:8/180: write d5/d9/d10/d1d/d21/f22 [879469,112620] 0 2024-04-23T14:49:48.029 INFO:tasks.workunit.client.1.smithi156.stdout:8/181: chown d5/d9/d10/d1d/d21/f40 46 1 2024-04-23T14:49:48.032 INFO:tasks.workunit.client.0.smithi081.stdout:8/756: dread d3/f2c [0,4194304] 0 2024-04-23T14:49:48.033 INFO:tasks.workunit.client.0.smithi081.stdout:3/471: mkdir d4/dc/d50/d9a 0 2024-04-23T14:49:48.037 INFO:tasks.workunit.client.1.smithi156.stdout:6/242: mkdir d3/d16/d5c 0 2024-04-23T14:49:48.041 INFO:tasks.workunit.client.0.smithi081.stdout:1/634: dwrite d3/d3d/d41/d92/fbc [0,4194304] 0 2024-04-23T14:49:48.043 INFO:tasks.workunit.client.1.smithi156.stdout:8/182: write d5/f1c [1675260,111420] 0 2024-04-23T14:49:48.048 INFO:tasks.workunit.client.0.smithi081.stdout:9/572: creat d3/d67/d77/fb6 x:0 0 0 2024-04-23T14:49:48.051 INFO:tasks.workunit.client.0.smithi081.stdout:8/757: dread d3/d11/d3e/fbb [0,4194304] 0 2024-04-23T14:49:48.054 INFO:tasks.workunit.client.0.smithi081.stdout:7/446: mknod d3/d11/d2c/d75/c94 0 2024-04-23T14:49:48.054 INFO:tasks.workunit.client.0.smithi081.stdout:7/447: fsync d3/d11/d2c/d75/f5c 0 2024-04-23T14:49:48.054 INFO:tasks.workunit.client.0.smithi081.stdout:7/448: fsync d3/d11/d2c/d75/f5c 0 2024-04-23T14:49:48.054 INFO:tasks.workunit.client.0.smithi081.stdout:7/449: creat d3/d11/d56/d7f/f95 x:0 0 0 2024-04-23T14:49:48.056 INFO:tasks.workunit.client.0.smithi081.stdout:2/612: dwrite d1/d33/d45/d6e/d96/f69 [0,4194304] 0 2024-04-23T14:49:48.056 INFO:tasks.workunit.client.0.smithi081.stdout:2/613: fsync d1/d11/d21/d52/f75 0 2024-04-23T14:49:48.057 INFO:tasks.workunit.client.1.smithi156.stdout:9/169: mkdir d1/d2/d4/d19/d2a/d3c 0 2024-04-23T14:49:48.076 INFO:tasks.workunit.client.0.smithi081.stdout:9/573: dread d3/de/d22/f5d [0,4194304] 0 2024-04-23T14:49:48.076 INFO:tasks.workunit.client.0.smithi081.stdout:3/472: creat d4/dc/d50/d9a/f9b x:0 0 0 2024-04-23T14:49:48.080 INFO:tasks.workunit.client.0.smithi081.stdout:1/635: truncate d3/d3d/d41/d4a/f39 474767 0 2024-04-23T14:49:48.085 INFO:tasks.workunit.client.0.smithi081.stdout:7/450: symlink d3/d11/d56/d7f/l96 0 2024-04-23T14:49:48.088 INFO:tasks.workunit.client.0.smithi081.stdout:6/528: dwrite d1/d51/d65/d13/f3e [0,4194304] 0 2024-04-23T14:49:48.096 INFO:tasks.workunit.client.1.smithi156.stdout:4/172: dwrite d0/df/f25 [0,4194304] 0 2024-04-23T14:49:48.096 INFO:tasks.workunit.client.1.smithi156.stdout:4/173: chown d0 1005 1 2024-04-23T14:49:48.098 INFO:tasks.workunit.client.1.smithi156.stdout:2/194: rename d4/ca to d4/d26/d3c/c4a 0 2024-04-23T14:49:48.101 INFO:tasks.workunit.client.0.smithi081.stdout:0/605: sync 2024-04-23T14:49:48.107 INFO:tasks.workunit.client.1.smithi156.stdout:3/178: dwrite d4/db/dd/d20/f23 [0,4194304] 0 2024-04-23T14:49:48.111 INFO:tasks.workunit.client.0.smithi081.stdout:5/569: dwrite d17/d1f/d42/f97 [0,4194304] 0 2024-04-23T14:49:48.112 INFO:tasks.workunit.client.0.smithi081.stdout:1/636: creat d3/d3d/d41/d4a/d77/fcd x:0 0 0 2024-04-23T14:49:48.112 INFO:tasks.workunit.client.0.smithi081.stdout:5/570: creat d17/d1f/d36/fcd x:0 0 0 2024-04-23T14:49:48.114 INFO:tasks.workunit.client.1.smithi156.stdout:7/188: rmdir dc/d1d/d24 39 2024-04-23T14:49:48.116 INFO:tasks.workunit.client.0.smithi081.stdout:6/529: mkdir d1/d51/d65/d8/d2e/d58/dc2 0 2024-04-23T14:49:48.116 INFO:tasks.workunit.client.0.smithi081.stdout:6/530: readlink d1/d2/d8e/d98/lb0 0 2024-04-23T14:49:48.122 INFO:tasks.workunit.client.0.smithi081.stdout:0/606: creat d6/d11/d14/db8/fbf x:0 0 0 2024-04-23T14:49:48.125 INFO:tasks.workunit.client.1.smithi156.stdout:6/243: symlink d3/d16/d46/d2b/d3b/l5d 0 2024-04-23T14:49:48.127 INFO:tasks.workunit.client.0.smithi081.stdout:3/473: write d4/d7/d2e/f8b [1417653,72436] 0 2024-04-23T14:49:48.129 INFO:tasks.workunit.client.1.smithi156.stdout:8/183: unlink d5/d9/c2a 0 2024-04-23T14:49:48.131 INFO:tasks.workunit.client.0.smithi081.stdout:1/637: mknod d3/d3d/d41/d5e/d1d/cce 0 2024-04-23T14:49:48.131 INFO:tasks.workunit.client.0.smithi081.stdout:1/638: write d3/d3d/d41/d5e/d12/d1a/f86 [169930,53791] 0 2024-04-23T14:49:48.131 INFO:tasks.workunit.client.0.smithi081.stdout:1/639: fdatasync d3/f5 0 2024-04-23T14:49:48.135 INFO:tasks.workunit.client.0.smithi081.stdout:5/571: mknod d17/d18/cce 0 2024-04-23T14:49:48.135 INFO:tasks.workunit.client.0.smithi081.stdout:6/531: rename d1/d2/f6d to d1/d51/d65/d1c/d6e/da0/fc3 0 2024-04-23T14:49:48.135 INFO:tasks.workunit.client.0.smithi081.stdout:6/532: write d1/d51/d65/d8/d2e/d59/f94 [1229869,106309] 0 2024-04-23T14:49:48.144 INFO:tasks.workunit.client.0.smithi081.stdout:0/607: truncate d6/d37/f38 1122904 0 2024-04-23T14:49:48.144 INFO:tasks.workunit.client.0.smithi081.stdout:0/608: chown d6/d11/d14/d24 35829 1 2024-04-23T14:49:48.144 INFO:tasks.workunit.client.0.smithi081.stdout:0/609: dread - d6/d11/d14/d41/d5b/d3f/d44/f8f zero size 2024-04-23T14:49:48.144 INFO:tasks.workunit.client.0.smithi081.stdout:0/610: stat d6/d11/d14/d41/d5b/d3f/d44/f86 0 2024-04-23T14:49:48.144 INFO:tasks.workunit.client.0.smithi081.stdout:5/572: mknod d17/d3c/d55/ccf 0 2024-04-23T14:49:48.153 INFO:tasks.workunit.client.1.smithi156.stdout:4/174: rename d0/df/c1d to d0/d8/d1e/c37 0 2024-04-23T14:49:48.153 INFO:tasks.workunit.client.1.smithi156.stdout:2/195: chown d4/c47 0 1 2024-04-23T14:49:48.153 INFO:tasks.workunit.client.1.smithi156.stdout:3/179: symlink d4/db/dd/d20/l2d 0 2024-04-23T14:49:48.153 INFO:tasks.workunit.client.0.smithi081.stdout:6/533: link d1/d51/d65/l1f d1/d51/d65/d8/d2e/d58/dc2/lc4 0 2024-04-23T14:49:48.153 INFO:tasks.workunit.client.0.smithi081.stdout:6/534: truncate d1/d51/d65/fbf 4784047 0 2024-04-23T14:49:48.153 INFO:tasks.workunit.client.0.smithi081.stdout:6/535: readlink d1/d2/d5a/l60 0 2024-04-23T14:49:48.153 INFO:tasks.workunit.client.0.smithi081.stdout:5/573: symlink d17/d1f/da5/ld0 0 2024-04-23T14:49:48.156 INFO:tasks.workunit.client.1.smithi156.stdout:7/189: rename dc/f11 to dc/d1d/d24/f2e 0 2024-04-23T14:49:48.156 INFO:tasks.workunit.client.1.smithi156.stdout:7/190: write dc/f17 [3203531,53131] 0 2024-04-23T14:49:48.157 INFO:tasks.workunit.client.1.smithi156.stdout:7/191: write dc/d1d/d24/f27 [892405,45874] 0 2024-04-23T14:49:48.158 INFO:tasks.workunit.client.0.smithi081.stdout:6/536: mknod d1/d51/d65/d8/d2e/d58/cc5 0 2024-04-23T14:49:48.159 INFO:tasks.workunit.client.1.smithi156.stdout:2/196: chown d4/l12 4085 1 2024-04-23T14:49:48.161 INFO:tasks.workunit.client.0.smithi081.stdout:9/574: dwrite d3/f8 [4194304,4194304] 0 2024-04-23T14:49:48.161 INFO:tasks.workunit.client.0.smithi081.stdout:5/574: truncate d17/d3d/f49 3617635 0 2024-04-23T14:49:48.161 INFO:tasks.workunit.client.0.smithi081.stdout:5/575: fdatasync d17/d18/f33 0 2024-04-23T14:49:48.161 INFO:tasks.workunit.client.0.smithi081.stdout:5/576: fdatasync d17/d18/d3a/d8e/f90 0 2024-04-23T14:49:48.164 INFO:tasks.workunit.client.1.smithi156.stdout:9/170: rmdir d1/d2/d4/d17 39 2024-04-23T14:49:48.164 INFO:tasks.workunit.client.1.smithi156.stdout:7/192: symlink dc/d1d/l2f 0 2024-04-23T14:49:48.165 INFO:tasks.workunit.client.1.smithi156.stdout:6/244: rename d3/c29 to d3/d16/d1e/c5e 0 2024-04-23T14:49:48.168 INFO:tasks.workunit.client.0.smithi081.stdout:8/758: dwrite d3/d11/d4f/faa [0,4194304] 0 2024-04-23T14:49:48.172 INFO:tasks.workunit.client.0.smithi081.stdout:5/577: unlink d17/l5a 0 2024-04-23T14:49:48.174 INFO:tasks.workunit.client.1.smithi156.stdout:7/193: truncate fb 2361930 0 2024-04-23T14:49:48.175 INFO:tasks.workunit.client.1.smithi156.stdout:7/194: write dc/f1c [606699,96009] 0 2024-04-23T14:49:48.178 INFO:tasks.workunit.client.0.smithi081.stdout:2/614: dread d1/d11/d21/f3b [0,4194304] 0 2024-04-23T14:49:48.190 INFO:tasks.workunit.client.1.smithi156.stdout:2/197: rename d4/d13/d19/f33 to d4/d13/f4b 0 2024-04-23T14:49:48.190 INFO:tasks.workunit.client.1.smithi156.stdout:3/180: write d4/f2a [4214943,94971] 0 2024-04-23T14:49:48.210 INFO:tasks.workunit.client.0.smithi081.stdout:8/759: mknod d3/d11/cf8 0 2024-04-23T14:49:48.210 INFO:tasks.workunit.client.0.smithi081.stdout:8/760: dread - d3/d11/d86/fdf zero size 2024-04-23T14:49:48.210 INFO:tasks.workunit.client.0.smithi081.stdout:8/761: getdents d3/d11/d34 0 2024-04-23T14:49:48.211 INFO:tasks.workunit.client.0.smithi081.stdout:9/575: dread d3/de/d1d/d54/f6a [0,4194304] 0 2024-04-23T14:49:48.211 INFO:tasks.workunit.client.1.smithi156.stdout:7/195: symlink dc/d2c/l30 0 2024-04-23T14:49:48.211 INFO:tasks.workunit.client.1.smithi156.stdout:7/196: chown ca 2795 1 2024-04-23T14:49:48.212 INFO:tasks.workunit.client.0.smithi081.stdout:9/576: chown d3/de/d1d/l98 52712252 1 2024-04-23T14:49:48.212 INFO:tasks.workunit.client.0.smithi081.stdout:7/451: dwrite d3/f10 [0,4194304] 0 2024-04-23T14:49:48.213 INFO:tasks.workunit.client.1.smithi156.stdout:6/245: getdents d3/da 0 2024-04-23T14:49:48.213 INFO:tasks.workunit.client.1.smithi156.stdout:6/246: stat d3/da/d1d/d27 0 2024-04-23T14:49:48.213 INFO:tasks.workunit.client.1.smithi156.stdout:6/247: write d3/f4e [253845,55199] 0 2024-04-23T14:49:48.213 INFO:tasks.workunit.client.1.smithi156.stdout:6/248: fdatasync d3/d16/d1e/f53 0 2024-04-23T14:49:48.213 INFO:tasks.workunit.client.1.smithi156.stdout:6/249: fdatasync d3/da/d1d/d27/f58 0 2024-04-23T14:49:48.214 INFO:tasks.workunit.client.0.smithi081.stdout:3/474: write d4/d7/d32/f33 [4020201,33439] 0 2024-04-23T14:49:48.214 INFO:tasks.workunit.client.0.smithi081.stdout:3/475: creat d4/d7/d32/f9c x:0 0 0 2024-04-23T14:49:48.223 INFO:tasks.workunit.client.1.smithi156.stdout:1/247: sync 2024-04-23T14:49:48.223 INFO:tasks.workunit.client.1.smithi156.stdout:5/255: sync 2024-04-23T14:49:48.223 INFO:tasks.workunit.client.1.smithi156.stdout:0/190: sync 2024-04-23T14:49:48.228 INFO:tasks.workunit.client.0.smithi081.stdout:8/762: rename d3/d11/d34/dab/lca to d3/d11/d86/d88/da7/de0/lf9 0 2024-04-23T14:49:48.230 INFO:tasks.workunit.client.1.smithi156.stdout:1/248: read db/d1f/f41 [591220,109842] 0 2024-04-23T14:49:48.232 INFO:tasks.workunit.client.1.smithi156.stdout:7/197: write f6 [2431024,13154] 0 2024-04-23T14:49:48.236 INFO:tasks.workunit.client.1.smithi156.stdout:4/175: dwrite d0/d8/d2c/f2e [0,4194304] 0 2024-04-23T14:49:48.236 INFO:tasks.workunit.client.0.smithi081.stdout:6/537: dwrite d1/f2a [0,4194304] 0 2024-04-23T14:49:48.237 INFO:tasks.workunit.client.0.smithi081.stdout:6/538: stat d1/c72 0 2024-04-23T14:49:48.237 INFO:tasks.workunit.client.1.smithi156.stdout:8/184: dwrite d5/d9/d10/d1d/d21/f2f [0,4194304] 0 2024-04-23T14:49:48.241 INFO:tasks.workunit.client.0.smithi081.stdout:1/640: dwrite d3/d3d/d41/d5e/d17/f20 [0,4194304] 0 2024-04-23T14:49:48.241 INFO:tasks.workunit.client.0.smithi081.stdout:0/611: dwrite d6/f2d [0,4194304] 0 2024-04-23T14:49:48.247 INFO:tasks.workunit.client.1.smithi156.stdout:9/171: link d1/d2/d4/ff d1/d2/d4/f3d 0 2024-04-23T14:49:48.247 INFO:tasks.workunit.client.1.smithi156.stdout:8/185: write d5/d9/d10/d1d/d21/f22 [992640,28460] 0 2024-04-23T14:49:48.248 INFO:tasks.workunit.client.1.smithi156.stdout:8/186: chown d5/l3f 4 1 2024-04-23T14:49:48.248 INFO:tasks.workunit.client.1.smithi156.stdout:8/187: stat d5/d9/fd 0 2024-04-23T14:49:48.250 INFO:tasks.workunit.client.0.smithi081.stdout:3/476: dread d4/d7/d32/f33 [0,4194304] 0 2024-04-23T14:49:48.251 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:47 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:49:48.254 INFO:tasks.workunit.client.0.smithi081.stdout:9/577: creat d3/de/d14/d5e/d72/fb7 x:0 0 0 2024-04-23T14:49:48.261 INFO:tasks.workunit.client.0.smithi081.stdout:7/452: mkdir d3/d97 0 2024-04-23T14:49:48.261 INFO:tasks.workunit.client.0.smithi081.stdout:7/453: write d3/d21/d31/d33/d4b/d71/f8b [285084,64772] 0 2024-04-23T14:49:48.261 INFO:tasks.workunit.client.0.smithi081.stdout:5/578: getdents d17/d4a 0 2024-04-23T14:49:48.263 INFO:tasks.workunit.client.1.smithi156.stdout:2/198: rmdir d4/d39 0 2024-04-23T14:49:48.263 INFO:tasks.workunit.client.1.smithi156.stdout:5/256: creat d1/d3/d24/f58 x:0 0 0 2024-04-23T14:49:48.263 INFO:tasks.workunit.client.1.smithi156.stdout:7/198: creat dc/d1d/d20/f31 x:0 0 0 2024-04-23T14:49:48.263 INFO:tasks.workunit.client.1.smithi156.stdout:2/199: fdatasync d4/d21/d42/f43 0 2024-04-23T14:49:48.263 INFO:tasks.workunit.client.1.smithi156.stdout:5/257: dread - d1/d11/f4d zero size 2024-04-23T14:49:48.264 INFO:tasks.workunit.client.1.smithi156.stdout:5/258: truncate d1/d11/d27/f2c 2369631 0 2024-04-23T14:49:48.264 INFO:tasks.workunit.client.1.smithi156.stdout:3/181: link d4/db/dd/d20/f23 d4/db/dd/d1d/f2e 0 2024-04-23T14:49:48.266 INFO:tasks.workunit.client.1.smithi156.stdout:4/176: stat d0/c10 0 2024-04-23T14:49:48.266 INFO:tasks.workunit.client.1.smithi156.stdout:8/188: dread d5/d9/d10/f11 [0,4194304] 0 2024-04-23T14:49:48.269 INFO:tasks.workunit.client.0.smithi081.stdout:6/539: dread d1/d51/d65/f4f [0,4194304] 0 2024-04-23T14:49:48.276 INFO:tasks.workunit.client.1.smithi156.stdout:9/172: mkdir d1/d2/d3e 0 2024-04-23T14:49:48.276 INFO:tasks.workunit.client.1.smithi156.stdout:9/173: chown d1/d2/d4/d19/d2a/d30 32 1 2024-04-23T14:49:48.276 INFO:tasks.workunit.client.1.smithi156.stdout:1/249: dwrite db/d1f/f41 [0,4194304] 0 2024-04-23T14:49:48.280 INFO:tasks.workunit.client.1.smithi156.stdout:0/191: dwrite d0/d16/d3a/d2a/f12 [4194304,4194304] 0 2024-04-23T14:49:48.281 INFO:tasks.workunit.client.0.smithi081.stdout:8/763: mknod d3/d11/d3e/cfa 0 2024-04-23T14:49:48.281 INFO:tasks.workunit.client.0.smithi081.stdout:9/578: dread d3/de/d14/f3c [0,4194304] 0 2024-04-23T14:49:48.283 INFO:tasks.workunit.client.0.smithi081.stdout:1/641: creat d3/d3d/d41/d5e/d12/fcf x:0 0 0 2024-04-23T14:49:48.283 INFO:tasks.workunit.client.0.smithi081.stdout:1/642: readlink d3/d3d/d90/la8 0 2024-04-23T14:49:48.283 INFO:tasks.workunit.client.1.smithi156.stdout:1/250: dread db/d1f/d2d/f36 [0,4194304] 0 2024-04-23T14:49:48.286 INFO:tasks.workunit.client.0.smithi081.stdout:0/612: mknod d6/d11/d14/db8/cc0 0 2024-04-23T14:49:48.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:47 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:49:48.286 INFO:tasks.workunit.client.0.smithi081.stdout:0/613: write d6/d37/d85/f8b [4314262,80344] 0 2024-04-23T14:49:48.287 INFO:tasks.workunit.client.0.smithi081.stdout:0/614: creat d6/d11/d14/db8/fc1 x:0 0 0 2024-04-23T14:49:48.293 INFO:tasks.workunit.client.1.smithi156.stdout:7/199: rename fb to dc/d1d/f32 0 2024-04-23T14:49:48.293 INFO:tasks.workunit.client.1.smithi156.stdout:0/192: rename d0/d16/d3a/d2a/d1d/d2d to d0/d16/d3a/d2a/d1d/d2d/d3b 22 2024-04-23T14:49:48.293 INFO:tasks.workunit.client.1.smithi156.stdout:7/200: readlink l3 0 2024-04-23T14:49:48.293 INFO:tasks.workunit.client.1.smithi156.stdout:7/201: write dc/d1d/d20/f31 [348182,121478] 0 2024-04-23T14:49:48.294 INFO:tasks.workunit.client.0.smithi081.stdout:8/764: dread d3/d11/d3e/fbb [0,4194304] 0 2024-04-23T14:49:48.295 INFO:tasks.workunit.client.1.smithi156.stdout:4/177: dwrite d0/df/f17 [4194304,4194304] 0 2024-04-23T14:49:48.295 INFO:tasks.workunit.client.1.smithi156.stdout:4/178: chown d0/d8/d1e/l20 5195900 1 2024-04-23T14:49:48.299 INFO:tasks.workunit.client.1.smithi156.stdout:5/259: mknod d1/d11/c59 0 2024-04-23T14:49:48.299 INFO:tasks.workunit.client.1.smithi156.stdout:2/200: write d4/f24 [307287,115750] 0 2024-04-23T14:49:48.303 INFO:tasks.workunit.client.1.smithi156.stdout:3/182: link d4/db/dd/d20/f23 d4/db/f2f 0 2024-04-23T14:49:48.304 INFO:tasks.workunit.client.1.smithi156.stdout:8/189: getdents d5/d9/d10 0 2024-04-23T14:49:48.305 INFO:tasks.workunit.client.1.smithi156.stdout:3/183: write d4/db/dd/f26 [4217696,104375] 0 2024-04-23T14:49:48.305 INFO:tasks.workunit.client.1.smithi156.stdout:3/184: truncate d4/db/dd/d1d/d1e/f12 4367918 0 2024-04-23T14:49:48.308 INFO:tasks.workunit.client.0.smithi081.stdout:7/454: chown d3/d21/d31/c1c 153 1 2024-04-23T14:49:48.309 INFO:tasks.workunit.client.0.smithi081.stdout:1/643: symlink d3/d3d/d41/d5e/da0/dbb/ld0 0 2024-04-23T14:49:48.319 INFO:tasks.workunit.client.0.smithi081.stdout:6/540: dwrite d1/d51/d65/d1c/d6e/da0/fc3 [0,4194304] 0 2024-04-23T14:49:48.322 INFO:tasks.workunit.client.0.smithi081.stdout:7/455: dread d3/d21/d31/d33/f3b [0,4194304] 0 2024-04-23T14:49:48.322 INFO:tasks.workunit.client.0.smithi081.stdout:7/456: fdatasync d3/d21/d41/d7c/f8f 0 2024-04-23T14:49:48.325 INFO:tasks.workunit.client.1.smithi156.stdout:8/190: write d5/d9/fd [1943211,2132] 0 2024-04-23T14:49:48.328 INFO:tasks.workunit.client.0.smithi081.stdout:9/579: symlink d3/d1a/d6c/lb8 0 2024-04-23T14:49:48.330 INFO:tasks.workunit.client.1.smithi156.stdout:1/251: symlink db/d25/d30/d38/d40/l49 0 2024-04-23T14:49:48.333 INFO:tasks.workunit.client.1.smithi156.stdout:3/185: dread d4/db/dd/f25 [0,4194304] 0 2024-04-23T14:49:48.333 INFO:tasks.workunit.client.0.smithi081.stdout:1/644: truncate d3/d3d/f13 369053 0 2024-04-23T14:49:48.334 INFO:tasks.workunit.client.0.smithi081.stdout:1/645: dread - d3/d3d/faa zero size 2024-04-23T14:49:48.334 INFO:tasks.workunit.client.0.smithi081.stdout:1/646: chown d3/d3d/d41/d5e/d17/d58/f61 1969 1 2024-04-23T14:49:48.334 INFO:tasks.workunit.client.0.smithi081.stdout:1/647: chown d3/d3d/d41/d5e/d12/f40 3659 1 2024-04-23T14:49:48.334 INFO:tasks.workunit.client.1.smithi156.stdout:0/193: symlink d0/d16/d3a/l3c 0 2024-04-23T14:49:48.335 INFO:tasks.workunit.client.0.smithi081.stdout:6/541: truncate d1/d51/d65/d13/d16/f1e 406086 0 2024-04-23T14:49:48.336 INFO:tasks.workunit.client.1.smithi156.stdout:7/202: creat dc/d2c/f33 x:0 0 0 2024-04-23T14:49:48.336 INFO:tasks.workunit.client.1.smithi156.stdout:7/203: write dc/d1d/f23 [1397460,43600] 0 2024-04-23T14:49:48.340 INFO:tasks.workunit.client.0.smithi081.stdout:7/457: mkdir d3/d11/d56/d7f/d98 0 2024-04-23T14:49:48.340 INFO:tasks.workunit.client.0.smithi081.stdout:7/458: creat d3/d21/d31/d33/d4b/d71/f99 x:0 0 0 2024-04-23T14:49:48.342 INFO:tasks.workunit.client.0.smithi081.stdout:3/477: rename d4/dc/d31 to d4/d7/d7f/d85/d9d 0 2024-04-23T14:49:48.342 INFO:tasks.workunit.client.0.smithi081.stdout:3/478: creat d4/d7/d1a/f9e x:0 0 0 2024-04-23T14:49:48.342 INFO:tasks.workunit.client.0.smithi081.stdout:3/479: write d4/d7/d2e/f8b [1719045,117808] 0 2024-04-23T14:49:48.344 INFO:tasks.workunit.client.1.smithi156.stdout:4/179: creat d0/df/d21/d36/f38 x:0 0 0 2024-04-23T14:49:48.345 INFO:tasks.workunit.client.0.smithi081.stdout:9/580: mknod d3/de/d14/d5e/cb9 0 2024-04-23T14:49:48.345 INFO:tasks.workunit.client.0.smithi081.stdout:9/581: stat d3/de/d14/d5e/cb9 0 2024-04-23T14:49:48.346 INFO:tasks.workunit.client.1.smithi156.stdout:7/204: read dc/f1e [1207742,124971] 0 2024-04-23T14:49:48.347 INFO:tasks.workunit.client.1.smithi156.stdout:9/174: truncate d1/d2/d4/f8 4803033 0 2024-04-23T14:49:48.351 INFO:tasks.workunit.client.0.smithi081.stdout:7/459: link d3/d11/d2c/d75/c94 d3/d11/d56/c9a 0 2024-04-23T14:49:48.352 INFO:tasks.workunit.client.0.smithi081.stdout:7/460: truncate d3/d21/d31/d33/d4b/d71/f99 478827 0 2024-04-23T14:49:48.352 INFO:tasks.workunit.client.0.smithi081.stdout:7/461: chown d3/d21/d41/d7c/f8f 0 1 2024-04-23T14:49:48.352 INFO:tasks.workunit.client.0.smithi081.stdout:7/462: creat d3/d11/d56/d7f/f9b x:0 0 0 2024-04-23T14:49:48.352 INFO:tasks.workunit.client.0.smithi081.stdout:7/463: chown d3/d21/d31/d33/c6a 9449 1 2024-04-23T14:49:48.352 INFO:tasks.workunit.client.0.smithi081.stdout:7/464: write d3/d11/d56/d7f/f95 [361198,34922] 0 2024-04-23T14:49:48.352 INFO:tasks.workunit.client.1.smithi156.stdout:1/252: creat db/d1f/d34/f4a x:0 0 0 2024-04-23T14:49:48.359 INFO:tasks.workunit.client.0.smithi081.stdout:5/579: rename d17/d1f/d42/l4d to d17/d1f/d36/d59/da8/ld1 0 2024-04-23T14:49:48.362 INFO:tasks.workunit.client.1.smithi156.stdout:3/186: symlink d4/l30 0 2024-04-23T14:49:48.362 INFO:tasks.workunit.client.1.smithi156.stdout:0/194: creat d0/d16/d3a/d1e/f3d x:0 0 0 2024-04-23T14:49:48.364 INFO:tasks.workunit.client.1.smithi156.stdout:4/180: link d0/l1 d0/d8/d1e/l39 0 2024-04-23T14:49:48.365 INFO:tasks.workunit.client.1.smithi156.stdout:4/181: chown d0/df/c11 1812970 1 2024-04-23T14:49:48.369 INFO:tasks.workunit.client.1.smithi156.stdout:0/195: dread d0/d16/d3a/d2a/d1d/d2d/f2f [0,4194304] 0 2024-04-23T14:49:48.369 INFO:tasks.workunit.client.1.smithi156.stdout:0/196: chown d0/d4/d22/f34 32545863 1 2024-04-23T14:49:48.369 INFO:tasks.workunit.client.1.smithi156.stdout:0/197: truncate d0/d4/d22/f34 1042763 0 2024-04-23T14:49:48.371 INFO:tasks.workunit.client.0.smithi081.stdout:1/648: dread d3/d3d/d41/d5e/d17/d58/f61 [0,4194304] 0 2024-04-23T14:49:48.371 INFO:tasks.workunit.client.0.smithi081.stdout:5/580: dread d17/d1f/f31 [0,4194304] 0 2024-04-23T14:49:48.371 INFO:tasks.workunit.client.0.smithi081.stdout:5/581: readlink d17/d3d/d41/lb3 0 2024-04-23T14:49:48.374 INFO:tasks.workunit.client.1.smithi156.stdout:7/205: rename dc/l18 to dc/d1d/l34 0 2024-04-23T14:49:48.375 INFO:tasks.workunit.client.0.smithi081.stdout:0/615: dwrite d6/d37/f5c [0,4194304] 0 2024-04-23T14:49:48.375 INFO:tasks.workunit.client.0.smithi081.stdout:0/616: fdatasync d6/d11/d14/d41/d5b/d3f/d44/d78/fb7 0 2024-04-23T14:49:48.380 INFO:tasks.workunit.client.0.smithi081.stdout:7/465: creat d3/d11/d2c/f9c x:0 0 0 2024-04-23T14:49:48.381 INFO:tasks.workunit.client.1.smithi156.stdout:5/260: rmdir d1/d3/d24 39 2024-04-23T14:49:48.381 INFO:tasks.workunit.client.1.smithi156.stdout:4/182: dread d0/df/f17 [0,4194304] 0 2024-04-23T14:49:48.382 INFO:tasks.workunit.client.1.smithi156.stdout:4/183: chown d0/df/d21/d36 0 1 2024-04-23T14:49:48.386 INFO:tasks.workunit.client.1.smithi156.stdout:2/201: dwrite d4/d21/f37 [0,4194304] 0 2024-04-23T14:49:48.387 INFO:tasks.workunit.client.0.smithi081.stdout:8/765: rename d3/d11/d4f/d66/f79 to d3/d11/d4f/d6c/ffb 0 2024-04-23T14:49:48.388 INFO:tasks.workunit.client.1.smithi156.stdout:4/184: write d0/f3 [492034,102694] 0 2024-04-23T14:49:48.391 INFO:tasks.workunit.client.1.smithi156.stdout:8/191: rmdir d5/d9 39 2024-04-23T14:49:48.391 INFO:tasks.workunit.client.1.smithi156.stdout:8/192: write d5/d9/f1f [5107534,125832] 0 2024-04-23T14:49:48.391 INFO:tasks.workunit.client.1.smithi156.stdout:8/193: creat d5/d19/f41 x:0 0 0 2024-04-23T14:49:48.394 INFO:tasks.workunit.client.1.smithi156.stdout:1/253: mkdir db/d1f/d4b 0 2024-04-23T14:49:48.395 INFO:tasks.workunit.client.1.smithi156.stdout:3/187: mkdir d4/db/dd/d1d/d1e/d2b/d31 0 2024-04-23T14:49:48.398 INFO:tasks.workunit.client.0.smithi081.stdout:1/649: symlink d3/d3d/d41/d5e/d1d/ld1 0 2024-04-23T14:49:48.398 INFO:tasks.workunit.client.1.smithi156.stdout:0/198: unlink d0/d16/d3a/d2a/f29 0 2024-04-23T14:49:48.399 INFO:tasks.workunit.client.1.smithi156.stdout:7/206: link f8 dc/d1d/f35 0 2024-04-23T14:49:48.399 INFO:tasks.workunit.client.1.smithi156.stdout:5/261: symlink d1/l5a 0 2024-04-23T14:49:48.403 INFO:tasks.workunit.client.1.smithi156.stdout:9/175: dwrite d1/d2/d23/f27 [4194304,4194304] 0 2024-04-23T14:49:48.406 INFO:tasks.workunit.client.0.smithi081.stdout:5/582: unlink d17/d4f/d61/c67 0 2024-04-23T14:49:48.412 INFO:tasks.workunit.client.0.smithi081.stdout:8/766: read d3/d1a/fb8 [412485,9062] 0 2024-04-23T14:49:48.419 INFO:tasks.workunit.client.0.smithi081.stdout:5/583: mkdir d17/d65/dd2 0 2024-04-23T14:49:48.422 INFO:tasks.workunit.client.0.smithi081.stdout:9/582: rename d3/de/d1d/c3b to d3/de/d47/cba 0 2024-04-23T14:49:48.424 INFO:tasks.workunit.client.0.smithi081.stdout:6/542: dwrite d1/d51/d65/fbf [4194304,4194304] 0 2024-04-23T14:49:48.425 INFO:tasks.workunit.client.0.smithi081.stdout:1/650: read d3/d3d/d41/d5e/d5d/db0/f45 [1094623,100785] 0 2024-04-23T14:49:48.428 INFO:tasks.workunit.client.0.smithi081.stdout:9/583: symlink d3/de/d14/d5e/d72/lbb 0 2024-04-23T14:49:48.432 INFO:tasks.workunit.client.0.smithi081.stdout:8/767: dread d3/d11/d34/f57 [0,4194304] 0 2024-04-23T14:49:48.433 INFO:tasks.workunit.client.1.smithi156.stdout:0/199: dread d0/d4/fe [4194304,4194304] 0 2024-04-23T14:49:48.434 INFO:tasks.workunit.client.0.smithi081.stdout:1/651: mkdir d3/d3d/d41/d5e/dd2 0 2024-04-23T14:49:48.434 INFO:tasks.workunit.client.0.smithi081.stdout:1/652: chown d3/d3d/d41/d5e/d12/l9e 0 1 2024-04-23T14:49:48.442 INFO:tasks.workunit.client.0.smithi081.stdout:5/584: dread d17/d1f/d36/d9a/f9f [0,4194304] 0 2024-04-23T14:49:48.442 INFO:tasks.workunit.client.0.smithi081.stdout:5/585: chown d17/d1f/da5/db1 0 1 2024-04-23T14:49:48.444 INFO:tasks.workunit.client.0.smithi081.stdout:6/543: rename d1/d51/d65/d8/d2e/d59/d80/d90/cba to d1/d51/d65/cc6 0 2024-04-23T14:49:48.446 INFO:tasks.workunit.client.0.smithi081.stdout:8/768: creat d3/d11/d48/d7e/ffc x:0 0 0 2024-04-23T14:49:48.455 INFO:tasks.workunit.client.1.smithi156.stdout:2/202: mkdir d4/d13/d19/d4c 0 2024-04-23T14:49:48.457 INFO:tasks.workunit.client.0.smithi081.stdout:6/544: dread d1/f17 [0,4194304] 0 2024-04-23T14:49:48.461 INFO:tasks.workunit.client.1.smithi156.stdout:8/194: dwrite d5/f28 [0,4194304] 0 2024-04-23T14:49:48.461 INFO:tasks.workunit.client.1.smithi156.stdout:8/195: creat d5/d19/f42 x:0 0 0 2024-04-23T14:49:48.465 INFO:tasks.workunit.client.1.smithi156.stdout:4/185: rename d0/df/d1b to d0/df/d3a 0 2024-04-23T14:49:48.465 INFO:tasks.workunit.client.1.smithi156.stdout:4/186: chown d0/df/f17 1337 1 2024-04-23T14:49:48.466 INFO:tasks.workunit.client.1.smithi156.stdout:4/187: write d0/f3 [2294619,38908] 0 2024-04-23T14:49:48.471 INFO:tasks.workunit.client.0.smithi081.stdout:5/586: creat d17/d18/d3a/fd3 x:0 0 0 2024-04-23T14:49:48.471 INFO:tasks.workunit.client.0.smithi081.stdout:5/587: creat d17/d18/d3a/fd4 x:0 0 0 2024-04-23T14:49:48.477 INFO:tasks.workunit.client.1.smithi156.stdout:1/254: unlink db/d1f/d28/l2b 0 2024-04-23T14:49:48.477 INFO:tasks.workunit.client.1.smithi156.stdout:1/255: chown db/ff 60 1 2024-04-23T14:49:48.479 INFO:tasks.workunit.client.0.smithi081.stdout:7/466: dwrite d3/d21/d31/d63/f82 [0,4194304] 0 2024-04-23T14:49:48.479 INFO:tasks.workunit.client.0.smithi081.stdout:7/467: dread - d3/d21/d31/d33/d4b/f92 zero size 2024-04-23T14:49:48.479 INFO:tasks.workunit.client.0.smithi081.stdout:0/617: dwrite d6/f10 [4194304,4194304] 0 2024-04-23T14:49:48.483 INFO:tasks.workunit.client.1.smithi156.stdout:3/188: getdents d4/db/dd/d20 0 2024-04-23T14:49:48.485 INFO:tasks.workunit.client.0.smithi081.stdout:5/588: dread d17/d3d/d41/f5e [0,4194304] 0 2024-04-23T14:49:48.485 INFO:tasks.workunit.client.0.smithi081.stdout:5/589: fsync d17/d3d/f51 0 2024-04-23T14:49:48.485 INFO:tasks.workunit.client.0.smithi081.stdout:5/590: dread - d17/d3d/f51 zero size 2024-04-23T14:49:48.486 INFO:tasks.workunit.client.0.smithi081.stdout:9/584: dwrite d3/d1a/f9e [0,4194304] 0 2024-04-23T14:49:48.486 INFO:tasks.workunit.client.0.smithi081.stdout:7/468: dread d3/d21/d31/d33/f3b [0,4194304] 0 2024-04-23T14:49:48.487 INFO:tasks.workunit.client.0.smithi081.stdout:1/653: dwrite d3/d3d/faa [0,4194304] 0 2024-04-23T14:49:48.487 INFO:tasks.workunit.client.0.smithi081.stdout:6/545: rmdir d1/d51/d65/d8/db1 39 2024-04-23T14:49:48.489 INFO:tasks.workunit.client.1.smithi156.stdout:5/262: symlink d1/d3/l5b 0 2024-04-23T14:49:48.492 INFO:tasks.workunit.client.1.smithi156.stdout:9/176: truncate d1/d2/f13 186630 0 2024-04-23T14:49:48.494 INFO:tasks.workunit.client.0.smithi081.stdout:4/530: sync 2024-04-23T14:49:48.497 INFO:tasks.workunit.client.0.smithi081.stdout:4/531: write d1/d1d/d59/f85 [1251328,87426] 0 2024-04-23T14:49:48.497 INFO:tasks.workunit.client.0.smithi081.stdout:8/769: dread d3/d11/d48/d7e/f95 [0,4194304] 0 2024-04-23T14:49:48.498 INFO:tasks.workunit.client.0.smithi081.stdout:2/615: sync 2024-04-23T14:49:48.507 INFO:tasks.workunit.client.0.smithi081.stdout:0/618: creat d6/d11/d14/d41/d5b/d3f/d44/d76/fc2 x:0 0 0 2024-04-23T14:49:48.512 INFO:tasks.workunit.client.0.smithi081.stdout:1/654: dread d3/d3d/d41/d5e/d12/d2e/f8b [0,4194304] 0 2024-04-23T14:49:48.512 INFO:tasks.workunit.client.0.smithi081.stdout:1/655: truncate f0 1181183 0 2024-04-23T14:49:48.513 INFO:tasks.workunit.client.1.smithi156.stdout:0/200: unlink d0/d16/d3a/d2a/lc 0 2024-04-23T14:49:48.514 INFO:tasks.workunit.client.0.smithi081.stdout:5/591: truncate d17/d1f/d42/f50 6566058 0 2024-04-23T14:49:48.514 INFO:tasks.workunit.client.0.smithi081.stdout:5/592: fdatasync d17/d18/f32 0 2024-04-23T14:49:48.517 INFO:tasks.workunit.client.1.smithi156.stdout:2/203: mknod d4/d21/d2f/c4d 0 2024-04-23T14:49:48.531 INFO:tasks.workunit.client.1.smithi156.stdout:4/188: mknod d0/df/c3b 0 2024-04-23T14:49:48.531 INFO:tasks.workunit.client.1.smithi156.stdout:4/189: write d0/d8/fc [1916913,45371] 0 2024-04-23T14:49:48.532 INFO:tasks.workunit.client.1.smithi156.stdout:4/190: write d0/df/d21/d36/f38 [822589,118141] 0 2024-04-23T14:49:48.534 INFO:tasks.workunit.client.1.smithi156.stdout:1/256: mknod db/d1f/d28/c4c 0 2024-04-23T14:49:48.536 INFO:tasks.workunit.client.1.smithi156.stdout:3/189: rename d4/db/dd/d1d/d1e/d13/c28 to d4/db/c32 0 2024-04-23T14:49:48.536 INFO:tasks.workunit.client.1.smithi156.stdout:3/190: write d4/db/dd/d1d/d1e/f12 [3327420,66479] 0 2024-04-23T14:49:48.537 INFO:tasks.workunit.client.0.smithi081.stdout:0/619: dread d6/f10 [4194304,4194304] 0 2024-04-23T14:49:48.537 INFO:tasks.workunit.client.0.smithi081.stdout:0/620: readlink d6/d11/d14/d41/d5b/d3f/d44/l7f 0 2024-04-23T14:49:48.538 INFO:tasks.workunit.client.1.smithi156.stdout:9/177: dwrite d1/d2/d4/d17/d1f/f36 [0,4194304] 0 2024-04-23T14:49:48.542 INFO:tasks.workunit.client.1.smithi156.stdout:7/207: getdents dc/d1d 0 2024-04-23T14:49:48.542 INFO:tasks.workunit.client.1.smithi156.stdout:5/263: creat d1/d11/d18/d19/f5c x:0 0 0 2024-04-23T14:49:48.542 INFO:tasks.workunit.client.1.smithi156.stdout:7/208: write f8 [2222689,8721] 0 2024-04-23T14:49:48.543 INFO:tasks.workunit.client.1.smithi156.stdout:0/201: creat d0/d16/d3a/d2b/f3e x:0 0 0 2024-04-23T14:49:48.544 INFO:tasks.workunit.client.0.smithi081.stdout:4/532: symlink d1/d4/d11/d9d/dac/lb1 0 2024-04-23T14:49:48.545 INFO:tasks.workunit.client.1.smithi156.stdout:2/204: chown d4/f29 11527694 1 2024-04-23T14:49:48.545 INFO:tasks.workunit.client.1.smithi156.stdout:2/205: write d4/d13/f4b [247601,43461] 0 2024-04-23T14:49:48.546 INFO:tasks.workunit.client.1.smithi156.stdout:2/206: creat d4/d21/d42/f4e x:0 0 0 2024-04-23T14:49:48.546 INFO:tasks.workunit.client.0.smithi081.stdout:8/770: creat d3/d11/d86/d88/da7/de0/ffd x:0 0 0 2024-04-23T14:49:48.547 INFO:tasks.workunit.client.0.smithi081.stdout:6/546: dwrite d1/d51/d65/d1c/f3b [0,4194304] 0 2024-04-23T14:49:48.549 INFO:tasks.workunit.client.0.smithi081.stdout:2/616: dwrite d1/d11/d21/d34/f47 [0,4194304] 0 2024-04-23T14:49:48.552 INFO:tasks.workunit.client.0.smithi081.stdout:1/656: rename d3/d3d/d41/d5e/d17/d26/f5a to d3/d3d/fd3 0 2024-04-23T14:49:48.554 INFO:tasks.workunit.client.0.smithi081.stdout:5/593: truncate d17/d4a/f5b 2126124 0 2024-04-23T14:49:48.556 INFO:tasks.workunit.client.1.smithi156.stdout:1/257: creat db/d25/d30/d38/f4d x:0 0 0 2024-04-23T14:49:48.556 INFO:tasks.workunit.client.1.smithi156.stdout:1/258: fsync db/f19 0 2024-04-23T14:49:48.557 INFO:tasks.workunit.client.0.smithi081.stdout:3/480: sync 2024-04-23T14:49:48.558 INFO:tasks.workunit.client.1.smithi156.stdout:3/191: symlink d4/db/dd/d1d/l33 0 2024-04-23T14:49:48.558 INFO:tasks.workunit.client.1.smithi156.stdout:3/192: dread - d4/db/dd/d1d/d1e/d13/f1a zero size 2024-04-23T14:49:48.559 INFO:tasks.workunit.client.0.smithi081.stdout:3/481: read d4/d7/d1a/f8e [429355,105306] 0 2024-04-23T14:49:48.562 INFO:tasks.workunit.client.0.smithi081.stdout:0/621: creat d6/d25/fc3 x:0 0 0 2024-04-23T14:49:48.563 INFO:tasks.workunit.client.0.smithi081.stdout:4/533: creat d1/d1d/d59/fb2 x:0 0 0 2024-04-23T14:49:48.566 INFO:tasks.workunit.client.1.smithi156.stdout:4/191: dread d0/df/f25 [0,4194304] 0 2024-04-23T14:49:48.566 INFO:tasks.workunit.client.1.smithi156.stdout:4/192: creat d0/d8/d2c/f3c x:0 0 0 2024-04-23T14:49:48.566 INFO:tasks.workunit.client.1.smithi156.stdout:4/193: dread - d0/d8/d2c/f3c zero size 2024-04-23T14:49:48.567 INFO:tasks.workunit.client.0.smithi081.stdout:8/771: link d3/d11/d48/dc1/lc4 d3/d11/d48/d7e/de4/df0/lfe 0 2024-04-23T14:49:48.571 INFO:tasks.workunit.client.1.smithi156.stdout:6/250: sync 2024-04-23T14:49:48.571 INFO:tasks.workunit.client.0.smithi081.stdout:6/547: creat d1/d51/d65/d13/d16/fc7 x:0 0 0 2024-04-23T14:49:48.577 INFO:tasks.workunit.client.1.smithi156.stdout:3/193: write d4/f2a [3757922,35983] 0 2024-04-23T14:49:48.577 INFO:tasks.workunit.client.1.smithi156.stdout:3/194: stat d4/db/dd/d1d/d1e 0 2024-04-23T14:49:48.580 INFO:tasks.workunit.client.0.smithi081.stdout:3/482: dread d4/d7/d7f/d91/d6c/f73 [0,4194304] 0 2024-04-23T14:49:48.580 INFO:tasks.workunit.client.0.smithi081.stdout:3/483: dread - d4/d7/df/f92 zero size 2024-04-23T14:49:48.580 INFO:tasks.workunit.client.0.smithi081.stdout:1/657: creat d3/d3d/d41/d5e/dd2/fd4 x:0 0 0 2024-04-23T14:49:48.580 INFO:tasks.workunit.client.0.smithi081.stdout:1/658: write d3/d3d/d41/d5e/dd2/fd4 [1026335,105749] 0 2024-04-23T14:49:48.581 INFO:tasks.workunit.client.1.smithi156.stdout:5/264: getdents d1/d11/d18 0 2024-04-23T14:49:48.581 INFO:tasks.workunit.client.1.smithi156.stdout:8/196: truncate d5/d9/f1f 1936931 0 2024-04-23T14:49:48.582 INFO:tasks.workunit.client.1.smithi156.stdout:7/209: link dc/d1d/l2f dc/d1d/l36 0 2024-04-23T14:49:48.582 INFO:tasks.workunit.client.1.smithi156.stdout:8/197: creat d5/d19/d29/f43 x:0 0 0 2024-04-23T14:49:48.582 INFO:tasks.workunit.client.1.smithi156.stdout:0/202: mkdir d0/d4/d11/d3f 0 2024-04-23T14:49:48.582 INFO:tasks.workunit.client.1.smithi156.stdout:0/203: chown d0/f1a 90020700 1 2024-04-23T14:49:48.584 INFO:tasks.workunit.client.0.smithi081.stdout:5/594: truncate d17/d3c/f81 3302311 0 2024-04-23T14:49:48.584 INFO:tasks.workunit.client.0.smithi081.stdout:5/595: write d17/d18/f19 [4748449,29058] 0 2024-04-23T14:49:48.584 INFO:tasks.workunit.client.0.smithi081.stdout:5/596: stat d17/d4f/d61/fab 0 2024-04-23T14:49:48.584 INFO:tasks.workunit.client.0.smithi081.stdout:5/597: write d17/d3c/f88 [964213,59126] 0 2024-04-23T14:49:48.584 INFO:tasks.workunit.client.0.smithi081.stdout:5/598: fdatasync d17/d1f/d36/d59/da8/fa9 0 2024-04-23T14:49:48.584 INFO:tasks.workunit.client.0.smithi081.stdout:5/599: readlink d17/d65/lc7 0 2024-04-23T14:49:48.584 INFO:tasks.workunit.client.0.smithi081.stdout:5/600: write d17/d18/f2d [1704704,116867] 0 2024-04-23T14:49:48.588 INFO:tasks.workunit.client.0.smithi081.stdout:0/622: rename d6/d37/cac to d6/d11/d14/d41/d5b/d59/d68/cc4 0 2024-04-23T14:49:48.590 INFO:tasks.workunit.client.1.smithi156.stdout:1/259: mkdir db/d25/d4e 0 2024-04-23T14:49:48.598 INFO:tasks.workunit.client.0.smithi081.stdout:4/534: write d1/d4/dc/f6a [616993,61343] 0 2024-04-23T14:49:48.600 INFO:tasks.workunit.client.1.smithi156.stdout:6/251: unlink d3/da/d1d/f56 0 2024-04-23T14:49:48.601 INFO:tasks.workunit.client.1.smithi156.stdout:5/265: rmdir d1/d3/d20/d3e 39 2024-04-23T14:49:48.603 INFO:tasks.workunit.client.1.smithi156.stdout:7/210: dread dc/d1d/f32 [0,4194304] 0 2024-04-23T14:49:48.603 INFO:tasks.workunit.client.1.smithi156.stdout:7/211: write f8 [2253533,100596] 0 2024-04-23T14:49:48.604 INFO:tasks.workunit.client.0.smithi081.stdout:8/772: rmdir d3/d11/d4f/d6c 39 2024-04-23T14:49:48.604 INFO:tasks.workunit.client.0.smithi081.stdout:6/548: unlink d1/d51/d7b/d91/lb2 0 2024-04-23T14:49:48.607 INFO:tasks.workunit.client.0.smithi081.stdout:1/659: dread d3/f5 [0,4194304] 0 2024-04-23T14:49:48.614 INFO:tasks.workunit.client.0.smithi081.stdout:8/773: read d3/d11/d86/d88/fbe [75860,101441] 0 2024-04-23T14:49:48.615 INFO:tasks.workunit.client.1.smithi156.stdout:6/252: rename d3/d16/d46/f4b to d3/d16/d1e/f5f 0 2024-04-23T14:49:48.615 INFO:tasks.workunit.client.1.smithi156.stdout:6/253: truncate d3/da/f38 934247 0 2024-04-23T14:49:48.617 INFO:tasks.workunit.client.0.smithi081.stdout:3/484: dread d4/d7/d1a/d71/f76 [0,4194304] 0 2024-04-23T14:49:48.618 INFO:tasks.workunit.client.0.smithi081.stdout:5/601: mknod d17/d3d/d41/cd5 0 2024-04-23T14:49:48.619 INFO:tasks.workunit.client.0.smithi081.stdout:5/602: write d17/fa0 [377247,104830] 0 2024-04-23T14:49:48.620 INFO:tasks.workunit.client.1.smithi156.stdout:7/212: mkdir dc/d2c/d37 0 2024-04-23T14:49:48.620 INFO:tasks.workunit.client.1.smithi156.stdout:7/213: readlink dc/l1b 0 2024-04-23T14:49:48.620 INFO:tasks.workunit.client.1.smithi156.stdout:7/214: chown dc/d2a 1 1 2024-04-23T14:49:48.622 INFO:tasks.workunit.client.0.smithi081.stdout:6/549: dread d1/d51/d65/d13/d16/f4c [0,4194304] 0 2024-04-23T14:49:48.622 INFO:tasks.workunit.client.0.smithi081.stdout:6/550: fsync d1/d51/d7b/d91/f97 0 2024-04-23T14:49:48.622 INFO:tasks.workunit.client.0.smithi081.stdout:6/551: write d1/d51/d65/d1c/fbc [79657,23713] 0 2024-04-23T14:49:48.622 INFO:tasks.workunit.client.0.smithi081.stdout:6/552: creat d1/d51/d65/d78/fc8 x:0 0 0 2024-04-23T14:49:48.623 INFO:tasks.workunit.client.1.smithi156.stdout:4/194: dwrite d0/df/d21/f33 [0,4194304] 0 2024-04-23T14:49:48.623 INFO:tasks.workunit.client.1.smithi156.stdout:2/207: dwrite d4/f24 [0,4194304] 0 2024-04-23T14:49:48.626 INFO:tasks.workunit.client.0.smithi081.stdout:0/623: truncate d6/d37/d67/d7d/f90 561783 0 2024-04-23T14:49:48.626 INFO:tasks.workunit.client.0.smithi081.stdout:0/624: write d6/f9 [1142348,12140] 0 2024-04-23T14:49:48.627 INFO:tasks.workunit.client.1.smithi156.stdout:6/254: creat d3/d16/d46/f60 x:0 0 0 2024-04-23T14:49:48.627 INFO:tasks.workunit.client.1.smithi156.stdout:6/255: creat d3/da/d1d/f61 x:0 0 0 2024-04-23T14:49:48.634 INFO:tasks.workunit.client.0.smithi081.stdout:1/660: dread d3/fa [0,4194304] 0 2024-04-23T14:49:48.634 INFO:tasks.workunit.client.1.smithi156.stdout:1/260: write db/ff [592672,3217] 0 2024-04-23T14:49:48.635 INFO:tasks.workunit.client.1.smithi156.stdout:1/261: chown db/d1f/l35 1972302 1 2024-04-23T14:49:48.637 INFO:tasks.workunit.client.1.smithi156.stdout:7/215: symlink dc/d2c/l38 0 2024-04-23T14:49:48.637 INFO:tasks.workunit.client.1.smithi156.stdout:7/216: write dc/f17 [1530279,12404] 0 2024-04-23T14:49:48.637 INFO:tasks.workunit.client.1.smithi156.stdout:7/217: chown dc/d1d/l2f 33242670 1 2024-04-23T14:49:48.641 INFO:tasks.workunit.client.1.smithi156.stdout:0/204: write d0/f1a [1271659,50552] 0 2024-04-23T14:49:48.641 INFO:tasks.workunit.client.1.smithi156.stdout:0/205: write d0/d16/d3a/d1e/f3d [963122,82325] 0 2024-04-23T14:49:48.641 INFO:tasks.workunit.client.1.smithi156.stdout:9/178: dwrite d1/d2/d4/f3d [0,4194304] 0 2024-04-23T14:49:48.641 INFO:tasks.workunit.client.1.smithi156.stdout:0/206: creat d0/d16/d3a/d1e/f40 x:0 0 0 2024-04-23T14:49:48.641 INFO:tasks.workunit.client.1.smithi156.stdout:9/179: write d1/d2/f18 [3164050,41244] 0 2024-04-23T14:49:48.642 INFO:tasks.workunit.client.0.smithi081.stdout:8/774: rmdir d3/d11/d34/d8b 39 2024-04-23T14:49:48.642 INFO:tasks.workunit.client.0.smithi081.stdout:8/775: creat d3/d11/d3e/d63/d78/da0/fff x:0 0 0 2024-04-23T14:49:48.642 INFO:tasks.workunit.client.0.smithi081.stdout:8/776: truncate d3/d11/d3e/fb5 920979 0 2024-04-23T14:49:48.656 INFO:tasks.workunit.client.0.smithi081.stdout:3/485: creat d4/d7/df/f9f x:0 0 0 2024-04-23T14:49:48.660 INFO:tasks.workunit.client.0.smithi081.stdout:5/603: rmdir d17/d3d 39 2024-04-23T14:49:48.670 INFO:tasks.workunit.client.0.smithi081.stdout:4/535: rmdir d1/d4/d11/d75 39 2024-04-23T14:49:48.674 INFO:tasks.workunit.client.0.smithi081.stdout:0/625: dwrite d6/d25/fc3 [0,4194304] 0 2024-04-23T14:49:48.678 INFO:tasks.workunit.client.1.smithi156.stdout:4/195: truncate d0/d8/d2c/f2e 2799004 0 2024-04-23T14:49:48.678 INFO:tasks.workunit.client.1.smithi156.stdout:4/196: rename d0/d8 to d0/d8/d2c/d3d 22 2024-04-23T14:49:48.679 INFO:tasks.workunit.client.0.smithi081.stdout:8/777: dread d3/d11/d34/f55 [0,4194304] 0 2024-04-23T14:49:48.683 INFO:tasks.workunit.client.0.smithi081.stdout:5/604: link d17/d18/c30 d17/d3c/d55/d64/dcc/cd6 0 2024-04-23T14:49:48.692 INFO:tasks.workunit.client.1.smithi156.stdout:6/256: creat d3/da/f62 x:0 0 0 2024-04-23T14:49:48.712 INFO:tasks.workunit.client.1.smithi156.stdout:4/197: mknod d0/d30/c3e 0 2024-04-23T14:49:48.713 INFO:tasks.workunit.client.0.smithi081.stdout:8/778: symlink d3/d11/d48/l100 0 2024-04-23T14:49:48.713 INFO:tasks.workunit.client.0.smithi081.stdout:8/779: chown d3/d3c/cb0 862 1 2024-04-23T14:49:48.713 INFO:tasks.workunit.client.0.smithi081.stdout:2/617: dwrite d1/d11/d21/f3b [0,4194304] 0 2024-04-23T14:49:48.713 INFO:tasks.workunit.client.1.smithi156.stdout:7/218: rmdir dc/d1d/d20 39 2024-04-23T14:49:48.714 INFO:tasks.workunit.client.1.smithi156.stdout:7/219: write dc/d1d/f23 [1648491,92355] 0 2024-04-23T14:49:48.714 INFO:tasks.workunit.client.0.smithi081.stdout:8/780: symlink d3/d3c/ddb/l101 0 2024-04-23T14:49:48.716 INFO:tasks.workunit.client.1.smithi156.stdout:6/257: mkdir d3/da/d1d/d27/d63 0 2024-04-23T14:49:48.716 INFO:tasks.workunit.client.0.smithi081.stdout:2/618: creat d1/d11/fd6 x:0 0 0 2024-04-23T14:49:48.718 INFO:tasks.workunit.client.1.smithi156.stdout:4/198: creat d0/d30/f3f x:0 0 0 2024-04-23T14:49:48.720 INFO:tasks.workunit.client.0.smithi081.stdout:2/619: creat d1/d11/d21/d52/fd7 x:0 0 0 2024-04-23T14:49:48.723 INFO:tasks.workunit.client.1.smithi156.stdout:3/195: dwrite d4/db/dd/f26 [0,4194304] 0 2024-04-23T14:49:48.726 INFO:tasks.workunit.client.1.smithi156.stdout:6/258: mkdir d3/d16/d46/d64 0 2024-04-23T14:49:48.727 INFO:tasks.workunit.client.1.smithi156.stdout:4/199: creat d0/d8/f40 x:0 0 0 2024-04-23T14:49:48.728 INFO:tasks.workunit.client.1.smithi156.stdout:8/198: dwrite d5/d9/f13 [4194304,4194304] 0 2024-04-23T14:49:48.729 INFO:tasks.workunit.client.1.smithi156.stdout:8/199: chown d5/l3f 1615115 1 2024-04-23T14:49:48.729 INFO:tasks.workunit.client.1.smithi156.stdout:8/200: write d5/d19/d29/f2e [412055,99062] 0 2024-04-23T14:49:48.729 INFO:tasks.workunit.client.1.smithi156.stdout:6/259: link d3/d16/f30 d3/da/d1d/f65 0 2024-04-23T14:49:48.730 INFO:tasks.workunit.client.1.smithi156.stdout:8/201: symlink d5/d9/l44 0 2024-04-23T14:49:48.764 INFO:tasks.workunit.client.1.smithi156.stdout:0/207: dwrite d0/d4/f3 [0,4194304] 0 2024-04-23T14:49:48.772 INFO:tasks.workunit.client.0.smithi081.stdout:5/605: dwrite d17/d1f/d36/d59/fc1 [0,4194304] 0 2024-04-23T14:49:48.772 INFO:tasks.workunit.client.0.smithi081.stdout:5/606: write d17/d3d/d41/f5e [967718,75197] 0 2024-04-23T14:49:48.772 INFO:tasks.workunit.client.0.smithi081.stdout:5/607: getdents d17/d1f/d42/d9b/dc9 0 2024-04-23T14:49:48.772 INFO:tasks.workunit.client.0.smithi081.stdout:5/608: readlink d17/d4a/l5c 0 2024-04-23T14:49:48.774 INFO:tasks.workunit.client.1.smithi156.stdout:0/208: dread d0/d16/d3a/d2a/d1d/d2d/f2f [0,4194304] 0 2024-04-23T14:49:48.788 INFO:tasks.workunit.client.0.smithi081.stdout:4/536: dread d1/f44 [0,4194304] 0 2024-04-23T14:49:48.793 INFO:tasks.workunit.client.1.smithi156.stdout:1/262: dwrite db/d25/d30/d38/f4d [0,4194304] 0 2024-04-23T14:49:48.795 INFO:tasks.workunit.client.0.smithi081.stdout:3/486: dwrite d4/d7/d32/f9c [0,4194304] 0 2024-04-23T14:49:48.803 INFO:tasks.workunit.client.0.smithi081.stdout:5/609: write d17/d3c/fbe [1942428,82386] 0 2024-04-23T14:49:48.803 INFO:tasks.workunit.client.0.smithi081.stdout:1/661: dwrite d3/d3d/d41/d5e/d12/d1a/fb1 [0,4194304] 0 2024-04-23T14:49:48.803 INFO:tasks.workunit.client.0.smithi081.stdout:6/553: dwrite d1/f18 [0,4194304] 0 2024-04-23T14:49:48.803 INFO:tasks.workunit.client.0.smithi081.stdout:1/662: write d3/d3d/d41/d5e/d17/d58/f67 [794139,11077] 0 2024-04-23T14:49:48.810 INFO:tasks.workunit.client.1.smithi156.stdout:3/196: dwrite d4/db/dd/d1d/d1e/ff [0,4194304] 0 2024-04-23T14:49:48.811 INFO:tasks.workunit.client.1.smithi156.stdout:3/197: creat d4/db/dd/d1d/d1e/d13/f34 x:0 0 0 2024-04-23T14:49:48.811 INFO:tasks.workunit.client.1.smithi156.stdout:3/198: fsync d4/db/dd/f25 0 2024-04-23T14:49:48.812 INFO:tasks.workunit.client.0.smithi081.stdout:4/537: dread d1/f12 [0,4194304] 0 2024-04-23T14:49:48.813 INFO:tasks.workunit.client.0.smithi081.stdout:0/626: dwrite d6/d37/d67/f97 [0,4194304] 0 2024-04-23T14:49:48.813 INFO:tasks.workunit.client.0.smithi081.stdout:0/627: fdatasync d6/d25/fc3 0 2024-04-23T14:49:48.813 INFO:tasks.workunit.client.0.smithi081.stdout:0/628: readlink d6/d11/l22 0 2024-04-23T14:49:48.814 INFO:tasks.workunit.client.1.smithi156.stdout:7/220: dwrite f6 [0,4194304] 0 2024-04-23T14:49:48.814 INFO:tasks.workunit.client.1.smithi156.stdout:7/221: write dc/f1c [1126368,66675] 0 2024-04-23T14:49:48.814 INFO:tasks.workunit.client.1.smithi156.stdout:7/222: fsync dc/d1d/d20/f31 0 2024-04-23T14:49:48.815 INFO:tasks.workunit.client.1.smithi156.stdout:2/208: dwrite d4/f16 [0,4194304] 0 2024-04-23T14:49:48.815 INFO:tasks.workunit.client.1.smithi156.stdout:2/209: dread - d4/d21/d2f/f35 zero size 2024-04-23T14:49:48.815 INFO:tasks.workunit.client.0.smithi081.stdout:3/487: dread d4/d7/f6f [0,4194304] 0 2024-04-23T14:49:48.815 INFO:tasks.workunit.client.0.smithi081.stdout:3/488: stat d4/d7/d49/d51/l6b 0 2024-04-23T14:49:48.819 INFO:tasks.workunit.client.0.smithi081.stdout:5/610: dread d17/d3d/fa1 [0,4194304] 0 2024-04-23T14:49:48.830 INFO:tasks.workunit.client.1.smithi156.stdout:6/260: symlink d3/d16/d1e/l66 0 2024-04-23T14:49:48.830 INFO:tasks.workunit.client.1.smithi156.stdout:6/261: creat d3/da/d1d/f67 x:0 0 0 2024-04-23T14:49:48.830 INFO:tasks.workunit.client.1.smithi156.stdout:8/202: mkdir d5/d45 0 2024-04-23T14:49:48.832 INFO:tasks.workunit.client.0.smithi081.stdout:3/489: read d4/d7/d32/d6a/f7a [2194227,94585] 0 2024-04-23T14:49:48.847 INFO:tasks.workunit.client.1.smithi156.stdout:9/180: truncate d1/d2/d4/f3d 1509653 0 2024-04-23T14:49:48.848 INFO:tasks.workunit.client.1.smithi156.stdout:0/209: creat d0/d16/d3a/d2a/d1d/d2d/f41 x:0 0 0 2024-04-23T14:49:48.851 INFO:tasks.workunit.client.0.smithi081.stdout:6/554: truncate d1/d51/d65/d1c/d6e/da0/fc3 2106244 0 2024-04-23T14:49:48.853 INFO:tasks.workunit.client.0.smithi081.stdout:1/663: mkdir d3/d3d/d41/d5e/dd2/dd5 0 2024-04-23T14:49:48.858 INFO:tasks.workunit.client.0.smithi081.stdout:4/538: stat d1/d4/d6f/d70/daf/c4e 0 2024-04-23T14:49:48.858 INFO:tasks.workunit.client.0.smithi081.stdout:4/539: chown d1/d1d/f52 102508590 1 2024-04-23T14:49:48.868 INFO:tasks.workunit.client.1.smithi156.stdout:0/210: write d0/d4/f20 [742176,84211] 0 2024-04-23T14:49:48.868 INFO:tasks.workunit.client.1.smithi156.stdout:0/211: truncate d0/d16/d3a/d2b/f3e 210282 0 2024-04-23T14:49:48.870 INFO:tasks.workunit.client.1.smithi156.stdout:2/210: write d4/f7 [5143745,48961] 0 2024-04-23T14:49:48.873 INFO:tasks.workunit.client.0.smithi081.stdout:0/629: link d6/d11/d14/d41/d5b/d3f/d44/d78/c95 d6/d37/d4d/d71/cc5 0 2024-04-23T14:49:48.877 INFO:tasks.workunit.client.1.smithi156.stdout:6/262: symlink d3/da/d1d/d27/d63/l68 0 2024-04-23T14:49:48.877 INFO:tasks.workunit.client.1.smithi156.stdout:6/263: creat d3/d16/d46/d2b/d3b/f69 x:0 0 0 2024-04-23T14:49:48.880 INFO:tasks.workunit.client.1.smithi156.stdout:8/203: creat d5/d9/d10/f46 x:0 0 0 2024-04-23T14:49:48.881 INFO:tasks.workunit.client.1.smithi156.stdout:8/204: chown d5/d9/d10/f12 951 1 2024-04-23T14:49:48.883 INFO:tasks.workunit.client.1.smithi156.stdout:8/205: read d5/d19/f35 [255349,117981] 0 2024-04-23T14:49:48.883 INFO:tasks.workunit.client.1.smithi156.stdout:8/206: read - d5/d19/d29/f43 zero size 2024-04-23T14:49:48.885 INFO:tasks.workunit.client.1.smithi156.stdout:1/263: rename db/d1f/d34/f4a to db/f4f 0 2024-04-23T14:49:48.890 INFO:tasks.workunit.client.0.smithi081.stdout:5/611: creat d17/d4f/fd7 x:0 0 0 2024-04-23T14:49:48.890 INFO:tasks.workunit.client.0.smithi081.stdout:5/612: write d17/d1f/d36/fcd [32532,96398] 0 2024-04-23T14:49:48.891 INFO:tasks.workunit.client.0.smithi081.stdout:5/613: write d17/d18/f19 [4811732,86916] 0 2024-04-23T14:49:48.891 INFO:tasks.workunit.client.0.smithi081.stdout:5/614: fdatasync d17/d3c/f88 0 2024-04-23T14:49:48.891 INFO:tasks.workunit.client.0.smithi081.stdout:5/615: read - d17/fb4 zero size 2024-04-23T14:49:48.891 INFO:tasks.workunit.client.0.smithi081.stdout:5/616: chown d17/d37/l83 19 1 2024-04-23T14:49:48.892 INFO:tasks.workunit.client.1.smithi156.stdout:0/212: mknod d0/d4/d14/c42 0 2024-04-23T14:49:48.892 INFO:tasks.workunit.client.1.smithi156.stdout:0/213: stat d0/d4/d14/c42 0 2024-04-23T14:49:48.892 INFO:tasks.workunit.client.1.smithi156.stdout:0/214: fdatasync d0/d4/ff 0 2024-04-23T14:49:48.893 INFO:tasks.workunit.client.0.smithi081.stdout:3/490: chown d4/d7/df/l4f 16845 1 2024-04-23T14:49:48.893 INFO:tasks.workunit.client.0.smithi081.stdout:3/491: write d4/d7/d32/f3e [1133944,106288] 0 2024-04-23T14:49:48.893 INFO:tasks.workunit.client.0.smithi081.stdout:3/492: write d4/d7/d7f/f65 [1559192,8002] 0 2024-04-23T14:49:48.893 INFO:tasks.workunit.client.0.smithi081.stdout:3/493: write d4/d7/d49/d51/f62 [52403,33724] 0 2024-04-23T14:49:48.893 INFO:tasks.workunit.client.0.smithi081.stdout:3/494: fdatasync d4/dc/f3b 0 2024-04-23T14:49:48.893 INFO:tasks.workunit.client.1.smithi156.stdout:2/211: getdents d4/d26/d3c 0 2024-04-23T14:49:48.896 INFO:tasks.workunit.client.1.smithi156.stdout:1/264: dread db/ff [0,4194304] 0 2024-04-23T14:49:48.897 INFO:tasks.workunit.client.1.smithi156.stdout:3/199: dwrite d4/db/dd/d1d/f2e [0,4194304] 0 2024-04-23T14:49:48.899 INFO:tasks.workunit.client.0.smithi081.stdout:1/664: unlink d3/d3d/d41/d5e/d12/d2e/lb8 0 2024-04-23T14:49:48.899 INFO:tasks.workunit.client.0.smithi081.stdout:1/665: write d3/d3d/d41/d5e/d12/f54 [4607220,112001] 0 2024-04-23T14:49:48.899 INFO:tasks.workunit.client.0.smithi081.stdout:4/540: mknod d1/d4/cb3 0 2024-04-23T14:49:48.900 INFO:tasks.workunit.client.0.smithi081.stdout:6/555: dwrite d1/d51/d65/d13/d16/f75 [0,4194304] 0 2024-04-23T14:49:48.901 INFO:tasks.workunit.client.0.smithi081.stdout:5/617: mkdir d17/d1f/da5/dd8 0 2024-04-23T14:49:48.903 INFO:tasks.workunit.client.1.smithi156.stdout:6/264: mkdir d3/d16/d5c/d6a 0 2024-04-23T14:49:48.903 INFO:tasks.workunit.client.1.smithi156.stdout:6/265: creat d3/f6b x:0 0 0 2024-04-23T14:49:48.906 INFO:tasks.workunit.client.0.smithi081.stdout:3/495: mknod d4/d7/d32/d6a/ca0 0 2024-04-23T14:49:48.908 INFO:tasks.workunit.client.1.smithi156.stdout:7/223: rename dc/d1d/d24/c25 to dc/d2c/c39 0 2024-04-23T14:49:48.909 INFO:tasks.workunit.client.1.smithi156.stdout:2/212: mknod d4/d21/d2f/c4f 0 2024-04-23T14:49:48.909 INFO:tasks.workunit.client.1.smithi156.stdout:2/213: readlink d4/d21/l45 0 2024-04-23T14:49:48.909 INFO:tasks.workunit.client.1.smithi156.stdout:5/266: sync 2024-04-23T14:49:48.909 INFO:tasks.workunit.client.1.smithi156.stdout:4/200: sync 2024-04-23T14:49:48.909 INFO:tasks.workunit.client.1.smithi156.stdout:4/201: fsync d0/d8/d1e/f22 0 2024-04-23T14:49:48.909 INFO:tasks.workunit.client.1.smithi156.stdout:4/202: write d0/d8/f40 [466817,60781] 0 2024-04-23T14:49:48.912 INFO:tasks.workunit.client.1.smithi156.stdout:1/265: symlink db/d25/d4e/l50 0 2024-04-23T14:49:48.912 INFO:tasks.workunit.client.1.smithi156.stdout:1/266: truncate db/d25/f3b 4958816 0 2024-04-23T14:49:48.913 INFO:tasks.workunit.client.1.smithi156.stdout:1/267: readlink db/d15/l29 0 2024-04-23T14:49:48.913 INFO:tasks.workunit.client.1.smithi156.stdout:1/268: readlink l6 0 2024-04-23T14:49:48.913 INFO:tasks.workunit.client.1.smithi156.stdout:1/269: truncate db/d1f/f3f 1030834 0 2024-04-23T14:49:48.913 INFO:tasks.workunit.client.1.smithi156.stdout:3/200: dread d4/db/dd/d1d/f2e [0,4194304] 0 2024-04-23T14:49:48.913 INFO:tasks.workunit.client.1.smithi156.stdout:7/224: read dc/d1d/d24/f27 [318894,92559] 0 2024-04-23T14:49:48.913 INFO:tasks.workunit.client.1.smithi156.stdout:7/225: chown dc/d1d/d20/f31 1222589 1 2024-04-23T14:49:48.913 INFO:tasks.workunit.client.1.smithi156.stdout:7/226: write dc/d1d/d24/f27 [1153059,14795] 0 2024-04-23T14:49:48.921 INFO:tasks.workunit.client.0.smithi081.stdout:0/630: dwrite d6/d11/d14/d41/d5b/d3f/d44/f8f [0,4194304] 0 2024-04-23T14:49:48.928 INFO:tasks.workunit.client.0.smithi081.stdout:4/541: dread d1/d1d/d59/f65 [0,4194304] 0 2024-04-23T14:49:48.928 INFO:tasks.workunit.client.0.smithi081.stdout:6/556: mkdir d1/d51/d65/d1c/d6e/da0/da1/dc1/dc9 0 2024-04-23T14:49:48.928 INFO:tasks.workunit.client.0.smithi081.stdout:5/618: creat d17/d1f/d42/d9b/fd9 x:0 0 0 2024-04-23T14:49:48.928 INFO:tasks.workunit.client.0.smithi081.stdout:6/557: truncate d1/d2/d49/d52/fab 28510 0 2024-04-23T14:49:48.933 INFO:tasks.workunit.client.0.smithi081.stdout:3/496: rename d4/d7/d1a/l57 to d4/d41/la1 0 2024-04-23T14:49:48.941 INFO:tasks.workunit.client.1.smithi156.stdout:4/203: dread d0/df/d21/f33 [0,4194304] 0 2024-04-23T14:49:48.941 INFO:tasks.workunit.client.1.smithi156.stdout:4/204: creat d0/f41 x:0 0 0 2024-04-23T14:49:48.943 INFO:tasks.workunit.client.1.smithi156.stdout:9/181: rename d1/d2/d4/dc/c29 to d1/d2/d4/d17/c3f 0 2024-04-23T14:49:48.944 INFO:tasks.workunit.client.0.smithi081.stdout:9/585: sync 2024-04-23T14:49:48.944 INFO:tasks.workunit.client.0.smithi081.stdout:7/469: sync 2024-04-23T14:49:48.944 INFO:tasks.workunit.client.0.smithi081.stdout:7/470: truncate d3/d21/d31/d63/f74 652624 0 2024-04-23T14:49:48.944 INFO:tasks.workunit.client.0.smithi081.stdout:9/586: write d3/de/d25/f8e [957465,5184] 0 2024-04-23T14:49:48.945 INFO:tasks.workunit.client.1.smithi156.stdout:2/214: symlink d4/d13/l50 0 2024-04-23T14:49:48.948 INFO:tasks.workunit.client.1.smithi156.stdout:3/201: symlink d4/l35 0 2024-04-23T14:49:48.948 INFO:tasks.workunit.client.1.smithi156.stdout:3/202: chown d4/db/dd/d1d/d1e/ff 0 1 2024-04-23T14:49:48.948 INFO:tasks.workunit.client.1.smithi156.stdout:3/203: chown d4/db/dd/d20 44745 1 2024-04-23T14:49:48.949 INFO:tasks.workunit.client.1.smithi156.stdout:3/204: write d4/f10 [13212038,17497] 0 2024-04-23T14:49:48.950 INFO:tasks.workunit.client.0.smithi081.stdout:0/631: dread d6/d11/d14/f73 [0,4194304] 0 2024-04-23T14:49:48.952 INFO:tasks.workunit.client.0.smithi081.stdout:5/619: symlink d17/d1f/da5/db1/lda 0 2024-04-23T14:49:48.955 INFO:tasks.workunit.client.1.smithi156.stdout:1/270: unlink db/d1f/f3f 0 2024-04-23T14:49:48.955 INFO:tasks.workunit.client.1.smithi156.stdout:7/227: creat dc/d2a/f3a x:0 0 0 2024-04-23T14:49:48.955 INFO:tasks.workunit.client.1.smithi156.stdout:7/228: readlink l7 0 2024-04-23T14:49:48.955 INFO:tasks.workunit.client.1.smithi156.stdout:7/229: readlink dc/l29 0 2024-04-23T14:49:48.955 INFO:tasks.workunit.client.1.smithi156.stdout:7/230: dread - dc/d2c/f33 zero size 2024-04-23T14:49:48.957 INFO:tasks.workunit.client.0.smithi081.stdout:7/471: symlink d3/d21/d31/d63/l9d 0 2024-04-23T14:49:48.957 INFO:tasks.workunit.client.0.smithi081.stdout:7/472: write d3/d21/d31/d33/d4b/f60 [1152596,9653] 0 2024-04-23T14:49:48.978 INFO:tasks.workunit.client.1.smithi156.stdout:6/266: dwrite d3/f34 [0,4194304] 0 2024-04-23T14:49:48.982 INFO:tasks.workunit.client.0.smithi081.stdout:6/558: getdents d1/d51/d65/d78 0 2024-04-23T14:49:48.992 INFO:tasks.workunit.client.1.smithi156.stdout:8/207: rename d5/d9/d10/d1d/l2c to d5/d39/l47 0 2024-04-23T14:49:48.997 INFO:tasks.workunit.client.1.smithi156.stdout:2/215: dwrite d4/d13/f14 [4194304,4194304] 0 2024-04-23T14:49:48.997 INFO:tasks.workunit.client.1.smithi156.stdout:2/216: write d4/d21/f31 [478320,23936] 0 2024-04-23T14:49:48.999 INFO:tasks.workunit.client.0.smithi081.stdout:0/632: mkdir d6/d11/d14/d41/d5b/d59/dc6 0 2024-04-23T14:49:48.999 INFO:tasks.workunit.client.0.smithi081.stdout:0/633: truncate d6/d11/d14/d41/d5b/d3f/d44/f8f 4432710 0 2024-04-23T14:49:49.001 INFO:tasks.workunit.client.1.smithi156.stdout:3/205: unlink d4/db/dd/d1d/d1e/d13/l21 0 2024-04-23T14:49:49.003 INFO:tasks.workunit.client.1.smithi156.stdout:4/205: read d0/d8/d2c/f2e [2392236,5895] 0 2024-04-23T14:49:49.003 INFO:tasks.workunit.client.1.smithi156.stdout:4/206: write d0/d8/f40 [1055412,17747] 0 2024-04-23T14:49:49.003 INFO:tasks.workunit.client.1.smithi156.stdout:5/267: dwrite d1/d11/d27/f2c [0,4194304] 0 2024-04-23T14:49:49.008 INFO:tasks.workunit.client.0.smithi081.stdout:9/587: symlink d3/de/d1d/d5b/d7b/d90/lbc 0 2024-04-23T14:49:49.015 INFO:tasks.workunit.client.0.smithi081.stdout:6/559: rename d1/d51/d65/d1c/l3a to d1/d51/d65/d13/lca 0 2024-04-23T14:49:49.015 INFO:tasks.workunit.client.0.smithi081.stdout:6/560: stat d1/d2/d8e/d98/lb0 0 2024-04-23T14:49:49.015 INFO:tasks.workunit.client.1.smithi156.stdout:6/267: dread d3/d16/f3c [4194304,4194304] 0 2024-04-23T14:49:49.016 INFO:tasks.workunit.client.0.smithi081.stdout:0/634: getdents d6/d37/d4d/d71 0 2024-04-23T14:49:49.019 INFO:tasks.workunit.client.0.smithi081.stdout:6/561: link d1/c7c d1/d51/d65/d8/d2e/d59/ccb 0 2024-04-23T14:49:49.019 INFO:tasks.workunit.client.0.smithi081.stdout:6/562: write d1/d51/d65/d8/d2e/d58/f9d [204779,126274] 0 2024-04-23T14:49:49.019 INFO:tasks.workunit.client.0.smithi081.stdout:6/563: fdatasync d1/d51/d65/d1c/f73 0 2024-04-23T14:49:49.021 INFO:tasks.workunit.client.1.smithi156.stdout:7/231: symlink dc/d1d/l3b 0 2024-04-23T14:49:49.021 INFO:tasks.workunit.client.1.smithi156.stdout:2/217: creat d4/d26/f51 x:0 0 0 2024-04-23T14:49:49.021 INFO:tasks.workunit.client.1.smithi156.stdout:2/218: chown d4/l12 105975330 1 2024-04-23T14:49:49.021 INFO:tasks.workunit.client.1.smithi156.stdout:7/232: write dc/d1d/d20/f31 [755266,108158] 0 2024-04-23T14:49:49.021 INFO:tasks.workunit.client.1.smithi156.stdout:7/233: chown dc/d1d/d24/f27 1367960 1 2024-04-23T14:49:49.021 INFO:tasks.workunit.client.0.smithi081.stdout:7/473: dwrite d3/d11/d2c/d75/f86 [0,4194304] 0 2024-04-23T14:49:49.028 INFO:tasks.workunit.client.0.smithi081.stdout:1/666: dwrite d3/d3d/d41/d5e/d12/fcf [0,4194304] 0 2024-04-23T14:49:49.028 INFO:tasks.workunit.client.0.smithi081.stdout:6/564: mknod d1/d51/d65/d13/d46/ccc 0 2024-04-23T14:49:49.028 INFO:tasks.workunit.client.0.smithi081.stdout:9/588: write d3/de/f84 [9621333,30789] 0 2024-04-23T14:49:49.028 INFO:tasks.workunit.client.0.smithi081.stdout:6/565: write d1/d51/d65/d8/d2e/d59/d80/f8d [1019609,17871] 0 2024-04-23T14:49:49.030 INFO:tasks.workunit.client.1.smithi156.stdout:4/207: link d0/d8/c15 d0/d8/d2c/c42 0 2024-04-23T14:49:49.031 INFO:tasks.workunit.client.1.smithi156.stdout:5/268: mknod d1/c5d 0 2024-04-23T14:49:49.031 INFO:tasks.workunit.client.1.smithi156.stdout:5/269: dread - d1/d3/d20/d3e/f46 zero size 2024-04-23T14:49:49.031 INFO:tasks.workunit.client.1.smithi156.stdout:5/270: dread - d1/f38 zero size 2024-04-23T14:49:49.031 INFO:tasks.workunit.client.1.smithi156.stdout:6/268: mknod d3/da/c6c 0 2024-04-23T14:49:49.031 INFO:tasks.workunit.client.1.smithi156.stdout:9/182: rename d1/d2/d28 to d1/d2/d4/d40 0 2024-04-23T14:49:49.032 INFO:tasks.workunit.client.0.smithi081.stdout:5/620: dread d17/d1f/d42/f97 [0,4194304] 0 2024-04-23T14:49:49.032 INFO:tasks.workunit.client.0.smithi081.stdout:5/621: write d17/d18/f19 [5763917,120198] 0 2024-04-23T14:49:49.038 INFO:tasks.workunit.client.0.smithi081.stdout:1/667: dread d3/d3d/d41/d5e/dd2/fd4 [0,4194304] 0 2024-04-23T14:49:49.038 INFO:tasks.workunit.client.0.smithi081.stdout:1/668: chown d3/d3d/d41/d5e/d17/d58/f61 7 1 2024-04-23T14:49:49.038 INFO:tasks.workunit.client.0.smithi081.stdout:1/669: dread - d3/d3d/d41/d5e/d12/fbf zero size 2024-04-23T14:49:49.038 INFO:tasks.workunit.client.1.smithi156.stdout:1/271: dwrite db/d1f/d2d/f36 [0,4194304] 0 2024-04-23T14:49:49.044 INFO:tasks.workunit.client.1.smithi156.stdout:7/234: rename dc/d1d/d24/f2e to dc/d1d/d24/f3c 0 2024-04-23T14:49:49.044 INFO:tasks.workunit.client.1.smithi156.stdout:6/269: creat d3/da/d1d/d59/f6d x:0 0 0 2024-04-23T14:49:49.044 INFO:tasks.workunit.client.1.smithi156.stdout:5/271: creat d1/d11/f5e x:0 0 0 2024-04-23T14:49:49.044 INFO:tasks.workunit.client.1.smithi156.stdout:7/235: write dc/f17 [174585,101369] 0 2024-04-23T14:49:49.044 INFO:tasks.workunit.client.1.smithi156.stdout:5/272: read - d1/d3/d20/d3e/f46 zero size 2024-04-23T14:49:49.044 INFO:tasks.workunit.client.1.smithi156.stdout:7/236: readlink dc/d1d/l3b 0 2024-04-23T14:49:49.044 INFO:tasks.workunit.client.1.smithi156.stdout:9/183: truncate d1/d2/d4/f8 1907495 0 2024-04-23T14:49:49.047 INFO:tasks.workunit.client.1.smithi156.stdout:8/208: rename d5/d19/f35 to d5/d9/f48 0 2024-04-23T14:49:49.061 INFO:tasks.workunit.client.0.smithi081.stdout:4/542: dwrite d1/d1d/d39/f58 [0,4194304] 0 2024-04-23T14:49:49.061 INFO:tasks.workunit.client.0.smithi081.stdout:0/635: dread d6/d11/d14/d41/d5b/d59/d68/f74 [0,4194304] 0 2024-04-23T14:49:49.061 INFO:tasks.workunit.client.0.smithi081.stdout:0/636: fdatasync d6/d11/d14/d41/d5b/d3f/d44/d78/fb7 0 2024-04-23T14:49:49.061 INFO:tasks.workunit.client.0.smithi081.stdout:0/637: chown d6/d11/db0 0 1 2024-04-23T14:49:49.061 INFO:tasks.workunit.client.0.smithi081.stdout:0/638: write d6/d37/f7e [2238257,109474] 0 2024-04-23T14:49:49.065 INFO:tasks.workunit.client.0.smithi081.stdout:3/497: dwrite d4/dc/d50/f4e [0,4194304] 0 2024-04-23T14:49:49.065 INFO:tasks.workunit.client.0.smithi081.stdout:3/498: write d4/d7/df/d30/f4c [3454635,40739] 0 2024-04-23T14:49:49.066 INFO:tasks.workunit.client.1.smithi156.stdout:6/270: unlink d3/d16/d46/f40 0 2024-04-23T14:49:49.066 INFO:tasks.workunit.client.1.smithi156.stdout:5/273: creat d1/d3/d20/f5f x:0 0 0 2024-04-23T14:49:49.066 INFO:tasks.workunit.client.1.smithi156.stdout:1/272: rename db/d25/d4e/l50 to db/d1f/d4b/l51 0 2024-04-23T14:49:49.066 INFO:tasks.workunit.client.1.smithi156.stdout:6/271: write d3/d16/d46/d2b/d3b/f4d [198056,87799] 0 2024-04-23T14:49:49.066 INFO:tasks.workunit.client.1.smithi156.stdout:8/209: creat d5/d39/f49 x:0 0 0 2024-04-23T14:49:49.066 INFO:tasks.workunit.client.1.smithi156.stdout:7/237: truncate f8 3238909 0 2024-04-23T14:49:49.066 INFO:tasks.workunit.client.1.smithi156.stdout:7/238: truncate dc/d1d/f32 2387724 0 2024-04-23T14:49:49.067 INFO:tasks.workunit.client.0.smithi081.stdout:9/589: creat d3/de/d76/db5/fbd x:0 0 0 2024-04-23T14:49:49.067 INFO:tasks.workunit.client.0.smithi081.stdout:5/622: symlink d17/d37/da4/ldb 0 2024-04-23T14:49:49.067 INFO:tasks.workunit.client.0.smithi081.stdout:5/623: dread - d17/d4a/fb9 zero size 2024-04-23T14:49:49.069 INFO:tasks.workunit.client.0.smithi081.stdout:1/670: link d3/d3d/faa d3/d3d/d41/d5e/d1d/fd6 0 2024-04-23T14:49:49.071 INFO:tasks.workunit.client.0.smithi081.stdout:0/639: dread d6/d25/f51 [0,4194304] 0 2024-04-23T14:49:49.071 INFO:tasks.workunit.client.0.smithi081.stdout:0/640: creat d6/d11/d14/d41/d5b/d3f/d44/d78/fc7 x:0 0 0 2024-04-23T14:49:49.074 INFO:tasks.workunit.client.1.smithi156.stdout:4/208: dwrite d0/df/f25 [0,4194304] 0 2024-04-23T14:49:49.074 INFO:tasks.workunit.client.1.smithi156.stdout:4/209: creat d0/df/d21/d36/f43 x:0 0 0 2024-04-23T14:49:49.076 INFO:tasks.workunit.client.0.smithi081.stdout:4/543: truncate d1/d4/d6f/f91 3259862 0 2024-04-23T14:49:49.088 INFO:tasks.workunit.client.0.smithi081.stdout:1/671: creat d3/d3d/d41/d5e/d1d/fd7 x:0 0 0 2024-04-23T14:49:49.093 INFO:tasks.workunit.client.0.smithi081.stdout:0/641: rmdir d6/d11/d14/d41/da1 39 2024-04-23T14:49:49.093 INFO:tasks.workunit.client.0.smithi081.stdout:9/590: write d3/de/d14/d5e/f96 [91541,98078] 0 2024-04-23T14:49:49.094 INFO:tasks.workunit.client.0.smithi081.stdout:9/591: fsync d3/d5/f41 0 2024-04-23T14:49:49.095 INFO:tasks.workunit.client.0.smithi081.stdout:6/566: dwrite d1/d51/d65/d8/f2b [0,4194304] 0 2024-04-23T14:49:49.095 INFO:tasks.workunit.client.0.smithi081.stdout:6/567: fsync d1/d51/d65/d78/fc8 0 2024-04-23T14:49:49.095 INFO:tasks.workunit.client.0.smithi081.stdout:6/568: write d1/d51/d65/d13/d46/f7a [171958,26405] 0 2024-04-23T14:49:49.095 INFO:tasks.workunit.client.0.smithi081.stdout:6/569: dread - d1/d2/d8e/f9e zero size 2024-04-23T14:49:49.095 INFO:tasks.workunit.client.0.smithi081.stdout:6/570: getdents d1/d51/d65/d1c/d6e/da0/da1/dc1/dc9 0 2024-04-23T14:49:49.095 INFO:tasks.workunit.client.0.smithi081.stdout:6/571: fdatasync d1/d51/d65/f6a 0 2024-04-23T14:49:49.096 INFO:tasks.workunit.client.0.smithi081.stdout:4/544: rename d1/f61 to d1/d4/d6f/fb4 0 2024-04-23T14:49:49.098 INFO:tasks.workunit.client.1.smithi156.stdout:1/273: mknod db/d15/c52 0 2024-04-23T14:49:49.098 INFO:tasks.workunit.client.1.smithi156.stdout:1/274: write db/d25/f3b [5575085,39985] 0 2024-04-23T14:49:49.098 INFO:tasks.workunit.client.0.smithi081.stdout:3/499: mknod d4/d7/df/ca2 0 2024-04-23T14:49:49.098 INFO:tasks.workunit.client.0.smithi081.stdout:3/500: write d4/d7/df/f27 [883600,113859] 0 2024-04-23T14:49:49.099 INFO:tasks.workunit.client.0.smithi081.stdout:3/501: write d4/d7/df/d30/f4c [3672982,77852] 0 2024-04-23T14:49:49.100 INFO:tasks.workunit.client.0.smithi081.stdout:7/474: write d3/d11/d2c/f32 [2971298,12140] 0 2024-04-23T14:49:49.100 INFO:tasks.workunit.client.0.smithi081.stdout:7/475: fdatasync d3/d21/d31/d33/f3b 0 2024-04-23T14:49:49.101 INFO:tasks.workunit.client.1.smithi156.stdout:8/210: symlink d5/l4a 0 2024-04-23T14:49:49.101 INFO:tasks.workunit.client.0.smithi081.stdout:1/672: symlink d3/d3d/d41/d5e/dd2/dd5/ld8 0 2024-04-23T14:49:49.103 INFO:tasks.workunit.client.0.smithi081.stdout:0/642: mkdir d6/d37/d67/dc8 0 2024-04-23T14:49:49.107 INFO:tasks.workunit.client.0.smithi081.stdout:5/624: dwrite d17/d3c/f40 [0,4194304] 0 2024-04-23T14:49:49.108 INFO:tasks.workunit.client.0.smithi081.stdout:5/625: fsync d17/d4a/f8c 0 2024-04-23T14:49:49.108 INFO:tasks.workunit.client.1.smithi156.stdout:3/206: dwrite d4/db/dd/d1d/d1e/d13/f34 [0,4194304] 0 2024-04-23T14:49:49.109 INFO:tasks.workunit.client.0.smithi081.stdout:9/592: symlink d3/d67/lbe 0 2024-04-23T14:49:49.113 INFO:tasks.workunit.client.1.smithi156.stdout:8/211: dread d5/d9/d10/d1d/d21/f22 [0,4194304] 0 2024-04-23T14:49:49.114 INFO:tasks.workunit.client.1.smithi156.stdout:8/212: write d5/d19/d29/f2e [1519859,23076] 0 2024-04-23T14:49:49.114 INFO:tasks.workunit.client.0.smithi081.stdout:6/572: rmdir d1/d51/d65/d1c/d6e/d7d 39 2024-04-23T14:49:49.114 INFO:tasks.workunit.client.0.smithi081.stdout:6/573: fdatasync d1/d51/d65/d8/da4/fbd 0 2024-04-23T14:49:49.118 INFO:tasks.workunit.client.0.smithi081.stdout:4/545: creat d1/d4/d11/d9d/fb5 x:0 0 0 2024-04-23T14:49:49.119 INFO:tasks.workunit.client.1.smithi156.stdout:4/210: link d0/c9 d0/d8/d1e/c44 0 2024-04-23T14:49:49.119 INFO:tasks.workunit.client.0.smithi081.stdout:3/502: stat d4/dc/d50/l2f 0 2024-04-23T14:49:49.125 INFO:tasks.workunit.client.0.smithi081.stdout:7/476: mknod d3/d21/d31/d50/c9e 0 2024-04-23T14:49:49.125 INFO:tasks.workunit.client.0.smithi081.stdout:5/626: dread d17/d1f/d36/d59/fc1 [0,4194304] 0 2024-04-23T14:49:49.126 INFO:tasks.workunit.client.0.smithi081.stdout:1/673: rename d3/f5 to d3/d3d/d7a/fd9 0 2024-04-23T14:49:49.132 INFO:tasks.workunit.client.1.smithi156.stdout:3/207: creat d4/db/dd/d1d/f36 x:0 0 0 2024-04-23T14:49:49.133 INFO:tasks.workunit.client.1.smithi156.stdout:3/208: creat d4/db/dd/d1d/f37 x:0 0 0 2024-04-23T14:49:49.135 INFO:tasks.workunit.client.0.smithi081.stdout:5/627: symlink d17/d1f/d42/d9b/dc9/ldc 0 2024-04-23T14:49:49.136 INFO:tasks.workunit.client.1.smithi156.stdout:7/239: rename f8 to dc/d2c/d37/f3d 0 2024-04-23T14:49:49.136 INFO:tasks.workunit.client.1.smithi156.stdout:7/240: stat dc/f19 0 2024-04-23T14:49:49.136 INFO:tasks.workunit.client.1.smithi156.stdout:7/241: chown dc/d1d/d24/f27 0 1 2024-04-23T14:49:49.137 INFO:tasks.workunit.client.0.smithi081.stdout:6/574: rename d1/d51/c40 to d1/d51/d65/d8/d2e/d59/d80/d90/ccd 0 2024-04-23T14:49:49.143 INFO:tasks.workunit.client.0.smithi081.stdout:1/674: mkdir d3/d3d/d41/d5e/d17/d25/dda 0 2024-04-23T14:49:49.146 INFO:tasks.workunit.client.1.smithi156.stdout:4/211: getdents d0/d8 0 2024-04-23T14:49:49.151 INFO:tasks.workunit.client.1.smithi156.stdout:1/275: rename db/d1f/f41 to db/d25/d30/f53 0 2024-04-23T14:49:49.155 INFO:tasks.workunit.client.0.smithi081.stdout:5/628: creat d17/d65/dd2/fdd x:0 0 0 2024-04-23T14:49:49.155 INFO:tasks.workunit.client.0.smithi081.stdout:5/629: dread - d17/fb4 zero size 2024-04-23T14:49:49.157 INFO:tasks.workunit.client.1.smithi156.stdout:7/242: symlink dc/d1d/l3e 0 2024-04-23T14:49:49.158 INFO:tasks.workunit.client.1.smithi156.stdout:2/219: dwrite d4/d13/f23 [0,4194304] 0 2024-04-23T14:49:49.159 INFO:tasks.workunit.client.0.smithi081.stdout:2/620: sync 2024-04-23T14:49:49.159 INFO:tasks.workunit.client.0.smithi081.stdout:8/781: sync 2024-04-23T14:49:49.159 INFO:tasks.workunit.client.0.smithi081.stdout:8/782: readlink d3/l6 0 2024-04-23T14:49:49.160 INFO:tasks.workunit.client.0.smithi081.stdout:4/546: rename d1/d4/dc/f21 to d1/d1d/d59/fb6 0 2024-04-23T14:49:49.161 INFO:tasks.workunit.client.0.smithi081.stdout:4/547: read d1/d1d/d39/f48 [646583,54916] 0 2024-04-23T14:49:49.162 INFO:tasks.workunit.client.0.smithi081.stdout:7/477: write d3/d21/f55 [118851,27986] 0 2024-04-23T14:49:49.166 INFO:tasks.workunit.client.1.smithi156.stdout:1/276: symlink db/d1f/d28/l54 0 2024-04-23T14:49:49.166 INFO:tasks.workunit.client.1.smithi156.stdout:1/277: fdatasync db/d25/f26 0 2024-04-23T14:49:49.168 INFO:tasks.workunit.client.1.smithi156.stdout:8/213: rename d5/d19/d29/f30 to d5/d9/f4b 0 2024-04-23T14:49:49.169 INFO:tasks.workunit.client.1.smithi156.stdout:8/214: write d5/f1c [894115,75217] 0 2024-04-23T14:49:49.170 INFO:tasks.workunit.client.0.smithi081.stdout:5/630: creat d17/d1f/d36/d9a/fde x:0 0 0 2024-04-23T14:49:49.171 INFO:tasks.workunit.client.1.smithi156.stdout:7/243: symlink dc/d2a/l3f 0 2024-04-23T14:49:49.173 INFO:tasks.workunit.client.0.smithi081.stdout:8/783: link d3/d11/d86/d88/da7/de0/ffd d3/f102 0 2024-04-23T14:49:49.173 INFO:tasks.workunit.client.0.smithi081.stdout:8/784: write d3/d1a/fe1 [936786,80639] 0 2024-04-23T14:49:49.174 INFO:tasks.workunit.client.1.smithi156.stdout:0/215: sync 2024-04-23T14:49:49.174 INFO:tasks.workunit.client.1.smithi156.stdout:0/216: fdatasync d0/d16/d3a/d2a/d1d/f17 0 2024-04-23T14:49:49.175 INFO:tasks.workunit.client.0.smithi081.stdout:9/593: dwrite d3/de/d47/fa9 [0,4194304] 0 2024-04-23T14:49:49.179 INFO:tasks.workunit.client.0.smithi081.stdout:2/621: mknod d1/d11/d21/cd8 0 2024-04-23T14:49:49.181 INFO:tasks.workunit.client.1.smithi156.stdout:6/272: dwrite d3/d16/f39 [0,4194304] 0 2024-04-23T14:49:49.182 INFO:tasks.workunit.client.1.smithi156.stdout:5/274: dwrite d1/d3/f25 [0,4194304] 0 2024-04-23T14:49:49.182 INFO:tasks.workunit.client.1.smithi156.stdout:5/275: write d1/d3/f3a [625740,81274] 0 2024-04-23T14:49:49.186 INFO:tasks.workunit.client.0.smithi081.stdout:1/675: rename d3/d3d/d41/d4a/f39 to d3/d3d/d6f/fdb 0 2024-04-23T14:49:49.189 INFO:tasks.workunit.client.1.smithi156.stdout:7/244: symlink dc/d1d/d20/l40 0 2024-04-23T14:49:49.189 INFO:tasks.workunit.client.1.smithi156.stdout:7/245: write dc/d2c/d37/f3d [4071351,99514] 0 2024-04-23T14:49:49.195 INFO:tasks.workunit.client.0.smithi081.stdout:4/548: unlink d1/d4/f10 0 2024-04-23T14:49:49.195 INFO:tasks.workunit.client.0.smithi081.stdout:0/643: getdents d6/d37/d67 0 2024-04-23T14:49:49.196 INFO:tasks.workunit.client.1.smithi156.stdout:1/278: dread db/d25/d30/d38/f4d [0,4194304] 0 2024-04-23T14:49:49.196 INFO:tasks.workunit.client.1.smithi156.stdout:1/279: chown db/d1f/d28/f37 861721818 1 2024-04-23T14:49:49.196 INFO:tasks.workunit.client.0.smithi081.stdout:0/644: read - d6/d11/d14/d41/d5b/d3f/f6c zero size 2024-04-23T14:49:49.196 INFO:tasks.workunit.client.0.smithi081.stdout:7/478: unlink d3/d21/d31/d33/c2f 0 2024-04-23T14:49:49.196 INFO:tasks.workunit.client.0.smithi081.stdout:7/479: rename d3/d21 to d3/d21/d31/d33/d52/d9f 22 2024-04-23T14:49:49.196 INFO:tasks.workunit.client.0.smithi081.stdout:0/645: creat d6/d11/d14/d41/d5b/d59/fc9 x:0 0 0 2024-04-23T14:49:49.197 INFO:tasks.workunit.client.1.smithi156.stdout:0/217: mkdir d0/d16/d43 0 2024-04-23T14:49:49.202 INFO:tasks.workunit.client.0.smithi081.stdout:8/785: unlink d3/d3c/ddb/l101 0 2024-04-23T14:49:49.203 INFO:tasks.workunit.client.0.smithi081.stdout:8/786: dread - d3/d11/d4f/d6c/fb4 zero size 2024-04-23T14:49:49.204 INFO:tasks.workunit.client.1.smithi156.stdout:4/212: dwrite d0/df/d21/f33 [4194304,4194304] 0 2024-04-23T14:49:49.204 INFO:tasks.workunit.client.1.smithi156.stdout:6/273: mkdir d3/d16/d46/d2b/d6e 0 2024-04-23T14:49:49.206 INFO:tasks.workunit.client.1.smithi156.stdout:2/220: dread d4/f24 [0,4194304] 0 2024-04-23T14:49:49.206 INFO:tasks.workunit.client.1.smithi156.stdout:2/221: dread - d4/d21/d2f/f49 zero size 2024-04-23T14:49:49.214 INFO:tasks.workunit.client.0.smithi081.stdout:2/622: symlink d1/ld9 0 2024-04-23T14:49:49.214 INFO:tasks.workunit.client.0.smithi081.stdout:4/549: write d1/d1d/f3e [1517120,53000] 0 2024-04-23T14:49:49.215 INFO:tasks.workunit.client.1.smithi156.stdout:3/209: dread d4/f10 [8388608,4194304] 0 2024-04-23T14:49:49.217 INFO:tasks.workunit.client.0.smithi081.stdout:1/676: mkdir d3/d3d/d41/d4a/d77/ddc 0 2024-04-23T14:49:49.217 INFO:tasks.workunit.client.1.smithi156.stdout:5/276: symlink d1/d3/l60 0 2024-04-23T14:49:49.220 INFO:tasks.workunit.client.1.smithi156.stdout:1/280: link db/d25/f3d db/d1f/d2f/f55 0 2024-04-23T14:49:49.221 INFO:tasks.workunit.client.1.smithi156.stdout:1/281: write db/d1f/d28/f44 [356773,84393] 0 2024-04-23T14:49:49.231 INFO:tasks.workunit.client.0.smithi081.stdout:7/480: mknod d3/d21/d41/ca0 0 2024-04-23T14:49:49.234 INFO:tasks.workunit.client.0.smithi081.stdout:3/503: write d4/d7/df/f5e [1033688,98571] 0 2024-04-23T14:49:49.235 INFO:tasks.workunit.client.1.smithi156.stdout:7/246: rename dc/d2c/d37 to dc/d1d/d41 0 2024-04-23T14:49:49.235 INFO:tasks.workunit.client.1.smithi156.stdout:0/218: mkdir d0/d16/d3a/d2b/d44 0 2024-04-23T14:49:49.235 INFO:tasks.workunit.client.0.smithi081.stdout:8/787: rename d3/d11/d3e/d63/d78/da0/la4 to d3/d11/d3e/d63/d78/da0/l103 0 2024-04-23T14:49:49.235 INFO:tasks.workunit.client.0.smithi081.stdout:8/788: dread - d3/dc6/fc9 zero size 2024-04-23T14:49:49.236 INFO:tasks.workunit.client.0.smithi081.stdout:6/575: dwrite d1/d51/d65/d1c/d6e/d7d/faf [0,4194304] 0 2024-04-23T14:49:49.247 INFO:tasks.workunit.client.0.smithi081.stdout:2/623: link d1/d11/d21/d34/f47 d1/d1e/fda 0 2024-04-23T14:49:49.247 INFO:tasks.workunit.client.0.smithi081.stdout:9/594: dwrite d3/de/d1d/d54/d68/f7c [0,4194304] 0 2024-04-23T14:49:49.248 INFO:tasks.workunit.client.0.smithi081.stdout:4/550: mkdir d1/d4/d6f/d70/daf/d89/db7 0 2024-04-23T14:49:49.250 INFO:tasks.workunit.client.1.smithi156.stdout:4/213: symlink d0/d30/l45 0 2024-04-23T14:49:49.251 INFO:tasks.workunit.client.1.smithi156.stdout:4/214: chown d0/d8/d1e/c37 806950254 1 2024-04-23T14:49:49.253 INFO:tasks.workunit.client.1.smithi156.stdout:6/274: mkdir d3/d16/d5c/d6f 0 2024-04-23T14:49:49.253 INFO:tasks.workunit.client.1.smithi156.stdout:8/215: getdents d5/d9 0 2024-04-23T14:49:49.253 INFO:tasks.workunit.client.1.smithi156.stdout:8/216: chown d5/d9/d10/d1d/c38 0 1 2024-04-23T14:49:49.254 INFO:tasks.workunit.client.0.smithi081.stdout:0/646: dread d6/d37/d4d/f55 [0,4194304] 0 2024-04-23T14:49:49.263 INFO:tasks.workunit.client.0.smithi081.stdout:8/789: dread d3/d11/d48/d7e/feb [0,4194304] 0 2024-04-23T14:49:49.263 INFO:tasks.workunit.client.0.smithi081.stdout:8/790: fdatasync d3/d11/d3e/fbb 0 2024-04-23T14:49:49.263 INFO:tasks.workunit.client.0.smithi081.stdout:7/481: mknod d3/d21/d31/d50/ca1 0 2024-04-23T14:49:49.273 INFO:tasks.workunit.client.0.smithi081.stdout:3/504: dread d4/d7/f6f [0,4194304] 0 2024-04-23T14:49:49.273 INFO:tasks.workunit.client.0.smithi081.stdout:3/505: chown d4/c7b 2807 1 2024-04-23T14:49:49.279 INFO:tasks.workunit.client.0.smithi081.stdout:5/631: dwrite d17/d4f/d61/f84 [0,4194304] 0 2024-04-23T14:49:49.283 INFO:tasks.workunit.client.0.smithi081.stdout:9/595: creat d3/de/fbf x:0 0 0 2024-04-23T14:49:49.283 INFO:tasks.workunit.client.0.smithi081.stdout:6/576: read d1/f18 [2674590,105333] 0 2024-04-23T14:49:49.283 INFO:tasks.workunit.client.0.smithi081.stdout:6/577: chown d1/d51/d65/d8/d2e/d59/faa 1 1 2024-04-23T14:49:49.283 INFO:tasks.workunit.client.0.smithi081.stdout:9/596: write d3/de/d1d/d5b/d7b/fa6 [838444,75002] 0 2024-04-23T14:49:49.284 INFO:tasks.workunit.client.0.smithi081.stdout:9/597: creat d3/de/d22/fc0 x:0 0 0 2024-04-23T14:49:49.284 INFO:tasks.workunit.client.0.smithi081.stdout:9/598: creat d3/de/d14/d5e/d72/fc1 x:0 0 0 2024-04-23T14:49:49.284 INFO:tasks.workunit.client.0.smithi081.stdout:9/599: truncate d3/de/d25/f8e 1745908 0 2024-04-23T14:49:49.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:48 smithi156 ceph-mon[32341]: pgmap v33: 65 pgs: 65 active+clean; 1.3 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 77 MiB/s rd, 89 MiB/s wr, 453 op/s 2024-04-23T14:49:49.286 INFO:tasks.workunit.client.0.smithi081.stdout:4/551: rename d1/d4/d11/d9d/dac/f9b to d1/d1d/d39/d8d/fb8 0 2024-04-23T14:49:49.292 INFO:tasks.workunit.client.0.smithi081.stdout:0/647: unlink d6/d37/d67/l89 0 2024-04-23T14:49:49.292 INFO:tasks.workunit.client.0.smithi081.stdout:0/648: dread - d6/d69/f6f zero size 2024-04-23T14:49:49.292 INFO:tasks.workunit.client.0.smithi081.stdout:0/649: chown d6/d37/d4d/f55 111244 1 2024-04-23T14:49:49.292 INFO:tasks.workunit.client.0.smithi081.stdout:0/650: stat d6/d11/d14/db8/fc1 0 2024-04-23T14:49:49.295 INFO:tasks.workunit.client.1.smithi156.stdout:1/282: truncate db/d25/f3b 575296 0 2024-04-23T14:49:49.295 INFO:tasks.workunit.client.1.smithi156.stdout:1/283: creat db/d1f/d2f/f56 x:0 0 0 2024-04-23T14:49:49.295 INFO:tasks.workunit.client.1.smithi156.stdout:1/284: write db/f4f [1041389,130582] 0 2024-04-23T14:49:49.295 INFO:tasks.workunit.client.0.smithi081.stdout:2/624: dwrite d1/d1e/fb0 [0,4194304] 0 2024-04-23T14:49:49.295 INFO:tasks.workunit.client.0.smithi081.stdout:2/625: creat d1/d11/fdb x:0 0 0 2024-04-23T14:49:49.295 INFO:tasks.workunit.client.0.smithi081.stdout:2/626: write d1/d33/d95/fc9 [944650,116008] 0 2024-04-23T14:49:49.295 INFO:tasks.workunit.client.0.smithi081.stdout:2/627: write d1/f7f [1110268,6748] 0 2024-04-23T14:49:49.298 INFO:tasks.workunit.client.0.smithi081.stdout:5/632: dread d17/d1f/d36/daf/fc4 [4194304,4194304] 0 2024-04-23T14:49:49.302 INFO:tasks.workunit.client.1.smithi156.stdout:7/247: creat dc/d1d/f42 x:0 0 0 2024-04-23T14:49:49.305 INFO:tasks.workunit.client.1.smithi156.stdout:3/210: dwrite d4/db/dd/d1d/d1e/d13/f34 [0,4194304] 0 2024-04-23T14:49:49.307 INFO:tasks.workunit.client.1.smithi156.stdout:0/219: mkdir d0/d4/d11/d3f/d45 0 2024-04-23T14:49:49.308 INFO:tasks.workunit.client.0.smithi081.stdout:8/791: symlink d3/dc6/l104 0 2024-04-23T14:49:49.309 INFO:tasks.workunit.client.1.smithi156.stdout:6/275: rmdir d3/d16/d46/d2b/d3b/d57 0 2024-04-23T14:49:49.311 INFO:tasks.workunit.client.1.smithi156.stdout:4/215: dwrite d0/d8/d1e/f22 [4194304,4194304] 0 2024-04-23T14:49:49.311 INFO:tasks.workunit.client.1.smithi156.stdout:4/216: chown d0/d8/d1e/l20 1734755 1 2024-04-23T14:49:49.314 INFO:tasks.workunit.client.1.smithi156.stdout:2/222: mknod d4/c52 0 2024-04-23T14:49:49.314 INFO:tasks.workunit.client.1.smithi156.stdout:2/223: creat d4/d21/d42/f53 x:0 0 0 2024-04-23T14:49:49.320 INFO:tasks.workunit.client.0.smithi081.stdout:7/482: dwrite d3/d20/f3f [0,4194304] 0 2024-04-23T14:49:49.321 INFO:tasks.workunit.client.1.smithi156.stdout:7/248: link dc/f17 dc/d1d/d41/f43 0 2024-04-23T14:49:49.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:48 smithi081 ceph-mon[25540]: pgmap v33: 65 pgs: 65 active+clean; 1.3 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 77 MiB/s rd, 89 MiB/s wr, 453 op/s 2024-04-23T14:49:49.327 INFO:tasks.workunit.client.1.smithi156.stdout:1/285: dwrite db/f39 [0,4194304] 0 2024-04-23T14:49:49.328 INFO:tasks.workunit.client.1.smithi156.stdout:3/211: symlink d4/db/l38 0 2024-04-23T14:49:49.328 INFO:tasks.workunit.client.1.smithi156.stdout:3/212: getdents d4/db/dd/d1d/d1e/d2b/d31 0 2024-04-23T14:49:49.328 INFO:tasks.workunit.client.1.smithi156.stdout:3/213: stat d4/db/dd/d1d/l33 0 2024-04-23T14:49:49.329 INFO:tasks.workunit.client.1.smithi156.stdout:0/220: truncate d0/d16/d3a/d1e/f3d 909636 0 2024-04-23T14:49:49.333 INFO:tasks.workunit.client.0.smithi081.stdout:3/506: unlink d4/d7/d49/f8f 0 2024-04-23T14:49:49.334 INFO:tasks.workunit.client.0.smithi081.stdout:8/792: read d3/d11/f35 [6734124,98596] 0 2024-04-23T14:49:49.335 INFO:tasks.workunit.client.0.smithi081.stdout:8/793: fsync d3/d11/d48/d7e/f95 0 2024-04-23T14:49:49.338 INFO:tasks.workunit.client.0.smithi081.stdout:6/578: creat d1/d51/d65/d78/fce x:0 0 0 2024-04-23T14:49:49.342 INFO:tasks.workunit.client.0.smithi081.stdout:9/600: dwrite d3/d1a/f52 [0,4194304] 0 2024-04-23T14:49:49.342 INFO:tasks.workunit.client.0.smithi081.stdout:9/601: chown d3/de/d14/f3c 1302408 1 2024-04-23T14:49:49.347 INFO:tasks.workunit.client.0.smithi081.stdout:4/552: mkdir d1/d8b/db9 0 2024-04-23T14:49:49.347 INFO:tasks.workunit.client.0.smithi081.stdout:4/553: readlink d1/d1d/d59/l7d 0 2024-04-23T14:49:49.347 INFO:tasks.workunit.client.0.smithi081.stdout:0/651: symlink d6/d11/d14/d24/d6b/lca 0 2024-04-23T14:49:49.347 INFO:tasks.workunit.client.1.smithi156.stdout:7/249: creat dc/d1d/d20/f44 x:0 0 0 2024-04-23T14:49:49.355 INFO:tasks.workunit.client.0.smithi081.stdout:2/628: rename d1/d1e/f30 to d1/d11/d21/d52/fdc 0 2024-04-23T14:49:49.355 INFO:tasks.workunit.client.0.smithi081.stdout:2/629: fdatasync d1/d11/d21/d34/f76 0 2024-04-23T14:49:49.356 INFO:tasks.workunit.client.1.smithi156.stdout:1/286: creat db/d1f/d2d/d48/f57 x:0 0 0 2024-04-23T14:49:49.359 INFO:tasks.workunit.client.1.smithi156.stdout:3/214: mknod d4/db/dd/d1d/d1e/d2b/d31/c39 0 2024-04-23T14:49:49.359 INFO:tasks.workunit.client.1.smithi156.stdout:3/215: dread - d4/db/dd/d1d/f37 zero size 2024-04-23T14:49:49.359 INFO:tasks.workunit.client.1.smithi156.stdout:3/216: chown d4/l5 246821 1 2024-04-23T14:49:49.359 INFO:tasks.workunit.client.1.smithi156.stdout:3/217: write d4/db/dd/d1d/f37 [664754,28045] 0 2024-04-23T14:49:49.359 INFO:tasks.workunit.client.0.smithi081.stdout:5/633: mknod d17/d18/d3a/d8e/cdf 0 2024-04-23T14:49:49.361 INFO:tasks.workunit.client.1.smithi156.stdout:0/221: creat d0/f46 x:0 0 0 2024-04-23T14:49:49.363 INFO:tasks.workunit.client.0.smithi081.stdout:0/652: write d6/f2d [1131424,16269] 0 2024-04-23T14:49:49.364 INFO:tasks.workunit.client.1.smithi156.stdout:8/217: rename d5/d19 to d5/d9/d10/d1d/d4c 0 2024-04-23T14:49:49.364 INFO:tasks.workunit.client.1.smithi156.stdout:8/218: write d5/f1c [3684480,88463] 0 2024-04-23T14:49:49.365 INFO:tasks.workunit.client.0.smithi081.stdout:5/634: dread d17/d65/f7e [0,4194304] 0 2024-04-23T14:49:49.367 INFO:tasks.workunit.client.1.smithi156.stdout:2/224: mkdir d4/d54 0 2024-04-23T14:49:49.368 INFO:tasks.workunit.client.0.smithi081.stdout:8/794: symlink d3/d11/d34/l105 0 2024-04-23T14:49:49.368 INFO:tasks.workunit.client.0.smithi081.stdout:8/795: read d3/d1a/f51 [2540651,16231] 0 2024-04-23T14:49:49.369 INFO:tasks.workunit.client.1.smithi156.stdout:1/287: symlink db/d1f/d2f/d47/l58 0 2024-04-23T14:49:49.371 INFO:tasks.workunit.client.1.smithi156.stdout:3/218: unlink d4/db/dd/d20/c22 0 2024-04-23T14:49:49.375 INFO:tasks.workunit.client.1.smithi156.stdout:6/276: rename d3/c9 to d3/da/d1d/c70 0 2024-04-23T14:49:49.375 INFO:tasks.workunit.client.1.smithi156.stdout:6/277: truncate d3/da/d1d/f61 788643 0 2024-04-23T14:49:49.376 INFO:tasks.workunit.client.1.smithi156.stdout:0/222: write d0/d16/d3a/d2a/f6 [6708022,68868] 0 2024-04-23T14:49:49.379 INFO:tasks.workunit.client.1.smithi156.stdout:8/219: creat d5/d9/f4d x:0 0 0 2024-04-23T14:49:49.380 INFO:tasks.workunit.client.1.smithi156.stdout:8/220: chown d5/d9/d10/d1d/d4c/f42 0 1 2024-04-23T14:49:49.385 INFO:tasks.workunit.client.0.smithi081.stdout:6/579: mkdir d1/d51/d65/d1c/d6e/da0/da1/dc1/dc9/dcf 0 2024-04-23T14:49:49.386 INFO:tasks.workunit.client.0.smithi081.stdout:6/580: write d1/f18 [3825046,103424] 0 2024-04-23T14:49:49.386 INFO:tasks.workunit.client.0.smithi081.stdout:6/581: getdents d1/d51/d65/d1c/d6e/da0/da1/dc1/dc9/dcf 0 2024-04-23T14:49:49.386 INFO:tasks.workunit.client.0.smithi081.stdout:6/582: truncate d1/d51/d65/d8/d2e/f5b 979020 0 2024-04-23T14:49:49.386 INFO:tasks.workunit.client.0.smithi081.stdout:6/583: stat d1/d51/d7b/d91/f9f 0 2024-04-23T14:49:49.386 INFO:tasks.workunit.client.0.smithi081.stdout:8/796: dread d3/d11/d34/d8b/fa6 [0,4194304] 0 2024-04-23T14:49:49.387 INFO:tasks.workunit.client.0.smithi081.stdout:8/797: truncate d3/d11/d48/fe2 979192 0 2024-04-23T14:49:49.387 INFO:tasks.workunit.client.0.smithi081.stdout:8/798: creat d3/d11/d48/d7e/f106 x:0 0 0 2024-04-23T14:49:49.387 INFO:tasks.workunit.client.1.smithi156.stdout:2/225: link d4/d13/d19/f1a d4/d21/d42/f55 0 2024-04-23T14:49:49.387 INFO:tasks.workunit.client.1.smithi156.stdout:2/226: dread - d4/d21/d42/f4e zero size 2024-04-23T14:49:49.391 INFO:tasks.workunit.client.1.smithi156.stdout:3/219: mknod d4/db/dd/d20/c3a 0 2024-04-23T14:49:49.395 INFO:tasks.workunit.client.1.smithi156.stdout:8/221: mkdir d5/d4e 0 2024-04-23T14:49:49.395 INFO:tasks.workunit.client.1.smithi156.stdout:8/222: fdatasync d5/d9/d10/d1d/d4c/d29/f43 0 2024-04-23T14:49:49.395 INFO:tasks.workunit.client.1.smithi156.stdout:6/278: dread d3/da/d1d/f35 [0,4194304] 0 2024-04-23T14:49:49.396 INFO:tasks.workunit.client.0.smithi081.stdout:9/602: creat d3/de/d1d/fc2 x:0 0 0 2024-04-23T14:49:49.396 INFO:tasks.workunit.client.0.smithi081.stdout:9/603: chown d3/de/d76/f7d 15218 1 2024-04-23T14:49:49.398 INFO:tasks.workunit.client.0.smithi081.stdout:4/554: truncate d1/f1e 2644211 0 2024-04-23T14:49:49.402 INFO:tasks.workunit.client.0.smithi081.stdout:8/799: dread d3/d11/d34/fb6 [0,4194304] 0 2024-04-23T14:49:49.402 INFO:tasks.workunit.client.1.smithi156.stdout:5/277: sync 2024-04-23T14:49:49.403 INFO:tasks.workunit.client.1.smithi156.stdout:9/184: sync 2024-04-23T14:49:49.406 INFO:tasks.workunit.client.1.smithi156.stdout:7/250: dwrite dc/f14 [0,4194304] 0 2024-04-23T14:49:49.410 INFO:tasks.workunit.client.0.smithi081.stdout:7/483: rename d3/d21/d31/d33/d4b/d4c/d4f to d3/d21/d31/d50/da2 0 2024-04-23T14:49:49.410 INFO:tasks.workunit.client.0.smithi081.stdout:0/653: symlink d6/d37/d4d/d71/lcb 0 2024-04-23T14:49:49.411 INFO:tasks.workunit.client.0.smithi081.stdout:5/635: mkdir d17/d1f/d42/d9b/d9e/da3/de0 0 2024-04-23T14:49:49.411 INFO:tasks.workunit.client.0.smithi081.stdout:5/636: truncate d17/d18/d3a/f71 1565258 0 2024-04-23T14:49:49.411 INFO:tasks.workunit.client.0.smithi081.stdout:6/584: truncate d1/d51/d54/f6b 250143 0 2024-04-23T14:49:49.411 INFO:tasks.workunit.client.1.smithi156.stdout:9/185: creat d1/d2/d4/dc/f41 x:0 0 0 2024-04-23T14:49:49.414 INFO:tasks.workunit.client.1.smithi156.stdout:6/279: rmdir d3/da/d1d 39 2024-04-23T14:49:49.414 INFO:tasks.workunit.client.1.smithi156.stdout:6/280: truncate d3/da/d1d/d59/f6d 915670 0 2024-04-23T14:49:49.414 INFO:tasks.workunit.client.1.smithi156.stdout:6/281: stat d3/d16/d5c/d6f 0 2024-04-23T14:49:49.415 INFO:tasks.workunit.client.0.smithi081.stdout:4/555: write d1/d4/dc/f78 [27059,29375] 0 2024-04-23T14:49:49.415 INFO:tasks.workunit.client.1.smithi156.stdout:8/223: dread d5/d9/f13 [0,4194304] 0 2024-04-23T14:49:49.416 INFO:tasks.workunit.client.0.smithi081.stdout:8/800: mkdir d3/d11/d4f/d6c/d107 0 2024-04-23T14:49:49.417 INFO:tasks.workunit.client.1.smithi156.stdout:7/251: dread dc/f19 [0,4194304] 0 2024-04-23T14:49:49.418 INFO:tasks.workunit.client.0.smithi081.stdout:3/507: rename d4/d7/d2e/c39 to d4/d7/d7f/d91/ca3 0 2024-04-23T14:49:49.418 INFO:tasks.workunit.client.0.smithi081.stdout:3/508: readlink d4/dc/l86 0 2024-04-23T14:49:49.422 INFO:tasks.workunit.client.1.smithi156.stdout:7/252: mknod dc/d1d/d24/c45 0 2024-04-23T14:49:49.423 INFO:tasks.workunit.client.0.smithi081.stdout:5/637: symlink d17/d1f/d42/d9b/d9e/da3/le1 0 2024-04-23T14:49:49.424 INFO:tasks.workunit.client.0.smithi081.stdout:5/638: fsync d17/d3c/f88 0 2024-04-23T14:49:49.424 INFO:tasks.workunit.client.0.smithi081.stdout:5/639: truncate d17/d1f/d36/fc6 710661 0 2024-04-23T14:49:49.424 INFO:tasks.workunit.client.1.smithi156.stdout:7/253: write dc/d1d/d24/f27 [1326540,109059] 0 2024-04-23T14:49:49.424 INFO:tasks.workunit.client.1.smithi156.stdout:5/278: dread d1/d3/fd [0,4194304] 0 2024-04-23T14:49:49.435 INFO:tasks.workunit.client.1.smithi156.stdout:5/279: rename d1/d3/f1e to d1/d3/d20/d3e/f61 0 2024-04-23T14:49:49.435 INFO:tasks.workunit.client.1.smithi156.stdout:5/280: truncate d1/d3/d20/f3c 457589 0 2024-04-23T14:49:49.435 INFO:tasks.workunit.client.1.smithi156.stdout:5/281: truncate d1/d3/d20/f5f 759990 0 2024-04-23T14:49:49.435 INFO:tasks.workunit.client.1.smithi156.stdout:3/220: dread d4/db/dd/d1d/d1e/d13/f34 [0,4194304] 0 2024-04-23T14:49:49.436 INFO:tasks.workunit.client.0.smithi081.stdout:8/801: unlink d3/d11/d4f/d6c/c6e 0 2024-04-23T14:49:49.436 INFO:tasks.workunit.client.0.smithi081.stdout:8/802: read - d3/d3c/ddb/df3/ff6 zero size 2024-04-23T14:49:49.436 INFO:tasks.workunit.client.0.smithi081.stdout:7/484: rename d3/d20/d77 to d3/d21/d41/da3 0 2024-04-23T14:49:49.438 INFO:tasks.workunit.client.0.smithi081.stdout:3/509: unlink d4/d7/d7f/f65 0 2024-04-23T14:49:49.441 INFO:tasks.workunit.client.1.smithi156.stdout:1/288: dwrite db/d1f/d2f/f56 [0,4194304] 0 2024-04-23T14:49:49.441 INFO:tasks.workunit.client.1.smithi156.stdout:1/289: creat db/d25/d30/f59 x:0 0 0 2024-04-23T14:49:49.441 INFO:tasks.workunit.client.1.smithi156.stdout:5/282: truncate d1/d11/d18/d19/f36 2050096 0 2024-04-23T14:49:49.443 INFO:tasks.workunit.client.0.smithi081.stdout:4/556: mkdir d1/d4/dc/dba 0 2024-04-23T14:49:49.444 INFO:tasks.workunit.client.1.smithi156.stdout:8/224: write d5/d9/d10/d1d/d21/f2f [3715156,6625] 0 2024-04-23T14:49:49.444 INFO:tasks.workunit.client.1.smithi156.stdout:8/225: dread - d5/d9/d36/f3e zero size 2024-04-23T14:49:49.444 INFO:tasks.workunit.client.1.smithi156.stdout:8/226: chown d5/d9/le 686402 1 2024-04-23T14:49:49.444 INFO:tasks.workunit.client.0.smithi081.stdout:7/485: creat d3/d21/d31/d50/da2/fa4 x:0 0 0 2024-04-23T14:49:49.449 INFO:tasks.workunit.client.1.smithi156.stdout:8/227: read d5/d9/d10/f34 [34173,55477] 0 2024-04-23T14:49:49.449 INFO:tasks.workunit.client.1.smithi156.stdout:0/223: truncate d0/d16/d3a/d2a/f6 5967073 0 2024-04-23T14:49:49.449 INFO:tasks.workunit.client.1.smithi156.stdout:3/221: dread d4/db/dd/d1d/f2e [0,4194304] 0 2024-04-23T14:49:49.450 INFO:tasks.workunit.client.1.smithi156.stdout:3/222: creat d4/db/dd/d1d/f3b x:0 0 0 2024-04-23T14:49:49.450 INFO:tasks.workunit.client.1.smithi156.stdout:7/254: dread dc/f14 [0,4194304] 0 2024-04-23T14:49:49.452 INFO:tasks.workunit.client.1.smithi156.stdout:2/227: dwrite d4/d13/f20 [0,4194304] 0 2024-04-23T14:49:49.453 INFO:tasks.workunit.client.1.smithi156.stdout:1/290: unlink db/d15/f23 0 2024-04-23T14:49:49.453 INFO:tasks.workunit.client.1.smithi156.stdout:1/291: fdatasync db/d25/f3d 0 2024-04-23T14:49:49.456 INFO:tasks.workunit.client.0.smithi081.stdout:9/604: dwrite d3/de/d14/d5e/d72/fb7 [0,4194304] 0 2024-04-23T14:49:49.457 INFO:tasks.workunit.client.0.smithi081.stdout:0/654: rename d6/d11/d14/d41/d5b/d3f/d44/d76/c9d to d6/d11/d14/d41/da1/daa/ccc 0 2024-04-23T14:49:49.468 INFO:tasks.workunit.client.1.smithi156.stdout:0/224: symlink d0/l47 0 2024-04-23T14:49:49.468 INFO:tasks.workunit.client.1.smithi156.stdout:5/283: unlink d1/f3f 0 2024-04-23T14:49:49.468 INFO:tasks.workunit.client.1.smithi156.stdout:3/223: link d4/db/dd/d20/l2d d4/db/dd/d20/l3c 0 2024-04-23T14:49:49.468 INFO:tasks.workunit.client.1.smithi156.stdout:5/284: truncate d1/d3/f3a 746402 0 2024-04-23T14:49:49.468 INFO:tasks.workunit.client.1.smithi156.stdout:1/292: getdents db/d1f/d2f/d47 0 2024-04-23T14:49:49.468 INFO:tasks.workunit.client.1.smithi156.stdout:1/293: stat db/d15/l14 0 2024-04-23T14:49:49.472 INFO:tasks.workunit.client.1.smithi156.stdout:5/285: symlink d1/d3/d20/d3e/l62 0 2024-04-23T14:49:49.475 INFO:tasks.workunit.client.0.smithi081.stdout:9/605: truncate d3/d1a/d6c/f42 202412 0 2024-04-23T14:49:49.478 INFO:tasks.workunit.client.0.smithi081.stdout:7/486: dread d3/d21/d31/d63/f74 [0,4194304] 0 2024-04-23T14:49:49.478 INFO:tasks.workunit.client.1.smithi156.stdout:3/224: symlink d4/l3d 0 2024-04-23T14:49:49.481 INFO:tasks.workunit.client.1.smithi156.stdout:1/294: mknod db/d1f/d4b/c5a 0 2024-04-23T14:49:49.483 INFO:tasks.workunit.client.0.smithi081.stdout:0/655: mknod d6/d11/ccd 0 2024-04-23T14:49:49.483 INFO:tasks.workunit.client.0.smithi081.stdout:0/656: stat d6/d37/d85/f8b 0 2024-04-23T14:49:49.483 INFO:tasks.workunit.client.0.smithi081.stdout:0/657: truncate d6/d11/d14/d41/f43 4891654 0 2024-04-23T14:49:49.486 INFO:tasks.workunit.client.1.smithi156.stdout:5/286: mknod d1/c63 0 2024-04-23T14:49:49.491 INFO:tasks.workunit.client.0.smithi081.stdout:5/640: rename d17/cc2 to d17/d37/da4/ce2 0 2024-04-23T14:49:49.491 INFO:tasks.workunit.client.0.smithi081.stdout:6/585: dwrite d1/d2/d49/fb7 [0,4194304] 0 2024-04-23T14:49:49.491 INFO:tasks.workunit.client.0.smithi081.stdout:6/586: fdatasync d1/d51/d65/f4f 0 2024-04-23T14:49:49.497 INFO:tasks.workunit.client.0.smithi081.stdout:3/510: dread d4/d7/df/f1b [0,4194304] 0 2024-04-23T14:49:49.499 INFO:tasks.workunit.client.1.smithi156.stdout:3/225: mkdir d4/db/dd/d20/d3e 0 2024-04-23T14:49:49.499 INFO:tasks.workunit.client.1.smithi156.stdout:3/226: chown d4/db/dd/d20/c3a 24 1 2024-04-23T14:49:49.499 INFO:tasks.workunit.client.1.smithi156.stdout:3/227: readlink d4/l3d 0 2024-04-23T14:49:49.499 INFO:tasks.workunit.client.1.smithi156.stdout:3/228: creat d4/f3f x:0 0 0 2024-04-23T14:49:49.500 INFO:tasks.workunit.client.1.smithi156.stdout:0/225: write d0/d16/d3a/d2a/d1d/f17 [1205182,67444] 0 2024-04-23T14:49:49.502 INFO:tasks.workunit.client.1.smithi156.stdout:1/295: getdents db/d1f/d2d/d48 0 2024-04-23T14:49:49.510 INFO:tasks.workunit.client.0.smithi081.stdout:4/557: dwrite d1/fa [8388608,4194304] 0 2024-04-23T14:49:49.510 INFO:tasks.workunit.client.0.smithi081.stdout:4/558: readlink d1/d1d/l2f 0 2024-04-23T14:49:49.510 INFO:tasks.workunit.client.0.smithi081.stdout:4/559: write d1/f29 [857084,110978] 0 2024-04-23T14:49:49.510 INFO:tasks.workunit.client.0.smithi081.stdout:4/560: creat d1/fbb x:0 0 0 2024-04-23T14:49:49.513 INFO:tasks.workunit.client.1.smithi156.stdout:0/226: truncate d0/d4/fe 2064685 0 2024-04-23T14:49:49.513 INFO:tasks.workunit.client.1.smithi156.stdout:0/227: stat d0/d16 0 2024-04-23T14:49:49.513 INFO:tasks.workunit.client.1.smithi156.stdout:4/217: sync 2024-04-23T14:49:49.513 INFO:tasks.workunit.client.1.smithi156.stdout:4/218: chown d0/d8/d2c/c42 3965465 1 2024-04-23T14:49:49.513 INFO:tasks.workunit.client.1.smithi156.stdout:4/219: creat d0/f46 x:0 0 0 2024-04-23T14:49:49.515 INFO:tasks.workunit.client.1.smithi156.stdout:1/296: unlink db/d25/d30/d38/l46 0 2024-04-23T14:49:49.515 INFO:tasks.workunit.client.1.smithi156.stdout:1/297: write db/d25/d30/f43 [2633603,116142] 0 2024-04-23T14:49:49.519 INFO:tasks.workunit.client.0.smithi081.stdout:8/803: dwrite d3/f4a [0,4194304] 0 2024-04-23T14:49:49.519 INFO:tasks.workunit.client.1.smithi156.stdout:8/228: dwrite d5/d9/d10/f33 [0,4194304] 0 2024-04-23T14:49:49.520 INFO:tasks.workunit.client.1.smithi156.stdout:0/228: mknod d0/d4/d11/d3f/d45/c48 0 2024-04-23T14:49:49.527 INFO:tasks.workunit.client.0.smithi081.stdout:0/658: creat d6/d11/d14/d41/d5b/d3f/d44/d78/d83/fce x:0 0 0 2024-04-23T14:49:49.527 INFO:tasks.workunit.client.0.smithi081.stdout:0/659: dread - d6/d11/d14/d41/d5b/d3f/d44/d76/fc2 zero size 2024-04-23T14:49:49.528 INFO:tasks.workunit.client.1.smithi156.stdout:4/220: rename d0/d8/f18 to d0/d8/d1e/f47 0 2024-04-23T14:49:49.529 INFO:tasks.workunit.client.1.smithi156.stdout:4/221: chown d0/f46 49959924 1 2024-04-23T14:49:49.545 INFO:tasks.workunit.client.0.smithi081.stdout:6/587: unlink d1/d51/d65/d13/d16/f32 0 2024-04-23T14:49:49.545 INFO:tasks.workunit.client.0.smithi081.stdout:3/511: mkdir d4/d7/df/d30/d64/da4 0 2024-04-23T14:49:49.545 INFO:tasks.workunit.client.0.smithi081.stdout:3/512: dread - d4/dc/d50/d9a/f9b zero size 2024-04-23T14:49:49.545 INFO:tasks.workunit.client.0.smithi081.stdout:3/513: write d4/dc/d50/d9a/f9b [761255,103043] 0 2024-04-23T14:49:49.545 INFO:tasks.workunit.client.0.smithi081.stdout:3/514: write d4/d7/df/f92 [861953,80761] 0 2024-04-23T14:49:49.545 INFO:tasks.workunit.client.0.smithi081.stdout:3/515: write d4/d7/d32/f94 [532942,62363] 0 2024-04-23T14:49:49.545 INFO:tasks.workunit.client.0.smithi081.stdout:3/516: fsync d4/d41/f67 0 2024-04-23T14:49:49.549 INFO:tasks.workunit.client.1.smithi156.stdout:8/229: getdents d5 0 2024-04-23T14:49:49.549 INFO:tasks.workunit.client.1.smithi156.stdout:8/230: write d5/d9/d10/f46 [366560,104589] 0 2024-04-23T14:49:49.549 INFO:tasks.workunit.client.1.smithi156.stdout:8/231: write d5/f1c [4653928,9057] 0 2024-04-23T14:49:49.549 INFO:tasks.workunit.client.1.smithi156.stdout:8/232: read - d5/d39/f49 zero size 2024-04-23T14:49:49.553 INFO:tasks.workunit.client.1.smithi156.stdout:0/229: write d0/d4/f3 [2251171,108102] 0 2024-04-23T14:49:49.553 INFO:tasks.workunit.client.1.smithi156.stdout:5/287: dwrite d1/d11/d18/d19/f36 [0,4194304] 0 2024-04-23T14:49:49.556 INFO:tasks.workunit.client.1.smithi156.stdout:7/255: dwrite dc/d1d/d24/f28 [0,4194304] 0 2024-04-23T14:49:49.560 INFO:tasks.workunit.client.1.smithi156.stdout:8/233: creat d5/d45/f4f x:0 0 0 2024-04-23T14:49:49.560 INFO:tasks.workunit.client.1.smithi156.stdout:8/234: chown d5/d9/d10/d1d/d21 8326 1 2024-04-23T14:49:49.562 INFO:tasks.workunit.client.1.smithi156.stdout:3/229: dwrite d4/db/dd/d1d/d1e/d13/f1a [0,4194304] 0 2024-04-23T14:49:49.566 INFO:tasks.workunit.client.0.smithi081.stdout:4/561: mkdir d1/d8b/dbc 0 2024-04-23T14:49:49.573 INFO:tasks.workunit.client.0.smithi081.stdout:5/641: dread f14 [0,4194304] 0 2024-04-23T14:49:49.574 INFO:tasks.workunit.client.0.smithi081.stdout:6/588: mkdir d1/d51/d65/d13/d16/dd0 0 2024-04-23T14:49:49.576 INFO:tasks.workunit.client.0.smithi081.stdout:9/606: rename d3/d1a/f52 to d3/de/d1d/fc3 0 2024-04-23T14:49:49.578 INFO:tasks.workunit.client.1.smithi156.stdout:5/288: write d1/d17/f1a [3311809,116103] 0 2024-04-23T14:49:49.578 INFO:tasks.workunit.client.1.smithi156.stdout:5/289: write d1/d3/d20/f4c [803711,73452] 0 2024-04-23T14:49:49.578 INFO:tasks.workunit.client.1.smithi156.stdout:5/290: dread - d1/f38 zero size 2024-04-23T14:49:49.578 INFO:tasks.workunit.client.1.smithi156.stdout:5/291: read d1/d17/f1a [357995,60981] 0 2024-04-23T14:49:49.578 INFO:tasks.workunit.client.1.smithi156.stdout:5/292: fsync d1/f56 0 2024-04-23T14:49:49.579 INFO:tasks.workunit.client.0.smithi081.stdout:5/642: mkdir d17/d65/de3 0 2024-04-23T14:49:49.579 INFO:tasks.workunit.client.0.smithi081.stdout:5/643: write d17/d3c/f3e [207849,32327] 0 2024-04-23T14:49:49.582 INFO:tasks.workunit.client.1.smithi156.stdout:8/235: creat d5/d9/d10/d1d/d4c/f50 x:0 0 0 2024-04-23T14:49:49.583 INFO:tasks.workunit.client.0.smithi081.stdout:6/589: truncate d1/d51/d65/d8/d2e/f5b 1165025 0 2024-04-23T14:49:49.583 INFO:tasks.workunit.client.0.smithi081.stdout:6/590: creat d1/d51/d65/d1c/d66/fd1 x:0 0 0 2024-04-23T14:49:49.588 INFO:tasks.workunit.client.0.smithi081.stdout:3/517: rename d4/d7/d7f/d91/d6c/f73 to d4/dc/d50/d9a/fa5 0 2024-04-23T14:49:49.595 INFO:tasks.workunit.client.1.smithi156.stdout:5/293: mkdir d1/d3/d64 0 2024-04-23T14:49:49.595 INFO:tasks.workunit.client.1.smithi156.stdout:5/294: write d1/d11/f5e [129552,76449] 0 2024-04-23T14:49:49.595 INFO:tasks.workunit.client.0.smithi081.stdout:6/591: mkdir d1/d51/d65/d1c/d6e/da0/dd2 0 2024-04-23T14:49:49.595 INFO:tasks.workunit.client.0.smithi081.stdout:6/592: read d1/d2/f1d [182370,27107] 0 2024-04-23T14:49:49.596 INFO:tasks.workunit.client.0.smithi081.stdout:3/518: mkdir d4/d7/d32/da6 0 2024-04-23T14:49:49.596 INFO:tasks.workunit.client.0.smithi081.stdout:3/519: write d4/d7/df/d30/f4c [3503550,77337] 0 2024-04-23T14:49:49.596 INFO:tasks.workunit.client.0.smithi081.stdout:3/520: truncate d4/d7/f8a 821646 0 2024-04-23T14:49:49.597 INFO:tasks.workunit.client.0.smithi081.stdout:9/607: dread d3/de/d14/d5e/f96 [0,4194304] 0 2024-04-23T14:49:49.598 INFO:tasks.workunit.client.0.smithi081.stdout:6/593: symlink d1/d51/d65/d8/db1/ld3 0 2024-04-23T14:49:49.598 INFO:tasks.workunit.client.0.smithi081.stdout:6/594: read d1/f18 [2126828,1293] 0 2024-04-23T14:49:49.598 INFO:tasks.workunit.client.0.smithi081.stdout:6/595: stat d1/d51/d65/d13/d16/c25 0 2024-04-23T14:49:49.599 INFO:tasks.workunit.client.1.smithi156.stdout:5/295: creat d1/d3/d64/f65 x:0 0 0 2024-04-23T14:49:49.599 INFO:tasks.workunit.client.1.smithi156.stdout:5/296: creat d1/d11/d18/d19/f66 x:0 0 0 2024-04-23T14:49:49.599 INFO:tasks.workunit.client.1.smithi156.stdout:5/297: chown d1/d11/f5e 114 1 2024-04-23T14:49:49.600 INFO:tasks.workunit.client.1.smithi156.stdout:5/298: dread - d1/d3/f4b zero size 2024-04-23T14:49:49.600 INFO:tasks.workunit.client.1.smithi156.stdout:5/299: read d1/d3/fa [1383092,7954] 0 2024-04-23T14:49:49.600 INFO:tasks.workunit.client.0.smithi081.stdout:9/608: link d3/de/d25/f45 d3/de/fc4 0 2024-04-23T14:49:49.600 INFO:tasks.workunit.client.0.smithi081.stdout:9/609: truncate d3/de/d76/db5/fbd 1023583 0 2024-04-23T14:49:49.602 INFO:tasks.workunit.client.1.smithi156.stdout:5/300: creat d1/d11/d18/d52/f67 x:0 0 0 2024-04-23T14:49:49.604 INFO:tasks.workunit.client.0.smithi081.stdout:6/596: truncate d1/d2/f1d 3855578 0 2024-04-23T14:49:49.604 INFO:tasks.workunit.client.0.smithi081.stdout:6/597: chown d1/d2 12301875 1 2024-04-23T14:49:49.604 INFO:tasks.workunit.client.0.smithi081.stdout:6/598: stat d1/d51/d65/d8/d2e/f2f 0 2024-04-23T14:49:49.605 INFO:tasks.workunit.client.1.smithi156.stdout:5/301: mknod d1/d3/d20/d3e/c68 0 2024-04-23T14:49:49.606 INFO:tasks.workunit.client.0.smithi081.stdout:6/599: rename d1/d2/d49/c57 to d1/d51/cd4 0 2024-04-23T14:49:49.608 INFO:tasks.workunit.client.0.smithi081.stdout:6/600: creat d1/d51/d65/d1c/d6e/da0/da1/dc1/dc9/fd5 x:0 0 0 2024-04-23T14:49:49.609 INFO:tasks.workunit.client.0.smithi081.stdout:6/601: write d1/d51/d65/d8/da4/fbd [117875,2458] 0 2024-04-23T14:49:49.610 INFO:tasks.workunit.client.0.smithi081.stdout:6/602: symlink d1/d51/d65/d13/d16/ld6 0 2024-04-23T14:49:49.611 INFO:tasks.workunit.client.0.smithi081.stdout:6/603: creat d1/d2/d8e/d98/fd7 x:0 0 0 2024-04-23T14:49:49.612 INFO:tasks.workunit.client.0.smithi081.stdout:5/644: dread d17/d1f/f23 [0,4194304] 0 2024-04-23T14:49:49.612 INFO:tasks.workunit.client.0.smithi081.stdout:5/645: write d17/d4a/fbd [456013,42334] 0 2024-04-23T14:49:49.616 INFO:tasks.workunit.client.0.smithi081.stdout:6/604: creat d1/d51/d65/d1c/d6e/da0/da1/dc1/fd8 x:0 0 0 2024-04-23T14:49:49.617 INFO:tasks.workunit.client.0.smithi081.stdout:7/487: dwrite d3/d21/d31/d33/d52/f59 [0,4194304] 0 2024-04-23T14:49:49.617 INFO:tasks.workunit.client.0.smithi081.stdout:0/660: dwrite d6/d69/fa0 [0,4194304] 0 2024-04-23T14:49:49.618 INFO:tasks.workunit.client.1.smithi156.stdout:4/222: dwrite d0/f46 [0,4194304] 0 2024-04-23T14:49:49.618 INFO:tasks.workunit.client.0.smithi081.stdout:8/804: dwrite d3/f31 [0,4194304] 0 2024-04-23T14:49:49.619 INFO:tasks.workunit.client.1.smithi156.stdout:1/298: dwrite db/d15/f22 [0,4194304] 0 2024-04-23T14:49:49.619 INFO:tasks.workunit.client.1.smithi156.stdout:1/299: chown db/d1f/d28/l54 3378 1 2024-04-23T14:49:49.619 INFO:tasks.workunit.client.1.smithi156.stdout:1/300: readlink db/d1f/d4b/l51 0 2024-04-23T14:49:49.620 INFO:tasks.workunit.client.0.smithi081.stdout:5/646: symlink d17/d1f/d36/d9a/le4 0 2024-04-23T14:49:49.623 INFO:tasks.workunit.client.1.smithi156.stdout:4/223: truncate d0/d8/d1e/f47 3292511 0 2024-04-23T14:49:49.625 INFO:tasks.workunit.client.1.smithi156.stdout:0/230: dwrite d0/d4/ff [0,4194304] 0 2024-04-23T14:49:49.626 INFO:tasks.workunit.client.1.smithi156.stdout:4/224: mknod d0/d30/d34/c48 0 2024-04-23T14:49:49.630 INFO:tasks.workunit.client.0.smithi081.stdout:3/521: dread d4/d7/d32/f3e [0,4194304] 0 2024-04-23T14:49:49.632 INFO:tasks.workunit.client.1.smithi156.stdout:7/256: dwrite dc/f14 [0,4194304] 0 2024-04-23T14:49:49.635 INFO:tasks.workunit.client.1.smithi156.stdout:0/231: symlink d0/d4/d11/d3f/d45/l49 0 2024-04-23T14:49:49.640 INFO:tasks.workunit.client.1.smithi156.stdout:4/225: creat d0/d8/d1e/f49 x:0 0 0 2024-04-23T14:49:49.644 INFO:tasks.workunit.client.0.smithi081.stdout:7/488: read d3/d21/d31/d63/f82 [2091817,6587] 0 2024-04-23T14:49:49.644 INFO:tasks.workunit.client.1.smithi156.stdout:1/301: dread db/d15/f22 [0,4194304] 0 2024-04-23T14:49:49.649 INFO:tasks.workunit.client.0.smithi081.stdout:9/610: dwrite d3/de/d22/fac [4194304,4194304] 0 2024-04-23T14:49:49.651 INFO:tasks.workunit.client.1.smithi156.stdout:7/257: truncate dc/d1d/d24/f28 3621426 0 2024-04-23T14:49:49.651 INFO:tasks.workunit.client.1.smithi156.stdout:7/258: read dc/f1e [423395,60109] 0 2024-04-23T14:49:49.651 INFO:tasks.workunit.client.1.smithi156.stdout:2/228: dwrite d4/d26/f44 [4194304,4194304] 0 2024-04-23T14:49:49.653 INFO:tasks.workunit.client.0.smithi081.stdout:8/805: mkdir d3/d3c/ddb/df3/d108 0 2024-04-23T14:49:49.656 INFO:tasks.workunit.client.0.smithi081.stdout:0/661: rename d6/d37/f38 to d6/d11/d14/d24/fcf 0 2024-04-23T14:49:49.661 INFO:tasks.workunit.client.0.smithi081.stdout:5/647: creat d17/d18/fe5 x:0 0 0 2024-04-23T14:49:49.661 INFO:tasks.workunit.client.0.smithi081.stdout:3/522: mknod d4/dc/ca7 0 2024-04-23T14:49:49.662 INFO:tasks.workunit.client.0.smithi081.stdout:3/523: write d4/d7/d7f/d85/d9d/f63 [5220059,103799] 0 2024-04-23T14:49:49.662 INFO:tasks.workunit.client.0.smithi081.stdout:3/524: read - d4/dc/d10/d47/f96 zero size 2024-04-23T14:49:49.664 INFO:tasks.workunit.client.0.smithi081.stdout:7/489: creat d3/d97/fa5 x:0 0 0 2024-04-23T14:49:49.664 INFO:tasks.workunit.client.0.smithi081.stdout:7/490: readlink d3/d21/l35 0 2024-04-23T14:49:49.664 INFO:tasks.workunit.client.0.smithi081.stdout:7/491: write d3/d21/d31/d33/d4b/d6e/f87 [1039806,125904] 0 2024-04-23T14:49:49.670 INFO:tasks.workunit.client.0.smithi081.stdout:9/611: mknod d3/de/d14/d5e/d72/cc5 0 2024-04-23T14:49:49.674 INFO:tasks.workunit.client.0.smithi081.stdout:9/612: truncate d3/de/d47/f9c 384892 0 2024-04-23T14:49:49.680 INFO:tasks.workunit.client.1.smithi156.stdout:5/302: dwrite d1/d3/f4b [0,4194304] 0 2024-04-23T14:49:49.680 INFO:tasks.workunit.client.1.smithi156.stdout:5/303: creat d1/d3/d64/f69 x:0 0 0 2024-04-23T14:49:49.687 INFO:tasks.workunit.client.0.smithi081.stdout:8/806: mknod d3/d11/d48/d7e/de4/df0/c109 0 2024-04-23T14:49:49.687 INFO:tasks.workunit.client.0.smithi081.stdout:5/648: mkdir d17/d18/d3a/d8e/de6 0 2024-04-23T14:49:49.688 INFO:tasks.workunit.client.0.smithi081.stdout:5/649: chown d17/c89 16 1 2024-04-23T14:49:49.688 INFO:tasks.workunit.client.0.smithi081.stdout:8/807: truncate d3/d3c/f97 4889845 0 2024-04-23T14:49:49.688 INFO:tasks.workunit.client.0.smithi081.stdout:3/525: symlink d4/d7/d7f/d91/d6c/la8 0 2024-04-23T14:49:49.688 INFO:tasks.workunit.client.0.smithi081.stdout:3/526: creat d4/d7/d32/fa9 x:0 0 0 2024-04-23T14:49:49.688 INFO:tasks.workunit.client.0.smithi081.stdout:3/527: dread - d4/d7/d1a/f9e zero size 2024-04-23T14:49:49.688 INFO:tasks.workunit.client.1.smithi156.stdout:3/230: dwrite d4/f2a [0,4194304] 0 2024-04-23T14:49:49.688 INFO:tasks.workunit.client.1.smithi156.stdout:3/231: creat d4/db/dd/d1d/f40 x:0 0 0 2024-04-23T14:49:49.690 INFO:tasks.workunit.client.0.smithi081.stdout:5/650: mkdir d17/d3c/de7 0 2024-04-23T14:49:49.690 INFO:tasks.workunit.client.0.smithi081.stdout:5/651: creat d17/d1f/d36/d9a/fe8 x:0 0 0 2024-04-23T14:49:49.691 INFO:tasks.workunit.client.0.smithi081.stdout:5/652: write d17/d1f/d36/fca [810313,75147] 0 2024-04-23T14:49:49.694 INFO:tasks.workunit.client.1.smithi156.stdout:2/229: symlink d4/d21/d2f/l56 0 2024-04-23T14:49:49.694 INFO:tasks.workunit.client.1.smithi156.stdout:2/230: stat d4/d13/l3a 0 2024-04-23T14:49:49.695 INFO:tasks.workunit.client.0.smithi081.stdout:3/528: truncate d4/dc/d50/f4e 2091364 0 2024-04-23T14:49:49.696 INFO:tasks.workunit.client.0.smithi081.stdout:3/529: write d4/d7/df/f72 [332753,83514] 0 2024-04-23T14:49:49.699 INFO:tasks.workunit.client.0.smithi081.stdout:8/808: unlink d3/d1a/l7b 0 2024-04-23T14:49:49.699 INFO:tasks.workunit.client.1.smithi156.stdout:7/259: dread dc/d1d/f32 [0,4194304] 0 2024-04-23T14:49:49.703 INFO:tasks.workunit.client.1.smithi156.stdout:8/236: dread d5/d9/d10/f46 [0,4194304] 0 2024-04-23T14:49:49.704 INFO:tasks.workunit.client.0.smithi081.stdout:6/605: dwrite d1/d51/d65/d13/f3c [4194304,4194304] 0 2024-04-23T14:49:49.704 INFO:tasks.workunit.client.0.smithi081.stdout:6/606: chown d1/d51/d65/d8/d2e/d59/faa 188040 1 2024-04-23T14:49:49.704 INFO:tasks.workunit.client.0.smithi081.stdout:6/607: chown d1/d2 11 1 2024-04-23T14:49:49.710 INFO:tasks.workunit.client.1.smithi156.stdout:3/232: dread d4/f10 [4194304,4194304] 0 2024-04-23T14:49:49.710 INFO:tasks.workunit.client.1.smithi156.stdout:3/233: creat d4/db/dd/d1d/d1e/d13/f41 x:0 0 0 2024-04-23T14:49:49.711 INFO:tasks.workunit.client.1.smithi156.stdout:0/232: truncate d0/d4/ff 2599510 0 2024-04-23T14:49:49.711 INFO:tasks.workunit.client.1.smithi156.stdout:4/226: dwrite d0/d8/d1e/f22 [0,4194304] 0 2024-04-23T14:49:49.718 INFO:tasks.workunit.client.1.smithi156.stdout:5/304: mknod d1/d3/d43/d4e/c6a 0 2024-04-23T14:49:49.719 INFO:tasks.workunit.client.0.smithi081.stdout:1/677: sync 2024-04-23T14:49:49.719 INFO:tasks.workunit.client.0.smithi081.stdout:1/678: read d3/d3d/d41/d5e/d17/d58/f61 [472089,123451] 0 2024-04-23T14:49:49.719 INFO:tasks.workunit.client.0.smithi081.stdout:2/630: sync 2024-04-23T14:49:49.720 INFO:tasks.workunit.client.0.smithi081.stdout:3/530: write d4/dc/d10/d5a/f7c [355890,53601] 0 2024-04-23T14:49:49.720 INFO:tasks.workunit.client.0.smithi081.stdout:3/531: readlink d4/dc/l2d 0 2024-04-23T14:49:49.723 INFO:tasks.workunit.client.0.smithi081.stdout:8/809: mknod d3/dc6/c10a 0 2024-04-23T14:49:49.725 INFO:tasks.workunit.client.1.smithi156.stdout:1/302: dwrite db/d1f/d28/f37 [0,4194304] 0 2024-04-23T14:49:49.728 INFO:tasks.workunit.client.1.smithi156.stdout:2/231: unlink d4/d13/f23 0 2024-04-23T14:49:49.731 INFO:tasks.workunit.client.1.smithi156.stdout:8/237: creat d5/d9/d10/d1d/f51 x:0 0 0 2024-04-23T14:49:49.735 INFO:tasks.workunit.client.0.smithi081.stdout:2/631: truncate d1/d33/f40 198207 0 2024-04-23T14:49:49.738 INFO:tasks.workunit.client.0.smithi081.stdout:5/653: dread f4 [0,4194304] 0 2024-04-23T14:49:49.740 INFO:tasks.workunit.client.1.smithi156.stdout:3/234: mkdir d4/db/dd/d1d/d1e/d42 0 2024-04-23T14:49:49.740 INFO:tasks.workunit.client.1.smithi156.stdout:3/235: stat d4/db/dd/d1d/d1e 0 2024-04-23T14:49:49.742 INFO:tasks.workunit.client.0.smithi081.stdout:0/662: dwrite d6/d37/d67/f97 [0,4194304] 0 2024-04-23T14:49:49.742 INFO:tasks.workunit.client.0.smithi081.stdout:0/663: creat d6/d11/d14/d41/d5b/d59/fd0 x:0 0 0 2024-04-23T14:49:49.742 INFO:tasks.workunit.client.0.smithi081.stdout:0/664: chown d6/d11/d14/d41/l75 217557368 1 2024-04-23T14:49:49.742 INFO:tasks.workunit.client.0.smithi081.stdout:0/665: chown d6/d37/d67/dc8 49 1 2024-04-23T14:49:49.744 INFO:tasks.workunit.client.1.smithi156.stdout:0/233: mkdir d0/d16/d3a/d2b/d44/d4a 0 2024-04-23T14:49:49.744 INFO:tasks.workunit.client.1.smithi156.stdout:0/234: chown d0/d16/d3a/d2a/d1d 61 1 2024-04-23T14:49:49.748 INFO:tasks.workunit.client.0.smithi081.stdout:9/613: write d3/de/d47/fa9 [834472,30239] 0 2024-04-23T14:49:49.752 INFO:tasks.workunit.client.0.smithi081.stdout:8/810: rename d3/d3c/ddb/cdd to d3/d3c/ddb/df3/d108/c10b 0 2024-04-23T14:49:49.752 INFO:tasks.workunit.client.0.smithi081.stdout:8/811: write d3/d1a/f51 [3547896,112843] 0 2024-04-23T14:49:49.752 INFO:tasks.workunit.client.0.smithi081.stdout:8/812: write d3/d11/d3e/f5d [4209198,17474] 0 2024-04-23T14:49:49.754 INFO:tasks.workunit.client.0.smithi081.stdout:1/679: write d3/d3d/d7a/fd9 [3202933,85344] 0 2024-04-23T14:49:49.756 INFO:tasks.workunit.client.0.smithi081.stdout:1/680: write d3/d3d/d41/d5e/da0/fa2 [426626,28424] 0 2024-04-23T14:49:49.756 INFO:tasks.workunit.client.0.smithi081.stdout:1/681: truncate d3/d3d/d41/d5e/d5d/db0/d70/f84 621503 0 2024-04-23T14:49:49.761 INFO:tasks.workunit.client.1.smithi156.stdout:8/238: rename d5/d39/f49 to d5/d4e/f52 0 2024-04-23T14:49:49.761 INFO:tasks.workunit.client.1.smithi156.stdout:8/239: truncate d5/d9/f48 1575213 0 2024-04-23T14:49:49.761 INFO:tasks.workunit.client.1.smithi156.stdout:8/240: chown d5/d9/d10/d1d/d21/f37 135048 1 2024-04-23T14:49:49.765 INFO:tasks.workunit.client.1.smithi156.stdout:2/232: write d4/d13/f14 [4018287,104233] 0 2024-04-23T14:49:49.770 INFO:tasks.workunit.client.0.smithi081.stdout:2/632: symlink d1/d33/d45/d48/ldd 0 2024-04-23T14:49:49.774 INFO:tasks.workunit.client.0.smithi081.stdout:5/654: rename d17/d3c/d55/d64/f75 to d17/d3c/d55/d64/fe9 0 2024-04-23T14:49:49.774 INFO:tasks.workunit.client.0.smithi081.stdout:5/655: chown d17/d37/d4e 952790 1 2024-04-23T14:49:49.777 INFO:tasks.workunit.client.0.smithi081.stdout:8/813: write d3/d11/d3e/f44 [1416083,117237] 0 2024-04-23T14:49:49.778 INFO:tasks.workunit.client.1.smithi156.stdout:6/282: sync 2024-04-23T14:49:49.778 INFO:tasks.workunit.client.1.smithi156.stdout:9/186: sync 2024-04-23T14:49:49.780 INFO:tasks.workunit.client.1.smithi156.stdout:8/241: dread d5/d9/d10/f12 [0,4194304] 0 2024-04-23T14:49:49.780 INFO:tasks.workunit.client.1.smithi156.stdout:8/242: readlink d5/d9/d10/d1d/d4c/l3d 0 2024-04-23T14:49:49.783 INFO:tasks.workunit.client.0.smithi081.stdout:7/492: dwrite d3/d21/d31/f8 [0,4194304] 0 2024-04-23T14:49:49.786 INFO:tasks.workunit.client.1.smithi156.stdout:4/227: dwrite d0/df/f25 [0,4194304] 0 2024-04-23T14:49:49.787 INFO:tasks.workunit.client.1.smithi156.stdout:1/303: symlink db/d1f/d34/l5b 0 2024-04-23T14:49:49.789 INFO:tasks.workunit.client.0.smithi081.stdout:0/666: creat d6/d11/d14/d41/fd1 x:0 0 0 2024-04-23T14:49:49.789 INFO:tasks.workunit.client.0.smithi081.stdout:0/667: creat d6/d11/d14/d41/d5b/d3f/d44/d78/d83/fd2 x:0 0 0 2024-04-23T14:49:49.789 INFO:tasks.workunit.client.0.smithi081.stdout:0/668: write f5 [353649,89065] 0 2024-04-23T14:49:49.795 INFO:tasks.workunit.client.0.smithi081.stdout:3/532: unlink d4/d7/d2e/f46 0 2024-04-23T14:49:49.796 INFO:tasks.workunit.client.0.smithi081.stdout:3/533: fdatasync d4/dc/d10/d47/f4a 0 2024-04-23T14:49:49.796 INFO:tasks.workunit.client.0.smithi081.stdout:3/534: write d4/d7/d32/f33 [1460768,11444] 0 2024-04-23T14:49:49.796 INFO:tasks.workunit.client.1.smithi156.stdout:3/236: dwrite d4/db/f2f [4194304,4194304] 0 2024-04-23T14:49:49.796 INFO:tasks.workunit.client.1.smithi156.stdout:3/237: write d4/db/dd/d1d/d1e/d13/f34 [4431423,85435] 0 2024-04-23T14:49:49.802 INFO:tasks.workunit.client.1.smithi156.stdout:5/305: dwrite d1/d3/d64/f69 [0,4194304] 0 2024-04-23T14:49:49.803 INFO:tasks.workunit.client.1.smithi156.stdout:5/306: chown d1/d3/d20/d3e/f61 805000 1 2024-04-23T14:49:49.815 INFO:tasks.workunit.client.0.smithi081.stdout:1/682: dwrite d3/d3d/d41/d5e/d12/d1a/f65 [0,4194304] 0 2024-04-23T14:49:49.817 INFO:tasks.workunit.client.1.smithi156.stdout:2/233: readlink d4/lb 0 2024-04-23T14:49:49.817 INFO:tasks.workunit.client.1.smithi156.stdout:6/283: creat d3/d16/d46/d64/f71 x:0 0 0 2024-04-23T14:49:49.817 INFO:tasks.workunit.client.1.smithi156.stdout:2/234: fdatasync d4/f7 0 2024-04-23T14:49:49.817 INFO:tasks.workunit.client.1.smithi156.stdout:0/235: getdents d0/d4/d14 0 2024-04-23T14:49:49.817 INFO:tasks.workunit.client.1.smithi156.stdout:0/236: write d0/f15 [924831,39662] 0 2024-04-23T14:49:49.817 INFO:tasks.workunit.client.1.smithi156.stdout:8/243: mknod d5/c53 0 2024-04-23T14:49:49.817 INFO:tasks.workunit.client.1.smithi156.stdout:2/235: chown d4/c47 6552 1 2024-04-23T14:49:49.818 INFO:tasks.workunit.client.1.smithi156.stdout:4/228: rename d0/d30/d34 to d0/d8/d1e/d4a 0 2024-04-23T14:49:49.818 INFO:tasks.workunit.client.1.smithi156.stdout:0/237: fdatasync d0/d16/d3a/d2a/d1d/d2d/f2f 0 2024-04-23T14:49:49.818 INFO:tasks.workunit.client.1.smithi156.stdout:0/238: chown d0/d16/d3a/d1e/c37 227223 1 2024-04-23T14:49:49.818 INFO:tasks.workunit.client.1.smithi156.stdout:8/244: truncate d5/d9/d10/d1d/d4c/f42 164476 0 2024-04-23T14:49:49.818 INFO:tasks.workunit.client.0.smithi081.stdout:2/633: creat d1/d33/d45/d48/fde x:0 0 0 2024-04-23T14:49:49.821 INFO:tasks.workunit.client.1.smithi156.stdout:3/238: mknod d4/db/dd/d1d/d1e/c43 0 2024-04-23T14:49:49.821 INFO:tasks.workunit.client.1.smithi156.stdout:3/239: dread - d4/db/dd/d1d/d1e/d13/f41 zero size 2024-04-23T14:49:49.821 INFO:tasks.workunit.client.1.smithi156.stdout:3/240: write d4/db/dd/f25 [25721,109291] 0 2024-04-23T14:49:49.821 INFO:tasks.workunit.client.1.smithi156.stdout:3/241: write d4/db/dd/d1d/d1e/d13/f1f [237112,127265] 0 2024-04-23T14:49:49.823 INFO:tasks.workunit.client.0.smithi081.stdout:5/656: symlink d17/d1f/da5/lea 0 2024-04-23T14:49:49.827 INFO:tasks.workunit.client.0.smithi081.stdout:8/814: creat d3/d11/d48/d7e/de4/f10c x:0 0 0 2024-04-23T14:49:49.833 INFO:tasks.workunit.client.1.smithi156.stdout:8/245: dread d5/d9/d10/f34 [0,4194304] 0 2024-04-23T14:49:49.836 INFO:tasks.workunit.client.0.smithi081.stdout:0/669: symlink d6/d11/d14/d41/d5b/d3f/ld3 0 2024-04-23T14:49:49.836 INFO:tasks.workunit.client.1.smithi156.stdout:6/284: mkdir d3/da/d1d/d59/d72 0 2024-04-23T14:49:49.838 INFO:tasks.workunit.client.1.smithi156.stdout:2/236: creat d4/d54/f57 x:0 0 0 2024-04-23T14:49:49.844 INFO:tasks.workunit.client.1.smithi156.stdout:8/246: dread d5/d9/f48 [0,4194304] 0 2024-04-23T14:49:49.850 INFO:tasks.workunit.client.1.smithi156.stdout:7/260: sync 2024-04-23T14:49:49.850 INFO:tasks.workunit.client.1.smithi156.stdout:7/261: write dc/f14 [4606573,46644] 0 2024-04-23T14:49:49.850 INFO:tasks.workunit.client.1.smithi156.stdout:7/262: fdatasync dc/d1d/d24/f27 0 2024-04-23T14:49:49.852 INFO:tasks.workunit.client.1.smithi156.stdout:8/247: dread d5/d9/f48 [0,4194304] 0 2024-04-23T14:49:49.853 INFO:tasks.workunit.client.0.smithi081.stdout:7/493: dwrite d3/d21/d31/d33/d4b/d71/f99 [0,4194304] 0 2024-04-23T14:49:49.861 INFO:tasks.workunit.client.1.smithi156.stdout:8/248: creat d5/d9/d10/d1d/d4c/d29/f54 x:0 0 0 2024-04-23T14:49:49.861 INFO:tasks.workunit.client.1.smithi156.stdout:8/249: creat d5/d45/f55 x:0 0 0 2024-04-23T14:49:49.861 INFO:tasks.workunit.client.0.smithi081.stdout:0/670: dread d6/d11/d14/d41/d5b/d3f/d44/f86 [0,4194304] 0 2024-04-23T14:49:49.862 INFO:tasks.workunit.client.0.smithi081.stdout:0/671: write d6/d25/f45 [4210222,23222] 0 2024-04-23T14:49:49.869 INFO:tasks.workunit.client.0.smithi081.stdout:9/614: rmdir d3/de 39 2024-04-23T14:49:49.870 INFO:tasks.workunit.client.0.smithi081.stdout:2/634: mkdir d1/d11/d21/d52/d8b/d8f/ddf 0 2024-04-23T14:49:49.870 INFO:tasks.workunit.client.0.smithi081.stdout:2/635: readlink d1/laa 0 2024-04-23T14:49:49.875 INFO:tasks.workunit.client.0.smithi081.stdout:7/494: dread d3/d11/d2c/f34 [0,4194304] 0 2024-04-23T14:49:49.875 INFO:tasks.workunit.client.0.smithi081.stdout:2/636: write d1/d33/d45/f4a [631075,106312] 0 2024-04-23T14:49:49.877 INFO:tasks.workunit.client.0.smithi081.stdout:5/657: symlink d17/d65/dd2/leb 0 2024-04-23T14:49:49.879 INFO:tasks.workunit.client.1.smithi156.stdout:8/250: dread d5/f1c [0,4194304] 0 2024-04-23T14:49:49.879 INFO:tasks.workunit.client.1.smithi156.stdout:8/251: chown d5/d9/d10/l3c 46413670 1 2024-04-23T14:49:49.881 INFO:tasks.workunit.client.0.smithi081.stdout:8/815: symlink d3/d11/d48/l10d 0 2024-04-23T14:49:49.881 INFO:tasks.workunit.client.0.smithi081.stdout:8/816: read - d3/d11/d4f/d6c/fb4 zero size 2024-04-23T14:49:49.882 INFO:tasks.workunit.client.1.smithi156.stdout:4/229: read d0/d8/fd [1333912,18786] 0 2024-04-23T14:49:49.885 INFO:tasks.workunit.client.1.smithi156.stdout:5/307: dwrite d1/d3/d24/f58 [0,4194304] 0 2024-04-23T14:49:49.894 INFO:tasks.workunit.client.0.smithi081.stdout:3/535: getdents d4/d7/d49 0 2024-04-23T14:49:49.896 INFO:tasks.workunit.client.1.smithi156.stdout:5/308: creat d1/d3/f6b x:0 0 0 2024-04-23T14:49:49.899 INFO:tasks.workunit.client.0.smithi081.stdout:0/672: symlink d6/d11/d14/d41/da1/daa/ld4 0 2024-04-23T14:49:49.899 INFO:tasks.workunit.client.1.smithi156.stdout:9/187: dwrite d1/d2/d23/f27 [8388608,4194304] 0 2024-04-23T14:49:49.902 INFO:tasks.workunit.client.1.smithi156.stdout:1/304: dwrite db/d15/f22 [4194304,4194304] 0 2024-04-23T14:49:49.903 INFO:tasks.workunit.client.1.smithi156.stdout:1/305: truncate db/d25/f3b 630247 0 2024-04-23T14:49:49.903 INFO:tasks.workunit.client.1.smithi156.stdout:4/230: dread d0/df/d21/d36/f38 [0,4194304] 0 2024-04-23T14:49:49.903 INFO:tasks.workunit.client.0.smithi081.stdout:7/495: link d3/d21/d41/c4d d3/d21/d31/d33/d52/ca6 0 2024-04-23T14:49:49.905 INFO:tasks.workunit.client.1.smithi156.stdout:9/188: creat d1/d2/d23/d2d/d39/f42 x:0 0 0 2024-04-23T14:49:49.908 INFO:tasks.workunit.client.0.smithi081.stdout:5/658: mkdir d17/d3c/dec 0 2024-04-23T14:49:49.908 INFO:tasks.workunit.client.0.smithi081.stdout:5/659: fsync d17/d3c/f88 0 2024-04-23T14:49:49.911 INFO:tasks.workunit.client.0.smithi081.stdout:3/536: creat d4/d7/d49/d51/d84/faa x:0 0 0 2024-04-23T14:49:49.912 INFO:tasks.workunit.client.1.smithi156.stdout:0/239: dwrite d0/d4/fe [0,4194304] 0 2024-04-23T14:49:49.912 INFO:tasks.workunit.client.1.smithi156.stdout:0/240: chown d0/d4 13471458 1 2024-04-23T14:49:49.912 INFO:tasks.workunit.client.1.smithi156.stdout:0/241: read - d0/d16/d3a/d2a/f2c zero size 2024-04-23T14:49:49.912 INFO:tasks.workunit.client.1.smithi156.stdout:9/189: write d1/d2/d4/ff [307871,45643] 0 2024-04-23T14:49:49.912 INFO:tasks.workunit.client.1.smithi156.stdout:0/242: read d0/d16/d3a/d2a/d1d/d2d/f2f [6312,115599] 0 2024-04-23T14:49:49.917 INFO:tasks.workunit.client.1.smithi156.stdout:1/306: symlink db/l5c 0 2024-04-23T14:49:49.925 INFO:tasks.workunit.client.1.smithi156.stdout:3/242: dwrite d4/db/dd/d1d/f3b [0,4194304] 0 2024-04-23T14:49:49.925 INFO:tasks.workunit.client.1.smithi156.stdout:3/243: readlink d4/db/dd/d20/l2d 0 2024-04-23T14:49:49.929 INFO:tasks.workunit.client.1.smithi156.stdout:6/285: dread d3/da/f28 [4194304,4194304] 0 2024-04-23T14:49:49.929 INFO:tasks.workunit.client.1.smithi156.stdout:6/286: chown d3/d16/d46/c48 0 1 2024-04-23T14:49:49.930 INFO:tasks.workunit.client.1.smithi156.stdout:1/307: mkdir db/d25/d4e/d5d 0 2024-04-23T14:49:49.930 INFO:tasks.workunit.client.1.smithi156.stdout:6/287: creat d3/d16/d46/f73 x:0 0 0 2024-04-23T14:49:49.936 INFO:tasks.workunit.client.0.smithi081.stdout:9/615: dwrite d3/de/d1d/d54/f9b [0,4194304] 0 2024-04-23T14:49:49.936 INFO:tasks.workunit.client.0.smithi081.stdout:9/616: write d3/de/d14/d5e/f87 [636653,12801] 0 2024-04-23T14:49:49.944 INFO:tasks.workunit.client.0.smithi081.stdout:2/637: rmdir d1 39 2024-04-23T14:49:49.945 INFO:tasks.workunit.client.1.smithi156.stdout:6/288: mkdir d3/da/d74 0 2024-04-23T14:49:49.951 INFO:tasks.workunit.client.0.smithi081.stdout:7/496: rename d3/d21/d31/d33/d52/f59 to d3/d21/d31/d50/fa7 0 2024-04-23T14:49:49.953 INFO:tasks.workunit.client.1.smithi156.stdout:6/289: symlink d3/da/d74/l75 0 2024-04-23T14:49:49.953 INFO:tasks.workunit.client.1.smithi156.stdout:6/290: fsync d3/da/f1a 0 2024-04-23T14:49:49.953 INFO:tasks.workunit.client.1.smithi156.stdout:6/291: chown d3/d16/d46/l2e 0 1 2024-04-23T14:49:49.954 INFO:tasks.workunit.client.0.smithi081.stdout:5/660: symlink d17/d1f/da5/db1/led 0 2024-04-23T14:49:49.956 INFO:tasks.workunit.client.0.smithi081.stdout:3/537: mknod d4/dc/d10/d5a/cab 0 2024-04-23T14:49:49.961 INFO:tasks.workunit.client.1.smithi156.stdout:1/308: dread db/d1f/d28/f44 [0,4194304] 0 2024-04-23T14:49:49.963 INFO:tasks.workunit.client.1.smithi156.stdout:6/292: link d3/d16/d46/d2b/d3b/f69 d3/d16/f76 0 2024-04-23T14:49:49.964 INFO:tasks.workunit.client.1.smithi156.stdout:6/293: write d3/fd [3544205,16027] 0 2024-04-23T14:49:49.964 INFO:tasks.workunit.client.1.smithi156.stdout:6/294: chown d3/d16/f76 4363498 1 2024-04-23T14:49:49.964 INFO:tasks.workunit.client.0.smithi081.stdout:2/638: rmdir d1/d11/d21/d52 39 2024-04-23T14:49:49.964 INFO:tasks.workunit.client.0.smithi081.stdout:2/639: write d1/d11/d21/d52/d8b/d8f/fc3 [488679,20077] 0 2024-04-23T14:49:49.964 INFO:tasks.workunit.client.0.smithi081.stdout:2/640: write d1/d33/f90 [513767,76014] 0 2024-04-23T14:49:49.965 INFO:tasks.workunit.client.0.smithi081.stdout:7/497: creat d3/d20/fa8 x:0 0 0 2024-04-23T14:49:49.966 INFO:tasks.workunit.client.0.smithi081.stdout:0/673: dwrite d6/d37/d67/d7d/f94 [0,4194304] 0 2024-04-23T14:49:49.967 INFO:tasks.workunit.client.1.smithi156.stdout:0/243: dwrite d0/d4/ff [0,4194304] 0 2024-04-23T14:49:49.971 INFO:tasks.workunit.client.1.smithi156.stdout:7/263: dwrite dc/f17 [0,4194304] 0 2024-04-23T14:49:49.971 INFO:tasks.workunit.client.1.smithi156.stdout:6/295: mkdir d3/d16/d46/d64/d77 0 2024-04-23T14:49:49.973 INFO:tasks.workunit.client.0.smithi081.stdout:3/538: mkdir d4/d7/d7f/d85/d9d/dac 0 2024-04-23T14:49:49.973 INFO:tasks.workunit.client.0.smithi081.stdout:3/539: fsync d4/d7/df/f92 0 2024-04-23T14:49:49.974 INFO:tasks.workunit.client.1.smithi156.stdout:9/190: dwrite d1/d2/d4/dc/f22 [0,4194304] 0 2024-04-23T14:49:49.978 INFO:tasks.workunit.client.0.smithi081.stdout:2/641: rmdir d1/d33/d45/d6e/d97 39 2024-04-23T14:49:49.978 INFO:tasks.workunit.client.0.smithi081.stdout:2/642: write d1/d33/d45/d6e/d97/fb2 [661739,102211] 0 2024-04-23T14:49:49.978 INFO:tasks.workunit.client.1.smithi156.stdout:0/244: creat d0/d4/d11/f4b x:0 0 0 2024-04-23T14:49:49.980 INFO:tasks.workunit.client.1.smithi156.stdout:6/296: link d3/d16/l5b d3/da/d1d/d27/d63/l78 0 2024-04-23T14:49:49.980 INFO:tasks.workunit.client.1.smithi156.stdout:6/297: chown d3/c5 410 1 2024-04-23T14:49:49.980 INFO:tasks.workunit.client.1.smithi156.stdout:6/298: dread - d3/f6b zero size 2024-04-23T14:49:49.982 INFO:tasks.workunit.client.0.smithi081.stdout:7/498: truncate d3/d21/d31/f3a 857315 0 2024-04-23T14:49:49.983 INFO:tasks.workunit.client.1.smithi156.stdout:9/191: dread d1/d2/d4/ff [0,4194304] 0 2024-04-23T14:49:49.983 INFO:tasks.workunit.client.1.smithi156.stdout:9/192: fdatasync d1/d2/f13 0 2024-04-23T14:49:49.983 INFO:tasks.workunit.client.1.smithi156.stdout:9/193: chown d1/d2/d4/d17/f2c 2518 1 2024-04-23T14:49:49.984 INFO:tasks.workunit.client.1.smithi156.stdout:9/194: write d1/d2/d23/d2f/f3b [999801,126724] 0 2024-04-23T14:49:49.984 INFO:tasks.workunit.client.1.smithi156.stdout:0/245: creat d0/d16/d3a/d2b/d44/d4a/f4c x:0 0 0 2024-04-23T14:49:49.984 INFO:tasks.workunit.client.1.smithi156.stdout:0/246: read - d0/d16/d3a/d1e/f40 zero size 2024-04-23T14:49:49.986 INFO:tasks.workunit.client.1.smithi156.stdout:6/299: rename d3/d16/l5b to d3/l79 0 2024-04-23T14:49:49.986 INFO:tasks.workunit.client.1.smithi156.stdout:6/300: stat d3/d16/f2f 0 2024-04-23T14:49:49.988 INFO:tasks.workunit.client.0.smithi081.stdout:9/617: dwrite d3/de/d22/fac [0,4194304] 0 2024-04-23T14:49:49.988 INFO:tasks.workunit.client.0.smithi081.stdout:0/674: creat d6/d37/d67/dc8/fd5 x:0 0 0 2024-04-23T14:49:49.988 INFO:tasks.workunit.client.0.smithi081.stdout:0/675: dread - d6/d11/d14/d41/d5b/d59/fbc zero size 2024-04-23T14:49:49.988 INFO:tasks.workunit.client.0.smithi081.stdout:0/676: fsync d6/d37/d67/d7d/f94 0 2024-04-23T14:49:49.989 INFO:tasks.workunit.client.1.smithi156.stdout:8/252: dwrite d5/d9/f4d [0,4194304] 0 2024-04-23T14:49:49.991 INFO:tasks.workunit.client.0.smithi081.stdout:5/661: getdents d17/d18 0 2024-04-23T14:49:49.991 INFO:tasks.workunit.client.1.smithi156.stdout:9/195: mknod d1/d2/c43 0 2024-04-23T14:49:49.992 INFO:tasks.workunit.client.1.smithi156.stdout:0/247: mknod d0/d16/d43/c4d 0 2024-04-23T14:49:49.997 INFO:tasks.workunit.client.1.smithi156.stdout:6/301: rename d3/d16/d46/c48 to d3/d16/c7a 0 2024-04-23T14:49:49.998 INFO:tasks.workunit.client.0.smithi081.stdout:2/643: creat d1/d11/dab/fe0 x:0 0 0 2024-04-23T14:49:50.006 INFO:tasks.workunit.client.0.smithi081.stdout:7/499: truncate d3/d21/d31/d33/d4b/d71/f84 186307 0 2024-04-23T14:49:50.006 INFO:tasks.workunit.client.0.smithi081.stdout:7/500: write d3/d21/d31/d33/d4b/f92 [853717,15792] 0 2024-04-23T14:49:50.006 INFO:tasks.workunit.client.0.smithi081.stdout:7/501: dread - d3/d21/d31/d50/d5a/f78 zero size 2024-04-23T14:49:50.006 INFO:tasks.workunit.client.0.smithi081.stdout:0/677: chown d6/d25/c6a 16806354 1 2024-04-23T14:49:50.008 INFO:tasks.workunit.client.0.smithi081.stdout:5/662: creat d17/d18/d3a/d8e/de6/fee x:0 0 0 2024-04-23T14:49:50.009 INFO:tasks.workunit.client.1.smithi156.stdout:8/253: dread d5/d9/d10/f11 [0,4194304] 0 2024-04-23T14:49:50.009 INFO:tasks.workunit.client.1.smithi156.stdout:8/254: creat d5/d9/d10/d1d/d4c/f56 x:0 0 0 2024-04-23T14:49:50.010 INFO:tasks.workunit.client.0.smithi081.stdout:2/644: mkdir d1/d11/d21/d52/d8b/d8f/de1 0 2024-04-23T14:49:50.010 INFO:tasks.workunit.client.0.smithi081.stdout:2/645: getdents d1/d11/d21/d52/d8b 0 2024-04-23T14:49:50.011 INFO:tasks.workunit.client.1.smithi156.stdout:9/196: dread d1/d2/d4/f3d [0,4194304] 0 2024-04-23T14:49:50.012 INFO:tasks.workunit.client.0.smithi081.stdout:0/678: getdents d6/d11/db0 0 2024-04-23T14:49:50.016 INFO:tasks.workunit.client.0.smithi081.stdout:5/663: truncate d17/d37/f6e 719735 0 2024-04-23T14:49:50.016 INFO:tasks.workunit.client.0.smithi081.stdout:5/664: chown d17/d1f/d36 105398205 1 2024-04-23T14:49:50.016 INFO:tasks.workunit.client.0.smithi081.stdout:7/502: rmdir d3/d20 39 2024-04-23T14:49:50.018 INFO:tasks.workunit.client.1.smithi156.stdout:8/255: truncate d5/d9/d10/f33 3753754 0 2024-04-23T14:49:50.020 INFO:tasks.workunit.client.0.smithi081.stdout:0/679: mkdir d6/d37/d85/dd6 0 2024-04-23T14:49:50.020 INFO:tasks.workunit.client.1.smithi156.stdout:9/197: mknod d1/d2/d23/d2d/c44 0 2024-04-23T14:49:50.024 INFO:tasks.workunit.client.0.smithi081.stdout:3/540: dwrite d4/d7/d32/fa9 [0,4194304] 0 2024-04-23T14:49:50.026 INFO:tasks.workunit.client.1.smithi156.stdout:9/198: truncate d1/d2/f18 1710540 0 2024-04-23T14:49:50.027 INFO:tasks.workunit.client.0.smithi081.stdout:5/665: mknod d17/d37/d4e/cef 0 2024-04-23T14:49:50.027 INFO:tasks.workunit.client.0.smithi081.stdout:7/503: getdents d3/d21/d31/d33/d4b/d6e 0 2024-04-23T14:49:50.027 INFO:tasks.workunit.client.0.smithi081.stdout:5/666: fsync d17/d1f/d36/d9a/f9f 0 2024-04-23T14:49:50.027 INFO:tasks.workunit.client.0.smithi081.stdout:5/667: readlink d17/d1f/d36/d59/da8/ld1 0 2024-04-23T14:49:50.028 INFO:tasks.workunit.client.0.smithi081.stdout:5/668: creat d17/d18/d3a/ff0 x:0 0 0 2024-04-23T14:49:50.030 INFO:tasks.workunit.client.0.smithi081.stdout:0/680: link d6/d25/c42 d6/d69/cd7 0 2024-04-23T14:49:50.030 INFO:tasks.workunit.client.0.smithi081.stdout:0/681: dread - d6/d11/d14/d41/d5b/d59/fd0 zero size 2024-04-23T14:49:50.030 INFO:tasks.workunit.client.0.smithi081.stdout:0/682: readlink d6/l66 0 2024-04-23T14:49:50.030 INFO:tasks.workunit.client.0.smithi081.stdout:0/683: chown d6/d25/l65 7159 1 2024-04-23T14:49:50.030 INFO:tasks.workunit.client.0.smithi081.stdout:0/684: readlink d6/d11/d14/d41/d5b/d3f/d44/l7f 0 2024-04-23T14:49:50.030 INFO:tasks.workunit.client.0.smithi081.stdout:0/685: readlink d6/d11/d14/l3b 0 2024-04-23T14:49:50.030 INFO:tasks.workunit.client.1.smithi156.stdout:9/199: mknod d1/d2/d4/d40/c45 0 2024-04-23T14:49:50.037 INFO:tasks.workunit.client.1.smithi156.stdout:9/200: unlink d1/d2/l7 0 2024-04-23T14:49:50.040 INFO:tasks.workunit.client.1.smithi156.stdout:9/201: truncate d1/fe 1016781 0 2024-04-23T14:49:50.041 INFO:tasks.workunit.client.1.smithi156.stdout:1/309: dwrite db/d25/f3b [0,4194304] 0 2024-04-23T14:49:50.041 INFO:tasks.workunit.client.1.smithi156.stdout:1/310: write db/d25/f26 [748336,4233] 0 2024-04-23T14:49:50.042 INFO:tasks.workunit.client.1.smithi156.stdout:9/202: mknod d1/d2/d23/d2d/d39/c46 0 2024-04-23T14:49:50.044 INFO:tasks.workunit.client.0.smithi081.stdout:3/541: unlink d4/dc/f3b 0 2024-04-23T14:49:50.047 INFO:tasks.workunit.client.1.smithi156.stdout:1/311: mknod db/d25/d4e/c5e 0 2024-04-23T14:49:50.052 INFO:tasks.workunit.client.1.smithi156.stdout:4/231: sync 2024-04-23T14:49:50.052 INFO:tasks.workunit.client.1.smithi156.stdout:2/237: sync 2024-04-23T14:49:50.052 INFO:tasks.workunit.client.1.smithi156.stdout:5/309: sync 2024-04-23T14:49:50.052 INFO:tasks.workunit.client.1.smithi156.stdout:4/232: chown d0/df/c3b 4 1 2024-04-23T14:49:50.052 INFO:tasks.workunit.client.1.smithi156.stdout:4/233: write d0/d8/d2c/f2e [3159696,100524] 0 2024-04-23T14:49:50.052 INFO:tasks.workunit.client.1.smithi156.stdout:4/234: write d0/d8/d1e/f47 [2381718,102819] 0 2024-04-23T14:49:50.053 INFO:tasks.workunit.client.0.smithi081.stdout:0/686: dread d6/f2d [0,4194304] 0 2024-04-23T14:49:50.053 INFO:tasks.workunit.client.0.smithi081.stdout:0/687: dread - d6/d11/d14/d41/d5b/d59/fc9 zero size 2024-04-23T14:49:50.053 INFO:tasks.workunit.client.1.smithi156.stdout:8/256: write d5/d9/f4d [4206788,105890] 0 2024-04-23T14:49:50.054 INFO:tasks.workunit.client.1.smithi156.stdout:6/302: truncate d3/fd 2362586 0 2024-04-23T14:49:50.055 INFO:tasks.workunit.client.0.smithi081.stdout:7/504: symlink d3/d11/d56/d7f/d98/la9 0 2024-04-23T14:49:50.055 INFO:tasks.workunit.client.0.smithi081.stdout:7/505: truncate d3/d21/d41/f6b 5078217 0 2024-04-23T14:49:50.055 INFO:tasks.workunit.client.1.smithi156.stdout:7/264: dwrite dc/d1d/d24/f27 [0,4194304] 0 2024-04-23T14:49:50.055 INFO:tasks.workunit.client.1.smithi156.stdout:7/265: write dc/f1c [1162695,77875] 0 2024-04-23T14:49:50.056 INFO:tasks.workunit.client.1.smithi156.stdout:9/203: creat d1/d2/d4/d19/d2a/f47 x:0 0 0 2024-04-23T14:49:50.057 INFO:tasks.workunit.client.1.smithi156.stdout:1/312: creat db/d1f/d2f/d47/f5f x:0 0 0 2024-04-23T14:49:50.060 INFO:tasks.workunit.client.1.smithi156.stdout:2/238: mkdir d4/d13/d19/d58 0 2024-04-23T14:49:50.061 INFO:tasks.workunit.client.0.smithi081.stdout:3/542: symlink d4/d7/d32/lad 0 2024-04-23T14:49:50.063 INFO:tasks.workunit.client.1.smithi156.stdout:4/235: mknod d0/d8/d2c/c4b 0 2024-04-23T14:49:50.064 INFO:tasks.workunit.client.0.smithi081.stdout:0/688: creat d6/d11/d14/d41/d5b/d3f/d44/fd8 x:0 0 0 2024-04-23T14:49:50.064 INFO:tasks.workunit.client.0.smithi081.stdout:0/689: truncate d6/d37/d4d/d71/f72 1733493 0 2024-04-23T14:49:50.064 INFO:tasks.workunit.client.0.smithi081.stdout:0/690: write d6/d37/f7e [1484666,68600] 0 2024-04-23T14:49:50.067 INFO:tasks.workunit.client.1.smithi156.stdout:6/303: dread d3/da/d1d/d27/f31 [0,4194304] 0 2024-04-23T14:49:50.076 INFO:tasks.workunit.client.1.smithi156.stdout:0/248: dwrite d0/d16/d3a/d2a/d1d/f17 [0,4194304] 0 2024-04-23T14:49:50.076 INFO:tasks.workunit.client.1.smithi156.stdout:0/249: truncate d0/d4/ff 4728424 0 2024-04-23T14:49:50.076 INFO:tasks.workunit.client.1.smithi156.stdout:0/250: read - d0/d16/d3a/d1e/f40 zero size 2024-04-23T14:49:50.076 INFO:tasks.workunit.client.1.smithi156.stdout:0/251: write d0/f1a [2077320,13090] 0 2024-04-23T14:49:50.078 INFO:tasks.workunit.client.0.smithi081.stdout:7/506: rename d3/d21/d41/f80 to d3/d11/faa 0 2024-04-23T14:49:50.078 INFO:tasks.workunit.client.0.smithi081.stdout:3/543: creat d4/d7/d2e/fae x:0 0 0 2024-04-23T14:49:50.078 INFO:tasks.workunit.client.0.smithi081.stdout:3/544: readlink d4/d7/d49/d51/l6b 0 2024-04-23T14:49:50.078 INFO:tasks.workunit.client.0.smithi081.stdout:2/646: dwrite d1/d33/da3/fd1 [0,4194304] 0 2024-04-23T14:49:50.078 INFO:tasks.workunit.client.0.smithi081.stdout:2/647: dread - d1/d33/d95/fc6 zero size 2024-04-23T14:49:50.078 INFO:tasks.workunit.client.0.smithi081.stdout:9/618: dwrite d3/de/d76/f7d [0,4194304] 0 2024-04-23T14:49:50.078 INFO:tasks.workunit.client.0.smithi081.stdout:9/619: dread - d3/de/d1d/d73/fb4 zero size 2024-04-23T14:49:50.079 INFO:tasks.workunit.client.1.smithi156.stdout:2/239: mknod d4/d13/c59 0 2024-04-23T14:49:50.082 INFO:tasks.workunit.client.0.smithi081.stdout:0/691: unlink d6/d11/d14/d41/d5b/d3f/d44/c80 0 2024-04-23T14:49:50.082 INFO:tasks.workunit.client.0.smithi081.stdout:0/692: stat d6/d25/fba 0 2024-04-23T14:49:50.082 INFO:tasks.workunit.client.1.smithi156.stdout:4/236: link d0/d8/d1e/c28 d0/c4c 0 2024-04-23T14:49:50.084 INFO:tasks.workunit.client.1.smithi156.stdout:8/257: rmdir d5/d9/d10/d1d/d4c/d29 39 2024-04-23T14:49:50.088 INFO:tasks.workunit.client.0.smithi081.stdout:3/545: rename d4/d7/d7f/d91/d6c/l82 to d4/dc/laf 0 2024-04-23T14:49:50.088 INFO:tasks.workunit.client.1.smithi156.stdout:5/310: dread d1/d3/d20/f33 [0,4194304] 0 2024-04-23T14:49:50.088 INFO:tasks.workunit.client.1.smithi156.stdout:5/311: chown d1/d3/d20/d3e/f61 0 1 2024-04-23T14:49:50.089 INFO:tasks.workunit.client.1.smithi156.stdout:5/312: truncate d1/d11/f4d 832399 0 2024-04-23T14:49:50.089 INFO:tasks.workunit.client.1.smithi156.stdout:5/313: dread - d1/d11/d18/d52/f67 zero size 2024-04-23T14:49:50.091 INFO:tasks.workunit.client.0.smithi081.stdout:2/648: creat d1/d33/d45/fe2 x:0 0 0 2024-04-23T14:49:50.091 INFO:tasks.workunit.client.0.smithi081.stdout:2/649: stat d1/d11/f25 0 2024-04-23T14:49:50.092 INFO:tasks.workunit.client.1.smithi156.stdout:8/258: dread d5/d9/d10/d1d/d4c/f42 [0,4194304] 0 2024-04-23T14:49:50.097 INFO:tasks.workunit.client.0.smithi081.stdout:5/669: write f4 [2588042,117333] 0 2024-04-23T14:49:50.098 INFO:tasks.workunit.client.0.smithi081.stdout:5/670: write d17/f2c [1820123,129068] 0 2024-04-23T14:49:50.098 INFO:tasks.workunit.client.0.smithi081.stdout:3/546: write d4/d7/df/d30/f80 [177291,104325] 0 2024-04-23T14:49:50.100 INFO:tasks.workunit.client.0.smithi081.stdout:4/562: sync 2024-04-23T14:49:50.100 INFO:tasks.workunit.client.0.smithi081.stdout:6/608: sync 2024-04-23T14:49:50.100 INFO:tasks.workunit.client.0.smithi081.stdout:6/609: chown d1/d51/d65/d1c/d66/c8b 7427 1 2024-04-23T14:49:50.100 INFO:tasks.workunit.client.0.smithi081.stdout:6/610: read - d1/d2/d8e/f9e zero size 2024-04-23T14:49:50.100 INFO:tasks.workunit.client.0.smithi081.stdout:1/683: sync 2024-04-23T14:49:50.109 INFO:tasks.workunit.client.1.smithi156.stdout:0/252: link d0/f1a d0/d4/f4e 0 2024-04-23T14:49:50.116 INFO:tasks.workunit.client.1.smithi156.stdout:4/237: creat d0/df/d3a/f4d x:0 0 0 2024-04-23T14:49:50.121 INFO:tasks.workunit.client.0.smithi081.stdout:7/507: symlink d3/d21/d31/lab 0 2024-04-23T14:49:50.123 INFO:tasks.workunit.client.0.smithi081.stdout:2/650: creat d1/d11/dab/fe3 x:0 0 0 2024-04-23T14:49:50.125 INFO:tasks.workunit.client.1.smithi156.stdout:8/259: mkdir d5/d9/d10/d1d/d4c/d29/d57 0 2024-04-23T14:49:50.126 INFO:tasks.workunit.client.0.smithi081.stdout:5/671: symlink d17/d18/d3a/d8e/lf1 0 2024-04-23T14:49:50.128 INFO:tasks.workunit.client.0.smithi081.stdout:5/672: write d17/d4a/fb9 [488370,75050] 0 2024-04-23T14:49:50.128 INFO:tasks.workunit.client.1.smithi156.stdout:7/266: rename dc/d1d/d20 to dc/d46 0 2024-04-23T14:49:50.130 INFO:tasks.workunit.client.0.smithi081.stdout:3/547: mkdir d4/d7/d32/db0 0 2024-04-23T14:49:50.132 INFO:tasks.workunit.client.1.smithi156.stdout:4/238: symlink d0/df/d21/d36/l4e 0 2024-04-23T14:49:50.133 INFO:tasks.workunit.client.1.smithi156.stdout:4/239: write d0/d8/f2f [2866792,125595] 0 2024-04-23T14:49:50.140 INFO:tasks.workunit.client.0.smithi081.stdout:6/611: link d1/d51/d7b/d91/f97 d1/d51/d54/fd9 0 2024-04-23T14:49:50.140 INFO:tasks.workunit.client.0.smithi081.stdout:6/612: write d1/d51/d65/d8/f42 [384597,58251] 0 2024-04-23T14:49:50.143 INFO:tasks.workunit.client.0.smithi081.stdout:4/563: mkdir d1/d4/d6f/d70/daf/d89/db7/dbd 0 2024-04-23T14:49:50.145 INFO:tasks.workunit.client.1.smithi156.stdout:1/313: dwrite db/d1f/d2d/d48/f57 [0,4194304] 0 2024-04-23T14:49:50.145 INFO:tasks.workunit.client.0.smithi081.stdout:5/673: read f14 [1266579,12050] 0 2024-04-23T14:49:50.145 INFO:tasks.workunit.client.0.smithi081.stdout:5/674: stat d17/d1f/d36/fc6 0 2024-04-23T14:49:50.145 INFO:tasks.workunit.client.0.smithi081.stdout:5/675: fsync d17/d18/f33 0 2024-04-23T14:49:50.146 INFO:tasks.workunit.client.0.smithi081.stdout:5/676: creat d17/d1f/d36/d59/da8/ff2 x:0 0 0 2024-04-23T14:49:50.147 INFO:tasks.workunit.client.1.smithi156.stdout:6/304: dwrite d3/da/d1d/d27/f31 [0,4194304] 0 2024-04-23T14:49:50.147 INFO:tasks.workunit.client.1.smithi156.stdout:6/305: chown d3/c5 1 1 2024-04-23T14:49:50.147 INFO:tasks.workunit.client.1.smithi156.stdout:6/306: chown d3/da/d1d/l54 3533 1 2024-04-23T14:49:50.147 INFO:tasks.workunit.client.1.smithi156.stdout:6/307: getdents d3/d16/d46/d64/d77 0 2024-04-23T14:49:50.147 INFO:tasks.workunit.client.1.smithi156.stdout:6/308: fdatasync d3/d16/d46/d2b/d3b/f4d 0 2024-04-23T14:49:50.147 INFO:tasks.workunit.client.1.smithi156.stdout:6/309: truncate d3/d16/f30 104872 0 2024-04-23T14:49:50.148 INFO:tasks.workunit.client.1.smithi156.stdout:5/314: rmdir d1/d3 39 2024-04-23T14:49:50.148 INFO:tasks.workunit.client.0.smithi081.stdout:9/620: symlink d3/d1a/d6c/lc6 0 2024-04-23T14:49:50.149 INFO:tasks.workunit.client.0.smithi081.stdout:7/508: write d3/d21/d31/d63/f6c [2484536,5395] 0 2024-04-23T14:49:50.151 INFO:tasks.workunit.client.0.smithi081.stdout:0/693: dwrite d6/d11/d14/d41/d5b/d3f/d44/d76/fc2 [0,4194304] 0 2024-04-23T14:49:50.151 INFO:tasks.workunit.client.0.smithi081.stdout:1/684: dwrite d3/d3d/d41/d5e/d12/d1a/f86 [0,4194304] 0 2024-04-23T14:49:50.151 INFO:tasks.workunit.client.0.smithi081.stdout:0/694: fsync d6/d11/d14/f73 0 2024-04-23T14:49:50.152 INFO:tasks.workunit.client.0.smithi081.stdout:6/613: unlink d1/d51/d54/fd9 0 2024-04-23T14:49:50.152 INFO:tasks.workunit.client.1.smithi156.stdout:2/240: dwrite d4/f7 [4194304,4194304] 0 2024-04-23T14:49:50.153 INFO:tasks.workunit.client.0.smithi081.stdout:4/564: unlink d1/d4/f74 0 2024-04-23T14:49:50.154 INFO:tasks.workunit.client.0.smithi081.stdout:4/565: write d1/d1d/d39/d8d/f90 [477767,105563] 0 2024-04-23T14:49:50.154 INFO:tasks.workunit.client.0.smithi081.stdout:4/566: write d1/d8b/f92 [671941,88073] 0 2024-04-23T14:49:50.155 INFO:tasks.workunit.client.0.smithi081.stdout:4/567: dread - d1/d4/d11/d9d/fb5 zero size 2024-04-23T14:49:50.155 INFO:tasks.workunit.client.1.smithi156.stdout:2/241: write d4/d13/d19/f1a [172838,18199] 0 2024-04-23T14:49:50.156 INFO:tasks.workunit.client.1.smithi156.stdout:7/267: creat dc/d1d/d41/f47 x:0 0 0 2024-04-23T14:49:50.156 INFO:tasks.workunit.client.1.smithi156.stdout:0/253: dwrite d0/d4/fe [0,4194304] 0 2024-04-23T14:49:50.158 INFO:tasks.workunit.client.0.smithi081.stdout:2/651: dread d1/d33/f5e [0,4194304] 0 2024-04-23T14:49:50.159 INFO:tasks.workunit.client.0.smithi081.stdout:9/621: read d3/de/d1d/d54/d68/f7e [214014,84714] 0 2024-04-23T14:49:50.160 INFO:tasks.workunit.client.1.smithi156.stdout:9/204: rename d1/d2/d4/d19/d2a/d3c to d1/d2/d4/d17/d1f/d48 0 2024-04-23T14:49:50.161 INFO:tasks.workunit.client.0.smithi081.stdout:8/817: sync 2024-04-23T14:49:50.162 INFO:tasks.workunit.client.0.smithi081.stdout:5/677: mkdir d17/df3 0 2024-04-23T14:49:50.162 INFO:tasks.workunit.client.0.smithi081.stdout:5/678: chown d17/d1f/d42/d9b/fd9 204503 1 2024-04-23T14:49:50.169 INFO:tasks.workunit.client.0.smithi081.stdout:7/509: creat d3/d11/d56/fac x:0 0 0 2024-04-23T14:49:50.169 INFO:tasks.workunit.client.1.smithi156.stdout:3/244: sync 2024-04-23T14:49:50.171 INFO:tasks.workunit.client.1.smithi156.stdout:1/314: mknod db/d25/d30/d38/d40/c60 0 2024-04-23T14:49:50.171 INFO:tasks.workunit.client.1.smithi156.stdout:1/315: readlink l6 0 2024-04-23T14:49:50.173 INFO:tasks.workunit.client.1.smithi156.stdout:6/310: mkdir d3/d16/d46/d2b/d3b/d7b 0 2024-04-23T14:49:50.174 INFO:tasks.workunit.client.0.smithi081.stdout:2/652: write d1/d11/d21/d52/f75 [1610483,68518] 0 2024-04-23T14:49:50.177 INFO:tasks.workunit.client.1.smithi156.stdout:5/315: getdents d1/d3/d20 0 2024-04-23T14:49:50.181 INFO:tasks.workunit.client.1.smithi156.stdout:8/260: rmdir d5/d9/d10/d1d 39 2024-04-23T14:49:50.182 INFO:tasks.workunit.client.1.smithi156.stdout:8/261: dread - d5/d9/d10/d1d/f51 zero size 2024-04-23T14:49:50.182 INFO:tasks.workunit.client.1.smithi156.stdout:8/262: chown d5/d9/d10/f46 535342344 1 2024-04-23T14:49:50.188 INFO:tasks.workunit.client.0.smithi081.stdout:1/685: creat d3/d3d/d41/d92/da6/fdd x:0 0 0 2024-04-23T14:49:50.188 INFO:tasks.workunit.client.0.smithi081.stdout:1/686: dread - d3/d3d/d41/d5e/d17/d58/fcb zero size 2024-04-23T14:49:50.191 INFO:tasks.workunit.client.1.smithi156.stdout:7/268: mkdir dc/d1d/d48 0 2024-04-23T14:49:50.191 INFO:tasks.workunit.client.1.smithi156.stdout:7/269: fdatasync dc/f19 0 2024-04-23T14:49:50.192 INFO:tasks.workunit.client.0.smithi081.stdout:2/653: dread d1/d33/d45/d6e/d96/f69 [0,4194304] 0 2024-04-23T14:49:50.193 INFO:tasks.workunit.client.0.smithi081.stdout:6/614: rmdir d1/d51 39 2024-04-23T14:49:50.195 INFO:tasks.workunit.client.1.smithi156.stdout:0/254: rename d0/d4/l10 to d0/d16/d43/l4f 0 2024-04-23T14:49:50.195 INFO:tasks.workunit.client.1.smithi156.stdout:0/255: write d0/d4/d11/f4b [284130,38778] 0 2024-04-23T14:49:50.196 INFO:tasks.workunit.client.1.smithi156.stdout:0/256: write d0/d16/d3a/d2b/f3e [770768,118635] 0 2024-04-23T14:49:50.198 INFO:tasks.workunit.client.1.smithi156.stdout:9/205: mkdir d1/d2/d23/d49 0 2024-04-23T14:49:50.198 INFO:tasks.workunit.client.1.smithi156.stdout:9/206: truncate d1/f1e 1039210 0 2024-04-23T14:49:50.199 INFO:tasks.workunit.client.0.smithi081.stdout:4/568: rmdir d1/d4/d6f/d70/daf/d89 39 2024-04-23T14:49:50.203 INFO:tasks.workunit.client.1.smithi156.stdout:4/240: rmdir d0/d8/d1e 39 2024-04-23T14:49:50.203 INFO:tasks.workunit.client.1.smithi156.stdout:4/241: readlink d0/d8/d1e/l39 0 2024-04-23T14:49:50.206 INFO:tasks.workunit.client.1.smithi156.stdout:3/245: symlink d4/db/dd/d20/l44 0 2024-04-23T14:49:50.206 INFO:tasks.workunit.client.1.smithi156.stdout:8/263: rmdir d5/d9/d10/d1d 39 2024-04-23T14:49:50.207 INFO:tasks.workunit.client.0.smithi081.stdout:9/622: truncate d3/de/d14/d5e/f96 998185 0 2024-04-23T14:49:50.207 INFO:tasks.workunit.client.0.smithi081.stdout:8/818: symlink d3/d3c/l10e 0 2024-04-23T14:49:50.211 INFO:tasks.workunit.client.1.smithi156.stdout:2/242: symlink d4/l5a 0 2024-04-23T14:49:50.211 INFO:tasks.workunit.client.1.smithi156.stdout:2/243: write d4/d21/d42/f53 [72580,66009] 0 2024-04-23T14:49:50.212 INFO:tasks.workunit.client.1.smithi156.stdout:7/270: rename dc/f19 to dc/d1d/d24/f49 0 2024-04-23T14:49:50.212 INFO:tasks.workunit.client.1.smithi156.stdout:0/257: mknod d0/d16/d3a/d2a/d1d/c50 0 2024-04-23T14:49:50.215 INFO:tasks.workunit.client.1.smithi156.stdout:9/207: creat d1/d2/d23/d2d/f4a x:0 0 0 2024-04-23T14:49:50.215 INFO:tasks.workunit.client.1.smithi156.stdout:9/208: fdatasync d1/d2/d4/dc/f41 0 2024-04-23T14:49:50.218 INFO:tasks.workunit.client.0.smithi081.stdout:6/615: write d1/d51/d7b/d91/fb9 [1423675,17826] 0 2024-04-23T14:49:50.231 INFO:tasks.workunit.client.1.smithi156.stdout:5/316: dwrite d1/d11/f13 [0,4194304] 0 2024-04-23T14:49:50.236 INFO:tasks.workunit.client.1.smithi156.stdout:4/242: dread d0/df/d21/f33 [0,4194304] 0 2024-04-23T14:49:50.239 INFO:tasks.workunit.client.0.smithi081.stdout:5/679: dwrite d17/d3d/f49 [0,4194304] 0 2024-04-23T14:49:50.255 INFO:tasks.workunit.client.0.smithi081.stdout:5/680: read d17/d1f/d42/f50 [5923225,106909] 0 2024-04-23T14:49:50.255 INFO:tasks.workunit.client.0.smithi081.stdout:5/681: creat d17/d18/d3a/d8e/de6/ff4 x:0 0 0 2024-04-23T14:49:50.255 INFO:tasks.workunit.client.0.smithi081.stdout:8/819: dwrite f2 [0,4194304] 0 2024-04-23T14:49:50.255 INFO:tasks.workunit.client.0.smithi081.stdout:8/820: stat d3/d11/d48/d7e 0 2024-04-23T14:49:50.256 INFO:tasks.workunit.client.1.smithi156.stdout:6/311: dwrite d3/da/d1d/f61 [0,4194304] 0 2024-04-23T14:49:50.256 INFO:tasks.workunit.client.1.smithi156.stdout:6/312: fsync d3/da/d1d/f65 0 2024-04-23T14:49:50.274 INFO:tasks.workunit.client.0.smithi081.stdout:0/695: rmdir d6/d25 39 2024-04-23T14:49:50.275 INFO:tasks.workunit.client.1.smithi156.stdout:8/264: dwrite d5/d9/d10/d1d/d4c/f56 [0,4194304] 0 2024-04-23T14:49:50.275 INFO:tasks.workunit.client.1.smithi156.stdout:6/313: dread d3/da/f1a [4194304,4194304] 0 2024-04-23T14:49:50.276 INFO:tasks.workunit.client.1.smithi156.stdout:1/316: rmdir db/d25/d30/d38 39 2024-04-23T14:49:50.277 INFO:tasks.workunit.client.0.smithi081.stdout:2/654: getdents d1/d11 0 2024-04-23T14:49:50.278 INFO:tasks.workunit.client.1.smithi156.stdout:3/246: dwrite d4/db/dd/d1d/d1e/d13/f1f [0,4194304] 0 2024-04-23T14:49:50.279 INFO:tasks.workunit.client.1.smithi156.stdout:2/244: creat d4/d13/d19/d58/f5b x:0 0 0 2024-04-23T14:49:50.282 INFO:tasks.workunit.client.1.smithi156.stdout:7/271: unlink dc/d1d/d24/f3c 0 2024-04-23T14:49:50.286 INFO:tasks.workunit.client.1.smithi156.stdout:5/317: dwrite d1/d3/d24/f3d [0,4194304] 0 2024-04-23T14:49:50.287 INFO:tasks.workunit.client.0.smithi081.stdout:9/623: link d3/l86 d3/d1a/lc7 0 2024-04-23T14:49:50.287 INFO:tasks.workunit.client.0.smithi081.stdout:9/624: stat d3/d5/f6 0 2024-04-23T14:49:50.289 INFO:tasks.workunit.client.1.smithi156.stdout:9/209: unlink d1/d2/d4/d19/d2a/l33 0 2024-04-23T14:49:50.292 INFO:tasks.workunit.client.1.smithi156.stdout:0/258: link d0/d4/f25 d0/d4/d11/d3f/f51 0 2024-04-23T14:49:50.295 INFO:tasks.workunit.client.0.smithi081.stdout:6/616: rename d1/d2/d49/d52/ca2 to d1/d51/d65/d8/d2e/d59/d80/db8/cda 0 2024-04-23T14:49:50.305 INFO:tasks.workunit.client.1.smithi156.stdout:9/210: dread d1/d2/f18 [0,4194304] 0 2024-04-23T14:49:50.306 INFO:tasks.workunit.client.1.smithi156.stdout:9/211: write d1/d2/d4/dc/f41 [707289,16185] 0 2024-04-23T14:49:50.349 INFO:tasks.workunit.client.1.smithi156.stdout:5/318: dwrite d1/d3/f25 [0,4194304] 0 2024-04-23T14:49:50.415 INFO:tasks.workunit.client.0.smithi081.stdout:5/682: creat d17/d3c/d55/d64/dcc/ff5 x:0 0 0 2024-04-23T14:49:50.418 INFO:tasks.workunit.client.0.smithi081.stdout:5/683: read d17/d3c/f88 [238960,93045] 0 2024-04-23T14:49:50.419 INFO:tasks.workunit.client.0.smithi081.stdout:8/821: creat d3/d11/d3e/d63/f10f x:0 0 0 2024-04-23T14:49:50.438 INFO:tasks.workunit.client.0.smithi081.stdout:5/684: dread d17/f26 [0,4194304] 0 2024-04-23T14:49:50.444 INFO:tasks.workunit.client.0.smithi081.stdout:4/569: creat d1/d4/d11/fbe x:0 0 0 2024-04-23T14:49:50.444 INFO:tasks.workunit.client.0.smithi081.stdout:4/570: write d1/fbb [263241,20184] 0 2024-04-23T14:49:50.454 INFO:tasks.workunit.client.1.smithi156.stdout:6/314: symlink d3/d16/d46/d2b/d3b/l7c 0 2024-04-23T14:49:50.456 INFO:tasks.workunit.client.0.smithi081.stdout:2/655: symlink d1/d33/d45/d6e/d97/le4 0 2024-04-23T14:49:50.457 INFO:tasks.workunit.client.1.smithi156.stdout:1/317: mknod db/d1f/c61 0 2024-04-23T14:49:50.464 INFO:tasks.workunit.client.0.smithi081.stdout:6/617: unlink d1/d51/d65/d1c/d6e/da0/da1/fb5 0 2024-04-23T14:49:50.466 INFO:tasks.workunit.client.1.smithi156.stdout:3/247: mknod d4/db/dd/d1d/d1e/d2b/c45 0 2024-04-23T14:49:50.466 INFO:tasks.workunit.client.1.smithi156.stdout:3/248: chown d4/l3d 29365507 1 2024-04-23T14:49:50.467 INFO:tasks.workunit.client.1.smithi156.stdout:3/249: creat d4/db/dd/d1d/d1e/d13/f46 x:0 0 0 2024-04-23T14:49:50.467 INFO:tasks.workunit.client.1.smithi156.stdout:3/250: readlink d4/l35 0 2024-04-23T14:49:50.468 INFO:tasks.workunit.client.0.smithi081.stdout:0/696: rename d6/d11/d14/d41/d5b/d3f/d44/d78/cb1 to d6/d11/d14/d41/d5b/d3f/d44/d78/d83/cd9 0 2024-04-23T14:49:50.468 INFO:tasks.workunit.client.0.smithi081.stdout:0/697: stat d6/d11/d14/f91 0 2024-04-23T14:49:50.472 INFO:tasks.workunit.client.1.smithi156.stdout:7/272: creat dc/d1d/d24/f4a x:0 0 0 2024-04-23T14:49:50.474 INFO:tasks.workunit.client.0.smithi081.stdout:2/656: link d1/d33/d45/d6e/d96/f63 d1/d33/da3/fe5 0 2024-04-23T14:49:50.475 INFO:tasks.workunit.client.0.smithi081.stdout:2/657: fsync d1/d11/d21/d34/f9a 0 2024-04-23T14:49:50.475 INFO:tasks.workunit.client.0.smithi081.stdout:2/658: chown d1/c9 247078 1 2024-04-23T14:49:50.475 INFO:tasks.workunit.client.0.smithi081.stdout:2/659: getdents d1/d11/d21/d52/d8b/d8f/ddf 0 2024-04-23T14:49:50.477 INFO:tasks.workunit.client.0.smithi081.stdout:6/618: mkdir d1/d51/d65/d1c/d6e/da0/da1/dc1/dc9/ddb 0 2024-04-23T14:49:50.480 INFO:tasks.workunit.client.1.smithi156.stdout:0/259: creat d0/d16/d3a/d2b/d44/f52 x:0 0 0 2024-04-23T14:49:50.480 INFO:tasks.workunit.client.1.smithi156.stdout:0/260: chown d0/d16/d3a/d2a/d1d/c50 1213155 1 2024-04-23T14:49:50.481 INFO:tasks.workunit.client.0.smithi081.stdout:0/698: truncate d6/d37/d85/f8b 127360 0 2024-04-23T14:49:50.483 INFO:tasks.workunit.client.1.smithi156.stdout:4/243: getdents d0/df/d3a 0 2024-04-23T14:49:50.483 INFO:tasks.workunit.client.1.smithi156.stdout:1/318: write db/d15/f22 [1024091,110346] 0 2024-04-23T14:49:50.483 INFO:tasks.workunit.client.1.smithi156.stdout:4/244: chown d0/d8/d1e 32492044 1 2024-04-23T14:49:50.483 INFO:tasks.workunit.client.1.smithi156.stdout:4/245: creat d0/df/d21/d36/f4f x:0 0 0 2024-04-23T14:49:50.485 INFO:tasks.workunit.client.0.smithi081.stdout:4/571: rename d1/d4/d6f/d70/daf/f36 to d1/d4/d6f/d70/daf/d89/fbf 0 2024-04-23T14:49:50.488 INFO:tasks.workunit.client.0.smithi081.stdout:6/619: dread d1/d51/d65/d8/d2e/d58/f61 [4194304,4194304] 0 2024-04-23T14:49:50.490 INFO:tasks.workunit.client.0.smithi081.stdout:2/660: truncate d1/f32 1071964 0 2024-04-23T14:49:50.491 INFO:tasks.workunit.client.1.smithi156.stdout:6/315: creat d3/d16/d1e/f7d x:0 0 0 2024-04-23T14:49:50.492 INFO:tasks.workunit.client.0.smithi081.stdout:0/699: getdents d6/d37/d4d/d71 0 2024-04-23T14:49:50.496 INFO:tasks.workunit.client.1.smithi156.stdout:3/251: creat d4/db/dd/d1d/d1e/d42/f47 x:0 0 0 2024-04-23T14:49:50.499 INFO:tasks.workunit.client.1.smithi156.stdout:7/273: link dc/l22 dc/d1d/d41/l4b 0 2024-04-23T14:49:50.502 INFO:tasks.workunit.client.0.smithi081.stdout:2/661: creat d1/d33/d9f/fe6 x:0 0 0 2024-04-23T14:49:50.502 INFO:tasks.workunit.client.0.smithi081.stdout:2/662: truncate d1/d33/d45/d48/fde 102737 0 2024-04-23T14:49:50.505 INFO:tasks.workunit.client.0.smithi081.stdout:6/620: write d1/d51/f5d [3478797,20321] 0 2024-04-23T14:49:50.506 INFO:tasks.workunit.client.0.smithi081.stdout:0/700: mknod d6/d11/d14/db8/cda 0 2024-04-23T14:49:50.506 INFO:tasks.workunit.client.0.smithi081.stdout:0/701: chown d6/d69/f6f 3314785 1 2024-04-23T14:49:50.508 INFO:tasks.workunit.client.0.smithi081.stdout:0/702: truncate d6/d11/d14/d41/d5b/f3e 1358449 0 2024-04-23T14:49:50.511 INFO:tasks.workunit.client.1.smithi156.stdout:4/246: creat d0/d8/d1e/d4a/f50 x:0 0 0 2024-04-23T14:49:50.516 INFO:tasks.workunit.client.1.smithi156.stdout:3/252: rmdir d4/db/dd/d1d/d1e/d2b 39 2024-04-23T14:49:50.518 INFO:tasks.workunit.client.0.smithi081.stdout:6/621: creat d1/d51/d65/d8/db1/fdc x:0 0 0 2024-04-23T14:49:50.519 INFO:tasks.workunit.client.1.smithi156.stdout:7/274: truncate dc/d1d/d41/f43 2259780 0 2024-04-23T14:49:50.520 INFO:tasks.workunit.client.0.smithi081.stdout:6/622: symlink d1/d51/d65/d8/d2e/d59/d80/ldd 0 2024-04-23T14:49:50.521 INFO:tasks.workunit.client.1.smithi156.stdout:7/275: symlink dc/d46/l4c 0 2024-04-23T14:49:50.524 INFO:tasks.workunit.client.0.smithi081.stdout:6/623: rename d1/d51/d65/d1c/c63 to d1/d51/d65/d13/d16/dd0/cde 0 2024-04-23T14:49:50.528 INFO:tasks.workunit.client.0.smithi081.stdout:6/624: mknod d1/d2/d8e/cdf 0 2024-04-23T14:49:50.529 INFO:tasks.workunit.client.1.smithi156.stdout:7/276: rmdir dc/d2a 39 2024-04-23T14:49:50.529 INFO:tasks.workunit.client.1.smithi156.stdout:7/277: dread - dc/d1d/d24/f4a zero size 2024-04-23T14:49:50.531 INFO:tasks.workunit.client.1.smithi156.stdout:4/247: write d0/df/f25 [3319028,117033] 0 2024-04-23T14:49:50.532 INFO:tasks.workunit.client.0.smithi081.stdout:6/625: getdents d1/d2 0 2024-04-23T14:49:50.532 INFO:tasks.workunit.client.0.smithi081.stdout:6/626: creat d1/d51/d65/d8/d2e/d59/d80/fe0 x:0 0 0 2024-04-23T14:49:50.533 INFO:tasks.workunit.client.1.smithi156.stdout:7/278: symlink dc/d2c/l4d 0 2024-04-23T14:49:50.534 INFO:tasks.workunit.client.1.smithi156.stdout:4/248: link d0/df/d3a/f4d d0/df/f51 0 2024-04-23T14:49:50.548 INFO:tasks.workunit.client.1.smithi156.stdout:7/279: dread dc/d1d/f23 [0,4194304] 0 2024-04-23T14:49:50.548 INFO:tasks.workunit.client.1.smithi156.stdout:7/280: dread - dc/d1d/d41/f47 zero size 2024-04-23T14:49:50.550 INFO:tasks.workunit.client.1.smithi156.stdout:7/281: symlink dc/d2c/l4e 0 2024-04-23T14:49:50.554 INFO:tasks.workunit.client.0.smithi081.stdout:4/572: dwrite d1/d1d/d59/f65 [0,4194304] 0 2024-04-23T14:49:50.554 INFO:tasks.workunit.client.0.smithi081.stdout:4/573: chown d1/d4/d11/f28 207 1 2024-04-23T14:49:50.556 INFO:tasks.workunit.client.1.smithi156.stdout:6/316: dread d3/da/d1d/f21 [4194304,4194304] 0 2024-04-23T14:49:50.556 INFO:tasks.workunit.client.1.smithi156.stdout:6/317: readlink d3/d16/d46/d2b/l44 0 2024-04-23T14:49:50.557 INFO:tasks.workunit.client.0.smithi081.stdout:4/574: symlink d1/d4/lc0 0 2024-04-23T14:49:50.579 INFO:tasks.workunit.client.1.smithi156.stdout:8/265: symlink d5/d9/d10/d1d/l58 0 2024-04-23T14:49:50.588 INFO:tasks.workunit.client.1.smithi156.stdout:2/245: rename d4/d54 to d4/d13/d19/d4c/d5c 0 2024-04-23T14:49:50.590 INFO:tasks.workunit.client.0.smithi081.stdout:6/627: dwrite d1/d51/d65/f62 [0,4194304] 0 2024-04-23T14:49:50.591 INFO:tasks.workunit.client.1.smithi156.stdout:5/319: rename d1/d11/d18/d52/f67 to d1/d3/d20/d3e/f6c 0 2024-04-23T14:49:50.591 INFO:tasks.workunit.client.1.smithi156.stdout:5/320: fsync d1/d11/d18/d19/f5c 0 2024-04-23T14:49:50.591 INFO:tasks.workunit.client.0.smithi081.stdout:0/703: dwrite d6/d37/d67/d7d/f90 [0,4194304] 0 2024-04-23T14:49:50.595 INFO:tasks.workunit.client.1.smithi156.stdout:3/253: rename d4/db/dd/d20/l3c to d4/l48 0 2024-04-23T14:49:50.595 INFO:tasks.workunit.client.1.smithi156.stdout:3/254: creat d4/db/dd/d1d/f49 x:0 0 0 2024-04-23T14:49:50.596 INFO:tasks.workunit.client.0.smithi081.stdout:2/663: dwrite d1/d11/dab/fb7 [0,4194304] 0 2024-04-23T14:49:50.598 INFO:tasks.workunit.client.0.smithi081.stdout:6/628: symlink d1/d51/d65/d1c/d6e/da0/le1 0 2024-04-23T14:49:50.598 INFO:tasks.workunit.client.0.smithi081.stdout:6/629: chown d1/d51/d65/d1c/d6e/f79 402649423 1 2024-04-23T14:49:50.598 INFO:tasks.workunit.client.0.smithi081.stdout:6/630: fdatasync d1/d51/d65/d8/d2e/d59/f68 0 2024-04-23T14:49:50.598 INFO:tasks.workunit.client.1.smithi156.stdout:5/321: rmdir d1/d3/d43 39 2024-04-23T14:49:50.600 INFO:tasks.workunit.client.1.smithi156.stdout:4/249: rename d0/d30/c3e to d0/c52 0 2024-04-23T14:49:50.602 INFO:tasks.workunit.client.0.smithi081.stdout:0/704: creat d6/d11/d14/d41/d5b/d3f/d44/d76/fdb x:0 0 0 2024-04-23T14:49:50.602 INFO:tasks.workunit.client.0.smithi081.stdout:0/705: readlink d6/la 0 2024-04-23T14:49:50.602 INFO:tasks.workunit.client.0.smithi081.stdout:0/706: truncate d6/d37/d67/d7d/f94 4770189 0 2024-04-23T14:49:50.602 INFO:tasks.workunit.client.0.smithi081.stdout:0/707: chown d6/d69/fa0 492669767 1 2024-04-23T14:49:50.604 INFO:tasks.workunit.client.1.smithi156.stdout:0/261: dwrite d0/d4/f4e [0,4194304] 0 2024-04-23T14:49:50.608 INFO:tasks.workunit.client.0.smithi081.stdout:4/575: rename d1/d1d/f51 to d1/d8f/fc1 0 2024-04-23T14:49:50.612 INFO:tasks.workunit.client.0.smithi081.stdout:4/576: write d1/d4/d11/f79 [114941,9138] 0 2024-04-23T14:49:50.612 INFO:tasks.workunit.client.1.smithi156.stdout:7/282: rename dc/d2a/c2d to dc/d2c/c4f 0 2024-04-23T14:49:50.612 INFO:tasks.workunit.client.1.smithi156.stdout:7/283: fsync f6 0 2024-04-23T14:49:50.612 INFO:tasks.workunit.client.1.smithi156.stdout:7/284: creat dc/d2c/f50 x:0 0 0 2024-04-23T14:49:50.613 INFO:tasks.workunit.client.1.smithi156.stdout:7/285: write dc/d2c/f50 [291824,103818] 0 2024-04-23T14:49:50.613 INFO:tasks.workunit.client.1.smithi156.stdout:7/286: creat dc/d1d/d41/f51 x:0 0 0 2024-04-23T14:49:50.613 INFO:tasks.workunit.client.0.smithi081.stdout:2/664: mknod d1/d33/d9f/ce7 0 2024-04-23T14:49:50.615 INFO:tasks.workunit.client.0.smithi081.stdout:0/708: getdents d6/d11/d14/d41/d5b/d3f 0 2024-04-23T14:49:50.618 INFO:tasks.workunit.client.0.smithi081.stdout:6/631: write d1/d51/d65/d13/f3e [3754743,24813] 0 2024-04-23T14:49:50.619 INFO:tasks.workunit.client.0.smithi081.stdout:2/665: mkdir d1/d11/d21/d52/d8b/d8f/de8 0 2024-04-23T14:49:50.626 INFO:tasks.workunit.client.0.smithi081.stdout:0/709: symlink d6/d25/ldc 0 2024-04-23T14:49:50.626 INFO:tasks.workunit.client.0.smithi081.stdout:0/710: write d6/d11/d14/d24/fcf [1720135,52140] 0 2024-04-23T14:49:50.626 INFO:tasks.workunit.client.1.smithi156.stdout:6/318: dwrite d3/d16/f5a [0,4194304] 0 2024-04-23T14:49:50.629 INFO:tasks.workunit.client.1.smithi156.stdout:5/322: dread d1/d11/f13 [0,4194304] 0 2024-04-23T14:49:50.629 INFO:tasks.workunit.client.1.smithi156.stdout:8/266: dwrite d5/d9/f32 [0,4194304] 0 2024-04-23T14:49:50.629 INFO:tasks.workunit.client.1.smithi156.stdout:8/267: write d5/d9/d10/f34 [693596,44861] 0 2024-04-23T14:49:50.632 INFO:tasks.workunit.client.1.smithi156.stdout:9/212: rmdir d1/d2/d23 39 2024-04-23T14:49:50.639 INFO:tasks.workunit.client.1.smithi156.stdout:6/319: creat d3/da/d1d/d59/f7e x:0 0 0 2024-04-23T14:49:50.641 INFO:tasks.workunit.client.1.smithi156.stdout:7/287: dread dc/d1d/d41/f3d [0,4194304] 0 2024-04-23T14:49:50.641 INFO:tasks.workunit.client.1.smithi156.stdout:7/288: write dc/d1d/f42 [879001,78707] 0 2024-04-23T14:49:50.642 INFO:tasks.workunit.client.1.smithi156.stdout:7/289: truncate dc/d46/f44 447253 0 2024-04-23T14:49:50.644 INFO:tasks.workunit.client.0.smithi081.stdout:6/632: dread d1/d51/d65/d13/d16/f75 [0,4194304] 0 2024-04-23T14:49:50.651 INFO:tasks.workunit.client.0.smithi081.stdout:6/633: rename d1/d51/d65/f43 to d1/d51/d65/d8/db1/fe2 0 2024-04-23T14:49:50.654 INFO:tasks.workunit.client.0.smithi081.stdout:6/634: creat d1/d51/d65/d1c/d6e/fe3 x:0 0 0 2024-04-23T14:49:50.654 INFO:tasks.workunit.client.0.smithi081.stdout:6/635: chown d1/d51/cd4 26186016 1 2024-04-23T14:49:50.657 INFO:tasks.workunit.client.0.smithi081.stdout:6/636: symlink d1/d51/d65/d1c/d6e/le4 0 2024-04-23T14:49:50.657 INFO:tasks.workunit.client.0.smithi081.stdout:6/637: dread - d1/d51/d65/d78/fc8 zero size 2024-04-23T14:49:50.659 INFO:tasks.workunit.client.1.smithi156.stdout:5/323: dread d1/d3/f5 [0,4194304] 0 2024-04-23T14:49:50.660 INFO:tasks.workunit.client.1.smithi156.stdout:5/324: fsync d1/d3/d24/f57 0 2024-04-23T14:49:50.660 INFO:tasks.workunit.client.1.smithi156.stdout:3/255: dwrite d4/f10 [4194304,4194304] 0 2024-04-23T14:49:50.660 INFO:tasks.workunit.client.1.smithi156.stdout:9/213: write d1/d2/d4/d17/f2c [3614987,68886] 0 2024-04-23T14:49:50.660 INFO:tasks.workunit.client.1.smithi156.stdout:9/214: truncate d1/fe 1503954 0 2024-04-23T14:49:50.662 INFO:tasks.workunit.client.0.smithi081.stdout:6/638: symlink d1/d51/d65/d1c/d6e/da0/dd2/le5 0 2024-04-23T14:49:50.662 INFO:tasks.workunit.client.0.smithi081.stdout:6/639: write d1/d2/d8e/f9e [897236,99106] 0 2024-04-23T14:49:50.662 INFO:tasks.workunit.client.0.smithi081.stdout:6/640: dread - d1/d51/d65/d1c/d66/fd1 zero size 2024-04-23T14:49:50.665 INFO:tasks.workunit.client.1.smithi156.stdout:5/325: mknod d1/d3/c6d 0 2024-04-23T14:49:50.667 INFO:tasks.workunit.client.1.smithi156.stdout:3/256: symlink d4/db/dd/d1d/d1e/d2b/l4a 0 2024-04-23T14:49:50.669 INFO:tasks.workunit.client.1.smithi156.stdout:9/215: unlink d1/d2/d4/f3d 0 2024-04-23T14:49:50.669 INFO:tasks.workunit.client.1.smithi156.stdout:4/250: dread d0/d8/f2f [0,4194304] 0 2024-04-23T14:49:50.671 INFO:tasks.workunit.client.1.smithi156.stdout:4/251: mkdir d0/df/d21/d36/d53 0 2024-04-23T14:49:50.674 INFO:tasks.workunit.client.0.smithi081.stdout:6/641: write d1/d51/d65/d1c/d6e/da0/fc3 [1878054,91051] 0 2024-04-23T14:49:50.674 INFO:tasks.workunit.client.0.smithi081.stdout:6/642: read d1/d2/f8f [2024445,100079] 0 2024-04-23T14:49:50.676 INFO:tasks.workunit.client.0.smithi081.stdout:6/643: unlink d1/d51/d65/d8/f2b 0 2024-04-23T14:49:50.677 INFO:tasks.workunit.client.1.smithi156.stdout:8/268: creat d5/d9/f59 x:0 0 0 2024-04-23T14:49:50.678 INFO:tasks.workunit.client.1.smithi156.stdout:8/269: read - d5/d4e/f52 zero size 2024-04-23T14:49:50.678 INFO:tasks.workunit.client.1.smithi156.stdout:1/319: symlink db/l62 0 2024-04-23T14:49:50.678 INFO:tasks.workunit.client.1.smithi156.stdout:0/262: dwrite d0/d16/d3a/d2a/d1d/d2d/f41 [0,4194304] 0 2024-04-23T14:49:50.678 INFO:tasks.workunit.client.0.smithi081.stdout:2/666: mkdir d1/d33/d45/de9 0 2024-04-23T14:49:50.678 INFO:tasks.workunit.client.1.smithi156.stdout:1/320: write db/ff [1677055,111053] 0 2024-04-23T14:49:50.681 INFO:tasks.workunit.client.0.smithi081.stdout:2/667: unlink d1/d33/d45/fe2 0 2024-04-23T14:49:50.681 INFO:tasks.workunit.client.0.smithi081.stdout:2/668: truncate d1/fbc 176471 0 2024-04-23T14:49:50.684 INFO:tasks.workunit.client.1.smithi156.stdout:1/321: mkdir db/d1f/d34/d63 0 2024-04-23T14:49:50.684 INFO:tasks.workunit.client.1.smithi156.stdout:1/322: creat db/d25/f64 x:0 0 0 2024-04-23T14:49:50.684 INFO:tasks.workunit.client.1.smithi156.stdout:1/323: chown db/d1f/d28/c4c 248242350 1 2024-04-23T14:49:50.693 INFO:tasks.workunit.client.1.smithi156.stdout:2/246: getdents d4/d13/d19/d4c 0 2024-04-23T14:49:50.699 INFO:tasks.workunit.client.0.smithi081.stdout:7/510: sync 2024-04-23T14:49:50.699 INFO:tasks.workunit.client.0.smithi081.stdout:3/548: sync 2024-04-23T14:49:50.699 INFO:tasks.workunit.client.0.smithi081.stdout:6/644: dread d1/d51/d65/d13/f3c [0,4194304] 0 2024-04-23T14:49:50.705 INFO:tasks.workunit.client.0.smithi081.stdout:6/645: rmdir d1/d51/d65/d1c/d6e/da0/da1/dc1/dc9 39 2024-04-23T14:49:50.706 INFO:tasks.workunit.client.0.smithi081.stdout:4/577: dwrite d1/f12 [0,4194304] 0 2024-04-23T14:49:50.709 INFO:tasks.workunit.client.1.smithi156.stdout:0/263: write d0/f15 [472853,114801] 0 2024-04-23T14:49:50.711 INFO:tasks.workunit.client.1.smithi156.stdout:1/324: dread db/f4f [0,4194304] 0 2024-04-23T14:49:50.712 INFO:tasks.workunit.client.0.smithi081.stdout:6/646: symlink d1/d51/d65/d78/le6 0 2024-04-23T14:49:50.713 INFO:tasks.workunit.client.0.smithi081.stdout:0/711: dwrite d6/d11/d14/f73 [0,4194304] 0 2024-04-23T14:49:50.715 INFO:tasks.workunit.client.1.smithi156.stdout:7/290: dread dc/f14 [0,4194304] 0 2024-04-23T14:49:50.715 INFO:tasks.workunit.client.1.smithi156.stdout:7/291: dread - dc/d2c/f33 zero size 2024-04-23T14:49:50.720 INFO:tasks.workunit.client.0.smithi081.stdout:2/669: dread d1/d11/f12 [0,4194304] 0 2024-04-23T14:49:50.733 INFO:tasks.workunit.client.1.smithi156.stdout:6/320: dwrite d3/f4e [0,4194304] 0 2024-04-23T14:49:50.733 INFO:tasks.workunit.client.1.smithi156.stdout:6/321: readlink d3/lc 0 2024-04-23T14:49:50.736 INFO:tasks.workunit.client.1.smithi156.stdout:7/292: truncate dc/d1d/d41/f3d 1238243 0 2024-04-23T14:49:50.736 INFO:tasks.workunit.client.1.smithi156.stdout:7/293: creat dc/d1d/f52 x:0 0 0 2024-04-23T14:49:50.736 INFO:tasks.workunit.client.1.smithi156.stdout:7/294: dread - dc/d1d/d41/f47 zero size 2024-04-23T14:49:50.736 INFO:tasks.workunit.client.1.smithi156.stdout:0/264: rmdir d0/d16/d3a/d2a/d1d/d2d 39 2024-04-23T14:49:50.737 INFO:tasks.workunit.client.1.smithi156.stdout:9/216: dwrite d1/d2/f18 [0,4194304] 0 2024-04-23T14:49:50.737 INFO:tasks.workunit.client.1.smithi156.stdout:9/217: fsync d1/d2/d4/d17/d1f/f37 0 2024-04-23T14:49:50.740 INFO:tasks.workunit.client.0.smithi081.stdout:3/549: write d4/d7/d32/fa9 [198964,120447] 0 2024-04-23T14:49:50.743 INFO:tasks.workunit.client.1.smithi156.stdout:0/265: write d0/d16/d3a/d2a/d1d/d2d/f41 [4842162,47514] 0 2024-04-23T14:49:50.750 INFO:tasks.workunit.client.1.smithi156.stdout:6/322: rename d3/d16/d46/f1b to d3/da/f7f 0 2024-04-23T14:49:50.754 INFO:tasks.workunit.client.0.smithi081.stdout:7/511: dwrite d3/d21/f4a [0,4194304] 0 2024-04-23T14:49:50.755 INFO:tasks.workunit.client.0.smithi081.stdout:6/647: rmdir d1/d51/d7b 39 2024-04-23T14:49:50.755 INFO:tasks.workunit.client.0.smithi081.stdout:2/670: symlink d1/d11/d21/d52/d8b/d8f/de1/lea 0 2024-04-23T14:49:50.757 INFO:tasks.workunit.client.1.smithi156.stdout:7/295: getdents dc/d2a 0 2024-04-23T14:49:50.757 INFO:tasks.workunit.client.1.smithi156.stdout:0/266: mknod d0/d4/c53 0 2024-04-23T14:49:50.757 INFO:tasks.workunit.client.1.smithi156.stdout:7/296: dread - dc/d1d/d41/f47 zero size 2024-04-23T14:49:50.758 INFO:tasks.workunit.client.0.smithi081.stdout:0/712: symlink d6/d11/d14/d41/d5b/d59/d68/ldd 0 2024-04-23T14:49:50.758 INFO:tasks.workunit.client.0.smithi081.stdout:0/713: write d6/d11/d14/d41/d5b/d59/fb9 [4189743,52158] 0 2024-04-23T14:49:50.758 INFO:tasks.workunit.client.0.smithi081.stdout:0/714: creat d6/d37/d85/fde x:0 0 0 2024-04-23T14:49:50.758 INFO:tasks.workunit.client.0.smithi081.stdout:3/550: symlink d4/d7/d7f/d91/lb1 0 2024-04-23T14:49:50.759 INFO:tasks.workunit.client.0.smithi081.stdout:7/512: truncate d3/d21/d41/f6b 4462739 0 2024-04-23T14:49:50.760 INFO:tasks.workunit.client.0.smithi081.stdout:6/648: mkdir d1/d51/d65/d13/d16/de7 0 2024-04-23T14:49:50.764 INFO:tasks.workunit.client.0.smithi081.stdout:2/671: mknod d1/d11/d21/d52/d8b/ceb 0 2024-04-23T14:49:50.764 INFO:tasks.workunit.client.1.smithi156.stdout:6/323: mkdir d3/da/d1d/d27/d80 0 2024-04-23T14:49:50.765 INFO:tasks.workunit.client.1.smithi156.stdout:5/326: dread d1/d11/f29 [0,4194304] 0 2024-04-23T14:49:50.765 INFO:tasks.workunit.client.1.smithi156.stdout:7/297: mkdir dc/d1d/d41/d53 0 2024-04-23T14:49:50.767 INFO:tasks.workunit.client.0.smithi081.stdout:0/715: link d6/d11/d14/d41/d5b/d59/d8e/c9e d6/d11/d14/db8/cdf 0 2024-04-23T14:49:50.767 INFO:tasks.workunit.client.0.smithi081.stdout:0/716: readlink d6/d11/l2a 0 2024-04-23T14:49:50.767 INFO:tasks.workunit.client.0.smithi081.stdout:0/717: readlink d6/d25/ldc 0 2024-04-23T14:49:50.771 INFO:tasks.workunit.client.0.smithi081.stdout:6/649: unlink d1/d51/d65/d8/l4a 0 2024-04-23T14:49:50.772 INFO:tasks.workunit.client.1.smithi156.stdout:9/218: dread d1/d2/f13 [0,4194304] 0 2024-04-23T14:49:50.774 INFO:tasks.workunit.client.1.smithi156.stdout:5/327: rename d1/d17/l37 to d1/d3/d20/l6e 0 2024-04-23T14:49:50.774 INFO:tasks.workunit.client.1.smithi156.stdout:5/328: write d1/d11/f5e [916361,51701] 0 2024-04-23T14:49:50.774 INFO:tasks.workunit.client.1.smithi156.stdout:5/329: write d1/d11/d18/f47 [526455,36243] 0 2024-04-23T14:49:50.775 INFO:tasks.workunit.client.0.smithi081.stdout:2/672: truncate d1/d33/d45/d48/f51 1271534 0 2024-04-23T14:49:50.775 INFO:tasks.workunit.client.0.smithi081.stdout:2/673: chown d1/d33/d95/fc9 15 1 2024-04-23T14:49:50.777 INFO:tasks.workunit.client.1.smithi156.stdout:8/270: dwrite d5/d9/d10/d1d/d21/f22 [0,4194304] 0 2024-04-23T14:49:50.778 INFO:tasks.workunit.client.0.smithi081.stdout:0/718: symlink d6/d11/d14/d41/d5b/le0 0 2024-04-23T14:49:50.780 INFO:tasks.workunit.client.0.smithi081.stdout:6/650: link d1/d51/d65/d8/l37 d1/d2/le8 0 2024-04-23T14:49:50.780 INFO:tasks.workunit.client.0.smithi081.stdout:6/651: fdatasync d1/d51/d65/d78/fce 0 2024-04-23T14:49:50.780 INFO:tasks.workunit.client.0.smithi081.stdout:6/652: dread - d1/d51/d7b/f87 zero size 2024-04-23T14:49:50.780 INFO:tasks.workunit.client.0.smithi081.stdout:6/653: creat d1/d51/d65/d8/db1/fe9 x:0 0 0 2024-04-23T14:49:50.781 INFO:tasks.workunit.client.1.smithi156.stdout:6/324: dread d3/da/d1d/f35 [0,4194304] 0 2024-04-23T14:49:50.781 INFO:tasks.workunit.client.1.smithi156.stdout:4/252: dwrite d0/f41 [0,4194304] 0 2024-04-23T14:49:50.784 INFO:tasks.workunit.client.0.smithi081.stdout:2/674: creat d1/d11/d21/d52/d8b/d8f/fec x:0 0 0 2024-04-23T14:49:50.785 INFO:tasks.workunit.client.0.smithi081.stdout:4/578: dwrite d1/d4/d11/f28 [0,4194304] 0 2024-04-23T14:49:50.786 INFO:tasks.workunit.client.0.smithi081.stdout:0/719: symlink d6/d37/d4d/d71/le1 0 2024-04-23T14:49:50.786 INFO:tasks.workunit.client.1.smithi156.stdout:7/298: dread dc/d1d/d41/f43 [0,4194304] 0 2024-04-23T14:49:50.790 INFO:tasks.workunit.client.0.smithi081.stdout:6/654: mknod d1/d51/d65/d1c/d6e/da0/da1/dc1/dc9/ddb/cea 0 2024-04-23T14:49:50.790 INFO:tasks.workunit.client.0.smithi081.stdout:6/655: chown d1/d51/d65/d8/d2e/d58/c76 66098300 1 2024-04-23T14:49:50.790 INFO:tasks.workunit.client.1.smithi156.stdout:0/267: dread d0/d4/f3 [0,4194304] 0 2024-04-23T14:49:50.793 INFO:tasks.workunit.client.1.smithi156.stdout:5/330: mknod d1/d11/d18/d52/c6f 0 2024-04-23T14:49:50.795 INFO:tasks.workunit.client.0.smithi081.stdout:4/579: mkdir d1/d4/d6f/d70/daf/d8c/dc2 0 2024-04-23T14:49:50.797 INFO:tasks.workunit.client.0.smithi081.stdout:6/656: link d1/f2a d1/d51/feb 0 2024-04-23T14:49:50.797 INFO:tasks.workunit.client.0.smithi081.stdout:6/657: truncate d1/d51/d65/d8/da4/fbd 1083751 0 2024-04-23T14:49:50.797 INFO:tasks.workunit.client.1.smithi156.stdout:2/247: dwrite d4/d13/d19/f1a [0,4194304] 0 2024-04-23T14:49:50.798 INFO:tasks.workunit.client.0.smithi081.stdout:6/658: creat d1/d51/d65/d8/db1/fec x:0 0 0 2024-04-23T14:49:50.798 INFO:tasks.workunit.client.0.smithi081.stdout:6/659: dread - d1/d51/d65/d1c/d6e/f79 zero size 2024-04-23T14:49:50.798 INFO:tasks.workunit.client.1.smithi156.stdout:8/271: dread d5/d9/d10/f34 [0,4194304] 0 2024-04-23T14:49:50.801 INFO:tasks.workunit.client.1.smithi156.stdout:4/253: write d0/d8/fd [6339427,11535] 0 2024-04-23T14:49:50.802 INFO:tasks.workunit.client.1.smithi156.stdout:4/254: readlink d0/l31 0 2024-04-23T14:49:50.802 INFO:tasks.workunit.client.1.smithi156.stdout:4/255: fsync d0/f41 0 2024-04-23T14:49:50.802 INFO:tasks.workunit.client.1.smithi156.stdout:4/256: chown d0/d8/d1e/d4a 7162 1 2024-04-23T14:49:50.802 INFO:tasks.workunit.client.1.smithi156.stdout:4/257: write d0/df/d21/d36/f43 [256197,5092] 0 2024-04-23T14:49:50.802 INFO:tasks.workunit.client.1.smithi156.stdout:1/325: dwrite db/f4f [0,4194304] 0 2024-04-23T14:49:50.803 INFO:tasks.workunit.client.0.smithi081.stdout:2/675: write d1/d11/d21/d34/fce [6538606,125649] 0 2024-04-23T14:49:50.803 INFO:tasks.workunit.client.0.smithi081.stdout:2/676: write d1/d1e/f66 [821043,95312] 0 2024-04-23T14:49:50.803 INFO:tasks.workunit.client.0.smithi081.stdout:2/677: truncate d1/d11/d21/d52/d8b/d8f/fec 232633 0 2024-04-23T14:49:50.803 INFO:tasks.workunit.client.0.smithi081.stdout:2/678: readlink d1/d11/d21/d34/l55 0 2024-04-23T14:49:50.804 INFO:tasks.workunit.client.1.smithi156.stdout:0/268: dread d0/d4/f3 [4194304,4194304] 0 2024-04-23T14:49:50.804 INFO:tasks.workunit.client.1.smithi156.stdout:0/269: creat d0/d16/d3a/d2b/d44/f54 x:0 0 0 2024-04-23T14:49:50.805 INFO:tasks.workunit.client.0.smithi081.stdout:3/551: rmdir d4/d7/d7f 39 2024-04-23T14:49:50.805 INFO:tasks.workunit.client.1.smithi156.stdout:7/299: creat dc/f54 x:0 0 0 2024-04-23T14:49:50.810 INFO:tasks.workunit.client.1.smithi156.stdout:9/219: write d1/d2/d4/d17/d1f/f36 [3247835,38414] 0 2024-04-23T14:49:50.811 INFO:tasks.workunit.client.1.smithi156.stdout:9/220: chown d1/d2/d3e 347831388 1 2024-04-23T14:49:50.811 INFO:tasks.workunit.client.1.smithi156.stdout:9/221: stat d1/d2/d4/d40/c45 0 2024-04-23T14:49:50.812 INFO:tasks.workunit.client.1.smithi156.stdout:6/325: read d3/f34 [3451267,19047] 0 2024-04-23T14:49:50.812 INFO:tasks.workunit.client.1.smithi156.stdout:6/326: fdatasync d3/d16/f2f 0 2024-04-23T14:49:50.813 INFO:tasks.workunit.client.0.smithi081.stdout:1/687: sync 2024-04-23T14:49:50.813 INFO:tasks.workunit.client.0.smithi081.stdout:3/552: link d4/d7/d7f/c68 d4/d7/d7f/d91/cb2 0 2024-04-23T14:49:50.813 INFO:tasks.workunit.client.0.smithi081.stdout:3/553: write d4/d7/df/f72 [1104444,62699] 0 2024-04-23T14:49:50.814 INFO:tasks.workunit.client.0.smithi081.stdout:9/625: sync 2024-04-23T14:49:50.814 INFO:tasks.workunit.client.0.smithi081.stdout:5/685: sync 2024-04-23T14:49:50.814 INFO:tasks.workunit.client.0.smithi081.stdout:9/626: read d3/d1a/f17 [196721,23691] 0 2024-04-23T14:49:50.814 INFO:tasks.workunit.client.0.smithi081.stdout:5/686: fdatasync d17/d3d/fa1 0 2024-04-23T14:49:50.814 INFO:tasks.workunit.client.0.smithi081.stdout:8/822: sync 2024-04-23T14:49:50.814 INFO:tasks.workunit.client.0.smithi081.stdout:8/823: readlink d3/l6 0 2024-04-23T14:49:50.814 INFO:tasks.workunit.client.0.smithi081.stdout:5/687: write d17/d18/d3a/ff0 [990397,67703] 0 2024-04-23T14:49:50.816 INFO:tasks.workunit.client.0.smithi081.stdout:7/513: write d3/d21/d31/f29 [4845056,92416] 0 2024-04-23T14:49:50.817 INFO:tasks.workunit.client.0.smithi081.stdout:7/514: fdatasync d3/d21/d31/d33/d4b/d71/f7e 0 2024-04-23T14:49:50.817 INFO:tasks.workunit.client.0.smithi081.stdout:7/515: truncate d3/d21/d41/f6b 5343373 0 2024-04-23T14:49:50.819 INFO:tasks.workunit.client.0.smithi081.stdout:8/824: mkdir d3/d11/d48/dc1/d110 0 2024-04-23T14:49:50.821 INFO:tasks.workunit.client.1.smithi156.stdout:4/258: dread d0/d8/fc [0,4194304] 0 2024-04-23T14:49:50.837 INFO:tasks.workunit.client.0.smithi081.stdout:7/516: symlink d3/d11/d2c/d75/d8e/lad 0 2024-04-23T14:49:50.838 INFO:tasks.workunit.client.0.smithi081.stdout:5/688: write d17/f26 [172130,16520] 0 2024-04-23T14:49:50.838 INFO:tasks.workunit.client.0.smithi081.stdout:5/689: creat d17/d3d/d7a/ff6 x:0 0 0 2024-04-23T14:49:50.842 INFO:tasks.workunit.client.1.smithi156.stdout:1/326: write db/f39 [2894531,63138] 0 2024-04-23T14:49:50.846 INFO:tasks.workunit.client.0.smithi081.stdout:8/825: rmdir d3/d11 39 2024-04-23T14:49:50.851 INFO:tasks.workunit.client.1.smithi156.stdout:2/248: write d4/f16 [271773,62623] 0 2024-04-23T14:49:50.861 INFO:tasks.workunit.client.0.smithi081.stdout:1/688: read d3/d3d/d41/d5e/d1d/fd6 [821406,100420] 0 2024-04-23T14:49:50.872 INFO:tasks.workunit.client.1.smithi156.stdout:5/331: mknod d1/c70 0 2024-04-23T14:49:50.872 INFO:tasks.workunit.client.1.smithi156.stdout:5/332: fdatasync d1/d3/d20/f4c 0 2024-04-23T14:49:50.872 INFO:tasks.workunit.client.1.smithi156.stdout:5/333: stat d1/d3 0 2024-04-23T14:49:50.872 INFO:tasks.workunit.client.1.smithi156.stdout:5/334: fdatasync d1/d11/d27/f2c 0 2024-04-23T14:49:50.876 INFO:tasks.workunit.client.1.smithi156.stdout:8/272: rename d5/d9/d10/d1d/d4c/d29 to d5/d9/d5a 0 2024-04-23T14:49:50.877 INFO:tasks.workunit.client.1.smithi156.stdout:8/273: write d5/d9/d10/d1d/d4c/f42 [183227,24185] 0 2024-04-23T14:49:50.880 INFO:tasks.workunit.client.1.smithi156.stdout:0/270: rmdir d0/d4/d11 39 2024-04-23T14:49:50.882 INFO:tasks.workunit.client.0.smithi081.stdout:0/720: dwrite d6/d37/d85/f8b [0,4194304] 0 2024-04-23T14:49:50.893 INFO:tasks.workunit.client.1.smithi156.stdout:6/327: unlink d3/d16/d46/c17 0 2024-04-23T14:49:50.893 INFO:tasks.workunit.client.1.smithi156.stdout:9/222: unlink d1/d2/d4/d40/c45 0 2024-04-23T14:49:50.893 INFO:tasks.workunit.client.1.smithi156.stdout:4/259: mkdir d0/d8/d54 0 2024-04-23T14:49:50.896 INFO:tasks.workunit.client.0.smithi081.stdout:2/679: dwrite d1/d33/d45/d6e/d96/f69 [0,4194304] 0 2024-04-23T14:49:50.899 INFO:tasks.workunit.client.1.smithi156.stdout:7/300: rename dc/d1d/l3e to dc/l55 0 2024-04-23T14:49:50.899 INFO:tasks.workunit.client.1.smithi156.stdout:7/301: readlink dc/d1d/l34 0 2024-04-23T14:49:50.899 INFO:tasks.workunit.client.1.smithi156.stdout:8/274: creat d5/d9/d10/d1d/d4c/f5b x:0 0 0 2024-04-23T14:49:50.900 INFO:tasks.workunit.client.1.smithi156.stdout:6/328: mknod d3/d16/d46/d2b/c81 0 2024-04-23T14:49:50.903 INFO:tasks.workunit.client.1.smithi156.stdout:5/335: getdents d1/d11/d18/d19 0 2024-04-23T14:49:50.903 INFO:tasks.workunit.client.1.smithi156.stdout:5/336: readlink d1/l5a 0 2024-04-23T14:49:50.903 INFO:tasks.workunit.client.1.smithi156.stdout:9/223: mkdir d1/d2/d23/d49/d4b 0 2024-04-23T14:49:50.906 INFO:tasks.workunit.client.1.smithi156.stdout:7/302: mknod dc/d1d/d41/d53/c56 0 2024-04-23T14:49:50.906 INFO:tasks.workunit.client.1.smithi156.stdout:7/303: read - dc/d2a/f3a zero size 2024-04-23T14:49:50.906 INFO:tasks.workunit.client.1.smithi156.stdout:7/304: write dc/d1d/f42 [928354,105107] 0 2024-04-23T14:49:50.906 INFO:tasks.workunit.client.1.smithi156.stdout:7/305: write dc/d1d/d24/f4a [737511,44722] 0 2024-04-23T14:49:50.907 INFO:tasks.workunit.client.1.smithi156.stdout:7/306: creat dc/d1d/d41/f57 x:0 0 0 2024-04-23T14:49:50.908 INFO:tasks.workunit.client.1.smithi156.stdout:0/271: rename d0/d16/d3a/d2a/f6 to d0/d16/d43/f55 0 2024-04-23T14:49:50.908 INFO:tasks.workunit.client.1.smithi156.stdout:0/272: readlink d0/d16/d3a/l3c 0 2024-04-23T14:49:50.908 INFO:tasks.workunit.client.1.smithi156.stdout:0/273: write d0/f1a [4770784,643] 0 2024-04-23T14:49:50.912 INFO:tasks.workunit.client.1.smithi156.stdout:8/275: mkdir d5/d9/d5a/d5c 0 2024-04-23T14:49:50.917 INFO:tasks.workunit.client.1.smithi156.stdout:6/329: mknod d3/da/d1d/d59/c82 0 2024-04-23T14:49:50.918 INFO:tasks.workunit.client.1.smithi156.stdout:6/330: chown d3/d16/f30 1518676 1 2024-04-23T14:49:50.918 INFO:tasks.workunit.client.1.smithi156.stdout:7/307: mkdir dc/d46/d58 0 2024-04-23T14:49:50.918 INFO:tasks.workunit.client.1.smithi156.stdout:7/308: fsync dc/d2a/f3a 0 2024-04-23T14:49:50.924 INFO:tasks.workunit.client.1.smithi156.stdout:0/274: link d0/d16/d3a/d2a/d1d/d2d/f2f d0/d4/d14/f56 0 2024-04-23T14:49:50.924 INFO:tasks.workunit.client.1.smithi156.stdout:7/309: mkdir dc/d2a/d59 0 2024-04-23T14:49:50.926 INFO:tasks.workunit.client.1.smithi156.stdout:4/260: rename d0/d8/d2c to d0/df/d55 0 2024-04-23T14:49:50.928 INFO:tasks.workunit.client.1.smithi156.stdout:4/261: mknod d0/d8/c56 0 2024-04-23T14:49:50.929 INFO:tasks.workunit.client.1.smithi156.stdout:8/276: creat d5/d4e/f5d x:0 0 0 2024-04-23T14:49:50.929 INFO:tasks.workunit.client.1.smithi156.stdout:8/277: readlink d5/d9/d10/d1d/d4c/l3d 0 2024-04-23T14:49:50.932 INFO:tasks.workunit.client.0.smithi081.stdout:2/680: write d1/d11/f12 [708232,16603] 0 2024-04-23T14:49:50.933 INFO:tasks.workunit.client.0.smithi081.stdout:2/681: readlink d1/d11/dab/l8c 0 2024-04-23T14:49:50.933 INFO:tasks.workunit.client.1.smithi156.stdout:1/327: dwrite db/f17 [8388608,4194304] 0 2024-04-23T14:49:50.933 INFO:tasks.workunit.client.1.smithi156.stdout:1/328: fsync db/d1f/d2d/f36 0 2024-04-23T14:49:50.933 INFO:tasks.workunit.client.1.smithi156.stdout:4/262: mknod d0/df/d21/d36/c57 0 2024-04-23T14:49:50.933 INFO:tasks.workunit.client.1.smithi156.stdout:4/263: truncate d0/d8/d1e/f49 788233 0 2024-04-23T14:49:50.934 INFO:tasks.workunit.client.0.smithi081.stdout:5/690: dwrite d17/d1f/f31 [0,4194304] 0 2024-04-23T14:49:50.934 INFO:tasks.workunit.client.1.smithi156.stdout:7/310: dread dc/d46/f31 [0,4194304] 0 2024-04-23T14:49:50.936 INFO:tasks.workunit.client.1.smithi156.stdout:7/311: readlink dc/l22 0 2024-04-23T14:49:50.936 INFO:tasks.workunit.client.1.smithi156.stdout:7/312: chown dc/f14 8616141 1 2024-04-23T14:49:50.936 INFO:tasks.workunit.client.1.smithi156.stdout:7/313: chown dc/d1d/l2f 1715777 1 2024-04-23T14:49:50.936 INFO:tasks.workunit.client.1.smithi156.stdout:5/337: dread d1/d3/f5 [4194304,4194304] 0 2024-04-23T14:49:50.940 INFO:tasks.workunit.client.0.smithi081.stdout:9/627: dwrite d3/de/d14/f3d [4194304,4194304] 0 2024-04-23T14:49:50.941 INFO:tasks.workunit.client.0.smithi081.stdout:6/660: dwrite d1/d51/d65/d78/f9b [0,4194304] 0 2024-04-23T14:49:50.942 INFO:tasks.workunit.client.0.smithi081.stdout:3/554: dwrite d4/d7/df/d30/f4c [4194304,4194304] 0 2024-04-23T14:49:50.943 INFO:tasks.workunit.client.1.smithi156.stdout:4/264: creat d0/df/f58 x:0 0 0 2024-04-23T14:49:50.943 INFO:tasks.workunit.client.0.smithi081.stdout:3/555: write d4/dc/d50/d9a/f9b [1005518,6208] 0 2024-04-23T14:49:50.943 INFO:tasks.workunit.client.0.smithi081.stdout:3/556: readlink d4/d7/d1a/l5f 0 2024-04-23T14:49:50.945 INFO:tasks.workunit.client.0.smithi081.stdout:5/691: mknod d17/d3d/d41/cf7 0 2024-04-23T14:49:50.945 INFO:tasks.workunit.client.0.smithi081.stdout:5/692: fsync d17/d3d/f51 0 2024-04-23T14:49:50.948 INFO:tasks.workunit.client.0.smithi081.stdout:1/689: dwrite d3/d3d/d41/d5e/d17/d58/d7f/f4b [4194304,4194304] 0 2024-04-23T14:49:50.948 INFO:tasks.workunit.client.0.smithi081.stdout:1/690: stat d3/d3d/d41/d5e/da0/dbb/ld0 0 2024-04-23T14:49:50.949 INFO:tasks.workunit.client.1.smithi156.stdout:2/249: dwrite d4/d26/f51 [0,4194304] 0 2024-04-23T14:49:50.949 INFO:tasks.workunit.client.1.smithi156.stdout:6/331: dread d3/f4e [0,4194304] 0 2024-04-23T14:49:50.958 INFO:tasks.workunit.client.0.smithi081.stdout:6/661: truncate d1/d2/f1d 1154741 0 2024-04-23T14:49:50.967 INFO:tasks.workunit.client.0.smithi081.stdout:9/628: dread d3/de/d1d/fc3 [0,4194304] 0 2024-04-23T14:49:50.967 INFO:tasks.workunit.client.0.smithi081.stdout:3/557: symlink d4/dc/d10/d5a/lb3 0 2024-04-23T14:49:50.968 INFO:tasks.workunit.client.1.smithi156.stdout:0/275: write d0/d4/d14/f35 [292600,38753] 0 2024-04-23T14:49:50.969 INFO:tasks.workunit.client.1.smithi156.stdout:0/276: creat d0/d16/d3a/d2b/d44/d4a/f57 x:0 0 0 2024-04-23T14:49:50.971 INFO:tasks.workunit.client.0.smithi081.stdout:5/693: mkdir d17/df8 0 2024-04-23T14:49:50.971 INFO:tasks.workunit.client.0.smithi081.stdout:5/694: dread - d17/d3c/d55/d64/dcc/ff5 zero size 2024-04-23T14:49:50.971 INFO:tasks.workunit.client.0.smithi081.stdout:5/695: write d17/d3d/d41/f73 [511602,85676] 0 2024-04-23T14:49:50.972 INFO:tasks.workunit.client.1.smithi156.stdout:6/332: rmdir d3/da/d1d/d27 39 2024-04-23T14:49:50.972 INFO:tasks.workunit.client.1.smithi156.stdout:6/333: dread - d3/d16/d46/f73 zero size 2024-04-23T14:49:50.972 INFO:tasks.workunit.client.1.smithi156.stdout:6/334: dread - d3/da/d1d/d27/f58 zero size 2024-04-23T14:49:50.986 INFO:tasks.workunit.client.1.smithi156.stdout:6/335: link d3/c6 d3/d16/d5c/d6a/c83 0 2024-04-23T14:49:50.986 INFO:tasks.workunit.client.0.smithi081.stdout:1/691: unlink d3/d3d/d41/d5e/d12/d2e/f50 0 2024-04-23T14:49:50.986 INFO:tasks.workunit.client.0.smithi081.stdout:5/696: dread d17/f2c [0,4194304] 0 2024-04-23T14:49:50.989 INFO:tasks.workunit.client.1.smithi156.stdout:6/336: symlink d3/d16/d46/d64/l84 0 2024-04-23T14:49:50.992 INFO:tasks.workunit.client.0.smithi081.stdout:9/629: getdents d3/de 0 2024-04-23T14:49:50.993 INFO:tasks.workunit.client.0.smithi081.stdout:1/692: creat d3/d3d/d41/d5e/d9d/fde x:0 0 0 2024-04-23T14:49:50.993 INFO:tasks.workunit.client.1.smithi156.stdout:3/257: sync 2024-04-23T14:49:50.993 INFO:tasks.workunit.client.0.smithi081.stdout:6/662: getdents d1/d2/d8e/d98 0 2024-04-23T14:49:50.997 INFO:tasks.workunit.client.0.smithi081.stdout:9/630: mknod d3/de/d1d/d62/cc8 0 2024-04-23T14:49:50.998 INFO:tasks.workunit.client.0.smithi081.stdout:6/663: link d1/d51/d65/d8/d2e/d58/c76 d1/d51/d65/d8/d2e/d59/ced 0 2024-04-23T14:49:50.998 INFO:tasks.workunit.client.0.smithi081.stdout:6/664: symlink d1/d2/d5a/lee 0 2024-04-23T14:49:50.998 INFO:tasks.workunit.client.0.smithi081.stdout:6/665: write d1/d51/d65/d1c/d66/fd1 [207700,10518] 0 2024-04-23T14:49:51.001 INFO:tasks.workunit.client.0.smithi081.stdout:9/631: write d3/de/d76/db5/fbd [110025,56606] 0 2024-04-23T14:49:51.001 INFO:tasks.workunit.client.0.smithi081.stdout:9/632: truncate d3/fa7 1488848 0 2024-04-23T14:49:51.001 INFO:tasks.workunit.client.0.smithi081.stdout:9/633: chown d3/de/d22/f5d 6676 1 2024-04-23T14:49:51.007 INFO:tasks.workunit.client.1.smithi156.stdout:2/250: dread d4/d13/f14 [0,4194304] 0 2024-04-23T14:49:51.014 INFO:tasks.workunit.client.1.smithi156.stdout:2/251: mknod d4/d26/d3c/c5d 0 2024-04-23T14:49:51.014 INFO:tasks.workunit.client.1.smithi156.stdout:0/277: write d0/d4/fe [2659271,19959] 0 2024-04-23T14:49:51.014 INFO:tasks.workunit.client.1.smithi156.stdout:0/278: fdatasync d0/f1a 0 2024-04-23T14:49:51.014 INFO:tasks.workunit.client.1.smithi156.stdout:2/252: creat d4/d21/d42/f5e x:0 0 0 2024-04-23T14:49:51.015 INFO:tasks.workunit.client.1.smithi156.stdout:2/253: stat d4/d21/d2f/l56 0 2024-04-23T14:49:51.015 INFO:tasks.workunit.client.0.smithi081.stdout:5/697: read d17/d1f/d36/d59/f63 [3093076,100797] 0 2024-04-23T14:49:51.015 INFO:tasks.workunit.client.0.smithi081.stdout:5/698: write d17/d3c/d55/d64/dcc/ff5 [1015791,66049] 0 2024-04-23T14:49:51.015 INFO:tasks.workunit.client.0.smithi081.stdout:5/699: write d17/f1b [4840499,43829] 0 2024-04-23T14:49:51.015 INFO:tasks.workunit.client.0.smithi081.stdout:5/700: fdatasync d17/d18/fe5 0 2024-04-23T14:49:51.020 INFO:tasks.workunit.client.0.smithi081.stdout:5/701: unlink d17/f1d 0 2024-04-23T14:49:51.020 INFO:tasks.workunit.client.0.smithi081.stdout:0/721: dwrite d6/d11/d14/d41/d5b/fa4 [0,4194304] 0 2024-04-23T14:49:51.020 INFO:tasks.workunit.client.0.smithi081.stdout:0/722: getdents d6/d37/d85/dd6 0 2024-04-23T14:49:51.020 INFO:tasks.workunit.client.0.smithi081.stdout:0/723: chown d6/d25/f45 1929 1 2024-04-23T14:49:51.020 INFO:tasks.workunit.client.0.smithi081.stdout:0/724: readlink d6/d11/d14/d41/d5b/d59/l9a 0 2024-04-23T14:49:51.020 INFO:tasks.workunit.client.0.smithi081.stdout:0/725: write d6/d11/d14/d41/d5b/d3f/d44/f86 [2083031,33187] 0 2024-04-23T14:49:51.020 INFO:tasks.workunit.client.1.smithi156.stdout:2/254: truncate d4/d13/f25 1219284 0 2024-04-23T14:49:51.025 INFO:tasks.workunit.client.1.smithi156.stdout:9/224: dwrite d1/d2/d4/d17/d1f/f36 [0,4194304] 0 2024-04-23T14:49:51.029 INFO:tasks.workunit.client.1.smithi156.stdout:8/278: dread d5/d9/d10/f12 [0,4194304] 0 2024-04-23T14:49:51.031 INFO:tasks.workunit.client.1.smithi156.stdout:3/258: dread d4/db/dd/d1d/f2e [0,4194304] 0 2024-04-23T14:49:51.037 INFO:tasks.workunit.client.0.smithi081.stdout:3/558: dread d4/dc/d50/d9a/fa5 [0,4194304] 0 2024-04-23T14:49:51.039 INFO:tasks.workunit.client.1.smithi156.stdout:8/279: creat d5/f5e x:0 0 0 2024-04-23T14:49:51.039 INFO:tasks.workunit.client.1.smithi156.stdout:3/259: mkdir d4/db/d4b 0 2024-04-23T14:49:51.043 INFO:tasks.workunit.client.0.smithi081.stdout:3/559: symlink d4/d7/d7f/d85/lb4 0 2024-04-23T14:49:51.043 INFO:tasks.workunit.client.0.smithi081.stdout:5/702: dread d17/d1f/f22 [0,4194304] 0 2024-04-23T14:49:51.043 INFO:tasks.workunit.client.0.smithi081.stdout:5/703: fdatasync d17/d1f/d36/d59/da8/fa9 0 2024-04-23T14:49:51.046 INFO:tasks.workunit.client.1.smithi156.stdout:3/260: unlink d4/f2a 0 2024-04-23T14:49:51.046 INFO:tasks.workunit.client.1.smithi156.stdout:3/261: creat d4/db/dd/d1d/d1e/d13/f4c x:0 0 0 2024-04-23T14:49:51.049 INFO:tasks.workunit.client.1.smithi156.stdout:8/280: rmdir d5/d4e 39 2024-04-23T14:49:51.052 INFO:tasks.workunit.client.1.smithi156.stdout:9/225: dread d1/d2/d23/f27 [0,4194304] 0 2024-04-23T14:49:51.052 INFO:tasks.workunit.client.1.smithi156.stdout:9/226: write d1/d2/d23/d2d/d39/f42 [445892,25848] 0 2024-04-23T14:49:51.053 INFO:tasks.workunit.client.1.smithi156.stdout:3/262: creat d4/db/dd/d1d/d1e/d2b/d31/f4d x:0 0 0 2024-04-23T14:49:51.053 INFO:tasks.workunit.client.1.smithi156.stdout:8/281: link d5/d9/la d5/d9/d5a/d5c/l5f 0 2024-04-23T14:49:51.054 INFO:tasks.workunit.client.1.smithi156.stdout:3/263: truncate d4/db/dd/d20/f23 9116357 0 2024-04-23T14:49:51.054 INFO:tasks.workunit.client.1.smithi156.stdout:8/282: readlink d5/d9/d5a/d5c/l5f 0 2024-04-23T14:49:51.055 INFO:tasks.workunit.client.0.smithi081.stdout:1/693: dwrite d3/d3d/d41/d5e/d5d/fa4 [0,4194304] 0 2024-04-23T14:49:51.055 INFO:tasks.workunit.client.0.smithi081.stdout:1/694: creat d3/d3d/d41/d5e/dd2/fdf x:0 0 0 2024-04-23T14:49:51.056 INFO:tasks.workunit.client.1.smithi156.stdout:3/264: symlink d4/db/dd/d20/l4e 0 2024-04-23T14:49:51.062 INFO:tasks.workunit.client.1.smithi156.stdout:9/227: dread d1/fe [0,4194304] 0 2024-04-23T14:49:51.062 INFO:tasks.workunit.client.1.smithi156.stdout:9/228: getdents d1/d2/d4/d17/d1f/d48 0 2024-04-23T14:49:51.062 INFO:tasks.workunit.client.0.smithi081.stdout:1/695: mkdir d3/d3d/d90/de0 0 2024-04-23T14:49:51.063 INFO:tasks.workunit.client.0.smithi081.stdout:1/696: mkdir d3/de1 0 2024-04-23T14:49:51.064 INFO:tasks.workunit.client.0.smithi081.stdout:3/560: dread d4/dc/d10/d47/f6d [0,4194304] 0 2024-04-23T14:49:51.065 INFO:tasks.workunit.client.0.smithi081.stdout:1/697: mknod d3/d3d/d41/d5e/d17/d25/ce2 0 2024-04-23T14:49:51.065 INFO:tasks.workunit.client.0.smithi081.stdout:3/561: getdents d4/dc/d10 0 2024-04-23T14:49:51.067 INFO:tasks.workunit.client.0.smithi081.stdout:1/698: rename d3/d3d/d41/d5e/da0/fa2 to d3/d3d/d41/d5e/d12/fe3 0 2024-04-23T14:49:51.067 INFO:tasks.workunit.client.0.smithi081.stdout:1/699: read - d3/d3d/d41/d4a/d77/fcd zero size 2024-04-23T14:49:51.067 INFO:tasks.workunit.client.0.smithi081.stdout:3/562: getdents d4/dc/d50 0 2024-04-23T14:49:51.068 INFO:tasks.workunit.client.0.smithi081.stdout:1/700: mknod d3/d3d/d41/d92/ce4 0 2024-04-23T14:49:51.068 INFO:tasks.workunit.client.0.smithi081.stdout:1/701: write d3/d3d/d41/d5e/d17/d58/d7f/dba/fc7 [709100,69724] 0 2024-04-23T14:49:51.068 INFO:tasks.workunit.client.0.smithi081.stdout:1/702: write d3/d3d/d41/d5e/d12/d2e/fc5 [654211,111455] 0 2024-04-23T14:49:51.068 INFO:tasks.workunit.client.0.smithi081.stdout:3/563: truncate d4/d7/d32/f9c 1129179 0 2024-04-23T14:49:51.070 INFO:tasks.workunit.client.0.smithi081.stdout:1/703: rename d3/d3d/d6f/f9a to d3/d3d/d7a/fe5 0 2024-04-23T14:49:51.072 INFO:tasks.workunit.client.0.smithi081.stdout:1/704: mkdir d3/d3d/d6f/de6 0 2024-04-23T14:49:51.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:50 smithi081 ceph-mon[25540]: pgmap v34: 65 pgs: 65 active+clean; 1.9 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 165 MiB/s rd, 192 MiB/s wr, 607 op/s 2024-04-23T14:49:51.097 INFO:tasks.workunit.client.0.smithi081.stdout:8/826: dwrite d3/d11/f3a [0,4194304] 0 2024-04-23T14:49:51.101 INFO:tasks.workunit.client.1.smithi156.stdout:2/255: truncate d4/d26/f51 65302 0 2024-04-23T14:49:51.109 INFO:tasks.workunit.client.1.smithi156.stdout:9/229: dwrite d1/d2/f18 [0,4194304] 0 2024-04-23T14:49:51.127 INFO:tasks.workunit.client.1.smithi156.stdout:9/230: rename d1/d2/d23/d2f to d1/d2/d23/d49/d4c 0 2024-04-23T14:49:51.127 INFO:tasks.workunit.client.1.smithi156.stdout:9/231: truncate d1/d2/d23/d2d/d39/f42 1331432 0 2024-04-23T14:49:51.129 INFO:tasks.workunit.client.1.smithi156.stdout:2/256: dread d4/d13/d19/f1e [0,4194304] 0 2024-04-23T14:49:51.129 INFO:tasks.workunit.client.1.smithi156.stdout:1/329: dwrite db/f19 [0,4194304] 0 2024-04-23T14:49:51.131 INFO:tasks.workunit.client.1.smithi156.stdout:0/279: dwrite d0/d16/d3a/d2a/d1d/f17 [4194304,4194304] 0 2024-04-23T14:49:51.131 INFO:tasks.workunit.client.1.smithi156.stdout:0/280: truncate d0/d4/d11/f4b 664599 0 2024-04-23T14:49:51.131 INFO:tasks.workunit.client.1.smithi156.stdout:0/281: stat d0/d4/d11/l27 0 2024-04-23T14:49:51.135 INFO:tasks.workunit.client.1.smithi156.stdout:2/257: stat d4/d13/l40 0 2024-04-23T14:49:51.135 INFO:tasks.workunit.client.1.smithi156.stdout:2/258: read - d4/d21/f3f zero size 2024-04-23T14:49:51.135 INFO:tasks.workunit.client.1.smithi156.stdout:2/259: rename d4/d13/d19/d58 to d4/d13/d19/d58/d5f 22 2024-04-23T14:49:51.138 INFO:tasks.workunit.client.1.smithi156.stdout:1/330: unlink db/d1f/d2f/c3c 0 2024-04-23T14:49:51.140 INFO:tasks.workunit.client.1.smithi156.stdout:2/260: truncate d4/d26/f44 5712176 0 2024-04-23T14:49:51.142 INFO:tasks.workunit.client.0.smithi081.stdout:3/564: dwrite d4/d7/df/f72 [0,4194304] 0 2024-04-23T14:49:51.147 INFO:tasks.workunit.client.1.smithi156.stdout:1/331: rmdir db/d25/d30/d38/d40 39 2024-04-23T14:49:51.148 INFO:tasks.workunit.client.1.smithi156.stdout:1/332: write db/d1f/d2f/d47/f5f [985769,8663] 0 2024-04-23T14:49:51.156 INFO:tasks.workunit.client.0.smithi081.stdout:3/565: read d4/d7/df/f5e [527780,50369] 0 2024-04-23T14:49:51.156 INFO:tasks.workunit.client.1.smithi156.stdout:6/337: dwrite d3/d16/d1e/f53 [0,4194304] 0 2024-04-23T14:49:51.160 INFO:tasks.workunit.client.1.smithi156.stdout:3/265: dwrite d4/f3f [0,4194304] 0 2024-04-23T14:49:51.160 INFO:tasks.workunit.client.1.smithi156.stdout:3/266: fdatasync d4/db/dd/d1d/d1e/d13/f4c 0 2024-04-23T14:49:51.160 INFO:tasks.workunit.client.1.smithi156.stdout:3/267: fsync d4/db/dd/d1d/d1e/d13/f34 0 2024-04-23T14:49:51.160 INFO:tasks.workunit.client.1.smithi156.stdout:3/268: chown d4/db/dd/c24 474 1 2024-04-23T14:49:51.160 INFO:tasks.workunit.client.1.smithi156.stdout:3/269: fdatasync d4/db/dd/d1d/d1e/d2b/d31/f4d 0 2024-04-23T14:49:51.162 INFO:tasks.workunit.client.0.smithi081.stdout:1/705: dwrite d3/d3d/d41/d5e/d5d/db0/f8e [0,4194304] 0 2024-04-23T14:49:51.165 INFO:tasks.workunit.client.1.smithi156.stdout:0/282: write d0/d4/ff [3491361,31097] 0 2024-04-23T14:49:51.165 INFO:tasks.workunit.client.1.smithi156.stdout:0/283: chown d0/d4/d11/f4b 1 1 2024-04-23T14:49:51.165 INFO:tasks.workunit.client.1.smithi156.stdout:0/284: chown d0/d16/d3a/d2a/d1d 160451517 1 2024-04-23T14:49:51.166 INFO:tasks.workunit.client.0.smithi081.stdout:0/726: dwrite d6/d11/d14/d41/d5b/d3f/f6c [0,4194304] 0 2024-04-23T14:49:51.167 INFO:tasks.workunit.client.1.smithi156.stdout:6/338: rename d3/d16/d46/f73 to d3/d16/f85 0 2024-04-23T14:49:51.168 INFO:tasks.workunit.client.1.smithi156.stdout:6/339: dread - d3/d16/f85 zero size 2024-04-23T14:49:51.171 INFO:tasks.workunit.client.0.smithi081.stdout:5/704: dwrite d17/d1f/f25 [0,4194304] 0 2024-04-23T14:49:51.172 INFO:tasks.workunit.client.1.smithi156.stdout:7/314: dwrite dc/d1d/d24/f4a [0,4194304] 0 2024-04-23T14:49:51.172 INFO:tasks.workunit.client.0.smithi081.stdout:3/566: read d4/dc/d50/d9a/fa5 [2801069,56323] 0 2024-04-23T14:49:51.173 INFO:tasks.workunit.client.1.smithi156.stdout:3/270: mknod d4/db/dd/c4f 0 2024-04-23T14:49:51.174 INFO:tasks.workunit.client.1.smithi156.stdout:3/271: fsync d4/db/dd/d1d/d1e/d13/f1f 0 2024-04-23T14:49:51.174 INFO:tasks.workunit.client.1.smithi156.stdout:3/272: write d4/db/dd/d1d/d1e/d13/f41 [423735,27649] 0 2024-04-23T14:49:51.174 INFO:tasks.workunit.client.1.smithi156.stdout:3/273: getdents d4/db/d4b 0 2024-04-23T14:49:51.174 INFO:tasks.workunit.client.1.smithi156.stdout:3/274: creat d4/db/dd/f50 x:0 0 0 2024-04-23T14:49:51.178 INFO:tasks.workunit.client.0.smithi081.stdout:8/827: dwrite d3/d11/d34/f7c [0,4194304] 0 2024-04-23T14:49:51.179 INFO:tasks.workunit.client.1.smithi156.stdout:6/340: creat d3/d16/d5c/f86 x:0 0 0 2024-04-23T14:49:51.183 INFO:tasks.workunit.client.1.smithi156.stdout:0/285: dread d0/d16/d3a/d1e/f3d [0,4194304] 0 2024-04-23T14:49:51.189 INFO:tasks.workunit.client.0.smithi081.stdout:1/706: write d3/d3d/d41/d4a/f3f [4783298,108145] 0 2024-04-23T14:49:51.191 INFO:tasks.workunit.client.0.smithi081.stdout:0/727: truncate d6/d11/d14/d24/f6d 3638702 0 2024-04-23T14:49:51.200 INFO:tasks.workunit.client.0.smithi081.stdout:5/705: symlink d17/d1f/lf9 0 2024-04-23T14:49:51.200 INFO:tasks.workunit.client.0.smithi081.stdout:5/706: chown d17/d1f/d42/d9b/d9e/da3/cb2 16041 1 2024-04-23T14:49:51.204 INFO:tasks.workunit.client.0.smithi081.stdout:3/567: mkdir d4/d7/d32/db0/db5 0 2024-04-23T14:49:51.209 INFO:tasks.workunit.client.1.smithi156.stdout:7/315: mkdir dc/d1d/d24/d5a 0 2024-04-23T14:49:51.209 INFO:tasks.workunit.client.0.smithi081.stdout:3/568: write d4/d7/d32/d6a/f7e [4576346,52549] 0 2024-04-23T14:49:51.213 INFO:tasks.workunit.client.0.smithi081.stdout:0/728: readlink d6/d37/l39 0 2024-04-23T14:49:51.214 INFO:tasks.workunit.client.0.smithi081.stdout:5/707: creat d17/d1f/ffa x:0 0 0 2024-04-23T14:49:51.214 INFO:tasks.workunit.client.0.smithi081.stdout:1/707: dread d3/d3d/d41/d5e/d12/d1a/f48 [0,4194304] 0 2024-04-23T14:49:51.215 INFO:tasks.workunit.client.1.smithi156.stdout:3/275: truncate d4/db/dd/f26 2002209 0 2024-04-23T14:49:51.218 INFO:tasks.workunit.client.0.smithi081.stdout:0/729: link d6/d37/d67/dc8/fd5 d6/d11/d14/d41/d5b/d3f/d44/d78/d83/fe2 0 2024-04-23T14:49:51.221 INFO:tasks.workunit.client.1.smithi156.stdout:9/232: truncate d1/d2/f18 1670138 0 2024-04-23T14:49:51.224 INFO:tasks.workunit.client.1.smithi156.stdout:6/341: rename d3/d16/d46/d2b/d3b/f4d to d3/d16/d5c/d6a/f87 0 2024-04-23T14:49:51.226 INFO:tasks.workunit.client.0.smithi081.stdout:5/708: truncate d17/d1f/d36/d59/fc1 2638442 0 2024-04-23T14:49:51.226 INFO:tasks.workunit.client.0.smithi081.stdout:5/709: chown l15 12050 1 2024-04-23T14:49:51.229 INFO:tasks.workunit.client.1.smithi156.stdout:0/286: truncate d0/d4/d14/f56 53409 0 2024-04-23T14:49:51.230 INFO:tasks.workunit.client.0.smithi081.stdout:8/828: dread d3/d3c/f97 [0,4194304] 0 2024-04-23T14:49:51.230 INFO:tasks.workunit.client.1.smithi156.stdout:7/316: dread dc/d1d/d41/f43 [0,4194304] 0 2024-04-23T14:49:51.231 INFO:tasks.workunit.client.1.smithi156.stdout:9/233: mknod d1/d2/d4/d19/c4d 0 2024-04-23T14:49:51.236 INFO:tasks.workunit.client.1.smithi156.stdout:1/333: dwrite db/ff [0,4194304] 0 2024-04-23T14:49:51.236 INFO:tasks.workunit.client.0.smithi081.stdout:1/708: creat d3/d3d/d41/d5e/d17/d58/d7f/fe7 x:0 0 0 2024-04-23T14:49:51.236 INFO:tasks.workunit.client.0.smithi081.stdout:1/709: chown d3/d3d/d41/d92/cc3 8017 1 2024-04-23T14:49:51.237 INFO:tasks.workunit.client.0.smithi081.stdout:0/730: link d6/d11/d14/d41/d5b/d59/l9a d6/d69/le3 0 2024-04-23T14:49:51.237 INFO:tasks.workunit.client.0.smithi081.stdout:1/710: fdatasync d3/d3d/d41/d5e/d17/d26/f31 0 2024-04-23T14:49:51.239 INFO:tasks.workunit.client.1.smithi156.stdout:2/261: dwrite d4/d26/f51 [0,4194304] 0 2024-04-23T14:49:51.239 INFO:tasks.workunit.client.1.smithi156.stdout:2/262: readlink d4/d13/d19/l1c 0 2024-04-23T14:49:51.239 INFO:tasks.workunit.client.0.smithi081.stdout:5/710: rename d17/d65/f7e to d17/d1f/d42/dbb/ffb 0 2024-04-23T14:49:51.245 INFO:tasks.workunit.client.1.smithi156.stdout:9/234: mkdir d1/d2/d4/d17/d1f/d48/d4e 0 2024-04-23T14:49:51.248 INFO:tasks.workunit.client.0.smithi081.stdout:1/711: link d3/d3d/d41/d5e/d12/d1a/c28 d3/d3d/d41/d92/da6/ce8 0 2024-04-23T14:49:51.252 INFO:tasks.workunit.client.0.smithi081.stdout:5/711: dread d17/d3d/d41/f6a [0,4194304] 0 2024-04-23T14:49:51.255 INFO:tasks.workunit.client.1.smithi156.stdout:2/263: rename d4/d13/f25 to d4/d13/d19/d4c/f60 0 2024-04-23T14:49:51.255 INFO:tasks.workunit.client.0.smithi081.stdout:0/731: read d6/d11/d14/d24/fcf [747188,91981] 0 2024-04-23T14:49:51.257 INFO:tasks.workunit.client.0.smithi081.stdout:1/712: truncate d3/d3d/d6f/f62 1826475 0 2024-04-23T14:49:51.269 INFO:tasks.workunit.client.1.smithi156.stdout:0/287: dwrite d0/d16/d3a/d2a/d1d/d2d/f41 [0,4194304] 0 2024-04-23T14:49:51.269 INFO:tasks.workunit.client.1.smithi156.stdout:0/288: fdatasync d0/d16/d3a/d2a/d1d/d2d/f2f 0 2024-04-23T14:49:51.269 INFO:tasks.workunit.client.1.smithi156.stdout:7/317: rmdir dc 39 2024-04-23T14:49:51.269 INFO:tasks.workunit.client.1.smithi156.stdout:7/318: getdents dc/d46/d58 0 2024-04-23T14:49:51.270 INFO:tasks.workunit.client.0.smithi081.stdout:8/829: dread d3/d11/d34/f68 [0,4194304] 0 2024-04-23T14:49:51.270 INFO:tasks.workunit.client.0.smithi081.stdout:3/569: dwrite d4/d41/f67 [0,4194304] 0 2024-04-23T14:49:51.270 INFO:tasks.workunit.client.0.smithi081.stdout:8/830: fsync d3/d11/d34/f40 0 2024-04-23T14:49:51.270 INFO:tasks.workunit.client.0.smithi081.stdout:8/831: readlink d3/d11/d86/d88/da7/de0/lf9 0 2024-04-23T14:49:51.271 INFO:tasks.workunit.client.1.smithi156.stdout:9/235: rmdir d1/d2/d23/d2d 39 2024-04-23T14:49:51.273 INFO:tasks.workunit.client.1.smithi156.stdout:2/264: rmdir d4/d13/d19/d4c/d5c 39 2024-04-23T14:49:51.273 INFO:tasks.workunit.client.1.smithi156.stdout:2/265: stat d4/d21/d42/f43 0 2024-04-23T14:49:51.276 INFO:tasks.workunit.client.0.smithi081.stdout:3/570: rename d4/c7b to d4/d7/d1a/cb6 0 2024-04-23T14:49:51.279 INFO:tasks.workunit.client.1.smithi156.stdout:0/289: mkdir d0/d4/d22/d58 0 2024-04-23T14:49:51.279 INFO:tasks.workunit.client.1.smithi156.stdout:0/290: rename d0 to d0/d16/d3a/d2a/d59 22 2024-04-23T14:49:51.279 INFO:tasks.workunit.client.1.smithi156.stdout:0/291: stat d0/d4/fe 0 2024-04-23T14:49:51.279 INFO:tasks.workunit.client.1.smithi156.stdout:5/338: sync 2024-04-23T14:49:51.279 INFO:tasks.workunit.client.1.smithi156.stdout:8/283: sync 2024-04-23T14:49:51.279 INFO:tasks.workunit.client.1.smithi156.stdout:4/265: sync 2024-04-23T14:49:51.279 INFO:tasks.workunit.client.1.smithi156.stdout:4/266: truncate d0/df/d21/d36/f4f 592756 0 2024-04-23T14:49:51.279 INFO:tasks.workunit.client.1.smithi156.stdout:4/267: write d0/f41 [4856386,17292] 0 2024-04-23T14:49:51.280 INFO:tasks.workunit.client.1.smithi156.stdout:4/268: truncate d0/d8/d1e/d4a/f50 447721 0 2024-04-23T14:49:51.280 INFO:tasks.workunit.client.1.smithi156.stdout:6/342: rmdir d3/d16/d46 39 2024-04-23T14:49:51.282 INFO:tasks.workunit.client.1.smithi156.stdout:7/319: creat dc/d1d/d48/f5b x:0 0 0 2024-04-23T14:49:51.282 INFO:tasks.workunit.client.1.smithi156.stdout:7/320: fdatasync dc/d46/f44 0 2024-04-23T14:49:51.283 INFO:tasks.workunit.client.1.smithi156.stdout:9/236: dread d1/d2/d23/d49/d4c/f3b [0,4194304] 0 2024-04-23T14:49:51.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:50 smithi156 ceph-mon[32341]: pgmap v34: 65 pgs: 65 active+clean; 1.9 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 165 MiB/s rd, 192 MiB/s wr, 607 op/s 2024-04-23T14:49:51.288 INFO:tasks.workunit.client.1.smithi156.stdout:2/266: mknod d4/d21/d2f/c61 0 2024-04-23T14:49:51.288 INFO:tasks.workunit.client.1.smithi156.stdout:2/267: truncate d4/d21/d42/f4e 16075 0 2024-04-23T14:49:51.290 INFO:tasks.workunit.client.1.smithi156.stdout:4/269: mknod d0/df/d21/d36/c59 0 2024-04-23T14:49:51.290 INFO:tasks.workunit.client.1.smithi156.stdout:0/292: rename d0/d4/d14/c28 to d0/d4/c5a 0 2024-04-23T14:49:51.294 INFO:tasks.workunit.client.1.smithi156.stdout:6/343: mknod d3/da/d1d/d27/d63/c88 0 2024-04-23T14:49:51.296 INFO:tasks.workunit.client.1.smithi156.stdout:9/237: creat d1/d2/d4/d17/d1f/d48/f4f x:0 0 0 2024-04-23T14:49:51.296 INFO:tasks.workunit.client.1.smithi156.stdout:9/238: truncate d1/d2/d23/d49/d4c/f3b 1508935 0 2024-04-23T14:49:51.296 INFO:tasks.workunit.client.1.smithi156.stdout:9/239: chown d1/d2/d4/d17/d1f/d48/f4f 1524865 1 2024-04-23T14:49:51.297 INFO:tasks.workunit.client.0.smithi081.stdout:8/832: rmdir d3/d11/d34/dab 39 2024-04-23T14:49:51.301 INFO:tasks.workunit.client.1.smithi156.stdout:0/293: creat d0/d16/d3a/d2a/d1d/d2d/f5b x:0 0 0 2024-04-23T14:49:51.305 INFO:tasks.workunit.client.1.smithi156.stdout:1/334: dwrite db/d1f/d2f/f56 [0,4194304] 0 2024-04-23T14:49:51.305 INFO:tasks.workunit.client.1.smithi156.stdout:1/335: chown db/d25/d30 1 1 2024-04-23T14:49:51.305 INFO:tasks.workunit.client.1.smithi156.stdout:1/336: readlink db/d1f/l35 0 2024-04-23T14:49:51.306 INFO:tasks.workunit.client.1.smithi156.stdout:5/339: rename d1/d3/d24/l48 to d1/d3/d20/d3e/l71 0 2024-04-23T14:49:51.315 INFO:tasks.workunit.client.0.smithi081.stdout:3/571: link d4/dc/d50/f4e d4/d7/d7f/d91/fb7 0 2024-04-23T14:49:51.315 INFO:tasks.workunit.client.0.smithi081.stdout:3/572: fsync d4/d7/d32/f94 0 2024-04-23T14:49:51.315 INFO:tasks.workunit.client.0.smithi081.stdout:8/833: creat d3/d11/d48/f111 x:0 0 0 2024-04-23T14:49:51.316 INFO:tasks.workunit.client.1.smithi156.stdout:6/344: unlink d3/da/d1d/d27/l2a 0 2024-04-23T14:49:51.316 INFO:tasks.workunit.client.1.smithi156.stdout:6/345: chown d3/da/d1d/f35 1 1 2024-04-23T14:49:51.316 INFO:tasks.workunit.client.1.smithi156.stdout:6/346: write d3/d16/d1e/f3d [714096,62743] 0 2024-04-23T14:49:51.316 INFO:tasks.workunit.client.1.smithi156.stdout:6/347: write d3/da/f4f [978129,37550] 0 2024-04-23T14:49:51.316 INFO:tasks.workunit.client.1.smithi156.stdout:6/348: getdents d3/d16/d46/d2b/d6e 0 2024-04-23T14:49:51.316 INFO:tasks.workunit.client.1.smithi156.stdout:6/349: write d3/d16/f5a [4284345,42726] 0 2024-04-23T14:49:51.316 INFO:tasks.workunit.client.1.smithi156.stdout:6/350: dread - d3/d16/d46/f3e zero size 2024-04-23T14:49:51.317 INFO:tasks.workunit.client.1.smithi156.stdout:9/240: unlink d1/d2/f18 0 2024-04-23T14:49:51.317 INFO:tasks.workunit.client.0.smithi081.stdout:1/713: dwrite d3/d3d/d41/d92/fbc [0,4194304] 0 2024-04-23T14:49:51.317 INFO:tasks.workunit.client.0.smithi081.stdout:1/714: dread - d3/d3d/d41/d5e/d1d/fd7 zero size 2024-04-23T14:49:51.318 INFO:tasks.workunit.client.0.smithi081.stdout:1/715: write d3/d3d/d41/d4a/d77/fcd [89934,52615] 0 2024-04-23T14:49:51.320 INFO:tasks.workunit.client.1.smithi156.stdout:1/337: write db/ff [4088955,93659] 0 2024-04-23T14:49:51.324 INFO:tasks.workunit.client.0.smithi081.stdout:8/834: mknod d3/c112 0 2024-04-23T14:49:51.328 INFO:tasks.workunit.client.1.smithi156.stdout:0/294: mknod d0/c5c 0 2024-04-23T14:49:51.329 INFO:tasks.workunit.client.1.smithi156.stdout:0/295: readlink d0/l36 0 2024-04-23T14:49:51.329 INFO:tasks.workunit.client.1.smithi156.stdout:4/270: rename d0/df/c11 to d0/df/d21/d36/d53/c5a 0 2024-04-23T14:49:51.329 INFO:tasks.workunit.client.1.smithi156.stdout:0/296: creat d0/d16/d3a/d1e/f5d x:0 0 0 2024-04-23T14:49:51.332 INFO:tasks.workunit.client.0.smithi081.stdout:1/716: mkdir d3/d3d/de9 0 2024-04-23T14:49:51.334 INFO:tasks.workunit.client.1.smithi156.stdout:5/340: creat d1/d3/d24/f72 x:0 0 0 2024-04-23T14:49:51.339 INFO:tasks.workunit.client.0.smithi081.stdout:8/835: rename d3/d11/d48/fe2 to d3/d11/d86/f113 0 2024-04-23T14:49:51.339 INFO:tasks.workunit.client.0.smithi081.stdout:5/712: dwrite d17/d1f/d36/d9a/fde [0,4194304] 0 2024-04-23T14:49:51.343 INFO:tasks.workunit.client.0.smithi081.stdout:5/713: chown d17/d18/d3a/d8e/f90 15791821 1 2024-04-23T14:49:51.343 INFO:tasks.workunit.client.0.smithi081.stdout:5/714: write d17/d1f/d42/fbc [470365,19788] 0 2024-04-23T14:49:51.343 INFO:tasks.workunit.client.0.smithi081.stdout:1/717: creat d3/d3d/d41/d5e/d5d/fea x:0 0 0 2024-04-23T14:49:51.346 INFO:tasks.workunit.client.1.smithi156.stdout:6/351: mknod d3/da/d1d/d59/d72/c89 0 2024-04-23T14:49:51.350 INFO:tasks.workunit.client.0.smithi081.stdout:0/732: dwrite d6/d37/d4d/d71/f72 [0,4194304] 0 2024-04-23T14:49:51.353 INFO:tasks.workunit.client.0.smithi081.stdout:4/580: sync 2024-04-23T14:49:51.353 INFO:tasks.workunit.client.0.smithi081.stdout:9/634: sync 2024-04-23T14:49:51.353 INFO:tasks.workunit.client.0.smithi081.stdout:6/666: sync 2024-04-23T14:49:51.353 INFO:tasks.workunit.client.0.smithi081.stdout:9/635: chown d3/de/d1d/d73/l81 9563974 1 2024-04-23T14:49:51.354 INFO:tasks.workunit.client.1.smithi156.stdout:9/241: mkdir d1/d2/d3e/d50 0 2024-04-23T14:49:51.354 INFO:tasks.workunit.client.1.smithi156.stdout:9/242: getdents d1/d2/d3e/d50 0 2024-04-23T14:49:51.356 INFO:tasks.workunit.client.0.smithi081.stdout:1/718: mknod d3/d3d/d41/d5e/dd2/dd5/ceb 0 2024-04-23T14:49:51.356 INFO:tasks.workunit.client.1.smithi156.stdout:7/321: dwrite dc/d2c/f33 [0,4194304] 0 2024-04-23T14:49:51.359 INFO:tasks.workunit.client.0.smithi081.stdout:2/682: sync 2024-04-23T14:49:51.359 INFO:tasks.workunit.client.0.smithi081.stdout:7/517: sync 2024-04-23T14:49:51.359 INFO:tasks.workunit.client.0.smithi081.stdout:2/683: truncate d1/d33/fcf 505873 0 2024-04-23T14:49:51.361 INFO:tasks.workunit.client.1.smithi156.stdout:1/338: mknod db/d1f/d4b/c65 0 2024-04-23T14:49:51.367 INFO:tasks.workunit.client.0.smithi081.stdout:4/581: mkdir d1/d4f/dc3 0 2024-04-23T14:49:51.368 INFO:tasks.workunit.client.1.smithi156.stdout:6/352: link d3/lc d3/d16/d5c/d6f/l8a 0 2024-04-23T14:49:51.369 INFO:tasks.workunit.client.1.smithi156.stdout:7/322: write dc/d1d/f32 [1513455,11156] 0 2024-04-23T14:49:51.370 INFO:tasks.workunit.client.0.smithi081.stdout:7/518: symlink d3/d21/d31/d33/d4b/lae 0 2024-04-23T14:49:51.374 INFO:tasks.workunit.client.0.smithi081.stdout:7/519: creat d3/d11/d56/d7f/faf x:0 0 0 2024-04-23T14:49:51.374 INFO:tasks.workunit.client.1.smithi156.stdout:5/341: fsync d1/d3/d24/f72 0 2024-04-23T14:49:51.375 INFO:tasks.workunit.client.0.smithi081.stdout:4/582: rmdir d1/d4/d6f/d70/daf/d8c 39 2024-04-23T14:49:51.375 INFO:tasks.workunit.client.0.smithi081.stdout:4/583: readlink d1/d1d/l4b 0 2024-04-23T14:49:51.377 INFO:tasks.workunit.client.0.smithi081.stdout:3/573: dwrite d4/dc/d10/d47/f4a [0,4194304] 0 2024-04-23T14:49:51.378 INFO:tasks.workunit.client.1.smithi156.stdout:1/339: mkdir db/d25/d66 0 2024-04-23T14:49:51.384 INFO:tasks.workunit.client.1.smithi156.stdout:7/323: creat dc/d2c/f5c x:0 0 0 2024-04-23T14:49:51.385 INFO:tasks.workunit.client.1.smithi156.stdout:4/271: rmdir d0/d8/d1e/d4a 39 2024-04-23T14:49:51.389 INFO:tasks.workunit.client.0.smithi081.stdout:8/836: dread d3/d3c/f84 [0,4194304] 0 2024-04-23T14:49:51.398 INFO:tasks.workunit.client.0.smithi081.stdout:1/719: dread d3/d3d/d41/d5e/d12/d1a/f86 [0,4194304] 0 2024-04-23T14:49:51.400 INFO:tasks.workunit.client.0.smithi081.stdout:4/584: link d1/f5b d1/d1d/d59/fc4 0 2024-04-23T14:49:51.400 INFO:tasks.workunit.client.0.smithi081.stdout:4/585: truncate d1/d8b/f92 1411692 0 2024-04-23T14:49:51.403 INFO:tasks.workunit.client.1.smithi156.stdout:5/342: creat d1/d3/d20/d3e/f73 x:0 0 0 2024-04-23T14:49:51.403 INFO:tasks.workunit.client.1.smithi156.stdout:7/324: getdents dc/d2a 0 2024-04-23T14:49:51.403 INFO:tasks.workunit.client.1.smithi156.stdout:7/325: chown dc/d1d/d41/f47 105279445 1 2024-04-23T14:49:51.404 INFO:tasks.workunit.client.0.smithi081.stdout:6/667: read d1/d51/d65/d1c/d6e/d7d/faf [240574,100452] 0 2024-04-23T14:49:51.404 INFO:tasks.workunit.client.0.smithi081.stdout:9/636: dwrite d3/de/d22/f5d [0,4194304] 0 2024-04-23T14:49:51.405 INFO:tasks.workunit.client.0.smithi081.stdout:2/684: write d1/d11/f25 [762041,127060] 0 2024-04-23T14:49:51.407 INFO:tasks.workunit.client.0.smithi081.stdout:6/668: creat d1/d51/d65/d8/d2e/d59/d80/d90/fef x:0 0 0 2024-04-23T14:49:51.409 INFO:tasks.workunit.client.0.smithi081.stdout:9/637: rename d3/de/d1d/fa1 to d3/d67/fc9 0 2024-04-23T14:49:51.409 INFO:tasks.workunit.client.0.smithi081.stdout:2/685: rmdir d1/d33/d95 39 2024-04-23T14:49:51.418 INFO:tasks.workunit.client.0.smithi081.stdout:7/520: write d3/d21/d31/d63/f74 [138091,93185] 0 2024-04-23T14:49:51.418 INFO:tasks.workunit.client.0.smithi081.stdout:7/521: write d3/d21/d31/d50/f58 [613012,102089] 0 2024-04-23T14:49:51.423 INFO:tasks.workunit.client.1.smithi156.stdout:7/326: dread dc/d1d/f42 [0,4194304] 0 2024-04-23T14:49:51.423 INFO:tasks.workunit.client.1.smithi156.stdout:7/327: fsync dc/d1d/d24/f4a 0 2024-04-23T14:49:51.424 INFO:tasks.workunit.client.1.smithi156.stdout:7/328: fdatasync dc/d1d/d24/f27 0 2024-04-23T14:49:51.424 INFO:tasks.workunit.client.1.smithi156.stdout:7/329: chown dc/d2c/f5c 5 1 2024-04-23T14:49:51.426 INFO:tasks.workunit.client.1.smithi156.stdout:7/330: mknod dc/d1d/d48/c5d 0 2024-04-23T14:49:51.426 INFO:tasks.workunit.client.1.smithi156.stdout:7/331: fsync dc/d1d/f35 0 2024-04-23T14:49:51.428 INFO:tasks.workunit.client.1.smithi156.stdout:7/332: rmdir dc 39 2024-04-23T14:49:51.430 INFO:tasks.workunit.client.0.smithi081.stdout:6/669: mkdir d1/d51/d65/d8/db1/df0 0 2024-04-23T14:49:51.430 INFO:tasks.workunit.client.0.smithi081.stdout:7/522: symlink d3/d21/d31/d33/d4b/d6e/lb0 0 2024-04-23T14:49:51.430 INFO:tasks.workunit.client.0.smithi081.stdout:6/670: fdatasync d1/d51/d65/d8/d2e/f2f 0 2024-04-23T14:49:51.430 INFO:tasks.workunit.client.0.smithi081.stdout:7/523: dread - d3/d21/d31/d50/da2/fa4 zero size 2024-04-23T14:49:51.430 INFO:tasks.workunit.client.0.smithi081.stdout:7/524: write d3/d21/d41/d7c/f8f [252290,104617] 0 2024-04-23T14:49:51.439 INFO:tasks.workunit.client.1.smithi156.stdout:2/268: dwrite d4/d21/d42/f55 [4194304,4194304] 0 2024-04-23T14:49:51.440 INFO:tasks.workunit.client.0.smithi081.stdout:5/715: dwrite d17/d4f/f68 [0,4194304] 0 2024-04-23T14:49:51.441 INFO:tasks.workunit.client.0.smithi081.stdout:1/720: dread d3/d3d/d41/d5e/d17/d58/f61 [0,4194304] 0 2024-04-23T14:49:51.441 INFO:tasks.workunit.client.0.smithi081.stdout:1/721: chown d3/f51 21 1 2024-04-23T14:49:51.446 INFO:tasks.workunit.client.0.smithi081.stdout:5/716: mknod d17/d3d/d7a/cfc 0 2024-04-23T14:49:51.446 INFO:tasks.workunit.client.0.smithi081.stdout:5/717: fsync d17/d1f/f25 0 2024-04-23T14:49:51.446 INFO:tasks.workunit.client.0.smithi081.stdout:5/718: readlink lb 0 2024-04-23T14:49:51.446 INFO:tasks.workunit.client.0.smithi081.stdout:5/719: chown d17/f38 19606 1 2024-04-23T14:49:51.447 INFO:tasks.workunit.client.1.smithi156.stdout:0/297: dwrite d0/d4/d14/f1f [0,4194304] 0 2024-04-23T14:49:51.449 INFO:tasks.workunit.client.0.smithi081.stdout:6/671: write d1/d51/feb [3951859,12287] 0 2024-04-23T14:49:51.451 INFO:tasks.workunit.client.0.smithi081.stdout:2/686: dread d1/f85 [0,4194304] 0 2024-04-23T14:49:51.457 INFO:tasks.workunit.client.0.smithi081.stdout:1/722: unlink d3/d3d/d41/d5e/d17/d26/l93 0 2024-04-23T14:49:51.457 INFO:tasks.workunit.client.0.smithi081.stdout:1/723: truncate d3/d3d/d41/d5e/d12/fe3 556178 0 2024-04-23T14:49:51.457 INFO:tasks.workunit.client.0.smithi081.stdout:5/720: creat d17/df3/ffd x:0 0 0 2024-04-23T14:49:51.459 INFO:tasks.workunit.client.1.smithi156.stdout:1/340: dread db/d1f/d2d/f36 [0,4194304] 0 2024-04-23T14:49:51.459 INFO:tasks.workunit.client.1.smithi156.stdout:1/341: readlink db/d15/l29 0 2024-04-23T14:49:51.465 INFO:tasks.workunit.client.0.smithi081.stdout:5/721: mkdir d17/d1f/d36/d59/dfe 0 2024-04-23T14:49:51.470 INFO:tasks.workunit.client.0.smithi081.stdout:5/722: rmdir d17/d1f/d42/d9b/d9e/da3/de0 0 2024-04-23T14:49:51.472 INFO:tasks.workunit.client.0.smithi081.stdout:3/574: dwrite d4/d7/d32/f33 [0,4194304] 0 2024-04-23T14:49:51.474 INFO:tasks.workunit.client.1.smithi156.stdout:2/269: creat d4/f62 x:0 0 0 2024-04-23T14:49:51.474 INFO:tasks.workunit.client.1.smithi156.stdout:2/270: fsync d4/d26/d3c/f46 0 2024-04-23T14:49:51.474 INFO:tasks.workunit.client.1.smithi156.stdout:2/271: write d4/d26/d3c/f46 [1628081,113882] 0 2024-04-23T14:49:51.474 INFO:tasks.workunit.client.1.smithi156.stdout:2/272: creat d4/d13/d19/d58/f63 x:0 0 0 2024-04-23T14:49:51.474 INFO:tasks.workunit.client.1.smithi156.stdout:2/273: dread - d4/f62 zero size 2024-04-23T14:49:51.479 INFO:tasks.workunit.client.1.smithi156.stdout:0/298: mkdir d0/d16/d3a/d2a/d5e 0 2024-04-23T14:49:51.481 INFO:tasks.workunit.client.1.smithi156.stdout:5/343: dwrite d1/d3/d24/f57 [0,4194304] 0 2024-04-23T14:49:51.481 INFO:tasks.workunit.client.1.smithi156.stdout:5/344: readlink d1/l4 0 2024-04-23T14:49:51.482 INFO:tasks.workunit.client.0.smithi081.stdout:4/586: dwrite d1/d4/dc/f78 [0,4194304] 0 2024-04-23T14:49:51.484 INFO:tasks.workunit.client.1.smithi156.stdout:1/342: link db/ff db/d25/d4e/d5d/f67 0 2024-04-23T14:49:51.488 INFO:tasks.workunit.client.1.smithi156.stdout:6/353: dwrite d3/d16/f30 [0,4194304] 0 2024-04-23T14:49:51.488 INFO:tasks.workunit.client.1.smithi156.stdout:6/354: chown d3/d16/f3c 3411558 1 2024-04-23T14:49:51.490 INFO:tasks.workunit.client.1.smithi156.stdout:7/333: dwrite dc/f14 [0,4194304] 0 2024-04-23T14:49:51.496 INFO:tasks.workunit.client.1.smithi156.stdout:2/274: chown d4/l6 4222 1 2024-04-23T14:49:51.496 INFO:tasks.workunit.client.1.smithi156.stdout:2/275: creat d4/d13/d19/d58/f64 x:0 0 0 2024-04-23T14:49:51.497 INFO:tasks.workunit.client.1.smithi156.stdout:0/299: rename d0/d4/d14 to d0/d4/d11/d3f/d5f 0 2024-04-23T14:49:51.499 INFO:tasks.workunit.client.1.smithi156.stdout:7/334: dread dc/d46/f31 [0,4194304] 0 2024-04-23T14:49:51.510 INFO:tasks.workunit.client.0.smithi081.stdout:4/587: getdents d1/d4/d6f/d70/daf/d8c 0 2024-04-23T14:49:51.515 INFO:tasks.workunit.client.1.smithi156.stdout:1/343: mkdir db/d1f/d4b/d68 0 2024-04-23T14:49:51.516 INFO:tasks.workunit.client.0.smithi081.stdout:0/733: dwrite d6/d11/d14/d24/f6d [0,4194304] 0 2024-04-23T14:49:51.523 INFO:tasks.workunit.client.0.smithi081.stdout:4/588: getdents d1/d4f/d87 0 2024-04-23T14:49:51.524 INFO:tasks.workunit.client.1.smithi156.stdout:4/272: dwrite d0/f3 [0,4194304] 0 2024-04-23T14:49:51.524 INFO:tasks.workunit.client.1.smithi156.stdout:4/273: write d0/df/f14 [1621218,109218] 0 2024-04-23T14:49:51.526 INFO:tasks.workunit.client.0.smithi081.stdout:8/837: dwrite d3/d11/d48/f111 [0,4194304] 0 2024-04-23T14:49:51.526 INFO:tasks.workunit.client.0.smithi081.stdout:8/838: creat d3/d3c/ddb/df3/f114 x:0 0 0 2024-04-23T14:49:51.527 INFO:tasks.workunit.client.1.smithi156.stdout:6/355: mknod d3/d16/d5c/d6a/c8b 0 2024-04-23T14:49:51.529 INFO:tasks.workunit.client.0.smithi081.stdout:7/525: write d3/d20/f30 [624260,93704] 0 2024-04-23T14:49:51.529 INFO:tasks.workunit.client.0.smithi081.stdout:7/526: creat d3/d21/d41/d7c/fb1 x:0 0 0 2024-04-23T14:49:51.533 INFO:tasks.workunit.client.0.smithi081.stdout:0/734: creat d6/d37/fe4 x:0 0 0 2024-04-23T14:49:51.536 INFO:tasks.workunit.client.0.smithi081.stdout:1/724: dwrite d3/d3d/d41/d5e/d5d/db0/f46 [0,4194304] 0 2024-04-23T14:49:51.537 INFO:tasks.workunit.client.0.smithi081.stdout:6/672: dwrite d1/d51/d7b/f87 [0,4194304] 0 2024-04-23T14:49:51.538 INFO:tasks.workunit.client.0.smithi081.stdout:6/673: write d1/d51/d65/d1c/d6e/da0/da1/dc1/dc9/fd5 [492311,25553] 0 2024-04-23T14:49:51.540 INFO:tasks.workunit.client.0.smithi081.stdout:4/589: unlink d1/f8a 0 2024-04-23T14:49:51.542 INFO:tasks.workunit.client.1.smithi156.stdout:2/276: mknod d4/d13/c65 0 2024-04-23T14:49:51.544 INFO:tasks.workunit.client.1.smithi156.stdout:0/300: symlink d0/d16/l60 0 2024-04-23T14:49:51.545 INFO:tasks.workunit.client.1.smithi156.stdout:0/301: write d0/d4/d11/d3f/d5f/f35 [598339,109622] 0 2024-04-23T14:49:51.545 INFO:tasks.workunit.client.0.smithi081.stdout:5/723: rename d17/d1f/d36 to d17/d18/dff 0 2024-04-23T14:49:51.548 INFO:tasks.workunit.client.1.smithi156.stdout:7/335: link dc/d1d/d48/c5d dc/d1d/d24/c5e 0 2024-04-23T14:49:51.551 INFO:tasks.workunit.client.0.smithi081.stdout:8/839: mknod d3/d11/d48/d7e/de4/df0/c115 0 2024-04-23T14:49:51.552 INFO:tasks.workunit.client.1.smithi156.stdout:2/277: dread d4/d21/d42/f53 [0,4194304] 0 2024-04-23T14:49:51.553 INFO:tasks.workunit.client.1.smithi156.stdout:3/276: sync 2024-04-23T14:49:51.553 INFO:tasks.workunit.client.1.smithi156.stdout:3/277: rename d4/db to d4/db/dd/d51 22 2024-04-23T14:49:51.553 INFO:tasks.workunit.client.1.smithi156.stdout:3/278: write d4/db/dd/d1d/d1e/f12 [1313848,66367] 0 2024-04-23T14:49:51.553 INFO:tasks.workunit.client.1.smithi156.stdout:3/279: creat d4/db/dd/d1d/d1e/d42/f52 x:0 0 0 2024-04-23T14:49:51.554 INFO:tasks.workunit.client.0.smithi081.stdout:6/674: dread d1/d51/d65/d8/d2e/d59/f94 [0,4194304] 0 2024-04-23T14:49:51.557 INFO:tasks.workunit.client.1.smithi156.stdout:5/345: dwrite d1/d3/d20/f5f [0,4194304] 0 2024-04-23T14:49:51.558 INFO:tasks.workunit.client.0.smithi081.stdout:3/575: dwrite d4/d41/f66 [0,4194304] 0 2024-04-23T14:49:51.559 INFO:tasks.workunit.client.0.smithi081.stdout:0/735: symlink d6/d11/db0/le5 0 2024-04-23T14:49:51.563 INFO:tasks.workunit.client.1.smithi156.stdout:1/344: truncate db/d25/d30/d38/f4d 743493 0 2024-04-23T14:49:51.564 INFO:tasks.workunit.client.0.smithi081.stdout:1/725: mkdir d3/d3d/d41/d5e/da0/dec 0 2024-04-23T14:49:51.565 INFO:tasks.workunit.client.1.smithi156.stdout:4/274: mknod d0/d8/c5b 0 2024-04-23T14:49:51.567 INFO:tasks.workunit.client.1.smithi156.stdout:6/356: rmdir d3/d16 39 2024-04-23T14:49:51.569 INFO:tasks.workunit.client.1.smithi156.stdout:2/278: dread d4/d13/d19/f1e [0,4194304] 0 2024-04-23T14:49:51.569 INFO:tasks.workunit.client.1.smithi156.stdout:2/279: truncate d4/d26/d3c/f46 1991209 0 2024-04-23T14:49:51.569 INFO:tasks.workunit.client.1.smithi156.stdout:2/280: read d4/d13/f14 [2394607,114635] 0 2024-04-23T14:49:51.570 INFO:tasks.workunit.client.0.smithi081.stdout:5/724: mknod d17/d3c/d55/d64/c100 0 2024-04-23T14:49:51.571 INFO:tasks.workunit.client.1.smithi156.stdout:7/336: symlink dc/l5f 0 2024-04-23T14:49:51.574 INFO:tasks.workunit.client.1.smithi156.stdout:3/280: read d4/db/dd/d1d/f3b [1850717,88767] 0 2024-04-23T14:49:51.574 INFO:tasks.workunit.client.1.smithi156.stdout:3/281: chown d4/db/dd/d1d/d1e/ce 29 1 2024-04-23T14:49:51.574 INFO:tasks.workunit.client.1.smithi156.stdout:3/282: getdents d4/db/dd/d20/d3e 0 2024-04-23T14:49:51.574 INFO:tasks.workunit.client.0.smithi081.stdout:8/840: rename d3/d11/d3e/lb7 to d3/d3c/ddb/df3/d108/l116 0 2024-04-23T14:49:51.580 INFO:tasks.workunit.client.0.smithi081.stdout:7/527: unlink d3/d21/d31/c28 0 2024-04-23T14:49:51.580 INFO:tasks.workunit.client.1.smithi156.stdout:5/346: write d1/d3/f4b [1452161,102840] 0 2024-04-23T14:49:51.581 INFO:tasks.workunit.client.1.smithi156.stdout:4/275: symlink d0/d30/l5c 0 2024-04-23T14:49:51.584 INFO:tasks.workunit.client.1.smithi156.stdout:6/357: creat d3/da/d1d/d27/d63/f8c x:0 0 0 2024-04-23T14:49:51.587 INFO:tasks.workunit.client.1.smithi156.stdout:2/281: rename d4/d21/d2f/l41 to d4/d13/d19/d58/l66 0 2024-04-23T14:49:51.587 INFO:tasks.workunit.client.1.smithi156.stdout:2/282: chown d4/d21/f31 5881 1 2024-04-23T14:49:51.591 INFO:tasks.workunit.client.1.smithi156.stdout:1/345: write db/d25/d30/d38/f4d [1480457,44502] 0 2024-04-23T14:49:51.592 INFO:tasks.workunit.client.1.smithi156.stdout:8/284: sync 2024-04-23T14:49:51.593 INFO:tasks.workunit.client.1.smithi156.stdout:8/285: dread - d5/d9/d10/d1d/f51 zero size 2024-04-23T14:49:51.598 INFO:tasks.workunit.client.1.smithi156.stdout:5/347: mkdir d1/d11/d18/d19/d74 0 2024-04-23T14:49:51.598 INFO:tasks.workunit.client.1.smithi156.stdout:5/348: write d1/d3/fa [2054014,56143] 0 2024-04-23T14:49:51.598 INFO:tasks.workunit.client.1.smithi156.stdout:9/243: sync 2024-04-23T14:49:51.599 INFO:tasks.workunit.client.0.smithi081.stdout:0/736: unlink d6/d37/d85/c9f 0 2024-04-23T14:49:51.602 INFO:tasks.workunit.client.1.smithi156.stdout:7/337: write dc/d46/f31 [346977,105506] 0 2024-04-23T14:49:51.602 INFO:tasks.workunit.client.1.smithi156.stdout:7/338: write dc/d46/f44 [1163207,59580] 0 2024-04-23T14:49:51.602 INFO:tasks.workunit.client.1.smithi156.stdout:2/283: rename d4/d13/d19/d4c/d5c/f57 to d4/d21/f67 0 2024-04-23T14:49:51.606 INFO:tasks.workunit.client.0.smithi081.stdout:1/726: link d3/d3d/d41/d5e/d17/d25/f74 d3/d3d/d41/d5e/fed 0 2024-04-23T14:49:51.610 INFO:tasks.workunit.client.0.smithi081.stdout:5/725: unlink d17/d18/c29 0 2024-04-23T14:49:51.611 INFO:tasks.workunit.client.1.smithi156.stdout:7/339: dread dc/f1c [0,4194304] 0 2024-04-23T14:49:51.613 INFO:tasks.workunit.client.1.smithi156.stdout:4/276: rmdir d0/df/d21/d36 39 2024-04-23T14:49:51.613 INFO:tasks.workunit.client.1.smithi156.stdout:4/277: chown d0/d8/d54 459 1 2024-04-23T14:49:51.613 INFO:tasks.workunit.client.1.smithi156.stdout:4/278: getdents d0/df/d3a 0 2024-04-23T14:49:51.621 INFO:tasks.workunit.client.1.smithi156.stdout:5/349: unlink d1/d3/d20/d3e/f61 0 2024-04-23T14:49:51.625 INFO:tasks.workunit.client.1.smithi156.stdout:9/244: link d1/d2/d4/d17/f2c d1/f51 0 2024-04-23T14:49:51.625 INFO:tasks.workunit.client.1.smithi156.stdout:9/245: write d1/d2/d4/dc/f41 [1003728,44545] 0 2024-04-23T14:49:51.626 INFO:tasks.workunit.client.0.smithi081.stdout:8/841: dwrite d3/d11/d3e/d63/f94 [0,4194304] 0 2024-04-23T14:49:51.626 INFO:tasks.workunit.client.0.smithi081.stdout:8/842: chown d3/d11/d4f/ce6 929851 1 2024-04-23T14:49:51.627 INFO:tasks.workunit.client.0.smithi081.stdout:0/737: read d6/d11/d14/d41/d5b/d3f/d44/d76/fc2 [2841284,93357] 0 2024-04-23T14:49:51.627 INFO:tasks.workunit.client.0.smithi081.stdout:3/576: dwrite d4/dc/d50/f4e [0,4194304] 0 2024-04-23T14:49:51.629 INFO:tasks.workunit.client.0.smithi081.stdout:5/726: read d17/d3d/fa1 [445840,57432] 0 2024-04-23T14:49:51.632 INFO:tasks.workunit.client.1.smithi156.stdout:1/346: getdents db/d1f/d2d 0 2024-04-23T14:49:51.634 INFO:tasks.workunit.client.0.smithi081.stdout:6/675: getdents d1/d51/d65/d1c 0 2024-04-23T14:49:51.635 INFO:tasks.workunit.client.0.smithi081.stdout:6/676: write d1/d51/d65/d78/fc8 [573890,65494] 0 2024-04-23T14:49:51.637 INFO:tasks.workunit.client.0.smithi081.stdout:7/528: symlink d3/d97/lb2 0 2024-04-23T14:49:51.637 INFO:tasks.workunit.client.0.smithi081.stdout:7/529: write d3/d21/d31/d33/d4b/f57 [4846343,61872] 0 2024-04-23T14:49:51.637 INFO:tasks.workunit.client.0.smithi081.stdout:7/530: chown d3/d21/f79 3 1 2024-04-23T14:49:51.641 INFO:tasks.workunit.client.0.smithi081.stdout:1/727: creat d3/d3d/d90/de0/fee x:0 0 0 2024-04-23T14:49:51.642 INFO:tasks.workunit.client.0.smithi081.stdout:3/577: dread d4/dc/f52 [0,4194304] 0 2024-04-23T14:49:51.643 INFO:tasks.workunit.client.1.smithi156.stdout:6/358: write d3/d16/f3c [4577283,65724] 0 2024-04-23T14:49:51.643 INFO:tasks.workunit.client.1.smithi156.stdout:6/359: dread - d3/d16/d5c/f86 zero size 2024-04-23T14:49:51.643 INFO:tasks.workunit.client.1.smithi156.stdout:0/302: dwrite d0/d16/d3a/d2b/d44/d4a/f57 [0,4194304] 0 2024-04-23T14:49:51.643 INFO:tasks.workunit.client.1.smithi156.stdout:6/360: write d3/da/f28 [2035391,67376] 0 2024-04-23T14:49:51.643 INFO:tasks.workunit.client.1.smithi156.stdout:7/340: mknod dc/d2c/c60 0 2024-04-23T14:49:51.644 INFO:tasks.workunit.client.1.smithi156.stdout:7/341: write dc/d2c/f50 [340589,33222] 0 2024-04-23T14:49:51.644 INFO:tasks.workunit.client.0.smithi081.stdout:8/843: mkdir d3/d11/d86/d88/da7/d117 0 2024-04-23T14:49:51.647 INFO:tasks.workunit.client.1.smithi156.stdout:2/284: dread d4/f17 [0,4194304] 0 2024-04-23T14:49:51.647 INFO:tasks.workunit.client.1.smithi156.stdout:2/285: readlink d4/d21/d2f/l56 0 2024-04-23T14:49:51.650 INFO:tasks.workunit.client.0.smithi081.stdout:0/738: truncate d6/d11/d14/d41/d5b/d3f/d44/f8f 2756593 0 2024-04-23T14:49:51.650 INFO:tasks.workunit.client.0.smithi081.stdout:0/739: creat d6/d11/d14/d24/d6b/fe6 x:0 0 0 2024-04-23T14:49:51.650 INFO:tasks.workunit.client.0.smithi081.stdout:0/740: truncate d6/d11/d14/d41/d5b/d59/d68/f74 4578236 0 2024-04-23T14:49:51.650 INFO:tasks.workunit.client.0.smithi081.stdout:0/741: stat d6/d11/d14/d41/d5b/d3f/d44/d78/d84 0 2024-04-23T14:49:51.650 INFO:tasks.workunit.client.0.smithi081.stdout:0/742: read - d6/d11/d14/d41/fd1 zero size 2024-04-23T14:49:51.654 INFO:tasks.workunit.client.0.smithi081.stdout:6/677: mknod d1/d51/d65/d8/d2e/d59/d80/d90/cf1 0 2024-04-23T14:49:51.654 INFO:tasks.workunit.client.0.smithi081.stdout:6/678: chown d1/l38 274842 1 2024-04-23T14:49:51.657 INFO:tasks.workunit.client.0.smithi081.stdout:7/531: symlink d3/d11/d56/d7f/lb3 0 2024-04-23T14:49:51.659 INFO:tasks.workunit.client.0.smithi081.stdout:1/728: symlink d3/d3d/d7a/lef 0 2024-04-23T14:49:51.664 INFO:tasks.workunit.client.0.smithi081.stdout:1/729: read f0 [1024868,121433] 0 2024-04-23T14:49:51.665 INFO:tasks.workunit.client.1.smithi156.stdout:8/286: dwrite d5/d9/d5a/f54 [0,4194304] 0 2024-04-23T14:49:51.665 INFO:tasks.workunit.client.1.smithi156.stdout:8/287: chown d5/d9/f32 189349379 1 2024-04-23T14:49:51.665 INFO:tasks.workunit.client.0.smithi081.stdout:3/578: unlink d4/d7/cb 0 2024-04-23T14:49:51.665 INFO:tasks.workunit.client.0.smithi081.stdout:3/579: fsync d4/dc/d10/d47/f6d 0 2024-04-23T14:49:51.665 INFO:tasks.workunit.client.0.smithi081.stdout:3/580: dread - d4/d7/d49/d51/d84/faa zero size 2024-04-23T14:49:51.666 INFO:tasks.workunit.client.1.smithi156.stdout:0/303: mknod d0/d4/d11/d3f/c61 0 2024-04-23T14:49:51.667 INFO:tasks.workunit.client.0.smithi081.stdout:8/844: mknod d3/d11/d86/d88/da7/c118 0 2024-04-23T14:49:51.668 INFO:tasks.workunit.client.0.smithi081.stdout:0/743: write d6/d11/d14/d41/f43 [3043277,113941] 0 2024-04-23T14:49:51.670 INFO:tasks.workunit.client.1.smithi156.stdout:5/350: dwrite d1/d3/f4b [4194304,4194304] 0 2024-04-23T14:49:51.672 INFO:tasks.workunit.client.1.smithi156.stdout:8/288: dread d5/d9/d10/d1d/d4c/f42 [0,4194304] 0 2024-04-23T14:49:51.672 INFO:tasks.workunit.client.1.smithi156.stdout:1/347: rename db/d1f/d34/c42 to db/d15/c69 0 2024-04-23T14:49:51.673 INFO:tasks.workunit.client.0.smithi081.stdout:5/727: getdents d17/d1f/d42/d9b/d9e/da3 0 2024-04-23T14:49:51.675 INFO:tasks.workunit.client.1.smithi156.stdout:2/286: creat d4/d13/d19/d4c/f68 x:0 0 0 2024-04-23T14:49:51.675 INFO:tasks.workunit.client.1.smithi156.stdout:2/287: dread - d4/f62 zero size 2024-04-23T14:49:51.675 INFO:tasks.workunit.client.0.smithi081.stdout:6/679: mknod d1/d51/d65/d1c/d6e/da0/dd2/cf2 0 2024-04-23T14:49:51.677 INFO:tasks.workunit.client.0.smithi081.stdout:7/532: symlink d3/d21/d31/d33/d4b/d71/lb4 0 2024-04-23T14:49:51.678 INFO:tasks.workunit.client.0.smithi081.stdout:3/581: dread d4/dc/d50/d9a/f9b [0,4194304] 0 2024-04-23T14:49:51.678 INFO:tasks.workunit.client.0.smithi081.stdout:3/582: truncate d4/d7/df/f5e 1683859 0 2024-04-23T14:49:51.680 INFO:tasks.workunit.client.1.smithi156.stdout:0/304: mknod d0/d16/d3a/d1e/c62 0 2024-04-23T14:49:51.681 INFO:tasks.workunit.client.0.smithi081.stdout:0/744: rename d6/d11/d14/d24/la3 to d6/d11/d14/d41/d5b/d59/db6/le7 0 2024-04-23T14:49:51.681 INFO:tasks.workunit.client.0.smithi081.stdout:6/680: rename d1/d2 to d1/d2/d5a/df3 22 2024-04-23T14:49:51.681 INFO:tasks.workunit.client.0.smithi081.stdout:0/745: creat d6/d11/d14/db8/fe8 x:0 0 0 2024-04-23T14:49:51.683 INFO:tasks.workunit.client.1.smithi156.stdout:6/361: dread d3/da/f1a [4194304,4194304] 0 2024-04-23T14:49:51.683 INFO:tasks.workunit.client.1.smithi156.stdout:6/362: write d3/f6b [667547,40757] 0 2024-04-23T14:49:51.686 INFO:tasks.workunit.client.0.smithi081.stdout:7/533: symlink d3/d97/lb5 0 2024-04-23T14:49:51.686 INFO:tasks.workunit.client.0.smithi081.stdout:7/534: fsync f2 0 2024-04-23T14:49:51.686 INFO:tasks.workunit.client.1.smithi156.stdout:6/363: truncate d3/da/d1d/f67 382755 0 2024-04-23T14:49:51.687 INFO:tasks.workunit.client.1.smithi156.stdout:8/289: mkdir d5/d9/d36/d60 0 2024-04-23T14:49:51.687 INFO:tasks.workunit.client.1.smithi156.stdout:5/351: mkdir d1/d11/d18/d52/d75 0 2024-04-23T14:49:51.687 INFO:tasks.workunit.client.0.smithi081.stdout:3/583: symlink d4/d7/d7f/d91/lb8 0 2024-04-23T14:49:51.688 INFO:tasks.workunit.client.1.smithi156.stdout:2/288: symlink d4/d13/d19/d4c/d5c/l69 0 2024-04-23T14:49:51.694 INFO:tasks.workunit.client.1.smithi156.stdout:0/305: truncate d0/d4/f25 2380633 0 2024-04-23T14:49:51.696 INFO:tasks.workunit.client.1.smithi156.stdout:5/352: mknod d1/d3/d43/d4e/c76 0 2024-04-23T14:49:51.696 INFO:tasks.workunit.client.1.smithi156.stdout:5/353: dread - d1/d3/d20/d3e/f46 zero size 2024-04-23T14:49:51.703 INFO:tasks.workunit.client.1.smithi156.stdout:6/364: dread d3/fd [0,4194304] 0 2024-04-23T14:49:51.703 INFO:tasks.workunit.client.1.smithi156.stdout:6/365: chown d3/f6b 9252370 1 2024-04-23T14:49:51.703 INFO:tasks.workunit.client.1.smithi156.stdout:6/366: dread - d3/d16/d5c/f86 zero size 2024-04-23T14:49:51.703 INFO:tasks.workunit.client.1.smithi156.stdout:6/367: dread - d3/d16/d46/f60 zero size 2024-04-23T14:49:51.706 INFO:tasks.workunit.client.1.smithi156.stdout:0/306: dread d0/d4/d22/f34 [0,4194304] 0 2024-04-23T14:49:51.706 INFO:tasks.workunit.client.1.smithi156.stdout:0/307: chown d0/d16/d3a/d2b/d44/d4a/f57 408 1 2024-04-23T14:49:51.707 INFO:tasks.workunit.client.1.smithi156.stdout:5/354: creat d1/d11/d27/f77 x:0 0 0 2024-04-23T14:49:51.707 INFO:tasks.workunit.client.1.smithi156.stdout:2/289: symlink d4/d13/d19/d58/l6a 0 2024-04-23T14:49:51.707 INFO:tasks.workunit.client.1.smithi156.stdout:5/355: chown d1/d3/l7 19 1 2024-04-23T14:49:51.707 INFO:tasks.workunit.client.1.smithi156.stdout:1/348: dread db/f27 [0,4194304] 0 2024-04-23T14:49:51.718 INFO:tasks.workunit.client.0.smithi081.stdout:3/584: write d4/d7/df/f72 [3214138,7748] 0 2024-04-23T14:49:51.725 INFO:tasks.workunit.client.0.smithi081.stdout:7/535: rmdir d3/d21/d31/d50/d5a 39 2024-04-23T14:49:51.725 INFO:tasks.workunit.client.1.smithi156.stdout:8/290: write d5/d9/d10/f33 [1459143,105876] 0 2024-04-23T14:49:51.725 INFO:tasks.workunit.client.1.smithi156.stdout:8/291: creat d5/d39/f61 x:0 0 0 2024-04-23T14:49:51.725 INFO:tasks.workunit.client.1.smithi156.stdout:6/368: link d3/d16/d46/d2b/d3b/f69 d3/f8d 0 2024-04-23T14:49:51.727 INFO:tasks.workunit.client.1.smithi156.stdout:2/290: symlink d4/d13/l6b 0 2024-04-23T14:49:51.727 INFO:tasks.workunit.client.1.smithi156.stdout:2/291: creat d4/d13/d19/d4c/f6c x:0 0 0 2024-04-23T14:49:51.728 INFO:tasks.workunit.client.1.smithi156.stdout:1/349: truncate db/d25/d30/d38/f4d 1092389 0 2024-04-23T14:49:51.733 INFO:tasks.workunit.client.0.smithi081.stdout:3/585: symlink d4/dc/d10/d5a/lb9 0 2024-04-23T14:49:51.735 INFO:tasks.workunit.client.0.smithi081.stdout:7/536: mknod d3/d11/d2c/cb6 0 2024-04-23T14:49:51.746 INFO:tasks.workunit.client.0.smithi081.stdout:7/537: mkdir d3/db7 0 2024-04-23T14:49:51.747 INFO:tasks.workunit.client.0.smithi081.stdout:5/728: dwrite d17/d4a/fb9 [0,4194304] 0 2024-04-23T14:49:51.747 INFO:tasks.workunit.client.1.smithi156.stdout:2/292: mknod d4/d13/d19/d4c/d5c/c6d 0 2024-04-23T14:49:51.748 INFO:tasks.workunit.client.1.smithi156.stdout:2/293: creat d4/d21/d42/f6e x:0 0 0 2024-04-23T14:49:51.762 INFO:tasks.workunit.client.0.smithi081.stdout:7/538: symlink d3/d21/lb8 0 2024-04-23T14:49:51.762 INFO:tasks.workunit.client.0.smithi081.stdout:7/539: truncate d3/d11/d56/f72 1352542 0 2024-04-23T14:49:51.763 INFO:tasks.workunit.client.1.smithi156.stdout:9/246: dwrite d1/d2/d4/d17/d1f/f37 [0,4194304] 0 2024-04-23T14:49:51.765 INFO:tasks.workunit.client.0.smithi081.stdout:3/586: write d4/d7/d7f/d91/fb7 [1228555,25977] 0 2024-04-23T14:49:51.765 INFO:tasks.workunit.client.0.smithi081.stdout:3/587: chown d4/d7/d7f/d85/l8d 118203013 1 2024-04-23T14:49:51.766 INFO:tasks.workunit.client.1.smithi156.stdout:2/294: symlink d4/d13/d19/d4c/d5c/l6f 0 2024-04-23T14:49:51.767 INFO:tasks.workunit.client.0.smithi081.stdout:7/540: rmdir d3/db7 0 2024-04-23T14:49:51.769 INFO:tasks.workunit.client.0.smithi081.stdout:0/746: dwrite d6/d69/fa0 [4194304,4194304] 0 2024-04-23T14:49:51.769 INFO:tasks.workunit.client.0.smithi081.stdout:0/747: chown d6/f10 10 1 2024-04-23T14:49:51.769 INFO:tasks.workunit.client.0.smithi081.stdout:0/748: dread - d6/d11/d14/d41/d5b/d3f/d44/fd8 zero size 2024-04-23T14:49:51.769 INFO:tasks.workunit.client.0.smithi081.stdout:0/749: fdatasync d6/d37/d67/f92 0 2024-04-23T14:49:51.769 INFO:tasks.workunit.client.0.smithi081.stdout:0/750: chown d6/d11/d14/d41/d5b/d59/d8e/f93 2 1 2024-04-23T14:49:51.772 INFO:tasks.workunit.client.1.smithi156.stdout:9/247: mknod d1/d2/d23/d2d/c52 0 2024-04-23T14:49:51.775 INFO:tasks.workunit.client.0.smithi081.stdout:3/588: readlink d4/d7/l13 0 2024-04-23T14:49:51.775 INFO:tasks.workunit.client.0.smithi081.stdout:3/589: chown d4/dc/d50 1734 1 2024-04-23T14:49:51.776 INFO:tasks.workunit.client.1.smithi156.stdout:9/248: symlink d1/d2/d4/d19/d2a/l53 0 2024-04-23T14:49:51.776 INFO:tasks.workunit.client.1.smithi156.stdout:9/249: write d1/d2/d4/f8 [564168,108185] 0 2024-04-23T14:49:51.777 INFO:tasks.workunit.client.1.smithi156.stdout:9/250: chown d1/cb 3821 1 2024-04-23T14:49:51.779 INFO:tasks.workunit.client.0.smithi081.stdout:7/541: symlink d3/d11/d56/d7f/lb9 0 2024-04-23T14:49:51.782 INFO:tasks.workunit.client.0.smithi081.stdout:7/542: unlink d3/d21/f4a 0 2024-04-23T14:49:51.783 INFO:tasks.workunit.client.1.smithi156.stdout:2/295: write d4/d21/d42/f55 [8219731,61198] 0 2024-04-23T14:49:51.783 INFO:tasks.workunit.client.1.smithi156.stdout:8/292: dwrite d5/d9/d10/d1d/d4c/f42 [0,4194304] 0 2024-04-23T14:49:51.784 INFO:tasks.workunit.client.1.smithi156.stdout:8/293: dread - d5/d9/d10/d1d/d4c/f5b zero size 2024-04-23T14:49:51.788 INFO:tasks.workunit.client.0.smithi081.stdout:3/590: unlink d4/d7/d49/d51/d84/faa 0 2024-04-23T14:49:51.790 INFO:tasks.workunit.client.1.smithi156.stdout:9/251: creat d1/d2/d4/d17/f54 x:0 0 0 2024-04-23T14:49:51.796 INFO:tasks.workunit.client.0.smithi081.stdout:1/730: dwrite d3/d3d/f13 [0,4194304] 0 2024-04-23T14:49:51.796 INFO:tasks.workunit.client.0.smithi081.stdout:1/731: chown d3/d3d/d6f/c60 0 1 2024-04-23T14:49:51.796 INFO:tasks.workunit.client.0.smithi081.stdout:3/591: fdatasync d4/d7/d32/f94 0 2024-04-23T14:49:51.797 INFO:tasks.workunit.client.1.smithi156.stdout:5/356: dwrite d1/d11/d18/d19/f66 [0,4194304] 0 2024-04-23T14:49:51.797 INFO:tasks.workunit.client.1.smithi156.stdout:2/296: mkdir d4/d13/d19/d4c/d5c/d70 0 2024-04-23T14:49:51.797 INFO:tasks.workunit.client.1.smithi156.stdout:2/297: fdatasync d4/d21/f3f 0 2024-04-23T14:49:51.797 INFO:tasks.workunit.client.1.smithi156.stdout:2/298: write d4/d13/f4b [1214671,58313] 0 2024-04-23T14:49:51.798 INFO:tasks.workunit.client.0.smithi081.stdout:7/543: getdents d3/d11/d2c/d75 0 2024-04-23T14:49:51.798 INFO:tasks.workunit.client.0.smithi081.stdout:7/544: creat d3/d21/d31/d63/fba x:0 0 0 2024-04-23T14:49:51.802 INFO:tasks.workunit.client.1.smithi156.stdout:3/283: sync 2024-04-23T14:49:51.802 INFO:tasks.workunit.client.1.smithi156.stdout:8/294: mkdir d5/d9/d36/d60/d62 0 2024-04-23T14:49:51.802 INFO:tasks.workunit.client.1.smithi156.stdout:8/295: creat d5/d39/f63 x:0 0 0 2024-04-23T14:49:51.804 INFO:tasks.workunit.client.0.smithi081.stdout:3/592: link d4/dc/l61 d4/d7/df/d30/lba 0 2024-04-23T14:49:51.804 INFO:tasks.workunit.client.0.smithi081.stdout:3/593: chown d4/f5b 10 1 2024-04-23T14:49:51.804 INFO:tasks.workunit.client.0.smithi081.stdout:3/594: stat d4/d7/d7f/d85/d9d/dac 0 2024-04-23T14:49:51.804 INFO:tasks.workunit.client.0.smithi081.stdout:3/595: truncate d4/d7/d49/d51/f62 375378 0 2024-04-23T14:49:51.805 INFO:tasks.workunit.client.0.smithi081.stdout:3/596: fsync d4/d7/d32/d6a/f7e 0 2024-04-23T14:49:51.805 INFO:tasks.workunit.client.0.smithi081.stdout:7/545: getdents d3/d21/d41 0 2024-04-23T14:49:51.808 INFO:tasks.workunit.client.1.smithi156.stdout:5/357: mknod d1/d3/d24/c78 0 2024-04-23T14:49:51.809 INFO:tasks.workunit.client.1.smithi156.stdout:3/284: unlink d4/db/dd/d1d/d1e/d42/f47 0 2024-04-23T14:49:51.809 INFO:tasks.workunit.client.0.smithi081.stdout:3/597: truncate d4/dc/f45 4426285 0 2024-04-23T14:49:51.810 INFO:tasks.workunit.client.0.smithi081.stdout:3/598: write d4/d7/d32/f33 [5068880,65174] 0 2024-04-23T14:49:51.810 INFO:tasks.workunit.client.1.smithi156.stdout:0/308: dwrite d0/d4/d11/d3f/d5f/f1f [0,4194304] 0 2024-04-23T14:49:51.811 INFO:tasks.workunit.client.1.smithi156.stdout:0/309: dread - d0/d16/d3a/d2b/d44/d4a/f4c zero size 2024-04-23T14:49:51.811 INFO:tasks.workunit.client.1.smithi156.stdout:0/310: dread - d0/f46 zero size 2024-04-23T14:49:51.811 INFO:tasks.workunit.client.1.smithi156.stdout:0/311: creat d0/d16/d3a/d2b/f63 x:0 0 0 2024-04-23T14:49:51.811 INFO:tasks.workunit.client.1.smithi156.stdout:2/299: symlink d4/l71 0 2024-04-23T14:49:51.811 INFO:tasks.workunit.client.1.smithi156.stdout:2/300: chown d4/d21/d42 7994204 1 2024-04-23T14:49:51.811 INFO:tasks.workunit.client.1.smithi156.stdout:5/358: getdents d1/d3 0 2024-04-23T14:49:51.813 INFO:tasks.workunit.client.1.smithi156.stdout:3/285: rename d4/db/dd/d20/l2d to d4/db/l53 0 2024-04-23T14:49:51.813 INFO:tasks.workunit.client.0.smithi081.stdout:7/546: rmdir d3/d11/d56/d7f 39 2024-04-23T14:49:51.816 INFO:tasks.workunit.client.1.smithi156.stdout:0/312: symlink d0/d16/d3a/d2b/d44/l64 0 2024-04-23T14:49:51.819 INFO:tasks.workunit.client.0.smithi081.stdout:3/599: creat d4/d7/df/d30/fbb x:0 0 0 2024-04-23T14:49:51.819 INFO:tasks.workunit.client.0.smithi081.stdout:3/600: read - d4/d7/df/f9f zero size 2024-04-23T14:49:51.819 INFO:tasks.workunit.client.1.smithi156.stdout:5/359: mknod d1/d11/d18/d52/d75/c79 0 2024-04-23T14:49:51.823 INFO:tasks.workunit.client.1.smithi156.stdout:3/286: mknod d4/db/c54 0 2024-04-23T14:49:51.823 INFO:tasks.workunit.client.1.smithi156.stdout:3/287: dread - d4/db/dd/d1d/f49 zero size 2024-04-23T14:49:51.824 INFO:tasks.workunit.client.0.smithi081.stdout:7/547: mkdir d3/d21/d41/dbb 0 2024-04-23T14:49:51.827 INFO:tasks.workunit.client.1.smithi156.stdout:5/360: rename d1/d3/d24/f3d to d1/d3/d43/d4e/f7a 0 2024-04-23T14:49:51.827 INFO:tasks.workunit.client.1.smithi156.stdout:5/361: stat d1/d3/f5 0 2024-04-23T14:49:51.827 INFO:tasks.workunit.client.1.smithi156.stdout:5/362: stat d1/d3/d20/l35 0 2024-04-23T14:49:51.829 INFO:tasks.workunit.client.0.smithi081.stdout:8/845: dwrite d3/d11/d34/dab/ff7 [0,4194304] 0 2024-04-23T14:49:51.831 INFO:tasks.workunit.client.0.smithi081.stdout:7/548: mkdir d3/d21/d31/d33/dbc 0 2024-04-23T14:49:51.832 INFO:tasks.workunit.client.0.smithi081.stdout:7/549: creat d3/d97/fbd x:0 0 0 2024-04-23T14:49:51.837 INFO:tasks.workunit.client.1.smithi156.stdout:6/369: dwrite d3/d16/f2f [0,4194304] 0 2024-04-23T14:49:51.841 INFO:tasks.workunit.client.1.smithi156.stdout:1/350: dwrite db/d25/f64 [0,4194304] 0 2024-04-23T14:49:51.850 INFO:tasks.workunit.client.1.smithi156.stdout:5/363: link d1/d3/d20/d3e/l71 d1/d3/d43/l7b 0 2024-04-23T14:49:51.850 INFO:tasks.workunit.client.1.smithi156.stdout:5/364: chown d1/d11/f4d 28679 1 2024-04-23T14:49:51.853 INFO:tasks.workunit.client.0.smithi081.stdout:8/846: write d3/d11/d34/f72 [295622,5395] 0 2024-04-23T14:49:51.869 INFO:tasks.workunit.client.1.smithi156.stdout:2/301: dread d4/f24 [0,4194304] 0 2024-04-23T14:49:51.869 INFO:tasks.workunit.client.1.smithi156.stdout:2/302: readlink d4/d13/d19/d4c/d5c/l69 0 2024-04-23T14:49:51.870 INFO:tasks.workunit.client.1.smithi156.stdout:6/370: read d3/f4e [3083206,118629] 0 2024-04-23T14:49:51.870 INFO:tasks.workunit.client.1.smithi156.stdout:6/371: chown d3/da/d74 448400742 1 2024-04-23T14:49:51.870 INFO:tasks.workunit.client.1.smithi156.stdout:6/372: truncate d3/d16/d1e/f3d 923845 0 2024-04-23T14:49:51.873 INFO:tasks.workunit.client.1.smithi156.stdout:3/288: dread d4/db/dd/d1d/d1e/ff [0,4194304] 0 2024-04-23T14:49:51.873 INFO:tasks.workunit.client.1.smithi156.stdout:1/351: rename db/d1f/d34/l5b to db/d1f/l6a 0 2024-04-23T14:49:51.876 INFO:tasks.workunit.client.0.smithi081.stdout:8/847: symlink d3/d11/d34/d8b/l119 0 2024-04-23T14:49:51.877 INFO:tasks.workunit.client.0.smithi081.stdout:8/848: chown d3/d1a/f53 682 1 2024-04-23T14:49:51.877 INFO:tasks.workunit.client.0.smithi081.stdout:5/729: dwrite d17/d4a/fbd [0,4194304] 0 2024-04-23T14:49:51.878 INFO:tasks.workunit.client.1.smithi156.stdout:5/365: creat d1/f7c x:0 0 0 2024-04-23T14:49:51.879 INFO:tasks.workunit.client.1.smithi156.stdout:2/303: creat d4/d13/d19/d4c/d5c/d70/f72 x:0 0 0 2024-04-23T14:49:51.880 INFO:tasks.workunit.client.1.smithi156.stdout:6/373: truncate d3/f4e 605386 0 2024-04-23T14:49:51.881 INFO:tasks.workunit.client.1.smithi156.stdout:3/289: unlink d4/db/dd/d1d/d1e/ce 0 2024-04-23T14:49:51.881 INFO:tasks.workunit.client.1.smithi156.stdout:3/290: stat d4/db/dd/d1d/d1e/d2b 0 2024-04-23T14:49:51.881 INFO:tasks.workunit.client.1.smithi156.stdout:3/291: dread - d4/db/dd/d1d/f49 zero size 2024-04-23T14:49:51.884 INFO:tasks.workunit.client.0.smithi081.stdout:8/849: creat d3/dc6/f11a x:0 0 0 2024-04-23T14:49:51.885 INFO:tasks.workunit.client.1.smithi156.stdout:1/352: mkdir db/d25/d6b 0 2024-04-23T14:49:51.886 INFO:tasks.workunit.client.0.smithi081.stdout:5/730: creat d17/d37/d4e/f101 x:0 0 0 2024-04-23T14:49:51.886 INFO:tasks.workunit.client.0.smithi081.stdout:5/731: fsync d17/d18/dff/fc6 0 2024-04-23T14:49:51.887 INFO:tasks.workunit.client.1.smithi156.stdout:0/313: dwrite d0/d16/d3a/d2a/d1d/d2d/f41 [4194304,4194304] 0 2024-04-23T14:49:51.888 INFO:tasks.workunit.client.1.smithi156.stdout:8/296: dwrite d5/d9/d10/f34 [0,4194304] 0 2024-04-23T14:49:51.889 INFO:tasks.workunit.client.1.smithi156.stdout:5/366: rename d1/d3/d20/f5f to d1/d17/f7d 0 2024-04-23T14:49:51.889 INFO:tasks.workunit.client.1.smithi156.stdout:5/367: write d1/d11/d18/f28 [1102493,77314] 0 2024-04-23T14:49:51.890 INFO:tasks.workunit.client.0.smithi081.stdout:0/751: dwrite d6/d11/d14/d41/d5b/d59/fbc [0,4194304] 0 2024-04-23T14:49:51.890 INFO:tasks.workunit.client.0.smithi081.stdout:0/752: dread - d6/d37/fe4 zero size 2024-04-23T14:49:51.890 INFO:tasks.workunit.client.0.smithi081.stdout:3/601: dwrite d4/d41/f67 [0,4194304] 0 2024-04-23T14:49:51.890 INFO:tasks.workunit.client.0.smithi081.stdout:1/732: dwrite d3/d3d/d41/d5e/d17/d25/f4d [0,4194304] 0 2024-04-23T14:49:51.891 INFO:tasks.workunit.client.1.smithi156.stdout:2/304: mknod d4/d21/d42/c73 0 2024-04-23T14:49:51.896 INFO:tasks.workunit.client.0.smithi081.stdout:5/732: creat d17/d1f/d42/f102 x:0 0 0 2024-04-23T14:49:51.897 INFO:tasks.workunit.client.1.smithi156.stdout:3/292: creat d4/f55 x:0 0 0 2024-04-23T14:49:51.897 INFO:tasks.workunit.client.1.smithi156.stdout:3/293: readlink d4/db/dd/d1d/l33 0 2024-04-23T14:49:51.909 INFO:tasks.workunit.client.0.smithi081.stdout:8/850: write d3/d11/d3e/d63/f75 [2555794,114318] 0 2024-04-23T14:49:51.909 INFO:tasks.workunit.client.0.smithi081.stdout:3/602: truncate d4/dc/d10/d47/f4a 2288685 0 2024-04-23T14:49:51.909 INFO:tasks.workunit.client.0.smithi081.stdout:3/603: fdatasync d4/dc/f45 0 2024-04-23T14:49:51.910 INFO:tasks.workunit.client.1.smithi156.stdout:0/314: dread d0/d16/d3a/d2a/d1d/f17 [0,4194304] 0 2024-04-23T14:49:51.910 INFO:tasks.workunit.client.1.smithi156.stdout:0/315: fsync d0/d16/d3a/d2b/d44/d4a/f57 0 2024-04-23T14:49:51.910 INFO:tasks.workunit.client.1.smithi156.stdout:0/316: truncate d0/d16/d3a/d1e/f40 132617 0 2024-04-23T14:49:51.910 INFO:tasks.workunit.client.1.smithi156.stdout:0/317: write d0/d16/d3a/d2b/d44/f52 [913785,48487] 0 2024-04-23T14:49:51.910 INFO:tasks.workunit.client.1.smithi156.stdout:7/342: sync 2024-04-23T14:49:51.910 INFO:tasks.workunit.client.1.smithi156.stdout:4/279: sync 2024-04-23T14:49:51.917 INFO:tasks.workunit.client.0.smithi081.stdout:3/604: link d4/d7/d7f/d91/d6c/la8 d4/d7/d32/d6a/lbc 0 2024-04-23T14:49:51.918 INFO:tasks.workunit.client.1.smithi156.stdout:8/297: getdents d5/d9/d36/d60 0 2024-04-23T14:49:51.918 INFO:tasks.workunit.client.1.smithi156.stdout:5/368: mkdir d1/d17/d7e 0 2024-04-23T14:49:51.918 INFO:tasks.workunit.client.1.smithi156.stdout:5/369: dread - d1/d3/f49 zero size 2024-04-23T14:49:51.918 INFO:tasks.workunit.client.1.smithi156.stdout:5/370: creat d1/d11/d18/d52/f7f x:0 0 0 2024-04-23T14:49:51.918 INFO:tasks.workunit.client.1.smithi156.stdout:5/371: stat d1/d11/d18/d19/c2b 0 2024-04-23T14:49:51.918 INFO:tasks.workunit.client.1.smithi156.stdout:1/353: dread db/f39 [0,4194304] 0 2024-04-23T14:49:51.918 INFO:tasks.workunit.client.1.smithi156.stdout:1/354: fsync db/d25/d30/d38/f4d 0 2024-04-23T14:49:51.918 INFO:tasks.workunit.client.1.smithi156.stdout:1/355: readlink db/d1f/d28/l54 0 2024-04-23T14:49:51.918 INFO:tasks.workunit.client.1.smithi156.stdout:2/305: rename d4/d21/f3f to d4/d21/d2f/f74 0 2024-04-23T14:49:51.919 INFO:tasks.workunit.client.1.smithi156.stdout:3/294: symlink d4/db/dd/d1d/d1e/d2b/d31/l56 0 2024-04-23T14:49:51.920 INFO:tasks.workunit.client.1.smithi156.stdout:3/295: write d4/db/dd/d1d/f37 [1509127,55726] 0 2024-04-23T14:49:51.922 INFO:tasks.workunit.client.0.smithi081.stdout:5/733: dread d17/d1f/d42/f50 [0,4194304] 0 2024-04-23T14:49:51.923 INFO:tasks.workunit.client.0.smithi081.stdout:3/605: rename d4/d7/d7f/d91/lb1 to d4/d7/d32/lbd 0 2024-04-23T14:49:51.923 INFO:tasks.workunit.client.0.smithi081.stdout:3/606: write d4/dc/d10/d5a/f7c [4794553,4629] 0 2024-04-23T14:49:51.924 INFO:tasks.workunit.client.1.smithi156.stdout:5/372: rename d1/d11/d18/f28 to d1/d11/d18/d19/d74/f80 0 2024-04-23T14:49:51.926 INFO:tasks.workunit.client.0.smithi081.stdout:8/851: write d3/d11/d4f/d58/f99 [3181089,72230] 0 2024-04-23T14:49:51.928 INFO:tasks.workunit.client.0.smithi081.stdout:5/734: unlink d17/d18/c30 0 2024-04-23T14:49:51.931 INFO:tasks.workunit.client.1.smithi156.stdout:4/280: write d0/df/f17 [7148033,121604] 0 2024-04-23T14:49:51.931 INFO:tasks.workunit.client.1.smithi156.stdout:6/374: dwrite d3/da/d1d/d59/f6d [0,4194304] 0 2024-04-23T14:49:51.932 INFO:tasks.workunit.client.0.smithi081.stdout:3/607: getdents d4/d7/d32/db0 0 2024-04-23T14:49:51.932 INFO:tasks.workunit.client.1.smithi156.stdout:3/296: mkdir d4/db/dd/d20/d57 0 2024-04-23T14:49:51.932 INFO:tasks.workunit.client.1.smithi156.stdout:3/297: fdatasync d4/db/f2f 0 2024-04-23T14:49:51.937 INFO:tasks.workunit.client.0.smithi081.stdout:8/852: rename d3/d1a/ccd to d3/d11/d86/d88/c11b 0 2024-04-23T14:49:51.941 INFO:tasks.workunit.client.1.smithi156.stdout:5/373: truncate d1/d11/f5e 33157 0 2024-04-23T14:49:51.941 INFO:tasks.workunit.client.1.smithi156.stdout:5/374: fdatasync d1/d11/d27/f77 0 2024-04-23T14:49:51.943 INFO:tasks.workunit.client.0.smithi081.stdout:3/608: readlink d4/d7/d1a/l5f 0 2024-04-23T14:49:51.943 INFO:tasks.workunit.client.0.smithi081.stdout:3/609: chown d4/d7/d49 500927 1 2024-04-23T14:49:51.945 INFO:tasks.workunit.client.1.smithi156.stdout:2/306: getdents d4/d13/d19 0 2024-04-23T14:49:51.949 INFO:tasks.workunit.client.1.smithi156.stdout:9/252: sync 2024-04-23T14:49:51.950 INFO:tasks.workunit.client.0.smithi081.stdout:5/735: dread d17/d18/dff/d59/f63 [0,4194304] 0 2024-04-23T14:49:51.950 INFO:tasks.workunit.client.0.smithi081.stdout:5/736: write d17/d4f/fd7 [666712,126624] 0 2024-04-23T14:49:51.952 INFO:tasks.workunit.client.1.smithi156.stdout:0/318: dread d0/d16/d3a/d2a/f12 [4194304,4194304] 0 2024-04-23T14:49:51.954 INFO:tasks.workunit.client.0.smithi081.stdout:5/737: mknod d17/d1f/d42/dbb/c103 0 2024-04-23T14:49:51.955 INFO:tasks.workunit.client.1.smithi156.stdout:0/319: chown d0/d16/d3a/d2a/d1d/c26 15399945 1 2024-04-23T14:49:51.955 INFO:tasks.workunit.client.1.smithi156.stdout:4/281: rename d0/d30/l5c to d0/l5d 0 2024-04-23T14:49:51.956 INFO:tasks.workunit.client.1.smithi156.stdout:6/375: creat d3/da/d1d/d27/f8e x:0 0 0 2024-04-23T14:49:51.957 INFO:tasks.workunit.client.0.smithi081.stdout:8/853: dread d3/d11/d3e/fbb [0,4194304] 0 2024-04-23T14:49:51.957 INFO:tasks.workunit.client.0.smithi081.stdout:8/854: write d3/d3c/f42 [5441325,123881] 0 2024-04-23T14:49:51.961 INFO:tasks.workunit.client.1.smithi156.stdout:5/375: symlink d1/d11/d18/d19/d74/l81 0 2024-04-23T14:49:51.961 INFO:tasks.workunit.client.1.smithi156.stdout:5/376: fdatasync d1/d3/f49 0 2024-04-23T14:49:51.961 INFO:tasks.workunit.client.1.smithi156.stdout:5/377: write d1/d17/f2e [1582850,71531] 0 2024-04-23T14:49:51.961 INFO:tasks.workunit.client.1.smithi156.stdout:5/378: write d1/d3/d24/f72 [691363,74179] 0 2024-04-23T14:49:51.961 INFO:tasks.workunit.client.1.smithi156.stdout:9/253: mkdir d1/d2/d3e/d55 0 2024-04-23T14:49:51.961 INFO:tasks.workunit.client.1.smithi156.stdout:9/254: write d1/d2/d4/d17/f2c [2175989,61422] 0 2024-04-23T14:49:51.961 INFO:tasks.workunit.client.1.smithi156.stdout:9/255: dread - d1/d2/d4/d19/d2a/f47 zero size 2024-04-23T14:49:51.964 INFO:tasks.workunit.client.0.smithi081.stdout:3/610: dread d4/d7/df/f5e [0,4194304] 0 2024-04-23T14:49:51.967 INFO:tasks.workunit.client.0.smithi081.stdout:9/638: sync 2024-04-23T14:49:51.974 INFO:tasks.workunit.client.1.smithi156.stdout:4/282: creat d0/d8/d1e/f5e x:0 0 0 2024-04-23T14:49:51.974 INFO:tasks.workunit.client.1.smithi156.stdout:4/283: chown d0/d8/d1e/f5e 4383 1 2024-04-23T14:49:51.977 INFO:tasks.workunit.client.1.smithi156.stdout:6/376: rename d3/d16/d46/d2b/d3b/d7b to d3/d16/d46/d2b/d6e/d8f 0 2024-04-23T14:49:51.981 INFO:tasks.workunit.client.0.smithi081.stdout:1/733: dread d3/d3d/d41/d5e/d17/d58/f99 [0,4194304] 0 2024-04-23T14:49:51.982 INFO:tasks.workunit.client.0.smithi081.stdout:3/611: creat d4/d7/d1a/fbe x:0 0 0 2024-04-23T14:49:51.984 INFO:tasks.workunit.client.0.smithi081.stdout:3/612: write d4/dc/d10/d47/f96 [341555,101490] 0 2024-04-23T14:49:51.984 INFO:tasks.workunit.client.1.smithi156.stdout:8/298: dwrite d5/d9/d10/f33 [0,4194304] 0 2024-04-23T14:49:51.985 INFO:tasks.workunit.client.1.smithi156.stdout:2/307: dread d4/f29 [0,4194304] 0 2024-04-23T14:49:51.985 INFO:tasks.workunit.client.1.smithi156.stdout:2/308: truncate d4/d13/d19/d4c/f6c 901245 0 2024-04-23T14:49:51.985 INFO:tasks.workunit.client.1.smithi156.stdout:5/379: link d1/d11/d18/d19/d74/l81 d1/d17/l82 0 2024-04-23T14:49:51.990 INFO:tasks.workunit.client.1.smithi156.stdout:1/356: dwrite db/d25/d30/f53 [4194304,4194304] 0 2024-04-23T14:49:51.992 INFO:tasks.workunit.client.0.smithi081.stdout:5/738: dread d17/d1f/f23 [0,4194304] 0 2024-04-23T14:49:51.992 INFO:tasks.workunit.client.0.smithi081.stdout:5/739: truncate d17/d1f/d42/d9b/d9e/da3/fcb 988466 0 2024-04-23T14:49:51.993 INFO:tasks.workunit.client.0.smithi081.stdout:0/753: dwrite d6/d11/d14/d41/d5b/d3f/d44/d78/d83/fe2 [0,4194304] 0 2024-04-23T14:49:51.995 INFO:tasks.workunit.client.1.smithi156.stdout:0/320: dread d0/d4/d11/d3f/d5f/f56 [0,4194304] 0 2024-04-23T14:49:51.995 INFO:tasks.workunit.client.1.smithi156.stdout:0/321: chown d0/d4/d11/f4b 1429 1 2024-04-23T14:49:51.995 INFO:tasks.workunit.client.1.smithi156.stdout:0/322: chown d0/d16/d3a/d1e/f5d 5575283 1 2024-04-23T14:49:51.996 INFO:tasks.workunit.client.1.smithi156.stdout:0/323: creat d0/d16/d3a/d2b/d44/d4a/f65 x:0 0 0 2024-04-23T14:49:51.997 INFO:tasks.workunit.client.0.smithi081.stdout:1/734: symlink d3/d3d/lf0 0 2024-04-23T14:49:51.998 INFO:tasks.workunit.client.0.smithi081.stdout:1/735: write d3/d3d/faa [2814544,24398] 0 2024-04-23T14:49:52.006 INFO:tasks.workunit.client.0.smithi081.stdout:0/754: write d6/f9 [948235,105926] 0 2024-04-23T14:49:52.006 INFO:tasks.workunit.client.1.smithi156.stdout:9/256: creat d1/d2/d3e/f56 x:0 0 0 2024-04-23T14:49:52.006 INFO:tasks.workunit.client.1.smithi156.stdout:9/257: write d1/fe [432936,10355] 0 2024-04-23T14:49:52.009 INFO:tasks.workunit.client.1.smithi156.stdout:7/343: dwrite dc/d2c/f50 [0,4194304] 0 2024-04-23T14:49:52.010 INFO:tasks.workunit.client.0.smithi081.stdout:8/855: dwrite d3/d11/d34/f72 [0,4194304] 0 2024-04-23T14:49:52.011 INFO:tasks.workunit.client.0.smithi081.stdout:3/613: creat d4/d7/df/fbf x:0 0 0 2024-04-23T14:49:52.011 INFO:tasks.workunit.client.1.smithi156.stdout:4/284: mknod d0/df/d21/d36/c5f 0 2024-04-23T14:49:52.011 INFO:tasks.workunit.client.1.smithi156.stdout:4/285: truncate d0/d8/d1e/f5e 921400 0 2024-04-23T14:49:52.012 INFO:tasks.workunit.client.1.smithi156.stdout:4/286: chown d0/d30 0 1 2024-04-23T14:49:52.012 INFO:tasks.workunit.client.1.smithi156.stdout:3/298: dwrite d4/db/dd/d1d/d1e/d13/f34 [0,4194304] 0 2024-04-23T14:49:52.021 INFO:tasks.workunit.client.0.smithi081.stdout:5/740: link d17/d1f/f23 d17/d1f/d42/dbb/f104 0 2024-04-23T14:49:52.023 INFO:tasks.workunit.client.0.smithi081.stdout:9/639: dwrite d3/de/d1d/fc2 [0,4194304] 0 2024-04-23T14:49:52.028 INFO:tasks.workunit.client.1.smithi156.stdout:6/377: unlink d3/d16/d46/d64/f71 0 2024-04-23T14:49:52.028 INFO:tasks.workunit.client.1.smithi156.stdout:8/299: truncate d5/d9/f4d 2898155 0 2024-04-23T14:49:52.028 INFO:tasks.workunit.client.1.smithi156.stdout:2/309: mkdir d4/d21/d42/d75 0 2024-04-23T14:49:52.029 INFO:tasks.workunit.client.1.smithi156.stdout:8/300: dread - d5/d9/d10/d1d/d21/f40 zero size 2024-04-23T14:49:52.029 INFO:tasks.workunit.client.1.smithi156.stdout:0/324: symlink d0/d16/d3a/d1e/l66 0 2024-04-23T14:49:52.029 INFO:tasks.workunit.client.1.smithi156.stdout:9/258: rename d1/d2/d23/d2d/c44 to d1/d2/d4/d19/d2a/c57 0 2024-04-23T14:49:52.029 INFO:tasks.workunit.client.1.smithi156.stdout:1/357: write db/d1f/d28/f37 [749810,31650] 0 2024-04-23T14:49:52.030 INFO:tasks.workunit.client.0.smithi081.stdout:1/736: unlink d3/d3d/d41/fcc 0 2024-04-23T14:49:52.037 INFO:tasks.workunit.client.1.smithi156.stdout:9/259: dread d1/d2/f13 [0,4194304] 0 2024-04-23T14:49:52.037 INFO:tasks.workunit.client.1.smithi156.stdout:9/260: chown d1/d2 356912904 1 2024-04-23T14:49:52.047 INFO:tasks.workunit.client.0.smithi081.stdout:8/856: rename d3/d11/d86/d88/fa5 to d3/dc6/f11c 0 2024-04-23T14:49:52.048 INFO:tasks.workunit.client.1.smithi156.stdout:7/344: symlink dc/d2c/l61 0 2024-04-23T14:49:52.048 INFO:tasks.workunit.client.1.smithi156.stdout:7/345: chown l3 501 1 2024-04-23T14:49:52.048 INFO:tasks.workunit.client.1.smithi156.stdout:6/378: link d3/d16/d1e/f5f d3/d16/d46/d64/f90 0 2024-04-23T14:49:52.048 INFO:tasks.workunit.client.1.smithi156.stdout:7/346: stat dc/d1d/d48 0 2024-04-23T14:49:52.050 INFO:tasks.workunit.client.1.smithi156.stdout:0/325: creat d0/d16/d43/f67 x:0 0 0 2024-04-23T14:49:52.052 INFO:tasks.workunit.client.0.smithi081.stdout:3/614: creat d4/dc/d10/fc0 x:0 0 0 2024-04-23T14:49:52.056 INFO:tasks.workunit.client.1.smithi156.stdout:8/301: rename d5/f5e to d5/d39/f64 0 2024-04-23T14:49:52.059 INFO:tasks.workunit.client.1.smithi156.stdout:5/380: dwrite d1/d11/d18/f32 [4194304,4194304] 0 2024-04-23T14:49:52.060 INFO:tasks.workunit.client.0.smithi081.stdout:5/741: fsync d17/d3c/d55/d64/dcc/ff5 0 2024-04-23T14:49:52.063 INFO:tasks.workunit.client.1.smithi156.stdout:9/261: creat d1/d2/f58 x:0 0 0 2024-04-23T14:49:52.066 INFO:tasks.workunit.client.1.smithi156.stdout:4/287: getdents d0/d8/d1e 0 2024-04-23T14:49:52.072 INFO:tasks.workunit.client.1.smithi156.stdout:6/379: creat d3/d16/d5c/d6a/f91 x:0 0 0 2024-04-23T14:49:52.072 INFO:tasks.workunit.client.1.smithi156.stdout:6/380: fdatasync d3/d16/d5c/d6a/f91 0 2024-04-23T14:49:52.072 INFO:tasks.workunit.client.1.smithi156.stdout:6/381: write d3/f6b [832709,110115] 0 2024-04-23T14:49:52.082 INFO:tasks.workunit.client.1.smithi156.stdout:7/347: creat dc/d1d/d24/f62 x:0 0 0 2024-04-23T14:49:52.082 INFO:tasks.workunit.client.1.smithi156.stdout:7/348: chown dc/d1d/d41/f57 1019679346 1 2024-04-23T14:49:52.082 INFO:tasks.workunit.client.1.smithi156.stdout:7/349: readlink dc/l29 0 2024-04-23T14:49:52.091 INFO:tasks.workunit.client.1.smithi156.stdout:0/326: getdents d0/d4/d22 0 2024-04-23T14:49:52.100 INFO:tasks.workunit.client.0.smithi081.stdout:1/737: mkdir d3/d3d/d41/d92/df1 0 2024-04-23T14:49:52.101 INFO:tasks.workunit.client.1.smithi156.stdout:8/302: mknod d5/c65 0 2024-04-23T14:49:52.105 INFO:tasks.workunit.client.0.smithi081.stdout:3/615: link d4/d7/d49/d51/d84/l97 d4/d7/d7f/lc1 0 2024-04-23T14:49:52.106 INFO:tasks.workunit.client.1.smithi156.stdout:1/358: unlink db/d1f/d34/c2c 0 2024-04-23T14:49:52.107 INFO:tasks.workunit.client.0.smithi081.stdout:5/742: stat d17/d1f/c2f 0 2024-04-23T14:49:52.107 INFO:tasks.workunit.client.0.smithi081.stdout:5/743: dread - d17/d3d/f51 zero size 2024-04-23T14:49:52.108 INFO:tasks.workunit.client.1.smithi156.stdout:4/288: dread d0/df/f25 [0,4194304] 0 2024-04-23T14:49:52.108 INFO:tasks.workunit.client.1.smithi156.stdout:6/382: mknod d3/da/d1d/d59/c92 0 2024-04-23T14:49:52.108 INFO:tasks.workunit.client.1.smithi156.stdout:6/383: dread - d3/d16/f76 zero size 2024-04-23T14:49:52.109 INFO:tasks.workunit.client.0.smithi081.stdout:9/640: mknod d3/d1a/d6c/cca 0 2024-04-23T14:49:52.109 INFO:tasks.workunit.client.0.smithi081.stdout:8/857: dwrite d3/d11/d34/f7c [0,4194304] 0 2024-04-23T14:49:52.109 INFO:tasks.workunit.client.1.smithi156.stdout:0/327: link d0/d4/f3 d0/d4/d11/d3f/f68 0 2024-04-23T14:49:52.110 INFO:tasks.workunit.client.0.smithi081.stdout:2/687: sync 2024-04-23T14:49:52.111 INFO:tasks.workunit.client.1.smithi156.stdout:8/303: truncate d5/d9/f48 533112 0 2024-04-23T14:49:52.112 INFO:tasks.workunit.client.0.smithi081.stdout:0/755: dwrite d6/d37/d67/dc8/fd5 [0,4194304] 0 2024-04-23T14:49:52.112 INFO:tasks.workunit.client.0.smithi081.stdout:0/756: fdatasync d6/d11/d14/f91 0 2024-04-23T14:49:52.113 INFO:tasks.workunit.client.0.smithi081.stdout:3/616: mkdir d4/d7/d1a/d71/dc2 0 2024-04-23T14:49:52.114 INFO:tasks.workunit.client.1.smithi156.stdout:3/299: dwrite d4/db/dd/d1d/d1e/d42/f52 [0,4194304] 0 2024-04-23T14:49:52.114 INFO:tasks.workunit.client.1.smithi156.stdout:5/381: dwrite d1/f7c [0,4194304] 0 2024-04-23T14:49:52.114 INFO:tasks.workunit.client.1.smithi156.stdout:5/382: write d1/d11/f51 [4911585,84297] 0 2024-04-23T14:49:52.115 INFO:tasks.workunit.client.1.smithi156.stdout:1/359: truncate db/d25/f3b 3444884 0 2024-04-23T14:49:52.115 INFO:tasks.workunit.client.1.smithi156.stdout:1/360: chown db/d25/d4e/d5d/f67 8618753 1 2024-04-23T14:49:52.118 INFO:tasks.workunit.client.0.smithi081.stdout:5/744: stat l15 0 2024-04-23T14:49:52.118 INFO:tasks.workunit.client.0.smithi081.stdout:9/641: mkdir d3/d5/dcb 0 2024-04-23T14:49:52.118 INFO:tasks.workunit.client.1.smithi156.stdout:4/289: rename d0/d8/d1e/c28 to d0/d8/c60 0 2024-04-23T14:49:52.120 INFO:tasks.workunit.client.0.smithi081.stdout:8/858: symlink d3/d11/d3e/d63/l11d 0 2024-04-23T14:49:52.120 INFO:tasks.workunit.client.0.smithi081.stdout:8/859: write d3/d11/d34/d8b/f9b [4817844,109216] 0 2024-04-23T14:49:52.121 INFO:tasks.workunit.client.1.smithi156.stdout:6/384: mkdir d3/da/d74/d93 0 2024-04-23T14:49:52.126 INFO:tasks.workunit.client.1.smithi156.stdout:8/304: creat d5/d4e/f66 x:0 0 0 2024-04-23T14:49:52.127 INFO:tasks.workunit.client.0.smithi081.stdout:1/738: unlink d3/d3d/d41/d5e/d17/l56 0 2024-04-23T14:49:52.127 INFO:tasks.workunit.client.0.smithi081.stdout:2/688: creat d1/d1e/dad/fed x:0 0 0 2024-04-23T14:49:52.133 INFO:tasks.workunit.client.1.smithi156.stdout:2/310: dwrite d4/f7 [4194304,4194304] 0 2024-04-23T14:49:52.146 INFO:tasks.workunit.client.0.smithi081.stdout:0/757: unlink d6/d11/d14/d41/d5b/fa4 0 2024-04-23T14:49:52.147 INFO:tasks.workunit.client.0.smithi081.stdout:8/860: dread d3/d11/d34/f72 [0,4194304] 0 2024-04-23T14:49:52.147 INFO:tasks.workunit.client.1.smithi156.stdout:8/305: write d5/d9/d5a/f54 [3355067,63033] 0 2024-04-23T14:49:52.147 INFO:tasks.workunit.client.1.smithi156.stdout:8/306: creat d5/d9/f67 x:0 0 0 2024-04-23T14:49:52.147 INFO:tasks.workunit.client.1.smithi156.stdout:8/307: truncate d5/f28 4925002 0 2024-04-23T14:49:52.154 INFO:tasks.workunit.client.1.smithi156.stdout:1/361: creat db/d25/d30/d38/f6c x:0 0 0 2024-04-23T14:49:52.154 INFO:tasks.workunit.client.1.smithi156.stdout:0/328: rename d0/d16/d43/f67 to d0/d4/d22/d58/f69 0 2024-04-23T14:49:52.154 INFO:tasks.workunit.client.1.smithi156.stdout:1/362: fdatasync db/d25/d30/d38/f4d 0 2024-04-23T14:49:52.157 INFO:tasks.workunit.client.0.smithi081.stdout:3/617: rename d4/d7/df/f9f to d4/d7/d1a/d71/fc3 0 2024-04-23T14:49:52.166 INFO:tasks.workunit.client.0.smithi081.stdout:8/861: read f2 [1481154,89487] 0 2024-04-23T14:49:52.166 INFO:tasks.workunit.client.0.smithi081.stdout:8/862: chown d3/d11/d34/d8b/l91 721668703 1 2024-04-23T14:49:52.166 INFO:tasks.workunit.client.0.smithi081.stdout:8/863: chown d3/d11/d48/d7e/de4/df0/c115 121 1 2024-04-23T14:49:52.166 INFO:tasks.workunit.client.0.smithi081.stdout:8/864: fsync d3/dc6/fd2 0 2024-04-23T14:49:52.166 INFO:tasks.workunit.client.0.smithi081.stdout:5/745: mkdir d17/d3c/d105 0 2024-04-23T14:49:52.167 INFO:tasks.workunit.client.0.smithi081.stdout:5/746: chown d17/f1b 129786 1 2024-04-23T14:49:52.167 INFO:tasks.workunit.client.0.smithi081.stdout:5/747: read - d17/d18/dff/fb5 zero size 2024-04-23T14:49:52.168 INFO:tasks.workunit.client.0.smithi081.stdout:6/681: sync 2024-04-23T14:49:52.168 INFO:tasks.workunit.client.1.smithi156.stdout:8/308: dread d5/d9/d10/f33 [0,4194304] 0 2024-04-23T14:49:52.171 INFO:tasks.workunit.client.0.smithi081.stdout:1/739: mkdir d3/d3d/d41/d5e/dd2/dd5/df2 0 2024-04-23T14:49:52.171 INFO:tasks.workunit.client.0.smithi081.stdout:1/740: stat d3/d3d/d41/d5e/d17/f20 0 2024-04-23T14:49:52.172 INFO:tasks.workunit.client.0.smithi081.stdout:2/689: truncate d1/d11/d21/d34/f76 15193 0 2024-04-23T14:49:52.172 INFO:tasks.workunit.client.1.smithi156.stdout:5/383: dwrite d1/f7c [0,4194304] 0 2024-04-23T14:49:52.176 INFO:tasks.workunit.client.0.smithi081.stdout:8/865: creat d3/d11/d86/d88/da7/d117/f11e x:0 0 0 2024-04-23T14:49:52.179 INFO:tasks.workunit.client.0.smithi081.stdout:0/758: link d6/d37/cb2 d6/d37/d67/d7d/ce9 0 2024-04-23T14:49:52.184 INFO:tasks.workunit.client.1.smithi156.stdout:9/262: dwrite d1/d2/d4/d19/d2a/f47 [0,4194304] 0 2024-04-23T14:49:52.188 INFO:tasks.workunit.client.0.smithi081.stdout:4/590: sync 2024-04-23T14:49:52.188 INFO:tasks.workunit.client.0.smithi081.stdout:7/550: sync 2024-04-23T14:49:52.189 INFO:tasks.workunit.client.0.smithi081.stdout:2/690: getdents d1/d33/d45/d6e/d97 0 2024-04-23T14:49:52.189 INFO:tasks.workunit.client.0.smithi081.stdout:1/741: symlink d3/d3d/d41/d5e/d17/d58/d7f/lf3 0 2024-04-23T14:49:52.189 INFO:tasks.workunit.client.0.smithi081.stdout:9/642: mkdir d3/de/d1d/dcc 0 2024-04-23T14:49:52.191 INFO:tasks.workunit.client.0.smithi081.stdout:1/742: creat d3/d3d/d41/d5e/d1d/ff4 x:0 0 0 2024-04-23T14:49:52.191 INFO:tasks.workunit.client.1.smithi156.stdout:3/300: rename d4/l8 to d4/db/d4b/l58 0 2024-04-23T14:49:52.193 INFO:tasks.workunit.client.1.smithi156.stdout:1/363: symlink db/d1f/d2f/l6d 0 2024-04-23T14:49:52.201 INFO:tasks.workunit.client.1.smithi156.stdout:2/311: dwrite d4/d13/d19/f1e [4194304,4194304] 0 2024-04-23T14:49:52.209 INFO:tasks.workunit.client.1.smithi156.stdout:0/329: dwrite d0/d4/f3 [4194304,4194304] 0 2024-04-23T14:49:52.213 INFO:tasks.workunit.client.1.smithi156.stdout:6/385: dwrite d3/f34 [0,4194304] 0 2024-04-23T14:49:52.214 INFO:tasks.workunit.client.0.smithi081.stdout:7/551: write d3/d21/d31/d33/d4b/d71/f99 [2503540,47350] 0 2024-04-23T14:49:52.214 INFO:tasks.workunit.client.0.smithi081.stdout:0/759: rename d6/d11/d14/d41/d5b/d59/fbc to d6/d11/d14/d41/d5b/d59/d68/dbd/fea 0 2024-04-23T14:49:52.214 INFO:tasks.workunit.client.0.smithi081.stdout:0/760: fsync d6/d37/d85/fde 0 2024-04-23T14:49:52.215 INFO:tasks.workunit.client.0.smithi081.stdout:4/591: link d1/d4/d6f/d70/f7e d1/d4f/dc3/fc5 0 2024-04-23T14:49:52.216 INFO:tasks.workunit.client.1.smithi156.stdout:5/384: getdents d1/d11/d18/d19/d74 0 2024-04-23T14:49:52.216 INFO:tasks.workunit.client.1.smithi156.stdout:5/385: creat d1/d3/d20/d3e/f83 x:0 0 0 2024-04-23T14:49:52.216 INFO:tasks.workunit.client.1.smithi156.stdout:5/386: truncate d1/d3/f4f 4513252 0 2024-04-23T14:49:52.216 INFO:tasks.workunit.client.1.smithi156.stdout:5/387: dread - d1/d3/d20/d3e/f6c zero size 2024-04-23T14:49:52.220 INFO:tasks.workunit.client.0.smithi081.stdout:7/552: write d3/d21/d31/d33/d4b/f60 [585472,114297] 0 2024-04-23T14:49:52.220 INFO:tasks.workunit.client.0.smithi081.stdout:2/691: mkdir d1/d11/d21/d52/d8b/d8f/dee 0 2024-04-23T14:49:52.221 INFO:tasks.workunit.client.1.smithi156.stdout:2/312: dread d4/d13/d19/f1a [0,4194304] 0 2024-04-23T14:49:52.221 INFO:tasks.workunit.client.1.smithi156.stdout:2/313: fsync d4/d13/d19/d4c/d5c/d70/f72 0 2024-04-23T14:49:52.221 INFO:tasks.workunit.client.1.smithi156.stdout:5/388: write d1/d11/f51 [4197590,74300] 0 2024-04-23T14:49:52.223 INFO:tasks.workunit.client.0.smithi081.stdout:4/592: dread d1/d4/d6f/d70/daf/d89/fbf [0,4194304] 0 2024-04-23T14:49:52.223 INFO:tasks.workunit.client.0.smithi081.stdout:4/593: fsync d1/d4/d11/d75/f88 0 2024-04-23T14:49:52.226 INFO:tasks.workunit.client.0.smithi081.stdout:8/866: dwrite d3/d11/d3e/d63/f94 [0,4194304] 0 2024-04-23T14:49:52.229 INFO:tasks.workunit.client.0.smithi081.stdout:9/643: symlink d3/de/d1d/d73/lcd 0 2024-04-23T14:49:52.237 INFO:tasks.workunit.client.0.smithi081.stdout:1/743: mknod d3/d3d/d41/d5e/d12/cf5 0 2024-04-23T14:49:52.238 INFO:tasks.workunit.client.0.smithi081.stdout:0/761: dread d6/d25/fc3 [0,4194304] 0 2024-04-23T14:49:52.244 INFO:tasks.workunit.client.1.smithi156.stdout:2/314: write d4/f24 [232119,80029] 0 2024-04-23T14:49:52.246 INFO:tasks.workunit.client.0.smithi081.stdout:2/692: mknod d1/d11/d21/d52/d8b/d8f/dee/cef 0 2024-04-23T14:49:52.246 INFO:tasks.workunit.client.0.smithi081.stdout:5/748: dwrite d17/d18/fe5 [0,4194304] 0 2024-04-23T14:49:52.247 INFO:tasks.workunit.client.0.smithi081.stdout:8/867: dread d3/d3c/f42 [0,4194304] 0 2024-04-23T14:49:52.247 INFO:tasks.workunit.client.0.smithi081.stdout:8/868: chown d3/l1f 1 1 2024-04-23T14:49:52.249 INFO:tasks.workunit.client.0.smithi081.stdout:7/553: mknod d3/d11/d56/d7f/d98/cbe 0 2024-04-23T14:49:52.249 INFO:tasks.workunit.client.0.smithi081.stdout:7/554: creat d3/d21/d31/d33/d4b/d71/fbf x:0 0 0 2024-04-23T14:49:52.249 INFO:tasks.workunit.client.0.smithi081.stdout:4/594: mkdir d1/d4/dc/dba/dc6 0 2024-04-23T14:49:52.252 INFO:tasks.workunit.client.0.smithi081.stdout:9/644: creat d3/de/d25/fce x:0 0 0 2024-04-23T14:49:52.254 INFO:tasks.workunit.client.0.smithi081.stdout:1/744: rename d3/d3d/d41/d5e/d17/f78 to d3/d3d/d6f/de6/ff6 0 2024-04-23T14:49:52.254 INFO:tasks.workunit.client.0.smithi081.stdout:1/745: stat d3/d3d/d41/d4a/d77/f98 0 2024-04-23T14:49:52.257 INFO:tasks.workunit.client.0.smithi081.stdout:0/762: mkdir d6/d11/d14/d41/d5b/d3f/d44/d76/deb 0 2024-04-23T14:49:52.259 INFO:tasks.workunit.client.1.smithi156.stdout:9/263: symlink d1/d2/d4/d19/d2a/d30/l59 0 2024-04-23T14:49:52.260 INFO:tasks.workunit.client.1.smithi156.stdout:9/264: stat d1/d2/d4/d19/d2a/l53 0 2024-04-23T14:49:52.262 INFO:tasks.workunit.client.1.smithi156.stdout:3/301: unlink d4/db/dd/c24 0 2024-04-23T14:49:52.262 INFO:tasks.workunit.client.1.smithi156.stdout:3/302: fsync d4/db/dd/d1d/f36 0 2024-04-23T14:49:52.262 INFO:tasks.workunit.client.1.smithi156.stdout:3/303: fsync d4/db/dd/d1d/d1e/ff 0 2024-04-23T14:49:52.267 INFO:tasks.workunit.client.1.smithi156.stdout:4/290: rename d0/d8/c5b to d0/df/d21/d36/d53/c61 0 2024-04-23T14:49:52.267 INFO:tasks.workunit.client.1.smithi156.stdout:1/364: creat db/d1f/d2d/f6e x:0 0 0 2024-04-23T14:49:52.277 INFO:tasks.workunit.client.0.smithi081.stdout:5/749: unlink d17/d18/c2b 0 2024-04-23T14:49:52.277 INFO:tasks.workunit.client.0.smithi081.stdout:8/869: creat d3/d11/d4f/d6c/f11f x:0 0 0 2024-04-23T14:49:52.277 INFO:tasks.workunit.client.0.smithi081.stdout:8/870: write d3/d3c/ddb/df3/ff6 [105316,78174] 0 2024-04-23T14:49:52.280 INFO:tasks.workunit.client.0.smithi081.stdout:7/555: symlink d3/d21/d41/d7c/lc0 0 2024-04-23T14:49:52.281 INFO:tasks.workunit.client.0.smithi081.stdout:7/556: read - d3/d11/d2c/f9c zero size 2024-04-23T14:49:52.281 INFO:tasks.workunit.client.0.smithi081.stdout:7/557: dread - d3/d21/d31/d63/fba zero size 2024-04-23T14:49:52.281 INFO:tasks.workunit.client.0.smithi081.stdout:7/558: readlink d3/d11/d56/d7f/l96 0 2024-04-23T14:49:52.281 INFO:tasks.workunit.client.0.smithi081.stdout:7/559: chown d3/d21/d31/d50/f58 28113 1 2024-04-23T14:49:52.281 INFO:tasks.workunit.client.0.smithi081.stdout:7/560: readlink d3/d21/d31/d33/l37 0 2024-04-23T14:49:52.284 INFO:tasks.workunit.client.0.smithi081.stdout:9/645: mkdir d3/de/d14/d5e/d72/dcf 0 2024-04-23T14:49:52.284 INFO:tasks.workunit.client.0.smithi081.stdout:9/646: chown d3/de/c18 922198929 1 2024-04-23T14:49:52.284 INFO:tasks.workunit.client.1.smithi156.stdout:3/304: dread d4/db/dd/d1d/f3b [0,4194304] 0 2024-04-23T14:49:52.291 INFO:tasks.workunit.client.1.smithi156.stdout:8/309: rmdir d5 39 2024-04-23T14:49:52.295 INFO:tasks.workunit.client.1.smithi156.stdout:0/330: creat d0/d16/d3a/f6a x:0 0 0 2024-04-23T14:49:52.303 INFO:tasks.workunit.client.0.smithi081.stdout:8/871: dread d3/d11/d34/dab/ff7 [0,4194304] 0 2024-04-23T14:49:52.304 INFO:tasks.workunit.client.0.smithi081.stdout:4/595: rename d1/d4/d11/d9d/dac/lb1 to d1/d4/d6f/d70/daf/lc7 0 2024-04-23T14:49:52.304 INFO:tasks.workunit.client.0.smithi081.stdout:1/746: truncate d3/d3d/d41/d5e/d17/d25/f4d 2861818 0 2024-04-23T14:49:52.305 INFO:tasks.workunit.client.0.smithi081.stdout:5/750: mknod d17/d18/c106 0 2024-04-23T14:49:52.307 INFO:tasks.workunit.client.0.smithi081.stdout:7/561: symlink d3/d21/d31/d63/lc1 0 2024-04-23T14:49:52.308 INFO:tasks.workunit.client.1.smithi156.stdout:6/386: symlink d3/da/d1d/d27/d63/l94 0 2024-04-23T14:49:52.310 INFO:tasks.workunit.client.0.smithi081.stdout:2/693: dwrite d1/d33/d45/d6e/f9d [0,4194304] 0 2024-04-23T14:49:52.310 INFO:tasks.workunit.client.0.smithi081.stdout:8/872: unlink d3/d11/d34/d8b/fa6 0 2024-04-23T14:49:52.314 INFO:tasks.workunit.client.1.smithi156.stdout:5/389: unlink d1/l4 0 2024-04-23T14:49:52.314 INFO:tasks.workunit.client.1.smithi156.stdout:5/390: fdatasync d1/d17/f7d 0 2024-04-23T14:49:52.314 INFO:tasks.workunit.client.1.smithi156.stdout:5/391: chown d1/d11/d18/d19/c26 571802 1 2024-04-23T14:49:52.315 INFO:tasks.workunit.client.1.smithi156.stdout:1/365: dread db/f4f [0,4194304] 0 2024-04-23T14:49:52.315 INFO:tasks.workunit.client.1.smithi156.stdout:1/366: getdents db/d25/d6b 0 2024-04-23T14:49:52.315 INFO:tasks.workunit.client.1.smithi156.stdout:1/367: chown db/d1f/d2f/l6d 1246033 1 2024-04-23T14:49:52.317 INFO:tasks.workunit.client.0.smithi081.stdout:4/596: rmdir d1/d4/d6f/d70/daf/d89/db7/dbd 0 2024-04-23T14:49:52.317 INFO:tasks.workunit.client.0.smithi081.stdout:5/751: link d17/d18/d3a/fd3 d17/d37/d4e/f107 0 2024-04-23T14:49:52.317 INFO:tasks.workunit.client.0.smithi081.stdout:1/747: creat d3/d3d/d41/d5e/d5d/db0/ff7 x:0 0 0 2024-04-23T14:49:52.317 INFO:tasks.workunit.client.0.smithi081.stdout:1/748: chown d3/d3d/d41/l4e 4269 1 2024-04-23T14:49:52.317 INFO:tasks.workunit.client.0.smithi081.stdout:4/597: write d1/d4/f5d [4253141,38596] 0 2024-04-23T14:49:52.317 INFO:tasks.workunit.client.0.smithi081.stdout:4/598: dread - d1/d4/d6f/d70/d9c/fab zero size 2024-04-23T14:49:52.318 INFO:tasks.workunit.client.0.smithi081.stdout:0/763: dwrite d6/d37/d4d/f55 [4194304,4194304] 0 2024-04-23T14:49:52.318 INFO:tasks.workunit.client.0.smithi081.stdout:7/562: chown d3/d21/d31/d50/d5a/c5e 29710054 1 2024-04-23T14:49:52.320 INFO:tasks.workunit.client.1.smithi156.stdout:3/305: truncate d4/f10 7285870 0 2024-04-23T14:49:52.320 INFO:tasks.workunit.client.1.smithi156.stdout:3/306: fsync d4/db/dd/d1d/d1e/ff 0 2024-04-23T14:49:52.320 INFO:tasks.workunit.client.1.smithi156.stdout:3/307: write d4/db/dd/d1d/f36 [82069,1037] 0 2024-04-23T14:49:52.324 INFO:tasks.workunit.client.0.smithi081.stdout:2/694: rmdir d1/d11/d21/d52/d8b/d8f/d93 39 2024-04-23T14:49:52.324 INFO:tasks.workunit.client.0.smithi081.stdout:8/873: symlink d3/d11/d34/dab/l120 0 2024-04-23T14:49:52.325 INFO:tasks.workunit.client.1.smithi156.stdout:8/310: creat d5/d39/f68 x:0 0 0 2024-04-23T14:49:52.325 INFO:tasks.workunit.client.1.smithi156.stdout:0/331: mkdir d0/d16/d3a/d2a/d1d/d2d/d6b 0 2024-04-23T14:49:52.325 INFO:tasks.workunit.client.1.smithi156.stdout:0/332: readlink d0/d4/lb 0 2024-04-23T14:49:52.325 INFO:tasks.workunit.client.1.smithi156.stdout:5/392: dread d1/d11/f5e [0,4194304] 0 2024-04-23T14:49:52.328 INFO:tasks.workunit.client.0.smithi081.stdout:5/752: rename d17/d1f/da5 to d17/d65/de3/d108 0 2024-04-23T14:49:52.329 INFO:tasks.workunit.client.1.smithi156.stdout:6/387: creat d3/d16/d46/d2b/d6e/f95 x:0 0 0 2024-04-23T14:49:52.329 INFO:tasks.workunit.client.1.smithi156.stdout:6/388: creat d3/da/d1d/d27/d63/f96 x:0 0 0 2024-04-23T14:49:52.329 INFO:tasks.workunit.client.0.smithi081.stdout:1/749: truncate d3/d3d/d41/d5e/d12/f54 3166235 0 2024-04-23T14:49:52.331 INFO:tasks.workunit.client.1.smithi156.stdout:2/315: dwrite d4/d21/f31 [0,4194304] 0 2024-04-23T14:49:52.331 INFO:tasks.workunit.client.1.smithi156.stdout:2/316: read d4/f16 [1064132,114180] 0 2024-04-23T14:49:52.335 INFO:tasks.workunit.client.1.smithi156.stdout:1/368: symlink db/d25/d6b/l6f 0 2024-04-23T14:49:52.336 INFO:tasks.workunit.client.1.smithi156.stdout:9/265: rename d1/d2/d4/f8 to d1/d2/d4/f5a 0 2024-04-23T14:49:52.336 INFO:tasks.workunit.client.1.smithi156.stdout:3/308: truncate d4/db/dd/f25 2609795 0 2024-04-23T14:49:52.337 INFO:tasks.workunit.client.1.smithi156.stdout:3/309: chown d4/db/dd/d20/l44 1240822 1 2024-04-23T14:49:52.337 INFO:tasks.workunit.client.1.smithi156.stdout:3/310: chown d4/db/l53 247 1 2024-04-23T14:49:52.339 INFO:tasks.workunit.client.0.smithi081.stdout:4/599: mkdir d1/d8b/dbc/dc8 0 2024-04-23T14:49:52.339 INFO:tasks.workunit.client.0.smithi081.stdout:0/764: mkdir d6/d11/d14/dec 0 2024-04-23T14:49:52.347 INFO:tasks.workunit.client.0.smithi081.stdout:9/647: dwrite d3/de/f84 [8388608,4194304] 0 2024-04-23T14:49:52.358 INFO:tasks.workunit.client.1.smithi156.stdout:4/291: dwrite d0/df/d55/f3c [0,4194304] 0 2024-04-23T14:49:52.365 INFO:tasks.workunit.client.0.smithi081.stdout:0/765: write d6/f10 [6206351,20600] 0 2024-04-23T14:49:52.370 INFO:tasks.workunit.client.0.smithi081.stdout:7/563: mkdir d3/d11/d2c/d75/d8e/dc2 0 2024-04-23T14:49:52.372 INFO:tasks.workunit.client.0.smithi081.stdout:9/648: dread d3/de/d14/f3c [0,4194304] 0 2024-04-23T14:49:52.373 INFO:tasks.workunit.client.0.smithi081.stdout:2/695: symlink d1/d11/d21/d52/lf0 0 2024-04-23T14:49:52.374 INFO:tasks.workunit.client.1.smithi156.stdout:8/311: dwrite d5/d45/f4f [0,4194304] 0 2024-04-23T14:49:52.377 INFO:tasks.workunit.client.1.smithi156.stdout:2/317: mkdir d4/d21/d76 0 2024-04-23T14:49:52.377 INFO:tasks.workunit.client.1.smithi156.stdout:2/318: fdatasync d4/d21/d2f/f35 0 2024-04-23T14:49:52.381 INFO:tasks.workunit.client.1.smithi156.stdout:9/266: rename d1/d2/d4/d19/d2a/f47 to d1/d2/d23/d49/d4b/f5b 0 2024-04-23T14:49:52.383 INFO:tasks.workunit.client.0.smithi081.stdout:4/600: dread d1/d4/f63 [0,4194304] 0 2024-04-23T14:49:52.384 INFO:tasks.workunit.client.1.smithi156.stdout:3/311: mknod d4/db/dd/d1d/d1e/d42/c59 0 2024-04-23T14:49:52.386 INFO:tasks.workunit.client.0.smithi081.stdout:1/750: dwrite d3/d3d/d41/d92/da6/fdd [0,4194304] 0 2024-04-23T14:49:52.386 INFO:tasks.workunit.client.0.smithi081.stdout:1/751: stat d3/d3d/d41/d5e/d5d/db0/c69 0 2024-04-23T14:49:52.386 INFO:tasks.workunit.client.1.smithi156.stdout:1/369: read db/d25/d30/f53 [33138,73920] 0 2024-04-23T14:49:52.386 INFO:tasks.workunit.client.1.smithi156.stdout:1/370: fsync db/d25/d30/f53 0 2024-04-23T14:49:52.386 INFO:tasks.workunit.client.1.smithi156.stdout:0/333: dwrite d0/d16/d3a/d2a/f2c [0,4194304] 0 2024-04-23T14:49:52.392 INFO:tasks.workunit.client.1.smithi156.stdout:1/371: read db/d1f/d2f/d47/f5f [193458,106620] 0 2024-04-23T14:49:52.392 INFO:tasks.workunit.client.1.smithi156.stdout:1/372: write db/d25/d30/f43 [3156318,80304] 0 2024-04-23T14:49:52.392 INFO:tasks.workunit.client.1.smithi156.stdout:1/373: chown db/le 0 1 2024-04-23T14:49:52.392 INFO:tasks.workunit.client.1.smithi156.stdout:1/374: write db/d15/f22 [2041542,106433] 0 2024-04-23T14:49:52.392 INFO:tasks.workunit.client.1.smithi156.stdout:1/375: fdatasync db/d25/f26 0 2024-04-23T14:49:52.392 INFO:tasks.workunit.client.1.smithi156.stdout:1/376: truncate db/d1f/d28/f44 567317 0 2024-04-23T14:49:52.396 INFO:tasks.workunit.client.1.smithi156.stdout:7/350: sync 2024-04-23T14:49:52.400 INFO:tasks.workunit.client.1.smithi156.stdout:4/292: creat d0/df/d55/f62 x:0 0 0 2024-04-23T14:49:52.400 INFO:tasks.workunit.client.1.smithi156.stdout:4/293: fdatasync d0/d8/fc 0 2024-04-23T14:49:52.409 INFO:tasks.workunit.client.1.smithi156.stdout:2/319: creat d4/d13/d19/f77 x:0 0 0 2024-04-23T14:49:52.410 INFO:tasks.workunit.client.0.smithi081.stdout:9/649: symlink d3/d67/d77/ld0 0 2024-04-23T14:49:52.418 INFO:tasks.workunit.client.1.smithi156.stdout:1/377: dread db/d25/f64 [0,4194304] 0 2024-04-23T14:49:52.425 INFO:tasks.workunit.client.1.smithi156.stdout:9/267: unlink d1/d2/c32 0 2024-04-23T14:49:52.425 INFO:tasks.workunit.client.1.smithi156.stdout:3/312: mkdir d4/db/dd/d1d/d1e/d13/d5a 0 2024-04-23T14:49:52.425 INFO:tasks.workunit.client.1.smithi156.stdout:3/313: chown d4/l3d 2429 1 2024-04-23T14:49:52.429 INFO:tasks.workunit.client.1.smithi156.stdout:0/334: symlink d0/d4/d22/d58/l6c 0 2024-04-23T14:49:52.429 INFO:tasks.workunit.client.1.smithi156.stdout:0/335: write d0/d16/d3a/d2a/f12 [9122476,29779] 0 2024-04-23T14:49:52.430 INFO:tasks.workunit.client.0.smithi081.stdout:2/696: dread d1/f92 [0,4194304] 0 2024-04-23T14:49:52.434 INFO:tasks.workunit.client.1.smithi156.stdout:7/351: mknod dc/d2a/c63 0 2024-04-23T14:49:52.436 INFO:tasks.workunit.client.0.smithi081.stdout:2/697: mkdir d1/d33/d45/df1 0 2024-04-23T14:49:52.436 INFO:tasks.workunit.client.0.smithi081.stdout:2/698: chown d1/d33/d45/d6e 508 1 2024-04-23T14:49:52.442 INFO:tasks.workunit.client.1.smithi156.stdout:9/268: creat d1/d2/d4/f5c x:0 0 0 2024-04-23T14:49:52.443 INFO:tasks.workunit.client.0.smithi081.stdout:0/766: rename d6/d11/d14/d24/d6b to d6/d11/d14/d41/d5b/d3f/ded 0 2024-04-23T14:49:52.443 INFO:tasks.workunit.client.0.smithi081.stdout:9/650: dread d3/de/d25/f45 [0,4194304] 0 2024-04-23T14:49:52.443 INFO:tasks.workunit.client.0.smithi081.stdout:1/752: dwrite d3/d3d/d41/d5e/d17/d58/d7f/fe7 [0,4194304] 0 2024-04-23T14:49:52.443 INFO:tasks.workunit.client.0.smithi081.stdout:2/699: mknod d1/d11/d21/d34/cf2 0 2024-04-23T14:49:52.443 INFO:tasks.workunit.client.0.smithi081.stdout:2/700: chown d1/d11/d21/d34/l81 59633 1 2024-04-23T14:49:52.445 INFO:tasks.workunit.client.0.smithi081.stdout:2/701: write d1/d33/d45/f4a [807411,40387] 0 2024-04-23T14:49:52.445 INFO:tasks.workunit.client.0.smithi081.stdout:2/702: stat d1/d33/d9f/fb8 0 2024-04-23T14:49:52.445 INFO:tasks.workunit.client.1.smithi156.stdout:1/378: dread db/d25/f3b [0,4194304] 0 2024-04-23T14:49:52.446 INFO:tasks.workunit.client.1.smithi156.stdout:3/314: unlink d4/db/dd/d1d/f40 0 2024-04-23T14:49:52.447 INFO:tasks.workunit.client.1.smithi156.stdout:8/312: dwrite d5/d9/d10/d1d/d4c/f42 [4194304,4194304] 0 2024-04-23T14:49:52.448 INFO:tasks.workunit.client.0.smithi081.stdout:9/651: unlink d3/l8f 0 2024-04-23T14:49:52.448 INFO:tasks.workunit.client.0.smithi081.stdout:9/652: write d3/de/fbf [151535,33737] 0 2024-04-23T14:49:52.451 INFO:tasks.workunit.client.1.smithi156.stdout:0/336: truncate d0/d4/d11/d3f/f68 3201296 0 2024-04-23T14:49:52.452 INFO:tasks.workunit.client.0.smithi081.stdout:6/682: sync 2024-04-23T14:49:52.452 INFO:tasks.workunit.client.0.smithi081.stdout:3/618: sync 2024-04-23T14:49:52.452 INFO:tasks.workunit.client.0.smithi081.stdout:6/683: chown d1/d51/d65/d8/d2e/d59/db3 1 1 2024-04-23T14:49:52.452 INFO:tasks.workunit.client.0.smithi081.stdout:3/619: write d4/d7/df/d30/f80 [119185,80915] 0 2024-04-23T14:49:52.453 INFO:tasks.workunit.client.1.smithi156.stdout:7/352: creat dc/d1d/d41/f64 x:0 0 0 2024-04-23T14:49:52.455 INFO:tasks.workunit.client.1.smithi156.stdout:2/320: rmdir d4/d13/d19/d58 39 2024-04-23T14:49:52.455 INFO:tasks.workunit.client.1.smithi156.stdout:2/321: truncate d4/f62 1046136 0 2024-04-23T14:49:52.456 INFO:tasks.workunit.client.1.smithi156.stdout:5/393: dwrite d1/d11/d27/f2c [0,4194304] 0 2024-04-23T14:49:52.457 INFO:tasks.workunit.client.1.smithi156.stdout:5/394: fsync d1/d11/d27/f2c 0 2024-04-23T14:49:52.457 INFO:tasks.workunit.client.1.smithi156.stdout:5/395: write d1/d3/f49 [927091,16225] 0 2024-04-23T14:49:52.457 INFO:tasks.workunit.client.1.smithi156.stdout:6/389: dwrite d3/d16/f39 [0,4194304] 0 2024-04-23T14:49:52.457 INFO:tasks.workunit.client.1.smithi156.stdout:6/390: chown d3/da/f4f 1182440 1 2024-04-23T14:49:52.458 INFO:tasks.workunit.client.0.smithi081.stdout:1/753: creat d3/d3d/d41/d5e/d12/d1a/ff8 x:0 0 0 2024-04-23T14:49:52.458 INFO:tasks.workunit.client.0.smithi081.stdout:1/754: fsync d3/d3d/d41/d5e/d12/d1a/f86 0 2024-04-23T14:49:52.458 INFO:tasks.workunit.client.0.smithi081.stdout:1/755: chown d3/d3d/d41/d5e/d5d/db0/f46 10 1 2024-04-23T14:49:52.459 INFO:tasks.workunit.client.1.smithi156.stdout:9/269: creat d1/d2/d4/d17/d1f/f5d x:0 0 0 2024-04-23T14:49:52.459 INFO:tasks.workunit.client.1.smithi156.stdout:9/270: chown d1/d2/d4/d17 296 1 2024-04-23T14:49:52.460 INFO:tasks.workunit.client.0.smithi081.stdout:0/767: dread d6/d11/d14/d24/f4b [0,4194304] 0 2024-04-23T14:49:52.463 INFO:tasks.workunit.client.1.smithi156.stdout:1/379: mkdir db/d1f/d28/d70 0 2024-04-23T14:49:52.463 INFO:tasks.workunit.client.1.smithi156.stdout:1/380: chown db/d1f/d2f/d47/l58 125366185 1 2024-04-23T14:49:52.463 INFO:tasks.workunit.client.1.smithi156.stdout:1/381: chown db/d15/l2e 185572427 1 2024-04-23T14:49:52.463 INFO:tasks.workunit.client.0.smithi081.stdout:2/703: creat d1/d11/dab/ff3 x:0 0 0 2024-04-23T14:49:52.463 INFO:tasks.workunit.client.0.smithi081.stdout:2/704: creat d1/d1e/dad/ff4 x:0 0 0 2024-04-23T14:49:52.466 INFO:tasks.workunit.client.1.smithi156.stdout:3/315: rename d4/db/dd/d1d/d1e/d2b/l4a to d4/l5b 0 2024-04-23T14:49:52.466 INFO:tasks.workunit.client.1.smithi156.stdout:3/316: stat d4/db/d4b 0 2024-04-23T14:49:52.471 INFO:tasks.workunit.client.0.smithi081.stdout:2/705: read d1/f43 [140319,56557] 0 2024-04-23T14:49:52.471 INFO:tasks.workunit.client.0.smithi081.stdout:2/706: read d1/d11/f12 [1044196,48181] 0 2024-04-23T14:49:52.471 INFO:tasks.workunit.client.0.smithi081.stdout:9/653: creat d3/de/d47/fd1 x:0 0 0 2024-04-23T14:49:52.471 INFO:tasks.workunit.client.0.smithi081.stdout:6/684: stat d1/d51/d65/d13/d16/dd0/cde 0 2024-04-23T14:49:52.471 INFO:tasks.workunit.client.0.smithi081.stdout:6/685: chown d1/d51/d7b 67575867 1 2024-04-23T14:49:52.472 INFO:tasks.workunit.client.0.smithi081.stdout:4/601: write d1/d8f/fc1 [1517864,29088] 0 2024-04-23T14:49:52.473 INFO:tasks.workunit.client.1.smithi156.stdout:8/313: creat d5/d9/d36/f69 x:0 0 0 2024-04-23T14:49:52.473 INFO:tasks.workunit.client.1.smithi156.stdout:8/314: write d5/d9/f67 [256788,80057] 0 2024-04-23T14:49:52.474 INFO:tasks.workunit.client.1.smithi156.stdout:2/322: dread d4/d13/f14 [4194304,4194304] 0 2024-04-23T14:49:52.474 INFO:tasks.workunit.client.1.smithi156.stdout:2/323: readlink d4/d13/l6b 0 2024-04-23T14:49:52.475 INFO:tasks.workunit.client.1.smithi156.stdout:0/337: mknod d0/d16/d3a/d2a/c6d 0 2024-04-23T14:49:52.476 INFO:tasks.workunit.client.1.smithi156.stdout:4/294: dwrite d0/df/d55/f2e [0,4194304] 0 2024-04-23T14:49:52.476 INFO:tasks.workunit.client.1.smithi156.stdout:4/295: chown d0/df/d55 106975 1 2024-04-23T14:49:52.477 INFO:tasks.workunit.client.1.smithi156.stdout:7/353: getdents dc/d1d/d41/d53 0 2024-04-23T14:49:52.477 INFO:tasks.workunit.client.1.smithi156.stdout:7/354: read - dc/d2a/f3a zero size 2024-04-23T14:49:52.478 INFO:tasks.workunit.client.1.smithi156.stdout:2/324: read d4/f62 [451861,99634] 0 2024-04-23T14:49:52.479 INFO:tasks.workunit.client.0.smithi081.stdout:2/707: dread d1/d11/f29 [0,4194304] 0 2024-04-23T14:49:52.479 INFO:tasks.workunit.client.0.smithi081.stdout:0/768: creat d6/d11/d14/d24/db3/fee x:0 0 0 2024-04-23T14:49:52.482 INFO:tasks.workunit.client.1.smithi156.stdout:5/396: mknod d1/d11/d18/d19/c84 0 2024-04-23T14:49:52.486 INFO:tasks.workunit.client.1.smithi156.stdout:6/391: mkdir d3/d16/d46/d2b/d97 0 2024-04-23T14:49:52.486 INFO:tasks.workunit.client.1.smithi156.stdout:6/392: creat d3/da/d1d/d27/f98 x:0 0 0 2024-04-23T14:49:52.486 INFO:tasks.workunit.client.1.smithi156.stdout:6/393: write d3/da/d1d/f67 [768207,114076] 0 2024-04-23T14:49:52.490 INFO:tasks.workunit.client.0.smithi081.stdout:6/686: mkdir d1/d51/d65/d13/df4 0 2024-04-23T14:49:52.492 INFO:tasks.workunit.client.1.smithi156.stdout:1/382: mkdir db/d1f/d2f/d47/d71 0 2024-04-23T14:49:52.492 INFO:tasks.workunit.client.1.smithi156.stdout:1/383: chown db/d25/d30 253263 1 2024-04-23T14:49:52.498 INFO:tasks.workunit.client.0.smithi081.stdout:4/602: mknod d1/d4/d6f/d70/daf/d8c/dc2/cc9 0 2024-04-23T14:49:52.500 INFO:tasks.workunit.client.1.smithi156.stdout:3/317: mknod d4/db/c5c 0 2024-04-23T14:49:52.502 INFO:tasks.workunit.client.0.smithi081.stdout:7/564: rename d3/d11/d56 to d3/d21/d41/d7c/dc3 0 2024-04-23T14:49:52.506 INFO:tasks.workunit.client.1.smithi156.stdout:8/315: creat d5/d9/d5a/f6a x:0 0 0 2024-04-23T14:49:52.507 INFO:tasks.workunit.client.1.smithi156.stdout:8/316: readlink d5/d9/d5a/d5c/l5f 0 2024-04-23T14:49:52.507 INFO:tasks.workunit.client.1.smithi156.stdout:8/317: fsync d5/d9/d10/d1d/d21/f37 0 2024-04-23T14:49:52.508 INFO:tasks.workunit.client.1.smithi156.stdout:2/325: link d4/d13/d19/l1c d4/d13/d19/d58/l78 0 2024-04-23T14:49:52.509 INFO:tasks.workunit.client.1.smithi156.stdout:2/326: stat d4/d21/f67 0 2024-04-23T14:49:52.509 INFO:tasks.workunit.client.0.smithi081.stdout:1/756: dwrite d3/d3d/d7a/fe5 [0,4194304] 0 2024-04-23T14:49:52.509 INFO:tasks.workunit.client.0.smithi081.stdout:2/708: unlink d1/d33/d45/d6e/d96/f69 0 2024-04-23T14:49:52.509 INFO:tasks.workunit.client.0.smithi081.stdout:2/709: write d1/d33/d95/fc9 [1414583,22615] 0 2024-04-23T14:49:52.510 INFO:tasks.workunit.client.0.smithi081.stdout:2/710: fdatasync d1/d33/d45/d6e/d96/f63 0 2024-04-23T14:49:52.517 INFO:tasks.workunit.client.0.smithi081.stdout:0/769: link d6/d11/d14/f91 d6/d11/d14/d41/d5b/d59/d8e/fef 0 2024-04-23T14:49:52.517 INFO:tasks.workunit.client.0.smithi081.stdout:7/565: dread d3/d21/d41/d7c/f8f [0,4194304] 0 2024-04-23T14:49:52.517 INFO:tasks.workunit.client.0.smithi081.stdout:9/654: mkdir d3/de/d1d/d5b/d7b/d90/dd2 0 2024-04-23T14:49:52.517 INFO:tasks.workunit.client.0.smithi081.stdout:9/655: fsync d3/de/d22/fac 0 2024-04-23T14:49:52.518 INFO:tasks.workunit.client.1.smithi156.stdout:5/397: mkdir d1/d11/d18/d52/d85 0 2024-04-23T14:49:52.518 INFO:tasks.workunit.client.1.smithi156.stdout:5/398: truncate d1/d11/d18/f47 1212473 0 2024-04-23T14:49:52.520 INFO:tasks.workunit.client.0.smithi081.stdout:6/687: creat d1/d51/d65/d8/d2e/d59/ff5 x:0 0 0 2024-04-23T14:49:52.520 INFO:tasks.workunit.client.0.smithi081.stdout:6/688: chown d1/d2/d5a/l70 663 1 2024-04-23T14:49:52.521 INFO:tasks.workunit.client.0.smithi081.stdout:6/689: fsync d1/d51/d65/d8/db1/fe2 0 2024-04-23T14:49:52.521 INFO:tasks.workunit.client.0.smithi081.stdout:6/690: chown d1/d51/d65/d8/d2e/d59/ccb 205498 1 2024-04-23T14:49:52.522 INFO:tasks.workunit.client.1.smithi156.stdout:1/384: link db/d1f/d4b/l51 db/d1f/d2d/d48/l72 0 2024-04-23T14:49:52.523 INFO:tasks.workunit.client.1.smithi156.stdout:1/385: creat db/d25/d30/d38/f73 x:0 0 0 2024-04-23T14:49:52.525 INFO:tasks.workunit.client.0.smithi081.stdout:4/603: symlink d1/d1d/d39/lca 0 2024-04-23T14:49:52.525 INFO:tasks.workunit.client.0.smithi081.stdout:4/604: dread - d1/d4/d11/d9d/fb5 zero size 2024-04-23T14:49:52.526 INFO:tasks.workunit.client.1.smithi156.stdout:4/296: dwrite d0/d30/f3f [0,4194304] 0 2024-04-23T14:49:52.528 INFO:tasks.workunit.client.1.smithi156.stdout:3/318: symlink d4/db/dd/d20/l5d 0 2024-04-23T14:49:52.533 INFO:tasks.workunit.client.1.smithi156.stdout:8/318: mkdir d5/d9/d5a/d5c/d6b 0 2024-04-23T14:49:52.533 INFO:tasks.workunit.client.1.smithi156.stdout:8/319: getdents d5/d9/d5a/d5c/d6b 0 2024-04-23T14:49:52.534 INFO:tasks.workunit.client.1.smithi156.stdout:2/327: mkdir d4/d21/d42/d75/d79 0 2024-04-23T14:49:52.535 INFO:tasks.workunit.client.1.smithi156.stdout:2/328: creat d4/d26/f7a x:0 0 0 2024-04-23T14:49:52.535 INFO:tasks.workunit.client.1.smithi156.stdout:2/329: stat d4/d21/d76 0 2024-04-23T14:49:52.535 INFO:tasks.workunit.client.1.smithi156.stdout:9/271: dwrite d1/fe [0,4194304] 0 2024-04-23T14:49:52.535 INFO:tasks.workunit.client.1.smithi156.stdout:9/272: write d1/d2/d4/f5c [130755,121486] 0 2024-04-23T14:49:52.537 INFO:tasks.workunit.client.0.smithi081.stdout:2/711: dread d1/d33/d45/d6e/f8e [0,4194304] 0 2024-04-23T14:49:52.543 INFO:tasks.workunit.client.1.smithi156.stdout:5/399: mkdir d1/d3/d43/d4e/d86 0 2024-04-23T14:49:52.547 INFO:tasks.workunit.client.1.smithi156.stdout:1/386: creat db/d1f/d4b/f74 x:0 0 0 2024-04-23T14:49:52.547 INFO:tasks.workunit.client.1.smithi156.stdout:1/387: fsync db/d25/d30/f53 0 2024-04-23T14:49:52.547 INFO:tasks.workunit.client.1.smithi156.stdout:1/388: stat db/d25/f26 0 2024-04-23T14:49:52.547 INFO:tasks.workunit.client.1.smithi156.stdout:1/389: fsync db/f17 0 2024-04-23T14:49:52.549 INFO:tasks.workunit.client.1.smithi156.stdout:1/390: write db/d25/d30/f43 [1165509,55572] 0 2024-04-23T14:49:52.550 INFO:tasks.workunit.client.1.smithi156.stdout:4/297: truncate d0/df/f17 6486576 0 2024-04-23T14:49:52.553 INFO:tasks.workunit.client.1.smithi156.stdout:7/355: dwrite dc/f1e [0,4194304] 0 2024-04-23T14:49:52.558 INFO:tasks.workunit.client.1.smithi156.stdout:8/320: rmdir d5/d9/d5a/d5c 39 2024-04-23T14:49:52.558 INFO:tasks.workunit.client.1.smithi156.stdout:3/319: rename d4/db/dd/d20/d3e to d4/db/d5e 0 2024-04-23T14:49:52.558 INFO:tasks.workunit.client.1.smithi156.stdout:3/320: stat d4/db/dd/d1d/d1e/d13/f4c 0 2024-04-23T14:49:52.558 INFO:tasks.workunit.client.1.smithi156.stdout:3/321: readlink d4/db/dd/d20/l5d 0 2024-04-23T14:49:52.558 INFO:tasks.workunit.client.1.smithi156.stdout:0/338: dwrite d0/d16/d3a/d1e/f40 [0,4194304] 0 2024-04-23T14:49:52.559 INFO:tasks.workunit.client.1.smithi156.stdout:5/400: dread d1/d17/f2e [0,4194304] 0 2024-04-23T14:49:52.560 INFO:tasks.workunit.client.0.smithi081.stdout:7/566: truncate d3/d21/d31/d63/f74 6598 0 2024-04-23T14:49:52.564 INFO:tasks.workunit.client.0.smithi081.stdout:9/656: truncate d3/de/d1d/d54/f5f 1119401 0 2024-04-23T14:49:52.564 INFO:tasks.workunit.client.1.smithi156.stdout:6/394: dwrite d3/da/d1d/d27/d63/f96 [0,4194304] 0 2024-04-23T14:49:52.564 INFO:tasks.workunit.client.1.smithi156.stdout:2/330: symlink d4/d13/d19/d4c/d5c/d70/l7b 0 2024-04-23T14:49:52.566 INFO:tasks.workunit.client.1.smithi156.stdout:9/273: mknod d1/d2/d4/d17/d1f/d48/d4e/c5e 0 2024-04-23T14:49:52.566 INFO:tasks.workunit.client.1.smithi156.stdout:9/274: readlink d1/d2/l25 0 2024-04-23T14:49:52.568 INFO:tasks.workunit.client.1.smithi156.stdout:1/391: mkdir db/d1f/d2f/d47/d71/d75 0 2024-04-23T14:49:52.568 INFO:tasks.workunit.client.1.smithi156.stdout:1/392: stat db/d25/d6b 0 2024-04-23T14:49:52.569 INFO:tasks.workunit.client.1.smithi156.stdout:1/393: fdatasync db/f4f 0 2024-04-23T14:49:52.569 INFO:tasks.workunit.client.1.smithi156.stdout:1/394: write db/d25/f3d [4579497,73500] 0 2024-04-23T14:49:52.570 INFO:tasks.workunit.client.0.smithi081.stdout:6/691: mkdir d1/d2/d8e/df6 0 2024-04-23T14:49:52.573 INFO:tasks.workunit.client.0.smithi081.stdout:4/605: creat d1/d4/d11/d9d/dac/fcb x:0 0 0 2024-04-23T14:49:52.580 INFO:tasks.workunit.client.1.smithi156.stdout:7/356: creat dc/d46/d58/f65 x:0 0 0 2024-04-23T14:49:52.580 INFO:tasks.workunit.client.1.smithi156.stdout:7/357: fdatasync dc/d1d/d48/f5b 0 2024-04-23T14:49:52.580 INFO:tasks.workunit.client.0.smithi081.stdout:0/770: dwrite d6/d11/d14/d41/d5b/d59/fc9 [0,4194304] 0 2024-04-23T14:49:52.584 INFO:tasks.workunit.client.1.smithi156.stdout:5/401: dread d1/d3/d24/f57 [0,4194304] 0 2024-04-23T14:49:52.595 INFO:tasks.workunit.client.1.smithi156.stdout:3/322: write d4/db/dd/d1d/d1e/ff [3364781,23247] 0 2024-04-23T14:49:52.595 INFO:tasks.workunit.client.1.smithi156.stdout:7/358: dread dc/d1d/f32 [0,4194304] 0 2024-04-23T14:49:52.598 INFO:tasks.workunit.client.0.smithi081.stdout:1/757: getdents d3/d3d/d41/d92/da6 0 2024-04-23T14:49:52.599 INFO:tasks.workunit.client.0.smithi081.stdout:7/567: creat d3/d21/d41/dbb/fc4 x:0 0 0 2024-04-23T14:49:52.602 INFO:tasks.workunit.client.1.smithi156.stdout:2/331: rename d4/d21/d42/f53 to d4/d13/d19/d4c/d5c/d70/f7c 0 2024-04-23T14:49:52.602 INFO:tasks.workunit.client.1.smithi156.stdout:2/332: write d4/d13/d19/d58/f5b [253372,38605] 0 2024-04-23T14:49:52.604 INFO:tasks.workunit.client.0.smithi081.stdout:4/606: creat d1/d4/d6f/d70/daf/fcc x:0 0 0 2024-04-23T14:49:52.608 INFO:tasks.workunit.client.1.smithi156.stdout:1/395: fsync db/d1f/d4b/f74 0 2024-04-23T14:49:52.608 INFO:tasks.workunit.client.1.smithi156.stdout:5/402: rmdir d1/d11 39 2024-04-23T14:49:52.616 INFO:tasks.workunit.client.0.smithi081.stdout:2/712: dwrite d1/d11/fd6 [0,4194304] 0 2024-04-23T14:49:52.616 INFO:tasks.workunit.client.1.smithi156.stdout:3/323: dread d4/db/dd/d1d/f2e [0,4194304] 0 2024-04-23T14:49:52.622 INFO:tasks.workunit.client.1.smithi156.stdout:7/359: mknod dc/d2a/c66 0 2024-04-23T14:49:52.623 INFO:tasks.workunit.client.0.smithi081.stdout:3/620: rename d4/dc/d10 to d4/d7/d32/da6/dc4 0 2024-04-23T14:49:52.624 INFO:tasks.workunit.client.1.smithi156.stdout:9/275: rename d1/d2/l2b to d1/d2/d4/d40/d35/l5f 0 2024-04-23T14:49:52.625 INFO:tasks.workunit.client.1.smithi156.stdout:9/276: dread - d1/d2/d3e/f56 zero size 2024-04-23T14:49:52.631 INFO:tasks.workunit.client.1.smithi156.stdout:2/333: creat d4/f7d x:0 0 0 2024-04-23T14:49:52.632 INFO:tasks.workunit.client.1.smithi156.stdout:2/334: truncate d4/d13/f4b 1308713 0 2024-04-23T14:49:52.637 INFO:tasks.workunit.client.1.smithi156.stdout:4/298: dwrite d0/d8/fd [4194304,4194304] 0 2024-04-23T14:49:52.637 INFO:tasks.workunit.client.1.smithi156.stdout:8/321: dread d5/d9/f4b [0,4194304] 0 2024-04-23T14:49:52.637 INFO:tasks.workunit.client.1.smithi156.stdout:5/403: unlink d1/d11/d18/d19/l42 0 2024-04-23T14:49:52.639 INFO:tasks.workunit.client.1.smithi156.stdout:3/324: creat d4/db/dd/d20/d57/f5f x:0 0 0 2024-04-23T14:49:52.639 INFO:tasks.workunit.client.1.smithi156.stdout:3/325: dread - d4/db/dd/d1d/d1e/d13/f46 zero size 2024-04-23T14:49:52.639 INFO:tasks.workunit.client.1.smithi156.stdout:3/326: chown d4/db/dd 75 1 2024-04-23T14:49:52.643 INFO:tasks.workunit.client.0.smithi081.stdout:3/621: dread d4/d7/d32/f9c [0,4194304] 0 2024-04-23T14:49:52.648 INFO:tasks.workunit.client.0.smithi081.stdout:2/713: mkdir d1/d33/da3/df5 0 2024-04-23T14:49:52.649 INFO:tasks.workunit.client.1.smithi156.stdout:2/335: creat d4/d13/d19/d58/f7e x:0 0 0 2024-04-23T14:49:52.649 INFO:tasks.workunit.client.1.smithi156.stdout:9/277: read d1/d2/d4/dc/f22 [4135998,44192] 0 2024-04-23T14:49:52.649 INFO:tasks.workunit.client.1.smithi156.stdout:2/336: read - d4/d13/d19/d58/f63 zero size 2024-04-23T14:49:52.649 INFO:tasks.workunit.client.1.smithi156.stdout:9/278: read - d1/d2/d4/d17/f54 zero size 2024-04-23T14:49:52.653 INFO:tasks.workunit.client.0.smithi081.stdout:3/622: symlink d4/d7/d32/lc5 0 2024-04-23T14:49:52.654 INFO:tasks.workunit.client.1.smithi156.stdout:4/299: mkdir d0/df/d3a/d63 0 2024-04-23T14:49:52.657 INFO:tasks.workunit.client.1.smithi156.stdout:6/395: dwrite d3/d16/f5a [0,4194304] 0 2024-04-23T14:49:52.659 INFO:tasks.workunit.client.1.smithi156.stdout:0/339: dwrite d0/d16/d3a/d2a/d1d/d2d/f5b [0,4194304] 0 2024-04-23T14:49:52.659 INFO:tasks.workunit.client.0.smithi081.stdout:9/657: dwrite d3/de/d1d/d54/f6a [0,4194304] 0 2024-04-23T14:49:52.664 INFO:tasks.workunit.client.1.smithi156.stdout:8/322: rename d5/d9/d10/d1d/d21/f2f to d5/d4e/f6c 0 2024-04-23T14:49:52.667 INFO:tasks.workunit.client.1.smithi156.stdout:5/404: rmdir d1/d11 39 2024-04-23T14:49:52.671 INFO:tasks.workunit.client.0.smithi081.stdout:6/692: rename d1/d51/d65/d1c/d6e/da0 to d1/d51/d65/d13/d16/dd0/df7 0 2024-04-23T14:49:52.671 INFO:tasks.workunit.client.0.smithi081.stdout:6/693: dread - d1/d51/d65/d8/d2e/d59/d80/fe0 zero size 2024-04-23T14:49:52.678 INFO:tasks.workunit.client.0.smithi081.stdout:3/623: truncate d4/d7/d7f/d85/d9d/f74 3726653 0 2024-04-23T14:49:52.679 INFO:tasks.workunit.client.1.smithi156.stdout:3/327: symlink d4/db/dd/d1d/d1e/d13/d5a/l60 0 2024-04-23T14:49:52.679 INFO:tasks.workunit.client.1.smithi156.stdout:9/279: getdents d1/d2/d23/d49/d4b 0 2024-04-23T14:49:52.684 INFO:tasks.workunit.client.0.smithi081.stdout:8/874: sync 2024-04-23T14:49:52.684 INFO:tasks.workunit.client.0.smithi081.stdout:5/753: sync 2024-04-23T14:49:52.690 INFO:tasks.workunit.client.0.smithi081.stdout:8/875: write d3/d11/d3e/d63/d78/da0/ff2 [1014036,79114] 0 2024-04-23T14:49:52.691 INFO:tasks.workunit.client.0.smithi081.stdout:9/658: symlink d3/d67/d77/ld3 0 2024-04-23T14:49:52.691 INFO:tasks.workunit.client.0.smithi081.stdout:9/659: chown d3/f9 90 1 2024-04-23T14:49:52.694 INFO:tasks.workunit.client.0.smithi081.stdout:6/694: creat d1/d51/d65/d13/d16/dd0/ff8 x:0 0 0 2024-04-23T14:49:52.695 INFO:tasks.workunit.client.0.smithi081.stdout:6/695: truncate d1/d51/d65/d8/da4/fbd 1129092 0 2024-04-23T14:49:52.703 INFO:tasks.workunit.client.0.smithi081.stdout:2/714: dwrite d1/d11/d21/fc7 [0,4194304] 0 2024-04-23T14:49:52.705 INFO:tasks.workunit.client.0.smithi081.stdout:1/758: rename d3/d3d/d41/d5e/d17/d58/d7f/c53 to d3/d3d/d41/d5e/d5d/db0/cf9 0 2024-04-23T14:49:52.705 INFO:tasks.workunit.client.0.smithi081.stdout:8/876: symlink d3/d11/d4f/d66/l121 0 2024-04-23T14:49:52.707 INFO:tasks.workunit.client.1.smithi156.stdout:6/396: mknod d3/d16/d46/d2b/d97/c99 0 2024-04-23T14:49:52.707 INFO:tasks.workunit.client.1.smithi156.stdout:6/397: chown d3/da/d1d/d27/c4c 7711988 1 2024-04-23T14:49:52.708 INFO:tasks.workunit.client.0.smithi081.stdout:0/771: dwrite d6/d25/fc3 [4194304,4194304] 0 2024-04-23T14:49:52.708 INFO:tasks.workunit.client.0.smithi081.stdout:0/772: creat d6/d37/d85/ff0 x:0 0 0 2024-04-23T14:49:52.710 INFO:tasks.workunit.client.1.smithi156.stdout:1/396: dwrite db/d1f/d2d/f6e [0,4194304] 0 2024-04-23T14:49:52.711 INFO:tasks.workunit.client.1.smithi156.stdout:1/397: creat db/d1f/f76 x:0 0 0 2024-04-23T14:49:52.711 INFO:tasks.workunit.client.1.smithi156.stdout:8/323: unlink d5/d9/f1f 0 2024-04-23T14:49:52.715 INFO:tasks.workunit.client.0.smithi081.stdout:9/660: truncate d3/de/d25/f8e 335972 0 2024-04-23T14:49:52.723 INFO:tasks.workunit.client.1.smithi156.stdout:2/337: rename d4/d13/c59 to d4/d21/d42/d75/d79/c7f 0 2024-04-23T14:49:52.729 INFO:tasks.workunit.client.1.smithi156.stdout:5/405: link d1/d3/l7 d1/d3/d20/d3e/l87 0 2024-04-23T14:49:52.735 INFO:tasks.workunit.client.0.smithi081.stdout:1/759: symlink d3/d3d/d41/d5e/da0/lfa 0 2024-04-23T14:49:52.735 INFO:tasks.workunit.client.0.smithi081.stdout:1/760: chown d3/d3d/d41/d5e/d17/d58/f61 117 1 2024-04-23T14:49:52.735 INFO:tasks.workunit.client.0.smithi081.stdout:0/773: dread d6/d11/d14/d41/d5b/f47 [0,4194304] 0 2024-04-23T14:49:52.735 INFO:tasks.workunit.client.0.smithi081.stdout:0/774: readlink d6/d11/d14/d41/d5b/le0 0 2024-04-23T14:49:52.736 INFO:tasks.workunit.client.1.smithi156.stdout:9/280: mknod d1/d2/d4/d17/d1f/d48/d4e/c60 0 2024-04-23T14:49:52.740 INFO:tasks.workunit.client.0.smithi081.stdout:7/568: rename d3/d21/d31/d63/f82 to d3/d21/d41/d7c/fc5 0 2024-04-23T14:49:52.743 INFO:tasks.workunit.client.1.smithi156.stdout:6/398: link d3/f6b d3/da/d1d/d27/d80/f9a 0 2024-04-23T14:49:52.753 INFO:tasks.workunit.client.0.smithi081.stdout:4/607: dwrite d1/d4/dc/f14 [0,4194304] 0 2024-04-23T14:49:52.755 INFO:tasks.workunit.client.0.smithi081.stdout:1/761: write d3/d3d/d41/d5e/d12/d1a/fb1 [1346180,55277] 0 2024-04-23T14:49:52.759 INFO:tasks.workunit.client.0.smithi081.stdout:8/877: symlink d3/d11/d48/d7e/de4/df0/l122 0 2024-04-23T14:49:52.764 INFO:tasks.workunit.client.1.smithi156.stdout:1/398: symlink db/d25/d4e/d5d/l77 0 2024-04-23T14:49:52.764 INFO:tasks.workunit.client.1.smithi156.stdout:1/399: creat db/d25/d30/f78 x:0 0 0 2024-04-23T14:49:52.764 INFO:tasks.workunit.client.0.smithi081.stdout:0/775: mknod d6/d11/d14/db8/cf1 0 2024-04-23T14:49:52.767 INFO:tasks.workunit.client.0.smithi081.stdout:2/715: rename d1/d1e/cbf to d1/d11/d21/d52/d8b/d8f/de8/cf6 0 2024-04-23T14:49:52.767 INFO:tasks.workunit.client.0.smithi081.stdout:2/716: dread - d1/d1e/dad/ff4 zero size 2024-04-23T14:49:52.768 INFO:tasks.workunit.client.0.smithi081.stdout:2/717: write d1/f5 [1602110,108633] 0 2024-04-23T14:49:52.768 INFO:tasks.workunit.client.0.smithi081.stdout:2/718: chown d1/d33/d45/d48/c83 136076920 1 2024-04-23T14:49:52.768 INFO:tasks.workunit.client.1.smithi156.stdout:8/324: mkdir d5/d39/d6d 0 2024-04-23T14:49:52.768 INFO:tasks.workunit.client.1.smithi156.stdout:8/325: readlink d5/d9/le 0 2024-04-23T14:49:52.769 INFO:tasks.workunit.client.0.smithi081.stdout:7/569: creat d3/d21/d31/fc6 x:0 0 0 2024-04-23T14:49:52.769 INFO:tasks.workunit.client.0.smithi081.stdout:7/570: write d3/d11/d2c/f34 [4216473,130668] 0 2024-04-23T14:49:52.772 INFO:tasks.workunit.client.1.smithi156.stdout:0/340: dwrite d0/d4/f4e [0,4194304] 0 2024-04-23T14:49:52.773 INFO:tasks.workunit.client.1.smithi156.stdout:0/341: creat d0/d16/d3a/d1e/f6e x:0 0 0 2024-04-23T14:49:52.773 INFO:tasks.workunit.client.1.smithi156.stdout:4/300: rename d0/f41 to d0/df/f64 0 2024-04-23T14:49:52.773 INFO:tasks.workunit.client.1.smithi156.stdout:4/301: fdatasync d0/d8/f40 0 2024-04-23T14:49:52.773 INFO:tasks.workunit.client.1.smithi156.stdout:5/406: unlink d1/d3/d20/d3e/f83 0 2024-04-23T14:49:52.774 INFO:tasks.workunit.client.0.smithi081.stdout:1/762: mknod d3/d3d/d41/d5e/dd2/dd5/df2/cfb 0 2024-04-23T14:49:52.775 INFO:tasks.workunit.client.0.smithi081.stdout:0/776: creat d6/d11/d14/d41/d5b/d3f/ff2 x:0 0 0 2024-04-23T14:49:52.776 INFO:tasks.workunit.client.1.smithi156.stdout:6/399: creat d3/d16/d5c/d6f/f9b x:0 0 0 2024-04-23T14:49:52.779 INFO:tasks.workunit.client.0.smithi081.stdout:8/878: rename d3/d11/d48/d7e/de4/df0/c115 to d3/d11/d3e/d63/d78/c123 0 2024-04-23T14:49:52.781 INFO:tasks.workunit.client.1.smithi156.stdout:8/326: creat d5/d9/d10/f6e x:0 0 0 2024-04-23T14:49:52.781 INFO:tasks.workunit.client.1.smithi156.stdout:8/327: rename d5 to d5/d9/d36/d60/d6f 22 2024-04-23T14:49:52.784 INFO:tasks.workunit.client.0.smithi081.stdout:9/661: dread d3/de/d14/f6b [0,4194304] 0 2024-04-23T14:49:52.785 INFO:tasks.workunit.client.1.smithi156.stdout:3/328: dwrite d4/db/dd/f25 [0,4194304] 0 2024-04-23T14:49:52.785 INFO:tasks.workunit.client.1.smithi156.stdout:3/329: chown d4/db/dd/d1d/d1e/d13/f4c 79607076 1 2024-04-23T14:49:52.785 INFO:tasks.workunit.client.1.smithi156.stdout:1/400: dread db/d25/f3b [0,4194304] 0 2024-04-23T14:49:52.785 INFO:tasks.workunit.client.1.smithi156.stdout:1/401: chown db/d1f 173 1 2024-04-23T14:49:52.786 INFO:tasks.workunit.client.1.smithi156.stdout:7/360: dwrite dc/f1c [4194304,4194304] 0 2024-04-23T14:49:52.786 INFO:tasks.workunit.client.1.smithi156.stdout:4/302: creat d0/df/d21/d36/f65 x:0 0 0 2024-04-23T14:49:52.787 INFO:tasks.workunit.client.1.smithi156.stdout:5/407: truncate d1/d3/fd 2128091 0 2024-04-23T14:49:52.788 INFO:tasks.workunit.client.1.smithi156.stdout:5/408: chown d1/l5a 0 1 2024-04-23T14:49:52.788 INFO:tasks.workunit.client.1.smithi156.stdout:5/409: fdatasync d1/d11/f5e 0 2024-04-23T14:49:52.788 INFO:tasks.workunit.client.1.smithi156.stdout:2/338: dwrite d4/d13/d19/d4c/f68 [0,4194304] 0 2024-04-23T14:49:52.788 INFO:tasks.workunit.client.1.smithi156.stdout:4/303: write d0/df/f64 [4439308,125421] 0 2024-04-23T14:49:52.790 INFO:tasks.workunit.client.0.smithi081.stdout:1/763: symlink d3/d3d/d41/d5e/d17/d25/dda/lfc 0 2024-04-23T14:49:52.790 INFO:tasks.workunit.client.0.smithi081.stdout:0/777: link d6/d11/d14/d24/c1b d6/d37/d85/dd6/cf3 0 2024-04-23T14:49:52.790 INFO:tasks.workunit.client.0.smithi081.stdout:9/662: truncate d3/de/d76/db5/fbd 278028 0 2024-04-23T14:49:52.793 INFO:tasks.workunit.client.1.smithi156.stdout:6/400: mkdir d3/da/d1d/d59/d9c 0 2024-04-23T14:49:52.794 INFO:tasks.workunit.client.1.smithi156.stdout:8/328: mknod d5/d39/c70 0 2024-04-23T14:49:52.794 INFO:tasks.workunit.client.0.smithi081.stdout:5/754: dwrite d17/d18/dff/d9a/fde [4194304,4194304] 0 2024-04-23T14:49:52.795 INFO:tasks.workunit.client.0.smithi081.stdout:1/764: truncate d3/d3d/faa 29353 0 2024-04-23T14:49:52.797 INFO:tasks.workunit.client.1.smithi156.stdout:3/330: mkdir d4/db/dd/d1d/d61 0 2024-04-23T14:49:52.801 INFO:tasks.workunit.client.1.smithi156.stdout:9/281: dwrite d1/d2/d4/d17/d1f/f5d [0,4194304] 0 2024-04-23T14:49:52.805 INFO:tasks.workunit.client.1.smithi156.stdout:7/361: mkdir dc/d1d/d41/d53/d67 0 2024-04-23T14:49:52.808 INFO:tasks.workunit.client.0.smithi081.stdout:5/755: mkdir d17/d3d/d41/d109 0 2024-04-23T14:49:52.810 INFO:tasks.workunit.client.1.smithi156.stdout:1/402: dread db/f11 [0,4194304] 0 2024-04-23T14:49:52.811 INFO:tasks.workunit.client.0.smithi081.stdout:1/765: rmdir d3/d3d/d90 39 2024-04-23T14:49:52.811 INFO:tasks.workunit.client.0.smithi081.stdout:1/766: readlink d3/d3d/d41/l87 0 2024-04-23T14:49:52.812 INFO:tasks.workunit.client.0.smithi081.stdout:9/663: symlink d3/de/d1d/d5b/d7b/d90/ld4 0 2024-04-23T14:49:52.815 INFO:tasks.workunit.client.0.smithi081.stdout:5/756: truncate d17/d3c/fbe 1960829 0 2024-04-23T14:49:52.816 INFO:tasks.workunit.client.1.smithi156.stdout:2/339: truncate d4/f16 2941385 0 2024-04-23T14:49:52.816 INFO:tasks.workunit.client.1.smithi156.stdout:2/340: dread - d4/f7d zero size 2024-04-23T14:49:52.816 INFO:tasks.workunit.client.0.smithi081.stdout:4/608: dwrite d1/d4/d6f/f9f [0,4194304] 0 2024-04-23T14:49:52.818 INFO:tasks.workunit.client.1.smithi156.stdout:4/304: rmdir d0/d8/d54 0 2024-04-23T14:49:52.819 INFO:tasks.workunit.client.0.smithi081.stdout:1/767: unlink d3/d3d/d41/d5e/d17/d58/d7f/fe7 0 2024-04-23T14:49:52.820 INFO:tasks.workunit.client.0.smithi081.stdout:1/768: write d3/d3d/d41/d5e/d17/d25/f74 [87016,68203] 0 2024-04-23T14:49:52.820 INFO:tasks.workunit.client.1.smithi156.stdout:6/401: mkdir d3/d16/d46/d9d 0 2024-04-23T14:49:52.821 INFO:tasks.workunit.client.1.smithi156.stdout:8/329: write d5/d45/f4f [1234938,58418] 0 2024-04-23T14:49:52.828 INFO:tasks.workunit.client.0.smithi081.stdout:8/879: dwrite d3/d11/d48/fc2 [0,4194304] 0 2024-04-23T14:49:52.829 INFO:tasks.workunit.client.1.smithi156.stdout:9/282: rename d1/d2/d4/d19/d2a/d30/f34 to d1/d2/d4/d40/f61 0 2024-04-23T14:49:52.830 INFO:tasks.workunit.client.0.smithi081.stdout:5/757: mkdir d17/d18/d3a/d8e/d10a 0 2024-04-23T14:49:52.830 INFO:tasks.workunit.client.0.smithi081.stdout:5/758: chown d17/d1f/d42/f50 11843 1 2024-04-23T14:49:52.831 INFO:tasks.workunit.client.1.smithi156.stdout:7/362: mkdir dc/d2c/d68 0 2024-04-23T14:49:52.833 INFO:tasks.workunit.client.0.smithi081.stdout:4/609: mknod d1/d4/d6f/d70/daf/d8c/d99/ccd 0 2024-04-23T14:49:52.833 INFO:tasks.workunit.client.1.smithi156.stdout:2/341: stat d4/d13/c2e 0 2024-04-23T14:49:52.837 INFO:tasks.workunit.client.0.smithi081.stdout:0/778: dwrite d6/d11/d14/d41/fd1 [0,4194304] 0 2024-04-23T14:49:52.837 INFO:tasks.workunit.client.1.smithi156.stdout:4/305: symlink d0/d8/d1e/d4a/l66 0 2024-04-23T14:49:52.839 INFO:tasks.workunit.client.0.smithi081.stdout:9/664: getdents d3/d67/d77 0 2024-04-23T14:49:52.839 INFO:tasks.workunit.client.0.smithi081.stdout:9/665: readlink d3/de/d1d/d54/l79 0 2024-04-23T14:49:52.839 INFO:tasks.workunit.client.0.smithi081.stdout:9/666: stat d3/de/d14 0 2024-04-23T14:49:52.840 INFO:tasks.workunit.client.0.smithi081.stdout:9/667: write d3/de/d14/d5e/d72/fc1 [982412,117987] 0 2024-04-23T14:49:52.841 INFO:tasks.workunit.client.1.smithi156.stdout:6/402: mkdir d3/d16/d46/d2b/d3b/d9e 0 2024-04-23T14:49:52.843 INFO:tasks.workunit.client.1.smithi156.stdout:8/330: symlink d5/d9/d10/d1d/d21/l71 0 2024-04-23T14:49:52.844 INFO:tasks.workunit.client.0.smithi081.stdout:1/769: write d3/d3d/d41/d5e/d5d/db0/f46 [3698027,32764] 0 2024-04-23T14:49:52.846 INFO:tasks.workunit.client.0.smithi081.stdout:8/880: creat d3/d11/f124 x:0 0 0 2024-04-23T14:49:52.846 INFO:tasks.workunit.client.0.smithi081.stdout:8/881: fdatasync d3/f2f 0 2024-04-23T14:49:52.850 INFO:tasks.workunit.client.1.smithi156.stdout:1/403: rename db/ff to db/d1f/f79 0 2024-04-23T14:49:52.850 INFO:tasks.workunit.client.1.smithi156.stdout:1/404: creat db/d1f/f7a x:0 0 0 2024-04-23T14:49:52.851 INFO:tasks.workunit.client.1.smithi156.stdout:1/405: fdatasync db/d25/d30/f78 0 2024-04-23T14:49:52.851 INFO:tasks.workunit.client.1.smithi156.stdout:1/406: creat db/d1f/d2f/f7b x:0 0 0 2024-04-23T14:49:52.851 INFO:tasks.workunit.client.1.smithi156.stdout:1/407: write db/d1f/d2f/f56 [5133410,15194] 0 2024-04-23T14:49:52.853 INFO:tasks.workunit.client.1.smithi156.stdout:9/283: symlink d1/d2/d3e/d50/l62 0 2024-04-23T14:49:52.858 INFO:tasks.workunit.client.1.smithi156.stdout:7/363: rmdir dc/d1d/d41/d53/d67 0 2024-04-23T14:49:52.860 INFO:tasks.workunit.client.0.smithi081.stdout:9/668: rename d3/d5/dcb to d3/de/d1d/d5b/d7b/db2/dd5 0 2024-04-23T14:49:52.860 INFO:tasks.workunit.client.1.smithi156.stdout:5/410: dwrite d1/d11/d27/f2c [0,4194304] 0 2024-04-23T14:49:52.860 INFO:tasks.workunit.client.1.smithi156.stdout:5/411: dread - d1/f38 zero size 2024-04-23T14:49:52.866 INFO:tasks.workunit.client.0.smithi081.stdout:1/770: mkdir d3/d3d/d41/d5e/d12/dfd 0 2024-04-23T14:49:52.866 INFO:tasks.workunit.client.0.smithi081.stdout:5/759: dread d17/d18/dff/d9a/fde [4194304,4194304] 0 2024-04-23T14:49:52.868 INFO:tasks.workunit.client.0.smithi081.stdout:8/882: creat d3/d11/d86/d88/dd5/f125 x:0 0 0 2024-04-23T14:49:52.868 INFO:tasks.workunit.client.1.smithi156.stdout:4/306: symlink d0/df/d3a/l67 0 2024-04-23T14:49:52.868 INFO:tasks.workunit.client.1.smithi156.stdout:6/403: mkdir d3/d16/d46/d9d/d9f 0 2024-04-23T14:49:52.871 INFO:tasks.workunit.client.1.smithi156.stdout:0/342: truncate d0/d16/d3a/d2a/f12 715555 0 2024-04-23T14:49:52.874 INFO:tasks.workunit.client.1.smithi156.stdout:2/342: dread d4/d13/d19/d4c/f60 [0,4194304] 0 2024-04-23T14:49:52.877 INFO:tasks.workunit.client.0.smithi081.stdout:9/669: symlink d3/de/d1d/d5b/ld6 0 2024-04-23T14:49:52.877 INFO:tasks.workunit.client.0.smithi081.stdout:9/670: stat d3/de/d14/d5e/d72/cc5 0 2024-04-23T14:49:52.884 INFO:tasks.workunit.client.0.smithi081.stdout:5/760: link d17/d18/dff/l52 d17/d18/dff/l10b 0 2024-04-23T14:49:52.884 INFO:tasks.workunit.client.0.smithi081.stdout:5/761: write d17/fa0 [1392352,126010] 0 2024-04-23T14:49:52.890 INFO:tasks.workunit.client.0.smithi081.stdout:8/883: truncate d3/d11/d48/d7e/f95 717106 0 2024-04-23T14:49:52.901 INFO:tasks.workunit.client.0.smithi081.stdout:5/762: truncate d17/d3d/fa1 2157319 0 2024-04-23T14:49:52.901 INFO:tasks.workunit.client.0.smithi081.stdout:5/763: readlink l15 0 2024-04-23T14:49:52.907 INFO:tasks.workunit.client.0.smithi081.stdout:8/884: getdents d3/d11/d86/d88 0 2024-04-23T14:49:52.914 INFO:tasks.workunit.client.0.smithi081.stdout:8/885: symlink d3/l126 0 2024-04-23T14:49:52.914 INFO:tasks.workunit.client.0.smithi081.stdout:8/886: write d3/d11/d34/f68 [568567,104678] 0 2024-04-23T14:49:52.918 INFO:tasks.workunit.client.0.smithi081.stdout:4/610: dwrite d1/fa [4194304,4194304] 0 2024-04-23T14:49:52.918 INFO:tasks.workunit.client.0.smithi081.stdout:8/887: mkdir d3/d11/d3e/d63/d78/da0/d127 0 2024-04-23T14:49:52.918 INFO:tasks.workunit.client.0.smithi081.stdout:4/611: fsync d1/d1d/d39/d8d/f90 0 2024-04-23T14:49:52.923 INFO:tasks.workunit.client.0.smithi081.stdout:9/671: dwrite d3/de/d1d/d5b/fa3 [0,4194304] 0 2024-04-23T14:49:52.923 INFO:tasks.workunit.client.1.smithi156.stdout:6/404: dread d3/d16/f30 [0,4194304] 0 2024-04-23T14:49:52.924 INFO:tasks.workunit.client.0.smithi081.stdout:8/888: creat d3/d11/d86/d88/da7/f128 x:0 0 0 2024-04-23T14:49:52.927 INFO:tasks.workunit.client.1.smithi156.stdout:8/331: getdents d5/d9/d36 0 2024-04-23T14:49:52.927 INFO:tasks.workunit.client.1.smithi156.stdout:8/332: chown d5/d9/l1b 730766 1 2024-04-23T14:49:52.927 INFO:tasks.workunit.client.1.smithi156.stdout:8/333: dread - d5/d45/f55 zero size 2024-04-23T14:49:52.928 INFO:tasks.workunit.client.0.smithi081.stdout:4/612: write d1/d1d/d39/f3c [708213,111630] 0 2024-04-23T14:49:52.930 INFO:tasks.workunit.client.0.smithi081.stdout:1/771: dwrite d3/d3d/d41/d4a/d77/f98 [4194304,4194304] 0 2024-04-23T14:49:52.934 INFO:tasks.workunit.client.1.smithi156.stdout:9/284: dwrite d1/d2/d4/f5a [0,4194304] 0 2024-04-23T14:49:52.934 INFO:tasks.workunit.client.1.smithi156.stdout:9/285: readlink d1/d2/l25 0 2024-04-23T14:49:52.936 INFO:tasks.workunit.client.1.smithi156.stdout:4/307: dwrite d0/d8/d1e/d4a/f50 [0,4194304] 0 2024-04-23T14:49:52.936 INFO:tasks.workunit.client.0.smithi081.stdout:8/889: mknod d3/c129 0 2024-04-23T14:49:52.937 INFO:tasks.workunit.client.0.smithi081.stdout:0/779: dwrite d6/f4f [0,4194304] 0 2024-04-23T14:49:52.937 INFO:tasks.workunit.client.0.smithi081.stdout:0/780: chown d6/d11/d14/d41/da1 13396208 1 2024-04-23T14:49:52.940 INFO:tasks.workunit.client.0.smithi081.stdout:4/613: mkdir d1/d4/d6f/d70/daf/d8c/dce 0 2024-04-23T14:49:52.955 INFO:tasks.workunit.client.0.smithi081.stdout:1/772: write d3/f51 [3705244,76392] 0 2024-04-23T14:49:52.955 INFO:tasks.workunit.client.0.smithi081.stdout:1/773: write d3/d3d/d41/d5e/d12/d2e/fc5 [4329797,44268] 0 2024-04-23T14:49:52.957 INFO:tasks.workunit.client.0.smithi081.stdout:4/614: creat d1/d4f/fcf x:0 0 0 2024-04-23T14:49:52.957 INFO:tasks.workunit.client.0.smithi081.stdout:8/890: dread d3/d3c/f97 [0,4194304] 0 2024-04-23T14:49:52.957 INFO:tasks.workunit.client.0.smithi081.stdout:4/615: write d1/d1d/f26 [992147,100666] 0 2024-04-23T14:49:52.957 INFO:tasks.workunit.client.0.smithi081.stdout:4/616: write d1/d4/f5d [1634415,46763] 0 2024-04-23T14:49:52.961 INFO:tasks.workunit.client.0.smithi081.stdout:8/891: mknod d3/d11/d48/d7e/c12a 0 2024-04-23T14:49:52.961 INFO:tasks.workunit.client.0.smithi081.stdout:8/892: creat d3/d11/d48/dc1/f12b x:0 0 0 2024-04-23T14:49:52.968 INFO:tasks.workunit.client.0.smithi081.stdout:4/617: truncate d1/d1d/f52 832777 0 2024-04-23T14:49:52.968 INFO:tasks.workunit.client.0.smithi081.stdout:4/618: chown d1/d1d/f97 2122 1 2024-04-23T14:49:52.968 INFO:tasks.workunit.client.1.smithi156.stdout:8/334: dwrite d5/d9/d10/d1d/d21/f22 [0,4194304] 0 2024-04-23T14:49:52.979 INFO:tasks.workunit.client.1.smithi156.stdout:2/343: getdents d4/d13/d19/d4c/d5c/d70 0 2024-04-23T14:49:52.982 INFO:tasks.workunit.client.1.smithi156.stdout:9/286: link d1/d2/d4/dc/f41 d1/d2/d4/d17/d1f/f63 0 2024-04-23T14:49:52.998 INFO:tasks.workunit.client.1.smithi156.stdout:1/408: rename db/d1f/d4b to db/d25/d66/d7c 0 2024-04-23T14:49:52.998 INFO:tasks.workunit.client.1.smithi156.stdout:8/335: unlink d5/d9/d10/d1d/f51 0 2024-04-23T14:49:52.998 INFO:tasks.workunit.client.1.smithi156.stdout:1/409: write db/d25/f3d [1868700,71282] 0 2024-04-23T14:49:52.998 INFO:tasks.workunit.client.1.smithi156.stdout:1/410: readlink db/d25/d30/d38/d40/l49 0 2024-04-23T14:49:52.998 INFO:tasks.workunit.client.1.smithi156.stdout:6/405: rmdir d3/d16/d5c/d6f 39 2024-04-23T14:49:52.999 INFO:tasks.workunit.client.0.smithi081.stdout:9/672: write d3/de/d1d/d54/f5f [880404,75262] 0 2024-04-23T14:49:53.000 INFO:tasks.workunit.client.1.smithi156.stdout:9/287: rmdir d1/d2/d4/d17/d1f/d48 39 2024-04-23T14:49:53.002 INFO:tasks.workunit.client.1.smithi156.stdout:7/364: rename dc/d2c/l4d to dc/d2a/d59/l69 0 2024-04-23T14:49:53.002 INFO:tasks.workunit.client.1.smithi156.stdout:8/336: getdents d5/d45 0 2024-04-23T14:49:53.005 INFO:tasks.workunit.client.1.smithi156.stdout:1/411: creat db/d1f/d28/d70/f7d x:0 0 0 2024-04-23T14:49:53.007 INFO:tasks.workunit.client.1.smithi156.stdout:6/406: creat d3/da/fa0 x:0 0 0 2024-04-23T14:49:53.008 INFO:tasks.workunit.client.1.smithi156.stdout:9/288: symlink d1/d2/d4/d17/d1f/d48/l64 0 2024-04-23T14:49:53.009 INFO:tasks.workunit.client.0.smithi081.stdout:1/774: dwrite d3/d3d/d41/d5e/d5d/db0/f89 [0,4194304] 0 2024-04-23T14:49:53.009 INFO:tasks.workunit.client.0.smithi081.stdout:1/775: fsync d3/d3d/d41/d5e/d5d/db0/f46 0 2024-04-23T14:49:53.009 INFO:tasks.workunit.client.1.smithi156.stdout:9/289: creat d1/d2/d4/d19/d2a/f65 x:0 0 0 2024-04-23T14:49:53.016 INFO:tasks.workunit.client.1.smithi156.stdout:5/412: rename d1/d3/d43/d4e/f7a to d1/d3/d64/f88 0 2024-04-23T14:49:53.016 INFO:tasks.workunit.client.1.smithi156.stdout:5/413: chown d1/d3 2758 1 2024-04-23T14:49:53.018 INFO:tasks.workunit.client.1.smithi156.stdout:7/365: creat dc/d2a/f6a x:0 0 0 2024-04-23T14:49:53.018 INFO:tasks.workunit.client.1.smithi156.stdout:7/366: creat dc/d1d/d48/f6b x:0 0 0 2024-04-23T14:49:53.018 INFO:tasks.workunit.client.0.smithi081.stdout:9/673: dread d3/d5/f6 [0,4194304] 0 2024-04-23T14:49:53.023 INFO:tasks.workunit.client.1.smithi156.stdout:5/414: read d1/d3/f49 [773579,108260] 0 2024-04-23T14:49:53.023 INFO:tasks.workunit.client.1.smithi156.stdout:5/415: write d1/d11/d18/d52/f7f [725735,107342] 0 2024-04-23T14:49:53.023 INFO:tasks.workunit.client.1.smithi156.stdout:8/337: creat d5/d9/d5a/d5c/f72 x:0 0 0 2024-04-23T14:49:53.023 INFO:tasks.workunit.client.1.smithi156.stdout:8/338: write d5/d9/d36/f69 [893597,20082] 0 2024-04-23T14:49:53.028 INFO:tasks.workunit.client.1.smithi156.stdout:6/407: symlink d3/da/d1d/la1 0 2024-04-23T14:49:53.028 INFO:tasks.workunit.client.1.smithi156.stdout:9/290: mkdir d1/d2/d3e/d55/d66 0 2024-04-23T14:49:53.034 INFO:tasks.workunit.client.0.smithi081.stdout:0/781: dwrite d6/d11/d14/d41/d5b/d59/fc9 [0,4194304] 0 2024-04-23T14:49:53.034 INFO:tasks.workunit.client.0.smithi081.stdout:0/782: dread - d6/d11/d14/d41/d5b/d3f/ff2 zero size 2024-04-23T14:49:53.034 INFO:tasks.workunit.client.0.smithi081.stdout:0/783: stat d6/d11/d14/d41/d5b/d3f/d44/d76/fc2 0 2024-04-23T14:49:53.034 INFO:tasks.workunit.client.0.smithi081.stdout:1/776: dread d3/d3d/d41/d5e/d5d/db0/f89 [0,4194304] 0 2024-04-23T14:49:53.037 INFO:tasks.workunit.client.0.smithi081.stdout:9/674: symlink d3/de/d14/d5e/d72/ld7 0 2024-04-23T14:49:53.043 INFO:tasks.workunit.client.1.smithi156.stdout:0/343: rename d0/d16/d3a/d2a/d1d/d2d/f2f to d0/d16/d3a/d2b/f6f 0 2024-04-23T14:49:53.043 INFO:tasks.workunit.client.1.smithi156.stdout:7/367: mkdir dc/d1d/d41/d53/d6c 0 2024-04-23T14:49:53.043 INFO:tasks.workunit.client.1.smithi156.stdout:7/368: stat dc/d1d/d41/f57 0 2024-04-23T14:49:53.044 INFO:tasks.workunit.client.0.smithi081.stdout:0/784: link d6/d37/cb2 d6/d11/cf4 0 2024-04-23T14:49:53.049 INFO:tasks.workunit.client.0.smithi081.stdout:1/777: dread d3/d3d/d6f/f62 [0,4194304] 0 2024-04-23T14:49:53.053 INFO:tasks.workunit.client.1.smithi156.stdout:5/416: symlink d1/d17/d7e/l89 0 2024-04-23T14:49:53.053 INFO:tasks.workunit.client.1.smithi156.stdout:5/417: readlink d1/d3/d20/d3e/l62 0 2024-04-23T14:49:53.053 INFO:tasks.workunit.client.1.smithi156.stdout:5/418: truncate d1/d11/f4d 1697178 0 2024-04-23T14:49:53.053 INFO:tasks.workunit.client.1.smithi156.stdout:8/339: mknod d5/d9/d10/d1d/c73 0 2024-04-23T14:49:53.053 INFO:tasks.workunit.client.1.smithi156.stdout:8/340: stat d5/d4e/f66 0 2024-04-23T14:49:53.053 INFO:tasks.workunit.client.1.smithi156.stdout:9/291: link d1/d2/d4/d40/d35/l5f d1/d2/d4/d19/d2a/l67 0 2024-04-23T14:49:53.055 INFO:tasks.workunit.client.1.smithi156.stdout:3/331: sync 2024-04-23T14:49:53.055 INFO:tasks.workunit.client.1.smithi156.stdout:3/332: readlink d4/l3d 0 2024-04-23T14:49:53.059 INFO:tasks.workunit.client.1.smithi156.stdout:2/344: dwrite d4/d21/d42/f6e [0,4194304] 0 2024-04-23T14:49:53.060 INFO:tasks.workunit.client.0.smithi081.stdout:8/893: dwrite d3/dc6/fc9 [0,4194304] 0 2024-04-23T14:49:53.060 INFO:tasks.workunit.client.0.smithi081.stdout:8/894: chown d3/d3c/l10e 253515611 1 2024-04-23T14:49:53.061 INFO:tasks.workunit.client.1.smithi156.stdout:0/344: mknod d0/d16/d3a/d2a/d1d/d2d/d6b/c70 0 2024-04-23T14:49:53.064 INFO:tasks.workunit.client.0.smithi081.stdout:9/675: rename d3/de/d1d/d5b/ld6 to d3/de/d1d/d62/ld8 0 2024-04-23T14:49:53.066 INFO:tasks.workunit.client.1.smithi156.stdout:7/369: rename dc/l1f to dc/l6d 0 2024-04-23T14:49:53.066 INFO:tasks.workunit.client.1.smithi156.stdout:7/370: dread - dc/d1d/d48/f5b zero size 2024-04-23T14:49:53.071 INFO:tasks.workunit.client.0.smithi081.stdout:1/778: dread d3/f51 [0,4194304] 0 2024-04-23T14:49:53.071 INFO:tasks.workunit.client.0.smithi081.stdout:1/779: write d3/d3d/d41/d5e/d17/d25/f74 [921167,21807] 0 2024-04-23T14:49:53.071 INFO:tasks.workunit.client.0.smithi081.stdout:1/780: write d3/d3d/d41/d5e/d17/d58/fcb [330469,50150] 0 2024-04-23T14:49:53.073 INFO:tasks.workunit.client.0.smithi081.stdout:5/764: dwrite d17/d37/f6e [0,4194304] 0 2024-04-23T14:49:53.074 INFO:tasks.workunit.client.1.smithi156.stdout:5/419: mknod d1/d11/d18/d19/d74/c8a 0 2024-04-23T14:49:53.074 INFO:tasks.workunit.client.1.smithi156.stdout:8/341: symlink d5/d9/d5a/d5c/d6b/l74 0 2024-04-23T14:49:53.075 INFO:tasks.workunit.client.1.smithi156.stdout:7/371: write dc/d1d/d24/f49 [581197,76707] 0 2024-04-23T14:49:53.076 INFO:tasks.workunit.client.1.smithi156.stdout:9/292: mknod d1/d2/d23/c68 0 2024-04-23T14:49:53.079 INFO:tasks.workunit.client.1.smithi156.stdout:3/333: creat d4/db/dd/d1d/d61/f62 x:0 0 0 2024-04-23T14:49:53.080 INFO:tasks.workunit.client.0.smithi081.stdout:1/781: dread d3/d3d/d41/f5f [0,4194304] 0 2024-04-23T14:49:53.082 INFO:tasks.workunit.client.1.smithi156.stdout:6/408: dwrite d3/da/d1d/d27/f31 [0,4194304] 0 2024-04-23T14:49:53.082 INFO:tasks.workunit.client.1.smithi156.stdout:1/412: dwrite db/f11 [0,4194304] 0 2024-04-23T14:49:53.082 INFO:tasks.workunit.client.1.smithi156.stdout:6/409: creat d3/da/fa2 x:0 0 0 2024-04-23T14:49:53.082 INFO:tasks.workunit.client.1.smithi156.stdout:6/410: write d3/d16/d5c/d6a/f91 [69664,76007] 0 2024-04-23T14:49:53.082 INFO:tasks.workunit.client.1.smithi156.stdout:6/411: fdatasync d3/da/f62 0 2024-04-23T14:49:53.082 INFO:tasks.workunit.client.1.smithi156.stdout:6/412: write d3/d16/f37 [798385,73551] 0 2024-04-23T14:49:53.083 INFO:tasks.workunit.client.1.smithi156.stdout:0/345: read d0/d4/f25 [1523361,75763] 0 2024-04-23T14:49:53.088 INFO:tasks.workunit.client.1.smithi156.stdout:2/345: symlink d4/d26/d3c/l80 0 2024-04-23T14:49:53.092 INFO:tasks.workunit.client.1.smithi156.stdout:5/420: creat d1/d17/d7e/f8b x:0 0 0 2024-04-23T14:49:53.092 INFO:tasks.workunit.client.1.smithi156.stdout:8/342: write d5/d9/d10/f11 [4070933,122633] 0 2024-04-23T14:49:53.092 INFO:tasks.workunit.client.1.smithi156.stdout:8/343: creat d5/d9/d5a/f75 x:0 0 0 2024-04-23T14:49:53.097 INFO:tasks.workunit.client.1.smithi156.stdout:4/308: rename d0/df/d21/d36 to d0/df/d55/d68 0 2024-04-23T14:49:53.097 INFO:tasks.workunit.client.1.smithi156.stdout:4/309: creat d0/df/d21/f69 x:0 0 0 2024-04-23T14:49:53.097 INFO:tasks.workunit.client.0.smithi081.stdout:8/895: creat d3/d11/d3e/f12c x:0 0 0 2024-04-23T14:49:53.100 INFO:tasks.workunit.client.1.smithi156.stdout:3/334: link d4/l3d d4/db/dd/d1d/d1e/d13/l63 0 2024-04-23T14:49:53.106 INFO:tasks.workunit.client.1.smithi156.stdout:6/413: link d3/f34 d3/d16/d46/d9d/d9f/fa3 0 2024-04-23T14:49:53.108 INFO:tasks.workunit.client.1.smithi156.stdout:0/346: creat d0/d4/d11/d3f/d5f/f71 x:0 0 0 2024-04-23T14:49:53.109 INFO:tasks.workunit.client.1.smithi156.stdout:0/347: chown d0/d16/d3a/d2a/d1d 634586635 1 2024-04-23T14:49:53.109 INFO:tasks.workunit.client.1.smithi156.stdout:9/293: read d1/d2/d23/d49/d4b/f5b [1888758,55757] 0 2024-04-23T14:49:53.109 INFO:tasks.workunit.client.1.smithi156.stdout:9/294: write d1/d2/d4/dc/f22 [3855088,59660] 0 2024-04-23T14:49:53.112 INFO:tasks.workunit.client.0.smithi081.stdout:1/782: rename d3/d3d/d41/d5e/d17/d25/c35 to d3/cfe 0 2024-04-23T14:49:53.115 INFO:tasks.workunit.client.0.smithi081.stdout:8/896: getdents d3 0 2024-04-23T14:49:53.117 INFO:tasks.workunit.client.1.smithi156.stdout:5/421: write d1/d11/f13 [2942825,126684] 0 2024-04-23T14:49:53.118 INFO:tasks.workunit.client.1.smithi156.stdout:5/422: rename d1/d3/d24 to d1/d3/d24/d8c 22 2024-04-23T14:49:53.118 INFO:tasks.workunit.client.1.smithi156.stdout:5/423: write d1/d3/f3a [819118,125287] 0 2024-04-23T14:49:53.121 INFO:tasks.workunit.client.0.smithi081.stdout:9/676: mkdir d3/de/d1d/dd9 0 2024-04-23T14:49:53.123 INFO:tasks.workunit.client.0.smithi081.stdout:0/785: dwrite d6/d69/fa0 [0,4194304] 0 2024-04-23T14:49:53.125 INFO:tasks.workunit.client.1.smithi156.stdout:8/344: unlink d5/d4e/f5d 0 2024-04-23T14:49:53.130 INFO:tasks.workunit.client.0.smithi081.stdout:1/783: creat d3/fff x:0 0 0 2024-04-23T14:49:53.133 INFO:tasks.workunit.client.0.smithi081.stdout:9/677: dread d3/de/d76/db5/fbd [0,4194304] 0 2024-04-23T14:49:53.133 INFO:tasks.workunit.client.0.smithi081.stdout:9/678: fdatasync d3/de/d1d/d54/f89 0 2024-04-23T14:49:53.136 INFO:tasks.workunit.client.0.smithi081.stdout:5/765: dwrite d17/d18/dff/d59/fc1 [0,4194304] 0 2024-04-23T14:49:53.136 INFO:tasks.workunit.client.0.smithi081.stdout:5/766: chown l15 122403 1 2024-04-23T14:49:53.140 INFO:tasks.workunit.client.1.smithi156.stdout:4/310: truncate d0/df/f14 3005241 0 2024-04-23T14:49:53.142 INFO:tasks.workunit.client.0.smithi081.stdout:9/679: unlink d3/de/d25/f59 0 2024-04-23T14:49:53.144 INFO:tasks.workunit.client.0.smithi081.stdout:5/767: symlink d17/d1f/d42/d9b/l10c 0 2024-04-23T14:49:53.145 INFO:tasks.workunit.client.0.smithi081.stdout:5/768: write d17/d37/d4e/f101 [505336,76550] 0 2024-04-23T14:49:53.147 INFO:tasks.workunit.client.0.smithi081.stdout:9/680: creat d3/de/d14/dab/fda x:0 0 0 2024-04-23T14:49:53.147 INFO:tasks.workunit.client.0.smithi081.stdout:8/897: dread d3/d3c/f84 [0,4194304] 0 2024-04-23T14:49:53.147 INFO:tasks.workunit.client.0.smithi081.stdout:8/898: chown d3/d3c/ddb 7 1 2024-04-23T14:49:53.149 INFO:tasks.workunit.client.0.smithi081.stdout:5/769: symlink d17/d37/d4e/dc3/l10d 0 2024-04-23T14:49:53.149 INFO:tasks.workunit.client.0.smithi081.stdout:5/770: read - d17/d4a/f8c zero size 2024-04-23T14:49:53.152 INFO:tasks.workunit.client.1.smithi156.stdout:8/345: dread d5/d9/d10/f11 [0,4194304] 0 2024-04-23T14:49:53.152 INFO:tasks.workunit.client.1.smithi156.stdout:7/372: dwrite dc/d2c/f50 [0,4194304] 0 2024-04-23T14:49:53.154 INFO:tasks.workunit.client.0.smithi081.stdout:8/899: write d3/d11/d34/f57 [4207781,83752] 0 2024-04-23T14:49:53.158 INFO:tasks.workunit.client.1.smithi156.stdout:3/335: mknod d4/db/dd/d1d/d1e/c64 0 2024-04-23T14:49:53.158 INFO:tasks.workunit.client.1.smithi156.stdout:3/336: write d4/db/dd/d1d/d61/f62 [459038,124205] 0 2024-04-23T14:49:53.159 INFO:tasks.workunit.client.0.smithi081.stdout:5/771: creat d17/d3c/d55/d64/dcc/f10e x:0 0 0 2024-04-23T14:49:53.160 INFO:tasks.workunit.client.1.smithi156.stdout:6/414: mknod d3/d16/d46/d2b/ca4 0 2024-04-23T14:49:53.160 INFO:tasks.workunit.client.1.smithi156.stdout:6/415: write d3/da/f1a [5406238,78080] 0 2024-04-23T14:49:53.160 INFO:tasks.workunit.client.0.smithi081.stdout:5/772: symlink d17/df3/l10f 0 2024-04-23T14:49:53.160 INFO:tasks.workunit.client.0.smithi081.stdout:5/773: write d17/d18/dff/d9a/fe8 [786226,44777] 0 2024-04-23T14:49:53.161 INFO:tasks.workunit.client.1.smithi156.stdout:0/348: creat d0/d4/d11/d3f/f72 x:0 0 0 2024-04-23T14:49:53.162 INFO:tasks.workunit.client.1.smithi156.stdout:0/349: write d0/d4/d11/d3f/d5f/f71 [974758,65093] 0 2024-04-23T14:49:53.162 INFO:tasks.workunit.client.1.smithi156.stdout:0/350: read d0/d4/f25 [614222,83009] 0 2024-04-23T14:49:53.162 INFO:tasks.workunit.client.1.smithi156.stdout:0/351: write d0/d16/d3a/d2b/d44/d4a/f4c [146708,65018] 0 2024-04-23T14:49:53.162 INFO:tasks.workunit.client.1.smithi156.stdout:9/295: mknod d1/d2/d4/d40/c69 0 2024-04-23T14:49:53.163 INFO:tasks.workunit.client.0.smithi081.stdout:5/774: link d17/c8b d17/df8/c110 0 2024-04-23T14:49:53.163 INFO:tasks.workunit.client.0.smithi081.stdout:5/775: chown d17/d1f/d42/d9b/d9e/da3/cb2 484 1 2024-04-23T14:49:53.163 INFO:tasks.workunit.client.0.smithi081.stdout:5/776: readlink d17/d65/de3/d108/db1/lda 0 2024-04-23T14:49:53.163 INFO:tasks.workunit.client.0.smithi081.stdout:5/777: getdents d17/d65/de3/d108/dd8 0 2024-04-23T14:49:53.164 INFO:tasks.workunit.client.1.smithi156.stdout:5/424: mknod d1/d11/d18/d19/c8d 0 2024-04-23T14:49:53.165 INFO:tasks.workunit.client.1.smithi156.stdout:2/346: getdents d4/d26/d3c 0 2024-04-23T14:49:53.166 INFO:tasks.workunit.client.0.smithi081.stdout:5/778: creat d17/d18/dff/d59/da8/f111 x:0 0 0 2024-04-23T14:49:53.166 INFO:tasks.workunit.client.0.smithi081.stdout:5/779: creat d17/d3d/d41/f112 x:0 0 0 2024-04-23T14:49:53.166 INFO:tasks.workunit.client.1.smithi156.stdout:4/311: mknod d0/c6a 0 2024-04-23T14:49:53.167 INFO:tasks.workunit.client.1.smithi156.stdout:4/312: creat d0/df/f6b x:0 0 0 2024-04-23T14:49:53.167 INFO:tasks.workunit.client.1.smithi156.stdout:9/296: dread d1/d2/d4/f5c [0,4194304] 0 2024-04-23T14:49:53.171 INFO:tasks.workunit.client.1.smithi156.stdout:8/346: mknod d5/d9/d36/c76 0 2024-04-23T14:49:53.173 INFO:tasks.workunit.client.0.smithi081.stdout:5/780: symlink d17/d4f/d61/l113 0 2024-04-23T14:49:53.173 INFO:tasks.workunit.client.0.smithi081.stdout:1/784: dread d3/d3d/d41/d5e/dd2/fd4 [0,4194304] 0 2024-04-23T14:49:53.173 INFO:tasks.workunit.client.0.smithi081.stdout:1/785: creat d3/d3d/d90/de0/f100 x:0 0 0 2024-04-23T14:49:53.179 INFO:tasks.workunit.client.0.smithi081.stdout:5/781: unlink d17/d1f/f23 0 2024-04-23T14:49:53.179 INFO:tasks.workunit.client.0.smithi081.stdout:5/782: stat d17/d18/d3a/d8e/de6/fee 0 2024-04-23T14:49:53.179 INFO:tasks.workunit.client.0.smithi081.stdout:5/783: fsync d17/d18/f2e 0 2024-04-23T14:49:53.179 INFO:tasks.workunit.client.0.smithi081.stdout:5/784: stat d17/d65/l78 0 2024-04-23T14:49:53.184 INFO:tasks.workunit.client.1.smithi156.stdout:7/373: creat dc/d1d/f6e x:0 0 0 2024-04-23T14:49:53.184 INFO:tasks.workunit.client.1.smithi156.stdout:7/374: stat dc/f17 0 2024-04-23T14:49:53.184 INFO:tasks.workunit.client.0.smithi081.stdout:5/785: creat d17/d4a/f114 x:0 0 0 2024-04-23T14:49:53.185 INFO:tasks.workunit.client.1.smithi156.stdout:3/337: mknod d4/db/dd/d1d/c65 0 2024-04-23T14:49:53.186 INFO:tasks.workunit.client.1.smithi156.stdout:2/347: write d4/d13/f14 [5054530,14415] 0 2024-04-23T14:49:53.187 INFO:tasks.workunit.client.0.smithi081.stdout:0/786: dwrite d6/d11/db0/fbe [0,4194304] 0 2024-04-23T14:49:53.187 INFO:tasks.workunit.client.0.smithi081.stdout:0/787: creat d6/d11/d14/d41/d5b/d3f/d44/d78/d83/ff5 x:0 0 0 2024-04-23T14:49:53.187 INFO:tasks.workunit.client.0.smithi081.stdout:0/788: dread - d6/d11/d14/db8/fbf zero size 2024-04-23T14:49:53.187 INFO:tasks.workunit.client.0.smithi081.stdout:0/789: creat d6/d11/d14/d41/d5b/d3f/d44/ff6 x:0 0 0 2024-04-23T14:49:53.187 INFO:tasks.workunit.client.1.smithi156.stdout:6/416: mkdir d3/da/d1d/d27/d80/da5 0 2024-04-23T14:49:53.188 INFO:tasks.workunit.client.1.smithi156.stdout:6/417: write d3/da/d1d/d27/f51 [754602,19096] 0 2024-04-23T14:49:53.188 INFO:tasks.workunit.client.1.smithi156.stdout:6/418: fdatasync d3/da/d1d/d27/d63/f8c 0 2024-04-23T14:49:53.189 INFO:tasks.workunit.client.0.smithi081.stdout:5/786: rename d17/c35 to d17/d3d/c115 0 2024-04-23T14:49:53.189 INFO:tasks.workunit.client.0.smithi081.stdout:5/787: truncate d17/d3d/d7a/ff6 87646 0 2024-04-23T14:49:53.190 INFO:tasks.workunit.client.1.smithi156.stdout:0/352: rename d0/d4/f20 to d0/d16/d3a/d2a/d1d/d2d/f73 0 2024-04-23T14:49:53.190 INFO:tasks.workunit.client.1.smithi156.stdout:0/353: dread - d0/d16/d3a/d1e/f5d zero size 2024-04-23T14:49:53.191 INFO:tasks.workunit.client.1.smithi156.stdout:0/354: fdatasync d0/d16/d3a/d2a/d1d/d2d/f5b 0 2024-04-23T14:49:53.192 INFO:tasks.workunit.client.1.smithi156.stdout:5/425: truncate d1/d3/d24/f58 2807551 0 2024-04-23T14:49:53.193 INFO:tasks.workunit.client.0.smithi081.stdout:1/786: dread d3/d3d/d41/d5e/d17/d26/f31 [4194304,4194304] 0 2024-04-23T14:49:53.194 INFO:tasks.workunit.client.0.smithi081.stdout:8/900: dread d3/d3c/f52 [0,4194304] 0 2024-04-23T14:49:53.194 INFO:tasks.workunit.client.0.smithi081.stdout:8/901: write d3/dc6/f11c [381405,129282] 0 2024-04-23T14:49:53.194 INFO:tasks.workunit.client.0.smithi081.stdout:8/902: chown d3/d11/d86/d88/c11b 126474717 1 2024-04-23T14:49:53.197 INFO:tasks.workunit.client.0.smithi081.stdout:0/790: creat d6/d11/d14/dec/ff7 x:0 0 0 2024-04-23T14:49:53.198 INFO:tasks.workunit.client.1.smithi156.stdout:4/313: link d0/d30/l35 d0/df/d21/l6c 0 2024-04-23T14:49:53.200 INFO:tasks.workunit.client.0.smithi081.stdout:5/788: creat d17/df8/f116 x:0 0 0 2024-04-23T14:49:53.201 INFO:tasks.workunit.client.1.smithi156.stdout:8/347: creat d5/d9/d10/d1d/d21/f77 x:0 0 0 2024-04-23T14:49:53.201 INFO:tasks.workunit.client.1.smithi156.stdout:8/348: readlink d5/l4a 0 2024-04-23T14:49:53.205 INFO:tasks.workunit.client.1.smithi156.stdout:2/348: creat d4/f81 x:0 0 0 2024-04-23T14:49:53.205 INFO:tasks.workunit.client.1.smithi156.stdout:2/349: write d4/d26/f7a [1037168,36648] 0 2024-04-23T14:49:53.205 INFO:tasks.workunit.client.1.smithi156.stdout:0/355: mknod d0/d16/d3a/d2b/d44/c74 0 2024-04-23T14:49:53.206 INFO:tasks.workunit.client.1.smithi156.stdout:5/426: mknod d1/d11/d18/c8e 0 2024-04-23T14:49:53.210 INFO:tasks.workunit.client.0.smithi081.stdout:1/787: dread d3/d3d/d41/d5e/d17/d58/f61 [0,4194304] 0 2024-04-23T14:49:53.210 INFO:tasks.workunit.client.1.smithi156.stdout:8/349: symlink d5/d9/d5a/d57/l78 0 2024-04-23T14:49:53.213 INFO:tasks.workunit.client.0.smithi081.stdout:1/788: rename d3/cfe to d3/d3d/d41/d5e/d12/dfd/c101 0 2024-04-23T14:49:53.214 INFO:tasks.workunit.client.0.smithi081.stdout:1/789: chown d3/d3d 70 1 2024-04-23T14:49:53.219 INFO:tasks.workunit.client.0.smithi081.stdout:5/789: dread d17/d18/dff/d9a/fe8 [0,4194304] 0 2024-04-23T14:49:53.221 INFO:tasks.workunit.client.0.smithi081.stdout:5/790: rename d17/d3d/c94 to d17/d4f/d61/dba/c117 0 2024-04-23T14:49:53.234 INFO:tasks.workunit.client.1.smithi156.stdout:1/413: sync 2024-04-23T14:49:53.238 INFO:tasks.workunit.client.1.smithi156.stdout:1/414: rename db/d1f/d28/l33 to db/d25/d30/d38/d40/l7e 0 2024-04-23T14:49:53.244 INFO:tasks.workunit.client.1.smithi156.stdout:1/415: symlink db/d1f/d2f/l7f 0 2024-04-23T14:49:53.244 INFO:tasks.workunit.client.1.smithi156.stdout:1/416: chown db/d1f/l6a 0 1 2024-04-23T14:49:53.244 INFO:tasks.workunit.client.1.smithi156.stdout:8/350: dread d5/f28 [0,4194304] 0 2024-04-23T14:49:53.245 INFO:tasks.workunit.client.1.smithi156.stdout:8/351: symlink d5/d9/d10/d1d/d4c/l79 0 2024-04-23T14:49:53.251 INFO:tasks.workunit.client.1.smithi156.stdout:8/352: rename d5/f28 to d5/d9/d10/d1d/f7a 0 2024-04-23T14:49:53.253 INFO:tasks.workunit.client.1.smithi156.stdout:8/353: creat d5/d9/d5a/d5c/d6b/f7b x:0 0 0 2024-04-23T14:49:53.253 INFO:tasks.workunit.client.1.smithi156.stdout:6/419: dread d3/d16/f39 [0,4194304] 0 2024-04-23T14:49:53.253 INFO:tasks.workunit.client.1.smithi156.stdout:6/420: creat d3/da/d1d/d27/fa6 x:0 0 0 2024-04-23T14:49:53.254 INFO:tasks.workunit.client.1.smithi156.stdout:9/297: dwrite d1/f51 [0,4194304] 0 2024-04-23T14:49:53.260 INFO:tasks.workunit.client.1.smithi156.stdout:5/427: write d1/d11/f4d [846108,84187] 0 2024-04-23T14:49:53.260 INFO:tasks.workunit.client.1.smithi156.stdout:8/354: mkdir d5/d9/d36/d60/d7c 0 2024-04-23T14:49:53.260 INFO:tasks.workunit.client.1.smithi156.stdout:1/417: dread db/d1f/d28/f44 [0,4194304] 0 2024-04-23T14:49:53.261 INFO:tasks.workunit.client.1.smithi156.stdout:1/418: chown db/d15/l14 211265413 1 2024-04-23T14:49:53.262 INFO:tasks.workunit.client.1.smithi156.stdout:6/421: symlink d3/d16/d46/d2b/d3b/d9e/la7 0 2024-04-23T14:49:53.264 INFO:tasks.workunit.client.1.smithi156.stdout:7/375: dwrite dc/d1d/d24/f62 [0,4194304] 0 2024-04-23T14:49:53.264 INFO:tasks.workunit.client.1.smithi156.stdout:7/376: truncate dc/d46/f31 1495406 0 2024-04-23T14:49:53.264 INFO:tasks.workunit.client.1.smithi156.stdout:7/377: chown dc/d46/l40 531821776 1 2024-04-23T14:49:53.264 INFO:tasks.workunit.client.1.smithi156.stdout:1/419: rename db/d25/f26 to db/d25/d30/d38/f80 0 2024-04-23T14:49:53.273 INFO:tasks.workunit.client.1.smithi156.stdout:1/420: mkdir db/d25/d66/d81 0 2024-04-23T14:49:53.274 INFO:tasks.workunit.client.1.smithi156.stdout:6/422: rmdir d3/da/d1d/d27/d80 39 2024-04-23T14:49:53.276 INFO:tasks.workunit.client.1.smithi156.stdout:7/378: creat dc/d1d/d24/d5a/f6f x:0 0 0 2024-04-23T14:49:53.276 INFO:tasks.workunit.client.1.smithi156.stdout:7/379: readlink dc/le 0 2024-04-23T14:49:53.277 INFO:tasks.workunit.client.1.smithi156.stdout:7/380: fsync dc/d2c/f50 0 2024-04-23T14:49:53.277 INFO:tasks.workunit.client.1.smithi156.stdout:8/355: write d5/d9/d10/d1d/d4c/f56 [3458284,29547] 0 2024-04-23T14:49:53.277 INFO:tasks.workunit.client.1.smithi156.stdout:8/356: chown d5/d9/d10/d1d/d4c/c3a 0 1 2024-04-23T14:49:53.277 INFO:tasks.workunit.client.1.smithi156.stdout:4/314: dwrite d0/d8/fc [0,4194304] 0 2024-04-23T14:49:53.278 INFO:tasks.workunit.client.1.smithi156.stdout:4/315: fsync d0/d8/d1e/f49 0 2024-04-23T14:49:53.283 INFO:tasks.workunit.client.0.smithi081.stdout:1/790: dwrite d3/d3d/d41/d5e/d5d/db0/f75 [0,4194304] 0 2024-04-23T14:49:53.284 INFO:tasks.workunit.client.1.smithi156.stdout:3/338: dwrite d4/db/dd/d1d/f49 [0,4194304] 0 2024-04-23T14:49:53.284 INFO:tasks.workunit.client.0.smithi081.stdout:5/791: dwrite d17/d65/dd2/fdd [0,4194304] 0 2024-04-23T14:49:53.285 INFO:tasks.workunit.client.1.smithi156.stdout:0/356: dwrite d0/d16/d3a/d2a/d1d/f17 [4194304,4194304] 0 2024-04-23T14:49:53.285 INFO:tasks.workunit.client.1.smithi156.stdout:1/421: mknod db/d1f/d34/d63/c82 0 2024-04-23T14:49:53.285 INFO:tasks.workunit.client.0.smithi081.stdout:1/791: rmdir d3/de1 0 2024-04-23T14:49:53.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:52 smithi156 ceph-mon[32341]: pgmap v35: 65 pgs: 65 active+clean; 1.9 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 122 MiB/s rd, 143 MiB/s wr, 224 op/s 2024-04-23T14:49:53.289 INFO:tasks.workunit.client.1.smithi156.stdout:6/423: mknod d3/d16/d46/d2b/d6e/d8f/ca8 0 2024-04-23T14:49:53.291 INFO:tasks.workunit.client.1.smithi156.stdout:7/381: creat dc/d46/f70 x:0 0 0 2024-04-23T14:49:53.291 INFO:tasks.workunit.client.1.smithi156.stdout:7/382: dread - dc/d1d/f6e zero size 2024-04-23T14:49:53.296 INFO:tasks.workunit.client.0.smithi081.stdout:5/792: dread d17/d4a/f5b [0,4194304] 0 2024-04-23T14:49:53.300 INFO:tasks.workunit.client.1.smithi156.stdout:0/357: dread d0/d4/d11/d3f/f68 [0,4194304] 0 2024-04-23T14:49:53.301 INFO:tasks.workunit.client.1.smithi156.stdout:4/316: symlink d0/d30/l6d 0 2024-04-23T14:49:53.307 INFO:tasks.workunit.client.0.smithi081.stdout:1/792: rename d3/d3d/d41/d5e/d12/d1a/c28 to d3/d3d/d41/d5e/d12/dfd/c102 0 2024-04-23T14:49:53.307 INFO:tasks.workunit.client.0.smithi081.stdout:1/793: dread - d3/d3d/d41/d5e/dd2/fdf zero size 2024-04-23T14:49:53.312 INFO:tasks.workunit.client.1.smithi156.stdout:1/422: symlink db/d1f/l83 0 2024-04-23T14:49:53.312 INFO:tasks.workunit.client.1.smithi156.stdout:5/428: write d1/d11/d27/f2c [1814788,43231] 0 2024-04-23T14:49:53.312 INFO:tasks.workunit.client.1.smithi156.stdout:6/424: mknod d3/d16/d1e/ca9 0 2024-04-23T14:49:53.313 INFO:tasks.workunit.client.0.smithi081.stdout:6/696: sync 2024-04-23T14:49:53.313 INFO:tasks.workunit.client.0.smithi081.stdout:3/624: sync 2024-04-23T14:49:53.313 INFO:tasks.workunit.client.0.smithi081.stdout:4/619: sync 2024-04-23T14:49:53.313 INFO:tasks.workunit.client.0.smithi081.stdout:3/625: fsync d4/dc/d50/d9a/fa5 0 2024-04-23T14:49:53.313 INFO:tasks.workunit.client.0.smithi081.stdout:2/719: sync 2024-04-23T14:49:53.314 INFO:tasks.workunit.client.0.smithi081.stdout:5/793: dread d17/d3c/f3e [0,4194304] 0 2024-04-23T14:49:53.314 INFO:tasks.workunit.client.0.smithi081.stdout:7/571: sync 2024-04-23T14:49:53.314 INFO:tasks.workunit.client.0.smithi081.stdout:7/572: chown d3/d21/d31/l47 343 1 2024-04-23T14:49:53.314 INFO:tasks.workunit.client.0.smithi081.stdout:7/573: read - d3/d21/d31/d33/d4b/d71/fbf zero size 2024-04-23T14:49:53.314 INFO:tasks.workunit.client.1.smithi156.stdout:7/383: unlink dc/d2c/l30 0 2024-04-23T14:49:53.315 INFO:tasks.workunit.client.0.smithi081.stdout:4/620: symlink d1/d8b/dbc/ld0 0 2024-04-23T14:49:53.315 INFO:tasks.workunit.client.0.smithi081.stdout:4/621: getdents d1/d4/d6f/d70/daf/d89/da9 0 2024-04-23T14:49:53.316 INFO:tasks.workunit.client.0.smithi081.stdout:6/697: creat d1/d2/d8e/d98/ff9 x:0 0 0 2024-04-23T14:49:53.319 INFO:tasks.workunit.client.1.smithi156.stdout:9/298: dwrite d1/d2/d4/f5a [0,4194304] 0 2024-04-23T14:49:53.320 INFO:tasks.workunit.client.0.smithi081.stdout:2/720: mkdir d1/d11/df7 0 2024-04-23T14:49:53.320 INFO:tasks.workunit.client.1.smithi156.stdout:8/357: rmdir d5/d9/d10/d1d/d21 39 2024-04-23T14:49:53.320 INFO:tasks.workunit.client.1.smithi156.stdout:8/358: creat d5/d39/f7d x:0 0 0 2024-04-23T14:49:53.320 INFO:tasks.workunit.client.1.smithi156.stdout:8/359: creat d5/d9/d5a/d5c/d6b/f7e x:0 0 0 2024-04-23T14:49:53.321 INFO:tasks.workunit.client.0.smithi081.stdout:5/794: chown d17/d1f/d42/dbb/f104 44177 1 2024-04-23T14:49:53.321 INFO:tasks.workunit.client.0.smithi081.stdout:1/794: write d3/d3d/f13 [1946878,84130] 0 2024-04-23T14:49:53.323 INFO:tasks.workunit.client.1.smithi156.stdout:1/423: mknod db/d1f/d28/c84 0 2024-04-23T14:49:53.326 INFO:tasks.workunit.client.1.smithi156.stdout:5/429: symlink d1/d3/l8f 0 2024-04-23T14:49:53.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:52 smithi081 ceph-mon[25540]: pgmap v35: 65 pgs: 65 active+clean; 1.9 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 122 MiB/s rd, 143 MiB/s wr, 224 op/s 2024-04-23T14:49:53.328 INFO:tasks.workunit.client.0.smithi081.stdout:4/622: unlink d1/d4/d6f/d70/d9c/fab 0 2024-04-23T14:49:53.328 INFO:tasks.workunit.client.0.smithi081.stdout:4/623: truncate d1/d4/f76 55016 0 2024-04-23T14:49:53.329 INFO:tasks.workunit.client.0.smithi081.stdout:4/624: creat d1/d8b/fd1 x:0 0 0 2024-04-23T14:49:53.329 INFO:tasks.workunit.client.0.smithi081.stdout:4/625: stat d1/d1d/f20 0 2024-04-23T14:49:53.332 INFO:tasks.workunit.client.0.smithi081.stdout:6/698: creat d1/d51/d65/ffa x:0 0 0 2024-04-23T14:49:53.333 INFO:tasks.workunit.client.0.smithi081.stdout:6/699: creat d1/d51/d65/d1c/d66/ffb x:0 0 0 2024-04-23T14:49:53.333 INFO:tasks.workunit.client.0.smithi081.stdout:6/700: fdatasync d1/d51/d65/f6a 0 2024-04-23T14:49:53.333 INFO:tasks.workunit.client.1.smithi156.stdout:7/384: rename dc/d46/f44 to dc/d46/d58/f71 0 2024-04-23T14:49:53.334 INFO:tasks.workunit.client.1.smithi156.stdout:7/385: creat dc/d1d/d24/d5a/f72 x:0 0 0 2024-04-23T14:49:53.336 INFO:tasks.workunit.client.0.smithi081.stdout:5/795: truncate d17/f2c 549784 0 2024-04-23T14:49:53.338 INFO:tasks.workunit.client.1.smithi156.stdout:9/299: dread d1/d2/d4/d19/f26 [0,4194304] 0 2024-04-23T14:49:53.342 INFO:tasks.workunit.client.1.smithi156.stdout:0/358: dwrite d0/d16/d3a/d1e/f40 [0,4194304] 0 2024-04-23T14:49:53.345 INFO:tasks.workunit.client.0.smithi081.stdout:1/795: link d3/d3d/d41/d5e/d12/fbf d3/d3d/d41/d5e/dd2/dd5/df2/f103 0 2024-04-23T14:49:53.346 INFO:tasks.workunit.client.1.smithi156.stdout:5/430: dread d1/d11/d18/f32 [0,4194304] 0 2024-04-23T14:49:53.350 INFO:tasks.workunit.client.0.smithi081.stdout:7/574: getdents d3/d11/d2c 0 2024-04-23T14:49:53.351 INFO:tasks.workunit.client.0.smithi081.stdout:7/575: chown d3/d21/d41/d7c/dc3 121072 1 2024-04-23T14:49:53.352 INFO:tasks.workunit.client.1.smithi156.stdout:8/360: link d5/d9/d10/d1d/d4c/c3a d5/c7f 0 2024-04-23T14:49:53.355 INFO:tasks.workunit.client.1.smithi156.stdout:0/359: link d0/d16/d43/c4d d0/d16/d3a/d2a/d5e/c75 0 2024-04-23T14:49:53.358 INFO:tasks.workunit.client.1.smithi156.stdout:5/431: symlink d1/d17/d7e/l90 0 2024-04-23T14:49:53.360 INFO:tasks.workunit.client.0.smithi081.stdout:4/626: truncate d1/d4/dc/f78 2971021 0 2024-04-23T14:49:53.360 INFO:tasks.workunit.client.0.smithi081.stdout:4/627: dread - d1/d4/d11/fbe zero size 2024-04-23T14:49:53.361 INFO:tasks.workunit.client.1.smithi156.stdout:1/424: dread db/d1f/d2f/f56 [0,4194304] 0 2024-04-23T14:49:53.361 INFO:tasks.workunit.client.1.smithi156.stdout:9/300: getdents d1/d2/d3e 0 2024-04-23T14:49:53.361 INFO:tasks.workunit.client.1.smithi156.stdout:9/301: stat d1/d2/d23/d49/d4c 0 2024-04-23T14:49:53.364 INFO:tasks.workunit.client.0.smithi081.stdout:4/628: read d1/d8b/f92 [654196,75215] 0 2024-04-23T14:49:53.367 INFO:tasks.workunit.client.1.smithi156.stdout:8/361: link d5/d39/c70 d5/d45/c80 0 2024-04-23T14:49:53.367 INFO:tasks.workunit.client.1.smithi156.stdout:8/362: dread - d5/d9/d5a/d5c/d6b/f7e zero size 2024-04-23T14:49:53.372 INFO:tasks.workunit.client.0.smithi081.stdout:2/721: dwrite d1/d11/d21/d52/fd7 [0,4194304] 0 2024-04-23T14:49:53.373 INFO:tasks.workunit.client.0.smithi081.stdout:6/701: link d1/d51/d65/d8/d2e/c7e d1/d51/d7b/d91/cfc 0 2024-04-23T14:49:53.373 INFO:tasks.workunit.client.0.smithi081.stdout:3/626: rename d4/d7/d32/d6a to d4/d41/dc6 0 2024-04-23T14:49:53.373 INFO:tasks.workunit.client.0.smithi081.stdout:3/627: write d4/d7/df/f1b [3778479,116430] 0 2024-04-23T14:49:53.374 INFO:tasks.workunit.client.0.smithi081.stdout:6/702: write d1/d2/d49/d52/fab [351733,84896] 0 2024-04-23T14:49:53.374 INFO:tasks.workunit.client.0.smithi081.stdout:1/796: dread d3/d3d/d41/d5e/d17/f20 [0,4194304] 0 2024-04-23T14:49:53.374 INFO:tasks.workunit.client.1.smithi156.stdout:5/432: rename d1/d3/d20/d3e/l62 to d1/d11/d18/d52/d85/l91 0 2024-04-23T14:49:53.378 INFO:tasks.workunit.client.0.smithi081.stdout:7/576: symlink d3/d21/d41/d7c/dc3/d7f/d98/lc7 0 2024-04-23T14:49:53.380 INFO:tasks.workunit.client.1.smithi156.stdout:7/386: dwrite dc/d1d/d24/f49 [0,4194304] 0 2024-04-23T14:49:53.380 INFO:tasks.workunit.client.1.smithi156.stdout:7/387: truncate dc/d1d/d41/f43 3216018 0 2024-04-23T14:49:53.387 INFO:tasks.workunit.client.0.smithi081.stdout:4/629: symlink d1/d4/ld2 0 2024-04-23T14:49:53.388 INFO:tasks.workunit.client.0.smithi081.stdout:1/797: dread d3/d3d/d41/d5e/d17/d58/f67 [0,4194304] 0 2024-04-23T14:49:53.391 INFO:tasks.workunit.client.0.smithi081.stdout:6/703: mknod d1/d2/d49/d52/cfd 0 2024-04-23T14:49:53.397 INFO:tasks.workunit.client.0.smithi081.stdout:7/577: mkdir d3/d21/d41/d7c/dc3/d7f/dc8 0 2024-04-23T14:49:53.398 INFO:tasks.workunit.client.1.smithi156.stdout:7/388: rmdir dc/d2c 39 2024-04-23T14:49:53.399 INFO:tasks.workunit.client.1.smithi156.stdout:3/339: dwrite d4/db/dd/f26 [0,4194304] 0 2024-04-23T14:49:53.399 INFO:tasks.workunit.client.1.smithi156.stdout:3/340: chown d4 890651070 1 2024-04-23T14:49:53.400 INFO:tasks.workunit.client.1.smithi156.stdout:3/341: stat d4/db/dd/d1d/d61/f62 0 2024-04-23T14:49:53.400 INFO:tasks.workunit.client.1.smithi156.stdout:3/342: readlink d4/l1c 0 2024-04-23T14:49:53.408 INFO:tasks.workunit.client.0.smithi081.stdout:3/628: dread d4/dc/f55 [0,4194304] 0 2024-04-23T14:49:53.410 INFO:tasks.workunit.client.0.smithi081.stdout:1/798: read d3/d3d/d41/d5e/d17/f20 [4069909,70293] 0 2024-04-23T14:49:53.413 INFO:tasks.workunit.client.0.smithi081.stdout:3/629: mkdir d4/d7/d7f/d85/d9d/dac/dc7 0 2024-04-23T14:49:53.413 INFO:tasks.workunit.client.0.smithi081.stdout:3/630: read d4/dc/f55 [1998818,67290] 0 2024-04-23T14:49:53.417 INFO:tasks.workunit.client.1.smithi156.stdout:8/363: dread d5/d9/d10/f11 [0,4194304] 0 2024-04-23T14:49:53.417 INFO:tasks.workunit.client.1.smithi156.stdout:8/364: write d5/d9/d10/d1d/d4c/f50 [661817,12200] 0 2024-04-23T14:49:53.417 INFO:tasks.workunit.client.0.smithi081.stdout:1/799: getdents d3/d3d/d7a 0 2024-04-23T14:49:53.417 INFO:tasks.workunit.client.0.smithi081.stdout:1/800: read - d3/d3d/d6f/fa7 zero size 2024-04-23T14:49:53.419 INFO:tasks.workunit.client.0.smithi081.stdout:3/631: mknod d4/d7/d1a/d71/cc8 0 2024-04-23T14:49:53.420 INFO:tasks.workunit.client.0.smithi081.stdout:1/801: creat d3/d3d/d41/d5e/dd2/dd5/df2/f104 x:0 0 0 2024-04-23T14:49:53.421 INFO:tasks.workunit.client.0.smithi081.stdout:3/632: fdatasync d4/d7/d1a/d71/f76 0 2024-04-23T14:49:53.421 INFO:tasks.workunit.client.0.smithi081.stdout:3/633: readlink d4/dc/l90 0 2024-04-23T14:49:53.421 INFO:tasks.workunit.client.0.smithi081.stdout:7/578: rename d3/d21/d31/d33/d4b/d71 to d3/d20/dc9 0 2024-04-23T14:49:53.423 INFO:tasks.workunit.client.0.smithi081.stdout:3/634: creat d4/d7/d2e/fc9 x:0 0 0 2024-04-23T14:49:53.425 INFO:tasks.workunit.client.1.smithi156.stdout:8/365: truncate d5/d9/d5a/f2e 122625 0 2024-04-23T14:49:53.426 INFO:tasks.workunit.client.0.smithi081.stdout:3/635: write d4/d7/d32/fa9 [909862,53403] 0 2024-04-23T14:49:53.429 INFO:tasks.workunit.client.0.smithi081.stdout:3/636: mknod d4/d7/d7f/d91/cca 0 2024-04-23T14:49:53.430 INFO:tasks.workunit.client.1.smithi156.stdout:8/366: rmdir d5/d9/d10/d1d 39 2024-04-23T14:49:53.432 INFO:tasks.workunit.client.0.smithi081.stdout:3/637: rmdir d4/d7/d7f/d85/d9d/dac 39 2024-04-23T14:49:53.433 INFO:tasks.workunit.client.1.smithi156.stdout:9/302: dwrite d1/d2/d4/d17/d1f/f63 [0,4194304] 0 2024-04-23T14:49:53.433 INFO:tasks.workunit.client.1.smithi156.stdout:9/303: fdatasync d1/d2/d4/d17/d1f/f5d 0 2024-04-23T14:49:53.435 INFO:tasks.workunit.client.1.smithi156.stdout:3/343: write d4/db/dd/d1d/d1e/d13/f1a [990299,120767] 0 2024-04-23T14:49:53.435 INFO:tasks.workunit.client.1.smithi156.stdout:3/344: stat d4/db/dd/d20/l5d 0 2024-04-23T14:49:53.435 INFO:tasks.workunit.client.1.smithi156.stdout:3/345: fdatasync d4/db/dd/d1d/d1e/d13/f41 0 2024-04-23T14:49:53.435 INFO:tasks.workunit.client.1.smithi156.stdout:3/346: write d4/db/dd/f50 [401116,9336] 0 2024-04-23T14:49:53.435 INFO:tasks.workunit.client.1.smithi156.stdout:5/433: dwrite d1/d3/d24/f58 [0,4194304] 0 2024-04-23T14:49:53.435 INFO:tasks.workunit.client.1.smithi156.stdout:5/434: truncate d1/d3/f6b 117684 0 2024-04-23T14:49:53.438 INFO:tasks.workunit.client.0.smithi081.stdout:3/638: truncate d4/d7/d1a/d71/f76 2745974 0 2024-04-23T14:49:53.440 INFO:tasks.workunit.client.0.smithi081.stdout:2/722: dwrite d1/f5 [0,4194304] 0 2024-04-23T14:49:53.440 INFO:tasks.workunit.client.1.smithi156.stdout:0/360: dwrite d0/f15 [0,4194304] 0 2024-04-23T14:49:53.440 INFO:tasks.workunit.client.1.smithi156.stdout:9/304: rmdir d1/d2/d4/d19/d2a/d30 39 2024-04-23T14:49:53.446 INFO:tasks.workunit.client.0.smithi081.stdout:3/639: link d4/dc/f45 d4/d41/fcb 0 2024-04-23T14:49:53.446 INFO:tasks.workunit.client.0.smithi081.stdout:3/640: chown d4/l4d 64275 1 2024-04-23T14:49:53.446 INFO:tasks.workunit.client.0.smithi081.stdout:3/641: write d4/d7/d2e/fae [1021724,14830] 0 2024-04-23T14:49:53.458 INFO:tasks.workunit.client.1.smithi156.stdout:0/361: symlink d0/d4/d11/d3f/l76 0 2024-04-23T14:49:53.458 INFO:tasks.workunit.client.0.smithi081.stdout:2/723: symlink d1/d11/df7/lf8 0 2024-04-23T14:49:53.461 INFO:tasks.workunit.client.1.smithi156.stdout:9/305: mknod d1/d2/d4/d19/d2a/d30/c6a 0 2024-04-23T14:49:53.461 INFO:tasks.workunit.client.1.smithi156.stdout:9/306: truncate d1/d2/d4/d17/d1f/f36 4490043 0 2024-04-23T14:49:53.463 INFO:tasks.workunit.client.0.smithi081.stdout:3/642: creat d4/d7/fcc x:0 0 0 2024-04-23T14:49:53.463 INFO:tasks.workunit.client.0.smithi081.stdout:3/643: readlink d4/dc/l86 0 2024-04-23T14:49:53.467 INFO:tasks.workunit.client.1.smithi156.stdout:0/362: unlink d0/d4/d11/d3f/f72 0 2024-04-23T14:49:53.467 INFO:tasks.workunit.client.1.smithi156.stdout:0/363: creat d0/d16/d3a/d1e/f77 x:0 0 0 2024-04-23T14:49:53.467 INFO:tasks.workunit.client.1.smithi156.stdout:1/425: dwrite db/f19 [0,4194304] 0 2024-04-23T14:49:53.471 INFO:tasks.workunit.client.1.smithi156.stdout:9/307: creat d1/d2/d3e/d55/f6b x:0 0 0 2024-04-23T14:49:53.471 INFO:tasks.workunit.client.1.smithi156.stdout:9/308: fdatasync d1/d2/d4/d17/d1f/f36 0 2024-04-23T14:49:53.474 INFO:tasks.workunit.client.0.smithi081.stdout:2/724: getdents d1/d11/d21/d52/d8b/d8f/d93 0 2024-04-23T14:49:53.474 INFO:tasks.workunit.client.0.smithi081.stdout:2/725: write d1/d11/d21/d34/fce [6779640,120836] 0 2024-04-23T14:49:53.482 INFO:tasks.workunit.client.0.smithi081.stdout:3/644: mkdir d4/d7/d7f/d85/d9d/dac/dc7/dcd 0 2024-04-23T14:49:53.495 INFO:tasks.workunit.client.0.smithi081.stdout:3/645: mknod d4/d7/d7f/d85/d9d/dac/cce 0 2024-04-23T14:49:53.497 INFO:tasks.workunit.client.0.smithi081.stdout:4/630: dwrite d1/d1d/d39/f58 [4194304,4194304] 0 2024-04-23T14:49:53.497 INFO:tasks.workunit.client.0.smithi081.stdout:4/631: chown d1/d4/c84 0 1 2024-04-23T14:49:53.498 INFO:tasks.workunit.client.0.smithi081.stdout:4/632: write d1/d4/d11/d75/f88 [363324,33699] 0 2024-04-23T14:49:53.501 INFO:tasks.workunit.client.1.smithi156.stdout:0/364: mknod d0/d4/d11/d3f/c78 0 2024-04-23T14:49:53.506 INFO:tasks.workunit.client.0.smithi081.stdout:3/646: fsync d4/d7/d2e/f8b 0 2024-04-23T14:49:53.507 INFO:tasks.workunit.client.1.smithi156.stdout:1/426: mkdir db/d1f/d2d/d85 0 2024-04-23T14:49:53.511 INFO:tasks.workunit.client.1.smithi156.stdout:8/367: dwrite d5/d9/d10/f12 [0,4194304] 0 2024-04-23T14:49:53.513 INFO:tasks.workunit.client.1.smithi156.stdout:5/435: dwrite d1/d3/f3a [0,4194304] 0 2024-04-23T14:49:53.513 INFO:tasks.workunit.client.1.smithi156.stdout:3/347: dwrite d4/db/dd/d1d/d1e/ff [0,4194304] 0 2024-04-23T14:49:53.513 INFO:tasks.workunit.client.1.smithi156.stdout:3/348: creat d4/db/dd/f66 x:0 0 0 2024-04-23T14:49:53.514 INFO:tasks.workunit.client.0.smithi081.stdout:4/633: symlink d1/d4/d6f/d70/daf/d8c/d99/ld3 0 2024-04-23T14:49:53.514 INFO:tasks.workunit.client.0.smithi081.stdout:7/579: write d3/d21/d31/d50/fa7 [3703101,93360] 0 2024-04-23T14:49:53.518 INFO:tasks.workunit.client.0.smithi081.stdout:2/726: dread d1/d1e/fb0 [0,4194304] 0 2024-04-23T14:49:53.519 INFO:tasks.workunit.client.0.smithi081.stdout:6/704: dwrite d1/d51/d7b/d91/f97 [0,4194304] 0 2024-04-23T14:49:53.520 INFO:tasks.workunit.client.1.smithi156.stdout:9/309: mkdir d1/d2/d23/d2d/d39/d6c 0 2024-04-23T14:49:53.520 INFO:tasks.workunit.client.1.smithi156.stdout:9/310: readlink d1/d2/d4/d17/d1f/d48/l64 0 2024-04-23T14:49:53.520 INFO:tasks.workunit.client.1.smithi156.stdout:9/311: stat d1/d2/d4/d17 0 2024-04-23T14:49:53.520 INFO:tasks.workunit.client.1.smithi156.stdout:9/312: chown d1/d2 28 1 2024-04-23T14:49:53.520 INFO:tasks.workunit.client.1.smithi156.stdout:0/365: symlink d0/d4/d11/d3f/d45/l79 0 2024-04-23T14:49:53.521 INFO:tasks.workunit.client.0.smithi081.stdout:7/580: link d3/d21/c2e d3/d11/cca 0 2024-04-23T14:49:53.521 INFO:tasks.workunit.client.0.smithi081.stdout:7/581: write d3/d21/d31/d63/fba [980234,69402] 0 2024-04-23T14:49:53.521 INFO:tasks.workunit.client.0.smithi081.stdout:7/582: chown d3/d21/d31/d50/fa7 95825871 1 2024-04-23T14:49:53.521 INFO:tasks.workunit.client.0.smithi081.stdout:7/583: fsync d3/d20/dc9/f8b 0 2024-04-23T14:49:53.522 INFO:tasks.workunit.client.1.smithi156.stdout:1/427: rename db/d25/d4e/d5d to db/d25/d66/d7c/d86 0 2024-04-23T14:49:53.523 INFO:tasks.workunit.client.1.smithi156.stdout:1/428: fsync db/d25/d66/d7c/f74 0 2024-04-23T14:49:53.526 INFO:tasks.workunit.client.0.smithi081.stdout:1/802: dwrite d3/d3d/d41/d4a/d77/fcd [0,4194304] 0 2024-04-23T14:49:53.538 INFO:tasks.workunit.client.1.smithi156.stdout:5/436: symlink d1/d11/d18/l92 0 2024-04-23T14:49:53.541 INFO:tasks.workunit.client.0.smithi081.stdout:7/584: mknod d3/d21/d41/ccb 0 2024-04-23T14:49:53.541 INFO:tasks.workunit.client.0.smithi081.stdout:7/585: fdatasync d3/d21/d31/d63/f6c 0 2024-04-23T14:49:53.542 INFO:tasks.workunit.client.1.smithi156.stdout:4/317: sync 2024-04-23T14:49:53.542 INFO:tasks.workunit.client.1.smithi156.stdout:2/350: sync 2024-04-23T14:49:53.543 INFO:tasks.workunit.client.1.smithi156.stdout:6/425: sync 2024-04-23T14:49:53.548 INFO:tasks.workunit.client.0.smithi081.stdout:2/727: dread d1/d11/dab/fa0 [0,4194304] 0 2024-04-23T14:49:53.548 INFO:tasks.workunit.client.0.smithi081.stdout:2/728: stat d1/d33/da3/fe5 0 2024-04-23T14:49:53.548 INFO:tasks.workunit.client.1.smithi156.stdout:5/437: dread d1/d3/f6b [0,4194304] 0 2024-04-23T14:49:53.548 INFO:tasks.workunit.client.0.smithi081.stdout:1/803: mknod d3/d3d/d41/d5e/d17/d58/d7f/dba/c105 0 2024-04-23T14:49:53.559 INFO:tasks.workunit.client.1.smithi156.stdout:6/426: dread d3/d16/f5a [0,4194304] 0 2024-04-23T14:49:53.562 INFO:tasks.workunit.client.0.smithi081.stdout:4/634: dwrite d1/d4/dc/fa0 [0,4194304] 0 2024-04-23T14:49:53.564 INFO:tasks.workunit.client.1.smithi156.stdout:0/366: getdents d0/d16/d3a/d2a/d1d/d2d/d6b 0 2024-04-23T14:49:53.564 INFO:tasks.workunit.client.1.smithi156.stdout:0/367: readlink d0/d4/d11/l27 0 2024-04-23T14:49:53.569 INFO:tasks.workunit.client.1.smithi156.stdout:9/313: rename d1/d2/d4/d17/d1f/f5d to d1/d2/d4/d19/d2a/d30/f6d 0 2024-04-23T14:49:53.569 INFO:tasks.workunit.client.1.smithi156.stdout:9/314: readlink d1/d2/d4/d17/l24 0 2024-04-23T14:49:53.572 INFO:tasks.workunit.client.1.smithi156.stdout:1/429: symlink db/d1f/d2d/l87 0 2024-04-23T14:49:53.572 INFO:tasks.workunit.client.1.smithi156.stdout:1/430: readlink db/d1f/l35 0 2024-04-23T14:49:53.573 INFO:tasks.workunit.client.1.smithi156.stdout:0/368: dread d0/f1a [4194304,4194304] 0 2024-04-23T14:49:53.575 INFO:tasks.workunit.client.0.smithi081.stdout:6/705: truncate d1/d51/d65/d8/d2e/f5b 523876 0 2024-04-23T14:49:53.577 INFO:tasks.workunit.client.1.smithi156.stdout:5/438: dread d1/d3/d20/f33 [0,4194304] 0 2024-04-23T14:49:53.577 INFO:tasks.workunit.client.1.smithi156.stdout:8/368: getdents d5/d9/d10 0 2024-04-23T14:49:53.577 INFO:tasks.workunit.client.1.smithi156.stdout:8/369: stat d5/f1c 0 2024-04-23T14:49:53.578 INFO:tasks.workunit.client.1.smithi156.stdout:8/370: write d5/d9/d10/d1d/f7a [4234084,111533] 0 2024-04-23T14:49:53.581 INFO:tasks.workunit.client.0.smithi081.stdout:1/804: creat d3/d3d/d41/d92/df1/f106 x:0 0 0 2024-04-23T14:49:53.581 INFO:tasks.workunit.client.0.smithi081.stdout:1/805: chown d3/d3d/d41/d5e/d5d/c6c 108377 1 2024-04-23T14:49:53.585 INFO:tasks.workunit.client.1.smithi156.stdout:2/351: getdents d4/d13 0 2024-04-23T14:49:53.585 INFO:tasks.workunit.client.1.smithi156.stdout:2/352: creat d4/d13/d19/f82 x:0 0 0 2024-04-23T14:49:53.586 INFO:tasks.workunit.client.1.smithi156.stdout:1/431: dread db/d25/d30/f43 [0,4194304] 0 2024-04-23T14:49:53.586 INFO:tasks.workunit.client.1.smithi156.stdout:2/353: write d4/d21/d42/f5e [998885,126505] 0 2024-04-23T14:49:53.586 INFO:tasks.workunit.client.1.smithi156.stdout:2/354: read d4/f62 [170180,104141] 0 2024-04-23T14:49:53.586 INFO:tasks.workunit.client.1.smithi156.stdout:2/355: write d4/d21/d2f/f74 [912064,112207] 0 2024-04-23T14:49:53.586 INFO:tasks.workunit.client.1.smithi156.stdout:4/318: symlink d0/d8/d1e/l6e 0 2024-04-23T14:49:53.588 INFO:tasks.workunit.client.1.smithi156.stdout:3/349: rmdir d4/db/dd/d1d/d61 39 2024-04-23T14:49:53.588 INFO:tasks.workunit.client.1.smithi156.stdout:7/389: sync 2024-04-23T14:49:53.591 INFO:tasks.workunit.client.0.smithi081.stdout:4/635: symlink d1/d4/dc/dba/ld4 0 2024-04-23T14:49:53.591 INFO:tasks.workunit.client.0.smithi081.stdout:4/636: chown d1/d4f/dc3/fc5 479 1 2024-04-23T14:49:53.591 INFO:tasks.workunit.client.0.smithi081.stdout:4/637: fsync d1/d4/d6f/f9f 0 2024-04-23T14:49:53.591 INFO:tasks.workunit.client.1.smithi156.stdout:5/439: write d1/d11/f51 [1133463,27055] 0 2024-04-23T14:49:53.595 INFO:tasks.workunit.client.1.smithi156.stdout:6/427: rename d3/f6b to d3/da/d1d/d27/d80/da5/faa 0 2024-04-23T14:49:53.595 INFO:tasks.workunit.client.1.smithi156.stdout:6/428: write d3/da/f28 [3710419,37641] 0 2024-04-23T14:49:53.595 INFO:tasks.workunit.client.1.smithi156.stdout:6/429: chown d3/d16/d46/d64/l84 9 1 2024-04-23T14:49:53.595 INFO:tasks.workunit.client.1.smithi156.stdout:3/350: dread d4/db/dd/d1d/f36 [0,4194304] 0 2024-04-23T14:49:53.595 INFO:tasks.workunit.client.1.smithi156.stdout:3/351: creat d4/db/dd/d1d/d1e/d2b/d31/f67 x:0 0 0 2024-04-23T14:49:53.595 INFO:tasks.workunit.client.1.smithi156.stdout:0/369: mkdir d0/d4/d11/d7a 0 2024-04-23T14:49:53.595 INFO:tasks.workunit.client.1.smithi156.stdout:0/370: dread - d0/d16/d3a/d1e/f77 zero size 2024-04-23T14:49:53.596 INFO:tasks.workunit.client.0.smithi081.stdout:7/586: dwrite d3/d21/d31/d33/d4b/f57 [0,4194304] 0 2024-04-23T14:49:53.596 INFO:tasks.workunit.client.0.smithi081.stdout:7/587: readlink d3/d21/d31/d33/d4b/lae 0 2024-04-23T14:49:53.597 INFO:tasks.workunit.client.0.smithi081.stdout:3/647: dwrite d4/d41/f66 [0,4194304] 0 2024-04-23T14:49:53.597 INFO:tasks.workunit.client.0.smithi081.stdout:3/648: fsync d4/d7/d1a/fbe 0 2024-04-23T14:49:53.599 INFO:tasks.workunit.client.0.smithi081.stdout:6/706: rename d1/d51/d65/d8/d2e/d59/f94 to d1/d51/d65/d8/d2e/d59/d80/d90/ffe 0 2024-04-23T14:49:53.600 INFO:tasks.workunit.client.1.smithi156.stdout:8/371: symlink d5/d9/d10/d1d/d21/l81 0 2024-04-23T14:49:53.601 INFO:tasks.workunit.client.0.smithi081.stdout:1/806: unlink d3/d3d/d41/d5e/d17/d25/l37 0 2024-04-23T14:49:53.601 INFO:tasks.workunit.client.0.smithi081.stdout:1/807: dread - d3/d3d/d41/d5e/d12/d1a/ff8 zero size 2024-04-23T14:49:53.601 INFO:tasks.workunit.client.0.smithi081.stdout:1/808: stat d3/d3d/d41/d5e/d17/d25/dda/lfc 0 2024-04-23T14:49:53.602 INFO:tasks.workunit.client.1.smithi156.stdout:2/356: write d4/d13/f20 [4107308,90087] 0 2024-04-23T14:49:53.603 INFO:tasks.workunit.client.0.smithi081.stdout:4/638: creat d1/d4f/dc3/fd5 x:0 0 0 2024-04-23T14:49:53.605 INFO:tasks.workunit.client.1.smithi156.stdout:1/432: unlink db/f39 0 2024-04-23T14:49:53.606 INFO:tasks.workunit.client.1.smithi156.stdout:4/319: creat d0/df/d55/d68/f6f x:0 0 0 2024-04-23T14:49:53.606 INFO:tasks.workunit.client.1.smithi156.stdout:4/320: fdatasync d0/f46 0 2024-04-23T14:49:53.608 INFO:tasks.workunit.client.1.smithi156.stdout:7/390: mknod dc/d2c/d68/c73 0 2024-04-23T14:49:53.608 INFO:tasks.workunit.client.1.smithi156.stdout:5/440: getdents d1/d3 0 2024-04-23T14:49:53.609 INFO:tasks.workunit.client.1.smithi156.stdout:4/321: read d0/df/d55/d68/f43 [248674,85620] 0 2024-04-23T14:49:53.609 INFO:tasks.workunit.client.0.smithi081.stdout:3/649: creat d4/d7/d2e/fcf x:0 0 0 2024-04-23T14:49:53.610 INFO:tasks.workunit.client.0.smithi081.stdout:9/681: sync 2024-04-23T14:49:53.610 INFO:tasks.workunit.client.0.smithi081.stdout:9/682: write d3/de/d25/f45 [1238910,18178] 0 2024-04-23T14:49:53.610 INFO:tasks.workunit.client.1.smithi156.stdout:9/315: rename d1/d2/d4/f5a to d1/d2/d4/d17/d1f/d48/d4e/f6e 0 2024-04-23T14:49:53.612 INFO:tasks.workunit.client.1.smithi156.stdout:6/430: truncate d3/da/d1d/f65 1617047 0 2024-04-23T14:49:53.613 INFO:tasks.workunit.client.0.smithi081.stdout:7/588: dread d3/d21/d31/d33/d4b/f57 [0,4194304] 0 2024-04-23T14:49:53.615 INFO:tasks.workunit.client.0.smithi081.stdout:1/809: getdents d3/d3d/d41 0 2024-04-23T14:49:53.615 INFO:tasks.workunit.client.1.smithi156.stdout:1/433: read db/d25/f3b [1054874,96105] 0 2024-04-23T14:49:53.616 INFO:tasks.workunit.client.1.smithi156.stdout:3/352: truncate d4/db/dd/d1d/d1e/d13/f1a 3708338 0 2024-04-23T14:49:53.616 INFO:tasks.workunit.client.1.smithi156.stdout:3/353: fsync d4/db/dd/d1d/d61/f62 0 2024-04-23T14:49:53.618 INFO:tasks.workunit.client.0.smithi081.stdout:4/639: link d1/d1d/c54 d1/d1d/daa/cd6 0 2024-04-23T14:49:53.619 INFO:tasks.workunit.client.1.smithi156.stdout:0/371: mknod d0/d4/d11/c7b 0 2024-04-23T14:49:53.621 INFO:tasks.workunit.client.0.smithi081.stdout:3/650: rename d4/d7/d32/da6/dc4/d5a/c87 to d4/d7/d49/d51/d84/cd0 0 2024-04-23T14:49:53.622 INFO:tasks.workunit.client.1.smithi156.stdout:8/372: mknod d5/d9/d10/c82 0 2024-04-23T14:49:53.622 INFO:tasks.workunit.client.1.smithi156.stdout:8/373: write d5/d9/d5a/f54 [4931766,50902] 0 2024-04-23T14:49:53.628 INFO:tasks.workunit.client.0.smithi081.stdout:9/683: creat d3/de/d1d/d5b/d7b/db2/fdb x:0 0 0 2024-04-23T14:49:53.630 INFO:tasks.workunit.client.1.smithi156.stdout:2/357: symlink d4/d21/d42/d75/d79/l83 0 2024-04-23T14:49:53.631 INFO:tasks.workunit.client.1.smithi156.stdout:2/358: read - d4/d13/d19/d58/f7e zero size 2024-04-23T14:49:53.631 INFO:tasks.workunit.client.1.smithi156.stdout:2/359: write d4/f16 [3772227,117981] 0 2024-04-23T14:49:53.632 INFO:tasks.workunit.client.0.smithi081.stdout:7/589: rmdir d3/d21/d41/d7c/dc3/d7f/dc8 0 2024-04-23T14:49:53.632 INFO:tasks.workunit.client.0.smithi081.stdout:5/796: sync 2024-04-23T14:49:53.632 INFO:tasks.workunit.client.0.smithi081.stdout:0/791: sync 2024-04-23T14:49:53.634 INFO:tasks.workunit.client.0.smithi081.stdout:5/797: write d17/d1f/d42/d9b/d9e/da3/fcb [637141,79180] 0 2024-04-23T14:49:53.635 INFO:tasks.workunit.client.0.smithi081.stdout:1/810: creat d3/d3d/d41/d5e/f107 x:0 0 0 2024-04-23T14:49:53.637 INFO:tasks.workunit.client.0.smithi081.stdout:8/903: sync 2024-04-23T14:49:53.637 INFO:tasks.workunit.client.0.smithi081.stdout:8/904: readlink d3/l6 0 2024-04-23T14:49:53.641 INFO:tasks.workunit.client.1.smithi156.stdout:7/391: rename dc/d1d/l36 to dc/d1d/d41/l74 0 2024-04-23T14:49:53.643 INFO:tasks.workunit.client.0.smithi081.stdout:2/729: dwrite d1/d11/d21/fc7 [4194304,4194304] 0 2024-04-23T14:49:53.644 INFO:tasks.workunit.client.0.smithi081.stdout:2/730: write d1/d11/dab/fe3 [419247,22127] 0 2024-04-23T14:49:53.644 INFO:tasks.workunit.client.0.smithi081.stdout:2/731: chown d1/d11/c6f 55 1 2024-04-23T14:49:53.644 INFO:tasks.workunit.client.0.smithi081.stdout:4/640: link d1/d4/dc/f14 d1/d4f/fd7 0 2024-04-23T14:49:53.650 INFO:tasks.workunit.client.1.smithi156.stdout:6/431: mknod d3/d16/cab 0 2024-04-23T14:49:53.650 INFO:tasks.workunit.client.1.smithi156.stdout:6/432: chown d3/da/f18 15040683 1 2024-04-23T14:49:53.652 INFO:tasks.workunit.client.1.smithi156.stdout:6/433: creat d3/d16/d5c/fac x:0 0 0 2024-04-23T14:49:53.658 INFO:tasks.workunit.client.1.smithi156.stdout:8/374: unlink d5/c18 0 2024-04-23T14:49:53.658 INFO:tasks.workunit.client.1.smithi156.stdout:8/375: dread - d5/d9/d5a/d5c/d6b/f7b zero size 2024-04-23T14:49:53.659 INFO:tasks.workunit.client.0.smithi081.stdout:0/792: link d6/d11/d14/d41/d5b/d59/d8e/c98 d6/d11/d14/d41/d5b/d3f/d44/d78/d83/cf8 0 2024-04-23T14:49:53.665 INFO:tasks.workunit.client.0.smithi081.stdout:5/798: unlink d17/d3c/d55/l5d 0 2024-04-23T14:49:53.665 INFO:tasks.workunit.client.0.smithi081.stdout:5/799: chown d17/d65/de3/d108/ld0 1507485 1 2024-04-23T14:49:53.670 INFO:tasks.workunit.client.1.smithi156.stdout:2/360: creat d4/d13/f84 x:0 0 0 2024-04-23T14:49:53.674 INFO:tasks.workunit.client.0.smithi081.stdout:2/732: mkdir d1/d11/df7/df9 0 2024-04-23T14:49:53.675 INFO:tasks.workunit.client.0.smithi081.stdout:1/811: creat d3/d3d/d41/d5e/dd2/dd5/f108 x:0 0 0 2024-04-23T14:49:53.675 INFO:tasks.workunit.client.0.smithi081.stdout:8/905: dread d3/d11/d34/f55 [0,4194304] 0 2024-04-23T14:49:53.678 INFO:tasks.workunit.client.0.smithi081.stdout:4/641: symlink d1/d4/d6f/d70/daf/d8c/dc2/ld8 0 2024-04-23T14:49:53.680 INFO:tasks.workunit.client.0.smithi081.stdout:9/684: rename d3/d67/d77/ld0 to d3/de/d1d/ldc 0 2024-04-23T14:49:53.681 INFO:tasks.workunit.client.1.smithi156.stdout:0/372: dwrite d0/d16/d3a/d2a/d1d/d2d/f41 [0,4194304] 0 2024-04-23T14:49:53.681 INFO:tasks.workunit.client.1.smithi156.stdout:0/373: creat d0/f7c x:0 0 0 2024-04-23T14:49:53.681 INFO:tasks.workunit.client.1.smithi156.stdout:0/374: truncate d0/d4/d11/f4b 1254235 0 2024-04-23T14:49:53.681 INFO:tasks.workunit.client.1.smithi156.stdout:0/375: creat d0/d16/d3a/d2b/d44/f7d x:0 0 0 2024-04-23T14:49:53.682 INFO:tasks.workunit.client.0.smithi081.stdout:7/590: rmdir d3/d21/d31/d33/d4b 39 2024-04-23T14:49:53.682 INFO:tasks.workunit.client.0.smithi081.stdout:7/591: creat d3/d21/d31/d63/fcc x:0 0 0 2024-04-23T14:49:53.682 INFO:tasks.workunit.client.0.smithi081.stdout:6/707: dwrite d1/d51/d65/d13/d16/f1e [0,4194304] 0 2024-04-23T14:49:53.683 INFO:tasks.workunit.client.0.smithi081.stdout:0/793: creat d6/d37/ff9 x:0 0 0 2024-04-23T14:49:53.685 INFO:tasks.workunit.client.0.smithi081.stdout:3/651: dwrite d4/d7/d32/da6/dc4/fc0 [0,4194304] 0 2024-04-23T14:49:53.685 INFO:tasks.workunit.client.0.smithi081.stdout:4/642: symlink d1/d4/d6f/d70/daf/ld9 0 2024-04-23T14:49:53.689 INFO:tasks.workunit.client.1.smithi156.stdout:5/441: rmdir d1 39 2024-04-23T14:49:53.689 INFO:tasks.workunit.client.1.smithi156.stdout:5/442: stat d1/d11/d18/d19/f36 0 2024-04-23T14:49:53.689 INFO:tasks.workunit.client.1.smithi156.stdout:5/443: fdatasync d1/d11/d27/f77 0 2024-04-23T14:49:53.689 INFO:tasks.workunit.client.1.smithi156.stdout:4/322: getdents d0/df/d55 0 2024-04-23T14:49:53.689 INFO:tasks.workunit.client.1.smithi156.stdout:5/444: chown d1/d17/f2e 64367 1 2024-04-23T14:49:53.690 INFO:tasks.workunit.client.0.smithi081.stdout:9/685: creat d3/de/d76/fdd x:0 0 0 2024-04-23T14:49:53.691 INFO:tasks.workunit.client.1.smithi156.stdout:2/361: dread d4/d21/d42/f5e [0,4194304] 0 2024-04-23T14:49:53.691 INFO:tasks.workunit.client.1.smithi156.stdout:1/434: dwrite db/d15/f22 [4194304,4194304] 0 2024-04-23T14:49:53.691 INFO:tasks.workunit.client.1.smithi156.stdout:1/435: dread - db/d1f/f76 zero size 2024-04-23T14:49:53.694 INFO:tasks.workunit.client.0.smithi081.stdout:7/592: mkdir d3/d21/d41/dcd 0 2024-04-23T14:49:53.694 INFO:tasks.workunit.client.0.smithi081.stdout:6/708: link d1/d51/d65/d13/f4e d1/d51/d65/d8/da4/fff 0 2024-04-23T14:49:53.695 INFO:tasks.workunit.client.1.smithi156.stdout:7/392: creat dc/d2c/d68/f75 x:0 0 0 2024-04-23T14:49:53.695 INFO:tasks.workunit.client.1.smithi156.stdout:7/393: chown dc/d1d/d24/c45 0 1 2024-04-23T14:49:53.697 INFO:tasks.workunit.client.0.smithi081.stdout:0/794: rmdir d6/d11/d14/d41/d5b/d3f/d44/d76/deb 0 2024-04-23T14:49:53.697 INFO:tasks.workunit.client.0.smithi081.stdout:2/733: symlink d1/d33/lfa 0 2024-04-23T14:49:53.704 INFO:tasks.workunit.client.0.smithi081.stdout:6/709: dread d1/d51/d7b/d91/f9f [0,4194304] 0 2024-04-23T14:49:53.706 INFO:tasks.workunit.client.0.smithi081.stdout:3/652: creat d4/d7/d7f/d85/fd1 x:0 0 0 2024-04-23T14:49:53.706 INFO:tasks.workunit.client.0.smithi081.stdout:3/653: dread - d4/d7/fcc zero size 2024-04-23T14:49:53.706 INFO:tasks.workunit.client.0.smithi081.stdout:3/654: write d4/d41/dc6/f7e [5440424,120618] 0 2024-04-23T14:49:53.706 INFO:tasks.workunit.client.1.smithi156.stdout:3/354: rmdir d4/db/dd/d1d 39 2024-04-23T14:49:53.707 INFO:tasks.workunit.client.0.smithi081.stdout:7/593: creat d3/d21/d31/d33/d4b/d6e/fce x:0 0 0 2024-04-23T14:49:53.718 INFO:tasks.workunit.client.1.smithi156.stdout:6/434: unlink d3/da/d1d/d27/c2c 0 2024-04-23T14:49:53.718 INFO:tasks.workunit.client.1.smithi156.stdout:6/435: dread - d3/f8d zero size 2024-04-23T14:49:53.720 INFO:tasks.workunit.client.0.smithi081.stdout:0/795: mkdir d6/d11/d14/d41/d5b/d59/db6/dfa 0 2024-04-23T14:49:53.723 INFO:tasks.workunit.client.1.smithi156.stdout:8/376: link d5/d9/d10/d1d/f7a d5/d4e/f83 0 2024-04-23T14:49:53.728 INFO:tasks.workunit.client.0.smithi081.stdout:2/734: rename d1/d33/d45/d6e/d96/c67 to d1/d11/d21/d52/cfb 0 2024-04-23T14:49:53.730 INFO:tasks.workunit.client.0.smithi081.stdout:9/686: write d3/f9 [3957766,18137] 0 2024-04-23T14:49:53.730 INFO:tasks.workunit.client.0.smithi081.stdout:9/687: write d3/de/d14/d5e/f87 [1331883,105536] 0 2024-04-23T14:49:53.731 INFO:tasks.workunit.client.0.smithi081.stdout:7/594: chown d3/d21/d31/d33/d4b/d4c/c83 57217976 1 2024-04-23T14:49:53.731 INFO:tasks.workunit.client.0.smithi081.stdout:3/655: mknod d4/d7/d32/da6/dc4/cd2 0 2024-04-23T14:49:53.734 INFO:tasks.workunit.client.1.smithi156.stdout:0/376: link d0/d16/d3a/d1e/f6e d0/d16/d3a/d2b/d44/d4a/f7e 0 2024-04-23T14:49:53.735 INFO:tasks.workunit.client.0.smithi081.stdout:8/906: dwrite d3/d11/d3e/d63/d78/da0/ff2 [0,4194304] 0 2024-04-23T14:49:53.738 INFO:tasks.workunit.client.1.smithi156.stdout:6/436: dread d3/d16/d46/d9d/d9f/fa3 [0,4194304] 0 2024-04-23T14:49:53.739 INFO:tasks.workunit.client.0.smithi081.stdout:1/812: dwrite d3/d3d/d41/d5e/dd2/fd4 [0,4194304] 0 2024-04-23T14:49:53.740 INFO:tasks.workunit.client.0.smithi081.stdout:0/796: unlink d6/d37/d4d/l9c 0 2024-04-23T14:49:53.746 INFO:tasks.workunit.client.0.smithi081.stdout:3/656: dread d4/d7/d32/f94 [0,4194304] 0 2024-04-23T14:49:53.746 INFO:tasks.workunit.client.0.smithi081.stdout:3/657: write d4/d7/d1a/f8e [106909,129280] 0 2024-04-23T14:49:53.750 INFO:tasks.workunit.client.1.smithi156.stdout:2/362: creat d4/d21/d42/d75/d79/f85 x:0 0 0 2024-04-23T14:49:53.751 INFO:tasks.workunit.client.1.smithi156.stdout:2/363: creat d4/d13/f86 x:0 0 0 2024-04-23T14:49:53.752 INFO:tasks.workunit.client.1.smithi156.stdout:7/394: truncate f6 2161534 0 2024-04-23T14:49:53.752 INFO:tasks.workunit.client.1.smithi156.stdout:7/395: creat dc/d1d/d24/d5a/f76 x:0 0 0 2024-04-23T14:49:53.755 INFO:tasks.workunit.client.1.smithi156.stdout:3/355: symlink d4/db/dd/d1d/l68 0 2024-04-23T14:49:53.755 INFO:tasks.workunit.client.1.smithi156.stdout:3/356: chown d4/db/dd/d1d/d1e/d13/l63 1623252478 1 2024-04-23T14:49:53.755 INFO:tasks.workunit.client.1.smithi156.stdout:3/357: readlink d4/db/dd/d1d/l33 0 2024-04-23T14:49:53.755 INFO:tasks.workunit.client.1.smithi156.stdout:3/358: truncate d4/db/dd/d1d/d1e/d13/f41 996293 0 2024-04-23T14:49:53.757 INFO:tasks.workunit.client.0.smithi081.stdout:2/735: truncate d1/d11/fd6 4064764 0 2024-04-23T14:49:53.757 INFO:tasks.workunit.client.0.smithi081.stdout:2/736: fdatasync d1/f6 0 2024-04-23T14:49:53.757 INFO:tasks.workunit.client.0.smithi081.stdout:9/688: dread d3/de/d1d/d54/f89 [0,4194304] 0 2024-04-23T14:49:53.757 INFO:tasks.workunit.client.0.smithi081.stdout:9/689: dread - d3/de/d1d/d73/fb4 zero size 2024-04-23T14:49:53.757 INFO:tasks.workunit.client.0.smithi081.stdout:7/595: symlink d3/d11/lcf 0 2024-04-23T14:49:53.758 INFO:tasks.workunit.client.1.smithi156.stdout:8/377: mkdir d5/d9/d36/d84 0 2024-04-23T14:49:53.762 INFO:tasks.workunit.client.1.smithi156.stdout:9/316: rename d1/d2/d4/d19/d2a to d1/d2/d3e/d55/d6f 0 2024-04-23T14:49:53.765 INFO:tasks.workunit.client.1.smithi156.stdout:7/396: dread dc/d1d/f32 [0,4194304] 0 2024-04-23T14:49:53.766 INFO:tasks.workunit.client.0.smithi081.stdout:4/643: dread d1/f5b [0,4194304] 0 2024-04-23T14:49:53.766 INFO:tasks.workunit.client.0.smithi081.stdout:4/644: fsync d1/d4/d6f/d70/daf/f41 0 2024-04-23T14:49:53.770 INFO:tasks.workunit.client.1.smithi156.stdout:2/364: mknod d4/d21/d42/d75/d79/c87 0 2024-04-23T14:49:53.771 INFO:tasks.workunit.client.0.smithi081.stdout:5/800: dwrite d17/d18/dff/d59/da8/f111 [0,4194304] 0 2024-04-23T14:49:53.774 INFO:tasks.workunit.client.0.smithi081.stdout:0/797: dread d6/d37/d67/dc8/fd5 [0,4194304] 0 2024-04-23T14:49:53.776 INFO:tasks.workunit.client.1.smithi156.stdout:3/359: rmdir d4/db/dd/d1d/d1e/d42 39 2024-04-23T14:49:53.778 INFO:tasks.workunit.client.0.smithi081.stdout:8/907: link d3/d3c/ddb/le7 d3/d11/d86/d88/da7/de0/l12d 0 2024-04-23T14:49:53.780 INFO:tasks.workunit.client.1.smithi156.stdout:0/377: rename d0/d4/d11/d3f/d5f/f56 to d0/d4/d22/f7f 0 2024-04-23T14:49:53.780 INFO:tasks.workunit.client.0.smithi081.stdout:2/737: write d1/d33/f37 [1667815,114617] 0 2024-04-23T14:49:53.781 INFO:tasks.workunit.client.1.smithi156.stdout:9/317: write d1/d2/d4/d17/d1f/f37 [3381102,109795] 0 2024-04-23T14:49:53.782 INFO:tasks.workunit.client.0.smithi081.stdout:1/813: unlink d3/d3d/d41/d5e/d17/l94 0 2024-04-23T14:49:53.797 INFO:tasks.workunit.client.0.smithi081.stdout:3/658: rename d4/d7/d7f/d91/d6c to d4/d7/d7f/d85/d9d/dac/dc7/dd3 0 2024-04-23T14:49:53.797 INFO:tasks.workunit.client.0.smithi081.stdout:9/690: unlink d3/de/fbf 0 2024-04-23T14:49:53.797 INFO:tasks.workunit.client.0.smithi081.stdout:7/596: creat d3/d21/d31/d33/fd0 x:0 0 0 2024-04-23T14:49:53.798 INFO:tasks.workunit.client.1.smithi156.stdout:6/437: rename d3/d16/d5c/d6f to d3/d16/d46/d9d/d9f/dad 0 2024-04-23T14:49:53.798 INFO:tasks.workunit.client.1.smithi156.stdout:6/438: getdents d3/da/d74/d93 0 2024-04-23T14:49:53.798 INFO:tasks.workunit.client.1.smithi156.stdout:6/439: fdatasync d3/da/d1d/d27/d80/f9a 0 2024-04-23T14:49:53.799 INFO:tasks.workunit.client.0.smithi081.stdout:4/645: symlink d1/d4/lda 0 2024-04-23T14:49:53.803 INFO:tasks.workunit.client.1.smithi156.stdout:6/440: creat d3/d16/d46/d9d/d9f/dad/fae x:0 0 0 2024-04-23T14:49:53.803 INFO:tasks.workunit.client.1.smithi156.stdout:6/441: chown d3/da/d74/d93 51372 1 2024-04-23T14:49:53.803 INFO:tasks.workunit.client.1.smithi156.stdout:6/442: chown d3/l79 50664 1 2024-04-23T14:49:53.804 INFO:tasks.workunit.client.0.smithi081.stdout:8/908: symlink d3/d11/d34/l12e 0 2024-04-23T14:49:53.806 INFO:tasks.workunit.client.1.smithi156.stdout:1/436: dwrite db/d1f/d2d/d48/f57 [0,4194304] 0 2024-04-23T14:49:53.806 INFO:tasks.workunit.client.1.smithi156.stdout:1/437: chown db/d25/d4e 0 1 2024-04-23T14:49:53.807 INFO:tasks.workunit.client.0.smithi081.stdout:1/814: write d3/d3d/d41/d5e/d17/d58/f99 [472468,96600] 0 2024-04-23T14:49:53.807 INFO:tasks.workunit.client.0.smithi081.stdout:1/815: dread - d3/d3d/d41/d5e/d12/fbf zero size 2024-04-23T14:49:53.808 INFO:tasks.workunit.client.1.smithi156.stdout:2/365: rename d4/d13/d19/d4c/d5c/d70 to d4/d13/d88 0 2024-04-23T14:49:53.809 INFO:tasks.workunit.client.0.smithi081.stdout:2/738: mkdir d1/d11/d21/d52/d8b/dfc 0 2024-04-23T14:49:53.809 INFO:tasks.workunit.client.0.smithi081.stdout:2/739: fsync d1/d33/d9f/fe6 0 2024-04-23T14:49:53.812 INFO:tasks.workunit.client.1.smithi156.stdout:5/445: dwrite d1/d11/d18/d52/f7f [0,4194304] 0 2024-04-23T14:49:53.814 INFO:tasks.workunit.client.0.smithi081.stdout:3/659: unlink d4/d7/df/fbf 0 2024-04-23T14:49:53.815 INFO:tasks.workunit.client.0.smithi081.stdout:3/660: chown d4/l78 88506800 1 2024-04-23T14:49:53.820 INFO:tasks.workunit.client.0.smithi081.stdout:3/661: write d4/d7/d2e/fae [1361893,8522] 0 2024-04-23T14:49:53.821 INFO:tasks.workunit.client.0.smithi081.stdout:9/691: creat d3/de/d1d/d5b/d7b/db2/dd5/fde x:0 0 0 2024-04-23T14:49:53.822 INFO:tasks.workunit.client.1.smithi156.stdout:6/443: symlink d3/d16/d46/d9d/d9f/dad/laf 0 2024-04-23T14:49:53.822 INFO:tasks.workunit.client.1.smithi156.stdout:6/444: write d3/da/f18 [1056592,48387] 0 2024-04-23T14:49:53.822 INFO:tasks.workunit.client.1.smithi156.stdout:1/438: creat db/d25/d6b/f88 x:0 0 0 2024-04-23T14:49:53.825 INFO:tasks.workunit.client.0.smithi081.stdout:5/801: rename d17/d65/dd2/fdd to d17/d1f/d42/d9b/d9e/f118 0 2024-04-23T14:49:53.829 INFO:tasks.workunit.client.0.smithi081.stdout:7/597: rmdir d3/d20/dc9 39 2024-04-23T14:49:53.834 INFO:tasks.workunit.client.1.smithi156.stdout:4/323: dwrite d0/df/d21/f33 [4194304,4194304] 0 2024-04-23T14:49:53.834 INFO:tasks.workunit.client.1.smithi156.stdout:1/439: creat db/d25/d66/d7c/d86/f89 x:0 0 0 2024-04-23T14:49:53.834 INFO:tasks.workunit.client.1.smithi156.stdout:1/440: chown db/d1f/f79 1568944 1 2024-04-23T14:49:53.839 INFO:tasks.workunit.client.0.smithi081.stdout:4/646: fsync d1/d4/dc/f83 0 2024-04-23T14:49:53.844 INFO:tasks.workunit.client.0.smithi081.stdout:0/798: dwrite d6/d11/d14/d41/d5b/d3f/d44/fd8 [0,4194304] 0 2024-04-23T14:49:53.849 INFO:tasks.workunit.client.1.smithi156.stdout:1/441: symlink db/d25/d4e/l8a 0 2024-04-23T14:49:53.849 INFO:tasks.workunit.client.1.smithi156.stdout:3/360: truncate d4/db/dd/d1d/d1e/d13/f41 765439 0 2024-04-23T14:49:53.851 INFO:tasks.workunit.client.0.smithi081.stdout:2/740: getdents d1/d11/d21/d52 0 2024-04-23T14:49:53.854 INFO:tasks.workunit.client.0.smithi081.stdout:8/909: rename d3/l6 to d3/d11/d34/dab/l12f 0 2024-04-23T14:49:53.854 INFO:tasks.workunit.client.0.smithi081.stdout:7/598: dread d3/d11/d2c/d75/f5c [0,4194304] 0 2024-04-23T14:49:53.857 INFO:tasks.workunit.client.0.smithi081.stdout:4/647: creat d1/d8f/d94/fdb x:0 0 0 2024-04-23T14:49:53.857 INFO:tasks.workunit.client.0.smithi081.stdout:4/648: stat d1/d1d 0 2024-04-23T14:49:53.857 INFO:tasks.workunit.client.0.smithi081.stdout:4/649: dread - d1/d8b/fd1 zero size 2024-04-23T14:49:53.857 INFO:tasks.workunit.client.0.smithi081.stdout:4/650: write d1/d1d/d39/f3c [2695761,101540] 0 2024-04-23T14:49:53.859 INFO:tasks.workunit.client.0.smithi081.stdout:2/741: dread d1/d33/f90 [0,4194304] 0 2024-04-23T14:49:53.860 INFO:tasks.workunit.client.1.smithi156.stdout:1/442: rename db/l5c to db/d25/d30/l8b 0 2024-04-23T14:49:53.863 INFO:tasks.workunit.client.1.smithi156.stdout:3/361: getdents d4/db/dd/d1d/d1e/d42 0 2024-04-23T14:49:53.863 INFO:tasks.workunit.client.0.smithi081.stdout:9/692: dwrite d3/de/d1d/d5b/d7b/fb1 [0,4194304] 0 2024-04-23T14:49:53.866 INFO:tasks.workunit.client.1.smithi156.stdout:1/443: getdents db/d1f/d2f/d47/d71 0 2024-04-23T14:49:53.876 INFO:tasks.workunit.client.0.smithi081.stdout:1/816: rename d3/d3d/d90/la8 to d3/d3d/d41/d5e/da0/l109 0 2024-04-23T14:49:53.877 INFO:tasks.workunit.client.1.smithi156.stdout:8/378: dwrite d5/d9/d10/d1d/f7a [0,4194304] 0 2024-04-23T14:49:53.877 INFO:tasks.workunit.client.1.smithi156.stdout:0/378: dread d0/d4/d22/f7f [0,4194304] 0 2024-04-23T14:49:53.880 INFO:tasks.workunit.client.1.smithi156.stdout:1/444: symlink db/d15/l8c 0 2024-04-23T14:49:53.882 INFO:tasks.workunit.client.0.smithi081.stdout:1/817: write d3/d3d/d41/d5e/fed [96194,115380] 0 2024-04-23T14:49:53.882 INFO:tasks.workunit.client.0.smithi081.stdout:8/910: mknod d3/d11/d86/d88/dd5/c130 0 2024-04-23T14:49:53.886 INFO:tasks.workunit.client.0.smithi081.stdout:4/651: write d1/d1d/d59/f65 [1716687,113081] 0 2024-04-23T14:49:53.888 INFO:tasks.workunit.client.1.smithi156.stdout:9/318: dread d1/d2/d4/d17/d1f/d48/d4e/f6e [0,4194304] 0 2024-04-23T14:49:53.888 INFO:tasks.workunit.client.1.smithi156.stdout:9/319: write d1/d2/d3e/d55/f6b [740888,76555] 0 2024-04-23T14:49:53.888 INFO:tasks.workunit.client.1.smithi156.stdout:9/320: dread - d1/d2/d4/d17/f54 zero size 2024-04-23T14:49:53.889 INFO:tasks.workunit.client.1.smithi156.stdout:0/379: mkdir d0/d16/d3a/d1e/d80 0 2024-04-23T14:49:53.890 INFO:tasks.workunit.client.1.smithi156.stdout:7/397: dwrite dc/d46/f31 [0,4194304] 0 2024-04-23T14:49:53.890 INFO:tasks.workunit.client.1.smithi156.stdout:7/398: stat dc/d46 0 2024-04-23T14:49:53.890 INFO:tasks.workunit.client.1.smithi156.stdout:7/399: read - dc/d1d/d48/f6b zero size 2024-04-23T14:49:53.890 INFO:tasks.workunit.client.1.smithi156.stdout:7/400: chown dc/d1d/d24/d5a/f76 3 1 2024-04-23T14:49:53.890 INFO:tasks.workunit.client.1.smithi156.stdout:7/401: fsync dc/d1d/d41/f57 0 2024-04-23T14:49:53.890 INFO:tasks.workunit.client.1.smithi156.stdout:7/402: dread - dc/d1d/d41/f51 zero size 2024-04-23T14:49:53.890 INFO:tasks.workunit.client.1.smithi156.stdout:7/403: fdatasync dc/d1d/d24/f4a 0 2024-04-23T14:49:53.891 INFO:tasks.workunit.client.0.smithi081.stdout:0/799: write d6/d37/f5c [374768,18267] 0 2024-04-23T14:49:53.891 INFO:tasks.workunit.client.0.smithi081.stdout:0/800: readlink d6/d37/d67/l6e 0 2024-04-23T14:49:53.891 INFO:tasks.workunit.client.0.smithi081.stdout:0/801: fdatasync d6/d37/d4d/f55 0 2024-04-23T14:49:53.893 INFO:tasks.workunit.client.0.smithi081.stdout:9/693: symlink d3/de/ldf 0 2024-04-23T14:49:53.894 INFO:tasks.workunit.client.1.smithi156.stdout:5/446: write d1/d3/d64/f69 [2315592,45830] 0 2024-04-23T14:49:53.898 INFO:tasks.workunit.client.1.smithi156.stdout:8/379: getdents d5/d4e 0 2024-04-23T14:49:53.898 INFO:tasks.workunit.client.1.smithi156.stdout:8/380: truncate d5/d9/d10/d1d/d4c/f50 1655774 0 2024-04-23T14:49:53.898 INFO:tasks.workunit.client.1.smithi156.stdout:8/381: dread - d5/d9/d5a/f75 zero size 2024-04-23T14:49:53.903 INFO:tasks.workunit.client.0.smithi081.stdout:2/742: rename d1/d11/l1a to d1/d33/d9f/lfd 0 2024-04-23T14:49:53.904 INFO:tasks.workunit.client.0.smithi081.stdout:5/802: dwrite d17/d4a/fb9 [4194304,4194304] 0 2024-04-23T14:49:53.904 INFO:tasks.workunit.client.0.smithi081.stdout:5/803: chown d17/d4f/c80 10438 1 2024-04-23T14:49:53.905 INFO:tasks.workunit.client.0.smithi081.stdout:4/652: creat d1/d4/d11/d75/fdc x:0 0 0 2024-04-23T14:49:53.907 INFO:tasks.workunit.client.1.smithi156.stdout:2/366: dwrite d4/d21/d42/f6e [0,4194304] 0 2024-04-23T14:49:53.907 INFO:tasks.workunit.client.1.smithi156.stdout:2/367: dread - d4/d13/d19/d58/f63 zero size 2024-04-23T14:49:53.907 INFO:tasks.workunit.client.1.smithi156.stdout:2/368: dread - d4/d13/d19/f82 zero size 2024-04-23T14:49:53.908 INFO:tasks.workunit.client.0.smithi081.stdout:5/804: read d17/fa0 [220597,100528] 0 2024-04-23T14:49:53.908 INFO:tasks.workunit.client.0.smithi081.stdout:1/818: dread d3/d3d/d41/d4a/d77/f98 [4194304,4194304] 0 2024-04-23T14:49:53.910 INFO:tasks.workunit.client.1.smithi156.stdout:4/324: dwrite d0/df/f17 [0,4194304] 0 2024-04-23T14:49:53.911 INFO:tasks.workunit.client.1.smithi156.stdout:4/325: read d0/df/d55/d68/f43 [130763,52160] 0 2024-04-23T14:49:53.913 INFO:tasks.workunit.client.1.smithi156.stdout:9/321: truncate d1/d2/d4/d40/f61 786908 0 2024-04-23T14:49:53.913 INFO:tasks.workunit.client.1.smithi156.stdout:9/322: chown d1/d2/d4/d19/f26 9873884 1 2024-04-23T14:49:53.913 INFO:tasks.workunit.client.1.smithi156.stdout:9/323: chown d1/d2/d3e/d55/d6f/l53 10555 1 2024-04-23T14:49:53.915 INFO:tasks.workunit.client.0.smithi081.stdout:3/662: truncate d4/d7/d2e/fae 577035 0 2024-04-23T14:49:53.915 INFO:tasks.workunit.client.0.smithi081.stdout:7/599: dwrite d3/d97/fa5 [0,4194304] 0 2024-04-23T14:49:53.919 INFO:tasks.workunit.client.0.smithi081.stdout:0/802: mkdir d6/d11/d14/d24/db3/dfb 0 2024-04-23T14:49:53.919 INFO:tasks.workunit.client.0.smithi081.stdout:0/803: truncate d6/d37/fe4 537346 0 2024-04-23T14:49:53.919 INFO:tasks.workunit.client.0.smithi081.stdout:0/804: creat d6/d37/d85/ffc x:0 0 0 2024-04-23T14:49:53.928 INFO:tasks.workunit.client.1.smithi156.stdout:7/404: stat dc/lf 0 2024-04-23T14:49:53.929 INFO:tasks.workunit.client.1.smithi156.stdout:0/380: creat d0/d16/d3a/d2a/d1d/d2d/d6b/f81 x:0 0 0 2024-04-23T14:49:53.929 INFO:tasks.workunit.client.0.smithi081.stdout:9/694: rename d3/de/d47/cba to d3/de/d1d/d62/ce0 0 2024-04-23T14:49:53.931 INFO:tasks.workunit.client.1.smithi156.stdout:5/447: mknod d1/d3/c93 0 2024-04-23T14:49:53.931 INFO:tasks.workunit.client.1.smithi156.stdout:5/448: write d1/f56 [981244,86433] 0 2024-04-23T14:49:53.932 INFO:tasks.workunit.client.0.smithi081.stdout:2/743: creat d1/d11/df7/ffe x:0 0 0 2024-04-23T14:49:53.934 INFO:tasks.workunit.client.1.smithi156.stdout:1/445: rename db/d1f/d2d/l87 to db/d1f/d34/l8d 0 2024-04-23T14:49:53.934 INFO:tasks.workunit.client.1.smithi156.stdout:1/446: stat db/f17 0 2024-04-23T14:49:53.936 INFO:tasks.workunit.client.0.smithi081.stdout:5/805: creat d17/d3c/f119 x:0 0 0 2024-04-23T14:49:53.936 INFO:tasks.workunit.client.0.smithi081.stdout:5/806: write d17/d18/dff/daf/fc4 [5361543,127887] 0 2024-04-23T14:49:53.936 INFO:tasks.workunit.client.0.smithi081.stdout:4/653: dread d1/d1d/d59/f65 [0,4194304] 0 2024-04-23T14:49:53.937 INFO:tasks.workunit.client.0.smithi081.stdout:1/819: symlink d3/d3d/d41/d5e/d5d/l10a 0 2024-04-23T14:49:53.941 INFO:tasks.workunit.client.1.smithi156.stdout:8/382: dwrite d5/d9/d36/f3e [0,4194304] 0 2024-04-23T14:49:53.943 INFO:tasks.workunit.client.0.smithi081.stdout:8/911: dwrite d3/d1a/f1e [4194304,4194304] 0 2024-04-23T14:49:53.943 INFO:tasks.workunit.client.0.smithi081.stdout:8/912: dread - d3/d11/d86/f9c zero size 2024-04-23T14:49:53.943 INFO:tasks.workunit.client.0.smithi081.stdout:8/913: chown d3/d11/d4f/fee 12 1 2024-04-23T14:49:53.943 INFO:tasks.workunit.client.0.smithi081.stdout:8/914: creat d3/d11/d3e/f131 x:0 0 0 2024-04-23T14:49:53.950 INFO:tasks.workunit.client.0.smithi081.stdout:7/600: creat d3/d21/d41/da3/fd1 x:0 0 0 2024-04-23T14:49:53.960 INFO:tasks.workunit.client.1.smithi156.stdout:9/324: dwrite d1/d2/d4/d17/d1f/f36 [0,4194304] 0 2024-04-23T14:49:53.963 INFO:tasks.workunit.client.1.smithi156.stdout:5/449: link d1/d3/d20/l35 d1/d11/d18/d52/l94 0 2024-04-23T14:49:53.964 INFO:tasks.workunit.client.0.smithi081.stdout:3/663: rename d4/d7/d7f/d85/lb4 to d4/d7/d7f/d85/d9d/dac/dc7/ld4 0 2024-04-23T14:49:53.965 INFO:tasks.workunit.client.0.smithi081.stdout:3/664: read d4/d7/df/f35 [3576466,68929] 0 2024-04-23T14:49:53.966 INFO:tasks.workunit.client.1.smithi156.stdout:2/369: rename d4/d13/f84 to d4/d21/d42/f89 0 2024-04-23T14:49:53.967 INFO:tasks.workunit.client.0.smithi081.stdout:3/665: write d4/dc/d50/d9a/f9b [392441,43388] 0 2024-04-23T14:49:53.968 INFO:tasks.workunit.client.0.smithi081.stdout:9/695: link d3/de/d25/f60 d3/de/d1d/d73/fe1 0 2024-04-23T14:49:53.970 INFO:tasks.workunit.client.1.smithi156.stdout:1/447: creat db/d1f/d34/d63/f8e x:0 0 0 2024-04-23T14:49:53.970 INFO:tasks.workunit.client.1.smithi156.stdout:1/448: creat db/d1f/d2f/d47/f8f x:0 0 0 2024-04-23T14:49:53.970 INFO:tasks.workunit.client.1.smithi156.stdout:1/449: dread - db/d1f/d2f/f7b zero size 2024-04-23T14:49:53.970 INFO:tasks.workunit.client.1.smithi156.stdout:1/450: dread - db/d1f/d34/d63/f8e zero size 2024-04-23T14:49:53.970 INFO:tasks.workunit.client.1.smithi156.stdout:1/451: fsync db/d1f/d2d/d48/f57 0 2024-04-23T14:49:53.970 INFO:tasks.workunit.client.1.smithi156.stdout:1/452: chown db/f27 28298 1 2024-04-23T14:49:53.971 INFO:tasks.workunit.client.0.smithi081.stdout:5/807: creat d17/f11a x:0 0 0 2024-04-23T14:49:53.971 INFO:tasks.workunit.client.0.smithi081.stdout:5/808: chown d17/d18/dff/d9a 205039 1 2024-04-23T14:49:53.974 INFO:tasks.workunit.client.0.smithi081.stdout:4/654: mkdir d1/d4/d6f/d70/d9c/ddd 0 2024-04-23T14:49:53.976 INFO:tasks.workunit.client.1.smithi156.stdout:7/405: dwrite dc/d1d/d24/d5a/f76 [0,4194304] 0 2024-04-23T14:49:53.976 INFO:tasks.workunit.client.1.smithi156.stdout:4/326: dwrite d0/d8/f2f [0,4194304] 0 2024-04-23T14:49:53.976 INFO:tasks.workunit.client.1.smithi156.stdout:4/327: write d0/d8/d1e/f47 [2546812,84711] 0 2024-04-23T14:49:53.976 INFO:tasks.workunit.client.1.smithi156.stdout:4/328: dread - d0/df/f58 zero size 2024-04-23T14:49:53.979 INFO:tasks.workunit.client.1.smithi156.stdout:0/381: getdents d0/d16/d43 0 2024-04-23T14:49:53.980 INFO:tasks.workunit.client.1.smithi156.stdout:9/325: creat d1/d2/d4/d19/f70 x:0 0 0 2024-04-23T14:49:53.983 INFO:tasks.workunit.client.0.smithi081.stdout:8/915: mkdir d3/d11/d3e/d63/d132 0 2024-04-23T14:49:53.985 INFO:tasks.workunit.client.0.smithi081.stdout:7/601: mkdir d3/d21/d41/dd2 0 2024-04-23T14:49:53.985 INFO:tasks.workunit.client.0.smithi081.stdout:7/602: readlink d3/d21/d31/d63/l9d 0 2024-04-23T14:49:53.988 INFO:tasks.workunit.client.1.smithi156.stdout:8/383: rename d5/d39/f7d to d5/d9/d5a/d5c/f85 0 2024-04-23T14:49:53.988 INFO:tasks.workunit.client.1.smithi156.stdout:2/370: symlink d4/d13/d19/d4c/d5c/l8a 0 2024-04-23T14:49:53.988 INFO:tasks.workunit.client.1.smithi156.stdout:2/371: write d4/d13/f86 [357649,80959] 0 2024-04-23T14:49:53.988 INFO:tasks.workunit.client.0.smithi081.stdout:0/805: rmdir d6/d11/d14/d41/d5b/d59/d68 39 2024-04-23T14:49:53.988 INFO:tasks.workunit.client.0.smithi081.stdout:0/806: dread - d6/d11/d14/d41/d5b/d3f/d44/d78/d83/fd2 zero size 2024-04-23T14:49:53.990 INFO:tasks.workunit.client.1.smithi156.stdout:4/329: dread d0/df/f17 [0,4194304] 0 2024-04-23T14:49:53.990 INFO:tasks.workunit.client.1.smithi156.stdout:1/453: unlink db/d25/d30/f53 0 2024-04-23T14:49:53.990 INFO:tasks.workunit.client.1.smithi156.stdout:1/454: write db/d25/d66/d7c/d86/f67 [2696609,43446] 0 2024-04-23T14:49:53.992 INFO:tasks.workunit.client.0.smithi081.stdout:2/744: rename d1/f1c to d1/d33/d9f/fff 0 2024-04-23T14:49:53.994 INFO:tasks.workunit.client.1.smithi156.stdout:4/330: dread d0/df/d55/d68/f4f [0,4194304] 0 2024-04-23T14:49:53.995 INFO:tasks.workunit.client.0.smithi081.stdout:9/696: dread d3/de/d1d/fc3 [0,4194304] 0 2024-04-23T14:49:53.999 INFO:tasks.workunit.client.0.smithi081.stdout:8/916: mkdir d3/d11/d86/d88/da7/de0/d133 0 2024-04-23T14:49:54.004 INFO:tasks.workunit.client.0.smithi081.stdout:0/807: truncate d6/d37/d67/d7d/f94 1062299 0 2024-04-23T14:49:54.005 INFO:tasks.workunit.client.1.smithi156.stdout:7/406: unlink dc/d1d/l3b 0 2024-04-23T14:49:54.007 INFO:tasks.workunit.client.0.smithi081.stdout:0/808: creat d6/d11/d14/d41/d5b/d3f/ffd x:0 0 0 2024-04-23T14:49:54.007 INFO:tasks.workunit.client.0.smithi081.stdout:0/809: stat d6/d11/d14/d41/d5b/l48 0 2024-04-23T14:49:54.007 INFO:tasks.workunit.client.0.smithi081.stdout:0/810: fsync d6/d11/d14/f91 0 2024-04-23T14:49:54.010 INFO:tasks.workunit.client.0.smithi081.stdout:1/820: rename d3/d3d/d41/d5e/d5d/db0/f75 to d3/d3d/d41/d4a/d77/f10b 0 2024-04-23T14:49:54.010 INFO:tasks.workunit.client.0.smithi081.stdout:1/821: creat d3/d3d/d41/d5e/d5d/f10c x:0 0 0 2024-04-23T14:49:54.011 INFO:tasks.workunit.client.1.smithi156.stdout:0/382: rename d0/f1a to d0/d16/d3a/d2a/d1d/d2d/d6b/f82 0 2024-04-23T14:49:54.011 INFO:tasks.workunit.client.0.smithi081.stdout:9/697: rmdir d3/de/d22 39 2024-04-23T14:49:54.014 INFO:tasks.workunit.client.1.smithi156.stdout:8/384: symlink d5/d9/d10/d1d/l86 0 2024-04-23T14:49:54.014 INFO:tasks.workunit.client.1.smithi156.stdout:8/385: stat d5/d4e/f52 0 2024-04-23T14:49:54.015 INFO:tasks.workunit.client.0.smithi081.stdout:6/710: sync 2024-04-23T14:49:54.015 INFO:tasks.workunit.client.0.smithi081.stdout:6/711: chown d1/d51/d65/d8/l1a 87053919 1 2024-04-23T14:49:54.015 INFO:tasks.workunit.client.0.smithi081.stdout:6/712: read d1/f17 [160032,108084] 0 2024-04-23T14:49:54.015 INFO:tasks.workunit.client.0.smithi081.stdout:6/713: rename d1/d51/d65/d8/db1/df0 to d1/d51/d65/d8/db1/df0/d100 22 2024-04-23T14:49:54.015 INFO:tasks.workunit.client.0.smithi081.stdout:6/714: dread - d1/d51/d65/d8/d2e/d59/ff5 zero size 2024-04-23T14:49:54.015 INFO:tasks.workunit.client.0.smithi081.stdout:6/715: chown d1/d51/d65/d8/d2e/d59/c81 2106841 1 2024-04-23T14:49:54.015 INFO:tasks.workunit.client.0.smithi081.stdout:6/716: chown d1/d51/d65/d1c/d6e/d7d/faf 1531 1 2024-04-23T14:49:54.016 INFO:tasks.workunit.client.0.smithi081.stdout:6/717: fsync d1/d51/d65/d8/db1/fec 0 2024-04-23T14:49:54.017 INFO:tasks.workunit.client.0.smithi081.stdout:8/917: symlink d3/d11/d4f/d58/l134 0 2024-04-23T14:49:54.017 INFO:tasks.workunit.client.0.smithi081.stdout:8/918: dread - d3/d11/d4f/d6c/fb4 zero size 2024-04-23T14:49:54.017 INFO:tasks.workunit.client.0.smithi081.stdout:8/919: readlink d3/d11/d48/dc1/lc4 0 2024-04-23T14:49:54.019 INFO:tasks.workunit.client.1.smithi156.stdout:1/455: mkdir db/d25/d6b/d90 0 2024-04-23T14:49:54.020 INFO:tasks.workunit.client.0.smithi081.stdout:7/603: mknod d3/d21/d31/d33/d4b/d4c/cd3 0 2024-04-23T14:49:54.023 INFO:tasks.workunit.client.1.smithi156.stdout:4/331: creat d0/df/d3a/f70 x:0 0 0 2024-04-23T14:49:54.026 INFO:tasks.workunit.client.1.smithi156.stdout:7/407: read dc/d2c/f33 [996401,28708] 0 2024-04-23T14:49:54.026 INFO:tasks.workunit.client.1.smithi156.stdout:2/372: dread d4/d21/d42/f55 [0,4194304] 0 2024-04-23T14:49:54.029 INFO:tasks.workunit.client.1.smithi156.stdout:9/326: rmdir d1/d2/d4/d17 39 2024-04-23T14:49:54.031 INFO:tasks.workunit.client.0.smithi081.stdout:1/822: mkdir d3/d3d/d10d 0 2024-04-23T14:49:54.033 INFO:tasks.workunit.client.1.smithi156.stdout:0/383: mknod d0/d16/c83 0 2024-04-23T14:49:54.036 INFO:tasks.workunit.client.0.smithi081.stdout:6/718: mkdir d1/d51/d65/d13/d16/dd0/df7/da1/dc1/dc9/dcf/d101 0 2024-04-23T14:49:54.036 INFO:tasks.workunit.client.0.smithi081.stdout:6/719: stat d1/d51/d65/d13 0 2024-04-23T14:49:54.036 INFO:tasks.workunit.client.0.smithi081.stdout:6/720: stat d1/d2/d8e/l92 0 2024-04-23T14:49:54.036 INFO:tasks.workunit.client.0.smithi081.stdout:6/721: dread - d1/d51/d65/d13/d16/dd0/df7/da1/dc1/fd8 zero size 2024-04-23T14:49:54.037 INFO:tasks.workunit.client.1.smithi156.stdout:1/456: truncate db/d25/d30/f43 738790 0 2024-04-23T14:49:54.039 INFO:tasks.workunit.client.0.smithi081.stdout:1/823: symlink d3/d3d/d41/d5e/d1d/l10e 0 2024-04-23T14:49:54.039 INFO:tasks.workunit.client.0.smithi081.stdout:1/824: chown d3/d3d/d41/d5e/d17/d58/d7f/f4b 82060 1 2024-04-23T14:49:54.039 INFO:tasks.workunit.client.0.smithi081.stdout:1/825: readlink d3/d3d/d41/l4e 0 2024-04-23T14:49:54.040 INFO:tasks.workunit.client.1.smithi156.stdout:2/373: unlink d4/c52 0 2024-04-23T14:49:54.043 INFO:tasks.workunit.client.0.smithi081.stdout:6/722: link d1/d51/d65/fbf d1/d51/d65/d1c/d6e/d7d/f102 0 2024-04-23T14:49:54.043 INFO:tasks.workunit.client.0.smithi081.stdout:6/723: chown d1/d2/d8e 81814 1 2024-04-23T14:49:54.043 INFO:tasks.workunit.client.0.smithi081.stdout:6/724: chown d1/d51/d65/d8/d2e/c7e 0 1 2024-04-23T14:49:54.043 INFO:tasks.workunit.client.0.smithi081.stdout:6/725: read - d1/d2/d8e/d98/fb4 zero size 2024-04-23T14:49:54.043 INFO:tasks.workunit.client.0.smithi081.stdout:6/726: fdatasync d1/d51/d65/d8/d2e/f5b 0 2024-04-23T14:49:54.044 INFO:tasks.workunit.client.0.smithi081.stdout:6/727: creat d1/d51/d65/d13/d16/f103 x:0 0 0 2024-04-23T14:49:54.044 INFO:tasks.workunit.client.0.smithi081.stdout:6/728: chown d1/d51/d65/d8/db1/fe9 172 1 2024-04-23T14:49:54.044 INFO:tasks.workunit.client.1.smithi156.stdout:3/362: sync 2024-04-23T14:49:54.044 INFO:tasks.workunit.client.1.smithi156.stdout:6/445: sync 2024-04-23T14:49:54.044 INFO:tasks.workunit.client.1.smithi156.stdout:0/384: truncate d0/d16/d3a/d1e/f40 2494207 0 2024-04-23T14:49:54.044 INFO:tasks.workunit.client.1.smithi156.stdout:0/385: write d0/d4/f25 [2881261,3985] 0 2024-04-23T14:49:54.044 INFO:tasks.workunit.client.1.smithi156.stdout:6/446: write d3/da/d1d/d27/f51 [908734,94445] 0 2024-04-23T14:49:54.045 INFO:tasks.workunit.client.0.smithi081.stdout:1/826: mknod d3/d3d/d41/d4a/d77/ddc/c10f 0 2024-04-23T14:49:54.045 INFO:tasks.workunit.client.0.smithi081.stdout:1/827: write d3/d3d/d41/d5e/d5d/fea [402129,126792] 0 2024-04-23T14:49:54.046 INFO:tasks.workunit.client.0.smithi081.stdout:5/809: dwrite d17/d4f/d61/fab [0,4194304] 0 2024-04-23T14:49:54.046 INFO:tasks.workunit.client.0.smithi081.stdout:5/810: stat d17/d1f/ffa 0 2024-04-23T14:49:54.047 INFO:tasks.workunit.client.1.smithi156.stdout:2/374: symlink d4/d13/l8b 0 2024-04-23T14:49:54.047 INFO:tasks.workunit.client.1.smithi156.stdout:2/375: fdatasync d4/d13/d19/d58/f7e 0 2024-04-23T14:49:54.050 INFO:tasks.workunit.client.1.smithi156.stdout:3/363: rename d4/l48 to d4/db/dd/l69 0 2024-04-23T14:49:54.050 INFO:tasks.workunit.client.1.smithi156.stdout:2/376: rename d4/d13/d19 to d4/d13/d19/d58/d8c 22 2024-04-23T14:49:54.054 INFO:tasks.workunit.client.1.smithi156.stdout:0/386: mknod d0/d16/d3a/d2b/d44/d4a/c84 0 2024-04-23T14:49:54.054 INFO:tasks.workunit.client.1.smithi156.stdout:9/327: write d1/d2/d4/d17/d1f/f36 [3158211,59119] 0 2024-04-23T14:49:54.054 INFO:tasks.workunit.client.1.smithi156.stdout:6/447: getdents d3/d16/d46/d2b/d6e/d8f 0 2024-04-23T14:49:54.055 INFO:tasks.workunit.client.0.smithi081.stdout:6/729: unlink d1/d51/d65/d8/d2e/d59/d80/ldd 0 2024-04-23T14:49:54.058 INFO:tasks.workunit.client.0.smithi081.stdout:1/828: symlink d3/d3d/d7a/l110 0 2024-04-23T14:49:54.058 INFO:tasks.workunit.client.0.smithi081.stdout:1/829: creat d3/f111 x:0 0 0 2024-04-23T14:49:54.062 INFO:tasks.workunit.client.1.smithi156.stdout:3/364: rename d4/db/dd/d1d/f49 to d4/db/dd/d1d/d61/f6a 0 2024-04-23T14:49:54.063 INFO:tasks.workunit.client.1.smithi156.stdout:3/365: chown d4/db/dd/d1d/d1e/d42/c59 728153 1 2024-04-23T14:49:54.063 INFO:tasks.workunit.client.1.smithi156.stdout:3/366: readlink d4/l5b 0 2024-04-23T14:49:54.063 INFO:tasks.workunit.client.1.smithi156.stdout:2/377: symlink d4/d21/l8d 0 2024-04-23T14:49:54.065 INFO:tasks.workunit.client.1.smithi156.stdout:3/367: unlink d4/f3f 0 2024-04-23T14:49:54.066 INFO:tasks.workunit.client.0.smithi081.stdout:6/730: link d1/d51/d65/d13/d46/l47 d1/d51/da6/l104 0 2024-04-23T14:49:54.066 INFO:tasks.workunit.client.0.smithi081.stdout:6/731: truncate d1/d51/d65/d8/db1/fe2 3643577 0 2024-04-23T14:49:54.067 INFO:tasks.workunit.client.1.smithi156.stdout:2/378: chown d4/c28 424164064 1 2024-04-23T14:49:54.069 INFO:tasks.workunit.client.1.smithi156.stdout:1/457: dread db/f11 [0,4194304] 0 2024-04-23T14:49:54.071 INFO:tasks.workunit.client.1.smithi156.stdout:9/328: dread d1/d2/d23/d49/d4c/f3b [0,4194304] 0 2024-04-23T14:49:54.072 INFO:tasks.workunit.client.1.smithi156.stdout:9/329: fdatasync d1/d2/d3e/f56 0 2024-04-23T14:49:54.076 INFO:tasks.workunit.client.1.smithi156.stdout:3/368: write d4/db/dd/d1d/d61/f62 [411895,50357] 0 2024-04-23T14:49:54.076 INFO:tasks.workunit.client.1.smithi156.stdout:3/369: stat d4/db/dd/d1d/d1e/d2b/d31/c39 0 2024-04-23T14:49:54.076 INFO:tasks.workunit.client.1.smithi156.stdout:1/458: symlink db/d1f/d2d/d85/l91 0 2024-04-23T14:49:54.078 INFO:tasks.workunit.client.0.smithi081.stdout:1/830: creat d3/d3d/d7a/f112 x:0 0 0 2024-04-23T14:49:54.078 INFO:tasks.workunit.client.0.smithi081.stdout:5/811: mknod d17/d1f/d42/dbb/c11b 0 2024-04-23T14:49:54.078 INFO:tasks.workunit.client.0.smithi081.stdout:6/732: rename d1/d2/d5a/l60 to d1/d51/d65/d13/d16/dd0/df7/da1/dc1/dc9/dcf/l105 0 2024-04-23T14:49:54.079 INFO:tasks.workunit.client.0.smithi081.stdout:6/733: chown d1/d51/d65/d8/d2e/d59/d80/d90/fef 22 1 2024-04-23T14:49:54.079 INFO:tasks.workunit.client.0.smithi081.stdout:6/734: creat d1/d51/d65/d8/d2e/d59/d80/d90/f106 x:0 0 0 2024-04-23T14:49:54.082 INFO:tasks.workunit.client.0.smithi081.stdout:6/735: read d1/d51/d65/d13/d16/dd0/df7/da1/dc1/dc9/fd5 [203459,46683] 0 2024-04-23T14:49:54.082 INFO:tasks.workunit.client.1.smithi156.stdout:3/370: symlink d4/db/dd/l6b 0 2024-04-23T14:49:54.083 INFO:tasks.workunit.client.1.smithi156.stdout:3/371: fdatasync d4/db/dd/f66 0 2024-04-23T14:49:54.087 INFO:tasks.workunit.client.1.smithi156.stdout:2/379: dread d4/d21/d42/f5e [0,4194304] 0 2024-04-23T14:49:54.087 INFO:tasks.workunit.client.1.smithi156.stdout:2/380: readlink d4/d13/l32 0 2024-04-23T14:49:54.098 INFO:tasks.workunit.client.0.smithi081.stdout:8/920: dwrite d3/d11/d4f/fee [0,4194304] 0 2024-04-23T14:49:54.103 INFO:tasks.workunit.client.1.smithi156.stdout:8/386: dwrite d5/d9/d5a/f54 [4194304,4194304] 0 2024-04-23T14:49:54.105 INFO:tasks.workunit.client.1.smithi156.stdout:1/459: rename db/d1f/d2d/d48/l72 to db/d25/l92 0 2024-04-23T14:49:54.107 INFO:tasks.workunit.client.1.smithi156.stdout:3/372: creat d4/db/dd/d1d/d1e/d13/d5a/f6c x:0 0 0 2024-04-23T14:49:54.108 INFO:tasks.workunit.client.1.smithi156.stdout:2/381: mkdir d4/d21/d42/d75/d8e 0 2024-04-23T14:49:54.109 INFO:tasks.workunit.client.1.smithi156.stdout:1/460: getdents db/d25/d66 0 2024-04-23T14:49:54.111 INFO:tasks.workunit.client.1.smithi156.stdout:3/373: mknod d4/c6d 0 2024-04-23T14:49:54.111 INFO:tasks.workunit.client.1.smithi156.stdout:1/461: mkdir db/d1f/d2d/d93 0 2024-04-23T14:49:54.111 INFO:tasks.workunit.client.1.smithi156.stdout:1/462: readlink db/d1f/d28/l31 0 2024-04-23T14:49:54.119 INFO:tasks.workunit.client.1.smithi156.stdout:1/463: mkdir db/d1f/d94 0 2024-04-23T14:49:54.121 INFO:tasks.workunit.client.1.smithi156.stdout:1/464: mknod db/d25/d66/d7c/d68/c95 0 2024-04-23T14:49:54.123 INFO:tasks.workunit.client.0.smithi081.stdout:8/921: dread d3/d11/d4f/faa [0,4194304] 0 2024-04-23T14:49:54.123 INFO:tasks.workunit.client.0.smithi081.stdout:8/922: dread - d3/d11/d4f/d58/fbf zero size 2024-04-23T14:49:54.124 INFO:tasks.workunit.client.1.smithi156.stdout:2/382: read d4/d21/d42/f6e [1748860,8379] 0 2024-04-23T14:49:54.124 INFO:tasks.workunit.client.1.smithi156.stdout:1/465: symlink db/d1f/d2f/l96 0 2024-04-23T14:49:54.124 INFO:tasks.workunit.client.1.smithi156.stdout:1/466: truncate db/f27 4962480 0 2024-04-23T14:49:54.124 INFO:tasks.workunit.client.1.smithi156.stdout:2/383: write d4/d13/d19/d58/f7e [912702,27368] 0 2024-04-23T14:49:54.124 INFO:tasks.workunit.client.1.smithi156.stdout:2/384: write d4/d13/d19/f82 [276631,52386] 0 2024-04-23T14:49:54.124 INFO:tasks.workunit.client.1.smithi156.stdout:2/385: chown d4/l5a 60598 1 2024-04-23T14:49:54.126 INFO:tasks.workunit.client.1.smithi156.stdout:2/386: unlink d4/d13/l32 0 2024-04-23T14:49:54.127 INFO:tasks.workunit.client.0.smithi081.stdout:4/655: dwrite d1/d4/f76 [0,4194304] 0 2024-04-23T14:49:54.128 INFO:tasks.workunit.client.1.smithi156.stdout:1/467: rmdir db/d25/d30 39 2024-04-23T14:49:54.128 INFO:tasks.workunit.client.1.smithi156.stdout:1/468: readlink db/d1f/d34/l8d 0 2024-04-23T14:49:54.129 INFO:tasks.workunit.client.1.smithi156.stdout:2/387: mknod d4/d13/d19/d4c/d5c/c8f 0 2024-04-23T14:49:54.130 INFO:tasks.workunit.client.1.smithi156.stdout:1/469: symlink db/d1f/l97 0 2024-04-23T14:49:54.134 INFO:tasks.workunit.client.1.smithi156.stdout:2/388: creat d4/d21/d42/d75/d8e/f90 x:0 0 0 2024-04-23T14:49:54.138 INFO:tasks.workunit.client.1.smithi156.stdout:1/470: readlink db/d1f/d34/l24 0 2024-04-23T14:49:54.139 INFO:tasks.workunit.client.1.smithi156.stdout:1/471: read - db/d1f/d2f/f7b zero size 2024-04-23T14:49:54.143 INFO:tasks.workunit.client.1.smithi156.stdout:1/472: rmdir db/d25/d66/d7c/d86 39 2024-04-23T14:49:54.144 INFO:tasks.workunit.client.0.smithi081.stdout:9/698: dread d3/de/d1d/d5b/fa3 [0,4194304] 0 2024-04-23T14:49:54.144 INFO:tasks.workunit.client.0.smithi081.stdout:4/656: mknod d1/d1d/d59/cde 0 2024-04-23T14:49:54.147 INFO:tasks.workunit.client.0.smithi081.stdout:4/657: rmdir d1/d4/d11/d9d/dac 39 2024-04-23T14:49:54.147 INFO:tasks.workunit.client.0.smithi081.stdout:4/658: chown d1/d4/d11/c60 14611967 1 2024-04-23T14:49:54.147 INFO:tasks.workunit.client.0.smithi081.stdout:4/659: dread - d1/d8f/d94/fdb zero size 2024-04-23T14:49:54.148 INFO:tasks.workunit.client.1.smithi156.stdout:5/450: dwrite d1/d3/d64/f69 [0,4194304] 0 2024-04-23T14:49:54.148 INFO:tasks.workunit.client.1.smithi156.stdout:5/451: stat d1/c5d 0 2024-04-23T14:49:54.148 INFO:tasks.workunit.client.1.smithi156.stdout:5/452: fsync d1/d11/d18/d52/f7f 0 2024-04-23T14:49:54.148 INFO:tasks.workunit.client.0.smithi081.stdout:4/660: rmdir d1/d4/d11/d9d/dac 39 2024-04-23T14:49:54.149 INFO:tasks.workunit.client.1.smithi156.stdout:8/387: dread d5/d9/d36/f69 [0,4194304] 0 2024-04-23T14:49:54.153 INFO:tasks.workunit.client.0.smithi081.stdout:4/661: write d1/d1d/d59/fb2 [487166,77211] 0 2024-04-23T14:49:54.153 INFO:tasks.workunit.client.0.smithi081.stdout:4/662: write d1/d1d/d39/d8d/fad [468255,64955] 0 2024-04-23T14:49:54.153 INFO:tasks.workunit.client.0.smithi081.stdout:8/923: dread d3/d11/d4f/fee [0,4194304] 0 2024-04-23T14:49:54.156 INFO:tasks.workunit.client.1.smithi156.stdout:7/408: write dc/d1d/d24/f4a [2437896,79285] 0 2024-04-23T14:49:54.156 INFO:tasks.workunit.client.1.smithi156.stdout:7/409: creat dc/d1d/f77 x:0 0 0 2024-04-23T14:49:54.156 INFO:tasks.workunit.client.1.smithi156.stdout:7/410: creat dc/d1d/f78 x:0 0 0 2024-04-23T14:49:54.156 INFO:tasks.workunit.client.1.smithi156.stdout:7/411: chown dc/d2c/c39 3621 1 2024-04-23T14:49:54.159 INFO:tasks.workunit.client.1.smithi156.stdout:5/453: creat d1/d11/d27/f95 x:0 0 0 2024-04-23T14:49:54.159 INFO:tasks.workunit.client.1.smithi156.stdout:5/454: readlink d1/d11/d18/d19/l1d 0 2024-04-23T14:49:54.159 INFO:tasks.workunit.client.1.smithi156.stdout:5/455: write d1/d11/f13 [874799,5006] 0 2024-04-23T14:49:54.159 INFO:tasks.workunit.client.1.smithi156.stdout:5/456: fsync d1/d11/f5e 0 2024-04-23T14:49:54.159 INFO:tasks.workunit.client.1.smithi156.stdout:5/457: write d1/d11/d27/f77 [551017,117275] 0 2024-04-23T14:49:54.160 INFO:tasks.workunit.client.0.smithi081.stdout:8/924: symlink d3/d11/d48/d7e/l135 0 2024-04-23T14:49:54.160 INFO:tasks.workunit.client.0.smithi081.stdout:8/925: chown d3/d11/f9a 986570 1 2024-04-23T14:49:54.160 INFO:tasks.workunit.client.0.smithi081.stdout:8/926: stat d3/l61 0 2024-04-23T14:49:54.165 INFO:tasks.workunit.client.1.smithi156.stdout:8/388: rename d5/d9/d10/f12 to d5/d9/d10/f87 0 2024-04-23T14:49:54.165 INFO:tasks.workunit.client.1.smithi156.stdout:8/389: chown d5/d39/f68 779 1 2024-04-23T14:49:54.171 INFO:tasks.workunit.client.0.smithi081.stdout:8/927: write d3/d11/d34/fa2 [247678,7210] 0 2024-04-23T14:49:54.172 INFO:tasks.workunit.client.1.smithi156.stdout:5/458: dread d1/d3/fd [0,4194304] 0 2024-04-23T14:49:54.179 INFO:tasks.workunit.client.1.smithi156.stdout:7/412: write dc/d46/f31 [2099647,100897] 0 2024-04-23T14:49:54.179 INFO:tasks.workunit.client.0.smithi081.stdout:8/928: link d3/d1a/f53 d3/d11/d86/d88/da7/d117/f136 0 2024-04-23T14:49:54.185 INFO:tasks.workunit.client.1.smithi156.stdout:3/374: getdents d4/db/dd/d1d/d1e/d13/d5a 0 2024-04-23T14:49:54.192 INFO:tasks.workunit.client.1.smithi156.stdout:3/375: dread d4/db/dd/f1b [0,4194304] 0 2024-04-23T14:49:54.192 INFO:tasks.workunit.client.1.smithi156.stdout:3/376: readlink d4/db/dd/d1d/d1e/d13/l63 0 2024-04-23T14:49:54.192 INFO:tasks.workunit.client.1.smithi156.stdout:3/377: dread - d4/db/dd/d1d/d1e/d2b/d31/f4d zero size 2024-04-23T14:49:54.194 INFO:tasks.workunit.client.1.smithi156.stdout:2/389: getdents d4/d13 0 2024-04-23T14:49:54.196 INFO:tasks.workunit.client.0.smithi081.stdout:7/604: dwrite d3/d11/d2c/d75/f86 [0,4194304] 0 2024-04-23T14:49:54.197 INFO:tasks.workunit.client.0.smithi081.stdout:7/605: chown d3/d21/d31/d50/d5a/c5e 0 1 2024-04-23T14:49:54.199 INFO:tasks.workunit.client.1.smithi156.stdout:9/330: dwrite d1/d2/d4/d17/d1f/d48/f4f [0,4194304] 0 2024-04-23T14:49:54.199 INFO:tasks.workunit.client.1.smithi156.stdout:5/459: mkdir d1/d11/d18/d52/d85/d96 0 2024-04-23T14:49:54.200 INFO:tasks.workunit.client.0.smithi081.stdout:6/736: dwrite d1/d51/d65/d13/d16/f4c [0,4194304] 0 2024-04-23T14:49:54.200 INFO:tasks.workunit.client.0.smithi081.stdout:1/831: dwrite d3/d3d/d41/d5e/d5d/db0/f45 [0,4194304] 0 2024-04-23T14:49:54.201 INFO:tasks.workunit.client.0.smithi081.stdout:0/811: dwrite d6/d37/d85/fde [0,4194304] 0 2024-04-23T14:49:54.201 INFO:tasks.workunit.client.0.smithi081.stdout:7/606: link d3/d21/d31/d63/fcc d3/d21/d31/d33/d52/fd4 0 2024-04-23T14:49:54.201 INFO:tasks.workunit.client.0.smithi081.stdout:7/607: dread - d3/d11/d2c/f3d zero size 2024-04-23T14:49:54.202 INFO:tasks.workunit.client.0.smithi081.stdout:5/812: dwrite d17/d4a/f5b [0,4194304] 0 2024-04-23T14:49:54.203 INFO:tasks.workunit.client.1.smithi156.stdout:7/413: mknod dc/c79 0 2024-04-23T14:49:54.209 INFO:tasks.workunit.client.1.smithi156.stdout:1/473: dwrite db/d1f/d2f/d47/f5f [0,4194304] 0 2024-04-23T14:49:54.211 INFO:tasks.workunit.client.0.smithi081.stdout:4/663: dwrite d1/d4/d11/d75/f88 [0,4194304] 0 2024-04-23T14:49:54.212 INFO:tasks.workunit.client.0.smithi081.stdout:4/664: write d1/d4/dc/f6a [1221530,108388] 0 2024-04-23T14:49:54.212 INFO:tasks.workunit.client.0.smithi081.stdout:4/665: stat d1/f12 0 2024-04-23T14:49:54.212 INFO:tasks.workunit.client.0.smithi081.stdout:4/666: chown d1/d4f/la2 7577739 1 2024-04-23T14:49:54.218 INFO:tasks.workunit.client.1.smithi156.stdout:7/414: symlink dc/d1d/d41/d53/l7a 0 2024-04-23T14:49:54.218 INFO:tasks.workunit.client.1.smithi156.stdout:7/415: creat dc/d1d/d24/f7b x:0 0 0 2024-04-23T14:49:54.220 INFO:tasks.workunit.client.0.smithi081.stdout:8/929: dread d3/d11/d34/fa2 [0,4194304] 0 2024-04-23T14:49:54.220 INFO:tasks.workunit.client.0.smithi081.stdout:8/930: chown d3/d11/d48/d7e/feb 2433 1 2024-04-23T14:49:54.224 INFO:tasks.workunit.client.1.smithi156.stdout:3/378: getdents d4/db/dd/d20 0 2024-04-23T14:49:54.224 INFO:tasks.workunit.client.0.smithi081.stdout:0/812: dread d6/d37/d4d/f55 [0,4194304] 0 2024-04-23T14:49:54.225 INFO:tasks.workunit.client.0.smithi081.stdout:6/737: mknod d1/d2/d8e/d98/c107 0 2024-04-23T14:49:54.226 INFO:tasks.workunit.client.0.smithi081.stdout:6/738: creat d1/d51/d65/f108 x:0 0 0 2024-04-23T14:49:54.229 INFO:tasks.workunit.client.0.smithi081.stdout:1/832: creat d3/d3d/d41/d5e/d17/d25/f113 x:0 0 0 2024-04-23T14:49:54.229 INFO:tasks.workunit.client.0.smithi081.stdout:1/833: chown d3/d3d/d41/d5e/d17/d58 422175 1 2024-04-23T14:49:54.229 INFO:tasks.workunit.client.0.smithi081.stdout:1/834: chown d3/d3d/f32 671 1 2024-04-23T14:49:54.229 INFO:tasks.workunit.client.0.smithi081.stdout:1/835: write d3/d3d/d41/d5e/d5d/fea [582296,25520] 0 2024-04-23T14:49:54.229 INFO:tasks.workunit.client.0.smithi081.stdout:1/836: creat d3/d3d/d41/d5e/dd2/f114 x:0 0 0 2024-04-23T14:49:54.233 INFO:tasks.workunit.client.0.smithi081.stdout:5/813: symlink d17/l11c 0 2024-04-23T14:49:54.234 INFO:tasks.workunit.client.1.smithi156.stdout:1/474: symlink db/d1f/d34/d63/l98 0 2024-04-23T14:49:54.237 INFO:tasks.workunit.client.1.smithi156.stdout:0/387: truncate d0/d16/d3a/d1e/f40 1638829 0 2024-04-23T14:49:54.237 INFO:tasks.workunit.client.1.smithi156.stdout:0/388: creat d0/d16/d3a/d2a/d1d/d2d/f85 x:0 0 0 2024-04-23T14:49:54.238 INFO:tasks.workunit.client.1.smithi156.stdout:8/390: dwrite d5/d9/d10/d1d/d21/f40 [0,4194304] 0 2024-04-23T14:49:54.238 INFO:tasks.workunit.client.1.smithi156.stdout:8/391: fdatasync d5/d9/d5a/f43 0 2024-04-23T14:49:54.240 INFO:tasks.workunit.client.0.smithi081.stdout:4/667: mknod d1/d4f/dc3/cdf 0 2024-04-23T14:49:54.243 INFO:tasks.workunit.client.1.smithi156.stdout:9/331: symlink d1/d2/d4/l71 0 2024-04-23T14:49:54.249 INFO:tasks.workunit.client.0.smithi081.stdout:8/931: truncate d3/d11/d3e/d63/f75 190435 0 2024-04-23T14:49:54.253 INFO:tasks.workunit.client.0.smithi081.stdout:0/813: unlink d6/d25/fba 0 2024-04-23T14:49:54.257 INFO:tasks.workunit.client.1.smithi156.stdout:3/379: symlink d4/db/dd/d1d/d1e/l6e 0 2024-04-23T14:49:54.257 INFO:tasks.workunit.client.1.smithi156.stdout:3/380: chown d4/l3d 33473 1 2024-04-23T14:49:54.259 INFO:tasks.workunit.client.0.smithi081.stdout:6/739: getdents d1/d51/d65/d1c/d6e/d7d 0 2024-04-23T14:49:54.259 INFO:tasks.workunit.client.0.smithi081.stdout:6/740: truncate d1/d51/d65/d13/d16/fc7 276639 0 2024-04-23T14:49:54.263 INFO:tasks.workunit.client.1.smithi156.stdout:2/390: dwrite d4/d13/d19/f82 [0,4194304] 0 2024-04-23T14:49:54.263 INFO:tasks.workunit.client.1.smithi156.stdout:2/391: creat d4/d13/d19/d4c/f91 x:0 0 0 2024-04-23T14:49:54.263 INFO:tasks.workunit.client.1.smithi156.stdout:2/392: chown d4/lb 68363141 1 2024-04-23T14:49:54.263 INFO:tasks.workunit.client.0.smithi081.stdout:1/837: mkdir d3/d3d/d41/d5e/d12/d1a/d115 0 2024-04-23T14:49:54.264 INFO:tasks.workunit.client.0.smithi081.stdout:1/838: creat d3/d3d/d90/de0/f116 x:0 0 0 2024-04-23T14:49:54.265 INFO:tasks.workunit.client.0.smithi081.stdout:5/814: truncate d17/d3d/d41/f5e 32870 0 2024-04-23T14:49:54.268 INFO:tasks.workunit.client.0.smithi081.stdout:4/668: link d1/f3a d1/d4/d6f/d70/daf/d8c/dce/fe0 0 2024-04-23T14:49:54.268 INFO:tasks.workunit.client.0.smithi081.stdout:4/669: creat d1/d8b/fe1 x:0 0 0 2024-04-23T14:49:54.270 INFO:tasks.workunit.client.0.smithi081.stdout:4/670: dread - d1/d4/d6f/d70/daf/d8c/dce/fe0 zero size 2024-04-23T14:49:54.271 INFO:tasks.workunit.client.0.smithi081.stdout:8/932: rename d3/l126 to d3/d11/d48/dc1/d110/l137 0 2024-04-23T14:49:54.271 INFO:tasks.workunit.client.0.smithi081.stdout:0/814: write d6/d11/db0/fbe [706859,129754] 0 2024-04-23T14:49:54.271 INFO:tasks.workunit.client.0.smithi081.stdout:0/815: chown d6/d11/d14/dec 638124 1 2024-04-23T14:49:54.272 INFO:tasks.workunit.client.1.smithi156.stdout:3/381: mknod d4/db/c6f 0 2024-04-23T14:49:54.273 INFO:tasks.workunit.client.0.smithi081.stdout:6/741: symlink d1/d51/d65/d1c/d66/l109 0 2024-04-23T14:49:54.273 INFO:tasks.workunit.client.0.smithi081.stdout:7/608: dwrite d3/d11/d2c/f3d [0,4194304] 0 2024-04-23T14:49:54.278 INFO:tasks.workunit.client.0.smithi081.stdout:1/839: mkdir d3/d3d/d41/d5e/d117 0 2024-04-23T14:49:54.282 INFO:tasks.workunit.client.1.smithi156.stdout:2/393: link d4/d13/l50 d4/d26/l92 0 2024-04-23T14:49:54.282 INFO:tasks.workunit.client.1.smithi156.stdout:2/394: fdatasync d4/d13/d19/d4c/f6c 0 2024-04-23T14:49:54.284 INFO:tasks.workunit.client.0.smithi081.stdout:6/742: dread d1/d51/d65/d8/d2e/d58/f9d [0,4194304] 0 2024-04-23T14:49:54.285 INFO:tasks.workunit.client.1.smithi156.stdout:3/382: mkdir d4/db/dd/d1d/d1e/d2b/d31/d70 0 2024-04-23T14:49:54.287 INFO:tasks.workunit.client.0.smithi081.stdout:5/815: link d17/d18/dff/l10b d17/d1f/d42/l11d 0 2024-04-23T14:49:54.287 INFO:tasks.workunit.client.1.smithi156.stdout:6/448: sync 2024-04-23T14:49:54.288 INFO:tasks.workunit.client.1.smithi156.stdout:6/449: truncate d3/d16/d1e/f7d 963297 0 2024-04-23T14:49:54.288 INFO:tasks.workunit.client.1.smithi156.stdout:6/450: chown d3/d16/d5c/fac 32340877 1 2024-04-23T14:49:54.290 INFO:tasks.workunit.client.1.smithi156.stdout:4/332: sync 2024-04-23T14:49:54.291 INFO:tasks.workunit.client.0.smithi081.stdout:0/816: mkdir d6/d11/d14/d41/d5b/d3f/d44/d78/d84/dfe 0 2024-04-23T14:49:54.294 INFO:tasks.workunit.client.0.smithi081.stdout:8/933: dread d3/d11/d3e/fbb [0,4194304] 0 2024-04-23T14:49:54.300 INFO:tasks.workunit.client.1.smithi156.stdout:6/451: creat d3/fb0 x:0 0 0 2024-04-23T14:49:54.305 INFO:tasks.workunit.client.0.smithi081.stdout:7/609: truncate d3/d21/d31/d63/f6c 37113 0 2024-04-23T14:49:54.305 INFO:tasks.workunit.client.0.smithi081.stdout:7/610: fdatasync d3/d20/dc9/f99 0 2024-04-23T14:49:54.305 INFO:tasks.workunit.client.0.smithi081.stdout:7/611: read - d3/d21/d31/d33/d52/fd4 zero size 2024-04-23T14:49:54.306 INFO:tasks.workunit.client.1.smithi156.stdout:6/452: truncate d3/da/d1d/f61 3006262 0 2024-04-23T14:49:54.306 INFO:tasks.workunit.client.1.smithi156.stdout:6/453: chown d3/da/d1d/f67 87480 1 2024-04-23T14:49:54.307 INFO:tasks.workunit.client.0.smithi081.stdout:1/840: mknod d3/d3d/d10d/c118 0 2024-04-23T14:49:54.309 INFO:tasks.workunit.client.0.smithi081.stdout:5/816: creat d17/d37/da4/f11e x:0 0 0 2024-04-23T14:49:54.311 INFO:tasks.workunit.client.1.smithi156.stdout:6/454: unlink d3/da/d1d/d27/d63/c88 0 2024-04-23T14:49:54.312 INFO:tasks.workunit.client.0.smithi081.stdout:4/671: dwrite d1/d8f/d94/fdb [0,4194304] 0 2024-04-23T14:49:54.313 INFO:tasks.workunit.client.1.smithi156.stdout:2/395: dread d4/f16 [0,4194304] 0 2024-04-23T14:49:54.313 INFO:tasks.workunit.client.1.smithi156.stdout:2/396: chown d4/d13/d19/d4c/d5c/c6d 11898624 1 2024-04-23T14:49:54.315 INFO:tasks.workunit.client.1.smithi156.stdout:2/397: fsync d4/d13/f86 0 2024-04-23T14:49:54.315 INFO:tasks.workunit.client.1.smithi156.stdout:0/389: dwrite d0/d4/fe [4194304,4194304] 0 2024-04-23T14:49:54.315 INFO:tasks.workunit.client.1.smithi156.stdout:0/390: chown d0/d16/d3a/d2a/d1d/d2d/d6b/f81 6629 1 2024-04-23T14:49:54.315 INFO:tasks.workunit.client.1.smithi156.stdout:0/391: readlink d0/d16/d43/l4f 0 2024-04-23T14:49:54.316 INFO:tasks.workunit.client.1.smithi156.stdout:6/455: mknod d3/d16/cb1 0 2024-04-23T14:49:54.316 INFO:tasks.workunit.client.1.smithi156.stdout:6/456: fsync d3/d16/d1e/f3d 0 2024-04-23T14:49:54.318 INFO:tasks.workunit.client.0.smithi081.stdout:7/612: rename d3/d20/f2d to d3/d21/d31/d33/d4b/fd5 0 2024-04-23T14:49:54.318 INFO:tasks.workunit.client.0.smithi081.stdout:5/817: link d17/d3c/fbe d17/d3c/d55/d64/f11f 0 2024-04-23T14:49:54.320 INFO:tasks.workunit.client.1.smithi156.stdout:0/392: creat d0/d4/d11/d3f/d45/f86 x:0 0 0 2024-04-23T14:49:54.322 INFO:tasks.workunit.client.0.smithi081.stdout:7/613: symlink d3/d21/d41/da3/ld6 0 2024-04-23T14:49:54.323 INFO:tasks.workunit.client.1.smithi156.stdout:1/475: dwrite db/f17 [0,4194304] 0 2024-04-23T14:49:54.324 INFO:tasks.workunit.client.1.smithi156.stdout:0/393: truncate d0/d16/d3a/d2a/d1d/d2d/d6b/f82 44815 0 2024-04-23T14:49:54.327 INFO:tasks.workunit.client.0.smithi081.stdout:0/817: dread d6/d11/d14/d41/d5b/d3f/f4a [0,4194304] 0 2024-04-23T14:49:54.327 INFO:tasks.workunit.client.0.smithi081.stdout:0/818: write d6/d11/d14/d41/d5b/d3f/d44/d78/fb7 [528916,90238] 0 2024-04-23T14:49:54.331 INFO:tasks.workunit.client.0.smithi081.stdout:0/819: unlink d6/f10 0 2024-04-23T14:49:54.335 INFO:tasks.workunit.client.0.smithi081.stdout:0/820: symlink d6/d37/d4d/d71/lff 0 2024-04-23T14:49:54.336 INFO:tasks.workunit.client.1.smithi156.stdout:4/333: dread d0/f3 [0,4194304] 0 2024-04-23T14:49:54.337 INFO:tasks.workunit.client.0.smithi081.stdout:0/821: symlink d6/d11/d14/d41/d5b/d3f/d44/d76/l100 0 2024-04-23T14:49:54.338 INFO:tasks.workunit.client.1.smithi156.stdout:4/334: truncate d0/df/d55/d68/f6f 629114 0 2024-04-23T14:49:54.338 INFO:tasks.workunit.client.1.smithi156.stdout:6/457: write d3/d16/d1e/f5f [90384,75629] 0 2024-04-23T14:49:54.338 INFO:tasks.workunit.client.1.smithi156.stdout:6/458: fsync d3/f4e 0 2024-04-23T14:49:54.339 INFO:tasks.workunit.client.1.smithi156.stdout:9/332: dread d1/d2/d4/ff [0,4194304] 0 2024-04-23T14:49:54.339 INFO:tasks.workunit.client.1.smithi156.stdout:9/333: fdatasync d1/d2/d4/d19/f70 0 2024-04-23T14:49:54.343 INFO:tasks.workunit.client.1.smithi156.stdout:2/398: dread d4/d26/f44 [0,4194304] 0 2024-04-23T14:49:54.346 INFO:tasks.workunit.client.0.smithi081.stdout:4/672: dread d1/d4/d11/f7f [4194304,4194304] 0 2024-04-23T14:49:54.346 INFO:tasks.workunit.client.0.smithi081.stdout:4/673: chown d1/d8f/d94 29593790 1 2024-04-23T14:49:54.346 INFO:tasks.workunit.client.0.smithi081.stdout:8/934: write d3/d11/f35 [3756114,12015] 0 2024-04-23T14:49:54.350 INFO:tasks.workunit.client.0.smithi081.stdout:0/822: rename d6/d37/cb2 to d6/d37/d4d/c101 0 2024-04-23T14:49:54.354 INFO:tasks.workunit.client.0.smithi081.stdout:7/614: read d3/d21/d31/f8 [3967732,87443] 0 2024-04-23T14:49:54.355 INFO:tasks.workunit.client.0.smithi081.stdout:7/615: write d3/d11/d2c/d75/f3c [2176799,105228] 0 2024-04-23T14:49:54.358 INFO:tasks.workunit.client.1.smithi156.stdout:6/459: symlink d3/da/d1d/d27/d80/da5/lb2 0 2024-04-23T14:49:54.358 INFO:tasks.workunit.client.1.smithi156.stdout:6/460: getdents d3/d16/d46/d2b/d6e/d8f 0 2024-04-23T14:49:54.364 INFO:tasks.workunit.client.0.smithi081.stdout:4/674: creat d1/d4/dc/dba/fe2 x:0 0 0 2024-04-23T14:49:54.367 INFO:tasks.workunit.client.1.smithi156.stdout:1/476: dread db/d15/f22 [0,4194304] 0 2024-04-23T14:49:54.367 INFO:tasks.workunit.client.1.smithi156.stdout:9/334: creat d1/d2/d4/d40/f72 x:0 0 0 2024-04-23T14:49:54.367 INFO:tasks.workunit.client.1.smithi156.stdout:1/477: write db/d1f/d28/f37 [4008950,119516] 0 2024-04-23T14:49:54.367 INFO:tasks.workunit.client.1.smithi156.stdout:9/335: creat d1/d2/d4/d40/f73 x:0 0 0 2024-04-23T14:49:54.368 INFO:tasks.workunit.client.1.smithi156.stdout:1/478: dread - db/d25/d66/d7c/d86/f89 zero size 2024-04-23T14:49:54.368 INFO:tasks.workunit.client.1.smithi156.stdout:9/336: fdatasync d1/d2/d4/d17/d1f/f63 0 2024-04-23T14:49:54.368 INFO:tasks.workunit.client.1.smithi156.stdout:9/337: write d1/d2/d4/d17/d1f/f37 [5108778,120327] 0 2024-04-23T14:49:54.368 INFO:tasks.workunit.client.1.smithi156.stdout:9/338: stat d1/d2 0 2024-04-23T14:49:54.368 INFO:tasks.workunit.client.0.smithi081.stdout:6/743: dwrite d1/d51/d65/f62 [0,4194304] 0 2024-04-23T14:49:54.370 INFO:tasks.workunit.client.1.smithi156.stdout:3/383: dwrite d4/db/dd/d1d/f2e [0,4194304] 0 2024-04-23T14:49:54.373 INFO:tasks.workunit.client.1.smithi156.stdout:3/384: truncate d4/db/dd/d1d/d1e/d13/d5a/f6c 1016839 0 2024-04-23T14:49:54.373 INFO:tasks.workunit.client.1.smithi156.stdout:6/461: symlink d3/da/d74/d93/lb3 0 2024-04-23T14:49:54.375 INFO:tasks.workunit.client.0.smithi081.stdout:8/935: getdents d3/d11/d3e/d63/d78/da0 0 2024-04-23T14:49:54.376 INFO:tasks.workunit.client.0.smithi081.stdout:8/936: dread - d3/d11/d48/dc1/ff4 zero size 2024-04-23T14:49:54.376 INFO:tasks.workunit.client.0.smithi081.stdout:8/937: write d3/d1a/f1e [997999,126892] 0 2024-04-23T14:49:54.376 INFO:tasks.workunit.client.0.smithi081.stdout:5/818: dwrite d17/f38 [0,4194304] 0 2024-04-23T14:49:54.389 INFO:tasks.workunit.client.1.smithi156.stdout:3/385: write d4/db/dd/d1d/f2e [2077170,77094] 0 2024-04-23T14:49:54.393 INFO:tasks.workunit.client.1.smithi156.stdout:9/339: link d1/d2/d3e/d50/l62 d1/d2/d23/d2d/d39/d6c/l74 0 2024-04-23T14:49:54.397 INFO:tasks.workunit.client.1.smithi156.stdout:6/462: mknod d3/da/d1d/cb4 0 2024-04-23T14:49:54.400 INFO:tasks.workunit.client.1.smithi156.stdout:8/392: dwrite d5/d9/f48 [0,4194304] 0 2024-04-23T14:49:54.403 INFO:tasks.workunit.client.1.smithi156.stdout:1/479: mknod db/d1f/d34/c99 0 2024-04-23T14:49:54.407 INFO:tasks.workunit.client.1.smithi156.stdout:9/340: mkdir d1/d2/d23/d75 0 2024-04-23T14:49:54.412 INFO:tasks.workunit.client.0.smithi081.stdout:5/819: mkdir d17/d1f/d42/d9b/dc9/d120 0 2024-04-23T14:49:54.419 INFO:tasks.workunit.client.1.smithi156.stdout:8/393: creat d5/d9/d10/f88 x:0 0 0 2024-04-23T14:49:54.422 INFO:tasks.workunit.client.1.smithi156.stdout:1/480: creat db/d25/d30/d38/d40/f9a x:0 0 0 2024-04-23T14:49:54.425 INFO:tasks.workunit.client.0.smithi081.stdout:0/823: dwrite d6/d11/d14/d41/d5b/d59/d68/dbd/fea [0,4194304] 0 2024-04-23T14:49:54.429 INFO:tasks.workunit.client.1.smithi156.stdout:8/394: rmdir d5/d39 39 2024-04-23T14:49:54.432 INFO:tasks.workunit.client.0.smithi081.stdout:1/841: dwrite d3/d3d/f13 [0,4194304] 0 2024-04-23T14:49:54.432 INFO:tasks.workunit.client.0.smithi081.stdout:1/842: truncate d3/d3d/d41/d5e/d9d/fb9 148031 0 2024-04-23T14:49:54.432 INFO:tasks.workunit.client.0.smithi081.stdout:1/843: write d3/d3d/d41/d92/fbc [4931863,9522] 0 2024-04-23T14:49:54.433 INFO:tasks.workunit.client.1.smithi156.stdout:0/394: dwrite d0/d4/d11/d3f/f68 [0,4194304] 0 2024-04-23T14:49:54.434 INFO:tasks.workunit.client.1.smithi156.stdout:0/395: read - d0/d16/d3a/d1e/f77 zero size 2024-04-23T14:49:54.434 INFO:tasks.workunit.client.1.smithi156.stdout:0/396: chown d0/d16/d3a/d2b/d44/d4a/f57 111490512 1 2024-04-23T14:49:54.434 INFO:tasks.workunit.client.1.smithi156.stdout:0/397: readlink d0/d4/d11/l2e 0 2024-04-23T14:49:54.441 INFO:tasks.workunit.client.1.smithi156.stdout:0/398: truncate d0/d4/d11/d3f/d5f/f1f 37535 0 2024-04-23T14:49:54.449 INFO:tasks.workunit.client.0.smithi081.stdout:4/675: dwrite d1/d1d/d39/d8d/fb8 [0,4194304] 0 2024-04-23T14:49:54.452 INFO:tasks.workunit.client.1.smithi156.stdout:0/399: creat d0/d16/d3a/d2a/f87 x:0 0 0 2024-04-23T14:49:54.455 INFO:tasks.workunit.client.0.smithi081.stdout:7/616: dwrite d3/d97/fbd [0,4194304] 0 2024-04-23T14:49:54.455 INFO:tasks.workunit.client.0.smithi081.stdout:6/744: dwrite d1/d51/d65/ffa [0,4194304] 0 2024-04-23T14:49:54.455 INFO:tasks.workunit.client.0.smithi081.stdout:7/617: write d3/d21/d31/d50/fa7 [237085,51694] 0 2024-04-23T14:49:54.455 INFO:tasks.workunit.client.0.smithi081.stdout:7/618: chown d3/d21/d41/ccb 1592673 1 2024-04-23T14:49:54.455 INFO:tasks.workunit.client.0.smithi081.stdout:7/619: fsync d3/d21/d41/dbb/fc4 0 2024-04-23T14:49:54.461 INFO:tasks.workunit.client.0.smithi081.stdout:5/820: dread d17/d37/d4e/f101 [0,4194304] 0 2024-04-23T14:49:54.465 INFO:tasks.workunit.client.1.smithi156.stdout:6/463: dwrite d3/da/d1d/f67 [0,4194304] 0 2024-04-23T14:49:54.465 INFO:tasks.workunit.client.1.smithi156.stdout:6/464: fdatasync d3/da/d1d/d27/f51 0 2024-04-23T14:49:54.465 INFO:tasks.workunit.client.1.smithi156.stdout:6/465: dread - d3/d16/d5c/f86 zero size 2024-04-23T14:49:54.465 INFO:tasks.workunit.client.1.smithi156.stdout:6/466: fsync d3/da/f18 0 2024-04-23T14:49:54.467 INFO:tasks.workunit.client.1.smithi156.stdout:0/400: symlink d0/l88 0 2024-04-23T14:49:54.467 INFO:tasks.workunit.client.1.smithi156.stdout:0/401: write d0/d4/d22/d58/f69 [102204,50290] 0 2024-04-23T14:49:54.468 INFO:tasks.workunit.client.0.smithi081.stdout:1/844: write d3/d3d/d41/d5e/d5d/fa4 [3117650,67206] 0 2024-04-23T14:49:54.469 INFO:tasks.workunit.client.1.smithi156.stdout:0/402: creat d0/f89 x:0 0 0 2024-04-23T14:49:54.484 INFO:tasks.workunit.client.1.smithi156.stdout:1/481: dwrite db/d25/d66/d7c/d86/f67 [4194304,4194304] 0 2024-04-23T14:49:54.485 INFO:tasks.workunit.client.1.smithi156.stdout:6/467: creat d3/da/d1d/fb5 x:0 0 0 2024-04-23T14:49:54.490 INFO:tasks.workunit.client.0.smithi081.stdout:6/745: symlink d1/d51/d65/d8/da4/l10a 0 2024-04-23T14:49:54.490 INFO:tasks.workunit.client.0.smithi081.stdout:6/746: chown d1/d51/d65/d13/d16/dd0/df7/da1/dc1/dc9/ddb/cea 1795197 1 2024-04-23T14:49:54.493 INFO:tasks.workunit.client.0.smithi081.stdout:7/620: symlink d3/d21/d41/dcd/ld7 0 2024-04-23T14:49:54.496 INFO:tasks.workunit.client.1.smithi156.stdout:1/482: unlink db/d25/d30/d38/f4d 0 2024-04-23T14:49:54.499 INFO:tasks.workunit.client.0.smithi081.stdout:8/938: dwrite d3/d1a/fb8 [0,4194304] 0 2024-04-23T14:49:54.502 INFO:tasks.workunit.client.0.smithi081.stdout:5/821: rename d17/d1f/d42/f102 to d17/d1f/d42/d9b/d9e/da3/f121 0 2024-04-23T14:49:54.502 INFO:tasks.workunit.client.1.smithi156.stdout:0/403: dread d0/d4/fe [4194304,4194304] 0 2024-04-23T14:49:54.502 INFO:tasks.workunit.client.1.smithi156.stdout:6/468: rmdir d3/d16/d46/d2b/d3b/d9e 39 2024-04-23T14:49:54.506 INFO:tasks.workunit.client.1.smithi156.stdout:2/399: dwrite d4/d13/d19/d58/f5b [0,4194304] 0 2024-04-23T14:49:54.506 INFO:tasks.workunit.client.1.smithi156.stdout:2/400: chown d4/d13/d88/l7b 30378 1 2024-04-23T14:49:54.507 INFO:tasks.workunit.client.1.smithi156.stdout:4/335: dwrite d0/df/f14 [0,4194304] 0 2024-04-23T14:49:54.507 INFO:tasks.workunit.client.1.smithi156.stdout:8/395: dread d5/d9/f4b [0,4194304] 0 2024-04-23T14:49:54.509 INFO:tasks.workunit.client.1.smithi156.stdout:1/483: rename db/d1f/d34/l24 to db/d1f/d34/d63/l9b 0 2024-04-23T14:49:54.513 INFO:tasks.workunit.client.0.smithi081.stdout:7/621: truncate d3/d21/d31/d33/d4b/f60 483079 0 2024-04-23T14:49:54.514 INFO:tasks.workunit.client.1.smithi156.stdout:0/404: creat d0/d4/f8a x:0 0 0 2024-04-23T14:49:54.520 INFO:tasks.workunit.client.0.smithi081.stdout:6/747: read d1/d51/d65/f86 [114810,85805] 0 2024-04-23T14:49:54.520 INFO:tasks.workunit.client.0.smithi081.stdout:6/748: fdatasync d1/d51/d65/d1c/d6e/fe3 0 2024-04-23T14:49:54.520 INFO:tasks.workunit.client.0.smithi081.stdout:6/749: chown d1/d51/d65/d13/d46/l89 0 1 2024-04-23T14:49:54.522 INFO:tasks.workunit.client.0.smithi081.stdout:5/822: creat d17/d65/de3/d108/dd8/f122 x:0 0 0 2024-04-23T14:49:54.523 INFO:tasks.workunit.client.1.smithi156.stdout:7/416: sync 2024-04-23T14:49:54.523 INFO:tasks.workunit.client.1.smithi156.stdout:5/460: sync 2024-04-23T14:49:54.529 INFO:tasks.workunit.client.0.smithi081.stdout:7/622: dread d3/d21/d31/d33/d4b/f92 [0,4194304] 0 2024-04-23T14:49:54.529 INFO:tasks.workunit.client.0.smithi081.stdout:7/623: readlink d3/l7b 0 2024-04-23T14:49:54.532 INFO:tasks.workunit.client.0.smithi081.stdout:7/624: creat d3/d21/d31/d33/d4b/d6e/fd8 x:0 0 0 2024-04-23T14:49:54.533 INFO:tasks.workunit.client.0.smithi081.stdout:4/676: dwrite d1/d4/d6f/fb4 [0,4194304] 0 2024-04-23T14:49:54.535 INFO:tasks.workunit.client.0.smithi081.stdout:8/939: dwrite d3/d11/d3e/d63/d78/da0/fff [0,4194304] 0 2024-04-23T14:49:54.537 INFO:tasks.workunit.client.1.smithi156.stdout:1/484: rename db/d1f/d34/d63/c82 to db/d1f/d2f/d47/d71/d75/c9c 0 2024-04-23T14:49:54.538 INFO:tasks.workunit.client.1.smithi156.stdout:1/485: fsync db/d1f/d28/d70/f7d 0 2024-04-23T14:49:54.542 INFO:tasks.workunit.client.0.smithi081.stdout:1/845: dwrite d3/d3d/d41/d5e/d12/d2e/fc5 [0,4194304] 0 2024-04-23T14:49:54.543 INFO:tasks.workunit.client.1.smithi156.stdout:0/405: rmdir d0/d4/d11/d7a 0 2024-04-23T14:49:54.543 INFO:tasks.workunit.client.1.smithi156.stdout:0/406: chown d0/d4/d11/d3f/d5f/f1f 0 1 2024-04-23T14:49:54.545 INFO:tasks.workunit.client.1.smithi156.stdout:7/417: mknod dc/d46/d58/c7c 0 2024-04-23T14:49:54.545 INFO:tasks.workunit.client.1.smithi156.stdout:7/418: truncate dc/d1d/d24/d5a/f76 4672600 0 2024-04-23T14:49:54.545 INFO:tasks.workunit.client.1.smithi156.stdout:7/419: creat dc/d1d/d41/f7d x:0 0 0 2024-04-23T14:49:54.548 INFO:tasks.workunit.client.1.smithi156.stdout:1/486: mknod db/d25/c9d 0 2024-04-23T14:49:54.549 INFO:tasks.workunit.client.1.smithi156.stdout:1/487: chown db/d1f/d34/d63/f8e 84445907 1 2024-04-23T14:49:54.553 INFO:tasks.workunit.client.1.smithi156.stdout:0/407: link d0/d16/d43/f55 d0/d4/d22/d58/f8b 0 2024-04-23T14:49:54.554 INFO:tasks.workunit.client.1.smithi156.stdout:0/408: creat d0/d16/d3a/d2a/d1d/d2d/f8c x:0 0 0 2024-04-23T14:49:54.555 INFO:tasks.workunit.client.1.smithi156.stdout:5/461: dread d1/d11/f51 [0,4194304] 0 2024-04-23T14:49:54.557 INFO:tasks.workunit.client.0.smithi081.stdout:3/666: sync 2024-04-23T14:49:54.563 INFO:tasks.workunit.client.1.smithi156.stdout:7/420: rename dc/lf to dc/d1d/l7e 0 2024-04-23T14:49:54.565 INFO:tasks.workunit.client.1.smithi156.stdout:8/396: dread d5/d9/d10/f33 [0,4194304] 0 2024-04-23T14:49:54.567 INFO:tasks.workunit.client.1.smithi156.stdout:1/488: mkdir db/d1f/d34/d63/d9e 0 2024-04-23T14:49:54.567 INFO:tasks.workunit.client.1.smithi156.stdout:2/401: dwrite d4/d26/d3c/f46 [0,4194304] 0 2024-04-23T14:49:54.567 INFO:tasks.workunit.client.1.smithi156.stdout:2/402: readlink d4/d13/d19/d58/l66 0 2024-04-23T14:49:54.567 INFO:tasks.workunit.client.1.smithi156.stdout:2/403: creat d4/d13/d19/d4c/f93 x:0 0 0 2024-04-23T14:49:54.571 INFO:tasks.workunit.client.1.smithi156.stdout:9/341: dread d1/d2/d4/dc/f22 [0,4194304] 0 2024-04-23T14:49:54.575 INFO:tasks.workunit.client.1.smithi156.stdout:3/386: dwrite d4/db/dd/d1d/d61/f6a [4194304,4194304] 0 2024-04-23T14:49:54.577 INFO:tasks.workunit.client.1.smithi156.stdout:5/462: mkdir d1/d3/d20/d3e/d97 0 2024-04-23T14:49:54.577 INFO:tasks.workunit.client.1.smithi156.stdout:5/463: chown d1/d3/d24/f72 7292 1 2024-04-23T14:49:54.578 INFO:tasks.workunit.client.1.smithi156.stdout:5/464: fdatasync d1/d11/d18/f47 0 2024-04-23T14:49:54.578 INFO:tasks.workunit.client.1.smithi156.stdout:5/465: truncate d1/d3/d24/f58 4704308 0 2024-04-23T14:49:54.578 INFO:tasks.workunit.client.1.smithi156.stdout:0/409: creat d0/d16/f8d x:0 0 0 2024-04-23T14:49:54.578 INFO:tasks.workunit.client.1.smithi156.stdout:0/410: stat d0/d16/d3a/d2a/d1d/d2d/d6b 0 2024-04-23T14:49:54.579 INFO:tasks.workunit.client.1.smithi156.stdout:7/421: symlink dc/d2a/d59/l7f 0 2024-04-23T14:49:54.580 INFO:tasks.workunit.client.0.smithi081.stdout:5/823: rmdir d17/d1f/d42 39 2024-04-23T14:49:54.581 INFO:tasks.workunit.client.1.smithi156.stdout:8/397: creat d5/d9/d36/d60/f89 x:0 0 0 2024-04-23T14:49:54.585 INFO:tasks.workunit.client.0.smithi081.stdout:3/667: getdents d4 0 2024-04-23T14:49:54.585 INFO:tasks.workunit.client.0.smithi081.stdout:3/668: dread - d4/d7/d1a/fbe zero size 2024-04-23T14:49:54.589 INFO:tasks.workunit.client.1.smithi156.stdout:9/342: creat d1/d2/d23/f76 x:0 0 0 2024-04-23T14:49:54.594 INFO:tasks.workunit.client.0.smithi081.stdout:6/750: dwrite d1/d51/d65/f108 [0,4194304] 0 2024-04-23T14:49:54.598 INFO:tasks.workunit.client.1.smithi156.stdout:3/387: creat d4/db/dd/d1d/d61/f71 x:0 0 0 2024-04-23T14:49:54.603 INFO:tasks.workunit.client.1.smithi156.stdout:5/466: creat d1/d3/d24/f98 x:0 0 0 2024-04-23T14:49:54.604 INFO:tasks.workunit.client.1.smithi156.stdout:7/422: mknod dc/d1d/d24/d5a/c80 0 2024-04-23T14:49:54.608 INFO:tasks.workunit.client.1.smithi156.stdout:4/336: dwrite d0/d8/d1e/f49 [0,4194304] 0 2024-04-23T14:49:54.610 INFO:tasks.workunit.client.0.smithi081.stdout:9/699: sync 2024-04-23T14:49:54.610 INFO:tasks.workunit.client.0.smithi081.stdout:2/745: sync 2024-04-23T14:49:54.613 INFO:tasks.workunit.client.1.smithi156.stdout:2/404: mknod d4/c94 0 2024-04-23T14:49:54.613 INFO:tasks.workunit.client.1.smithi156.stdout:2/405: chown d4/d13/d19/d4c/f91 0 1 2024-04-23T14:49:54.619 INFO:tasks.workunit.client.0.smithi081.stdout:6/751: rename d1/d51/d65/d8/db1/lbe to d1/d2/d5a/l10b 0 2024-04-23T14:49:54.624 INFO:tasks.workunit.client.1.smithi156.stdout:6/469: dwrite d3/da/fa2 [0,4194304] 0 2024-04-23T14:49:54.624 INFO:tasks.workunit.client.1.smithi156.stdout:6/470: chown d3/d16/d5c/d6a/c8b 792 1 2024-04-23T14:49:54.624 INFO:tasks.workunit.client.1.smithi156.stdout:6/471: fsync d3/d16/d1e/f7d 0 2024-04-23T14:49:54.627 INFO:tasks.workunit.client.1.smithi156.stdout:9/343: mknod d1/d2/d23/d49/d4b/c77 0 2024-04-23T14:49:54.632 INFO:tasks.workunit.client.1.smithi156.stdout:3/388: creat d4/db/d5e/f72 x:0 0 0 2024-04-23T14:49:54.637 INFO:tasks.workunit.client.0.smithi081.stdout:1/846: dwrite f0 [0,4194304] 0 2024-04-23T14:49:54.646 INFO:tasks.workunit.client.1.smithi156.stdout:7/423: dread dc/f1e [4194304,4194304] 0 2024-04-23T14:49:54.646 INFO:tasks.workunit.client.1.smithi156.stdout:7/424: write dc/d1d/f42 [966971,81234] 0 2024-04-23T14:49:54.648 INFO:tasks.workunit.client.0.smithi081.stdout:9/700: mknod d3/d67/ce2 0 2024-04-23T14:49:54.648 INFO:tasks.workunit.client.0.smithi081.stdout:4/677: dwrite d1/d4f/dc3/fc5 [0,4194304] 0 2024-04-23T14:49:54.650 INFO:tasks.workunit.client.0.smithi081.stdout:6/752: stat d1/d2/d5a/l10b 0 2024-04-23T14:49:54.650 INFO:tasks.workunit.client.1.smithi156.stdout:5/467: symlink d1/d3/d24/l99 0 2024-04-23T14:49:54.650 INFO:tasks.workunit.client.1.smithi156.stdout:5/468: stat d1/d3 0 2024-04-23T14:49:54.650 INFO:tasks.workunit.client.1.smithi156.stdout:9/344: read d1/d2/d4/ff [43720,15626] 0 2024-04-23T14:49:54.651 INFO:tasks.workunit.client.1.smithi156.stdout:9/345: fdatasync d1/d2/d4/d40/f61 0 2024-04-23T14:49:54.651 INFO:tasks.workunit.client.1.smithi156.stdout:9/346: write d1/d2/d23/d2d/d39/f42 [2081427,34073] 0 2024-04-23T14:49:54.661 INFO:tasks.workunit.client.1.smithi156.stdout:2/406: truncate d4/d21/f37 1516234 0 2024-04-23T14:49:54.661 INFO:tasks.workunit.client.1.smithi156.stdout:2/407: fdatasync d4/d21/d42/d75/d79/f85 0 2024-04-23T14:49:54.666 INFO:tasks.workunit.client.1.smithi156.stdout:0/411: dwrite d0/d16/d3a/d1e/f3d [0,4194304] 0 2024-04-23T14:49:54.666 INFO:tasks.workunit.client.1.smithi156.stdout:0/412: chown d0/d16/f8d 1664031803 1 2024-04-23T14:49:54.667 INFO:tasks.workunit.client.1.smithi156.stdout:3/389: mkdir d4/db/dd/d73 0 2024-04-23T14:49:54.668 INFO:tasks.workunit.client.1.smithi156.stdout:0/413: write d0/d4/d11/d3f/f51 [2291681,105872] 0 2024-04-23T14:49:54.669 INFO:tasks.workunit.client.0.smithi081.stdout:4/678: truncate d1/d1d/f3e 3352107 0 2024-04-23T14:49:54.669 INFO:tasks.workunit.client.0.smithi081.stdout:4/679: chown d1/f5b 1639426 1 2024-04-23T14:49:54.670 INFO:tasks.workunit.client.0.smithi081.stdout:6/753: dread d1/d2/f21 [0,4194304] 0 2024-04-23T14:49:54.670 INFO:tasks.workunit.client.0.smithi081.stdout:6/754: truncate d1/d51/d65/d8/d2e/d59/ff5 1041568 0 2024-04-23T14:49:54.670 INFO:tasks.workunit.client.0.smithi081.stdout:6/755: readlink d1/l38 0 2024-04-23T14:49:54.670 INFO:tasks.workunit.client.0.smithi081.stdout:6/756: write d1/d51/d65/d8/d2e/d59/faa [995889,96396] 0 2024-04-23T14:49:54.671 INFO:tasks.workunit.client.1.smithi156.stdout:7/425: creat dc/f81 x:0 0 0 2024-04-23T14:49:54.671 INFO:tasks.workunit.client.1.smithi156.stdout:7/426: chown dc/d1d 7054901 1 2024-04-23T14:49:54.671 INFO:tasks.workunit.client.1.smithi156.stdout:7/427: chown dc/d1d/d41/d53/c56 6 1 2024-04-23T14:49:54.672 INFO:tasks.workunit.client.1.smithi156.stdout:7/428: creat dc/d1d/d41/f82 x:0 0 0 2024-04-23T14:49:54.672 INFO:tasks.workunit.client.1.smithi156.stdout:7/429: fdatasync dc/d46/f31 0 2024-04-23T14:49:54.672 INFO:tasks.workunit.client.1.smithi156.stdout:7/430: chown dc/d1d/d41/d53/d6c 58281 1 2024-04-23T14:49:54.676 INFO:tasks.workunit.client.0.smithi081.stdout:8/940: dwrite d3/d11/d34/fa2 [0,4194304] 0 2024-04-23T14:49:54.676 INFO:tasks.workunit.client.0.smithi081.stdout:8/941: dread - d3/d11/d48/dc1/ff4 zero size 2024-04-23T14:49:54.679 INFO:tasks.workunit.client.1.smithi156.stdout:5/469: mkdir d1/d11/d18/d19/d9a 0 2024-04-23T14:49:54.680 INFO:tasks.workunit.client.0.smithi081.stdout:7/625: dwrite d3/d11/f1b [8388608,4194304] 0 2024-04-23T14:49:54.684 INFO:tasks.workunit.client.0.smithi081.stdout:4/680: mkdir d1/d1d/d39/d8d/de3 0 2024-04-23T14:49:54.685 INFO:tasks.workunit.client.0.smithi081.stdout:4/681: write d1/d4/d11/d75/fa8 [165704,22945] 0 2024-04-23T14:49:54.685 INFO:tasks.workunit.client.0.smithi081.stdout:4/682: readlink d1/d4/l4a 0 2024-04-23T14:49:54.685 INFO:tasks.workunit.client.0.smithi081.stdout:4/683: fsync d1/d4/d11/f6d 0 2024-04-23T14:49:54.687 INFO:tasks.workunit.client.1.smithi156.stdout:8/398: dwrite d5/d9/d10/f33 [0,4194304] 0 2024-04-23T14:49:54.687 INFO:tasks.workunit.client.1.smithi156.stdout:8/399: fsync d5/d9/d10/f87 0 2024-04-23T14:49:54.690 INFO:tasks.workunit.client.0.smithi081.stdout:6/757: symlink d1/d51/d65/d1c/l10c 0 2024-04-23T14:49:54.691 INFO:tasks.workunit.client.0.smithi081.stdout:6/758: write d1/f18 [155309,124651] 0 2024-04-23T14:49:54.691 INFO:tasks.workunit.client.0.smithi081.stdout:6/759: write d1/d51/d65/d8/db1/fdc [984981,1922] 0 2024-04-23T14:49:54.691 INFO:tasks.workunit.client.0.smithi081.stdout:6/760: fdatasync d1/d51/d65/d8/db1/fe2 0 2024-04-23T14:49:54.691 INFO:tasks.workunit.client.0.smithi081.stdout:6/761: write d1/d51/d65/d1c/d6e/fe3 [805252,117034] 0 2024-04-23T14:49:54.692 INFO:tasks.workunit.client.0.smithi081.stdout:5/824: dwrite d17/d3c/f88 [0,4194304] 0 2024-04-23T14:49:54.693 INFO:tasks.workunit.client.0.smithi081.stdout:5/825: chown d17/d37 9 1 2024-04-23T14:49:54.693 INFO:tasks.workunit.client.0.smithi081.stdout:5/826: chown d17/d3c/fbe 2 1 2024-04-23T14:49:54.693 INFO:tasks.workunit.client.0.smithi081.stdout:5/827: stat d17/d3c/f3e 0 2024-04-23T14:49:54.693 INFO:tasks.workunit.client.0.smithi081.stdout:5/828: chown d17/d1f/d42/d9b/d9e/da3/cb2 838007646 1 2024-04-23T14:49:54.693 INFO:tasks.workunit.client.1.smithi156.stdout:9/347: link d1/fe d1/d2/d3e/d50/f78 0 2024-04-23T14:49:54.694 INFO:tasks.workunit.client.0.smithi081.stdout:3/669: dwrite d4/d41/f67 [0,4194304] 0 2024-04-23T14:49:54.695 INFO:tasks.workunit.client.0.smithi081.stdout:8/942: dread f2 [0,4194304] 0 2024-04-23T14:49:54.695 INFO:tasks.workunit.client.0.smithi081.stdout:8/943: fdatasync d3/fde 0 2024-04-23T14:49:54.698 INFO:tasks.workunit.client.0.smithi081.stdout:2/746: write d1/d33/f40 [680168,85014] 0 2024-04-23T14:49:54.699 INFO:tasks.workunit.client.0.smithi081.stdout:7/626: symlink d3/d21/d31/d33/d4b/d6e/ld9 0 2024-04-23T14:49:54.700 INFO:tasks.workunit.client.1.smithi156.stdout:4/337: dwrite d0/df/d55/f3c [0,4194304] 0 2024-04-23T14:49:54.700 INFO:tasks.workunit.client.1.smithi156.stdout:4/338: readlink d0/d8/d1e/l6e 0 2024-04-23T14:49:54.702 INFO:tasks.workunit.client.0.smithi081.stdout:4/684: mknod d1/d4/d6f/d70/daf/d8c/ce4 0 2024-04-23T14:49:54.702 INFO:tasks.workunit.client.1.smithi156.stdout:3/390: getdents d4/db/dd/d1d/d1e/d2b 0 2024-04-23T14:49:54.703 INFO:tasks.workunit.client.1.smithi156.stdout:6/472: dwrite d3/d16/d46/f3e [0,4194304] 0 2024-04-23T14:49:54.703 INFO:tasks.workunit.client.1.smithi156.stdout:6/473: truncate d3/da/f28 7735008 0 2024-04-23T14:49:54.704 INFO:tasks.workunit.client.1.smithi156.stdout:8/400: write d5/d9/d5a/f54 [7456132,103493] 0 2024-04-23T14:49:54.705 INFO:tasks.workunit.client.1.smithi156.stdout:1/489: dwrite db/d1f/f79 [0,4194304] 0 2024-04-23T14:49:54.707 INFO:tasks.workunit.client.0.smithi081.stdout:6/762: symlink d1/d51/d65/d13/d16/dd0/df7/da1/dc1/dc9/l10d 0 2024-04-23T14:49:54.709 INFO:tasks.workunit.client.0.smithi081.stdout:1/847: dread d3/d3d/d41/d5e/d12/d1a/fb1 [0,4194304] 0 2024-04-23T14:49:54.709 INFO:tasks.workunit.client.0.smithi081.stdout:1/848: chown d3/d3d/d41/d4a/d77/fcd 0 1 2024-04-23T14:49:54.710 INFO:tasks.workunit.client.0.smithi081.stdout:9/701: dwrite d3/de/d76/db5/fbd [0,4194304] 0 2024-04-23T14:49:54.712 INFO:tasks.workunit.client.0.smithi081.stdout:8/944: dread d3/d11/d34/f57 [0,4194304] 0 2024-04-23T14:49:54.713 INFO:tasks.workunit.client.0.smithi081.stdout:7/627: dread d3/d11/d2c/f32 [0,4194304] 0 2024-04-23T14:49:54.719 INFO:tasks.workunit.client.0.smithi081.stdout:5/829: creat d17/d1f/d42/d9b/dc9/f123 x:0 0 0 2024-04-23T14:49:54.719 INFO:tasks.workunit.client.0.smithi081.stdout:5/830: chown d17/d18 942326 1 2024-04-23T14:49:54.719 INFO:tasks.workunit.client.0.smithi081.stdout:5/831: chown d17/d37/d4e/dc3/lc5 30273 1 2024-04-23T14:49:54.719 INFO:tasks.workunit.client.0.smithi081.stdout:5/832: chown d17/d18/dff/d59 3540 1 2024-04-23T14:49:54.719 INFO:tasks.workunit.client.0.smithi081.stdout:3/670: mknod d4/dc/d50/d9a/cd5 0 2024-04-23T14:49:54.721 INFO:tasks.workunit.client.0.smithi081.stdout:2/747: creat d1/d33/f100 x:0 0 0 2024-04-23T14:49:54.721 INFO:tasks.workunit.client.0.smithi081.stdout:7/628: dread d3/d21/d31/d63/f6c [0,4194304] 0 2024-04-23T14:49:54.721 INFO:tasks.workunit.client.0.smithi081.stdout:7/629: chown d3/d21/d31/d33/d4b/d6e/fd8 18 1 2024-04-23T14:49:54.721 INFO:tasks.workunit.client.0.smithi081.stdout:7/630: chown d3/d21/d31/d33/d4b/d6e/f87 10916506 1 2024-04-23T14:49:54.721 INFO:tasks.workunit.client.0.smithi081.stdout:7/631: fsync d3/d20/f30 0 2024-04-23T14:49:54.721 INFO:tasks.workunit.client.0.smithi081.stdout:2/748: chown d1/d11/d21/d52/d8b 211423 1 2024-04-23T14:49:54.722 INFO:tasks.workunit.client.1.smithi156.stdout:7/431: mkdir dc/d1d/d48/d83 0 2024-04-23T14:49:54.722 INFO:tasks.workunit.client.1.smithi156.stdout:5/470: creat d1/d11/d18/d52/d85/f9b x:0 0 0 2024-04-23T14:49:54.722 INFO:tasks.workunit.client.1.smithi156.stdout:7/432: write dc/d2c/d68/f75 [725245,100527] 0 2024-04-23T14:49:54.722 INFO:tasks.workunit.client.0.smithi081.stdout:3/671: write d4/d7/d32/f94 [143341,66282] 0 2024-04-23T14:49:54.731 INFO:tasks.workunit.client.0.smithi081.stdout:1/849: symlink d3/d3d/d41/d92/df1/l119 0 2024-04-23T14:49:54.731 INFO:tasks.workunit.client.0.smithi081.stdout:1/850: readlink d3/d3d/d7a/lac 0 2024-04-23T14:49:54.732 INFO:tasks.workunit.client.0.smithi081.stdout:6/763: rmdir d1/d2 39 2024-04-23T14:49:54.750 INFO:tasks.workunit.client.1.smithi156.stdout:9/348: dread d1/f51 [0,4194304] 0 2024-04-23T14:49:54.751 INFO:tasks.workunit.client.1.smithi156.stdout:3/391: mkdir d4/db/dd/d1d/d1e/d74 0 2024-04-23T14:49:54.755 INFO:tasks.workunit.client.0.smithi081.stdout:4/685: dwrite d1/f3a [0,4194304] 0 2024-04-23T14:49:54.756 INFO:tasks.workunit.client.0.smithi081.stdout:4/686: write d1/d4/dc/dba/fe2 [918360,58369] 0 2024-04-23T14:49:54.760 INFO:tasks.workunit.client.1.smithi156.stdout:6/474: link d3/da/d1d/d27/d80/f9a d3/da/d1d/d27/fb6 0 2024-04-23T14:49:54.767 INFO:tasks.workunit.client.0.smithi081.stdout:9/702: link d3/de/d1d/fc2 d3/de/d1d/d54/d68/fe3 0 2024-04-23T14:49:54.770 INFO:tasks.workunit.client.1.smithi156.stdout:8/401: mkdir d5/d39/d6d/d8a 0 2024-04-23T14:49:54.770 INFO:tasks.workunit.client.1.smithi156.stdout:0/414: getdents d0/d16/d3a/d2b/d44 0 2024-04-23T14:49:54.771 INFO:tasks.workunit.client.0.smithi081.stdout:8/945: creat d3/d11/d3e/d63/d132/f138 x:0 0 0 2024-04-23T14:49:54.772 INFO:tasks.workunit.client.0.smithi081.stdout:1/851: dread d3/d3d/d6f/fdb [0,4194304] 0 2024-04-23T14:49:54.772 INFO:tasks.workunit.client.0.smithi081.stdout:1/852: write d3/d3d/d41/d5e/d17/d58/fcb [873551,6685] 0 2024-04-23T14:49:54.772 INFO:tasks.workunit.client.0.smithi081.stdout:1/853: chown d3/d3d/d41/d5e/d12/fe3 3 1 2024-04-23T14:49:54.773 INFO:tasks.workunit.client.1.smithi156.stdout:1/490: creat db/d25/d30/d38/f9f x:0 0 0 2024-04-23T14:49:54.775 INFO:tasks.workunit.client.0.smithi081.stdout:7/632: truncate d3/d97/fa5 3203329 0 2024-04-23T14:49:54.776 INFO:tasks.workunit.client.0.smithi081.stdout:6/764: mknod d1/d2/c10e 0 2024-04-23T14:49:54.778 INFO:tasks.workunit.client.0.smithi081.stdout:9/703: dread d3/de/d25/f8e [0,4194304] 0 2024-04-23T14:49:54.779 INFO:tasks.workunit.client.1.smithi156.stdout:5/471: unlink d1/d11/d18/d19/f5c 0 2024-04-23T14:49:54.779 INFO:tasks.workunit.client.1.smithi156.stdout:4/339: dwrite d0/df/f14 [0,4194304] 0 2024-04-23T14:49:54.781 INFO:tasks.workunit.client.1.smithi156.stdout:9/349: link d1/d2/d4/d17/d1f/d48/l64 d1/d2/d3e/d50/l79 0 2024-04-23T14:49:54.782 INFO:tasks.workunit.client.0.smithi081.stdout:3/672: dwrite d4/f6 [4194304,4194304] 0 2024-04-23T14:49:54.782 INFO:tasks.workunit.client.0.smithi081.stdout:3/673: creat d4/d7/d49/d51/d84/fd6 x:0 0 0 2024-04-23T14:49:54.789 INFO:tasks.workunit.client.1.smithi156.stdout:6/475: rename d3/d16/f2f to d3/d16/d46/d64/d77/fb7 0 2024-04-23T14:49:54.789 INFO:tasks.workunit.client.1.smithi156.stdout:6/476: creat d3/da/d1d/d27/fb8 x:0 0 0 2024-04-23T14:49:54.789 INFO:tasks.workunit.client.1.smithi156.stdout:6/477: truncate d3/d16/f30 1850618 0 2024-04-23T14:49:54.791 INFO:tasks.workunit.client.0.smithi081.stdout:1/854: mkdir d3/d3d/d6f/de6/d11a 0 2024-04-23T14:49:54.791 INFO:tasks.workunit.client.0.smithi081.stdout:9/704: getdents d3/de/d14 0 2024-04-23T14:49:54.791 INFO:tasks.workunit.client.0.smithi081.stdout:9/705: chown d3/de/d14/f3d 535359129 1 2024-04-23T14:49:54.794 INFO:tasks.workunit.client.0.smithi081.stdout:8/946: rmdir d3/d11/d86/d88/da7/de0 39 2024-04-23T14:49:54.794 INFO:tasks.workunit.client.0.smithi081.stdout:8/947: fdatasync d3/d1a/fec 0 2024-04-23T14:49:54.795 INFO:tasks.workunit.client.1.smithi156.stdout:0/415: rmdir d0/d4/d22/d58 39 2024-04-23T14:49:54.795 INFO:tasks.workunit.client.1.smithi156.stdout:0/416: fdatasync d0/d16/d3a/d2b/d44/d4a/f57 0 2024-04-23T14:49:54.795 INFO:tasks.workunit.client.1.smithi156.stdout:8/402: mkdir d5/d39/d6d/d8b 0 2024-04-23T14:49:54.796 INFO:tasks.workunit.client.0.smithi081.stdout:0/824: sync 2024-04-23T14:49:54.796 INFO:tasks.workunit.client.0.smithi081.stdout:0/825: chown d6/d11/d14/d41/d5b/d3f/d44/d78/fc7 196455171 1 2024-04-23T14:49:54.800 INFO:tasks.workunit.client.1.smithi156.stdout:1/491: creat db/d1f/d2d/d93/fa0 x:0 0 0 2024-04-23T14:49:54.800 INFO:tasks.workunit.client.1.smithi156.stdout:5/472: mknod d1/d3/d43/c9c 0 2024-04-23T14:49:54.803 INFO:tasks.workunit.client.1.smithi156.stdout:0/417: unlink d0/d16/d3a/d2b/d44/f54 0 2024-04-23T14:49:54.804 INFO:tasks.workunit.client.1.smithi156.stdout:0/418: write d0/d16/d3a/d2a/d1d/d2d/f8c [447739,87658] 0 2024-04-23T14:49:54.804 INFO:tasks.workunit.client.1.smithi156.stdout:0/419: chown d0/d16/d3a/d2b/d44/f7d 272665036 1 2024-04-23T14:49:54.808 INFO:tasks.workunit.client.0.smithi081.stdout:0/826: mkdir d6/d11/d14/d41/d5b/d59/d102 0 2024-04-23T14:49:54.808 INFO:tasks.workunit.client.0.smithi081.stdout:0/827: write d6/d37/d4d/d71/f72 [5005770,43880] 0 2024-04-23T14:49:54.809 INFO:tasks.workunit.client.0.smithi081.stdout:0/828: fdatasync d6/d37/d67/f92 0 2024-04-23T14:49:54.809 INFO:tasks.workunit.client.0.smithi081.stdout:0/829: chown d6/d37/d67/d7d 822885819 1 2024-04-23T14:49:54.811 INFO:tasks.workunit.client.1.smithi156.stdout:1/492: rename db/d25/d66 to db/d1f/d94/da1 0 2024-04-23T14:49:54.812 INFO:tasks.workunit.client.0.smithi081.stdout:0/830: mkdir d6/d11/d14/d41/d5b/d3f/d44/d78/d83/d103 0 2024-04-23T14:49:54.812 INFO:tasks.workunit.client.1.smithi156.stdout:5/473: creat d1/d11/d18/d19/d74/f9d x:0 0 0 2024-04-23T14:49:54.820 INFO:tasks.workunit.client.1.smithi156.stdout:5/474: rmdir d1/d17/d7e 39 2024-04-23T14:49:54.821 INFO:tasks.workunit.client.1.smithi156.stdout:5/475: chown d1/d3/d20/d3e/f46 309 1 2024-04-23T14:49:54.821 INFO:tasks.workunit.client.1.smithi156.stdout:5/476: fdatasync d1/d17/f7d 0 2024-04-23T14:49:54.831 INFO:tasks.workunit.client.1.smithi156.stdout:2/408: sync 2024-04-23T14:49:54.834 INFO:tasks.workunit.client.0.smithi081.stdout:5/833: dwrite d17/d1f/f22 [0,4194304] 0 2024-04-23T14:49:54.834 INFO:tasks.workunit.client.0.smithi081.stdout:5/834: truncate d17/d3d/d7a/fae 690885 0 2024-04-23T14:49:54.834 INFO:tasks.workunit.client.0.smithi081.stdout:5/835: dread - d17/d3d/d41/f112 zero size 2024-04-23T14:49:54.835 INFO:tasks.workunit.client.1.smithi156.stdout:2/409: unlink d4/d26/f44 0 2024-04-23T14:49:54.839 INFO:tasks.workunit.client.1.smithi156.stdout:2/410: rename d4/f7d to d4/d13/f95 0 2024-04-23T14:49:54.839 INFO:tasks.workunit.client.1.smithi156.stdout:2/411: readlink d4/lb 0 2024-04-23T14:49:54.840 INFO:tasks.workunit.client.0.smithi081.stdout:4/687: read d1/d1d/d59/f5a [3391507,18477] 0 2024-04-23T14:49:54.840 INFO:tasks.workunit.client.0.smithi081.stdout:4/688: chown d1/d4/d6f/d70/daf/ld9 505281 1 2024-04-23T14:49:54.843 INFO:tasks.workunit.client.1.smithi156.stdout:2/412: link d4/d13/d19/f82 d4/d21/f96 0 2024-04-23T14:49:54.843 INFO:tasks.workunit.client.1.smithi156.stdout:2/413: truncate d4/d21/d2f/f74 1193274 0 2024-04-23T14:49:54.843 INFO:tasks.workunit.client.1.smithi156.stdout:2/414: fsync d4/d21/d42/f5e 0 2024-04-23T14:49:54.846 INFO:tasks.workunit.client.0.smithi081.stdout:4/689: truncate d1/d1d/d39/d8d/fb8 1270565 0 2024-04-23T14:49:54.846 INFO:tasks.workunit.client.0.smithi081.stdout:4/690: truncate d1/d4/d11/fbe 297372 0 2024-04-23T14:49:54.847 INFO:tasks.workunit.client.0.smithi081.stdout:4/691: write d1/d4/d6f/d70/daf/fcc [358199,77205] 0 2024-04-23T14:49:54.850 INFO:tasks.workunit.client.0.smithi081.stdout:0/831: dread d6/d11/d14/d41/d5b/d3f/f4a [0,4194304] 0 2024-04-23T14:49:54.850 INFO:tasks.workunit.client.0.smithi081.stdout:0/832: dread - d6/d11/d14/d41/d5b/d59/d8e/fef zero size 2024-04-23T14:49:54.850 INFO:tasks.workunit.client.0.smithi081.stdout:0/833: fdatasync d6/d11/d14/d41/d5b/d3f/d44/f86 0 2024-04-23T14:49:54.851 INFO:tasks.workunit.client.0.smithi081.stdout:0/834: mknod d6/d11/d14/d41/d5b/d59/d102/c104 0 2024-04-23T14:49:54.852 INFO:tasks.workunit.client.1.smithi156.stdout:2/415: getdents d4/d21/d42 0 2024-04-23T14:49:54.853 INFO:tasks.workunit.client.0.smithi081.stdout:0/835: mkdir d6/d11/d14/d41/d5b/d59/d68/d105 0 2024-04-23T14:49:54.855 INFO:tasks.workunit.client.1.smithi156.stdout:2/416: chown d4/d13/f14 261356913 1 2024-04-23T14:49:54.856 INFO:tasks.workunit.client.1.smithi156.stdout:2/417: fdatasync d4/d13/d19/d4c/f68 0 2024-04-23T14:49:54.859 INFO:tasks.workunit.client.0.smithi081.stdout:9/706: write d3/de/d1d/d54/f6a [3247676,127785] 0 2024-04-23T14:49:54.861 INFO:tasks.workunit.client.0.smithi081.stdout:9/707: symlink d3/de/d25/le4 0 2024-04-23T14:49:54.865 INFO:tasks.workunit.client.0.smithi081.stdout:0/836: dread d6/d11/d14/d41/d5b/d3f/d44/d78/fb7 [0,4194304] 0 2024-04-23T14:49:54.871 INFO:tasks.workunit.client.0.smithi081.stdout:9/708: mknod d3/de/d1d/d5b/d7b/db2/ce5 0 2024-04-23T14:49:54.884 INFO:tasks.workunit.client.0.smithi081.stdout:6/765: dwrite d1/d51/d65/d8/d2e/d59/ff5 [0,4194304] 0 2024-04-23T14:49:54.887 INFO:tasks.workunit.client.0.smithi081.stdout:2/749: dwrite d1/d33/d45/d6e/f8e [4194304,4194304] 0 2024-04-23T14:49:54.887 INFO:tasks.workunit.client.0.smithi081.stdout:4/692: dread d1/f31 [0,4194304] 0 2024-04-23T14:49:54.888 INFO:tasks.workunit.client.0.smithi081.stdout:4/693: fsync d1/d1d/d39/d8d/f90 0 2024-04-23T14:49:54.898 INFO:tasks.workunit.client.0.smithi081.stdout:7/633: dwrite d3/d21/d31/fc6 [0,4194304] 0 2024-04-23T14:49:54.899 INFO:tasks.workunit.client.0.smithi081.stdout:6/766: dread d1/d51/d65/d13/d46/f7a [0,4194304] 0 2024-04-23T14:49:54.899 INFO:tasks.workunit.client.0.smithi081.stdout:3/674: dwrite d4/d41/f67 [0,4194304] 0 2024-04-23T14:49:54.899 INFO:tasks.workunit.client.0.smithi081.stdout:6/767: creat d1/d51/d65/d8/f10f x:0 0 0 2024-04-23T14:49:54.899 INFO:tasks.workunit.client.0.smithi081.stdout:4/694: mknod d1/d4/ce5 0 2024-04-23T14:49:54.911 INFO:tasks.workunit.client.1.smithi156.stdout:7/433: dwrite dc/d2c/d68/f75 [0,4194304] 0 2024-04-23T14:49:54.912 INFO:tasks.workunit.client.0.smithi081.stdout:6/768: unlink d1/d51/d65/d8/d2e/d58/dc2/lc4 0 2024-04-23T14:49:54.912 INFO:tasks.workunit.client.0.smithi081.stdout:6/769: write d1/d51/d65/d78/fc8 [1425159,10781] 0 2024-04-23T14:49:54.913 INFO:tasks.workunit.client.0.smithi081.stdout:6/770: chown d1/d51/d65/d13/d16/ld6 138415789 1 2024-04-23T14:49:54.914 INFO:tasks.workunit.client.0.smithi081.stdout:4/695: mknod d1/d4/d6f/d70/daf/d8c/d99/ce6 0 2024-04-23T14:49:54.918 INFO:tasks.workunit.client.1.smithi156.stdout:5/477: dwrite d1/d3/d24/f72 [0,4194304] 0 2024-04-23T14:49:54.918 INFO:tasks.workunit.client.1.smithi156.stdout:5/478: dread - d1/d3/d64/f65 zero size 2024-04-23T14:49:54.918 INFO:tasks.workunit.client.1.smithi156.stdout:5/479: dread - d1/d11/d18/d19/d74/f9d zero size 2024-04-23T14:49:54.921 INFO:tasks.workunit.client.0.smithi081.stdout:3/675: mkdir d4/d7/dd7 0 2024-04-23T14:49:54.926 INFO:tasks.workunit.client.0.smithi081.stdout:3/676: symlink d4/d7/d32/ld8 0 2024-04-23T14:49:54.926 INFO:tasks.workunit.client.0.smithi081.stdout:3/677: chown l1 30126294 1 2024-04-23T14:49:54.926 INFO:tasks.workunit.client.1.smithi156.stdout:7/434: link dc/f17 dc/d1d/d41/f84 0 2024-04-23T14:49:54.932 INFO:tasks.workunit.client.0.smithi081.stdout:2/750: write d1/d11/d21/fc4 [235844,45295] 0 2024-04-23T14:49:54.933 INFO:tasks.workunit.client.0.smithi081.stdout:1/855: dwrite d3/d3d/d41/d5e/d12/f54 [0,4194304] 0 2024-04-23T14:49:54.933 INFO:tasks.workunit.client.0.smithi081.stdout:1/856: write d3/d3d/d41/d5e/d5d/db0/ff7 [350726,57726] 0 2024-04-23T14:49:54.943 INFO:tasks.workunit.client.0.smithi081.stdout:1/857: dread d3/d3d/d41/d5e/d9d/fb9 [0,4194304] 0 2024-04-23T14:49:54.943 INFO:tasks.workunit.client.0.smithi081.stdout:1/858: chown d3/d3d/d41/d5e/dd2/fdf 426402 1 2024-04-23T14:49:54.943 INFO:tasks.workunit.client.0.smithi081.stdout:1/859: chown d3/d3d/d41/d5e/d5d/db0/c69 13779 1 2024-04-23T14:49:54.943 INFO:tasks.workunit.client.0.smithi081.stdout:1/860: write d3/d3d/d41/d5e/d5d/fea [997378,106248] 0 2024-04-23T14:49:54.943 INFO:tasks.workunit.client.0.smithi081.stdout:1/861: dread - d3/d3d/d41/fae zero size 2024-04-23T14:49:54.943 INFO:tasks.workunit.client.0.smithi081.stdout:2/751: dread d1/d33/f37 [4194304,4194304] 0 2024-04-23T14:49:54.945 INFO:tasks.workunit.client.1.smithi156.stdout:2/418: dread d4/d26/d3c/f46 [0,4194304] 0 2024-04-23T14:49:54.945 INFO:tasks.workunit.client.1.smithi156.stdout:8/403: dwrite d5/d9/d10/d1d/d21/f37 [0,4194304] 0 2024-04-23T14:49:54.946 INFO:tasks.workunit.client.0.smithi081.stdout:4/696: dread d1/d1d/d59/f65 [0,4194304] 0 2024-04-23T14:49:54.946 INFO:tasks.workunit.client.0.smithi081.stdout:4/697: readlink d1/d4f/la2 0 2024-04-23T14:49:54.946 INFO:tasks.workunit.client.0.smithi081.stdout:4/698: fsync d1/d1d/d39/f4c 0 2024-04-23T14:49:54.947 INFO:tasks.workunit.client.1.smithi156.stdout:9/350: dwrite d1/d2/d3e/d55/f6b [0,4194304] 0 2024-04-23T14:49:54.949 INFO:tasks.workunit.client.1.smithi156.stdout:7/435: dread dc/f1c [4194304,4194304] 0 2024-04-23T14:49:54.953 INFO:tasks.workunit.client.1.smithi156.stdout:0/420: dwrite d0/d16/d3a/d2b/d44/f7d [0,4194304] 0 2024-04-23T14:49:54.954 INFO:tasks.workunit.client.1.smithi156.stdout:0/421: readlink d0/d16/d3a/d2b/d44/l64 0 2024-04-23T14:49:54.954 INFO:tasks.workunit.client.1.smithi156.stdout:1/493: dwrite db/d25/d30/d38/f9f [0,4194304] 0 2024-04-23T14:49:54.954 INFO:tasks.workunit.client.1.smithi156.stdout:1/494: truncate db/d25/d30/d38/f6c 96490 0 2024-04-23T14:49:54.955 INFO:tasks.workunit.client.1.smithi156.stdout:2/419: unlink d4/d13/d19/f82 0 2024-04-23T14:49:54.955 INFO:tasks.workunit.client.0.smithi081.stdout:9/709: dwrite d3/de/d1d/d5b/d7b/fb1 [0,4194304] 0 2024-04-23T14:49:54.955 INFO:tasks.workunit.client.0.smithi081.stdout:9/710: dread - d3/de/d1d/d73/fb4 zero size 2024-04-23T14:49:54.955 INFO:tasks.workunit.client.0.smithi081.stdout:9/711: truncate d3/d67/faf 587218 0 2024-04-23T14:49:54.956 INFO:tasks.workunit.client.1.smithi156.stdout:8/404: mkdir d5/d9/d36/d84/d8c 0 2024-04-23T14:49:54.956 INFO:tasks.workunit.client.0.smithi081.stdout:4/699: mkdir d1/d4/d11/d9d/dac/de7 0 2024-04-23T14:49:54.959 INFO:tasks.workunit.client.0.smithi081.stdout:8/948: dwrite d3/d11/d48/d7e/feb [4194304,4194304] 0 2024-04-23T14:49:54.959 INFO:tasks.workunit.client.0.smithi081.stdout:0/837: dwrite d6/f50 [0,4194304] 0 2024-04-23T14:49:54.962 INFO:tasks.workunit.client.0.smithi081.stdout:7/634: dwrite d3/d21/d41/d7c/dc3/d7f/f88 [0,4194304] 0 2024-04-23T14:49:54.963 INFO:tasks.workunit.client.1.smithi156.stdout:7/436: dread dc/d46/f31 [0,4194304] 0 2024-04-23T14:49:54.963 INFO:tasks.workunit.client.1.smithi156.stdout:7/437: chown dc/d1d/d41/f43 12 1 2024-04-23T14:49:54.963 INFO:tasks.workunit.client.1.smithi156.stdout:7/438: write dc/d2a/f6a [496247,23756] 0 2024-04-23T14:49:54.966 INFO:tasks.workunit.client.1.smithi156.stdout:0/422: mkdir d0/d16/d8e 0 2024-04-23T14:49:54.970 INFO:tasks.workunit.client.0.smithi081.stdout:1/862: dread d3/d3d/d41/d4a/d77/f98 [0,4194304] 0 2024-04-23T14:49:54.970 INFO:tasks.workunit.client.0.smithi081.stdout:1/863: write d3/d3d/d41/d4a/d77/f82 [226968,24910] 0 2024-04-23T14:49:54.970 INFO:tasks.workunit.client.0.smithi081.stdout:9/712: truncate d3/d1a/d6c/f31 2578276 0 2024-04-23T14:49:54.973 INFO:tasks.workunit.client.0.smithi081.stdout:4/700: rmdir d1/d4/dc/dba/dc6 0 2024-04-23T14:49:54.973 INFO:tasks.workunit.client.0.smithi081.stdout:8/949: dread d3/f4 [0,4194304] 0 2024-04-23T14:49:54.973 INFO:tasks.workunit.client.0.smithi081.stdout:4/701: write d1/d1d/f30 [1309904,80422] 0 2024-04-23T14:49:54.973 INFO:tasks.workunit.client.0.smithi081.stdout:8/950: truncate d3/d11/d48/d7e/ffc 248056 0 2024-04-23T14:49:54.974 INFO:tasks.workunit.client.1.smithi156.stdout:4/340: dwrite d0/df/f6b [0,4194304] 0 2024-04-23T14:49:54.974 INFO:tasks.workunit.client.1.smithi156.stdout:4/341: stat d0/d30/l6d 0 2024-04-23T14:49:54.974 INFO:tasks.workunit.client.1.smithi156.stdout:4/342: creat d0/df/f71 x:0 0 0 2024-04-23T14:49:54.985 INFO:tasks.workunit.client.0.smithi081.stdout:9/713: dread d3/de/d14/d5e/d72/fc1 [0,4194304] 0 2024-04-23T14:49:54.987 INFO:tasks.workunit.client.1.smithi156.stdout:1/495: link db/d1f/d94/da1/d7c/l51 db/d1f/d2f/d47/d71/d75/la2 0 2024-04-23T14:49:54.993 INFO:tasks.workunit.client.1.smithi156.stdout:4/343: dread d0/df/d55/f2e [0,4194304] 0 2024-04-23T14:49:54.993 INFO:tasks.workunit.client.1.smithi156.stdout:4/344: truncate d0/df/f58 51706 0 2024-04-23T14:49:54.994 INFO:tasks.workunit.client.1.smithi156.stdout:2/420: mkdir d4/d13/d19/d97 0 2024-04-23T14:49:54.996 INFO:tasks.workunit.client.0.smithi081.stdout:7/635: read d3/d11/d2c/d75/f5c [3963707,32049] 0 2024-04-23T14:49:54.997 INFO:tasks.workunit.client.1.smithi156.stdout:5/480: dwrite d1/d17/f2e [0,4194304] 0 2024-04-23T14:49:54.997 INFO:tasks.workunit.client.0.smithi081.stdout:7/636: write d3/d21/d31/d33/d4b/fd5 [116713,97443] 0 2024-04-23T14:49:54.997 INFO:tasks.workunit.client.1.smithi156.stdout:1/496: dread db/d25/d30/f43 [0,4194304] 0 2024-04-23T14:49:54.999 INFO:tasks.workunit.client.0.smithi081.stdout:9/714: dread d3/de/d14/d5e/f96 [0,4194304] 0 2024-04-23T14:49:55.002 INFO:tasks.workunit.client.1.smithi156.stdout:8/405: symlink d5/d45/l8d 0 2024-04-23T14:49:55.002 INFO:tasks.workunit.client.0.smithi081.stdout:8/951: write d3/d11/f9a [985023,76383] 0 2024-04-23T14:49:55.007 INFO:tasks.workunit.client.1.smithi156.stdout:5/481: dread d1/d3/d20/f4c [0,4194304] 0 2024-04-23T14:49:55.007 INFO:tasks.workunit.client.1.smithi156.stdout:5/482: chown l0 1 1 2024-04-23T14:49:55.011 INFO:tasks.workunit.client.1.smithi156.stdout:9/351: dwrite d1/d2/d4/d17/d1f/d48/d4e/f6e [4194304,4194304] 0 2024-04-23T14:49:55.011 INFO:tasks.workunit.client.1.smithi156.stdout:9/352: stat d1/d2/d3e/d55/d66 0 2024-04-23T14:49:55.014 INFO:tasks.workunit.client.1.smithi156.stdout:0/423: rename d0/d4/d22/d58/l6c to d0/d4/d22/d58/l8f 0 2024-04-23T14:49:55.017 INFO:tasks.workunit.client.0.smithi081.stdout:4/702: write d1/d4/f76 [573697,4561] 0 2024-04-23T14:49:55.017 INFO:tasks.workunit.client.0.smithi081.stdout:4/703: write d1/d4/d6f/d70/daf/fcc [1196258,40233] 0 2024-04-23T14:49:55.023 INFO:tasks.workunit.client.1.smithi156.stdout:8/406: dread d5/d9/d10/f33 [0,4194304] 0 2024-04-23T14:49:55.025 INFO:tasks.workunit.client.1.smithi156.stdout:2/421: creat d4/d26/d3c/f98 x:0 0 0 2024-04-23T14:49:55.025 INFO:tasks.workunit.client.1.smithi156.stdout:2/422: chown d4/d13/d19/f1e 2006098 1 2024-04-23T14:49:55.025 INFO:tasks.workunit.client.1.smithi156.stdout:2/423: fdatasync d4/f81 0 2024-04-23T14:49:55.025 INFO:tasks.workunit.client.1.smithi156.stdout:2/424: chown d4/l6 31463597 1 2024-04-23T14:49:55.025 INFO:tasks.workunit.client.0.smithi081.stdout:7/637: mknod d3/d11/d2c/cda 0 2024-04-23T14:49:55.026 INFO:tasks.workunit.client.0.smithi081.stdout:7/638: creat d3/d21/d31/d33/d4b/d6e/fdb x:0 0 0 2024-04-23T14:49:55.029 INFO:tasks.workunit.client.0.smithi081.stdout:9/715: link d3/d1a/d6c/lb8 d3/de/d1d/d5b/d7b/db2/le6 0 2024-04-23T14:49:55.032 INFO:tasks.workunit.client.0.smithi081.stdout:8/952: mknod d3/dc6/c139 0 2024-04-23T14:49:55.032 INFO:tasks.workunit.client.0.smithi081.stdout:8/953: chown d3/d11/d3e/d63/l11d 21 1 2024-04-23T14:49:55.032 INFO:tasks.workunit.client.1.smithi156.stdout:0/424: dread d0/d4/d11/d3f/f51 [0,4194304] 0 2024-04-23T14:49:55.034 INFO:tasks.workunit.client.0.smithi081.stdout:0/838: mknod d6/d37/c106 0 2024-04-23T14:49:55.034 INFO:tasks.workunit.client.1.smithi156.stdout:3/392: sync 2024-04-23T14:49:55.048 INFO:tasks.workunit.client.0.smithi081.stdout:7/639: creat d3/d21/d41/dcd/fdc x:0 0 0 2024-04-23T14:49:55.048 INFO:tasks.workunit.client.0.smithi081.stdout:7/640: stat d3/d11/d2c/d75/d8e 0 2024-04-23T14:49:55.050 INFO:tasks.workunit.client.1.smithi156.stdout:9/353: dwrite d1/d2/d4/ff [0,4194304] 0 2024-04-23T14:49:55.050 INFO:tasks.workunit.client.0.smithi081.stdout:9/716: dread d3/de/d1d/d54/f66 [0,4194304] 0 2024-04-23T14:49:55.053 INFO:tasks.workunit.client.1.smithi156.stdout:7/439: getdents dc/d1d/d41 0 2024-04-23T14:49:55.054 INFO:tasks.workunit.client.1.smithi156.stdout:7/440: write dc/d2c/f33 [1761012,99438] 0 2024-04-23T14:49:55.054 INFO:tasks.workunit.client.1.smithi156.stdout:7/441: read - dc/d1d/d24/d5a/f72 zero size 2024-04-23T14:49:55.054 INFO:tasks.workunit.client.1.smithi156.stdout:7/442: truncate dc/d2c/f5c 835383 0 2024-04-23T14:49:55.055 INFO:tasks.workunit.client.1.smithi156.stdout:6/478: sync 2024-04-23T14:49:55.055 INFO:tasks.workunit.client.1.smithi156.stdout:6/479: chown d3/da/d1d/c32 10 1 2024-04-23T14:49:55.055 INFO:tasks.workunit.client.1.smithi156.stdout:6/480: readlink d3/da/d1d/l54 0 2024-04-23T14:49:55.055 INFO:tasks.workunit.client.1.smithi156.stdout:4/345: getdents d0/df/d21 0 2024-04-23T14:49:55.056 INFO:tasks.workunit.client.0.smithi081.stdout:8/954: mkdir d3/d11/d86/d88/da7/d117/d13a 0 2024-04-23T14:49:55.056 INFO:tasks.workunit.client.0.smithi081.stdout:7/641: mkdir d3/d21/d41/d7c/dc3/d7f/ddd 0 2024-04-23T14:49:55.058 INFO:tasks.workunit.client.1.smithi156.stdout:8/407: unlink d5/d9/d5a/f6a 0 2024-04-23T14:49:55.058 INFO:tasks.workunit.client.1.smithi156.stdout:8/408: fsync d5/d4e/f66 0 2024-04-23T14:49:55.062 INFO:tasks.workunit.client.0.smithi081.stdout:7/642: rename d3/d21/d41/dcd/fdc to d3/d21/d41/dbb/fde 0 2024-04-23T14:49:55.063 INFO:tasks.workunit.client.1.smithi156.stdout:0/425: getdents d0/d4/d11 0 2024-04-23T14:49:55.063 INFO:tasks.workunit.client.1.smithi156.stdout:0/426: chown d0/d16/d3a/d2a/d5e/c75 6 1 2024-04-23T14:49:55.065 INFO:tasks.workunit.client.1.smithi156.stdout:7/443: mknod dc/d1d/d24/d5a/c85 0 2024-04-23T14:49:55.065 INFO:tasks.workunit.client.1.smithi156.stdout:7/444: fdatasync dc/d1d/f77 0 2024-04-23T14:49:55.065 INFO:tasks.workunit.client.1.smithi156.stdout:7/445: fsync dc/d1d/d41/f51 0 2024-04-23T14:49:55.070 INFO:tasks.workunit.client.0.smithi081.stdout:7/643: symlink d3/d21/d31/d33/dbc/ldf 0 2024-04-23T14:49:55.071 INFO:tasks.workunit.client.1.smithi156.stdout:6/481: getdents d3/d16/d5c 0 2024-04-23T14:49:55.071 INFO:tasks.workunit.client.1.smithi156.stdout:6/482: chown d3/da/d1d/d27/f51 811755 1 2024-04-23T14:49:55.075 INFO:tasks.workunit.client.1.smithi156.stdout:7/446: creat dc/d1d/d41/d53/f86 x:0 0 0 2024-04-23T14:49:55.078 INFO:tasks.workunit.client.0.smithi081.stdout:7/644: truncate d3/d21/d31/f29 4652242 0 2024-04-23T14:49:55.079 INFO:tasks.workunit.client.1.smithi156.stdout:9/354: rename d1/d2/d4 to d1/d2/d3e/d50/d7a 0 2024-04-23T14:49:55.079 INFO:tasks.workunit.client.1.smithi156.stdout:7/447: write dc/d1d/d24/d5a/f6f [830287,79336] 0 2024-04-23T14:49:55.079 INFO:tasks.workunit.client.1.smithi156.stdout:9/355: truncate d1/d2/f13 361714 0 2024-04-23T14:49:55.079 INFO:tasks.workunit.client.1.smithi156.stdout:2/425: getdents d4/d21/d42/d75/d8e 0 2024-04-23T14:49:55.079 INFO:tasks.workunit.client.1.smithi156.stdout:7/448: creat dc/d1d/d24/f87 x:0 0 0 2024-04-23T14:49:55.079 INFO:tasks.workunit.client.1.smithi156.stdout:7/449: write dc/d1d/d41/f47 [999463,83127] 0 2024-04-23T14:49:55.079 INFO:tasks.workunit.client.1.smithi156.stdout:7/450: readlink dc/d46/l40 0 2024-04-23T14:49:55.079 INFO:tasks.workunit.client.1.smithi156.stdout:7/451: chown dc/d1d/d41/d53/c56 16191 1 2024-04-23T14:49:55.079 INFO:tasks.workunit.client.1.smithi156.stdout:8/409: rename d5/d39/f68 to d5/d9/d10/d1d/f8e 0 2024-04-23T14:49:55.080 INFO:tasks.workunit.client.1.smithi156.stdout:7/452: write dc/d46/d58/f71 [646579,117241] 0 2024-04-23T14:49:55.082 INFO:tasks.workunit.client.0.smithi081.stdout:9/717: write d3/de/d1d/f20 [1601677,103894] 0 2024-04-23T14:49:55.082 INFO:tasks.workunit.client.0.smithi081.stdout:9/718: readlink d3/de/d1d/ldc 0 2024-04-23T14:49:55.082 INFO:tasks.workunit.client.0.smithi081.stdout:9/719: write d3/f4a [1987652,84708] 0 2024-04-23T14:49:55.083 INFO:tasks.workunit.client.0.smithi081.stdout:7/645: rename d3/d21/d31/d33/d4b/d6e/fdb to d3/d20/fe0 0 2024-04-23T14:49:55.085 INFO:tasks.workunit.client.1.smithi156.stdout:6/483: rmdir d3/da 39 2024-04-23T14:49:55.085 INFO:tasks.workunit.client.1.smithi156.stdout:6/484: readlink d3/l1f 0 2024-04-23T14:49:55.088 INFO:tasks.workunit.client.1.smithi156.stdout:0/427: rename d0/d4/d11/l2e to d0/d4/d22/l90 0 2024-04-23T14:49:55.088 INFO:tasks.workunit.client.1.smithi156.stdout:0/428: creat d0/d16/d3a/d2b/d44/d4a/f91 x:0 0 0 2024-04-23T14:49:55.090 INFO:tasks.workunit.client.0.smithi081.stdout:0/839: dread d6/d25/fc3 [4194304,4194304] 0 2024-04-23T14:49:55.091 INFO:tasks.workunit.client.0.smithi081.stdout:9/720: creat d3/de/d14/d5e/d72/fe7 x:0 0 0 2024-04-23T14:49:55.091 INFO:tasks.workunit.client.0.smithi081.stdout:9/721: truncate d3/de/d14/d5e/d72/fe7 699898 0 2024-04-23T14:49:55.096 INFO:tasks.workunit.client.0.smithi081.stdout:0/840: rmdir d6/d11/d14/d41/d5b/d59/dc6 0 2024-04-23T14:49:55.100 INFO:tasks.workunit.client.1.smithi156.stdout:3/393: dwrite d4/db/dd/d1d/f2e [4194304,4194304] 0 2024-04-23T14:49:55.103 INFO:tasks.workunit.client.0.smithi081.stdout:9/722: symlink d3/de/d14/dab/le8 0 2024-04-23T14:49:55.103 INFO:tasks.workunit.client.0.smithi081.stdout:9/723: creat d3/de/d47/fe9 x:0 0 0 2024-04-23T14:49:55.105 INFO:tasks.workunit.client.1.smithi156.stdout:0/429: mkdir d0/d16/d43/d92 0 2024-04-23T14:49:55.105 INFO:tasks.workunit.client.1.smithi156.stdout:0/430: truncate d0/f15 4984928 0 2024-04-23T14:49:55.105 INFO:tasks.workunit.client.1.smithi156.stdout:0/431: write d0/f7c [1006559,71990] 0 2024-04-23T14:49:55.112 INFO:tasks.workunit.client.0.smithi081.stdout:9/724: rename d3/d1a/d6c/f58 to d3/de/d14/fea 0 2024-04-23T14:49:55.112 INFO:tasks.workunit.client.0.smithi081.stdout:9/725: readlink d3/de/d14/d5e/d72/ld7 0 2024-04-23T14:49:55.117 INFO:tasks.workunit.client.1.smithi156.stdout:4/346: write d0/d30/f3f [2054181,92077] 0 2024-04-23T14:49:55.117 INFO:tasks.workunit.client.0.smithi081.stdout:0/841: write d6/d37/d67/f97 [2271549,114125] 0 2024-04-23T14:49:55.118 INFO:tasks.workunit.client.0.smithi081.stdout:0/842: fsync d6/d11/d14/d41/d5b/d3f/f4a 0 2024-04-23T14:49:55.118 INFO:tasks.workunit.client.0.smithi081.stdout:0/843: write d6/d11/d14/db8/fbf [451970,58250] 0 2024-04-23T14:49:55.119 INFO:tasks.workunit.client.0.smithi081.stdout:0/844: write d6/d11/d14/d24/f4b [4727562,83459] 0 2024-04-23T14:49:55.119 INFO:tasks.workunit.client.0.smithi081.stdout:0/845: write d6/d37/f5c [5041267,85118] 0 2024-04-23T14:49:55.119 INFO:tasks.workunit.client.0.smithi081.stdout:0/846: fsync d6/d11/d14/db8/fe8 0 2024-04-23T14:49:55.120 INFO:tasks.workunit.client.1.smithi156.stdout:3/394: truncate d4/db/dd/f26 550246 0 2024-04-23T14:49:55.120 INFO:tasks.workunit.client.1.smithi156.stdout:0/432: mkdir d0/d4/d93 0 2024-04-23T14:49:55.120 INFO:tasks.workunit.client.1.smithi156.stdout:3/395: truncate d4/db/dd/d1d/d1e/d13/f1f 4767842 0 2024-04-23T14:49:55.120 INFO:tasks.workunit.client.1.smithi156.stdout:6/485: dread d3/d16/f37 [0,4194304] 0 2024-04-23T14:49:55.121 INFO:tasks.workunit.client.0.smithi081.stdout:7/646: dread d3/d11/d2c/f3d [0,4194304] 0 2024-04-23T14:49:55.121 INFO:tasks.workunit.client.1.smithi156.stdout:4/347: stat d0/df/d55/c42 0 2024-04-23T14:49:55.121 INFO:tasks.workunit.client.0.smithi081.stdout:4/704: dwrite d1/d1d/f3e [0,4194304] 0 2024-04-23T14:49:55.126 INFO:tasks.workunit.client.0.smithi081.stdout:0/847: rename d6/d11/d14/d41/d5b/d59/fd0 to d6/d11/d14/d41/d5b/d3f/d44/d78/d84/f107 0 2024-04-23T14:49:55.126 INFO:tasks.workunit.client.0.smithi081.stdout:0/848: stat d6/f9 0 2024-04-23T14:49:55.126 INFO:tasks.workunit.client.1.smithi156.stdout:0/433: mknod d0/d4/d93/c94 0 2024-04-23T14:49:55.129 INFO:tasks.workunit.client.1.smithi156.stdout:6/486: unlink d3/da/f7f 0 2024-04-23T14:49:55.129 INFO:tasks.workunit.client.1.smithi156.stdout:6/487: dread - d3/da/d1d/d27/f58 zero size 2024-04-23T14:49:55.129 INFO:tasks.workunit.client.1.smithi156.stdout:6/488: readlink d3/da/l36 0 2024-04-23T14:49:55.131 INFO:tasks.workunit.client.1.smithi156.stdout:4/348: creat d0/df/d3a/d63/f72 x:0 0 0 2024-04-23T14:49:55.131 INFO:tasks.workunit.client.1.smithi156.stdout:4/349: fsync d0/d8/d1e/f22 0 2024-04-23T14:49:55.134 INFO:tasks.workunit.client.0.smithi081.stdout:4/705: symlink d1/d4/d6f/le8 0 2024-04-23T14:49:55.140 INFO:tasks.workunit.client.1.smithi156.stdout:0/434: dread d0/d16/d3a/d2a/d1d/d2d/f8c [0,4194304] 0 2024-04-23T14:49:55.140 INFO:tasks.workunit.client.1.smithi156.stdout:5/483: dwrite d1/d11/d18/d19/d74/f80 [4194304,4194304] 0 2024-04-23T14:49:55.141 INFO:tasks.workunit.client.1.smithi156.stdout:5/484: read - d1/d3/d64/f65 zero size 2024-04-23T14:49:55.145 INFO:tasks.workunit.client.0.smithi081.stdout:4/706: creat d1/d4/fe9 x:0 0 0 2024-04-23T14:49:55.150 INFO:tasks.workunit.client.1.smithi156.stdout:1/497: dwrite db/f4f [0,4194304] 0 2024-04-23T14:49:55.151 INFO:tasks.workunit.client.0.smithi081.stdout:9/726: dread d3/d5/f16 [4194304,4194304] 0 2024-04-23T14:49:55.155 INFO:tasks.workunit.client.1.smithi156.stdout:3/396: read d4/f10 [6752826,27291] 0 2024-04-23T14:49:55.155 INFO:tasks.workunit.client.0.smithi081.stdout:8/955: dwrite d3/d11/f2e [0,4194304] 0 2024-04-23T14:49:55.160 INFO:tasks.workunit.client.1.smithi156.stdout:2/426: dwrite d4/f62 [0,4194304] 0 2024-04-23T14:49:55.160 INFO:tasks.workunit.client.1.smithi156.stdout:2/427: fsync d4/d13/d88/f7c 0 2024-04-23T14:49:55.167 INFO:tasks.workunit.client.0.smithi081.stdout:4/707: dread d1/d4/d6f/d70/daf/f71 [0,4194304] 0 2024-04-23T14:49:55.167 INFO:tasks.workunit.client.0.smithi081.stdout:4/708: stat d1/d4/d6f/d70 0 2024-04-23T14:49:55.168 INFO:tasks.workunit.client.1.smithi156.stdout:7/453: dwrite dc/d1d/d41/f57 [0,4194304] 0 2024-04-23T14:49:55.181 INFO:tasks.workunit.client.0.smithi081.stdout:9/727: creat d3/de/d1d/dcc/feb x:0 0 0 2024-04-23T14:49:55.181 INFO:tasks.workunit.client.0.smithi081.stdout:9/728: write d3/de/d1d/d5b/fae [1929442,88042] 0 2024-04-23T14:49:55.182 INFO:tasks.workunit.client.0.smithi081.stdout:9/729: dread - d3/de/d1d/dcc/feb zero size 2024-04-23T14:49:55.182 INFO:tasks.workunit.client.0.smithi081.stdout:9/730: dread - d3/de/d1d/d5b/d7b/db2/fdb zero size 2024-04-23T14:49:55.182 INFO:tasks.workunit.client.0.smithi081.stdout:9/731: fsync d3/de/d47/f49 0 2024-04-23T14:49:55.190 INFO:tasks.workunit.client.0.smithi081.stdout:7/647: dwrite d3/d20/dc9/f84 [0,4194304] 0 2024-04-23T14:49:55.193 INFO:tasks.workunit.client.1.smithi156.stdout:7/454: rename dc/d2a/d59 to dc/d1d/d41/d53/d6c/d88 0 2024-04-23T14:49:55.195 INFO:tasks.workunit.client.0.smithi081.stdout:9/732: unlink d3/de/l15 0 2024-04-23T14:49:55.205 INFO:tasks.workunit.client.0.smithi081.stdout:7/648: unlink d3/d21/d31/c1c 0 2024-04-23T14:49:55.205 INFO:tasks.workunit.client.1.smithi156.stdout:4/350: dwrite d0/df/d3a/f4d [0,4194304] 0 2024-04-23T14:49:55.207 INFO:tasks.workunit.client.1.smithi156.stdout:9/356: dwrite d1/d2/d23/d49/d4b/f5b [0,4194304] 0 2024-04-23T14:49:55.210 INFO:tasks.workunit.client.0.smithi081.stdout:9/733: mknod d3/de/d1d/d5b/d7b/d90/dd2/cec 0 2024-04-23T14:49:55.214 INFO:tasks.workunit.client.0.smithi081.stdout:7/649: rmdir d3/d21/d41/dcd 39 2024-04-23T14:49:55.219 INFO:tasks.workunit.client.0.smithi081.stdout:9/734: dread d3/d5/f41 [0,4194304] 0 2024-04-23T14:49:55.220 INFO:tasks.workunit.client.1.smithi156.stdout:8/410: dwrite d5/d45/f55 [0,4194304] 0 2024-04-23T14:49:55.220 INFO:tasks.workunit.client.1.smithi156.stdout:6/489: dwrite d3/fd [0,4194304] 0 2024-04-23T14:49:55.220 INFO:tasks.workunit.client.1.smithi156.stdout:6/490: chown d3/da/d1d/f35 300622 1 2024-04-23T14:49:55.241 INFO:tasks.workunit.client.0.smithi081.stdout:4/709: dwrite d1/d1d/f97 [0,4194304] 0 2024-04-23T14:49:55.243 INFO:tasks.workunit.client.1.smithi156.stdout:0/435: dwrite d0/d16/d3a/d2b/d44/d4a/f65 [0,4194304] 0 2024-04-23T14:49:55.254 INFO:tasks.workunit.client.1.smithi156.stdout:1/498: dwrite db/d25/d6b/f88 [0,4194304] 0 2024-04-23T14:49:55.254 INFO:tasks.workunit.client.1.smithi156.stdout:1/499: fsync db/d1f/f76 0 2024-04-23T14:49:55.254 INFO:tasks.workunit.client.1.smithi156.stdout:1/500: chown db/d1f 171098647 1 2024-04-23T14:49:55.273 INFO:tasks.workunit.client.1.smithi156.stdout:3/397: dwrite d4/db/dd/d1d/d1e/d13/f46 [0,4194304] 0 2024-04-23T14:49:55.273 INFO:tasks.workunit.client.1.smithi156.stdout:3/398: stat d4/db/dd/d1d/f36 0 2024-04-23T14:49:55.283 INFO:tasks.workunit.client.0.smithi081.stdout:7/650: mknod d3/ce1 0 2024-04-23T14:49:55.284 INFO:tasks.workunit.client.1.smithi156.stdout:2/428: rmdir d4 39 2024-04-23T14:49:55.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:54 smithi156 ceph-mon[32341]: pgmap v36: 65 pgs: 65 active+clean; 2.1 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 142 MiB/s rd, 167 MiB/s wr, 245 op/s 2024-04-23T14:49:55.288 INFO:tasks.workunit.client.1.smithi156.stdout:2/429: read d4/d13/d19/d58/f7e [743463,78609] 0 2024-04-23T14:49:55.288 INFO:tasks.workunit.client.1.smithi156.stdout:2/430: fsync d4/d21/d42/f55 0 2024-04-23T14:49:55.289 INFO:tasks.workunit.client.1.smithi156.stdout:7/455: mknod dc/d1d/d48/c89 0 2024-04-23T14:49:55.294 INFO:tasks.workunit.client.0.smithi081.stdout:4/710: dwrite d1/d1d/d39/f53 [0,4194304] 0 2024-04-23T14:49:55.294 INFO:tasks.workunit.client.0.smithi081.stdout:4/711: write d1/d4f/dc3/fd5 [88684,47334] 0 2024-04-23T14:49:55.298 INFO:tasks.workunit.client.1.smithi156.stdout:4/351: creat d0/df/d55/f73 x:0 0 0 2024-04-23T14:49:55.300 INFO:tasks.workunit.client.1.smithi156.stdout:9/357: getdents d1/d2/d3e/d50/d7a/d17/d1f/d48 0 2024-04-23T14:49:55.303 INFO:tasks.workunit.client.0.smithi081.stdout:4/712: dread d1/d4/dc/f6a [0,4194304] 0 2024-04-23T14:49:55.306 INFO:tasks.workunit.client.0.smithi081.stdout:7/651: read d3/d21/d31/d50/da2/f8c [3414060,54744] 0 2024-04-23T14:49:55.311 INFO:tasks.workunit.client.1.smithi156.stdout:8/411: rmdir d5/d9/d10/d1d/d4c 39 2024-04-23T14:49:55.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:54 smithi081 ceph-mon[25540]: pgmap v36: 65 pgs: 65 active+clean; 2.1 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 142 MiB/s rd, 167 MiB/s wr, 245 op/s 2024-04-23T14:49:55.344 INFO:tasks.workunit.client.0.smithi081.stdout:7/652: dwrite d3/d21/f79 [0,4194304] 0 2024-04-23T14:49:55.344 INFO:tasks.workunit.client.0.smithi081.stdout:7/653: chown d3/d97/fa5 1257106 1 2024-04-23T14:49:55.344 INFO:tasks.workunit.client.0.smithi081.stdout:7/654: write d3/d20/dc9/fbf [718720,35471] 0 2024-04-23T14:49:55.400 INFO:tasks.workunit.client.1.smithi156.stdout:3/399: symlink d4/db/dd/d1d/d61/l75 0 2024-04-23T14:49:55.421 INFO:tasks.workunit.client.1.smithi156.stdout:2/431: symlink d4/d13/d19/d97/l99 0 2024-04-23T14:49:55.425 INFO:tasks.workunit.client.1.smithi156.stdout:7/456: creat dc/d1d/d48/d83/f8a x:0 0 0 2024-04-23T14:49:55.429 INFO:tasks.workunit.client.1.smithi156.stdout:4/352: mkdir d0/df/d55/d68/d74 0 2024-04-23T14:49:55.431 INFO:tasks.workunit.client.0.smithi081.stdout:4/713: creat d1/fea x:0 0 0 2024-04-23T14:49:55.431 INFO:tasks.workunit.client.0.smithi081.stdout:4/714: readlink d1/d4/d6f/d70/daf/d8c/d99/la1 0 2024-04-23T14:49:55.433 INFO:tasks.workunit.client.1.smithi156.stdout:9/358: creat d1/d2/d23/d75/f7b x:0 0 0 2024-04-23T14:49:55.434 INFO:tasks.workunit.client.1.smithi156.stdout:8/412: creat d5/d9/d36/d84/f8f x:0 0 0 2024-04-23T14:49:55.434 INFO:tasks.workunit.client.1.smithi156.stdout:8/413: write d5/d9/d5a/d5c/f85 [978846,99036] 0 2024-04-23T14:49:55.435 INFO:tasks.workunit.client.1.smithi156.stdout:8/414: chown d5/d45/l8d 1045319 1 2024-04-23T14:49:55.436 INFO:tasks.workunit.client.0.smithi081.stdout:7/655: creat d3/d21/d31/d50/d5a/fe2 x:0 0 0 2024-04-23T14:49:55.441 INFO:tasks.workunit.client.1.smithi156.stdout:3/400: truncate d4/db/dd/d1d/d1e/d13/f34 3995254 0 2024-04-23T14:49:55.445 INFO:tasks.workunit.client.1.smithi156.stdout:7/457: rename dc/d1d/d41/f82 to dc/d1d/d41/d53/d6c/f8b 0 2024-04-23T14:49:55.448 INFO:tasks.workunit.client.1.smithi156.stdout:9/359: creat d1/d2/d3e/d50/f7c x:0 0 0 2024-04-23T14:49:55.449 INFO:tasks.workunit.client.0.smithi081.stdout:4/715: write d1/d1d/d59/fb6 [807435,37773] 0 2024-04-23T14:49:55.450 INFO:tasks.workunit.client.1.smithi156.stdout:3/401: mkdir d4/db/dd/d1d/d1e/d42/d76 0 2024-04-23T14:49:55.452 INFO:tasks.workunit.client.0.smithi081.stdout:7/656: rename d3/d21/d41/d7c/dc3/d7f/d98/lc7 to d3/d11/d2c/d75/le3 0 2024-04-23T14:49:55.454 INFO:tasks.workunit.client.0.smithi081.stdout:4/716: creat d1/d4/d6f/feb x:0 0 0 2024-04-23T14:49:55.457 INFO:tasks.workunit.client.0.smithi081.stdout:7/657: creat d3/d21/d41/d7c/dc3/d7f/ddd/fe4 x:0 0 0 2024-04-23T14:49:55.458 INFO:tasks.workunit.client.1.smithi156.stdout:4/353: dread d0/df/d55/f3c [0,4194304] 0 2024-04-23T14:49:55.460 INFO:tasks.workunit.client.0.smithi081.stdout:7/658: rename d3/d21/d31/f9 to d3/d21/d41/d7c/dc3/fe5 0 2024-04-23T14:49:55.460 INFO:tasks.workunit.client.0.smithi081.stdout:7/659: write d3/d21/d41/d7c/dc3/fac [161258,78821] 0 2024-04-23T14:49:55.460 INFO:tasks.workunit.client.0.smithi081.stdout:7/660: fdatasync d3/d21/d31/f8 0 2024-04-23T14:49:55.461 INFO:tasks.workunit.client.0.smithi081.stdout:7/661: dread - d3/d21/d31/d33/d4b/d6e/fce zero size 2024-04-23T14:49:55.461 INFO:tasks.workunit.client.0.smithi081.stdout:7/662: creat d3/d21/d41/d7c/fe6 x:0 0 0 2024-04-23T14:49:55.462 INFO:tasks.workunit.client.1.smithi156.stdout:8/415: write d5/d9/f4d [1295986,112809] 0 2024-04-23T14:49:55.462 INFO:tasks.workunit.client.1.smithi156.stdout:8/416: read - d5/d9/d36/d60/f89 zero size 2024-04-23T14:49:55.464 INFO:tasks.workunit.client.0.smithi081.stdout:7/663: creat d3/fe7 x:0 0 0 2024-04-23T14:49:55.464 INFO:tasks.workunit.client.1.smithi156.stdout:4/354: dread d0/df/d55/d68/f4f [0,4194304] 0 2024-04-23T14:49:55.467 INFO:tasks.workunit.client.0.smithi081.stdout:4/717: dread d1/d1d/f26 [0,4194304] 0 2024-04-23T14:49:55.467 INFO:tasks.workunit.client.0.smithi081.stdout:4/718: chown d1/f1e 253 1 2024-04-23T14:49:55.468 INFO:tasks.workunit.client.1.smithi156.stdout:8/417: mknod d5/d9/d10/d1d/d21/c90 0 2024-04-23T14:49:55.468 INFO:tasks.workunit.client.1.smithi156.stdout:8/418: readlink d5/d9/d5a/d5c/d6b/l74 0 2024-04-23T14:49:55.469 INFO:tasks.workunit.client.1.smithi156.stdout:8/419: dread - d5/d39/f64 zero size 2024-04-23T14:49:55.471 INFO:tasks.workunit.client.0.smithi081.stdout:7/664: read d3/d21/d31/f40 [335813,114429] 0 2024-04-23T14:49:55.472 INFO:tasks.workunit.client.1.smithi156.stdout:8/420: mknod d5/d9/d10/d1d/d21/c91 0 2024-04-23T14:49:55.477 INFO:tasks.workunit.client.1.smithi156.stdout:6/491: rmdir d3/d16/d46/d2b 39 2024-04-23T14:49:55.477 INFO:tasks.workunit.client.1.smithi156.stdout:6/492: creat d3/d16/d1e/fb9 x:0 0 0 2024-04-23T14:49:55.477 INFO:tasks.workunit.client.1.smithi156.stdout:6/493: readlink d3/d16/d46/l47 0 2024-04-23T14:49:55.481 INFO:tasks.workunit.client.1.smithi156.stdout:6/494: symlink d3/da/d1d/d59/lba 0 2024-04-23T14:49:55.482 INFO:tasks.workunit.client.1.smithi156.stdout:6/495: creat d3/d16/d46/d9d/d9f/dad/fbb x:0 0 0 2024-04-23T14:49:55.492 INFO:tasks.workunit.client.1.smithi156.stdout:8/421: write d5/d9/d10/d1d/d4c/f42 [7169849,114519] 0 2024-04-23T14:49:55.498 INFO:tasks.workunit.client.1.smithi156.stdout:7/458: dwrite dc/d2a/f3a [0,4194304] 0 2024-04-23T14:49:55.499 INFO:tasks.workunit.client.1.smithi156.stdout:7/459: truncate dc/d1d/d48/f5b 54747 0 2024-04-23T14:49:55.499 INFO:tasks.workunit.client.1.smithi156.stdout:7/460: stat dc/d1d/d24/d5a/f76 0 2024-04-23T14:49:55.506 INFO:tasks.workunit.client.1.smithi156.stdout:6/496: read d3/da/d1d/d27/f31 [3801300,31808] 0 2024-04-23T14:49:55.506 INFO:tasks.workunit.client.1.smithi156.stdout:6/497: fdatasync d3/fd 0 2024-04-23T14:49:55.506 INFO:tasks.workunit.client.1.smithi156.stdout:6/498: chown d3/d16/f76 124 1 2024-04-23T14:49:55.506 INFO:tasks.workunit.client.1.smithi156.stdout:1/501: symlink db/d25/d30/d38/la3 0 2024-04-23T14:49:55.506 INFO:tasks.workunit.client.1.smithi156.stdout:3/402: creat d4/db/f77 x:0 0 0 2024-04-23T14:49:55.506 INFO:tasks.workunit.client.1.smithi156.stdout:3/403: dread - d4/db/dd/f66 zero size 2024-04-23T14:49:55.506 INFO:tasks.workunit.client.1.smithi156.stdout:3/404: stat d4/db/dd/f50 0 2024-04-23T14:49:55.506 INFO:tasks.workunit.client.1.smithi156.stdout:7/461: truncate dc/d1d/d24/f27 1753251 0 2024-04-23T14:49:55.506 INFO:tasks.workunit.client.1.smithi156.stdout:3/405: readlink d4/db/dd/d20/l4e 0 2024-04-23T14:49:55.506 INFO:tasks.workunit.client.1.smithi156.stdout:3/406: write d4/db/dd/d1d/d1e/f12 [81917,37987] 0 2024-04-23T14:49:55.507 INFO:tasks.workunit.client.1.smithi156.stdout:6/499: symlink d3/da/d1d/d27/d80/lbc 0 2024-04-23T14:49:55.507 INFO:tasks.workunit.client.1.smithi156.stdout:6/500: dread - d3/da/d1d/fb5 zero size 2024-04-23T14:49:55.507 INFO:tasks.workunit.client.1.smithi156.stdout:6/501: truncate d3/d16/d1e/f20 2138354 0 2024-04-23T14:49:55.507 INFO:tasks.workunit.client.1.smithi156.stdout:3/407: mknod d4/db/dd/d1d/d1e/d42/d76/c78 0 2024-04-23T14:49:55.508 INFO:tasks.workunit.client.1.smithi156.stdout:3/408: truncate d4/db/dd/f25 3830440 0 2024-04-23T14:49:55.511 INFO:tasks.workunit.client.1.smithi156.stdout:8/422: read d5/d9/d10/f87 [771378,84731] 0 2024-04-23T14:49:55.511 INFO:tasks.workunit.client.1.smithi156.stdout:8/423: chown d5/d9/d5a/d5c/f72 0 1 2024-04-23T14:49:55.511 INFO:tasks.workunit.client.1.smithi156.stdout:3/409: truncate d4/db/dd/d1d/d1e/d13/f1a 893648 0 2024-04-23T14:49:55.517 INFO:tasks.workunit.client.1.smithi156.stdout:4/355: mkdir d0/df/d75 0 2024-04-23T14:49:55.517 INFO:tasks.workunit.client.1.smithi156.stdout:4/356: fdatasync d0/df/f17 0 2024-04-23T14:49:55.517 INFO:tasks.workunit.client.1.smithi156.stdout:4/357: write d0/df/d3a/f4d [5044780,75010] 0 2024-04-23T14:49:55.517 INFO:tasks.workunit.client.1.smithi156.stdout:4/358: chown d0/df/d55/d68/c59 61 1 2024-04-23T14:49:55.520 INFO:tasks.workunit.client.1.smithi156.stdout:7/462: dread dc/d46/d58/f71 [0,4194304] 0 2024-04-23T14:49:55.521 INFO:tasks.workunit.client.1.smithi156.stdout:7/463: chown dc/d1d/d24/f62 18287938 1 2024-04-23T14:49:55.529 INFO:tasks.workunit.client.0.smithi081.stdout:4/719: rename d1/d4/d6f/d70/daf/cae to d1/d4/d6f/d70/d9c/cec 0 2024-04-23T14:49:55.531 INFO:tasks.workunit.client.0.smithi081.stdout:4/720: symlink d1/d1d/led 0 2024-04-23T14:49:55.531 INFO:tasks.workunit.client.0.smithi081.stdout:4/721: chown d1/d4/d6f/fb4 436502 1 2024-04-23T14:49:55.531 INFO:tasks.workunit.client.0.smithi081.stdout:4/722: write d1/f31 [474516,76723] 0 2024-04-23T14:49:55.533 INFO:tasks.workunit.client.0.smithi081.stdout:4/723: rename d1/d4/ld2 to d1/d8b/lee 0 2024-04-23T14:49:55.538 INFO:tasks.workunit.client.0.smithi081.stdout:7/665: dwrite d3/d20/fe0 [0,4194304] 0 2024-04-23T14:49:55.541 INFO:tasks.workunit.client.1.smithi156.stdout:8/424: dread d5/d9/d10/d1d/d21/f37 [0,4194304] 0 2024-04-23T14:49:55.542 INFO:tasks.workunit.client.0.smithi081.stdout:7/666: mknod d3/d97/ce8 0 2024-04-23T14:49:55.543 INFO:tasks.workunit.client.1.smithi156.stdout:8/425: creat d5/d39/d6d/d8a/f92 x:0 0 0 2024-04-23T14:49:55.544 INFO:tasks.workunit.client.1.smithi156.stdout:8/426: fdatasync d5/d9/d5a/d5c/f72 0 2024-04-23T14:49:55.544 INFO:tasks.workunit.client.1.smithi156.stdout:8/427: dread - d5/d9/d5a/d5c/f72 zero size 2024-04-23T14:49:55.546 INFO:tasks.workunit.client.1.smithi156.stdout:8/428: mkdir d5/d39/d6d/d93 0 2024-04-23T14:49:55.546 INFO:tasks.workunit.client.1.smithi156.stdout:8/429: fdatasync d5/d9/d10/d1d/d21/f40 0 2024-04-23T14:49:55.546 INFO:tasks.workunit.client.1.smithi156.stdout:8/430: stat d5/d9/d36/d84/f8f 0 2024-04-23T14:49:55.546 INFO:tasks.workunit.client.1.smithi156.stdout:8/431: dread - d5/d9/d10/f6e zero size 2024-04-23T14:49:55.546 INFO:tasks.workunit.client.1.smithi156.stdout:8/432: readlink d5/d9/d5a/d5c/d6b/l74 0 2024-04-23T14:49:55.548 INFO:tasks.workunit.client.0.smithi081.stdout:5/836: sync 2024-04-23T14:49:55.557 INFO:tasks.workunit.client.0.smithi081.stdout:5/837: dread d17/d4f/fd7 [0,4194304] 0 2024-04-23T14:49:55.565 INFO:tasks.workunit.client.1.smithi156.stdout:7/464: dread dc/d1d/d41/f3d [0,4194304] 0 2024-04-23T14:49:55.565 INFO:tasks.workunit.client.1.smithi156.stdout:7/465: fdatasync dc/d1d/d24/d5a/f72 0 2024-04-23T14:49:55.565 INFO:tasks.workunit.client.1.smithi156.stdout:7/466: write dc/d1d/d24/d5a/f6f [1067401,99620] 0 2024-04-23T14:49:55.567 INFO:tasks.workunit.client.0.smithi081.stdout:7/667: dread d3/d21/d31/d33/d4b/d4c/f5d [0,4194304] 0 2024-04-23T14:49:55.569 INFO:tasks.workunit.client.1.smithi156.stdout:4/359: dwrite d0/d30/f3f [4194304,4194304] 0 2024-04-23T14:49:55.576 INFO:tasks.workunit.client.1.smithi156.stdout:1/502: dwrite db/f17 [4194304,4194304] 0 2024-04-23T14:49:55.576 INFO:tasks.workunit.client.1.smithi156.stdout:6/502: dwrite d3/da/d1d/d27/d63/f96 [0,4194304] 0 2024-04-23T14:49:55.576 INFO:tasks.workunit.client.1.smithi156.stdout:6/503: chown d3/da/d1d/d59 14278 1 2024-04-23T14:49:55.604 INFO:tasks.workunit.client.1.smithi156.stdout:8/433: symlink d5/d9/d36/d60/d62/l94 0 2024-04-23T14:49:55.605 INFO:tasks.workunit.client.0.smithi081.stdout:5/838: mknod d17/d3c/d105/c124 0 2024-04-23T14:49:55.607 INFO:tasks.workunit.client.0.smithi081.stdout:7/668: symlink d3/d21/d31/d33/d4b/d6e/le9 0 2024-04-23T14:49:55.607 INFO:tasks.workunit.client.0.smithi081.stdout:7/669: stat d3/d21/d31/d50 0 2024-04-23T14:49:55.608 INFO:tasks.workunit.client.1.smithi156.stdout:5/485: sync 2024-04-23T14:49:55.608 INFO:tasks.workunit.client.1.smithi156.stdout:0/436: sync 2024-04-23T14:49:55.608 INFO:tasks.workunit.client.1.smithi156.stdout:5/486: fsync d1/d11/f51 0 2024-04-23T14:49:55.610 INFO:tasks.workunit.client.1.smithi156.stdout:7/467: dwrite dc/d1d/d41/f51 [0,4194304] 0 2024-04-23T14:49:55.611 INFO:tasks.workunit.client.1.smithi156.stdout:6/504: dwrite d3/d16/d5c/d6a/f87 [0,4194304] 0 2024-04-23T14:49:55.614 INFO:tasks.workunit.client.0.smithi081.stdout:5/839: unlink d17/d37/d4e/dc3/l10d 0 2024-04-23T14:49:55.625 INFO:tasks.workunit.client.0.smithi081.stdout:5/840: dread d17/d4f/f68 [0,4194304] 0 2024-04-23T14:49:55.628 INFO:tasks.workunit.client.1.smithi156.stdout:8/434: mknod d5/d9/d5a/d5c/c95 0 2024-04-23T14:49:55.630 INFO:tasks.workunit.client.1.smithi156.stdout:0/437: mknod d0/d4/d11/d3f/d45/c95 0 2024-04-23T14:49:55.633 INFO:tasks.workunit.client.1.smithi156.stdout:5/487: creat d1/d17/f9e x:0 0 0 2024-04-23T14:49:55.644 INFO:tasks.workunit.client.0.smithi081.stdout:5/841: dread d17/d18/dff/d59/fc1 [0,4194304] 0 2024-04-23T14:49:55.645 INFO:tasks.workunit.client.1.smithi156.stdout:0/438: creat d0/d4/d22/f96 x:0 0 0 2024-04-23T14:49:55.646 INFO:tasks.workunit.client.1.smithi156.stdout:8/435: read d5/d4e/f83 [1528164,114109] 0 2024-04-23T14:49:55.646 INFO:tasks.workunit.client.1.smithi156.stdout:8/436: chown d5/d9/d5a/d5c/f72 191687381 1 2024-04-23T14:49:55.647 INFO:tasks.workunit.client.1.smithi156.stdout:5/488: link d1/d3/f5 d1/d11/d18/f9f 0 2024-04-23T14:49:55.649 INFO:tasks.workunit.client.0.smithi081.stdout:5/842: link d17/d18/d3a/f71 d17/d18/dff/d59/da8/f125 0 2024-04-23T14:49:55.651 INFO:tasks.workunit.client.1.smithi156.stdout:4/360: rename d0/df/d3a to d0/d76 0 2024-04-23T14:49:55.653 INFO:tasks.workunit.client.1.smithi156.stdout:0/439: truncate d0/f15 2295001 0 2024-04-23T14:49:55.654 INFO:tasks.workunit.client.1.smithi156.stdout:0/440: creat d0/d4/d11/d3f/d5f/f97 x:0 0 0 2024-04-23T14:49:55.658 INFO:tasks.workunit.client.1.smithi156.stdout:7/468: dwrite dc/d1d/d41/f57 [0,4194304] 0 2024-04-23T14:49:55.658 INFO:tasks.workunit.client.1.smithi156.stdout:7/469: chown dc/d2a/c63 46589848 1 2024-04-23T14:49:55.658 INFO:tasks.workunit.client.1.smithi156.stdout:7/470: fsync f6 0 2024-04-23T14:49:55.658 INFO:tasks.workunit.client.1.smithi156.stdout:5/489: truncate d1/d11/d18/d19/d74/f80 2984564 0 2024-04-23T14:49:55.658 INFO:tasks.workunit.client.1.smithi156.stdout:5/490: chown d1/d11/d18/d19/d74/l81 1229204 1 2024-04-23T14:49:55.658 INFO:tasks.workunit.client.1.smithi156.stdout:5/491: chown d1/d11/d18/d19/l53 85880470 1 2024-04-23T14:49:55.658 INFO:tasks.workunit.client.1.smithi156.stdout:5/492: chown d1/d3/d20/f4c 4 1 2024-04-23T14:49:55.659 INFO:tasks.workunit.client.0.smithi081.stdout:5/843: link d17/d3c/ca2 d17/d18/d3a/c126 0 2024-04-23T14:49:55.660 INFO:tasks.workunit.client.1.smithi156.stdout:4/361: unlink d0/df/d55/c4b 0 2024-04-23T14:49:55.662 INFO:tasks.workunit.client.0.smithi081.stdout:5/844: dread d17/d3d/d7a/ff6 [0,4194304] 0 2024-04-23T14:49:55.663 INFO:tasks.workunit.client.1.smithi156.stdout:0/441: creat d0/d16/d3a/d2a/d1d/f98 x:0 0 0 2024-04-23T14:49:55.665 INFO:tasks.workunit.client.0.smithi081.stdout:7/670: write d3/d21/d31/f3a [859343,71155] 0 2024-04-23T14:49:55.665 INFO:tasks.workunit.client.0.smithi081.stdout:7/671: write d3/d11/d2c/f53 [4383953,126610] 0 2024-04-23T14:49:55.666 INFO:tasks.workunit.client.0.smithi081.stdout:7/672: fdatasync d3/d21/d41/d7c/dc3/d7f/f9b 0 2024-04-23T14:49:55.667 INFO:tasks.workunit.client.1.smithi156.stdout:7/471: rename dc/d1d/d41/f64 to dc/d2c/f8c 0 2024-04-23T14:49:55.668 INFO:tasks.workunit.client.1.smithi156.stdout:7/472: truncate dc/d1d/f35 1479058 0 2024-04-23T14:49:55.668 INFO:tasks.workunit.client.1.smithi156.stdout:7/473: truncate dc/d1d/f52 937334 0 2024-04-23T14:49:55.669 INFO:tasks.workunit.client.1.smithi156.stdout:4/362: mkdir d0/d8/d1e/d4a/d77 0 2024-04-23T14:49:55.671 INFO:tasks.workunit.client.1.smithi156.stdout:7/474: mknod dc/d1d/d24/d5a/c8d 0 2024-04-23T14:49:55.672 INFO:tasks.workunit.client.1.smithi156.stdout:7/475: write dc/d1d/d24/f27 [2726993,40201] 0 2024-04-23T14:49:55.673 INFO:tasks.workunit.client.1.smithi156.stdout:4/363: link d0/df/d55/d68/l4e d0/df/d75/l78 0 2024-04-23T14:49:55.674 INFO:tasks.workunit.client.1.smithi156.stdout:4/364: fdatasync d0/df/d55/f62 0 2024-04-23T14:49:55.674 INFO:tasks.workunit.client.1.smithi156.stdout:4/365: truncate d0/d8/fc 4303260 0 2024-04-23T14:49:55.676 INFO:tasks.workunit.client.0.smithi081.stdout:5/845: mkdir d17/d4f/d61/dba/d127 0 2024-04-23T14:49:55.678 INFO:tasks.workunit.client.0.smithi081.stdout:7/673: mkdir d3/d11/d2c/d75/d8e/dea 0 2024-04-23T14:49:55.681 INFO:tasks.workunit.client.1.smithi156.stdout:5/493: read d1/d3/d24/f58 [1346061,34238] 0 2024-04-23T14:49:55.681 INFO:tasks.workunit.client.1.smithi156.stdout:5/494: chown d1/d3/d64/f65 3073950 1 2024-04-23T14:49:55.682 INFO:tasks.workunit.client.1.smithi156.stdout:5/495: chown d1/d3/d24 202736888 1 2024-04-23T14:49:55.682 INFO:tasks.workunit.client.1.smithi156.stdout:5/496: write d1/d3/d64/f69 [4438355,87232] 0 2024-04-23T14:49:55.682 INFO:tasks.workunit.client.1.smithi156.stdout:5/497: chown d1/d3/d43/l7b 1675829427 1 2024-04-23T14:49:55.682 INFO:tasks.workunit.client.1.smithi156.stdout:5/498: dread - d1/d3/d20/d3e/f73 zero size 2024-04-23T14:49:55.682 INFO:tasks.workunit.client.1.smithi156.stdout:3/410: dwrite d4/db/dd/d1d/d1e/d13/f1a [0,4194304] 0 2024-04-23T14:49:55.682 INFO:tasks.workunit.client.1.smithi156.stdout:3/411: chown d4/db/dd/d1d/d1e/l6e 44 1 2024-04-23T14:49:55.683 INFO:tasks.workunit.client.0.smithi081.stdout:5/846: creat d17/d1f/d42/dbb/f128 x:0 0 0 2024-04-23T14:49:55.686 INFO:tasks.workunit.client.1.smithi156.stdout:2/432: sync 2024-04-23T14:49:55.686 INFO:tasks.workunit.client.1.smithi156.stdout:9/360: sync 2024-04-23T14:49:55.687 INFO:tasks.workunit.client.1.smithi156.stdout:3/412: creat d4/db/dd/d1d/d1e/d13/f79 x:0 0 0 2024-04-23T14:49:55.687 INFO:tasks.workunit.client.1.smithi156.stdout:3/413: write d4/db/dd/d1d/d1e/d13/f79 [1014426,88831] 0 2024-04-23T14:49:55.700 INFO:tasks.workunit.client.0.smithi081.stdout:5/847: rename d17/d18/d3a/d8e/cdf to d17/d4f/d61/dba/c129 0 2024-04-23T14:49:55.700 INFO:tasks.workunit.client.1.smithi156.stdout:8/437: dwrite d5/d9/d5a/d5c/d6b/f7b [0,4194304] 0 2024-04-23T14:49:55.701 INFO:tasks.workunit.client.0.smithi081.stdout:8/956: sync 2024-04-23T14:49:55.701 INFO:tasks.workunit.client.0.smithi081.stdout:6/771: sync 2024-04-23T14:49:55.701 INFO:tasks.workunit.client.0.smithi081.stdout:8/957: chown d3/dc6/l104 1714 1 2024-04-23T14:49:55.701 INFO:tasks.workunit.client.0.smithi081.stdout:8/958: read - d3/fba zero size 2024-04-23T14:49:55.701 INFO:tasks.workunit.client.0.smithi081.stdout:2/752: sync 2024-04-23T14:49:55.702 INFO:tasks.workunit.client.0.smithi081.stdout:3/678: sync 2024-04-23T14:49:55.702 INFO:tasks.workunit.client.0.smithi081.stdout:1/864: sync 2024-04-23T14:49:55.702 INFO:tasks.workunit.client.0.smithi081.stdout:9/735: sync 2024-04-23T14:49:55.702 INFO:tasks.workunit.client.0.smithi081.stdout:0/849: sync 2024-04-23T14:49:55.704 INFO:tasks.workunit.client.1.smithi156.stdout:9/361: creat d1/d2/d3e/d50/d7a/d40/d35/f7d x:0 0 0 2024-04-23T14:49:55.704 INFO:tasks.workunit.client.1.smithi156.stdout:9/362: chown d1/d2/d3e/d55/d66 2 1 2024-04-23T14:49:55.706 INFO:tasks.workunit.client.1.smithi156.stdout:7/476: read dc/d1d/d41/f51 [518006,124286] 0 2024-04-23T14:49:55.707 INFO:tasks.workunit.client.1.smithi156.stdout:3/414: rename d4/l35 to d4/db/dd/d1d/d1e/d42/d76/l7a 0 2024-04-23T14:49:55.707 INFO:tasks.workunit.client.1.smithi156.stdout:3/415: chown d4/db/dd/d1d/d1e/ff 481 1 2024-04-23T14:49:55.707 INFO:tasks.workunit.client.1.smithi156.stdout:3/416: chown d4/db/dd/d1d/d1e/d42/d76/l7a 983 1 2024-04-23T14:49:55.707 INFO:tasks.workunit.client.1.smithi156.stdout:7/477: fsync dc/d1d/d41/f43 0 2024-04-23T14:49:55.707 INFO:tasks.workunit.client.1.smithi156.stdout:3/417: fdatasync d4/db/dd/d1d/d61/f62 0 2024-04-23T14:49:55.708 INFO:tasks.workunit.client.0.smithi081.stdout:6/772: creat d1/d51/d65/d1c/f110 x:0 0 0 2024-04-23T14:49:55.708 INFO:tasks.workunit.client.1.smithi156.stdout:0/442: dwrite d0/d16/d3a/d2a/f12 [0,4194304] 0 2024-04-23T14:49:55.709 INFO:tasks.workunit.client.0.smithi081.stdout:5/848: dread d17/d3d/d41/f66 [0,4194304] 0 2024-04-23T14:49:55.709 INFO:tasks.workunit.client.0.smithi081.stdout:5/849: dread - d17/d18/d3a/fd4 zero size 2024-04-23T14:49:55.713 INFO:tasks.workunit.client.0.smithi081.stdout:8/959: symlink d3/d3c/ddb/l13b 0 2024-04-23T14:49:55.716 INFO:tasks.workunit.client.0.smithi081.stdout:3/679: unlink d4/d7/d32/lbd 0 2024-04-23T14:49:55.720 INFO:tasks.workunit.client.1.smithi156.stdout:9/363: unlink d1/d2/d3e/d50/d7a/d40/f73 0 2024-04-23T14:49:55.723 INFO:tasks.workunit.client.0.smithi081.stdout:2/753: link d1/d11/d21/d52/d8b/d8f/de8/cf6 d1/d11/d21/d52/d8b/d8f/d93/c101 0 2024-04-23T14:49:55.727 INFO:tasks.workunit.client.0.smithi081.stdout:9/736: symlink d3/led 0 2024-04-23T14:49:55.727 INFO:tasks.workunit.client.0.smithi081.stdout:6/773: read d1/d2/d49/fb7 [321802,83588] 0 2024-04-23T14:49:55.727 INFO:tasks.workunit.client.0.smithi081.stdout:9/737: write d3/de/d14/d5e/d72/fe7 [1430700,16110] 0 2024-04-23T14:49:55.729 INFO:tasks.workunit.client.0.smithi081.stdout:1/865: truncate d3/d3d/d41/d5e/d5d/db0/d70/f84 8041 0 2024-04-23T14:49:55.732 INFO:tasks.workunit.client.0.smithi081.stdout:0/850: chown d6/d37/l7b 110349 1 2024-04-23T14:49:55.735 INFO:tasks.workunit.client.0.smithi081.stdout:4/724: sync 2024-04-23T14:49:55.737 INFO:tasks.workunit.client.1.smithi156.stdout:0/443: unlink d0/d4/ff 0 2024-04-23T14:49:55.746 INFO:tasks.workunit.client.0.smithi081.stdout:8/960: truncate d3/d11/d4f/fee 758678 0 2024-04-23T14:49:55.746 INFO:tasks.workunit.client.0.smithi081.stdout:8/961: creat d3/d11/d3e/d63/d132/f13c x:0 0 0 2024-04-23T14:49:55.750 INFO:tasks.workunit.client.0.smithi081.stdout:3/680: rename d4/d7/c40 to d4/d41/cd9 0 2024-04-23T14:49:55.752 INFO:tasks.workunit.client.0.smithi081.stdout:2/754: creat d1/d11/d21/d52/d8b/d8f/dee/f102 x:0 0 0 2024-04-23T14:49:55.752 INFO:tasks.workunit.client.0.smithi081.stdout:9/738: creat d3/d1a/d6c/fee x:0 0 0 2024-04-23T14:49:55.752 INFO:tasks.workunit.client.0.smithi081.stdout:1/866: link d3/d3d/d41/d5e/d12/d1a/fb1 d3/d3d/d41/d5e/f11b 0 2024-04-23T14:49:55.752 INFO:tasks.workunit.client.0.smithi081.stdout:1/867: creat d3/d3d/d41/d5e/d9d/f11c x:0 0 0 2024-04-23T14:49:55.752 INFO:tasks.workunit.client.0.smithi081.stdout:1/868: chown d3/d3d/d10d/c118 6 1 2024-04-23T14:49:55.752 INFO:tasks.workunit.client.0.smithi081.stdout:1/869: dread - d3/d3d/d41/d5e/d5d/f10c zero size 2024-04-23T14:49:55.757 INFO:tasks.workunit.client.1.smithi156.stdout:9/364: mknod d1/d2/d3e/d50/c7e 0 2024-04-23T14:49:55.759 INFO:tasks.workunit.client.1.smithi156.stdout:4/366: dwrite d0/df/f14 [0,4194304] 0 2024-04-23T14:49:55.762 INFO:tasks.workunit.client.0.smithi081.stdout:0/851: write d6/d11/d14/d41/d5b/d3f/d44/fd8 [3509619,118982] 0 2024-04-23T14:49:55.767 INFO:tasks.workunit.client.0.smithi081.stdout:8/962: creat d3/d3c/ddb/df3/f13d x:0 0 0 2024-04-23T14:49:55.767 INFO:tasks.workunit.client.0.smithi081.stdout:8/963: read - d3/d11/d48/d7e/f106 zero size 2024-04-23T14:49:55.770 INFO:tasks.workunit.client.1.smithi156.stdout:7/478: rmdir dc/d1d/d24 39 2024-04-23T14:49:55.770 INFO:tasks.workunit.client.1.smithi156.stdout:7/479: creat dc/d2c/d68/f8e x:0 0 0 2024-04-23T14:49:55.774 INFO:tasks.workunit.client.1.smithi156.stdout:9/365: creat d1/d2/d3e/d50/d7a/d17/d1f/f7f x:0 0 0 2024-04-23T14:49:55.774 INFO:tasks.workunit.client.1.smithi156.stdout:9/366: write d1/d2/d3e/d50/f7c [553556,1782] 0 2024-04-23T14:49:55.774 INFO:tasks.workunit.client.0.smithi081.stdout:5/850: dwrite d17/d3d/d7a/ff6 [0,4194304] 0 2024-04-23T14:49:55.776 INFO:tasks.workunit.client.1.smithi156.stdout:8/438: dwrite d5/d9/f32 [0,4194304] 0 2024-04-23T14:49:55.776 INFO:tasks.workunit.client.1.smithi156.stdout:8/439: chown d5/d9/d5a/d57/l78 10286763 1 2024-04-23T14:49:55.776 INFO:tasks.workunit.client.1.smithi156.stdout:8/440: dread - d5/d39/f63 zero size 2024-04-23T14:49:55.776 INFO:tasks.workunit.client.1.smithi156.stdout:8/441: dread - d5/d9/d10/f88 zero size 2024-04-23T14:49:55.776 INFO:tasks.workunit.client.1.smithi156.stdout:8/442: fdatasync d5/d9/d5a/d5c/f85 0 2024-04-23T14:49:55.778 INFO:tasks.workunit.client.0.smithi081.stdout:1/870: mkdir d3/d3d/d90/d11d 0 2024-04-23T14:49:55.778 INFO:tasks.workunit.client.0.smithi081.stdout:1/871: fsync d3/d3d/f32 0 2024-04-23T14:49:55.781 INFO:tasks.workunit.client.0.smithi081.stdout:0/852: symlink d6/d11/d14/d41/d5b/d3f/d44/d78/d84/l108 0 2024-04-23T14:49:55.783 INFO:tasks.workunit.client.1.smithi156.stdout:4/367: write d0/d30/f3f [8306361,90776] 0 2024-04-23T14:49:55.783 INFO:tasks.workunit.client.1.smithi156.stdout:4/368: chown d0/f3 62467 1 2024-04-23T14:49:55.787 INFO:tasks.workunit.client.0.smithi081.stdout:9/739: rename d3/de/d1d/d5b/d7b/l8b to d3/de/d1d/lef 0 2024-04-23T14:49:55.787 INFO:tasks.workunit.client.0.smithi081.stdout:9/740: read - d3/de/d47/fa4 zero size 2024-04-23T14:49:55.788 INFO:tasks.workunit.client.1.smithi156.stdout:7/480: symlink dc/d1d/d24/l8f 0 2024-04-23T14:49:55.788 INFO:tasks.workunit.client.1.smithi156.stdout:7/481: chown dc/d1d/d41/d53/d6c 115244793 1 2024-04-23T14:49:55.788 INFO:tasks.workunit.client.1.smithi156.stdout:7/482: dread - dc/d46/d58/f65 zero size 2024-04-23T14:49:55.788 INFO:tasks.workunit.client.1.smithi156.stdout:9/367: getdents d1/d2/d23/d2d 0 2024-04-23T14:49:55.789 INFO:tasks.workunit.client.0.smithi081.stdout:5/851: mknod d17/d18/d3a/d8e/c12a 0 2024-04-23T14:49:55.789 INFO:tasks.workunit.client.0.smithi081.stdout:1/872: creat d3/d3d/d41/d5e/da0/f11e x:0 0 0 2024-04-23T14:49:55.791 INFO:tasks.workunit.client.0.smithi081.stdout:0/853: rename d6/d11/d14/d41/d5b/d3f/d44/d78/d83/c87 to d6/d11/d14/d24/db3/dfb/c109 0 2024-04-23T14:49:55.792 INFO:tasks.workunit.client.0.smithi081.stdout:0/854: chown d6/d11/d14/d41/d5b/d59/d68/d105 15224215 1 2024-04-23T14:49:55.792 INFO:tasks.workunit.client.0.smithi081.stdout:0/855: write d6/d11/db0/fbe [2097788,51517] 0 2024-04-23T14:49:55.793 INFO:tasks.workunit.client.1.smithi156.stdout:9/368: mkdir d1/d2/d3e/d80 0 2024-04-23T14:49:55.793 INFO:tasks.workunit.client.1.smithi156.stdout:9/369: stat d1/d2/d3e/d50/d7a/d17/d1f/d48/d4e/f6e 0 2024-04-23T14:49:55.793 INFO:tasks.workunit.client.1.smithi156.stdout:9/370: read - d1/d2/d3e/d50/d7a/d17/d1f/f7f zero size 2024-04-23T14:49:55.795 INFO:tasks.workunit.client.0.smithi081.stdout:0/856: symlink d6/d11/d14/d41/l10a 0 2024-04-23T14:49:55.797 INFO:tasks.workunit.client.1.smithi156.stdout:9/371: creat d1/f81 x:0 0 0 2024-04-23T14:49:55.800 INFO:tasks.workunit.client.1.smithi156.stdout:9/372: creat d1/d2/d3e/d50/d7a/d17/f82 x:0 0 0 2024-04-23T14:49:55.801 INFO:tasks.workunit.client.1.smithi156.stdout:9/373: dread - d1/d2/d3e/d50/d7a/d40/d35/f7d zero size 2024-04-23T14:49:55.804 INFO:tasks.workunit.client.1.smithi156.stdout:9/374: unlink d1/d2/d3e/d50/d7a/d19/f70 0 2024-04-23T14:49:55.805 INFO:tasks.workunit.client.1.smithi156.stdout:3/418: dwrite d4/db/f2f [4194304,4194304] 0 2024-04-23T14:49:55.809 INFO:tasks.workunit.client.1.smithi156.stdout:4/369: write d0/d8/f2f [3119684,23772] 0 2024-04-23T14:49:55.809 INFO:tasks.workunit.client.1.smithi156.stdout:4/370: dread - d0/df/f71 zero size 2024-04-23T14:49:55.810 INFO:tasks.workunit.client.0.smithi081.stdout:3/681: dwrite d4/dc/d50/d9a/fa5 [0,4194304] 0 2024-04-23T14:49:55.810 INFO:tasks.workunit.client.0.smithi081.stdout:3/682: fdatasync d4/d41/f67 0 2024-04-23T14:49:55.812 INFO:tasks.workunit.client.1.smithi156.stdout:3/419: mknod d4/db/c7b 0 2024-04-23T14:49:55.812 INFO:tasks.workunit.client.1.smithi156.stdout:3/420: readlink d4/l3d 0 2024-04-23T14:49:55.813 INFO:tasks.workunit.client.1.smithi156.stdout:3/421: truncate d4/db/dd/f50 679649 0 2024-04-23T14:49:55.813 INFO:tasks.workunit.client.0.smithi081.stdout:9/741: dread d3/d1a/f63 [0,4194304] 0 2024-04-23T14:49:55.813 INFO:tasks.workunit.client.0.smithi081.stdout:9/742: chown d3/de/d22/l4d 63000 1 2024-04-23T14:49:55.813 INFO:tasks.workunit.client.1.smithi156.stdout:4/371: rmdir d0/d76 39 2024-04-23T14:49:55.813 INFO:tasks.workunit.client.1.smithi156.stdout:4/372: stat d0/df/f6b 0 2024-04-23T14:49:55.818 INFO:tasks.workunit.client.0.smithi081.stdout:3/683: rename d4/d7/df/f5e to d4/d7/d7f/d85/d9d/dac/dc7/fda 0 2024-04-23T14:49:55.818 INFO:tasks.workunit.client.0.smithi081.stdout:3/684: write d4/d7/df/f72 [2478445,24669] 0 2024-04-23T14:49:55.818 INFO:tasks.workunit.client.0.smithi081.stdout:3/685: fsync d4/d7/d1a/d71/f76 0 2024-04-23T14:49:55.818 INFO:tasks.workunit.client.0.smithi081.stdout:6/774: dwrite d1/d51/d65/d1c/d6e/f79 [0,4194304] 0 2024-04-23T14:49:55.818 INFO:tasks.workunit.client.0.smithi081.stdout:6/775: read - d1/d51/d65/d13/d16/dd0/ff8 zero size 2024-04-23T14:49:55.818 INFO:tasks.workunit.client.0.smithi081.stdout:6/776: truncate d1/d2/f21 2275478 0 2024-04-23T14:49:55.824 INFO:tasks.workunit.client.1.smithi156.stdout:3/422: creat d4/db/dd/d1d/d1e/d42/d76/f7c x:0 0 0 2024-04-23T14:49:55.824 INFO:tasks.workunit.client.1.smithi156.stdout:4/373: creat d0/df/d55/d68/d53/f79 x:0 0 0 2024-04-23T14:49:55.824 INFO:tasks.workunit.client.1.smithi156.stdout:8/443: dread d5/d9/d10/f33 [0,4194304] 0 2024-04-23T14:49:55.825 INFO:tasks.workunit.client.1.smithi156.stdout:1/503: sync 2024-04-23T14:49:55.825 INFO:tasks.workunit.client.1.smithi156.stdout:1/504: stat db/d25/d30/f43 0 2024-04-23T14:49:55.825 INFO:tasks.workunit.client.1.smithi156.stdout:1/505: fsync db/d25/d30/f78 0 2024-04-23T14:49:55.825 INFO:tasks.workunit.client.1.smithi156.stdout:1/506: fdatasync db/d25/f3b 0 2024-04-23T14:49:55.825 INFO:tasks.workunit.client.1.smithi156.stdout:1/507: dread - db/d25/d30/f59 zero size 2024-04-23T14:49:55.828 INFO:tasks.workunit.client.1.smithi156.stdout:4/374: getdents d0/d30 0 2024-04-23T14:49:55.828 INFO:tasks.workunit.client.1.smithi156.stdout:4/375: write d0/df/f25 [3099234,62918] 0 2024-04-23T14:49:55.838 INFO:tasks.workunit.client.0.smithi081.stdout:0/857: dread d6/d11/d14/d24/fcf [0,4194304] 0 2024-04-23T14:49:55.838 INFO:tasks.workunit.client.1.smithi156.stdout:3/423: rename d4/db/dd/f25 to d4/db/dd/d20/d57/f7d 0 2024-04-23T14:49:55.838 INFO:tasks.workunit.client.1.smithi156.stdout:3/424: chown d4/db/dd/d1d/d1e/d13/f4c 122082058 1 2024-04-23T14:49:55.838 INFO:tasks.workunit.client.0.smithi081.stdout:9/743: dread d3/de/d1d/d54/f6a [0,4194304] 0 2024-04-23T14:49:55.840 INFO:tasks.workunit.client.1.smithi156.stdout:6/505: sync 2024-04-23T14:49:55.841 INFO:tasks.workunit.client.0.smithi081.stdout:2/755: dwrite d1/d1e/dad/fed [0,4194304] 0 2024-04-23T14:49:55.841 INFO:tasks.workunit.client.0.smithi081.stdout:4/725: dwrite d1/d1d/d59/f5a [0,4194304] 0 2024-04-23T14:49:55.841 INFO:tasks.workunit.client.0.smithi081.stdout:6/777: rename d1/d51/d65/d8/d2e/d59/d80/db8/cda to d1/d51/d65/d8/d2e/d59/db3/c111 0 2024-04-23T14:49:55.845 INFO:tasks.workunit.client.1.smithi156.stdout:8/444: mkdir d5/d39/d6d/d93/d96 0 2024-04-23T14:49:55.850 INFO:tasks.workunit.client.0.smithi081.stdout:1/873: dwrite d3/d3d/d41/d5e/d17/d58/fcb [0,4194304] 0 2024-04-23T14:49:55.850 INFO:tasks.workunit.client.0.smithi081.stdout:1/874: write d3/d3d/d41/d5e/d5d/db0/f46 [2505492,123020] 0 2024-04-23T14:49:55.851 INFO:tasks.workunit.client.1.smithi156.stdout:1/508: creat db/d1f/d2f/d47/d71/fa4 x:0 0 0 2024-04-23T14:49:55.851 INFO:tasks.workunit.client.1.smithi156.stdout:1/509: truncate db/d1f/f7a 557395 0 2024-04-23T14:49:55.853 INFO:tasks.workunit.client.1.smithi156.stdout:5/499: dwrite d1/d3/d64/f69 [0,4194304] 0 2024-04-23T14:49:55.854 INFO:tasks.workunit.client.1.smithi156.stdout:2/433: dwrite d4/d13/d19/d58/f63 [0,4194304] 0 2024-04-23T14:49:55.857 INFO:tasks.workunit.client.1.smithi156.stdout:4/376: truncate d0/df/d21/f33 3254811 0 2024-04-23T14:49:55.862 INFO:tasks.workunit.client.1.smithi156.stdout:6/506: rename d3/da/d1d/f61 to d3/da/d1d/d59/d9c/fbd 0 2024-04-23T14:49:55.866 INFO:tasks.workunit.client.0.smithi081.stdout:6/778: dread d1/d51/d65/d8/db1/fe2 [0,4194304] 0 2024-04-23T14:49:55.866 INFO:tasks.workunit.client.1.smithi156.stdout:8/445: mkdir d5/d9/d36/d60/d62/d97 0 2024-04-23T14:49:55.868 INFO:tasks.workunit.client.0.smithi081.stdout:3/686: dwrite d4/d7/d7f/d85/d9d/f74 [0,4194304] 0 2024-04-23T14:49:55.868 INFO:tasks.workunit.client.1.smithi156.stdout:1/510: creat db/fa5 x:0 0 0 2024-04-23T14:49:55.878 INFO:tasks.workunit.client.0.smithi081.stdout:4/726: link d1/d1d/c54 d1/d4f/dc3/cef 0 2024-04-23T14:49:55.879 INFO:tasks.workunit.client.1.smithi156.stdout:9/375: dwrite d1/d2/d3e/d50/d7a/d19/f26 [4194304,4194304] 0 2024-04-23T14:49:55.881 INFO:tasks.workunit.client.1.smithi156.stdout:2/434: link d4/d26/d3c/l80 d4/d13/d88/l9a 0 2024-04-23T14:49:55.881 INFO:tasks.workunit.client.1.smithi156.stdout:2/435: write d4/f16 [4129002,110741] 0 2024-04-23T14:49:55.881 INFO:tasks.workunit.client.1.smithi156.stdout:2/436: dread - d4/d21/d42/f89 zero size 2024-04-23T14:49:55.883 INFO:tasks.workunit.client.1.smithi156.stdout:5/500: write d1/d3/f5 [10948454,63660] 0 2024-04-23T14:49:55.883 INFO:tasks.workunit.client.1.smithi156.stdout:3/425: dwrite d4/db/dd/d1d/d1e/d13/f1f [0,4194304] 0 2024-04-23T14:49:55.883 INFO:tasks.workunit.client.1.smithi156.stdout:3/426: readlink d4/db/dd/l6b 0 2024-04-23T14:49:55.883 INFO:tasks.workunit.client.1.smithi156.stdout:5/501: write d1/d3/d20/d3e/f46 [438753,31939] 0 2024-04-23T14:49:55.884 INFO:tasks.workunit.client.1.smithi156.stdout:4/377: mknod d0/d8/c7a 0 2024-04-23T14:49:55.884 INFO:tasks.workunit.client.1.smithi156.stdout:4/378: write d0/d8/d1e/f47 [1474385,74247] 0 2024-04-23T14:49:55.884 INFO:tasks.workunit.client.1.smithi156.stdout:4/379: write d0/df/f71 [264818,125492] 0 2024-04-23T14:49:55.884 INFO:tasks.workunit.client.1.smithi156.stdout:4/380: write d0/df/f64 [4340294,46698] 0 2024-04-23T14:49:55.885 INFO:tasks.workunit.client.1.smithi156.stdout:4/381: chown d0/l31 1 1 2024-04-23T14:49:55.887 INFO:tasks.workunit.client.0.smithi081.stdout:1/875: creat d3/d3d/d41/d5e/d17/d26/f11f x:0 0 0 2024-04-23T14:49:55.888 INFO:tasks.workunit.client.0.smithi081.stdout:0/858: mknod d6/d25/c10b 0 2024-04-23T14:49:55.891 INFO:tasks.workunit.client.1.smithi156.stdout:4/382: dread d0/df/d55/d68/f6f [0,4194304] 0 2024-04-23T14:49:55.892 INFO:tasks.workunit.client.0.smithi081.stdout:6/779: getdents d1/d51/d65/d13/d16/dd0/df7/da1/dc1/dc9/dcf 0 2024-04-23T14:49:55.893 INFO:tasks.workunit.client.0.smithi081.stdout:3/687: truncate d4/f17 856636 0 2024-04-23T14:49:55.896 INFO:tasks.workunit.client.0.smithi081.stdout:4/727: rmdir d1/d8b/dbc/dc8 0 2024-04-23T14:49:55.899 INFO:tasks.workunit.client.0.smithi081.stdout:1/876: creat d3/d3d/d41/d5e/f120 x:0 0 0 2024-04-23T14:49:55.900 INFO:tasks.workunit.client.0.smithi081.stdout:0/859: mknod d6/d69/c10c 0 2024-04-23T14:49:55.900 INFO:tasks.workunit.client.0.smithi081.stdout:0/860: write d6/d11/d14/d41/d5b/d59/d68/dbd/fea [4276788,50111] 0 2024-04-23T14:49:55.902 INFO:tasks.workunit.client.0.smithi081.stdout:6/780: stat d1/d51/d7b/d91/cfc 0 2024-04-23T14:49:55.902 INFO:tasks.workunit.client.0.smithi081.stdout:6/781: truncate d1/d51/d54/f8c 82700 0 2024-04-23T14:49:55.902 INFO:tasks.workunit.client.0.smithi081.stdout:6/782: write d1/d51/d65/d13/d16/dd0/df7/fc3 [2350786,117031] 0 2024-04-23T14:49:55.902 INFO:tasks.workunit.client.0.smithi081.stdout:9/744: dwrite d3/de/d22/f5d [0,4194304] 0 2024-04-23T14:49:55.903 INFO:tasks.workunit.client.1.smithi156.stdout:6/507: creat d3/d16/d46/d9d/fbe x:0 0 0 2024-04-23T14:49:55.904 INFO:tasks.workunit.client.1.smithi156.stdout:6/508: truncate d3/da/d1d/d27/f58 868810 0 2024-04-23T14:49:55.904 INFO:tasks.workunit.client.1.smithi156.stdout:8/446: mkdir d5/d39/d6d/d8b/d98 0 2024-04-23T14:49:55.905 INFO:tasks.workunit.client.1.smithi156.stdout:6/509: read d3/d16/d1e/f7d [438889,13068] 0 2024-04-23T14:49:55.905 INFO:tasks.workunit.client.1.smithi156.stdout:6/510: fsync d3/da/d1d/d59/f7e 0 2024-04-23T14:49:55.906 INFO:tasks.workunit.client.1.smithi156.stdout:1/511: truncate db/d25/d30/d38/f9f 3461888 0 2024-04-23T14:49:55.910 INFO:tasks.workunit.client.0.smithi081.stdout:3/688: rmdir d4/d7/d7f/d85/d9d/dac/dc7/dcd 0 2024-04-23T14:49:55.910 INFO:tasks.workunit.client.0.smithi081.stdout:3/689: chown d4/d7/d7f/d91/c77 5509357 1 2024-04-23T14:49:55.910 INFO:tasks.workunit.client.0.smithi081.stdout:3/690: write d4/d7/df/d30/fbb [431788,106371] 0 2024-04-23T14:49:55.910 INFO:tasks.workunit.client.0.smithi081.stdout:3/691: truncate d4/d7/d1a/fbe 661411 0 2024-04-23T14:49:55.917 INFO:tasks.workunit.client.1.smithi156.stdout:9/376: symlink d1/d2/d3e/d50/d7a/d19/l83 0 2024-04-23T14:49:55.919 INFO:tasks.workunit.client.0.smithi081.stdout:4/728: unlink d1/fbb 0 2024-04-23T14:49:55.920 INFO:tasks.workunit.client.1.smithi156.stdout:6/511: dread d3/da/d1d/d27/d80/f9a [0,4194304] 0 2024-04-23T14:49:55.920 INFO:tasks.workunit.client.1.smithi156.stdout:6/512: fsync d3/da/d1d/d27/d80/da5/faa 0 2024-04-23T14:49:55.920 INFO:tasks.workunit.client.1.smithi156.stdout:6/513: chown d3/cf 40 1 2024-04-23T14:49:55.920 INFO:tasks.workunit.client.1.smithi156.stdout:6/514: stat d3/da/d1d/d59/f7e 0 2024-04-23T14:49:55.922 INFO:tasks.workunit.client.0.smithi081.stdout:1/877: symlink d3/d3d/d41/d5e/d1d/l121 0 2024-04-23T14:49:55.922 INFO:tasks.workunit.client.0.smithi081.stdout:1/878: write d3/d3d/d41/d5e/d12/d1a/ff8 [920498,35668] 0 2024-04-23T14:49:55.923 INFO:tasks.workunit.client.0.smithi081.stdout:6/783: dread d1/d51/d65/fbf [4194304,4194304] 0 2024-04-23T14:49:55.923 INFO:tasks.workunit.client.0.smithi081.stdout:6/784: getdents d1/d51/d65/d8/d2e 0 2024-04-23T14:49:55.925 INFO:tasks.workunit.client.0.smithi081.stdout:0/861: mkdir d6/d37/d4d/d10d 0 2024-04-23T14:49:55.926 INFO:tasks.workunit.client.0.smithi081.stdout:3/692: dread d4/d7/d32/f33 [0,4194304] 0 2024-04-23T14:49:55.926 INFO:tasks.workunit.client.0.smithi081.stdout:3/693: chown d4/dc/d50/d9a/cd5 13 1 2024-04-23T14:49:55.929 INFO:tasks.workunit.client.0.smithi081.stdout:9/745: creat d3/de/d1d/d5b/d7b/ff0 x:0 0 0 2024-04-23T14:49:55.933 INFO:tasks.workunit.client.1.smithi156.stdout:3/427: unlink d4/db/dd/d20/f23 0 2024-04-23T14:49:55.933 INFO:tasks.workunit.client.1.smithi156.stdout:3/428: fdatasync d4/db/dd/f66 0 2024-04-23T14:49:55.934 INFO:tasks.workunit.client.1.smithi156.stdout:6/515: dread d3/fd [0,4194304] 0 2024-04-23T14:49:55.934 INFO:tasks.workunit.client.1.smithi156.stdout:5/502: rename d1/d3/d20 to d1/d3/d24/da0 0 2024-04-23T14:49:55.934 INFO:tasks.workunit.client.1.smithi156.stdout:5/503: chown d1/d11/l1c 108285 1 2024-04-23T14:49:55.934 INFO:tasks.workunit.client.1.smithi156.stdout:5/504: creat d1/d11/d27/fa1 x:0 0 0 2024-04-23T14:49:55.934 INFO:tasks.workunit.client.1.smithi156.stdout:5/505: write d1/f38 [1010180,118943] 0 2024-04-23T14:49:55.936 INFO:tasks.workunit.client.0.smithi081.stdout:1/879: creat d3/d3d/d41/d4a/d77/ddc/f122 x:0 0 0 2024-04-23T14:49:55.938 INFO:tasks.workunit.client.1.smithi156.stdout:4/383: creat d0/d8/d1e/d4a/f7b x:0 0 0 2024-04-23T14:49:55.939 INFO:tasks.workunit.client.1.smithi156.stdout:0/444: sync 2024-04-23T14:49:55.940 INFO:tasks.workunit.client.0.smithi081.stdout:6/785: creat d1/d51/f112 x:0 0 0 2024-04-23T14:49:55.945 INFO:tasks.workunit.client.0.smithi081.stdout:9/746: mknod d3/de/d47/cf1 0 2024-04-23T14:49:55.946 INFO:tasks.workunit.client.0.smithi081.stdout:9/747: dread - d3/de/d14/dab/fda zero size 2024-04-23T14:49:55.946 INFO:tasks.workunit.client.0.smithi081.stdout:9/748: stat d3/de/d14/d5e/d72/ld7 0 2024-04-23T14:49:55.946 INFO:tasks.workunit.client.0.smithi081.stdout:0/862: dread d6/d37/d4d/f55 [0,4194304] 0 2024-04-23T14:49:55.946 INFO:tasks.workunit.client.0.smithi081.stdout:0/863: dread - d6/d11/d14/d41/d5b/d3f/ded/fe6 zero size 2024-04-23T14:49:55.946 INFO:tasks.workunit.client.0.smithi081.stdout:0/864: stat d6/d11/d14/d41/d5b/d3f/f4a 0 2024-04-23T14:49:55.950 INFO:tasks.workunit.client.0.smithi081.stdout:4/729: rmdir d1/d8f 39 2024-04-23T14:49:55.950 INFO:tasks.workunit.client.0.smithi081.stdout:4/730: truncate d1/d4/dc/f83 1240661 0 2024-04-23T14:49:55.950 INFO:tasks.workunit.client.0.smithi081.stdout:4/731: chown d1/d1d/f3e 0 1 2024-04-23T14:49:55.953 INFO:tasks.workunit.client.1.smithi156.stdout:9/377: unlink d1/d2/d3e/d50/d7a/f5c 0 2024-04-23T14:49:55.956 INFO:tasks.workunit.client.0.smithi081.stdout:1/880: symlink d3/d3d/d41/d5e/da0/l123 0 2024-04-23T14:49:55.957 INFO:tasks.workunit.client.1.smithi156.stdout:2/437: creat d4/d21/d76/f9b x:0 0 0 2024-04-23T14:49:55.960 INFO:tasks.workunit.client.0.smithi081.stdout:6/786: symlink d1/d51/d65/d1c/l113 0 2024-04-23T14:49:55.969 INFO:tasks.workunit.client.1.smithi156.stdout:7/483: sync 2024-04-23T14:49:55.970 INFO:tasks.workunit.client.1.smithi156.stdout:6/516: stat d3/da/c22 0 2024-04-23T14:49:55.970 INFO:tasks.workunit.client.1.smithi156.stdout:5/506: rename d1/d3/d24/da0/d3e/l71 to d1/d3/la2 0 2024-04-23T14:49:55.970 INFO:tasks.workunit.client.1.smithi156.stdout:5/507: write d1/d11/d18/d19/d74/f9d [577651,101275] 0 2024-04-23T14:49:55.970 INFO:tasks.workunit.client.1.smithi156.stdout:5/508: write d1/d3/f49 [1628207,6103] 0 2024-04-23T14:49:55.970 INFO:tasks.workunit.client.1.smithi156.stdout:6/517: fdatasync d3/da/d1d/d59/d9c/fbd 0 2024-04-23T14:49:55.970 INFO:tasks.workunit.client.1.smithi156.stdout:6/518: read - d3/da/d1d/d27/f98 zero size 2024-04-23T14:49:55.971 INFO:tasks.workunit.client.0.smithi081.stdout:4/732: write d1/f12 [1949422,52145] 0 2024-04-23T14:49:55.973 INFO:tasks.workunit.client.1.smithi156.stdout:9/378: symlink d1/d2/d3e/d50/d7a/d17/d1f/l84 0 2024-04-23T14:49:55.973 INFO:tasks.workunit.client.1.smithi156.stdout:2/438: link d4/lb d4/d13/d19/d4c/l9c 0 2024-04-23T14:49:55.975 INFO:tasks.workunit.client.0.smithi081.stdout:4/733: creat d1/d1d/d39/d8d/de3/ff0 x:0 0 0 2024-04-23T14:49:55.975 INFO:tasks.workunit.client.0.smithi081.stdout:4/734: chown d1/d1d/d39/f3b 109 1 2024-04-23T14:49:55.976 INFO:tasks.workunit.client.0.smithi081.stdout:4/735: truncate d1/d4/d11/d9d/fb5 748224 0 2024-04-23T14:49:55.976 INFO:tasks.workunit.client.0.smithi081.stdout:0/865: dread d6/d11/d14/d41/d5b/d59/d8e/f93 [0,4194304] 0 2024-04-23T14:49:55.976 INFO:tasks.workunit.client.0.smithi081.stdout:0/866: dread - d6/d11/d14/d41/d5b/d3f/d44/d78/d83/fd2 zero size 2024-04-23T14:49:55.977 INFO:tasks.workunit.client.1.smithi156.stdout:7/484: symlink dc/d2c/d68/l90 0 2024-04-23T14:49:55.977 INFO:tasks.workunit.client.1.smithi156.stdout:7/485: chown dc/d1d/f78 476 1 2024-04-23T14:49:55.979 INFO:tasks.workunit.client.0.smithi081.stdout:4/736: write d1/d4/d11/d9d/dac/fa4 [326561,90154] 0 2024-04-23T14:49:55.979 INFO:tasks.workunit.client.0.smithi081.stdout:4/737: creat d1/d4f/dc3/ff1 x:0 0 0 2024-04-23T14:49:55.982 INFO:tasks.workunit.client.0.smithi081.stdout:0/867: getdents d6/d11/d14/d41/d5b/d3f 0 2024-04-23T14:49:55.982 INFO:tasks.workunit.client.0.smithi081.stdout:0/868: truncate d6/d11/d14/d41/d5b/d3f/d44/d76/fdb 739837 0 2024-04-23T14:49:55.989 INFO:tasks.workunit.client.0.smithi081.stdout:3/694: dwrite d4/dc/f45 [0,4194304] 0 2024-04-23T14:49:55.989 INFO:tasks.workunit.client.0.smithi081.stdout:3/695: truncate d4/d7/d49/d51/f62 728680 0 2024-04-23T14:49:55.989 INFO:tasks.workunit.client.0.smithi081.stdout:3/696: readlink l1 0 2024-04-23T14:49:55.990 INFO:tasks.workunit.client.0.smithi081.stdout:3/697: write d4/d7/df/d30/f80 [723627,39841] 0 2024-04-23T14:49:55.990 INFO:tasks.workunit.client.1.smithi156.stdout:4/384: getdents d0/df/d55 0 2024-04-23T14:49:55.990 INFO:tasks.workunit.client.1.smithi156.stdout:0/445: rename d0/d16/d3a/d2b/d44/d4a/f91 to d0/d16/d3a/d2a/f99 0 2024-04-23T14:49:55.990 INFO:tasks.workunit.client.1.smithi156.stdout:4/385: write d0/d8/f40 [1519684,73713] 0 2024-04-23T14:49:55.992 INFO:tasks.workunit.client.1.smithi156.stdout:7/486: creat dc/d2c/f91 x:0 0 0 2024-04-23T14:49:55.992 INFO:tasks.workunit.client.1.smithi156.stdout:0/446: rmdir d0 39 2024-04-23T14:49:55.992 INFO:tasks.workunit.client.1.smithi156.stdout:0/447: stat d0/d4/d11/d3f/d5f/f71 0 2024-04-23T14:49:55.992 INFO:tasks.workunit.client.1.smithi156.stdout:7/487: write dc/d46/d58/f71 [408452,125108] 0 2024-04-23T14:49:55.993 INFO:tasks.workunit.client.0.smithi081.stdout:1/881: dread d3/f47 [0,4194304] 0 2024-04-23T14:49:55.993 INFO:tasks.workunit.client.0.smithi081.stdout:1/882: chown d3/d3d/d6f/lad 0 1 2024-04-23T14:49:55.994 INFO:tasks.workunit.client.1.smithi156.stdout:7/488: chown dc/l55 27942523 1 2024-04-23T14:49:55.995 INFO:tasks.workunit.client.1.smithi156.stdout:2/439: dread - d4/d21/f67 zero size 2024-04-23T14:49:55.995 INFO:tasks.workunit.client.1.smithi156.stdout:4/386: creat d0/d8/d1e/d4a/d77/f7c x:0 0 0 2024-04-23T14:49:56.003 INFO:tasks.workunit.client.0.smithi081.stdout:1/883: creat d3/d3d/d41/d5e/d17/d58/d7f/dba/f124 x:0 0 0 2024-04-23T14:49:56.005 INFO:tasks.workunit.client.0.smithi081.stdout:4/738: dread d1/d1d/d39/f4c [0,4194304] 0 2024-04-23T14:49:56.005 INFO:tasks.workunit.client.1.smithi156.stdout:2/440: creat d4/d21/f9d x:0 0 0 2024-04-23T14:49:56.005 INFO:tasks.workunit.client.0.smithi081.stdout:4/739: write d1/d4/d11/d75/fa8 [1170915,117297] 0 2024-04-23T14:49:56.009 INFO:tasks.workunit.client.0.smithi081.stdout:9/749: dwrite d3/de/d14/f3c [4194304,4194304] 0 2024-04-23T14:49:56.009 INFO:tasks.workunit.client.0.smithi081.stdout:9/750: write d3/de/f1c [5152989,88303] 0 2024-04-23T14:49:56.009 INFO:tasks.workunit.client.1.smithi156.stdout:2/441: mknod d4/d26/d3c/c9e 0 2024-04-23T14:49:56.009 INFO:tasks.workunit.client.1.smithi156.stdout:2/442: write d4/d21/d42/f43 [635258,124410] 0 2024-04-23T14:49:56.009 INFO:tasks.workunit.client.1.smithi156.stdout:2/443: dread - d4/d21/d42/f89 zero size 2024-04-23T14:49:56.009 INFO:tasks.workunit.client.1.smithi156.stdout:2/444: chown d4/d21/d42/d75/d8e 263178555 1 2024-04-23T14:49:56.013 INFO:tasks.workunit.client.1.smithi156.stdout:5/509: dwrite d1/d3/f5 [0,4194304] 0 2024-04-23T14:49:56.014 INFO:tasks.workunit.client.1.smithi156.stdout:2/445: mkdir d4/d21/d42/d9f 0 2024-04-23T14:49:56.018 INFO:tasks.workunit.client.1.smithi156.stdout:2/446: creat d4/d13/d19/d97/fa0 x:0 0 0 2024-04-23T14:49:56.018 INFO:tasks.workunit.client.1.smithi156.stdout:2/447: chown d4/d13/l50 921578 1 2024-04-23T14:49:56.022 INFO:tasks.workunit.client.0.smithi081.stdout:9/751: truncate d3/d1a/fc 946255 0 2024-04-23T14:49:56.030 INFO:tasks.workunit.client.0.smithi081.stdout:1/884: rename d3/d3d/d41/d5e/d12 to d3/d3d/d41/d5e/d5d/d125 0 2024-04-23T14:49:56.030 INFO:tasks.workunit.client.1.smithi156.stdout:1/512: dwrite db/d1f/d2f/d47/f8f [0,4194304] 0 2024-04-23T14:49:56.034 INFO:tasks.workunit.client.1.smithi156.stdout:0/448: rename d0/d16/d3a/d2b to d0/d4/d22/d58/d9a 0 2024-04-23T14:49:56.034 INFO:tasks.workunit.client.1.smithi156.stdout:0/449: dread - d0/f89 zero size 2024-04-23T14:49:56.037 INFO:tasks.workunit.client.0.smithi081.stdout:1/885: mkdir d3/d3d/d41/d5e/dd2/dd5/d126 0 2024-04-23T14:49:56.037 INFO:tasks.workunit.client.0.smithi081.stdout:1/886: write d3/d3d/d41/d5e/d5d/fa4 [311075,113267] 0 2024-04-23T14:49:56.049 INFO:tasks.workunit.client.0.smithi081.stdout:9/752: symlink d3/de/d1d/lf2 0 2024-04-23T14:49:56.049 INFO:tasks.workunit.client.0.smithi081.stdout:0/869: write d6/d11/d14/d41/d5b/f3e [1446615,61226] 0 2024-04-23T14:49:56.050 INFO:tasks.workunit.client.0.smithi081.stdout:0/870: read d6/d37/f4e [390179,4202] 0 2024-04-23T14:49:56.056 INFO:tasks.workunit.client.0.smithi081.stdout:9/753: creat d3/d67/da5/ff3 x:0 0 0 2024-04-23T14:49:56.056 INFO:tasks.workunit.client.0.smithi081.stdout:0/871: stat d6/d11/d14/d41/d5b/d3f/d44/d78/d83/cd9 0 2024-04-23T14:49:56.058 INFO:tasks.workunit.client.1.smithi156.stdout:5/510: rename d1/d11/d18/d19/c84 to d1/d11/d18/d52/d85/ca3 0 2024-04-23T14:49:56.058 INFO:tasks.workunit.client.1.smithi156.stdout:5/511: fsync d1/d11/f5e 0 2024-04-23T14:49:56.058 INFO:tasks.workunit.client.1.smithi156.stdout:5/512: fdatasync d1/d11/f29 0 2024-04-23T14:49:56.058 INFO:tasks.workunit.client.0.smithi081.stdout:9/754: creat d3/de/ff4 x:0 0 0 2024-04-23T14:49:56.059 INFO:tasks.workunit.client.1.smithi156.stdout:0/450: write d0/d4/d22/d58/d9a/d44/f7d [3081329,66706] 0 2024-04-23T14:49:56.059 INFO:tasks.workunit.client.0.smithi081.stdout:0/872: rename d6/d37/d67/f92 to d6/d11/d14/f10e 0 2024-04-23T14:49:56.070 INFO:tasks.workunit.client.0.smithi081.stdout:4/740: dwrite d1/d1d/d59/fc4 [0,4194304] 0 2024-04-23T14:49:56.076 INFO:tasks.workunit.client.1.smithi156.stdout:9/379: dwrite d1/f51 [0,4194304] 0 2024-04-23T14:49:56.080 INFO:tasks.workunit.client.1.smithi156.stdout:7/489: dread dc/d2a/f6a [0,4194304] 0 2024-04-23T14:49:56.080 INFO:tasks.workunit.client.1.smithi156.stdout:7/490: truncate dc/d1d/d41/f3d 2432755 0 2024-04-23T14:49:56.080 INFO:tasks.workunit.client.1.smithi156.stdout:7/491: chown dc/d2c/d68/f75 15 1 2024-04-23T14:49:56.080 INFO:tasks.workunit.client.1.smithi156.stdout:6/519: dwrite d3/d16/f39 [0,4194304] 0 2024-04-23T14:49:56.080 INFO:tasks.workunit.client.1.smithi156.stdout:7/492: creat dc/d2a/f92 x:0 0 0 2024-04-23T14:49:56.087 INFO:tasks.workunit.client.0.smithi081.stdout:4/741: dread d1/d1d/d39/f4c [0,4194304] 0 2024-04-23T14:49:56.088 INFO:tasks.workunit.client.0.smithi081.stdout:4/742: dread - d1/d8b/fd1 zero size 2024-04-23T14:49:56.090 INFO:tasks.workunit.client.0.smithi081.stdout:1/887: dwrite d3/d3d/f32 [0,4194304] 0 2024-04-23T14:49:56.111 INFO:tasks.workunit.client.1.smithi156.stdout:5/513: dwrite d1/d3/d24/da0/d3e/f6c [0,4194304] 0 2024-04-23T14:49:56.111 INFO:tasks.workunit.client.1.smithi156.stdout:5/514: dread - d1/d11/d18/d52/d85/f9b zero size 2024-04-23T14:49:56.111 INFO:tasks.workunit.client.1.smithi156.stdout:5/515: readlink d1/d11/d18/d52/l94 0 2024-04-23T14:49:56.111 INFO:tasks.workunit.client.1.smithi156.stdout:2/448: dwrite d4/d13/d19/d4c/f6c [0,4194304] 0 2024-04-23T14:49:56.114 INFO:tasks.workunit.client.1.smithi156.stdout:4/387: dwrite d0/d8/fc [0,4194304] 0 2024-04-23T14:49:56.114 INFO:tasks.workunit.client.1.smithi156.stdout:4/388: write d0/df/d55/f62 [455863,49861] 0 2024-04-23T14:49:56.114 INFO:tasks.workunit.client.1.smithi156.stdout:6/520: dwrite d3/da/d1d/d27/d63/f96 [0,4194304] 0 2024-04-23T14:49:56.115 INFO:tasks.workunit.client.1.smithi156.stdout:4/389: read d0/d8/d1e/f5e [910969,113485] 0 2024-04-23T14:49:56.115 INFO:tasks.workunit.client.1.smithi156.stdout:4/390: chown d0/df/d75/l78 311 1 2024-04-23T14:49:56.126 INFO:tasks.workunit.client.1.smithi156.stdout:4/391: read d0/df/f14 [2097980,31960] 0 2024-04-23T14:49:56.126 INFO:tasks.workunit.client.1.smithi156.stdout:4/392: write d0/d76/d63/f72 [487230,77863] 0 2024-04-23T14:49:56.141 INFO:tasks.workunit.client.0.smithi081.stdout:9/755: rename d3/de/d1d/d73/f94 to d3/de/d14/d5e/ff5 0 2024-04-23T14:49:56.142 INFO:tasks.workunit.client.0.smithi081.stdout:9/756: chown d3/f9 524 1 2024-04-23T14:49:56.143 INFO:tasks.workunit.client.0.smithi081.stdout:0/873: mknod d6/d11/d14/d41/d5b/d3f/d44/d78/d84/c10f 0 2024-04-23T14:49:56.157 INFO:tasks.workunit.client.0.smithi081.stdout:4/743: creat d1/d4/d11/d9d/dac/ff2 x:0 0 0 2024-04-23T14:49:56.159 INFO:tasks.workunit.client.0.smithi081.stdout:1/888: link d3/d3d/d41/d5e/d9d/fb9 d3/d3d/d41/d5e/d5d/db0/d70/f127 0 2024-04-23T14:49:56.164 INFO:tasks.workunit.client.0.smithi081.stdout:9/757: symlink d3/de/d1d/d54/d68/lf6 0 2024-04-23T14:49:56.164 INFO:tasks.workunit.client.0.smithi081.stdout:9/758: chown d3/de/d76/db5 27211 1 2024-04-23T14:49:56.168 INFO:tasks.workunit.client.0.smithi081.stdout:0/874: creat d6/d11/d14/d41/d5b/d59/f110 x:0 0 0 2024-04-23T14:49:56.172 INFO:tasks.workunit.client.1.smithi156.stdout:2/449: mkdir d4/d21/d42/da1 0 2024-04-23T14:49:56.173 INFO:tasks.workunit.client.0.smithi081.stdout:9/759: dread d3/de/d25/f8e [0,4194304] 0 2024-04-23T14:49:56.173 INFO:tasks.workunit.client.0.smithi081.stdout:9/760: fdatasync d3/d5/f6 0 2024-04-23T14:49:56.179 INFO:tasks.workunit.client.0.smithi081.stdout:1/889: symlink d3/l128 0 2024-04-23T14:49:56.180 INFO:tasks.workunit.client.0.smithi081.stdout:1/890: readlink d3/d3d/d41/d5e/d17/l19 0 2024-04-23T14:49:56.182 INFO:tasks.workunit.client.0.smithi081.stdout:0/875: mkdir d6/d11/d14/d41/d111 0 2024-04-23T14:49:56.184 INFO:tasks.workunit.client.0.smithi081.stdout:4/744: getdents d1/d4/d6f/d70 0 2024-04-23T14:49:56.184 INFO:tasks.workunit.client.0.smithi081.stdout:4/745: chown d1/d1d/d59/fb6 268070568 1 2024-04-23T14:49:56.184 INFO:tasks.workunit.client.0.smithi081.stdout:4/746: write d1/f29 [1031934,83162] 0 2024-04-23T14:49:56.185 INFO:tasks.workunit.client.1.smithi156.stdout:4/393: rmdir d0/d30 39 2024-04-23T14:49:56.185 INFO:tasks.workunit.client.1.smithi156.stdout:4/394: write d0/df/f14 [34420,59750] 0 2024-04-23T14:49:56.186 INFO:tasks.workunit.client.0.smithi081.stdout:1/891: mknod d3/d3d/d7a/c129 0 2024-04-23T14:49:56.186 INFO:tasks.workunit.client.0.smithi081.stdout:1/892: write d3/d3d/d90/de0/f116 [56628,69982] 0 2024-04-23T14:49:56.191 INFO:tasks.workunit.client.1.smithi156.stdout:9/380: mkdir d1/d2/d3e/d50/d7a/d85 0 2024-04-23T14:49:56.192 INFO:tasks.workunit.client.1.smithi156.stdout:2/450: dread d4/d13/f20 [0,4194304] 0 2024-04-23T14:49:56.192 INFO:tasks.workunit.client.1.smithi156.stdout:2/451: chown d4/d21/d42/f4e 14 1 2024-04-23T14:49:56.193 INFO:tasks.workunit.client.0.smithi081.stdout:1/893: creat d3/d3d/d41/d5e/d5d/db0/d70/f12a x:0 0 0 2024-04-23T14:49:56.199 INFO:tasks.workunit.client.0.smithi081.stdout:9/761: dread d3/de/d1d/d54/d68/fe3 [0,4194304] 0 2024-04-23T14:49:56.201 INFO:tasks.workunit.client.1.smithi156.stdout:8/447: sync 2024-04-23T14:49:56.201 INFO:tasks.workunit.client.1.smithi156.stdout:8/448: fdatasync d5/f1c 0 2024-04-23T14:49:56.201 INFO:tasks.workunit.client.1.smithi156.stdout:8/449: write d5/d39/d6d/d8a/f92 [494286,95512] 0 2024-04-23T14:49:56.203 INFO:tasks.workunit.client.0.smithi081.stdout:1/894: truncate d3/d3d/d41/d5e/d5d/d125/d2e/fc5 3214705 0 2024-04-23T14:49:56.203 INFO:tasks.workunit.client.0.smithi081.stdout:1/895: chown d3/d3d/d41/d5e/d17/d58/d7f/dba 3 1 2024-04-23T14:49:56.209 INFO:tasks.workunit.client.0.smithi081.stdout:1/896: creat d3/d3d/d41/d92/df1/f12b x:0 0 0 2024-04-23T14:49:56.209 INFO:tasks.workunit.client.0.smithi081.stdout:0/876: dread f5 [0,4194304] 0 2024-04-23T14:49:56.211 INFO:tasks.workunit.client.1.smithi156.stdout:4/395: link d0/d8/c7a d0/df/d55/c7d 0 2024-04-23T14:49:56.213 INFO:tasks.workunit.client.1.smithi156.stdout:2/452: rmdir d4 39 2024-04-23T14:49:56.213 INFO:tasks.workunit.client.0.smithi081.stdout:7/674: sync 2024-04-23T14:49:56.214 INFO:tasks.workunit.client.1.smithi156.stdout:8/450: mkdir d5/d39/d99 0 2024-04-23T14:49:56.221 INFO:tasks.workunit.client.0.smithi081.stdout:0/877: rename d6/d37/d85/dd6/cf3 to d6/d11/d14/d24/db3/dfb/c112 0 2024-04-23T14:49:56.221 INFO:tasks.workunit.client.0.smithi081.stdout:0/878: chown d6/d37/d85/fde 327 1 2024-04-23T14:49:56.223 INFO:tasks.workunit.client.0.smithi081.stdout:0/879: write d6/d25/f2e [829264,51156] 0 2024-04-23T14:49:56.223 INFO:tasks.workunit.client.1.smithi156.stdout:7/493: rename dc/d1d/d41/d53 to dc/d93 0 2024-04-23T14:49:56.224 INFO:tasks.workunit.client.1.smithi156.stdout:7/494: dread - dc/d1d/d48/f6b zero size 2024-04-23T14:49:56.226 INFO:tasks.workunit.client.0.smithi081.stdout:0/880: write d6/d11/d14/d41/d5b/d3f/d44/d78/fb7 [748709,16875] 0 2024-04-23T14:49:56.227 INFO:tasks.workunit.client.0.smithi081.stdout:0/881: truncate d6/d11/d14/d41/d5b/d3f/ff2 431865 0 2024-04-23T14:49:56.228 INFO:tasks.workunit.client.1.smithi156.stdout:2/453: getdents d4/d13/d19/d4c 0 2024-04-23T14:49:56.228 INFO:tasks.workunit.client.1.smithi156.stdout:2/454: write d4/d21/d42/d75/d79/f85 [339996,21780] 0 2024-04-23T14:49:56.232 INFO:tasks.workunit.client.0.smithi081.stdout:7/675: rename d3/d11/d2c/d75/f86 to d3/d21/d31/d33/d4b/d4c/feb 0 2024-04-23T14:49:56.233 INFO:tasks.workunit.client.1.smithi156.stdout:6/521: rename d3/d16/c1c to d3/d16/d1e/cbf 0 2024-04-23T14:49:56.234 INFO:tasks.workunit.client.1.smithi156.stdout:6/522: creat d3/d16/d5c/d6a/fc0 x:0 0 0 2024-04-23T14:49:56.234 INFO:tasks.workunit.client.1.smithi156.stdout:6/523: chown d3/d16/d46/d2b/d3b 13396 1 2024-04-23T14:49:56.234 INFO:tasks.workunit.client.1.smithi156.stdout:6/524: readlink d3/da/d1d/d27/d63/l78 0 2024-04-23T14:49:56.239 INFO:tasks.workunit.client.0.smithi081.stdout:4/747: dwrite d1/d1d/f9a [0,4194304] 0 2024-04-23T14:49:56.239 INFO:tasks.workunit.client.0.smithi081.stdout:4/748: chown d1/d1d/d39/f73 131177644 1 2024-04-23T14:49:56.243 INFO:tasks.workunit.client.1.smithi156.stdout:8/451: rmdir d5/d9 39 2024-04-23T14:49:56.243 INFO:tasks.workunit.client.1.smithi156.stdout:2/455: creat d4/d21/d42/da1/fa2 x:0 0 0 2024-04-23T14:49:56.244 INFO:tasks.workunit.client.1.smithi156.stdout:9/381: write d1/d2/d3e/d50/d7a/d17/d1f/d48/f4f [3775825,110848] 0 2024-04-23T14:49:56.245 INFO:tasks.workunit.client.1.smithi156.stdout:4/396: rename d0/df/d21/f33 to d0/df/d55/d68/d53/f7e 0 2024-04-23T14:49:56.246 INFO:tasks.workunit.client.0.smithi081.stdout:0/882: dread d6/d37/d67/dc8/fd5 [0,4194304] 0 2024-04-23T14:49:56.251 INFO:tasks.workunit.client.1.smithi156.stdout:8/452: unlink d5/d39/d6d/d8a/f92 0 2024-04-23T14:49:56.253 INFO:tasks.workunit.client.1.smithi156.stdout:2/456: creat d4/d13/d19/d4c/d5c/fa3 x:0 0 0 2024-04-23T14:49:56.257 INFO:tasks.workunit.client.0.smithi081.stdout:7/676: dread d3/d20/fe0 [0,4194304] 0 2024-04-23T14:49:56.259 INFO:tasks.workunit.client.1.smithi156.stdout:4/397: mknod d0/d8/d1e/d4a/d77/c7f 0 2024-04-23T14:49:56.260 INFO:tasks.workunit.client.1.smithi156.stdout:9/382: dread d1/d2/d23/f27 [0,4194304] 0 2024-04-23T14:49:56.262 INFO:tasks.workunit.client.1.smithi156.stdout:8/453: mknod d5/d9/d10/d1d/d4c/c9a 0 2024-04-23T14:49:56.262 INFO:tasks.workunit.client.1.smithi156.stdout:6/525: dread d3/da/d1d/d27/f51 [0,4194304] 0 2024-04-23T14:49:56.263 INFO:tasks.workunit.client.1.smithi156.stdout:6/526: chown d3/d16/d5c/fac 108 1 2024-04-23T14:49:56.263 INFO:tasks.workunit.client.1.smithi156.stdout:6/527: truncate d3/da/d1d/d59/f7e 742522 0 2024-04-23T14:49:56.263 INFO:tasks.workunit.client.1.smithi156.stdout:6/528: stat d3/da/d1d/d27/c55 0 2024-04-23T14:49:56.263 INFO:tasks.workunit.client.1.smithi156.stdout:4/398: creat d0/f80 x:0 0 0 2024-04-23T14:49:56.272 INFO:tasks.workunit.client.1.smithi156.stdout:8/454: mknod d5/d9/d5a/d57/c9b 0 2024-04-23T14:49:56.274 INFO:tasks.workunit.client.1.smithi156.stdout:6/529: unlink d3/da/f28 0 2024-04-23T14:49:56.274 INFO:tasks.workunit.client.1.smithi156.stdout:6/530: dread - d3/d16/d5c/d6a/fc0 zero size 2024-04-23T14:49:56.275 INFO:tasks.workunit.client.1.smithi156.stdout:4/399: dread d0/df/f71 [0,4194304] 0 2024-04-23T14:49:56.275 INFO:tasks.workunit.client.1.smithi156.stdout:4/400: readlink d0/l5d 0 2024-04-23T14:49:56.280 INFO:tasks.workunit.client.0.smithi081.stdout:5/852: sync 2024-04-23T14:49:56.280 INFO:tasks.workunit.client.0.smithi081.stdout:8/964: sync 2024-04-23T14:49:56.280 INFO:tasks.workunit.client.0.smithi081.stdout:5/853: chown d17/d3d/d7a/cfc 30 1 2024-04-23T14:49:56.280 INFO:tasks.workunit.client.0.smithi081.stdout:7/677: getdents d3/d21/d41/dbb 0 2024-04-23T14:49:56.281 INFO:tasks.workunit.client.1.smithi156.stdout:6/531: truncate d3/d16/d1e/f7d 893189 0 2024-04-23T14:49:56.281 INFO:tasks.workunit.client.1.smithi156.stdout:4/401: mknod d0/df/d55/d68/d53/c81 0 2024-04-23T14:49:56.283 INFO:tasks.workunit.client.0.smithi081.stdout:8/965: link d3/d11/d4f/d6c/fb4 d3/d11/d86/d88/f13e 0 2024-04-23T14:49:56.286 INFO:tasks.workunit.client.0.smithi081.stdout:5/854: mknod d17/d65/de3/d108/db1/c12b 0 2024-04-23T14:49:56.288 INFO:tasks.workunit.client.0.smithi081.stdout:7/678: creat d3/d21/d31/d33/d52/fec x:0 0 0 2024-04-23T14:49:56.288 INFO:tasks.workunit.client.0.smithi081.stdout:7/679: stat d3/d21/d31/d33/c7a 0 2024-04-23T14:49:56.288 INFO:tasks.workunit.client.0.smithi081.stdout:7/680: write d3/d21/d31/f29 [4711997,24084] 0 2024-04-23T14:49:56.288 INFO:tasks.workunit.client.0.smithi081.stdout:7/681: readlink d3/d21/d31/d33/l8d 0 2024-04-23T14:49:56.288 INFO:tasks.workunit.client.1.smithi156.stdout:1/513: sync 2024-04-23T14:49:56.289 INFO:tasks.workunit.client.1.smithi156.stdout:0/451: sync 2024-04-23T14:49:56.289 INFO:tasks.workunit.client.1.smithi156.stdout:3/429: sync 2024-04-23T14:49:56.289 INFO:tasks.workunit.client.1.smithi156.stdout:0/452: fdatasync d0/d16/d3a/d2a/d1d/d2d/f8c 0 2024-04-23T14:49:56.289 INFO:tasks.workunit.client.0.smithi081.stdout:8/966: mknod d3/d3c/ddb/df3/c13f 0 2024-04-23T14:49:56.289 INFO:tasks.workunit.client.1.smithi156.stdout:5/516: sync 2024-04-23T14:49:56.290 INFO:tasks.workunit.client.0.smithi081.stdout:5/855: mkdir d17/d65/de3/d108/db1/d12c 0 2024-04-23T14:49:56.291 INFO:tasks.workunit.client.0.smithi081.stdout:7/682: mknod d3/d11/d2c/ced 0 2024-04-23T14:49:56.292 INFO:tasks.workunit.client.1.smithi156.stdout:9/383: fdatasync d1/d2/d3e/d50/d7a/d17/d1f/d48/f4f 0 2024-04-23T14:49:56.295 INFO:tasks.workunit.client.0.smithi081.stdout:8/967: mknod d3/d11/c140 0 2024-04-23T14:49:56.295 INFO:tasks.workunit.client.0.smithi081.stdout:5/856: mknod d17/d65/de3/c12d 0 2024-04-23T14:49:56.296 INFO:tasks.workunit.client.1.smithi156.stdout:7/495: dwrite dc/d1d/f52 [0,4194304] 0 2024-04-23T14:49:56.303 INFO:tasks.workunit.client.1.smithi156.stdout:7/496: write dc/d1d/d41/f3d [2059128,20154] 0 2024-04-23T14:49:56.303 INFO:tasks.workunit.client.1.smithi156.stdout:7/497: dread - dc/d46/d58/f65 zero size 2024-04-23T14:49:56.303 INFO:tasks.workunit.client.1.smithi156.stdout:7/498: chown dc/d93/d6c/d88/l7f 365933218 1 2024-04-23T14:49:56.303 INFO:tasks.workunit.client.1.smithi156.stdout:5/517: dread d1/f56 [0,4194304] 0 2024-04-23T14:49:56.304 INFO:tasks.workunit.client.1.smithi156.stdout:2/457: dwrite d4/d13/d88/f72 [0,4194304] 0 2024-04-23T14:49:56.304 INFO:tasks.workunit.client.1.smithi156.stdout:2/458: read - d4/f81 zero size 2024-04-23T14:49:56.304 INFO:tasks.workunit.client.1.smithi156.stdout:2/459: fsync d4/d21/d42/d75/d79/f85 0 2024-04-23T14:49:56.305 INFO:tasks.workunit.client.0.smithi081.stdout:9/762: dwrite d3/de/d1d/d54/d68/f7c [4194304,4194304] 0 2024-04-23T14:49:56.305 INFO:tasks.workunit.client.0.smithi081.stdout:7/683: dread d3/d20/dc9/f8b [0,4194304] 0 2024-04-23T14:49:56.305 INFO:tasks.workunit.client.0.smithi081.stdout:7/684: read - d3/d21/d31/d33/d4b/d6e/fce zero size 2024-04-23T14:49:56.305 INFO:tasks.workunit.client.0.smithi081.stdout:8/968: mknod d3/d11/d3e/c141 0 2024-04-23T14:49:56.305 INFO:tasks.workunit.client.0.smithi081.stdout:7/685: write d3/d21/d31/f8 [149768,7273] 0 2024-04-23T14:49:56.305 INFO:tasks.workunit.client.0.smithi081.stdout:7/686: fsync d3/d21/d41/d7c/dc3/f72 0 2024-04-23T14:49:56.305 INFO:tasks.workunit.client.0.smithi081.stdout:4/749: dwrite d1/f1e [0,4194304] 0 2024-04-23T14:49:56.305 INFO:tasks.workunit.client.0.smithi081.stdout:4/750: chown d1/d4f/d87 86933616 1 2024-04-23T14:49:56.305 INFO:tasks.workunit.client.0.smithi081.stdout:4/751: chown d1/d1d/d59/f5a 0 1 2024-04-23T14:49:56.308 INFO:tasks.workunit.client.0.smithi081.stdout:5/857: creat d17/d3c/d105/f12e x:0 0 0 2024-04-23T14:49:56.308 INFO:tasks.workunit.client.0.smithi081.stdout:5/858: readlink d17/d1f/d42/d9b/d9e/da3/le1 0 2024-04-23T14:49:56.308 INFO:tasks.workunit.client.0.smithi081.stdout:5/859: dread - d17/d18/d3a/fd3 zero size 2024-04-23T14:49:56.308 INFO:tasks.workunit.client.0.smithi081.stdout:5/860: chown d17/l47 22334 1 2024-04-23T14:49:56.308 INFO:tasks.workunit.client.0.smithi081.stdout:5/861: truncate d17/d3c/d55/d64/dcc/f10e 839451 0 2024-04-23T14:49:56.308 INFO:tasks.workunit.client.0.smithi081.stdout:0/883: dwrite d6/d11/d14/d41/d5b/d3f/d44/d78/d83/fe2 [0,4194304] 0 2024-04-23T14:49:56.310 INFO:tasks.workunit.client.1.smithi156.stdout:7/499: mknod dc/d93/d6c/d88/c94 0 2024-04-23T14:49:56.314 INFO:tasks.workunit.client.0.smithi081.stdout:9/763: symlink d3/de/d47/lf7 0 2024-04-23T14:49:56.320 INFO:tasks.workunit.client.0.smithi081.stdout:8/969: dread d3/d11/d3e/d63/d78/da0/ff2 [0,4194304] 0 2024-04-23T14:49:56.324 INFO:tasks.workunit.client.1.smithi156.stdout:3/430: creat d4/db/dd/d73/f7e x:0 0 0 2024-04-23T14:49:56.327 INFO:tasks.workunit.client.1.smithi156.stdout:8/455: rename d5/d9/d10/d1d/d4c to d5/d9/d36/d9c 0 2024-04-23T14:49:56.327 INFO:tasks.workunit.client.1.smithi156.stdout:8/456: truncate d5/d9/d10/d1d/f8e 229483 0 2024-04-23T14:49:56.328 INFO:tasks.workunit.client.1.smithi156.stdout:8/457: write d5/d9/d10/f88 [646103,23096] 0 2024-04-23T14:49:56.328 INFO:tasks.workunit.client.1.smithi156.stdout:8/458: readlink d5/d9/d5a/d5c/l5f 0 2024-04-23T14:49:56.328 INFO:tasks.workunit.client.1.smithi156.stdout:7/500: write dc/d1d/d24/f62 [2036062,80980] 0 2024-04-23T14:49:56.328 INFO:tasks.workunit.client.0.smithi081.stdout:8/970: dread d3/f2f [0,4194304] 0 2024-04-23T14:49:56.328 INFO:tasks.workunit.client.0.smithi081.stdout:8/971: chown d3/d11/d48/d7e/f9e 176007349 1 2024-04-23T14:49:56.331 INFO:tasks.workunit.client.1.smithi156.stdout:6/532: rmdir d3 39 2024-04-23T14:49:56.333 INFO:tasks.workunit.client.1.smithi156.stdout:3/431: mkdir d4/db/dd/d1d/d61/d7f 0 2024-04-23T14:49:56.334 INFO:tasks.workunit.client.1.smithi156.stdout:0/453: dwrite d0/d4/f3 [0,4194304] 0 2024-04-23T14:49:56.334 INFO:tasks.workunit.client.1.smithi156.stdout:0/454: write d0/d16/d3a/d2a/d1d/d2d/f8c [1138130,40123] 0 2024-04-23T14:49:56.334 INFO:tasks.workunit.client.1.smithi156.stdout:0/455: fsync d0/d16/d3a/d2a/f99 0 2024-04-23T14:49:56.335 INFO:tasks.workunit.client.0.smithi081.stdout:7/687: mknod d3/d21/d41/d7c/dc3/d7f/cee 0 2024-04-23T14:49:56.335 INFO:tasks.workunit.client.0.smithi081.stdout:7/688: stat d3/d21/d31/d33/d4b/fd5 0 2024-04-23T14:49:56.336 INFO:tasks.workunit.client.1.smithi156.stdout:1/514: rename db/d1f/d2f/l7f to db/d1f/d2d/d93/la6 0 2024-04-23T14:49:56.336 INFO:tasks.workunit.client.1.smithi156.stdout:1/515: read - db/d25/d30/d38/d40/f9a zero size 2024-04-23T14:49:56.337 INFO:tasks.workunit.client.0.smithi081.stdout:4/752: mknod d1/d1d/d39/d8d/de3/cf3 0 2024-04-23T14:49:56.338 INFO:tasks.workunit.client.1.smithi156.stdout:8/459: truncate d5/d9/d10/f34 1040570 0 2024-04-23T14:49:56.338 INFO:tasks.workunit.client.1.smithi156.stdout:8/460: getdents d5/d39/d6d/d8b/d98 0 2024-04-23T14:49:56.341 INFO:tasks.workunit.client.1.smithi156.stdout:7/501: creat dc/d1d/f95 x:0 0 0 2024-04-23T14:49:56.342 INFO:tasks.workunit.client.0.smithi081.stdout:5/862: truncate d17/d4a/f5b 3477078 0 2024-04-23T14:49:56.343 INFO:tasks.workunit.client.1.smithi156.stdout:6/533: creat d3/d16/d46/d2b/d6e/d8f/fc1 x:0 0 0 2024-04-23T14:49:56.344 INFO:tasks.workunit.client.1.smithi156.stdout:6/534: fsync d3/d16/d46/d9d/fbe 0 2024-04-23T14:49:56.344 INFO:tasks.workunit.client.1.smithi156.stdout:6/535: fdatasync d3/fb0 0 2024-04-23T14:49:56.344 INFO:tasks.workunit.client.0.smithi081.stdout:0/884: creat d6/d11/d14/d41/d5b/d3f/d44/d76/f113 x:0 0 0 2024-04-23T14:49:56.344 INFO:tasks.workunit.client.0.smithi081.stdout:0/885: chown d6/c62 3 1 2024-04-23T14:49:56.345 INFO:tasks.workunit.client.1.smithi156.stdout:3/432: readlink d4/db/l53 0 2024-04-23T14:49:56.345 INFO:tasks.workunit.client.1.smithi156.stdout:3/433: chown d4/db/dd/d1d/d1e/d42/d76/l7a 1 1 2024-04-23T14:49:56.345 INFO:tasks.workunit.client.1.smithi156.stdout:3/434: chown d4/db/dd/d1d/d1e/d13 53820 1 2024-04-23T14:49:56.345 INFO:tasks.workunit.client.1.smithi156.stdout:3/435: stat d4/db/dd/d1d/l68 0 2024-04-23T14:49:56.346 INFO:tasks.workunit.client.1.smithi156.stdout:3/436: write d4/db/dd/d1d/d61/f62 [76195,18651] 0 2024-04-23T14:49:56.346 INFO:tasks.workunit.client.1.smithi156.stdout:3/437: chown d4/db/dd/d20/c3a 232987 1 2024-04-23T14:49:56.347 INFO:tasks.workunit.client.1.smithi156.stdout:0/456: creat d0/d16/d3a/d1e/d80/f9b x:0 0 0 2024-04-23T14:49:56.348 INFO:tasks.workunit.client.1.smithi156.stdout:1/516: mknod db/d1f/d2d/d85/ca7 0 2024-04-23T14:49:56.351 INFO:tasks.workunit.client.1.smithi156.stdout:8/461: creat d5/d9/d5a/d5c/f9d x:0 0 0 2024-04-23T14:49:56.354 INFO:tasks.workunit.client.1.smithi156.stdout:7/502: symlink dc/d1d/d24/l96 0 2024-04-23T14:49:56.354 INFO:tasks.workunit.client.1.smithi156.stdout:7/503: write dc/f81 [294113,22314] 0 2024-04-23T14:49:56.355 INFO:tasks.workunit.client.0.smithi081.stdout:8/972: truncate d3/dc6/fc9 2653145 0 2024-04-23T14:49:56.357 INFO:tasks.workunit.client.1.smithi156.stdout:6/536: mknod d3/d16/d46/d64/d77/cc2 0 2024-04-23T14:49:56.360 INFO:tasks.workunit.client.1.smithi156.stdout:3/438: dread - d4/db/f77 zero size 2024-04-23T14:49:56.360 INFO:tasks.workunit.client.1.smithi156.stdout:5/518: dwrite d1/d11/f29 [0,4194304] 0 2024-04-23T14:49:56.360 INFO:tasks.workunit.client.1.smithi156.stdout:5/519: write d1/d11/f13 [2160867,75047] 0 2024-04-23T14:49:56.362 INFO:tasks.workunit.client.1.smithi156.stdout:0/457: unlink d0/d4/d22/d58/d9a/d44/d4a/f65 0 2024-04-23T14:49:56.364 INFO:tasks.workunit.client.1.smithi156.stdout:7/504: dread dc/d1d/f42 [0,4194304] 0 2024-04-23T14:49:56.364 INFO:tasks.workunit.client.0.smithi081.stdout:0/886: rename d6/d11/ccd to d6/d37/d85/dd6/c114 0 2024-04-23T14:49:56.366 INFO:tasks.workunit.client.0.smithi081.stdout:8/973: getdents d3/d11/d3e/d63/d78 0 2024-04-23T14:49:56.366 INFO:tasks.workunit.client.0.smithi081.stdout:8/974: stat d3/f4 0 2024-04-23T14:49:56.368 INFO:tasks.workunit.client.1.smithi156.stdout:8/462: creat d5/d39/f9e x:0 0 0 2024-04-23T14:49:56.370 INFO:tasks.workunit.client.0.smithi081.stdout:7/689: mknod d3/d21/d31/d33/d4b/d4c/cef 0 2024-04-23T14:49:56.370 INFO:tasks.workunit.client.0.smithi081.stdout:7/690: write d3/d21/d31/f38 [4332675,1922] 0 2024-04-23T14:49:56.372 INFO:tasks.workunit.client.1.smithi156.stdout:6/537: mkdir d3/da/d74/d93/dc3 0 2024-04-23T14:49:56.374 INFO:tasks.workunit.client.0.smithi081.stdout:4/753: symlink d1/d4/dc/lf4 0 2024-04-23T14:49:56.374 INFO:tasks.workunit.client.0.smithi081.stdout:4/754: creat d1/d1d/d39/d8d/de3/ff5 x:0 0 0 2024-04-23T14:49:56.374 INFO:tasks.workunit.client.0.smithi081.stdout:4/755: write d1/d1d/f26 [535804,48475] 0 2024-04-23T14:49:56.374 INFO:tasks.workunit.client.0.smithi081.stdout:4/756: fsync d1/d4/d11/f7f 0 2024-04-23T14:49:56.374 INFO:tasks.workunit.client.0.smithi081.stdout:4/757: fdatasync d1/d4/d11/f80 0 2024-04-23T14:49:56.374 INFO:tasks.workunit.client.0.smithi081.stdout:4/758: write d1/d4/f76 [2589743,44564] 0 2024-04-23T14:49:56.376 INFO:tasks.workunit.client.0.smithi081.stdout:0/887: mkdir d6/d11/d14/d41/d5b/d3f/d44/d78/d83/d115 0 2024-04-23T14:49:56.376 INFO:tasks.workunit.client.0.smithi081.stdout:0/888: write d6/d11/d14/d41/d5b/d59/d68/fa9 [624291,16382] 0 2024-04-23T14:49:56.379 INFO:tasks.workunit.client.0.smithi081.stdout:5/863: dwrite d17/d4a/f8f [0,4194304] 0 2024-04-23T14:49:56.380 INFO:tasks.workunit.client.0.smithi081.stdout:7/691: symlink d3/d97/lf0 0 2024-04-23T14:49:56.385 INFO:tasks.workunit.client.0.smithi081.stdout:0/889: symlink d6/d11/d14/d41/d5b/l116 0 2024-04-23T14:49:56.388 INFO:tasks.workunit.client.0.smithi081.stdout:2/756: sync 2024-04-23T14:49:56.388 INFO:tasks.workunit.client.0.smithi081.stdout:6/787: sync 2024-04-23T14:49:56.389 INFO:tasks.workunit.client.0.smithi081.stdout:2/757: read d1/d33/d45/d6e/d96/f63 [3024652,96486] 0 2024-04-23T14:49:56.389 INFO:tasks.workunit.client.0.smithi081.stdout:6/788: write d1/d51/f112 [885034,69075] 0 2024-04-23T14:49:56.391 INFO:tasks.workunit.client.0.smithi081.stdout:5/864: creat d17/d1f/d42/f12f x:0 0 0 2024-04-23T14:49:56.393 INFO:tasks.workunit.client.0.smithi081.stdout:7/692: creat d3/d21/d41/d7c/dc3/d7f/ff1 x:0 0 0 2024-04-23T14:49:56.400 INFO:tasks.workunit.client.1.smithi156.stdout:3/439: mkdir d4/db/dd/d80 0 2024-04-23T14:49:56.402 INFO:tasks.workunit.client.0.smithi081.stdout:6/789: dread d1/d51/d65/d13/d16/dd0/df7/fc3 [0,4194304] 0 2024-04-23T14:49:56.402 INFO:tasks.workunit.client.0.smithi081.stdout:6/790: fdatasync d1/d51/d65/f4f 0 2024-04-23T14:49:56.403 INFO:tasks.workunit.client.0.smithi081.stdout:0/890: symlink d6/d37/d67/d7d/l117 0 2024-04-23T14:49:56.405 INFO:tasks.workunit.client.1.smithi156.stdout:0/458: unlink d0/d4/c53 0 2024-04-23T14:49:56.405 INFO:tasks.workunit.client.1.smithi156.stdout:0/459: chown d0/d16/d3a/d2a/d1d/d2d/f73 4 1 2024-04-23T14:49:56.405 INFO:tasks.workunit.client.1.smithi156.stdout:0/460: dread - d0/d16/d3a/d1e/d80/f9b zero size 2024-04-23T14:49:56.405 INFO:tasks.workunit.client.1.smithi156.stdout:0/461: write d0/d16/d3a/d1e/f6e [209069,126794] 0 2024-04-23T14:49:56.406 INFO:tasks.workunit.client.1.smithi156.stdout:1/517: rmdir db/d1f/d2f/d47/d71 39 2024-04-23T14:49:56.407 INFO:tasks.workunit.client.1.smithi156.stdout:1/518: creat db/d1f/d28/fa8 x:0 0 0 2024-04-23T14:49:56.410 INFO:tasks.workunit.client.1.smithi156.stdout:0/462: mkdir d0/d16/d43/d9c 0 2024-04-23T14:49:56.412 INFO:tasks.workunit.client.1.smithi156.stdout:1/519: mkdir db/d1f/d2f/da9 0 2024-04-23T14:49:56.412 INFO:tasks.workunit.client.1.smithi156.stdout:1/520: write db/d1f/d28/fa8 [677401,53435] 0 2024-04-23T14:49:56.413 INFO:tasks.workunit.client.0.smithi081.stdout:6/791: getdents d1/d2/d5a 0 2024-04-23T14:49:56.413 INFO:tasks.workunit.client.0.smithi081.stdout:6/792: readlink d1/l38 0 2024-04-23T14:49:56.413 INFO:tasks.workunit.client.0.smithi081.stdout:2/758: symlink d1/d11/dab/l103 0 2024-04-23T14:49:56.414 INFO:tasks.workunit.client.1.smithi156.stdout:0/463: read d0/d4/d11/d3f/d5f/f71 [9950,98254] 0 2024-04-23T14:49:56.414 INFO:tasks.workunit.client.1.smithi156.stdout:1/521: getdents db/d1f/d2d/d48 0 2024-04-23T14:49:56.414 INFO:tasks.workunit.client.1.smithi156.stdout:1/522: fsync db/d25/f3d 0 2024-04-23T14:49:56.415 INFO:tasks.workunit.client.1.smithi156.stdout:9/384: sync 2024-04-23T14:49:56.415 INFO:tasks.workunit.client.1.smithi156.stdout:2/460: sync 2024-04-23T14:49:56.415 INFO:tasks.workunit.client.1.smithi156.stdout:4/402: sync 2024-04-23T14:49:56.415 INFO:tasks.workunit.client.1.smithi156.stdout:2/461: fsync d4/d21/d42/f89 0 2024-04-23T14:49:56.415 INFO:tasks.workunit.client.1.smithi156.stdout:9/385: chown d1/d2/d3e/d50/d7a/d17/d1f/l84 28 1 2024-04-23T14:49:56.415 INFO:tasks.workunit.client.1.smithi156.stdout:4/403: creat d0/df/d55/d68/d53/f82 x:0 0 0 2024-04-23T14:49:56.417 INFO:tasks.workunit.client.1.smithi156.stdout:0/464: mknod d0/d16/d43/c9d 0 2024-04-23T14:49:56.418 INFO:tasks.workunit.client.1.smithi156.stdout:1/523: getdents db/d1f/d94 0 2024-04-23T14:49:56.419 INFO:tasks.workunit.client.0.smithi081.stdout:2/759: symlink d1/d1e/l104 0 2024-04-23T14:49:56.422 INFO:tasks.workunit.client.0.smithi081.stdout:5/865: rename d17/d1f/d42/d9b/dc9 to d17/d4f/d61/dba/d127/d130 0 2024-04-23T14:49:56.422 INFO:tasks.workunit.client.0.smithi081.stdout:5/866: readlink lb 0 2024-04-23T14:49:56.425 INFO:tasks.workunit.client.1.smithi156.stdout:2/462: truncate d4/d13/d19/f1e 5070466 0 2024-04-23T14:49:56.427 INFO:tasks.workunit.client.1.smithi156.stdout:5/520: dread d1/d3/d24/f72 [0,4194304] 0 2024-04-23T14:49:56.430 INFO:tasks.workunit.client.0.smithi081.stdout:6/793: getdents d1/d51/d54 0 2024-04-23T14:49:56.430 INFO:tasks.workunit.client.0.smithi081.stdout:6/794: chown d1/d51/d65/d8/d2e/d59/d80/d90/cf1 117062446 1 2024-04-23T14:49:56.430 INFO:tasks.workunit.client.0.smithi081.stdout:2/760: dread d1/d33/da3/fc8 [0,4194304] 0 2024-04-23T14:49:56.431 INFO:tasks.workunit.client.1.smithi156.stdout:9/386: rename d1/d2/d3e/d50/d7a/d19/l83 to d1/d2/d23/d49/d4c/l86 0 2024-04-23T14:49:56.431 INFO:tasks.workunit.client.1.smithi156.stdout:9/387: creat d1/d2/d3e/d50/d7a/d17/d1f/f87 x:0 0 0 2024-04-23T14:49:56.436 INFO:tasks.workunit.client.0.smithi081.stdout:5/867: rename d17/d65/de3/d108/db1/led to d17/d4f/l131 0 2024-04-23T14:49:56.436 INFO:tasks.workunit.client.1.smithi156.stdout:0/465: mknod d0/d4/d11/d3f/d5f/c9e 0 2024-04-23T14:49:56.436 INFO:tasks.workunit.client.1.smithi156.stdout:0/466: fdatasync d0/d16/d3a/d2a/d1d/d2d/f5b 0 2024-04-23T14:49:56.438 INFO:tasks.workunit.client.0.smithi081.stdout:2/761: mkdir d1/d11/d21/d52/d8b/d8f/d105 0 2024-04-23T14:49:56.441 INFO:tasks.workunit.client.1.smithi156.stdout:5/521: mknod d1/d11/d27/ca4 0 2024-04-23T14:49:56.441 INFO:tasks.workunit.client.1.smithi156.stdout:5/522: fdatasync d1/d3/f49 0 2024-04-23T14:49:56.442 INFO:tasks.workunit.client.0.smithi081.stdout:6/795: dread d1/d51/d65/d13/d16/dd0/df7/fc3 [0,4194304] 0 2024-04-23T14:49:56.444 INFO:tasks.workunit.client.0.smithi081.stdout:7/693: dwrite d3/d11/d2c/f9c [0,4194304] 0 2024-04-23T14:49:56.444 INFO:tasks.workunit.client.0.smithi081.stdout:7/694: fdatasync d3/d20/f3f 0 2024-04-23T14:49:56.444 INFO:tasks.workunit.client.0.smithi081.stdout:5/868: dread d17/d18/d3a/d8e/f90 [0,4194304] 0 2024-04-23T14:49:56.445 INFO:tasks.workunit.client.0.smithi081.stdout:5/869: truncate d17/d4a/fbd 4474309 0 2024-04-23T14:49:56.445 INFO:tasks.workunit.client.0.smithi081.stdout:5/870: write d17/d3d/d41/f6a [1651494,49983] 0 2024-04-23T14:49:56.445 INFO:tasks.workunit.client.1.smithi156.stdout:4/404: rename d0/c4c to d0/df/d55/c83 0 2024-04-23T14:49:56.454 INFO:tasks.workunit.client.1.smithi156.stdout:9/388: dread d1/d2/d3e/d50/f7c [0,4194304] 0 2024-04-23T14:49:56.457 INFO:tasks.workunit.client.0.smithi081.stdout:6/796: symlink d1/d2/l114 0 2024-04-23T14:49:56.457 INFO:tasks.workunit.client.1.smithi156.stdout:3/440: dread d4/db/dd/d1d/d1e/f12 [0,4194304] 0 2024-04-23T14:49:56.458 INFO:tasks.workunit.client.1.smithi156.stdout:3/441: write d4/db/dd/d1d/d1e/d13/f79 [1038321,78744] 0 2024-04-23T14:49:56.458 INFO:tasks.workunit.client.1.smithi156.stdout:5/523: rename l0 to d1/la5 0 2024-04-23T14:49:56.458 INFO:tasks.workunit.client.1.smithi156.stdout:5/524: chown d1/d11/d18/d52/d75/c79 26 1 2024-04-23T14:49:56.458 INFO:tasks.workunit.client.1.smithi156.stdout:4/405: mknod d0/d76/c84 0 2024-04-23T14:49:56.458 INFO:tasks.workunit.client.1.smithi156.stdout:7/505: dwrite dc/f1e [4194304,4194304] 0 2024-04-23T14:49:56.461 INFO:tasks.workunit.client.1.smithi156.stdout:6/538: dwrite d3/d16/d46/d2b/d3b/f69 [0,4194304] 0 2024-04-23T14:49:56.465 INFO:tasks.workunit.client.1.smithi156.stdout:5/525: truncate d1/d11/f13 2448108 0 2024-04-23T14:49:56.465 INFO:tasks.workunit.client.1.smithi156.stdout:5/526: chown d1/d3/d43/d4e/c6a 98 1 2024-04-23T14:49:56.470 INFO:tasks.workunit.client.0.smithi081.stdout:7/695: mknod d3/d21/d31/d33/d4b/d6e/cf2 0 2024-04-23T14:49:56.470 INFO:tasks.workunit.client.0.smithi081.stdout:7/696: getdents d3/d11/d2c/d75/d8e/dc2 0 2024-04-23T14:49:56.470 INFO:tasks.workunit.client.0.smithi081.stdout:7/697: stat d3/d21/d31/d33/f6f 0 2024-04-23T14:49:56.473 INFO:tasks.workunit.client.1.smithi156.stdout:6/539: rename d3/d16/d5c/fac to d3/d16/fc4 0 2024-04-23T14:49:56.473 INFO:tasks.workunit.client.1.smithi156.stdout:6/540: dread - d3/d16/d46/d9d/fbe zero size 2024-04-23T14:49:56.474 INFO:tasks.workunit.client.1.smithi156.stdout:7/506: dread dc/d1d/d24/f27 [0,4194304] 0 2024-04-23T14:49:56.474 INFO:tasks.workunit.client.1.smithi156.stdout:7/507: fsync dc/d1d/f52 0 2024-04-23T14:49:56.474 INFO:tasks.workunit.client.1.smithi156.stdout:7/508: creat dc/d2c/d68/f97 x:0 0 0 2024-04-23T14:49:56.475 INFO:tasks.workunit.client.1.smithi156.stdout:3/442: creat d4/db/d4b/f81 x:0 0 0 2024-04-23T14:49:56.477 INFO:tasks.workunit.client.1.smithi156.stdout:9/389: dread d1/d2/d3e/d50/d7a/d17/f2c [0,4194304] 0 2024-04-23T14:49:56.477 INFO:tasks.workunit.client.1.smithi156.stdout:9/390: readlink d1/d2/d3e/d55/d6f/l53 0 2024-04-23T14:49:56.478 INFO:tasks.workunit.client.1.smithi156.stdout:5/527: rename d1/d3/d43/d4e to d1/d3/da6 0 2024-04-23T14:49:56.483 INFO:tasks.workunit.client.1.smithi156.stdout:3/443: rmdir d4/db/dd/d1d/d1e/d2b/d31/d70 0 2024-04-23T14:49:56.484 INFO:tasks.workunit.client.1.smithi156.stdout:6/541: dread d3/d16/f5a [4194304,4194304] 0 2024-04-23T14:49:56.484 INFO:tasks.workunit.client.1.smithi156.stdout:6/542: write d3/d16/d46/d9d/d9f/dad/f9b [142240,44966] 0 2024-04-23T14:49:56.486 INFO:tasks.workunit.client.1.smithi156.stdout:1/524: dwrite db/d25/d30/d38/f9f [4194304,4194304] 0 2024-04-23T14:49:56.486 INFO:tasks.workunit.client.1.smithi156.stdout:1/525: creat db/d25/d30/d38/d40/faa x:0 0 0 2024-04-23T14:49:56.489 INFO:tasks.workunit.client.0.smithi081.stdout:7/698: link d3/d21/d31/d50/f62 d3/d21/d31/d63/ff3 0 2024-04-23T14:49:56.489 INFO:tasks.workunit.client.0.smithi081.stdout:7/699: write d3/d20/dc9/f8b [489626,52452] 0 2024-04-23T14:49:56.490 INFO:tasks.workunit.client.1.smithi156.stdout:9/391: symlink d1/l88 0 2024-04-23T14:49:56.495 INFO:tasks.workunit.client.1.smithi156.stdout:2/463: dwrite d4/d21/d76/f9b [0,4194304] 0 2024-04-23T14:49:56.496 INFO:tasks.workunit.client.1.smithi156.stdout:7/509: rename dc/d1d/f6e to dc/d1d/d24/f98 0 2024-04-23T14:49:56.496 INFO:tasks.workunit.client.1.smithi156.stdout:7/510: dread - dc/d2c/d68/f97 zero size 2024-04-23T14:49:56.503 INFO:tasks.workunit.client.0.smithi081.stdout:0/891: dwrite d6/d37/fe4 [0,4194304] 0 2024-04-23T14:49:56.503 INFO:tasks.workunit.client.0.smithi081.stdout:0/892: chown d6/d11/d14/f91 7 1 2024-04-23T14:49:56.504 INFO:tasks.workunit.client.1.smithi156.stdout:6/543: link d3/da/f18 d3/da/d74/fc5 0 2024-04-23T14:49:56.504 INFO:tasks.workunit.client.1.smithi156.stdout:4/406: dread d0/d76/f4d [0,4194304] 0 2024-04-23T14:49:56.506 INFO:tasks.workunit.client.0.smithi081.stdout:7/700: truncate d3/d21/d31/d50/da2/f8c 1464254 0 2024-04-23T14:49:56.520 INFO:tasks.workunit.client.0.smithi081.stdout:0/893: creat d6/d11/d14/d41/d5b/d59/db6/f118 x:0 0 0 2024-04-23T14:49:56.520 INFO:tasks.workunit.client.0.smithi081.stdout:0/894: chown d6/d11/d14/d41/d5b/d59 4 1 2024-04-23T14:49:56.523 INFO:tasks.workunit.client.0.smithi081.stdout:7/701: mknod d3/d21/d31/d33/d4b/d6e/cf4 0 2024-04-23T14:49:56.524 INFO:tasks.workunit.client.1.smithi156.stdout:0/467: dwrite d0/d4/d22/d58/d9a/d44/d4a/f4c [0,4194304] 0 2024-04-23T14:49:56.524 INFO:tasks.workunit.client.1.smithi156.stdout:0/468: creat d0/d16/d3a/d2a/d1d/d2d/d6b/f9f x:0 0 0 2024-04-23T14:49:56.524 INFO:tasks.workunit.client.1.smithi156.stdout:1/526: mkdir db/d1f/d2d/d48/dab 0 2024-04-23T14:49:56.526 INFO:tasks.workunit.client.1.smithi156.stdout:9/392: creat d1/d2/d3e/d50/d7a/d19/f89 x:0 0 0 2024-04-23T14:49:56.526 INFO:tasks.workunit.client.1.smithi156.stdout:9/393: truncate d1/d2/f58 1039745 0 2024-04-23T14:49:56.529 INFO:tasks.workunit.client.0.smithi081.stdout:7/702: unlink d3/d21/d31/d33/c6a 0 2024-04-23T14:49:56.530 INFO:tasks.workunit.client.1.smithi156.stdout:2/464: mknod d4/d21/d42/ca4 0 2024-04-23T14:49:56.531 INFO:tasks.workunit.client.0.smithi081.stdout:7/703: mknod d3/d21/d41/d7c/dc3/d7f/d98/cf5 0 2024-04-23T14:49:56.532 INFO:tasks.workunit.client.0.smithi081.stdout:2/762: dwrite d1/d33/d45/d48/f51 [0,4194304] 0 2024-04-23T14:49:56.533 INFO:tasks.workunit.client.1.smithi156.stdout:3/444: rename d4/db/dd/d80 to d4/db/dd/d1d/d1e/d42/d76/d82 0 2024-04-23T14:49:56.534 INFO:tasks.workunit.client.0.smithi081.stdout:5/871: dwrite d17/d18/dff/d59/f63 [0,4194304] 0 2024-04-23T14:49:56.537 INFO:tasks.workunit.client.1.smithi156.stdout:7/511: unlink dc/d1d/d24/f87 0 2024-04-23T14:49:56.537 INFO:tasks.workunit.client.1.smithi156.stdout:7/512: dread - dc/d1d/d24/f7b zero size 2024-04-23T14:49:56.537 INFO:tasks.workunit.client.1.smithi156.stdout:7/513: chown dc/d2c/d68/l90 1 1 2024-04-23T14:49:56.541 INFO:tasks.workunit.client.1.smithi156.stdout:6/544: unlink d3/da/d1d/f21 0 2024-04-23T14:49:56.541 INFO:tasks.workunit.client.1.smithi156.stdout:6/545: write d3/da/f1a [2221507,98151] 0 2024-04-23T14:49:56.543 INFO:tasks.workunit.client.1.smithi156.stdout:4/407: mkdir d0/df/d55/d68/d85 0 2024-04-23T14:49:56.543 INFO:tasks.workunit.client.1.smithi156.stdout:4/408: dread - d0/d8/d1e/d4a/f7b zero size 2024-04-23T14:49:56.544 INFO:tasks.workunit.client.1.smithi156.stdout:3/445: dread d4/db/dd/d1d/f37 [0,4194304] 0 2024-04-23T14:49:56.550 INFO:tasks.workunit.client.0.smithi081.stdout:6/797: dwrite d1/d51/d7b/d91/f9f [0,4194304] 0 2024-04-23T14:49:56.550 INFO:tasks.workunit.client.1.smithi156.stdout:8/463: sync 2024-04-23T14:49:56.551 INFO:tasks.workunit.client.0.smithi081.stdout:5/872: truncate d17/d3c/f81 1251332 0 2024-04-23T14:49:56.551 INFO:tasks.workunit.client.0.smithi081.stdout:5/873: read - d17/d1f/ffa zero size 2024-04-23T14:49:56.551 INFO:tasks.workunit.client.0.smithi081.stdout:1/897: sync 2024-04-23T14:49:56.551 INFO:tasks.workunit.client.0.smithi081.stdout:3/698: sync 2024-04-23T14:49:56.551 INFO:tasks.workunit.client.0.smithi081.stdout:1/898: fdatasync d3/d3d/d41/f9c 0 2024-04-23T14:49:56.551 INFO:tasks.workunit.client.0.smithi081.stdout:3/699: write d4/d7/df/f19 [75374,78291] 0 2024-04-23T14:49:56.552 INFO:tasks.workunit.client.1.smithi156.stdout:0/469: symlink d0/d16/d43/la0 0 2024-04-23T14:49:56.552 INFO:tasks.workunit.client.1.smithi156.stdout:0/470: fdatasync d0/d4/d22/d58/f69 0 2024-04-23T14:49:56.552 INFO:tasks.workunit.client.0.smithi081.stdout:7/704: rmdir d3/d21/d41/da3 39 2024-04-23T14:49:56.554 INFO:tasks.workunit.client.0.smithi081.stdout:2/763: rmdir d1/d11/dab 39 2024-04-23T14:49:56.557 INFO:tasks.workunit.client.1.smithi156.stdout:1/527: rename db/d1f/d34/d63/f8e to db/d1f/d2d/d93/fac 0 2024-04-23T14:49:56.559 INFO:tasks.workunit.client.1.smithi156.stdout:7/514: mknod dc/d93/d6c/c99 0 2024-04-23T14:49:56.561 INFO:tasks.workunit.client.1.smithi156.stdout:6/546: symlink d3/da/d1d/d59/lc6 0 2024-04-23T14:49:56.561 INFO:tasks.workunit.client.1.smithi156.stdout:6/547: read d3/d16/f37 [1285331,15561] 0 2024-04-23T14:49:56.563 INFO:tasks.workunit.client.1.smithi156.stdout:3/446: symlink d4/db/dd/d20/l83 0 2024-04-23T14:49:56.567 INFO:tasks.workunit.client.1.smithi156.stdout:8/464: creat d5/d39/d99/f9f x:0 0 0 2024-04-23T14:49:56.569 INFO:tasks.workunit.client.0.smithi081.stdout:1/899: write d3/d3d/d7a/fe5 [1672652,105235] 0 2024-04-23T14:49:56.569 INFO:tasks.workunit.client.0.smithi081.stdout:1/900: truncate d3/d3d/d41/d5e/d9d/f11c 775520 0 2024-04-23T14:49:56.569 INFO:tasks.workunit.client.1.smithi156.stdout:2/465: dread d4/d21/d76/f9b [0,4194304] 0 2024-04-23T14:49:56.570 INFO:tasks.workunit.client.0.smithi081.stdout:6/798: symlink d1/d51/d65/d13/d16/dd0/df7/da1/l115 0 2024-04-23T14:49:56.572 INFO:tasks.workunit.client.0.smithi081.stdout:0/895: dwrite d6/d11/d14/f10e [0,4194304] 0 2024-04-23T14:49:56.572 INFO:tasks.workunit.client.0.smithi081.stdout:0/896: creat d6/d11/d14/db8/f119 x:0 0 0 2024-04-23T14:49:56.572 INFO:tasks.workunit.client.1.smithi156.stdout:0/471: creat d0/d16/d3a/fa1 x:0 0 0 2024-04-23T14:49:56.572 INFO:tasks.workunit.client.1.smithi156.stdout:0/472: creat d0/d4/fa2 x:0 0 0 2024-04-23T14:49:56.572 INFO:tasks.workunit.client.1.smithi156.stdout:4/409: rename d0/df/d55/d68/f6f to d0/df/f86 0 2024-04-23T14:49:56.573 INFO:tasks.workunit.client.1.smithi156.stdout:7/515: stat dc/d1d/d24/c5e 0 2024-04-23T14:49:56.574 INFO:tasks.workunit.client.1.smithi156.stdout:7/516: truncate dc/d1d/f95 768542 0 2024-04-23T14:49:56.574 INFO:tasks.workunit.client.1.smithi156.stdout:7/517: dread - dc/d1d/d24/f98 zero size 2024-04-23T14:49:56.574 INFO:tasks.workunit.client.1.smithi156.stdout:6/548: getdents d3/d16/d46/d64/d77 0 2024-04-23T14:49:56.575 INFO:tasks.workunit.client.1.smithi156.stdout:6/549: write d3/da/d1d/d27/f8e [260583,118180] 0 2024-04-23T14:49:56.576 INFO:tasks.workunit.client.0.smithi081.stdout:9/764: sync 2024-04-23T14:49:56.576 INFO:tasks.workunit.client.0.smithi081.stdout:4/759: sync 2024-04-23T14:49:56.576 INFO:tasks.workunit.client.0.smithi081.stdout:8/975: sync 2024-04-23T14:49:56.582 INFO:tasks.workunit.client.1.smithi156.stdout:8/465: mknod d5/d9/d36/ca0 0 2024-04-23T14:49:56.589 INFO:tasks.workunit.client.1.smithi156.stdout:1/528: dread db/f11 [0,4194304] 0 2024-04-23T14:49:56.589 INFO:tasks.workunit.client.0.smithi081.stdout:3/700: creat d4/d7/d32/da6/dc4/d47/fdb x:0 0 0 2024-04-23T14:49:56.589 INFO:tasks.workunit.client.0.smithi081.stdout:3/701: dread - d4/d7/d7f/d85/fd1 zero size 2024-04-23T14:49:56.591 INFO:tasks.workunit.client.0.smithi081.stdout:1/901: read d3/d3d/d41/d92/da6/fdd [3190008,34412] 0 2024-04-23T14:49:56.594 INFO:tasks.workunit.client.0.smithi081.stdout:7/705: unlink d3/l7b 0 2024-04-23T14:49:56.594 INFO:tasks.workunit.client.0.smithi081.stdout:7/706: fdatasync d3/d21/d41/d7c/dc3/fac 0 2024-04-23T14:49:56.594 INFO:tasks.workunit.client.0.smithi081.stdout:7/707: chown d3/d11/d2c/d75/c44 309 1 2024-04-23T14:49:56.594 INFO:tasks.workunit.client.0.smithi081.stdout:7/708: write d3/d21/d31/d50/da2/f8c [1488832,39852] 0 2024-04-23T14:49:56.594 INFO:tasks.workunit.client.0.smithi081.stdout:7/709: creat d3/d21/d41/d7c/ff6 x:0 0 0 2024-04-23T14:49:56.595 INFO:tasks.workunit.client.1.smithi156.stdout:0/473: unlink d0/f46 0 2024-04-23T14:49:56.597 INFO:tasks.workunit.client.0.smithi081.stdout:2/764: creat d1/d1e/f106 x:0 0 0 2024-04-23T14:49:56.601 INFO:tasks.workunit.client.1.smithi156.stdout:9/394: dwrite d1/fe [0,4194304] 0 2024-04-23T14:49:56.602 INFO:tasks.workunit.client.1.smithi156.stdout:6/550: unlink d3/da/d1d/d59/d72/c89 0 2024-04-23T14:49:56.609 INFO:tasks.workunit.client.0.smithi081.stdout:8/976: dread d3/d11/d48/f111 [0,4194304] 0 2024-04-23T14:49:56.610 INFO:tasks.workunit.client.1.smithi156.stdout:8/466: symlink d5/d39/d99/la1 0 2024-04-23T14:49:56.611 INFO:tasks.workunit.client.1.smithi156.stdout:8/467: write d5/d9/d36/d9c/f56 [2817876,96391] 0 2024-04-23T14:49:56.611 INFO:tasks.workunit.client.1.smithi156.stdout:2/466: write d4/d21/d2f/f74 [1029227,101405] 0 2024-04-23T14:49:56.612 INFO:tasks.workunit.client.1.smithi156.stdout:2/467: read - d4/d21/d42/f89 zero size 2024-04-23T14:49:56.614 INFO:tasks.workunit.client.0.smithi081.stdout:0/897: creat d6/d37/d67/f11a x:0 0 0 2024-04-23T14:49:56.615 INFO:tasks.workunit.client.1.smithi156.stdout:1/529: unlink db/d25/d30/f59 0 2024-04-23T14:49:56.615 INFO:tasks.workunit.client.1.smithi156.stdout:1/530: fsync db/d1f/d2f/f55 0 2024-04-23T14:49:56.615 INFO:tasks.workunit.client.1.smithi156.stdout:1/531: dread - db/d1f/d2d/d93/fac zero size 2024-04-23T14:49:56.615 INFO:tasks.workunit.client.1.smithi156.stdout:1/532: dread - db/d1f/f76 zero size 2024-04-23T14:49:56.618 INFO:tasks.workunit.client.0.smithi081.stdout:5/874: write d17/d3d/d41/f5e [686285,75314] 0 2024-04-23T14:49:56.618 INFO:tasks.workunit.client.0.smithi081.stdout:5/875: fsync d17/d18/dff/d59/f9c 0 2024-04-23T14:49:56.620 INFO:tasks.workunit.client.1.smithi156.stdout:9/395: read d1/d2/d3e/d55/f6b [2935681,99938] 0 2024-04-23T14:49:56.621 INFO:tasks.workunit.client.1.smithi156.stdout:0/474: symlink d0/d16/d3a/d2a/d1d/d2d/la3 0 2024-04-23T14:49:56.623 INFO:tasks.workunit.client.0.smithi081.stdout:9/765: creat d3/de/d1d/d62/ff8 x:0 0 0 2024-04-23T14:49:56.624 INFO:tasks.workunit.client.0.smithi081.stdout:9/766: write d3/de/d14/f2c [5208755,23665] 0 2024-04-23T14:49:56.624 INFO:tasks.workunit.client.0.smithi081.stdout:9/767: creat d3/de/d1d/d5b/d7b/ff9 x:0 0 0 2024-04-23T14:49:56.626 INFO:tasks.workunit.client.0.smithi081.stdout:4/760: truncate d1/d1d/d59/f65 3335391 0 2024-04-23T14:49:56.631 INFO:tasks.workunit.client.0.smithi081.stdout:3/702: write d4/d7/d7f/d85/d9d/f74 [657568,112412] 0 2024-04-23T14:49:56.631 INFO:tasks.workunit.client.0.smithi081.stdout:3/703: read - d4/d7/d2e/fc9 zero size 2024-04-23T14:49:56.631 INFO:tasks.workunit.client.0.smithi081.stdout:3/704: read d4/d7/d32/fa9 [2783427,123242] 0 2024-04-23T14:49:56.633 INFO:tasks.workunit.client.0.smithi081.stdout:0/898: read d6/ff [1756328,91241] 0 2024-04-23T14:49:56.635 INFO:tasks.workunit.client.1.smithi156.stdout:4/410: dwrite d0/f46 [0,4194304] 0 2024-04-23T14:49:56.636 INFO:tasks.workunit.client.1.smithi156.stdout:7/518: dwrite dc/d2c/d68/f97 [0,4194304] 0 2024-04-23T14:49:56.636 INFO:tasks.workunit.client.1.smithi156.stdout:7/519: stat dc/d46/d58 0 2024-04-23T14:49:56.636 INFO:tasks.workunit.client.1.smithi156.stdout:7/520: write dc/d1d/d24/f62 [1210397,12190] 0 2024-04-23T14:49:56.637 INFO:tasks.workunit.client.1.smithi156.stdout:7/521: stat dc/d1d/d24/d5a/c85 0 2024-04-23T14:49:56.637 INFO:tasks.workunit.client.0.smithi081.stdout:7/710: symlink d3/d11/d2c/d75/lf7 0 2024-04-23T14:49:56.637 INFO:tasks.workunit.client.0.smithi081.stdout:7/711: readlink d3/d21/d31/d63/lc1 0 2024-04-23T14:49:56.637 INFO:tasks.workunit.client.0.smithi081.stdout:7/712: getdents d3/d21/d41/dd2 0 2024-04-23T14:49:56.638 INFO:tasks.workunit.client.0.smithi081.stdout:1/902: dwrite d3/d3d/d41/d5e/dd2/fd4 [0,4194304] 0 2024-04-23T14:49:56.638 INFO:tasks.workunit.client.1.smithi156.stdout:8/468: link d5/d9/d10/f88 d5/d9/d10/fa2 0 2024-04-23T14:49:56.639 INFO:tasks.workunit.client.0.smithi081.stdout:2/765: unlink d1/d11/c16 0 2024-04-23T14:49:56.641 INFO:tasks.workunit.client.1.smithi156.stdout:1/533: unlink db/d1f/d2d/d93/fac 0 2024-04-23T14:49:56.641 INFO:tasks.workunit.client.1.smithi156.stdout:1/534: write db/d1f/d2f/d47/d71/fa4 [135347,48142] 0 2024-04-23T14:49:56.642 INFO:tasks.workunit.client.1.smithi156.stdout:1/535: dread - db/d25/d30/d38/d40/faa zero size 2024-04-23T14:49:56.643 INFO:tasks.workunit.client.1.smithi156.stdout:7/522: write dc/d1d/d24/f27 [1111896,105644] 0 2024-04-23T14:49:56.643 INFO:tasks.workunit.client.1.smithi156.stdout:7/523: chown dc/d1d/d24/f4a 7508 1 2024-04-23T14:49:56.643 INFO:tasks.workunit.client.1.smithi156.stdout:7/524: chown dc/d2c/d68/f97 2992 1 2024-04-23T14:49:56.644 INFO:tasks.workunit.client.0.smithi081.stdout:8/977: rename d3/d11/d3e/d63/d78/da0 to d3/d11/d34/d142 0 2024-04-23T14:49:56.646 INFO:tasks.workunit.client.1.smithi156.stdout:9/396: mknod d1/d2/d3e/d50/d7a/dc/c8a 0 2024-04-23T14:49:56.652 INFO:tasks.workunit.client.1.smithi156.stdout:4/411: creat d0/df/d75/f87 x:0 0 0 2024-04-23T14:49:56.652 INFO:tasks.workunit.client.0.smithi081.stdout:8/978: write d3/d11/d48/d7e/f95 [686145,119905] 0 2024-04-23T14:49:56.655 INFO:tasks.workunit.client.0.smithi081.stdout:4/761: mknod d1/d4/d11/d75/cf6 0 2024-04-23T14:49:56.655 INFO:tasks.workunit.client.0.smithi081.stdout:0/899: mknod d6/d11/d14/d41/d5b/d59/d102/c11b 0 2024-04-23T14:49:56.655 INFO:tasks.workunit.client.0.smithi081.stdout:0/900: readlink d6/d37/l7b 0 2024-04-23T14:49:56.664 INFO:tasks.workunit.client.1.smithi156.stdout:5/528: sync 2024-04-23T14:49:56.670 INFO:tasks.workunit.client.0.smithi081.stdout:7/713: creat d3/d21/d41/dbb/ff8 x:0 0 0 2024-04-23T14:49:56.670 INFO:tasks.workunit.client.0.smithi081.stdout:7/714: read d3/d21/d31/f38 [3388229,12301] 0 2024-04-23T14:49:56.670 INFO:tasks.workunit.client.0.smithi081.stdout:7/715: truncate d3/d21/d31/f3a 1882718 0 2024-04-23T14:49:56.674 INFO:tasks.workunit.client.1.smithi156.stdout:6/551: dwrite d3/da/f38 [0,4194304] 0 2024-04-23T14:49:56.675 INFO:tasks.workunit.client.0.smithi081.stdout:0/901: dread d6/d11/db0/fbe [0,4194304] 0 2024-04-23T14:49:56.675 INFO:tasks.workunit.client.0.smithi081.stdout:0/902: chown d6/d37/d67/l6e 0 1 2024-04-23T14:49:56.675 INFO:tasks.workunit.client.0.smithi081.stdout:0/903: write d6/d37/d67/d7d/f90 [4725321,6847] 0 2024-04-23T14:49:56.675 INFO:tasks.workunit.client.0.smithi081.stdout:0/904: write d6/d11/d14/d41/d5b/d3f/d44/d78/fc7 [45532,99938] 0 2024-04-23T14:49:56.675 INFO:tasks.workunit.client.1.smithi156.stdout:2/468: link d4/l27 d4/d13/d19/d97/la5 0 2024-04-23T14:49:56.675 INFO:tasks.workunit.client.1.smithi156.stdout:2/469: truncate d4/d13/f14 8819450 0 2024-04-23T14:49:56.680 INFO:tasks.workunit.client.0.smithi081.stdout:1/903: dread d3/d3d/d41/d5e/d17/d25/f4d [0,4194304] 0 2024-04-23T14:49:56.687 INFO:tasks.workunit.client.0.smithi081.stdout:9/768: rename d3/d1a/d6c/f42 to d3/de/d76/db5/ffa 0 2024-04-23T14:49:56.689 INFO:tasks.workunit.client.1.smithi156.stdout:7/525: symlink dc/d2c/d68/l9a 0 2024-04-23T14:49:56.692 INFO:tasks.workunit.client.1.smithi156.stdout:9/397: unlink d1/d2/d3e/d50/d7a/ff 0 2024-04-23T14:49:56.692 INFO:tasks.workunit.client.1.smithi156.stdout:9/398: readlink d1/d2/d3e/d50/d7a/d17/l24 0 2024-04-23T14:49:56.697 INFO:tasks.workunit.client.1.smithi156.stdout:2/470: write d4/f62 [1321833,45189] 0 2024-04-23T14:49:56.697 INFO:tasks.workunit.client.1.smithi156.stdout:2/471: dread - d4/d21/d42/f89 zero size 2024-04-23T14:49:56.697 INFO:tasks.workunit.client.1.smithi156.stdout:2/472: write d4/d13/d19/d4c/f91 [415336,84069] 0 2024-04-23T14:49:56.698 INFO:tasks.workunit.client.0.smithi081.stdout:2/766: dwrite d1/d11/f12 [0,4194304] 0 2024-04-23T14:49:56.698 INFO:tasks.workunit.client.0.smithi081.stdout:7/716: unlink d3/d21/d31/d33/c7a 0 2024-04-23T14:49:56.702 INFO:tasks.workunit.client.0.smithi081.stdout:1/904: creat d3/d3d/de9/f12c x:0 0 0 2024-04-23T14:49:56.704 INFO:tasks.workunit.client.0.smithi081.stdout:8/979: rename d3/d11/d4f/d6c/cd9 to d3/d3c/ddb/c143 0 2024-04-23T14:49:56.705 INFO:tasks.workunit.client.1.smithi156.stdout:2/473: dread d4/f17 [0,4194304] 0 2024-04-23T14:49:56.710 INFO:tasks.workunit.client.0.smithi081.stdout:4/762: dwrite d1/d4/d11/d9d/dac/fcb [0,4194304] 0 2024-04-23T14:49:56.710 INFO:tasks.workunit.client.1.smithi156.stdout:0/475: rmdir d0/d16/d3a/d2a 39 2024-04-23T14:49:56.710 INFO:tasks.workunit.client.1.smithi156.stdout:7/526: write dc/d2c/d68/f97 [2199067,32710] 0 2024-04-23T14:49:56.712 INFO:tasks.workunit.client.0.smithi081.stdout:2/767: link d1/d33/d45/d6e/d96/f63 d1/f107 0 2024-04-23T14:49:56.715 INFO:tasks.workunit.client.1.smithi156.stdout:4/412: rename d0/d8/c7a to d0/df/d55/d68/d85/c88 0 2024-04-23T14:49:56.717 INFO:tasks.workunit.client.0.smithi081.stdout:1/905: link d3/d3d/d41/d5e/d5d/db0/f83 d3/d3d/d41/d4a/f12d 0 2024-04-23T14:49:56.718 INFO:tasks.workunit.client.1.smithi156.stdout:5/529: symlink d1/la7 0 2024-04-23T14:49:56.720 INFO:tasks.workunit.client.0.smithi081.stdout:7/717: write d3/d11/d2c/f3d [1542775,59219] 0 2024-04-23T14:49:56.720 INFO:tasks.workunit.client.0.smithi081.stdout:7/718: chown d3/d21/d41/d7c/dc3/d7f/d98/cf5 27798 1 2024-04-23T14:49:56.720 INFO:tasks.workunit.client.0.smithi081.stdout:9/769: dwrite d3/de/d1d/d5b/d7b/ff9 [0,4194304] 0 2024-04-23T14:49:56.725 INFO:tasks.workunit.client.0.smithi081.stdout:2/768: mkdir d1/d11/df7/df9/d108 0 2024-04-23T14:49:56.725 INFO:tasks.workunit.client.0.smithi081.stdout:0/905: dwrite d6/d11/d14/d41/d5b/d59/d68/dbd/fea [4194304,4194304] 0 2024-04-23T14:49:56.727 INFO:tasks.workunit.client.1.smithi156.stdout:8/469: rmdir d5/d39 39 2024-04-23T14:49:56.728 INFO:tasks.workunit.client.0.smithi081.stdout:1/906: mknod d3/d3d/d41/d5e/dd2/dd5/df2/c12e 0 2024-04-23T14:49:56.729 INFO:tasks.workunit.client.1.smithi156.stdout:5/530: dread d1/d11/f4d [0,4194304] 0 2024-04-23T14:49:56.741 INFO:tasks.workunit.client.0.smithi081.stdout:2/769: creat d1/d11/df7/df9/d108/f109 x:0 0 0 2024-04-23T14:49:56.741 INFO:tasks.workunit.client.0.smithi081.stdout:2/770: dread - d1/d11/dab/ff3 zero size 2024-04-23T14:49:56.743 INFO:tasks.workunit.client.1.smithi156.stdout:1/536: symlink db/d1f/d34/lad 0 2024-04-23T14:49:56.743 INFO:tasks.workunit.client.1.smithi156.stdout:1/537: fsync db/d25/d30/d38/f80 0 2024-04-23T14:49:56.743 INFO:tasks.workunit.client.1.smithi156.stdout:1/538: write db/d25/f3d [3636684,52157] 0 2024-04-23T14:49:56.743 INFO:tasks.workunit.client.1.smithi156.stdout:1/539: chown db/f11 401707318 1 2024-04-23T14:49:56.743 INFO:tasks.workunit.client.1.smithi156.stdout:1/540: read - db/d1f/d2f/f7b zero size 2024-04-23T14:49:56.744 INFO:tasks.workunit.client.0.smithi081.stdout:0/906: mkdir d6/d11/d14/dec/d11c 0 2024-04-23T14:49:56.744 INFO:tasks.workunit.client.0.smithi081.stdout:0/907: creat d6/d37/d67/f11d x:0 0 0 2024-04-23T14:49:56.745 INFO:tasks.workunit.client.1.smithi156.stdout:9/399: mknod d1/d2/d23/d49/c8b 0 2024-04-23T14:49:56.745 INFO:tasks.workunit.client.1.smithi156.stdout:9/400: fsync d1/d2/d3e/d50/d7a/dc/f41 0 2024-04-23T14:49:56.746 INFO:tasks.workunit.client.1.smithi156.stdout:1/541: read db/d1f/d28/fa8 [610033,89615] 0 2024-04-23T14:49:56.746 INFO:tasks.workunit.client.1.smithi156.stdout:1/542: read - db/d1f/d28/d70/f7d zero size 2024-04-23T14:49:56.747 INFO:tasks.workunit.client.0.smithi081.stdout:1/907: truncate d3/d3d/d41/d4a/d77/f82 124074 0 2024-04-23T14:49:56.751 INFO:tasks.workunit.client.0.smithi081.stdout:7/719: mknod d3/d21/d31/d33/d4b/d4c/cf9 0 2024-04-23T14:49:56.753 INFO:tasks.workunit.client.1.smithi156.stdout:3/447: sync 2024-04-23T14:49:56.753 INFO:tasks.workunit.client.1.smithi156.stdout:3/448: chown d4/l5b 549722 1 2024-04-23T14:49:56.753 INFO:tasks.workunit.client.1.smithi156.stdout:7/527: creat dc/d1d/d24/d5a/f9b x:0 0 0 2024-04-23T14:49:56.753 INFO:tasks.workunit.client.1.smithi156.stdout:3/449: creat d4/db/d4b/f84 x:0 0 0 2024-04-23T14:49:56.754 INFO:tasks.workunit.client.1.smithi156.stdout:9/401: dread d1/d2/d3e/d50/f7c [0,4194304] 0 2024-04-23T14:49:56.754 INFO:tasks.workunit.client.0.smithi081.stdout:2/771: creat d1/d11/d21/d52/d8b/f10a x:0 0 0 2024-04-23T14:49:56.757 INFO:tasks.workunit.client.1.smithi156.stdout:4/413: link d0/d8/d1e/d4a/c48 d0/df/d55/d68/c89 0 2024-04-23T14:49:56.757 INFO:tasks.workunit.client.1.smithi156.stdout:4/414: dread - d0/df/d55/f73 zero size 2024-04-23T14:49:56.758 INFO:tasks.workunit.client.0.smithi081.stdout:0/908: stat d6/d11/d14/d41/d5b/d3f/d44/d78/c95 0 2024-04-23T14:49:56.759 INFO:tasks.workunit.client.0.smithi081.stdout:0/909: write d6/d11/d14/d41/d5b/d3f/ded/fe6 [719307,112512] 0 2024-04-23T14:49:56.759 INFO:tasks.workunit.client.0.smithi081.stdout:0/910: chown d6/d11/d14/f73 33 1 2024-04-23T14:49:56.762 INFO:tasks.workunit.client.1.smithi156.stdout:7/528: fsync dc/d2c/d68/f97 0 2024-04-23T14:49:56.762 INFO:tasks.workunit.client.1.smithi156.stdout:6/552: rename d3/d16/d46/d9d/d9f/dad/laf to d3/da/d1d/d27/d80/da5/lc7 0 2024-04-23T14:49:56.762 INFO:tasks.workunit.client.1.smithi156.stdout:6/553: write d3/da/fa0 [589886,54698] 0 2024-04-23T14:49:56.762 INFO:tasks.workunit.client.1.smithi156.stdout:6/554: dread - d3/da/d1d/d27/f98 zero size 2024-04-23T14:49:56.763 INFO:tasks.workunit.client.0.smithi081.stdout:1/908: mkdir d3/d3d/d41/d5e/d5d/db0/d12f 0 2024-04-23T14:49:56.769 INFO:tasks.workunit.client.1.smithi156.stdout:8/470: link d5/c65 d5/d9/d36/d60/d7c/ca3 0 2024-04-23T14:49:56.769 INFO:tasks.workunit.client.1.smithi156.stdout:8/471: chown d5/d9 1 1 2024-04-23T14:49:56.774 INFO:tasks.workunit.client.1.smithi156.stdout:1/543: symlink db/d1f/d94/da1/d7c/lae 0 2024-04-23T14:49:56.775 INFO:tasks.workunit.client.1.smithi156.stdout:4/415: dread d0/df/d55/f2e [0,4194304] 0 2024-04-23T14:49:56.776 INFO:tasks.workunit.client.1.smithi156.stdout:0/476: rmdir d0/d4/d11/d3f/d45 39 2024-04-23T14:49:56.776 INFO:tasks.workunit.client.1.smithi156.stdout:0/477: truncate d0/d16/d3a/d2a/d1d/d2d/f85 20456 0 2024-04-23T14:49:56.776 INFO:tasks.workunit.client.1.smithi156.stdout:0/478: stat d0/d4/d22/d58/d9a/d44/d4a/f57 0 2024-04-23T14:49:56.776 INFO:tasks.workunit.client.1.smithi156.stdout:0/479: dread - d0/d16/d3a/f6a zero size 2024-04-23T14:49:56.777 INFO:tasks.workunit.client.0.smithi081.stdout:7/720: mknod d3/d21/d41/d7c/dc3/d7f/cfa 0 2024-04-23T14:49:56.777 INFO:tasks.workunit.client.1.smithi156.stdout:5/531: unlink d1/d3/d64/f69 0 2024-04-23T14:49:56.777 INFO:tasks.workunit.client.1.smithi156.stdout:5/532: truncate d1/d11/d18/d19/d74/f9d 956806 0 2024-04-23T14:49:56.778 INFO:tasks.workunit.client.1.smithi156.stdout:5/533: chown d1/d17/d7e 1762062 1 2024-04-23T14:49:56.778 INFO:tasks.workunit.client.1.smithi156.stdout:3/450: symlink d4/db/dd/d1d/l85 0 2024-04-23T14:49:56.779 INFO:tasks.workunit.client.0.smithi081.stdout:0/911: mknod d6/d11/d14/d41/d5b/d59/db6/c11e 0 2024-04-23T14:49:56.779 INFO:tasks.workunit.client.0.smithi081.stdout:2/772: rename d1/d33/d45/d48/fde to d1/d11/f10b 0 2024-04-23T14:49:56.780 INFO:tasks.workunit.client.1.smithi156.stdout:9/402: mkdir d1/d2/d8c 0 2024-04-23T14:49:56.781 INFO:tasks.workunit.client.1.smithi156.stdout:9/403: write d1/f51 [4877558,94956] 0 2024-04-23T14:49:56.781 INFO:tasks.workunit.client.1.smithi156.stdout:9/404: chown d1/d2/d3e/d50/d7a/d17/d1f/d48 148 1 2024-04-23T14:49:56.782 INFO:tasks.workunit.client.0.smithi081.stdout:0/912: mknod d6/d11/d14/d41/d5b/d59/d8e/c11f 0 2024-04-23T14:49:56.786 INFO:tasks.workunit.client.1.smithi156.stdout:8/472: symlink d5/d9/d10/d1d/d21/la4 0 2024-04-23T14:49:56.786 INFO:tasks.workunit.client.1.smithi156.stdout:8/473: readlink d5/d9/d36/d60/d62/l94 0 2024-04-23T14:49:56.786 INFO:tasks.workunit.client.1.smithi156.stdout:8/474: stat d5/d9/d36/d60/d62/d97 0 2024-04-23T14:49:56.788 INFO:tasks.workunit.client.0.smithi081.stdout:2/773: mknod d1/d11/d21/d34/c10c 0 2024-04-23T14:49:56.788 INFO:tasks.workunit.client.0.smithi081.stdout:4/763: dwrite d1/d4/d11/f28 [0,4194304] 0 2024-04-23T14:49:56.788 INFO:tasks.workunit.client.0.smithi081.stdout:9/770: dread d3/de/d1d/d54/d68/f7c [4194304,4194304] 0 2024-04-23T14:49:56.788 INFO:tasks.workunit.client.0.smithi081.stdout:9/771: creat d3/de/d1d/d62/ffb x:0 0 0 2024-04-23T14:49:56.788 INFO:tasks.workunit.client.0.smithi081.stdout:0/913: creat d6/d11/d14/d41/d5b/d3f/d44/f120 x:0 0 0 2024-04-23T14:49:56.791 INFO:tasks.workunit.client.1.smithi156.stdout:0/480: mkdir d0/d16/da4 0 2024-04-23T14:49:56.791 INFO:tasks.workunit.client.1.smithi156.stdout:4/416: truncate d0/f3 759993 0 2024-04-23T14:49:56.791 INFO:tasks.workunit.client.1.smithi156.stdout:0/481: fdatasync d0/d4/d11/d3f/d5f/f1f 0 2024-04-23T14:49:56.791 INFO:tasks.workunit.client.1.smithi156.stdout:0/482: chown d0/d4/d22/d58/f69 93284 1 2024-04-23T14:49:56.791 INFO:tasks.workunit.client.1.smithi156.stdout:3/451: rename d4/db/dd/d1d/d1e/ff to d4/f86 0 2024-04-23T14:49:56.794 INFO:tasks.workunit.client.1.smithi156.stdout:9/405: creat d1/d2/d3e/d50/d7a/dc/f8d x:0 0 0 2024-04-23T14:49:56.797 INFO:tasks.workunit.client.1.smithi156.stdout:8/475: creat d5/d9/d36/d60/fa5 x:0 0 0 2024-04-23T14:49:56.797 INFO:tasks.workunit.client.1.smithi156.stdout:8/476: write d5/d9/d10/d1d/f7a [3529001,64300] 0 2024-04-23T14:49:56.799 INFO:tasks.workunit.client.0.smithi081.stdout:9/772: mknod d3/de/d1d/d5b/d7b/db2/cfc 0 2024-04-23T14:49:56.799 INFO:tasks.workunit.client.0.smithi081.stdout:0/914: mknod d6/d11/d14/d24/c121 0 2024-04-23T14:49:56.802 INFO:tasks.workunit.client.0.smithi081.stdout:0/915: creat d6/d25/f122 x:0 0 0 2024-04-23T14:49:56.804 INFO:tasks.workunit.client.1.smithi156.stdout:4/417: getdents d0/d8 0 2024-04-23T14:49:56.804 INFO:tasks.workunit.client.1.smithi156.stdout:4/418: write d0/d76/f70 [968564,106457] 0 2024-04-23T14:49:56.804 INFO:tasks.workunit.client.1.smithi156.stdout:4/419: fsync d0/df/f51 0 2024-04-23T14:49:56.805 INFO:tasks.workunit.client.0.smithi081.stdout:0/916: mkdir d6/d11/d14/d41/d111/d123 0 2024-04-23T14:49:56.810 INFO:tasks.workunit.client.1.smithi156.stdout:9/406: mkdir d1/d2/d3e/d55/d6f/d8e 0 2024-04-23T14:49:56.814 INFO:tasks.workunit.client.0.smithi081.stdout:0/917: mknod d6/d11/d14/d41/d5b/d59/c124 0 2024-04-23T14:49:56.820 INFO:tasks.workunit.client.1.smithi156.stdout:8/477: dread d5/d9/d10/f87 [0,4194304] 0 2024-04-23T14:49:56.821 INFO:tasks.workunit.client.0.smithi081.stdout:0/918: unlink d6/d11/d14/d41/d5b/d59/f110 0 2024-04-23T14:49:56.824 INFO:tasks.workunit.client.1.smithi156.stdout:4/420: getdents d0/df/d55/d68/d85 0 2024-04-23T14:49:56.824 INFO:tasks.workunit.client.1.smithi156.stdout:4/421: chown d0/d76/f4d 4151558 1 2024-04-23T14:49:56.824 INFO:tasks.workunit.client.1.smithi156.stdout:9/407: mknod d1/d2/d3e/d50/c8f 0 2024-04-23T14:49:56.825 INFO:tasks.workunit.client.1.smithi156.stdout:4/422: write d0/df/f86 [449420,56610] 0 2024-04-23T14:49:56.830 INFO:tasks.workunit.client.1.smithi156.stdout:2/474: dwrite d4/d13/d19/d58/f63 [0,4194304] 0 2024-04-23T14:49:56.831 INFO:tasks.workunit.client.0.smithi081.stdout:0/919: rename d6/c31 to d6/d11/db0/c125 0 2024-04-23T14:49:56.835 INFO:tasks.workunit.client.0.smithi081.stdout:0/920: getdents d6/d37/d67 0 2024-04-23T14:49:56.839 INFO:tasks.workunit.client.0.smithi081.stdout:9/773: write d3/de/d14/f38 [1084150,63814] 0 2024-04-23T14:49:56.842 INFO:tasks.workunit.client.1.smithi156.stdout:2/475: mknod d4/d13/d19/d4c/ca6 0 2024-04-23T14:49:56.843 INFO:tasks.workunit.client.1.smithi156.stdout:0/483: dread d0/d4/f4e [0,4194304] 0 2024-04-23T14:49:56.844 INFO:tasks.workunit.client.0.smithi081.stdout:0/921: symlink d6/d11/d14/d41/d5b/d3f/d44/d78/d83/d115/l126 0 2024-04-23T14:49:56.844 INFO:tasks.workunit.client.0.smithi081.stdout:0/922: chown d6/d11/d14/d41/d5b/d3f/d44/d78/d83/fd2 378 1 2024-04-23T14:49:56.846 INFO:tasks.workunit.client.1.smithi156.stdout:1/544: dwrite db/d1f/d28/fa8 [0,4194304] 0 2024-04-23T14:49:56.849 INFO:tasks.workunit.client.0.smithi081.stdout:9/774: symlink d3/de/d1d/d73/lfd 0 2024-04-23T14:49:56.849 INFO:tasks.workunit.client.0.smithi081.stdout:9/775: chown d3/led 159 1 2024-04-23T14:49:56.850 INFO:tasks.workunit.client.1.smithi156.stdout:2/476: getdents d4/d13/d88 0 2024-04-23T14:49:56.850 INFO:tasks.workunit.client.1.smithi156.stdout:2/477: chown d4/f62 3899264 1 2024-04-23T14:49:56.850 INFO:tasks.workunit.client.1.smithi156.stdout:2/478: chown d4/d13/d19/d97/la5 24 1 2024-04-23T14:49:56.850 INFO:tasks.workunit.client.0.smithi081.stdout:0/923: rmdir d6/d11/d14/d41/d5b/d59/db6/dfa 0 2024-04-23T14:49:56.853 INFO:tasks.workunit.client.0.smithi081.stdout:0/924: unlink d6/d11/d14/d41/d5b/d59/d68/ldd 0 2024-04-23T14:49:56.853 INFO:tasks.workunit.client.1.smithi156.stdout:0/484: getdents d0/d16/d3a/d2a 0 2024-04-23T14:49:56.853 INFO:tasks.workunit.client.1.smithi156.stdout:0/485: readlink d0/d16/d3a/d2a/d1d/d2d/la3 0 2024-04-23T14:49:56.853 INFO:tasks.workunit.client.1.smithi156.stdout:0/486: write d0/d4/d11/f4b [1944068,69074] 0 2024-04-23T14:49:56.854 INFO:tasks.workunit.client.1.smithi156.stdout:1/545: rename db/d1f/d94/da1/d7c to db/d1f/d2d/d48/daf 0 2024-04-23T14:49:56.855 INFO:tasks.workunit.client.1.smithi156.stdout:2/479: fdatasync d4/d21/f31 0 2024-04-23T14:49:56.855 INFO:tasks.workunit.client.1.smithi156.stdout:2/480: stat d4/d21/d42/f4e 0 2024-04-23T14:49:56.856 INFO:tasks.workunit.client.1.smithi156.stdout:9/408: dread d1/d2/d23/f27 [8388608,4194304] 0 2024-04-23T14:49:56.856 INFO:tasks.workunit.client.1.smithi156.stdout:0/487: truncate d0/d4/d22/f34 248007 0 2024-04-23T14:49:56.856 INFO:tasks.workunit.client.1.smithi156.stdout:0/488: chown d0/d16/d3a/d2a/f87 85935 1 2024-04-23T14:49:56.856 INFO:tasks.workunit.client.1.smithi156.stdout:1/546: symlink db/d1f/d2f/d47/lb0 0 2024-04-23T14:49:56.860 INFO:tasks.workunit.client.1.smithi156.stdout:2/481: unlink d4/d13/l6b 0 2024-04-23T14:49:56.860 INFO:tasks.workunit.client.1.smithi156.stdout:2/482: chown d4/d13/d19/f1e 47 1 2024-04-23T14:49:56.860 INFO:tasks.workunit.client.1.smithi156.stdout:2/483: truncate d4/d21/d42/da1/fa2 563614 0 2024-04-23T14:49:56.860 INFO:tasks.workunit.client.1.smithi156.stdout:2/484: chown d4/f7 1581908994 1 2024-04-23T14:49:56.860 INFO:tasks.workunit.client.0.smithi081.stdout:1/909: dwrite d3/d3d/d41/d5e/fed [0,4194304] 0 2024-04-23T14:49:56.861 INFO:tasks.workunit.client.0.smithi081.stdout:1/910: dread - d3/d3d/d41/d92/df1/f106 zero size 2024-04-23T14:49:56.861 INFO:tasks.workunit.client.1.smithi156.stdout:9/409: getdents d1/d2/d3e/d50/d7a/d17/d1f/d48/d4e 0 2024-04-23T14:49:56.861 INFO:tasks.workunit.client.1.smithi156.stdout:9/410: creat d1/d2/d3e/d50/f90 x:0 0 0 2024-04-23T14:49:56.863 INFO:tasks.workunit.client.1.smithi156.stdout:0/489: symlink d0/d16/d3a/d2a/d1d/la5 0 2024-04-23T14:49:56.865 INFO:tasks.workunit.client.0.smithi081.stdout:1/911: symlink d3/d3d/d41/d5e/d17/d58/l130 0 2024-04-23T14:49:56.865 INFO:tasks.workunit.client.0.smithi081.stdout:1/912: chown d3/ld 1184516408 1 2024-04-23T14:49:56.865 INFO:tasks.workunit.client.0.smithi081.stdout:1/913: truncate d3/d3d/d41/d5e/d5d/db0/f8e 3190643 0 2024-04-23T14:49:56.866 INFO:tasks.workunit.client.1.smithi156.stdout:7/529: dwrite dc/d2a/f92 [0,4194304] 0 2024-04-23T14:49:56.867 INFO:tasks.workunit.client.1.smithi156.stdout:2/485: creat d4/d13/d19/d58/fa7 x:0 0 0 2024-04-23T14:49:56.867 INFO:tasks.workunit.client.0.smithi081.stdout:4/764: dwrite d1/d4/d6f/d70/daf/f82 [0,4194304] 0 2024-04-23T14:49:56.873 INFO:tasks.workunit.client.0.smithi081.stdout:9/776: read d3/de/d1d/d54/f9b [2442685,49566] 0 2024-04-23T14:49:56.873 INFO:tasks.workunit.client.0.smithi081.stdout:9/777: chown d3/de/d14/dab/le8 443873 1 2024-04-23T14:49:56.876 INFO:tasks.workunit.client.1.smithi156.stdout:1/547: read db/f17 [764427,4746] 0 2024-04-23T14:49:56.876 INFO:tasks.workunit.client.1.smithi156.stdout:1/548: write db/d25/d30/f78 [262647,75460] 0 2024-04-23T14:49:56.876 INFO:tasks.workunit.client.0.smithi081.stdout:7/721: dwrite d3/d21/d41/d7c/dc3/f72 [0,4194304] 0 2024-04-23T14:49:56.877 INFO:tasks.workunit.client.1.smithi156.stdout:6/555: dwrite d3/da/d1d/d59/f7e [0,4194304] 0 2024-04-23T14:49:56.878 INFO:tasks.workunit.client.1.smithi156.stdout:8/478: read d5/d45/f55 [1459293,93070] 0 2024-04-23T14:49:56.879 INFO:tasks.workunit.client.1.smithi156.stdout:9/411: link d1/d2/d3e/d55/d6f/f65 d1/d2/d3e/d50/d7a/d17/d1f/d48/f91 0 2024-04-23T14:49:56.879 INFO:tasks.workunit.client.1.smithi156.stdout:9/412: chown d1/d2/d23/f76 393 1 2024-04-23T14:49:56.879 INFO:tasks.workunit.client.1.smithi156.stdout:9/413: write d1/d2/f58 [1404726,120275] 0 2024-04-23T14:49:56.880 INFO:tasks.workunit.client.1.smithi156.stdout:3/452: dwrite d4/db/f2f [4194304,4194304] 0 2024-04-23T14:49:56.880 INFO:tasks.workunit.client.1.smithi156.stdout:3/453: write d4/db/f2f [2797932,77769] 0 2024-04-23T14:49:56.880 INFO:tasks.workunit.client.1.smithi156.stdout:3/454: truncate d4/db/dd/d1d/f37 1916833 0 2024-04-23T14:49:56.880 INFO:tasks.workunit.client.1.smithi156.stdout:0/490: unlink d0/d16/d3a/d1e/l66 0 2024-04-23T14:49:56.880 INFO:tasks.workunit.client.1.smithi156.stdout:0/491: read d0/d4/d11/d3f/f51 [1716203,34118] 0 2024-04-23T14:49:56.881 INFO:tasks.workunit.client.0.smithi081.stdout:1/914: creat d3/d3d/d41/d5e/d17/f131 x:0 0 0 2024-04-23T14:49:56.889 INFO:tasks.workunit.client.1.smithi156.stdout:7/530: link dc/d2c/d68/f75 dc/d1d/d41/f9c 0 2024-04-23T14:49:56.890 INFO:tasks.workunit.client.0.smithi081.stdout:9/778: rmdir d3/de/d76/db5 39 2024-04-23T14:49:56.890 INFO:tasks.workunit.client.0.smithi081.stdout:9/779: chown d3/de/d25/f60 34258676 1 2024-04-23T14:49:56.890 INFO:tasks.workunit.client.1.smithi156.stdout:5/534: dwrite d1/d11/d18/d52/d85/f9b [0,4194304] 0 2024-04-23T14:49:56.896 INFO:tasks.workunit.client.1.smithi156.stdout:1/549: read db/d1f/d28/fa8 [275290,89000] 0 2024-04-23T14:49:56.897 INFO:tasks.workunit.client.1.smithi156.stdout:9/414: write d1/d2/d23/d49/d4b/f5b [3309013,49734] 0 2024-04-23T14:49:56.899 INFO:tasks.workunit.client.1.smithi156.stdout:9/415: write d1/d2/d3e/d50/d7a/d17/f2c [4614317,10416] 0 2024-04-23T14:49:56.899 INFO:tasks.workunit.client.1.smithi156.stdout:9/416: write d1/d2/d3e/d50/d7a/d17/d1f/d48/f4f [43469,130641] 0 2024-04-23T14:49:56.900 INFO:tasks.workunit.client.1.smithi156.stdout:9/417: creat d1/d2/d3e/d50/d7a/dc/f92 x:0 0 0 2024-04-23T14:49:56.900 INFO:tasks.workunit.client.0.smithi081.stdout:1/915: dread d3/d3d/d41/d4a/d77/f98 [4194304,4194304] 0 2024-04-23T14:49:56.901 INFO:tasks.workunit.client.0.smithi081.stdout:7/722: unlink d3/d21/d31/d33/d4b/d6e/fce 0 2024-04-23T14:49:56.901 INFO:tasks.workunit.client.1.smithi156.stdout:9/418: write d1/d2/d23/d75/f7b [537016,37923] 0 2024-04-23T14:49:56.901 INFO:tasks.workunit.client.1.smithi156.stdout:9/419: write d1/d2/d3e/d50/d7a/d19/f26 [9088958,1535] 0 2024-04-23T14:49:56.901 INFO:tasks.workunit.client.1.smithi156.stdout:9/420: chown d1/d2/d23/f76 18 1 2024-04-23T14:49:56.906 INFO:tasks.workunit.client.0.smithi081.stdout:9/780: symlink d3/de/d1d/dd9/lfe 0 2024-04-23T14:49:56.914 INFO:tasks.workunit.client.0.smithi081.stdout:1/916: creat d3/d3d/d41/d5e/da0/dbb/f132 x:0 0 0 2024-04-23T14:49:56.914 INFO:tasks.workunit.client.0.smithi081.stdout:1/917: write d3/d3d/d41/d5e/da0/f11e [779029,103355] 0 2024-04-23T14:49:56.914 INFO:tasks.workunit.client.0.smithi081.stdout:1/918: write d3/d3d/d41/d5e/f11b [4518956,71714] 0 2024-04-23T14:49:56.916 INFO:tasks.workunit.client.0.smithi081.stdout:9/781: stat d3/de/d1d/lef 0 2024-04-23T14:49:56.919 INFO:tasks.workunit.client.1.smithi156.stdout:6/556: mkdir d3/d16/d46/d2b/d97/dc8 0 2024-04-23T14:49:56.919 INFO:tasks.workunit.client.1.smithi156.stdout:6/557: fsync d3/d16/d46/f60 0 2024-04-23T14:49:56.921 INFO:tasks.workunit.client.1.smithi156.stdout:8/479: rename d5/d9/d36/d9c/f50 to d5/d9/d5a/d57/fa6 0 2024-04-23T14:49:56.924 INFO:tasks.workunit.client.0.smithi081.stdout:9/782: dread d3/de/d76/db5/ffa [0,4194304] 0 2024-04-23T14:49:56.925 INFO:tasks.workunit.client.0.smithi081.stdout:7/723: rmdir d3/d21/d31/d63 39 2024-04-23T14:49:56.928 INFO:tasks.workunit.client.0.smithi081.stdout:1/919: mknod d3/d3d/d41/d5e/d17/c133 0 2024-04-23T14:49:56.928 INFO:tasks.workunit.client.0.smithi081.stdout:1/920: write d3/d3d/f13 [4698531,90944] 0 2024-04-23T14:49:56.930 INFO:tasks.workunit.client.0.smithi081.stdout:9/783: mknod d3/de/d25/cff 0 2024-04-23T14:49:56.932 INFO:tasks.workunit.client.0.smithi081.stdout:0/925: dwrite d6/d11/d14/d24/f4b [0,4194304] 0 2024-04-23T14:49:56.932 INFO:tasks.workunit.client.0.smithi081.stdout:0/926: dread - d6/d37/ff9 zero size 2024-04-23T14:49:56.932 INFO:tasks.workunit.client.0.smithi081.stdout:0/927: truncate d6/d11/d14/d41/d5b/d3f/d44/d78/d84/f107 753715 0 2024-04-23T14:49:56.932 INFO:tasks.workunit.client.0.smithi081.stdout:0/928: creat d6/d11/d14/db8/f127 x:0 0 0 2024-04-23T14:49:56.932 INFO:tasks.workunit.client.0.smithi081.stdout:0/929: write d6/d37/ff9 [788751,33409] 0 2024-04-23T14:49:56.933 INFO:tasks.workunit.client.1.smithi156.stdout:7/531: mkdir dc/d9d 0 2024-04-23T14:49:56.935 INFO:tasks.workunit.client.0.smithi081.stdout:1/921: creat d3/d3d/d41/d4a/f134 x:0 0 0 2024-04-23T14:49:56.938 INFO:tasks.workunit.client.0.smithi081.stdout:9/784: unlink d3/de/d47/fa9 0 2024-04-23T14:49:56.939 INFO:tasks.workunit.client.0.smithi081.stdout:4/765: dwrite d1/d4/d6f/d70/daf/d8c/dce/fe0 [0,4194304] 0 2024-04-23T14:49:56.946 INFO:tasks.workunit.client.0.smithi081.stdout:7/724: write d3/d11/d2c/f34 [4115542,84493] 0 2024-04-23T14:49:56.946 INFO:tasks.workunit.client.0.smithi081.stdout:7/725: write d3/d21/d31/d50/d5a/fe2 [547513,92759] 0 2024-04-23T14:49:56.946 INFO:tasks.workunit.client.0.smithi081.stdout:7/726: truncate d3/d21/d31/f38 4482532 0 2024-04-23T14:49:56.946 INFO:tasks.workunit.client.0.smithi081.stdout:7/727: chown d3/d21/d31/d33/d4b/d6e/lb0 9 1 2024-04-23T14:49:56.954 INFO:tasks.workunit.client.0.smithi081.stdout:0/930: unlink d6/d11/d14/d24/db3/dfb/c112 0 2024-04-23T14:49:56.959 INFO:tasks.workunit.client.1.smithi156.stdout:5/535: creat d1/d17/d7e/fa8 x:0 0 0 2024-04-23T14:49:56.964 INFO:tasks.workunit.client.1.smithi156.stdout:2/486: symlink d4/d21/la8 0 2024-04-23T14:49:56.967 INFO:tasks.workunit.client.1.smithi156.stdout:0/492: truncate d0/d4/d22/f34 197499 0 2024-04-23T14:49:56.969 INFO:tasks.workunit.client.0.smithi081.stdout:9/785: link d3/d1a/f9e d3/de/d14/f100 0 2024-04-23T14:49:56.971 INFO:tasks.workunit.client.1.smithi156.stdout:1/550: creat db/d1f/fb1 x:0 0 0 2024-04-23T14:49:56.971 INFO:tasks.workunit.client.1.smithi156.stdout:1/551: stat db/d1f/d34/d63 0 2024-04-23T14:49:56.971 INFO:tasks.workunit.client.1.smithi156.stdout:1/552: fdatasync db/d25/f3b 0 2024-04-23T14:49:56.971 INFO:tasks.workunit.client.1.smithi156.stdout:1/553: readlink db/d1f/d28/l54 0 2024-04-23T14:49:56.972 INFO:tasks.workunit.client.1.smithi156.stdout:1/554: fdatasync db/d25/d30/f43 0 2024-04-23T14:49:56.972 INFO:tasks.workunit.client.1.smithi156.stdout:1/555: write db/d25/d30/d38/f73 [665025,112359] 0 2024-04-23T14:49:56.972 INFO:tasks.workunit.client.0.smithi081.stdout:6/799: sync 2024-04-23T14:49:56.973 INFO:tasks.workunit.client.0.smithi081.stdout:5/876: sync 2024-04-23T14:49:56.973 INFO:tasks.workunit.client.0.smithi081.stdout:5/877: chown d17/l11c 14919 1 2024-04-23T14:49:56.974 INFO:tasks.workunit.client.0.smithi081.stdout:3/705: sync 2024-04-23T14:49:56.975 INFO:tasks.workunit.client.0.smithi081.stdout:3/706: chown d4/dc/ca7 328655 1 2024-04-23T14:49:56.975 INFO:tasks.workunit.client.0.smithi081.stdout:8/980: sync 2024-04-23T14:49:56.978 INFO:tasks.workunit.client.0.smithi081.stdout:7/728: creat d3/d21/d31/d50/da2/ffb x:0 0 0 2024-04-23T14:49:56.979 INFO:tasks.workunit.client.1.smithi156.stdout:5/536: dread d1/d3/d24/da0/d3e/f6c [0,4194304] 0 2024-04-23T14:49:56.988 INFO:tasks.workunit.client.0.smithi081.stdout:9/786: mknod d3/de/d1d/d54/d68/c101 0 2024-04-23T14:49:56.988 INFO:tasks.workunit.client.0.smithi081.stdout:9/787: readlink d3/de/d22/l4d 0 2024-04-23T14:49:56.988 INFO:tasks.workunit.client.0.smithi081.stdout:9/788: chown d3/de/d1d/d62/cc8 16286 1 2024-04-23T14:49:56.989 INFO:tasks.workunit.client.0.smithi081.stdout:9/789: creat d3/de/d1d/d5b/d7b/db2/f102 x:0 0 0 2024-04-23T14:49:56.989 INFO:tasks.workunit.client.0.smithi081.stdout:9/790: fsync d3/de/d1d/d54/f9b 0 2024-04-23T14:49:56.991 INFO:tasks.workunit.client.1.smithi156.stdout:0/493: read d0/d4/f3 [2910447,5400] 0 2024-04-23T14:49:56.991 INFO:tasks.workunit.client.1.smithi156.stdout:0/494: chown d0/d4 61603 1 2024-04-23T14:49:56.991 INFO:tasks.workunit.client.1.smithi156.stdout:0/495: write d0/d4/d22/f96 [754727,1147] 0 2024-04-23T14:49:56.991 INFO:tasks.workunit.client.1.smithi156.stdout:0/496: chown d0/d4/d22/d58/d9a/l30 43 1 2024-04-23T14:49:56.991 INFO:tasks.workunit.client.1.smithi156.stdout:0/497: write d0/d4/d22/d58/d9a/d44/d4a/f7e [739131,75227] 0 2024-04-23T14:49:56.991 INFO:tasks.workunit.client.1.smithi156.stdout:0/498: truncate d0/d4/f4e 251729 0 2024-04-23T14:49:56.993 INFO:tasks.workunit.client.0.smithi081.stdout:5/878: write d17/d4f/d61/fab [755315,103662] 0 2024-04-23T14:49:56.996 INFO:tasks.workunit.client.0.smithi081.stdout:5/879: write d17/df8/f116 [996647,93132] 0 2024-04-23T14:49:56.996 INFO:tasks.workunit.client.0.smithi081.stdout:6/800: getdents d1/d51/d65/d8/d2e/d59/d80 0 2024-04-23T14:49:56.996 INFO:tasks.workunit.client.0.smithi081.stdout:2/774: sync 2024-04-23T14:49:57.007 INFO:tasks.workunit.client.0.smithi081.stdout:3/707: symlink d4/d7/d32/da6/ldc 0 2024-04-23T14:49:57.007 INFO:tasks.workunit.client.0.smithi081.stdout:3/708: readlink d4/d7/d49/d51/l6b 0 2024-04-23T14:49:57.008 INFO:tasks.workunit.client.0.smithi081.stdout:7/729: rename d3/d21/d31/d50/d5a/c5e to d3/d21/d31/d50/cfc 0 2024-04-23T14:49:57.011 INFO:tasks.workunit.client.1.smithi156.stdout:6/558: truncate d3/da/f1a 3634535 0 2024-04-23T14:49:57.018 INFO:tasks.workunit.client.1.smithi156.stdout:3/455: rename d4/l5b to d4/db/dd/d1d/d1e/d13/d5a/l87 0 2024-04-23T14:49:57.018 INFO:tasks.workunit.client.1.smithi156.stdout:3/456: creat d4/db/dd/d1d/d1e/d42/d76/f88 x:0 0 0 2024-04-23T14:49:57.018 INFO:tasks.workunit.client.1.smithi156.stdout:3/457: dread - d4/db/d4b/f84 zero size 2024-04-23T14:49:57.019 INFO:tasks.workunit.client.0.smithi081.stdout:5/880: getdents d17/d18/dff/d59 0 2024-04-23T14:49:57.021 INFO:tasks.workunit.client.1.smithi156.stdout:8/480: rmdir d5/d9/d36 39 2024-04-23T14:49:57.022 INFO:tasks.workunit.client.0.smithi081.stdout:2/775: truncate d1/d1e/dad/fed 2234416 0 2024-04-23T14:49:57.025 INFO:tasks.workunit.client.0.smithi081.stdout:3/709: link d4/d7/df/d30/fbb d4/d7/d49/fdd 0 2024-04-23T14:49:57.025 INFO:tasks.workunit.client.0.smithi081.stdout:3/710: fdatasync d4/d7/d7f/d85/d9d/f74 0 2024-04-23T14:49:57.027 INFO:tasks.workunit.client.0.smithi081.stdout:7/730: mknod d3/d21/d41/dd2/cfd 0 2024-04-23T14:49:57.028 INFO:tasks.workunit.client.1.smithi156.stdout:5/537: symlink d1/d11/d18/d52/d75/la9 0 2024-04-23T14:49:57.029 INFO:tasks.workunit.client.0.smithi081.stdout:8/981: dread d3/d11/d4f/d6c/ffb [0,4194304] 0 2024-04-23T14:49:57.029 INFO:tasks.workunit.client.0.smithi081.stdout:8/982: write d3/d11/d48/d7e/f95 [613261,2079] 0 2024-04-23T14:49:57.032 INFO:tasks.workunit.client.1.smithi156.stdout:0/499: mkdir d0/d16/d43/da6 0 2024-04-23T14:49:57.033 INFO:tasks.workunit.client.0.smithi081.stdout:5/881: rename d17/d18/f19 to d17/d4f/d61/dba/d127/f132 0 2024-04-23T14:49:57.034 INFO:tasks.workunit.client.1.smithi156.stdout:6/559: creat d3/d16/d5c/d6a/fc9 x:0 0 0 2024-04-23T14:49:57.034 INFO:tasks.workunit.client.1.smithi156.stdout:6/560: truncate d3/d16/d46/d2b/d6e/f95 42230 0 2024-04-23T14:49:57.034 INFO:tasks.workunit.client.1.smithi156.stdout:6/561: fdatasync d3/d16/d1e/f20 0 2024-04-23T14:49:57.036 INFO:tasks.workunit.client.1.smithi156.stdout:9/421: rename d1/d2/d3e/d50/l79 to d1/d2/d3e/d50/d7a/d17/l93 0 2024-04-23T14:49:57.036 INFO:tasks.workunit.client.1.smithi156.stdout:9/422: getdents d1/d2/d3e/d55/d66 0 2024-04-23T14:49:57.036 INFO:tasks.workunit.client.1.smithi156.stdout:9/423: write d1/d2/d3e/d50/d7a/d17/d1f/f7f [607187,27170] 0 2024-04-23T14:49:57.038 INFO:tasks.workunit.client.0.smithi081.stdout:3/711: rename d4/d7/df/d30/lba to d4/d7/d32/da6/dc4/d5a/d93/lde 0 2024-04-23T14:49:57.044 INFO:tasks.workunit.client.1.smithi156.stdout:3/458: mknod d4/db/dd/d1d/d1e/d74/c89 0 2024-04-23T14:49:57.046 INFO:tasks.workunit.client.1.smithi156.stdout:7/532: dwrite dc/d1d/d24/f28 [0,4194304] 0 2024-04-23T14:49:57.047 INFO:tasks.workunit.client.1.smithi156.stdout:7/533: dread - dc/d2c/d68/f8e zero size 2024-04-23T14:49:57.047 INFO:tasks.workunit.client.1.smithi156.stdout:7/534: write dc/d2c/f8c [925522,12794] 0 2024-04-23T14:49:57.047 INFO:tasks.workunit.client.1.smithi156.stdout:7/535: chown dc/d2c/d68/l90 1662168 1 2024-04-23T14:49:57.047 INFO:tasks.workunit.client.0.smithi081.stdout:8/983: rename d3/d11/d3e/c141 to d3/d11/c144 0 2024-04-23T14:49:57.049 INFO:tasks.workunit.client.1.smithi156.stdout:2/487: symlink d4/la9 0 2024-04-23T14:49:57.051 INFO:tasks.workunit.client.1.smithi156.stdout:4/423: sync 2024-04-23T14:49:57.052 INFO:tasks.workunit.client.1.smithi156.stdout:0/500: creat d0/d4/d22/d58/d9a/fa7 x:0 0 0 2024-04-23T14:49:57.057 INFO:tasks.workunit.client.0.smithi081.stdout:2/776: dread d1/d11/d21/d34/f72 [0,4194304] 0 2024-04-23T14:49:57.059 INFO:tasks.workunit.client.0.smithi081.stdout:3/712: read d4/d7/d32/f9c [527962,10063] 0 2024-04-23T14:49:57.061 INFO:tasks.workunit.client.0.smithi081.stdout:3/713: write d4/d7/df/d30/fbb [339181,96643] 0 2024-04-23T14:49:57.061 INFO:tasks.workunit.client.0.smithi081.stdout:2/777: write d1/f87 [63396,75037] 0 2024-04-23T14:49:57.063 INFO:tasks.workunit.client.1.smithi156.stdout:1/556: dwrite db/d1f/d28/f44 [0,4194304] 0 2024-04-23T14:49:57.070 INFO:tasks.workunit.client.0.smithi081.stdout:0/931: dwrite d6/d11/d14/d41/d5b/d3f/d44/d76/f113 [0,4194304] 0 2024-04-23T14:49:57.071 INFO:tasks.workunit.client.1.smithi156.stdout:6/562: dread d3/d16/d5c/d6a/f87 [0,4194304] 0 2024-04-23T14:49:57.071 INFO:tasks.workunit.client.1.smithi156.stdout:6/563: write d3/f4e [1590958,74689] 0 2024-04-23T14:49:57.071 INFO:tasks.workunit.client.0.smithi081.stdout:5/882: rename d17/d4a/f114 to d17/f133 0 2024-04-23T14:49:57.072 INFO:tasks.workunit.client.1.smithi156.stdout:5/538: read d1/d3/d64/f88 [3287835,56898] 0 2024-04-23T14:49:57.072 INFO:tasks.workunit.client.1.smithi156.stdout:8/481: rename d5/d9/f59 to d5/d9/d36/d84/d8c/fa7 0 2024-04-23T14:49:57.072 INFO:tasks.workunit.client.1.smithi156.stdout:9/424: mknod d1/d2/d3e/d55/d6f/d8e/c94 0 2024-04-23T14:49:57.075 INFO:tasks.workunit.client.0.smithi081.stdout:4/766: dwrite d1/d1d/d59/f65 [0,4194304] 0 2024-04-23T14:49:57.080 INFO:tasks.workunit.client.0.smithi081.stdout:8/984: rename d3/d11/d86/d88/da7/d117/d13a to d3/d11/d4f/d58/d145 0 2024-04-23T14:49:57.082 INFO:tasks.workunit.client.1.smithi156.stdout:4/424: mkdir d0/d30/d8a 0 2024-04-23T14:49:57.082 INFO:tasks.workunit.client.1.smithi156.stdout:4/425: chown d0/df/f14 1357 1 2024-04-23T14:49:57.082 INFO:tasks.workunit.client.1.smithi156.stdout:2/488: creat d4/d21/faa x:0 0 0 2024-04-23T14:49:57.086 INFO:tasks.workunit.client.1.smithi156.stdout:6/564: mknod d3/d16/d46/d2b/d6e/cca 0 2024-04-23T14:49:57.090 INFO:tasks.workunit.client.0.smithi081.stdout:6/801: dwrite d1/d51/d65/d13/d16/f1e [0,4194304] 0 2024-04-23T14:49:57.090 INFO:tasks.workunit.client.0.smithi081.stdout:6/802: getdents d1/d51/d54 0 2024-04-23T14:49:57.090 INFO:tasks.workunit.client.0.smithi081.stdout:4/767: write d1/d4/d6f/f91 [2771475,99035] 0 2024-04-23T14:49:57.090 INFO:tasks.workunit.client.0.smithi081.stdout:4/768: dread - d1/fea zero size 2024-04-23T14:49:57.092 INFO:tasks.workunit.client.0.smithi081.stdout:3/714: rename d4/c26 to d4/d7/d7f/cdf 0 2024-04-23T14:49:57.093 INFO:tasks.workunit.client.1.smithi156.stdout:5/539: symlink d1/d11/d18/laa 0 2024-04-23T14:49:57.096 INFO:tasks.workunit.client.0.smithi081.stdout:8/985: creat d3/d11/d4f/d58/f146 x:0 0 0 2024-04-23T14:49:57.102 INFO:tasks.workunit.client.1.smithi156.stdout:0/501: rename d0/d16/d43/d92 to d0/d16/d3a/d2a/d1d/da8 0 2024-04-23T14:49:57.103 INFO:tasks.workunit.client.1.smithi156.stdout:0/502: creat d0/d16/d3a/fa9 x:0 0 0 2024-04-23T14:49:57.105 INFO:tasks.workunit.client.0.smithi081.stdout:7/731: dwrite d3/d97/fbd [0,4194304] 0 2024-04-23T14:49:57.108 INFO:tasks.workunit.client.0.smithi081.stdout:9/791: dwrite d3/de/d1d/f20 [0,4194304] 0 2024-04-23T14:49:57.118 INFO:tasks.workunit.client.1.smithi156.stdout:8/482: creat d5/d39/d99/fa8 x:0 0 0 2024-04-23T14:49:57.119 INFO:tasks.workunit.client.1.smithi156.stdout:8/483: stat d5/d39/d99/la1 0 2024-04-23T14:49:57.121 INFO:tasks.workunit.client.1.smithi156.stdout:2/489: read d4/d21/f31 [1647786,87526] 0 2024-04-23T14:49:57.122 INFO:tasks.workunit.client.1.smithi156.stdout:5/540: read d1/f7c [3925630,104356] 0 2024-04-23T14:49:57.122 INFO:tasks.workunit.client.1.smithi156.stdout:5/541: write d1/d3/d24/f58 [1836371,37137] 0 2024-04-23T14:49:57.122 INFO:tasks.workunit.client.0.smithi081.stdout:4/769: dread d1/d1d/d39/f4c [0,4194304] 0 2024-04-23T14:49:57.122 INFO:tasks.workunit.client.0.smithi081.stdout:3/715: creat d4/dc/d50/fe0 x:0 0 0 2024-04-23T14:49:57.123 INFO:tasks.workunit.client.1.smithi156.stdout:0/503: dread d0/d4/d22/d58/d9a/d44/f52 [0,4194304] 0 2024-04-23T14:49:57.127 INFO:tasks.workunit.client.1.smithi156.stdout:7/536: dwrite dc/d1d/d24/f62 [0,4194304] 0 2024-04-23T14:49:57.127 INFO:tasks.workunit.client.1.smithi156.stdout:7/537: fsync dc/f81 0 2024-04-23T14:49:57.128 INFO:tasks.workunit.client.1.smithi156.stdout:9/425: symlink d1/d2/l95 0 2024-04-23T14:49:57.136 INFO:tasks.workunit.client.1.smithi156.stdout:4/426: mkdir d0/df/d55/d68/d74/d8b 0 2024-04-23T14:49:57.140 INFO:tasks.workunit.client.0.smithi081.stdout:2/778: rename d1/d11/d21/d34/cf2 to d1/d11/c10d 0 2024-04-23T14:49:57.141 INFO:tasks.workunit.client.0.smithi081.stdout:5/883: dwrite d17/d37/d4e/f107 [0,4194304] 0 2024-04-23T14:49:57.141 INFO:tasks.workunit.client.0.smithi081.stdout:5/884: fdatasync d17/d3c/d55/d64/dcc/ff5 0 2024-04-23T14:49:57.141 INFO:tasks.workunit.client.0.smithi081.stdout:7/732: creat d3/d21/d41/dcd/ffe x:0 0 0 2024-04-23T14:49:57.142 INFO:tasks.workunit.client.1.smithi156.stdout:6/565: creat d3/da/d74/fcb x:0 0 0 2024-04-23T14:49:57.144 INFO:tasks.workunit.client.1.smithi156.stdout:9/426: write d1/d2/d3e/d50/d7a/d17/f2c [3084037,17676] 0 2024-04-23T14:49:57.145 INFO:tasks.workunit.client.0.smithi081.stdout:9/792: mknod d3/d1a/c103 0 2024-04-23T14:49:57.152 INFO:tasks.workunit.client.0.smithi081.stdout:4/770: link d1/d4/d6f/d70/daf/d8c/d99/ld3 d1/d4/d6f/d70/daf/d8c/lf7 0 2024-04-23T14:49:57.152 INFO:tasks.workunit.client.0.smithi081.stdout:4/771: stat d1/d4/d6f/d70/daf/f57 0 2024-04-23T14:49:57.153 INFO:tasks.workunit.client.1.smithi156.stdout:2/490: dread d4/f16 [0,4194304] 0 2024-04-23T14:49:57.153 INFO:tasks.workunit.client.1.smithi156.stdout:2/491: dread - d4/d21/f67 zero size 2024-04-23T14:49:57.155 INFO:tasks.workunit.client.1.smithi156.stdout:3/459: dread d4/db/f2f [4194304,4194304] 0 2024-04-23T14:49:57.163 INFO:tasks.workunit.client.1.smithi156.stdout:8/484: mknod d5/d39/ca9 0 2024-04-23T14:49:57.166 INFO:tasks.workunit.client.0.smithi081.stdout:3/716: write d4/d7/df/d30/f4c [6872801,43530] 0 2024-04-23T14:49:57.166 INFO:tasks.workunit.client.0.smithi081.stdout:2/779: read d1/f85 [3431974,79687] 0 2024-04-23T14:49:57.171 INFO:tasks.workunit.client.1.smithi156.stdout:0/504: rename d0/c5c to d0/d16/d43/d9c/caa 0 2024-04-23T14:49:57.174 INFO:tasks.workunit.client.1.smithi156.stdout:7/538: creat dc/d93/f9e x:0 0 0 2024-04-23T14:49:57.175 INFO:tasks.workunit.client.0.smithi081.stdout:0/932: dwrite d6/d11/d14/d41/d5b/d3f/d44/d78/d83/fd2 [0,4194304] 0 2024-04-23T14:49:57.176 INFO:tasks.workunit.client.1.smithi156.stdout:1/557: dwrite db/d1f/d28/d70/f7d [0,4194304] 0 2024-04-23T14:49:57.176 INFO:tasks.workunit.client.1.smithi156.stdout:8/485: dread d5/d4e/f83 [0,4194304] 0 2024-04-23T14:49:57.177 INFO:tasks.workunit.client.1.smithi156.stdout:1/558: write db/d1f/d2d/f36 [4508694,30093] 0 2024-04-23T14:49:57.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.177+0000 7fa6ce800700 1 -- 172.21.15.81:0/3498995999 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6c806fdd0 msgr2=0x7fa6c806e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:57.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.177+0000 7fa6ce800700 1 --2- 172.21.15.81:0/3498995999 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6c806fdd0 0x7fa6c806e470 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8004940 tx=0x7fa6b8009e30 comp rx=0 tx=0).stop 2024-04-23T14:49:57.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.177+0000 7fa6ce800700 1 -- 172.21.15.81:0/3498995999 shutdown_connections 2024-04-23T14:49:57.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.177+0000 7fa6ce800700 1 --2- 172.21.15.81:0/3498995999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c806e9b0 0x7fa6c806ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:57.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.177+0000 7fa6ce800700 1 --2- 172.21.15.81:0/3498995999 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6c806fdd0 0x7fa6c806e470 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:57.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.177+0000 7fa6ce800700 1 -- 172.21.15.81:0/3498995999 >> 172.21.15.81:0/3498995999 conn(0x7fa6c8069df0 msgr2=0x7fa6c806c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:57.179 INFO:tasks.workunit.client.1.smithi156.stdout:1/559: write db/d25/d30/d38/f73 [98449,52973] 0 2024-04-23T14:49:57.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.178+0000 7fa6ce800700 1 -- 172.21.15.81:0/3498995999 shutdown_connections 2024-04-23T14:49:57.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.179+0000 7fa6ce800700 1 -- 172.21.15.81:0/3498995999 wait complete. 2024-04-23T14:49:57.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.180+0000 7fa6ce800700 1 Processor -- start 2024-04-23T14:49:57.180 INFO:tasks.workunit.client.0.smithi081.stdout:2/780: dread d1/d33/f90 [0,4194304] 0 2024-04-23T14:49:57.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.181+0000 7fa6ce800700 1 -- start start 2024-04-23T14:49:57.181 INFO:tasks.workunit.client.1.smithi156.stdout:4/427: mknod d0/df/d55/c8c 0 2024-04-23T14:49:57.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.181+0000 7fa6ce800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c806e9b0 0x7fa6c811c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:57.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.181+0000 7fa6ce800700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6c806fdd0 0x7fa6c811ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:57.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.181+0000 7fa6ce800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c811d050 con 0x7fa6c806e9b0 2024-04-23T14:49:57.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.181+0000 7fa6ce800700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c811d1c0 con 0x7fa6c806fdd0 2024-04-23T14:49:57.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.182+0000 7fa6bfe00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6c806fdd0 0x7fa6c811ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:57.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.182+0000 7fa6bfe00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6c806fdd0 0x7fa6c811ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.81:33106/0 (socket says 172.21.15.81:33106) 2024-04-23T14:49:57.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.182+0000 7fa6c7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c806e9b0 0x7fa6c811c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:57.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.182+0000 7fa6bfe00700 1 -- 172.21.15.81:0/297822881 learned_addr learned my addr 172.21.15.81:0/297822881 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:49:57.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.183+0000 7fa6c7400700 1 -- 172.21.15.81:0/297822881 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6c806fdd0 msgr2=0x7fa6c811ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:57.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.183+0000 7fa6c7400700 1 --2- 172.21.15.81:0/297822881 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6c806fdd0 0x7fa6c811ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:57.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.183+0000 7fa6c7400700 1 -- 172.21.15.81:0/297822881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b8005040 con 0x7fa6c806e9b0 2024-04-23T14:49:57.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.184+0000 7fa6c7400700 1 --2- 172.21.15.81:0/297822881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c806e9b0 0x7fa6c811c510 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8004890 tx=0x7fa6b8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.185+0000 7fa6bf400700 1 -- 172.21.15.81:0/297822881 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6b800e040 con 0x7fa6c806e9b0 2024-04-23T14:49:57.185 INFO:tasks.workunit.client.0.smithi081.stdout:6/803: rename d1/l38 to d1/d2/d49/d52/l116 0 2024-04-23T14:49:57.185 INFO:tasks.workunit.client.0.smithi081.stdout:6/804: chown d1/d2/d8e/d98/f9a 2847 1 2024-04-23T14:49:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.185+0000 7fa6bf400700 1 -- 172.21.15.81:0/297822881 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa6b800be70 con 0x7fa6c806e9b0 2024-04-23T14:49:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.185+0000 7fa6bf400700 1 -- 172.21.15.81:0/297822881 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6b801c6c0 con 0x7fa6c806e9b0 2024-04-23T14:49:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.185+0000 7fa6ce800700 1 -- 172.21.15.81:0/297822881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6c8121bc0 con 0x7fa6c806e9b0 2024-04-23T14:49:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.185+0000 7fa6ce800700 1 -- 172.21.15.81:0/297822881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6c81220d0 con 0x7fa6c806e9b0 2024-04-23T14:49:57.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.190+0000 7fa6bf400700 1 -- 172.21.15.81:0/297822881 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7fa6b8013af0 con 0x7fa6c806e9b0 2024-04-23T14:49:57.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.190+0000 7fa6ce800700 1 -- 172.21.15.81:0/297822881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6c804c710 con 0x7fa6c806e9b0 2024-04-23T14:49:57.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.192+0000 7fa6bf400700 1 --2- 172.21.15.81:0/297822881 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fa6ac06be80 0x7fa6ac06e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:57.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.193+0000 7fa6bf400700 1 -- 172.21.15.81:0/297822881 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fa6b808bfd0 con 0x7fa6c806e9b0 2024-04-23T14:49:57.194 INFO:tasks.workunit.client.1.smithi156.stdout:5/542: dwrite d1/d3/d24/da0/f33 [0,4194304] 0 2024-04-23T14:49:57.194 INFO:tasks.workunit.client.1.smithi156.stdout:5/543: chown d1/c70 276313 1 2024-04-23T14:49:57.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.193+0000 7fa6bfe00700 1 --2- 172.21.15.81:0/297822881 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fa6ac06be80 0x7fa6ac06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:57.194 INFO:tasks.workunit.client.0.smithi081.stdout:5/885: creat d17/d37/f134 x:0 0 0 2024-04-23T14:49:57.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.195+0000 7fa6bfe00700 1 --2- 172.21.15.81:0/297822881 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fa6ac06be80 0x7fa6ac06e330 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa6b0004ef0 tx=0x7fa6b0009040 comp rx=0 tx=0).ready entity=mgr.24373 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:57.195 INFO:tasks.workunit.client.0.smithi081.stdout:3/717: dread d4/f6 [4194304,4194304] 0 2024-04-23T14:49:57.198 INFO:tasks.workunit.client.1.smithi156.stdout:9/427: mkdir d1/d2/d23/d49/d4c/d96 0 2024-04-23T14:49:57.199 INFO:tasks.workunit.client.1.smithi156.stdout:2/492: symlink d4/d13/d19/lab 0 2024-04-23T14:49:57.200 INFO:tasks.workunit.client.1.smithi156.stdout:1/560: dread db/f4f [0,4194304] 0 2024-04-23T14:49:57.201 INFO:tasks.workunit.client.0.smithi081.stdout:0/933: dread d6/d11/d14/d41/d5b/d3f/d44/f86 [0,4194304] 0 2024-04-23T14:49:57.202 INFO:tasks.workunit.client.0.smithi081.stdout:0/934: chown d6/d11/d14/db8 624672 1 2024-04-23T14:49:57.215 INFO:tasks.workunit.client.1.smithi156.stdout:7/539: symlink dc/d1d/d48/d83/l9f 0 2024-04-23T14:49:57.215 INFO:tasks.workunit.client.1.smithi156.stdout:7/540: chown dc/d1d/d41/f51 105767973 1 2024-04-23T14:49:57.216 INFO:tasks.workunit.client.1.smithi156.stdout:7/541: creat dc/d1d/d48/fa0 x:0 0 0 2024-04-23T14:49:57.221 INFO:tasks.workunit.client.0.smithi081.stdout:6/805: dread d1/d51/d65/d8/d2e/d59/ff5 [0,4194304] 0 2024-04-23T14:49:57.221 INFO:tasks.workunit.client.0.smithi081.stdout:6/806: truncate d1/d51/d65/d8/d2e/d59/d80/fe0 356570 0 2024-04-23T14:49:57.221 INFO:tasks.workunit.client.0.smithi081.stdout:6/807: truncate d1/d51/d65/d78/fc8 2298501 0 2024-04-23T14:49:57.221 INFO:tasks.workunit.client.0.smithi081.stdout:6/808: write d1/d51/d65/d8/d2e/d59/d80/d90/f106 [87231,103018] 0 2024-04-23T14:49:57.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.222+0000 7fa6bf400700 1 -- 172.21.15.81:0/297822881 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7fa6b80590c0 con 0x7fa6c806e9b0 2024-04-23T14:49:57.223 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:56 smithi081 ceph-mon[25540]: pgmap v37: 65 pgs: 65 active+clean; 2.5 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 199 MiB/s rd, 239 MiB/s wr, 377 op/s 2024-04-23T14:49:57.231 INFO:tasks.workunit.client.1.smithi156.stdout:6/566: dwrite d3/da/d1d/d27/fb6 [0,4194304] 0 2024-04-23T14:49:57.235 INFO:tasks.workunit.client.1.smithi156.stdout:4/428: dwrite d0/df/d55/d68/f38 [0,4194304] 0 2024-04-23T14:49:57.238 INFO:tasks.workunit.client.1.smithi156.stdout:2/493: symlink d4/d21/d42/d75/d79/lac 0 2024-04-23T14:49:57.246 INFO:tasks.workunit.client.1.smithi156.stdout:1/561: symlink db/d25/lb2 0 2024-04-23T14:49:57.247 INFO:tasks.workunit.client.1.smithi156.stdout:1/562: chown db/d1f/d2f/d47/d71/fa4 1 1 2024-04-23T14:49:57.252 INFO:tasks.workunit.client.1.smithi156.stdout:0/505: rename d0/d16/d43/d9c/caa to d0/d4/d11/d3f/d45/cab 0 2024-04-23T14:49:57.252 INFO:tasks.workunit.client.1.smithi156.stdout:0/506: chown d0/d16/d3a/d2a/d1d/c50 208213 1 2024-04-23T14:49:57.258 INFO:tasks.workunit.client.1.smithi156.stdout:2/494: dread d4/f16 [0,4194304] 0 2024-04-23T14:49:57.258 INFO:tasks.workunit.client.1.smithi156.stdout:4/429: dread d0/df/d55/f62 [0,4194304] 0 2024-04-23T14:49:57.258 INFO:tasks.workunit.client.1.smithi156.stdout:4/430: dread - d0/df/d21/f69 zero size 2024-04-23T14:49:57.260 INFO:tasks.workunit.client.1.smithi156.stdout:7/542: mknod dc/d93/ca1 0 2024-04-23T14:49:57.260 INFO:tasks.workunit.client.1.smithi156.stdout:6/567: dread d3/da/f1a [0,4194304] 0 2024-04-23T14:49:57.269 INFO:tasks.workunit.client.1.smithi156.stdout:3/460: dwrite d4/db/dd/d1d/d1e/d13/f79 [0,4194304] 0 2024-04-23T14:49:57.271 INFO:tasks.workunit.client.0.smithi081.stdout:2/781: getdents d1/d11/d21/d52/d8b/d8f/de8 0 2024-04-23T14:49:57.271 INFO:tasks.workunit.client.0.smithi081.stdout:2/782: stat d1/d33/d9f/lbb 0 2024-04-23T14:49:57.271 INFO:tasks.workunit.client.0.smithi081.stdout:2/783: chown d1/cc2 11230644 1 2024-04-23T14:49:57.272 INFO:tasks.workunit.client.1.smithi156.stdout:3/461: write d4/db/dd/f1b [996700,38441] 0 2024-04-23T14:49:57.272 INFO:tasks.workunit.client.1.smithi156.stdout:9/428: dwrite d1/d2/d3e/d55/d6f/d30/f6d [0,4194304] 0 2024-04-23T14:49:57.272 INFO:tasks.workunit.client.1.smithi156.stdout:9/429: readlink d1/d2/d3e/d55/d6f/l3a 0 2024-04-23T14:49:57.272 INFO:tasks.workunit.client.1.smithi156.stdout:6/568: dread d3/da/d1d/d59/d9c/fbd [0,4194304] 0 2024-04-23T14:49:57.273 INFO:tasks.workunit.client.1.smithi156.stdout:6/569: chown d3/d16/d46/d2b/d3b/d9e 94 1 2024-04-23T14:49:57.274 INFO:tasks.workunit.client.0.smithi081.stdout:8/986: rename d3/d3c/fa9 to d3/d3c/ddb/df3/f147 0 2024-04-23T14:49:57.282 INFO:tasks.workunit.client.0.smithi081.stdout:3/718: creat d4/d7/df/d30/d64/d83/fe1 x:0 0 0 2024-04-23T14:49:57.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:56 smithi156 ceph-mon[32341]: pgmap v37: 65 pgs: 65 active+clean; 2.5 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 199 MiB/s rd, 239 MiB/s wr, 377 op/s 2024-04-23T14:49:57.288 INFO:tasks.workunit.client.0.smithi081.stdout:0/935: mkdir d6/d37/d67/dc8/d128 0 2024-04-23T14:49:57.292 INFO:tasks.workunit.client.0.smithi081.stdout:6/809: mknod d1/d2/d8e/c117 0 2024-04-23T14:49:57.292 INFO:tasks.workunit.client.1.smithi156.stdout:3/462: dread d4/db/dd/d1d/d61/f6a [0,4194304] 0 2024-04-23T14:49:57.310 INFO:tasks.workunit.client.1.smithi156.stdout:8/486: rename d5/d45/f55 to d5/d9/d36/d84/d8c/faa 0 2024-04-23T14:49:57.317 INFO:tasks.workunit.client.1.smithi156.stdout:3/463: write d4/db/dd/d1d/d1e/d42/f52 [876630,24522] 0 2024-04-23T14:49:57.317 INFO:tasks.workunit.client.1.smithi156.stdout:3/464: dread - d4/db/d4b/f81 zero size 2024-04-23T14:49:57.318 INFO:tasks.workunit.client.1.smithi156.stdout:0/507: creat d0/d4/d11/d3f/d45/fac x:0 0 0 2024-04-23T14:49:57.318 INFO:tasks.workunit.client.1.smithi156.stdout:0/508: fsync d0/d16/d3a/d2a/d1d/f17 0 2024-04-23T14:49:57.319 INFO:tasks.workunit.client.1.smithi156.stdout:2/495: mkdir d4/d13/d88/dad 0 2024-04-23T14:49:57.328 INFO:tasks.workunit.client.1.smithi156.stdout:4/431: truncate d0/d8/fc 666898 0 2024-04-23T14:49:57.330 INFO:tasks.workunit.client.0.smithi081.stdout:7/733: rename d3/d21/c2e to d3/d21/d41/d7c/cff 0 2024-04-23T14:49:57.330 INFO:tasks.workunit.client.0.smithi081.stdout:7/734: fsync d3/d21/d41/d7c/dc3/fe5 0 2024-04-23T14:49:57.330 INFO:tasks.workunit.client.0.smithi081.stdout:7/735: readlink d3/d21/d31/l47 0 2024-04-23T14:49:57.336 INFO:tasks.workunit.client.0.smithi081.stdout:5/886: write fd [678159,38459] 0 2024-04-23T14:49:57.338 INFO:tasks.workunit.client.0.smithi081.stdout:3/719: creat d4/d7/d49/fe2 x:0 0 0 2024-04-23T14:49:57.340 INFO:tasks.workunit.client.0.smithi081.stdout:9/793: dwrite d3/d1a/fc [0,4194304] 0 2024-04-23T14:49:57.347 INFO:tasks.workunit.client.0.smithi081.stdout:1/922: sync 2024-04-23T14:49:57.349 INFO:tasks.workunit.client.1.smithi156.stdout:4/432: dread d0/df/d55/d68/f43 [0,4194304] 0 2024-04-23T14:49:57.350 INFO:tasks.workunit.client.0.smithi081.stdout:4/772: rename d1/d4/ce5 to d1/d1d/daa/cf8 0 2024-04-23T14:49:57.352 INFO:tasks.workunit.client.0.smithi081.stdout:5/887: creat d17/d4f/d61/dba/f135 x:0 0 0 2024-04-23T14:49:57.354 INFO:tasks.workunit.client.0.smithi081.stdout:7/736: write d3/d21/d31/fc6 [2387290,109794] 0 2024-04-23T14:49:57.354 INFO:tasks.workunit.client.0.smithi081.stdout:7/737: fsync d3/d97/fbd 0 2024-04-23T14:49:57.355 INFO:tasks.workunit.client.0.smithi081.stdout:3/720: link d4/d7/d49/d51/d84/l97 d4/d7/df/d30/d64/d83/le3 0 2024-04-23T14:49:57.357 INFO:tasks.workunit.client.0.smithi081.stdout:8/987: dwrite d3/d11/d48/d7e/de4/f10c [0,4194304] 0 2024-04-23T14:49:57.362 INFO:tasks.workunit.client.1.smithi156.stdout:4/433: dread d0/df/f17 [0,4194304] 0 2024-04-23T14:49:57.364 INFO:tasks.workunit.client.0.smithi081.stdout:2/784: dwrite d1/d11/d21/d34/fce [8388608,4194304] 0 2024-04-23T14:49:57.364 INFO:tasks.workunit.client.0.smithi081.stdout:2/785: fdatasync d1/fb 0 2024-04-23T14:49:57.364 INFO:tasks.workunit.client.0.smithi081.stdout:2/786: fsync d1/d33/f5e 0 2024-04-23T14:49:57.364 INFO:tasks.workunit.client.0.smithi081.stdout:2/787: fsync d1/d11/dab/fe0 0 2024-04-23T14:49:57.370 INFO:tasks.workunit.client.0.smithi081.stdout:9/794: creat d3/de/d1d/d5b/f104 x:0 0 0 2024-04-23T14:49:57.372 INFO:tasks.workunit.client.0.smithi081.stdout:5/888: write d17/d18/dff/d59/f9c [1992287,38375] 0 2024-04-23T14:49:57.378 INFO:tasks.workunit.client.0.smithi081.stdout:4/773: write d1/d4/d6f/d70/daf/fcc [228057,116160] 0 2024-04-23T14:49:57.378 INFO:tasks.workunit.client.0.smithi081.stdout:4/774: stat d1/d4/d6f/d70/daf/f41 0 2024-04-23T14:49:57.379 INFO:tasks.workunit.client.0.smithi081.stdout:4/775: fsync d1/d1d/f22 0 2024-04-23T14:49:57.379 INFO:tasks.workunit.client.0.smithi081.stdout:4/776: stat d1/d4f/dc3/cdf 0 2024-04-23T14:49:57.379 INFO:tasks.workunit.client.0.smithi081.stdout:4/777: stat d1/d4/d11/d75/f95 0 2024-04-23T14:49:57.379 INFO:tasks.workunit.client.0.smithi081.stdout:3/721: dread d4/d41/f66 [4194304,4194304] 0 2024-04-23T14:49:57.379 INFO:tasks.workunit.client.0.smithi081.stdout:1/923: symlink d3/d3d/d41/d5e/d17/d25/l135 0 2024-04-23T14:49:57.379 INFO:tasks.workunit.client.0.smithi081.stdout:1/924: chown d3/d3d/d41/d4a 1 1 2024-04-23T14:49:57.390 INFO:tasks.workunit.client.1.smithi156.stdout:9/430: unlink d1/d2/d3e/d50/d7a/d19/f26 0 2024-04-23T14:49:57.390 INFO:tasks.workunit.client.0.smithi081.stdout:0/936: rename d6/d37/d85/dd6 to d6/d69/d129 0 2024-04-23T14:49:57.391 INFO:tasks.workunit.client.0.smithi081.stdout:6/810: rename d1/d51/d65/d8 to d1/d51/d65/d8/da4/d118 22 2024-04-23T14:49:57.391 INFO:tasks.workunit.client.0.smithi081.stdout:0/937: read d6/d25/f2e [540912,13586] 0 2024-04-23T14:49:57.394 INFO:tasks.workunit.client.1.smithi156.stdout:3/465: dwrite d4/db/dd/d1d/d1e/d13/f79 [0,4194304] 0 2024-04-23T14:49:57.398 INFO:tasks.workunit.client.1.smithi156.stdout:6/570: mkdir d3/da/d1d/d59/d72/dcc 0 2024-04-23T14:49:57.401 INFO:tasks.workunit.client.0.smithi081.stdout:6/811: dread d1/d51/d65/d8/d2e/d59/d80/f8d [0,4194304] 0 2024-04-23T14:49:57.401 INFO:tasks.workunit.client.0.smithi081.stdout:6/812: chown d1/d51/d65/d1c/d66/f93 7559 1 2024-04-23T14:49:57.405 INFO:tasks.workunit.client.1.smithi156.stdout:8/487: creat d5/d9/d36/d84/fab x:0 0 0 2024-04-23T14:49:57.405 INFO:tasks.workunit.client.1.smithi156.stdout:8/488: chown d5/d9/d10/f88 7905374 1 2024-04-23T14:49:57.415 INFO:tasks.workunit.client.0.smithi081.stdout:9/795: unlink d3/de/d1d/d62/cc8 0 2024-04-23T14:49:57.416 INFO:tasks.workunit.client.1.smithi156.stdout:2/496: mknod d4/d21/d42/cae 0 2024-04-23T14:49:57.418 INFO:tasks.workunit.client.1.smithi156.stdout:4/434: rmdir d0/df 39 2024-04-23T14:49:57.419 INFO:tasks.workunit.client.0.smithi081.stdout:2/788: dwrite d1/d11/d21/fc7 [4194304,4194304] 0 2024-04-23T14:49:57.419 INFO:tasks.workunit.client.0.smithi081.stdout:2/789: chown d1/d11/d21/d34/l55 6453223 1 2024-04-23T14:49:57.420 INFO:tasks.workunit.client.0.smithi081.stdout:2/790: write d1/d33/d95/fc6 [276160,10605] 0 2024-04-23T14:49:57.422 INFO:tasks.workunit.client.0.smithi081.stdout:5/889: symlink d17/d18/l136 0 2024-04-23T14:49:57.426 INFO:tasks.workunit.client.0.smithi081.stdout:4/778: creat d1/d1d/ff9 x:0 0 0 2024-04-23T14:49:57.428 INFO:tasks.workunit.client.0.smithi081.stdout:3/722: unlink d4/d7/d49/d51/d84/l97 0 2024-04-23T14:49:57.433 INFO:tasks.workunit.client.0.smithi081.stdout:0/938: symlink d6/d11/d14/d41/l12a 0 2024-04-23T14:49:57.434 INFO:tasks.workunit.client.0.smithi081.stdout:9/796: dread d3/de/d14/d5e/d72/fe7 [0,4194304] 0 2024-04-23T14:49:57.441 INFO:tasks.workunit.client.0.smithi081.stdout:1/925: dwrite d3/d3d/d41/d5e/d5d/d125/d2e/fc5 [0,4194304] 0 2024-04-23T14:49:57.441 INFO:tasks.workunit.client.0.smithi081.stdout:1/926: chown d3/d3d/d41/d5e/f11b 24559 1 2024-04-23T14:49:57.441 INFO:tasks.workunit.client.0.smithi081.stdout:1/927: chown d3/d3d/d41/d5e/d5d/d125/fcf 123 1 2024-04-23T14:49:57.441 INFO:tasks.workunit.client.0.smithi081.stdout:1/928: dread - d3/d3d/d41/d5e/d1d/ff4 zero size 2024-04-23T14:49:57.441 INFO:tasks.workunit.client.1.smithi156.stdout:6/571: unlink d3/da/d1d/d27/d63/f8c 0 2024-04-23T14:49:57.445 INFO:tasks.workunit.client.1.smithi156.stdout:2/497: dread d4/f24 [0,4194304] 0 2024-04-23T14:49:57.445 INFO:tasks.workunit.client.0.smithi081.stdout:8/988: rename d3/d11/d34/d8b to d3/d11/d48/d7e/d148 0 2024-04-23T14:49:57.450 INFO:tasks.workunit.client.0.smithi081.stdout:6/813: mknod d1/d2/c119 0 2024-04-23T14:49:57.455 INFO:tasks.workunit.client.0.smithi081.stdout:7/738: mknod d3/d21/d31/c100 0 2024-04-23T14:49:57.459 INFO:tasks.workunit.client.1.smithi156.stdout:8/489: creat d5/d9/d36/d60/d7c/fac x:0 0 0 2024-04-23T14:49:57.459 INFO:tasks.workunit.client.1.smithi156.stdout:8/490: write d5/d9/d10/f11 [109154,27753] 0 2024-04-23T14:49:57.460 INFO:tasks.workunit.client.1.smithi156.stdout:9/431: dwrite d1/f81 [0,4194304] 0 2024-04-23T14:49:57.461 INFO:tasks.workunit.client.1.smithi156.stdout:9/432: chown d1/d2/d23/d2d/d39 609344332 1 2024-04-23T14:49:57.461 INFO:tasks.workunit.client.1.smithi156.stdout:9/433: chown d1/d2/d3e/d50 88 1 2024-04-23T14:49:57.461 INFO:tasks.workunit.client.1.smithi156.stdout:9/434: stat d1/d2/d23/f27 0 2024-04-23T14:49:57.461 INFO:tasks.workunit.client.1.smithi156.stdout:9/435: stat d1/d2/d3e/d55 0 2024-04-23T14:49:57.464 INFO:tasks.workunit.client.0.smithi081.stdout:5/890: mkdir d17/d18/dff/daf/d137 0 2024-04-23T14:49:57.466 INFO:tasks.workunit.client.1.smithi156.stdout:3/466: mkdir d4/db/d5e/d8a 0 2024-04-23T14:49:57.470 INFO:tasks.workunit.client.1.smithi156.stdout:6/572: mkdir d3/d16/d46/d9d/d9f/dad/dcd 0 2024-04-23T14:49:57.470 INFO:tasks.workunit.client.1.smithi156.stdout:6/573: chown d3/da/d1d/d59/c82 244 1 2024-04-23T14:49:57.472 INFO:tasks.workunit.client.1.smithi156.stdout:2/498: symlink d4/d21/d42/laf 0 2024-04-23T14:49:57.472 INFO:tasks.workunit.client.1.smithi156.stdout:2/499: chown d4/d13/d88 61753 1 2024-04-23T14:49:57.473 INFO:tasks.workunit.client.0.smithi081.stdout:3/723: symlink d4/d7/d32/da6/dc4/d5a/le4 0 2024-04-23T14:49:57.474 INFO:tasks.workunit.client.0.smithi081.stdout:4/779: dwrite d1/d4/f63 [0,4194304] 0 2024-04-23T14:49:57.475 INFO:tasks.workunit.client.1.smithi156.stdout:1/563: rename db/d1f/d34 to db/d1f/d28/d70/db3 0 2024-04-23T14:49:57.475 INFO:tasks.workunit.client.1.smithi156.stdout:1/564: chown db/d1f/d2d/d85/l91 90343 1 2024-04-23T14:49:57.475 INFO:tasks.workunit.client.1.smithi156.stdout:1/565: chown db/d25/d30/d38/d40/faa 300148 1 2024-04-23T14:49:57.476 INFO:tasks.workunit.client.1.smithi156.stdout:1/566: truncate db/d25/d30/d38/f9f 9248186 0 2024-04-23T14:49:57.480 INFO:tasks.workunit.client.0.smithi081.stdout:1/929: link d3/f47 d3/d3d/d41/d5e/d5d/d125/d1a/d115/f136 0 2024-04-23T14:49:57.480 INFO:tasks.workunit.client.0.smithi081.stdout:1/930: readlink d3/d3d/d41/d5e/d5d/l10a 0 2024-04-23T14:49:57.480 INFO:tasks.workunit.client.0.smithi081.stdout:9/797: mkdir d3/de/d22/d105 0 2024-04-23T14:49:57.481 INFO:tasks.workunit.client.0.smithi081.stdout:8/989: getdents d3/d3c/ddb/df3/d108 0 2024-04-23T14:49:57.485 INFO:tasks.workunit.client.0.smithi081.stdout:6/814: rename d1/d51/d54/f8c to d1/d51/d65/d13/d16/dd0/f11a 0 2024-04-23T14:49:57.485 INFO:tasks.workunit.client.0.smithi081.stdout:6/815: write d1/d51/d65/d8/db1/fe2 [3989932,98217] 0 2024-04-23T14:49:57.486 INFO:tasks.workunit.client.0.smithi081.stdout:4/780: dread d1/d4/d11/d75/fa8 [0,4194304] 0 2024-04-23T14:49:57.487 INFO:tasks.workunit.client.1.smithi156.stdout:9/436: link d1/d2/c11 d1/d2/d3e/d50/d7a/d17/c97 0 2024-04-23T14:49:57.490 INFO:tasks.workunit.client.1.smithi156.stdout:3/467: symlink d4/db/dd/d20/l8b 0 2024-04-23T14:49:57.497 INFO:tasks.workunit.client.1.smithi156.stdout:2/500: creat d4/fb0 x:0 0 0 2024-04-23T14:49:57.498 INFO:tasks.workunit.client.0.smithi081.stdout:7/739: truncate d3/d97/fa5 76417 0 2024-04-23T14:49:57.499 INFO:tasks.workunit.client.0.smithi081.stdout:7/740: truncate d3/fe7 997313 0 2024-04-23T14:49:57.499 INFO:tasks.workunit.client.0.smithi081.stdout:7/741: fsync d3/d21/d31/d33/d4b/d4c/feb 0 2024-04-23T14:49:57.502 INFO:tasks.workunit.client.1.smithi156.stdout:0/509: rename d0/d4/d22/d58/d9a/fa7 to d0/d4/fad 0 2024-04-23T14:49:57.504 INFO:tasks.workunit.client.0.smithi081.stdout:3/724: creat d4/d7/d1a/d71/dc2/fe5 x:0 0 0 2024-04-23T14:49:57.506 INFO:tasks.workunit.client.1.smithi156.stdout:2/501: creat d4/d26/fb1 x:0 0 0 2024-04-23T14:49:57.509 INFO:tasks.workunit.client.0.smithi081.stdout:0/939: link d6/d37/c7a d6/d11/d14/dec/d11c/c12b 0 2024-04-23T14:49:57.509 INFO:tasks.workunit.client.0.smithi081.stdout:0/940: chown f5 64 1 2024-04-23T14:49:57.512 INFO:tasks.workunit.client.1.smithi156.stdout:0/510: creat d0/d16/d3a/d2a/d1d/d2d/fae x:0 0 0 2024-04-23T14:49:57.512 INFO:tasks.workunit.client.1.smithi156.stdout:1/567: dread db/d1f/f79 [4194304,4194304] 0 2024-04-23T14:49:57.512 INFO:tasks.workunit.client.1.smithi156.stdout:0/511: creat d0/d16/d3a/d1e/d80/faf x:0 0 0 2024-04-23T14:49:57.514 INFO:tasks.workunit.client.1.smithi156.stdout:9/437: rename d1/d2/d3e/d55/d6f/c57 to d1/d2/d23/d49/d4c/d96/c98 0 2024-04-23T14:49:57.516 INFO:tasks.workunit.client.0.smithi081.stdout:7/742: dread d3/d20/dc9/fbf [0,4194304] 0 2024-04-23T14:49:57.518 INFO:tasks.workunit.client.0.smithi081.stdout:1/931: rmdir d3/d3d 39 2024-04-23T14:49:57.518 INFO:tasks.workunit.client.0.smithi081.stdout:1/932: dread - d3/d3d/d90/de0/f100 zero size 2024-04-23T14:49:57.518 INFO:tasks.workunit.client.0.smithi081.stdout:1/933: fdatasync d3/d3d/d7a/f112 0 2024-04-23T14:49:57.521 INFO:tasks.workunit.client.1.smithi156.stdout:7/543: sync 2024-04-23T14:49:57.521 INFO:tasks.workunit.client.1.smithi156.stdout:5/544: sync 2024-04-23T14:49:57.523 INFO:tasks.workunit.client.0.smithi081.stdout:9/798: mknod d3/de/d14/d5e/d72/c106 0 2024-04-23T14:49:57.530 INFO:tasks.workunit.client.0.smithi081.stdout:8/990: symlink d3/d11/d4f/d58/l149 0 2024-04-23T14:49:57.530 INFO:tasks.workunit.client.0.smithi081.stdout:6/816: rename d1/d2/d49/d52/c55 to d1/d51/d65/d1c/d6e/c11b 0 2024-04-23T14:49:57.531 INFO:tasks.workunit.client.0.smithi081.stdout:6/817: creat d1/d2/d49/d52/f11c x:0 0 0 2024-04-23T14:49:57.533 INFO:tasks.workunit.client.0.smithi081.stdout:6/818: readlink d1/d51/d65/d13/d46/l89 0 2024-04-23T14:49:57.533 INFO:tasks.workunit.client.0.smithi081.stdout:4/781: mknod d1/d4/d11/d9d/dac/de7/cfa 0 2024-04-23T14:49:57.536 INFO:tasks.workunit.client.0.smithi081.stdout:3/725: mknod d4/d7/df/d30/d64/d83/ce6 0 2024-04-23T14:49:57.536 INFO:tasks.workunit.client.0.smithi081.stdout:3/726: truncate d4/d7/df/d30/f80 1058595 0 2024-04-23T14:49:57.539 INFO:tasks.workunit.client.1.smithi156.stdout:1/568: dread db/d1f/d2f/d47/f8f [0,4194304] 0 2024-04-23T14:49:57.540 INFO:tasks.workunit.client.1.smithi156.stdout:8/491: dwrite d5/d4e/f52 [0,4194304] 0 2024-04-23T14:49:57.540 INFO:tasks.workunit.client.0.smithi081.stdout:0/941: creat d6/d11/db0/f12c x:0 0 0 2024-04-23T14:49:57.544 INFO:tasks.workunit.client.0.smithi081.stdout:1/934: symlink d3/d3d/d41/d92/df1/l137 0 2024-04-23T14:49:57.545 INFO:tasks.workunit.client.0.smithi081.stdout:8/991: mkdir d3/d11/d48/d14a 0 2024-04-23T14:49:57.546 INFO:tasks.workunit.client.1.smithi156.stdout:1/569: mkdir db/d1f/d2d/d48/db4 0 2024-04-23T14:49:57.548 INFO:tasks.workunit.client.0.smithi081.stdout:4/782: rename d1/d4/d11/f80 to d1/ffb 0 2024-04-23T14:49:57.548 INFO:tasks.workunit.client.0.smithi081.stdout:4/783: chown d1/d1d/daa/cf8 5903324 1 2024-04-23T14:49:57.548 INFO:tasks.workunit.client.0.smithi081.stdout:4/784: readlink d1/l5f 0 2024-04-23T14:49:57.548 INFO:tasks.workunit.client.0.smithi081.stdout:6/819: dread d1/d51/d65/d13/d46/f7a [0,4194304] 0 2024-04-23T14:49:57.557 INFO:tasks.workunit.client.1.smithi156.stdout:8/492: rename d5/d9/d36/c3b to d5/d45/cad 0 2024-04-23T14:49:57.557 INFO:tasks.workunit.client.1.smithi156.stdout:1/570: dread db/d25/d30/d38/f6c [0,4194304] 0 2024-04-23T14:49:57.557 INFO:tasks.workunit.client.1.smithi156.stdout:8/493: write d5/d9/d36/d84/f8f [173617,88330] 0 2024-04-23T14:49:57.557 INFO:tasks.workunit.client.1.smithi156.stdout:8/494: readlink d5/l3f 0 2024-04-23T14:49:57.557 INFO:tasks.workunit.client.1.smithi156.stdout:8/495: dread - d5/d9/d5a/d5c/f72 zero size 2024-04-23T14:49:57.559 INFO:tasks.workunit.client.0.smithi081.stdout:3/727: unlink d4/dc/l86 0 2024-04-23T14:49:57.561 INFO:tasks.workunit.client.1.smithi156.stdout:8/496: creat d5/d9/d10/d1d/fae x:0 0 0 2024-04-23T14:49:57.562 INFO:tasks.workunit.client.0.smithi081.stdout:7/743: getdents d3 0 2024-04-23T14:49:57.562 INFO:tasks.workunit.client.0.smithi081.stdout:7/744: chown d3/d21/d41/dbb/fde 561169 1 2024-04-23T14:49:57.566 INFO:tasks.workunit.client.1.smithi156.stdout:7/544: dread dc/d1d/f23 [0,4194304] 0 2024-04-23T14:49:57.566 INFO:tasks.workunit.client.1.smithi156.stdout:7/545: chown dc/l22 3 1 2024-04-23T14:49:57.568 INFO:tasks.workunit.client.0.smithi081.stdout:1/935: mkdir d3/d3d/d138 0 2024-04-23T14:49:57.569 INFO:tasks.workunit.client.0.smithi081.stdout:1/936: read d3/d3d/d7a/fd9 [4079055,9735] 0 2024-04-23T14:49:57.569 INFO:tasks.workunit.client.0.smithi081.stdout:1/937: truncate d3/d3d/d41/d5e/d5d/d125/d1a/fb4 773624 0 2024-04-23T14:49:57.569 INFO:tasks.workunit.client.0.smithi081.stdout:1/938: readlink d3/d3d/d41/d5e/d17/l19 0 2024-04-23T14:49:57.570 INFO:tasks.workunit.client.1.smithi156.stdout:8/497: symlink d5/d9/d5a/d5c/d6b/laf 0 2024-04-23T14:49:57.570 INFO:tasks.workunit.client.1.smithi156.stdout:8/498: creat d5/d9/d10/d1d/fb0 x:0 0 0 2024-04-23T14:49:57.572 INFO:tasks.workunit.client.0.smithi081.stdout:8/992: link d3/dc6/c10a d3/d11/d48/dc1/d110/c14b 0 2024-04-23T14:49:57.573 INFO:tasks.workunit.client.0.smithi081.stdout:8/993: stat d3/d1a/c21 0 2024-04-23T14:49:57.573 INFO:tasks.workunit.client.0.smithi081.stdout:8/994: fdatasync d3/d11/d3e/f5d 0 2024-04-23T14:49:57.573 INFO:tasks.workunit.client.0.smithi081.stdout:8/995: write d3/d11/d86/f9c [156835,39299] 0 2024-04-23T14:49:57.573 INFO:tasks.workunit.client.0.smithi081.stdout:6/820: symlink d1/d2/d8e/df6/l11d 0 2024-04-23T14:49:57.573 INFO:tasks.workunit.client.1.smithi156.stdout:7/546: creat dc/d9d/fa2 x:0 0 0 2024-04-23T14:49:57.574 INFO:tasks.workunit.client.1.smithi156.stdout:7/547: fdatasync dc/f14 0 2024-04-23T14:49:57.574 INFO:tasks.workunit.client.0.smithi081.stdout:3/728: fdatasync d4/d7/d7f/d85/fd1 0 2024-04-23T14:49:57.575 INFO:tasks.workunit.client.0.smithi081.stdout:3/729: write d4/d7/df/d30/d64/d83/fe1 [99131,64061] 0 2024-04-23T14:49:57.575 INFO:tasks.workunit.client.0.smithi081.stdout:3/730: readlink d4/d41/la1 0 2024-04-23T14:49:57.577 INFO:tasks.workunit.client.0.smithi081.stdout:4/785: write d1/d8f/d94/fdb [2426333,71989] 0 2024-04-23T14:49:57.577 INFO:tasks.workunit.client.0.smithi081.stdout:4/786: creat d1/ffc x:0 0 0 2024-04-23T14:49:57.577 INFO:tasks.workunit.client.0.smithi081.stdout:4/787: chown d1/d1d/d39/l40 2887800 1 2024-04-23T14:49:57.577 INFO:tasks.workunit.client.0.smithi081.stdout:4/788: fdatasync d1/d4/d6f/d70/daf/fcc 0 2024-04-23T14:49:57.580 INFO:tasks.workunit.client.1.smithi156.stdout:8/499: creat d5/fb1 x:0 0 0 2024-04-23T14:49:57.581 INFO:tasks.workunit.client.1.smithi156.stdout:8/500: chown d5/d45/cad 8266005 1 2024-04-23T14:49:57.581 INFO:tasks.workunit.client.0.smithi081.stdout:0/942: read d6/d11/d14/d41/d5b/d3f/f6c [411515,105568] 0 2024-04-23T14:49:57.581 INFO:tasks.workunit.client.0.smithi081.stdout:0/943: stat d6/d11/d14 0 2024-04-23T14:49:57.583 INFO:tasks.workunit.client.1.smithi156.stdout:2/502: dwrite d4/d13/f4b [0,4194304] 0 2024-04-23T14:49:57.583 INFO:tasks.workunit.client.1.smithi156.stdout:3/468: dwrite d4/db/dd/d1d/d1e/d13/f1a [4194304,4194304] 0 2024-04-23T14:49:57.583 INFO:tasks.workunit.client.1.smithi156.stdout:2/503: write d4/d13/d19/d58/f64 [926983,72253] 0 2024-04-23T14:49:57.583 INFO:tasks.workunit.client.1.smithi156.stdout:2/504: write d4/f16 [4873356,8923] 0 2024-04-23T14:49:57.586 INFO:tasks.workunit.client.0.smithi081.stdout:5/891: dwrite d17/d37/da4/f11e [0,4194304] 0 2024-04-23T14:49:57.587 INFO:tasks.workunit.client.0.smithi081.stdout:5/892: chown d17/d1f/f74 31350381 1 2024-04-23T14:49:57.587 INFO:tasks.workunit.client.0.smithi081.stdout:5/893: write f14 [4462028,83742] 0 2024-04-23T14:49:57.588 INFO:tasks.workunit.client.1.smithi156.stdout:6/574: dwrite d3/d16/d46/d2b/d3b/f69 [4194304,4194304] 0 2024-04-23T14:49:57.588 INFO:tasks.workunit.client.1.smithi156.stdout:7/548: rename dc/d93/c56 to dc/d93/d6c/d88/ca3 0 2024-04-23T14:49:57.592 INFO:tasks.workunit.client.0.smithi081.stdout:0/944: dread d6/d11/d14/db8/fbf [0,4194304] 0 2024-04-23T14:49:57.603 INFO:tasks.workunit.client.0.smithi081.stdout:7/745: read d3/d21/d31/d33/d4b/f57 [871688,72310] 0 2024-04-23T14:49:57.603 INFO:tasks.workunit.client.0.smithi081.stdout:7/746: chown d3/d21/l35 292 1 2024-04-23T14:49:57.603 INFO:tasks.workunit.client.0.smithi081.stdout:1/939: symlink d3/d3d/d41/d5e/d117/l139 0 2024-04-23T14:49:57.608 INFO:tasks.workunit.client.1.smithi156.stdout:3/469: symlink d4/db/dd/d1d/d1e/l8c 0 2024-04-23T14:49:57.610 INFO:tasks.workunit.client.0.smithi081.stdout:8/996: rename d3/fba to d3/d11/d48/f14c 0 2024-04-23T14:49:57.610 INFO:tasks.workunit.client.1.smithi156.stdout:0/512: dwrite d0/d16/d3a/d2a/d1d/d2d/f8c [0,4194304] 0 2024-04-23T14:49:57.611 INFO:tasks.workunit.client.1.smithi156.stdout:0/513: creat d0/d4/d22/fb0 x:0 0 0 2024-04-23T14:49:57.611 INFO:tasks.workunit.client.1.smithi156.stdout:0/514: truncate d0/d16/d3a/d1e/f5d 297907 0 2024-04-23T14:49:57.611 INFO:tasks.workunit.client.1.smithi156.stdout:0/515: chown d0/d16/d3a/d2a/d1d/d2d/la3 19049 1 2024-04-23T14:49:57.617 INFO:tasks.workunit.client.0.smithi081.stdout:3/731: link d4/d7/d32/f9c d4/d7/df/d30/d64/da4/fe7 0 2024-04-23T14:49:57.618 INFO:tasks.workunit.client.0.smithi081.stdout:7/747: write d3/d20/fe0 [2615185,109923] 0 2024-04-23T14:49:57.620 INFO:tasks.workunit.client.1.smithi156.stdout:6/575: mknod d3/d16/d46/d9d/d9f/cce 0 2024-04-23T14:49:57.624 INFO:tasks.workunit.client.1.smithi156.stdout:7/549: symlink dc/d1d/d41/la4 0 2024-04-23T14:49:57.626 INFO:tasks.workunit.client.1.smithi156.stdout:6/576: write d3/d16/f30 [1398880,57977] 0 2024-04-23T14:49:57.630 INFO:tasks.workunit.client.1.smithi156.stdout:9/438: dwrite d1/d2/d3e/d50/d7a/d17/d1f/f63 [0,4194304] 0 2024-04-23T14:49:57.630 INFO:tasks.workunit.client.1.smithi156.stdout:9/439: fsync d1/d2/d3e/d50/f90 0 2024-04-23T14:49:57.630 INFO:tasks.workunit.client.1.smithi156.stdout:9/440: creat d1/d2/d3e/d50/f99 x:0 0 0 2024-04-23T14:49:57.631 INFO:tasks.workunit.client.1.smithi156.stdout:9/441: dread - d1/d2/d3e/d50/d7a/d17/f82 zero size 2024-04-23T14:49:57.631 INFO:tasks.workunit.client.1.smithi156.stdout:5/545: dread d1/d3/d24/da0/f3c [0,4194304] 0 2024-04-23T14:49:57.631 INFO:tasks.workunit.client.1.smithi156.stdout:9/442: write d1/d2/d3e/d50/d7a/d17/f2c [6017765,31648] 0 2024-04-23T14:49:57.636 INFO:tasks.workunit.client.0.smithi081.stdout:5/894: creat d17/d3c/d55/d64/f138 x:0 0 0 2024-04-23T14:49:57.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.636+0000 7fa6ce800700 1 -- 172.21.15.81:0/297822881 --> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa6c806b930 con 0x7fa6ac06be80 2024-04-23T14:49:57.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.638+0000 7fa6bf400700 1 -- 172.21.15.81:0/297822881 <== mgr.24373 v2:172.21.15.156:6828/100981835 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fa6c806b930 con 0x7fa6ac06be80 2024-04-23T14:49:57.642 INFO:tasks.workunit.client.0.smithi081.stdout:4/789: dwrite d1/d4/dc/f78 [0,4194304] 0 2024-04-23T14:49:57.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.645+0000 7fa6ce800700 1 -- 172.21.15.81:0/297822881 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fa6ac06be80 msgr2=0x7fa6ac06e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:57.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.645+0000 7fa6ce800700 1 --2- 172.21.15.81:0/297822881 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fa6ac06be80 0x7fa6ac06e330 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa6b0004ef0 tx=0x7fa6b0009040 comp rx=0 tx=0).stop 2024-04-23T14:49:57.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.646+0000 7fa6ce800700 1 -- 172.21.15.81:0/297822881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c806e9b0 msgr2=0x7fa6c811c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:57.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.646+0000 7fa6ce800700 1 --2- 172.21.15.81:0/297822881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c806e9b0 0x7fa6c811c510 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8004890 tx=0x7fa6b8009e30 comp rx=0 tx=0).stop 2024-04-23T14:49:57.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.646+0000 7fa6ce800700 1 -- 172.21.15.81:0/297822881 shutdown_connections 2024-04-23T14:49:57.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.646+0000 7fa6ce800700 1 --2- 172.21.15.81:0/297822881 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fa6ac06be80 0x7fa6ac06e330 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:57.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.646+0000 7fa6ce800700 1 --2- 172.21.15.81:0/297822881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c806e9b0 0x7fa6c811c510 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:57.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.646+0000 7fa6ce800700 1 --2- 172.21.15.81:0/297822881 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6c806fdd0 0x7fa6c811ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:57.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.646+0000 7fa6ce800700 1 -- 172.21.15.81:0/297822881 >> 172.21.15.81:0/297822881 conn(0x7fa6c8069df0 msgr2=0x7fa6c806a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:57.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.646+0000 7fa6ce800700 1 -- 172.21.15.81:0/297822881 shutdown_connections 2024-04-23T14:49:57.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.646+0000 7fa6ce800700 1 -- 172.21.15.81:0/297822881 wait complete. 2024-04-23T14:49:57.649 INFO:tasks.workunit.client.0.smithi081.stdout:0/945: symlink d6/d37/d4d/d71/l12d 0 2024-04-23T14:49:57.652 INFO:tasks.workunit.client.1.smithi156.stdout:6/577: dread d3/d16/f76 [0,4194304] 0 2024-04-23T14:49:57.655 INFO:tasks.workunit.client.1.smithi156.stdout:0/516: creat d0/fb1 x:0 0 0 2024-04-23T14:49:57.658 INFO:tasks.workunit.client.0.smithi081.stdout:1/940: mkdir d3/d3d/d90/de0/d13a 0 2024-04-23T14:49:57.658 INFO:tasks.workunit.client.0.smithi081.stdout:1/941: chown d3/d3d/d41/d5e/d17/d25/ce2 33395 1 2024-04-23T14:49:57.659 INFO:tasks.workunit.client.0.smithi081.stdout:1/942: chown d3/d3d/d41/d5e/c8c 30372 1 2024-04-23T14:49:57.660 INFO:tasks.workunit.client.1.smithi156.stdout:7/550: creat dc/fa5 x:0 0 0 2024-04-23T14:49:57.668 INFO:tasks.workunit.client.0.smithi081.stdout:6/821: rename d1/d51/d65/d13/f3e to d1/d51/d65/d1c/f11e 0 2024-04-23T14:49:57.669 INFO:tasks.workunit.client.0.smithi081.stdout:6/822: write d1/d51/d65/f86 [1355976,86110] 0 2024-04-23T14:49:57.669 INFO:tasks.workunit.client.0.smithi081.stdout:6/823: write d1/d51/d65/d1c/d66/f93 [707190,113705] 0 2024-04-23T14:49:57.674 INFO:tasks.workunit.client.1.smithi156.stdout:2/505: dwrite d4/d13/f20 [0,4194304] 0 2024-04-23T14:49:57.678 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-04-23T14:49:57.680 INFO:tasks.workunit.client.1.smithi156.stdout:7/551: dread dc/d2c/f50 [0,4194304] 0 2024-04-23T14:49:57.685 INFO:tasks.workunit.client.0.smithi081.stdout:8/997: dwrite d3/d11/d3e/d63/f94 [0,4194304] 0 2024-04-23T14:49:57.691 INFO:tasks.workunit.client.0.smithi081.stdout:3/732: creat d4/d7/d32/db0/db5/fe8 x:0 0 0 2024-04-23T14:49:57.691 INFO:tasks.workunit.client.0.smithi081.stdout:7/748: dwrite d3/d11/d2c/d75/f68 [0,4194304] 0 2024-04-23T14:49:57.697 INFO:tasks.workunit.client.0.smithi081.stdout:0/946: mknod d6/d11/c12e 0 2024-04-23T14:49:57.697 INFO:tasks.workunit.client.0.smithi081.stdout:0/947: creat d6/d11/d14/d24/db3/f12f x:0 0 0 2024-04-23T14:49:57.698 INFO:tasks.workunit.client.0.smithi081.stdout:0/948: write d6/d37/d85/ff0 [960314,2394] 0 2024-04-23T14:49:57.707 INFO:tasks.workunit.client.0.smithi081.stdout:8/998: mkdir d3/d11/d86/d88/da7/de0/d14d 0 2024-04-23T14:49:57.707 INFO:tasks.workunit.client.0.smithi081.stdout:8/999: truncate d3/dc6/f11a 1007476 0 2024-04-23T14:49:57.710 INFO:tasks.workunit.client.1.smithi156.stdout:5/546: symlink d1/d11/d27/lab 0 2024-04-23T14:49:57.714 INFO:tasks.workunit.client.1.smithi156.stdout:6/578: mknod d3/da/d74/d93/dc3/ccf 0 2024-04-23T14:49:57.716 INFO:tasks.workunit.client.0.smithi081.stdout:4/790: dwrite d1/fea [0,4194304] 0 2024-04-23T14:49:57.720 INFO:tasks.workunit.client.0.smithi081.stdout:1/943: dwrite d3/d3d/d6f/de6/ff6 [0,4194304] 0 2024-04-23T14:49:57.720 INFO:tasks.workunit.client.0.smithi081.stdout:1/944: chown d3/d3d/d41/d5e/dd2/dd5/df2/f104 45445810 1 2024-04-23T14:49:57.723 INFO:tasks.workunit.client.0.smithi081.stdout:7/749: symlink d3/d21/d41/l101 0 2024-04-23T14:49:57.724 INFO:tasks.workunit.client.1.smithi156.stdout:8/501: dwrite d5/d4e/f66 [0,4194304] 0 2024-04-23T14:49:57.724 INFO:tasks.workunit.client.1.smithi156.stdout:1/571: dwrite db/f4f [4194304,4194304] 0 2024-04-23T14:49:57.724 INFO:tasks.workunit.client.1.smithi156.stdout:3/470: dread d4/db/dd/d1d/d1e/d13/f34 [0,4194304] 0 2024-04-23T14:49:57.724 INFO:tasks.workunit.client.1.smithi156.stdout:3/471: fsync d4/db/d4b/f81 0 2024-04-23T14:49:57.725 INFO:tasks.workunit.client.1.smithi156.stdout:0/517: rename d0/d4/d93 to d0/d4/d11/d3f/d5f/db2 0 2024-04-23T14:49:57.725 INFO:tasks.workunit.client.1.smithi156.stdout:2/506: symlink d4/d13/d19/d4c/lb2 0 2024-04-23T14:49:57.733 INFO:tasks.workunit.client.1.smithi156.stdout:7/552: mkdir dc/d1d/d48/da6 0 2024-04-23T14:49:57.735 INFO:tasks.workunit.client.1.smithi156.stdout:5/547: dread d1/d11/f29 [0,4194304] 0 2024-04-23T14:49:57.735 INFO:tasks.workunit.client.1.smithi156.stdout:6/579: link d3/da/d1d/d27/fb8 d3/da/d1d/fd0 0 2024-04-23T14:49:57.735 INFO:tasks.workunit.client.1.smithi156.stdout:5/548: chown d1/d3 132 1 2024-04-23T14:49:57.735 INFO:tasks.workunit.client.1.smithi156.stdout:6/580: write d3/d16/d46/d64/f90 [2371925,31011] 0 2024-04-23T14:49:57.736 INFO:tasks.workunit.client.1.smithi156.stdout:6/581: dread - d3/d16/d46/f60 zero size 2024-04-23T14:49:57.740 INFO:tasks.workunit.client.1.smithi156.stdout:5/549: dread d1/d11/d18/f47 [0,4194304] 0 2024-04-23T14:49:57.742 INFO:tasks.workunit.client.0.smithi081.stdout:5/895: dread f14 [0,4194304] 0 2024-04-23T14:49:57.744 INFO:tasks.workunit.client.1.smithi156.stdout:4/435: sync 2024-04-23T14:49:57.749 INFO:tasks.workunit.client.1.smithi156.stdout:1/572: mkdir db/d1f/d2f/db5 0 2024-04-23T14:49:57.749 INFO:tasks.workunit.client.1.smithi156.stdout:1/573: chown db/d1f/d28/l45 29 1 2024-04-23T14:49:57.749 INFO:tasks.workunit.client.1.smithi156.stdout:1/574: write db/d25/d30/d38/f6c [984633,107366] 0 2024-04-23T14:49:57.757 INFO:tasks.workunit.client.1.smithi156.stdout:0/518: getdents d0/d16/d43 0 2024-04-23T14:49:57.757 INFO:tasks.workunit.client.1.smithi156.stdout:0/519: write d0/d4/d22/d58/d9a/d44/d4a/f4c [4711562,42653] 0 2024-04-23T14:49:57.757 INFO:tasks.workunit.client.1.smithi156.stdout:0/520: fdatasync d0/d4/f4e 0 2024-04-23T14:49:57.760 INFO:tasks.workunit.client.0.smithi081.stdout:3/733: getdents d4/d7/d2e 0 2024-04-23T14:49:57.765 INFO:tasks.workunit.client.1.smithi156.stdout:5/550: symlink d1/d3/d43/lac 0 2024-04-23T14:49:57.768 INFO:tasks.workunit.client.0.smithi081.stdout:4/791: dread d1/d4/d6f/d70/daf/fcc [0,4194304] 0 2024-04-23T14:49:57.773 INFO:tasks.workunit.client.1.smithi156.stdout:9/443: dwrite d1/d2/d23/f76 [0,4194304] 0 2024-04-23T14:49:57.780 INFO:tasks.workunit.client.0.smithi081.stdout:7/750: mknod d3/d21/d31/d33/d4b/d6e/c102 0 2024-04-23T14:49:57.781 INFO:tasks.workunit.client.1.smithi156.stdout:1/575: truncate db/d1f/d2d/f6e 2949463 0 2024-04-23T14:49:57.781 INFO:tasks.workunit.client.1.smithi156.stdout:1/576: stat db/d1f/d28/c84 0 2024-04-23T14:49:57.782 INFO:tasks.workunit.client.1.smithi156.stdout:1/577: readlink db/d25/d30/d38/d40/l49 0 2024-04-23T14:49:57.786 INFO:tasks.workunit.client.0.smithi081.stdout:6/824: dwrite d1/d51/d7b/d91/f97 [0,4194304] 0 2024-04-23T14:49:57.786 INFO:tasks.workunit.client.0.smithi081.stdout:6/825: readlink d1/d2/d49/lae 0 2024-04-23T14:49:57.789 INFO:tasks.workunit.client.1.smithi156.stdout:0/521: mknod d0/d16/d3a/d2a/d1d/d2d/d6b/cb3 0 2024-04-23T14:49:57.794 INFO:tasks.workunit.client.0.smithi081.stdout:1/945: dwrite d3/d3d/d41/d5e/d5d/d125/d2e/fc5 [0,4194304] 0 2024-04-23T14:49:57.794 INFO:tasks.workunit.client.0.smithi081.stdout:1/946: write d3/d3d/d90/de0/fee [435223,71441] 0 2024-04-23T14:49:57.798 INFO:tasks.workunit.client.1.smithi156.stdout:5/551: symlink d1/d11/d18/d52/d85/lad 0 2024-04-23T14:49:57.798 INFO:tasks.workunit.client.1.smithi156.stdout:5/552: write d1/d11/f13 [611215,24822] 0 2024-04-23T14:49:57.801 INFO:tasks.workunit.client.1.smithi156.stdout:6/582: dwrite d3/da/f4f [0,4194304] 0 2024-04-23T14:49:57.801 INFO:tasks.workunit.client.1.smithi156.stdout:6/583: stat d3/d16/d1e/ca9 0 2024-04-23T14:49:57.801 INFO:tasks.workunit.client.1.smithi156.stdout:6/584: fsync d3/d16/d5c/f86 0 2024-04-23T14:49:57.801 INFO:tasks.workunit.client.1.smithi156.stdout:6/585: truncate d3/da/fa0 1283915 0 2024-04-23T14:49:57.808 INFO:tasks.workunit.client.0.smithi081.stdout:5/896: dwrite d17/d3d/d41/f6a [0,4194304] 0 2024-04-23T14:49:57.808 INFO:tasks.workunit.client.0.smithi081.stdout:4/792: link d1/d4/c84 d1/d4/d6f/d70/d9c/ddd/cfd 0 2024-04-23T14:49:57.811 INFO:tasks.workunit.client.0.smithi081.stdout:7/751: link d3/d21/d41/ca0 d3/d21/d31/d33/d4b/d6e/c103 0 2024-04-23T14:49:57.814 INFO:tasks.workunit.client.0.smithi081.stdout:6/826: creat d1/d51/d65/d13/d16/dd0/df7/da1/dc1/f11f x:0 0 0 2024-04-23T14:49:57.814 INFO:tasks.workunit.client.0.smithi081.stdout:6/827: stat d1/d51/d65/d13/df4 0 2024-04-23T14:49:57.814 INFO:tasks.workunit.client.0.smithi081.stdout:6/828: chown d1/d51/d65/d13/d16 57547304 1 2024-04-23T14:49:57.814 INFO:tasks.workunit.client.0.smithi081.stdout:6/829: chown d1/d51/d65/d8/d2e/c7e 95 1 2024-04-23T14:49:57.816 INFO:tasks.workunit.client.0.smithi081.stdout:1/947: symlink d3/d3d/d10d/l13b 0 2024-04-23T14:49:57.824 INFO:tasks.workunit.client.0.smithi081.stdout:3/734: dwrite d4/f6 [4194304,4194304] 0 2024-04-23T14:49:57.828 INFO:tasks.workunit.client.1.smithi156.stdout:1/578: getdents db/d1f/d2f/d47/d71 0 2024-04-23T14:49:57.828 INFO:tasks.workunit.client.1.smithi156.stdout:1/579: truncate db/d25/d30/d38/f73 1413708 0 2024-04-23T14:49:57.833 INFO:tasks.workunit.client.1.smithi156.stdout:9/444: dwrite d1/d2/d3e/d50/d7a/d17/d1f/f63 [0,4194304] 0 2024-04-23T14:49:57.844 INFO:tasks.workunit.client.1.smithi156.stdout:3/472: rename d4/db/d5e to d4/db/dd/d1d/d61/d8d 0 2024-04-23T14:49:57.846 INFO:tasks.workunit.client.0.smithi081.stdout:5/897: unlink d17/d3d/f49 0 2024-04-23T14:49:57.848 INFO:tasks.workunit.client.0.smithi081.stdout:9/799: sync 2024-04-23T14:49:57.848 INFO:tasks.workunit.client.0.smithi081.stdout:9/800: chown d3/d67/c7a 464 1 2024-04-23T14:49:57.848 INFO:tasks.workunit.client.0.smithi081.stdout:2/791: sync 2024-04-23T14:49:57.850 INFO:tasks.workunit.client.0.smithi081.stdout:4/793: creat d1/d4/d6f/d70/daf/d8c/ffe x:0 0 0 2024-04-23T14:49:57.850 INFO:tasks.workunit.client.1.smithi156.stdout:5/553: creat d1/d11/fae x:0 0 0 2024-04-23T14:49:57.852 INFO:tasks.workunit.client.0.smithi081.stdout:7/752: mknod d3/d97/c104 0 2024-04-23T14:49:57.855 INFO:tasks.workunit.client.0.smithi081.stdout:1/948: symlink d3/d3d/d41/d5e/da0/dec/l13c 0 2024-04-23T14:49:57.859 INFO:tasks.workunit.client.0.smithi081.stdout:2/792: dread d1/f43 [0,4194304] 0 2024-04-23T14:49:57.859 INFO:tasks.workunit.client.0.smithi081.stdout:2/793: fdatasync d1/d33/d45/d6e/d97/fb2 0 2024-04-23T14:49:57.860 INFO:tasks.workunit.client.0.smithi081.stdout:3/735: truncate d4/d7/d1a/f8e 396007 0 2024-04-23T14:49:57.867 INFO:tasks.workunit.client.0.smithi081.stdout:9/801: creat d3/f107 x:0 0 0 2024-04-23T14:49:57.867 INFO:tasks.workunit.client.0.smithi081.stdout:9/802: read d3/de/f2e [3553167,41151] 0 2024-04-23T14:49:57.867 INFO:tasks.workunit.client.0.smithi081.stdout:9/803: fsync d3/d1a/f9e 0 2024-04-23T14:49:57.867 INFO:tasks.workunit.client.1.smithi156.stdout:6/586: truncate d3/da/d1d/d59/f7e 3986842 0 2024-04-23T14:49:57.868 INFO:tasks.workunit.client.1.smithi156.stdout:6/587: chown d3/d16/d46/d2b/ca4 2 1 2024-04-23T14:49:57.870 INFO:tasks.workunit.client.1.smithi156.stdout:1/580: creat db/d1f/d2d/d48/dab/fb6 x:0 0 0 2024-04-23T14:49:57.870 INFO:tasks.workunit.client.0.smithi081.stdout:9/804: write d3/de/d25/fce [353750,38120] 0 2024-04-23T14:49:57.870 INFO:tasks.workunit.client.0.smithi081.stdout:9/805: chown d3/de/d14/d5e/d72/c106 14 1 2024-04-23T14:49:57.870 INFO:tasks.workunit.client.0.smithi081.stdout:4/794: rmdir d1/d8f/d94 39 2024-04-23T14:49:57.870 INFO:tasks.workunit.client.0.smithi081.stdout:4/795: dread - d1/d4f/dc3/ff1 zero size 2024-04-23T14:49:57.872 INFO:tasks.workunit.client.0.smithi081.stdout:7/753: link d3/d21/d41/dcd/ld7 d3/d21/d41/l105 0 2024-04-23T14:49:57.873 INFO:tasks.workunit.client.0.smithi081.stdout:6/830: dwrite d1/d51/d65/ffa [0,4194304] 0 2024-04-23T14:49:57.873 INFO:tasks.workunit.client.0.smithi081.stdout:6/831: readlink d1/d51/d65/d13/d16/dd0/df7/le1 0 2024-04-23T14:49:57.876 INFO:tasks.workunit.client.0.smithi081.stdout:3/736: mknod d4/d7/df/d30/d64/da4/ce9 0 2024-04-23T14:49:57.876 INFO:tasks.workunit.client.0.smithi081.stdout:3/737: fsync d4/d7/d32/f3e 0 2024-04-23T14:49:57.879 INFO:tasks.workunit.client.0.smithi081.stdout:9/806: symlink d3/d67/d77/l108 0 2024-04-23T14:49:57.885 INFO:tasks.workunit.client.0.smithi081.stdout:7/754: mkdir d3/d21/d41/d106 0 2024-04-23T14:49:57.887 INFO:tasks.workunit.client.0.smithi081.stdout:7/755: creat d3/d21/d31/d50/da2/f107 x:0 0 0 2024-04-23T14:49:57.892 INFO:tasks.workunit.client.1.smithi156.stdout:4/436: rename d0/d8/d1e/c37 to d0/c8d 0 2024-04-23T14:49:57.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.895+0000 7f2ea7400700 1 -- 172.21.15.81:0/387270592 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e9c013bb0 con 0x7f2ea80fe0e0 2024-04-23T14:49:57.903 INFO:tasks.workunit.client.1.smithi156.stdout:3/473: symlink d4/db/dd/l8e 0 2024-04-23T14:49:57.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.900+0000 7f2eafa00700 1 -- 172.21.15.81:0/387270592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ea80fe0e0 msgr2=0x7f2ea80fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:57.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.900+0000 7f2eafa00700 1 --2- 172.21.15.81:0/387270592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ea80fe0e0 0x7f2ea80fe550 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c0048b0 tx=0x7f2e9c009e30 comp rx=0 tx=0).stop 2024-04-23T14:49:57.906 INFO:tasks.workunit.client.0.smithi081.stdout:6/832: truncate d1/d2/d8e/f9e 495915 0 2024-04-23T14:49:57.906 INFO:tasks.workunit.client.0.smithi081.stdout:3/738: rename d4/dc/d50/f4e to d4/d7/d32/db0/db5/fea 0 2024-04-23T14:49:57.906 INFO:tasks.workunit.client.0.smithi081.stdout:3/739: write d4/d41/f66 [6065235,28212] 0 2024-04-23T14:49:57.906 INFO:tasks.workunit.client.0.smithi081.stdout:9/807: dread d3/de/d22/f39 [0,4194304] 0 2024-04-23T14:49:57.906 INFO:tasks.workunit.client.0.smithi081.stdout:9/808: creat d3/de/d1d/d5b/f109 x:0 0 0 2024-04-23T14:49:57.906 INFO:tasks.workunit.client.0.smithi081.stdout:9/809: chown d3/d1a/d6c/l92 3415 1 2024-04-23T14:49:57.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.905+0000 7f2eafa00700 1 -- 172.21.15.81:0/387270592 shutdown_connections 2024-04-23T14:49:57.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.905+0000 7f2eafa00700 1 --2- 172.21.15.81:0/387270592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ea80fe0e0 0x7f2ea80fe550 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:57.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.905+0000 7f2eafa00700 1 --2- 172.21.15.81:0/387270592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ea80fcef0 0x7f2ea80fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:57.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.905+0000 7f2eafa00700 1 -- 172.21.15.81:0/387270592 >> 172.21.15.81:0/387270592 conn(0x7f2ea80f8530 msgr2=0x7f2ea80fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:57.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.905+0000 7f2eafa00700 1 -- 172.21.15.81:0/387270592 shutdown_connections 2024-04-23T14:49:57.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.905+0000 7f2eafa00700 1 -- 172.21.15.81:0/387270592 wait complete. 2024-04-23T14:49:57.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.907+0000 7f2eafa00700 1 Processor -- start 2024-04-23T14:49:57.907 INFO:tasks.workunit.client.0.smithi081.stdout:5/898: dwrite d17/d4f/d61/fab [0,4194304] 0 2024-04-23T14:49:57.907 INFO:tasks.workunit.client.0.smithi081.stdout:5/899: creat d17/d3c/d55/d64/f139 x:0 0 0 2024-04-23T14:49:57.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.907+0000 7f2eafa00700 1 -- start start 2024-04-23T14:49:57.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.907+0000 7f2eafa00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ea80fcef0 0x7f2ea810fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:57.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.907+0000 7f2eafa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ea80fe0e0 0x7f2ea8110110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:57.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.907+0000 7f2eafa00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea8110710 con 0x7f2ea80fe0e0 2024-04-23T14:49:57.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.907+0000 7f2eafa00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea8110f60 con 0x7f2ea80fcef0 2024-04-23T14:49:57.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.908+0000 7f2ead000700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ea80fcef0 0x7f2ea810fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:57.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.908+0000 7f2ead000700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ea80fcef0 0x7f2ea810fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.81:33126/0 (socket says 172.21.15.81:33126) 2024-04-23T14:49:57.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.908+0000 7f2ead000700 1 -- 172.21.15.81:0/4104247831 learned_addr learned my addr 172.21.15.81:0/4104247831 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:49:57.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.909+0000 7f2ead000700 1 -- 172.21.15.81:0/4104247831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ea80fe0e0 msgr2=0x7f2ea8110110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:57.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.909+0000 7f2ead000700 1 --2- 172.21.15.81:0/4104247831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ea80fe0e0 0x7f2ea8110110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:57.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.909+0000 7f2ead000700 1 -- 172.21.15.81:0/4104247831 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9c005040 con 0x7f2ea80fcef0 2024-04-23T14:49:57.913 INFO:tasks.workunit.client.1.smithi156.stdout:6/588: mknod d3/da/d1d/d59/cd1 0 2024-04-23T14:49:57.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.912+0000 7f2ead000700 1 --2- 172.21.15.81:0/4104247831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ea80fcef0 0x7f2ea810fbd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2e94002a80 tx=0x7f2e94004630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:57.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.912+0000 7f2ea4c00700 1 -- 172.21.15.81:0/4104247831 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e94007cc0 con 0x7f2ea80fcef0 2024-04-23T14:49:57.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.912+0000 7f2eafa00700 1 -- 172.21.15.81:0/4104247831 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ea81111c0 con 0x7f2ea80fcef0 2024-04-23T14:49:57.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.912+0000 7f2ea4c00700 1 -- 172.21.15.81:0/4104247831 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2e9400f040 con 0x7f2ea80fcef0 2024-04-23T14:49:57.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.912+0000 7f2ea4c00700 1 -- 172.21.15.81:0/4104247831 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e9400db30 con 0x7f2ea80fcef0 2024-04-23T14:49:57.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.913+0000 7f2eafa00700 1 -- 172.21.15.81:0/4104247831 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ea8111780 con 0x7f2ea80fcef0 2024-04-23T14:49:57.915 INFO:tasks.workunit.client.0.smithi081.stdout:6/833: dread d1/d51/d65/d8/d2e/d59/f68 [0,4194304] 0 2024-04-23T14:49:57.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.916+0000 7f2eafa00700 1 -- 172.21.15.81:0/4104247831 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ea8101a70 con 0x7f2ea80fcef0 2024-04-23T14:49:57.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.922+0000 7f2ea4c00700 1 -- 172.21.15.81:0/4104247831 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f2e9400dc90 con 0x7f2ea80fcef0 2024-04-23T14:49:57.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.925+0000 7f2ea4c00700 1 --2- 172.21.15.81:0/4104247831 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f2e9006bdc0 0x7f2e9006e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:57.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.925+0000 7f2ea4c00700 1 -- 172.21.15.81:0/4104247831 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f2e9408a680 con 0x7f2ea80fcef0 2024-04-23T14:49:57.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.926+0000 7f2ea7e00700 1 --2- 172.21.15.81:0/4104247831 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f2e9006bdc0 0x7f2e9006e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:57.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.928+0000 7f2ea7e00700 1 --2- 172.21.15.81:0/4104247831 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f2e9006bdc0 0x7f2e9006e270 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c013870 tx=0x7f2e9c009e30 comp rx=0 tx=0).ready entity=mgr.24373 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:57.930 INFO:tasks.workunit.client.1.smithi156.stdout:1/581: creat db/d1f/d2d/d48/daf/d68/fb7 x:0 0 0 2024-04-23T14:49:57.930 INFO:tasks.workunit.client.1.smithi156.stdout:1/582: write db/d1f/f76 [641416,53698] 0 2024-04-23T14:49:57.930 INFO:tasks.workunit.client.0.smithi081.stdout:7/756: symlink d3/d21/d31/d33/d4b/l108 0 2024-04-23T14:49:57.934 INFO:tasks.workunit.client.0.smithi081.stdout:2/794: dwrite d1/d11/d21/d34/fb1 [0,4194304] 0 2024-04-23T14:49:57.939 INFO:tasks.workunit.client.1.smithi156.stdout:0/522: rename d0/d16/d3a/d1e/c37 to d0/d16/d3a/d2a/cb4 0 2024-04-23T14:49:57.939 INFO:tasks.workunit.client.1.smithi156.stdout:9/445: rename d1/d2 to d1/d2/d23/d9a 22 2024-04-23T14:49:57.939 INFO:tasks.workunit.client.1.smithi156.stdout:9/446: fsync d1/d2/d23/d49/d4c/f3b 0 2024-04-23T14:49:57.940 INFO:tasks.workunit.client.1.smithi156.stdout:8/502: sync 2024-04-23T14:49:57.940 INFO:tasks.workunit.client.1.smithi156.stdout:7/553: sync 2024-04-23T14:49:57.940 INFO:tasks.workunit.client.1.smithi156.stdout:2/507: sync 2024-04-23T14:49:57.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:57.939+0000 7f2ea4c00700 1 -- 172.21.15.81:0/4104247831 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f2e94057930 con 0x7f2ea80fcef0 2024-04-23T14:49:57.943 INFO:tasks.workunit.client.0.smithi081.stdout:4/796: dwrite d1/d1d/f3e [0,4194304] 0 2024-04-23T14:49:57.945 INFO:tasks.workunit.client.1.smithi156.stdout:4/437: creat d0/d8/f8e x:0 0 0 2024-04-23T14:49:57.945 INFO:tasks.workunit.client.1.smithi156.stdout:4/438: write d0/df/d55/f73 [404649,23246] 0 2024-04-23T14:49:57.954 INFO:tasks.workunit.client.0.smithi081.stdout:2/795: write d1/d11/d21/d34/fb1 [1822567,61412] 0 2024-04-23T14:49:57.955 INFO:tasks.workunit.client.1.smithi156.stdout:3/474: creat d4/db/dd/d1d/d1e/d42/f8f x:0 0 0 2024-04-23T14:49:57.956 INFO:tasks.workunit.client.1.smithi156.stdout:5/554: rename d1/d3/fd to d1/d11/d27/faf 0 2024-04-23T14:49:57.957 INFO:tasks.workunit.client.1.smithi156.stdout:5/555: chown d1/d11/f13 9784 1 2024-04-23T14:49:57.957 INFO:tasks.workunit.client.0.smithi081.stdout:3/740: readlink d4/d7/d7f/lc1 0 2024-04-23T14:49:57.957 INFO:tasks.workunit.client.0.smithi081.stdout:3/741: fdatasync d4/d7/d32/da6/dc4/f79 0 2024-04-23T14:49:57.959 INFO:tasks.workunit.client.1.smithi156.stdout:9/447: unlink d1/d2/d23/d49/d4b/f5b 0 2024-04-23T14:49:57.961 INFO:tasks.workunit.client.1.smithi156.stdout:8/503: mkdir d5/d9/d36/d9c/db2 0 2024-04-23T14:49:57.961 INFO:tasks.workunit.client.1.smithi156.stdout:8/504: write d5/d9/d5a/f2e [182882,8511] 0 2024-04-23T14:49:57.961 INFO:tasks.workunit.client.1.smithi156.stdout:8/505: truncate d5/d9/d36/d84/f8f 1193511 0 2024-04-23T14:49:57.961 INFO:tasks.workunit.client.1.smithi156.stdout:8/506: write d5/d9/d5a/d5c/f72 [818034,35705] 0 2024-04-23T14:49:57.963 INFO:tasks.workunit.client.0.smithi081.stdout:1/949: dwrite d3/d3d/d41/f42 [0,4194304] 0 2024-04-23T14:49:57.963 INFO:tasks.workunit.client.0.smithi081.stdout:4/797: write d1/d4/d6f/d70/f7e [213512,60370] 0 2024-04-23T14:49:57.963 INFO:tasks.workunit.client.0.smithi081.stdout:5/900: dwrite d17/d4f/d61/fab [0,4194304] 0 2024-04-23T14:49:57.963 INFO:tasks.workunit.client.1.smithi156.stdout:7/554: mkdir dc/d1d/d24/da7 0 2024-04-23T14:49:57.964 INFO:tasks.workunit.client.1.smithi156.stdout:1/583: write db/d25/d30/d38/f6c [554491,119847] 0 2024-04-23T14:49:57.965 INFO:tasks.workunit.client.0.smithi081.stdout:6/834: creat d1/d51/d7b/f120 x:0 0 0 2024-04-23T14:49:57.965 INFO:tasks.workunit.client.1.smithi156.stdout:4/439: creat d0/d30/f8f x:0 0 0 2024-04-23T14:49:57.971 INFO:tasks.workunit.client.0.smithi081.stdout:7/757: creat d3/d21/d41/d106/f109 x:0 0 0 2024-04-23T14:49:57.972 INFO:tasks.workunit.client.1.smithi156.stdout:3/475: rename d4/db/dd/d1d/d1e/d2b/d31 to d4/db/dd/d1d/d1e/d74/d90 0 2024-04-23T14:49:57.972 INFO:tasks.workunit.client.1.smithi156.stdout:3/476: dread - d4/db/dd/d1d/d1e/d42/f8f zero size 2024-04-23T14:49:57.976 INFO:tasks.workunit.client.1.smithi156.stdout:9/448: creat d1/d2/d3e/d80/f9b x:0 0 0 2024-04-23T14:49:57.984 INFO:tasks.workunit.client.0.smithi081.stdout:2/796: creat d1/f10e x:0 0 0 2024-04-23T14:49:57.989 INFO:tasks.workunit.client.1.smithi156.stdout:8/507: link d5/d39/f9e d5/d4e/fb3 0 2024-04-23T14:49:57.989 INFO:tasks.workunit.client.1.smithi156.stdout:8/508: chown d5/d9/d36/d84/d8c/faa 87 1 2024-04-23T14:49:57.990 INFO:tasks.workunit.client.1.smithi156.stdout:5/556: write d1/d3/d24/f57 [3775499,80122] 0 2024-04-23T14:49:57.991 INFO:tasks.workunit.client.0.smithi081.stdout:5/901: dread d17/d3d/d7a/fa6 [0,4194304] 0 2024-04-23T14:49:57.991 INFO:tasks.workunit.client.0.smithi081.stdout:5/902: read d17/d18/dff/d9a/fe8 [809462,124340] 0 2024-04-23T14:49:57.997 INFO:tasks.workunit.client.0.smithi081.stdout:3/742: unlink d4/d7/d32/f94 0 2024-04-23T14:49:57.998 INFO:tasks.workunit.client.0.smithi081.stdout:1/950: dread d3/d3d/d41/d4a/f3f [4194304,4194304] 0 2024-04-23T14:49:57.999 INFO:tasks.workunit.client.0.smithi081.stdout:1/951: write d3/d3d/d41/d5e/dd2/f114 [45158,60644] 0 2024-04-23T14:49:57.999 INFO:tasks.workunit.client.0.smithi081.stdout:1/952: creat d3/d3d/de9/f13d x:0 0 0 2024-04-23T14:49:58.000 INFO:tasks.workunit.client.1.smithi156.stdout:2/508: getdents d4/d13/d19/d4c/d5c 0 2024-04-23T14:49:58.003 INFO:tasks.workunit.client.1.smithi156.stdout:7/555: mknod dc/d1d/d24/da7/ca8 0 2024-04-23T14:49:58.006 INFO:tasks.workunit.client.1.smithi156.stdout:6/589: dwrite d3/da/d1d/f67 [0,4194304] 0 2024-04-23T14:49:58.006 INFO:tasks.workunit.client.1.smithi156.stdout:1/584: mkdir db/d1f/d28/db8 0 2024-04-23T14:49:58.014 INFO:tasks.workunit.client.1.smithi156.stdout:4/440: rename d0/df/f71 to d0/df/d55/d68/d85/f90 0 2024-04-23T14:49:58.016 INFO:tasks.workunit.client.1.smithi156.stdout:3/477: mkdir d4/db/dd/d1d/d61/d8d/d91 0 2024-04-23T14:49:58.019 INFO:tasks.workunit.client.0.smithi081.stdout:5/903: write d17/d3d/d7a/ff6 [1360490,98134] 0 2024-04-23T14:49:58.021 INFO:tasks.workunit.client.0.smithi081.stdout:3/743: write d4/dc/d50/d9a/fa5 [22139,1317] 0 2024-04-23T14:49:58.023 INFO:tasks.workunit.client.1.smithi156.stdout:4/441: dread d0/df/d55/f62 [0,4194304] 0 2024-04-23T14:49:58.029 INFO:tasks.workunit.client.1.smithi156.stdout:9/449: rmdir d1/d2/d3e/d50/d7a/d85 0 2024-04-23T14:49:58.030 INFO:tasks.workunit.client.1.smithi156.stdout:7/556: mkdir dc/d2a/da9 0 2024-04-23T14:49:58.031 INFO:tasks.workunit.client.1.smithi156.stdout:6/590: symlink d3/d16/d46/d2b/d97/ld2 0 2024-04-23T14:49:58.033 INFO:tasks.workunit.client.1.smithi156.stdout:1/585: dread db/f11 [0,4194304] 0 2024-04-23T14:49:58.033 INFO:tasks.workunit.client.1.smithi156.stdout:1/586: chown db/d1f/d28/d70/db3/d63/l98 614543 1 2024-04-23T14:49:58.033 INFO:tasks.workunit.client.1.smithi156.stdout:1/587: dread - db/d1f/d2d/d48/dab/fb6 zero size 2024-04-23T14:49:58.036 INFO:tasks.workunit.client.0.smithi081.stdout:4/798: dwrite d1/d1d/d39/d8d/f90 [0,4194304] 0 2024-04-23T14:49:58.038 INFO:tasks.workunit.client.0.smithi081.stdout:9/810: getdents d3/de/d1d/d5b 0 2024-04-23T14:49:58.041 INFO:tasks.workunit.client.0.smithi081.stdout:6/835: creat d1/d51/d65/d8/d2e/d59/d80/f121 x:0 0 0 2024-04-23T14:49:58.041 INFO:tasks.workunit.client.0.smithi081.stdout:7/758: creat d3/d11/f10a x:0 0 0 2024-04-23T14:49:58.043 INFO:tasks.workunit.client.1.smithi156.stdout:3/478: creat d4/db/dd/d1d/d61/d8d/d91/f92 x:0 0 0 2024-04-23T14:49:58.043 INFO:tasks.workunit.client.1.smithi156.stdout:3/479: readlink d4/db/dd/d1d/l33 0 2024-04-23T14:49:58.043 INFO:tasks.workunit.client.1.smithi156.stdout:3/480: chown d4/db/dd/d1d/d61/d7f 3715 1 2024-04-23T14:49:58.043 INFO:tasks.workunit.client.1.smithi156.stdout:3/481: truncate d4/db/dd/d1d/d61/d8d/d91/f92 899774 0 2024-04-23T14:49:58.045 INFO:tasks.workunit.client.0.smithi081.stdout:2/797: symlink d1/d33/d45/de9/l10f 0 2024-04-23T14:49:58.048 INFO:tasks.workunit.client.1.smithi156.stdout:4/442: unlink d0/l5d 0 2024-04-23T14:49:58.049 INFO:tasks.workunit.client.1.smithi156.stdout:4/443: fdatasync d0/df/d21/f69 0 2024-04-23T14:49:58.049 INFO:tasks.workunit.client.1.smithi156.stdout:2/509: truncate d4/d21/f37 643785 0 2024-04-23T14:49:58.052 INFO:tasks.workunit.client.1.smithi156.stdout:9/450: rename d1/d2/d23/d2d to d1/d2/d3e/d55/d9c 0 2024-04-23T14:49:58.053 INFO:tasks.workunit.client.1.smithi156.stdout:7/557: link dc/d1d/d24/f4a dc/d1d/d24/d5a/faa 0 2024-04-23T14:49:58.055 INFO:tasks.workunit.client.0.smithi081.stdout:5/904: creat d17/d65/de3/d108/db1/d12c/f13a x:0 0 0 2024-04-23T14:49:58.056 INFO:tasks.workunit.client.1.smithi156.stdout:6/591: creat d3/da/d74/d93/fd3 x:0 0 0 2024-04-23T14:49:58.056 INFO:tasks.workunit.client.1.smithi156.stdout:6/592: chown d3/d16/d46/d2b/d97/dc8 30425034 1 2024-04-23T14:49:58.059 INFO:tasks.workunit.client.1.smithi156.stdout:1/588: mkdir db/d1f/d2d/d48/db4/db9 0 2024-04-23T14:49:58.062 INFO:tasks.workunit.client.1.smithi156.stdout:3/482: mkdir d4/db/dd/d1d/d1e/d74/d93 0 2024-04-23T14:49:58.064 INFO:tasks.workunit.client.0.smithi081.stdout:3/744: rename d4/d7/d32/da6/dc4/d5a/lb3 to d4/leb 0 2024-04-23T14:49:58.064 INFO:tasks.workunit.client.0.smithi081.stdout:9/811: dread d3/de/d1d/d5b/d7b/ff9 [0,4194304] 0 2024-04-23T14:49:58.065 INFO:tasks.workunit.client.1.smithi156.stdout:2/510: creat d4/d13/d19/d4c/d5c/fb3 x:0 0 0 2024-04-23T14:49:58.066 INFO:tasks.workunit.client.0.smithi081.stdout:4/799: rename d1/d1d/d39/d8d/de3/ff0 to d1/d1d/d39/d8d/de3/fff 0 2024-04-23T14:49:58.066 INFO:tasks.workunit.client.1.smithi156.stdout:8/509: dwrite d5/d9/d5a/f75 [0,4194304] 0 2024-04-23T14:49:58.066 INFO:tasks.workunit.client.1.smithi156.stdout:8/510: stat d5/d4e/f66 0 2024-04-23T14:49:58.068 INFO:tasks.workunit.client.1.smithi156.stdout:9/451: unlink d1/d2/d3e/d50/d7a/d40/d35/l5f 0 2024-04-23T14:49:58.069 INFO:tasks.workunit.client.1.smithi156.stdout:9/452: readlink d1/d2/d3e/d50/d7a/d17/l24 0 2024-04-23T14:49:58.069 INFO:tasks.workunit.client.1.smithi156.stdout:9/453: stat d1/f81 0 2024-04-23T14:49:58.070 INFO:tasks.workunit.client.0.smithi081.stdout:6/836: unlink d1/d51/d65/d8/d2e/l48 0 2024-04-23T14:49:58.070 INFO:tasks.workunit.client.0.smithi081.stdout:6/837: chown d1/d51/d65/cc6 4744084 1 2024-04-23T14:49:58.071 INFO:tasks.workunit.client.0.smithi081.stdout:6/838: readlink d1/d51/d65/d13/d46/l56 0 2024-04-23T14:49:58.074 INFO:tasks.workunit.client.0.smithi081.stdout:1/953: rmdir d3/d3d/d41/d5e/dd2/dd5/df2 39 2024-04-23T14:49:58.074 INFO:tasks.workunit.client.0.smithi081.stdout:1/954: fdatasync d3/d3d/f32 0 2024-04-23T14:49:58.074 INFO:tasks.workunit.client.0.smithi081.stdout:1/955: getdents d3/d3d/d138 0 2024-04-23T14:49:58.075 INFO:tasks.workunit.client.1.smithi156.stdout:6/593: symlink d3/da/d1d/d27/ld4 0 2024-04-23T14:49:58.076 INFO:tasks.workunit.client.1.smithi156.stdout:6/594: read - d3/da/f3a zero size 2024-04-23T14:49:58.076 INFO:tasks.workunit.client.1.smithi156.stdout:6/595: truncate d3/da/d1d/d27/d63/f96 4678177 0 2024-04-23T14:49:58.082 INFO:tasks.workunit.client.0.smithi081.stdout:3/745: mknod d4/d7/d7f/d85/d9d/dac/dc7/dd3/cec 0 2024-04-23T14:49:58.089 INFO:tasks.workunit.client.0.smithi081.stdout:5/905: dread d17/d18/dff/d59/f63 [0,4194304] 0 2024-04-23T14:49:58.092 INFO:tasks.workunit.client.1.smithi156.stdout:3/483: symlink d4/db/dd/d1d/d1e/d74/l94 0 2024-04-23T14:49:58.092 INFO:tasks.workunit.client.1.smithi156.stdout:1/589: write db/d25/f64 [4075353,128787] 0 2024-04-23T14:49:58.093 INFO:tasks.workunit.client.1.smithi156.stdout:5/557: dwrite d1/d3/d64/f88 [0,4194304] 0 2024-04-23T14:49:58.094 INFO:tasks.workunit.client.1.smithi156.stdout:1/590: creat db/d1f/d2d/d93/fba x:0 0 0 2024-04-23T14:49:58.100 INFO:tasks.workunit.client.0.smithi081.stdout:9/812: truncate d3/de/d25/f8e 296266 0 2024-04-23T14:49:58.100 INFO:tasks.workunit.client.0.smithi081.stdout:4/800: creat d1/d4f/f100 x:0 0 0 2024-04-23T14:49:58.102 INFO:tasks.workunit.client.1.smithi156.stdout:6/596: dread d3/d16/f5a [0,4194304] 0 2024-04-23T14:49:58.105 INFO:tasks.workunit.client.0.smithi081.stdout:1/956: dread d3/d3d/f32 [0,4194304] 0 2024-04-23T14:49:58.106 INFO:tasks.workunit.client.0.smithi081.stdout:5/906: dread d17/d18/f32 [0,4194304] 0 2024-04-23T14:49:58.106 INFO:tasks.workunit.client.0.smithi081.stdout:4/801: link d1/d4/d6f/d70/d9c/ddd/cfd d1/d8f/d94/c101 0 2024-04-23T14:49:58.107 INFO:tasks.workunit.client.0.smithi081.stdout:4/802: write d1/f5b [8417731,123279] 0 2024-04-23T14:49:58.107 INFO:tasks.workunit.client.0.smithi081.stdout:4/803: chown d1/d1d/d59/fb2 144040 1 2024-04-23T14:49:58.107 INFO:tasks.workunit.client.0.smithi081.stdout:4/804: write d1/d4/d11/d9d/dac/ff2 [178892,110729] 0 2024-04-23T14:49:58.107 INFO:tasks.workunit.client.0.smithi081.stdout:4/805: creat d1/d8b/f102 x:0 0 0 2024-04-23T14:49:58.110 INFO:tasks.workunit.client.1.smithi156.stdout:8/511: symlink d5/d39/d6d/d8a/lb4 0 2024-04-23T14:49:58.111 INFO:tasks.workunit.client.0.smithi081.stdout:1/957: mkdir d3/d3d/d6f/d13e 0 2024-04-23T14:49:58.111 INFO:tasks.workunit.client.0.smithi081.stdout:0/949: sync 2024-04-23T14:49:58.111 INFO:tasks.workunit.client.0.smithi081.stdout:0/950: dread - d6/d11/d14/f91 zero size 2024-04-23T14:49:58.113 INFO:tasks.workunit.client.1.smithi156.stdout:3/484: dread d4/db/dd/d1d/d1e/d13/f34 [0,4194304] 0 2024-04-23T14:49:58.113 INFO:tasks.workunit.client.1.smithi156.stdout:3/485: creat d4/db/dd/d1d/d1e/d42/d76/f95 x:0 0 0 2024-04-23T14:49:58.120 INFO:tasks.workunit.client.0.smithi081.stdout:5/907: rename d17/d18/dff/d59/da8/f125 to d17/d1f/f13b 0 2024-04-23T14:49:58.120 INFO:tasks.workunit.client.0.smithi081.stdout:2/798: dread d1/f43 [0,4194304] 0 2024-04-23T14:49:58.128 INFO:tasks.workunit.client.0.smithi081.stdout:7/759: dwrite d3/d20/f3f [0,4194304] 0 2024-04-23T14:49:58.134 INFO:tasks.workunit.client.0.smithi081.stdout:4/806: truncate d1/d4/d6f/d70/f7e 2671472 0 2024-04-23T14:49:58.144 INFO:tasks.workunit.client.0.smithi081.stdout:1/958: creat d3/d3d/d41/d92/f13f x:0 0 0 2024-04-23T14:49:58.148 INFO:tasks.workunit.client.0.smithi081.stdout:4/807: dread d1/d4/dc/f83 [0,4194304] 0 2024-04-23T14:49:58.155 INFO:tasks.workunit.client.1.smithi156.stdout:3/486: dread d4/db/dd/d1d/d1e/d42/f52 [0,4194304] 0 2024-04-23T14:49:58.156 INFO:tasks.workunit.client.0.smithi081.stdout:3/746: dwrite d4/d7/d1a/fbe [0,4194304] 0 2024-04-23T14:49:58.156 INFO:tasks.workunit.client.0.smithi081.stdout:3/747: write d4/d7/d1a/d71/fc3 [832942,84808] 0 2024-04-23T14:49:58.157 INFO:tasks.workunit.client.0.smithi081.stdout:0/951: mkdir d6/d11/d14/d41/d5b/d3f/d44/d78/d84/dfe/d130 0 2024-04-23T14:49:58.157 INFO:tasks.workunit.client.0.smithi081.stdout:7/760: write d3/d11/f1b [11765945,124230] 0 2024-04-23T14:49:58.164 INFO:tasks.workunit.client.0.smithi081.stdout:5/908: mknod d17/d3d/d41/d109/c13c 0 2024-04-23T14:49:58.171 INFO:tasks.workunit.client.0.smithi081.stdout:6/839: dwrite d1/d51/d65/d13/f3c [4194304,4194304] 0 2024-04-23T14:49:58.179 INFO:tasks.workunit.client.1.smithi156.stdout:5/558: dwrite d1/d17/f7d [0,4194304] 0 2024-04-23T14:49:58.188 INFO:tasks.workunit.client.1.smithi156.stdout:5/559: dread d1/d3/d24/da0/f3c [0,4194304] 0 2024-04-23T14:49:58.188 INFO:tasks.workunit.client.1.smithi156.stdout:5/560: chown d1/d11/d18/d19 7315096 1 2024-04-23T14:49:58.189 INFO:tasks.workunit.client.1.smithi156.stdout:7/558: rmdir dc 39 2024-04-23T14:49:58.189 INFO:tasks.workunit.client.0.smithi081.stdout:2/799: dread d1/d33/d45/f7c [0,4194304] 0 2024-04-23T14:49:58.189 INFO:tasks.workunit.client.0.smithi081.stdout:2/800: chown d1/d1e/l3e 825 1 2024-04-23T14:49:58.189 INFO:tasks.workunit.client.0.smithi081.stdout:0/952: mkdir d6/d69/d131 0 2024-04-23T14:49:58.189 INFO:tasks.workunit.client.0.smithi081.stdout:0/953: write d6/d11/d14/d41/d5b/d59/d8e/f93 [4277185,37662] 0 2024-04-23T14:49:58.190 INFO:tasks.workunit.client.1.smithi156.stdout:5/561: read d1/d11/d18/d19/d74/f9d [475468,115008] 0 2024-04-23T14:49:58.194 INFO:tasks.workunit.client.0.smithi081.stdout:9/813: dwrite d3/de/d1d/d54/d68/fe3 [4194304,4194304] 0 2024-04-23T14:49:58.194 INFO:tasks.workunit.client.0.smithi081.stdout:9/814: creat d3/de/d47/f10a x:0 0 0 2024-04-23T14:49:58.194 INFO:tasks.workunit.client.0.smithi081.stdout:9/815: readlink d3/d1a/lc7 0 2024-04-23T14:49:58.194 INFO:tasks.workunit.client.0.smithi081.stdout:9/816: readlink d3/de/d14/d5e/d72/lbb 0 2024-04-23T14:49:58.194 INFO:tasks.workunit.client.0.smithi081.stdout:7/761: mknod d3/d21/d41/dbb/c10b 0 2024-04-23T14:49:58.199 INFO:tasks.workunit.client.0.smithi081.stdout:5/909: unlink d17/d18/dff/d59/f63 0 2024-04-23T14:49:58.203 INFO:tasks.workunit.client.0.smithi081.stdout:7/762: dread d3/d21/d31/d33/d4b/f92 [0,4194304] 0 2024-04-23T14:49:58.207 INFO:tasks.workunit.client.0.smithi081.stdout:0/954: write d6/d11/d14/d41/d5b/d3f/d44/d78/d83/fd2 [3467601,96141] 0 2024-04-23T14:49:58.210 INFO:tasks.workunit.client.1.smithi156.stdout:6/597: getdents d3/d16/d46/d9d/d9f/dad 0 2024-04-23T14:49:58.213 INFO:tasks.workunit.client.0.smithi081.stdout:2/801: link d1/f5 d1/d1e/dad/f110 0 2024-04-23T14:49:58.214 INFO:tasks.workunit.client.1.smithi156.stdout:9/454: write d1/f1e [368778,127758] 0 2024-04-23T14:49:58.225 INFO:tasks.workunit.client.1.smithi156.stdout:8/512: rmdir d5/d9/d36/d9c/db2 0 2024-04-23T14:49:58.233 INFO:tasks.workunit.client.1.smithi156.stdout:3/487: symlink d4/db/dd/d1d/d61/d8d/d91/l96 0 2024-04-23T14:49:58.233 INFO:tasks.workunit.client.1.smithi156.stdout:3/488: write d4/db/d4b/f81 [727656,22833] 0 2024-04-23T14:49:58.235 INFO:tasks.workunit.client.1.smithi156.stdout:2/511: truncate d4/d21/f37 1668507 0 2024-04-23T14:49:58.237 INFO:tasks.workunit.client.0.smithi081.stdout:5/910: link d17/d18/dff/fca d17/d3d/d41/f13d 0 2024-04-23T14:49:58.238 INFO:tasks.workunit.client.0.smithi081.stdout:5/911: chown d17/d1f/d42/d9b 55386 1 2024-04-23T14:49:58.243 INFO:tasks.workunit.client.0.smithi081.stdout:6/840: rmdir d1/d51/d65/d1c/d66 39 2024-04-23T14:49:58.245 INFO:tasks.workunit.client.1.smithi156.stdout:7/559: symlink dc/d1d/d41/lab 0 2024-04-23T14:49:58.247 INFO:tasks.workunit.client.1.smithi156.stdout:8/513: dread d5/d9/d10/fa2 [0,4194304] 0 2024-04-23T14:49:58.247 INFO:tasks.workunit.client.1.smithi156.stdout:8/514: readlink d5/l4a 0 2024-04-23T14:49:58.247 INFO:tasks.workunit.client.1.smithi156.stdout:8/515: dread - d5/d9/d5a/d5c/d6b/f7e zero size 2024-04-23T14:49:58.247 INFO:tasks.workunit.client.1.smithi156.stdout:8/516: readlink d5/l4a 0 2024-04-23T14:49:58.248 INFO:tasks.workunit.client.0.smithi081.stdout:3/748: write d4/f17 [108454,3802] 0 2024-04-23T14:49:58.250 INFO:tasks.workunit.client.1.smithi156.stdout:5/562: symlink d1/d11/d27/lb0 0 2024-04-23T14:49:58.253 INFO:tasks.workunit.client.1.smithi156.stdout:0/523: sync 2024-04-23T14:49:58.255 INFO:tasks.workunit.client.0.smithi081.stdout:4/808: unlink d1/d4f/dc3/fc5 0 2024-04-23T14:49:58.264 INFO:tasks.workunit.client.1.smithi156.stdout:6/598: symlink d3/d16/d46/d64/d77/ld5 0 2024-04-23T14:49:58.269 INFO:tasks.workunit.client.1.smithi156.stdout:9/455: symlink d1/d2/d3e/d50/d7a/d40/l9d 0 2024-04-23T14:49:58.274 INFO:tasks.workunit.client.1.smithi156.stdout:3/489: symlink d4/db/dd/d1d/d1e/d13/d5a/l97 0 2024-04-23T14:49:58.276 INFO:tasks.workunit.client.0.smithi081.stdout:5/912: dread d17/d3d/d7a/fae [0,4194304] 0 2024-04-23T14:49:58.280 INFO:tasks.workunit.client.0.smithi081.stdout:6/841: symlink d1/d51/da6/l122 0 2024-04-23T14:49:58.280 INFO:tasks.workunit.client.0.smithi081.stdout:6/842: read d1/d2/f1d [615907,71368] 0 2024-04-23T14:49:58.280 INFO:tasks.workunit.client.0.smithi081.stdout:6/843: dread - d1/d51/d65/d8/d2e/d59/d80/d90/fef zero size 2024-04-23T14:49:58.281 INFO:tasks.workunit.client.0.smithi081.stdout:2/802: dwrite d1/f4 [0,4194304] 0 2024-04-23T14:49:58.283 INFO:tasks.workunit.client.1.smithi156.stdout:7/560: creat dc/d1d/d24/fac x:0 0 0 2024-04-23T14:49:58.283 INFO:tasks.workunit.client.1.smithi156.stdout:4/444: sync 2024-04-23T14:49:58.284 INFO:tasks.workunit.client.0.smithi081.stdout:7/763: mkdir d3/d21/d31/d50/d5a/d10c 0 2024-04-23T14:49:58.284 INFO:tasks.workunit.client.0.smithi081.stdout:7/764: creat d3/d21/d41/d7c/dc3/d7f/f10d x:0 0 0 2024-04-23T14:49:58.284 INFO:tasks.workunit.client.0.smithi081.stdout:7/765: truncate d3/d21/d41/d7c/dc3/d7f/f9b 986492 0 2024-04-23T14:49:58.286 INFO:tasks.workunit.client.1.smithi156.stdout:8/517: rename d5/d39/d6d/d8b to d5/d9/d36/db5 0 2024-04-23T14:49:58.286 INFO:tasks.workunit.client.1.smithi156.stdout:1/591: sync 2024-04-23T14:49:58.286 INFO:tasks.workunit.client.1.smithi156.stdout:0/524: link d0/d4/d11/d3f/d5f/f71 d0/d16/d3a/d2a/d1d/d2d/d6b/fb5 0 2024-04-23T14:49:58.286 INFO:tasks.workunit.client.1.smithi156.stdout:0/525: chown d0/d16/d3a/d1e/f6e 363 1 2024-04-23T14:49:58.287 INFO:tasks.workunit.client.1.smithi156.stdout:0/526: read d0/d4/d11/d3f/d5f/f71 [532708,76318] 0 2024-04-23T14:49:58.287 INFO:tasks.workunit.client.0.smithi081.stdout:0/955: symlink d6/d37/l132 0 2024-04-23T14:49:58.288 INFO:tasks.workunit.client.1.smithi156.stdout:6/599: mkdir d3/d16/d46/d64/d77/dd6 0 2024-04-23T14:49:58.289 INFO:tasks.workunit.client.0.smithi081.stdout:3/749: unlink d4/d7/d7f/d85/d9d/dac/dc7/fda 0 2024-04-23T14:49:58.291 INFO:tasks.workunit.client.1.smithi156.stdout:7/561: write dc/d2c/f50 [946194,36856] 0 2024-04-23T14:49:58.291 INFO:tasks.workunit.client.1.smithi156.stdout:2/512: rmdir d4/d13/d19/d58 39 2024-04-23T14:49:58.291 INFO:tasks.workunit.client.1.smithi156.stdout:2/513: fsync d4/f24 0 2024-04-23T14:49:58.296 INFO:tasks.workunit.client.0.smithi081.stdout:4/809: link d1/d1d/d39/d8d/de3/fff d1/d4/d6f/f103 0 2024-04-23T14:49:58.300 INFO:tasks.workunit.client.0.smithi081.stdout:2/803: dread d1/d11/d21/fc4 [0,4194304] 0 2024-04-23T14:49:58.303 INFO:tasks.workunit.client.0.smithi081.stdout:5/913: truncate f12 4025021 0 2024-04-23T14:49:58.306 INFO:tasks.workunit.client.1.smithi156.stdout:1/592: mkdir db/d1f/d2f/d47/dbb 0 2024-04-23T14:49:58.308 INFO:tasks.workunit.client.0.smithi081.stdout:6/844: getdents d1/d2/d49 0 2024-04-23T14:49:58.311 INFO:tasks.workunit.client.1.smithi156.stdout:6/600: rename d3/da/d1d/d27/fb8 to d3/fd7 0 2024-04-23T14:49:58.317 INFO:tasks.workunit.client.1.smithi156.stdout:1/593: mknod db/d1f/d28/d70/db3/d63/d9e/cbc 0 2024-04-23T14:49:58.317 INFO:tasks.workunit.client.1.smithi156.stdout:1/594: fdatasync db/d25/d30/d38/d40/faa 0 2024-04-23T14:49:58.317 INFO:tasks.workunit.client.1.smithi156.stdout:1/595: truncate db/d1f/d2d/d48/daf/f74 140922 0 2024-04-23T14:49:58.318 INFO:tasks.workunit.client.0.smithi081.stdout:7/766: rename f2 to d3/d21/d41/d7c/dc3/d7f/d98/f10e 0 2024-04-23T14:49:58.320 INFO:tasks.workunit.client.0.smithi081.stdout:0/956: creat d6/d11/d14/d41/da1/f133 x:0 0 0 2024-04-23T14:49:58.324 INFO:tasks.workunit.client.1.smithi156.stdout:9/456: write d1/d2/d23/f76 [2023898,40037] 0 2024-04-23T14:49:58.326 INFO:tasks.workunit.client.1.smithi156.stdout:1/596: symlink db/d25/lbd 0 2024-04-23T14:49:58.327 INFO:tasks.workunit.client.1.smithi156.stdout:8/518: dread d5/d4e/f83 [0,4194304] 0 2024-04-23T14:49:58.327 INFO:tasks.workunit.client.1.smithi156.stdout:8/519: readlink d5/d9/d5a/l2d 0 2024-04-23T14:49:58.327 INFO:tasks.workunit.client.1.smithi156.stdout:5/563: dwrite d1/d11/d18/d19/f66 [4194304,4194304] 0 2024-04-23T14:49:58.328 INFO:tasks.workunit.client.1.smithi156.stdout:5/564: write d1/d11/fae [960718,121393] 0 2024-04-23T14:49:58.328 INFO:tasks.workunit.client.1.smithi156.stdout:5/565: chown d1/d11/d18/d52/d85/ca3 33630 1 2024-04-23T14:49:58.328 INFO:tasks.workunit.client.1.smithi156.stdout:5/566: readlink d1/d3/d43/l7b 0 2024-04-23T14:49:58.328 INFO:tasks.workunit.client.1.smithi156.stdout:5/567: chown d1/d17/l82 12070466 1 2024-04-23T14:49:58.330 INFO:tasks.workunit.client.0.smithi081.stdout:3/750: creat d4/d7/d7f/d85/d9d/dac/dc7/fed x:0 0 0 2024-04-23T14:49:58.330 INFO:tasks.workunit.client.0.smithi081.stdout:3/751: chown d4/d7/d32/da6/ldc 195 1 2024-04-23T14:49:58.335 INFO:tasks.workunit.client.0.smithi081.stdout:4/810: mkdir d1/d4/d6f/d70/daf/d8c/d99/d104 0 2024-04-23T14:49:58.337 INFO:tasks.workunit.client.0.smithi081.stdout:2/804: symlink d1/d11/d21/d52/d8b/d8f/l111 0 2024-04-23T14:49:58.337 INFO:tasks.workunit.client.0.smithi081.stdout:2/805: stat d1/d11/d21/d52/d8b/f10a 0 2024-04-23T14:49:58.339 INFO:tasks.workunit.client.1.smithi156.stdout:9/457: unlink d1/d2/c11 0 2024-04-23T14:49:58.339 INFO:tasks.workunit.client.1.smithi156.stdout:1/597: rename db/d1f/d2f/l6d to db/d1f/d2f/d47/lbe 0 2024-04-23T14:49:58.342 INFO:tasks.workunit.client.1.smithi156.stdout:8/520: creat d5/d9/d36/d60/d62/d97/fb6 x:0 0 0 2024-04-23T14:49:58.343 INFO:tasks.workunit.client.0.smithi081.stdout:0/957: write d6/f4f [1812047,12589] 0 2024-04-23T14:49:58.343 INFO:tasks.workunit.client.0.smithi081.stdout:0/958: creat d6/d11/d14/d41/d5b/d3f/d44/f134 x:0 0 0 2024-04-23T14:49:58.344 INFO:tasks.workunit.client.1.smithi156.stdout:5/568: creat d1/d11/d18/d19/d9a/fb1 x:0 0 0 2024-04-23T14:49:58.345 INFO:tasks.workunit.client.0.smithi081.stdout:5/914: symlink d17/d3c/d55/l13e 0 2024-04-23T14:49:58.345 INFO:tasks.workunit.client.0.smithi081.stdout:6/845: mkdir d1/d51/d65/d13/d16/dd0/df7/da1/dc1/dc9/dcf/d101/d123 0 2024-04-23T14:49:58.348 INFO:tasks.workunit.client.0.smithi081.stdout:7/767: mkdir d3/d21/d41/dd2/d10f 0 2024-04-23T14:49:58.351 INFO:tasks.workunit.client.0.smithi081.stdout:3/752: rmdir d4/d7/d32/da6/dc4/d5a/d93 39 2024-04-23T14:49:58.351 INFO:tasks.workunit.client.0.smithi081.stdout:2/806: dread d1/d33/d45/d6e/d97/fb4 [0,4194304] 0 2024-04-23T14:49:58.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.351+0000 7f2eafa00700 1 -- 172.21.15.81:0/4104247831 --> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ea8111a90 con 0x7f2e9006bdc0 2024-04-23T14:49:58.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.355+0000 7f2ea4c00700 1 -- 172.21.15.81:0/4104247831 <== mgr.24373 v2:172.21.15.156:6828/100981835 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f2ea8111a90 con 0x7f2e9006bdc0 2024-04-23T14:49:58.356 INFO:tasks.workunit.client.1.smithi156.stdout:9/458: unlink d1/d2/d3e/d55/d6f/l53 0 2024-04-23T14:49:58.356 INFO:tasks.workunit.client.1.smithi156.stdout:9/459: dread - d1/d2/d3e/d50/d7a/d17/f82 zero size 2024-04-23T14:49:58.359 INFO:tasks.workunit.client.1.smithi156.stdout:8/521: dread d5/d9/d10/f34 [0,4194304] 0 2024-04-23T14:49:58.360 INFO:tasks.workunit.client.1.smithi156.stdout:8/522: truncate d5/d9/d10/d1d/d21/f40 4672868 0 2024-04-23T14:49:58.360 INFO:tasks.workunit.client.1.smithi156.stdout:0/527: dwrite d0/d16/d3a/d1e/f3d [0,4194304] 0 2024-04-23T14:49:58.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.359+0000 7f2eafa00700 1 -- 172.21.15.81:0/4104247831 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f2e9006bdc0 msgr2=0x7f2e9006e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:58.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.359+0000 7f2eafa00700 1 --2- 172.21.15.81:0/4104247831 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f2e9006bdc0 0x7f2e9006e270 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c013870 tx=0x7f2e9c009e30 comp rx=0 tx=0).stop 2024-04-23T14:49:58.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.359+0000 7f2eafa00700 1 -- 172.21.15.81:0/4104247831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ea80fcef0 msgr2=0x7f2ea810fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:58.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.359+0000 7f2eafa00700 1 --2- 172.21.15.81:0/4104247831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ea80fcef0 0x7f2ea810fbd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2e94002a80 tx=0x7f2e94004630 comp rx=0 tx=0).stop 2024-04-23T14:49:58.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.359+0000 7f2eafa00700 1 -- 172.21.15.81:0/4104247831 shutdown_connections 2024-04-23T14:49:58.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.359+0000 7f2eafa00700 1 --2- 172.21.15.81:0/4104247831 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f2e9006bdc0 0x7f2e9006e270 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:58.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.359+0000 7f2eafa00700 1 --2- 172.21.15.81:0/4104247831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ea80fcef0 0x7f2ea810fbd0 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2e94002a80 tx=0x7f2e94004630 comp rx=0 tx=0).stop 2024-04-23T14:49:58.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.359+0000 7f2eafa00700 1 --2- 172.21.15.81:0/4104247831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ea80fe0e0 0x7f2ea8110110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:58.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.359+0000 7f2eafa00700 1 -- 172.21.15.81:0/4104247831 >> 172.21.15.81:0/4104247831 conn(0x7f2ea80f8530 msgr2=0x7f2ea80f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:58.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.360+0000 7f2eafa00700 1 -- 172.21.15.81:0/4104247831 shutdown_connections 2024-04-23T14:49:58.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.361+0000 7f2eafa00700 1 -- 172.21.15.81:0/4104247831 wait complete. 2024-04-23T14:49:58.365 INFO:tasks.workunit.client.0.smithi081.stdout:7/768: write d3/d11/d2c/f32 [1634809,53344] 0 2024-04-23T14:49:58.366 INFO:tasks.workunit.client.1.smithi156.stdout:9/460: creat d1/d2/d3e/d55/d9c/f9e x:0 0 0 2024-04-23T14:49:58.366 INFO:tasks.workunit.client.1.smithi156.stdout:9/461: chown d1/d2/d3e/d50/d7a/d17/d1f/d48/f91 5949329 1 2024-04-23T14:49:58.366 INFO:tasks.workunit.client.0.smithi081.stdout:0/959: creat d6/d11/d14/d41/d5b/d3f/d44/d78/d83/d115/f135 x:0 0 0 2024-04-23T14:49:58.367 INFO:tasks.workunit.client.0.smithi081.stdout:4/811: read d1/ffb [2086606,56662] 0 2024-04-23T14:49:58.374 INFO:tasks.workunit.client.0.smithi081.stdout:6/846: rmdir d1/d2/d8e/da9 0 2024-04-23T14:49:58.375 INFO:tasks.workunit.client.0.smithi081.stdout:6/847: write d1/d51/d65/d13/d16/f103 [982994,89975] 0 2024-04-23T14:49:58.375 INFO:tasks.workunit.client.1.smithi156.stdout:8/523: mkdir d5/d39/d6d/db7 0 2024-04-23T14:49:58.375 INFO:tasks.workunit.client.1.smithi156.stdout:8/524: truncate d5/d9/d36/d60/f89 100715 0 2024-04-23T14:49:58.376 INFO:tasks.workunit.client.1.smithi156.stdout:8/525: write d5/d9/d36/d9c/f56 [3674521,129256] 0 2024-04-23T14:49:58.379 INFO:tasks.workunit.client.0.smithi081.stdout:0/960: unlink d6/d11/d14/d24/c34 0 2024-04-23T14:49:58.386 INFO:tasks.workunit.client.1.smithi156.stdout:0/528: dread d0/d4/d22/f34 [0,4194304] 0 2024-04-23T14:49:58.386 INFO:tasks.workunit.client.1.smithi156.stdout:9/462: rename d1/d2/d3e/d50/d7a/d17/c3f to d1/d2/d3e/d50/d7a/d17/d1f/d48/d4e/c9f 0 2024-04-23T14:49:58.386 INFO:tasks.workunit.client.1.smithi156.stdout:9/463: readlink d1/d2/l95 0 2024-04-23T14:49:58.386 INFO:tasks.workunit.client.1.smithi156.stdout:0/529: write d0/d16/d3a/f6a [445051,2735] 0 2024-04-23T14:49:58.388 INFO:tasks.workunit.client.0.smithi081.stdout:5/915: rename d17/d4f to d17/d1f/d42/d9b/d13f 0 2024-04-23T14:49:58.388 INFO:tasks.workunit.client.0.smithi081.stdout:5/916: fdatasync d17/d18/dff/fb5 0 2024-04-23T14:49:58.397 INFO:tasks.workunit.client.0.smithi081.stdout:7/769: mkdir d3/d21/d31/d110 0 2024-04-23T14:49:58.398 INFO:tasks.workunit.client.0.smithi081.stdout:0/961: mknod d6/d11/d14/d24/db3/c136 0 2024-04-23T14:49:58.399 INFO:tasks.workunit.client.0.smithi081.stdout:0/962: fsync d6/d11/d14/d41/da1/f133 0 2024-04-23T14:49:58.399 INFO:tasks.workunit.client.0.smithi081.stdout:0/963: read - d6/d11/d14/d41/d5b/d3f/d44/d78/d83/fce zero size 2024-04-23T14:49:58.400 INFO:tasks.workunit.client.0.smithi081.stdout:5/917: dread d17/d37/d4e/f101 [0,4194304] 0 2024-04-23T14:49:58.400 INFO:tasks.workunit.client.0.smithi081.stdout:5/918: write d17/df3/ffd [189988,62735] 0 2024-04-23T14:49:58.404 INFO:tasks.workunit.client.1.smithi156.stdout:3/490: dwrite d4/db/dd/d1d/d1e/d13/d5a/f6c [0,4194304] 0 2024-04-23T14:49:58.405 INFO:tasks.workunit.client.1.smithi156.stdout:8/526: dread d5/d9/d5a/d5c/d6b/f7b [0,4194304] 0 2024-04-23T14:49:58.407 INFO:tasks.workunit.client.0.smithi081.stdout:4/812: dread d1/d4/f76 [0,4194304] 0 2024-04-23T14:49:58.408 INFO:tasks.workunit.client.1.smithi156.stdout:7/562: write dc/f1c [1834081,48909] 0 2024-04-23T14:49:58.411 INFO:tasks.workunit.client.0.smithi081.stdout:5/919: creat d17/d1f/d42/d9b/d13f/d61/dba/f140 x:0 0 0 2024-04-23T14:49:58.411 INFO:tasks.workunit.client.0.smithi081.stdout:5/920: write d17/f133 [44913,21188] 0 2024-04-23T14:49:58.412 INFO:tasks.workunit.client.0.smithi081.stdout:5/921: chown d17/df3/l10f 1004283 1 2024-04-23T14:49:58.413 INFO:tasks.workunit.client.0.smithi081.stdout:2/807: rename d1/d11/dab/cb9 to d1/c112 0 2024-04-23T14:49:58.413 INFO:tasks.workunit.client.0.smithi081.stdout:7/770: mknod d3/d21/d41/dcd/c111 0 2024-04-23T14:49:58.414 INFO:tasks.workunit.client.1.smithi156.stdout:2/514: write d4/d13/d19/f1a [2343380,115657] 0 2024-04-23T14:49:58.414 INFO:tasks.workunit.client.1.smithi156.stdout:2/515: dread - d4/fb0 zero size 2024-04-23T14:49:58.414 INFO:tasks.workunit.client.1.smithi156.stdout:4/445: dwrite d0/df/d55/d68/f65 [0,4194304] 0 2024-04-23T14:49:58.418 INFO:tasks.workunit.client.1.smithi156.stdout:3/491: rename d4/db/dd/d1d/d1e/d42/d76/d82 to d4/db/dd/d1d/d61/d8d/d8a/d98 0 2024-04-23T14:49:58.419 INFO:tasks.workunit.client.0.smithi081.stdout:0/964: rmdir d6/d37/d85 39 2024-04-23T14:49:58.424 INFO:tasks.workunit.client.0.smithi081.stdout:5/922: unlink d17/d3d/d41/f5e 0 2024-04-23T14:49:58.424 INFO:tasks.workunit.client.0.smithi081.stdout:5/923: fsync d17/d1f/d42/d9b/d9e/da3/fcb 0 2024-04-23T14:49:58.425 INFO:tasks.workunit.client.0.smithi081.stdout:5/924: dread - d17/d18/d3a/d8e/de6/fee zero size 2024-04-23T14:49:58.425 INFO:tasks.workunit.client.1.smithi156.stdout:1/598: write db/d1f/d28/f44 [3982390,85330] 0 2024-04-23T14:49:58.428 INFO:tasks.workunit.client.1.smithi156.stdout:5/569: write d1/d3/f25 [1008029,89948] 0 2024-04-23T14:49:58.428 INFO:tasks.workunit.client.1.smithi156.stdout:7/563: truncate dc/d1d/f52 1967749 0 2024-04-23T14:49:58.433 INFO:tasks.workunit.client.1.smithi156.stdout:6/601: dwrite d3/d16/d46/d9d/d9f/fa3 [0,4194304] 0 2024-04-23T14:49:58.434 INFO:tasks.workunit.client.0.smithi081.stdout:3/753: dwrite d4/d7/fcc [0,4194304] 0 2024-04-23T14:49:58.434 INFO:tasks.workunit.client.0.smithi081.stdout:2/808: rename d1/d33/d9f/ce7 to d1/d33/d45/d6e/d97/c113 0 2024-04-23T14:49:58.434 INFO:tasks.workunit.client.0.smithi081.stdout:3/754: creat d4/d7/df/d30/fee x:0 0 0 2024-04-23T14:49:58.434 INFO:tasks.workunit.client.0.smithi081.stdout:3/755: fdatasync d4/d7/d2e/fcf 0 2024-04-23T14:49:58.435 INFO:tasks.workunit.client.0.smithi081.stdout:7/771: rmdir d3/d11/d2c 39 2024-04-23T14:49:58.442 INFO:tasks.workunit.client.1.smithi156.stdout:2/516: creat d4/d21/d42/d75/d8e/fb4 x:0 0 0 2024-04-23T14:49:58.446 INFO:tasks.workunit.client.1.smithi156.stdout:4/446: mkdir d0/df/d55/d68/d53/d91 0 2024-04-23T14:49:58.446 INFO:tasks.workunit.client.1.smithi156.stdout:4/447: creat d0/df/d55/d68/d53/f92 x:0 0 0 2024-04-23T14:49:58.454 INFO:tasks.workunit.client.1.smithi156.stdout:3/492: mknod d4/db/dd/d20/d57/c99 0 2024-04-23T14:49:58.457 INFO:tasks.workunit.client.0.smithi081.stdout:5/925: dread d17/d1f/fb8 [0,4194304] 0 2024-04-23T14:49:58.457 INFO:tasks.workunit.client.0.smithi081.stdout:5/926: read d17/f26 [1371056,34772] 0 2024-04-23T14:49:58.459 INFO:tasks.workunit.client.1.smithi156.stdout:1/599: creat db/d1f/d2d/d48/db4/db9/fbf x:0 0 0 2024-04-23T14:49:58.465 INFO:tasks.workunit.client.1.smithi156.stdout:7/564: creat dc/d2c/d68/fad x:0 0 0 2024-04-23T14:49:58.465 INFO:tasks.workunit.client.1.smithi156.stdout:7/565: fdatasync dc/d2c/d68/f97 0 2024-04-23T14:49:58.471 INFO:tasks.workunit.client.1.smithi156.stdout:6/602: dread d3/da/d1d/d27/d80/da5/faa [0,4194304] 0 2024-04-23T14:49:58.471 INFO:tasks.workunit.client.1.smithi156.stdout:2/517: symlink d4/d21/d42/lb5 0 2024-04-23T14:49:58.471 INFO:tasks.workunit.client.0.smithi081.stdout:3/756: mknod d4/d7/d1a/cef 0 2024-04-23T14:49:58.471 INFO:tasks.workunit.client.0.smithi081.stdout:7/772: mknod d3/d11/c112 0 2024-04-23T14:49:58.471 INFO:tasks.workunit.client.0.smithi081.stdout:7/773: write d3/d21/d31/d50/f62 [757813,38781] 0 2024-04-23T14:49:58.472 INFO:tasks.workunit.client.0.smithi081.stdout:7/774: write d3/d21/d41/da3/fd1 [227058,83071] 0 2024-04-23T14:49:58.474 INFO:tasks.workunit.client.0.smithi081.stdout:3/757: rename d4/d7/df/d30/d64/da4 to d4/d7/d7f/d85/d9d/dac/dc7/dd3/df0 0 2024-04-23T14:49:58.474 INFO:tasks.workunit.client.1.smithi156.stdout:9/464: dwrite d1/d2/d3e/d55/f6b [0,4194304] 0 2024-04-23T14:49:58.477 INFO:tasks.workunit.client.1.smithi156.stdout:4/448: mknod d0/d76/c93 0 2024-04-23T14:49:58.477 INFO:tasks.workunit.client.1.smithi156.stdout:4/449: readlink d0/df/d75/l78 0 2024-04-23T14:49:58.481 INFO:tasks.workunit.client.0.smithi081.stdout:7/775: symlink d3/d21/d31/d50/l113 0 2024-04-23T14:49:58.481 INFO:tasks.workunit.client.0.smithi081.stdout:2/809: write d1/d11/d21/fc7 [7389204,43688] 0 2024-04-23T14:49:58.481 INFO:tasks.workunit.client.0.smithi081.stdout:2/810: creat d1/d11/df7/f114 x:0 0 0 2024-04-23T14:49:58.481 INFO:tasks.workunit.client.1.smithi156.stdout:1/600: mknod db/d1f/d2d/d85/cc0 0 2024-04-23T14:49:58.482 INFO:tasks.workunit.client.0.smithi081.stdout:4/813: dwrite d1/d1d/d39/d8d/de3/fff [0,4194304] 0 2024-04-23T14:49:58.482 INFO:tasks.workunit.client.0.smithi081.stdout:4/814: readlink d1/d4/d6f/d70/daf/d8c/lf7 0 2024-04-23T14:49:58.485 INFO:tasks.workunit.client.1.smithi156.stdout:7/566: creat dc/d2a/da9/fae x:0 0 0 2024-04-23T14:49:58.485 INFO:tasks.workunit.client.1.smithi156.stdout:6/603: link d3/l79 d3/d16/d46/d2b/d6e/d8f/ld8 0 2024-04-23T14:49:58.486 INFO:tasks.workunit.client.0.smithi081.stdout:7/776: creat d3/d21/f114 x:0 0 0 2024-04-23T14:49:58.488 INFO:tasks.workunit.client.1.smithi156.stdout:2/518: creat d4/fb6 x:0 0 0 2024-04-23T14:49:58.489 INFO:tasks.workunit.client.0.smithi081.stdout:0/965: dwrite d6/f9 [0,4194304] 0 2024-04-23T14:49:58.492 INFO:tasks.workunit.client.0.smithi081.stdout:2/811: rename d1/d11/df7/df9/d108/f109 to d1/d1e/dad/f115 0 2024-04-23T14:49:58.496 INFO:tasks.workunit.client.1.smithi156.stdout:1/601: dread db/d1f/d2d/d48/daf/f74 [0,4194304] 0 2024-04-23T14:49:58.501 INFO:tasks.workunit.client.0.smithi081.stdout:4/815: mkdir d1/d4/d11/d9d/dac/de7/d105 0 2024-04-23T14:49:58.501 INFO:tasks.workunit.client.0.smithi081.stdout:4/816: creat d1/d8b/f106 x:0 0 0 2024-04-23T14:49:58.501 INFO:tasks.workunit.client.1.smithi156.stdout:9/465: symlink d1/d2/d23/d49/d4b/la0 0 2024-04-23T14:49:58.502 INFO:tasks.workunit.client.1.smithi156.stdout:9/466: write d1/d2/d3e/d80/f9b [774013,94352] 0 2024-04-23T14:49:58.502 INFO:tasks.workunit.client.1.smithi156.stdout:9/467: fdatasync d1/d2/d3e/f56 0 2024-04-23T14:49:58.510 INFO:tasks.workunit.client.0.smithi081.stdout:7/777: creat d3/d21/d31/f115 x:0 0 0 2024-04-23T14:49:58.510 INFO:tasks.workunit.client.0.smithi081.stdout:7/778: fdatasync d3/d21/d31/d50/d5a/f78 0 2024-04-23T14:49:58.511 INFO:tasks.workunit.client.0.smithi081.stdout:2/812: mknod d1/d33/d45/c116 0 2024-04-23T14:49:58.511 INFO:tasks.workunit.client.0.smithi081.stdout:2/813: write d1/d11/d21/d52/d8b/d8f/d93/fcb [945871,36083] 0 2024-04-23T14:49:58.512 INFO:tasks.workunit.client.0.smithi081.stdout:7/779: mkdir d3/d21/d31/d110/d116 0 2024-04-23T14:49:58.513 INFO:tasks.workunit.client.0.smithi081.stdout:5/927: dwrite d17/d1f/d42/d9b/d9e/f118 [0,4194304] 0 2024-04-23T14:49:58.513 INFO:tasks.workunit.client.0.smithi081.stdout:5/928: dread - d17/d1f/d42/d9b/d13f/d61/dba/f135 zero size 2024-04-23T14:49:58.513 INFO:tasks.workunit.client.0.smithi081.stdout:2/814: stat d1/d33/d45/d6e/d97/c113 0 2024-04-23T14:49:58.517 INFO:tasks.workunit.client.1.smithi156.stdout:7/567: rename dc/d2c/f33 to dc/d93/d6c/faf 0 2024-04-23T14:49:58.518 INFO:tasks.workunit.client.1.smithi156.stdout:6/604: creat d3/d16/d46/d2b/d3b/fd9 x:0 0 0 2024-04-23T14:49:58.518 INFO:tasks.workunit.client.1.smithi156.stdout:9/468: mknod d1/d2/d23/d49/ca1 0 2024-04-23T14:49:58.519 INFO:tasks.workunit.client.1.smithi156.stdout:9/469: chown d1/d2/d3e/d80/f9b 8382038 1 2024-04-23T14:49:58.519 INFO:tasks.workunit.client.1.smithi156.stdout:9/470: chown d1/d2/d3e/d50/d7a/d19/c4d 30600550 1 2024-04-23T14:49:58.519 INFO:tasks.workunit.client.1.smithi156.stdout:9/471: write d1/d2/d3e/d50/d7a/d40/d35/f7d [481412,38446] 0 2024-04-23T14:49:58.520 INFO:tasks.workunit.client.1.smithi156.stdout:5/570: dwrite d1/d3/d24/da0/d3e/f6c [0,4194304] 0 2024-04-23T14:49:58.522 INFO:tasks.workunit.client.0.smithi081.stdout:2/815: dread d1/d33/f40 [0,4194304] 0 2024-04-23T14:49:58.523 INFO:tasks.workunit.client.0.smithi081.stdout:7/780: dread d3/d21/d41/d7c/dc3/fe5 [0,4194304] 0 2024-04-23T14:49:58.526 INFO:tasks.workunit.client.1.smithi156.stdout:4/450: dwrite d0/df/f58 [0,4194304] 0 2024-04-23T14:49:58.527 INFO:tasks.workunit.client.0.smithi081.stdout:0/966: write d6/d11/d14/d41/d5b/d59/d68/dbd/fea [1069333,27908] 0 2024-04-23T14:49:58.527 INFO:tasks.workunit.client.0.smithi081.stdout:0/967: write d6/d11/d14/d41/d5b/d3f/d44/f86 [367477,121037] 0 2024-04-23T14:49:58.529 INFO:tasks.workunit.client.1.smithi156.stdout:9/472: symlink d1/d2/d3e/la2 0 2024-04-23T14:49:58.530 INFO:tasks.workunit.client.1.smithi156.stdout:5/571: dread d1/d3/f49 [0,4194304] 0 2024-04-23T14:49:58.532 INFO:tasks.workunit.client.0.smithi081.stdout:3/758: dwrite d4/dc/d50/fe0 [0,4194304] 0 2024-04-23T14:49:58.535 INFO:tasks.workunit.client.0.smithi081.stdout:0/968: link d6/d11/d14/d41/d5b/d59/d68/la8 d6/d11/d14/d24/db3/l137 0 2024-04-23T14:49:58.535 INFO:tasks.workunit.client.0.smithi081.stdout:0/969: dread - d6/d25/f122 zero size 2024-04-23T14:49:58.538 INFO:tasks.workunit.client.1.smithi156.stdout:4/451: stat d0/df/d55/d68/d53/c5a 0 2024-04-23T14:49:58.538 INFO:tasks.workunit.client.1.smithi156.stdout:4/452: write d0/d8/d1e/f5e [831630,21391] 0 2024-04-23T14:49:58.538 INFO:tasks.workunit.client.1.smithi156.stdout:4/453: dread - d0/df/d55/d68/d53/f79 zero size 2024-04-23T14:49:58.538 INFO:tasks.workunit.client.1.smithi156.stdout:4/454: rename d0 to d0/d8/d1e/d4a/d94 22 2024-04-23T14:49:58.540 INFO:tasks.workunit.client.0.smithi081.stdout:2/816: getdents d1/d33/d45 0 2024-04-23T14:49:58.540 INFO:tasks.workunit.client.1.smithi156.stdout:5/572: dread d1/d3/f49 [0,4194304] 0 2024-04-23T14:49:58.543 INFO:tasks.workunit.client.0.smithi081.stdout:7/781: dread d3/d21/d41/f6b [0,4194304] 0 2024-04-23T14:49:58.545 INFO:tasks.workunit.client.0.smithi081.stdout:3/759: link d4/d7/d32/da6/dc4/c25 d4/d7/d32/db0/db5/cf1 0 2024-04-23T14:49:58.546 INFO:tasks.workunit.client.0.smithi081.stdout:3/760: readlink d4/d7/d32/ld8 0 2024-04-23T14:49:58.547 INFO:tasks.workunit.client.0.smithi081.stdout:2/817: mkdir d1/d11/d21/d52/d8b/d8f/de8/d117 0 2024-04-23T14:49:58.548 INFO:tasks.workunit.client.1.smithi156.stdout:4/455: mkdir d0/df/d55/d68/d53/d91/d95 0 2024-04-23T14:49:58.548 INFO:tasks.workunit.client.1.smithi156.stdout:4/456: chown d0/df/d55/d68/f43 9366774 1 2024-04-23T14:49:58.548 INFO:tasks.workunit.client.1.smithi156.stdout:4/457: readlink d0/d76/l29 0 2024-04-23T14:49:58.548 INFO:tasks.workunit.client.1.smithi156.stdout:5/573: symlink d1/d11/d18/d52/d85/d96/lb2 0 2024-04-23T14:49:58.549 INFO:tasks.workunit.client.0.smithi081.stdout:7/782: rename d3/ce1 to d3/d21/d41/d7c/c117 0 2024-04-23T14:49:58.550 INFO:tasks.workunit.client.1.smithi156.stdout:5/574: creat d1/d3/da6/d86/fb3 x:0 0 0 2024-04-23T14:49:58.550 INFO:tasks.workunit.client.1.smithi156.stdout:5/575: getdents d1/d3/d24/da0/d3e/d97 0 2024-04-23T14:49:58.550 INFO:tasks.workunit.client.1.smithi156.stdout:5/576: write d1/d17/f7d [5001358,29914] 0 2024-04-23T14:49:58.551 INFO:tasks.workunit.client.0.smithi081.stdout:3/761: mknod d4/d7/df/d30/cf2 0 2024-04-23T14:49:58.551 INFO:tasks.workunit.client.0.smithi081.stdout:3/762: fsync d4/d7/df/f72 0 2024-04-23T14:49:58.551 INFO:tasks.workunit.client.0.smithi081.stdout:3/763: fdatasync d4/d7/df/f92 0 2024-04-23T14:49:58.553 INFO:tasks.workunit.client.0.smithi081.stdout:2/818: rename d1/c10 to d1/d33/d95/c118 0 2024-04-23T14:49:58.554 INFO:tasks.workunit.client.1.smithi156.stdout:5/577: mkdir d1/d11/d18/d52/d85/d96/db4 0 2024-04-23T14:49:58.554 INFO:tasks.workunit.client.1.smithi156.stdout:5/578: write d1/d3/fa [1685658,45160] 0 2024-04-23T14:49:58.554 INFO:tasks.workunit.client.1.smithi156.stdout:5/579: chown d1/c10 100198 1 2024-04-23T14:49:58.554 INFO:tasks.workunit.client.1.smithi156.stdout:5/580: creat d1/d11/d27/fb5 x:0 0 0 2024-04-23T14:49:58.555 INFO:tasks.workunit.client.0.smithi081.stdout:7/783: mknod d3/d21/d41/dcd/c118 0 2024-04-23T14:49:58.556 INFO:tasks.workunit.client.1.smithi156.stdout:1/602: dread db/f4f [0,4194304] 0 2024-04-23T14:49:58.556 INFO:tasks.workunit.client.1.smithi156.stdout:2/519: dwrite d4/d26/fb1 [0,4194304] 0 2024-04-23T14:49:58.557 INFO:tasks.workunit.client.0.smithi081.stdout:3/764: symlink d4/d7/d7f/d85/d9d/dac/dc7/dd3/df0/lf3 0 2024-04-23T14:49:58.560 INFO:tasks.workunit.client.0.smithi081.stdout:2/819: mknod d1/d11/c119 0 2024-04-23T14:49:58.560 INFO:tasks.workunit.client.0.smithi081.stdout:2/820: dread - d1/d11/d21/d52/d8b/d8f/dee/f102 zero size 2024-04-23T14:49:58.563 INFO:tasks.workunit.client.0.smithi081.stdout:7/784: symlink d3/d21/d31/d33/d52/l119 0 2024-04-23T14:49:58.564 INFO:tasks.workunit.client.0.smithi081.stdout:7/785: fsync d3/d21/d41/dbb/fde 0 2024-04-23T14:49:58.564 INFO:tasks.workunit.client.0.smithi081.stdout:7/786: fdatasync d3/d21/d41/d7c/dc3/d7f/f9b 0 2024-04-23T14:49:58.565 INFO:tasks.workunit.client.0.smithi081.stdout:3/765: creat d4/d7/d7f/ff4 x:0 0 0 2024-04-23T14:49:58.568 INFO:tasks.workunit.client.1.smithi156.stdout:5/581: rename d1/d17/l82 to d1/d3/d24/da0/d3e/d97/lb6 0 2024-04-23T14:49:58.570 INFO:tasks.workunit.client.0.smithi081.stdout:2/821: creat d1/d11/d21/d52/d8b/d8f/de8/d117/f11a x:0 0 0 2024-04-23T14:49:58.570 INFO:tasks.workunit.client.0.smithi081.stdout:2/822: fsync d1/d11/d21/d34/f47 0 2024-04-23T14:49:58.575 INFO:tasks.workunit.client.0.smithi081.stdout:3/766: truncate d4/d7/d2e/fae 117051 0 2024-04-23T14:49:58.580 INFO:tasks.workunit.client.0.smithi081.stdout:2/823: mkdir d1/d33/d45/d11b 0 2024-04-23T14:49:58.583 INFO:tasks.workunit.client.0.smithi081.stdout:3/767: rename d4/d7/d49/d51/d84/cd0 to d4/d7/d32/cf5 0 2024-04-23T14:49:58.583 INFO:tasks.workunit.client.0.smithi081.stdout:3/768: creat d4/dc/d50/ff6 x:0 0 0 2024-04-23T14:49:58.585 INFO:tasks.workunit.client.0.smithi081.stdout:1/959: sync 2024-04-23T14:49:58.585 INFO:tasks.workunit.client.0.smithi081.stdout:2/824: creat d1/d33/d45/d6e/d96/f11c x:0 0 0 2024-04-23T14:49:58.586 INFO:tasks.workunit.client.1.smithi156.stdout:4/458: dwrite d0/df/f58 [0,4194304] 0 2024-04-23T14:49:58.586 INFO:tasks.workunit.client.0.smithi081.stdout:1/960: creat d3/d3d/d41/d5e/d5d/db0/f140 x:0 0 0 2024-04-23T14:49:58.590 INFO:tasks.workunit.client.1.smithi156.stdout:2/520: creat d4/d21/d42/fb7 x:0 0 0 2024-04-23T14:49:58.592 INFO:tasks.workunit.client.0.smithi081.stdout:3/769: mkdir d4/d7/d32/da6/dc4/df7 0 2024-04-23T14:49:58.593 INFO:tasks.workunit.client.1.smithi156.stdout:0/530: sync 2024-04-23T14:49:58.593 INFO:tasks.workunit.client.1.smithi156.stdout:0/531: chown d0/d4/d22/fb0 392116 1 2024-04-23T14:49:58.593 INFO:tasks.workunit.client.1.smithi156.stdout:0/532: chown d0/d16/d3a/d1e 15142769 1 2024-04-23T14:49:58.593 INFO:tasks.workunit.client.1.smithi156.stdout:0/533: chown d0/d4/d22/f96 6541 1 2024-04-23T14:49:58.593 INFO:tasks.workunit.client.1.smithi156.stdout:0/534: fdatasync d0/d4/d22/d58/d9a/f3e 0 2024-04-23T14:49:58.596 INFO:tasks.workunit.client.1.smithi156.stdout:5/582: symlink d1/d11/d18/d52/lb7 0 2024-04-23T14:49:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.597+0000 7ff5f1400700 1 -- 172.21.15.81:0/3471778587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5ec0fdd60 msgr2=0x7ff5ec1001e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.597+0000 7ff5f1400700 1 --2- 172.21.15.81:0/3471778587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5ec0fdd60 0x7ff5ec1001e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8004940 tx=0x7ff5d8009e30 comp rx=0 tx=0).stop 2024-04-23T14:49:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.597+0000 7ff5f1400700 1 -- 172.21.15.81:0/3471778587 shutdown_connections 2024-04-23T14:49:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.597+0000 7ff5f1400700 1 --2- 172.21.15.81:0/3471778587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5ec0fdd60 0x7ff5ec1001e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.597+0000 7ff5f1400700 1 --2- 172.21.15.81:0/3471778587 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5ec0662f0 0x7ff5ec0fd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.597+0000 7ff5f1400700 1 -- 172.21.15.81:0/3471778587 >> 172.21.15.81:0/3471778587 conn(0x7ff5ec0f74c0 msgr2=0x7ff5ec0f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:58.599 INFO:tasks.workunit.client.0.smithi081.stdout:2/825: symlink d1/d11/d21/d52/l11d 0 2024-04-23T14:49:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.598+0000 7ff5f1400700 1 -- 172.21.15.81:0/3471778587 shutdown_connections 2024-04-23T14:49:58.599 INFO:tasks.workunit.client.0.smithi081.stdout:3/770: symlink d4/d7/d7f/d85/d9d/dac/lf8 0 2024-04-23T14:49:58.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.599+0000 7ff5f1400700 1 -- 172.21.15.81:0/3471778587 wait complete. 2024-04-23T14:49:58.600 INFO:tasks.workunit.client.1.smithi156.stdout:1/603: read db/d1f/d2d/f6e [1547830,44803] 0 2024-04-23T14:49:58.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.600+0000 7ff5f1400700 1 Processor -- start 2024-04-23T14:49:58.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.600+0000 7ff5f1400700 1 -- start start 2024-04-23T14:49:58.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.600+0000 7ff5f1400700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5ec0662f0 0x7ff5ec113fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:58.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.601+0000 7ff5f1400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5ec0fdd60 0x7ff5ec114520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:58.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.601+0000 7ff5f1400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ec114b20 con 0x7ff5ec0fdd60 2024-04-23T14:49:58.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.601+0000 7ff5f1400700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ec115370 con 0x7ff5ec0662f0 2024-04-23T14:49:58.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.601+0000 7ff5e9e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5ec0fdd60 0x7ff5ec114520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:58.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.601+0000 7ff5e9e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5ec0fdd60 0x7ff5ec114520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58866/0 (socket says 172.21.15.81:58866) 2024-04-23T14:49:58.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.602+0000 7ff5e9e00700 1 -- 172.21.15.81:0/663017447 learned_addr learned my addr 172.21.15.81:0/663017447 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:49:58.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.602+0000 7ff5ea800700 1 --2- 172.21.15.81:0/663017447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5ec0662f0 0x7ff5ec113fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:58.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.602+0000 7ff5e9e00700 1 -- 172.21.15.81:0/663017447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5ec0662f0 msgr2=0x7ff5ec113fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:58.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.603+0000 7ff5e9e00700 1 --2- 172.21.15.81:0/663017447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5ec0662f0 0x7ff5ec113fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:58.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.603+0000 7ff5e9e00700 1 -- 172.21.15.81:0/663017447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d8005040 con 0x7ff5ec0fdd60 2024-04-23T14:49:58.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.603+0000 7ff5e9e00700 1 --2- 172.21.15.81:0/663017447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5ec0fdd60 0x7ff5ec114520 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff5d800b0d0 tx=0x7ff5d8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:58.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.606+0000 7ff5e2a00700 1 -- 172.21.15.81:0/663017447 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5d800e070 con 0x7ff5ec0fdd60 2024-04-23T14:49:58.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.606+0000 7ff5e2a00700 1 -- 172.21.15.81:0/663017447 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff5d800b410 con 0x7ff5ec0fdd60 2024-04-23T14:49:58.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.606+0000 7ff5e2a00700 1 -- 172.21.15.81:0/663017447 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5d8012600 con 0x7ff5ec0fdd60 2024-04-23T14:49:58.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.606+0000 7ff5f1400700 1 -- 172.21.15.81:0/663017447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5ec115570 con 0x7ff5ec0fdd60 2024-04-23T14:49:58.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.606+0000 7ff5f1400700 1 -- 172.21.15.81:0/663017447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5ec115b30 con 0x7ff5ec0fdd60 2024-04-23T14:49:58.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.607+0000 7ff5f1400700 1 -- 172.21.15.81:0/663017447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5ec05f5f0 con 0x7ff5ec0fdd60 2024-04-23T14:49:58.619 INFO:tasks.workunit.client.0.smithi081.stdout:7/787: dwrite d3/d21/d31/d33/d52/fec [0,4194304] 0 2024-04-23T14:49:58.619 INFO:tasks.workunit.client.0.smithi081.stdout:7/788: fsync d3/d21/d41/d7c/dc3/d7f/ddd/fe4 0 2024-04-23T14:49:58.619 INFO:tasks.workunit.client.0.smithi081.stdout:7/789: fdatasync d3/d21/d31/d33/d4b/fd5 0 2024-04-23T14:49:58.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.620+0000 7ff5e2a00700 1 -- 172.21.15.81:0/663017447 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7ff5d800ba80 con 0x7ff5ec0fdd60 2024-04-23T14:49:58.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.621+0000 7ff5e2a00700 1 --2- 172.21.15.81:0/663017447 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7ff5d006bdb0 0x7ff5d006e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:58.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.622+0000 7ff5e2a00700 1 -- 172.21.15.81:0/663017447 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7ff5d808ba80 con 0x7ff5ec0fdd60 2024-04-23T14:49:58.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.622+0000 7ff5ea800700 1 --2- 172.21.15.81:0/663017447 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7ff5d006bdb0 0x7ff5d006e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:58.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.622+0000 7ff5e2a00700 1 -- 172.21.15.81:0/663017447 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7ff5d80b99d0 con 0x7ff5ec0fdd60 2024-04-23T14:49:58.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.623+0000 7ff5ea800700 1 --2- 172.21.15.81:0/663017447 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7ff5d006bdb0 0x7ff5d006e260 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc009b80 tx=0x7ff5dc00b040 comp rx=0 tx=0).ready entity=mgr.24373 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:58.636 INFO:tasks.workunit.client.0.smithi081.stdout:7/790: dread d3/d20/dc9/f84 [0,4194304] 0 2024-04-23T14:49:58.644 INFO:tasks.workunit.client.0.smithi081.stdout:1/961: dwrite d3/d3d/d41/d5e/d17/d26/f72 [0,4194304] 0 2024-04-23T14:49:58.645 INFO:tasks.workunit.client.0.smithi081.stdout:1/962: creat d3/d3d/d41/d5e/d5d/db0/f141 x:0 0 0 2024-04-23T14:49:58.645 INFO:tasks.workunit.client.0.smithi081.stdout:7/791: dread d3/d21/d41/d7c/dc3/d7f/d98/f10e [0,4194304] 0 2024-04-23T14:49:58.653 INFO:tasks.workunit.client.1.smithi156.stdout:1/604: dwrite db/d25/d30/f78 [0,4194304] 0 2024-04-23T14:49:58.672 INFO:tasks.workunit.client.1.smithi156.stdout:1/605: dread db/d1f/d28/f37 [0,4194304] 0 2024-04-23T14:49:58.703 INFO:tasks.workunit.client.0.smithi081.stdout:1/963: dwrite d3/d3d/d41/d5e/d5d/db0/fa3 [0,4194304] 0 2024-04-23T14:49:58.714 INFO:tasks.workunit.client.1.smithi156.stdout:1/606: dwrite db/d1f/d2d/d48/daf/f74 [0,4194304] 0 2024-04-23T14:49:58.714 INFO:tasks.workunit.client.1.smithi156.stdout:1/607: fsync db/d1f/d28/d70/f7d 0 2024-04-23T14:49:58.714 INFO:tasks.workunit.client.1.smithi156.stdout:1/608: fdatasync db/f4f 0 2024-04-23T14:49:58.729 INFO:tasks.workunit.client.0.smithi081.stdout:2/826: creat d1/d11/d21/d52/d8b/d8f/d93/f11e x:0 0 0 2024-04-23T14:49:58.731 INFO:tasks.workunit.client.0.smithi081.stdout:3/771: symlink d4/d7/d1a/d71/dc2/lf9 0 2024-04-23T14:49:58.731 INFO:tasks.workunit.client.0.smithi081.stdout:3/772: readlink d4/d7/d1a/l5f 0 2024-04-23T14:49:58.734 INFO:tasks.workunit.client.1.smithi156.stdout:4/459: rename d0/d8/d1e/f49 to d0/df/d55/d68/d74/f96 0 2024-04-23T14:49:58.738 INFO:tasks.workunit.client.1.smithi156.stdout:2/521: creat d4/d21/d42/d9f/fb8 x:0 0 0 2024-04-23T14:49:58.741 INFO:tasks.workunit.client.1.smithi156.stdout:0/535: symlink d0/d4/lb6 0 2024-04-23T14:49:58.741 INFO:tasks.workunit.client.1.smithi156.stdout:0/536: dread - d0/d16/d3a/d2a/f87 zero size 2024-04-23T14:49:58.741 INFO:tasks.workunit.client.1.smithi156.stdout:0/537: chown d0/d16 414436 1 2024-04-23T14:49:58.742 INFO:tasks.workunit.client.1.smithi156.stdout:0/538: write d0/d4/d11/d3f/f51 [1177351,116615] 0 2024-04-23T14:49:58.744 INFO:tasks.workunit.client.1.smithi156.stdout:3/493: sync 2024-04-23T14:49:58.745 INFO:tasks.workunit.client.1.smithi156.stdout:8/527: sync 2024-04-23T14:49:58.745 INFO:tasks.workunit.client.1.smithi156.stdout:3/494: fsync d4/db/dd/d1d/d61/f62 0 2024-04-23T14:49:58.745 INFO:tasks.workunit.client.1.smithi156.stdout:8/528: dread - d5/d9/d5a/f43 zero size 2024-04-23T14:49:58.745 INFO:tasks.workunit.client.1.smithi156.stdout:5/583: mknod d1/d11/d18/d52/d85/d96/cb8 0 2024-04-23T14:49:58.745 INFO:tasks.workunit.client.1.smithi156.stdout:5/584: fsync d1/d3/f5 0 2024-04-23T14:49:58.751 INFO:tasks.workunit.client.0.smithi081.stdout:7/792: creat d3/d11/d2c/d75/d8e/dc2/f11a x:0 0 0 2024-04-23T14:49:58.761 INFO:tasks.workunit.client.1.smithi156.stdout:7/568: sync 2024-04-23T14:49:58.762 INFO:tasks.workunit.client.1.smithi156.stdout:9/473: sync 2024-04-23T14:49:58.762 INFO:tasks.workunit.client.1.smithi156.stdout:6/605: sync 2024-04-23T14:49:58.765 INFO:tasks.workunit.client.0.smithi081.stdout:1/964: mkdir d3/d3d/d41/d5e/d5d/db0/d142 0 2024-04-23T14:49:58.766 INFO:tasks.workunit.client.1.smithi156.stdout:4/460: stat d0/c9 0 2024-04-23T14:49:58.767 INFO:tasks.workunit.client.0.smithi081.stdout:2/827: mknod d1/d11/d21/d52/d8b/d8f/d93/c11f 0 2024-04-23T14:49:58.769 INFO:tasks.workunit.client.1.smithi156.stdout:2/522: mknod d4/d13/d19/d4c/d5c/cb9 0 2024-04-23T14:49:58.769 INFO:tasks.workunit.client.1.smithi156.stdout:2/523: chown d4/d13/f20 90199 1 2024-04-23T14:49:58.770 INFO:tasks.workunit.client.0.smithi081.stdout:3/773: creat d4/d41/dc6/ffa x:0 0 0 2024-04-23T14:49:58.773 INFO:tasks.workunit.client.0.smithi081.stdout:7/793: creat d3/d20/f11b x:0 0 0 2024-04-23T14:49:58.776 INFO:tasks.workunit.client.0.smithi081.stdout:1/965: symlink d3/d3d/d41/d92/da6/l143 0 2024-04-23T14:49:58.777 INFO:tasks.workunit.client.1.smithi156.stdout:3/495: mknod d4/db/dd/d1d/d1e/d42/c9a 0 2024-04-23T14:49:58.777 INFO:tasks.workunit.client.1.smithi156.stdout:8/529: rename d5/d39/d6d to d5/d9/d36/d60/db8 0 2024-04-23T14:49:58.777 INFO:tasks.workunit.client.1.smithi156.stdout:8/530: dread - d5/d39/d99/f9f zero size 2024-04-23T14:49:58.777 INFO:tasks.workunit.client.1.smithi156.stdout:8/531: creat d5/d9/d36/d60/d7c/fb9 x:0 0 0 2024-04-23T14:49:58.777 INFO:tasks.workunit.client.1.smithi156.stdout:8/532: write d5/d9/d36/d9c/f5b [717966,39859] 0 2024-04-23T14:49:58.777 INFO:tasks.workunit.client.1.smithi156.stdout:5/585: symlink d1/d11/d27/lb9 0 2024-04-23T14:49:58.778 INFO:tasks.workunit.client.1.smithi156.stdout:0/539: dread d0/f15 [0,4194304] 0 2024-04-23T14:49:58.778 INFO:tasks.workunit.client.0.smithi081.stdout:2/828: creat d1/d33/da3/df5/f120 x:0 0 0 2024-04-23T14:49:58.778 INFO:tasks.workunit.client.0.smithi081.stdout:2/829: chown d1/d33/d45/d6e/d96/l54 6 1 2024-04-23T14:49:58.781 INFO:tasks.workunit.client.0.smithi081.stdout:3/774: unlink d4/d7/d7f/d85/d9d/dac/dc7/dd3/df0/lf3 0 2024-04-23T14:49:58.781 INFO:tasks.workunit.client.0.smithi081.stdout:3/775: creat d4/d7/d1a/ffb x:0 0 0 2024-04-23T14:49:58.782 INFO:tasks.workunit.client.1.smithi156.stdout:7/569: mknod dc/d9d/cb0 0 2024-04-23T14:49:58.783 INFO:tasks.workunit.client.0.smithi081.stdout:9/817: sync 2024-04-23T14:49:58.783 INFO:tasks.workunit.client.1.smithi156.stdout:9/474: write d1/d2/d3e/d50/d7a/d17/f82 [967083,104871] 0 2024-04-23T14:49:58.783 INFO:tasks.workunit.client.0.smithi081.stdout:1/966: symlink d3/d3d/d41/d5e/d5d/d125/d1a/d115/l144 0 2024-04-23T14:49:58.784 INFO:tasks.workunit.client.1.smithi156.stdout:9/475: read d1/d2/d3e/d50/d7a/dc/f22 [569046,72621] 0 2024-04-23T14:49:58.786 INFO:tasks.workunit.client.1.smithi156.stdout:2/524: creat d4/fba x:0 0 0 2024-04-23T14:49:58.786 INFO:tasks.workunit.client.1.smithi156.stdout:2/525: dread - d4/d13/d19/d4c/f93 zero size 2024-04-23T14:49:58.789 INFO:tasks.workunit.client.1.smithi156.stdout:4/461: rename d0/c8d to d0/df/d21/c97 0 2024-04-23T14:49:58.789 INFO:tasks.workunit.client.1.smithi156.stdout:4/462: readlink d0/d76/l29 0 2024-04-23T14:49:58.789 INFO:tasks.workunit.client.1.smithi156.stdout:0/540: fsync d0/d4/d11/d3f/f51 0 2024-04-23T14:49:58.792 INFO:tasks.workunit.client.0.smithi081.stdout:3/776: creat d4/d7/d32/da6/dc4/d5a/d93/ffc x:0 0 0 2024-04-23T14:49:58.792 INFO:tasks.workunit.client.0.smithi081.stdout:3/777: creat d4/d7/d32/da6/dc4/d5a/d93/ffd x:0 0 0 2024-04-23T14:49:58.793 INFO:tasks.workunit.client.1.smithi156.stdout:8/533: creat d5/d9/d36/db5/fba x:0 0 0 2024-04-23T14:49:58.794 INFO:tasks.workunit.client.0.smithi081.stdout:9/818: symlink d3/d5/l10b 0 2024-04-23T14:49:58.794 INFO:tasks.workunit.client.1.smithi156.stdout:8/534: creat d5/d39/d99/fbb x:0 0 0 2024-04-23T14:49:58.796 INFO:tasks.workunit.client.1.smithi156.stdout:5/586: link d1/d11/d18/d52/f7f d1/d3/da6/d86/fba 0 2024-04-23T14:49:58.796 INFO:tasks.workunit.client.0.smithi081.stdout:1/967: mknod d3/d3d/d41/d5e/c145 0 2024-04-23T14:49:58.797 INFO:tasks.workunit.client.1.smithi156.stdout:5/587: dread - d1/d3/da6/d86/fb3 zero size 2024-04-23T14:49:58.798 INFO:tasks.workunit.client.1.smithi156.stdout:7/570: symlink dc/d93/d6c/lb1 0 2024-04-23T14:49:58.802 INFO:tasks.workunit.client.1.smithi156.stdout:2/526: unlink d4/d13/f4b 0 2024-04-23T14:49:58.802 INFO:tasks.workunit.client.1.smithi156.stdout:2/527: read d4/d13/d19/d58/f7e [331453,123721] 0 2024-04-23T14:49:58.802 INFO:tasks.workunit.client.1.smithi156.stdout:2/528: dread - d4/fb6 zero size 2024-04-23T14:49:58.802 INFO:tasks.workunit.client.1.smithi156.stdout:2/529: fsync d4/d13/f20 0 2024-04-23T14:49:58.805 INFO:tasks.workunit.client.0.smithi081.stdout:3/778: symlink d4/d7/d7f/d85/d9d/dac/lfe 0 2024-04-23T14:49:58.805 INFO:tasks.workunit.client.0.smithi081.stdout:3/779: stat d4/d7/d1a/d71/fc3 0 2024-04-23T14:49:58.808 INFO:tasks.workunit.client.1.smithi156.stdout:0/541: rename d0/d4/d11/d3f/d45/c95 to d0/d4/cb7 0 2024-04-23T14:49:58.810 INFO:tasks.workunit.client.1.smithi156.stdout:3/496: dread d4/db/dd/d1d/d1e/d13/f79 [0,4194304] 0 2024-04-23T14:49:58.812 INFO:tasks.workunit.client.0.smithi081.stdout:9/819: mkdir d3/de/d1d/d54/d10c 0 2024-04-23T14:49:58.812 INFO:tasks.workunit.client.0.smithi081.stdout:9/820: dread - d3/de/d47/fa4 zero size 2024-04-23T14:49:58.812 INFO:tasks.workunit.client.0.smithi081.stdout:1/968: creat d3/d3d/d41/d5e/d5d/db0/d142/f146 x:0 0 0 2024-04-23T14:49:58.813 INFO:tasks.workunit.client.1.smithi156.stdout:5/588: dread d1/f38 [0,4194304] 0 2024-04-23T14:49:58.814 INFO:tasks.workunit.client.1.smithi156.stdout:5/589: read d1/d11/d27/f2c [475925,50208] 0 2024-04-23T14:49:58.814 INFO:tasks.workunit.client.1.smithi156.stdout:5/590: creat d1/d17/fbb x:0 0 0 2024-04-23T14:49:58.815 INFO:tasks.workunit.client.1.smithi156.stdout:6/606: dread d3/d16/d46/d64/d77/fb7 [0,4194304] 0 2024-04-23T14:49:58.815 INFO:tasks.workunit.client.1.smithi156.stdout:8/535: link d5/d45/f4f d5/d9/d36/d60/db8/fbc 0 2024-04-23T14:49:58.817 INFO:tasks.workunit.client.1.smithi156.stdout:1/609: dwrite db/d25/f3b [0,4194304] 0 2024-04-23T14:49:58.817 INFO:tasks.workunit.client.1.smithi156.stdout:1/610: fdatasync db/d1f/d2d/d48/dab/fb6 0 2024-04-23T14:49:58.817 INFO:tasks.workunit.client.1.smithi156.stdout:1/611: stat db/d25/d4e/c5e 0 2024-04-23T14:49:58.818 INFO:tasks.workunit.client.1.smithi156.stdout:7/571: creat dc/d2a/fb2 x:0 0 0 2024-04-23T14:49:58.818 INFO:tasks.workunit.client.0.smithi081.stdout:3/780: mknod d4/d41/dc6/cff 0 2024-04-23T14:49:58.820 INFO:tasks.workunit.client.1.smithi156.stdout:2/530: symlink d4/d21/d42/d75/d79/lbb 0 2024-04-23T14:49:58.821 INFO:tasks.workunit.client.1.smithi156.stdout:2/531: truncate d4/f81 852072 0 2024-04-23T14:49:58.821 INFO:tasks.workunit.client.1.smithi156.stdout:4/463: write d0/df/d55/d68/d74/f96 [3484761,10103] 0 2024-04-23T14:49:58.822 INFO:tasks.workunit.client.0.smithi081.stdout:1/969: mknod d3/d3d/d41/d5e/d117/c147 0 2024-04-23T14:49:58.824 INFO:tasks.workunit.client.1.smithi156.stdout:5/591: dread d1/d11/d27/f77 [0,4194304] 0 2024-04-23T14:49:58.826 INFO:tasks.workunit.client.0.smithi081.stdout:9/821: dread d3/de/d14/d5e/ff5 [0,4194304] 0 2024-04-23T14:49:58.827 INFO:tasks.workunit.client.0.smithi081.stdout:2/830: rmdir d1/d11/df7/df9/d108 0 2024-04-23T14:49:58.829 INFO:tasks.workunit.client.0.smithi081.stdout:7/794: dwrite d3/d21/d41/dbb/fc4 [0,4194304] 0 2024-04-23T14:49:58.834 INFO:tasks.workunit.client.0.smithi081.stdout:3/781: creat d4/d7/df/d30/d64/f100 x:0 0 0 2024-04-23T14:49:58.838 INFO:tasks.workunit.client.1.smithi156.stdout:9/476: rename d1/d2/d3e/f56 to d1/d2/d23/d49/d4c/d96/fa3 0 2024-04-23T14:49:58.839 INFO:tasks.workunit.client.1.smithi156.stdout:0/542: mknod d0/d4/cb8 0 2024-04-23T14:49:58.839 INFO:tasks.workunit.client.1.smithi156.stdout:0/543: readlink d0/d16/d43/la0 0 2024-04-23T14:49:58.839 INFO:tasks.workunit.client.1.smithi156.stdout:0/544: readlink d0/d4/d22/l90 0 2024-04-23T14:49:58.840 INFO:tasks.workunit.client.0.smithi081.stdout:9/822: rename d3/de/f1c to d3/d67/da5/f10d 0 2024-04-23T14:49:58.844 INFO:tasks.workunit.client.0.smithi081.stdout:2/831: mkdir d1/d11/d21/d52/d8b/d8f/d93/d121 0 2024-04-23T14:49:58.854 INFO:tasks.workunit.client.0.smithi081.stdout:7/795: unlink d3/d21/d31/d33/l73 0 2024-04-23T14:49:58.854 INFO:tasks.workunit.client.1.smithi156.stdout:6/607: creat d3/d16/d46/d2b/d3b/d9e/fda x:0 0 0 2024-04-23T14:49:58.854 INFO:tasks.workunit.client.1.smithi156.stdout:1/612: link db/d1f/l35 db/d1f/d2d/d93/lc1 0 2024-04-23T14:49:58.854 INFO:tasks.workunit.client.1.smithi156.stdout:5/592: getdents d1/d3 0 2024-04-23T14:49:58.855 INFO:tasks.workunit.client.1.smithi156.stdout:8/536: rename d5/d9/d5a/d5c/d6b/laf to d5/d9/d5a/d57/lbd 0 2024-04-23T14:49:58.855 INFO:tasks.workunit.client.1.smithi156.stdout:8/537: write d5/d9/d36/d9c/f41 [188703,104433] 0 2024-04-23T14:49:58.856 INFO:tasks.workunit.client.0.smithi081.stdout:3/782: dread d4/dc/f52 [0,4194304] 0 2024-04-23T14:49:58.857 INFO:tasks.workunit.client.0.smithi081.stdout:3/783: creat d4/d7/d49/d51/d84/f101 x:0 0 0 2024-04-23T14:49:58.858 INFO:tasks.workunit.client.1.smithi156.stdout:1/613: link db/d1f/fb1 db/d15/fc2 0 2024-04-23T14:49:58.858 INFO:tasks.workunit.client.1.smithi156.stdout:1/614: stat db/d1f/d2d/d93/fba 0 2024-04-23T14:49:58.858 INFO:tasks.workunit.client.1.smithi156.stdout:1/615: stat db/d15/l2e 0 2024-04-23T14:49:58.858 INFO:tasks.workunit.client.1.smithi156.stdout:1/616: read db/d25/d30/d38/f80 [148656,51358] 0 2024-04-23T14:49:58.858 INFO:tasks.workunit.client.1.smithi156.stdout:4/464: write d0/df/d55/d68/d53/f7e [1242487,96349] 0 2024-04-23T14:49:58.862 INFO:tasks.workunit.client.1.smithi156.stdout:5/593: mkdir d1/d3/d24/dbc 0 2024-04-23T14:49:58.865 INFO:tasks.workunit.client.0.smithi081.stdout:9/823: unlink f1 0 2024-04-23T14:49:58.865 INFO:tasks.workunit.client.0.smithi081.stdout:9/824: chown d3/de/d22/fc0 1 1 2024-04-23T14:49:58.869 INFO:tasks.workunit.client.1.smithi156.stdout:8/538: rename d5/d9/d10/d1d/d21/c91 to d5/d9/d36/cbe 0 2024-04-23T14:49:58.871 INFO:tasks.workunit.client.0.smithi081.stdout:2/832: mknod d1/d11/d21/d52/d8b/dfc/c122 0 2024-04-23T14:49:58.871 INFO:tasks.workunit.client.0.smithi081.stdout:2/833: readlink d1/d1e/l49 0 2024-04-23T14:49:58.874 INFO:tasks.workunit.client.0.smithi081.stdout:7/796: mknod d3/d21/d41/d7c/dc3/c11c 0 2024-04-23T14:49:58.889 INFO:tasks.workunit.client.1.smithi156.stdout:4/465: mknod d0/df/d75/c98 0 2024-04-23T14:49:58.889 INFO:tasks.workunit.client.1.smithi156.stdout:4/466: readlink d0/d8/d1e/l39 0 2024-04-23T14:49:58.895 INFO:tasks.workunit.client.1.smithi156.stdout:5/594: mknod d1/d11/d18/cbd 0 2024-04-23T14:49:58.897 INFO:tasks.workunit.client.0.smithi081.stdout:1/970: dwrite d3/d3d/d41/d5e/d17/d26/f31 [4194304,4194304] 0 2024-04-23T14:49:58.897 INFO:tasks.workunit.client.0.smithi081.stdout:9/825: symlink d3/d67/l10e 0 2024-04-23T14:49:58.899 INFO:tasks.workunit.client.1.smithi156.stdout:8/539: creat d5/d9/d36/d60/db8/d93/fbf x:0 0 0 2024-04-23T14:49:58.899 INFO:tasks.workunit.client.1.smithi156.stdout:8/540: write d5/d9/d10/d1d/d21/f77 [680151,52645] 0 2024-04-23T14:49:58.900 INFO:tasks.workunit.client.1.smithi156.stdout:8/541: write d5/d9/d10/f11 [5199135,64656] 0 2024-04-23T14:49:58.900 INFO:tasks.workunit.client.1.smithi156.stdout:8/542: chown d5/d9/d36/d9c/l3d 411449173 1 2024-04-23T14:49:58.900 INFO:tasks.workunit.client.1.smithi156.stdout:8/543: fsync d5/d9/d36/f69 0 2024-04-23T14:49:58.900 INFO:tasks.workunit.client.1.smithi156.stdout:8/544: write d5/d9/d36/d84/fab [998771,52489] 0 2024-04-23T14:49:58.902 INFO:tasks.workunit.client.0.smithi081.stdout:2/834: mkdir d1/d11/d21/d52/d8b/d8f/de8/d123 0 2024-04-23T14:49:58.904 INFO:tasks.workunit.client.1.smithi156.stdout:1/617: link l8 db/d1f/d28/d70/db3/lc3 0 2024-04-23T14:49:58.904 INFO:tasks.workunit.client.1.smithi156.stdout:1/618: write db/d25/d30/d38/f73 [2393312,73128] 0 2024-04-23T14:49:58.904 INFO:tasks.workunit.client.1.smithi156.stdout:1/619: creat db/fc4 x:0 0 0 2024-04-23T14:49:58.905 INFO:tasks.workunit.client.0.smithi081.stdout:7/797: mknod d3/d21/d31/d50/d5a/d10c/c11d 0 2024-04-23T14:49:58.905 INFO:tasks.workunit.client.0.smithi081.stdout:7/798: chown d3/d21/d41/d7c/dc3/d7f/faf 14 1 2024-04-23T14:49:58.905 INFO:tasks.workunit.client.0.smithi081.stdout:7/799: truncate d3/d21/d41/d7c/dc3/d7f/f9b 1086438 0 2024-04-23T14:49:58.908 INFO:tasks.workunit.client.0.smithi081.stdout:6/848: sync 2024-04-23T14:49:58.909 INFO:tasks.workunit.client.1.smithi156.stdout:4/467: link d0/d8/d1e/d4a/l66 d0/df/d75/l99 0 2024-04-23T14:49:58.910 INFO:tasks.workunit.client.1.smithi156.stdout:2/532: dread d4/d21/d42/f43 [0,4194304] 0 2024-04-23T14:49:58.910 INFO:tasks.workunit.client.1.smithi156.stdout:2/533: read - d4/fb0 zero size 2024-04-23T14:49:58.910 INFO:tasks.workunit.client.1.smithi156.stdout:4/468: creat d0/df/d75/f9a x:0 0 0 2024-04-23T14:49:58.910 INFO:tasks.workunit.client.1.smithi156.stdout:5/595: mkdir d1/d11/d18/d19/d9a/dbe 0 2024-04-23T14:49:58.912 INFO:tasks.workunit.client.1.smithi156.stdout:7/572: dwrite dc/d2a/da9/fae [0,4194304] 0 2024-04-23T14:49:58.917 INFO:tasks.workunit.client.0.smithi081.stdout:2/835: truncate d1/f107 1151992 0 2024-04-23T14:49:58.917 INFO:tasks.workunit.client.0.smithi081.stdout:2/836: chown d1/d11/d21/l3f 12 1 2024-04-23T14:49:58.917 INFO:tasks.workunit.client.0.smithi081.stdout:2/837: chown d1/d11/d21/l57 1845773 1 2024-04-23T14:49:58.927 INFO:tasks.workunit.client.0.smithi081.stdout:3/784: dwrite d4/d7/d7f/d85/d9d/f74 [0,4194304] 0 2024-04-23T14:49:58.931 INFO:tasks.workunit.client.0.smithi081.stdout:7/800: mknod d3/d21/d41/d7c/dc3/d7f/ddd/c11e 0 2024-04-23T14:49:58.931 INFO:tasks.workunit.client.0.smithi081.stdout:7/801: fsync d3/d21/d41/d7c/dc3/d7f/f9b 0 2024-04-23T14:49:58.938 INFO:tasks.workunit.client.1.smithi156.stdout:8/545: write d5/d9/d36/f3e [3665612,77557] 0 2024-04-23T14:49:58.945 INFO:tasks.workunit.client.0.smithi081.stdout:9/826: getdents d3/de/d47 0 2024-04-23T14:49:58.945 INFO:tasks.workunit.client.0.smithi081.stdout:9/827: truncate d3/de/d1d/d5b/d7b/db2/f102 904361 0 2024-04-23T14:49:58.946 INFO:tasks.workunit.client.0.smithi081.stdout:1/971: dread d3/d3d/d41/d92/da6/fdd [0,4194304] 0 2024-04-23T14:49:58.948 INFO:tasks.workunit.client.0.smithi081.stdout:1/972: write d3/d3d/d41/d5e/d5d/d125/d1a/f86 [4200677,48391] 0 2024-04-23T14:49:58.948 INFO:tasks.workunit.client.0.smithi081.stdout:0/970: sync 2024-04-23T14:49:58.948 INFO:tasks.workunit.client.0.smithi081.stdout:4/817: sync 2024-04-23T14:49:58.948 INFO:tasks.workunit.client.0.smithi081.stdout:5/929: sync 2024-04-23T14:49:58.948 INFO:tasks.workunit.client.0.smithi081.stdout:1/973: readlink d3/d3d/d41/d4a/lab 0 2024-04-23T14:49:58.948 INFO:tasks.workunit.client.0.smithi081.stdout:1/974: getdents d3/d3d/d41 0 2024-04-23T14:49:58.948 INFO:tasks.workunit.client.0.smithi081.stdout:1/975: chown d3/d3d/d41/d5e/d17 0 1 2024-04-23T14:49:58.948 INFO:tasks.workunit.client.0.smithi081.stdout:0/971: write d6/d37/d85/ff0 [1442507,12504] 0 2024-04-23T14:49:58.949 INFO:tasks.workunit.client.1.smithi156.stdout:1/620: rmdir db/d25/d6b/d90 0 2024-04-23T14:49:58.953 INFO:tasks.workunit.client.0.smithi081.stdout:2/838: link d1/f6 d1/d33/d45/df1/f124 0 2024-04-23T14:49:58.955 INFO:tasks.workunit.client.0.smithi081.stdout:3/785: unlink d4/d7/d7f/d85/fd1 0 2024-04-23T14:49:58.955 INFO:tasks.workunit.client.0.smithi081.stdout:3/786: fsync d4/d7/d49/fe2 0 2024-04-23T14:49:58.955 INFO:tasks.workunit.client.0.smithi081.stdout:3/787: chown d4/d7/d49/d51/f62 19566522 1 2024-04-23T14:49:58.960 INFO:tasks.workunit.client.0.smithi081.stdout:7/802: link d3/f10 d3/d21/d41/d7c/f11f 0 2024-04-23T14:49:58.964 INFO:tasks.workunit.client.1.smithi156.stdout:6/608: dwrite d3/d16/d46/d9d/d9f/dad/fbb [0,4194304] 0 2024-04-23T14:49:58.964 INFO:tasks.workunit.client.1.smithi156.stdout:6/609: stat d3/d16/f30 0 2024-04-23T14:49:58.964 INFO:tasks.workunit.client.1.smithi156.stdout:6/610: fdatasync d3/da/f18 0 2024-04-23T14:49:58.964 INFO:tasks.workunit.client.1.smithi156.stdout:7/573: rename ca to dc/d2a/da9/cb3 0 2024-04-23T14:49:58.964 INFO:tasks.workunit.client.1.smithi156.stdout:5/596: dread d1/d3/d64/f88 [0,4194304] 0 2024-04-23T14:49:58.965 INFO:tasks.workunit.client.1.smithi156.stdout:5/597: truncate d1/d3/f49 2249857 0 2024-04-23T14:49:58.965 INFO:tasks.workunit.client.1.smithi156.stdout:5/598: write d1/f38 [1655150,63223] 0 2024-04-23T14:49:58.966 INFO:tasks.workunit.client.0.smithi081.stdout:0/972: dread d6/d11/d14/d24/fcf [0,4194304] 0 2024-04-23T14:49:58.966 INFO:tasks.workunit.client.1.smithi156.stdout:9/477: dwrite d1/f81 [0,4194304] 0 2024-04-23T14:49:58.970 INFO:tasks.workunit.client.0.smithi081.stdout:4/818: symlink d1/d8f/d94/l107 0 2024-04-23T14:49:58.971 INFO:tasks.workunit.client.0.smithi081.stdout:4/819: write d1/d4/d11/d75/fdc [834188,98847] 0 2024-04-23T14:49:58.971 INFO:tasks.workunit.client.1.smithi156.stdout:0/545: dwrite d0/d4/d11/d3f/d5f/f71 [0,4194304] 0 2024-04-23T14:49:58.972 INFO:tasks.workunit.client.0.smithi081.stdout:1/976: getdents d3/d3d/d6f/de6 0 2024-04-23T14:49:58.974 INFO:tasks.workunit.client.0.smithi081.stdout:5/930: mkdir d17/d65/de3/d141 0 2024-04-23T14:49:58.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.974+0000 7ff5f1400700 1 -- 172.21.15.81:0/663017447 --> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5ec115f20 con 0x7ff5d006bdb0 2024-04-23T14:49:58.977 INFO:tasks.workunit.client.1.smithi156.stdout:1/621: rmdir db/d1f/d2f/d47/dbb 0 2024-04-23T14:49:58.977 INFO:tasks.workunit.client.0.smithi081.stdout:6/849: dwrite d1/d51/d65/d8/fa8 [0,4194304] 0 2024-04-23T14:49:58.977 INFO:tasks.workunit.client.0.smithi081.stdout:6/850: write d1/d51/d7b/f120 [780062,86523] 0 2024-04-23T14:49:58.979 INFO:tasks.workunit.client.1.smithi156.stdout:2/534: link d4/d21/l8d d4/d13/d88/dad/lbc 0 2024-04-23T14:49:58.980 INFO:tasks.workunit.client.0.smithi081.stdout:9/828: mkdir d3/de/d1d/dcc/d10f 0 2024-04-23T14:49:58.984 INFO:tasks.workunit.client.0.smithi081.stdout:2/839: read d1/f32 [595728,130295] 0 2024-04-23T14:49:58.988 INFO:tasks.workunit.client.0.smithi081.stdout:3/788: mkdir d4/d7/d49/d102 0 2024-04-23T14:49:58.988 INFO:tasks.workunit.client.0.smithi081.stdout:3/789: fdatasync d4/d7/d2e/fc9 0 2024-04-23T14:49:58.989 INFO:tasks.workunit.client.1.smithi156.stdout:6/611: rmdir d3/da 39 2024-04-23T14:49:58.991 INFO:tasks.workunit.client.1.smithi156.stdout:3/497: dwrite d4/db/dd/d1d/d1e/d74/d90/f67 [0,4194304] 0 2024-04-23T14:49:58.992 INFO:tasks.workunit.client.1.smithi156.stdout:3/498: write d4/db/dd/d1d/d1e/d42/d76/f88 [954187,8117] 0 2024-04-23T14:49:58.992 INFO:tasks.workunit.client.0.smithi081.stdout:6/851: dread d1/d51/d7b/f87 [0,4194304] 0 2024-04-23T14:49:58.992 INFO:tasks.workunit.client.0.smithi081.stdout:6/852: dread - d1/d2/d8e/d98/ff9 zero size 2024-04-23T14:49:58.993 INFO:tasks.workunit.client.1.smithi156.stdout:7/574: symlink dc/d1d/d48/lb4 0 2024-04-23T14:49:58.993 INFO:tasks.workunit.client.1.smithi156.stdout:7/575: dread - dc/d9d/fa2 zero size 2024-04-23T14:49:58.994 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-23T14:49:58.994 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 starting - - - - 2024-04-23T14:49:58.994 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (11m) 50s ago 11m 6660k - 17.2.7-884-g70d0cb4b cafd8ddac8fa 6ae90c81b232 2024-04-23T14:49:58.994 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi156 smithi156 running (9m) 60s ago 9m 6660k - 17.2.7-884-g70d0cb4b cafd8ddac8fa ecc141919f37 2024-04-23T14:49:58.994 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (9m) 50s ago 10m 74.2M - 9.4.7 954c08fa6188 96965e7e10cc 2024-04-23T14:49:58.994 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.vcoywg smithi081 running (3m) 50s ago 3m 125M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 2ca7601ab60f 2024-04-23T14:49:58.994 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.wydgcg smithi081 running (4m) 50s ago 4m 68.8M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 58eb1a961b61 2024-04-23T14:49:58.995 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.rhbtxt smithi156 running (3m) 60s ago 3m 11.8M - 17.2.7-884-g70d0cb4b cafd8ddac8fa db3cb5034381 2024-04-23T14:49:58.995 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.vynkxn smithi156 running (3m) 60s ago 3m 11.8M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 1c8f2219e7fd 2024-04-23T14:49:58.995 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.ldghvq smithi081 *:9283 running (12m) 50s ago 12m 306M - 17.2.7-884-g70d0cb4b cafd8ddac8fa b3d1da9bbf01 2024-04-23T14:49:58.995 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi156.ounwyj smithi156 *:8443,9283 running (94s) 60s ago 9m 489M - 19.0.0-3126-gd44fddd9 76e77f280c74 4aef254a3b16 2024-04-23T14:49:58.995 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (12m) 50s ago 12m 49.1M 2048M 17.2.7-884-g70d0cb4b cafd8ddac8fa 6e43d934b336 2024-04-23T14:49:58.995 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi156 smithi156 running (9m) 60s ago 9m 38.8M 2048M 17.2.7-884-g70d0cb4b cafd8ddac8fa d9127540d3bb 2024-04-23T14:49:58.995 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 starting - - - - 2024-04-23T14:49:58.995 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi156 smithi156 *:9100 running (9m) 60s ago 9m 7658k - 1.5.0 0da6a335fe13 2d9e680be69f 2024-04-23T14:49:58.995 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (8m) 50s ago 8m 92.2M 1557M 17.2.7-884-g70d0cb4b cafd8ddac8fa 272ca032bec1 2024-04-23T14:49:58.995 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (8m) 50s ago 8m 96.6M 1557M 17.2.7-884-g70d0cb4b cafd8ddac8fa ee6d0c8af6ed 2024-04-23T14:49:58.995 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (7m) 50s ago 7m 84.9M 1557M 17.2.7-884-g70d0cb4b cafd8ddac8fa c26c640828a2 2024-04-23T14:49:58.995 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi156 running (7m) 60s ago 7m 96.9M 2581M 17.2.7-884-g70d0cb4b cafd8ddac8fa c1c261b1ee90 2024-04-23T14:49:58.995 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi156 running (6m) 60s ago 6m 89.7M 2581M 17.2.7-884-g70d0cb4b cafd8ddac8fa 83f996ee64de 2024-04-23T14:49:58.995 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi156 running (5m) 60s ago 5m 87.1M 2581M 17.2.7-884-g70d0cb4b cafd8ddac8fa b754244bef18 2024-04-23T14:49:58.996 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (8m) 50s ago 10m 50.3M - 2.43.0 a07b618ecd1d 1779b897e5df 2024-04-23T14:49:58.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.992+0000 7ff5e2a00700 1 -- 172.21.15.81:0/663017447 <== mgr.24373 v2:172.21.15.156:6828/100981835 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7ff5ec115f20 con 0x7ff5d006bdb0 2024-04-23T14:49:58.996 INFO:tasks.workunit.client.0.smithi081.stdout:7/803: mkdir d3/d21/d120 0 2024-04-23T14:49:58.996 INFO:tasks.workunit.client.1.smithi156.stdout:6/612: dread d3/da/d1d/f35 [0,4194304] 0 2024-04-23T14:49:58.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.996+0000 7ff5f1400700 1 -- 172.21.15.81:0/663017447 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7ff5d006bdb0 msgr2=0x7ff5d006e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:58.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.996+0000 7ff5f1400700 1 --2- 172.21.15.81:0/663017447 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7ff5d006bdb0 0x7ff5d006e260 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc009b80 tx=0x7ff5dc00b040 comp rx=0 tx=0).stop 2024-04-23T14:49:58.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.996+0000 7ff5f1400700 1 -- 172.21.15.81:0/663017447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5ec0fdd60 msgr2=0x7ff5ec114520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:58.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.996+0000 7ff5f1400700 1 --2- 172.21.15.81:0/663017447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5ec0fdd60 0x7ff5ec114520 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff5d800b0d0 tx=0x7ff5d8009e30 comp rx=0 tx=0).stop 2024-04-23T14:49:58.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.996+0000 7ff5f1400700 1 -- 172.21.15.81:0/663017447 shutdown_connections 2024-04-23T14:49:58.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.997+0000 7ff5f1400700 1 --2- 172.21.15.81:0/663017447 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7ff5d006bdb0 0x7ff5d006e260 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:58.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.997+0000 7ff5f1400700 1 --2- 172.21.15.81:0/663017447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5ec0662f0 0x7ff5ec113fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:58.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.997+0000 7ff5f1400700 1 --2- 172.21.15.81:0/663017447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5ec0fdd60 0x7ff5ec114520 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:58.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.997+0000 7ff5f1400700 1 -- 172.21.15.81:0/663017447 >> 172.21.15.81:0/663017447 conn(0x7ff5ec0f74c0 msgr2=0x7ff5ec0f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:58.999 INFO:tasks.workunit.client.1.smithi156.stdout:5/599: creat d1/d3/d24/da0/fbf x:0 0 0 2024-04-23T14:49:58.999 INFO:tasks.workunit.client.1.smithi156.stdout:5/600: fdatasync d1/d11/fae 0 2024-04-23T14:49:58.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.997+0000 7ff5f1400700 1 -- 172.21.15.81:0/663017447 shutdown_connections 2024-04-23T14:49:58.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:58.998+0000 7ff5f1400700 1 -- 172.21.15.81:0/663017447 wait complete. 2024-04-23T14:49:59.002 INFO:tasks.workunit.client.0.smithi081.stdout:0/973: unlink d6/d11/d14/d41/d5b/d3f/d44/d78/c95 0 2024-04-23T14:49:59.004 INFO:tasks.workunit.client.1.smithi156.stdout:8/546: dwrite d5/d9/d10/d1d/d21/f40 [0,4194304] 0 2024-04-23T14:49:59.010 INFO:tasks.workunit.client.0.smithi081.stdout:4/820: mkdir d1/d4/d6f/d108 0 2024-04-23T14:49:59.017 INFO:tasks.workunit.client.0.smithi081.stdout:1/977: creat d3/d3d/d41/d5e/d117/f148 x:0 0 0 2024-04-23T14:49:59.017 INFO:tasks.workunit.client.0.smithi081.stdout:5/931: mkdir d17/d18/dff/daf/d142 0 2024-04-23T14:49:59.050 INFO:tasks.workunit.client.0.smithi081.stdout:6/853: link d1/d51/d65/d8/f42 d1/d2/d5a/f124 0 2024-04-23T14:49:59.055 INFO:tasks.workunit.client.0.smithi081.stdout:4/821: symlink d1/d4/d6f/d70/daf/d8c/l109 0 2024-04-23T14:49:59.055 INFO:tasks.workunit.client.0.smithi081.stdout:4/822: write d1/d4f/fcf [333609,103188] 0 2024-04-23T14:49:59.058 INFO:tasks.workunit.client.0.smithi081.stdout:9/829: rmdir d3/de/d14/d5e/d72/dcf 0 2024-04-23T14:49:59.061 INFO:tasks.workunit.client.1.smithi156.stdout:0/546: dwrite d0/d16/d3a/d2a/d1d/d2d/f5b [0,4194304] 0 2024-04-23T14:49:59.061 INFO:tasks.workunit.client.1.smithi156.stdout:1/622: rmdir db/d1f/d28/db8 0 2024-04-23T14:49:59.067 INFO:tasks.workunit.client.0.smithi081.stdout:0/974: dwrite d6/d11/d14/f91 [0,4194304] 0 2024-04-23T14:49:59.067 INFO:tasks.workunit.client.0.smithi081.stdout:0/975: readlink d6/d11/d14/l3b 0 2024-04-23T14:49:59.067 INFO:tasks.workunit.client.0.smithi081.stdout:2/840: getdents d1/d1e/dad 0 2024-04-23T14:49:59.071 INFO:tasks.workunit.client.1.smithi156.stdout:2/535: creat d4/d21/d42/d75/fbd x:0 0 0 2024-04-23T14:49:59.071 INFO:tasks.workunit.client.1.smithi156.stdout:2/536: creat d4/d21/d76/fbe x:0 0 0 2024-04-23T14:49:59.082 INFO:tasks.workunit.client.0.smithi081.stdout:9/830: truncate d3/de/d1d/d5b/d7b/ff9 1040667 0 2024-04-23T14:49:59.087 INFO:tasks.workunit.client.0.smithi081.stdout:7/804: dwrite d3/d21/d31/d50/da2/ffb [0,4194304] 0 2024-04-23T14:49:59.088 INFO:tasks.workunit.client.1.smithi156.stdout:3/499: mknod d4/db/dd/d1d/d61/d8d/c9b 0 2024-04-23T14:49:59.088 INFO:tasks.workunit.client.1.smithi156.stdout:3/500: chown d4/db/dd/d1d/d1e/d2b 1046647906 1 2024-04-23T14:49:59.088 INFO:tasks.workunit.client.0.smithi081.stdout:5/932: dwrite d17/d18/d3a/d8e/de6/ff4 [0,4194304] 0 2024-04-23T14:49:59.088 INFO:tasks.workunit.client.0.smithi081.stdout:5/933: getdents d17/d18/dff/d59/dfe 0 2024-04-23T14:49:59.091 INFO:tasks.workunit.client.1.smithi156.stdout:0/547: dread d0/d4/d22/d58/f8b [0,4194304] 0 2024-04-23T14:49:59.092 INFO:tasks.workunit.client.0.smithi081.stdout:2/841: link d1/d33/d45/f7c d1/d33/d9f/f125 0 2024-04-23T14:49:59.092 INFO:tasks.workunit.client.0.smithi081.stdout:2/842: stat d1/d33/d9f/fff 0 2024-04-23T14:49:59.096 INFO:tasks.workunit.client.1.smithi156.stdout:7/576: mknod dc/d93/cb5 0 2024-04-23T14:49:59.096 INFO:tasks.workunit.client.1.smithi156.stdout:7/577: fdatasync dc/f81 0 2024-04-23T14:49:59.098 INFO:tasks.workunit.client.0.smithi081.stdout:4/823: dread d1/d1d/d59/f5a [0,4194304] 0 2024-04-23T14:49:59.098 INFO:tasks.workunit.client.0.smithi081.stdout:3/790: dwrite d4/d7/df/f19 [4194304,4194304] 0 2024-04-23T14:49:59.099 INFO:tasks.workunit.client.0.smithi081.stdout:3/791: chown d4/d41/c56 3919660 1 2024-04-23T14:49:59.105 INFO:tasks.workunit.client.0.smithi081.stdout:6/854: write d1/d51/d65/d8/db1/fe2 [1063398,15802] 0 2024-04-23T14:49:59.105 INFO:tasks.workunit.client.0.smithi081.stdout:6/855: dread - d1/d51/d65/d13/d16/dd0/ff8 zero size 2024-04-23T14:49:59.108 INFO:tasks.workunit.client.1.smithi156.stdout:6/613: creat d3/d16/d46/d64/d77/dd6/fdb x:0 0 0 2024-04-23T14:49:59.108 INFO:tasks.workunit.client.1.smithi156.stdout:6/614: chown d3/d16/d46 45 1 2024-04-23T14:49:59.118 INFO:tasks.workunit.client.0.smithi081.stdout:9/831: rmdir d3/de/d14 39 2024-04-23T14:49:59.119 INFO:tasks.workunit.client.1.smithi156.stdout:7/578: dread dc/d1d/d41/f3d [0,4194304] 0 2024-04-23T14:49:59.119 INFO:tasks.workunit.client.1.smithi156.stdout:7/579: fsync dc/d2c/f91 0 2024-04-23T14:49:59.121 INFO:tasks.workunit.client.1.smithi156.stdout:6/615: dread d3/da/d1d/f35 [0,4194304] 0 2024-04-23T14:49:59.121 INFO:tasks.workunit.client.0.smithi081.stdout:1/978: dwrite d3/d3d/d41/d5e/d17/f20 [0,4194304] 0 2024-04-23T14:49:59.121 INFO:tasks.workunit.client.0.smithi081.stdout:1/979: chown d3/d3d/d41/d5e/d5d/db0/d142/f146 0 1 2024-04-23T14:49:59.121 INFO:tasks.workunit.client.0.smithi081.stdout:1/980: fsync d3/d3d/d41/d5e/dd2/f114 0 2024-04-23T14:49:59.121 INFO:tasks.workunit.client.0.smithi081.stdout:1/981: chown d3/d3d/d41/d5e/d5d/d125/d2e/fc5 64909791 1 2024-04-23T14:49:59.121 INFO:tasks.workunit.client.0.smithi081.stdout:1/982: readlink d3/d3d/d41/d5e/d5d/d125/l79 0 2024-04-23T14:49:59.124 INFO:tasks.workunit.client.1.smithi156.stdout:5/601: dwrite d1/d3/f4b [0,4194304] 0 2024-04-23T14:49:59.125 INFO:tasks.workunit.client.1.smithi156.stdout:9/478: link d1/d2/d3e/d50/f7c d1/d2/d3e/d55/d6f/fa4 0 2024-04-23T14:49:59.125 INFO:tasks.workunit.client.1.smithi156.stdout:3/501: dwrite d4/db/dd/f50 [0,4194304] 0 2024-04-23T14:49:59.128 INFO:tasks.workunit.client.1.smithi156.stdout:1/623: creat db/d1f/d2d/fc5 x:0 0 0 2024-04-23T14:49:59.128 INFO:tasks.workunit.client.1.smithi156.stdout:1/624: dread - db/d1f/d2d/d48/dab/fb6 zero size 2024-04-23T14:49:59.128 INFO:tasks.workunit.client.1.smithi156.stdout:1/625: creat db/d25/d30/d38/d40/fc6 x:0 0 0 2024-04-23T14:49:59.135 INFO:tasks.workunit.client.0.smithi081.stdout:4/824: dread d1/d4/dc/f78 [0,4194304] 0 2024-04-23T14:49:59.135 INFO:tasks.workunit.client.0.smithi081.stdout:0/976: dwrite d6/d37/d85/f8b [4194304,4194304] 0 2024-04-23T14:49:59.136 INFO:tasks.workunit.client.0.smithi081.stdout:9/832: dread d3/de/d14/f6b [0,4194304] 0 2024-04-23T14:49:59.140 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:58 smithi081 ceph-mon[25540]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:49:59.140 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:58 smithi081 ceph-mon[25540]: pgmap v38: 65 pgs: 65 active+clean; 2.5 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 173 MiB/s rd, 205 MiB/s wr, 312 op/s 2024-04-23T14:49:59.141 INFO:tasks.workunit.client.1.smithi156.stdout:1/626: write db/d1f/d2d/d48/daf/d86/f67 [1876946,75590] 0 2024-04-23T14:49:59.142 INFO:tasks.workunit.client.1.smithi156.stdout:1/627: chown db/d1f/d2f/f55 11253 1 2024-04-23T14:49:59.143 INFO:tasks.workunit.client.0.smithi081.stdout:7/805: mkdir d3/d21/d41/dd2/d121 0 2024-04-23T14:49:59.145 INFO:tasks.workunit.client.0.smithi081.stdout:5/934: truncate d17/f2c 499626 0 2024-04-23T14:49:59.147 INFO:tasks.workunit.client.0.smithi081.stdout:2/843: creat d1/d11/d21/d52/d8b/d8f/d105/f126 x:0 0 0 2024-04-23T14:49:59.148 INFO:tasks.workunit.client.0.smithi081.stdout:2/844: dread - d1/d33/da3/df5/f120 zero size 2024-04-23T14:49:59.148 INFO:tasks.workunit.client.0.smithi081.stdout:9/833: dread d3/de/d14/d5e/f87 [0,4194304] 0 2024-04-23T14:49:59.148 INFO:tasks.workunit.client.0.smithi081.stdout:9/834: chown d3/de/d14/d5e/d72/cc5 807 1 2024-04-23T14:49:59.148 INFO:tasks.workunit.client.1.smithi156.stdout:2/537: creat d4/d13/d19/d58/fbf x:0 0 0 2024-04-23T14:49:59.149 INFO:tasks.workunit.client.1.smithi156.stdout:0/548: creat d0/d16/d3a/d2a/fb9 x:0 0 0 2024-04-23T14:49:59.151 INFO:tasks.workunit.client.0.smithi081.stdout:6/856: rename d1/d2/d5a/f124 to d1/d51/d7b/d91/f125 0 2024-04-23T14:49:59.152 INFO:tasks.workunit.client.1.smithi156.stdout:8/547: rmdir d5/d9/d10/d1d 39 2024-04-23T14:49:59.152 INFO:tasks.workunit.client.1.smithi156.stdout:8/548: dread - d5/fb1 zero size 2024-04-23T14:49:59.154 INFO:tasks.workunit.client.1.smithi156.stdout:7/580: link dc/d1d/d24/d5a/f9b dc/d46/fb6 0 2024-04-23T14:49:59.156 INFO:tasks.workunit.client.1.smithi156.stdout:6/616: symlink d3/d16/d46/d2b/d6e/ldc 0 2024-04-23T14:49:59.159 INFO:tasks.workunit.client.1.smithi156.stdout:5/602: rename d1/d11/d18/d19/d74/f9d to d1/fc0 0 2024-04-23T14:49:59.159 INFO:tasks.workunit.client.1.smithi156.stdout:5/603: fdatasync d1/d11/d18/d19/f66 0 2024-04-23T14:49:59.159 INFO:tasks.workunit.client.1.smithi156.stdout:5/604: write d1/d11/d18/d19/d74/f80 [3900015,35662] 0 2024-04-23T14:49:59.159 INFO:tasks.workunit.client.1.smithi156.stdout:4/469: sync 2024-04-23T14:49:59.160 INFO:tasks.workunit.client.1.smithi156.stdout:4/470: readlink d0/l1 0 2024-04-23T14:49:59.160 INFO:tasks.workunit.client.1.smithi156.stdout:4/471: read - d0/f80 zero size 2024-04-23T14:49:59.166 INFO:tasks.workunit.client.1.smithi156.stdout:7/581: write dc/d1d/d24/d5a/f76 [4362072,88259] 0 2024-04-23T14:49:59.166 INFO:tasks.workunit.client.1.smithi156.stdout:3/502: rmdir d4/db/dd 39 2024-04-23T14:49:59.167 INFO:tasks.workunit.client.0.smithi081.stdout:4/825: creat d1/d8b/db9/f10a x:0 0 0 2024-04-23T14:49:59.167 INFO:tasks.workunit.client.0.smithi081.stdout:0/977: dread d6/d11/d14/d41/d5b/d3f/d44/d76/fdb [0,4194304] 0 2024-04-23T14:49:59.167 INFO:tasks.workunit.client.0.smithi081.stdout:0/978: fdatasync d6/d37/d67/f97 0 2024-04-23T14:49:59.167 INFO:tasks.workunit.client.0.smithi081.stdout:0/979: write d6/d69/f6f [70472,7565] 0 2024-04-23T14:49:59.167 INFO:tasks.workunit.client.0.smithi081.stdout:0/980: fsync d6/f9 0 2024-04-23T14:49:59.169 INFO:tasks.workunit.client.0.smithi081.stdout:1/983: rename d3/d3d/d41/d5e/c16 to d3/d3d/d41/d5e/d17/d58/d7f/dba/c149 0 2024-04-23T14:49:59.171 INFO:tasks.workunit.client.1.smithi156.stdout:9/479: creat d1/d2/d23/fa5 x:0 0 0 2024-04-23T14:49:59.171 INFO:tasks.workunit.client.1.smithi156.stdout:9/480: chown d1/l88 2840093 1 2024-04-23T14:49:59.174 INFO:tasks.workunit.client.0.smithi081.stdout:6/857: mknod d1/d51/d65/d78/c126 0 2024-04-23T14:49:59.180 INFO:tasks.workunit.client.1.smithi156.stdout:2/538: mkdir d4/d21/d2f/dc0 0 2024-04-23T14:49:59.180 INFO:tasks.workunit.client.1.smithi156.stdout:2/539: creat d4/d21/d42/fc1 x:0 0 0 2024-04-23T14:49:59.180 INFO:tasks.workunit.client.1.smithi156.stdout:0/549: symlink d0/d16/d3a/d2a/d1d/d2d/d6b/lba 0 2024-04-23T14:49:59.180 INFO:tasks.workunit.client.1.smithi156.stdout:0/550: write d0/d4/d11/d3f/d5f/f35 [2445801,91590] 0 2024-04-23T14:49:59.181 INFO:tasks.workunit.client.0.smithi081.stdout:7/806: symlink d3/d21/d31/l122 0 2024-04-23T14:49:59.183 INFO:tasks.workunit.client.1.smithi156.stdout:8/549: unlink d5/c65 0 2024-04-23T14:49:59.184 INFO:tasks.workunit.client.1.smithi156.stdout:6/617: symlink d3/da/d74/d93/dc3/ldd 0 2024-04-23T14:49:59.187 INFO:tasks.workunit.client.1.smithi156.stdout:7/582: write dc/f17 [1265036,25110] 0 2024-04-23T14:49:59.190 INFO:tasks.workunit.client.1.smithi156.stdout:1/628: rename db/f19 to db/d1f/d94/da1/fc7 0 2024-04-23T14:49:59.191 INFO:tasks.workunit.client.0.smithi081.stdout:5/935: rename d17/d3c/f119 to d17/d18/dff/d59/da8/f143 0 2024-04-23T14:49:59.191 INFO:tasks.workunit.client.0.smithi081.stdout:5/936: stat d17 0 2024-04-23T14:49:59.192 INFO:tasks.workunit.client.0.smithi081.stdout:0/981: truncate d6/d11/d14/d41/d5b/d59/d68/dbd/fea 2427295 0 2024-04-23T14:49:59.192 INFO:tasks.workunit.client.1.smithi156.stdout:5/605: link d1/d3/da6/d86/fba d1/d3/d43/fc1 0 2024-04-23T14:49:59.195 INFO:tasks.workunit.client.1.smithi156.stdout:3/503: symlink d4/db/dd/d20/d57/l9c 0 2024-04-23T14:49:59.195 INFO:tasks.workunit.client.1.smithi156.stdout:3/504: write d4/db/f77 [62830,52214] 0 2024-04-23T14:49:59.198 INFO:tasks.workunit.client.1.smithi156.stdout:9/481: readlink d1/d2/d3e/d55/d6f/l67 0 2024-04-23T14:49:59.198 INFO:tasks.workunit.client.0.smithi081.stdout:6/858: link d1/d51/d7b/d91/fb9 d1/d51/d54/f127 0 2024-04-23T14:49:59.199 INFO:tasks.workunit.client.1.smithi156.stdout:6/618: dread d3/da/d1d/d27/f51 [0,4194304] 0 2024-04-23T14:49:59.200 INFO:tasks.workunit.client.0.smithi081.stdout:5/937: mknod d17/d18/dff/c144 0 2024-04-23T14:49:59.201 INFO:tasks.workunit.client.0.smithi081.stdout:9/835: dread d3/d1a/d6c/f31 [0,4194304] 0 2024-04-23T14:49:59.205 INFO:tasks.workunit.client.0.smithi081.stdout:3/792: rename d4/d7/d2e/fcf to d4/d7/d7f/d91/f103 0 2024-04-23T14:49:59.205 INFO:tasks.workunit.client.0.smithi081.stdout:2/845: dwrite d1/d1e/f9c [0,4194304] 0 2024-04-23T14:49:59.205 INFO:tasks.workunit.client.0.smithi081.stdout:2/846: chown d1/d11/dab/l8c 43 1 2024-04-23T14:49:59.211 INFO:tasks.workunit.client.1.smithi156.stdout:4/472: rename d0/d8/d1e/l39 to d0/df/d55/d68/l9b 0 2024-04-23T14:49:59.211 INFO:tasks.workunit.client.1.smithi156.stdout:4/473: write d0/d8/d1e/f5e [428855,56190] 0 2024-04-23T14:49:59.211 INFO:tasks.workunit.client.1.smithi156.stdout:4/474: truncate d0/df/d55/d68/f43 1085137 0 2024-04-23T14:49:59.216 INFO:tasks.workunit.client.1.smithi156.stdout:7/583: dread dc/d1d/f42 [0,4194304] 0 2024-04-23T14:49:59.217 INFO:tasks.workunit.client.0.smithi081.stdout:4/826: dwrite d1/ffb [4194304,4194304] 0 2024-04-23T14:49:59.218 INFO:tasks.workunit.client.1.smithi156.stdout:8/550: read d5/d9/d10/f33 [604216,112177] 0 2024-04-23T14:49:59.218 INFO:tasks.workunit.client.1.smithi156.stdout:3/505: link d4/db/dd/d1d/d1e/c27 d4/db/dd/d1d/d1e/d42/d76/c9d 0 2024-04-23T14:49:59.227 INFO:tasks.workunit.client.0.smithi081.stdout:0/982: write d6/d11/d14/d41/d5b/d3f/d44/d78/d83/fe2 [2308545,37125] 0 2024-04-23T14:49:59.229 INFO:tasks.workunit.client.1.smithi156.stdout:6/619: creat d3/d16/d46/d2b/fde x:0 0 0 2024-04-23T14:49:59.230 INFO:tasks.workunit.client.1.smithi156.stdout:2/540: getdents d4/d21 0 2024-04-23T14:49:59.235 INFO:tasks.workunit.client.1.smithi156.stdout:0/551: rename d0/d4/d22/fb0 to d0/d16/d43/fbb 0 2024-04-23T14:49:59.237 INFO:tasks.workunit.client.1.smithi156.stdout:6/620: dread d3/d16/d46/d9d/d9f/dad/f9b [0,4194304] 0 2024-04-23T14:49:59.238 INFO:tasks.workunit.client.1.smithi156.stdout:4/475: mkdir d0/d8/d1e/d4a/d77/d9c 0 2024-04-23T14:49:59.238 INFO:tasks.workunit.client.1.smithi156.stdout:4/476: write d0/d8/d1e/f47 [719977,130252] 0 2024-04-23T14:49:59.239 INFO:tasks.workunit.client.1.smithi156.stdout:4/477: creat d0/df/d55/d68/f9d x:0 0 0 2024-04-23T14:49:59.239 INFO:tasks.workunit.client.0.smithi081.stdout:4/827: dread d1/d4/d11/f7f [8388608,4194304] 0 2024-04-23T14:49:59.240 INFO:tasks.workunit.client.1.smithi156.stdout:7/584: mkdir dc/d46/d58/db7 0 2024-04-23T14:49:59.244 INFO:tasks.workunit.client.1.smithi156.stdout:8/551: getdents d5/d9 0 2024-04-23T14:49:59.244 INFO:tasks.workunit.client.1.smithi156.stdout:8/552: chown d5/d9/d10/d1d/d21/l81 1338133 1 2024-04-23T14:49:59.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.241+0000 7f5f73200700 1 -- 172.21.15.81:0/1841107854 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f6c0fe0e0 msgr2=0x7f5f6c0fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:59.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.241+0000 7f5f73200700 1 --2- 172.21.15.81:0/1841107854 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f6c0fe0e0 0x7f5f6c0fe550 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5f58004970 tx=0x7f5f58009e30 comp rx=0 tx=0).stop 2024-04-23T14:49:59.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.241+0000 7f5f73200700 1 -- 172.21.15.81:0/1841107854 shutdown_connections 2024-04-23T14:49:59.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.241+0000 7f5f73200700 1 --2- 172.21.15.81:0/1841107854 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f6c0fe0e0 0x7f5f6c0fe550 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:59.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.241+0000 7f5f73200700 1 --2- 172.21.15.81:0/1841107854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f6c0fcef0 0x7f5f6c0fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:59.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.241+0000 7f5f73200700 1 -- 172.21.15.81:0/1841107854 >> 172.21.15.81:0/1841107854 conn(0x7f5f6c0f8530 msgr2=0x7f5f6c0fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:59.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.241+0000 7f5f73200700 1 -- 172.21.15.81:0/1841107854 shutdown_connections 2024-04-23T14:49:59.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.241+0000 7f5f73200700 1 -- 172.21.15.81:0/1841107854 wait complete. 2024-04-23T14:49:59.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.242+0000 7f5f73200700 1 Processor -- start 2024-04-23T14:49:59.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.242+0000 7f5f73200700 1 -- start start 2024-04-23T14:49:59.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.243+0000 7f5f73200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f6c0fcef0 0x7f5f6c113fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:59.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.243+0000 7f5f73200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f6c0fe0e0 0x7f5f6c114520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:59.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.243+0000 7f5f73200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c114b20 con 0x7f5f6c0fcef0 2024-04-23T14:49:59.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.243+0000 7f5f73200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c115370 con 0x7f5f6c0fe0e0 2024-04-23T14:49:59.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.243+0000 7f5f6b400700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f6c0fe0e0 0x7f5f6c114520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:59.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.243+0000 7f5f6b400700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f6c0fe0e0 0x7f5f6c114520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.81:33162/0 (socket says 172.21.15.81:33162) 2024-04-23T14:49:59.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.243+0000 7f5f6b400700 1 -- 172.21.15.81:0/1420395027 learned_addr learned my addr 172.21.15.81:0/1420395027 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:49:59.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.244+0000 7f5f6be00700 1 --2- 172.21.15.81:0/1420395027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f6c0fcef0 0x7f5f6c113fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.244+0000 7f5f6b400700 1 -- 172.21.15.81:0/1420395027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f6c0fcef0 msgr2=0x7f5f6c113fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.244+0000 7f5f6b400700 1 --2- 172.21.15.81:0/1420395027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f6c0fcef0 0x7f5f6c113fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.245+0000 7f5f6b400700 1 -- 172.21.15.81:0/1420395027 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f58005040 con 0x7f5f6c0fe0e0 2024-04-23T14:49:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.245+0000 7f5f6b400700 1 --2- 172.21.15.81:0/1420395027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f6c0fe0e0 0x7f5f6c114520 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5f58009360 tx=0x7f5f58009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:59.247 INFO:tasks.workunit.client.0.smithi081.stdout:7/807: dwrite d3/d21/d41/d7c/dc3/d7f/ff1 [0,4194304] 0 2024-04-23T14:49:59.248 INFO:tasks.workunit.client.1.smithi156.stdout:3/506: rmdir d4/db/dd/d1d/d1e/d13/d5a 39 2024-04-23T14:49:59.248 INFO:tasks.workunit.client.1.smithi156.stdout:3/507: write d4/db/dd/d1d/f36 [888224,53018] 0 2024-04-23T14:49:59.248 INFO:tasks.workunit.client.1.smithi156.stdout:3/508: creat d4/db/dd/d73/f9e x:0 0 0 2024-04-23T14:49:59.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.246+0000 7f5f63e00700 1 -- 172.21.15.81:0/1420395027 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f5800e040 con 0x7f5f6c0fe0e0 2024-04-23T14:49:59.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.246+0000 7f5f63e00700 1 -- 172.21.15.81:0/1420395027 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5f5800bce0 con 0x7f5f6c0fe0e0 2024-04-23T14:49:59.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.246+0000 7f5f63e00700 1 -- 172.21.15.81:0/1420395027 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f5801c630 con 0x7f5f6c0fe0e0 2024-04-23T14:49:59.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.246+0000 7f5f73200700 1 -- 172.21.15.81:0/1420395027 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f6c1155f0 con 0x7f5f6c0fe0e0 2024-04-23T14:49:59.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.246+0000 7f5f73200700 1 -- 172.21.15.81:0/1420395027 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f6c115b30 con 0x7f5f6c0fe0e0 2024-04-23T14:49:59.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.248+0000 7f5f73200700 1 -- 172.21.15.81:0/1420395027 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f6c100a60 con 0x7f5f6c0fe0e0 2024-04-23T14:49:59.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.250+0000 7f5f63e00700 1 -- 172.21.15.81:0/1420395027 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f5f580139f0 con 0x7f5f6c0fe0e0 2024-04-23T14:49:59.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.251+0000 7f5f63e00700 1 --2- 172.21.15.81:0/1420395027 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f5f5006bcf0 0x7f5f5006e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:49:59.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.251+0000 7f5f63e00700 1 -- 172.21.15.81:0/1420395027 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f5f5808c950 con 0x7f5f6c0fe0e0 2024-04-23T14:49:59.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.252+0000 7f5f6be00700 1 --2- 172.21.15.81:0/1420395027 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f5f5006bcf0 0x7f5f5006e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:49:59.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.253+0000 7f5f6be00700 1 --2- 172.21.15.81:0/1420395027 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f5f5006bcf0 0x7f5f5006e1a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c0fcc30 tx=0x7f5f6400b040 comp rx=0 tx=0).ready entity=mgr.24373 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:49:59.254 INFO:tasks.workunit.client.1.smithi156.stdout:6/621: mkdir d3/d16/d46/d64/d77/ddf 0 2024-04-23T14:49:59.256 INFO:tasks.workunit.client.0.smithi081.stdout:1/984: rmdir d3/d3d/d41/d5e 39 2024-04-23T14:49:59.257 INFO:tasks.workunit.client.0.smithi081.stdout:1/985: chown d3/d3d/d6f/fa7 49266533 1 2024-04-23T14:49:59.262 INFO:tasks.workunit.client.1.smithi156.stdout:4/478: link d0/df/d21/c26 d0/d76/c9e 0 2024-04-23T14:49:59.262 INFO:tasks.workunit.client.1.smithi156.stdout:4/479: fsync d0/df/d55/d68/d85/f90 0 2024-04-23T14:49:59.265 INFO:tasks.workunit.client.0.smithi081.stdout:6/859: mkdir d1/d51/d65/d8/d2e/d59/d128 0 2024-04-23T14:49:59.266 INFO:tasks.workunit.client.0.smithi081.stdout:6/860: stat d1/d2/d5a/lee 0 2024-04-23T14:49:59.266 INFO:tasks.workunit.client.0.smithi081.stdout:6/861: stat d1/d51/d65/ffa 0 2024-04-23T14:49:59.266 INFO:tasks.workunit.client.0.smithi081.stdout:6/862: truncate d1/f17 1482363 0 2024-04-23T14:49:59.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.267+0000 7f5f63e00700 1 -- 172.21.15.81:0/1420395027 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f5f58059a40 con 0x7f5f6c0fe0e0 2024-04-23T14:49:59.270 INFO:tasks.workunit.client.1.smithi156.stdout:7/585: truncate dc/d2a/f92 4108224 0 2024-04-23T14:49:59.272 INFO:tasks.workunit.client.0.smithi081.stdout:5/938: unlink d17/d1f/d42/l11d 0 2024-04-23T14:49:59.274 INFO:tasks.workunit.client.1.smithi156.stdout:3/509: dread d4/db/dd/d1d/d1e/d13/f1f [0,4194304] 0 2024-04-23T14:49:59.274 INFO:tasks.workunit.client.1.smithi156.stdout:8/553: mkdir d5/d9/d36/d60/db8/d93/d96/dc0 0 2024-04-23T14:49:59.276 INFO:tasks.workunit.client.0.smithi081.stdout:3/793: mkdir d4/d7/d49/d104 0 2024-04-23T14:49:59.276 INFO:tasks.workunit.client.0.smithi081.stdout:3/794: readlink d4/d7/d32/lad 0 2024-04-23T14:49:59.276 INFO:tasks.workunit.client.0.smithi081.stdout:3/795: truncate d4/d7/d1a/d71/fc3 1277432 0 2024-04-23T14:49:59.280 INFO:tasks.workunit.client.1.smithi156.stdout:2/541: rmdir d4/d13/d19/d4c/d5c 39 2024-04-23T14:49:59.280 INFO:tasks.workunit.client.1.smithi156.stdout:2/542: chown d4/d13/d88/f7c 429081 1 2024-04-23T14:49:59.280 INFO:tasks.workunit.client.1.smithi156.stdout:2/543: readlink d4/d26/d3c/l80 0 2024-04-23T14:49:59.283 INFO:tasks.workunit.client.1.smithi156.stdout:6/622: getdents d3/d16 0 2024-04-23T14:49:59.284 INFO:tasks.workunit.client.1.smithi156.stdout:4/480: mkdir d0/df/d55/d68/d53/d9f 0 2024-04-23T14:49:59.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:58 smithi156 ceph-mon[32341]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:49:59.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:58 smithi156 ceph-mon[32341]: pgmap v38: 65 pgs: 65 active+clean; 2.5 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 173 MiB/s rd, 205 MiB/s wr, 312 op/s 2024-04-23T14:49:59.289 INFO:tasks.workunit.client.1.smithi156.stdout:3/510: creat d4/db/dd/d1d/d61/d7f/f9f x:0 0 0 2024-04-23T14:49:59.291 INFO:tasks.workunit.client.1.smithi156.stdout:8/554: mkdir d5/d9/d36/d84/dc1 0 2024-04-23T14:49:59.292 INFO:tasks.workunit.client.1.smithi156.stdout:0/552: dread d0/f7c [0,4194304] 0 2024-04-23T14:49:59.292 INFO:tasks.workunit.client.1.smithi156.stdout:8/555: creat d5/d39/d99/fc2 x:0 0 0 2024-04-23T14:49:59.292 INFO:tasks.workunit.client.1.smithi156.stdout:8/556: chown d5/d9/d36/f3e 5 1 2024-04-23T14:49:59.292 INFO:tasks.workunit.client.1.smithi156.stdout:8/557: read d5/d9/d10/f46 [378497,96394] 0 2024-04-23T14:49:59.292 INFO:tasks.workunit.client.1.smithi156.stdout:2/544: mknod d4/d13/d19/d97/cc2 0 2024-04-23T14:49:59.295 INFO:tasks.workunit.client.1.smithi156.stdout:6/623: mknod d3/da/d74/d93/dc3/ce0 0 2024-04-23T14:49:59.296 INFO:tasks.workunit.client.1.smithi156.stdout:4/481: mkdir d0/d8/d1e/da0 0 2024-04-23T14:49:59.297 INFO:tasks.workunit.client.1.smithi156.stdout:3/511: getdents d4/db/dd/d1d/d1e/d2b 0 2024-04-23T14:49:59.300 INFO:tasks.workunit.client.1.smithi156.stdout:8/558: creat d5/d9/d36/db5/d98/fc3 x:0 0 0 2024-04-23T14:49:59.302 INFO:tasks.workunit.client.0.smithi081.stdout:6/863: mkdir d1/d51/d65/d13/d16/dd0/df7/dd2/d129 0 2024-04-23T14:49:59.302 INFO:tasks.workunit.client.0.smithi081.stdout:6/864: fdatasync d1/d51/d65/d1c/d66/fd1 0 2024-04-23T14:49:59.302 INFO:tasks.workunit.client.0.smithi081.stdout:6/865: creat d1/d51/d65/d13/d16/dd0/f12a x:0 0 0 2024-04-23T14:49:59.303 INFO:tasks.workunit.client.1.smithi156.stdout:2/545: symlink d4/d13/d88/lc3 0 2024-04-23T14:49:59.307 INFO:tasks.workunit.client.1.smithi156.stdout:6/624: symlink d3/d16/d46/d9d/d9f/dad/le1 0 2024-04-23T14:49:59.308 INFO:tasks.workunit.client.1.smithi156.stdout:1/629: dwrite db/d1f/d2d/d48/db4/db9/fbf [0,4194304] 0 2024-04-23T14:49:59.309 INFO:tasks.workunit.client.0.smithi081.stdout:3/796: mkdir d4/d7/d7f/d85/d105 0 2024-04-23T14:49:59.309 INFO:tasks.workunit.client.0.smithi081.stdout:3/797: chown d4/d7/d7f/d85/d9d/dac/dc7/dd3/la8 959 1 2024-04-23T14:49:59.309 INFO:tasks.workunit.client.0.smithi081.stdout:3/798: write d4/d7/d2e/f8b [189163,119356] 0 2024-04-23T14:49:59.310 INFO:tasks.workunit.client.1.smithi156.stdout:4/482: creat d0/df/fa1 x:0 0 0 2024-04-23T14:49:59.310 INFO:tasks.workunit.client.1.smithi156.stdout:9/482: dwrite d1/d2/d3e/d50/d7a/d17/d1f/d48/f4f [4194304,4194304] 0 2024-04-23T14:49:59.310 INFO:tasks.workunit.client.1.smithi156.stdout:9/483: chown d1/d2/d3e/d55/d66 177 1 2024-04-23T14:49:59.310 INFO:tasks.workunit.client.1.smithi156.stdout:9/484: chown d1/d2/c43 3939157 1 2024-04-23T14:49:59.311 INFO:tasks.workunit.client.0.smithi081.stdout:0/983: mkdir d6/d25/d138 0 2024-04-23T14:49:59.314 INFO:tasks.workunit.client.1.smithi156.stdout:3/512: symlink d4/db/dd/d1d/la0 0 2024-04-23T14:49:59.315 INFO:tasks.workunit.client.1.smithi156.stdout:8/559: truncate d5/d9/d36/d9c/f42 3794906 0 2024-04-23T14:49:59.316 INFO:tasks.workunit.client.0.smithi081.stdout:2/847: dwrite d1/d11/d21/d52/d8b/d8f/d93/fcb [0,4194304] 0 2024-04-23T14:49:59.316 INFO:tasks.workunit.client.0.smithi081.stdout:2/848: chown d1/d33/d45/d6e/d96/l2f 550741885 1 2024-04-23T14:49:59.318 INFO:tasks.workunit.client.1.smithi156.stdout:2/546: symlink d4/d21/d42/d9f/lc4 0 2024-04-23T14:49:59.319 INFO:tasks.workunit.client.1.smithi156.stdout:2/547: dread - d4/d21/d42/f89 zero size 2024-04-23T14:49:59.319 INFO:tasks.workunit.client.1.smithi156.stdout:0/553: getdents d0/d16/d3a/d1e 0 2024-04-23T14:49:59.319 INFO:tasks.workunit.client.0.smithi081.stdout:7/808: dwrite d3/d20/dc9/f8b [0,4194304] 0 2024-04-23T14:49:59.323 INFO:tasks.workunit.client.0.smithi081.stdout:5/939: dread d17/f2c [0,4194304] 0 2024-04-23T14:49:59.324 INFO:tasks.workunit.client.0.smithi081.stdout:4/828: rmdir d1/d1d 39 2024-04-23T14:49:59.325 INFO:tasks.workunit.client.0.smithi081.stdout:1/986: dwrite d3/d3d/d41/d5e/d17/d25/f113 [0,4194304] 0 2024-04-23T14:49:59.325 INFO:tasks.workunit.client.1.smithi156.stdout:6/625: mkdir d3/d16/d46/d9d/d9f/de2 0 2024-04-23T14:49:59.326 INFO:tasks.workunit.client.0.smithi081.stdout:0/984: dread d6/d11/d14/d41/d5b/d59/d68/dbd/fea [0,4194304] 0 2024-04-23T14:49:59.326 INFO:tasks.workunit.client.0.smithi081.stdout:0/985: write d6/d11/d14/d41/d5b/d3f/d44/f9b [292213,35057] 0 2024-04-23T14:49:59.328 INFO:tasks.workunit.client.0.smithi081.stdout:6/866: rename d1/d51/d65/d1c/d66/f93 to d1/d51/d65/d13/d16/dd0/f12b 0 2024-04-23T14:49:59.330 INFO:tasks.workunit.client.0.smithi081.stdout:3/799: mkdir d4/d7/d32/da6/dc4/df7/d106 0 2024-04-23T14:49:59.331 INFO:tasks.workunit.client.1.smithi156.stdout:1/630: creat db/d1f/d2f/d47/d71/fc8 x:0 0 0 2024-04-23T14:49:59.333 INFO:tasks.workunit.client.1.smithi156.stdout:5/606: dwrite d1/d17/f2e [0,4194304] 0 2024-04-23T14:49:59.333 INFO:tasks.workunit.client.1.smithi156.stdout:7/586: dwrite dc/d1d/d41/f7d [0,4194304] 0 2024-04-23T14:49:59.337 INFO:tasks.workunit.client.1.smithi156.stdout:4/483: symlink d0/d8/d1e/d4a/d77/d9c/la2 0 2024-04-23T14:49:59.337 INFO:tasks.workunit.client.1.smithi156.stdout:4/484: creat d0/d8/d1e/d4a/d77/fa3 x:0 0 0 2024-04-23T14:49:59.339 INFO:tasks.workunit.client.0.smithi081.stdout:2/849: creat d1/d1e/dad/f127 x:0 0 0 2024-04-23T14:49:59.342 INFO:tasks.workunit.client.1.smithi156.stdout:0/554: dread d0/d16/d3a/d2a/d1d/f17 [4194304,4194304] 0 2024-04-23T14:49:59.342 INFO:tasks.workunit.client.1.smithi156.stdout:0/555: fdatasync d0/f89 0 2024-04-23T14:49:59.343 INFO:tasks.workunit.client.1.smithi156.stdout:3/513: symlink d4/db/dd/d1d/d61/d8d/la1 0 2024-04-23T14:49:59.347 INFO:tasks.workunit.client.1.smithi156.stdout:8/560: unlink d5/d9/d10/f87 0 2024-04-23T14:49:59.351 INFO:tasks.workunit.client.0.smithi081.stdout:4/829: unlink d1/d4/d6f/f9f 0 2024-04-23T14:49:59.354 INFO:tasks.workunit.client.1.smithi156.stdout:2/548: creat d4/d21/d42/d75/d79/fc5 x:0 0 0 2024-04-23T14:49:59.355 INFO:tasks.workunit.client.1.smithi156.stdout:2/549: chown d4/d21/d2f/c4d 951246300 1 2024-04-23T14:49:59.355 INFO:tasks.workunit.client.1.smithi156.stdout:2/550: stat d4/d21/d76/f9b 0 2024-04-23T14:49:59.355 INFO:tasks.workunit.client.1.smithi156.stdout:2/551: creat d4/d21/d42/d75/d79/fc6 x:0 0 0 2024-04-23T14:49:59.359 INFO:tasks.workunit.client.1.smithi156.stdout:6/626: rename d3/d16/d46/d2b/d6e/cca to d3/da/d1d/d27/d63/ce3 0 2024-04-23T14:49:59.359 INFO:tasks.workunit.client.1.smithi156.stdout:1/631: dread db/d1f/d28/f37 [0,4194304] 0 2024-04-23T14:49:59.359 INFO:tasks.workunit.client.1.smithi156.stdout:9/485: write d1/d2/d3e/d50/f78 [2403138,44683] 0 2024-04-23T14:49:59.363 INFO:tasks.workunit.client.0.smithi081.stdout:1/987: getdents d3/d3d/d41/d5e/dd2 0 2024-04-23T14:49:59.366 INFO:tasks.workunit.client.0.smithi081.stdout:0/986: mknod d6/d11/d14/d41/d5b/d3f/d44/d78/d84/dfe/c139 0 2024-04-23T14:49:59.368 INFO:tasks.workunit.client.1.smithi156.stdout:5/607: getdents d1 0 2024-04-23T14:49:59.368 INFO:tasks.workunit.client.1.smithi156.stdout:5/608: write d1/d11/d27/f95 [603921,123444] 0 2024-04-23T14:49:59.371 INFO:tasks.workunit.client.1.smithi156.stdout:7/587: mknod dc/d1d/d48/cb8 0 2024-04-23T14:49:59.375 INFO:tasks.workunit.client.0.smithi081.stdout:3/800: creat d4/d7/d32/da6/dc4/df7/d106/f107 x:0 0 0 2024-04-23T14:49:59.375 INFO:tasks.workunit.client.1.smithi156.stdout:5/609: dread d1/d11/d18/f47 [0,4194304] 0 2024-04-23T14:49:59.376 INFO:tasks.workunit.client.1.smithi156.stdout:4/485: stat d0/df/d55/c7d 0 2024-04-23T14:49:59.376 INFO:tasks.workunit.client.1.smithi156.stdout:4/486: getdents d0/df/d55/d68/d53/d9f 0 2024-04-23T14:49:59.376 INFO:tasks.workunit.client.1.smithi156.stdout:4/487: write d0/df/d55/f2e [4395039,63384] 0 2024-04-23T14:49:59.377 INFO:tasks.workunit.client.1.smithi156.stdout:4/488: write d0/d8/f40 [829323,105838] 0 2024-04-23T14:49:59.379 INFO:tasks.workunit.client.1.smithi156.stdout:3/514: mkdir d4/db/dd/d1d/d61/d7f/da2 0 2024-04-23T14:49:59.383 INFO:tasks.workunit.client.0.smithi081.stdout:4/830: creat d1/d4/d6f/d70/daf/d8c/d99/f10b x:0 0 0 2024-04-23T14:49:59.387 INFO:tasks.workunit.client.0.smithi081.stdout:1/988: creat d3/d3d/d41/f14a x:0 0 0 2024-04-23T14:49:59.393 INFO:tasks.workunit.client.0.smithi081.stdout:0/987: symlink d6/d11/d14/d24/db3/l13a 0 2024-04-23T14:49:59.394 INFO:tasks.workunit.client.1.smithi156.stdout:8/561: mknod d5/d39/d99/cc4 0 2024-04-23T14:49:59.395 INFO:tasks.workunit.client.1.smithi156.stdout:2/552: mknod d4/d21/d2f/dc0/cc7 0 2024-04-23T14:49:59.395 INFO:tasks.workunit.client.1.smithi156.stdout:2/553: truncate d4/d13/d19/d58/f7e 1632613 0 2024-04-23T14:49:59.395 INFO:tasks.workunit.client.1.smithi156.stdout:6/627: truncate d3/da/f4f 2372659 0 2024-04-23T14:49:59.396 INFO:tasks.workunit.client.1.smithi156.stdout:6/628: creat d3/d16/d46/d2b/d3b/d9e/fe4 x:0 0 0 2024-04-23T14:49:59.396 INFO:tasks.workunit.client.0.smithi081.stdout:7/809: rename d3/d11/faa to d3/d21/d31/d33/d4b/d4c/f123 0 2024-04-23T14:49:59.403 INFO:tasks.workunit.client.0.smithi081.stdout:2/850: getdents d1/d33 0 2024-04-23T14:49:59.411 INFO:tasks.workunit.client.0.smithi081.stdout:4/831: mknod d1/d4/d6f/d70/daf/d89/da9/c10c 0 2024-04-23T14:49:59.412 INFO:tasks.workunit.client.1.smithi156.stdout:1/632: truncate db/d25/d6b/f88 1418371 0 2024-04-23T14:49:59.413 INFO:tasks.workunit.client.1.smithi156.stdout:7/588: rmdir dc/d1d/d48/d83 39 2024-04-23T14:49:59.418 INFO:tasks.workunit.client.0.smithi081.stdout:3/801: read d4/d7/d1a/d71/f76 [318701,25688] 0 2024-04-23T14:49:59.418 INFO:tasks.workunit.client.1.smithi156.stdout:5/610: mknod d1/d11/d27/cc2 0 2024-04-23T14:49:59.419 INFO:tasks.workunit.client.0.smithi081.stdout:5/940: rename d17/f1b to d17/d18/dff/d59/da8/f145 0 2024-04-23T14:49:59.426 INFO:tasks.workunit.client.1.smithi156.stdout:4/489: stat d0/df/d55/c42 0 2024-04-23T14:49:59.435 INFO:tasks.workunit.client.0.smithi081.stdout:7/810: link d3/d20/dc9/f99 d3/d21/d41/d7c/dc3/f124 0 2024-04-23T14:49:59.435 INFO:tasks.workunit.client.1.smithi156.stdout:2/554: creat d4/d21/d2f/fc8 x:0 0 0 2024-04-23T14:49:59.435 INFO:tasks.workunit.client.1.smithi156.stdout:2/555: creat d4/d21/d42/da1/fc9 x:0 0 0 2024-04-23T14:49:59.436 INFO:tasks.workunit.client.1.smithi156.stdout:1/633: write db/d1f/d2d/d48/daf/d86/f67 [4797673,89373] 0 2024-04-23T14:49:59.436 INFO:tasks.workunit.client.1.smithi156.stdout:0/556: dwrite d0/d16/d3a/d2a/d1d/d2d/d6b/fb5 [0,4194304] 0 2024-04-23T14:49:59.437 INFO:tasks.workunit.client.1.smithi156.stdout:0/557: stat d0/d4/f3 0 2024-04-23T14:49:59.443 INFO:tasks.workunit.client.0.smithi081.stdout:3/802: symlink d4/d7/d7f/d85/l108 0 2024-04-23T14:49:59.451 INFO:tasks.workunit.client.0.smithi081.stdout:2/851: write d1/d33/f71 [3571640,83574] 0 2024-04-23T14:49:59.457 INFO:tasks.workunit.client.0.smithi081.stdout:5/941: rename d17/d37/da4/ce2 to d17/d1f/d42/d9b/d13f/d61/dba/d127/c146 0 2024-04-23T14:49:59.457 INFO:tasks.workunit.client.0.smithi081.stdout:5/942: stat d17/d18/dff/d59/fc1 0 2024-04-23T14:49:59.457 INFO:tasks.workunit.client.0.smithi081.stdout:5/943: chown d17/d3d/d41/cd5 428 1 2024-04-23T14:49:59.457 INFO:tasks.workunit.client.0.smithi081.stdout:7/811: write d3/d20/f3f [3059175,114552] 0 2024-04-23T14:49:59.461 INFO:tasks.workunit.client.0.smithi081.stdout:1/989: dwrite d3/d3d/d41/d5e/d5d/fa4 [4194304,4194304] 0 2024-04-23T14:49:59.461 INFO:tasks.workunit.client.0.smithi081.stdout:1/990: read - d3/d3d/d41/d4a/f134 zero size 2024-04-23T14:49:59.461 INFO:tasks.workunit.client.0.smithi081.stdout:1/991: truncate d3/d3d/d41/d5e/d1d/fd6 271434 0 2024-04-23T14:49:59.462 INFO:tasks.workunit.client.1.smithi156.stdout:6/629: creat d3/d16/d46/d9d/fe5 x:0 0 0 2024-04-23T14:49:59.478 INFO:tasks.workunit.client.0.smithi081.stdout:4/832: dwrite d1/d4/d11/d9d/dac/ff2 [0,4194304] 0 2024-04-23T14:49:59.482 INFO:tasks.workunit.client.1.smithi156.stdout:7/589: creat dc/d46/fb9 x:0 0 0 2024-04-23T14:49:59.483 INFO:tasks.workunit.client.1.smithi156.stdout:7/590: chown l3 6046 1 2024-04-23T14:49:59.490 INFO:tasks.workunit.client.0.smithi081.stdout:7/812: truncate d3/f36 4011648 0 2024-04-23T14:49:59.490 INFO:tasks.workunit.client.0.smithi081.stdout:7/813: read - d3/d21/d41/d7c/ff6 zero size 2024-04-23T14:49:59.490 INFO:tasks.workunit.client.0.smithi081.stdout:7/814: truncate d3/d21/d31/d63/f74 800488 0 2024-04-23T14:49:59.495 INFO:tasks.workunit.client.1.smithi156.stdout:2/556: dread d4/f24 [0,4194304] 0 2024-04-23T14:49:59.508 INFO:tasks.workunit.client.0.smithi081.stdout:4/833: dread d1/d1d/d39/f53 [0,4194304] 0 2024-04-23T14:49:59.508 INFO:tasks.workunit.client.0.smithi081.stdout:4/834: chown d1/d1d/d39/d8d/f90 27 1 2024-04-23T14:49:59.508 INFO:tasks.workunit.client.0.smithi081.stdout:4/835: chown d1/d4/d6f/d70/daf/d8c/ffe 0 1 2024-04-23T14:49:59.508 INFO:tasks.workunit.client.0.smithi081.stdout:4/836: readlink d1/d4/d6f/d70/daf/d8c/d99/la1 0 2024-04-23T14:49:59.509 INFO:tasks.workunit.client.0.smithi081.stdout:0/988: dwrite d6/d11/d14/d41/d5b/d59/fc9 [0,4194304] 0 2024-04-23T14:49:59.517 INFO:tasks.workunit.client.1.smithi156.stdout:0/558: dwrite d0/d16/d43/f55 [0,4194304] 0 2024-04-23T14:49:59.520 INFO:tasks.workunit.client.1.smithi156.stdout:9/486: dwrite d1/d2/d3e/d50/d7a/d17/f2c [0,4194304] 0 2024-04-23T14:49:59.520 INFO:tasks.workunit.client.1.smithi156.stdout:8/562: dwrite d5/d9/d10/d1d/f7a [0,4194304] 0 2024-04-23T14:49:59.520 INFO:tasks.workunit.client.1.smithi156.stdout:8/563: read d5/d9/f4d [2034068,18125] 0 2024-04-23T14:49:59.521 INFO:tasks.workunit.client.0.smithi081.stdout:1/992: creat d3/d3d/d41/d5e/d5d/db0/d12f/f14b x:0 0 0 2024-04-23T14:49:59.528 INFO:tasks.workunit.client.0.smithi081.stdout:0/989: dread d6/f4f [0,4194304] 0 2024-04-23T14:49:59.530 INFO:tasks.workunit.client.1.smithi156.stdout:5/611: symlink d1/d3/d24/lc3 0 2024-04-23T14:49:59.530 INFO:tasks.workunit.client.0.smithi081.stdout:3/803: dwrite d4/d7/d32/db0/db5/fe8 [0,4194304] 0 2024-04-23T14:49:59.533 INFO:tasks.workunit.client.0.smithi081.stdout:5/944: dwrite d17/d1f/d42/d9b/d13f/f7c [0,4194304] 0 2024-04-23T14:49:59.536 INFO:tasks.workunit.client.0.smithi081.stdout:2/852: dread d1/d33/f71 [0,4194304] 0 2024-04-23T14:49:59.538 INFO:tasks.workunit.client.1.smithi156.stdout:4/490: creat d0/df/d55/d68/d85/fa4 x:0 0 0 2024-04-23T14:49:59.538 INFO:tasks.workunit.client.1.smithi156.stdout:4/491: dread - d0/df/d55/d68/d53/f82 zero size 2024-04-23T14:49:59.538 INFO:tasks.workunit.client.0.smithi081.stdout:0/990: dread d6/d11/d14/d41/d5b/d3f/d44/d76/fdb [0,4194304] 0 2024-04-23T14:49:59.540 INFO:tasks.workunit.client.0.smithi081.stdout:7/815: rename d3/d97/ce8 to d3/d11/d2c/d75/c125 0 2024-04-23T14:49:59.540 INFO:tasks.workunit.client.0.smithi081.stdout:7/816: read - d3/d21/d41/f6d zero size 2024-04-23T14:49:59.541 INFO:tasks.workunit.client.0.smithi081.stdout:1/993: write d3/d3d/d41/d92/fbc [1867254,24846] 0 2024-04-23T14:49:59.542 INFO:tasks.workunit.client.0.smithi081.stdout:4/837: symlink d1/d1d/d39/l10d 0 2024-04-23T14:49:59.546 INFO:tasks.workunit.client.1.smithi156.stdout:1/634: rename db/d1f/d2d/d48/f57 to db/d1f/d2f/db5/fc9 0 2024-04-23T14:49:59.559 INFO:tasks.workunit.client.0.smithi081.stdout:5/945: dread d17/d4a/f8f [0,4194304] 0 2024-04-23T14:49:59.563 INFO:tasks.workunit.client.1.smithi156.stdout:6/630: mkdir d3/d16/d46/d9d/d9f/dad/dcd/de6 0 2024-04-23T14:49:59.563 INFO:tasks.workunit.client.1.smithi156.stdout:6/631: write d3/d16/f30 [186102,108036] 0 2024-04-23T14:49:59.564 INFO:tasks.workunit.client.1.smithi156.stdout:2/557: dwrite d4/fb0 [0,4194304] 0 2024-04-23T14:49:59.564 INFO:tasks.workunit.client.1.smithi156.stdout:2/558: chown d4/d21/d42/f55 93 1 2024-04-23T14:49:59.565 INFO:tasks.workunit.client.1.smithi156.stdout:2/559: write d4/d21/f67 [886369,127984] 0 2024-04-23T14:49:59.567 INFO:tasks.workunit.client.1.smithi156.stdout:7/591: mkdir dc/d1d/dba 0 2024-04-23T14:49:59.567 INFO:tasks.workunit.client.1.smithi156.stdout:7/592: chown dc/d1d/d48/d83 567 1 2024-04-23T14:49:59.567 INFO:tasks.workunit.client.1.smithi156.stdout:7/593: chown dc/d1d/f77 352 1 2024-04-23T14:49:59.567 INFO:tasks.workunit.client.1.smithi156.stdout:7/594: truncate dc/d2c/d68/f8e 571557 0 2024-04-23T14:49:59.567 INFO:tasks.workunit.client.1.smithi156.stdout:7/595: write dc/d1d/d48/f6b [392969,51407] 0 2024-04-23T14:49:59.569 INFO:tasks.workunit.client.1.smithi156.stdout:6/632: dread d3/d16/d46/d2b/d6e/f95 [0,4194304] 0 2024-04-23T14:49:59.569 INFO:tasks.workunit.client.1.smithi156.stdout:6/633: creat d3/d16/d46/d9d/fe7 x:0 0 0 2024-04-23T14:49:59.569 INFO:tasks.workunit.client.1.smithi156.stdout:6/634: read - d3/d16/d46/d2b/d3b/d9e/fda zero size 2024-04-23T14:49:59.569 INFO:tasks.workunit.client.1.smithi156.stdout:6/635: write d3/da/d1d/d27/fb6 [4295799,34241] 0 2024-04-23T14:49:59.569 INFO:tasks.workunit.client.1.smithi156.stdout:6/636: truncate d3/d16/d46/d64/d77/fb7 4898717 0 2024-04-23T14:49:59.569 INFO:tasks.workunit.client.1.smithi156.stdout:6/637: fdatasync d3/da/d1d/d59/d9c/fbd 0 2024-04-23T14:49:59.574 INFO:tasks.workunit.client.0.smithi081.stdout:2/853: mkdir d1/d11/d21/d52/d8b/d8f/d93/d128 0 2024-04-23T14:49:59.574 INFO:tasks.workunit.client.0.smithi081.stdout:4/838: dread d1/d4/dc/fa0 [0,4194304] 0 2024-04-23T14:49:59.576 INFO:tasks.workunit.client.1.smithi156.stdout:4/492: symlink d0/df/la5 0 2024-04-23T14:49:59.576 INFO:tasks.workunit.client.0.smithi081.stdout:3/804: dwrite d4/d7/d32/da6/dc4/d47/f96 [0,4194304] 0 2024-04-23T14:49:59.578 INFO:tasks.workunit.client.0.smithi081.stdout:0/991: creat d6/d11/d14/d41/d5b/d3f/d44/d78/d83/d103/f13b x:0 0 0 2024-04-23T14:49:59.578 INFO:tasks.workunit.client.0.smithi081.stdout:2/854: dread d1/d11/f10b [0,4194304] 0 2024-04-23T14:49:59.578 INFO:tasks.workunit.client.0.smithi081.stdout:0/992: write d6/d11/d14/d24/db3/f12f [607422,97955] 0 2024-04-23T14:49:59.579 INFO:tasks.workunit.client.0.smithi081.stdout:7/817: mkdir d3/d21/d31/d33/d126 0 2024-04-23T14:49:59.579 INFO:tasks.workunit.client.0.smithi081.stdout:7/818: chown d3/d20/dc9/lb4 49292210 1 2024-04-23T14:49:59.582 INFO:tasks.workunit.client.0.smithi081.stdout:1/994: creat d3/d3d/d41/d5e/d17/d58/d7f/dba/f14c x:0 0 0 2024-04-23T14:49:59.586 INFO:tasks.workunit.client.1.smithi156.stdout:0/559: rename d0/d4/f8a to d0/d16/d3a/d1e/d80/fbc 0 2024-04-23T14:49:59.590 INFO:tasks.workunit.client.0.smithi081.stdout:4/839: write d1/d1d/d39/d8d/f90 [2161474,53536] 0 2024-04-23T14:49:59.593 INFO:tasks.workunit.client.0.smithi081.stdout:5/946: rename d17/d3c/d105/c124 to d17/d3c/de7/c147 0 2024-04-23T14:49:59.599 INFO:tasks.workunit.client.0.smithi081.stdout:3/805: creat d4/d7/d7f/f109 x:0 0 0 2024-04-23T14:49:59.601 INFO:tasks.workunit.client.0.smithi081.stdout:0/993: symlink d6/d11/d14/d41/d5b/d3f/l13c 0 2024-04-23T14:49:59.601 INFO:tasks.workunit.client.0.smithi081.stdout:0/994: write d6/d11/d14/d41/d5b/d3f/d44/d78/d83/fce [469969,40965] 0 2024-04-23T14:49:59.604 INFO:tasks.workunit.client.0.smithi081.stdout:7/819: symlink d3/d21/d41/d7c/dc3/d7f/ddd/l127 0 2024-04-23T14:49:59.604 INFO:tasks.workunit.client.0.smithi081.stdout:7/820: creat d3/d21/d41/d7c/dc3/d7f/f128 x:0 0 0 2024-04-23T14:49:59.604 INFO:tasks.workunit.client.0.smithi081.stdout:7/821: truncate d3/d21/d31/d33/d4b/f60 567141 0 2024-04-23T14:49:59.605 INFO:tasks.workunit.client.1.smithi156.stdout:2/560: mkdir d4/d26/d3c/dca 0 2024-04-23T14:49:59.605 INFO:tasks.workunit.client.1.smithi156.stdout:2/561: read - d4/d21/d42/da1/fc9 zero size 2024-04-23T14:49:59.606 INFO:tasks.workunit.client.1.smithi156.stdout:2/562: creat d4/d21/d76/fcb x:0 0 0 2024-04-23T14:49:59.607 INFO:tasks.workunit.client.0.smithi081.stdout:1/995: truncate d3/d3d/d41/d5e/d5d/db0/f46 268939 0 2024-04-23T14:49:59.607 INFO:tasks.workunit.client.0.smithi081.stdout:1/996: write d3/d3d/d41/d5e/d5d/f10c [423267,39678] 0 2024-04-23T14:49:59.616 INFO:tasks.workunit.client.0.smithi081.stdout:7/822: dread d3/d21/f55 [0,4194304] 0 2024-04-23T14:49:59.616 INFO:tasks.workunit.client.1.smithi156.stdout:7/596: link dc/d1d/l7e dc/d1d/d48/lbb 0 2024-04-23T14:49:59.619 INFO:tasks.workunit.client.0.smithi081.stdout:4/840: rename d1/d8b/f92 to d1/d4f/f10e 0 2024-04-23T14:49:59.621 INFO:tasks.workunit.client.1.smithi156.stdout:6/638: creat d3/da/d1d/fe8 x:0 0 0 2024-04-23T14:49:59.622 INFO:tasks.workunit.client.0.smithi081.stdout:5/947: symlink d17/d3c/d55/l148 0 2024-04-23T14:49:59.623 INFO:tasks.workunit.client.1.smithi156.stdout:2/563: dread d4/d13/d19/d4c/f6c [0,4194304] 0 2024-04-23T14:49:59.624 INFO:tasks.workunit.client.0.smithi081.stdout:0/995: creat d6/d11/d14/f13d x:0 0 0 2024-04-23T14:49:59.625 INFO:tasks.workunit.client.1.smithi156.stdout:3/515: sync 2024-04-23T14:49:59.626 INFO:tasks.workunit.client.1.smithi156.stdout:5/612: rename d1/d11/d18/d52/d75/c79 to d1/d3/cc4 0 2024-04-23T14:49:59.629 INFO:tasks.workunit.client.0.smithi081.stdout:7/823: dread d3/d21/d31/f38 [0,4194304] 0 2024-04-23T14:49:59.630 INFO:tasks.workunit.client.1.smithi156.stdout:0/560: unlink d0/d16/d3a/d2a/d1d/f98 0 2024-04-23T14:49:59.630 INFO:tasks.workunit.client.1.smithi156.stdout:0/561: readlink d0/d4/d22/d58/d9a/l30 0 2024-04-23T14:49:59.635 INFO:tasks.workunit.client.0.smithi081.stdout:4/841: readlink d1/d1d/d59/l7d 0 2024-04-23T14:49:59.635 INFO:tasks.workunit.client.0.smithi081.stdout:4/842: chown d1/d4/d11/f6d 15 1 2024-04-23T14:49:59.636 INFO:tasks.workunit.client.1.smithi156.stdout:2/564: dread d4/d13/f86 [0,4194304] 0 2024-04-23T14:49:59.637 INFO:tasks.workunit.client.1.smithi156.stdout:1/635: rmdir db/d1f/d2d/d93 39 2024-04-23T14:49:59.638 INFO:tasks.workunit.client.1.smithi156.stdout:1/636: stat db/d1f/d2d/d48/daf/c65 0 2024-04-23T14:49:59.639 INFO:tasks.workunit.client.0.smithi081.stdout:5/948: unlink d17/d18/cce 0 2024-04-23T14:49:59.644 INFO:tasks.workunit.client.0.smithi081.stdout:7/824: getdents d3/d21/d41/dd2 0 2024-04-23T14:49:59.645 INFO:tasks.workunit.client.0.smithi081.stdout:7/825: chown d3/d21/d31/d50/cfc 2 1 2024-04-23T14:49:59.645 INFO:tasks.workunit.client.1.smithi156.stdout:7/597: unlink dc/d46/fb6 0 2024-04-23T14:49:59.645 INFO:tasks.workunit.client.1.smithi156.stdout:3/516: mknod d4/db/dd/d1d/ca3 0 2024-04-23T14:49:59.648 INFO:tasks.workunit.client.1.smithi156.stdout:9/487: rename d1/d2/d3e/d50/f90 to d1/d2/d3e/d55/d6f/d30/fa6 0 2024-04-23T14:49:59.649 INFO:tasks.workunit.client.0.smithi081.stdout:0/996: dread d6/d11/d14/d41/d5b/d3f/d44/d78/d83/fce [0,4194304] 0 2024-04-23T14:49:59.650 INFO:tasks.workunit.client.1.smithi156.stdout:5/613: link d1/d3/l21 d1/lc5 0 2024-04-23T14:49:59.651 INFO:tasks.workunit.client.1.smithi156.stdout:5/614: write d1/d11/f4d [317304,75275] 0 2024-04-23T14:49:59.656 INFO:tasks.workunit.client.0.smithi081.stdout:2/855: dwrite d1/d11/dab/ff3 [0,4194304] 0 2024-04-23T14:49:59.656 INFO:tasks.workunit.client.0.smithi081.stdout:5/949: dread d17/d3c/d55/d64/fe9 [0,4194304] 0 2024-04-23T14:49:59.656 INFO:tasks.workunit.client.0.smithi081.stdout:4/843: dread d1/d4/d6f/d70/daf/f71 [0,4194304] 0 2024-04-23T14:49:59.656 INFO:tasks.workunit.client.1.smithi156.stdout:2/565: creat d4/d13/d19/d4c/fcc x:0 0 0 2024-04-23T14:49:59.657 INFO:tasks.workunit.client.1.smithi156.stdout:0/562: dread d0/d4/f3 [0,4194304] 0 2024-04-23T14:49:59.660 INFO:tasks.workunit.client.0.smithi081.stdout:0/997: dread d6/d11/d14/d41/d5b/d3f/d44/d78/fc7 [0,4194304] 0 2024-04-23T14:49:59.665 INFO:tasks.workunit.client.0.smithi081.stdout:3/806: dwrite d4/d7/d32/da6/dc4/d47/fdb [0,4194304] 0 2024-04-23T14:49:59.665 INFO:tasks.workunit.client.0.smithi081.stdout:0/998: write d6/d37/ff9 [339932,10131] 0 2024-04-23T14:49:59.669 INFO:tasks.workunit.client.1.smithi156.stdout:1/637: unlink db/d25/d30/d38/d40/fc6 0 2024-04-23T14:49:59.669 INFO:tasks.workunit.client.1.smithi156.stdout:7/598: creat dc/d1d/d24/da7/fbc x:0 0 0 2024-04-23T14:49:59.669 INFO:tasks.workunit.client.1.smithi156.stdout:9/488: mkdir d1/d2/d3e/d50/d7a/d17/d1f/d48/da7 0 2024-04-23T14:49:59.669 INFO:tasks.workunit.client.1.smithi156.stdout:7/599: chown dc/d2c/f5c 351 1 2024-04-23T14:49:59.669 INFO:tasks.workunit.client.1.smithi156.stdout:9/489: chown d1/d2/d23/d49/d4b 7957 1 2024-04-23T14:49:59.669 INFO:tasks.workunit.client.1.smithi156.stdout:7/600: chown dc/d1d/d24/l8f 1861035 1 2024-04-23T14:49:59.669 INFO:tasks.workunit.client.1.smithi156.stdout:7/601: readlink dc/d2c/l4e 0 2024-04-23T14:49:59.670 INFO:tasks.workunit.client.1.smithi156.stdout:5/615: mknod d1/d11/d18/d19/d9a/cc6 0 2024-04-23T14:49:59.670 INFO:tasks.workunit.client.1.smithi156.stdout:5/616: chown d1/d3/l5b 7386 1 2024-04-23T14:49:59.670 INFO:tasks.workunit.client.1.smithi156.stdout:2/566: unlink d4/d21/d2f/c4d 0 2024-04-23T14:49:59.671 INFO:tasks.workunit.client.0.smithi081.stdout:2/856: creat d1/d33/d95/f129 x:0 0 0 2024-04-23T14:49:59.672 INFO:tasks.workunit.client.0.smithi081.stdout:2/857: write d1/f10e [502508,68376] 0 2024-04-23T14:49:59.673 INFO:tasks.workunit.client.0.smithi081.stdout:5/950: mknod d17/d65/dd2/c149 0 2024-04-23T14:49:59.677 INFO:tasks.workunit.client.0.smithi081.stdout:7/826: getdents d3/d21 0 2024-04-23T14:49:59.679 INFO:tasks.workunit.client.1.smithi156.stdout:7/602: symlink dc/d2c/lbd 0 2024-04-23T14:49:59.679 INFO:tasks.workunit.client.1.smithi156.stdout:7/603: fdatasync dc/d1d/f42 0 2024-04-23T14:49:59.679 INFO:tasks.workunit.client.1.smithi156.stdout:9/490: truncate d1/d2/d3e/d50/d7a/dc/f22 1320433 0 2024-04-23T14:49:59.679 INFO:tasks.workunit.client.1.smithi156.stdout:9/491: truncate d1/d2/d23/d49/d4c/f3b 1526247 0 2024-04-23T14:49:59.679 INFO:tasks.workunit.client.1.smithi156.stdout:5/617: getdents d1/d3/d43 0 2024-04-23T14:49:59.679 INFO:tasks.workunit.client.1.smithi156.stdout:0/563: read d0/d16/d3a/d2a/f12 [1482524,107003] 0 2024-04-23T14:49:59.679 INFO:tasks.workunit.client.1.smithi156.stdout:0/564: chown d0/d4/d22/c38 1663086345 1 2024-04-23T14:49:59.688 INFO:tasks.workunit.client.0.smithi081.stdout:4/844: dread d1/d8f/d94/fdb [0,4194304] 0 2024-04-23T14:49:59.693 INFO:tasks.workunit.client.0.smithi081.stdout:3/807: truncate d4/d7/df/d30/f4c 2680510 0 2024-04-23T14:49:59.694 INFO:tasks.workunit.client.0.smithi081.stdout:4/845: fdatasync d1/d4/d11/d75/fdc 0 2024-04-23T14:49:59.696 INFO:tasks.workunit.client.1.smithi156.stdout:0/565: creat d0/d16/d3a/d1e/fbd x:0 0 0 2024-04-23T14:49:59.699 INFO:tasks.workunit.client.0.smithi081.stdout:0/999: creat d6/d11/d14/d24/f13e x:0 0 0 2024-04-23T14:49:59.704 INFO:tasks.workunit.client.1.smithi156.stdout:4/493: dwrite d0/d8/fc [0,4194304] 0 2024-04-23T14:49:59.704 INFO:tasks.workunit.client.1.smithi156.stdout:4/494: write d0/d8/d1e/d4a/d77/fa3 [397328,107060] 0 2024-04-23T14:49:59.705 INFO:tasks.workunit.client.1.smithi156.stdout:4/495: write d0/df/d55/d68/d74/f96 [4126852,2338] 0 2024-04-23T14:49:59.705 INFO:tasks.workunit.client.0.smithi081.stdout:2/858: mknod d1/d1e/c12a 0 2024-04-23T14:49:59.705 INFO:tasks.workunit.client.0.smithi081.stdout:2/859: fsync d1/d11/d21/d34/f76 0 2024-04-23T14:49:59.705 INFO:tasks.workunit.client.0.smithi081.stdout:2/860: getdents d1/d33/d45/d11b 0 2024-04-23T14:49:59.714 INFO:tasks.workunit.client.1.smithi156.stdout:7/604: write dc/d1d/d24/d5a/f76 [2385622,27012] 0 2024-04-23T14:49:59.716 INFO:tasks.workunit.client.0.smithi081.stdout:2/861: mknod d1/d11/d21/d52/d8b/d8f/dee/c12b 0 2024-04-23T14:49:59.720 INFO:tasks.workunit.client.1.smithi156.stdout:6/639: dwrite d3/d16/d5c/f86 [0,4194304] 0 2024-04-23T14:49:59.733 INFO:tasks.workunit.client.1.smithi156.stdout:4/496: mknod d0/df/d21/ca6 0 2024-04-23T14:49:59.736 INFO:tasks.workunit.client.0.smithi081.stdout:2/862: write d1/d11/d21/d52/d8b/d8f/d93/fcb [1982600,41059] 0 2024-04-23T14:49:59.749 INFO:tasks.workunit.client.1.smithi156.stdout:6/640: rename d3/da/d1d/d27/f58 to d3/da/d74/fe9 0 2024-04-23T14:49:59.750 INFO:tasks.workunit.client.0.smithi081.stdout:2/863: dread d1/f92 [0,4194304] 0 2024-04-23T14:49:59.750 INFO:tasks.workunit.client.0.smithi081.stdout:2/864: stat d1/d11/d21/d52/l11d 0 2024-04-23T14:49:59.752 INFO:tasks.workunit.client.0.smithi081.stdout:5/951: dwrite d17/d18/dff/fcd [0,4194304] 0 2024-04-23T14:49:59.754 INFO:tasks.workunit.client.1.smithi156.stdout:4/497: creat d0/d8/d1e/da0/fa7 x:0 0 0 2024-04-23T14:49:59.757 INFO:tasks.workunit.client.0.smithi081.stdout:2/865: creat d1/d33/d45/d6e/f12c x:0 0 0 2024-04-23T14:49:59.761 INFO:tasks.workunit.client.0.smithi081.stdout:2/866: write d1/d11/f26 [910105,8958] 0 2024-04-23T14:49:59.762 INFO:tasks.workunit.client.0.smithi081.stdout:2/867: creat d1/d33/d45/d11b/f12d x:0 0 0 2024-04-23T14:49:59.763 INFO:tasks.workunit.client.0.smithi081.stdout:2/868: write d1/d1e/f106 [383792,50838] 0 2024-04-23T14:49:59.763 INFO:tasks.workunit.client.1.smithi156.stdout:3/517: dwrite d4/db/dd/d73/f7e [0,4194304] 0 2024-04-23T14:49:59.764 INFO:tasks.workunit.client.1.smithi156.stdout:1/638: dread db/d1f/d2d/f36 [0,4194304] 0 2024-04-23T14:49:59.767 INFO:tasks.workunit.client.0.smithi081.stdout:2/869: unlink d1/d33/d45/d6e/d96/l54 0 2024-04-23T14:49:59.768 INFO:tasks.workunit.client.1.smithi156.stdout:3/518: unlink d4/db/d4b/f84 0 2024-04-23T14:49:59.769 INFO:tasks.workunit.client.1.smithi156.stdout:8/564: sync 2024-04-23T14:49:59.770 INFO:tasks.workunit.client.1.smithi156.stdout:8/565: getdents d5/d9/d36/d60/d62 0 2024-04-23T14:49:59.771 INFO:tasks.workunit.client.0.smithi081.stdout:2/870: symlink d1/d33/d45/df1/l12e 0 2024-04-23T14:49:59.771 INFO:tasks.workunit.client.0.smithi081.stdout:2/871: stat d1/d33/d95/fc9 0 2024-04-23T14:49:59.775 INFO:tasks.workunit.client.1.smithi156.stdout:8/566: unlink d5/d4e/f66 0 2024-04-23T14:49:59.775 INFO:tasks.workunit.client.0.smithi081.stdout:2/872: mknod d1/d33/d45/d6e/c12f 0 2024-04-23T14:49:59.780 INFO:tasks.workunit.client.0.smithi081.stdout:2/873: getdents d1/d33/d95 0 2024-04-23T14:49:59.787 INFO:tasks.workunit.client.1.smithi156.stdout:6/641: dread d3/da/d1d/d27/d63/f96 [0,4194304] 0 2024-04-23T14:49:59.788 INFO:tasks.workunit.client.0.smithi081.stdout:2/874: rmdir d1/d1e 39 2024-04-23T14:49:59.792 INFO:tasks.workunit.client.0.smithi081.stdout:2/875: mknod d1/d11/d21/c130 0 2024-04-23T14:49:59.792 INFO:tasks.workunit.client.0.smithi081.stdout:2/876: write d1/d11/d21/d52/d8b/d8f/d93/fa6 [4859679,5490] 0 2024-04-23T14:49:59.794 INFO:tasks.workunit.client.0.smithi081.stdout:2/877: stat d1/d33/d9f/lfd 0 2024-04-23T14:49:59.797 INFO:tasks.workunit.client.0.smithi081.stdout:2/878: truncate d1/d11/d21/fc4 1336465 0 2024-04-23T14:49:59.797 INFO:tasks.workunit.client.0.smithi081.stdout:2/879: truncate d1/d11/d21/d52/d8b/d8f/fec 397450 0 2024-04-23T14:49:59.799 INFO:tasks.workunit.client.0.smithi081.stdout:2/880: mkdir d1/d11/d21/d52/d8b/d8f/d93/d121/d131 0 2024-04-23T14:49:59.799 INFO:tasks.workunit.client.0.smithi081.stdout:2/881: fsync d1/d33/d9f/fff 0 2024-04-23T14:49:59.799 INFO:tasks.workunit.client.0.smithi081.stdout:2/882: read - d1/d33/d45/fd5 zero size 2024-04-23T14:49:59.807 INFO:tasks.workunit.client.0.smithi081.stdout:2/883: rmdir d1/d11/d21/d52/d8b/d8f/de8/d123 0 2024-04-23T14:49:59.807 INFO:tasks.workunit.client.0.smithi081.stdout:2/884: truncate d1/d1e/f106 1101801 0 2024-04-23T14:49:59.807 INFO:tasks.workunit.client.0.smithi081.stdout:4/846: dwrite d1/fa [8388608,4194304] 0 2024-04-23T14:49:59.807 INFO:tasks.workunit.client.0.smithi081.stdout:4/847: creat d1/d4/d11/d9d/dac/f10f x:0 0 0 2024-04-23T14:49:59.810 INFO:tasks.workunit.client.1.smithi156.stdout:2/567: dwrite d4/d21/d2f/f35 [0,4194304] 0 2024-04-23T14:49:59.811 INFO:tasks.workunit.client.0.smithi081.stdout:4/848: creat d1/d4/d6f/d70/d9c/ddd/f110 x:0 0 0 2024-04-23T14:49:59.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.816+0000 7f5f73200700 1 -- 172.21.15.81:0/1420395027 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5f6c115e10 con 0x7f5f6c0fe0e0 2024-04-23T14:49:59.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.818+0000 7f5f63e00700 1 -- 172.21.15.81:0/1420395027 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7f5f58004de0 con 0x7f5f6c0fe0e0 2024-04-23T14:49:59.819 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:49:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-04-23T14:49:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 2 2024-04-23T14:49:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:49:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-04-23T14:49:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 1, 2024-04-23T14:49:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 1 2024-04-23T14:49:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:49:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-04-23T14:49:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 6 2024-04-23T14:49:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:49:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-04-23T14:49:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 4 2024-04-23T14:49:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:49:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-04-23T14:49:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 13, 2024-04-23T14:49:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 1 2024-04-23T14:49:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-23T14:49:59.821 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:49:59.821 INFO:tasks.workunit.client.1.smithi156.stdout:4/498: dread d0/d76/f70 [0,4194304] 0 2024-04-23T14:49:59.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.821+0000 7f5f73200700 1 -- 172.21.15.81:0/1420395027 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f5f5006bcf0 msgr2=0x7f5f5006e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:59.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.821+0000 7f5f73200700 1 --2- 172.21.15.81:0/1420395027 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f5f5006bcf0 0x7f5f5006e1a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c0fcc30 tx=0x7f5f6400b040 comp rx=0 tx=0).stop 2024-04-23T14:49:59.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.821+0000 7f5f73200700 1 -- 172.21.15.81:0/1420395027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f6c0fe0e0 msgr2=0x7f5f6c114520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:49:59.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.821+0000 7f5f73200700 1 --2- 172.21.15.81:0/1420395027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f6c0fe0e0 0x7f5f6c114520 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5f58009360 tx=0x7f5f58009e30 comp rx=0 tx=0).stop 2024-04-23T14:49:59.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.821+0000 7f5f73200700 1 -- 172.21.15.81:0/1420395027 shutdown_connections 2024-04-23T14:49:59.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.821+0000 7f5f73200700 1 --2- 172.21.15.81:0/1420395027 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f5f5006bcf0 0x7f5f5006e1a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:59.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.821+0000 7f5f73200700 1 --2- 172.21.15.81:0/1420395027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f6c0fcef0 0x7f5f6c113fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:59.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.821+0000 7f5f73200700 1 --2- 172.21.15.81:0/1420395027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f6c0fe0e0 0x7f5f6c114520 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:49:59.824 INFO:tasks.workunit.client.1.smithi156.stdout:4/499: unlink d0/df/d55/d68/d53/c61 0 2024-04-23T14:49:59.824 INFO:tasks.workunit.client.1.smithi156.stdout:0/566: dwrite d0/d16/d3a/d1e/fbd [0,4194304] 0 2024-04-23T14:49:59.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.821+0000 7f5f73200700 1 -- 172.21.15.81:0/1420395027 >> 172.21.15.81:0/1420395027 conn(0x7f5f6c0f8530 msgr2=0x7f5f6c0f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:49:59.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.822+0000 7f5f73200700 1 -- 172.21.15.81:0/1420395027 shutdown_connections 2024-04-23T14:49:59.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:49:59.822+0000 7f5f73200700 1 -- 172.21.15.81:0/1420395027 wait complete. 2024-04-23T14:49:59.829 INFO:tasks.workunit.client.1.smithi156.stdout:4/500: creat d0/df/d55/d68/d53/d9f/fa8 x:0 0 0 2024-04-23T14:49:59.830 INFO:tasks.workunit.client.0.smithi081.stdout:2/885: write d1/d33/da3/fd1 [2202759,94135] 0 2024-04-23T14:49:59.830 INFO:tasks.workunit.client.0.smithi081.stdout:2/886: chown d1/f32 104149 1 2024-04-23T14:49:59.830 INFO:tasks.workunit.client.0.smithi081.stdout:2/887: dread - d1/d11/d21/d52/d8b/d8f/dee/f102 zero size 2024-04-23T14:49:59.830 INFO:tasks.workunit.client.0.smithi081.stdout:7/827: dwrite d3/d11/f1b [8388608,4194304] 0 2024-04-23T14:49:59.832 INFO:tasks.workunit.client.0.smithi081.stdout:7/828: symlink d3/d21/d31/d50/l129 0 2024-04-23T14:49:59.833 INFO:tasks.workunit.client.1.smithi156.stdout:4/501: rmdir d0/d8/d1e/d4a 39 2024-04-23T14:49:59.839 INFO:tasks.workunit.client.1.smithi156.stdout:4/502: getdents d0/d8/d1e/d4a/d77/d9c 0 2024-04-23T14:49:59.840 INFO:tasks.workunit.client.0.smithi081.stdout:3/808: dwrite d4/d7/d32/da6/dc4/d47/fdb [4194304,4194304] 0 2024-04-23T14:49:59.841 INFO:tasks.workunit.client.0.smithi081.stdout:7/829: truncate d3/d21/d41/d7c/f11f 34992 0 2024-04-23T14:49:59.843 INFO:tasks.workunit.client.1.smithi156.stdout:9/492: dwrite d1/d2/d3e/d50/d7a/dc/f22 [0,4194304] 0 2024-04-23T14:49:59.843 INFO:tasks.workunit.client.1.smithi156.stdout:9/493: creat d1/d2/d3e/d50/fa8 x:0 0 0 2024-04-23T14:49:59.844 INFO:tasks.workunit.client.0.smithi081.stdout:7/830: rmdir d3/d11/d2c/d75/d8e 39 2024-04-23T14:49:59.852 INFO:tasks.workunit.client.0.smithi081.stdout:5/952: dwrite d17/d3c/d55/d64/dcc/ff5 [0,4194304] 0 2024-04-23T14:49:59.852 INFO:tasks.workunit.client.0.smithi081.stdout:5/953: creat d17/d37/f14a x:0 0 0 2024-04-23T14:49:59.861 INFO:tasks.workunit.client.0.smithi081.stdout:5/954: mknod d17/d18/d3a/d8e/c14b 0 2024-04-23T14:49:59.861 INFO:tasks.workunit.client.0.smithi081.stdout:5/955: creat d17/d3c/d105/f14c x:0 0 0 2024-04-23T14:49:59.861 INFO:tasks.workunit.client.1.smithi156.stdout:1/639: dwrite db/d1f/d2d/fc5 [0,4194304] 0 2024-04-23T14:49:59.861 INFO:tasks.workunit.client.1.smithi156.stdout:1/640: fsync db/d1f/d2f/d47/f5f 0 2024-04-23T14:49:59.862 INFO:tasks.workunit.client.1.smithi156.stdout:9/494: write d1/f51 [2997038,43909] 0 2024-04-23T14:49:59.865 INFO:tasks.workunit.client.0.smithi081.stdout:7/831: mkdir d3/d21/d31/d33/d4b/d4c/d12a 0 2024-04-23T14:49:59.870 INFO:tasks.workunit.client.0.smithi081.stdout:7/832: creat d3/d11/d2c/d75/d8e/f12b x:0 0 0 2024-04-23T14:49:59.875 INFO:tasks.workunit.client.0.smithi081.stdout:7/833: mkdir d3/d21/d31/d33/d52/d12c 0 2024-04-23T14:49:59.876 INFO:tasks.workunit.client.1.smithi156.stdout:8/567: dwrite d5/fb1 [0,4194304] 0 2024-04-23T14:49:59.876 INFO:tasks.workunit.client.1.smithi156.stdout:8/568: dread - d5/d39/f63 zero size 2024-04-23T14:49:59.878 INFO:tasks.workunit.client.1.smithi156.stdout:9/495: mkdir d1/d2/d3e/d50/da9 0 2024-04-23T14:49:59.883 INFO:tasks.workunit.client.0.smithi081.stdout:7/834: creat d3/d20/dc9/f12d x:0 0 0 2024-04-23T14:49:59.883 INFO:tasks.workunit.client.0.smithi081.stdout:7/835: write d3/d21/d41/d7c/dc3/fac [515032,20921] 0 2024-04-23T14:49:59.911 INFO:tasks.workunit.client.1.smithi156.stdout:8/569: creat d5/d9/d36/d84/dc1/fc5 x:0 0 0 2024-04-23T14:49:59.917 INFO:tasks.workunit.client.0.smithi081.stdout:3/809: dwrite d4/dc/f55 [0,4194304] 0 2024-04-23T14:49:59.938 INFO:tasks.workunit.client.1.smithi156.stdout:8/570: rename d5/d9/d36/d9c/c9a to d5/d4e/cc6 0 2024-04-23T14:49:59.939 INFO:tasks.workunit.client.1.smithi156.stdout:4/503: dwrite d0/df/d55/d68/d74/f96 [0,4194304] 0 2024-04-23T14:49:59.939 INFO:tasks.workunit.client.1.smithi156.stdout:4/504: fdatasync d0/d8/d1e/f47 0 2024-04-23T14:49:59.939 INFO:tasks.workunit.client.1.smithi156.stdout:4/505: write d0/df/fa1 [1022054,106221] 0 2024-04-23T14:49:59.939 INFO:tasks.workunit.client.1.smithi156.stdout:4/506: write d0/df/d55/d68/d53/f82 [627015,85561] 0 2024-04-23T14:49:59.940 INFO:tasks.workunit.client.1.smithi156.stdout:4/507: chown d0/df/d55/d68/d85/fa4 5 1 2024-04-23T14:49:59.944 INFO:tasks.workunit.client.1.smithi156.stdout:6/642: dwrite d3/d16/f39 [0,4194304] 0 2024-04-23T14:49:59.944 INFO:tasks.workunit.client.1.smithi156.stdout:6/643: chown d3/d16/d46/d2b/d3b/d9e/fe4 919 1 2024-04-23T14:49:59.944 INFO:tasks.workunit.client.1.smithi156.stdout:8/571: mkdir d5/d4e/dc7 0 2024-04-23T14:49:59.951 INFO:tasks.workunit.client.0.smithi081.stdout:4/849: dwrite d1/d4/fe9 [0,4194304] 0 2024-04-23T14:49:59.952 INFO:tasks.workunit.client.1.smithi156.stdout:4/508: rmdir d0/df/d21 39 2024-04-23T14:49:59.953 INFO:tasks.workunit.client.1.smithi156.stdout:4/509: readlink d0/l23 0 2024-04-23T14:49:59.955 INFO:tasks.workunit.client.1.smithi156.stdout:6/644: mkdir d3/d16/d46/d9d/d9f/dad/dea 0 2024-04-23T14:49:59.955 INFO:tasks.workunit.client.1.smithi156.stdout:6/645: read - d3/fd7 zero size 2024-04-23T14:49:59.956 INFO:tasks.workunit.client.1.smithi156.stdout:8/572: mkdir d5/d9/d5a/dc8 0 2024-04-23T14:49:59.956 INFO:tasks.workunit.client.1.smithi156.stdout:8/573: write d5/d9/d10/d1d/fae [125515,34333] 0 2024-04-23T14:49:59.961 INFO:tasks.workunit.client.1.smithi156.stdout:9/496: dwrite d1/d2/d3e/d50/f78 [0,4194304] 0 2024-04-23T14:49:59.961 INFO:tasks.workunit.client.1.smithi156.stdout:6/646: mkdir d3/da/d1d/d59/deb 0 2024-04-23T14:49:59.964 INFO:tasks.workunit.client.0.smithi081.stdout:3/810: mkdir d4/d41/d10a 0 2024-04-23T14:49:59.964 INFO:tasks.workunit.client.0.smithi081.stdout:3/811: chown d4/d7/d7f 10730251 1 2024-04-23T14:49:59.964 INFO:tasks.workunit.client.0.smithi081.stdout:3/812: chown d4/d7/df/d30/f80 139 1 2024-04-23T14:49:59.964 INFO:tasks.workunit.client.0.smithi081.stdout:3/813: write d4/d7/df/f1b [1417251,129972] 0 2024-04-23T14:49:59.965 INFO:tasks.workunit.client.1.smithi156.stdout:8/574: dread d5/d9/f4b [0,4194304] 0 2024-04-23T14:49:59.966 INFO:tasks.workunit.client.0.smithi081.stdout:2/888: dwrite d1/d33/d45/d11b/f12d [0,4194304] 0 2024-04-23T14:49:59.977 INFO:tasks.workunit.client.1.smithi156.stdout:2/568: dwrite d4/d21/d42/d75/d79/f85 [0,4194304] 0 2024-04-23T14:49:59.980 INFO:tasks.workunit.client.1.smithi156.stdout:8/575: dread d5/d9/d5a/d5c/f72 [0,4194304] 0 2024-04-23T14:49:59.980 INFO:tasks.workunit.client.1.smithi156.stdout:8/576: chown d5/l4a 1 1 2024-04-23T14:49:59.982 INFO:tasks.workunit.client.1.smithi156.stdout:6/647: creat d3/da/fec x:0 0 0 2024-04-23T14:49:59.982 INFO:tasks.workunit.client.1.smithi156.stdout:6/648: write d3/d16/f30 [1529465,60702] 0 2024-04-23T14:49:59.987 INFO:tasks.workunit.client.1.smithi156.stdout:0/567: dwrite d0/d16/d3a/f6a [0,4194304] 0 2024-04-23T14:49:59.987 INFO:tasks.workunit.client.1.smithi156.stdout:4/510: dread d0/df/f25 [0,4194304] 0 2024-04-23T14:49:59.991 INFO:tasks.workunit.client.1.smithi156.stdout:2/569: dread d4/d13/d19/d4c/f91 [0,4194304] 0 2024-04-23T14:49:59.996 INFO:tasks.workunit.client.0.smithi081.stdout:3/814: read d4/d7/df/f19 [7210545,53772] 0 2024-04-23T14:49:59.996 INFO:tasks.workunit.client.0.smithi081.stdout:7/836: dwrite d3/d11/d2c/f34 [0,4194304] 0 2024-04-23T14:49:59.997 INFO:tasks.workunit.client.0.smithi081.stdout:7/837: readlink d3/d21/d31/d63/l9d 0 2024-04-23T14:49:59.998 INFO:tasks.workunit.client.1.smithi156.stdout:8/577: mknod d5/d9/d36/d84/dc1/cc9 0 2024-04-23T14:50:00.006 INFO:tasks.workunit.client.0.smithi081.stdout:3/815: symlink d4/d7/d32/l10b 0 2024-04-23T14:50:00.008 INFO:tasks.workunit.client.1.smithi156.stdout:8/578: dread d5/d9/d10/f11 [4194304,4194304] 0 2024-04-23T14:50:00.015 INFO:tasks.workunit.client.0.smithi081.stdout:3/816: mknod d4/d7/d7f/d91/c10c 0 2024-04-23T14:50:00.016 INFO:tasks.workunit.client.0.smithi081.stdout:3/817: write d4/d41/dc6/ffa [565315,31828] 0 2024-04-23T14:50:00.018 INFO:tasks.workunit.client.0.smithi081.stdout:1/997: sync 2024-04-23T14:50:00.018 INFO:tasks.workunit.client.0.smithi081.stdout:6/867: sync 2024-04-23T14:50:00.018 INFO:tasks.workunit.client.0.smithi081.stdout:6/868: chown d1/d51/cd4 1325660305 1 2024-04-23T14:50:00.018 INFO:tasks.workunit.client.0.smithi081.stdout:1/998: chown d3/d3d/d41/d5e/d5d/d125/l79 11 1 2024-04-23T14:50:00.018 INFO:tasks.workunit.client.0.smithi081.stdout:9/836: sync 2024-04-23T14:50:00.018 INFO:tasks.workunit.client.0.smithi081.stdout:9/837: read d3/de/d14/d5e/f96 [736433,11254] 0 2024-04-23T14:50:00.018 INFO:tasks.workunit.client.0.smithi081.stdout:9/838: creat d3/de/d25/f110 x:0 0 0 2024-04-23T14:50:00.020 INFO:tasks.workunit.client.0.smithi081.stdout:7/838: dread d3/d11/f1b [0,4194304] 0 2024-04-23T14:50:00.023 INFO:tasks.workunit.client.0.smithi081.stdout:4/850: dwrite d1/d1d/d39/f3b [0,4194304] 0 2024-04-23T14:50:00.028 INFO:tasks.workunit.client.0.smithi081.stdout:3/818: mknod d4/d7/d7f/d85/d9d/dac/dc7/c10d 0 2024-04-23T14:50:00.028 INFO:tasks.workunit.client.0.smithi081.stdout:3/819: chown d4/d7/df/d30/d64/d83 25369149 1 2024-04-23T14:50:00.028 INFO:tasks.workunit.client.0.smithi081.stdout:3/820: fdatasync d4/f6 0 2024-04-23T14:50:00.028 INFO:tasks.workunit.client.0.smithi081.stdout:1/999: mkdir d3/d3d/d41/d5e/d5d/d125/d2e/d14d 0 2024-04-23T14:50:00.029 INFO:tasks.workunit.client.0.smithi081.stdout:2/889: dwrite d1/d11/d21/d52/d8b/d8f/fc3 [0,4194304] 0 2024-04-23T14:50:00.033 INFO:tasks.workunit.client.1.smithi156.stdout:9/497: dwrite d1/d2/d3e/d50/f99 [0,4194304] 0 2024-04-23T14:50:00.034 INFO:tasks.workunit.client.0.smithi081.stdout:9/839: creat d3/de/d1d/dd9/f111 x:0 0 0 2024-04-23T14:50:00.036 INFO:tasks.workunit.client.1.smithi156.stdout:6/649: mkdir d3/d16/d5c/ded 0 2024-04-23T14:50:00.036 INFO:tasks.workunit.client.1.smithi156.stdout:6/650: fsync d3/da/d74/d93/fd3 0 2024-04-23T14:50:00.036 INFO:tasks.workunit.client.1.smithi156.stdout:6/651: truncate d3/d16/d46/d9d/fbe 152444 0 2024-04-23T14:50:00.036 INFO:tasks.workunit.client.1.smithi156.stdout:1/641: dwrite db/d1f/d2d/f6e [0,4194304] 0 2024-04-23T14:50:00.037 INFO:tasks.workunit.client.1.smithi156.stdout:1/642: fdatasync db/d15/fc2 0 2024-04-23T14:50:00.037 INFO:tasks.workunit.client.1.smithi156.stdout:1/643: dread - db/d1f/d2d/d93/fba zero size 2024-04-23T14:50:00.037 INFO:tasks.workunit.client.0.smithi081.stdout:6/869: getdents d1/d51/d65/d13/d16/dd0/df7/da1/dc1/dc9/ddb 0 2024-04-23T14:50:00.037 INFO:tasks.workunit.client.0.smithi081.stdout:6/870: creat d1/d51/d65/d8/db1/f12c x:0 0 0 2024-04-23T14:50:00.038 INFO:tasks.workunit.client.1.smithi156.stdout:0/568: creat d0/d16/da4/fbe x:0 0 0 2024-04-23T14:50:00.040 INFO:tasks.workunit.client.1.smithi156.stdout:4/511: symlink d0/df/d55/d68/d53/d91/la9 0 2024-04-23T14:50:00.044 INFO:tasks.workunit.client.1.smithi156.stdout:8/579: symlink d5/d9/d5a/d5c/d6b/lca 0 2024-04-23T14:50:00.044 INFO:tasks.workunit.client.1.smithi156.stdout:8/580: chown d5/d9/d36/db5/d98/fc3 29 1 2024-04-23T14:50:00.046 INFO:tasks.workunit.client.0.smithi081.stdout:3/821: dread d4/d7/d32/da6/dc4/d5a/f7c [0,4194304] 0 2024-04-23T14:50:00.048 INFO:tasks.workunit.client.0.smithi081.stdout:4/851: truncate d1/d4/f38 127341 0 2024-04-23T14:50:00.055 INFO:tasks.workunit.client.1.smithi156.stdout:5/618: sync 2024-04-23T14:50:00.055 INFO:tasks.workunit.client.1.smithi156.stdout:7/605: sync 2024-04-23T14:50:00.055 INFO:tasks.workunit.client.1.smithi156.stdout:3/519: sync 2024-04-23T14:50:00.055 INFO:tasks.workunit.client.1.smithi156.stdout:3/520: truncate d4/db/dd/d1d/d61/d8d/d91/f92 1940542 0 2024-04-23T14:50:00.055 INFO:tasks.workunit.client.1.smithi156.stdout:6/652: link d3/da/d1d/d59/lc6 d3/d16/d46/d2b/lee 0 2024-04-23T14:50:00.057 INFO:tasks.workunit.client.1.smithi156.stdout:2/570: dwrite d4/d21/d2f/f49 [0,4194304] 0 2024-04-23T14:50:00.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.058+0000 7ffa93c00700 1 -- 172.21.15.81:0/962745940 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa8c073170 msgr2=0x7ffa8c073b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:00.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.058+0000 7ffa93c00700 1 --2- 172.21.15.81:0/962745940 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa8c073170 0x7ffa8c073b80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffa78004880 tx=0x7ffa78009e30 comp rx=0 tx=0).stop 2024-04-23T14:50:00.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.059+0000 7ffa93c00700 1 -- 172.21.15.81:0/962745940 shutdown_connections 2024-04-23T14:50:00.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.059+0000 7ffa93c00700 1 --2- 172.21.15.81:0/962745940 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa8c073170 0x7ffa8c073b80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:00.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.059+0000 7ffa93c00700 1 --2- 172.21.15.81:0/962745940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa8c072820 0x7ffa8c072c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:00.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.059+0000 7ffa93c00700 1 -- 172.21.15.81:0/962745940 >> 172.21.15.81:0/962745940 conn(0x7ffa8c0fa950 msgr2=0x7ffa8c0fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:00.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.062+0000 7ffa93c00700 1 -- 172.21.15.81:0/962745940 shutdown_connections 2024-04-23T14:50:00.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.062+0000 7ffa93c00700 1 -- 172.21.15.81:0/962745940 wait complete. 2024-04-23T14:50:00.063 INFO:tasks.workunit.client.1.smithi156.stdout:4/512: mknod d0/df/d75/caa 0 2024-04-23T14:50:00.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.063+0000 7ffa93c00700 1 Processor -- start 2024-04-23T14:50:00.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.063+0000 7ffa93c00700 1 -- start start 2024-04-23T14:50:00.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.064+0000 7ffa93c00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa8c072820 0x7ffa8c114020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:00.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.064+0000 7ffa93c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa8c114560 0x7ffa8c1153b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:00.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.064+0000 7ffa93c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c114a20 con 0x7ffa8c114560 2024-04-23T14:50:00.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.064+0000 7ffa93c00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c114b60 con 0x7ffa8c072820 2024-04-23T14:50:00.066 INFO:tasks.workunit.client.0.smithi081.stdout:7/839: write d3/f10 [411647,23664] 0 2024-04-23T14:50:00.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.065+0000 7ffa91200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa8c072820 0x7ffa8c114020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:00.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.065+0000 7ffa91200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa8c072820 0x7ffa8c114020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.81:33176/0 (socket says 172.21.15.81:33176) 2024-04-23T14:50:00.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.065+0000 7ffa91200700 1 -- 172.21.15.81:0/3451404846 learned_addr learned my addr 172.21.15.81:0/3451404846 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:50:00.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.067+0000 7ffa8be00700 1 --2- 172.21.15.81:0/3451404846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa8c114560 0x7ffa8c1153b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:00.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.068+0000 7ffa8be00700 1 -- 172.21.15.81:0/3451404846 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa8c072820 msgr2=0x7ffa8c114020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:00.069 INFO:tasks.workunit.client.0.smithi081.stdout:4/852: write d1/d4/d6f/d70/daf/f82 [2662486,97333] 0 2024-04-23T14:50:00.070 INFO:tasks.workunit.client.0.smithi081.stdout:4/853: fdatasync d1/d8b/f106 0 2024-04-23T14:50:00.070 INFO:tasks.workunit.client.1.smithi156.stdout:8/581: mknod d5/d39/ccb 0 2024-04-23T14:50:00.070 INFO:tasks.workunit.client.1.smithi156.stdout:8/582: dread - d5/d39/d99/fc2 zero size 2024-04-23T14:50:00.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.068+0000 7ffa8be00700 1 --2- 172.21.15.81:0/3451404846 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa8c072820 0x7ffa8c114020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:00.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.068+0000 7ffa8be00700 1 -- 172.21.15.81:0/3451404846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa78005040 con 0x7ffa8c114560 2024-04-23T14:50:00.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.068+0000 7ffa8be00700 1 --2- 172.21.15.81:0/3451404846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa8c114560 0x7ffa8c1153b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ffa78000c00 tx=0x7ffa78009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:00.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.069+0000 7ffa88c00700 1 -- 172.21.15.81:0/3451404846 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa7800e040 con 0x7ffa8c114560 2024-04-23T14:50:00.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.069+0000 7ffa88c00700 1 -- 172.21.15.81:0/3451404846 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffa78014c30 con 0x7ffa8c114560 2024-04-23T14:50:00.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.069+0000 7ffa88c00700 1 -- 172.21.15.81:0/3451404846 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa78012600 con 0x7ffa8c114560 2024-04-23T14:50:00.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.069+0000 7ffa93c00700 1 -- 172.21.15.81:0/3451404846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa8c1159b0 con 0x7ffa8c114560 2024-04-23T14:50:00.072 INFO:tasks.workunit.client.0.smithi081.stdout:6/871: symlink d1/d51/d65/d13/d16/de7/l12d 0 2024-04-23T14:50:00.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.069+0000 7ffa93c00700 1 -- 172.21.15.81:0/3451404846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa8c115f40 con 0x7ffa8c114560 2024-04-23T14:50:00.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.072+0000 7ffa93c00700 1 -- 172.21.15.81:0/3451404846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa8c05f5f0 con 0x7ffa8c114560 2024-04-23T14:50:00.072 INFO:tasks.workunit.client.1.smithi156.stdout:7/606: mkdir dc/d2c/dbe 0 2024-04-23T14:50:00.073 INFO:tasks.workunit.client.1.smithi156.stdout:9/498: symlink d1/d2/d3e/d55/d6f/laa 0 2024-04-23T14:50:00.073 INFO:tasks.workunit.client.0.smithi081.stdout:3/822: symlink d4/d7/d32/db0/l10e 0 2024-04-23T14:50:00.074 INFO:tasks.workunit.client.0.smithi081.stdout:7/840: dread d3/d21/d31/d63/f6c [0,4194304] 0 2024-04-23T14:50:00.074 INFO:tasks.workunit.client.0.smithi081.stdout:7/841: fsync d3/d11/d2c/d75/f3c 0 2024-04-23T14:50:00.075 INFO:tasks.workunit.client.0.smithi081.stdout:7/842: truncate d3/d11/d2c/d75/d8e/f12b 908657 0 2024-04-23T14:50:00.075 INFO:tasks.workunit.client.0.smithi081.stdout:7/843: write d3/d21/d31/d33/d52/fd4 [734153,78047] 0 2024-04-23T14:50:00.075 INFO:tasks.workunit.client.0.smithi081.stdout:7/844: write d3/d21/d41/d7c/ff6 [109323,42158] 0 2024-04-23T14:50:00.075 INFO:tasks.workunit.client.0.smithi081.stdout:7/845: creat d3/d21/d31/d50/da2/f12e x:0 0 0 2024-04-23T14:50:00.075 INFO:tasks.workunit.client.1.smithi156.stdout:6/653: truncate d3/da/f38 438823 0 2024-04-23T14:50:00.075 INFO:tasks.workunit.client.1.smithi156.stdout:6/654: dread - d3/d16/d46/d2b/d3b/d9e/fda zero size 2024-04-23T14:50:00.076 INFO:tasks.workunit.client.1.smithi156.stdout:6/655: creat d3/da/d74/fef x:0 0 0 2024-04-23T14:50:00.076 INFO:tasks.workunit.client.1.smithi156.stdout:2/571: mknod d4/d21/d2f/ccd 0 2024-04-23T14:50:00.076 INFO:tasks.workunit.client.1.smithi156.stdout:2/572: creat d4/d13/d19/d58/fce x:0 0 0 2024-04-23T14:50:00.077 INFO:tasks.workunit.client.1.smithi156.stdout:2/573: creat d4/d21/d42/d75/d8e/fcf x:0 0 0 2024-04-23T14:50:00.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.079+0000 7ffa88c00700 1 -- 172.21.15.81:0/3451404846 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7ffa7801c3f0 con 0x7ffa8c114560 2024-04-23T14:50:00.082 INFO:tasks.workunit.client.1.smithi156.stdout:3/521: dread d4/db/dd/d1d/d1e/d13/f79 [0,4194304] 0 2024-04-23T14:50:00.082 INFO:tasks.workunit.client.1.smithi156.stdout:3/522: chown d4/db/dd/d1d/d1e/d42/f52 48935 1 2024-04-23T14:50:00.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.082+0000 7ffa88c00700 1 --2- 172.21.15.81:0/3451404846 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7ffa7406be80 0x7ffa7406e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:00.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.082+0000 7ffa88c00700 1 -- 172.21.15.81:0/3451404846 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7ffa7808bcc0 con 0x7ffa8c114560 2024-04-23T14:50:00.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.082+0000 7ffa91200700 1 --2- 172.21.15.81:0/3451404846 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7ffa7406be80 0x7ffa7406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:00.084 INFO:tasks.workunit.client.1.smithi156.stdout:0/569: rename d0/d4/d11 to d0/d16/dbf 0 2024-04-23T14:50:00.084 INFO:tasks.workunit.client.1.smithi156.stdout:6/656: creat d3/d16/d46/d9d/d9f/ff0 x:0 0 0 2024-04-23T14:50:00.084 INFO:tasks.workunit.client.1.smithi156.stdout:0/570: write d0/f7c [1274499,55596] 0 2024-04-23T14:50:00.084 INFO:tasks.workunit.client.0.smithi081.stdout:4/854: mknod d1/d4f/dc3/c111 0 2024-04-23T14:50:00.085 INFO:tasks.workunit.client.1.smithi156.stdout:0/571: chown d0/d16/d3a/d1e/d80/faf 1481318 1 2024-04-23T14:50:00.086 INFO:tasks.workunit.client.1.smithi156.stdout:4/513: read d0/d76/d63/f72 [127566,98496] 0 2024-04-23T14:50:00.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.085+0000 7ffa91200700 1 --2- 172.21.15.81:0/3451404846 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7ffa7406be80 0x7ffa7406e330 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ffa800101c0 tx=0x7ffa8000b040 comp rx=0 tx=0).ready entity=mgr.24373 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:00.089 INFO:tasks.workunit.client.0.smithi081.stdout:7/846: dread d3/d21/d41/d7c/dc3/fac [0,4194304] 0 2024-04-23T14:50:00.089 INFO:tasks.workunit.client.0.smithi081.stdout:9/840: dread d3/d67/da5/f10d [0,4194304] 0 2024-04-23T14:50:00.089 INFO:tasks.workunit.client.0.smithi081.stdout:6/872: creat d1/d51/da6/f12e x:0 0 0 2024-04-23T14:50:00.095 INFO:tasks.workunit.client.1.smithi156.stdout:2/574: mkdir d4/d21/d42/d75/d79/dd0 0 2024-04-23T14:50:00.095 INFO:tasks.workunit.client.1.smithi156.stdout:2/575: write d4/d13/d19/d58/fa7 [68318,121120] 0 2024-04-23T14:50:00.095 INFO:tasks.workunit.client.1.smithi156.stdout:2/576: stat d4/d21/d2f/fc8 0 2024-04-23T14:50:00.095 INFO:tasks.workunit.client.1.smithi156.stdout:2/577: creat d4/d13/d19/d97/fd1 x:0 0 0 2024-04-23T14:50:00.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.095+0000 7ffa88c00700 1 -- 172.21.15.81:0/3451404846 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7ffa78058db0 con 0x7ffa8c114560 2024-04-23T14:50:00.097 INFO:tasks.workunit.client.0.smithi081.stdout:3/823: creat d4/d7/d32/db0/f10f x:0 0 0 2024-04-23T14:50:00.103 INFO:tasks.workunit.client.1.smithi156.stdout:3/523: link d4/db/dd/d1d/d1e/d13/l63 d4/db/dd/d1d/d61/d8d/d8a/la4 0 2024-04-23T14:50:00.103 INFO:tasks.workunit.client.1.smithi156.stdout:3/524: chown d4/db/dd/d1d/d1e/d74/d90/l56 186099544 1 2024-04-23T14:50:00.104 INFO:tasks.workunit.client.1.smithi156.stdout:5/619: rename d1/d3/fa to d1/d3/d43/fc7 0 2024-04-23T14:50:00.106 INFO:tasks.workunit.client.0.smithi081.stdout:2/890: rmdir d1/d11/d21/d52/d8b/d8f/ddf 0 2024-04-23T14:50:00.106 INFO:tasks.workunit.client.0.smithi081.stdout:2/891: fdatasync d1/d11/f26 0 2024-04-23T14:50:00.106 INFO:tasks.workunit.client.0.smithi081.stdout:6/873: symlink d1/d51/d65/d13/d16/dd0/df7/da1/dc1/dc9/ddb/l12f 0 2024-04-23T14:50:00.106 INFO:tasks.workunit.client.0.smithi081.stdout:6/874: readlink d1/d2/d8e/d98/lb0 0 2024-04-23T14:50:00.107 INFO:tasks.workunit.client.1.smithi156.stdout:6/657: link d3/da/d74/fcb d3/d16/d46/d2b/d6e/ff1 0 2024-04-23T14:50:00.107 INFO:tasks.workunit.client.1.smithi156.stdout:6/658: readlink d3/d16/d46/d2b/d6e/ldc 0 2024-04-23T14:50:00.108 INFO:tasks.workunit.client.0.smithi081.stdout:3/824: rename d4/dc/d50/l2f to d4/d7/d32/da6/dc4/d47/l110 0 2024-04-23T14:50:00.111 INFO:tasks.workunit.client.1.smithi156.stdout:0/572: mkdir d0/d16/d43/d9c/dc0 0 2024-04-23T14:50:00.111 INFO:tasks.workunit.client.0.smithi081.stdout:2/892: link d1/cae d1/d33/d45/df1/c132 0 2024-04-23T14:50:00.114 INFO:tasks.workunit.client.0.smithi081.stdout:6/875: mknod d1/d51/d65/d8/db1/c130 0 2024-04-23T14:50:00.115 INFO:tasks.workunit.client.1.smithi156.stdout:2/578: creat d4/d13/fd2 x:0 0 0 2024-04-23T14:50:00.120 INFO:tasks.workunit.client.0.smithi081.stdout:3/825: creat d4/d7/d32/da6/dc4/df7/f111 x:0 0 0 2024-04-23T14:50:00.121 INFO:tasks.workunit.client.1.smithi156.stdout:4/514: dread d0/df/d55/f73 [0,4194304] 0 2024-04-23T14:50:00.126 INFO:tasks.workunit.client.1.smithi156.stdout:5/620: unlink d1/d3/d24/f98 0 2024-04-23T14:50:00.126 INFO:tasks.workunit.client.1.smithi156.stdout:7/607: dread dc/d1d/d24/f28 [0,4194304] 0 2024-04-23T14:50:00.127 INFO:tasks.workunit.client.1.smithi156.stdout:9/499: dwrite d1/d2/d3e/d55/d9c/d39/f42 [0,4194304] 0 2024-04-23T14:50:00.131 INFO:tasks.workunit.client.0.smithi081.stdout:2/893: link d1/d11/d21/d52/d8b/d8f/de1/lea d1/d11/l133 0 2024-04-23T14:50:00.131 INFO:tasks.workunit.client.0.smithi081.stdout:2/894: creat d1/d33/da3/df5/f134 x:0 0 0 2024-04-23T14:50:00.131 INFO:tasks.workunit.client.0.smithi081.stdout:2/895: stat d1/d11/d21/d52/d8b/d8f/dee/c12b 0 2024-04-23T14:50:00.131 INFO:tasks.workunit.client.0.smithi081.stdout:2/896: chown d1/d1e/dad/f110 1503017 1 2024-04-23T14:50:00.131 INFO:tasks.workunit.client.0.smithi081.stdout:4/855: dread d1/d4/f76 [0,4194304] 0 2024-04-23T14:50:00.131 INFO:tasks.workunit.client.0.smithi081.stdout:4/856: truncate d1/d4/d6f/d70/daf/f2a 1676971 0 2024-04-23T14:50:00.131 INFO:tasks.workunit.client.0.smithi081.stdout:6/876: getdents d1/d2 0 2024-04-23T14:50:00.132 INFO:tasks.workunit.client.0.smithi081.stdout:6/877: fdatasync d1/d2/f99 0 2024-04-23T14:50:00.135 INFO:tasks.workunit.client.0.smithi081.stdout:3/826: mkdir d4/d7/df/d30/d112 0 2024-04-23T14:50:00.138 INFO:tasks.workunit.client.1.smithi156.stdout:6/659: creat d3/da/d1d/d59/d72/dcc/ff2 x:0 0 0 2024-04-23T14:50:00.138 INFO:tasks.workunit.client.1.smithi156.stdout:6/660: read d3/da/f1a [1054905,106516] 0 2024-04-23T14:50:00.139 INFO:tasks.workunit.client.1.smithi156.stdout:9/500: mkdir d1/d2/d23/dab 0 2024-04-23T14:50:00.139 INFO:tasks.workunit.client.1.smithi156.stdout:5/621: unlink d1/d11/d27/fa1 0 2024-04-23T14:50:00.139 INFO:tasks.workunit.client.1.smithi156.stdout:5/622: truncate d1/d11/d27/f95 1236462 0 2024-04-23T14:50:00.140 INFO:tasks.workunit.client.1.smithi156.stdout:5/623: truncate d1/d17/f9e 17517 0 2024-04-23T14:50:00.143 INFO:tasks.workunit.client.0.smithi081.stdout:2/897: dread d1/d33/da3/fe5 [0,4194304] 0 2024-04-23T14:50:00.145 INFO:tasks.workunit.client.0.smithi081.stdout:6/878: creat d1/d51/d65/d13/d16/dd0/df7/da1/dc1/dc9/dcf/d101/f131 x:0 0 0 2024-04-23T14:50:00.148 INFO:tasks.workunit.client.0.smithi081.stdout:7/847: dwrite d3/d21/d31/fc6 [4194304,4194304] 0 2024-04-23T14:50:00.150 INFO:tasks.workunit.client.0.smithi081.stdout:4/857: dread d1/d4/f76 [0,4194304] 0 2024-04-23T14:50:00.152 INFO:tasks.workunit.client.1.smithi156.stdout:8/583: dwrite d5/d9/f4b [0,4194304] 0 2024-04-23T14:50:00.153 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:59 smithi081 ceph-mon[25540]: from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:50:00.153 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:59 smithi081 ceph-mon[25540]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:50:00.153 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:49:59 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/1420395027' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:50:00.155 INFO:tasks.workunit.client.1.smithi156.stdout:6/661: mkdir d3/da/d1d/d59/df3 0 2024-04-23T14:50:00.155 INFO:tasks.workunit.client.1.smithi156.stdout:5/624: rename d1/f56 to d1/d17/d7e/fc8 0 2024-04-23T14:50:00.155 INFO:tasks.workunit.client.1.smithi156.stdout:5/625: chown d1/d3/d64/f65 7 1 2024-04-23T14:50:00.156 INFO:tasks.workunit.client.0.smithi081.stdout:2/898: truncate d1/d11/dab/fa0 2870554 0 2024-04-23T14:50:00.156 INFO:tasks.workunit.client.0.smithi081.stdout:2/899: readlink d1/d33/d9f/lfd 0 2024-04-23T14:50:00.157 INFO:tasks.workunit.client.0.smithi081.stdout:6/879: mkdir d1/d51/d65/d78/d132 0 2024-04-23T14:50:00.159 INFO:tasks.workunit.client.0.smithi081.stdout:3/827: dread d4/d7/d32/f88 [0,4194304] 0 2024-04-23T14:50:00.166 INFO:tasks.workunit.client.0.smithi081.stdout:4/858: creat d1/d4/d6f/d70/daf/d8c/dce/f112 x:0 0 0 2024-04-23T14:50:00.166 INFO:tasks.workunit.client.1.smithi156.stdout:0/573: fdatasync d0/f7c 0 2024-04-23T14:50:00.167 INFO:tasks.workunit.client.1.smithi156.stdout:0/574: chown d0/d4/c5a 386807361 1 2024-04-23T14:50:00.167 INFO:tasks.workunit.client.1.smithi156.stdout:0/575: stat d0/d16/d3a/d1e/f3d 0 2024-04-23T14:50:00.167 INFO:tasks.workunit.client.1.smithi156.stdout:0/576: chown d0/d4/d22/d58/d9a/d44/c74 36649 1 2024-04-23T14:50:00.167 INFO:tasks.workunit.client.1.smithi156.stdout:0/577: truncate d0/d4/fad 831003 0 2024-04-23T14:50:00.167 INFO:tasks.workunit.client.1.smithi156.stdout:0/578: readlink d0/d16/dbf/d3f/d45/l49 0 2024-04-23T14:50:00.167 INFO:tasks.workunit.client.1.smithi156.stdout:1/644: dwrite db/d1f/d2d/d93/fa0 [0,4194304] 0 2024-04-23T14:50:00.168 INFO:tasks.workunit.client.0.smithi081.stdout:7/848: dread d3/d20/dc9/f99 [0,4194304] 0 2024-04-23T14:50:00.169 INFO:tasks.workunit.client.1.smithi156.stdout:7/608: dread dc/d1d/d24/d5a/f6f [0,4194304] 0 2024-04-23T14:50:00.169 INFO:tasks.workunit.client.0.smithi081.stdout:9/841: dwrite d3/de/d47/fd1 [0,4194304] 0 2024-04-23T14:50:00.169 INFO:tasks.workunit.client.0.smithi081.stdout:4/859: write d1/d1d/d39/d8d/f90 [3736289,19144] 0 2024-04-23T14:50:00.170 INFO:tasks.workunit.client.0.smithi081.stdout:6/880: mkdir d1/d51/d65/d13/d16/dd0/df7/da1/dc1/dc9/dcf/d133 0 2024-04-23T14:50:00.170 INFO:tasks.workunit.client.0.smithi081.stdout:6/881: fdatasync d1/d51/d65/d8/d2e/f5b 0 2024-04-23T14:50:00.171 INFO:tasks.workunit.client.0.smithi081.stdout:6/882: write d1/d51/d65/d13/d16/dd0/df7/da1/dc1/dc9/dcf/d101/f131 [898164,93890] 0 2024-04-23T14:50:00.172 INFO:tasks.workunit.client.0.smithi081.stdout:6/883: truncate d1/d2/d8e/d98/fb4 27959 0 2024-04-23T14:50:00.176 INFO:tasks.workunit.client.1.smithi156.stdout:6/662: symlink d3/d16/d46/d64/d77/dd6/lf4 0 2024-04-23T14:50:00.176 INFO:tasks.workunit.client.1.smithi156.stdout:6/663: read - d3/d16/d5c/d6a/fc9 zero size 2024-04-23T14:50:00.176 INFO:tasks.workunit.client.0.smithi081.stdout:3/828: mknod d4/d41/d10a/c113 0 2024-04-23T14:50:00.176 INFO:tasks.workunit.client.0.smithi081.stdout:3/829: write d4/d7/d1a/d71/f76 [980847,22661] 0 2024-04-23T14:50:00.178 INFO:tasks.workunit.client.1.smithi156.stdout:5/626: dread d1/d3/d64/f88 [0,4194304] 0 2024-04-23T14:50:00.180 INFO:tasks.workunit.client.1.smithi156.stdout:9/501: dread d1/d2/d23/d49/d4c/f3b [0,4194304] 0 2024-04-23T14:50:00.195 INFO:tasks.workunit.client.1.smithi156.stdout:1/645: dread db/d1f/d2f/f55 [0,4194304] 0 2024-04-23T14:50:00.203 INFO:tasks.workunit.client.1.smithi156.stdout:4/515: dwrite d0/d8/d1e/d4a/f7b [0,4194304] 0 2024-04-23T14:50:00.203 INFO:tasks.workunit.client.1.smithi156.stdout:4/516: fsync d0/df/d55/f62 0 2024-04-23T14:50:00.203 INFO:tasks.workunit.client.1.smithi156.stdout:0/579: creat d0/d16/d3a/d2a/d1d/d2d/d6b/fc1 x:0 0 0 2024-04-23T14:50:00.208 INFO:tasks.workunit.client.0.smithi081.stdout:7/849: mknod d3/d11/d2c/d75/d8e/dc2/c12f 0 2024-04-23T14:50:00.212 INFO:tasks.workunit.client.1.smithi156.stdout:8/584: link d5/d9/d36/d60/d7c/fb9 d5/d9/d10/d1d/d21/fcc 0 2024-04-23T14:50:00.217 INFO:tasks.workunit.client.0.smithi081.stdout:9/842: mknod d3/de/d1d/dd9/c112 0 2024-04-23T14:50:00.217 INFO:tasks.workunit.client.0.smithi081.stdout:9/843: fdatasync d3/d1a/f63 0 2024-04-23T14:50:00.220 INFO:tasks.workunit.client.1.smithi156.stdout:6/664: rename d3/d16/d1e/fb9 to d3/d16/d46/d9d/ff5 0 2024-04-23T14:50:00.220 INFO:tasks.workunit.client.1.smithi156.stdout:6/665: readlink d3/d16/d1e/l66 0 2024-04-23T14:50:00.220 INFO:tasks.workunit.client.1.smithi156.stdout:6/666: chown d3/d16/d46/d9d/d9f/dad/le1 0 1 2024-04-23T14:50:00.220 INFO:tasks.workunit.client.1.smithi156.stdout:6/667: write d3/d16/d46/d9d/ff5 [1001835,123420] 0 2024-04-23T14:50:00.223 INFO:tasks.workunit.client.0.smithi081.stdout:5/956: sync 2024-04-23T14:50:00.224 INFO:tasks.workunit.client.0.smithi081.stdout:4/860: dwrite d1/ffb [0,4194304] 0 2024-04-23T14:50:00.232 INFO:tasks.workunit.client.0.smithi081.stdout:2/900: dwrite d1/d33/d9f/fe6 [0,4194304] 0 2024-04-23T14:50:00.237 INFO:tasks.workunit.client.1.smithi156.stdout:7/609: dwrite dc/d1d/d41/f47 [0,4194304] 0 2024-04-23T14:50:00.237 INFO:tasks.workunit.client.1.smithi156.stdout:3/525: dwrite d4/db/dd/d1d/f2e [0,4194304] 0 2024-04-23T14:50:00.242 INFO:tasks.workunit.client.1.smithi156.stdout:0/580: dwrite d0/d16/d3a/d2a/fb9 [0,4194304] 0 2024-04-23T14:50:00.248 INFO:tasks.workunit.client.1.smithi156.stdout:0/581: dread d0/d4/d22/d58/f69 [0,4194304] 0 2024-04-23T14:50:00.251 INFO:tasks.workunit.client.0.smithi081.stdout:4/861: dread d1/d1d/d59/fc4 [0,4194304] 0 2024-04-23T14:50:00.252 INFO:tasks.workunit.client.0.smithi081.stdout:2/901: dread d1/d33/f40 [0,4194304] 0 2024-04-23T14:50:00.252 INFO:tasks.workunit.client.0.smithi081.stdout:2/902: fsync d1/d11/d21/d34/f76 0 2024-04-23T14:50:00.274 INFO:tasks.workunit.client.1.smithi156.stdout:3/526: dwrite d4/db/dd/d1d/d1e/d42/f52 [0,4194304] 0 2024-04-23T14:50:00.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:59 smithi156 ceph-mon[32341]: from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:50:00.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:59 smithi156 ceph-mon[32341]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:50:00.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:49:59 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/1420395027' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:50:00.311 INFO:tasks.workunit.client.0.smithi081.stdout:6/884: symlink d1/d2/d8e/l134 0 2024-04-23T14:50:00.318 INFO:tasks.workunit.client.0.smithi081.stdout:3/830: getdents d4/d7/d7f/d85/d9d/dac/dc7/dd3 0 2024-04-23T14:50:00.318 INFO:tasks.workunit.client.1.smithi156.stdout:5/627: creat d1/d3/d64/fc9 x:0 0 0 2024-04-23T14:50:00.318 INFO:tasks.workunit.client.1.smithi156.stdout:5/628: read d1/d3/f49 [298129,79578] 0 2024-04-23T14:50:00.319 INFO:tasks.workunit.client.1.smithi156.stdout:5/629: write d1/d17/f9e [8061,46835] 0 2024-04-23T14:50:00.323 INFO:tasks.workunit.client.0.smithi081.stdout:7/850: symlink d3/d21/d41/da3/l130 0 2024-04-23T14:50:00.328 INFO:tasks.workunit.client.0.smithi081.stdout:3/831: dread d4/d7/d2e/fae [0,4194304] 0 2024-04-23T14:50:00.341 INFO:tasks.workunit.client.1.smithi156.stdout:4/517: symlink d0/d8/d1e/d4a/lab 0 2024-04-23T14:50:00.342 INFO:tasks.workunit.client.1.smithi156.stdout:4/518: fsync d0/d30/f3f 0 2024-04-23T14:50:00.344 INFO:tasks.workunit.client.1.smithi156.stdout:8/585: creat d5/d9/d5a/d5c/d6b/fcd x:0 0 0 2024-04-23T14:50:00.349 INFO:tasks.workunit.client.0.smithi081.stdout:3/832: dread d4/d7/df/f1b [0,4194304] 0 2024-04-23T14:50:00.351 INFO:tasks.workunit.client.1.smithi156.stdout:9/502: rename d1/d2/d23/d75/f7b to d1/d2/d3e/d50/d7a/dc/fac 0 2024-04-23T14:50:00.357 INFO:tasks.workunit.client.0.smithi081.stdout:7/851: dread d3/d20/f3f [0,4194304] 0 2024-04-23T14:50:00.358 INFO:tasks.workunit.client.1.smithi156.stdout:8/586: dread d5/d9/d10/fa2 [0,4194304] 0 2024-04-23T14:50:00.368 INFO:tasks.workunit.client.0.smithi081.stdout:2/903: unlink d1/d11/df7/lf8 0 2024-04-23T14:50:00.374 INFO:tasks.workunit.client.1.smithi156.stdout:7/610: mknod dc/d93/d6c/d88/cbf 0 2024-04-23T14:50:00.443 INFO:tasks.workunit.client.1.smithi156.stdout:9/503: dwrite d1/d2/d3e/d50/d7a/d17/d1f/f37 [0,4194304] 0 2024-04-23T14:50:00.443 INFO:tasks.workunit.client.1.smithi156.stdout:9/504: write d1/f1e [1016557,17092] 0 2024-04-23T14:50:00.444 INFO:tasks.workunit.client.1.smithi156.stdout:7/611: dwrite dc/d1d/f77 [0,4194304] 0 2024-04-23T14:50:00.444 INFO:tasks.workunit.client.1.smithi156.stdout:7/612: read - dc/d9d/fa2 zero size 2024-04-23T14:50:00.445 INFO:tasks.workunit.client.1.smithi156.stdout:3/527: link d4/db/dd/d20/l5d d4/db/dd/d73/la5 0 2024-04-23T14:50:00.457 INFO:tasks.workunit.client.1.smithi156.stdout:9/505: dread d1/d2/d23/d49/d4c/f3b [0,4194304] 0 2024-04-23T14:50:00.543 INFO:tasks.workunit.client.0.smithi081.stdout:6/885: mknod d1/d51/d65/d8/da4/c135 0 2024-04-23T14:50:00.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.549+0000 7ffa93c00700 1 -- 172.21.15.81:0/3451404846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ffa8c05f5f0 con 0x7ffa8c114560 2024-04-23T14:50:00.553 INFO:tasks.workunit.client.0.smithi081.stdout:3/833: truncate d4/d7/df/f92 587347 0 2024-04-23T14:50:00.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.554+0000 7ffa88c00700 1 -- 172.21.15.81:0/3451404846 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1837 (secure 0 0 0) 0x7ffa7808b020 con 0x7ffa8c114560 2024-04-23T14:50:00.556 INFO:teuthology.orchestra.run.smithi081.stdout:e18 2024-04-23T14:50:00.556 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-23T14:50:00.556 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:50:00.556 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-04-23T14:50:00.556 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:50:00.556 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-04-23T14:50:00.556 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-04-23T14:50:00.556 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 17 2024-04-23T14:50:00.556 INFO:teuthology.orchestra.run.smithi081.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-23T14:50:00.556 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-04-23T14:45:51.264703+0000 2024-04-23T14:50:00.556 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-04-23T14:46:12.782992+0000 2024-04-23T14:50:00.557 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-04-23T14:50:00.557 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-04-23T14:50:00.557 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-04-23T14:50:00.557 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-04-23T14:50:00.557 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-04-23T14:50:00.557 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-04-23T14:50:00.557 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-04-23T14:50:00.557 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 47 2024-04-23T14:50:00.557 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:50:00.557 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 1 2024-04-23T14:50:00.557 INFO:teuthology.orchestra.run.smithi081.stdout:in 0 2024-04-23T14:50:00.557 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=14472} 2024-04-23T14:50:00.557 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-04-23T14:50:00.557 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-04-23T14:50:00.557 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-04-23T14:50:00.558 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-04-23T14:50:00.558 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-04-23T14:50:00.558 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-04-23T14:50:00.558 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-04-23T14:50:00.558 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-04-23T14:50:00.558 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.vcoywg{0:14472} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.81:6828/2563365650,v1:172.21.15.81:6829/2563365650] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:50:00.558 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.wydgcg{0:14482} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.81:6826/759909104,v1:172.21.15.81:6827/759909104] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:50:00.558 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:50:00.558 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:50:00.558 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-04-23T14:50:00.558 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:50:00.558 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.vynkxn{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.156:6826/1794690362,v1:172.21.15.156:6827/1794690362] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:50:00.558 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.rhbtxt{-1:24263} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.156:6824/3854041261,v1:172.21.15.156:6825/3854041261] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:50:00.559 INFO:tasks.workunit.client.0.smithi081.stdout:6/886: dread d1/d51/d65/d1c/d66/fd1 [0,4194304] 0 2024-04-23T14:50:00.559 INFO:tasks.workunit.client.0.smithi081.stdout:6/887: truncate d1/d51/d65/d1c/f110 1019286 0 2024-04-23T14:50:00.559 INFO:tasks.workunit.client.0.smithi081.stdout:7/852: creat d3/d11/d2c/f131 x:0 0 0 2024-04-23T14:50:00.559 INFO:tasks.workunit.client.0.smithi081.stdout:7/853: write d3/d21/d31/d33/d4b/f57 [5269454,115878] 0 2024-04-23T14:50:00.559 INFO:tasks.workunit.client.0.smithi081.stdout:7/854: dread - d3/d21/f114 zero size 2024-04-23T14:50:00.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.559+0000 7ffa93c00700 1 -- 172.21.15.81:0/3451404846 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7ffa7406be80 msgr2=0x7ffa7406e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:00.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.559+0000 7ffa93c00700 1 --2- 172.21.15.81:0/3451404846 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7ffa7406be80 0x7ffa7406e330 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ffa800101c0 tx=0x7ffa8000b040 comp rx=0 tx=0).stop 2024-04-23T14:50:00.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.559+0000 7ffa93c00700 1 -- 172.21.15.81:0/3451404846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa8c114560 msgr2=0x7ffa8c1153b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:00.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.559+0000 7ffa93c00700 1 --2- 172.21.15.81:0/3451404846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa8c114560 0x7ffa8c1153b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ffa78000c00 tx=0x7ffa78009e30 comp rx=0 tx=0).stop 2024-04-23T14:50:00.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.559+0000 7ffa93c00700 1 -- 172.21.15.81:0/3451404846 shutdown_connections 2024-04-23T14:50:00.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.559+0000 7ffa93c00700 1 --2- 172.21.15.81:0/3451404846 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7ffa7406be80 0x7ffa7406e330 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:00.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.559+0000 7ffa93c00700 1 --2- 172.21.15.81:0/3451404846 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa8c072820 0x7ffa8c114020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:00.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.559+0000 7ffa93c00700 1 --2- 172.21.15.81:0/3451404846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa8c114560 0x7ffa8c1153b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:00.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.559+0000 7ffa93c00700 1 -- 172.21.15.81:0/3451404846 >> 172.21.15.81:0/3451404846 conn(0x7ffa8c0fa950 msgr2=0x7ffa8c0fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:00.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.559+0000 7ffa93c00700 1 -- 172.21.15.81:0/3451404846 shutdown_connections 2024-04-23T14:50:00.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.559+0000 7ffa93c00700 1 -- 172.21.15.81:0/3451404846 wait complete. 2024-04-23T14:50:00.565 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 18 2024-04-23T14:50:00.570 INFO:tasks.workunit.client.0.smithi081.stdout:2/904: mkdir d1/d33/d45/d6e/d97/d135 0 2024-04-23T14:50:00.570 INFO:tasks.workunit.client.0.smithi081.stdout:2/905: truncate d1/d33/d45/d6e/d97/fb2 1356534 0 2024-04-23T14:50:00.573 INFO:tasks.workunit.client.0.smithi081.stdout:5/957: rename d17/d18/d3a/d8e/de6 to d17/d4a/d14d 0 2024-04-23T14:50:00.573 INFO:tasks.workunit.client.0.smithi081.stdout:5/958: fsync d17/d18/f48 0 2024-04-23T14:50:00.576 INFO:tasks.workunit.client.0.smithi081.stdout:3/834: symlink d4/d7/d49/d51/l114 0 2024-04-23T14:50:00.576 INFO:tasks.workunit.client.0.smithi081.stdout:3/835: chown d4/d41/c56 24691 1 2024-04-23T14:50:00.578 INFO:tasks.workunit.client.0.smithi081.stdout:2/906: dread d1/f87 [0,4194304] 0 2024-04-23T14:50:00.583 INFO:tasks.workunit.client.0.smithi081.stdout:6/888: mkdir d1/d51/d65/d8/d2e/d59/d128/d136 0 2024-04-23T14:50:00.584 INFO:tasks.workunit.client.0.smithi081.stdout:7/855: symlink d3/d11/d2c/d75/d8e/dc2/l132 0 2024-04-23T14:50:00.584 INFO:tasks.workunit.client.0.smithi081.stdout:7/856: stat d3/d21/d31/d33/d4b/d4c/cf9 0 2024-04-23T14:50:00.584 INFO:tasks.workunit.client.0.smithi081.stdout:7/857: chown d3/d21/d31/lab 4529051 1 2024-04-23T14:50:00.584 INFO:tasks.workunit.client.0.smithi081.stdout:7/858: readlink d3/d21/d31/d33/d4b/l108 0 2024-04-23T14:50:00.584 INFO:tasks.workunit.client.0.smithi081.stdout:7/859: chown d3/d20 6495 1 2024-04-23T14:50:00.588 INFO:tasks.workunit.client.0.smithi081.stdout:6/889: dread d1/d51/d65/d1c/f110 [0,4194304] 0 2024-04-23T14:50:00.594 INFO:tasks.workunit.client.0.smithi081.stdout:5/959: creat d17/d3c/de7/f14e x:0 0 0 2024-04-23T14:50:00.597 INFO:tasks.workunit.client.0.smithi081.stdout:6/890: dread d1/d51/d65/d8/db1/fdc [0,4194304] 0 2024-04-23T14:50:00.604 INFO:tasks.workunit.client.1.smithi156.stdout:5/630: mknod d1/d3/da6/cca 0 2024-04-23T14:50:00.608 INFO:tasks.workunit.client.0.smithi081.stdout:2/907: mkdir d1/d33/d9f/d136 0 2024-04-23T14:50:00.608 INFO:tasks.workunit.client.0.smithi081.stdout:2/908: write d1/d11/d21/d34/f47 [4437524,103615] 0 2024-04-23T14:50:00.609 INFO:tasks.workunit.client.0.smithi081.stdout:2/909: write d1/d11/d21/d52/d8b/d8f/d93/f11e [238556,127113] 0 2024-04-23T14:50:00.609 INFO:tasks.workunit.client.0.smithi081.stdout:2/910: stat d1/d11/d21/d34/f4b 0 2024-04-23T14:50:00.609 INFO:tasks.workunit.client.0.smithi081.stdout:2/911: write d1/d1e/f9c [4416160,82103] 0 2024-04-23T14:50:00.609 INFO:tasks.workunit.client.0.smithi081.stdout:2/912: chown d1/d11/df7 74 1 2024-04-23T14:50:00.609 INFO:tasks.workunit.client.0.smithi081.stdout:2/913: read d1/f107 [907024,102810] 0 2024-04-23T14:50:00.611 INFO:tasks.workunit.client.1.smithi156.stdout:1/646: getdents db/d25/d30 0 2024-04-23T14:50:00.615 INFO:tasks.workunit.client.0.smithi081.stdout:5/960: creat d17/d18/d3a/d8e/d10a/f14f x:0 0 0 2024-04-23T14:50:00.620 INFO:tasks.workunit.client.0.smithi081.stdout:6/891: unlink d1/d51/d7b/d91/cfc 0 2024-04-23T14:50:00.620 INFO:tasks.workunit.client.0.smithi081.stdout:6/892: fdatasync d1/d51/d65/d8/d2e/d59/ff5 0 2024-04-23T14:50:00.624 INFO:tasks.workunit.client.1.smithi156.stdout:8/587: creat d5/d9/d10/d1d/fce x:0 0 0 2024-04-23T14:50:00.624 INFO:tasks.workunit.client.1.smithi156.stdout:8/588: chown d5/d9/d10/d1d/d21/f77 10741 1 2024-04-23T14:50:00.629 INFO:tasks.workunit.client.0.smithi081.stdout:3/836: rmdir d4/d7/df/d30/d64/d83 39 2024-04-23T14:50:00.629 INFO:tasks.workunit.client.0.smithi081.stdout:3/837: readlink d4/l4d 0 2024-04-23T14:50:00.630 INFO:tasks.workunit.client.0.smithi081.stdout:3/838: fdatasync d4/d7/d32/da6/dc4/f79 0 2024-04-23T14:50:00.630 INFO:tasks.workunit.client.0.smithi081.stdout:3/839: fdatasync d4/f17 0 2024-04-23T14:50:00.636 INFO:tasks.workunit.client.0.smithi081.stdout:5/961: write d17/d4a/fb9 [3453744,51004] 0 2024-04-23T14:50:00.640 INFO:tasks.workunit.client.0.smithi081.stdout:2/914: link d1/d33/f37 d1/d11/d21/d52/d8b/d8f/de8/f137 0 2024-04-23T14:50:00.642 INFO:tasks.workunit.client.0.smithi081.stdout:6/893: creat d1/d51/d65/d78/d132/f137 x:0 0 0 2024-04-23T14:50:00.646 INFO:tasks.workunit.client.1.smithi156.stdout:7/613: creat dc/d93/d6c/d88/fc0 x:0 0 0 2024-04-23T14:50:00.654 INFO:tasks.workunit.client.0.smithi081.stdout:3/840: truncate d4/f5b 3482004 0 2024-04-23T14:50:00.666 INFO:tasks.workunit.client.0.smithi081.stdout:2/915: write d1/d33/d45/df1/f124 [2531440,56381] 0 2024-04-23T14:50:00.703 INFO:tasks.workunit.client.0.smithi081.stdout:6/894: rmdir d1/d51/d65/d1c 39 2024-04-23T14:50:00.703 INFO:tasks.workunit.client.0.smithi081.stdout:6/895: getdents d1/d51/d65/d1c/d6e/d7d 0 2024-04-23T14:50:00.704 INFO:tasks.workunit.client.1.smithi156.stdout:1/647: mknod db/d1f/d2d/d93/cca 0 2024-04-23T14:50:00.706 INFO:tasks.workunit.client.0.smithi081.stdout:6/896: symlink d1/d51/l138 0 2024-04-23T14:50:00.727 INFO:tasks.workunit.client.1.smithi156.stdout:9/506: getdents d1/d2/d3e/d55 0 2024-04-23T14:50:00.727 INFO:tasks.workunit.client.1.smithi156.stdout:9/507: truncate d1/d2/d23/d49/d4c/d96/fa3 413377 0 2024-04-23T14:50:00.730 INFO:tasks.workunit.client.0.smithi081.stdout:6/897: mkdir d1/d2/d49/d52/d139 0 2024-04-23T14:50:00.731 INFO:tasks.workunit.client.0.smithi081.stdout:6/898: creat d1/d51/d65/d78/d132/f13a x:0 0 0 2024-04-23T14:50:00.732 INFO:tasks.workunit.client.0.smithi081.stdout:5/962: dwrite d17/d1f/d42/dbb/f104 [0,4194304] 0 2024-04-23T14:50:00.735 INFO:tasks.workunit.client.1.smithi156.stdout:1/648: dread db/d1f/f7a [0,4194304] 0 2024-04-23T14:50:00.735 INFO:tasks.workunit.client.1.smithi156.stdout:1/649: dread - db/fa5 zero size 2024-04-23T14:50:00.736 INFO:tasks.workunit.client.1.smithi156.stdout:1/650: write db/d25/d30/d38/f6c [1627959,60528] 0 2024-04-23T14:50:00.739 INFO:tasks.workunit.client.1.smithi156.stdout:0/582: rename d0/d4/d22/d58/d9a/d44/d4a to d0/d16/d43/dc2 0 2024-04-23T14:50:00.739 INFO:tasks.workunit.client.1.smithi156.stdout:0/583: fdatasync d0/d4/d22/f34 0 2024-04-23T14:50:00.739 INFO:tasks.workunit.client.1.smithi156.stdout:0/584: fdatasync d0/d16/d3a/d2a/d1d/d2d/f41 0 2024-04-23T14:50:00.748 INFO:tasks.workunit.client.0.smithi081.stdout:4/862: rename d1/d1d/f9a to d1/d4f/d87/f113 0 2024-04-23T14:50:00.756 INFO:tasks.workunit.client.1.smithi156.stdout:8/589: dwrite d5/d9/d10/f34 [0,4194304] 0 2024-04-23T14:50:00.759 INFO:tasks.workunit.client.0.smithi081.stdout:6/899: mkdir d1/d51/d65/d1c/d6e/d7d/d13b 0 2024-04-23T14:50:00.760 INFO:tasks.workunit.client.1.smithi156.stdout:1/651: mknod db/d25/d4e/ccb 0 2024-04-23T14:50:00.760 INFO:tasks.workunit.client.1.smithi156.stdout:9/508: write d1/d2/d3e/d50/d7a/dc/f22 [902416,108412] 0 2024-04-23T14:50:00.760 INFO:tasks.workunit.client.1.smithi156.stdout:9/509: truncate d1/d2/d3e/d50/d7a/dc/f92 463336 0 2024-04-23T14:50:00.763 INFO:tasks.workunit.client.0.smithi081.stdout:2/916: dwrite d1/d11/d21/d52/fdc [0,4194304] 0 2024-04-23T14:50:00.774 INFO:tasks.workunit.client.1.smithi156.stdout:0/585: symlink d0/d16/dbf/d3f/d5f/db2/lc3 0 2024-04-23T14:50:00.774 INFO:tasks.workunit.client.1.smithi156.stdout:0/586: write d0/d16/d43/fbb [523563,24430] 0 2024-04-23T14:50:00.774 INFO:tasks.workunit.client.1.smithi156.stdout:0/587: chown d0/d16/dbf/l27 15136332 1 2024-04-23T14:50:00.774 INFO:tasks.workunit.client.1.smithi156.stdout:0/588: write d0/d16/da4/fbe [217035,121731] 0 2024-04-23T14:50:00.784 INFO:tasks.workunit.client.1.smithi156.stdout:0/589: rmdir d0/d16/dbf/d3f/d5f/db2 39 2024-04-23T14:50:00.784 INFO:tasks.workunit.client.1.smithi156.stdout:0/590: write d0/d4/d22/f96 [1594961,85410] 0 2024-04-23T14:50:00.786 INFO:tasks.workunit.client.0.smithi081.stdout:6/900: creat d1/d51/d65/d8/da4/f13c x:0 0 0 2024-04-23T14:50:00.786 INFO:tasks.workunit.client.0.smithi081.stdout:6/901: truncate d1/d51/d65/d13/d16/dd0/df7/da1/dc1/f11f 872030 0 2024-04-23T14:50:00.787 INFO:tasks.workunit.client.0.smithi081.stdout:6/902: fdatasync d1/d51/d65/d8/d2e/d58/f61 0 2024-04-23T14:50:00.787 INFO:tasks.workunit.client.0.smithi081.stdout:6/903: chown d1/d2/l45 1 1 2024-04-23T14:50:00.789 INFO:tasks.workunit.client.0.smithi081.stdout:3/841: dwrite d4/d41/dc6/ffa [0,4194304] 0 2024-04-23T14:50:00.792 INFO:tasks.workunit.client.0.smithi081.stdout:6/904: symlink d1/d2/d8e/df6/l13d 0 2024-04-23T14:50:00.809 INFO:tasks.workunit.client.0.smithi081.stdout:3/842: symlink d4/d7/d7f/d85/d9d/dac/dc7/dd3/df0/l115 0 2024-04-23T14:50:00.819 INFO:tasks.workunit.client.0.smithi081.stdout:6/905: mkdir d1/d51/d65/d78/d13e 0 2024-04-23T14:50:00.820 INFO:tasks.workunit.client.0.smithi081.stdout:5/963: write d17/d1f/d42/d9b/d13f/d61/f84 [2926202,128298] 0 2024-04-23T14:50:00.820 INFO:tasks.workunit.client.0.smithi081.stdout:6/906: chown d1/d2/d8e/d98/fd7 19910 1 2024-04-23T14:50:00.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.820+0000 7fcdb3e00700 1 -- 172.21.15.81:0/1074207303 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcdac104fc0 msgr2=0x7fcdac1073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:00.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.820+0000 7fcdb3e00700 1 --2- 172.21.15.81:0/1074207303 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcdac104fc0 0x7fcdac1073a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcda0009ce0 tx=0x7fcda0004d10 comp rx=0 tx=0).stop 2024-04-23T14:50:00.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.822+0000 7fcdb3e00700 1 -- 172.21.15.81:0/1074207303 shutdown_connections 2024-04-23T14:50:00.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.822+0000 7fcdb3e00700 1 --2- 172.21.15.81:0/1074207303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdac1078e0 0x7fcdac109cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:00.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.822+0000 7fcdb3e00700 1 --2- 172.21.15.81:0/1074207303 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcdac104fc0 0x7fcdac1073a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:00.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.822+0000 7fcdb3e00700 1 -- 172.21.15.81:0/1074207303 >> 172.21.15.81:0/1074207303 conn(0x7fcdac06a390 msgr2=0x7fcdac06c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:00.825 INFO:tasks.workunit.client.0.smithi081.stdout:5/964: symlink d17/d65/de3/d108/db1/d12c/l150 0 2024-04-23T14:50:00.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.825+0000 7fcdb3e00700 1 -- 172.21.15.81:0/1074207303 shutdown_connections 2024-04-23T14:50:00.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.826+0000 7fcdb3e00700 1 -- 172.21.15.81:0/1074207303 wait complete. 2024-04-23T14:50:00.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.828+0000 7fcdb3e00700 1 Processor -- start 2024-04-23T14:50:00.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.828+0000 7fcdb3e00700 1 -- start start 2024-04-23T14:50:00.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.832+0000 7fcdb3e00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcdac104fc0 0x7fcdac113f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:00.833 INFO:tasks.workunit.client.0.smithi081.stdout:6/907: creat d1/d51/d65/d13/d16/dd0/df7/da1/dc1/dc9/f13f x:0 0 0 2024-04-23T14:50:00.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.832+0000 7fcdb3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdac1078e0 0x7fcdac114470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:00.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.832+0000 7fcdb3e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac114a70 con 0x7fcdac1078e0 2024-04-23T14:50:00.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.832+0000 7fcdb3e00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac114be0 con 0x7fcdac104fc0 2024-04-23T14:50:00.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.834+0000 7fcdb1400700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcdac104fc0 0x7fcdac113f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:00.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.834+0000 7fcdb1400700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcdac104fc0 0x7fcdac113f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.81:33186/0 (socket says 172.21.15.81:33186) 2024-04-23T14:50:00.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.834+0000 7fcdb1400700 1 -- 172.21.15.81:0/1570926095 learned_addr learned my addr 172.21.15.81:0/1570926095 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:50:00.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.834+0000 7fcdb0a00700 1 --2- 172.21.15.81:0/1570926095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdac1078e0 0x7fcdac114470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:00.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.835+0000 7fcdb1400700 1 -- 172.21.15.81:0/1570926095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdac1078e0 msgr2=0x7fcdac114470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:00.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.836+0000 7fcdb1400700 1 --2- 172.21.15.81:0/1570926095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdac1078e0 0x7fcdac114470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:00.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.836+0000 7fcdb1400700 1 -- 172.21.15.81:0/1570926095 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda0009940 con 0x7fcdac104fc0 2024-04-23T14:50:00.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.837+0000 7fcdb0a00700 1 --2- 172.21.15.81:0/1570926095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdac1078e0 0x7fcdac114470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T14:50:00.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.843+0000 7fcdb1400700 1 --2- 172.21.15.81:0/1570926095 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcdac104fc0 0x7fcdac113f30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcda0009f50 tx=0x7fcda0004d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:00.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.845+0000 7fcda9600700 1 -- 172.21.15.81:0/1570926095 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcda000e050 con 0x7fcdac104fc0 2024-04-23T14:50:00.846 INFO:tasks.workunit.client.1.smithi156.stdout:9/510: dread d1/d2/d3e/d50/d7a/d17/d1f/d48/f4f [0,4194304] 0 2024-04-23T14:50:00.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.845+0000 7fcdb3e00700 1 -- 172.21.15.81:0/1570926095 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdac1195e0 con 0x7fcdac104fc0 2024-04-23T14:50:00.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.845+0000 7fcdb3e00700 1 -- 172.21.15.81:0/1570926095 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdac119b20 con 0x7fcdac104fc0 2024-04-23T14:50:00.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.845+0000 7fcda9600700 1 -- 172.21.15.81:0/1570926095 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcda001d910 con 0x7fcdac104fc0 2024-04-23T14:50:00.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.846+0000 7fcda9600700 1 -- 172.21.15.81:0/1570926095 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcda000e050 con 0x7fcdac104fc0 2024-04-23T14:50:00.849 INFO:tasks.workunit.client.1.smithi156.stdout:9/511: rmdir d1/d2/d3e/d50/d7a/d17/d1f/d48/d4e 39 2024-04-23T14:50:00.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.850+0000 7fcd9ea00700 1 -- 172.21.15.81:0/1570926095 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd880052b0 con 0x7fcdac104fc0 2024-04-23T14:50:00.853 INFO:tasks.workunit.client.0.smithi081.stdout:5/965: write d17/d18/fe5 [1049082,4082] 0 2024-04-23T14:50:00.853 INFO:tasks.workunit.client.0.smithi081.stdout:5/966: write d17/d3c/f6f [668619,32305] 0 2024-04-23T14:50:00.854 INFO:tasks.workunit.client.1.smithi156.stdout:4/519: symlink d0/df/d55/d68/lac 0 2024-04-23T14:50:00.857 INFO:tasks.workunit.client.1.smithi156.stdout:4/520: mknod d0/d8/d1e/d4a/d77/cad 0 2024-04-23T14:50:00.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.855+0000 7fcda9600700 1 -- 172.21.15.81:0/1570926095 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7fcda0019040 con 0x7fcdac104fc0 2024-04-23T14:50:00.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.856+0000 7fcda9600700 1 --2- 172.21.15.81:0/1570926095 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fcd9406bd90 0x7fcd9406e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:00.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.856+0000 7fcda9600700 1 -- 172.21.15.81:0/1570926095 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fcda008c370 con 0x7fcdac104fc0 2024-04-23T14:50:00.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.858+0000 7fcdb0a00700 1 --2- 172.21.15.81:0/1570926095 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fcd9406bd90 0x7fcd9406e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:00.861 INFO:tasks.workunit.client.1.smithi156.stdout:8/590: dwrite d5/d9/d36/f3e [4194304,4194304] 0 2024-04-23T14:50:00.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.859+0000 7fcdb0a00700 1 --2- 172.21.15.81:0/1570926095 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fcd9406bd90 0x7fcd9406e240 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcdac066c70 tx=0x7fcd98009040 comp rx=0 tx=0).ready entity=mgr.24373 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:00.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:00.862+0000 7fcda9600700 1 -- 172.21.15.81:0/1570926095 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7fcda0059460 con 0x7fcdac104fc0 2024-04-23T14:50:00.868 INFO:tasks.workunit.client.1.smithi156.stdout:4/521: creat d0/d8/d1e/d4a/d77/d9c/fae x:0 0 0 2024-04-23T14:50:00.871 INFO:tasks.workunit.client.0.smithi081.stdout:4/863: dwrite d1/d4/d11/f28 [0,4194304] 0 2024-04-23T14:50:00.874 INFO:tasks.workunit.client.1.smithi156.stdout:9/512: dread d1/d2/d3e/d50/f7c [0,4194304] 0 2024-04-23T14:50:00.876 INFO:tasks.workunit.client.1.smithi156.stdout:7/614: rmdir dc/d93/d6c 39 2024-04-23T14:50:00.876 INFO:tasks.workunit.client.1.smithi156.stdout:7/615: write dc/d1d/d24/d5a/f6f [1134605,100664] 0 2024-04-23T14:50:00.881 INFO:tasks.workunit.client.0.smithi081.stdout:2/917: dwrite d1/d33/d95/fc9 [0,4194304] 0 2024-04-23T14:50:00.886 INFO:tasks.workunit.client.0.smithi081.stdout:4/864: mkdir d1/d8b/d114 0 2024-04-23T14:50:00.889 INFO:tasks.workunit.client.1.smithi156.stdout:0/591: dwrite d0/d16/d3a/d1e/fbd [0,4194304] 0 2024-04-23T14:50:00.889 INFO:tasks.workunit.client.1.smithi156.stdout:0/592: chown d0/d4/d22/d58 21057820 1 2024-04-23T14:50:00.889 INFO:tasks.workunit.client.1.smithi156.stdout:1/652: dwrite db/d15/f22 [4194304,4194304] 0 2024-04-23T14:50:00.893 INFO:tasks.workunit.client.1.smithi156.stdout:4/522: dread d0/d8/d1e/d4a/f7b [0,4194304] 0 2024-04-23T14:50:00.899 INFO:tasks.workunit.client.0.smithi081.stdout:3/843: dwrite d4/dc/d50/ff6 [0,4194304] 0 2024-04-23T14:50:00.899 INFO:tasks.workunit.client.0.smithi081.stdout:3/844: read - d4/d7/d1a/f9e zero size 2024-04-23T14:50:00.899 INFO:tasks.workunit.client.0.smithi081.stdout:3/845: dread - d4/d7/d32/da6/dc4/df7/f111 zero size 2024-04-23T14:50:00.902 INFO:tasks.workunit.client.0.smithi081.stdout:7/860: symlink d3/d20/l133 0 2024-04-23T14:50:00.904 INFO:tasks.workunit.client.1.smithi156.stdout:7/616: truncate dc/d93/d6c/faf 188959 0 2024-04-23T14:50:00.907 INFO:tasks.workunit.client.0.smithi081.stdout:2/918: symlink d1/d11/d21/d52/d8b/d8f/d93/d121/d131/l138 0 2024-04-23T14:50:00.916 INFO:tasks.workunit.client.1.smithi156.stdout:0/593: symlink d0/d16/da4/lc4 0 2024-04-23T14:50:00.916 INFO:tasks.workunit.client.1.smithi156.stdout:0/594: creat d0/d16/d3a/d1e/fc5 x:0 0 0 2024-04-23T14:50:00.924 INFO:tasks.workunit.client.1.smithi156.stdout:4/523: creat d0/d8/d1e/d4a/d77/faf x:0 0 0 2024-04-23T14:50:00.924 INFO:tasks.workunit.client.1.smithi156.stdout:4/524: read - d0/df/d55/d68/d85/fa4 zero size 2024-04-23T14:50:00.924 INFO:tasks.workunit.client.1.smithi156.stdout:8/591: dwrite d5/d9/d10/d1d/d21/f37 [0,4194304] 0 2024-04-23T14:50:00.924 INFO:tasks.workunit.client.1.smithi156.stdout:8/592: fdatasync d5/d9/d36/d9c/f5b 0 2024-04-23T14:50:00.933 INFO:tasks.workunit.client.0.smithi081.stdout:7/861: creat d3/d21/d31/d110/f134 x:0 0 0 2024-04-23T14:50:00.933 INFO:tasks.workunit.client.0.smithi081.stdout:7/862: write d3/d21/d41/d106/f109 [304226,67975] 0 2024-04-23T14:50:00.933 INFO:tasks.workunit.client.0.smithi081.stdout:7/863: stat d3/d20/dc9/l89 0 2024-04-23T14:50:00.933 INFO:tasks.workunit.client.0.smithi081.stdout:7/864: fdatasync d3/d21/d31/d33/d4b/f57 0 2024-04-23T14:50:00.935 INFO:tasks.workunit.client.0.smithi081.stdout:9/844: sync 2024-04-23T14:50:00.935 INFO:tasks.workunit.client.0.smithi081.stdout:9/845: chown d3/de/d1d/d5b/d7b/d90/lbc 397161 1 2024-04-23T14:50:00.935 INFO:tasks.workunit.client.0.smithi081.stdout:9/846: dread - d3/de/d1d/dcc/feb zero size 2024-04-23T14:50:00.939 INFO:tasks.workunit.client.0.smithi081.stdout:2/919: dread d1/d11/d21/d52/fd7 [0,4194304] 0 2024-04-23T14:50:00.940 INFO:tasks.workunit.client.0.smithi081.stdout:2/920: read d1/d11/d21/f4f [334151,45524] 0 2024-04-23T14:50:00.943 INFO:tasks.workunit.client.1.smithi156.stdout:8/593: read d5/d9/d10/d1d/d21/f40 [254658,68782] 0 2024-04-23T14:50:00.949 INFO:tasks.workunit.client.1.smithi156.stdout:7/617: rename dc/d1d/d41/f57 to dc/d93/d6c/d88/fc1 0 2024-04-23T14:50:00.950 INFO:tasks.workunit.client.0.smithi081.stdout:5/967: dwrite d17/d1f/d42/d9b/d13f/f7c [0,4194304] 0 2024-04-23T14:50:00.957 INFO:tasks.workunit.client.0.smithi081.stdout:2/921: dread d1/d1e/f106 [0,4194304] 0 2024-04-23T14:50:00.965 INFO:tasks.workunit.client.1.smithi156.stdout:0/595: truncate d0/d16/dbf/d3f/f51 1226775 0 2024-04-23T14:50:00.965 INFO:tasks.workunit.client.0.smithi081.stdout:7/865: dread d3/d21/d31/d33/d4b/f57 [0,4194304] 0 2024-04-23T14:50:00.965 INFO:tasks.workunit.client.0.smithi081.stdout:7/866: creat d3/d11/d2c/d75/d8e/dc2/f135 x:0 0 0 2024-04-23T14:50:00.968 INFO:tasks.workunit.client.0.smithi081.stdout:9/847: rmdir d3/de/d1d/d5b/d7b/db2/dd5 39 2024-04-23T14:50:00.968 INFO:tasks.workunit.client.0.smithi081.stdout:9/848: chown d3/de/d1d/d54/f5f 17740 1 2024-04-23T14:50:00.973 INFO:tasks.workunit.client.1.smithi156.stdout:1/653: mkdir db/d1f/d28/d70/db3/dcc 0 2024-04-23T14:50:00.975 INFO:tasks.workunit.client.1.smithi156.stdout:0/596: dread d0/d16/d3a/d2a/d1d/d2d/d6b/f82 [0,4194304] 0 2024-04-23T14:50:00.980 INFO:tasks.workunit.client.1.smithi156.stdout:4/525: symlink d0/df/d55/d68/d53/d91/d95/lb0 0 2024-04-23T14:50:00.980 INFO:tasks.workunit.client.1.smithi156.stdout:4/526: truncate d0/df/d55/d68/f43 1919235 0 2024-04-23T14:50:00.981 INFO:tasks.workunit.client.0.smithi081.stdout:2/922: write d1/d11/d21/d52/d8b/d8f/fc3 [3328035,52735] 0 2024-04-23T14:50:00.982 INFO:tasks.workunit.client.0.smithi081.stdout:3/846: dwrite d4/d7/d1a/fbe [0,4194304] 0 2024-04-23T14:50:00.987 INFO:tasks.workunit.client.0.smithi081.stdout:5/968: creat d17/d1f/d42/d9b/d13f/d61/dba/d127/f151 x:0 0 0 2024-04-23T14:50:00.988 INFO:tasks.workunit.client.1.smithi156.stdout:8/594: mkdir d5/d9/d36/d84/dc1/dcf 0 2024-04-23T14:50:01.001 INFO:tasks.workunit.client.1.smithi156.stdout:1/654: truncate db/f11 1651766 0 2024-04-23T14:50:01.002 INFO:tasks.workunit.client.0.smithi081.stdout:6/908: mkdir d1/d51/d65/d8/d2e/d140 0 2024-04-23T14:50:01.004 INFO:tasks.workunit.client.1.smithi156.stdout:8/595: dread d5/d9/d10/f46 [0,4194304] 0 2024-04-23T14:50:01.006 INFO:tasks.workunit.client.0.smithi081.stdout:2/923: mkdir d1/d33/d9f/d136/d139 0 2024-04-23T14:50:01.006 INFO:tasks.workunit.client.0.smithi081.stdout:2/924: fdatasync d1/d11/d21/f3b 0 2024-04-23T14:50:01.008 INFO:tasks.workunit.client.1.smithi156.stdout:0/597: truncate d0/d4/d22/d58/d9a/d44/f7d 114537 0 2024-04-23T14:50:01.025 INFO:tasks.workunit.client.0.smithi081.stdout:3/847: symlink d4/d7/d49/d51/l116 0 2024-04-23T14:50:01.028 INFO:tasks.workunit.client.0.smithi081.stdout:9/849: symlink d3/de/d1d/l113 0 2024-04-23T14:50:01.029 INFO:tasks.workunit.client.0.smithi081.stdout:9/850: write d3/de/ff4 [711843,29236] 0 2024-04-23T14:50:01.029 INFO:tasks.workunit.client.0.smithi081.stdout:9/851: read d3/de/d1d/d54/f9b [3316347,39726] 0 2024-04-23T14:50:01.033 INFO:tasks.workunit.client.0.smithi081.stdout:6/909: symlink d1/d51/d65/d13/d16/dd0/df7/l141 0 2024-04-23T14:50:01.033 INFO:tasks.workunit.client.0.smithi081.stdout:6/910: fdatasync d1/d51/d65/d13/d16/dd0/f12b 0 2024-04-23T14:50:01.037 INFO:tasks.workunit.client.0.smithi081.stdout:3/848: creat d4/d7/d49/d51/f117 x:0 0 0 2024-04-23T14:50:01.037 INFO:tasks.workunit.client.0.smithi081.stdout:3/849: write d4/d7/df/f92 [1223685,11395] 0 2024-04-23T14:50:01.037 INFO:tasks.workunit.client.1.smithi156.stdout:0/598: write d0/d16/d3a/f6a [1362866,45210] 0 2024-04-23T14:50:01.040 INFO:tasks.workunit.client.0.smithi081.stdout:5/969: dwrite d17/f38 [4194304,4194304] 0 2024-04-23T14:50:01.042 INFO:tasks.workunit.client.0.smithi081.stdout:9/852: mkdir d3/de/d1d/d62/d114 0 2024-04-23T14:50:01.048 INFO:tasks.workunit.client.0.smithi081.stdout:3/850: symlink d4/dc/d50/d9a/l118 0 2024-04-23T14:50:01.063 INFO:tasks.workunit.client.1.smithi156.stdout:4/527: creat d0/d76/fb1 x:0 0 0 2024-04-23T14:50:01.068 INFO:tasks.workunit.client.1.smithi156.stdout:4/528: write d0/df/d55/f73 [203653,130296] 0 2024-04-23T14:50:01.068 INFO:tasks.workunit.client.1.smithi156.stdout:4/529: fsync d0/df/d55/d68/d53/f79 0 2024-04-23T14:50:01.070 INFO:tasks.workunit.client.0.smithi081.stdout:6/911: getdents d1/d51/d65/d8/d2e/d59/d80 0 2024-04-23T14:50:01.071 INFO:tasks.workunit.client.0.smithi081.stdout:2/925: dwrite d1/d1e/f9c [4194304,4194304] 0 2024-04-23T14:50:01.071 INFO:tasks.workunit.client.0.smithi081.stdout:6/912: write d1/d51/d7b/f87 [4466147,35802] 0 2024-04-23T14:50:01.071 INFO:tasks.workunit.client.0.smithi081.stdout:6/913: dread - d1/d2/d8e/d98/f9a zero size 2024-04-23T14:50:01.072 INFO:tasks.workunit.client.1.smithi156.stdout:1/655: mknod db/d1f/d28/d70/db3/dcc/ccd 0 2024-04-23T14:50:01.072 INFO:tasks.workunit.client.1.smithi156.stdout:5/631: mkdir d1/d11/dcb 0 2024-04-23T14:50:01.073 INFO:tasks.workunit.client.1.smithi156.stdout:8/596: creat d5/d9/d5a/dc8/fd0 x:0 0 0 2024-04-23T14:50:01.075 INFO:tasks.workunit.client.1.smithi156.stdout:6/668: mknod d3/da/cf6 0 2024-04-23T14:50:01.076 INFO:tasks.workunit.client.0.smithi081.stdout:3/851: symlink d4/d7/df/d30/l119 0 2024-04-23T14:50:01.076 INFO:tasks.workunit.client.0.smithi081.stdout:3/852: fsync d4/f5b 0 2024-04-23T14:50:01.076 INFO:tasks.workunit.client.0.smithi081.stdout:3/853: read d4/d7/df/d30/f4c [892517,93434] 0 2024-04-23T14:50:01.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:00 smithi081 ceph-mon[25540]: pgmap v39: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 256 MiB/s rd, 298 MiB/s wr, 458 op/s 2024-04-23T14:50:01.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:00 smithi081 ceph-mon[25540]: overall HEALTH_OK 2024-04-23T14:50:01.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:00 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:50:01.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:00 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:50:01.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:00 smithi081 ceph-mon[25540]: Reconfiguring prometheus.smithi081 (dependencies changed)... 2024-04-23T14:50:01.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:00 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/3451404846' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:50:01.081 INFO:tasks.workunit.client.0.smithi081.stdout:2/926: dread d1/d33/d45/d6e/d97/fb2 [0,4194304] 0 2024-04-23T14:50:01.084 INFO:tasks.workunit.client.1.smithi156.stdout:0/599: unlink d0/l88 0 2024-04-23T14:50:01.088 INFO:tasks.workunit.client.1.smithi156.stdout:1/656: link db/d1f/d2d/d48/daf/d86/f89 db/d25/fce 0 2024-04-23T14:50:01.089 INFO:tasks.workunit.client.0.smithi081.stdout:9/853: rmdir d3/de/d14/dab 39 2024-04-23T14:50:01.107 INFO:tasks.workunit.client.1.smithi156.stdout:8/597: getdents d5 0 2024-04-23T14:50:01.107 INFO:tasks.workunit.client.1.smithi156.stdout:8/598: chown d5/d9/d36/d60/db8/d93 8043 1 2024-04-23T14:50:01.111 INFO:tasks.workunit.client.1.smithi156.stdout:1/657: truncate db/d1f/f79 4937673 0 2024-04-23T14:50:01.112 INFO:tasks.workunit.client.1.smithi156.stdout:0/600: write d0/d16/d3a/d1e/fbd [2025612,15402] 0 2024-04-23T14:50:01.112 INFO:tasks.workunit.client.0.smithi081.stdout:5/970: link d17/d18/dff/d9a/le4 d17/d1f/d42/d9b/l152 0 2024-04-23T14:50:01.112 INFO:tasks.workunit.client.1.smithi156.stdout:4/530: dread d0/df/d55/d68/f38 [0,4194304] 0 2024-04-23T14:50:01.119 INFO:tasks.workunit.client.1.smithi156.stdout:9/513: rmdir d1/d2/d3e/d50/d7a/d19 39 2024-04-23T14:50:01.121 INFO:tasks.workunit.client.0.smithi081.stdout:7/867: rmdir d3/d21/d41/d7c/dc3 39 2024-04-23T14:50:01.130 INFO:tasks.workunit.client.1.smithi156.stdout:1/658: unlink db/d1f/d2d/d48/daf/c5a 0 2024-04-23T14:50:01.134 INFO:tasks.workunit.client.1.smithi156.stdout:0/601: creat d0/d16/d43/da6/fc6 x:0 0 0 2024-04-23T14:50:01.135 INFO:tasks.workunit.client.1.smithi156.stdout:0/602: stat d0/d16/dbf/d3f/l76 0 2024-04-23T14:50:01.143 INFO:tasks.workunit.client.1.smithi156.stdout:4/531: creat d0/d8/d1e/d4a/fb2 x:0 0 0 2024-04-23T14:50:01.161 INFO:tasks.workunit.client.1.smithi156.stdout:9/514: symlink d1/d2/d3e/lad 0 2024-04-23T14:50:01.169 INFO:tasks.workunit.client.0.smithi081.stdout:6/914: unlink d1/d51/d65/d13/d16/dd0/df7/fc3 0 2024-04-23T14:50:01.173 INFO:tasks.workunit.client.0.smithi081.stdout:9/854: dwrite d3/de/d14/f6b [0,4194304] 0 2024-04-23T14:50:01.174 INFO:tasks.workunit.client.1.smithi156.stdout:0/603: creat d0/d4/d22/d58/d9a/d44/fc7 x:0 0 0 2024-04-23T14:50:01.174 INFO:tasks.workunit.client.1.smithi156.stdout:0/604: truncate d0/d16/d3a/d1e/fc5 458769 0 2024-04-23T14:50:01.180 INFO:tasks.workunit.client.0.smithi081.stdout:6/915: dread d1/d51/d65/d1c/d66/fd1 [0,4194304] 0 2024-04-23T14:50:01.181 INFO:tasks.workunit.client.0.smithi081.stdout:7/868: dwrite d3/d21/d41/d7c/ff6 [0,4194304] 0 2024-04-23T14:50:01.186 INFO:tasks.workunit.client.1.smithi156.stdout:4/532: symlink d0/df/d55/d68/d85/lb3 0 2024-04-23T14:50:01.187 INFO:tasks.workunit.client.0.smithi081.stdout:3/854: getdents d4/d41/d10a 0 2024-04-23T14:50:01.190 INFO:tasks.workunit.client.1.smithi156.stdout:5/632: dwrite d1/d11/d18/f47 [0,4194304] 0 2024-04-23T14:50:01.190 INFO:tasks.workunit.client.1.smithi156.stdout:5/633: write d1/d3/f5 [10639020,6782] 0 2024-04-23T14:50:01.190 INFO:tasks.workunit.client.1.smithi156.stdout:8/599: dwrite d5/d9/d5a/f54 [4194304,4194304] 0 2024-04-23T14:50:01.193 INFO:tasks.workunit.client.0.smithi081.stdout:2/927: link d1/d33/d45/d48/f51 d1/d11/d21/d52/d8b/d8f/de8/d117/f13a 0 2024-04-23T14:50:01.193 INFO:tasks.workunit.client.1.smithi156.stdout:9/515: mknod d1/cae 0 2024-04-23T14:50:01.198 INFO:tasks.workunit.client.1.smithi156.stdout:0/605: unlink d0/d16/l39 0 2024-04-23T14:50:01.198 INFO:tasks.workunit.client.1.smithi156.stdout:0/606: readlink d0/d16/dbf/l27 0 2024-04-23T14:50:01.200 INFO:tasks.workunit.client.1.smithi156.stdout:6/669: link d3/c45 d3/d16/d46/d9d/cf7 0 2024-04-23T14:50:01.205 INFO:tasks.workunit.client.1.smithi156.stdout:8/600: dread d5/f1c [0,4194304] 0 2024-04-23T14:50:01.205 INFO:tasks.workunit.client.1.smithi156.stdout:8/601: chown d5/d9/d36/d84/d8c/fa7 7053031 1 2024-04-23T14:50:01.206 INFO:tasks.workunit.client.1.smithi156.stdout:8/602: chown d5/d9/d36/d60/db8/d93/d96 15445 1 2024-04-23T14:50:01.206 INFO:tasks.workunit.client.1.smithi156.stdout:8/603: read d5/d9/d10/d1d/f7a [4904758,48259] 0 2024-04-23T14:50:01.209 INFO:tasks.workunit.client.0.smithi081.stdout:5/971: link d17/d1f/d42/d9b/d13f/fd7 d17/d18/d3a/d8e/f153 0 2024-04-23T14:50:01.210 INFO:tasks.workunit.client.1.smithi156.stdout:4/533: link d0/ca d0/df/d75/cb4 0 2024-04-23T14:50:01.210 INFO:tasks.workunit.client.1.smithi156.stdout:4/534: chown d0/df/d75/caa 30201 1 2024-04-23T14:50:01.228 INFO:tasks.workunit.client.0.smithi081.stdout:9/855: symlink d3/de/l115 0 2024-04-23T14:50:01.231 INFO:tasks.workunit.client.0.smithi081.stdout:6/916: creat d1/f142 x:0 0 0 2024-04-23T14:50:01.232 INFO:tasks.workunit.client.0.smithi081.stdout:6/917: dread - d1/f142 zero size 2024-04-23T14:50:01.232 INFO:tasks.workunit.client.0.smithi081.stdout:5/972: dread d17/d37/da4/f11e [0,4194304] 0 2024-04-23T14:50:01.242 INFO:tasks.workunit.client.1.smithi156.stdout:9/516: symlink d1/d2/d23/d75/laf 0 2024-04-23T14:50:01.242 INFO:tasks.workunit.client.1.smithi156.stdout:9/517: fdatasync d1/f1e 0 2024-04-23T14:50:01.242 INFO:tasks.workunit.client.1.smithi156.stdout:9/518: chown d1/d2/d3e/d50/d7a/d17/d1f/d48/l64 241537 1 2024-04-23T14:50:01.242 INFO:tasks.workunit.client.1.smithi156.stdout:9/519: rename d1/d2/d23/d49 to d1/d2/d23/d49/d4c/d96/db0 22 2024-04-23T14:50:01.251 INFO:tasks.workunit.client.1.smithi156.stdout:6/670: symlink d3/da/d1d/d27/lf8 0 2024-04-23T14:50:01.252 INFO:tasks.workunit.client.0.smithi081.stdout:7/869: mknod d3/d21/d41/da3/c136 0 2024-04-23T14:50:01.252 INFO:tasks.workunit.client.1.smithi156.stdout:1/659: dread db/f11 [0,4194304] 0 2024-04-23T14:50:01.252 INFO:tasks.workunit.client.1.smithi156.stdout:1/660: write db/d1f/d2f/d47/d71/fc8 [883453,23887] 0 2024-04-23T14:50:01.252 INFO:tasks.workunit.client.1.smithi156.stdout:1/661: readlink db/d1f/d28/l31 0 2024-04-23T14:50:01.256 INFO:tasks.workunit.client.0.smithi081.stdout:3/855: truncate d4/d7/fcc 2215792 0 2024-04-23T14:50:01.257 INFO:tasks.workunit.client.0.smithi081.stdout:2/928: truncate d1/d11/d21/f4f 246347 0 2024-04-23T14:50:01.262 INFO:tasks.workunit.client.0.smithi081.stdout:9/856: mkdir d3/de/d76/d116 0 2024-04-23T14:50:01.265 INFO:tasks.workunit.client.1.smithi156.stdout:5/634: getdents d1/d11/d18/d19/d9a 0 2024-04-23T14:50:01.266 INFO:tasks.workunit.client.0.smithi081.stdout:6/918: rename d1/d2/d49/fb7 to d1/d51/f143 0 2024-04-23T14:50:01.267 INFO:tasks.workunit.client.1.smithi156.stdout:9/520: mknod d1/d2/cb1 0 2024-04-23T14:50:01.271 INFO:tasks.workunit.client.1.smithi156.stdout:4/535: dwrite d0/df/d55/d68/f38 [0,4194304] 0 2024-04-23T14:50:01.272 INFO:tasks.workunit.client.0.smithi081.stdout:7/870: link d3/d21/d31/d50/ca1 d3/d21/d41/d7c/dc3/d7f/ddd/c137 0 2024-04-23T14:50:01.276 INFO:tasks.workunit.client.1.smithi156.stdout:5/635: unlink d1/d3/d64/f88 0 2024-04-23T14:50:01.276 INFO:tasks.workunit.client.1.smithi156.stdout:5/636: readlink d1/lc5 0 2024-04-23T14:50:01.276 INFO:tasks.workunit.client.1.smithi156.stdout:2/579: sync 2024-04-23T14:50:01.276 INFO:tasks.workunit.client.1.smithi156.stdout:3/528: sync 2024-04-23T14:50:01.279 INFO:tasks.workunit.client.0.smithi081.stdout:2/929: symlink d1/d33/d45/de9/l13b 0 2024-04-23T14:50:01.282 INFO:tasks.workunit.client.1.smithi156.stdout:4/536: mkdir d0/df/d55/d68/d53/d91/d95/db5 0 2024-04-23T14:50:01.282 INFO:tasks.workunit.client.1.smithi156.stdout:4/537: creat d0/d8/d1e/d4a/d77/fb6 x:0 0 0 2024-04-23T14:50:01.282 INFO:tasks.workunit.client.1.smithi156.stdout:4/538: chown d0/d30/l35 2949 1 2024-04-23T14:50:01.284 INFO:tasks.workunit.client.0.smithi081.stdout:3/856: write d4/d7/d7f/d85/d9d/f74 [2989932,115370] 0 2024-04-23T14:50:01.284 INFO:tasks.workunit.client.1.smithi156.stdout:7/618: sync 2024-04-23T14:50:01.285 INFO:tasks.workunit.client.1.smithi156.stdout:2/580: write d4/f16 [3393872,52523] 0 2024-04-23T14:50:01.285 INFO:tasks.workunit.client.1.smithi156.stdout:3/529: symlink d4/db/dd/d1d/d1e/d13/d5a/la6 0 2024-04-23T14:50:01.286 INFO:tasks.workunit.client.0.smithi081.stdout:6/919: dread d1/d51/d65/d1c/fbc [0,4194304] 0 2024-04-23T14:50:01.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:01 smithi156 ceph-mon[32341]: pgmap v39: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 256 MiB/s rd, 298 MiB/s wr, 458 op/s 2024-04-23T14:50:01.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:01 smithi156 ceph-mon[32341]: overall HEALTH_OK 2024-04-23T14:50:01.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:01 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:50:01.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:01 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:50:01.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:01 smithi156 ceph-mon[32341]: Reconfiguring prometheus.smithi081 (dependencies changed)... 2024-04-23T14:50:01.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:01 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/3451404846' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:50:01.294 INFO:tasks.workunit.client.1.smithi156.stdout:4/539: creat d0/df/d55/d68/fb7 x:0 0 0 2024-04-23T14:50:01.295 INFO:tasks.workunit.client.1.smithi156.stdout:2/581: dread d4/d21/d42/da1/fa2 [0,4194304] 0 2024-04-23T14:50:01.297 INFO:tasks.workunit.client.0.smithi081.stdout:7/871: unlink d3/d21/d31/d50/da2/f107 0 2024-04-23T14:50:01.303 INFO:tasks.workunit.client.1.smithi156.stdout:3/530: symlink d4/db/dd/d1d/d1e/la7 0 2024-04-23T14:50:01.305 INFO:tasks.workunit.client.0.smithi081.stdout:3/857: truncate d4/d7/df/f19 6469175 0 2024-04-23T14:50:01.305 INFO:tasks.workunit.client.0.smithi081.stdout:3/858: chown d4/d7/d32/da6/dc4/df7/d106/f107 1 1 2024-04-23T14:50:01.305 INFO:tasks.workunit.client.0.smithi081.stdout:3/859: chown d4/d7/d49/d104 1 1 2024-04-23T14:50:01.306 INFO:tasks.workunit.client.0.smithi081.stdout:6/920: creat d1/d2/d8e/df6/f144 x:0 0 0 2024-04-23T14:50:01.315 INFO:tasks.workunit.client.1.smithi156.stdout:3/531: link d4/db/dd/d1d/d61/d8d/d91/l96 d4/db/dd/d1d/d1e/d42/d76/la8 0 2024-04-23T14:50:01.315 INFO:tasks.workunit.client.1.smithi156.stdout:3/532: write d4/db/f77 [620634,80223] 0 2024-04-23T14:50:01.315 INFO:tasks.workunit.client.1.smithi156.stdout:3/533: chown d4/db/dd/d1d/d61/f71 940868 1 2024-04-23T14:50:01.315 INFO:tasks.workunit.client.1.smithi156.stdout:3/534: chown d4/db/d4b 0 1 2024-04-23T14:50:01.317 INFO:tasks.workunit.client.0.smithi081.stdout:7/872: truncate d3/d21/d41/d7c/dc3/d7f/f88 3312502 0 2024-04-23T14:50:01.318 INFO:tasks.workunit.client.0.smithi081.stdout:7/873: write d3/d21/f55 [397888,118776] 0 2024-04-23T14:50:01.319 INFO:tasks.workunit.client.0.smithi081.stdout:7/874: write d3/d21/d41/d7c/dc3/f124 [5010087,90636] 0 2024-04-23T14:50:01.322 INFO:tasks.workunit.client.1.smithi156.stdout:5/637: dread d1/f7c [0,4194304] 0 2024-04-23T14:50:01.322 INFO:tasks.workunit.client.1.smithi156.stdout:7/619: rename dc/d1d/d24/da7 to dc/d2c/dbe/dc2 0 2024-04-23T14:50:01.322 INFO:tasks.workunit.client.1.smithi156.stdout:7/620: dread - dc/d1d/d48/d83/f8a zero size 2024-04-23T14:50:01.322 INFO:tasks.workunit.client.1.smithi156.stdout:7/621: chown c2 13621406 1 2024-04-23T14:50:01.326 INFO:tasks.workunit.client.1.smithi156.stdout:3/535: mknod d4/db/dd/d1d/d61/ca9 0 2024-04-23T14:50:01.326 INFO:tasks.workunit.client.1.smithi156.stdout:3/536: creat d4/db/dd/d1d/d1e/d42/faa x:0 0 0 2024-04-23T14:50:01.326 INFO:tasks.workunit.client.1.smithi156.stdout:3/537: read - d4/db/dd/d1d/d1e/d42/d76/f95 zero size 2024-04-23T14:50:01.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.327+0000 7fcd9ea00700 1 -- 172.21.15.81:0/1570926095 --> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd88000bc0 con 0x7fcd9406bd90 2024-04-23T14:50:01.328 INFO:tasks.workunit.client.0.smithi081.stdout:3/860: mknod d4/d7/d7f/d85/d9d/c11a 0 2024-04-23T14:50:01.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.329+0000 7fcda9600700 1 -- 172.21.15.81:0/1570926095 <== mgr.24373 v2:172.21.15.156:6828/100981835 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fcd88000bc0 con 0x7fcd9406bd90 2024-04-23T14:50:01.331 INFO:tasks.workunit.client.1.smithi156.stdout:7/622: getdents dc/d1d/d48/d83 0 2024-04-23T14:50:01.331 INFO:tasks.workunit.client.1.smithi156.stdout:7/623: chown dc/d46 198167 1 2024-04-23T14:50:01.332 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:50:01.332 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd", 2024-04-23T14:50:01.332 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-04-23T14:50:01.332 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-23T14:50:01.332 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [], 2024-04-23T14:50:01.332 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "1/21 daemons upgraded", 2024-04-23T14:50:01.332 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "", 2024-04-23T14:50:01.333 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-04-23T14:50:01.333 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:50:01.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.333+0000 7fcd9ea00700 1 -- 172.21.15.81:0/1570926095 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fcd9406bd90 msgr2=0x7fcd9406e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:01.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.333+0000 7fcd9ea00700 1 --2- 172.21.15.81:0/1570926095 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fcd9406bd90 0x7fcd9406e240 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcdac066c70 tx=0x7fcd98009040 comp rx=0 tx=0).stop 2024-04-23T14:50:01.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.333+0000 7fcd9ea00700 1 -- 172.21.15.81:0/1570926095 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcdac104fc0 msgr2=0x7fcdac113f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:01.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.333+0000 7fcd9ea00700 1 --2- 172.21.15.81:0/1570926095 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcdac104fc0 0x7fcdac113f30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcda0009f50 tx=0x7fcda0004d10 comp rx=0 tx=0).stop 2024-04-23T14:50:01.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.334+0000 7fcd9ea00700 1 -- 172.21.15.81:0/1570926095 shutdown_connections 2024-04-23T14:50:01.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.334+0000 7fcd9ea00700 1 --2- 172.21.15.81:0/1570926095 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fcd9406bd90 0x7fcd9406e240 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:01.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.334+0000 7fcd9ea00700 1 --2- 172.21.15.81:0/1570926095 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcdac104fc0 0x7fcdac113f30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:01.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.334+0000 7fcd9ea00700 1 --2- 172.21.15.81:0/1570926095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdac1078e0 0x7fcdac114470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:01.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.334+0000 7fcd9ea00700 1 -- 172.21.15.81:0/1570926095 >> 172.21.15.81:0/1570926095 conn(0x7fcdac06a390 msgr2=0x7fcdac107ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:01.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.336+0000 7fcd9ea00700 1 -- 172.21.15.81:0/1570926095 shutdown_connections 2024-04-23T14:50:01.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.336+0000 7fcd9ea00700 1 -- 172.21.15.81:0/1570926095 wait complete. 2024-04-23T14:50:01.338 INFO:tasks.workunit.client.1.smithi156.stdout:7/624: dread dc/f81 [0,4194304] 0 2024-04-23T14:50:01.342 INFO:tasks.workunit.client.1.smithi156.stdout:3/538: mkdir d4/db/dd/d1d/d1e/d13/d5a/dab 0 2024-04-23T14:50:01.342 INFO:tasks.workunit.client.1.smithi156.stdout:3/539: write d4/db/dd/d1d/d61/f62 [283730,111305] 0 2024-04-23T14:50:01.343 INFO:tasks.workunit.client.0.smithi081.stdout:6/921: creat d1/d51/d65/d1c/f145 x:0 0 0 2024-04-23T14:50:01.343 INFO:tasks.workunit.client.1.smithi156.stdout:9/521: dwrite d1/d2/d3e/d50/d7a/d17/d1f/d48/f91 [0,4194304] 0 2024-04-23T14:50:01.344 INFO:tasks.workunit.client.1.smithi156.stdout:9/522: write d1/d2/f13 [437463,121891] 0 2024-04-23T14:50:01.344 INFO:tasks.workunit.client.1.smithi156.stdout:9/523: fdatasync d1/d2/d3e/d50/d7a/d17/d1f/d48/f91 0 2024-04-23T14:50:01.344 INFO:tasks.workunit.client.1.smithi156.stdout:7/625: mkdir dc/d2c/d68/dc3 0 2024-04-23T14:50:01.350 INFO:tasks.workunit.client.0.smithi081.stdout:5/973: rename d17/d18/d3a/d8e/d10a to d17/d3c/de7/d154 0 2024-04-23T14:50:01.350 INFO:tasks.workunit.client.0.smithi081.stdout:5/974: readlink d17/d1f/d42/d9b/d13f/l131 0 2024-04-23T14:50:01.355 INFO:tasks.workunit.client.1.smithi156.stdout:3/540: mknod d4/db/dd/d1d/d1e/d74/d93/cac 0 2024-04-23T14:50:01.357 INFO:tasks.workunit.client.1.smithi156.stdout:1/662: dwrite db/d25/d30/f43 [0,4194304] 0 2024-04-23T14:50:01.375 INFO:tasks.workunit.client.0.smithi081.stdout:2/930: rename d1/d1e/fda to d1/d11/df7/df9/f13c 0 2024-04-23T14:50:01.377 INFO:tasks.workunit.client.1.smithi156.stdout:4/540: dwrite d0/df/d75/f9a [0,4194304] 0 2024-04-23T14:50:01.377 INFO:tasks.workunit.client.1.smithi156.stdout:4/541: truncate d0/d8/d1e/d4a/d77/f7c 529815 0 2024-04-23T14:50:01.377 INFO:tasks.workunit.client.1.smithi156.stdout:4/542: chown d0/d30/f3f 51117 1 2024-04-23T14:50:01.377 INFO:tasks.workunit.client.1.smithi156.stdout:4/543: creat d0/d8/d1e/da0/fb8 x:0 0 0 2024-04-23T14:50:01.377 INFO:tasks.workunit.client.1.smithi156.stdout:2/582: read d4/d13/d88/f72 [730703,120244] 0 2024-04-23T14:50:01.390 INFO:tasks.workunit.client.1.smithi156.stdout:9/524: link d1/d2/d3e/d50/f99 d1/d2/d23/d49/d4c/fb2 0 2024-04-23T14:50:01.391 INFO:tasks.workunit.client.1.smithi156.stdout:3/541: dread d4/db/dd/d1d/d1e/d13/f1f [0,4194304] 0 2024-04-23T14:50:01.392 INFO:tasks.workunit.client.1.smithi156.stdout:6/671: dwrite d3/d16/f3c [0,4194304] 0 2024-04-23T14:50:01.393 INFO:tasks.workunit.client.1.smithi156.stdout:7/626: rename dc/d2c/d68/l90 to dc/d1d/d48/lc4 0 2024-04-23T14:50:01.393 INFO:tasks.workunit.client.1.smithi156.stdout:7/627: fsync dc/d1d/d41/f9c 0 2024-04-23T14:50:01.396 INFO:tasks.workunit.client.1.smithi156.stdout:1/663: mkdir db/d1f/d2d/d48/dab/dcf 0 2024-04-23T14:50:01.396 INFO:tasks.workunit.client.0.smithi081.stdout:3/861: rename d4/d7/d2e/fae to d4/d7/d7f/d85/d9d/dac/dc7/f11b 0 2024-04-23T14:50:01.405 INFO:tasks.workunit.client.0.smithi081.stdout:5/975: rename d17/d18/c106 to d17/df8/c155 0 2024-04-23T14:50:01.414 INFO:tasks.workunit.client.1.smithi156.stdout:4/544: symlink d0/lb9 0 2024-04-23T14:50:01.421 INFO:tasks.workunit.client.1.smithi156.stdout:2/583: creat d4/d13/d19/fd3 x:0 0 0 2024-04-23T14:50:01.426 INFO:tasks.workunit.client.0.smithi081.stdout:7/875: dwrite d3/d20/dc9/f84 [4194304,4194304] 0 2024-04-23T14:50:01.426 INFO:tasks.workunit.client.1.smithi156.stdout:2/584: write d4/d13/d19/d58/fa7 [106473,112559] 0 2024-04-23T14:50:01.427 INFO:tasks.workunit.client.0.smithi081.stdout:6/922: dwrite d1/d2/d8e/d98/f9a [0,4194304] 0 2024-04-23T14:50:01.432 INFO:tasks.workunit.client.0.smithi081.stdout:5/976: symlink d17/d1f/d42/d9b/d9e/l156 0 2024-04-23T14:50:01.444 INFO:tasks.workunit.client.0.smithi081.stdout:2/931: dwrite d1/d33/f100 [0,4194304] 0 2024-04-23T14:50:01.463 INFO:tasks.workunit.client.0.smithi081.stdout:6/923: fsync d1/d51/d7b/f87 0 2024-04-23T14:50:01.464 INFO:tasks.workunit.client.1.smithi156.stdout:9/525: symlink d1/d2/d23/lb3 0 2024-04-23T14:50:01.465 INFO:tasks.workunit.client.1.smithi156.stdout:7/628: dwrite dc/d93/f9e [0,4194304] 0 2024-04-23T14:50:01.465 INFO:tasks.workunit.client.1.smithi156.stdout:7/629: write dc/d1d/f35 [1260170,91835] 0 2024-04-23T14:50:01.466 INFO:tasks.workunit.client.1.smithi156.stdout:3/542: mkdir d4/db/dd/d1d/d1e/d74/d93/dad 0 2024-04-23T14:50:01.466 INFO:tasks.workunit.client.1.smithi156.stdout:3/543: readlink d4/db/dd/d1d/d1e/l6e 0 2024-04-23T14:50:01.478 INFO:tasks.workunit.client.0.smithi081.stdout:2/932: link d1/c24 d1/d33/da3/df5/c13d 0 2024-04-23T14:50:01.482 INFO:tasks.workunit.client.1.smithi156.stdout:1/664: dwrite db/d1f/d28/f37 [0,4194304] 0 2024-04-23T14:50:01.488 INFO:tasks.workunit.client.0.smithi081.stdout:2/933: symlink d1/d11/d21/d34/l13e 0 2024-04-23T14:50:01.488 INFO:tasks.workunit.client.0.smithi081.stdout:2/934: chown d1/d11/d21/l57 1126553 1 2024-04-23T14:50:01.489 INFO:tasks.workunit.client.1.smithi156.stdout:6/672: symlink d3/d16/d46/d9d/lf9 0 2024-04-23T14:50:01.489 INFO:tasks.workunit.client.1.smithi156.stdout:4/545: creat d0/df/d55/d68/d53/d91/d95/fba x:0 0 0 2024-04-23T14:50:01.493 INFO:tasks.workunit.client.0.smithi081.stdout:3/862: dwrite d4/d7/df/d30/f80 [0,4194304] 0 2024-04-23T14:50:01.493 INFO:tasks.workunit.client.0.smithi081.stdout:3/863: dread - d4/d7/d32/da6/dc4/d5a/d93/ffd zero size 2024-04-23T14:50:01.499 INFO:tasks.workunit.client.1.smithi156.stdout:2/585: dwrite d4/d26/fb1 [0,4194304] 0 2024-04-23T14:50:01.499 INFO:tasks.workunit.client.1.smithi156.stdout:2/586: stat d4/d13/d19/d58/f5b 0 2024-04-23T14:50:01.501 INFO:tasks.workunit.client.1.smithi156.stdout:7/630: creat dc/d46/d58/db7/fc5 x:0 0 0 2024-04-23T14:50:01.501 INFO:tasks.workunit.client.1.smithi156.stdout:7/631: write dc/d2c/f50 [2977269,101963] 0 2024-04-23T14:50:01.504 INFO:tasks.workunit.client.1.smithi156.stdout:3/544: mknod d4/db/dd/d1d/d1e/d42/cae 0 2024-04-23T14:50:01.509 INFO:tasks.workunit.client.0.smithi081.stdout:3/864: symlink d4/d7/d7f/d85/d9d/dac/dc7/l11c 0 2024-04-23T14:50:01.509 INFO:tasks.workunit.client.0.smithi081.stdout:3/865: write d4/f6 [3275214,95636] 0 2024-04-23T14:50:01.521 INFO:tasks.workunit.client.0.smithi081.stdout:3/866: link d4/d41/dc6/ca0 d4/dc/d50/d9a/c11d 0 2024-04-23T14:50:01.526 INFO:tasks.workunit.client.0.smithi081.stdout:7/876: dread d3/d21/d41/d7c/dc3/d7f/f88 [0,4194304] 0 2024-04-23T14:50:01.527 INFO:tasks.workunit.client.0.smithi081.stdout:2/935: dread d1/d33/f71 [0,4194304] 0 2024-04-23T14:50:01.529 INFO:tasks.workunit.client.0.smithi081.stdout:4/865: sync 2024-04-23T14:50:01.531 INFO:tasks.workunit.client.0.smithi081.stdout:3/867: mkdir d4/d7/df/d30/d112/d11e 0 2024-04-23T14:50:01.535 INFO:tasks.workunit.client.1.smithi156.stdout:1/665: rmdir db/d1f/d2f 39 2024-04-23T14:50:01.539 INFO:tasks.workunit.client.1.smithi156.stdout:2/587: symlink d4/d26/d3c/dca/ld4 0 2024-04-23T14:50:01.542 INFO:tasks.workunit.client.0.smithi081.stdout:2/936: link d1/d11/d21/f2a d1/d33/da3/df5/f13f 0 2024-04-23T14:50:01.548 INFO:tasks.workunit.client.1.smithi156.stdout:7/632: creat dc/d9d/fc6 x:0 0 0 2024-04-23T14:50:01.548 INFO:tasks.workunit.client.1.smithi156.stdout:7/633: creat dc/d2c/d68/fc7 x:0 0 0 2024-04-23T14:50:01.550 INFO:tasks.workunit.client.0.smithi081.stdout:4/866: unlink d1/d8f/l96 0 2024-04-23T14:50:01.552 INFO:tasks.workunit.client.1.smithi156.stdout:1/666: rename db/d25/d6b/f88 to db/d1f/d2d/d48/dab/dcf/fd0 0 2024-04-23T14:50:01.559 INFO:tasks.workunit.client.1.smithi156.stdout:2/588: mkdir d4/d13/d19/d4c/d5c/dd5 0 2024-04-23T14:50:01.559 INFO:tasks.workunit.client.1.smithi156.stdout:2/589: chown d4/f62 101281 1 2024-04-23T14:50:01.561 INFO:tasks.workunit.client.1.smithi156.stdout:7/634: getdents dc/d93 0 2024-04-23T14:50:01.562 INFO:tasks.workunit.client.0.smithi081.stdout:3/868: chown d4/d7/f6f 16969143 1 2024-04-23T14:50:01.562 INFO:tasks.workunit.client.0.smithi081.stdout:3/869: write d4/d7/d7f/d85/d9d/dac/dc7/fed [182237,111982] 0 2024-04-23T14:50:01.568 INFO:tasks.workunit.client.0.smithi081.stdout:6/924: dwrite d1/d51/d65/d78/fc8 [0,4194304] 0 2024-04-23T14:50:01.575 INFO:tasks.workunit.client.1.smithi156.stdout:9/526: dread d1/d2/d23/d49/d4c/fb2 [0,4194304] 0 2024-04-23T14:50:01.579 INFO:tasks.workunit.client.0.smithi081.stdout:2/937: link d1/d11/l133 d1/d33/d45/de9/l140 0 2024-04-23T14:50:01.581 INFO:tasks.workunit.client.1.smithi156.stdout:1/667: mkdir db/d1f/dd1 0 2024-04-23T14:50:01.583 INFO:tasks.workunit.client.0.smithi081.stdout:4/867: truncate d1/d1d/f26 603827 0 2024-04-23T14:50:01.589 INFO:tasks.workunit.client.1.smithi156.stdout:9/527: creat d1/d2/d3e/fb4 x:0 0 0 2024-04-23T14:50:01.591 INFO:tasks.workunit.client.1.smithi156.stdout:7/635: dread dc/d1d/d24/d5a/f76 [0,4194304] 0 2024-04-23T14:50:01.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.591+0000 7f8d95200700 1 -- 172.21.15.81:0/2178105516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d900fe040 msgr2=0x7f8d900fe4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:01.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.591+0000 7f8d95200700 1 --2- 172.21.15.81:0/2178105516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d900fe040 0x7f8d900fe4b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c004940 tx=0x7f8d7c009e30 comp rx=0 tx=0).stop 2024-04-23T14:50:01.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.592+0000 7f8d95200700 1 -- 172.21.15.81:0/2178105516 shutdown_connections 2024-04-23T14:50:01.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.592+0000 7f8d95200700 1 --2- 172.21.15.81:0/2178105516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d900fe040 0x7f8d900fe4b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:01.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.592+0000 7f8d95200700 1 --2- 172.21.15.81:0/2178105516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d900fce40 0x7f8d900fd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:01.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.592+0000 7f8d95200700 1 -- 172.21.15.81:0/2178105516 >> 172.21.15.81:0/2178105516 conn(0x7f8d900f8590 msgr2=0x7f8d900fa9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:01.594 INFO:tasks.workunit.client.1.smithi156.stdout:1/668: truncate db/d25/f64 4035858 0 2024-04-23T14:50:01.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.592+0000 7f8d95200700 1 -- 172.21.15.81:0/2178105516 shutdown_connections 2024-04-23T14:50:01.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.592+0000 7f8d95200700 1 -- 172.21.15.81:0/2178105516 wait complete. 2024-04-23T14:50:01.594 INFO:tasks.workunit.client.0.smithi081.stdout:2/938: dread d1/d11/d21/d52/d8b/d8f/fec [0,4194304] 0 2024-04-23T14:50:01.595 INFO:tasks.workunit.client.0.smithi081.stdout:2/939: chown d1/d33/d45/d11b/f12d 697671 1 2024-04-23T14:50:01.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.593+0000 7f8d95200700 1 Processor -- start 2024-04-23T14:50:01.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.594+0000 7f8d95200700 1 -- start start 2024-04-23T14:50:01.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.594+0000 7f8d95200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d900fce40 0x7f8d9010fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:01.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.594+0000 7f8d95200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d900fe040 0x7f8d90110130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:01.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.594+0000 7f8d95200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d90110730 con 0x7f8d900fce40 2024-04-23T14:50:01.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.594+0000 7f8d95200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d90110f80 con 0x7f8d900fe040 2024-04-23T14:50:01.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.595+0000 7f8d8de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d900fce40 0x7f8d9010fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:01.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.595+0000 7f8d8d400700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d900fe040 0x7f8d90110130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:01.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.595+0000 7f8d8d400700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d900fe040 0x7f8d90110130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.81:33200/0 (socket says 172.21.15.81:33200) 2024-04-23T14:50:01.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.595+0000 7f8d8d400700 1 -- 172.21.15.81:0/1842281704 learned_addr learned my addr 172.21.15.81:0/1842281704 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:50:01.598 INFO:tasks.workunit.client.1.smithi156.stdout:2/590: rename d4/c22 to d4/d26/cd6 0 2024-04-23T14:50:01.598 INFO:tasks.workunit.client.1.smithi156.stdout:1/669: creat db/d1f/d2d/d48/fd2 x:0 0 0 2024-04-23T14:50:01.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.596+0000 7f8d8de00700 1 -- 172.21.15.81:0/1842281704 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d900fe040 msgr2=0x7f8d90110130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:01.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.596+0000 7f8d8de00700 1 --2- 172.21.15.81:0/1842281704 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d900fe040 0x7f8d90110130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:01.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.596+0000 7f8d8de00700 1 -- 172.21.15.81:0/1842281704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d7c005040 con 0x7f8d900fce40 2024-04-23T14:50:01.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.596+0000 7f8d8d400700 1 --2- 172.21.15.81:0/1842281704 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d900fe040 0x7f8d90110130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T14:50:01.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.597+0000 7f8d8de00700 1 --2- 172.21.15.81:0/1842281704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d900fce40 0x7f8d9010fbf0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8d900fdbb0 tx=0x7f8d8000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:01.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.597+0000 7f8d86000700 1 -- 172.21.15.81:0/1842281704 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d80007cc0 con 0x7f8d900fce40 2024-04-23T14:50:01.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.597+0000 7f8d86000700 1 -- 172.21.15.81:0/1842281704 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8d8000f040 con 0x7f8d900fce40 2024-04-23T14:50:01.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.597+0000 7f8d86000700 1 -- 172.21.15.81:0/1842281704 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d8000ca60 con 0x7f8d900fce40 2024-04-23T14:50:01.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.597+0000 7f8d95200700 1 -- 172.21.15.81:0/1842281704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d90111200 con 0x7f8d900fce40 2024-04-23T14:50:01.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.598+0000 7f8d95200700 1 -- 172.21.15.81:0/1842281704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d90111740 con 0x7f8d900fce40 2024-04-23T14:50:01.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.599+0000 7f8d95200700 1 -- 172.21.15.81:0/1842281704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d9005f5f0 con 0x7f8d900fce40 2024-04-23T14:50:01.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.600+0000 7f8d86000700 1 -- 172.21.15.81:0/1842281704 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f8d8000cbc0 con 0x7f8d900fce40 2024-04-23T14:50:01.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.602+0000 7f8d86000700 1 --2- 172.21.15.81:0/1842281704 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f8d7406bd40 0x7f8d7406e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:01.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.602+0000 7f8d86000700 1 -- 172.21.15.81:0/1842281704 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f8d8008a570 con 0x7f8d900fce40 2024-04-23T14:50:01.603 INFO:tasks.workunit.client.1.smithi156.stdout:8/604: sync 2024-04-23T14:50:01.603 INFO:tasks.workunit.client.1.smithi156.stdout:0/607: sync 2024-04-23T14:50:01.603 INFO:tasks.workunit.client.1.smithi156.stdout:0/608: write d0/fb1 [445145,2551] 0 2024-04-23T14:50:01.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.602+0000 7f8d8d400700 1 --2- 172.21.15.81:0/1842281704 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f8d7406bd40 0x7f8d7406e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:01.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.603+0000 7f8d8d400700 1 --2- 172.21.15.81:0/1842281704 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f8d7406bd40 0x7f8d7406e1f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c00b0d0 tx=0x7f8d7c009e30 comp rx=0 tx=0).ready entity=mgr.24373 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:01.604 INFO:tasks.workunit.client.1.smithi156.stdout:8/605: mknod d5/d4e/cd1 0 2024-04-23T14:50:01.605 INFO:tasks.workunit.client.1.smithi156.stdout:8/606: getdents d5/d9/d10 0 2024-04-23T14:50:01.605 INFO:tasks.workunit.client.1.smithi156.stdout:8/607: chown d5/d39 5099 1 2024-04-23T14:50:01.607 INFO:tasks.workunit.client.0.smithi081.stdout:4/868: dread d1/d4/d6f/fb4 [0,4194304] 0 2024-04-23T14:50:01.607 INFO:tasks.workunit.client.1.smithi156.stdout:8/608: creat d5/d9/d10/d1d/d21/fd2 x:0 0 0 2024-04-23T14:50:01.607 INFO:tasks.workunit.client.1.smithi156.stdout:8/609: truncate d5/d39/f9e 1031192 0 2024-04-23T14:50:01.607 INFO:tasks.workunit.client.1.smithi156.stdout:8/610: creat d5/d9/d5a/d5c/d6b/fd3 x:0 0 0 2024-04-23T14:50:01.608 INFO:tasks.workunit.client.0.smithi081.stdout:4/869: getdents d1/d1d/d39/d8d 0 2024-04-23T14:50:01.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:01.610+0000 7f8d86000700 1 -- 172.21.15.81:0/1842281704 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f8d80057720 con 0x7f8d900fce40 2024-04-23T14:50:01.615 INFO:tasks.workunit.client.1.smithi156.stdout:9/528: dread d1/d2/d23/f27 [8388608,4194304] 0 2024-04-23T14:50:01.617 INFO:tasks.workunit.client.1.smithi156.stdout:9/529: truncate d1/d2/d23/d49/d4c/d96/fa3 2957 0 2024-04-23T14:50:01.619 INFO:tasks.workunit.client.1.smithi156.stdout:9/530: creat d1/d2/d23/d49/d4c/fb5 x:0 0 0 2024-04-23T14:50:01.619 INFO:tasks.workunit.client.1.smithi156.stdout:9/531: dread - d1/d2/d3e/d50/d7a/d40/f72 zero size 2024-04-23T14:50:01.619 INFO:tasks.workunit.client.1.smithi156.stdout:9/532: truncate d1/d2/d3e/d50/d7a/dc/f8d 522862 0 2024-04-23T14:50:01.621 INFO:tasks.workunit.client.1.smithi156.stdout:9/533: mkdir d1/d2/d3e/d50/d7a/d40/d35/db6 0 2024-04-23T14:50:01.621 INFO:tasks.workunit.client.1.smithi156.stdout:9/534: chown d1/d2/d3e/d50/d7a/d17/d1f/d48/f4f 164953067 1 2024-04-23T14:50:01.621 INFO:tasks.workunit.client.1.smithi156.stdout:9/535: chown d1/f51 10150 1 2024-04-23T14:50:01.622 INFO:tasks.workunit.client.1.smithi156.stdout:9/536: getdents d1/d2 0 2024-04-23T14:50:01.630 INFO:tasks.workunit.client.1.smithi156.stdout:9/537: write d1/d2/d3e/d50/d7a/d17/f82 [560530,34796] 0 2024-04-23T14:50:01.630 INFO:tasks.workunit.client.1.smithi156.stdout:9/538: creat d1/d2/d23/d49/d4c/d96/fb7 x:0 0 0 2024-04-23T14:50:01.630 INFO:tasks.workunit.client.1.smithi156.stdout:9/539: write d1/d2/d3e/d50/d7a/d17/d1f/d48/f4f [3480738,93944] 0 2024-04-23T14:50:01.631 INFO:tasks.workunit.client.1.smithi156.stdout:9/540: rename d1/d2/d23/c68 to d1/d2/d23/d49/d4c/cb8 0 2024-04-23T14:50:01.632 INFO:tasks.workunit.client.1.smithi156.stdout:0/609: dread d0/d4/fe [0,4194304] 0 2024-04-23T14:50:01.633 INFO:tasks.workunit.client.0.smithi081.stdout:4/870: dread d1/d8f/d94/fdb [0,4194304] 0 2024-04-23T14:50:01.633 INFO:tasks.workunit.client.1.smithi156.stdout:9/541: mkdir d1/d2/d3e/d50/d7a/d17/d1f/db9 0 2024-04-23T14:50:01.633 INFO:tasks.workunit.client.1.smithi156.stdout:0/610: creat d0/d16/dbf/d3f/fc8 x:0 0 0 2024-04-23T14:50:01.634 INFO:tasks.workunit.client.0.smithi081.stdout:4/871: creat d1/d4/d6f/f115 x:0 0 0 2024-04-23T14:50:01.635 INFO:tasks.workunit.client.1.smithi156.stdout:9/542: creat d1/d2/d3e/d55/d6f/fba x:0 0 0 2024-04-23T14:50:01.636 INFO:tasks.workunit.client.1.smithi156.stdout:9/543: fsync d1/d2/d3e/d50/d7a/d40/f72 0 2024-04-23T14:50:01.636 INFO:tasks.workunit.client.1.smithi156.stdout:9/544: dread - d1/d2/d23/d49/d4c/d96/fb7 zero size 2024-04-23T14:50:01.636 INFO:tasks.workunit.client.1.smithi156.stdout:0/611: rmdir d0/d16/d3a/d2a 39 2024-04-23T14:50:01.636 INFO:tasks.workunit.client.0.smithi081.stdout:4/872: rmdir d1/d4/d6f/d70/daf/d89/da9 39 2024-04-23T14:50:01.638 INFO:tasks.workunit.client.0.smithi081.stdout:4/873: mknod d1/d4/d6f/d70/daf/d8c/d99/c116 0 2024-04-23T14:50:01.638 INFO:tasks.workunit.client.0.smithi081.stdout:4/874: write d1/d1d/d39/f73 [4362019,26447] 0 2024-04-23T14:50:01.638 INFO:tasks.workunit.client.0.smithi081.stdout:4/875: write d1/d1d/ff9 [731300,106171] 0 2024-04-23T14:50:01.638 INFO:tasks.workunit.client.0.smithi081.stdout:4/876: dread - d1/d8b/fe1 zero size 2024-04-23T14:50:01.639 INFO:tasks.workunit.client.0.smithi081.stdout:4/877: link d1/d4/d6f/d70/daf/fcc d1/d4/d11/d9d/dac/de7/f117 0 2024-04-23T14:50:01.663 INFO:tasks.workunit.client.0.smithi081.stdout:4/878: dread d1/d4/d11/f7f [8388608,4194304] 0 2024-04-23T14:50:01.679 INFO:tasks.workunit.client.0.smithi081.stdout:4/879: read d1/d1d/d59/f65 [4117950,57649] 0 2024-04-23T14:50:01.679 INFO:tasks.workunit.client.0.smithi081.stdout:4/880: stat d1/d4/dc/c4d 0 2024-04-23T14:50:01.679 INFO:tasks.workunit.client.0.smithi081.stdout:4/881: chown d1/d4/d11/f28 1569 1 2024-04-23T14:50:01.717 INFO:tasks.workunit.client.0.smithi081.stdout:9/857: dwrite d3/f9 [0,4194304] 0 2024-04-23T14:50:01.717 INFO:tasks.workunit.client.0.smithi081.stdout:9/858: truncate d3/de/d14/f3d 7994121 0 2024-04-23T14:50:01.717 INFO:tasks.workunit.client.0.smithi081.stdout:9/859: creat d3/de/d1d/dcc/f117 x:0 0 0 2024-04-23T14:50:01.718 INFO:tasks.workunit.client.1.smithi156.stdout:5/638: sync 2024-04-23T14:50:01.718 INFO:tasks.workunit.client.1.smithi156.stdout:5/639: write d1/d11/f5e [163441,81684] 0 2024-04-23T14:50:01.720 INFO:tasks.workunit.client.0.smithi081.stdout:6/925: dread d1/d51/d65/d13/d16/f103 [0,4194304] 0 2024-04-23T14:50:01.720 INFO:tasks.workunit.client.0.smithi081.stdout:6/926: truncate d1/d51/f112 1824094 0 2024-04-23T14:50:01.720 INFO:tasks.workunit.client.1.smithi156.stdout:6/673: dwrite d3/d16/d46/d2b/d6e/ff1 [0,4194304] 0 2024-04-23T14:50:01.720 INFO:tasks.workunit.client.1.smithi156.stdout:0/612: dwrite d0/d16/d43/fbb [0,4194304] 0 2024-04-23T14:50:01.721 INFO:tasks.workunit.client.0.smithi081.stdout:9/860: unlink d3/d67/faf 0 2024-04-23T14:50:01.725 INFO:tasks.workunit.client.1.smithi156.stdout:4/546: dwrite d0/f80 [0,4194304] 0 2024-04-23T14:50:01.725 INFO:tasks.workunit.client.0.smithi081.stdout:9/861: truncate d3/d67/da5/f10d 4100093 0 2024-04-23T14:50:01.725 INFO:tasks.workunit.client.0.smithi081.stdout:9/862: chown d3/de/d1d/d54/d68/f7e 764815386 1 2024-04-23T14:50:01.726 INFO:tasks.workunit.client.1.smithi156.stdout:6/674: mknod d3/d16/d5c/cfa 0 2024-04-23T14:50:01.726 INFO:tasks.workunit.client.1.smithi156.stdout:6/675: fdatasync d3/d16/f39 0 2024-04-23T14:50:01.726 INFO:tasks.workunit.client.0.smithi081.stdout:4/882: dread d1/d4/dc/fa0 [0,4194304] 0 2024-04-23T14:50:01.726 INFO:tasks.workunit.client.1.smithi156.stdout:6/676: write d3/d16/d46/d9d/fbe [650490,129077] 0 2024-04-23T14:50:01.726 INFO:tasks.workunit.client.1.smithi156.stdout:6/677: chown d3/d16/d5c/cfa 201838117 1 2024-04-23T14:50:01.727 INFO:tasks.workunit.client.0.smithi081.stdout:9/863: creat d3/de/d1d/d54/d10c/f118 x:0 0 0 2024-04-23T14:50:01.728 INFO:tasks.workunit.client.1.smithi156.stdout:0/613: truncate d0/d4/d22/f96 1424556 0 2024-04-23T14:50:01.733 INFO:tasks.workunit.client.0.smithi081.stdout:4/883: rename d1/d4/d11/f6d to d1/d4f/d87/f118 0 2024-04-23T14:50:01.733 INFO:tasks.workunit.client.0.smithi081.stdout:4/884: readlink d1/d1d/d39/lca 0 2024-04-23T14:50:01.733 INFO:tasks.workunit.client.0.smithi081.stdout:4/885: readlink d1/d1d/l4b 0 2024-04-23T14:50:01.735 INFO:tasks.workunit.client.0.smithi081.stdout:4/886: creat d1/d4/d6f/d70/d9c/f119 x:0 0 0 2024-04-23T14:50:01.741 INFO:tasks.workunit.client.1.smithi156.stdout:7/636: dread dc/d1d/f23 [0,4194304] 0 2024-04-23T14:50:01.742 INFO:tasks.workunit.client.1.smithi156.stdout:4/547: mknod d0/d76/cbb 0 2024-04-23T14:50:01.742 INFO:tasks.workunit.client.1.smithi156.stdout:7/637: truncate dc/d1d/d41/f47 4503243 0 2024-04-23T14:50:01.742 INFO:tasks.workunit.client.1.smithi156.stdout:7/638: fdatasync dc/d46/d58/f71 0 2024-04-23T14:50:01.743 INFO:tasks.workunit.client.0.smithi081.stdout:9/864: rename d3/de/d14/d5e/f96 to d3/de/f119 0 2024-04-23T14:50:01.746 INFO:tasks.workunit.client.1.smithi156.stdout:6/678: creat d3/da/d1d/d59/deb/ffb x:0 0 0 2024-04-23T14:50:01.753 INFO:tasks.workunit.client.1.smithi156.stdout:2/591: write d4/d13/d19/d4c/f68 [813365,123529] 0 2024-04-23T14:50:01.755 INFO:tasks.workunit.client.0.smithi081.stdout:9/865: creat d3/de/d1d/d5b/f11a x:0 0 0 2024-04-23T14:50:01.755 INFO:tasks.workunit.client.0.smithi081.stdout:9/866: write d3/d1a/f63 [7548166,108043] 0 2024-04-23T14:50:01.765 INFO:tasks.workunit.client.1.smithi156.stdout:7/639: symlink dc/d2c/dbe/dc2/lc8 0 2024-04-23T14:50:01.769 INFO:tasks.workunit.client.1.smithi156.stdout:6/679: rmdir d3/d16/d46/d64/d77/ddf 0 2024-04-23T14:50:01.771 INFO:tasks.workunit.client.1.smithi156.stdout:6/680: fsync d3/da/d1d/d59/d9c/fbd 0 2024-04-23T14:50:01.771 INFO:tasks.workunit.client.1.smithi156.stdout:3/545: dwrite d4/db/dd/d1d/f3b [4194304,4194304] 0 2024-04-23T14:50:01.774 INFO:tasks.workunit.client.1.smithi156.stdout:5/640: dwrite d1/d11/d18/f32 [0,4194304] 0 2024-04-23T14:50:01.774 INFO:tasks.workunit.client.1.smithi156.stdout:1/670: dread db/d1f/d2d/fc5 [0,4194304] 0 2024-04-23T14:50:01.774 INFO:tasks.workunit.client.1.smithi156.stdout:1/671: chown db/d1f/d28/f37 18408 1 2024-04-23T14:50:01.774 INFO:tasks.workunit.client.1.smithi156.stdout:8/611: dwrite d5/d39/d99/f9f [0,4194304] 0 2024-04-23T14:50:01.775 INFO:tasks.workunit.client.1.smithi156.stdout:2/592: mkdir d4/d21/d42/d75/dd7 0 2024-04-23T14:50:01.776 INFO:tasks.workunit.client.0.smithi081.stdout:9/867: mkdir d3/de/d1d/d5b/d7b/d90/d11b 0 2024-04-23T14:50:01.780 INFO:tasks.workunit.client.1.smithi156.stdout:4/548: rmdir d0/d8/d1e/d4a/d77 39 2024-04-23T14:50:01.780 INFO:tasks.workunit.client.1.smithi156.stdout:4/549: chown d0/c2b 89857 1 2024-04-23T14:50:01.780 INFO:tasks.workunit.client.0.smithi081.stdout:9/868: mknod d3/de/d1d/dcc/c11c 0 2024-04-23T14:50:01.784 INFO:tasks.workunit.client.1.smithi156.stdout:7/640: mkdir dc/d1d/d24/dc9 0 2024-04-23T14:50:01.789 INFO:tasks.workunit.client.1.smithi156.stdout:3/546: symlink d4/db/dd/d1d/d1e/d74/d93/laf 0 2024-04-23T14:50:01.790 INFO:tasks.workunit.client.1.smithi156.stdout:3/547: creat d4/db/dd/d1d/d1e/d42/d76/fb0 x:0 0 0 2024-04-23T14:50:01.801 INFO:tasks.workunit.client.0.smithi081.stdout:6/927: dwrite d1/d51/d65/d8/db1/f12c [0,4194304] 0 2024-04-23T14:50:01.802 INFO:tasks.workunit.client.0.smithi081.stdout:7/877: dwrite d3/d21/d31/d33/d4b/f60 [0,4194304] 0 2024-04-23T14:50:01.802 INFO:tasks.workunit.client.0.smithi081.stdout:7/878: dread - d3/d11/d2c/d75/d8e/dc2/f135 zero size 2024-04-23T14:50:01.806 INFO:tasks.workunit.client.1.smithi156.stdout:6/681: dread d3/d16/d46/d2b/d3b/f69 [0,4194304] 0 2024-04-23T14:50:01.809 INFO:tasks.workunit.client.0.smithi081.stdout:4/887: dwrite d1/d4/d6f/d70/daf/f71 [0,4194304] 0 2024-04-23T14:50:01.819 INFO:tasks.workunit.client.1.smithi156.stdout:1/672: stat l6 0 2024-04-23T14:50:01.819 INFO:tasks.workunit.client.1.smithi156.stdout:4/550: write d0/f80 [4074359,108790] 0 2024-04-23T14:50:01.819 INFO:tasks.workunit.client.1.smithi156.stdout:8/612: unlink d5/d4e/f83 0 2024-04-23T14:50:01.823 INFO:tasks.workunit.client.0.smithi081.stdout:6/928: dread d1/d2/f1d [0,4194304] 0 2024-04-23T14:50:01.827 INFO:tasks.workunit.client.1.smithi156.stdout:3/548: mknod d4/db/dd/d1d/d1e/d74/d93/dad/cb1 0 2024-04-23T14:50:01.833 INFO:tasks.workunit.client.1.smithi156.stdout:6/682: truncate d3/da/d1d/d27/f51 347472 0 2024-04-23T14:50:01.833 INFO:tasks.workunit.client.1.smithi156.stdout:6/683: write d3/d16/d5c/d6a/fc9 [388421,106061] 0 2024-04-23T14:50:01.834 INFO:tasks.workunit.client.1.smithi156.stdout:6/684: chown d3/da/d1d/d27/fa6 7 1 2024-04-23T14:50:01.839 INFO:tasks.workunit.client.1.smithi156.stdout:4/551: symlink d0/df/d75/lbc 0 2024-04-23T14:50:01.841 INFO:tasks.workunit.client.1.smithi156.stdout:9/545: getdents d1/d2/d23/d49/d4c 0 2024-04-23T14:50:01.846 INFO:tasks.workunit.client.1.smithi156.stdout:0/614: dwrite d0/d4/d22/d58/d9a/d44/fc7 [0,4194304] 0 2024-04-23T14:50:01.848 INFO:tasks.workunit.client.0.smithi081.stdout:4/888: mknod d1/d4/d6f/d70/daf/d89/c11a 0 2024-04-23T14:50:01.849 INFO:tasks.workunit.client.1.smithi156.stdout:8/613: creat d5/fd4 x:0 0 0 2024-04-23T14:50:01.849 INFO:tasks.workunit.client.1.smithi156.stdout:8/614: fsync d5/d39/d99/fc2 0 2024-04-23T14:50:01.858 INFO:tasks.workunit.client.1.smithi156.stdout:6/685: rename d3/da/d1d/d59/d72/dcc/ff2 to d3/da/d1d/d59/d72/dcc/ffc 0 2024-04-23T14:50:01.859 INFO:tasks.workunit.client.1.smithi156.stdout:6/686: fsync d3/da/f4f 0 2024-04-23T14:50:01.865 INFO:tasks.workunit.client.0.smithi081.stdout:6/929: mkdir d1/d51/d65/d13/d16/dd0/df7/dd2/d129/d146 0 2024-04-23T14:50:01.865 INFO:tasks.workunit.client.0.smithi081.stdout:6/930: chown d1/d51/d65/d8/d2e/d58/f61 41537 1 2024-04-23T14:50:01.866 INFO:tasks.workunit.client.1.smithi156.stdout:4/552: getdents d0/df/d55 0 2024-04-23T14:50:01.868 INFO:tasks.workunit.client.0.smithi081.stdout:7/879: dwrite d3/d21/d41/d7c/dc3/d7f/ddd/fe4 [0,4194304] 0 2024-04-23T14:50:01.869 INFO:tasks.workunit.client.0.smithi081.stdout:6/931: dread d1/d51/d65/d1c/d66/fd1 [0,4194304] 0 2024-04-23T14:50:01.869 INFO:tasks.workunit.client.1.smithi156.stdout:5/641: dwrite d1/d3/f49 [0,4194304] 0 2024-04-23T14:50:01.870 INFO:tasks.workunit.client.1.smithi156.stdout:9/546: truncate d1/d2/d23/f27 2277226 0 2024-04-23T14:50:01.870 INFO:tasks.workunit.client.1.smithi156.stdout:9/547: creat d1/d2/d3e/d55/d9c/fbb x:0 0 0 2024-04-23T14:50:01.878 INFO:tasks.workunit.client.1.smithi156.stdout:8/615: creat d5/d4e/dc7/fd5 x:0 0 0 2024-04-23T14:50:01.880 INFO:tasks.workunit.client.1.smithi156.stdout:2/593: dwrite d4/d21/d42/f6e [0,4194304] 0 2024-04-23T14:50:01.880 INFO:tasks.workunit.client.1.smithi156.stdout:3/549: dread d4/db/dd/d1d/d61/d8d/d91/f92 [0,4194304] 0 2024-04-23T14:50:01.887 INFO:tasks.workunit.client.1.smithi156.stdout:6/687: mknod d3/d16/d46/d64/cfd 0 2024-04-23T14:50:01.887 INFO:tasks.workunit.client.0.smithi081.stdout:4/889: creat d1/d1d/d39/f11b x:0 0 0 2024-04-23T14:50:01.889 INFO:tasks.workunit.client.1.smithi156.stdout:7/641: dwrite dc/d1d/f95 [0,4194304] 0 2024-04-23T14:50:01.890 INFO:tasks.workunit.client.1.smithi156.stdout:7/642: read dc/d1d/d48/f5b [919,113942] 0 2024-04-23T14:50:01.891 INFO:tasks.workunit.client.1.smithi156.stdout:7/643: write dc/d46/fb9 [939873,3668] 0 2024-04-23T14:50:01.891 INFO:tasks.workunit.client.1.smithi156.stdout:4/553: unlink d0/df/d55/d68/d53/f82 0 2024-04-23T14:50:01.892 INFO:tasks.workunit.client.1.smithi156.stdout:5/642: dread d1/d17/f7d [0,4194304] 0 2024-04-23T14:50:01.892 INFO:tasks.workunit.client.1.smithi156.stdout:5/643: dread - d1/d3/d24/da0/d3e/f73 zero size 2024-04-23T14:50:01.897 INFO:tasks.workunit.client.1.smithi156.stdout:9/548: mkdir d1/d2/d23/d49/d4b/dbc 0 2024-04-23T14:50:01.897 INFO:tasks.workunit.client.1.smithi156.stdout:7/644: dread dc/d1d/d48/f5b [0,4194304] 0 2024-04-23T14:50:01.898 INFO:tasks.workunit.client.1.smithi156.stdout:9/549: chown d1/d2/d23/d49/d4c/fb2 71808 1 2024-04-23T14:50:01.899 INFO:tasks.workunit.client.0.smithi081.stdout:4/890: dread d1/d4/d11/d9d/dac/fa4 [0,4194304] 0 2024-04-23T14:50:01.901 INFO:tasks.workunit.client.1.smithi156.stdout:8/616: rename d5/d9/d5a/d57/lbd to d5/d39/d99/ld6 0 2024-04-23T14:50:01.905 INFO:tasks.workunit.client.0.smithi081.stdout:7/880: mknod d3/d21/d41/dd2/d10f/c138 0 2024-04-23T14:50:01.908 INFO:tasks.workunit.client.1.smithi156.stdout:3/550: creat d4/db/dd/d1d/d1e/d13/d5a/dab/fb2 x:0 0 0 2024-04-23T14:50:01.909 INFO:tasks.workunit.client.1.smithi156.stdout:3/551: readlink d4/db/dd/d1d/d1e/la7 0 2024-04-23T14:50:01.910 INFO:tasks.workunit.client.0.smithi081.stdout:6/932: truncate d1/d51/d65/d8/f41 1078871 0 2024-04-23T14:50:01.910 INFO:tasks.workunit.client.0.smithi081.stdout:6/933: chown d1/d51/d65/d78/d132/f137 11267627 1 2024-04-23T14:50:01.915 INFO:tasks.workunit.client.1.smithi156.stdout:7/645: dread dc/f17 [0,4194304] 0 2024-04-23T14:50:01.922 INFO:tasks.workunit.client.0.smithi081.stdout:4/891: write d1/d4/d11/d75/f88 [735264,49404] 0 2024-04-23T14:50:01.922 INFO:tasks.workunit.client.0.smithi081.stdout:6/934: rename d1/d51/d65/d13/d16/dd0/df7/da1/dc1/dc9/l10d to d1/d51/d65/d13/d16/dd0/df7/da1/dc1/dc9/dcf/d101/d123/l147 0 2024-04-23T14:50:01.928 INFO:tasks.workunit.client.1.smithi156.stdout:5/644: creat d1/d11/d18/d52/d85/d96/db4/fcc x:0 0 0 2024-04-23T14:50:01.928 INFO:tasks.workunit.client.1.smithi156.stdout:5/645: chown d1/c10 15885822 1 2024-04-23T14:50:01.928 INFO:tasks.workunit.client.1.smithi156.stdout:5/646: write d1/d3/d24/da0/fbf [27925,14332] 0 2024-04-23T14:50:01.930 INFO:tasks.workunit.client.1.smithi156.stdout:9/550: unlink d1/d2/d3e/d50/d7a/dc/f92 0 2024-04-23T14:50:01.932 INFO:tasks.workunit.client.1.smithi156.stdout:0/615: dwrite d0/d16/d3a/d1e/f6e [0,4194304] 0 2024-04-23T14:50:01.933 INFO:tasks.workunit.client.0.smithi081.stdout:6/935: getdents d1/d2/d5a 0 2024-04-23T14:50:01.938 INFO:tasks.workunit.client.1.smithi156.stdout:8/617: unlink d5/d9/d36/ca0 0 2024-04-23T14:50:01.938 INFO:tasks.workunit.client.1.smithi156.stdout:8/618: read - d5/d9/d36/d84/d8c/fa7 zero size 2024-04-23T14:50:01.942 INFO:tasks.workunit.client.1.smithi156.stdout:3/552: chown d4/db/c54 49093 1 2024-04-23T14:50:01.943 INFO:tasks.workunit.client.0.smithi081.stdout:6/936: getdents d1/d51/d65/d13/d16/dd0/df7/da1/dc1/dc9/dcf 0 2024-04-23T14:50:01.944 INFO:tasks.workunit.client.1.smithi156.stdout:1/673: dwrite db/d1f/d2d/d48/fd2 [0,4194304] 0 2024-04-23T14:50:01.949 INFO:tasks.workunit.client.1.smithi156.stdout:7/646: mkdir dc/d46/dca 0 2024-04-23T14:50:01.950 INFO:tasks.workunit.client.0.smithi081.stdout:6/937: rename d1/d51/d65/d78/f9b to d1/d51/d65/d78/d132/f148 0 2024-04-23T14:50:01.950 INFO:tasks.workunit.client.0.smithi081.stdout:6/938: write d1/d51/d65/f86 [300334,92236] 0 2024-04-23T14:50:01.950 INFO:tasks.workunit.client.0.smithi081.stdout:6/939: stat d1/d51/d65/d8/d2e/d59/d80/d90/ffe 0 2024-04-23T14:50:01.952 INFO:tasks.workunit.client.1.smithi156.stdout:5/647: dread d1/d17/f7d [0,4194304] 0 2024-04-23T14:50:01.959 INFO:tasks.workunit.client.1.smithi156.stdout:9/551: mkdir d1/d2/d23/dbd 0 2024-04-23T14:50:01.967 INFO:tasks.workunit.client.1.smithi156.stdout:0/616: rename d0/d16/d43/c4d to d0/d4/cc9 0 2024-04-23T14:50:01.969 INFO:tasks.workunit.client.1.smithi156.stdout:2/594: dwrite d4/d21/d42/d9f/fb8 [0,4194304] 0 2024-04-23T14:50:01.969 INFO:tasks.workunit.client.1.smithi156.stdout:8/619: unlink d5/d9/d10/d1d/f7a 0 2024-04-23T14:50:01.971 INFO:tasks.workunit.client.1.smithi156.stdout:3/553: creat d4/db/dd/d20/fb3 x:0 0 0 2024-04-23T14:50:01.972 INFO:tasks.workunit.client.1.smithi156.stdout:3/554: write d4/db/dd/d20/fb3 [897045,118324] 0 2024-04-23T14:50:01.972 INFO:tasks.workunit.client.1.smithi156.stdout:3/555: fdatasync d4/db/dd/d1d/d1e/d13/f1a 0 2024-04-23T14:50:01.973 INFO:tasks.workunit.client.0.smithi081.stdout:6/940: dread d1/d51/d65/d1c/d6e/d7d/faf [0,4194304] 0 2024-04-23T14:50:01.976 INFO:tasks.workunit.client.1.smithi156.stdout:1/674: truncate db/d1f/d2f/f56 1626964 0 2024-04-23T14:50:01.976 INFO:tasks.workunit.client.1.smithi156.stdout:1/675: write db/d25/d30/d38/d40/f9a [376126,81996] 0 2024-04-23T14:50:01.976 INFO:tasks.workunit.client.1.smithi156.stdout:1/676: fsync db/d1f/d2f/f55 0 2024-04-23T14:50:01.977 INFO:tasks.workunit.client.1.smithi156.stdout:5/648: mknod d1/d3/d24/ccd 0 2024-04-23T14:50:01.977 INFO:tasks.workunit.client.1.smithi156.stdout:5/649: fsync d1/d11/d18/d52/f7f 0 2024-04-23T14:50:01.979 INFO:tasks.workunit.client.1.smithi156.stdout:9/552: rename d1/d2/d3e/d50/d7a/dc/f41 to d1/d2/d23/fbe 0 2024-04-23T14:50:01.982 INFO:tasks.workunit.client.1.smithi156.stdout:0/617: unlink d0/d16/d3a/d2a/c6d 0 2024-04-23T14:50:01.982 INFO:tasks.workunit.client.0.smithi081.stdout:5/977: sync 2024-04-23T14:50:01.984 INFO:tasks.workunit.client.0.smithi081.stdout:7/881: dwrite d3/d21/d31/d33/d52/fec [0,4194304] 0 2024-04-23T14:50:01.985 INFO:tasks.workunit.client.1.smithi156.stdout:6/688: dwrite d3/f34 [0,4194304] 0 2024-04-23T14:50:01.986 INFO:tasks.workunit.client.1.smithi156.stdout:4/554: rmdir d0/df/d55/d68 39 2024-04-23T14:50:01.990 INFO:tasks.workunit.client.0.smithi081.stdout:5/978: write d17/d18/f48 [96981,116350] 0 2024-04-23T14:50:01.991 INFO:tasks.workunit.client.0.smithi081.stdout:6/941: write d1/d51/d7b/d91/f9f [2979300,8427] 0 2024-04-23T14:50:01.994 INFO:tasks.workunit.client.1.smithi156.stdout:2/595: unlink d4/d26/f51 0 2024-04-23T14:50:01.997 INFO:tasks.workunit.client.0.smithi081.stdout:7/882: mkdir d3/d21/d41/dbb/d139 0 2024-04-23T14:50:01.999 INFO:tasks.workunit.client.1.smithi156.stdout:3/556: creat d4/db/fb4 x:0 0 0 2024-04-23T14:50:02.006 INFO:tasks.workunit.client.0.smithi081.stdout:5/979: mknod d17/d1f/d42/d9b/d9e/c157 0 2024-04-23T14:50:02.006 INFO:tasks.workunit.client.0.smithi081.stdout:5/980: truncate d17/d18/dff/fb5 937264 0 2024-04-23T14:50:02.006 INFO:tasks.workunit.client.0.smithi081.stdout:5/981: readlink d17/d1f/d42/d9b/d9e/l156 0 2024-04-23T14:50:02.011 INFO:tasks.workunit.client.1.smithi156.stdout:0/618: read d0/d16/d3a/d2a/d1d/d2d/f8c [1347550,5303] 0 2024-04-23T14:50:02.011 INFO:tasks.workunit.client.1.smithi156.stdout:0/619: creat d0/d16/d3a/d2a/d1d/d2d/d6b/fca x:0 0 0 2024-04-23T14:50:02.011 INFO:tasks.workunit.client.1.smithi156.stdout:0/620: readlink d0/d16/d3a/d2a/d1d/d2d/d6b/lba 0 2024-04-23T14:50:02.011 INFO:tasks.workunit.client.1.smithi156.stdout:0/621: truncate d0/d4/d22/d58/d9a/f6f 960020 0 2024-04-23T14:50:02.011 INFO:tasks.workunit.client.1.smithi156.stdout:0/622: chown d0/d16/d3a/f6a 20601375 1 2024-04-23T14:50:02.011 INFO:tasks.workunit.client.1.smithi156.stdout:7/647: dwrite dc/d1d/d48/f6b [0,4194304] 0 2024-04-23T14:50:02.011 INFO:tasks.workunit.client.0.smithi081.stdout:6/942: dread d1/d51/d65/d8/d2e/f2f [0,4194304] 0 2024-04-23T14:50:02.012 INFO:tasks.workunit.client.1.smithi156.stdout:1/677: creat db/d1f/d2f/d47/d71/fd3 x:0 0 0 2024-04-23T14:50:02.012 INFO:tasks.workunit.client.0.smithi081.stdout:7/883: mknod d3/d21/d31/d50/c13a 0 2024-04-23T14:50:02.015 INFO:tasks.workunit.client.1.smithi156.stdout:5/650: mkdir d1/d11/d18/d19/d9a/dce 0 2024-04-23T14:50:02.016 INFO:tasks.workunit.client.1.smithi156.stdout:8/620: rename d5/d9/d5a/d57/c9b to d5/d9/d5a/cd7 0 2024-04-23T14:50:02.017 INFO:tasks.workunit.client.1.smithi156.stdout:5/651: write d1/f38 [1648903,75238] 0 2024-04-23T14:50:02.020 INFO:tasks.workunit.client.0.smithi081.stdout:6/943: truncate d1/d51/d65/d8/db1/fdc 552047 0 2024-04-23T14:50:02.020 INFO:tasks.workunit.client.0.smithi081.stdout:6/944: readlink d1/d51/d65/d8/db1/ld3 0 2024-04-23T14:50:02.022 INFO:tasks.workunit.client.1.smithi156.stdout:6/689: getdents d3/d16/d1e 0 2024-04-23T14:50:02.025 INFO:tasks.workunit.client.1.smithi156.stdout:4/555: mknod d0/df/cbd 0 2024-04-23T14:50:02.027 INFO:tasks.workunit.client.1.smithi156.stdout:2/596: chown d4/c2b 1 1 2024-04-23T14:50:02.027 INFO:tasks.workunit.client.1.smithi156.stdout:2/597: dread - d4/d21/d42/d75/fbd zero size 2024-04-23T14:50:02.027 INFO:tasks.workunit.client.1.smithi156.stdout:2/598: truncate d4/d21/d42/d75/d8e/fb4 58354 0 2024-04-23T14:50:02.035 INFO:tasks.workunit.client.1.smithi156.stdout:8/621: dread d5/d9/d5a/d5c/f85 [0,4194304] 0 2024-04-23T14:50:02.035 INFO:tasks.workunit.client.1.smithi156.stdout:8/622: read - d5/d39/d99/fc2 zero size 2024-04-23T14:50:02.036 INFO:tasks.workunit.client.0.smithi081.stdout:6/945: write d1/d51/d65/d1c/d6e/d7d/f102 [5301642,104288] 0 2024-04-23T14:50:02.036 INFO:tasks.workunit.client.1.smithi156.stdout:1/678: mkdir db/d1f/d2d/d48/dd4 0 2024-04-23T14:50:02.037 INFO:tasks.workunit.client.1.smithi156.stdout:3/557: rename d4/db/dd/d1d/d1e/d74/d93/cac to d4/db/dd/d1d/d1e/d2b/cb5 0 2024-04-23T14:50:02.039 INFO:tasks.workunit.client.1.smithi156.stdout:5/652: symlink d1/d11/lcf 0 2024-04-23T14:50:02.039 INFO:tasks.workunit.client.0.smithi081.stdout:6/946: mknod d1/d51/d7b/d91/c149 0 2024-04-23T14:50:02.039 INFO:tasks.workunit.client.0.smithi081.stdout:6/947: write d1/d51/d65/d13/d16/dd0/df7/da1/dc1/dc9/f13f [326310,25543] 0 2024-04-23T14:50:02.042 INFO:tasks.workunit.client.0.smithi081.stdout:6/948: truncate d1/d2/f8f 10543930 0 2024-04-23T14:50:02.043 INFO:tasks.workunit.client.1.smithi156.stdout:9/553: rmdir d1/d2/d23 39 2024-04-23T14:50:02.045 INFO:tasks.workunit.client.1.smithi156.stdout:6/690: dread d3/da/fa2 [0,4194304] 0 2024-04-23T14:50:02.045 INFO:tasks.workunit.client.1.smithi156.stdout:6/691: write d3/d16/d46/d2b/d3b/d9e/fda [184656,120352] 0 2024-04-23T14:50:02.046 INFO:tasks.workunit.client.1.smithi156.stdout:4/556: mkdir d0/df/d55/d68/d53/d91/d95/db5/dbe 0 2024-04-23T14:50:02.046 INFO:tasks.workunit.client.1.smithi156.stdout:4/557: write d0/d8/d1e/da0/fb8 [546241,35227] 0 2024-04-23T14:50:02.047 INFO:tasks.workunit.client.1.smithi156.stdout:2/599: dread d4/f7 [0,4194304] 0 2024-04-23T14:50:02.047 INFO:tasks.workunit.client.1.smithi156.stdout:2/600: fsync d4/d21/d42/da1/fa2 0 2024-04-23T14:50:02.048 INFO:tasks.workunit.client.1.smithi156.stdout:7/648: getdents dc/d93/d6c/d88 0 2024-04-23T14:50:02.052 INFO:tasks.workunit.client.1.smithi156.stdout:8/623: symlink d5/d9/d36/d60/db8/d8a/ld8 0 2024-04-23T14:50:02.052 INFO:tasks.workunit.client.1.smithi156.stdout:8/624: dread - d5/d9/d36/d84/dc1/fc5 zero size 2024-04-23T14:50:02.056 INFO:tasks.workunit.client.1.smithi156.stdout:5/653: mknod d1/d11/d18/d19/d9a/cd0 0 2024-04-23T14:50:02.057 INFO:tasks.workunit.client.1.smithi156.stdout:3/558: symlink d4/db/dd/d1d/d1e/lb6 0 2024-04-23T14:50:02.057 INFO:tasks.workunit.client.1.smithi156.stdout:5/654: chown d1/d17/l1b 19 1 2024-04-23T14:50:02.057 INFO:tasks.workunit.client.1.smithi156.stdout:5/655: read d1/d17/f1a [1126405,129623] 0 2024-04-23T14:50:02.057 INFO:tasks.workunit.client.1.smithi156.stdout:3/559: creat d4/db/dd/d73/fb7 x:0 0 0 2024-04-23T14:50:02.057 INFO:tasks.workunit.client.1.smithi156.stdout:3/560: chown d4/db/dd/d1d/d61/d8d/f72 63569661 1 2024-04-23T14:50:02.061 INFO:tasks.workunit.client.1.smithi156.stdout:4/558: creat d0/df/d55/d68/d53/d9f/fbf x:0 0 0 2024-04-23T14:50:02.061 INFO:tasks.workunit.client.1.smithi156.stdout:2/601: mkdir d4/d13/d19/dd8 0 2024-04-23T14:50:02.061 INFO:tasks.workunit.client.1.smithi156.stdout:2/602: fdatasync d4/d21/faa 0 2024-04-23T14:50:02.067 INFO:tasks.workunit.client.0.smithi081.stdout:7/884: write d3/d21/d31/f40 [865158,40938] 0 2024-04-23T14:50:02.068 INFO:tasks.workunit.client.0.smithi081.stdout:7/885: write d3/d21/d41/d7c/f8f [583316,30052] 0 2024-04-23T14:50:02.068 INFO:tasks.workunit.client.0.smithi081.stdout:7/886: chown d3/d21/d31/d33/l37 4 1 2024-04-23T14:50:02.068 INFO:tasks.workunit.client.0.smithi081.stdout:7/887: chown d3/d21/d41/d7c/cff 3293886 1 2024-04-23T14:50:02.082 INFO:tasks.workunit.client.0.smithi081.stdout:7/888: creat d3/d21/d31/f13b x:0 0 0 2024-04-23T14:50:02.086 INFO:tasks.workunit.client.1.smithi156.stdout:2/603: mknod d4/d13/d19/d4c/cd9 0 2024-04-23T14:50:02.086 INFO:tasks.workunit.client.1.smithi156.stdout:4/559: creat d0/df/d55/d68/d53/d91/fc0 x:0 0 0 2024-04-23T14:50:02.087 INFO:tasks.workunit.client.1.smithi156.stdout:4/560: write d0/d8/d1e/da0/fa7 [97863,82362] 0 2024-04-23T14:50:02.095 INFO:tasks.workunit.client.1.smithi156.stdout:6/692: rename d3/d16/d46/d2b to d3/da/d1d/d27/dfe 0 2024-04-23T14:50:02.105 INFO:tasks.workunit.client.1.smithi156.stdout:6/693: rename d3/da/d1d/d27/f98 to d3/d16/d46/d64/fff 0 2024-04-23T14:50:02.106 INFO:tasks.workunit.client.1.smithi156.stdout:0/623: dwrite d0/d16/d43/fbb [0,4194304] 0 2024-04-23T14:50:02.106 INFO:tasks.workunit.client.1.smithi156.stdout:0/624: dread - d0/f89 zero size 2024-04-23T14:50:02.111 INFO:tasks.workunit.client.1.smithi156.stdout:2/604: rename d4/d21/d42/d75/d79/dd0 to d4/d26/d3c/dda 0 2024-04-23T14:50:02.112 INFO:tasks.workunit.client.1.smithi156.stdout:2/605: creat d4/d21/d76/fdb x:0 0 0 2024-04-23T14:50:02.116 INFO:tasks.workunit.client.1.smithi156.stdout:5/656: dread d1/d3/d24/da0/d3e/f6c [0,4194304] 0 2024-04-23T14:50:02.116 INFO:tasks.workunit.client.1.smithi156.stdout:5/657: write d1/d3/d43/fc7 [2804466,101253] 0 2024-04-23T14:50:02.120 INFO:tasks.workunit.client.1.smithi156.stdout:0/625: rename d0/f89 to d0/d4/fcb 0 2024-04-23T14:50:02.121 INFO:tasks.workunit.client.1.smithi156.stdout:0/626: truncate d0/d16/dbf/d3f/d5f/f1f 1085556 0 2024-04-23T14:50:02.121 INFO:tasks.workunit.client.1.smithi156.stdout:2/606: symlink d4/d13/d88/ldc 0 2024-04-23T14:50:02.121 INFO:tasks.workunit.client.1.smithi156.stdout:2/607: truncate d4/d21/d42/f89 136413 0 2024-04-23T14:50:02.123 INFO:tasks.workunit.client.1.smithi156.stdout:7/649: dwrite dc/d2a/fb2 [0,4194304] 0 2024-04-23T14:50:02.123 INFO:tasks.workunit.client.1.smithi156.stdout:5/658: getdents d1/d3 0 2024-04-23T14:50:02.124 INFO:tasks.workunit.client.1.smithi156.stdout:6/694: dread d3/d16/d46/d9d/d9f/fa3 [0,4194304] 0 2024-04-23T14:50:02.128 INFO:tasks.workunit.client.1.smithi156.stdout:7/650: getdents dc/d2c/dbe/dc2 0 2024-04-23T14:50:02.132 INFO:tasks.workunit.client.0.smithi081.stdout:6/949: dwrite d1/d51/d65/d8/da4/fff [0,4194304] 0 2024-04-23T14:50:02.140 INFO:tasks.workunit.client.1.smithi156.stdout:1/679: dwrite db/d1f/d2d/d48/daf/f74 [0,4194304] 0 2024-04-23T14:50:02.140 INFO:tasks.workunit.client.1.smithi156.stdout:1/680: fsync db/d1f/d2f/d47/f5f 0 2024-04-23T14:50:02.140 INFO:tasks.workunit.client.1.smithi156.stdout:1/681: write db/d1f/f7a [692010,27318] 0 2024-04-23T14:50:02.146 INFO:tasks.workunit.client.1.smithi156.stdout:7/651: rename dc/d1d/d24/l96 to dc/d1d/dba/lcb 0 2024-04-23T14:50:02.146 INFO:tasks.workunit.client.1.smithi156.stdout:7/652: write dc/d1d/d24/d5a/f6f [1999952,80770] 0 2024-04-23T14:50:02.150 INFO:tasks.workunit.client.1.smithi156.stdout:0/627: dread d0/d16/d3a/d2a/d1d/d2d/f5b [0,4194304] 0 2024-04-23T14:50:02.154 INFO:tasks.workunit.client.1.smithi156.stdout:7/653: mknod dc/d1d/dba/ccc 0 2024-04-23T14:50:02.154 INFO:tasks.workunit.client.1.smithi156.stdout:1/682: rmdir db/d1f/d28/d70 39 2024-04-23T14:50:02.163 INFO:tasks.workunit.client.1.smithi156.stdout:3/561: dwrite d4/db/dd/d1d/d1e/d13/f79 [0,4194304] 0 2024-04-23T14:50:02.163 INFO:tasks.workunit.client.1.smithi156.stdout:5/659: dread d1/d11/d27/f2c [0,4194304] 0 2024-04-23T14:50:02.164 INFO:tasks.workunit.client.1.smithi156.stdout:9/554: dwrite d1/d2/d23/d49/d4c/fb5 [0,4194304] 0 2024-04-23T14:50:02.164 INFO:tasks.workunit.client.1.smithi156.stdout:9/555: truncate d1/d2/d23/d49/d4c/fb2 4801827 0 2024-04-23T14:50:02.164 INFO:tasks.workunit.client.1.smithi156.stdout:9/556: truncate d1/d2/d3e/d50/d7a/dc/f8d 1113381 0 2024-04-23T14:50:02.164 INFO:tasks.workunit.client.1.smithi156.stdout:9/557: chown d1/d2/d3e/d50/d7a/d17/d1f/f87 85163021 1 2024-04-23T14:50:02.165 INFO:tasks.workunit.client.0.smithi081.stdout:7/889: dread d3/d20/f30 [0,4194304] 0 2024-04-23T14:50:02.165 INFO:tasks.workunit.client.0.smithi081.stdout:5/982: dwrite f12 [0,4194304] 0 2024-04-23T14:50:02.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:02.165+0000 7f8d95200700 1 -- 172.21.15.81:0/1842281704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8d9004bed0 con 0x7f8d900fce40 2024-04-23T14:50:02.166 INFO:tasks.workunit.client.0.smithi081.stdout:5/983: stat d17/d18/dff/d59/da8/cbf 0 2024-04-23T14:50:02.171 INFO:tasks.workunit.client.0.smithi081.stdout:7/890: mknod d3/d20/dc9/c13c 0 2024-04-23T14:50:02.171 INFO:tasks.workunit.client.0.smithi081.stdout:7/891: getdents d3 0 2024-04-23T14:50:02.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:02.174+0000 7f8d86000700 1 -- 172.21.15.81:0/1842281704 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f8d800572b0 con 0x7f8d900fce40 2024-04-23T14:50:02.174 INFO:tasks.workunit.client.0.smithi081.stdout:7/892: unlink d3/d21/d41/f43 0 2024-04-23T14:50:02.175 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-04-23T14:50:02.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:02.178+0000 7f8d95200700 1 -- 172.21.15.81:0/1842281704 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f8d7406bd40 msgr2=0x7f8d7406e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:02.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:02.178+0000 7f8d95200700 1 --2- 172.21.15.81:0/1842281704 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f8d7406bd40 0x7f8d7406e1f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c00b0d0 tx=0x7f8d7c009e30 comp rx=0 tx=0).stop 2024-04-23T14:50:02.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:02.178+0000 7f8d95200700 1 -- 172.21.15.81:0/1842281704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d900fce40 msgr2=0x7f8d9010fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:02.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:02.178+0000 7f8d95200700 1 --2- 172.21.15.81:0/1842281704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d900fce40 0x7f8d9010fbf0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8d900fdbb0 tx=0x7f8d8000b040 comp rx=0 tx=0).stop 2024-04-23T14:50:02.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:02.179+0000 7f8d95200700 1 -- 172.21.15.81:0/1842281704 shutdown_connections 2024-04-23T14:50:02.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:02.179+0000 7f8d95200700 1 --2- 172.21.15.81:0/1842281704 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f8d7406bd40 0x7f8d7406e1f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:02.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:02.179+0000 7f8d95200700 1 --2- 172.21.15.81:0/1842281704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d900fce40 0x7f8d9010fbf0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:02.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:02.179+0000 7f8d95200700 1 --2- 172.21.15.81:0/1842281704 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d900fe040 0x7f8d90110130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:02.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:02.179+0000 7f8d95200700 1 -- 172.21.15.81:0/1842281704 >> 172.21.15.81:0/1842281704 conn(0x7f8d900f8590 msgr2=0x7f8d900f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:02.181 INFO:tasks.workunit.client.0.smithi081.stdout:7/893: mknod d3/d21/d41/d106/c13d 0 2024-04-23T14:50:02.182 INFO:tasks.workunit.client.0.smithi081.stdout:7/894: rmdir d3/d21/d31/d50/d5a/d10c 39 2024-04-23T14:50:02.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:02.182+0000 7f8d95200700 1 -- 172.21.15.81:0/1842281704 shutdown_connections 2024-04-23T14:50:02.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:02.182+0000 7f8d95200700 1 -- 172.21.15.81:0/1842281704 wait complete. 2024-04-23T14:50:02.187 INFO:tasks.workunit.client.0.smithi081.stdout:7/895: symlink d3/d20/dc9/l13e 0 2024-04-23T14:50:02.191 INFO:tasks.workunit.client.0.smithi081.stdout:7/896: mkdir d3/d21/d41/d7c/d13f 0 2024-04-23T14:50:02.191 INFO:tasks.workunit.client.0.smithi081.stdout:7/897: readlink d3/d21/d31/l47 0 2024-04-23T14:50:02.193 INFO:tasks.workunit.client.1.smithi156.stdout:3/562: creat d4/db/dd/fb8 x:0 0 0 2024-04-23T14:50:02.198 INFO:tasks.workunit.client.1.smithi156.stdout:5/660: creat d1/d3/fd1 x:0 0 0 2024-04-23T14:50:02.199 INFO:tasks.workunit.client.0.smithi081.stdout:7/898: link d3/d21/d41/l101 d3/d21/d41/dbb/l140 0 2024-04-23T14:50:02.199 INFO:tasks.workunit.client.0.smithi081.stdout:7/899: dread - d3/d20/f11b zero size 2024-04-23T14:50:02.199 INFO:tasks.workunit.client.1.smithi156.stdout:5/661: write d1/d17/d7e/f8b [483951,92461] 0 2024-04-23T14:50:02.199 INFO:tasks.workunit.client.1.smithi156.stdout:5/662: truncate d1/f38 1921605 0 2024-04-23T14:50:02.203 INFO:tasks.workunit.client.0.smithi081.stdout:7/900: mknod d3/d21/d31/d110/c141 0 2024-04-23T14:50:02.204 INFO:tasks.workunit.client.1.smithi156.stdout:4/561: dwrite d0/d30/f3f [0,4194304] 0 2024-04-23T14:50:02.204 INFO:tasks.workunit.client.1.smithi156.stdout:2/608: dwrite d4/d21/d76/fbe [0,4194304] 0 2024-04-23T14:50:02.205 INFO:tasks.workunit.client.1.smithi156.stdout:4/562: write d0/df/d55/d68/f4f [176791,78040] 0 2024-04-23T14:50:02.205 INFO:tasks.workunit.client.1.smithi156.stdout:4/563: truncate d0/df/d55/d68/f9d 502918 0 2024-04-23T14:50:02.206 INFO:tasks.workunit.client.1.smithi156.stdout:4/564: write d0/df/f17 [5362732,55733] 0 2024-04-23T14:50:02.209 INFO:tasks.workunit.client.0.smithi081.stdout:7/901: mknod d3/d11/c142 0 2024-04-23T14:50:02.209 INFO:tasks.workunit.client.0.smithi081.stdout:7/902: creat d3/d11/d2c/d75/d8e/f143 x:0 0 0 2024-04-23T14:50:02.209 INFO:tasks.workunit.client.0.smithi081.stdout:7/903: read - d3/d21/d31/d33/d4b/d6e/fd8 zero size 2024-04-23T14:50:02.209 INFO:tasks.workunit.client.0.smithi081.stdout:7/904: creat d3/d21/d31/d110/f144 x:0 0 0 2024-04-23T14:50:02.220 INFO:tasks.workunit.client.1.smithi156.stdout:6/695: dwrite d3/da/d74/fc5 [0,4194304] 0 2024-04-23T14:50:02.220 INFO:tasks.workunit.client.1.smithi156.stdout:6/696: stat d3/da/d1d/d59/d72 0 2024-04-23T14:50:02.222 INFO:tasks.workunit.client.0.smithi081.stdout:7/905: symlink d3/d21/d31/d110/d116/l145 0 2024-04-23T14:50:02.226 INFO:tasks.workunit.client.1.smithi156.stdout:6/697: dread d3/d16/d1e/f20 [0,4194304] 0 2024-04-23T14:50:02.230 INFO:tasks.workunit.client.0.smithi081.stdout:7/906: rename d3/d21/d31/f13b to d3/d21/d31/d33/d126/f146 0 2024-04-23T14:50:02.237 INFO:tasks.workunit.client.0.smithi081.stdout:7/907: mknod d3/d21/d31/d33/d126/c147 0 2024-04-23T14:50:02.237 INFO:tasks.workunit.client.1.smithi156.stdout:2/609: unlink d4/d26/d3c/c4a 0 2024-04-23T14:50:02.237 INFO:tasks.workunit.client.1.smithi156.stdout:2/610: chown d4/d13/d19/d4c/f91 11 1 2024-04-23T14:50:02.239 INFO:tasks.workunit.client.1.smithi156.stdout:3/563: dread d4/f10 [0,4194304] 0 2024-04-23T14:50:02.239 INFO:tasks.workunit.client.1.smithi156.stdout:0/628: dwrite d0/d4/d22/f34 [0,4194304] 0 2024-04-23T14:50:02.239 INFO:tasks.workunit.client.1.smithi156.stdout:3/564: creat d4/db/dd/d1d/d1e/d42/d76/fb9 x:0 0 0 2024-04-23T14:50:02.239 INFO:tasks.workunit.client.1.smithi156.stdout:3/565: chown d4/db/dd/d1d/l85 3 1 2024-04-23T14:50:02.239 INFO:tasks.workunit.client.1.smithi156.stdout:3/566: write d4/db/dd/fb8 [309095,18754] 0 2024-04-23T14:50:02.239 INFO:tasks.workunit.client.1.smithi156.stdout:0/629: creat d0/fcc x:0 0 0 2024-04-23T14:50:02.239 INFO:tasks.workunit.client.1.smithi156.stdout:3/567: fdatasync d4/db/dd/d1d/d1e/d13/f41 0 2024-04-23T14:50:02.239 INFO:tasks.workunit.client.1.smithi156.stdout:4/565: mkdir d0/d8/d1e/d4a/d77/dc1 0 2024-04-23T14:50:02.239 INFO:tasks.workunit.client.1.smithi156.stdout:4/566: chown d0/d8/d1e/l20 13 1 2024-04-23T14:50:02.240 INFO:tasks.workunit.client.1.smithi156.stdout:4/567: write d0/df/f14 [1596079,52347] 0 2024-04-23T14:50:02.240 INFO:tasks.workunit.client.1.smithi156.stdout:4/568: read - d0/df/d55/d68/d53/d9f/fbf zero size 2024-04-23T14:50:02.240 INFO:tasks.workunit.client.1.smithi156.stdout:4/569: dread - d0/df/d55/d68/fb7 zero size 2024-04-23T14:50:02.240 INFO:tasks.workunit.client.1.smithi156.stdout:4/570: dread - d0/df/d55/d68/d53/f92 zero size 2024-04-23T14:50:02.240 INFO:tasks.workunit.client.1.smithi156.stdout:4/571: truncate d0/d8/d1e/d4a/d77/faf 371973 0 2024-04-23T14:50:02.240 INFO:tasks.workunit.client.1.smithi156.stdout:5/663: rmdir d1/d11/d27 39 2024-04-23T14:50:02.244 INFO:tasks.workunit.client.1.smithi156.stdout:7/654: dwrite dc/d2c/dbe/dc2/fbc [0,4194304] 0 2024-04-23T14:50:02.245 INFO:tasks.workunit.client.1.smithi156.stdout:7/655: getdents dc/d2c/d68/dc3 0 2024-04-23T14:50:02.246 INFO:tasks.workunit.client.0.smithi081.stdout:5/984: dwrite d17/d1f/d42/dbb/f104 [0,4194304] 0 2024-04-23T14:50:02.246 INFO:tasks.workunit.client.0.smithi081.stdout:5/985: write d17/d18/dff/d9a/f9f [4215261,64152] 0 2024-04-23T14:50:02.247 INFO:tasks.workunit.client.1.smithi156.stdout:9/558: dwrite d1/d2/d3e/d55/d6f/fba [0,4194304] 0 2024-04-23T14:50:02.253 INFO:tasks.workunit.client.1.smithi156.stdout:0/630: dread d0/d4/d22/f96 [0,4194304] 0 2024-04-23T14:50:02.254 INFO:tasks.workunit.client.0.smithi081.stdout:5/986: mkdir d17/d1f/d42/d9b/d13f/d61/dba/d158 0 2024-04-23T14:50:02.254 INFO:tasks.workunit.client.1.smithi156.stdout:3/568: write d4/db/dd/d1d/d1e/d13/f34 [2586787,35258] 0 2024-04-23T14:50:02.258 INFO:tasks.workunit.client.0.smithi081.stdout:7/908: rename d3/d11/d2c/d75/d8e/dc2 to d3/d21/d31/d33/d4b/d6e/d148 0 2024-04-23T14:50:02.261 INFO:tasks.workunit.client.0.smithi081.stdout:5/987: rename d17/l20 to d17/d65/dd2/l159 0 2024-04-23T14:50:02.261 INFO:tasks.workunit.client.0.smithi081.stdout:5/988: chown d17/df3 41 1 2024-04-23T14:50:02.263 INFO:tasks.workunit.client.0.smithi081.stdout:7/909: creat d3/d21/d41/d7c/f149 x:0 0 0 2024-04-23T14:50:02.265 INFO:tasks.workunit.client.0.smithi081.stdout:5/989: unlink d17/d65/de3/d108/dd8/f122 0 2024-04-23T14:50:02.265 INFO:tasks.workunit.client.0.smithi081.stdout:5/990: write d17/f26 [573206,67907] 0 2024-04-23T14:50:02.269 INFO:tasks.workunit.client.0.smithi081.stdout:7/910: rename d3/fe7 to d3/d11/d2c/d75/d8e/dea/f14a 0 2024-04-23T14:50:02.271 INFO:tasks.workunit.client.0.smithi081.stdout:5/991: mkdir d17/d1f/d42/d9b/d13f/d61/dba/d127/d130/d15a 0 2024-04-23T14:50:02.271 INFO:tasks.workunit.client.0.smithi081.stdout:5/992: chown d17/d18 8 1 2024-04-23T14:50:02.276 INFO:tasks.workunit.client.0.smithi081.stdout:7/911: creat d3/d21/d31/d110/d116/f14b x:0 0 0 2024-04-23T14:50:02.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:02 smithi156 ceph-mon[32341]: Reconfiguring daemon prometheus.smithi081 on smithi081 2024-04-23T14:50:02.288 INFO:tasks.workunit.client.1.smithi156.stdout:6/698: dwrite d3/d16/d46/d9d/fe5 [0,4194304] 0 2024-04-23T14:50:02.288 INFO:tasks.workunit.client.1.smithi156.stdout:6/699: fdatasync d3/da/d74/fef 0 2024-04-23T14:50:02.290 INFO:tasks.workunit.client.1.smithi156.stdout:2/611: mkdir d4/d13/d19/d97/ddd 0 2024-04-23T14:50:02.293 INFO:tasks.workunit.client.1.smithi156.stdout:4/572: mkdir d0/df/d21/dc2 0 2024-04-23T14:50:02.298 INFO:tasks.workunit.client.1.smithi156.stdout:7/656: rename dc/d2c/dbe/dc2/ca8 to dc/d9d/ccd 0 2024-04-23T14:50:02.298 INFO:tasks.workunit.client.1.smithi156.stdout:7/657: chown dc/d1d/d48/lb4 657390176 1 2024-04-23T14:50:02.302 INFO:tasks.workunit.client.1.smithi156.stdout:0/631: mkdir d0/d16/dcd 0 2024-04-23T14:50:02.303 INFO:tasks.workunit.client.1.smithi156.stdout:3/569: mkdir d4/db/dd/d1d/d1e/d42/d76/dba 0 2024-04-23T14:50:02.315 INFO:tasks.workunit.client.1.smithi156.stdout:6/700: creat d3/d16/f100 x:0 0 0 2024-04-23T14:50:02.315 INFO:tasks.workunit.client.1.smithi156.stdout:2/612: mknod d4/d21/d42/d75/d79/cde 0 2024-04-23T14:50:02.315 INFO:tasks.workunit.client.1.smithi156.stdout:5/664: getdents d1/d11/d18/d52/d85 0 2024-04-23T14:50:02.315 INFO:tasks.workunit.client.1.smithi156.stdout:6/701: write d3/d16/d46/f60 [954518,128417] 0 2024-04-23T14:50:02.317 INFO:tasks.workunit.client.1.smithi156.stdout:4/573: mknod d0/d8/d1e/d4a/d77/cc3 0 2024-04-23T14:50:02.317 INFO:tasks.workunit.client.1.smithi156.stdout:4/574: readlink d0/d76/l29 0 2024-04-23T14:50:02.318 INFO:tasks.workunit.client.1.smithi156.stdout:2/613: mkdir d4/d21/d42/da1/ddf 0 2024-04-23T14:50:02.318 INFO:tasks.workunit.client.1.smithi156.stdout:7/658: dread dc/d1d/d24/f28 [0,4194304] 0 2024-04-23T14:50:02.318 INFO:tasks.workunit.client.1.smithi156.stdout:7/659: chown dc/d2c/d68/fad 198298 1 2024-04-23T14:50:02.319 INFO:tasks.workunit.client.1.smithi156.stdout:2/614: creat d4/d21/d2f/fe0 x:0 0 0 2024-04-23T14:50:02.319 INFO:tasks.workunit.client.0.smithi081.stdout:6/950: dwrite d1/f17 [0,4194304] 0 2024-04-23T14:50:02.319 INFO:tasks.workunit.client.0.smithi081.stdout:6/951: readlink d1/d51/d65/l1f 0 2024-04-23T14:50:02.320 INFO:tasks.workunit.client.1.smithi156.stdout:9/559: link d1/d2/d3e/d55/d6f/f65 d1/d2/d3e/d50/d7a/d17/fbf 0 2024-04-23T14:50:02.320 INFO:tasks.workunit.client.1.smithi156.stdout:9/560: truncate d1/d2/d23/fa5 724489 0 2024-04-23T14:50:02.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:02 smithi081 ceph-mon[25540]: Reconfiguring daemon prometheus.smithi081 on smithi081 2024-04-23T14:50:02.327 INFO:tasks.workunit.client.1.smithi156.stdout:4/575: fdatasync d0/df/f14 0 2024-04-23T14:50:02.328 INFO:tasks.workunit.client.1.smithi156.stdout:0/632: dread d0/d16/d3a/d2a/d1d/d2d/f8c [0,4194304] 0 2024-04-23T14:50:02.328 INFO:tasks.workunit.client.1.smithi156.stdout:6/702: rename d3/da/d1d/d27/lf8 to d3/d16/d1e/l101 0 2024-04-23T14:50:02.328 INFO:tasks.workunit.client.1.smithi156.stdout:6/703: fdatasync d3/d16/d46/d9d/fbe 0 2024-04-23T14:50:02.328 INFO:tasks.workunit.client.1.smithi156.stdout:3/570: getdents d4/db/dd 0 2024-04-23T14:50:02.328 INFO:tasks.workunit.client.1.smithi156.stdout:7/660: unlink f6 0 2024-04-23T14:50:02.329 INFO:tasks.workunit.client.1.smithi156.stdout:7/661: write dc/d93/d6c/d88/fc1 [4207856,91869] 0 2024-04-23T14:50:02.329 INFO:tasks.workunit.client.0.smithi081.stdout:6/952: mknod d1/d2/d49/d52/c14a 0 2024-04-23T14:50:02.332 INFO:tasks.workunit.client.1.smithi156.stdout:9/561: symlink d1/d2/d23/d49/d4c/lc0 0 2024-04-23T14:50:02.332 INFO:tasks.workunit.client.1.smithi156.stdout:0/633: mkdir d0/d16/dcd/dce 0 2024-04-23T14:50:02.338 INFO:tasks.workunit.client.1.smithi156.stdout:6/704: getdents d3/d16/d46/d9d 0 2024-04-23T14:50:02.338 INFO:tasks.workunit.client.1.smithi156.stdout:5/665: dread d1/d3/d43/fc1 [0,4194304] 0 2024-04-23T14:50:02.338 INFO:tasks.workunit.client.1.smithi156.stdout:5/666: read - d1/d3/da6/d86/fb3 zero size 2024-04-23T14:50:02.338 INFO:tasks.workunit.client.1.smithi156.stdout:5/667: chown d1/d3/d24/da0/d3e/c68 48501 1 2024-04-23T14:50:02.339 INFO:tasks.workunit.client.0.smithi081.stdout:7/912: dwrite d3/d21/d41/d7c/fe6 [0,4194304] 0 2024-04-23T14:50:02.339 INFO:tasks.workunit.client.0.smithi081.stdout:5/993: dwrite d17/d18/dff/d59/f9c [0,4194304] 0 2024-04-23T14:50:02.342 INFO:tasks.workunit.client.1.smithi156.stdout:7/662: creat dc/d2a/fce x:0 0 0 2024-04-23T14:50:02.342 INFO:tasks.workunit.client.1.smithi156.stdout:7/663: truncate dc/f54 336428 0 2024-04-23T14:50:02.342 INFO:tasks.workunit.client.1.smithi156.stdout:7/664: fsync dc/d1d/d41/f3d 0 2024-04-23T14:50:02.344 INFO:tasks.workunit.client.0.smithi081.stdout:7/913: dread d3/d21/d31/d63/fcc [0,4194304] 0 2024-04-23T14:50:02.351 INFO:tasks.workunit.client.1.smithi156.stdout:4/576: write d0/d8/fd [6529797,25946] 0 2024-04-23T14:50:02.351 INFO:tasks.workunit.client.1.smithi156.stdout:9/562: creat d1/d2/d3e/d50/d7a/d17/d1f/fc1 x:0 0 0 2024-04-23T14:50:02.351 INFO:tasks.workunit.client.1.smithi156.stdout:0/634: link d0/d16/dbf/d3f/f68 d0/d16/d3a/d1e/fcf 0 2024-04-23T14:50:02.351 INFO:tasks.workunit.client.1.smithi156.stdout:4/577: readlink d0/d30/l45 0 2024-04-23T14:50:02.352 INFO:tasks.workunit.client.1.smithi156.stdout:2/615: rename d4/d13/d19/d58/f5b to d4/fe1 0 2024-04-23T14:50:02.352 INFO:tasks.workunit.client.0.smithi081.stdout:6/953: rename d1/d51/d65/d13/d16 to d1/d14b 0 2024-04-23T14:50:02.354 INFO:tasks.workunit.client.1.smithi156.stdout:6/705: creat d3/da/d1d/f102 x:0 0 0 2024-04-23T14:50:02.355 INFO:tasks.workunit.client.1.smithi156.stdout:1/683: sync 2024-04-23T14:50:02.355 INFO:tasks.workunit.client.1.smithi156.stdout:8/625: sync 2024-04-23T14:50:02.364 INFO:tasks.workunit.client.1.smithi156.stdout:5/668: symlink d1/d11/d18/d52/ld2 0 2024-04-23T14:50:02.365 INFO:tasks.workunit.client.1.smithi156.stdout:5/669: chown d1/d3/ce 10893 1 2024-04-23T14:50:02.365 INFO:tasks.workunit.client.1.smithi156.stdout:7/665: mkdir dc/d2a/da9/dcf 0 2024-04-23T14:50:02.372 INFO:tasks.workunit.client.0.smithi081.stdout:3/870: sync 2024-04-23T14:50:02.372 INFO:tasks.workunit.client.0.smithi081.stdout:2/940: sync 2024-04-23T14:50:02.373 INFO:tasks.workunit.client.0.smithi081.stdout:2/941: chown d1/d33/d45/de9/l13b 3311199 1 2024-04-23T14:50:02.373 INFO:tasks.workunit.client.0.smithi081.stdout:2/942: stat d1/d33/d9f/d136/d139 0 2024-04-23T14:50:02.376 INFO:tasks.workunit.client.0.smithi081.stdout:9/869: sync 2024-04-23T14:50:02.376 INFO:tasks.workunit.client.0.smithi081.stdout:4/892: sync 2024-04-23T14:50:02.378 INFO:tasks.workunit.client.1.smithi156.stdout:0/635: creat d0/d4/d22/d58/fd0 x:0 0 0 2024-04-23T14:50:02.384 INFO:tasks.workunit.client.0.smithi081.stdout:6/954: read d1/d51/d65/fbf [3462514,130808] 0 2024-04-23T14:50:02.384 INFO:tasks.workunit.client.0.smithi081.stdout:6/955: fdatasync d1/d51/d65/d1c/f73 0 2024-04-23T14:50:02.385 INFO:tasks.workunit.client.1.smithi156.stdout:5/670: write d1/d11/d18/d19/d74/f80 [3178575,27179] 0 2024-04-23T14:50:02.388 INFO:tasks.workunit.client.1.smithi156.stdout:4/578: mkdir d0/df/d55/d68/d85/dc4 0 2024-04-23T14:50:02.388 INFO:tasks.workunit.client.1.smithi156.stdout:4/579: write d0/df/f86 [311989,86968] 0 2024-04-23T14:50:02.390 INFO:tasks.workunit.client.1.smithi156.stdout:2/616: mkdir d4/d13/d19/d4c/d5c/dd5/de2 0 2024-04-23T14:50:02.393 INFO:tasks.workunit.client.1.smithi156.stdout:3/571: dwrite d4/db/f2f [4194304,4194304] 0 2024-04-23T14:50:02.393 INFO:tasks.workunit.client.1.smithi156.stdout:3/572: stat d4/db/dd/d1d/d61/d8d/f72 0 2024-04-23T14:50:02.399 INFO:tasks.workunit.client.0.smithi081.stdout:6/956: mkdir d1/d14b/dd0/df7/da1/dc1/dc9/ddb/d14c 0 2024-04-23T14:50:02.402 INFO:tasks.workunit.client.1.smithi156.stdout:8/626: rename d5/d9/d5a/d5c/f85 to d5/d9/d5a/fd9 0 2024-04-23T14:50:02.402 INFO:tasks.workunit.client.1.smithi156.stdout:6/706: creat d3/da/d1d/d27/dfe/d6e/d8f/f103 x:0 0 0 2024-04-23T14:50:02.402 INFO:tasks.workunit.client.1.smithi156.stdout:7/666: mkdir dc/d1d/d24/d5a/dd0 0 2024-04-23T14:50:02.402 INFO:tasks.workunit.client.1.smithi156.stdout:7/667: dread - dc/d2a/fce zero size 2024-04-23T14:50:02.411 INFO:tasks.workunit.client.0.smithi081.stdout:2/943: write d1/d1e/dad/f110 [292939,70769] 0 2024-04-23T14:50:02.415 INFO:tasks.workunit.client.0.smithi081.stdout:6/957: mknod d1/d51/d65/d8/d2e/d140/c14d 0 2024-04-23T14:50:02.420 INFO:tasks.workunit.client.0.smithi081.stdout:7/914: dwrite d3/d20/dc9/f12d [0,4194304] 0 2024-04-23T14:50:02.426 INFO:tasks.workunit.client.0.smithi081.stdout:2/944: creat d1/d11/d21/d52/d8b/d8f/d93/d128/f141 x:0 0 0 2024-04-23T14:50:02.431 INFO:tasks.workunit.client.1.smithi156.stdout:5/671: mkdir d1/d11/d18/d52/d85/d96/dd3 0 2024-04-23T14:50:02.431 INFO:tasks.workunit.client.1.smithi156.stdout:2/617: symlink d4/d13/d19/d58/le3 0 2024-04-23T14:50:02.431 INFO:tasks.workunit.client.1.smithi156.stdout:5/672: chown d1/d11/d27/f95 76675 1 2024-04-23T14:50:02.431 INFO:tasks.workunit.client.1.smithi156.stdout:5/673: stat d1/d3/d24/l54 0 2024-04-23T14:50:02.431 INFO:tasks.workunit.client.1.smithi156.stdout:5/674: chown d1/c63 3 1 2024-04-23T14:50:02.431 INFO:tasks.workunit.client.0.smithi081.stdout:9/870: dread d3/d5/f41 [0,4194304] 0 2024-04-23T14:50:02.434 INFO:tasks.workunit.client.1.smithi156.stdout:4/580: creat d0/d8/d1e/d4a/d77/d9c/fc5 x:0 0 0 2024-04-23T14:50:02.434 INFO:tasks.workunit.client.1.smithi156.stdout:9/563: dwrite d1/d2/d3e/d50/d7a/d17/d1f/f36 [0,4194304] 0 2024-04-23T14:50:02.435 INFO:tasks.workunit.client.0.smithi081.stdout:9/871: creat d3/de/d1d/d54/d68/f11d x:0 0 0 2024-04-23T14:50:02.438 INFO:tasks.workunit.client.1.smithi156.stdout:3/573: symlink d4/db/dd/d1d/d1e/d74/lbb 0 2024-04-23T14:50:02.439 INFO:tasks.workunit.client.1.smithi156.stdout:8/627: link d5/d9/d5a/dc8/fd0 d5/d9/d36/d84/dc1/dcf/fda 0 2024-04-23T14:50:02.439 INFO:tasks.workunit.client.1.smithi156.stdout:6/707: link d3/d16/d46/d64/d77/dd6/fdb d3/da/d1d/d59/d72/f104 0 2024-04-23T14:50:02.443 INFO:tasks.workunit.client.1.smithi156.stdout:0/636: dwrite d0/d4/d22/d58/d9a/f3e [0,4194304] 0 2024-04-23T14:50:02.445 INFO:tasks.workunit.client.1.smithi156.stdout:2/618: mknod d4/d13/d19/d58/ce4 0 2024-04-23T14:50:02.446 INFO:tasks.workunit.client.0.smithi081.stdout:4/893: dwrite d1/fa [8388608,4194304] 0 2024-04-23T14:50:02.450 INFO:tasks.workunit.client.1.smithi156.stdout:5/675: symlink d1/d11/dcb/ld4 0 2024-04-23T14:50:02.450 INFO:tasks.workunit.client.1.smithi156.stdout:9/564: rename d1/d2/d23/d49/d4c/d96 to d1/d2/d3e/d50/d7a/d17/d1f/d48/dc2 0 2024-04-23T14:50:02.451 INFO:tasks.workunit.client.1.smithi156.stdout:6/708: read d3/d16/f76 [471454,76369] 0 2024-04-23T14:50:02.454 INFO:tasks.workunit.client.0.smithi081.stdout:4/894: creat d1/f11c x:0 0 0 2024-04-23T14:50:02.459 INFO:tasks.workunit.client.1.smithi156.stdout:3/574: mknod d4/db/dd/d1d/d1e/d74/d90/cbc 0 2024-04-23T14:50:02.461 INFO:tasks.workunit.client.0.smithi081.stdout:4/895: rename d1/d4/d6f/l77 to d1/d4/d6f/d70/d9c/l11d 0 2024-04-23T14:50:02.463 INFO:tasks.workunit.client.0.smithi081.stdout:2/945: dread d1/d1e/f84 [0,4194304] 0 2024-04-23T14:50:02.465 INFO:tasks.workunit.client.1.smithi156.stdout:7/668: getdents dc/d2a 0 2024-04-23T14:50:02.466 INFO:tasks.workunit.client.1.smithi156.stdout:7/669: write dc/d1d/d41/f51 [429285,31079] 0 2024-04-23T14:50:02.466 INFO:tasks.workunit.client.1.smithi156.stdout:7/670: fsync dc/d93/d6c/d88/fc1 0 2024-04-23T14:50:02.466 INFO:tasks.workunit.client.1.smithi156.stdout:7/671: chown dc/d2c/dbe/dc2/fbc 239 1 2024-04-23T14:50:02.467 INFO:tasks.workunit.client.0.smithi081.stdout:4/896: symlink d1/d1d/d39/l11e 0 2024-04-23T14:50:02.471 INFO:tasks.workunit.client.0.smithi081.stdout:2/946: mknod d1/d33/da3/df5/c142 0 2024-04-23T14:50:02.472 INFO:tasks.workunit.client.0.smithi081.stdout:2/947: write d1/d1e/f66 [1730446,80978] 0 2024-04-23T14:50:02.472 INFO:tasks.workunit.client.1.smithi156.stdout:0/637: mkdir d0/d16/d43/d9c/dd1 0 2024-04-23T14:50:02.478 INFO:tasks.workunit.client.0.smithi081.stdout:4/897: mkdir d1/d8b/dbc/d11f 0 2024-04-23T14:50:02.478 INFO:tasks.workunit.client.1.smithi156.stdout:5/676: link d1/d3/d24/da0/l6e d1/d3/d24/ld5 0 2024-04-23T14:50:02.481 INFO:tasks.workunit.client.1.smithi156.stdout:8/628: rename d5/d9/d10/f33 to d5/d4e/dc7/fdb 0 2024-04-23T14:50:02.482 INFO:tasks.workunit.client.0.smithi081.stdout:7/915: dwrite d3/d21/d31/d33/d4b/d6e/f87 [0,4194304] 0 2024-04-23T14:50:02.486 INFO:tasks.workunit.client.0.smithi081.stdout:4/898: link d1/d4/d6f/d70/d9c/ddd/f110 d1/d8b/dbc/f120 0 2024-04-23T14:50:02.486 INFO:tasks.workunit.client.0.smithi081.stdout:4/899: readlink d1/d4/dc/lf4 0 2024-04-23T14:50:02.486 INFO:tasks.workunit.client.0.smithi081.stdout:4/900: readlink d1/d4/d6f/d70/daf/ld9 0 2024-04-23T14:50:02.488 INFO:tasks.workunit.client.1.smithi156.stdout:7/672: rmdir dc/d46/d58 39 2024-04-23T14:50:02.491 INFO:tasks.workunit.client.1.smithi156.stdout:0/638: unlink d0/d16/d3a/d1e/d80/f9b 0 2024-04-23T14:50:02.494 INFO:tasks.workunit.client.0.smithi081.stdout:7/916: getdents d3/d20 0 2024-04-23T14:50:02.494 INFO:tasks.workunit.client.0.smithi081.stdout:7/917: chown d3/d21/d31/d33/d126/c147 826 1 2024-04-23T14:50:02.494 INFO:tasks.workunit.client.0.smithi081.stdout:7/918: fsync d3/d21/d41/d7c/dc3/d7f/f9b 0 2024-04-23T14:50:02.499 INFO:tasks.workunit.client.1.smithi156.stdout:8/629: symlink d5/d9/d5a/ldc 0 2024-04-23T14:50:02.506 INFO:tasks.workunit.client.1.smithi156.stdout:5/677: rename d1/d11/d18/d52/d85/d96/db4/fcc to d1/d11/d18/d52/d85/d96/dd3/fd6 0 2024-04-23T14:50:02.507 INFO:tasks.workunit.client.0.smithi081.stdout:7/919: rmdir d3 39 2024-04-23T14:50:02.507 INFO:tasks.workunit.client.0.smithi081.stdout:7/920: chown d3/d21/d31/d33/c27 0 1 2024-04-23T14:50:02.509 INFO:tasks.workunit.client.1.smithi156.stdout:4/581: dwrite d0/d76/f4d [4194304,4194304] 0 2024-04-23T14:50:02.510 INFO:tasks.workunit.client.0.smithi081.stdout:2/948: dread d1/d11/d21/d52/f75 [0,4194304] 0 2024-04-23T14:50:02.510 INFO:tasks.workunit.client.0.smithi081.stdout:2/949: chown d1/d33/d45/d6e/d97/le4 545010008 1 2024-04-23T14:50:02.510 INFO:tasks.workunit.client.0.smithi081.stdout:2/950: fdatasync d1/d33/d45/d6e/d97/fa4 0 2024-04-23T14:50:02.512 INFO:tasks.workunit.client.1.smithi156.stdout:7/673: mknod dc/d93/cd1 0 2024-04-23T14:50:02.512 INFO:tasks.workunit.client.1.smithi156.stdout:7/674: dread - dc/d1d/d24/d5a/f72 zero size 2024-04-23T14:50:02.515 INFO:tasks.workunit.client.1.smithi156.stdout:2/619: dwrite d4/d13/d19/d58/fce [0,4194304] 0 2024-04-23T14:50:02.516 INFO:tasks.workunit.client.1.smithi156.stdout:0/639: mknod d0/d16/dbf/d3f/cd2 0 2024-04-23T14:50:02.523 INFO:tasks.workunit.client.0.smithi081.stdout:2/951: unlink d1/d11/d21/d52/d8b/fa8 0 2024-04-23T14:50:02.525 INFO:tasks.workunit.client.1.smithi156.stdout:5/678: unlink d1/d3/d24/da0/d3e/l87 0 2024-04-23T14:50:02.528 INFO:tasks.workunit.client.0.smithi081.stdout:7/921: rename d3/d21/d31/d33/d4b to d3/d21/d41/dbb/d139/d14c 0 2024-04-23T14:50:02.532 INFO:tasks.workunit.client.0.smithi081.stdout:5/994: dwrite d17/d3c/f81 [0,4194304] 0 2024-04-23T14:50:02.532 INFO:tasks.workunit.client.0.smithi081.stdout:5/995: readlink d17/d4a/l5c 0 2024-04-23T14:50:02.533 INFO:tasks.workunit.client.1.smithi156.stdout:7/675: dread dc/d2c/d68/f75 [0,4194304] 0 2024-04-23T14:50:02.533 INFO:tasks.workunit.client.1.smithi156.stdout:7/676: chown dc/d93/cd1 43 1 2024-04-23T14:50:02.534 INFO:tasks.workunit.client.1.smithi156.stdout:7/677: readlink dc/d2c/dbe/dc2/lc8 0 2024-04-23T14:50:02.534 INFO:tasks.workunit.client.0.smithi081.stdout:7/922: mknod d3/d21/d31/d110/d116/c14d 0 2024-04-23T14:50:02.534 INFO:tasks.workunit.client.0.smithi081.stdout:7/923: chown d3/d21/d41/dd2/cfd 8121944 1 2024-04-23T14:50:02.537 INFO:tasks.workunit.client.0.smithi081.stdout:6/958: dwrite d1/d2/f1d [0,4194304] 0 2024-04-23T14:50:02.540 INFO:tasks.workunit.client.1.smithi156.stdout:0/640: symlink d0/d4/d22/ld3 0 2024-04-23T14:50:02.543 INFO:tasks.workunit.client.1.smithi156.stdout:7/678: mkdir dc/d9d/dd2 0 2024-04-23T14:50:02.544 INFO:tasks.workunit.client.0.smithi081.stdout:5/996: rename d17/d1f/d42/d9b/d9e/l156 to d17/d3c/l15b 0 2024-04-23T14:50:02.544 INFO:tasks.workunit.client.0.smithi081.stdout:5/997: dread - d17/d18/dff/d59/da8/f143 zero size 2024-04-23T14:50:02.544 INFO:tasks.workunit.client.0.smithi081.stdout:5/998: write d17/d3c/d105/f12e [267082,10291] 0 2024-04-23T14:50:02.544 INFO:tasks.workunit.client.0.smithi081.stdout:7/924: unlink d3/d21/d31/d50/da2/f12e 0 2024-04-23T14:50:02.545 INFO:tasks.workunit.client.0.smithi081.stdout:7/925: creat d3/d97/f14e x:0 0 0 2024-04-23T14:50:02.545 INFO:tasks.workunit.client.0.smithi081.stdout:6/959: stat d1/d51/d65/d8/d2e/d59/ccb 0 2024-04-23T14:50:02.548 INFO:tasks.workunit.client.0.smithi081.stdout:7/926: creat d3/d11/d2c/d75/d8e/dea/f14f x:0 0 0 2024-04-23T14:50:02.548 INFO:tasks.workunit.client.1.smithi156.stdout:7/679: link dc/d1d/d41/l4b dc/d1d/d48/d83/ld3 0 2024-04-23T14:50:02.550 INFO:tasks.workunit.client.1.smithi156.stdout:7/680: write dc/d1d/d48/f5b [739716,109832] 0 2024-04-23T14:50:02.550 INFO:tasks.workunit.client.1.smithi156.stdout:7/681: dread - dc/d1d/f78 zero size 2024-04-23T14:50:02.552 INFO:tasks.workunit.client.1.smithi156.stdout:7/682: rmdir dc/d46/d58 39 2024-04-23T14:50:02.554 INFO:tasks.workunit.client.1.smithi156.stdout:7/683: mkdir dc/d1d/dba/dd4 0 2024-04-23T14:50:02.554 INFO:tasks.workunit.client.1.smithi156.stdout:7/684: stat dc/d1d/d41/f43 0 2024-04-23T14:50:02.555 INFO:tasks.workunit.client.0.smithi081.stdout:2/952: dread d1/d11/d21/d52/fdc [0,4194304] 0 2024-04-23T14:50:02.555 INFO:tasks.workunit.client.0.smithi081.stdout:7/927: rename d3/d20/f3f to d3/d21/d31/f150 0 2024-04-23T14:50:02.556 INFO:tasks.workunit.client.1.smithi156.stdout:4/582: read d0/df/d55/f3c [2177629,59636] 0 2024-04-23T14:50:02.556 INFO:tasks.workunit.client.1.smithi156.stdout:4/583: fdatasync d0/f3 0 2024-04-23T14:50:02.556 INFO:tasks.workunit.client.1.smithi156.stdout:7/685: mkdir dc/d1d/d24/dd5 0 2024-04-23T14:50:02.556 INFO:tasks.workunit.client.1.smithi156.stdout:3/575: dwrite d4/db/dd/d1d/f3b [4194304,4194304] 0 2024-04-23T14:50:02.557 INFO:tasks.workunit.client.1.smithi156.stdout:9/565: dwrite d1/d2/d3e/d50/d7a/d17/fbf [0,4194304] 0 2024-04-23T14:50:02.562 INFO:tasks.workunit.client.0.smithi081.stdout:7/928: truncate d3/f36 4113388 0 2024-04-23T14:50:02.562 INFO:tasks.workunit.client.0.smithi081.stdout:7/929: truncate d3/d21/d41/d7c/dc3/fac 639141 0 2024-04-23T14:50:02.562 INFO:tasks.workunit.client.1.smithi156.stdout:4/584: unlink d0/df/d55/d68/d53/d9f/fa8 0 2024-04-23T14:50:02.562 INFO:tasks.workunit.client.1.smithi156.stdout:4/585: write d0/df/d55/f73 [1271493,31596] 0 2024-04-23T14:50:02.562 INFO:tasks.workunit.client.1.smithi156.stdout:8/630: dwrite d5/d9/f32 [0,4194304] 0 2024-04-23T14:50:02.563 INFO:tasks.workunit.client.0.smithi081.stdout:5/999: dread d17/d4a/fb9 [0,4194304] 0 2024-04-23T14:50:02.563 INFO:tasks.workunit.client.0.smithi081.stdout:4/901: dwrite d1/ffc [0,4194304] 0 2024-04-23T14:50:02.564 INFO:tasks.workunit.client.1.smithi156.stdout:7/686: creat dc/fd6 x:0 0 0 2024-04-23T14:50:02.566 INFO:tasks.workunit.client.0.smithi081.stdout:2/953: rmdir d1/d33/da3/df5 39 2024-04-23T14:50:02.566 INFO:tasks.workunit.client.1.smithi156.stdout:9/566: mknod d1/d2/d3e/d55/d6f/d30/cc3 0 2024-04-23T14:50:02.566 INFO:tasks.workunit.client.1.smithi156.stdout:9/567: dread - d1/d2/d3e/d50/d7a/d17/d1f/f87 zero size 2024-04-23T14:50:02.568 INFO:tasks.workunit.client.0.smithi081.stdout:9/872: dwrite d3/de/d25/f110 [0,4194304] 0 2024-04-23T14:50:02.568 INFO:tasks.workunit.client.0.smithi081.stdout:6/960: dread d1/d51/d65/d1c/d6e/d7d/faf [0,4194304] 0 2024-04-23T14:50:02.568 INFO:tasks.workunit.client.0.smithi081.stdout:9/873: chown d3/de/d1d/d5b/d7b/d90/lbc 3 1 2024-04-23T14:50:02.568 INFO:tasks.workunit.client.0.smithi081.stdout:6/961: chown d1/d2/d8e/l134 0 1 2024-04-23T14:50:02.573 INFO:tasks.workunit.client.1.smithi156.stdout:4/586: mknod d0/d8/d1e/d4a/d77/cc6 0 2024-04-23T14:50:02.573 INFO:tasks.workunit.client.1.smithi156.stdout:7/687: creat dc/d93/d6c/fd7 x:0 0 0 2024-04-23T14:50:02.578 INFO:tasks.workunit.client.0.smithi081.stdout:2/954: creat d1/d33/d95/f143 x:0 0 0 2024-04-23T14:50:02.578 INFO:tasks.workunit.client.1.smithi156.stdout:9/568: rmdir d1/d2/d3e/d50/d7a/d17/d1f/d48/da7 0 2024-04-23T14:50:02.579 INFO:tasks.workunit.client.1.smithi156.stdout:0/641: write d0/d16/d3a/d2a/d1d/d2d/f41 [6809444,89461] 0 2024-04-23T14:50:02.580 INFO:tasks.workunit.client.1.smithi156.stdout:0/642: read - d0/d16/d43/da6/fc6 zero size 2024-04-23T14:50:02.580 INFO:tasks.workunit.client.1.smithi156.stdout:4/587: mknod d0/d30/d8a/cc7 0 2024-04-23T14:50:02.580 INFO:tasks.workunit.client.1.smithi156.stdout:0/643: write d0/d16/f8d [434518,125125] 0 2024-04-23T14:50:02.581 INFO:tasks.workunit.client.1.smithi156.stdout:7/688: mknod dc/d1d/cd8 0 2024-04-23T14:50:02.585 INFO:tasks.workunit.client.0.smithi081.stdout:9/874: truncate d3/de/d1d/d54/f5f 989480 0 2024-04-23T14:50:02.585 INFO:tasks.workunit.client.0.smithi081.stdout:9/875: write d3/d67/fc9 [946762,100223] 0 2024-04-23T14:50:02.586 INFO:tasks.workunit.client.1.smithi156.stdout:4/588: mknod d0/d76/d63/cc8 0 2024-04-23T14:50:02.588 INFO:tasks.workunit.client.1.smithi156.stdout:0/644: mknod d0/d16/d3a/d2a/cd4 0 2024-04-23T14:50:02.591 INFO:tasks.workunit.client.1.smithi156.stdout:7/689: mkdir dc/d1d/dba/dd4/dd9 0 2024-04-23T14:50:02.591 INFO:tasks.workunit.client.1.smithi156.stdout:1/684: sync 2024-04-23T14:50:02.593 INFO:tasks.workunit.client.0.smithi081.stdout:2/955: mknod d1/d11/d21/d52/c144 0 2024-04-23T14:50:02.593 INFO:tasks.workunit.client.0.smithi081.stdout:2/956: chown d1/d33/d45/d48/c62 54490 1 2024-04-23T14:50:02.593 INFO:tasks.workunit.client.0.smithi081.stdout:2/957: write d1/f10e [1586234,16109] 0 2024-04-23T14:50:02.595 INFO:tasks.workunit.client.1.smithi156.stdout:2/620: dwrite d4/d13/f86 [0,4194304] 0 2024-04-23T14:50:02.595 INFO:tasks.workunit.client.1.smithi156.stdout:2/621: write d4/d13/d19/fd3 [583847,107112] 0 2024-04-23T14:50:02.595 INFO:tasks.workunit.client.1.smithi156.stdout:2/622: truncate d4/d21/d42/da1/fc9 886260 0 2024-04-23T14:50:02.601 INFO:tasks.workunit.client.1.smithi156.stdout:4/589: mknod d0/df/d55/d68/cc9 0 2024-04-23T14:50:02.603 INFO:tasks.workunit.client.0.smithi081.stdout:9/876: symlink d3/de/d14/d5e/l11e 0 2024-04-23T14:50:02.615 INFO:tasks.workunit.client.0.smithi081.stdout:2/958: rename d1/d33/d45/d6e/d97/c113 to d1/d11/d21/d52/d8b/d8f/de8/d117/c145 0 2024-04-23T14:50:02.615 INFO:tasks.workunit.client.0.smithi081.stdout:2/959: fsync d1/d11/d21/d52/d8b/d8f/de8/d117/f13a 0 2024-04-23T14:50:02.622 INFO:tasks.workunit.client.0.smithi081.stdout:7/930: dwrite d3/d21/f79 [0,4194304] 0 2024-04-23T14:50:02.622 INFO:tasks.workunit.client.0.smithi081.stdout:7/931: fdatasync d3/d21/d41/dbb/d139/d14c/d6e/fd8 0 2024-04-23T14:50:02.622 INFO:tasks.workunit.client.0.smithi081.stdout:7/932: chown d3/d21/d41/da3/fd1 299 1 2024-04-23T14:50:02.623 INFO:tasks.workunit.client.0.smithi081.stdout:9/877: creat d3/de/d14/dab/f11f x:0 0 0 2024-04-23T14:50:02.623 INFO:tasks.workunit.client.0.smithi081.stdout:9/878: stat d3/de/d47/fa4 0 2024-04-23T14:50:02.624 INFO:tasks.workunit.client.1.smithi156.stdout:2/623: unlink d4/d21/d42/d75/d79/c87 0 2024-04-23T14:50:02.624 INFO:tasks.workunit.client.1.smithi156.stdout:8/631: write d5/d9/d36/d9c/f42 [1210587,28597] 0 2024-04-23T14:50:02.624 INFO:tasks.workunit.client.1.smithi156.stdout:2/624: dread - d4/d21/d76/fdb zero size 2024-04-23T14:50:02.624 INFO:tasks.workunit.client.1.smithi156.stdout:8/632: write d5/d9/d36/d84/dc1/fc5 [146617,25916] 0 2024-04-23T14:50:02.624 INFO:tasks.workunit.client.1.smithi156.stdout:2/625: creat d4/d21/d76/fe5 x:0 0 0 2024-04-23T14:50:02.625 INFO:tasks.workunit.client.1.smithi156.stdout:2/626: chown d4/d13/d19/d4c/d5c 1317780 1 2024-04-23T14:50:02.625 INFO:tasks.workunit.client.1.smithi156.stdout:2/627: fsync d4/d21/f67 0 2024-04-23T14:50:02.626 INFO:tasks.workunit.client.0.smithi081.stdout:2/960: creat d1/d11/d21/f146 x:0 0 0 2024-04-23T14:50:02.627 INFO:tasks.workunit.client.0.smithi081.stdout:2/961: readlink d1/d11/d21/d52/d8b/d8f/l111 0 2024-04-23T14:50:02.630 INFO:tasks.workunit.client.0.smithi081.stdout:7/933: link d3/d20/c66 d3/d21/d41/dbb/c151 0 2024-04-23T14:50:02.630 INFO:tasks.workunit.client.0.smithi081.stdout:7/934: chown d3/d21/d41/dbb/d139/d14c/d6e/d148 99059927 1 2024-04-23T14:50:02.632 INFO:tasks.workunit.client.1.smithi156.stdout:5/679: dwrite d1/d17/f7d [0,4194304] 0 2024-04-23T14:50:02.634 INFO:tasks.workunit.client.0.smithi081.stdout:9/879: unlink d3/d1a/f9e 0 2024-04-23T14:50:02.634 INFO:tasks.workunit.client.0.smithi081.stdout:9/880: chown d3/de/d14/dab 402 1 2024-04-23T14:50:02.634 INFO:tasks.workunit.client.1.smithi156.stdout:5/680: write d1/d3/d24/f58 [5638428,51771] 0 2024-04-23T14:50:02.634 INFO:tasks.workunit.client.1.smithi156.stdout:5/681: stat d1/d11/d18/d19/l1d 0 2024-04-23T14:50:02.634 INFO:tasks.workunit.client.1.smithi156.stdout:5/682: chown d1/d3/d43/fc1 9 1 2024-04-23T14:50:02.635 INFO:tasks.workunit.client.0.smithi081.stdout:2/962: symlink d1/d11/d21/l147 0 2024-04-23T14:50:02.636 INFO:tasks.workunit.client.1.smithi156.stdout:4/590: dread d0/df/f64 [0,4194304] 0 2024-04-23T14:50:02.636 INFO:tasks.workunit.client.0.smithi081.stdout:7/935: unlink d3/d21/d41/dbb/fc4 0 2024-04-23T14:50:02.636 INFO:tasks.workunit.client.0.smithi081.stdout:7/936: readlink d3/d21/d41/d7c/lc0 0 2024-04-23T14:50:02.636 INFO:tasks.workunit.client.0.smithi081.stdout:7/937: stat d3/d21/d41/dd2/cfd 0 2024-04-23T14:50:02.637 INFO:tasks.workunit.client.1.smithi156.stdout:7/690: dread dc/d1d/d41/f7d [0,4194304] 0 2024-04-23T14:50:02.637 INFO:tasks.workunit.client.1.smithi156.stdout:3/576: dwrite d4/db/dd/d1d/d61/f62 [0,4194304] 0 2024-04-23T14:50:02.641 INFO:tasks.workunit.client.0.smithi081.stdout:4/902: write d1/d1d/f26 [794970,92564] 0 2024-04-23T14:50:02.641 INFO:tasks.workunit.client.0.smithi081.stdout:4/903: dread - d1/d8b/dbc/f120 zero size 2024-04-23T14:50:02.641 INFO:tasks.workunit.client.1.smithi156.stdout:8/633: mkdir d5/d9/d36/d60/db8/ddd 0 2024-04-23T14:50:02.641 INFO:tasks.workunit.client.1.smithi156.stdout:8/634: creat d5/d9/d36/d84/fde x:0 0 0 2024-04-23T14:50:02.644 INFO:tasks.workunit.client.1.smithi156.stdout:2/628: rename d4/d21/d42/d75/d79/fc6 to d4/d13/d19/d58/fe6 0 2024-04-23T14:50:02.644 INFO:tasks.workunit.client.1.smithi156.stdout:9/569: dwrite d1/d2/d3e/d50/d7a/d17/d1f/d48/f91 [0,4194304] 0 2024-04-23T14:50:02.644 INFO:tasks.workunit.client.1.smithi156.stdout:9/570: write d1/d2/d3e/d50/d7a/d17/d1f/d48/dc2/fa3 [529817,102197] 0 2024-04-23T14:50:02.650 INFO:tasks.workunit.client.1.smithi156.stdout:5/683: write d1/d11/d18/d52/d85/f9b [3460706,57848] 0 2024-04-23T14:50:02.653 INFO:tasks.workunit.client.0.smithi081.stdout:9/881: dread - d3/f107 zero size 2024-04-23T14:50:02.653 INFO:tasks.workunit.client.0.smithi081.stdout:9/882: stat d3/de/d1d/d5b/lb3 0 2024-04-23T14:50:02.660 INFO:tasks.workunit.client.0.smithi081.stdout:2/963: getdents d1/d33/d9f/d136 0 2024-04-23T14:50:02.660 INFO:tasks.workunit.client.0.smithi081.stdout:6/962: write d1/d2/d8e/d98/fb4 [108581,51190] 0 2024-04-23T14:50:02.662 INFO:tasks.workunit.client.1.smithi156.stdout:9/571: dread d1/d2/d3e/d50/d7a/d17/d1f/d48/f4f [4194304,4194304] 0 2024-04-23T14:50:02.663 INFO:tasks.workunit.client.0.smithi081.stdout:6/963: symlink d1/d51/l14e 0 2024-04-23T14:50:02.673 INFO:tasks.workunit.client.1.smithi156.stdout:1/685: dwrite db/d1f/d28/fa8 [0,4194304] 0 2024-04-23T14:50:02.674 INFO:tasks.workunit.client.1.smithi156.stdout:1/686: dread - db/d1f/fb1 zero size 2024-04-23T14:50:02.674 INFO:tasks.workunit.client.1.smithi156.stdout:1/687: chown db/d1f/d28 51 1 2024-04-23T14:50:02.674 INFO:tasks.workunit.client.1.smithi156.stdout:1/688: truncate db/d25/d30/d38/d40/faa 305266 0 2024-04-23T14:50:02.678 INFO:tasks.workunit.client.1.smithi156.stdout:7/691: link dc/d93/d6c/f8b dc/d93/d6c/fda 0 2024-04-23T14:50:02.678 INFO:tasks.workunit.client.1.smithi156.stdout:7/692: fdatasync dc/f54 0 2024-04-23T14:50:02.682 INFO:tasks.workunit.client.0.smithi081.stdout:9/883: dread d3/de/d76/f7d [0,4194304] 0 2024-04-23T14:50:02.682 INFO:tasks.workunit.client.0.smithi081.stdout:9/884: truncate d3/de/d14/d5e/f87 2392056 0 2024-04-23T14:50:02.682 INFO:tasks.workunit.client.0.smithi081.stdout:9/885: truncate d3/de/d1d/dcc/feb 572980 0 2024-04-23T14:50:02.682 INFO:tasks.workunit.client.0.smithi081.stdout:2/964: dread d1/d11/fd6 [0,4194304] 0 2024-04-23T14:50:02.682 INFO:tasks.workunit.client.0.smithi081.stdout:2/965: creat d1/d11/d21/f148 x:0 0 0 2024-04-23T14:50:02.683 INFO:tasks.workunit.client.0.smithi081.stdout:2/966: creat d1/d33/d9f/f149 x:0 0 0 2024-04-23T14:50:02.684 INFO:tasks.workunit.client.0.smithi081.stdout:4/904: dread d1/d4/d11/d75/f88 [0,4194304] 0 2024-04-23T14:50:02.684 INFO:tasks.workunit.client.0.smithi081.stdout:4/905: write d1/d4/d11/fbe [654027,105236] 0 2024-04-23T14:50:02.685 INFO:tasks.workunit.client.1.smithi156.stdout:8/635: creat d5/d9/d36/d60/db8/fdf x:0 0 0 2024-04-23T14:50:02.688 INFO:tasks.workunit.client.0.smithi081.stdout:9/886: creat d3/de/d1d/dcc/d10f/f120 x:0 0 0 2024-04-23T14:50:02.689 INFO:tasks.workunit.client.1.smithi156.stdout:2/629: truncate d4/d21/d42/f43 389706 0 2024-04-23T14:50:02.689 INFO:tasks.workunit.client.1.smithi156.stdout:2/630: readlink d4/d21/d42/laf 0 2024-04-23T14:50:02.692 INFO:tasks.workunit.client.1.smithi156.stdout:5/684: creat d1/d11/d18/d19/d9a/dbe/fd7 x:0 0 0 2024-04-23T14:50:02.692 INFO:tasks.workunit.client.1.smithi156.stdout:5/685: dread - d1/d17/fbb zero size 2024-04-23T14:50:02.699 INFO:tasks.workunit.client.1.smithi156.stdout:8/636: mkdir d5/d39/de0 0 2024-04-23T14:50:02.703 INFO:tasks.workunit.client.1.smithi156.stdout:5/686: rename d1/d11/d18/cbd to d1/d11/d18/d52/d85/d96/dd3/cd8 0 2024-04-23T14:50:02.705 INFO:tasks.workunit.client.0.smithi081.stdout:2/967: write d1/d1e/f9c [4987230,42707] 0 2024-04-23T14:50:02.705 INFO:tasks.workunit.client.0.smithi081.stdout:2/968: chown d1/d33/d45/d6e/f9d 0 1 2024-04-23T14:50:02.705 INFO:tasks.workunit.client.0.smithi081.stdout:7/938: dwrite d3/d21/d41/d7c/dc3/d7f/f128 [0,4194304] 0 2024-04-23T14:50:02.705 INFO:tasks.workunit.client.0.smithi081.stdout:7/939: fdatasync d3/d21/d31/f8 0 2024-04-23T14:50:02.707 INFO:tasks.workunit.client.1.smithi156.stdout:4/591: dwrite d0/df/f64 [0,4194304] 0 2024-04-23T14:50:02.707 INFO:tasks.workunit.client.1.smithi156.stdout:4/592: fsync d0/df/d55/f3c 0 2024-04-23T14:50:02.707 INFO:tasks.workunit.client.1.smithi156.stdout:6/709: sync 2024-04-23T14:50:02.707 INFO:tasks.workunit.client.1.smithi156.stdout:6/710: dread - d3/fb0 zero size 2024-04-23T14:50:02.708 INFO:tasks.workunit.client.0.smithi081.stdout:9/887: dread d3/de/d1d/d54/d68/f7e [0,4194304] 0 2024-04-23T14:50:02.709 INFO:tasks.workunit.client.1.smithi156.stdout:6/711: mknod d3/da/d1d/d27/dfe/d3b/c105 0 2024-04-23T14:50:02.709 INFO:tasks.workunit.client.1.smithi156.stdout:6/712: stat d3/d16/d46/l47 0 2024-04-23T14:50:02.715 INFO:tasks.workunit.client.0.smithi081.stdout:2/969: mkdir d1/d11/d21/d52/d8b/d14a 0 2024-04-23T14:50:02.723 INFO:tasks.workunit.client.0.smithi081.stdout:9/888: mknod d3/de/d1d/d62/c121 0 2024-04-23T14:50:02.723 INFO:tasks.workunit.client.0.smithi081.stdout:6/964: write d1/d2/f8f [10047251,99875] 0 2024-04-23T14:50:02.724 INFO:tasks.workunit.client.0.smithi081.stdout:2/970: truncate d1/d33/d45/d6e/d97/fb4 108507 0 2024-04-23T14:50:02.727 INFO:tasks.workunit.client.0.smithi081.stdout:6/965: creat d1/d51/d65/d8/d2e/d58/f14f x:0 0 0 2024-04-23T14:50:02.727 INFO:tasks.workunit.client.0.smithi081.stdout:6/966: creat d1/d51/d65/d13/d46/f150 x:0 0 0 2024-04-23T14:50:02.728 INFO:tasks.workunit.client.0.smithi081.stdout:2/971: creat d1/d11/d21/d52/d8b/d14a/f14b x:0 0 0 2024-04-23T14:50:02.729 INFO:tasks.workunit.client.0.smithi081.stdout:2/972: creat d1/d33/d9f/f14c x:0 0 0 2024-04-23T14:50:02.729 INFO:tasks.workunit.client.0.smithi081.stdout:2/973: chown d1/d11/d21/d52/cc5 111594970 1 2024-04-23T14:50:02.733 INFO:tasks.workunit.client.0.smithi081.stdout:6/967: truncate d1/d14b/f103 245402 0 2024-04-23T14:50:02.734 INFO:tasks.workunit.client.1.smithi156.stdout:2/631: dread d4/f62 [0,4194304] 0 2024-04-23T14:50:02.734 INFO:tasks.workunit.client.1.smithi156.stdout:2/632: readlink d4/lb 0 2024-04-23T14:50:02.735 INFO:tasks.workunit.client.0.smithi081.stdout:9/889: dread d3/de/d25/fce [0,4194304] 0 2024-04-23T14:50:02.738 INFO:tasks.workunit.client.0.smithi081.stdout:2/974: mknod d1/d11/d21/d52/d8b/d8f/dee/c14d 0 2024-04-23T14:50:02.738 INFO:tasks.workunit.client.1.smithi156.stdout:1/689: read db/d25/f3b [1696841,108194] 0 2024-04-23T14:50:02.738 INFO:tasks.workunit.client.1.smithi156.stdout:1/690: fsync db/d1f/d2f/f55 0 2024-04-23T14:50:02.740 INFO:tasks.workunit.client.0.smithi081.stdout:9/890: dread - d3/de/d14/dab/f11f zero size 2024-04-23T14:50:02.743 INFO:tasks.workunit.client.1.smithi156.stdout:3/577: dwrite d4/db/dd/f1b [0,4194304] 0 2024-04-23T14:50:02.743 INFO:tasks.workunit.client.1.smithi156.stdout:3/578: dread - d4/db/dd/d1d/d1e/d74/d90/f4d zero size 2024-04-23T14:50:02.744 INFO:tasks.workunit.client.0.smithi081.stdout:9/891: rename d3/de/d1d/d54/d68/l9a to d3/de/d1d/d5b/d7b/d90/d11b/l122 0 2024-04-23T14:50:02.745 INFO:tasks.workunit.client.0.smithi081.stdout:9/892: fsync d3/d5/fa8 0 2024-04-23T14:50:02.745 INFO:tasks.workunit.client.0.smithi081.stdout:9/893: fsync d3/de/d25/f110 0 2024-04-23T14:50:02.745 INFO:tasks.workunit.client.0.smithi081.stdout:9/894: fsync d3/de/d1d/d62/ff8 0 2024-04-23T14:50:02.745 INFO:tasks.workunit.client.0.smithi081.stdout:9/895: creat d3/de/d1d/d54/d68/f123 x:0 0 0 2024-04-23T14:50:02.747 INFO:tasks.workunit.client.1.smithi156.stdout:1/691: write db/d25/d30/d38/f73 [2297790,116554] 0 2024-04-23T14:50:02.751 INFO:tasks.workunit.client.0.smithi081.stdout:9/896: getdents d3/d67 0 2024-04-23T14:50:02.753 INFO:tasks.workunit.client.1.smithi156.stdout:3/579: creat d4/db/dd/d1d/d1e/d42/d76/dba/fbd x:0 0 0 2024-04-23T14:50:02.753 INFO:tasks.workunit.client.1.smithi156.stdout:3/580: write d4/f55 [706341,90960] 0 2024-04-23T14:50:02.756 INFO:tasks.workunit.client.0.smithi081.stdout:7/940: dwrite d3/d97/fa5 [0,4194304] 0 2024-04-23T14:50:02.756 INFO:tasks.workunit.client.0.smithi081.stdout:7/941: dread - d3/d21/d31/d50/d5a/f78 zero size 2024-04-23T14:50:02.756 INFO:tasks.workunit.client.0.smithi081.stdout:7/942: read - d3/d21/d41/dbb/ff8 zero size 2024-04-23T14:50:02.756 INFO:tasks.workunit.client.0.smithi081.stdout:7/943: fdatasync d3/d11/d2c/d75/d8e/dea/f14f 0 2024-04-23T14:50:02.764 INFO:tasks.workunit.client.1.smithi156.stdout:1/692: symlink db/d1f/d94/da1/ld5 0 2024-04-23T14:50:02.764 INFO:tasks.workunit.client.0.smithi081.stdout:7/944: creat d3/d21/f152 x:0 0 0 2024-04-23T14:50:02.765 INFO:tasks.workunit.client.0.smithi081.stdout:7/945: truncate d3/d21/d41/dbb/fde 118882 0 2024-04-23T14:50:02.765 INFO:tasks.workunit.client.0.smithi081.stdout:2/975: write d1/d33/d9f/f125 [1469109,35841] 0 2024-04-23T14:50:02.765 INFO:tasks.workunit.client.1.smithi156.stdout:3/581: truncate d4/db/dd/d1d/d61/f6a 921207 0 2024-04-23T14:50:02.766 INFO:tasks.workunit.client.0.smithi081.stdout:3/871: sync 2024-04-23T14:50:02.766 INFO:tasks.workunit.client.1.smithi156.stdout:9/572: dwrite d1/d2/d3e/d50/d7a/d17/f2c [0,4194304] 0 2024-04-23T14:50:02.767 INFO:tasks.workunit.client.1.smithi156.stdout:8/637: dread d5/d9/d5a/d5c/f72 [0,4194304] 0 2024-04-23T14:50:02.767 INFO:tasks.workunit.client.1.smithi156.stdout:9/573: creat d1/d2/d3e/d50/d7a/d40/d35/fc4 x:0 0 0 2024-04-23T14:50:02.767 INFO:tasks.workunit.client.1.smithi156.stdout:1/693: mknod db/d25/d30/d38/d40/cd6 0 2024-04-23T14:50:02.772 INFO:tasks.workunit.client.0.smithi081.stdout:7/946: creat d3/d11/d2c/d75/f153 x:0 0 0 2024-04-23T14:50:02.776 INFO:tasks.workunit.client.0.smithi081.stdout:2/976: mknod d1/d1e/dad/c14e 0 2024-04-23T14:50:02.777 INFO:tasks.workunit.client.0.smithi081.stdout:4/906: dwrite d1/d1d/d39/d8d/f90 [4194304,4194304] 0 2024-04-23T14:50:02.777 INFO:tasks.workunit.client.0.smithi081.stdout:4/907: chown d1/d1d/f52 121 1 2024-04-23T14:50:02.778 INFO:tasks.workunit.client.1.smithi156.stdout:3/582: rename d4/db/dd/d20/fb3 to d4/db/dd/d20/d57/fbe 0 2024-04-23T14:50:02.778 INFO:tasks.workunit.client.1.smithi156.stdout:3/583: stat d4/db/dd/l8e 0 2024-04-23T14:50:02.780 INFO:tasks.workunit.client.0.smithi081.stdout:3/872: mknod d4/d7/d32/da6/dc4/df7/d106/c11f 0 2024-04-23T14:50:02.780 INFO:tasks.workunit.client.1.smithi156.stdout:3/584: write d4/db/dd/d1d/d1e/d13/f1f [4437861,40042] 0 2024-04-23T14:50:02.785 INFO:tasks.workunit.client.0.smithi081.stdout:7/947: rename d3/d11/d2c/f3d to d3/f154 0 2024-04-23T14:50:02.785 INFO:tasks.workunit.client.0.smithi081.stdout:7/948: fdatasync d3/d11/d2c/f53 0 2024-04-23T14:50:02.787 INFO:tasks.workunit.client.0.smithi081.stdout:2/977: truncate d1/d11/dab/fb7 1080919 0 2024-04-23T14:50:02.788 INFO:tasks.workunit.client.1.smithi156.stdout:9/574: mkdir d1/d2/d3e/d50/d7a/d40/d35/db6/dc5 0 2024-04-23T14:50:02.789 INFO:tasks.workunit.client.0.smithi081.stdout:4/908: mknod d1/d4/d6f/d70/daf/d8c/dc2/c121 0 2024-04-23T14:50:02.790 INFO:tasks.workunit.client.0.smithi081.stdout:4/909: chown d1/d1d/f20 1 1 2024-04-23T14:50:02.790 INFO:tasks.workunit.client.0.smithi081.stdout:4/910: write d1/d4/d11/d9d/dac/de7/f117 [1844566,72043] 0 2024-04-23T14:50:02.790 INFO:tasks.workunit.client.1.smithi156.stdout:6/713: dwrite d3/da/d74/fcb [0,4194304] 0 2024-04-23T14:50:02.791 INFO:tasks.workunit.client.0.smithi081.stdout:6/968: dwrite d1/d2/d8e/d98/ff9 [0,4194304] 0 2024-04-23T14:50:02.791 INFO:tasks.workunit.client.1.smithi156.stdout:8/638: rmdir d5/d9/d36/d84/dc1 39 2024-04-23T14:50:02.795 INFO:tasks.workunit.client.0.smithi081.stdout:7/949: mknod d3/d11/d2c/c155 0 2024-04-23T14:50:02.795 INFO:tasks.workunit.client.1.smithi156.stdout:6/714: rename d3/d16/d46/f60 to d3/d16/d46/d9d/d9f/dad/f106 0 2024-04-23T14:50:02.795 INFO:tasks.workunit.client.1.smithi156.stdout:6/715: chown d3/da/d1d/d27/dfe/d6e/f95 1249560051 1 2024-04-23T14:50:02.797 INFO:tasks.workunit.client.1.smithi156.stdout:0/645: sync 2024-04-23T14:50:02.800 INFO:tasks.workunit.client.1.smithi156.stdout:6/716: symlink d3/da/d1d/d27/d80/l107 0 2024-04-23T14:50:02.801 INFO:tasks.workunit.client.0.smithi081.stdout:3/873: link d4/dc/d50/d9a/f9b d4/d7/f120 0 2024-04-23T14:50:02.802 INFO:tasks.workunit.client.0.smithi081.stdout:9/897: dwrite d3/de/d1d/dd9/f111 [0,4194304] 0 2024-04-23T14:50:02.805 INFO:tasks.workunit.client.1.smithi156.stdout:9/575: dread d1/fe [0,4194304] 0 2024-04-23T14:50:02.809 INFO:tasks.workunit.client.0.smithi081.stdout:6/969: rename d1/d2/d8e/d98/fb4 to d1/d14b/dd0/df7/da1/dc1/dc9/ddb/d14c/f151 0 2024-04-23T14:50:02.811 INFO:tasks.workunit.client.1.smithi156.stdout:8/639: rename d5/d9/d36/d60/d62/d97 to d5/d9/d36/d60/db8/ddd/de1 0 2024-04-23T14:50:02.812 INFO:tasks.workunit.client.1.smithi156.stdout:0/646: dread d0/d16/d3a/d1e/f5d [0,4194304] 0 2024-04-23T14:50:02.812 INFO:tasks.workunit.client.1.smithi156.stdout:0/647: fdatasync d0/d16/d3a/d1e/d80/fbc 0 2024-04-23T14:50:02.812 INFO:tasks.workunit.client.0.smithi081.stdout:2/978: getdents d1/d11/d21 0 2024-04-23T14:50:02.813 INFO:tasks.workunit.client.0.smithi081.stdout:2/979: fsync d1/d1e/dad/ff4 0 2024-04-23T14:50:02.815 INFO:tasks.workunit.client.1.smithi156.stdout:6/717: write d3/d16/d46/d9d/fbe [107528,19267] 0 2024-04-23T14:50:02.820 INFO:tasks.workunit.client.0.smithi081.stdout:9/898: creat d3/de/d76/d116/f124 x:0 0 0 2024-04-23T14:50:02.822 INFO:tasks.workunit.client.0.smithi081.stdout:6/970: symlink d1/d51/d65/d8/db1/l152 0 2024-04-23T14:50:02.826 INFO:tasks.workunit.client.1.smithi156.stdout:9/576: symlink d1/d2/d3e/d55/d6f/d8e/lc6 0 2024-04-23T14:50:02.831 INFO:tasks.workunit.client.0.smithi081.stdout:9/899: creat d3/de/d1d/d5b/d7b/db2/dd5/f125 x:0 0 0 2024-04-23T14:50:02.832 INFO:tasks.workunit.client.0.smithi081.stdout:3/874: dread d4/dc/d50/d9a/fa5 [0,4194304] 0 2024-04-23T14:50:02.834 INFO:tasks.workunit.client.0.smithi081.stdout:3/875: chown d4/d7/d7f/ff4 1 1 2024-04-23T14:50:02.834 INFO:tasks.workunit.client.0.smithi081.stdout:6/971: mkdir d1/d51/d65/d1c/d6e/d7d/d153 0 2024-04-23T14:50:02.837 INFO:tasks.workunit.client.0.smithi081.stdout:9/900: rename d3/d5/l10b to d3/de/d1d/d73/l126 0 2024-04-23T14:50:02.842 INFO:tasks.workunit.client.0.smithi081.stdout:7/950: dwrite d3/d20/dc9/f84 [8388608,4194304] 0 2024-04-23T14:50:02.843 INFO:tasks.workunit.client.0.smithi081.stdout:6/972: mkdir d1/d14b/dd0/df7/da1/dc1/dc9/dcf/d101/d154 0 2024-04-23T14:50:02.843 INFO:tasks.workunit.client.0.smithi081.stdout:7/951: write d3/d21/d31/f115 [122439,46379] 0 2024-04-23T14:50:02.846 INFO:tasks.workunit.client.0.smithi081.stdout:6/973: write d1/d51/d7b/d91/fb9 [1752014,65693] 0 2024-04-23T14:50:02.846 INFO:tasks.workunit.client.0.smithi081.stdout:3/876: dread d4/d7/d1a/f8e [0,4194304] 0 2024-04-23T14:50:02.846 INFO:tasks.workunit.client.0.smithi081.stdout:3/877: fsync d4/d7/d32/db0/db5/fea 0 2024-04-23T14:50:02.856 INFO:tasks.workunit.client.1.smithi156.stdout:7/693: dwrite dc/d2c/d68/fad [0,4194304] 0 2024-04-23T14:50:02.856 INFO:tasks.workunit.client.1.smithi156.stdout:7/694: readlink dc/d2c/l61 0 2024-04-23T14:50:02.856 INFO:tasks.workunit.client.1.smithi156.stdout:7/695: chown dc/d1d/d24/d5a/faa 3537 1 2024-04-23T14:50:02.856 INFO:tasks.workunit.client.0.smithi081.stdout:6/974: dread d1/d14b/dd0/df7/da1/dc1/dc9/dcf/d101/f131 [0,4194304] 0 2024-04-23T14:50:02.856 INFO:tasks.workunit.client.0.smithi081.stdout:6/975: write d1/d51/d65/d8/d2e/d58/f9d [694548,119448] 0 2024-04-23T14:50:02.857 INFO:tasks.workunit.client.1.smithi156.stdout:4/593: dwrite d0/df/d55/d68/f4f [0,4194304] 0 2024-04-23T14:50:02.861 INFO:tasks.workunit.client.0.smithi081.stdout:6/976: mkdir d1/d51/d65/d13/df4/d155 0 2024-04-23T14:50:02.862 INFO:tasks.workunit.client.1.smithi156.stdout:6/718: dread d3/d16/d46/d64/f90 [0,4194304] 0 2024-04-23T14:50:02.864 INFO:tasks.workunit.client.0.smithi081.stdout:6/977: symlink d1/d14b/dd0/df7/da1/l156 0 2024-04-23T14:50:02.864 INFO:tasks.workunit.client.0.smithi081.stdout:6/978: chown d1/d51/d65/d8/da4 0 1 2024-04-23T14:50:02.865 INFO:tasks.workunit.client.0.smithi081.stdout:7/952: dread d3/d21/d41/d7c/dc3/d7f/d98/f10e [0,4194304] 0 2024-04-23T14:50:02.867 INFO:tasks.workunit.client.0.smithi081.stdout:6/979: rename d1/d51/d65/d8/d2e/d59/ff5 to d1/d51/d65/d1c/d66/f157 0 2024-04-23T14:50:02.868 INFO:tasks.workunit.client.1.smithi156.stdout:3/585: dwrite d4/db/dd/d1d/d61/f6a [0,4194304] 0 2024-04-23T14:50:02.868 INFO:tasks.workunit.client.1.smithi156.stdout:4/594: symlink d0/df/d75/lca 0 2024-04-23T14:50:02.868 INFO:tasks.workunit.client.1.smithi156.stdout:7/696: creat dc/d1d/d48/fdb x:0 0 0 2024-04-23T14:50:02.869 INFO:tasks.workunit.client.1.smithi156.stdout:6/719: creat d3/da/d1d/d27/dfe/d6e/f108 x:0 0 0 2024-04-23T14:50:02.869 INFO:tasks.workunit.client.1.smithi156.stdout:6/720: dread - d3/da/f3a zero size 2024-04-23T14:50:02.869 INFO:tasks.workunit.client.0.smithi081.stdout:7/953: mknod d3/d11/d2c/d75/d8e/c156 0 2024-04-23T14:50:02.870 INFO:tasks.workunit.client.1.smithi156.stdout:3/586: rmdir d4/db/dd/d1d/d61/d8d 39 2024-04-23T14:50:02.875 INFO:tasks.workunit.client.0.smithi081.stdout:6/980: unlink d1/d51/f112 0 2024-04-23T14:50:02.875 INFO:tasks.workunit.client.0.smithi081.stdout:6/981: dread - d1/d14b/dd0/ff8 zero size 2024-04-23T14:50:02.879 INFO:tasks.workunit.client.1.smithi156.stdout:4/595: rename d0/df/f51 to d0/df/d75/fcb 0 2024-04-23T14:50:02.879 INFO:tasks.workunit.client.1.smithi156.stdout:7/697: symlink dc/d1d/dba/ldc 0 2024-04-23T14:50:02.879 INFO:tasks.workunit.client.1.smithi156.stdout:1/694: write db/d25/d30/f43 [842235,124818] 0 2024-04-23T14:50:02.880 INFO:tasks.workunit.client.0.smithi081.stdout:6/982: rename d1/c83 to d1/d14b/dd0/df7/dd2/d129/c158 0 2024-04-23T14:50:02.882 INFO:tasks.workunit.client.1.smithi156.stdout:6/721: creat d3/d16/d46/d64/f109 x:0 0 0 2024-04-23T14:50:02.885 INFO:tasks.workunit.client.0.smithi081.stdout:2/980: dwrite d1/d1e/dad/fed [0,4194304] 0 2024-04-23T14:50:02.885 INFO:tasks.workunit.client.0.smithi081.stdout:2/981: truncate d1/d1e/f66 2801211 0 2024-04-23T14:50:02.885 INFO:tasks.workunit.client.1.smithi156.stdout:3/587: rename d4/db/dd/d20/l44 to d4/db/dd/d1d/d61/lbf 0 2024-04-23T14:50:02.888 INFO:tasks.workunit.client.1.smithi156.stdout:2/633: dwrite d4/d13/d88/f72 [0,4194304] 0 2024-04-23T14:50:02.889 INFO:tasks.workunit.client.0.smithi081.stdout:6/983: mknod d1/d51/d65/d1c/d66/c159 0 2024-04-23T14:50:02.894 INFO:tasks.workunit.client.1.smithi156.stdout:3/588: link d4/db/d4b/l58 d4/db/dd/d1d/d1e/d13/d5a/dab/lc0 0 2024-04-23T14:50:02.895 INFO:tasks.workunit.client.0.smithi081.stdout:3/878: dwrite d4/d7/d32/da6/dc4/fc0 [0,4194304] 0 2024-04-23T14:50:02.895 INFO:tasks.workunit.client.0.smithi081.stdout:3/879: readlink d4/d7/df/d30/d64/d83/l89 0 2024-04-23T14:50:02.897 INFO:tasks.workunit.client.1.smithi156.stdout:7/698: rename dc/d1d/d48/d83 to dc/d46/d58/db7/ddd 0 2024-04-23T14:50:02.898 INFO:tasks.workunit.client.1.smithi156.stdout:7/699: truncate dc/f81 1256366 0 2024-04-23T14:50:02.900 INFO:tasks.workunit.client.0.smithi081.stdout:7/954: dread d3/d11/d2c/d75/f3c [0,4194304] 0 2024-04-23T14:50:02.901 INFO:tasks.workunit.client.0.smithi081.stdout:6/984: write d1/d14b/dd0/df7/da1/dc1/dc9/f13f [80706,27728] 0 2024-04-23T14:50:02.903 INFO:tasks.workunit.client.0.smithi081.stdout:9/901: dread d3/de/d22/fac [4194304,4194304] 0 2024-04-23T14:50:02.904 INFO:tasks.workunit.client.0.smithi081.stdout:9/902: fdatasync d3/de/d1d/fc3 0 2024-04-23T14:50:02.904 INFO:tasks.workunit.client.0.smithi081.stdout:3/880: rename d4/dc/f45 to d4/d7/d7f/d85/d9d/dac/dc7/f121 0 2024-04-23T14:50:02.904 INFO:tasks.workunit.client.0.smithi081.stdout:3/881: dread - d4/d7/d2e/fc9 zero size 2024-04-23T14:50:02.905 INFO:tasks.workunit.client.0.smithi081.stdout:4/911: dwrite d1/d1d/f52 [0,4194304] 0 2024-04-23T14:50:02.905 INFO:tasks.workunit.client.0.smithi081.stdout:4/912: fdatasync d1/f3a 0 2024-04-23T14:50:02.906 INFO:tasks.workunit.client.0.smithi081.stdout:9/903: creat d3/d1a/d6c/f127 x:0 0 0 2024-04-23T14:50:02.912 INFO:tasks.workunit.client.0.smithi081.stdout:3/882: creat d4/d7/d32/da6/f122 x:0 0 0 2024-04-23T14:50:02.913 INFO:tasks.workunit.client.0.smithi081.stdout:2/982: dread d1/d11/d21/d52/d8b/d8f/d93/fcb [0,4194304] 0 2024-04-23T14:50:02.913 INFO:tasks.workunit.client.1.smithi156.stdout:7/700: mknod dc/d1d/cde 0 2024-04-23T14:50:02.913 INFO:tasks.workunit.client.1.smithi156.stdout:7/701: chown dc/d46/d58/db7/ddd/ld3 3519951 1 2024-04-23T14:50:02.916 INFO:tasks.workunit.client.0.smithi081.stdout:9/904: rename d3/d5/l48 to d3/d67/l128 0 2024-04-23T14:50:02.916 INFO:tasks.workunit.client.0.smithi081.stdout:9/905: chown d3/de/d1d/d73/l81 9 1 2024-04-23T14:50:02.916 INFO:tasks.workunit.client.0.smithi081.stdout:9/906: fsync d3/de/d1d/d5b/d7b/db2/f102 0 2024-04-23T14:50:02.916 INFO:tasks.workunit.client.0.smithi081.stdout:9/907: readlink d3/de/d1d/d54/d68/lf6 0 2024-04-23T14:50:02.916 INFO:tasks.workunit.client.0.smithi081.stdout:9/908: readlink d3/de/d1d/d62/l6d 0 2024-04-23T14:50:02.923 INFO:tasks.workunit.client.1.smithi156.stdout:7/702: getdents dc/d2a/da9 0 2024-04-23T14:50:02.923 INFO:tasks.workunit.client.1.smithi156.stdout:7/703: dread - dc/d2a/fce zero size 2024-04-23T14:50:02.923 INFO:tasks.workunit.client.0.smithi081.stdout:3/883: truncate d4/f6 1859877 0 2024-04-23T14:50:02.923 INFO:tasks.workunit.client.0.smithi081.stdout:3/884: write d4/d7/d32/da6/dc4/df7/f111 [81754,17820] 0 2024-04-23T14:50:02.923 INFO:tasks.workunit.client.0.smithi081.stdout:3/885: write d4/d7/d49/d51/d84/fd6 [133536,46418] 0 2024-04-23T14:50:02.923 INFO:tasks.workunit.client.0.smithi081.stdout:3/886: chown d4/d7/f120 10 1 2024-04-23T14:50:02.924 INFO:tasks.workunit.client.0.smithi081.stdout:3/887: readlink d4/d7/df/l4f 0 2024-04-23T14:50:02.924 INFO:tasks.workunit.client.0.smithi081.stdout:7/955: dread d3/d21/d41/d7c/f8f [0,4194304] 0 2024-04-23T14:50:02.924 INFO:tasks.workunit.client.0.smithi081.stdout:7/956: chown d3/d21/d41/dcd/c118 85238352 1 2024-04-23T14:50:02.924 INFO:tasks.workunit.client.0.smithi081.stdout:6/985: write d1/d51/d65/d8/da4/fff [2405980,107519] 0 2024-04-23T14:50:02.930 INFO:tasks.workunit.client.1.smithi156.stdout:8/640: dwrite d5/d9/d5a/f75 [4194304,4194304] 0 2024-04-23T14:50:02.952 INFO:tasks.workunit.client.1.smithi156.stdout:3/589: dwrite d4/db/dd/d1d/d1e/d42/d76/fb9 [0,4194304] 0 2024-04-23T14:50:02.952 INFO:tasks.workunit.client.1.smithi156.stdout:3/590: chown d4/db/dd/d1d/l85 57514920 1 2024-04-23T14:50:02.954 INFO:tasks.workunit.client.0.smithi081.stdout:6/986: dread d1/d51/d65/d1c/d66/fd1 [0,4194304] 0 2024-04-23T14:50:02.962 INFO:tasks.workunit.client.1.smithi156.stdout:9/577: dwrite d1/d2/d3e/d50/d7a/dc/fac [0,4194304] 0 2024-04-23T14:50:02.962 INFO:tasks.workunit.client.1.smithi156.stdout:9/578: readlink d1/d2/d3e/d55/d6f/laa 0 2024-04-23T14:50:02.981 INFO:tasks.workunit.client.0.smithi081.stdout:6/987: link d1/d14b/dd0/ff8 d1/d51/d65/d1c/d6e/f15a 0 2024-04-23T14:50:02.982 INFO:tasks.workunit.client.0.smithi081.stdout:4/913: dwrite d1/d4f/f10e [0,4194304] 0 2024-04-23T14:50:02.985 INFO:tasks.workunit.client.1.smithi156.stdout:6/722: dread d3/d16/d1e/f53 [0,4194304] 0 2024-04-23T14:50:02.985 INFO:tasks.workunit.client.1.smithi156.stdout:6/723: write d3/da/d1d/d27/dfe/fde [824386,23791] 0 2024-04-23T14:50:02.985 INFO:tasks.workunit.client.1.smithi156.stdout:6/724: chown d3/c45 0 1 2024-04-23T14:50:02.988 INFO:tasks.workunit.client.1.smithi156.stdout:4/596: write d0/df/d55/d68/f65 [2455154,90340] 0 2024-04-23T14:50:02.988 INFO:tasks.workunit.client.1.smithi156.stdout:4/597: chown d0/d76/l29 26804962 1 2024-04-23T14:50:02.989 INFO:tasks.workunit.client.1.smithi156.stdout:4/598: fdatasync d0/df/d55/f62 0 2024-04-23T14:50:02.993 INFO:tasks.workunit.client.1.smithi156.stdout:3/591: read d4/db/dd/d1d/d1e/d13/d5a/f6c [1017293,94452] 0 2024-04-23T14:50:02.993 INFO:tasks.workunit.client.1.smithi156.stdout:3/592: dread - d4/db/dd/d1d/d1e/d42/d76/f95 zero size 2024-04-23T14:50:03.011 INFO:tasks.workunit.client.0.smithi081.stdout:4/914: dread d1/d4/dc/f6a [0,4194304] 0 2024-04-23T14:50:03.016 INFO:tasks.workunit.client.0.smithi081.stdout:6/988: truncate d1/d14b/fc7 277572 0 2024-04-23T14:50:03.016 INFO:tasks.workunit.client.0.smithi081.stdout:6/989: write d1/d51/d65/d1c/d6e/d7d/f102 [9049302,64083] 0 2024-04-23T14:50:03.017 INFO:tasks.workunit.client.0.smithi081.stdout:6/990: dread - d1/d51/d65/d8/d2e/d59/d80/f121 zero size 2024-04-23T14:50:03.017 INFO:tasks.workunit.client.0.smithi081.stdout:6/991: creat d1/d51/d65/d78/f15b x:0 0 0 2024-04-23T14:50:03.018 INFO:tasks.workunit.client.1.smithi156.stdout:9/579: unlink d1/d2/d23/c31 0 2024-04-23T14:50:03.018 INFO:tasks.workunit.client.1.smithi156.stdout:9/580: stat d1/d2/d3e/d50/d7a/dc 0 2024-04-23T14:50:03.019 INFO:tasks.workunit.client.1.smithi156.stdout:9/581: dread - d1/d2/d3e/d55/d9c/fbb zero size 2024-04-23T14:50:03.020 INFO:tasks.workunit.client.1.smithi156.stdout:6/725: symlink d3/da/d1d/d27/dfe/d3b/d9e/l10a 0 2024-04-23T14:50:03.024 INFO:tasks.workunit.client.1.smithi156.stdout:4/599: mkdir d0/df/d55/d68/d53/d9f/dcc 0 2024-04-23T14:50:03.028 INFO:tasks.workunit.client.1.smithi156.stdout:3/593: unlink d4/db/dd/d1d/d1e/d42/d76/fb9 0 2024-04-23T14:50:03.030 INFO:tasks.workunit.client.1.smithi156.stdout:4/600: mknod d0/df/d21/dc2/ccd 0 2024-04-23T14:50:03.030 INFO:tasks.workunit.client.1.smithi156.stdout:4/601: creat d0/d8/d1e/da0/fce x:0 0 0 2024-04-23T14:50:03.035 INFO:tasks.workunit.client.1.smithi156.stdout:6/726: dread d3/da/f1a [0,4194304] 0 2024-04-23T14:50:03.038 INFO:tasks.workunit.client.1.smithi156.stdout:6/727: rename d3/d16/d46/d64 to d3/d16/d10b 0 2024-04-23T14:50:03.039 INFO:tasks.workunit.client.1.smithi156.stdout:6/728: symlink d3/d16/d5c/d6a/l10c 0 2024-04-23T14:50:03.039 INFO:tasks.workunit.client.1.smithi156.stdout:6/729: readlink d3/l79 0 2024-04-23T14:50:03.050 INFO:tasks.workunit.client.0.smithi081.stdout:6/992: dread d1/d51/d65/f86 [0,4194304] 0 2024-04-23T14:50:03.050 INFO:tasks.workunit.client.1.smithi156.stdout:9/582: write d1/d2/d3e/d50/d7a/d17/d1f/f36 [3794878,95198] 0 2024-04-23T14:50:03.051 INFO:tasks.workunit.client.1.smithi156.stdout:9/583: chown d1/d2/d3e/d55/d6f/l67 2199 1 2024-04-23T14:50:03.051 INFO:tasks.workunit.client.0.smithi081.stdout:6/993: mkdir d1/d51/d65/d15c 0 2024-04-23T14:50:03.051 INFO:tasks.workunit.client.0.smithi081.stdout:6/994: write d1/d51/d65/d8/db1/fec [120342,91038] 0 2024-04-23T14:50:03.052 INFO:tasks.workunit.client.1.smithi156.stdout:9/584: creat d1/d2/d3e/d50/da9/fc7 x:0 0 0 2024-04-23T14:50:03.053 INFO:tasks.workunit.client.0.smithi081.stdout:6/995: mkdir d1/d51/d65/d78/d15d 0 2024-04-23T14:50:03.053 INFO:tasks.workunit.client.0.smithi081.stdout:6/996: rename d1 to d1/d14b/de7/d15e 22 2024-04-23T14:50:03.054 INFO:tasks.workunit.client.1.smithi156.stdout:9/585: dread - d1/d2/d3e/d50/d7a/d17/f54 zero size 2024-04-23T14:50:03.058 INFO:tasks.workunit.client.1.smithi156.stdout:9/586: mkdir d1/d2/d23/d49/d4b/dbc/dc8 0 2024-04-23T14:50:03.058 INFO:tasks.workunit.client.1.smithi156.stdout:9/587: write d1/d2/d3e/d50/d7a/d40/f72 [489075,104353] 0 2024-04-23T14:50:03.059 INFO:tasks.workunit.client.1.smithi156.stdout:9/588: dread - d1/d2/d3e/d55/d9c/f4a zero size 2024-04-23T14:50:03.060 INFO:tasks.workunit.client.0.smithi081.stdout:3/888: dwrite d4/d7/d1a/ffb [0,4194304] 0 2024-04-23T14:50:03.060 INFO:tasks.workunit.client.0.smithi081.stdout:3/889: chown d4/d7/d2e/f8b 236 1 2024-04-23T14:50:03.060 INFO:tasks.workunit.client.0.smithi081.stdout:9/909: dwrite d3/de/d1d/d73/fe1 [0,4194304] 0 2024-04-23T14:50:03.061 INFO:tasks.workunit.client.1.smithi156.stdout:4/602: read d0/df/f64 [1426512,130127] 0 2024-04-23T14:50:03.062 INFO:tasks.workunit.client.0.smithi081.stdout:7/957: dwrite d3/d21/d31/d33/d126/f146 [0,4194304] 0 2024-04-23T14:50:03.064 INFO:tasks.workunit.client.0.smithi081.stdout:6/997: dread d1/d14b/dd0/f11a [0,4194304] 0 2024-04-23T14:50:03.065 INFO:tasks.workunit.client.0.smithi081.stdout:3/890: rename d4/d7/df/d30/d64/d83/le3 to d4/d7/df/d30/d112/l123 0 2024-04-23T14:50:03.065 INFO:tasks.workunit.client.1.smithi156.stdout:7/704: dwrite dc/d2c/d68/f75 [0,4194304] 0 2024-04-23T14:50:03.065 INFO:tasks.workunit.client.1.smithi156.stdout:7/705: write dc/d1d/d24/fac [441838,96928] 0 2024-04-23T14:50:03.066 INFO:tasks.workunit.client.1.smithi156.stdout:1/695: dwrite db/d1f/d2f/db5/fc9 [0,4194304] 0 2024-04-23T14:50:03.066 INFO:tasks.workunit.client.1.smithi156.stdout:1/696: readlink db/d25/d30/d38/d40/l7e 0 2024-04-23T14:50:03.068 INFO:tasks.workunit.client.1.smithi156.stdout:4/603: creat d0/df/d55/fcf x:0 0 0 2024-04-23T14:50:03.075 INFO:tasks.workunit.client.0.smithi081.stdout:2/983: dwrite d1/d33/f90 [0,4194304] 0 2024-04-23T14:50:03.076 INFO:tasks.workunit.client.0.smithi081.stdout:2/984: write d1/d11/f26 [2762404,40396] 0 2024-04-23T14:50:03.076 INFO:tasks.workunit.client.0.smithi081.stdout:2/985: read - d1/d11/d21/f148 zero size 2024-04-23T14:50:03.076 INFO:tasks.workunit.client.1.smithi156.stdout:7/706: symlink dc/d1d/d24/dd5/ldf 0 2024-04-23T14:50:03.076 INFO:tasks.workunit.client.1.smithi156.stdout:7/707: read - dc/d46/d58/f65 zero size 2024-04-23T14:50:03.076 INFO:tasks.workunit.client.1.smithi156.stdout:7/708: fdatasync dc/d2a/fb2 0 2024-04-23T14:50:03.081 INFO:tasks.workunit.client.0.smithi081.stdout:7/958: mkdir d3/d21/d41/dbb/d139/d14c/d6e/d148/d157 0 2024-04-23T14:50:03.082 INFO:tasks.workunit.client.0.smithi081.stdout:4/915: dread d1/d1d/f20 [0,4194304] 0 2024-04-23T14:50:03.082 INFO:tasks.workunit.client.0.smithi081.stdout:6/998: mknod d1/d14b/dd0/df7/da1/dc1/dc9/dcf/d101/d123/c15f 0 2024-04-23T14:50:03.085 INFO:tasks.workunit.client.1.smithi156.stdout:0/648: dwrite d0/d16/d3a/fa1 [0,4194304] 0 2024-04-23T14:50:03.086 INFO:tasks.workunit.client.1.smithi156.stdout:0/649: write d0/d4/fcb [36526,78904] 0 2024-04-23T14:50:03.090 INFO:tasks.workunit.client.0.smithi081.stdout:2/986: creat d1/d1e/f14f x:0 0 0 2024-04-23T14:50:03.091 INFO:tasks.workunit.client.0.smithi081.stdout:2/987: chown d1/d33/d9f/lfd 5 1 2024-04-23T14:50:03.091 INFO:tasks.workunit.client.1.smithi156.stdout:9/589: dread d1/d2/d3e/d55/d9c/d39/f42 [0,4194304] 0 2024-04-23T14:50:03.091 INFO:tasks.workunit.client.1.smithi156.stdout:9/590: dread - d1/d2/d3e/d55/d9c/f9e zero size 2024-04-23T14:50:03.094 INFO:tasks.workunit.client.0.smithi081.stdout:7/959: truncate d3/d21/d41/f6b 4342156 0 2024-04-23T14:50:03.104 INFO:tasks.workunit.client.1.smithi156.stdout:4/604: dread d0/df/f58 [0,4194304] 0 2024-04-23T14:50:03.104 INFO:tasks.workunit.client.0.smithi081.stdout:6/999: dread d1/f2a [0,4194304] 0 2024-04-23T14:50:03.104 INFO:tasks.workunit.client.0.smithi081.stdout:4/916: truncate d1/d4/f63 3720535 0 2024-04-23T14:50:03.104 INFO:tasks.workunit.client.0.smithi081.stdout:3/891: getdents d4/d7/d7f/d85/d9d/dac/dc7 0 2024-04-23T14:50:03.107 INFO:tasks.workunit.client.0.smithi081.stdout:2/988: link d1/d33/fcf d1/d1e/f150 0 2024-04-23T14:50:03.110 INFO:tasks.workunit.client.1.smithi156.stdout:3/594: dwrite d4/f10 [0,4194304] 0 2024-04-23T14:50:03.110 INFO:tasks.workunit.client.1.smithi156.stdout:4/605: getdents d0/df/d55/d68/d53/d91/d95 0 2024-04-23T14:50:03.116 INFO:tasks.workunit.client.0.smithi081.stdout:4/917: creat d1/d4/d6f/d70/f122 x:0 0 0 2024-04-23T14:50:03.116 INFO:tasks.workunit.client.0.smithi081.stdout:4/918: read - d1/d8b/dbc/f120 zero size 2024-04-23T14:50:03.126 INFO:tasks.workunit.client.0.smithi081.stdout:4/919: dread d1/d4/d11/f79 [0,4194304] 0 2024-04-23T14:50:03.126 INFO:tasks.workunit.client.0.smithi081.stdout:4/920: dread - d1/d4/d6f/feb zero size 2024-04-23T14:50:03.128 INFO:tasks.workunit.client.1.smithi156.stdout:3/595: mkdir d4/db/dd/d1d/d1e/d42/d76/dc1 0 2024-04-23T14:50:03.129 INFO:tasks.workunit.client.1.smithi156.stdout:4/606: write d0/df/d55/d68/f4f [43626,57260] 0 2024-04-23T14:50:03.130 INFO:tasks.workunit.client.0.smithi081.stdout:3/892: write d4/d7/fcc [1750294,123390] 0 2024-04-23T14:50:03.132 INFO:tasks.workunit.client.0.smithi081.stdout:2/989: dread d1/d33/d95/fc9 [0,4194304] 0 2024-04-23T14:50:03.132 INFO:tasks.workunit.client.1.smithi156.stdout:4/607: truncate d0/df/f17 2901966 0 2024-04-23T14:50:03.136 INFO:tasks.workunit.client.0.smithi081.stdout:2/990: unlink d1/d1e/dad/f115 0 2024-04-23T14:50:03.136 INFO:tasks.workunit.client.1.smithi156.stdout:6/730: dwrite d3/d16/d46/d9d/fbe [0,4194304] 0 2024-04-23T14:50:03.150 INFO:tasks.workunit.client.1.smithi156.stdout:6/731: dread d3/d16/d46/d9d/d9f/fa3 [0,4194304] 0 2024-04-23T14:50:03.154 INFO:tasks.workunit.client.1.smithi156.stdout:6/732: rename d3/d16/d1e/f53 to d3/da/f10d 0 2024-04-23T14:50:03.154 INFO:tasks.workunit.client.0.smithi081.stdout:3/893: dread d4/d41/dc6/f7a [0,4194304] 0 2024-04-23T14:50:03.155 INFO:tasks.workunit.client.0.smithi081.stdout:3/894: chown d4/dc/d50/d9a/l118 71 1 2024-04-23T14:50:03.156 INFO:tasks.workunit.client.1.smithi156.stdout:2/634: sync 2024-04-23T14:50:03.156 INFO:tasks.workunit.client.1.smithi156.stdout:5/687: sync 2024-04-23T14:50:03.157 INFO:tasks.workunit.client.1.smithi156.stdout:2/635: chown d4/l5a 7386300 1 2024-04-23T14:50:03.157 INFO:tasks.workunit.client.1.smithi156.stdout:2/636: readlink d4/d13/d88/ldc 0 2024-04-23T14:50:03.157 INFO:tasks.workunit.client.1.smithi156.stdout:2/637: chown d4/d21/l45 4 1 2024-04-23T14:50:03.157 INFO:tasks.workunit.client.1.smithi156.stdout:2/638: creat d4/d13/d19/fe7 x:0 0 0 2024-04-23T14:50:03.158 INFO:tasks.workunit.client.1.smithi156.stdout:7/709: dread dc/d93/f9e [0,4194304] 0 2024-04-23T14:50:03.158 INFO:tasks.workunit.client.1.smithi156.stdout:7/710: dread - dc/d1d/f78 zero size 2024-04-23T14:50:03.159 INFO:tasks.workunit.client.1.smithi156.stdout:7/711: mknod dc/d1d/d48/da6/ce0 0 2024-04-23T14:50:03.160 INFO:tasks.workunit.client.1.smithi156.stdout:7/712: truncate dc/d1d/f42 2013134 0 2024-04-23T14:50:03.165 INFO:tasks.workunit.client.1.smithi156.stdout:8/641: sync 2024-04-23T14:50:03.165 INFO:tasks.workunit.client.1.smithi156.stdout:8/642: readlink d5/d9/l1b 0 2024-04-23T14:50:03.168 INFO:tasks.workunit.client.1.smithi156.stdout:8/643: rename d5/d9/d10/d1d/fce to d5/d9/d10/fe2 0 2024-04-23T14:50:03.168 INFO:tasks.workunit.client.1.smithi156.stdout:8/644: write d5/d9/d10/d1d/f8e [1081747,97354] 0 2024-04-23T14:50:03.170 INFO:tasks.workunit.client.0.smithi081.stdout:3/895: dread d4/d7/d7f/d85/d9d/dac/dc7/fed [0,4194304] 0 2024-04-23T14:50:03.173 INFO:tasks.workunit.client.1.smithi156.stdout:8/645: link d5/d9/d36/d60/d7c/fb9 d5/d9/d10/d1d/fe3 0 2024-04-23T14:50:03.173 INFO:tasks.workunit.client.0.smithi081.stdout:9/910: dwrite d3/de/d1d/d5b/d7b/db2/dd5/f125 [0,4194304] 0 2024-04-23T14:50:03.175 INFO:tasks.workunit.client.1.smithi156.stdout:5/688: dread d1/d11/d27/f2c [0,4194304] 0 2024-04-23T14:50:03.175 INFO:tasks.workunit.client.1.smithi156.stdout:8/646: symlink d5/d4e/le4 0 2024-04-23T14:50:03.175 INFO:tasks.workunit.client.1.smithi156.stdout:5/689: write d1/d11/f5e [352745,107163] 0 2024-04-23T14:50:03.176 INFO:tasks.workunit.client.1.smithi156.stdout:0/650: read d0/d16/d3a/d2a/fb9 [4076096,110782] 0 2024-04-23T14:50:03.177 INFO:tasks.workunit.client.1.smithi156.stdout:1/697: dwrite db/d25/d30/d38/f73 [0,4194304] 0 2024-04-23T14:50:03.179 INFO:tasks.workunit.client.1.smithi156.stdout:8/647: rename d5/d39/d99/la1 to d5/d4e/dc7/le5 0 2024-04-23T14:50:03.179 INFO:tasks.workunit.client.1.smithi156.stdout:5/690: rename d1/d11/d18/d19/d9a to d1/d11/d18/d19/d9a/dbe/dd9 22 2024-04-23T14:50:03.180 INFO:tasks.workunit.client.1.smithi156.stdout:0/651: mkdir d0/d16/d3a/d2a/d1d/d2d/dd5 0 2024-04-23T14:50:03.182 INFO:tasks.workunit.client.0.smithi081.stdout:9/911: mknod d3/de/d22/d105/c129 0 2024-04-23T14:50:03.185 INFO:tasks.workunit.client.1.smithi156.stdout:2/639: dread d4/fe1 [0,4194304] 0 2024-04-23T14:50:03.187 INFO:tasks.workunit.client.1.smithi156.stdout:1/698: creat db/d1f/d2d/d93/fd7 x:0 0 0 2024-04-23T14:50:03.189 INFO:tasks.workunit.client.1.smithi156.stdout:3/596: dwrite d4/db/dd/d1d/d61/d8d/f72 [0,4194304] 0 2024-04-23T14:50:03.189 INFO:tasks.workunit.client.1.smithi156.stdout:8/648: creat d5/d9/d36/d60/db8/d93/d96/fe6 x:0 0 0 2024-04-23T14:50:03.189 INFO:tasks.workunit.client.1.smithi156.stdout:8/649: readlink d5/d9/d5a/d57/l78 0 2024-04-23T14:50:03.189 INFO:tasks.workunit.client.1.smithi156.stdout:8/650: stat d5/d9/d5a/f54 0 2024-04-23T14:50:03.189 INFO:tasks.workunit.client.1.smithi156.stdout:8/651: fdatasync d5/d39/f64 0 2024-04-23T14:50:03.189 INFO:tasks.workunit.client.1.smithi156.stdout:8/652: write d5/d9/d36/d84/fde [598721,121961] 0 2024-04-23T14:50:03.190 INFO:tasks.workunit.client.1.smithi156.stdout:0/652: link d0/d4/c21 d0/d16/d43/cd6 0 2024-04-23T14:50:03.190 INFO:tasks.workunit.client.1.smithi156.stdout:0/653: chown d0/d4/d22/d58/d9a/c33 1 1 2024-04-23T14:50:03.190 INFO:tasks.workunit.client.1.smithi156.stdout:0/654: chown d0/d16/d3a/d2a/d1d/d2d/d6b/fb5 664244008 1 2024-04-23T14:50:03.190 INFO:tasks.workunit.client.1.smithi156.stdout:0/655: write d0/d16/d3a/d2a/f2c [5162396,45523] 0 2024-04-23T14:50:03.192 INFO:tasks.workunit.client.1.smithi156.stdout:2/640: mkdir d4/d13/d19/de8 0 2024-04-23T14:50:03.192 INFO:tasks.workunit.client.1.smithi156.stdout:2/641: chown d4/d13/d19/d4c 426 1 2024-04-23T14:50:03.193 INFO:tasks.workunit.client.0.smithi081.stdout:9/912: mknod d3/de/d14/d5e/d72/c12a 0 2024-04-23T14:50:03.193 INFO:tasks.workunit.client.0.smithi081.stdout:9/913: chown d3/d1a/d6c 9862 1 2024-04-23T14:50:03.195 INFO:tasks.workunit.client.0.smithi081.stdout:3/896: dread d4/f5b [0,4194304] 0 2024-04-23T14:50:03.195 INFO:tasks.workunit.client.0.smithi081.stdout:3/897: write d4/d7/d7f/d85/d9d/f74 [4259653,93602] 0 2024-04-23T14:50:03.196 INFO:tasks.workunit.client.0.smithi081.stdout:9/914: link d3/d67/c7a d3/de/c12b 0 2024-04-23T14:50:03.197 INFO:tasks.workunit.client.1.smithi156.stdout:1/699: symlink db/d1f/d2f/da9/ld8 0 2024-04-23T14:50:03.197 INFO:tasks.workunit.client.0.smithi081.stdout:4/921: dwrite d1/d1d/d39/f11b [0,4194304] 0 2024-04-23T14:50:03.198 INFO:tasks.workunit.client.1.smithi156.stdout:3/597: mknod d4/db/dd/d20/cc2 0 2024-04-23T14:50:03.200 INFO:tasks.workunit.client.0.smithi081.stdout:3/898: mknod d4/d7/d32/c124 0 2024-04-23T14:50:03.203 INFO:tasks.workunit.client.1.smithi156.stdout:8/653: unlink d5/d9/d10/f6e 0 2024-04-23T14:50:03.203 INFO:tasks.workunit.client.1.smithi156.stdout:6/733: dwrite d3/da/d1d/f102 [0,4194304] 0 2024-04-23T14:50:03.205 INFO:tasks.workunit.client.0.smithi081.stdout:2/991: dwrite d1/d33/da3/df5/f13f [0,4194304] 0 2024-04-23T14:50:03.206 INFO:tasks.workunit.client.0.smithi081.stdout:9/915: link d3/de/d1d/d62/ff8 d3/de/d1d/d5b/d7b/db2/f12c 0 2024-04-23T14:50:03.208 INFO:tasks.workunit.client.1.smithi156.stdout:0/656: creat d0/d16/d43/d9c/fd7 x:0 0 0 2024-04-23T14:50:03.208 INFO:tasks.workunit.client.0.smithi081.stdout:3/899: dread d4/d7/d7f/d85/d9d/dac/dc7/f11b [0,4194304] 0 2024-04-23T14:50:03.209 INFO:tasks.workunit.client.0.smithi081.stdout:3/900: write d4/d7/d7f/d85/d9d/dac/dc7/fed [25903,118348] 0 2024-04-23T14:50:03.211 INFO:tasks.workunit.client.1.smithi156.stdout:1/700: creat db/d1f/d28/d70/db3/fd9 x:0 0 0 2024-04-23T14:50:03.213 INFO:tasks.workunit.client.1.smithi156.stdout:3/598: creat d4/db/dd/d1d/d1e/d2b/fc3 x:0 0 0 2024-04-23T14:50:03.214 INFO:tasks.workunit.client.1.smithi156.stdout:7/713: dwrite dc/d93/d6c/f8b [0,4194304] 0 2024-04-23T14:50:03.216 INFO:tasks.workunit.client.0.smithi081.stdout:4/922: unlink d1/d4f/dc3/cef 0 2024-04-23T14:50:03.218 INFO:tasks.workunit.client.0.smithi081.stdout:3/901: creat d4/dc/f125 x:0 0 0 2024-04-23T14:50:03.218 INFO:tasks.workunit.client.0.smithi081.stdout:3/902: chown d4/d7/df 451 1 2024-04-23T14:50:03.221 INFO:tasks.workunit.client.0.smithi081.stdout:4/923: mknod d1/d4/d6f/d70/daf/d8c/d99/c123 0 2024-04-23T14:50:03.228 INFO:tasks.workunit.client.0.smithi081.stdout:2/992: dread d1/d11/f25 [0,4194304] 0 2024-04-23T14:50:03.229 INFO:tasks.workunit.client.0.smithi081.stdout:4/924: mkdir d1/d4/d6f/d70/daf/d8c/dce/d124 0 2024-04-23T14:50:03.230 INFO:tasks.workunit.client.1.smithi156.stdout:6/734: symlink d3/da/d1d/d27/d63/l10e 0 2024-04-23T14:50:03.230 INFO:tasks.workunit.client.1.smithi156.stdout:6/735: write d3/da/d1d/d27/dfe/d3b/d9e/fe4 [684292,74322] 0 2024-04-23T14:50:03.231 INFO:tasks.workunit.client.0.smithi081.stdout:3/903: mknod d4/d7/d7f/c126 0 2024-04-23T14:50:03.234 INFO:tasks.workunit.client.1.smithi156.stdout:0/657: creat d0/d16/d3a/d2a/d1d/d2d/fd8 x:0 0 0 2024-04-23T14:50:03.234 INFO:tasks.workunit.client.1.smithi156.stdout:1/701: symlink db/d25/d30/d38/lda 0 2024-04-23T14:50:03.234 INFO:tasks.workunit.client.0.smithi081.stdout:4/925: creat d1/d4/d6f/d70/daf/d8c/dc2/f125 x:0 0 0 2024-04-23T14:50:03.235 INFO:tasks.workunit.client.1.smithi156.stdout:3/599: mkdir d4/db/dd/d1d/d1e/d74/d93/dc4 0 2024-04-23T14:50:03.236 INFO:tasks.workunit.client.1.smithi156.stdout:5/691: dwrite d1/d17/f1a [0,4194304] 0 2024-04-23T14:50:03.237 INFO:tasks.workunit.client.0.smithi081.stdout:3/904: creat d4/d7/d7f/d85/d9d/dac/dc7/dd3/f127 x:0 0 0 2024-04-23T14:50:03.244 INFO:tasks.workunit.client.0.smithi081.stdout:4/926: mkdir d1/d4/d11/d75/d126 0 2024-04-23T14:50:03.244 INFO:tasks.workunit.client.0.smithi081.stdout:3/905: creat d4/d7/d7f/d85/d9d/dac/f128 x:0 0 0 2024-04-23T14:50:03.244 INFO:tasks.workunit.client.0.smithi081.stdout:3/906: stat d4/dc/d50 0 2024-04-23T14:50:03.244 INFO:tasks.workunit.client.0.smithi081.stdout:3/907: chown d4/d7/d32/da6/dc4/d47 1142 1 2024-04-23T14:50:03.244 INFO:tasks.workunit.client.0.smithi081.stdout:3/908: creat d4/d7/d1a/d71/dc2/f129 x:0 0 0 2024-04-23T14:50:03.245 INFO:tasks.workunit.client.1.smithi156.stdout:7/714: mknod dc/d1d/d24/d5a/dd0/ce1 0 2024-04-23T14:50:03.245 INFO:tasks.workunit.client.1.smithi156.stdout:0/658: dread d0/d16/dbf/d3f/f51 [0,4194304] 0 2024-04-23T14:50:03.248 INFO:tasks.workunit.client.0.smithi081.stdout:2/993: write d1/d33/d45/d6e/f8e [5608213,11159] 0 2024-04-23T14:50:03.248 INFO:tasks.workunit.client.0.smithi081.stdout:2/994: fdatasync d1/d11/d21/fc7 0 2024-04-23T14:50:03.262 INFO:tasks.workunit.client.1.smithi156.stdout:8/654: getdents d5/d9/d5a/dc8 0 2024-04-23T14:50:03.262 INFO:tasks.workunit.client.1.smithi156.stdout:8/655: write d5/d9/d10/f46 [1040579,100523] 0 2024-04-23T14:50:03.262 INFO:tasks.workunit.client.1.smithi156.stdout:0/659: dread d0/d16/d3a/d1e/f40 [0,4194304] 0 2024-04-23T14:50:03.262 INFO:tasks.workunit.client.1.smithi156.stdout:0/660: chown d0/d16/d3a/d2a/d1d/d2d/d6b/f81 8762423 1 2024-04-23T14:50:03.264 INFO:tasks.workunit.client.1.smithi156.stdout:5/692: mknod d1/d11/d18/d52/d85/cda 0 2024-04-23T14:50:03.264 INFO:tasks.workunit.client.1.smithi156.stdout:5/693: fsync d1/d3/d43/fc1 0 2024-04-23T14:50:03.264 INFO:tasks.workunit.client.1.smithi156.stdout:5/694: chown d1/d11/d18/laa 298073407 1 2024-04-23T14:50:03.266 INFO:tasks.workunit.client.1.smithi156.stdout:7/715: truncate dc/d2c/f8c 749064 0 2024-04-23T14:50:03.266 INFO:tasks.workunit.client.1.smithi156.stdout:7/716: getdents dc/d93/d6c/d88 0 2024-04-23T14:50:03.268 INFO:tasks.workunit.client.1.smithi156.stdout:8/656: truncate d5/d9/d36/d9c/f41 224735 0 2024-04-23T14:50:03.269 INFO:tasks.workunit.client.1.smithi156.stdout:6/736: dwrite d3/d16/d46/d9d/d9f/dad/fbb [0,4194304] 0 2024-04-23T14:50:03.270 INFO:tasks.workunit.client.1.smithi156.stdout:0/661: mknod d0/d16/dcd/cd9 0 2024-04-23T14:50:03.271 INFO:tasks.workunit.client.1.smithi156.stdout:1/702: rename db/d1f/d28/d70/db3/fd9 to db/d1f/fdb 0 2024-04-23T14:50:03.273 INFO:tasks.workunit.client.1.smithi156.stdout:5/695: creat d1/d3/d24/da0/d3e/fdb x:0 0 0 2024-04-23T14:50:03.276 INFO:tasks.workunit.client.1.smithi156.stdout:7/717: mknod dc/ce2 0 2024-04-23T14:50:03.276 INFO:tasks.workunit.client.1.smithi156.stdout:7/718: chown dc/d1d/cde 1 1 2024-04-23T14:50:03.278 INFO:tasks.workunit.client.1.smithi156.stdout:8/657: link d5/c7f d5/d9/d5a/dc8/ce7 0 2024-04-23T14:50:03.279 INFO:tasks.workunit.client.1.smithi156.stdout:6/737: mknod d3/d16/d10b/d77/c10f 0 2024-04-23T14:50:03.280 INFO:tasks.workunit.client.1.smithi156.stdout:6/738: read - d3/da/d1d/fe8 zero size 2024-04-23T14:50:03.281 INFO:tasks.workunit.client.1.smithi156.stdout:1/703: mkdir db/d25/d30/d38/ddc 0 2024-04-23T14:50:03.282 INFO:tasks.workunit.client.1.smithi156.stdout:5/696: mknod d1/d3/cdc 0 2024-04-23T14:50:03.284 INFO:tasks.workunit.client.1.smithi156.stdout:8/658: mkdir d5/d9/d36/de8 0 2024-04-23T14:50:03.284 INFO:tasks.workunit.client.0.smithi081.stdout:9/916: dwrite d3/de/d1d/d62/ffb [0,4194304] 0 2024-04-23T14:50:03.286 INFO:tasks.workunit.client.1.smithi156.stdout:1/704: read db/d25/d30/d38/d40/f9a [262102,105481] 0 2024-04-23T14:50:03.289 INFO:tasks.workunit.client.1.smithi156.stdout:8/659: creat d5/d39/fe9 x:0 0 0 2024-04-23T14:50:03.289 INFO:tasks.workunit.client.1.smithi156.stdout:6/739: dread d3/d16/d1e/f7d [0,4194304] 0 2024-04-23T14:50:03.289 INFO:tasks.workunit.client.1.smithi156.stdout:6/740: fdatasync d3/da/d1d/d27/dfe/d3b/d9e/fe4 0 2024-04-23T14:50:03.289 INFO:tasks.workunit.client.1.smithi156.stdout:6/741: fdatasync d3/da/d1d/d27/dfe/fde 0 2024-04-23T14:50:03.289 INFO:tasks.workunit.client.0.smithi081.stdout:9/917: creat d3/d1a/f12d x:0 0 0 2024-04-23T14:50:03.291 INFO:tasks.workunit.client.1.smithi156.stdout:1/705: rename db/d25/d4e/l8a to db/d1f/d28/d70/db3/d63/ldd 0 2024-04-23T14:50:03.292 INFO:tasks.workunit.client.1.smithi156.stdout:1/706: write db/d1f/f7a [1764703,35496] 0 2024-04-23T14:50:03.292 INFO:tasks.workunit.client.1.smithi156.stdout:9/591: sync 2024-04-23T14:50:03.292 INFO:tasks.workunit.client.1.smithi156.stdout:4/608: sync 2024-04-23T14:50:03.295 INFO:tasks.workunit.client.0.smithi081.stdout:9/918: mkdir d3/de/d1d/dcc/d10f/d12e 0 2024-04-23T14:50:03.297 INFO:tasks.workunit.client.0.smithi081.stdout:9/919: write d3/de/d1d/d54/f89 [4326911,36951] 0 2024-04-23T14:50:03.297 INFO:tasks.workunit.client.1.smithi156.stdout:8/660: mknod d5/d9/d36/cea 0 2024-04-23T14:50:03.297 INFO:tasks.workunit.client.1.smithi156.stdout:8/661: dread - d5/d9/d36/d60/db8/ddd/de1/fb6 zero size 2024-04-23T14:50:03.300 INFO:tasks.workunit.client.1.smithi156.stdout:9/592: rmdir d1/d2/d23/d49/d4b/dbc/dc8 0 2024-04-23T14:50:03.300 INFO:tasks.workunit.client.1.smithi156.stdout:9/593: read - d1/d2/d3e/d55/d9c/f9e zero size 2024-04-23T14:50:03.307 INFO:tasks.workunit.client.1.smithi156.stdout:9/594: rename d1/d2/d3e/la2 to d1/d2/lc9 0 2024-04-23T14:50:03.307 INFO:tasks.workunit.client.1.smithi156.stdout:9/595: fsync d1/d2/d3e/d50/d7a/d40/d35/fc4 0 2024-04-23T14:50:03.311 INFO:tasks.workunit.client.0.smithi081.stdout:3/909: dread d4/dc/d50/fe0 [0,4194304] 0 2024-04-23T14:50:03.313 INFO:tasks.workunit.client.0.smithi081.stdout:3/910: symlink d4/d7/d1a/d71/l12a 0 2024-04-23T14:50:03.314 INFO:tasks.workunit.client.0.smithi081.stdout:2/995: write d1/d11/d21/d34/f47 [1967823,90631] 0 2024-04-23T14:50:03.314 INFO:tasks.workunit.client.0.smithi081.stdout:3/911: truncate d4/d7/d32/da6/dc4/d47/f4a 1072656 0 2024-04-23T14:50:03.315 INFO:tasks.workunit.client.0.smithi081.stdout:4/927: dwrite d1/f29 [0,4194304] 0 2024-04-23T14:50:03.320 INFO:tasks.workunit.client.0.smithi081.stdout:4/928: rename d1/d4f/dc3 to d1/d4/d11/d75/d126/d127 0 2024-04-23T14:50:03.320 INFO:tasks.workunit.client.0.smithi081.stdout:4/929: chown d1/d1d/c35 3225 1 2024-04-23T14:50:03.322 INFO:tasks.workunit.client.0.smithi081.stdout:4/930: symlink d1/d4/dc/l128 0 2024-04-23T14:50:03.325 INFO:tasks.workunit.client.0.smithi081.stdout:4/931: creat d1/d8b/f129 x:0 0 0 2024-04-23T14:50:03.325 INFO:tasks.workunit.client.0.smithi081.stdout:4/932: read d1/d1d/f22 [2426437,75255] 0 2024-04-23T14:50:03.325 INFO:tasks.workunit.client.0.smithi081.stdout:4/933: readlink d1/d4/l13 0 2024-04-23T14:50:03.325 INFO:tasks.workunit.client.0.smithi081.stdout:4/934: fdatasync d1/d4/d6f/d70/daf/d8c/d99/f10b 0 2024-04-23T14:50:03.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:03 smithi081 ceph-mon[25540]: from='client.24455 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:50:03.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:03 smithi081 ceph-mon[25540]: pgmap v40: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 167 MiB/s rd, 195 MiB/s wr, 305 op/s 2024-04-23T14:50:03.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:03 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/1842281704' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:50:03.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:03 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:50:03.328 INFO:tasks.workunit.client.0.smithi081.stdout:4/935: symlink d1/d1d/d39/d8d/l12a 0 2024-04-23T14:50:03.328 INFO:tasks.workunit.client.0.smithi081.stdout:4/936: chown d1/d1d/d39/d8d/fad 125 1 2024-04-23T14:50:03.329 INFO:tasks.workunit.client.0.smithi081.stdout:4/937: mkdir d1/d4/d11/d9d/dac/de7/d105/d12b 0 2024-04-23T14:50:03.331 INFO:tasks.workunit.client.0.smithi081.stdout:4/938: creat d1/d1d/d39/d8d/f12c x:0 0 0 2024-04-23T14:50:03.337 INFO:tasks.workunit.client.0.smithi081.stdout:4/939: symlink d1/d4/l12d 0 2024-04-23T14:50:03.337 INFO:tasks.workunit.client.0.smithi081.stdout:4/940: chown d1/d1d/f20 6649 1 2024-04-23T14:50:03.337 INFO:tasks.workunit.client.0.smithi081.stdout:9/920: read d3/de/d1d/dd9/f111 [1751749,98749] 0 2024-04-23T14:50:03.341 INFO:tasks.workunit.client.0.smithi081.stdout:2/996: dread d1/d11/d21/d34/fb1 [0,4194304] 0 2024-04-23T14:50:03.347 INFO:tasks.workunit.client.0.smithi081.stdout:2/997: rename d1/d11/d21/f146 to d1/d33/d45/d48/f151 0 2024-04-23T14:50:03.347 INFO:tasks.workunit.client.0.smithi081.stdout:2/998: chown d1/d33/da3/df5/f134 10007095 1 2024-04-23T14:50:03.349 INFO:tasks.workunit.client.1.smithi156.stdout:1/707: dread db/d25/d30/d38/f73 [0,4194304] 0 2024-04-23T14:50:03.350 INFO:tasks.workunit.client.1.smithi156.stdout:0/662: dwrite d0/d16/d3a/d2a/f87 [0,4194304] 0 2024-04-23T14:50:03.355 INFO:tasks.workunit.client.1.smithi156.stdout:1/708: rename db/d1f/d2d/d48/daf/l51 to db/d1f/d2d/d48/daf/d86/lde 0 2024-04-23T14:50:03.355 INFO:tasks.workunit.client.0.smithi081.stdout:2/999: rename d1/d33/d9f/f149 to d1/d11/d21/d34/f152 0 2024-04-23T14:50:03.368 INFO:tasks.workunit.client.1.smithi156.stdout:5/697: dwrite d1/d3/d43/fc1 [0,4194304] 0 2024-04-23T14:50:03.373 INFO:tasks.workunit.client.1.smithi156.stdout:1/709: mknod db/cdf 0 2024-04-23T14:50:03.373 INFO:tasks.workunit.client.1.smithi156.stdout:1/710: write db/d1f/f76 [1138681,81763] 0 2024-04-23T14:50:03.384 INFO:tasks.workunit.client.1.smithi156.stdout:1/711: creat db/d1f/d28/d70/db3/fe0 x:0 0 0 2024-04-23T14:50:03.384 INFO:tasks.workunit.client.1.smithi156.stdout:5/698: rmdir d1/d11/d18/d19/d9a/dbe 39 2024-04-23T14:50:03.386 INFO:tasks.workunit.client.1.smithi156.stdout:1/712: symlink db/d25/d30/d38/ddc/le1 0 2024-04-23T14:50:03.389 INFO:tasks.workunit.client.1.smithi156.stdout:4/609: dwrite d0/df/f25 [0,4194304] 0 2024-04-23T14:50:03.394 INFO:tasks.workunit.client.1.smithi156.stdout:4/610: creat d0/df/d21/fd0 x:0 0 0 2024-04-23T14:50:03.395 INFO:tasks.workunit.client.1.smithi156.stdout:4/611: write d0/d8/f8e [603831,42601] 0 2024-04-23T14:50:03.404 INFO:tasks.workunit.client.1.smithi156.stdout:4/612: mkdir d0/df/d55/d68/d53/d91/dd1 0 2024-04-23T14:50:03.406 INFO:tasks.workunit.client.1.smithi156.stdout:4/613: getdents d0/df/d55/d68/d53/d9f 0 2024-04-23T14:50:03.409 INFO:tasks.workunit.client.1.smithi156.stdout:4/614: link d0/d76/c9e d0/df/d55/d68/d53/d91/cd2 0 2024-04-23T14:50:03.409 INFO:tasks.workunit.client.1.smithi156.stdout:4/615: stat d0/df/f58 0 2024-04-23T14:50:03.409 INFO:tasks.workunit.client.1.smithi156.stdout:4/616: readlink d0/d8/d1e/d4a/lab 0 2024-04-23T14:50:03.410 INFO:tasks.workunit.client.1.smithi156.stdout:4/617: truncate d0/df/d55/d68/d53/f7e 2690222 0 2024-04-23T14:50:03.410 INFO:tasks.workunit.client.1.smithi156.stdout:4/618: chown d0/df/d75 3 1 2024-04-23T14:50:03.412 INFO:tasks.workunit.client.1.smithi156.stdout:4/619: unlink d0/d8/d1e/f5e 0 2024-04-23T14:50:03.418 INFO:tasks.workunit.client.0.smithi081.stdout:4/941: dwrite d1/d4f/fcf [0,4194304] 0 2024-04-23T14:50:03.420 INFO:tasks.workunit.client.0.smithi081.stdout:3/912: dwrite d4/d7/df/f27 [4194304,4194304] 0 2024-04-23T14:50:03.425 INFO:tasks.workunit.client.1.smithi156.stdout:7/719: dwrite dc/d93/d6c/fda [0,4194304] 0 2024-04-23T14:50:03.428 INFO:tasks.workunit.client.1.smithi156.stdout:8/662: dwrite d5/d9/d5a/d5c/d6b/fd3 [0,4194304] 0 2024-04-23T14:50:03.429 INFO:tasks.workunit.client.0.smithi081.stdout:9/921: dwrite d3/d67/d77/fb6 [0,4194304] 0 2024-04-23T14:50:03.429 INFO:tasks.workunit.client.0.smithi081.stdout:9/922: write d3/de/f119 [530061,37464] 0 2024-04-23T14:50:03.430 INFO:tasks.workunit.client.1.smithi156.stdout:6/742: dwrite d3/d16/d10b/f109 [0,4194304] 0 2024-04-23T14:50:03.432 INFO:tasks.workunit.client.0.smithi081.stdout:3/913: creat d4/d7/d49/d102/f12b x:0 0 0 2024-04-23T14:50:03.434 INFO:tasks.workunit.client.1.smithi156.stdout:7/720: mknod dc/d1d/d24/dc9/ce3 0 2024-04-23T14:50:03.438 INFO:tasks.workunit.client.1.smithi156.stdout:2/642: sync 2024-04-23T14:50:03.438 INFO:tasks.workunit.client.1.smithi156.stdout:2/643: fsync d4/d21/d2f/f49 0 2024-04-23T14:50:03.438 INFO:tasks.workunit.client.1.smithi156.stdout:2/644: chown d4/l12 6 1 2024-04-23T14:50:03.440 INFO:tasks.workunit.client.1.smithi156.stdout:8/663: mknod d5/d9/d36/d60/db8/ceb 0 2024-04-23T14:50:03.440 INFO:tasks.workunit.client.1.smithi156.stdout:8/664: creat d5/d9/d10/d1d/d21/fec x:0 0 0 2024-04-23T14:50:03.441 INFO:tasks.workunit.client.1.smithi156.stdout:8/665: write d5/d9/d36/d84/f8f [928436,130335] 0 2024-04-23T14:50:03.443 INFO:tasks.workunit.client.0.smithi081.stdout:9/923: rmdir d3/de/d1d/d5b/d7b/db2/dd5 39 2024-04-23T14:50:03.446 INFO:tasks.workunit.client.1.smithi156.stdout:5/699: dwrite d1/d11/f4d [0,4194304] 0 2024-04-23T14:50:03.447 INFO:tasks.workunit.client.0.smithi081.stdout:9/924: symlink d3/de/d22/l12f 0 2024-04-23T14:50:03.448 INFO:tasks.workunit.client.1.smithi156.stdout:0/663: dwrite d0/d4/d22/d58/d9a/f63 [0,4194304] 0 2024-04-23T14:50:03.448 INFO:tasks.workunit.client.1.smithi156.stdout:1/713: dwrite db/d1f/d2d/d93/fba [0,4194304] 0 2024-04-23T14:50:03.449 INFO:tasks.workunit.client.1.smithi156.stdout:1/714: fsync db/fc4 0 2024-04-23T14:50:03.449 INFO:tasks.workunit.client.1.smithi156.stdout:1/715: fsync db/d1f/d2d/d93/fd7 0 2024-04-23T14:50:03.454 INFO:tasks.workunit.client.0.smithi081.stdout:3/914: dread d4/d7/f6f [0,4194304] 0 2024-04-23T14:50:03.455 INFO:tasks.workunit.client.1.smithi156.stdout:6/743: getdents d3/da/d1d/d27/dfe 0 2024-04-23T14:50:03.457 INFO:tasks.workunit.client.1.smithi156.stdout:7/721: creat dc/d46/dca/fe4 x:0 0 0 2024-04-23T14:50:03.461 INFO:tasks.workunit.client.1.smithi156.stdout:2/645: rename d4/d21/d42/da1/fa2 to d4/d26/d3c/fe9 0 2024-04-23T14:50:03.461 INFO:tasks.workunit.client.1.smithi156.stdout:2/646: dread - d4/fba zero size 2024-04-23T14:50:03.461 INFO:tasks.workunit.client.1.smithi156.stdout:2/647: dread - d4/d13/d19/d58/fbf zero size 2024-04-23T14:50:03.463 INFO:tasks.workunit.client.1.smithi156.stdout:4/620: dwrite d0/df/f17 [0,4194304] 0 2024-04-23T14:50:03.466 INFO:tasks.workunit.client.1.smithi156.stdout:1/716: dread db/f27 [0,4194304] 0 2024-04-23T14:50:03.467 INFO:tasks.workunit.client.1.smithi156.stdout:8/666: mknod d5/ced 0 2024-04-23T14:50:03.468 INFO:tasks.workunit.client.1.smithi156.stdout:3/600: sync 2024-04-23T14:50:03.468 INFO:tasks.workunit.client.1.smithi156.stdout:3/601: write d4/db/dd/d1d/d1e/d13/f34 [4873829,50635] 0 2024-04-23T14:50:03.478 INFO:tasks.workunit.client.1.smithi156.stdout:5/700: mkdir d1/d3/d24/da0/ddd 0 2024-04-23T14:50:03.478 INFO:tasks.workunit.client.1.smithi156.stdout:5/701: chown d1/d3/f25 24 1 2024-04-23T14:50:03.479 INFO:tasks.workunit.client.1.smithi156.stdout:5/702: read d1/d11/d18/f9f [5883017,2928] 0 2024-04-23T14:50:03.479 INFO:tasks.workunit.client.1.smithi156.stdout:5/703: stat d1/d3/da6 0 2024-04-23T14:50:03.479 INFO:tasks.workunit.client.1.smithi156.stdout:1/717: dread db/f27 [0,4194304] 0 2024-04-23T14:50:03.479 INFO:tasks.workunit.client.1.smithi156.stdout:1/718: chown db/d1f/d28/l45 103959 1 2024-04-23T14:50:03.479 INFO:tasks.workunit.client.1.smithi156.stdout:2/648: dread d4/f24 [0,4194304] 0 2024-04-23T14:50:03.480 INFO:tasks.workunit.client.0.smithi081.stdout:3/915: symlink d4/d7/d32/l12c 0 2024-04-23T14:50:03.483 INFO:tasks.workunit.client.0.smithi081.stdout:3/916: link d4/d7/d32/lc5 d4/dc/d50/l12d 0 2024-04-23T14:50:03.484 INFO:tasks.workunit.client.1.smithi156.stdout:0/664: mknod d0/d16/d3a/cda 0 2024-04-23T14:50:03.486 INFO:tasks.workunit.client.0.smithi081.stdout:3/917: symlink d4/d7/d49/d102/l12e 0 2024-04-23T14:50:03.486 INFO:tasks.workunit.client.0.smithi081.stdout:3/918: write d4/d7/d7f/d85/d9d/f74 [81701,58399] 0 2024-04-23T14:50:03.488 INFO:tasks.workunit.client.0.smithi081.stdout:3/919: symlink d4/d7/d7f/d91/l12f 0 2024-04-23T14:50:03.490 INFO:tasks.workunit.client.1.smithi156.stdout:9/596: sync 2024-04-23T14:50:03.491 INFO:tasks.workunit.client.1.smithi156.stdout:6/744: creat d3/da/d1d/d27/f110 x:0 0 0 2024-04-23T14:50:03.492 INFO:tasks.workunit.client.0.smithi081.stdout:3/920: mknod d4/d7/df/d30/d64/d83/c130 0 2024-04-23T14:50:03.492 INFO:tasks.workunit.client.0.smithi081.stdout:3/921: dread - d4/d7/d49/d102/f12b zero size 2024-04-23T14:50:03.497 INFO:tasks.workunit.client.0.smithi081.stdout:3/922: mkdir d4/d7/d32/da6/dc4/df7/d131 0 2024-04-23T14:50:03.497 INFO:tasks.workunit.client.0.smithi081.stdout:3/923: write d4/d7/fcc [1463121,33199] 0 2024-04-23T14:50:03.497 INFO:tasks.workunit.client.1.smithi156.stdout:7/722: mknod dc/d1d/d48/ce5 0 2024-04-23T14:50:03.497 INFO:tasks.workunit.client.1.smithi156.stdout:7/723: write dc/d1d/d24/f7b [217475,110554] 0 2024-04-23T14:50:03.498 INFO:tasks.workunit.client.1.smithi156.stdout:1/719: read db/d1f/d2d/f6e [2862831,128294] 0 2024-04-23T14:50:03.500 INFO:tasks.workunit.client.1.smithi156.stdout:4/621: link d0/c27 d0/df/d55/d68/d53/d91/d95/db5/cd3 0 2024-04-23T14:50:03.500 INFO:tasks.workunit.client.1.smithi156.stdout:4/622: getdents d0/df/d55/d68/d53/d91/d95 0 2024-04-23T14:50:03.500 INFO:tasks.workunit.client.1.smithi156.stdout:4/623: write d0/df/d55/d68/f4f [3128953,87989] 0 2024-04-23T14:50:03.500 INFO:tasks.workunit.client.0.smithi081.stdout:9/925: dwrite d3/de/d47/fa4 [0,4194304] 0 2024-04-23T14:50:03.501 INFO:tasks.workunit.client.1.smithi156.stdout:8/667: rename d5/d9/d5a/d5c/d6b/fcd to d5/d9/d36/d84/dc1/dcf/fee 0 2024-04-23T14:50:03.501 INFO:tasks.workunit.client.1.smithi156.stdout:8/668: write d5/d9/d36/d84/d8c/faa [2221589,2920] 0 2024-04-23T14:50:03.503 INFO:tasks.workunit.client.0.smithi081.stdout:3/924: mkdir d4/d7/d2e/d132 0 2024-04-23T14:50:03.503 INFO:tasks.workunit.client.1.smithi156.stdout:2/649: symlink d4/d13/d19/dd8/lea 0 2024-04-23T14:50:03.503 INFO:tasks.workunit.client.1.smithi156.stdout:2/650: fdatasync d4/d21/d42/f43 0 2024-04-23T14:50:03.506 INFO:tasks.workunit.client.0.smithi081.stdout:9/926: getdents d3/de/d1d/d54 0 2024-04-23T14:50:03.507 INFO:tasks.workunit.client.0.smithi081.stdout:4/942: dwrite d1/d4/d11/f43 [0,4194304] 0 2024-04-23T14:50:03.508 INFO:tasks.workunit.client.1.smithi156.stdout:0/665: creat d0/d16/d8e/fdb x:0 0 0 2024-04-23T14:50:03.508 INFO:tasks.workunit.client.1.smithi156.stdout:0/666: dread - d0/d16/d3a/d2a/d1d/d2d/d6b/fc1 zero size 2024-04-23T14:50:03.508 INFO:tasks.workunit.client.1.smithi156.stdout:6/745: creat d3/d16/d46/d9d/d9f/f111 x:0 0 0 2024-04-23T14:50:03.508 INFO:tasks.workunit.client.0.smithi081.stdout:3/925: symlink d4/dc/l133 0 2024-04-23T14:50:03.513 INFO:tasks.workunit.client.1.smithi156.stdout:5/704: rename d1/d3/la2 to d1/d11/d18/d19/d74/lde 0 2024-04-23T14:50:03.513 INFO:tasks.workunit.client.1.smithi156.stdout:1/720: write db/d1f/d94/da1/fc7 [843646,107898] 0 2024-04-23T14:50:03.513 INFO:tasks.workunit.client.1.smithi156.stdout:5/705: truncate d1/d3/d24/da0/f3c 973715 0 2024-04-23T14:50:03.515 INFO:tasks.workunit.client.1.smithi156.stdout:8/669: mknod d5/d9/d36/d84/d8c/cef 0 2024-04-23T14:50:03.516 INFO:tasks.workunit.client.0.smithi081.stdout:4/943: getdents d1/d4/d6f/d70/daf/d8c/dce 0 2024-04-23T14:50:03.517 INFO:tasks.workunit.client.0.smithi081.stdout:4/944: read - d1/d4f/d87/f118 zero size 2024-04-23T14:50:03.520 INFO:tasks.workunit.client.1.smithi156.stdout:3/602: rmdir d4/db/dd/d73 39 2024-04-23T14:50:03.523 INFO:tasks.workunit.client.1.smithi156.stdout:2/651: write d4/d13/f20 [4054696,103207] 0 2024-04-23T14:50:03.523 INFO:tasks.workunit.client.1.smithi156.stdout:2/652: chown d4/f7 1439408 1 2024-04-23T14:50:03.523 INFO:tasks.workunit.client.1.smithi156.stdout:2/653: readlink d4/d13/d19/d58/l78 0 2024-04-23T14:50:03.525 INFO:tasks.workunit.client.1.smithi156.stdout:9/597: mknod d1/d2/d3e/d55/d6f/cca 0 2024-04-23T14:50:03.530 INFO:tasks.workunit.client.1.smithi156.stdout:8/670: dread d5/d9/d10/f88 [0,4194304] 0 2024-04-23T14:50:03.532 INFO:tasks.workunit.client.1.smithi156.stdout:4/624: dread d0/df/d55/d68/f38 [0,4194304] 0 2024-04-23T14:50:03.532 INFO:tasks.workunit.client.1.smithi156.stdout:4/625: fdatasync d0/d8/d1e/d4a/d77/d9c/fc5 0 2024-04-23T14:50:03.533 INFO:tasks.workunit.client.0.smithi081.stdout:9/927: dread d3/de/d22/f39 [0,4194304] 0 2024-04-23T14:50:03.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:03 smithi156 ceph-mon[32341]: from='client.24455 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:50:03.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:03 smithi156 ceph-mon[32341]: pgmap v40: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 167 MiB/s rd, 195 MiB/s wr, 305 op/s 2024-04-23T14:50:03.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:03 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/1842281704' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:50:03.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:03 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:50:03.538 INFO:tasks.workunit.client.1.smithi156.stdout:6/746: truncate d3/d16/f37 3916274 0 2024-04-23T14:50:03.542 INFO:tasks.workunit.client.1.smithi156.stdout:5/706: truncate d1/d3/f3a 1486706 0 2024-04-23T14:50:03.542 INFO:tasks.workunit.client.1.smithi156.stdout:5/707: truncate d1/d17/f2e 4849943 0 2024-04-23T14:50:03.545 INFO:tasks.workunit.client.0.smithi081.stdout:4/945: getdents d1/d8b 0 2024-04-23T14:50:03.545 INFO:tasks.workunit.client.0.smithi081.stdout:4/946: write d1/d8b/db9/f10a [422700,23067] 0 2024-04-23T14:50:03.545 INFO:tasks.workunit.client.0.smithi081.stdout:4/947: chown d1/d1d/d39/f3b 12903950 1 2024-04-23T14:50:03.545 INFO:tasks.workunit.client.0.smithi081.stdout:4/948: fsync d1/d4/d6f/d70/daf/fcc 0 2024-04-23T14:50:03.546 INFO:tasks.workunit.client.1.smithi156.stdout:2/654: symlink d4/d13/d19/de8/leb 0 2024-04-23T14:50:03.547 INFO:tasks.workunit.client.1.smithi156.stdout:2/655: creat d4/d13/d19/d58/fec x:0 0 0 2024-04-23T14:50:03.551 INFO:tasks.workunit.client.1.smithi156.stdout:1/721: dread db/d1f/d2f/f55 [0,4194304] 0 2024-04-23T14:50:03.551 INFO:tasks.workunit.client.1.smithi156.stdout:1/722: fdatasync db/d25/d30/d38/f80 0 2024-04-23T14:50:03.553 INFO:tasks.workunit.client.1.smithi156.stdout:4/626: mknod d0/d8/d1e/cd4 0 2024-04-23T14:50:03.556 INFO:tasks.workunit.client.0.smithi081.stdout:9/928: creat d3/d5/f130 x:0 0 0 2024-04-23T14:50:03.558 INFO:tasks.workunit.client.1.smithi156.stdout:7/724: dwrite dc/d2c/dbe/dc2/fbc [0,4194304] 0 2024-04-23T14:50:03.562 INFO:tasks.workunit.client.1.smithi156.stdout:7/725: mknod dc/d9d/ce6 0 2024-04-23T14:50:03.568 INFO:tasks.workunit.client.1.smithi156.stdout:7/726: truncate dc/f1c 7526787 0 2024-04-23T14:50:03.568 INFO:tasks.workunit.client.1.smithi156.stdout:7/727: write dc/d46/fb9 [1083236,122542] 0 2024-04-23T14:50:03.571 INFO:tasks.workunit.client.1.smithi156.stdout:4/627: dread d0/df/fa1 [0,4194304] 0 2024-04-23T14:50:03.572 INFO:tasks.workunit.client.1.smithi156.stdout:0/667: dwrite d0/d16/d3a/d1e/f3d [0,4194304] 0 2024-04-23T14:50:03.574 INFO:tasks.workunit.client.1.smithi156.stdout:7/728: link dc/l1b dc/d46/d58/db7/le7 0 2024-04-23T14:50:03.577 INFO:tasks.workunit.client.1.smithi156.stdout:0/668: mknod d0/d16/dcd/cdc 0 2024-04-23T14:50:03.577 INFO:tasks.workunit.client.1.smithi156.stdout:0/669: fdatasync d0/d16/d3a/d2a/f2c 0 2024-04-23T14:50:03.578 INFO:tasks.workunit.client.1.smithi156.stdout:0/670: creat d0/fdd x:0 0 0 2024-04-23T14:50:03.578 INFO:tasks.workunit.client.1.smithi156.stdout:0/671: dread - d0/d16/d3a/d1e/d80/faf zero size 2024-04-23T14:50:03.581 INFO:tasks.workunit.client.1.smithi156.stdout:6/747: write d3/da/d1d/d27/f8e [31247,120359] 0 2024-04-23T14:50:03.582 INFO:tasks.workunit.client.1.smithi156.stdout:0/672: mkdir d0/d16/d3a/d2a/d1d/d2d/dd5/dde 0 2024-04-23T14:50:03.582 INFO:tasks.workunit.client.1.smithi156.stdout:0/673: readlink d0/d16/da4/lc4 0 2024-04-23T14:50:03.583 INFO:tasks.workunit.client.1.smithi156.stdout:7/729: rmdir dc/d2c/d68/dc3 0 2024-04-23T14:50:03.584 INFO:tasks.workunit.client.1.smithi156.stdout:7/730: fsync dc/d2c/d68/f75 0 2024-04-23T14:50:03.585 INFO:tasks.workunit.client.1.smithi156.stdout:0/674: rename d0/d16/dbf/d3f/d5f/c42 to d0/d4/d22/d58/d9a/cdf 0 2024-04-23T14:50:03.585 INFO:tasks.workunit.client.1.smithi156.stdout:0/675: write d0/d16/d3a/f6a [2131602,10309] 0 2024-04-23T14:50:03.587 INFO:tasks.workunit.client.0.smithi081.stdout:3/926: dwrite d4/d7/d7f/d85/d9d/dac/dc7/dd3/f127 [0,4194304] 0 2024-04-23T14:50:03.590 INFO:tasks.workunit.client.1.smithi156.stdout:7/731: mknod dc/d9d/dd2/ce8 0 2024-04-23T14:50:03.590 INFO:tasks.workunit.client.1.smithi156.stdout:9/598: dwrite d1/d2/d3e/d55/d9c/d39/f42 [0,4194304] 0 2024-04-23T14:50:03.593 INFO:tasks.workunit.client.1.smithi156.stdout:3/603: dwrite d4/db/fb4 [0,4194304] 0 2024-04-23T14:50:03.604 INFO:tasks.workunit.client.1.smithi156.stdout:7/732: creat dc/d1d/d24/fe9 x:0 0 0 2024-04-23T14:50:03.604 INFO:tasks.workunit.client.1.smithi156.stdout:7/733: read dc/d1d/d24/f4a [2211373,70993] 0 2024-04-23T14:50:03.604 INFO:tasks.workunit.client.1.smithi156.stdout:7/734: fsync dc/d1d/f77 0 2024-04-23T14:50:03.605 INFO:tasks.workunit.client.1.smithi156.stdout:9/599: rename d1/d2/d3e/d55/d9c/fbb to d1/d2/d3e/fcb 0 2024-04-23T14:50:03.618 INFO:tasks.workunit.client.0.smithi081.stdout:4/949: dwrite d1/d1d/d39/d8d/de3/fff [0,4194304] 0 2024-04-23T14:50:03.619 INFO:tasks.workunit.client.1.smithi156.stdout:3/604: dread d4/db/dd/d1d/d61/f62 [0,4194304] 0 2024-04-23T14:50:03.627 INFO:tasks.workunit.client.0.smithi081.stdout:4/950: mkdir d1/d4/d12e 0 2024-04-23T14:50:03.627 INFO:tasks.workunit.client.0.smithi081.stdout:4/951: stat d1/d4/d11/d75 0 2024-04-23T14:50:03.638 INFO:tasks.workunit.client.0.smithi081.stdout:3/927: dwrite d4/d7/f6f [0,4194304] 0 2024-04-23T14:50:03.638 INFO:tasks.workunit.client.0.smithi081.stdout:7/960: sync 2024-04-23T14:50:03.641 INFO:tasks.workunit.client.0.smithi081.stdout:3/928: creat d4/d7/d7f/d91/f134 x:0 0 0 2024-04-23T14:50:03.641 INFO:tasks.workunit.client.0.smithi081.stdout:3/929: creat d4/d7/d49/d51/f135 x:0 0 0 2024-04-23T14:50:03.645 INFO:tasks.workunit.client.0.smithi081.stdout:3/930: mkdir d4/d7/d2e/d136 0 2024-04-23T14:50:03.649 INFO:tasks.workunit.client.0.smithi081.stdout:4/952: dread d1/d4/d11/d9d/dac/ff2 [0,4194304] 0 2024-04-23T14:50:03.653 INFO:tasks.workunit.client.0.smithi081.stdout:4/953: mknod d1/d8b/c12f 0 2024-04-23T14:50:03.656 INFO:tasks.workunit.client.0.smithi081.stdout:4/954: mkdir d1/d1d/d39/d130 0 2024-04-23T14:50:03.656 INFO:tasks.workunit.client.0.smithi081.stdout:4/955: fsync d1/d1d/d59/fb2 0 2024-04-23T14:50:03.660 INFO:tasks.workunit.client.0.smithi081.stdout:4/956: creat d1/d8f/d94/f131 x:0 0 0 2024-04-23T14:50:03.660 INFO:tasks.workunit.client.0.smithi081.stdout:4/957: write d1/d4/d6f/d70/daf/d8c/ffe [484972,70291] 0 2024-04-23T14:50:03.662 INFO:tasks.workunit.client.0.smithi081.stdout:4/958: truncate d1/d4/d11/d9d/dac/ff2 219088 0 2024-04-23T14:50:03.667 INFO:tasks.workunit.client.1.smithi156.stdout:5/708: dwrite d1/d3/d24/da0/f3c [0,4194304] 0 2024-04-23T14:50:03.667 INFO:tasks.workunit.client.1.smithi156.stdout:1/723: dread db/d1f/d2f/f56 [0,4194304] 0 2024-04-23T14:50:03.668 INFO:tasks.workunit.client.1.smithi156.stdout:2/656: dwrite d4/d21/d2f/f35 [0,4194304] 0 2024-04-23T14:50:03.679 INFO:tasks.workunit.client.1.smithi156.stdout:1/724: symlink db/d25/d30/le2 0 2024-04-23T14:50:03.680 INFO:tasks.workunit.client.1.smithi156.stdout:5/709: creat d1/d3/d24/da0/d3e/d97/fdf x:0 0 0 2024-04-23T14:50:03.682 INFO:tasks.workunit.client.1.smithi156.stdout:7/735: dwrite dc/d93/d6c/fda [0,4194304] 0 2024-04-23T14:50:03.683 INFO:tasks.workunit.client.1.smithi156.stdout:2/657: link d4/d26/l92 d4/d21/d42/led 0 2024-04-23T14:50:03.683 INFO:tasks.workunit.client.1.smithi156.stdout:2/658: truncate d4/d13/d19/d58/fa7 472361 0 2024-04-23T14:50:03.686 INFO:tasks.workunit.client.1.smithi156.stdout:7/736: symlink dc/lea 0 2024-04-23T14:50:03.697 INFO:tasks.workunit.client.1.smithi156.stdout:5/710: write d1/d11/d27/f95 [182215,62509] 0 2024-04-23T14:50:03.699 INFO:tasks.workunit.client.1.smithi156.stdout:2/659: rmdir d4/d13/d88/dad 39 2024-04-23T14:50:03.699 INFO:tasks.workunit.client.1.smithi156.stdout:2/660: read - d4/d21/d76/fe5 zero size 2024-04-23T14:50:03.699 INFO:tasks.workunit.client.1.smithi156.stdout:2/661: chown d4/d13/d19/d4c/f60 4237 1 2024-04-23T14:50:03.699 INFO:tasks.workunit.client.1.smithi156.stdout:2/662: write d4/d13/d19/d58/fe6 [299148,32039] 0 2024-04-23T14:50:03.702 INFO:tasks.workunit.client.1.smithi156.stdout:7/737: symlink dc/d1d/d24/leb 0 2024-04-23T14:50:03.706 INFO:tasks.workunit.client.1.smithi156.stdout:4/628: dwrite d0/d30/f8f [0,4194304] 0 2024-04-23T14:50:03.707 INFO:tasks.workunit.client.0.smithi081.stdout:7/961: dwrite d3/d21/d31/d110/d116/f14b [0,4194304] 0 2024-04-23T14:50:03.715 INFO:tasks.workunit.client.1.smithi156.stdout:7/738: rmdir dc/d46/dca 39 2024-04-23T14:50:03.715 INFO:tasks.workunit.client.1.smithi156.stdout:7/739: dread - dc/d93/d6c/fd7 zero size 2024-04-23T14:50:03.715 INFO:tasks.workunit.client.1.smithi156.stdout:7/740: chown dc/d1d/d48/lc4 28837038 1 2024-04-23T14:50:03.715 INFO:tasks.workunit.client.1.smithi156.stdout:7/741: write dc/d1d/f95 [5080256,13719] 0 2024-04-23T14:50:03.715 INFO:tasks.workunit.client.1.smithi156.stdout:7/742: dread - dc/d46/d58/f65 zero size 2024-04-23T14:50:03.717 INFO:tasks.workunit.client.1.smithi156.stdout:7/743: rename dc/c13 to dc/cec 0 2024-04-23T14:50:03.721 INFO:tasks.workunit.client.1.smithi156.stdout:9/600: dwrite d1/d2/d3e/d55/d6f/fa4 [0,4194304] 0 2024-04-23T14:50:03.721 INFO:tasks.workunit.client.1.smithi156.stdout:9/601: getdents d1/d2/d23/dbd 0 2024-04-23T14:50:03.723 INFO:tasks.workunit.client.1.smithi156.stdout:3/605: dwrite d4/db/d4b/f81 [0,4194304] 0 2024-04-23T14:50:03.724 INFO:tasks.workunit.client.1.smithi156.stdout:3/606: creat d4/db/dd/d1d/d1e/d42/d76/dba/fc5 x:0 0 0 2024-04-23T14:50:03.724 INFO:tasks.workunit.client.1.smithi156.stdout:3/607: dread - d4/db/dd/d1d/d1e/d42/f8f zero size 2024-04-23T14:50:03.724 INFO:tasks.workunit.client.1.smithi156.stdout:7/744: symlink dc/d46/dca/led 0 2024-04-23T14:50:03.729 INFO:tasks.workunit.client.1.smithi156.stdout:9/602: symlink d1/d2/d3e/d55/d9c/lcc 0 2024-04-23T14:50:03.731 INFO:tasks.workunit.client.1.smithi156.stdout:5/711: rename d1/d3/d24/da0/d3e to d1/d11/de0 0 2024-04-23T14:50:03.733 INFO:tasks.workunit.client.0.smithi081.stdout:4/959: dwrite d1/d4/f27 [0,4194304] 0 2024-04-23T14:50:03.737 INFO:tasks.workunit.client.1.smithi156.stdout:0/676: dwrite d0/d16/d3a/d1e/f6e [4194304,4194304] 0 2024-04-23T14:50:03.739 INFO:tasks.workunit.client.0.smithi081.stdout:3/931: dwrite d4/d7/d7f/d85/d9d/dac/dc7/fed [0,4194304] 0 2024-04-23T14:50:03.739 INFO:tasks.workunit.client.0.smithi081.stdout:3/932: dread - d4/d7/d49/fe2 zero size 2024-04-23T14:50:03.742 INFO:tasks.workunit.client.0.smithi081.stdout:4/960: mkdir d1/d1d/d39/d132 0 2024-04-23T14:50:03.742 INFO:tasks.workunit.client.1.smithi156.stdout:3/608: creat d4/db/dd/d1d/d1e/d13/d5a/fc6 x:0 0 0 2024-04-23T14:50:03.743 INFO:tasks.workunit.client.1.smithi156.stdout:3/609: write d4/f55 [1572052,61612] 0 2024-04-23T14:50:03.745 INFO:tasks.workunit.client.1.smithi156.stdout:7/745: truncate dc/d1d/d41/f51 699187 0 2024-04-23T14:50:03.745 INFO:tasks.workunit.client.1.smithi156.stdout:9/603: getdents d1/d2/d3e/d50/d7a/d17 0 2024-04-23T14:50:03.750 INFO:tasks.workunit.client.0.smithi081.stdout:3/933: dread d4/d7/f120 [0,4194304] 0 2024-04-23T14:50:03.751 INFO:tasks.workunit.client.0.smithi081.stdout:4/961: mknod d1/d4/d6f/d70/d9c/ddd/c133 0 2024-04-23T14:50:03.752 INFO:tasks.workunit.client.1.smithi156.stdout:0/677: unlink d0/d4/fa2 0 2024-04-23T14:50:03.752 INFO:tasks.workunit.client.1.smithi156.stdout:0/678: write d0/d16/d3a/d1e/fbd [4888570,124963] 0 2024-04-23T14:50:03.752 INFO:tasks.workunit.client.1.smithi156.stdout:7/746: dread dc/f54 [0,4194304] 0 2024-04-23T14:50:03.754 INFO:tasks.workunit.client.1.smithi156.stdout:2/663: dwrite d4/d21/d2f/f74 [0,4194304] 0 2024-04-23T14:50:03.756 INFO:tasks.workunit.client.0.smithi081.stdout:4/962: creat d1/d4f/d87/f134 x:0 0 0 2024-04-23T14:50:03.761 INFO:tasks.workunit.client.0.smithi081.stdout:3/934: getdents d4/d7/df/d30/d64 0 2024-04-23T14:50:03.764 INFO:tasks.workunit.client.1.smithi156.stdout:5/712: dread d1/d11/d18/d52/f7f [0,4194304] 0 2024-04-23T14:50:03.765 INFO:tasks.workunit.client.1.smithi156.stdout:5/713: stat d1/d11/d18/d52/lb7 0 2024-04-23T14:50:03.765 INFO:tasks.workunit.client.1.smithi156.stdout:4/629: dwrite d0/f46 [0,4194304] 0 2024-04-23T14:50:03.769 INFO:tasks.workunit.client.0.smithi081.stdout:7/962: dwrite d3/d21/d41/d7c/dc3/d7f/f10d [0,4194304] 0 2024-04-23T14:50:03.769 INFO:tasks.workunit.client.0.smithi081.stdout:7/963: fsync d3/d21/d31/f40 0 2024-04-23T14:50:03.772 INFO:tasks.workunit.client.0.smithi081.stdout:4/963: dread d1/d4/dc/f6e [0,4194304] 0 2024-04-23T14:50:03.772 INFO:tasks.workunit.client.1.smithi156.stdout:9/604: link d1/d2/l95 d1/lcd 0 2024-04-23T14:50:03.777 INFO:tasks.workunit.client.1.smithi156.stdout:3/610: write d4/db/dd/d1d/d1e/d13/f46 [2420287,66000] 0 2024-04-23T14:50:03.778 INFO:tasks.workunit.client.1.smithi156.stdout:2/664: mknod d4/d26/d3c/cee 0 2024-04-23T14:50:03.779 INFO:tasks.workunit.client.1.smithi156.stdout:1/725: dwrite db/d1f/d94/da1/fc7 [4194304,4194304] 0 2024-04-23T14:50:03.779 INFO:tasks.workunit.client.0.smithi081.stdout:7/964: mknod d3/c158 0 2024-04-23T14:50:03.779 INFO:tasks.workunit.client.0.smithi081.stdout:3/935: dread d4/d7/d32/f33 [0,4194304] 0 2024-04-23T14:50:03.781 INFO:tasks.workunit.client.0.smithi081.stdout:3/936: chown d4/dc/l61 721440008 1 2024-04-23T14:50:03.781 INFO:tasks.workunit.client.0.smithi081.stdout:7/965: write d3/d21/d31/d50/f62 [1275300,78012] 0 2024-04-23T14:50:03.784 INFO:tasks.workunit.client.0.smithi081.stdout:4/964: mknod d1/d4f/d87/c135 0 2024-04-23T14:50:03.786 INFO:tasks.workunit.client.1.smithi156.stdout:9/605: mkdir d1/d2/d3e/d55/dce 0 2024-04-23T14:50:03.789 INFO:tasks.workunit.client.1.smithi156.stdout:6/748: sync 2024-04-23T14:50:03.789 INFO:tasks.workunit.client.1.smithi156.stdout:8/671: sync 2024-04-23T14:50:03.789 INFO:tasks.workunit.client.1.smithi156.stdout:8/672: read d5/d9/d10/d1d/d21/f40 [3572637,105450] 0 2024-04-23T14:50:03.790 INFO:tasks.workunit.client.1.smithi156.stdout:8/673: fdatasync d5/d9/fd 0 2024-04-23T14:50:03.790 INFO:tasks.workunit.client.0.smithi081.stdout:7/966: mknod d3/d21/d41/dbb/c159 0 2024-04-23T14:50:03.792 INFO:tasks.workunit.client.1.smithi156.stdout:4/630: write d0/d30/f3f [2978967,90551] 0 2024-04-23T14:50:03.792 INFO:tasks.workunit.client.1.smithi156.stdout:4/631: chown d0/df/d55/d68/d53/f79 15901 1 2024-04-23T14:50:03.792 INFO:tasks.workunit.client.1.smithi156.stdout:4/632: readlink d0/d76/l67 0 2024-04-23T14:50:03.792 INFO:tasks.workunit.client.1.smithi156.stdout:4/633: fsync d0/df/f25 0 2024-04-23T14:50:03.792 INFO:tasks.workunit.client.1.smithi156.stdout:4/634: dread - d0/df/d55/d68/d53/d91/fc0 zero size 2024-04-23T14:50:03.792 INFO:tasks.workunit.client.1.smithi156.stdout:4/635: readlink d0/d8/d1e/d4a/d77/d9c/la2 0 2024-04-23T14:50:03.792 INFO:tasks.workunit.client.1.smithi156.stdout:4/636: chown d0/df/d55/d68/d74/d8b 835 1 2024-04-23T14:50:03.792 INFO:tasks.workunit.client.1.smithi156.stdout:3/611: mknod d4/db/dd/d1d/d61/d7f/cc7 0 2024-04-23T14:50:03.793 INFO:tasks.workunit.client.1.smithi156.stdout:4/637: rename d0/d8/d1e/d4a/d77/dc1 to d0/d8/d1e/d4a/d77/dc1/dd5 22 2024-04-23T14:50:03.793 INFO:tasks.workunit.client.1.smithi156.stdout:0/679: dwrite d0/fdd [0,4194304] 0 2024-04-23T14:50:03.794 INFO:tasks.workunit.client.0.smithi081.stdout:3/937: rename d4/d7/d7f/d85/d9d/dac/dc7/dd3/f127 to d4/d7/d7f/f137 0 2024-04-23T14:50:03.797 INFO:tasks.workunit.client.1.smithi156.stdout:2/665: symlink d4/d13/d19/lef 0 2024-04-23T14:50:03.798 INFO:tasks.workunit.client.0.smithi081.stdout:7/967: mkdir d3/d21/d41/d7c/dc3/d15a 0 2024-04-23T14:50:03.801 INFO:tasks.workunit.client.1.smithi156.stdout:9/606: truncate d1/d2/d3e/d50/d7a/dc/f22 2994477 0 2024-04-23T14:50:03.803 INFO:tasks.workunit.client.1.smithi156.stdout:6/749: truncate d3/d16/f76 5788287 0 2024-04-23T14:50:03.805 INFO:tasks.workunit.client.1.smithi156.stdout:8/674: creat d5/d9/d36/d60/db8/ddd/de1/ff0 x:0 0 0 2024-04-23T14:50:03.807 INFO:tasks.workunit.client.0.smithi081.stdout:4/965: dread d1/d4f/f10e [0,4194304] 0 2024-04-23T14:50:03.807 INFO:tasks.workunit.client.1.smithi156.stdout:3/612: mknod d4/db/dd/d1d/d1e/d2b/cc8 0 2024-04-23T14:50:03.808 INFO:tasks.workunit.client.1.smithi156.stdout:3/613: chown d4/db/dd/d20/d57/c99 15 1 2024-04-23T14:50:03.808 INFO:tasks.workunit.client.1.smithi156.stdout:3/614: stat d4/db/dd/d1d/d1e/d74/lbb 0 2024-04-23T14:50:03.810 INFO:tasks.workunit.client.1.smithi156.stdout:4/638: rename d0/d30/d8a/cc7 to d0/df/d21/cd6 0 2024-04-23T14:50:03.810 INFO:tasks.workunit.client.1.smithi156.stdout:4/639: stat d0/d76/d63/cc8 0 2024-04-23T14:50:03.814 INFO:tasks.workunit.client.0.smithi081.stdout:3/938: dread d4/d7/d1a/ffb [0,4194304] 0 2024-04-23T14:50:03.814 INFO:tasks.workunit.client.1.smithi156.stdout:0/680: creat d0/d16/fe0 x:0 0 0 2024-04-23T14:50:03.815 INFO:tasks.workunit.client.1.smithi156.stdout:2/666: creat d4/d13/d19/d4c/d5c/dd5/ff0 x:0 0 0 2024-04-23T14:50:03.817 INFO:tasks.workunit.client.1.smithi156.stdout:9/607: fdatasync d1/d2/d3e/d50/d7a/d19/f89 0 2024-04-23T14:50:03.820 INFO:tasks.workunit.client.1.smithi156.stdout:6/750: rmdir d3/d16/d46/d9d 39 2024-04-23T14:50:03.828 INFO:tasks.workunit.client.0.smithi081.stdout:3/939: dread d4/d7/df/f92 [0,4194304] 0 2024-04-23T14:50:03.828 INFO:tasks.workunit.client.0.smithi081.stdout:3/940: creat d4/d7/d49/d51/f138 x:0 0 0 2024-04-23T14:50:03.829 INFO:tasks.workunit.client.1.smithi156.stdout:8/675: mkdir d5/d9/d10/d1d/d21/df1 0 2024-04-23T14:50:03.830 INFO:tasks.workunit.client.1.smithi156.stdout:5/714: dwrite d1/fc0 [0,4194304] 0 2024-04-23T14:50:03.830 INFO:tasks.workunit.client.1.smithi156.stdout:3/615: symlink d4/db/dd/d1d/d1e/d13/d5a/dab/lc9 0 2024-04-23T14:50:03.830 INFO:tasks.workunit.client.1.smithi156.stdout:3/616: truncate d4/db/dd/d1d/d1e/d42/faa 280412 0 2024-04-23T14:50:03.833 INFO:tasks.workunit.client.1.smithi156.stdout:2/667: symlink d4/d21/d42/d75/lf1 0 2024-04-23T14:50:03.833 INFO:tasks.workunit.client.1.smithi156.stdout:2/668: chown d4/d13/d88/lc3 9 1 2024-04-23T14:50:03.836 INFO:tasks.workunit.client.1.smithi156.stdout:5/715: mknod d1/d3/da6/d86/ce1 0 2024-04-23T14:50:03.838 INFO:tasks.workunit.client.1.smithi156.stdout:0/681: write d0/d16/d43/fbb [1504544,101578] 0 2024-04-23T14:50:03.839 INFO:tasks.workunit.client.1.smithi156.stdout:0/682: creat d0/d16/d3a/fe1 x:0 0 0 2024-04-23T14:50:03.839 INFO:tasks.workunit.client.1.smithi156.stdout:0/683: fdatasync d0/fb1 0 2024-04-23T14:50:03.848 INFO:tasks.workunit.client.1.smithi156.stdout:2/669: rmdir d4/d21/d42/d75/dd7 0 2024-04-23T14:50:03.849 INFO:tasks.workunit.client.1.smithi156.stdout:3/617: write d4/db/dd/f1b [3402084,49591] 0 2024-04-23T14:50:03.850 INFO:tasks.workunit.client.1.smithi156.stdout:0/684: rmdir d0/d16/dbf 39 2024-04-23T14:50:03.850 INFO:tasks.workunit.client.1.smithi156.stdout:5/716: write d1/d17/d7e/fc8 [880626,110069] 0 2024-04-23T14:50:03.860 INFO:tasks.workunit.client.1.smithi156.stdout:2/670: creat d4/d13/d19/d4c/d5c/ff2 x:0 0 0 2024-04-23T14:50:03.860 INFO:tasks.workunit.client.1.smithi156.stdout:2/671: fdatasync d4/d26/fb1 0 2024-04-23T14:50:03.860 INFO:tasks.workunit.client.1.smithi156.stdout:3/618: mknod d4/db/dd/cca 0 2024-04-23T14:50:03.863 INFO:tasks.workunit.client.1.smithi156.stdout:3/619: link d4/db/dd/d73/fb7 d4/db/dd/d1d/d1e/d74/d93/dc4/fcb 0 2024-04-23T14:50:03.865 INFO:tasks.workunit.client.1.smithi156.stdout:3/620: creat d4/db/dd/d20/d57/fcc x:0 0 0 2024-04-23T14:50:03.886 INFO:tasks.workunit.client.1.smithi156.stdout:4/640: dwrite d0/df/d55/d68/f38 [0,4194304] 0 2024-04-23T14:50:03.889 INFO:tasks.workunit.client.1.smithi156.stdout:4/641: truncate d0/d8/fd 5922559 0 2024-04-23T14:50:03.889 INFO:tasks.workunit.client.1.smithi156.stdout:4/642: chown d0/d76/c2a 470 1 2024-04-23T14:50:03.889 INFO:tasks.workunit.client.1.smithi156.stdout:4/643: creat d0/df/d55/d68/d53/d91/fd7 x:0 0 0 2024-04-23T14:50:03.889 INFO:tasks.workunit.client.1.smithi156.stdout:4/644: dread - d0/d8/d1e/d4a/fb2 zero size 2024-04-23T14:50:03.891 INFO:tasks.workunit.client.1.smithi156.stdout:4/645: rmdir d0/df/d55/d68/d53/d91/d95/db5 39 2024-04-23T14:50:03.893 INFO:tasks.workunit.client.0.smithi081.stdout:4/966: dwrite d1/d4/dc/dba/fe2 [0,4194304] 0 2024-04-23T14:50:03.894 INFO:tasks.workunit.client.1.smithi156.stdout:4/646: unlink d0/df/d55/d68/f9d 0 2024-04-23T14:50:03.899 INFO:tasks.workunit.client.1.smithi156.stdout:8/676: dwrite d5/d4e/f6c [0,4194304] 0 2024-04-23T14:50:03.899 INFO:tasks.workunit.client.1.smithi156.stdout:8/677: read - d5/d9/d10/d1d/d21/fec zero size 2024-04-23T14:50:03.901 INFO:tasks.workunit.client.0.smithi081.stdout:3/941: dwrite d4/d7/d32/da6/dc4/d5a/f7c [0,4194304] 0 2024-04-23T14:50:03.902 INFO:tasks.workunit.client.0.smithi081.stdout:3/942: truncate d4/d7/d32/da6/dc4/df7/d106/f107 18511 0 2024-04-23T14:50:03.902 INFO:tasks.workunit.client.1.smithi156.stdout:9/608: dwrite d1/d2/d3e/d80/f9b [0,4194304] 0 2024-04-23T14:50:03.905 INFO:tasks.workunit.client.1.smithi156.stdout:9/609: creat d1/d2/d3e/d55/d9c/d39/fcf x:0 0 0 2024-04-23T14:50:03.913 INFO:tasks.workunit.client.0.smithi081.stdout:3/943: dread d4/d41/f66 [4194304,4194304] 0 2024-04-23T14:50:03.913 INFO:tasks.workunit.client.0.smithi081.stdout:3/944: write d4/d7/d49/d51/d84/fd6 [870864,60636] 0 2024-04-23T14:50:03.916 INFO:tasks.workunit.client.0.smithi081.stdout:3/945: creat d4/d7/df/f139 x:0 0 0 2024-04-23T14:50:03.919 INFO:tasks.workunit.client.0.smithi081.stdout:3/946: rmdir d4/d7/dd7 0 2024-04-23T14:50:03.924 INFO:tasks.workunit.client.1.smithi156.stdout:0/685: dwrite d0/d16/d3a/d2a/d1d/d2d/f73 [0,4194304] 0 2024-04-23T14:50:03.925 INFO:tasks.workunit.client.1.smithi156.stdout:0/686: creat d0/d16/d3a/d1e/d80/fe2 x:0 0 0 2024-04-23T14:50:03.925 INFO:tasks.workunit.client.1.smithi156.stdout:0/687: truncate d0/d4/d22/d58/f69 255234 0 2024-04-23T14:50:03.929 INFO:tasks.workunit.client.1.smithi156.stdout:0/688: mknod d0/d16/dbf/d3f/d5f/db2/ce3 0 2024-04-23T14:50:03.947 INFO:tasks.workunit.client.1.smithi156.stdout:6/751: dwrite d3/d16/f5a [0,4194304] 0 2024-04-23T14:50:03.949 INFO:tasks.workunit.client.1.smithi156.stdout:6/752: creat d3/d16/d46/d9d/d9f/dad/f112 x:0 0 0 2024-04-23T14:50:03.950 INFO:tasks.workunit.client.1.smithi156.stdout:6/753: creat d3/da/d1d/d59/d9c/f113 x:0 0 0 2024-04-23T14:50:03.952 INFO:tasks.workunit.client.1.smithi156.stdout:6/754: symlink d3/da/d1d/d27/l114 0 2024-04-23T14:50:03.954 INFO:tasks.workunit.client.1.smithi156.stdout:6/755: read d3/da/d1d/d27/dfe/d3b/d9e/fe4 [216689,1569] 0 2024-04-23T14:50:03.956 INFO:tasks.workunit.client.1.smithi156.stdout:6/756: mknod d3/d16/d46/d9d/d9f/dad/dea/c115 0 2024-04-23T14:50:03.956 INFO:tasks.workunit.client.1.smithi156.stdout:6/757: stat d3/da/d1d/d27/dfe/d6e/d8f/f103 0 2024-04-23T14:50:03.957 INFO:tasks.workunit.client.1.smithi156.stdout:6/758: getdents d3/da/d1d/d27/dfe/d3b 0 2024-04-23T14:50:03.961 INFO:tasks.workunit.client.1.smithi156.stdout:5/717: dwrite d1/d11/d18/f47 [4194304,4194304] 0 2024-04-23T14:50:03.970 INFO:tasks.workunit.client.1.smithi156.stdout:4/647: dread d0/df/d55/f3c [0,4194304] 0 2024-04-23T14:50:03.970 INFO:tasks.workunit.client.1.smithi156.stdout:2/672: dwrite d4/fba [0,4194304] 0 2024-04-23T14:50:03.970 INFO:tasks.workunit.client.1.smithi156.stdout:2/673: write d4/fb6 [668557,118359] 0 2024-04-23T14:50:03.976 INFO:tasks.workunit.client.1.smithi156.stdout:5/718: dread d1/d3/d24/f72 [0,4194304] 0 2024-04-23T14:50:03.981 INFO:tasks.workunit.client.1.smithi156.stdout:1/726: sync 2024-04-23T14:50:03.981 INFO:tasks.workunit.client.1.smithi156.stdout:7/747: sync 2024-04-23T14:50:03.981 INFO:tasks.workunit.client.1.smithi156.stdout:7/748: chown dc/fd6 24092164 1 2024-04-23T14:50:03.982 INFO:tasks.workunit.client.1.smithi156.stdout:4/648: symlink d0/df/d55/d68/d74/d8b/ld8 0 2024-04-23T14:50:03.983 INFO:tasks.workunit.client.1.smithi156.stdout:5/719: rename d1/d3/f6b to d1/fe2 0 2024-04-23T14:50:03.984 INFO:tasks.workunit.client.1.smithi156.stdout:1/727: rmdir db/d1f/d28/d70/db3/d63 39 2024-04-23T14:50:04.048 INFO:tasks.workunit.client.0.smithi081.stdout:9/929: sync 2024-04-23T14:50:04.049 INFO:tasks.workunit.client.0.smithi081.stdout:9/930: creat d3/de/d1d/d5b/f131 x:0 0 0 2024-04-23T14:50:04.050 INFO:tasks.workunit.client.1.smithi156.stdout:5/720: dwrite d1/d11/d27/f95 [0,4194304] 0 2024-04-23T14:50:04.054 INFO:tasks.workunit.client.0.smithi081.stdout:9/931: rename d3/de/d76 to d3/d67/d77/d132 0 2024-04-23T14:50:04.054 INFO:tasks.workunit.client.0.smithi081.stdout:9/932: readlink d3/de/d1d/d73/l81 0 2024-04-23T14:50:04.058 INFO:tasks.workunit.client.0.smithi081.stdout:9/933: mknod d3/d67/d77/d132/d116/c133 0 2024-04-23T14:50:04.059 INFO:tasks.workunit.client.0.smithi081.stdout:9/934: creat d3/d67/d77/f134 x:0 0 0 2024-04-23T14:50:04.061 INFO:tasks.workunit.client.0.smithi081.stdout:9/935: mknod d3/d5/c135 0 2024-04-23T14:50:04.061 INFO:tasks.workunit.client.0.smithi081.stdout:9/936: creat d3/de/d1d/d54/d68/f136 x:0 0 0 2024-04-23T14:50:04.061 INFO:tasks.workunit.client.0.smithi081.stdout:9/937: write d3/d67/fc9 [1941483,108631] 0 2024-04-23T14:50:04.061 INFO:tasks.workunit.client.0.smithi081.stdout:9/938: dread - d3/d1a/d6c/f127 zero size 2024-04-23T14:50:04.062 INFO:tasks.workunit.client.1.smithi156.stdout:8/678: dwrite d5/d9/fd [0,4194304] 0 2024-04-23T14:50:04.064 INFO:tasks.workunit.client.0.smithi081.stdout:9/939: unlink d3/de/d1d/d73/lcd 0 2024-04-23T14:50:04.065 INFO:tasks.workunit.client.1.smithi156.stdout:2/674: dwrite d4/d26/f7a [0,4194304] 0 2024-04-23T14:50:04.065 INFO:tasks.workunit.client.1.smithi156.stdout:2/675: stat d4/d21/d42/d9f 0 2024-04-23T14:50:04.066 INFO:tasks.workunit.client.1.smithi156.stdout:9/610: dwrite d1/d2/d23/d49/d4c/fb2 [0,4194304] 0 2024-04-23T14:50:04.067 INFO:tasks.workunit.client.1.smithi156.stdout:9/611: readlink d1/d2/d3e/d55/d9c/d39/d6c/l74 0 2024-04-23T14:50:04.067 INFO:tasks.workunit.client.1.smithi156.stdout:9/612: chown d1/d2/d3e/d55/d6f/d30/fa6 1756148 1 2024-04-23T14:50:04.067 INFO:tasks.workunit.client.1.smithi156.stdout:0/689: dread d0/d4/d22/f34 [0,4194304] 0 2024-04-23T14:50:04.067 INFO:tasks.workunit.client.1.smithi156.stdout:0/690: stat d0/d16/d3a/d2a/d1d/d2d/d6b/f9f 0 2024-04-23T14:50:04.068 INFO:tasks.workunit.client.0.smithi081.stdout:9/940: rename d3/de/d14/d5e/d72/fc1 to d3/de/d1d/d5b/f137 0 2024-04-23T14:50:04.074 INFO:tasks.workunit.client.1.smithi156.stdout:8/679: dread - d5/d9/d36/d60/d7c/fac zero size 2024-04-23T14:50:04.076 INFO:tasks.workunit.client.0.smithi081.stdout:9/941: symlink d3/d67/d77/d132/d116/l138 0 2024-04-23T14:50:04.080 INFO:tasks.workunit.client.1.smithi156.stdout:2/676: creat d4/d21/d42/da1/ddf/ff3 x:0 0 0 2024-04-23T14:50:04.081 INFO:tasks.workunit.client.0.smithi081.stdout:9/942: symlink d3/de/d1d/d62/l139 0 2024-04-23T14:50:04.082 INFO:tasks.workunit.client.1.smithi156.stdout:0/691: truncate d0/d16/dbf/f4b 457308 0 2024-04-23T14:50:04.082 INFO:tasks.workunit.client.1.smithi156.stdout:0/692: write d0/d4/fe [2585171,30862] 0 2024-04-23T14:50:04.083 INFO:tasks.workunit.client.0.smithi081.stdout:9/943: getdents d3/de/d1d/d5b/d7b/d90/dd2 0 2024-04-23T14:50:04.084 INFO:tasks.workunit.client.0.smithi081.stdout:9/944: creat d3/de/d1d/dcc/d10f/f13a x:0 0 0 2024-04-23T14:50:04.088 INFO:tasks.workunit.client.1.smithi156.stdout:2/677: mknod d4/d21/d42/d75/cf4 0 2024-04-23T14:50:04.089 INFO:tasks.workunit.client.0.smithi081.stdout:9/945: creat d3/de/d22/f13b x:0 0 0 2024-04-23T14:50:04.092 INFO:tasks.workunit.client.0.smithi081.stdout:9/946: read d3/f4a [2030528,93272] 0 2024-04-23T14:50:04.092 INFO:tasks.workunit.client.0.smithi081.stdout:9/947: creat d3/de/d25/f13c x:0 0 0 2024-04-23T14:50:04.094 INFO:tasks.workunit.client.1.smithi156.stdout:0/693: creat d0/d16/d43/fe4 x:0 0 0 2024-04-23T14:50:04.095 INFO:tasks.workunit.client.1.smithi156.stdout:2/678: mkdir d4/d13/d19/d4c/d5c/dd5/de2/df5 0 2024-04-23T14:50:04.098 INFO:tasks.workunit.client.1.smithi156.stdout:2/679: link d4/d13/d19/d4c/lb2 d4/d21/d42/lf6 0 2024-04-23T14:50:04.098 INFO:tasks.workunit.client.1.smithi156.stdout:2/680: write d4/d13/d19/fe7 [561410,88038] 0 2024-04-23T14:50:04.099 INFO:tasks.workunit.client.1.smithi156.stdout:2/681: creat d4/d13/ff7 x:0 0 0 2024-04-23T14:50:04.099 INFO:tasks.workunit.client.1.smithi156.stdout:2/682: write d4/f24 [1862199,4928] 0 2024-04-23T14:50:04.100 INFO:tasks.workunit.client.1.smithi156.stdout:2/683: readlink d4/l5a 0 2024-04-23T14:50:04.101 INFO:tasks.workunit.client.0.smithi081.stdout:7/968: sync 2024-04-23T14:50:04.104 INFO:tasks.workunit.client.1.smithi156.stdout:2/684: truncate d4/d13/f14 6771361 0 2024-04-23T14:50:04.104 INFO:tasks.workunit.client.1.smithi156.stdout:0/694: dread d0/d16/dbf/d3f/f51 [0,4194304] 0 2024-04-23T14:50:04.106 INFO:tasks.workunit.client.1.smithi156.stdout:2/685: mkdir d4/d13/d88/df8 0 2024-04-23T14:50:04.108 INFO:tasks.workunit.client.1.smithi156.stdout:0/695: unlink d0/d16/d43/dc2/f57 0 2024-04-23T14:50:04.109 INFO:tasks.workunit.client.1.smithi156.stdout:0/696: mkdir d0/d4/d22/d58/d9a/d44/de5 0 2024-04-23T14:50:04.111 INFO:tasks.workunit.client.1.smithi156.stdout:0/697: link d0/d16/d43/c9d d0/d16/d43/ce6 0 2024-04-23T14:50:04.112 INFO:tasks.workunit.client.1.smithi156.stdout:0/698: write d0/d16/d43/dc2/f4c [4977996,131048] 0 2024-04-23T14:50:04.118 INFO:tasks.workunit.client.1.smithi156.stdout:0/699: read d0/d16/f8d [280444,82194] 0 2024-04-23T14:50:04.118 INFO:tasks.workunit.client.1.smithi156.stdout:0/700: creat d0/d16/dbf/d3f/fe7 x:0 0 0 2024-04-23T14:50:04.119 INFO:tasks.workunit.client.0.smithi081.stdout:9/948: dread d3/de/f84 [4194304,4194304] 0 2024-04-23T14:50:04.123 INFO:tasks.workunit.client.0.smithi081.stdout:9/949: link d3/d67/d77/d132/fad d3/de/d1d/d5b/d7b/f13d 0 2024-04-23T14:50:04.139 INFO:tasks.workunit.client.0.smithi081.stdout:7/969: dread d3/d11/d2c/f9c [0,4194304] 0 2024-04-23T14:50:04.140 INFO:tasks.workunit.client.0.smithi081.stdout:7/970: fdatasync d3/f154 0 2024-04-23T14:50:04.140 INFO:tasks.workunit.client.0.smithi081.stdout:7/971: readlink d3/d97/lb5 0 2024-04-23T14:50:04.140 INFO:tasks.workunit.client.0.smithi081.stdout:7/972: write d3/d21/d41/dbb/d139/d14c/f57 [3622751,120720] 0 2024-04-23T14:50:04.140 INFO:tasks.workunit.client.0.smithi081.stdout:7/973: write d3/d21/d41/d7c/dc3/fe5 [656305,53563] 0 2024-04-23T14:50:04.142 INFO:tasks.workunit.client.1.smithi156.stdout:2/686: read d4/f29 [3308195,12135] 0 2024-04-23T14:50:04.145 INFO:tasks.workunit.client.1.smithi156.stdout:6/759: dwrite d3/da/d1d/d27/dfe/d6e/d8f/fc1 [0,4194304] 0 2024-04-23T14:50:04.145 INFO:tasks.workunit.client.1.smithi156.stdout:4/649: dread d0/df/d55/d68/f43 [0,4194304] 0 2024-04-23T14:50:04.145 INFO:tasks.workunit.client.1.smithi156.stdout:2/687: mkdir d4/d13/d19/d4c/df9 0 2024-04-23T14:50:04.145 INFO:tasks.workunit.client.1.smithi156.stdout:6/760: chown d3/d16/d1e/c33 1 1 2024-04-23T14:50:04.145 INFO:tasks.workunit.client.1.smithi156.stdout:6/761: readlink d3/l1f 0 2024-04-23T14:50:04.152 INFO:tasks.workunit.client.1.smithi156.stdout:8/680: dwrite d5/d39/d99/fbb [0,4194304] 0 2024-04-23T14:50:04.156 INFO:tasks.workunit.client.0.smithi081.stdout:4/967: sync 2024-04-23T14:50:04.156 INFO:tasks.workunit.client.0.smithi081.stdout:3/947: sync 2024-04-23T14:50:04.156 INFO:tasks.workunit.client.0.smithi081.stdout:4/968: truncate d1/d8b/fd1 448056 0 2024-04-23T14:50:04.156 INFO:tasks.workunit.client.0.smithi081.stdout:3/948: creat d4/d7/d32/da6/dc4/d5a/d93/f13a x:0 0 0 2024-04-23T14:50:04.157 INFO:tasks.workunit.client.1.smithi156.stdout:2/688: mkdir d4/d21/d42/d75/d8e/dfa 0 2024-04-23T14:50:04.158 INFO:tasks.workunit.client.1.smithi156.stdout:6/762: symlink d3/da/d1d/d59/df3/l116 0 2024-04-23T14:50:04.158 INFO:tasks.workunit.client.1.smithi156.stdout:6/763: creat d3/d16/d46/d9d/d9f/f117 x:0 0 0 2024-04-23T14:50:04.158 INFO:tasks.workunit.client.1.smithi156.stdout:6/764: chown d3/d16/c41 4 1 2024-04-23T14:50:04.161 INFO:tasks.workunit.client.1.smithi156.stdout:6/765: mkdir d3/d16/d1e/d118 0 2024-04-23T14:50:04.166 INFO:tasks.workunit.client.1.smithi156.stdout:6/766: mkdir d3/d16/d119 0 2024-04-23T14:50:04.166 INFO:tasks.workunit.client.1.smithi156.stdout:6/767: fsync d3/d16/d46/d9d/fe7 0 2024-04-23T14:50:04.167 INFO:tasks.workunit.client.1.smithi156.stdout:0/701: dread d0/d16/d3a/d2a/d1d/d2d/f8c [0,4194304] 0 2024-04-23T14:50:04.167 INFO:tasks.workunit.client.1.smithi156.stdout:0/702: creat d0/d16/d43/d9c/fe8 x:0 0 0 2024-04-23T14:50:04.170 INFO:tasks.workunit.client.1.smithi156.stdout:6/768: creat d3/da/d1d/d59/d72/f11a x:0 0 0 2024-04-23T14:50:04.181 INFO:tasks.workunit.client.1.smithi156.stdout:1/728: write db/d1f/d94/da1/fc7 [7559910,93510] 0 2024-04-23T14:50:04.182 INFO:tasks.workunit.client.1.smithi156.stdout:7/749: dwrite dc/d2c/f5c [0,4194304] 0 2024-04-23T14:50:04.182 INFO:tasks.workunit.client.1.smithi156.stdout:7/750: truncate dc/d9d/fc6 196298 0 2024-04-23T14:50:04.182 INFO:tasks.workunit.client.1.smithi156.stdout:7/751: stat dc/d2c/l4e 0 2024-04-23T14:50:04.185 INFO:tasks.workunit.client.1.smithi156.stdout:6/769: dread d3/d16/d46/d9d/ff5 [0,4194304] 0 2024-04-23T14:50:04.190 INFO:tasks.workunit.client.0.smithi081.stdout:4/969: rmdir d1 39 2024-04-23T14:50:04.190 INFO:tasks.workunit.client.0.smithi081.stdout:4/970: readlink d1/d4/lda 0 2024-04-23T14:50:04.194 INFO:tasks.workunit.client.0.smithi081.stdout:4/971: creat d1/d4/d6f/d70/daf/d8c/d99/f136 x:0 0 0 2024-04-23T14:50:04.195 INFO:tasks.workunit.client.0.smithi081.stdout:4/972: rename d1/d4/dc/c4d to d1/d4/d6f/d70/c137 0 2024-04-23T14:50:04.196 INFO:tasks.workunit.client.1.smithi156.stdout:1/729: rename db/d1f/d2d/d48/daf/d86/lde to db/d25/d30/d38/ddc/le3 0 2024-04-23T14:50:04.196 INFO:tasks.workunit.client.0.smithi081.stdout:4/973: mknod d1/d4/d11/d9d/dac/de7/d105/d12b/c138 0 2024-04-23T14:50:04.197 INFO:tasks.workunit.client.1.smithi156.stdout:4/650: write d0/df/d75/fcb [179791,96639] 0 2024-04-23T14:50:04.197 INFO:tasks.workunit.client.1.smithi156.stdout:4/651: fsync d0/df/f6b 0 2024-04-23T14:50:04.197 INFO:tasks.workunit.client.0.smithi081.stdout:4/974: mkdir d1/d4/d6f/d70/d9c/d139 0 2024-04-23T14:50:04.197 INFO:tasks.workunit.client.1.smithi156.stdout:6/770: mknod d3/d16/d10b/c11b 0 2024-04-23T14:50:04.199 INFO:tasks.workunit.client.1.smithi156.stdout:3/621: sync 2024-04-23T14:50:04.199 INFO:tasks.workunit.client.1.smithi156.stdout:0/703: dread d0/d16/d3a/d2a/d1d/d2d/d6b/fb5 [0,4194304] 0 2024-04-23T14:50:04.199 INFO:tasks.workunit.client.1.smithi156.stdout:0/704: readlink d0/d4/lb 0 2024-04-23T14:50:04.200 INFO:tasks.workunit.client.0.smithi081.stdout:4/975: unlink d1/d8f/d94/c101 0 2024-04-23T14:50:04.201 INFO:tasks.workunit.client.0.smithi081.stdout:4/976: fdatasync d1/d1d/f30 0 2024-04-23T14:50:04.201 INFO:tasks.workunit.client.1.smithi156.stdout:4/652: link d0/df/d55/d68/d53/f7e d0/d8/d1e/d4a/d77/dc1/fd9 0 2024-04-23T14:50:04.201 INFO:tasks.workunit.client.1.smithi156.stdout:0/705: write d0/d16/d3a/d2a/d1d/d2d/d6b/f82 [1091141,76669] 0 2024-04-23T14:50:04.203 INFO:tasks.workunit.client.1.smithi156.stdout:8/681: write d5/d9/d10/d1d/d21/f37 [1507005,112508] 0 2024-04-23T14:50:04.204 INFO:tasks.workunit.client.1.smithi156.stdout:3/622: rename d4/db/dd/f1b to d4/db/dd/d20/d57/fcd 0 2024-04-23T14:50:04.206 INFO:tasks.workunit.client.1.smithi156.stdout:0/706: unlink d0/d16/d43/f55 0 2024-04-23T14:50:04.208 INFO:tasks.workunit.client.1.smithi156.stdout:8/682: rmdir d5/d9/d36/d84/d8c 39 2024-04-23T14:50:04.212 INFO:tasks.workunit.client.1.smithi156.stdout:3/623: symlink d4/db/dd/lce 0 2024-04-23T14:50:04.214 INFO:tasks.workunit.client.1.smithi156.stdout:3/624: write d4/db/dd/d1d/d1e/d74/d93/dc4/fcb [395448,70754] 0 2024-04-23T14:50:04.214 INFO:tasks.workunit.client.1.smithi156.stdout:3/625: chown d4/db/dd/d1d/d61/d8d/d91/f92 25 1 2024-04-23T14:50:04.214 INFO:tasks.workunit.client.1.smithi156.stdout:3/626: chown d4/db/dd/d1d/d1e/l6e 4 1 2024-04-23T14:50:04.214 INFO:tasks.workunit.client.1.smithi156.stdout:0/707: truncate d0/d16/d3a/d2a/d1d/d2d/f73 3645618 0 2024-04-23T14:50:04.216 INFO:tasks.workunit.client.1.smithi156.stdout:3/627: mkdir d4/db/dd/d1d/d1e/d74/dcf 0 2024-04-23T14:50:04.216 INFO:tasks.workunit.client.1.smithi156.stdout:3/628: fsync d4/db/dd/d1d/d1e/d13/d5a/fc6 0 2024-04-23T14:50:04.220 INFO:tasks.workunit.client.1.smithi156.stdout:3/629: getdents d4/db/dd/d1d/d1e/d74/d93/dad 0 2024-04-23T14:50:04.220 INFO:tasks.workunit.client.1.smithi156.stdout:3/630: read - d4/db/dd/d1d/d1e/d42/d76/dba/fbd zero size 2024-04-23T14:50:04.220 INFO:tasks.workunit.client.1.smithi156.stdout:3/631: chown d4/db/dd/d1d/d1e/d2b 0 1 2024-04-23T14:50:04.220 INFO:tasks.workunit.client.1.smithi156.stdout:3/632: chown d4/db/dd/d1d/d1e/lb6 425 1 2024-04-23T14:50:04.220 INFO:tasks.workunit.client.1.smithi156.stdout:3/633: chown d4/db/dd/d1d/d1e/d13/f34 261231454 1 2024-04-23T14:50:04.220 INFO:tasks.workunit.client.1.smithi156.stdout:8/683: dread d5/d9/d36/d9c/f5b [0,4194304] 0 2024-04-23T14:50:04.220 INFO:tasks.workunit.client.1.smithi156.stdout:8/684: fsync d5/d9/d36/d60/fa5 0 2024-04-23T14:50:04.220 INFO:tasks.workunit.client.1.smithi156.stdout:3/634: write d4/db/dd/d1d/d1e/d42/faa [658872,33657] 0 2024-04-23T14:50:04.220 INFO:tasks.workunit.client.1.smithi156.stdout:8/685: creat d5/d39/d99/ff2 x:0 0 0 2024-04-23T14:50:04.223 INFO:tasks.workunit.client.1.smithi156.stdout:3/635: unlink d4/db/dd/d1d/d1e/d13/f4c 0 2024-04-23T14:50:04.227 INFO:tasks.workunit.client.0.smithi081.stdout:3/949: dwrite d4/d7/d32/db0/db5/fe8 [0,4194304] 0 2024-04-23T14:50:04.227 INFO:tasks.workunit.client.0.smithi081.stdout:3/950: write d4/d41/dc6/f7a [1615146,20031] 0 2024-04-23T14:50:04.230 INFO:tasks.workunit.client.1.smithi156.stdout:8/686: rename d5/d9/d5a/d5c/d6b to d5/d9/d36/de8/df3 0 2024-04-23T14:50:04.231 INFO:tasks.workunit.client.1.smithi156.stdout:3/636: truncate d4/db/dd/d1d/d1e/d13/f46 3305424 0 2024-04-23T14:50:04.231 INFO:tasks.workunit.client.1.smithi156.stdout:3/637: fdatasync d4/db/dd/d20/d57/fcd 0 2024-04-23T14:50:04.233 INFO:tasks.workunit.client.1.smithi156.stdout:2/689: dwrite d4/d13/d88/f72 [0,4194304] 0 2024-04-23T14:50:04.234 INFO:tasks.workunit.client.0.smithi081.stdout:4/977: rename d1/d4/d6f/d70/daf to d1/d1d/d39/d132/d13a 0 2024-04-23T14:50:04.234 INFO:tasks.workunit.client.0.smithi081.stdout:4/978: write d1/d4/dc/f6e [374541,178] 0 2024-04-23T14:50:04.237 INFO:tasks.workunit.client.1.smithi156.stdout:3/638: creat d4/db/dd/d1d/d1e/d74/d93/dad/fd0 x:0 0 0 2024-04-23T14:50:04.240 INFO:tasks.workunit.client.1.smithi156.stdout:5/721: dwrite d1/d17/f2e [4194304,4194304] 0 2024-04-23T14:50:04.241 INFO:tasks.workunit.client.0.smithi081.stdout:4/979: mknod d1/c13b 0 2024-04-23T14:50:04.241 INFO:tasks.workunit.client.0.smithi081.stdout:4/980: readlink d1/d4/l13 0 2024-04-23T14:50:04.245 INFO:tasks.workunit.client.0.smithi081.stdout:4/981: rmdir d1/d1d/d39/d132/d13a/d89 39 2024-04-23T14:50:04.248 INFO:tasks.workunit.client.1.smithi156.stdout:0/708: dread d0/d16/d3a/d2a/d1d/d2d/f8c [0,4194304] 0 2024-04-23T14:50:04.250 INFO:tasks.workunit.client.1.smithi156.stdout:3/639: rmdir d4/db/dd/d1d/d61/d7f/da2 0 2024-04-23T14:50:04.252 INFO:tasks.workunit.client.1.smithi156.stdout:5/722: link d1/d3/f3a d1/d17/fe3 0 2024-04-23T14:50:04.253 INFO:tasks.workunit.client.1.smithi156.stdout:5/723: fsync d1/d17/d7e/f8b 0 2024-04-23T14:50:04.253 INFO:tasks.workunit.client.1.smithi156.stdout:5/724: dread - d1/d11/de0/d97/fdf zero size 2024-04-23T14:50:04.254 INFO:tasks.workunit.client.0.smithi081.stdout:4/982: creat d1/d4/d6f/d70/d9c/d139/f13c x:0 0 0 2024-04-23T14:50:04.255 INFO:tasks.workunit.client.1.smithi156.stdout:4/653: read d0/d76/f70 [596988,46881] 0 2024-04-23T14:50:04.256 INFO:tasks.workunit.client.1.smithi156.stdout:4/654: fdatasync d0/d8/d1e/da0/fce 0 2024-04-23T14:50:04.256 INFO:tasks.workunit.client.1.smithi156.stdout:4/655: chown d0/df/d55/d68/d53/d91/d95/db5/cd3 11719 1 2024-04-23T14:50:04.256 INFO:tasks.workunit.client.1.smithi156.stdout:2/690: rmdir d4/d13/d19/d97 39 2024-04-23T14:50:04.257 INFO:tasks.workunit.client.1.smithi156.stdout:2/691: write d4/d21/d2f/f74 [4479540,90207] 0 2024-04-23T14:50:04.257 INFO:tasks.workunit.client.1.smithi156.stdout:6/771: dwrite d3/da/d1d/d59/d9c/f113 [0,4194304] 0 2024-04-23T14:50:04.257 INFO:tasks.workunit.client.1.smithi156.stdout:2/692: write d4/d21/d42/d75/fbd [392378,20234] 0 2024-04-23T14:50:04.257 INFO:tasks.workunit.client.1.smithi156.stdout:6/772: creat d3/d16/d46/d9d/d9f/dad/f11c x:0 0 0 2024-04-23T14:50:04.257 INFO:tasks.workunit.client.1.smithi156.stdout:6/773: creat d3/da/d1d/d27/dfe/d6e/f11d x:0 0 0 2024-04-23T14:50:04.260 INFO:tasks.workunit.client.0.smithi081.stdout:4/983: creat d1/d1d/d39/d132/d13a/d89/db7/f13d x:0 0 0 2024-04-23T14:50:04.266 INFO:tasks.workunit.client.0.smithi081.stdout:4/984: creat d1/d1d/d39/d132/d13a/d8c/f13e x:0 0 0 2024-04-23T14:50:04.266 INFO:tasks.workunit.client.0.smithi081.stdout:4/985: chown d1/d1d/ff9 32332271 1 2024-04-23T14:50:04.272 INFO:tasks.workunit.client.0.smithi081.stdout:4/986: rename d1/d4/d11/d75/fdc to d1/f13f 0 2024-04-23T14:50:04.275 INFO:tasks.workunit.client.1.smithi156.stdout:8/687: write d5/d4e/fb3 [539742,115987] 0 2024-04-23T14:50:04.278 INFO:tasks.workunit.client.0.smithi081.stdout:4/987: mknod d1/d4/d6f/d70/d9c/d139/c140 0 2024-04-23T14:50:04.281 INFO:tasks.workunit.client.1.smithi156.stdout:7/752: dwrite dc/d1d/d24/d5a/faa [4194304,4194304] 0 2024-04-23T14:50:04.281 INFO:tasks.workunit.client.1.smithi156.stdout:7/753: creat dc/d1d/d48/fee x:0 0 0 2024-04-23T14:50:04.281 INFO:tasks.workunit.client.1.smithi156.stdout:7/754: stat dc/d2c/d68/f8e 0 2024-04-23T14:50:04.282 INFO:tasks.workunit.client.0.smithi081.stdout:4/988: link d1/ffb d1/d4/d11/d75/d126/f141 0 2024-04-23T14:50:04.283 INFO:tasks.workunit.client.0.smithi081.stdout:4/989: chown d1/d1d/d39/d8d/de3/ff5 162 1 2024-04-23T14:50:04.283 INFO:tasks.workunit.client.1.smithi156.stdout:0/709: dread d0/d16/dbf/d3f/f68 [0,4194304] 0 2024-04-23T14:50:04.283 INFO:tasks.workunit.client.1.smithi156.stdout:0/710: dread - d0/d16/d43/da6/fc6 zero size 2024-04-23T14:50:04.284 INFO:tasks.workunit.client.1.smithi156.stdout:1/730: dwrite db/d25/f64 [0,4194304] 0 2024-04-23T14:50:04.285 INFO:tasks.workunit.client.1.smithi156.stdout:4/656: rename d0/d8/d1e/f47 to d0/df/d55/d68/d53/d9f/dcc/fda 0 2024-04-23T14:50:04.290 INFO:tasks.workunit.client.0.smithi081.stdout:4/990: link d1/d4/l4a d1/d4/d6f/d108/l142 0 2024-04-23T14:50:04.291 INFO:tasks.workunit.client.0.smithi081.stdout:4/991: chown d1/d1d/daa 14 1 2024-04-23T14:50:04.292 INFO:tasks.workunit.client.0.smithi081.stdout:3/951: dwrite d4/d7/d49/fe2 [0,4194304] 0 2024-04-23T14:50:04.292 INFO:tasks.workunit.client.0.smithi081.stdout:3/952: write d4/d41/dc6/f7a [3409588,6563] 0 2024-04-23T14:50:04.292 INFO:tasks.workunit.client.0.smithi081.stdout:3/953: chown d4/dc/d50 2295422 1 2024-04-23T14:50:04.292 INFO:tasks.workunit.client.0.smithi081.stdout:3/954: truncate d4/d7/d7f/d85/d9d/dac/f128 834080 0 2024-04-23T14:50:04.293 INFO:tasks.workunit.client.1.smithi156.stdout:2/693: mkdir d4/d13/d19/de8/dfb 0 2024-04-23T14:50:04.297 INFO:tasks.workunit.client.1.smithi156.stdout:3/640: mkdir d4/db/dd1 0 2024-04-23T14:50:04.298 INFO:tasks.workunit.client.0.smithi081.stdout:3/955: mknod d4/d7/d1a/c13b 0 2024-04-23T14:50:04.299 INFO:tasks.workunit.client.1.smithi156.stdout:8/688: creat d5/d9/d5a/ff4 x:0 0 0 2024-04-23T14:50:04.300 INFO:tasks.workunit.client.1.smithi156.stdout:8/689: write d5/d9/d36/d60/f89 [44511,2853] 0 2024-04-23T14:50:04.304 INFO:tasks.workunit.client.1.smithi156.stdout:7/755: mkdir dc/d2a/da9/def 0 2024-04-23T14:50:04.304 INFO:tasks.workunit.client.1.smithi156.stdout:9/613: sync 2024-04-23T14:50:04.304 INFO:tasks.workunit.client.0.smithi081.stdout:4/992: write d1/d4f/d87/f113 [3147691,125303] 0 2024-04-23T14:50:04.308 INFO:tasks.workunit.client.1.smithi156.stdout:1/731: symlink db/d1f/d2d/d48/db4/le4 0 2024-04-23T14:50:04.310 INFO:tasks.workunit.client.1.smithi156.stdout:3/641: rmdir d4/db/dd 39 2024-04-23T14:50:04.310 INFO:tasks.workunit.client.1.smithi156.stdout:8/690: mkdir d5/d9/d36/de8/df5 0 2024-04-23T14:50:04.310 INFO:tasks.workunit.client.1.smithi156.stdout:6/774: getdents d3/da/d1d/d59/d72/dcc 0 2024-04-23T14:50:04.310 INFO:tasks.workunit.client.1.smithi156.stdout:6/775: fdatasync d3/d16/d46/f3e 0 2024-04-23T14:50:04.314 INFO:tasks.workunit.client.1.smithi156.stdout:3/642: unlink d4/db/dd/d73/fb7 0 2024-04-23T14:50:04.314 INFO:tasks.workunit.client.1.smithi156.stdout:4/657: getdents d0/df/d75 0 2024-04-23T14:50:04.314 INFO:tasks.workunit.client.1.smithi156.stdout:8/691: symlink d5/d9/d36/d60/db8/ddd/de1/lf6 0 2024-04-23T14:50:04.314 INFO:tasks.workunit.client.1.smithi156.stdout:8/692: dread - d5/d9/d5a/d5c/f9d zero size 2024-04-23T14:50:04.315 INFO:tasks.workunit.client.1.smithi156.stdout:3/643: unlink d4/db/dd/d20/d57/fbe 0 2024-04-23T14:50:04.316 INFO:tasks.workunit.client.1.smithi156.stdout:8/693: mknod d5/d9/d5a/cf7 0 2024-04-23T14:50:04.322 INFO:tasks.workunit.client.1.smithi156.stdout:5/725: dwrite d1/d3/f49 [4194304,4194304] 0 2024-04-23T14:50:04.327 INFO:tasks.workunit.client.1.smithi156.stdout:3/644: truncate d4/db/dd/d1d/d1e/d42/d76/f88 85541 0 2024-04-23T14:50:04.328 INFO:tasks.workunit.client.1.smithi156.stdout:8/694: unlink d5/d9/d10/d1d/d21/la4 0 2024-04-23T14:50:04.330 INFO:tasks.workunit.client.1.smithi156.stdout:3/645: symlink d4/db/dd/d1d/d1e/d74/d93/dc4/ld2 0 2024-04-23T14:50:04.331 INFO:tasks.workunit.client.1.smithi156.stdout:3/646: truncate d4/db/dd/d1d/d1e/d13/f1a 619383 0 2024-04-23T14:50:04.343 INFO:tasks.workunit.client.0.smithi081.stdout:4/993: dread d1/d1d/d39/d132/d13a/f82 [0,4194304] 0 2024-04-23T14:50:04.343 INFO:tasks.workunit.client.0.smithi081.stdout:4/994: chown d1/d8b 7132203 1 2024-04-23T14:50:04.344 INFO:tasks.workunit.client.0.smithi081.stdout:4/995: chown d1/d4/d11/d9d/dac/de7/f117 114077 1 2024-04-23T14:50:04.346 INFO:tasks.workunit.client.0.smithi081.stdout:4/996: unlink d1/d4f/d87/f134 0 2024-04-23T14:50:04.352 INFO:tasks.workunit.client.1.smithi156.stdout:3/647: dread d4/db/dd/d1d/f37 [0,4194304] 0 2024-04-23T14:50:04.352 INFO:tasks.workunit.client.1.smithi156.stdout:3/648: truncate d4/db/dd/d1d/d1e/d74/d90/f4d 492703 0 2024-04-23T14:50:04.352 INFO:tasks.workunit.client.1.smithi156.stdout:3/649: readlink d4/db/dd/d1d/d1e/d13/l63 0 2024-04-23T14:50:04.357 INFO:tasks.workunit.client.1.smithi156.stdout:3/650: rename d4/l30 to d4/ld3 0 2024-04-23T14:50:04.364 INFO:tasks.workunit.client.1.smithi156.stdout:2/694: write d4/d21/d2f/f49 [1139785,22502] 0 2024-04-23T14:50:04.364 INFO:tasks.workunit.client.1.smithi156.stdout:2/695: truncate d4/d26/d3c/fe9 1207195 0 2024-04-23T14:50:04.364 INFO:tasks.workunit.client.1.smithi156.stdout:6/776: dread d3/d16/d46/d9d/d9f/dad/f9b [0,4194304] 0 2024-04-23T14:50:04.375 INFO:tasks.workunit.client.0.smithi081.stdout:3/956: dwrite d4/d7/d32/f9c [0,4194304] 0 2024-04-23T14:50:04.375 INFO:tasks.workunit.client.0.smithi081.stdout:4/997: dread d1/d4/f76 [0,4194304] 0 2024-04-23T14:50:04.379 INFO:tasks.workunit.client.1.smithi156.stdout:6/777: creat d3/da/f11e x:0 0 0 2024-04-23T14:50:04.379 INFO:tasks.workunit.client.1.smithi156.stdout:6/778: dread - d3/da/d74/fef zero size 2024-04-23T14:50:04.379 INFO:tasks.workunit.client.1.smithi156.stdout:0/711: dwrite d0/d16/fe0 [0,4194304] 0 2024-04-23T14:50:04.379 INFO:tasks.workunit.client.0.smithi081.stdout:4/998: creat d1/d1d/f143 x:0 0 0 2024-04-23T14:50:04.381 INFO:tasks.workunit.client.0.smithi081.stdout:3/957: write d4/f17 [795122,59421] 0 2024-04-23T14:50:04.381 INFO:tasks.workunit.client.0.smithi081.stdout:3/958: write d4/d7/d32/da6/dc4/d5a/d93/ffd [798126,93328] 0 2024-04-23T14:50:04.381 INFO:tasks.workunit.client.0.smithi081.stdout:3/959: chown d4/d7/df/d30/fee 23327437 1 2024-04-23T14:50:04.381 INFO:tasks.workunit.client.0.smithi081.stdout:3/960: chown d4/d7/df/d30/f4c 2758 1 2024-04-23T14:50:04.382 INFO:tasks.workunit.client.1.smithi156.stdout:4/658: write d0/df/f6b [2824742,101458] 0 2024-04-23T14:50:04.382 INFO:tasks.workunit.client.0.smithi081.stdout:4/999: mkdir d1/d1d/d39/d144 0 2024-04-23T14:50:04.383 INFO:tasks.workunit.client.0.smithi081.stdout:3/961: truncate d4/d7/df/d30/f80 1321063 0 2024-04-23T14:50:04.385 INFO:tasks.workunit.client.1.smithi156.stdout:2/696: creat d4/d21/d42/d75/d8e/dfa/ffc x:0 0 0 2024-04-23T14:50:04.385 INFO:tasks.workunit.client.1.smithi156.stdout:2/697: chown d4/d13/d19/lab 1001660275 1 2024-04-23T14:50:04.385 INFO:tasks.workunit.client.1.smithi156.stdout:2/698: creat d4/d13/d19/d4c/d5c/ffd x:0 0 0 2024-04-23T14:50:04.385 INFO:tasks.workunit.client.1.smithi156.stdout:2/699: fsync d4/d26/fb1 0 2024-04-23T14:50:04.385 INFO:tasks.workunit.client.1.smithi156.stdout:2/700: chown d4/d21/d42/d75/lf1 31716132 1 2024-04-23T14:50:04.385 INFO:tasks.workunit.client.1.smithi156.stdout:2/701: fsync d4/d13/d19/d58/fa7 0 2024-04-23T14:50:04.385 INFO:tasks.workunit.client.1.smithi156.stdout:2/702: stat d4/d21/d42/laf 0 2024-04-23T14:50:04.387 INFO:tasks.workunit.client.1.smithi156.stdout:4/659: read d0/d8/f8e [434594,56457] 0 2024-04-23T14:50:04.387 INFO:tasks.workunit.client.1.smithi156.stdout:4/660: fsync d0/df/f58 0 2024-04-23T14:50:04.388 INFO:tasks.workunit.client.1.smithi156.stdout:4/661: fsync d0/df/d55/d68/d85/f90 0 2024-04-23T14:50:04.388 INFO:tasks.workunit.client.1.smithi156.stdout:4/662: dread - d0/df/d21/f69 zero size 2024-04-23T14:50:04.390 INFO:tasks.workunit.client.1.smithi156.stdout:4/663: symlink d0/d8/d1e/d4a/d77/d9c/ldb 0 2024-04-23T14:50:04.390 INFO:tasks.workunit.client.1.smithi156.stdout:4/664: chown d0/d8/d1e/l20 24195856 1 2024-04-23T14:50:04.393 INFO:tasks.workunit.client.1.smithi156.stdout:4/665: getdents d0/df/d55/d68/d85 0 2024-04-23T14:50:04.396 INFO:tasks.workunit.client.0.smithi081.stdout:3/962: dread d4/d7/d49/fdd [0,4194304] 0 2024-04-23T14:50:04.399 INFO:tasks.workunit.client.1.smithi156.stdout:2/703: read d4/d21/d42/f5e [747586,127922] 0 2024-04-23T14:50:04.401 INFO:tasks.workunit.client.1.smithi156.stdout:2/704: mkdir d4/d13/d19/d58/dfe 0 2024-04-23T14:50:04.401 INFO:tasks.workunit.client.1.smithi156.stdout:2/705: stat d4/d21/d2f/f35 0 2024-04-23T14:50:04.405 INFO:tasks.workunit.client.1.smithi156.stdout:2/706: creat d4/d13/d88/dad/fff x:0 0 0 2024-04-23T14:50:04.410 INFO:tasks.workunit.client.1.smithi156.stdout:2/707: truncate d4/d26/d3c/f46 10898 0 2024-04-23T14:50:04.410 INFO:tasks.workunit.client.1.smithi156.stdout:0/712: dread d0/d16/d3a/d1e/f3d [0,4194304] 0 2024-04-23T14:50:04.411 INFO:tasks.workunit.client.1.smithi156.stdout:0/713: creat d0/d16/d8e/fe9 x:0 0 0 2024-04-23T14:50:04.411 INFO:tasks.workunit.client.1.smithi156.stdout:0/714: readlink d0/d16/d3a/d2a/ld 0 2024-04-23T14:50:04.411 INFO:tasks.workunit.client.1.smithi156.stdout:0/715: fsync d0/d16/d3a/d2a/d1d/d2d/f85 0 2024-04-23T14:50:04.411 INFO:tasks.workunit.client.1.smithi156.stdout:0/716: dread - d0/d16/d3a/d2a/d1d/d2d/d6b/fc1 zero size 2024-04-23T14:50:04.414 INFO:tasks.workunit.client.1.smithi156.stdout:1/732: dwrite db/d25/fce [0,4194304] 0 2024-04-23T14:50:04.414 INFO:tasks.workunit.client.1.smithi156.stdout:1/733: creat db/d1f/d2d/d48/dab/fe5 x:0 0 0 2024-04-23T14:50:04.416 INFO:tasks.workunit.client.0.smithi081.stdout:3/963: write d4/d41/dc6/ffa [2465587,44767] 0 2024-04-23T14:50:04.416 INFO:tasks.workunit.client.0.smithi081.stdout:3/964: truncate d4/d7/df/d30/d64/d83/fe1 619580 0 2024-04-23T14:50:04.417 INFO:tasks.workunit.client.1.smithi156.stdout:4/666: dread d0/d8/fc [0,4194304] 0 2024-04-23T14:50:04.417 INFO:tasks.workunit.client.1.smithi156.stdout:8/695: dwrite d5/d9/d36/d60/d7c/fac [0,4194304] 0 2024-04-23T14:50:04.417 INFO:tasks.workunit.client.1.smithi156.stdout:8/696: chown d5/d9/d36/d9c/f56 295 1 2024-04-23T14:50:04.418 INFO:tasks.workunit.client.1.smithi156.stdout:5/726: dwrite d1/d11/d18/d52/d85/f9b [4194304,4194304] 0 2024-04-23T14:50:04.420 INFO:tasks.workunit.client.0.smithi081.stdout:3/965: unlink d4/d7/d32/da6/dc4/d5a/d93/ffd 0 2024-04-23T14:50:04.429 INFO:tasks.workunit.client.1.smithi156.stdout:9/614: dwrite d1/d2/d3e/d50/d7a/d17/d1f/f63 [0,4194304] 0 2024-04-23T14:50:04.435 INFO:tasks.workunit.client.0.smithi081.stdout:9/950: sync 2024-04-23T14:50:04.435 INFO:tasks.workunit.client.0.smithi081.stdout:7/974: sync 2024-04-23T14:50:04.436 INFO:tasks.workunit.client.1.smithi156.stdout:2/708: dread d4/d13/d19/d58/fa7 [0,4194304] 0 2024-04-23T14:50:04.436 INFO:tasks.workunit.client.1.smithi156.stdout:2/709: chown d4/d26/l92 0 1 2024-04-23T14:50:04.436 INFO:tasks.workunit.client.1.smithi156.stdout:2/710: chown d4/d21/faa 401671867 1 2024-04-23T14:50:04.437 INFO:tasks.workunit.client.1.smithi156.stdout:8/697: dread d5/d9/d36/d84/fde [0,4194304] 0 2024-04-23T14:50:04.437 INFO:tasks.workunit.client.1.smithi156.stdout:8/698: symlink d5/d39/lf8 0 2024-04-23T14:50:04.437 INFO:tasks.workunit.client.1.smithi156.stdout:8/699: creat d5/d9/d5a/ff9 x:0 0 0 2024-04-23T14:50:04.437 INFO:tasks.workunit.client.0.smithi081.stdout:7/975: readlink d3/d21/d41/dbb/d139/d14c/d4c/l5b 0 2024-04-23T14:50:04.437 INFO:tasks.workunit.client.0.smithi081.stdout:7/976: fdatasync d3/d21/d41/dbb/d139/d14c/d4c/f5d 0 2024-04-23T14:50:04.437 INFO:tasks.workunit.client.0.smithi081.stdout:7/977: creat d3/d21/d31/d33/d52/f15b x:0 0 0 2024-04-23T14:50:04.439 INFO:tasks.workunit.client.0.smithi081.stdout:9/951: creat d3/de/d1d/dcc/d10f/d12e/f13e x:0 0 0 2024-04-23T14:50:04.451 INFO:tasks.workunit.client.1.smithi156.stdout:9/615: write d1/fe [2817702,24896] 0 2024-04-23T14:50:04.453 INFO:tasks.workunit.client.1.smithi156.stdout:3/651: dwrite d4/db/dd/d1d/f37 [0,4194304] 0 2024-04-23T14:50:04.458 INFO:tasks.workunit.client.1.smithi156.stdout:7/756: dwrite dc/d46/d58/db7/ddd/f8a [0,4194304] 0 2024-04-23T14:50:04.472 INFO:tasks.workunit.client.1.smithi156.stdout:3/652: rename d4/db/dd/d1d/d1e/d74/l94 to d4/db/dd/d1d/d61/ld4 0 2024-04-23T14:50:04.473 INFO:tasks.workunit.client.1.smithi156.stdout:9/616: getdents d1/d2/d3e/d55/d9c/d39 0 2024-04-23T14:50:04.473 INFO:tasks.workunit.client.1.smithi156.stdout:3/653: write d4/db/dd/d1d/d1e/d42/faa [1065199,103179] 0 2024-04-23T14:50:04.481 INFO:tasks.workunit.client.1.smithi156.stdout:7/757: creat dc/d2c/dbe/dc2/ff0 x:0 0 0 2024-04-23T14:50:04.484 INFO:tasks.workunit.client.1.smithi156.stdout:3/654: dread d4/db/dd/d1d/d61/d8d/d91/f92 [0,4194304] 0 2024-04-23T14:50:04.485 INFO:tasks.workunit.client.1.smithi156.stdout:7/758: rmdir dc/d2c/d68 39 2024-04-23T14:50:04.485 INFO:tasks.workunit.client.1.smithi156.stdout:3/655: chown d4/db/dd 100 1 2024-04-23T14:50:04.485 INFO:tasks.workunit.client.1.smithi156.stdout:7/759: write dc/fa5 [118734,17966] 0 2024-04-23T14:50:04.486 INFO:tasks.workunit.client.1.smithi156.stdout:3/656: write d4/db/dd/d1d/d1e/d13/f46 [3681035,46792] 0 2024-04-23T14:50:04.488 INFO:tasks.workunit.client.1.smithi156.stdout:7/760: creat dc/d1d/d24/d5a/dd0/ff1 x:0 0 0 2024-04-23T14:50:04.488 INFO:tasks.workunit.client.1.smithi156.stdout:7/761: write dc/d1d/d48/fee [605243,56379] 0 2024-04-23T14:50:04.490 INFO:tasks.workunit.client.1.smithi156.stdout:3/657: rename d4/db/f2f to d4/db/dd/d20/fd5 0 2024-04-23T14:50:04.494 INFO:tasks.workunit.client.1.smithi156.stdout:2/711: dread d4/f62 [0,4194304] 0 2024-04-23T14:50:04.494 INFO:tasks.workunit.client.1.smithi156.stdout:2/712: write d4/d21/d42/da1/ddf/ff3 [112637,34070] 0 2024-04-23T14:50:04.494 INFO:tasks.workunit.client.1.smithi156.stdout:3/658: getdents d4/db/dd/d1d/d1e/d74/d93/dad 0 2024-04-23T14:50:04.494 INFO:tasks.workunit.client.1.smithi156.stdout:3/659: write d4/db/dd/d1d/d1e/f12 [5084236,88873] 0 2024-04-23T14:50:04.495 INFO:tasks.workunit.client.1.smithi156.stdout:2/713: getdents d4/d21/d42/d9f 0 2024-04-23T14:50:04.501 INFO:tasks.workunit.client.1.smithi156.stdout:5/727: dwrite d1/f7c [0,4194304] 0 2024-04-23T14:50:04.502 INFO:tasks.workunit.client.1.smithi156.stdout:5/728: unlink d1/d11/de0/fdb 0 2024-04-23T14:50:04.517 INFO:tasks.workunit.client.0.smithi081.stdout:3/966: dwrite d4/d7/df/f35 [0,4194304] 0 2024-04-23T14:50:04.517 INFO:tasks.workunit.client.0.smithi081.stdout:3/967: read d4/d7/d1a/d71/f76 [2291973,83214] 0 2024-04-23T14:50:04.517 INFO:tasks.workunit.client.0.smithi081.stdout:3/968: truncate d4/d7/df/f139 271853 0 2024-04-23T14:50:04.518 INFO:tasks.workunit.client.1.smithi156.stdout:4/667: dread d0/d8/fc [0,4194304] 0 2024-04-23T14:50:04.518 INFO:tasks.workunit.client.1.smithi156.stdout:0/717: dwrite d0/d4/d22/d58/d9a/d44/fc7 [0,4194304] 0 2024-04-23T14:50:04.518 INFO:tasks.workunit.client.1.smithi156.stdout:0/718: dread - d0/d16/d3a/fa9 zero size 2024-04-23T14:50:04.518 INFO:tasks.workunit.client.1.smithi156.stdout:0/719: stat d0/d16/d3a/d2a/d1d/d2d/d6b/c70 0 2024-04-23T14:50:04.518 INFO:tasks.workunit.client.1.smithi156.stdout:0/720: creat d0/d4/d22/d58/d9a/d44/fea x:0 0 0 2024-04-23T14:50:04.518 INFO:tasks.workunit.client.1.smithi156.stdout:4/668: write d0/df/f25 [4556326,47745] 0 2024-04-23T14:50:04.518 INFO:tasks.workunit.client.1.smithi156.stdout:0/721: chown d0/d16/c83 3 1 2024-04-23T14:50:04.518 INFO:tasks.workunit.client.1.smithi156.stdout:4/669: stat d0/l23 0 2024-04-23T14:50:04.518 INFO:tasks.workunit.client.1.smithi156.stdout:0/722: creat d0/d16/d3a/d2a/d1d/d2d/d6b/feb x:0 0 0 2024-04-23T14:50:04.525 INFO:tasks.workunit.client.1.smithi156.stdout:0/723: mkdir d0/d16/d3a/dec 0 2024-04-23T14:50:04.525 INFO:tasks.workunit.client.1.smithi156.stdout:0/724: fsync d0/d16/d3a/d2a/d1d/d2d/d6b/fca 0 2024-04-23T14:50:04.536 INFO:tasks.workunit.client.0.smithi081.stdout:7/978: dwrite d3/d21/f79 [4194304,4194304] 0 2024-04-23T14:50:04.536 INFO:tasks.workunit.client.0.smithi081.stdout:9/952: dwrite d3/de/ff4 [0,4194304] 0 2024-04-23T14:50:04.536 INFO:tasks.workunit.client.0.smithi081.stdout:3/969: dread d4/d7/df/d30/f4c [0,4194304] 0 2024-04-23T14:50:04.538 INFO:tasks.workunit.client.0.smithi081.stdout:7/979: creat d3/d21/d41/dbb/d139/d14c/d6e/d148/d157/f15c x:0 0 0 2024-04-23T14:50:04.538 INFO:tasks.workunit.client.0.smithi081.stdout:7/980: chown d3/d21/d31/d110/d116/l145 6 1 2024-04-23T14:50:04.539 INFO:tasks.workunit.client.0.smithi081.stdout:7/981: chown d3/d21/d41/d7c/fe6 15094507 1 2024-04-23T14:50:04.539 INFO:tasks.workunit.client.0.smithi081.stdout:9/953: unlink d3/de/d47/fe9 0 2024-04-23T14:50:04.540 INFO:tasks.workunit.client.0.smithi081.stdout:3/970: creat d4/d7/df/d30/d64/d83/f13c x:0 0 0 2024-04-23T14:50:04.541 INFO:tasks.workunit.client.0.smithi081.stdout:7/982: symlink d3/d21/l15d 0 2024-04-23T14:50:04.542 INFO:tasks.workunit.client.0.smithi081.stdout:7/983: fdatasync d3/d21/d41/dbb/d139/d14c/fd5 0 2024-04-23T14:50:04.542 INFO:tasks.workunit.client.0.smithi081.stdout:7/984: stat d3/d21/f55 0 2024-04-23T14:50:04.542 INFO:tasks.workunit.client.0.smithi081.stdout:7/985: fsync d3/d21/d31/f150 0 2024-04-23T14:50:04.542 INFO:tasks.workunit.client.0.smithi081.stdout:7/986: read d3/d21/d31/d50/fa7 [1050666,52311] 0 2024-04-23T14:50:04.542 INFO:tasks.workunit.client.0.smithi081.stdout:9/954: readlink d3/led 0 2024-04-23T14:50:04.542 INFO:tasks.workunit.client.0.smithi081.stdout:7/987: creat d3/d11/d2c/d75/d8e/dea/f15e x:0 0 0 2024-04-23T14:50:04.543 INFO:tasks.workunit.client.0.smithi081.stdout:7/988: creat d3/d97/f15f x:0 0 0 2024-04-23T14:50:04.543 INFO:tasks.workunit.client.0.smithi081.stdout:3/971: rename d4/d7/d32/da6/dc4/c98 to d4/d7/d1a/c13d 0 2024-04-23T14:50:04.545 INFO:tasks.workunit.client.0.smithi081.stdout:7/989: truncate d3/d21/d41/d7c/ff6 1474355 0 2024-04-23T14:50:04.549 INFO:tasks.workunit.client.1.smithi156.stdout:7/762: write dc/f81 [635712,6599] 0 2024-04-23T14:50:04.553 INFO:tasks.workunit.client.0.smithi081.stdout:3/972: write d4/d7/d1a/d71/fc3 [666761,67866] 0 2024-04-23T14:50:04.553 INFO:tasks.workunit.client.0.smithi081.stdout:3/973: truncate d4/d7/d32/da6/dc4/d47/f96 5185931 0 2024-04-23T14:50:04.556 INFO:tasks.workunit.client.0.smithi081.stdout:3/974: symlink d4/d7/d49/l13e 0 2024-04-23T14:50:04.560 INFO:tasks.workunit.client.1.smithi156.stdout:8/700: dwrite d5/d9/d36/de8/df3/fd3 [0,4194304] 0 2024-04-23T14:50:04.560 INFO:tasks.workunit.client.1.smithi156.stdout:8/701: fdatasync d5/d9/d36/d60/db8/ddd/de1/fb6 0 2024-04-23T14:50:04.560 INFO:tasks.workunit.client.1.smithi156.stdout:2/714: dwrite d4/d13/d19/d58/f7e [0,4194304] 0 2024-04-23T14:50:04.560 INFO:tasks.workunit.client.1.smithi156.stdout:8/702: symlink d5/d9/d36/d9c/lfa 0 2024-04-23T14:50:04.561 INFO:tasks.workunit.client.0.smithi081.stdout:3/975: creat d4/d7/df/d30/d112/f13f x:0 0 0 2024-04-23T14:50:04.562 INFO:tasks.workunit.client.1.smithi156.stdout:2/715: mknod d4/d13/d19/d4c/d5c/dd5/c100 0 2024-04-23T14:50:04.563 INFO:tasks.workunit.client.1.smithi156.stdout:2/716: fsync d4/d13/d19/fd3 0 2024-04-23T14:50:04.565 INFO:tasks.workunit.client.1.smithi156.stdout:9/617: dwrite d1/d2/d23/f27 [0,4194304] 0 2024-04-23T14:50:04.565 INFO:tasks.workunit.client.1.smithi156.stdout:9/618: truncate d1/d2/d3e/fb4 974903 0 2024-04-23T14:50:04.566 INFO:tasks.workunit.client.0.smithi081.stdout:3/976: link d4/leb d4/d7/df/d30/d64/d83/l140 0 2024-04-23T14:50:04.566 INFO:tasks.workunit.client.0.smithi081.stdout:3/977: chown d4/d7/d7f/d85/d9d/dac/dc7/dd3/df0 588556 1 2024-04-23T14:50:04.566 INFO:tasks.workunit.client.0.smithi081.stdout:3/978: write d4/f6 [1040616,36751] 0 2024-04-23T14:50:04.566 INFO:tasks.workunit.client.1.smithi156.stdout:2/717: creat d4/d13/d19/de8/f101 x:0 0 0 2024-04-23T14:50:04.569 INFO:tasks.workunit.client.1.smithi156.stdout:5/729: dread d1/d3/d24/da0/f3c [0,4194304] 0 2024-04-23T14:50:04.570 INFO:tasks.workunit.client.1.smithi156.stdout:5/730: creat d1/d3/d64/fe4 x:0 0 0 2024-04-23T14:50:04.570 INFO:tasks.workunit.client.1.smithi156.stdout:5/731: write d1/d11/fae [1652989,127649] 0 2024-04-23T14:50:04.574 INFO:tasks.workunit.client.1.smithi156.stdout:7/763: dread dc/d1d/d24/d5a/faa [0,4194304] 0 2024-04-23T14:50:04.579 INFO:tasks.workunit.client.1.smithi156.stdout:1/734: dwrite db/d1f/d2d/d48/daf/d68/fb7 [0,4194304] 0 2024-04-23T14:50:04.605 INFO:tasks.workunit.client.1.smithi156.stdout:3/660: dwrite d4/db/dd/d1d/d1e/d13/d5a/dab/fb2 [0,4194304] 0 2024-04-23T14:50:04.624 INFO:tasks.workunit.client.1.smithi156.stdout:9/619: symlink d1/d2/d23/d49/d4c/ld0 0 2024-04-23T14:50:04.625 INFO:tasks.workunit.client.1.smithi156.stdout:0/725: write d0/d16/dbf/f4b [1131266,8130] 0 2024-04-23T14:50:04.625 INFO:tasks.workunit.client.1.smithi156.stdout:0/726: fdatasync d0/d4/d22/d58/fd0 0 2024-04-23T14:50:04.627 INFO:tasks.workunit.client.1.smithi156.stdout:2/718: creat d4/f102 x:0 0 0 2024-04-23T14:50:04.628 INFO:tasks.workunit.client.0.smithi081.stdout:3/979: truncate d4/d7/f8a 713984 0 2024-04-23T14:50:04.628 INFO:tasks.workunit.client.0.smithi081.stdout:3/980: dread - d4/d7/d49/d51/d84/f101 zero size 2024-04-23T14:50:04.633 INFO:tasks.workunit.client.1.smithi156.stdout:5/732: symlink d1/d11/d18/d19/d9a/dbe/le5 0 2024-04-23T14:50:04.641 INFO:tasks.workunit.client.1.smithi156.stdout:4/670: dwrite d0/df/d55/f2e [0,4194304] 0 2024-04-23T14:50:04.644 INFO:tasks.workunit.client.0.smithi081.stdout:7/990: dwrite d3/d11/d2c/d75/d8e/f12b [0,4194304] 0 2024-04-23T14:50:04.648 INFO:tasks.workunit.client.1.smithi156.stdout:1/735: creat db/d1f/d94/da1/fe6 x:0 0 0 2024-04-23T14:50:04.650 INFO:tasks.workunit.client.0.smithi081.stdout:3/981: dread d4/d7/d32/f3e [0,4194304] 0 2024-04-23T14:50:04.651 INFO:tasks.workunit.client.0.smithi081.stdout:3/982: read d4/d7/d32/da6/dc4/df7/f111 [5850,3139] 0 2024-04-23T14:50:04.651 INFO:tasks.workunit.client.0.smithi081.stdout:7/991: creat d3/d21/d41/dbb/d139/d14c/d4c/f160 x:0 0 0 2024-04-23T14:50:04.652 INFO:tasks.workunit.client.1.smithi156.stdout:0/727: dread d0/fdd [0,4194304] 0 2024-04-23T14:50:04.655 INFO:tasks.workunit.client.1.smithi156.stdout:3/661: write d4/db/dd/d1d/d1e/d13/f79 [1144651,114176] 0 2024-04-23T14:50:04.655 INFO:tasks.workunit.client.1.smithi156.stdout:2/719: dread d4/d21/d42/da1/ddf/ff3 [0,4194304] 0 2024-04-23T14:50:04.656 INFO:tasks.workunit.client.1.smithi156.stdout:2/720: write d4/d13/d19/d4c/d5c/ffd [237944,90031] 0 2024-04-23T14:50:04.659 INFO:tasks.workunit.client.1.smithi156.stdout:7/764: read dc/d2c/f8c [729235,74280] 0 2024-04-23T14:50:04.666 INFO:tasks.workunit.client.1.smithi156.stdout:0/728: dread d0/d16/d3a/d1e/f40 [0,4194304] 0 2024-04-23T14:50:04.667 INFO:tasks.workunit.client.0.smithi081.stdout:7/992: rename d3/d21/d31/d110/d116/c14d to d3/d21/d31/d110/d116/c161 0 2024-04-23T14:50:04.667 INFO:tasks.workunit.client.0.smithi081.stdout:7/993: chown d3/d21/d41/da3 1 1 2024-04-23T14:50:04.667 INFO:tasks.workunit.client.0.smithi081.stdout:7/994: chown d3/d97/fa5 44186232 1 2024-04-23T14:50:04.673 INFO:tasks.workunit.client.0.smithi081.stdout:7/995: unlink d3/d21/d41/d7c/dc3/d7f/f10d 0 2024-04-23T14:50:04.682 INFO:tasks.workunit.client.1.smithi156.stdout:8/703: dwrite d5/d9/d36/d84/f8f [0,4194304] 0 2024-04-23T14:50:04.685 INFO:tasks.workunit.client.1.smithi156.stdout:3/662: rename d4/db/d4b/l58 to d4/db/dd/d1d/d1e/d42/ld6 0 2024-04-23T14:50:04.685 INFO:tasks.workunit.client.1.smithi156.stdout:3/663: fdatasync d4/db/dd/d1d/d1e/d13/d5a/dab/fb2 0 2024-04-23T14:50:04.687 INFO:tasks.workunit.client.1.smithi156.stdout:7/765: creat dc/d1d/d24/dd5/ff2 x:0 0 0 2024-04-23T14:50:04.687 INFO:tasks.workunit.client.1.smithi156.stdout:7/766: fsync dc/d2c/d68/f75 0 2024-04-23T14:50:04.687 INFO:tasks.workunit.client.1.smithi156.stdout:7/767: write dc/d1d/d24/f49 [4679552,129789] 0 2024-04-23T14:50:04.687 INFO:tasks.workunit.client.1.smithi156.stdout:7/768: write dc/d1d/d48/fdb [401528,105703] 0 2024-04-23T14:50:04.690 INFO:tasks.workunit.client.1.smithi156.stdout:1/736: write db/d1f/f76 [461616,124964] 0 2024-04-23T14:50:04.692 INFO:tasks.workunit.client.1.smithi156.stdout:2/721: dread d4/d26/d3c/fe9 [0,4194304] 0 2024-04-23T14:50:04.692 INFO:tasks.workunit.client.1.smithi156.stdout:8/704: dread d5/d9/d5a/d57/fa6 [0,4194304] 0 2024-04-23T14:50:04.694 INFO:tasks.workunit.client.1.smithi156.stdout:3/664: creat d4/db/dd/d1d/d1e/d74/d90/fd7 x:0 0 0 2024-04-23T14:50:04.694 INFO:tasks.workunit.client.1.smithi156.stdout:3/665: dread - d4/db/dd/d1d/d1e/d42/d76/fb0 zero size 2024-04-23T14:50:04.694 INFO:tasks.workunit.client.1.smithi156.stdout:3/666: truncate d4/db/dd/d1d/d1e/d42/d76/fb0 255164 0 2024-04-23T14:50:04.694 INFO:tasks.workunit.client.1.smithi156.stdout:7/769: symlink dc/d1d/dba/dd4/lf3 0 2024-04-23T14:50:04.696 INFO:tasks.workunit.client.1.smithi156.stdout:1/737: mkdir db/d1f/d28/de7 0 2024-04-23T14:50:04.697 INFO:tasks.workunit.client.1.smithi156.stdout:5/733: write d1/d11/f29 [3501365,30965] 0 2024-04-23T14:50:04.697 INFO:tasks.workunit.client.1.smithi156.stdout:2/722: mknod d4/d13/d19/d58/c103 0 2024-04-23T14:50:04.697 INFO:tasks.workunit.client.1.smithi156.stdout:2/723: stat d4/d21/d42/f5e 0 2024-04-23T14:50:04.698 INFO:tasks.workunit.client.1.smithi156.stdout:0/729: dread d0/d4/d22/d58/d9a/f6f [0,4194304] 0 2024-04-23T14:50:04.698 INFO:tasks.workunit.client.1.smithi156.stdout:0/730: read - d0/d16/d3a/d1e/f77 zero size 2024-04-23T14:50:04.698 INFO:tasks.workunit.client.1.smithi156.stdout:0/731: write d0/d16/d43/fbb [5089319,62758] 0 2024-04-23T14:50:04.699 INFO:tasks.workunit.client.1.smithi156.stdout:9/620: dwrite d1/d2/d3e/d50/d7a/d17/d1f/f87 [0,4194304] 0 2024-04-23T14:50:04.701 INFO:tasks.workunit.client.1.smithi156.stdout:8/705: symlink d5/d9/d36/d9c/lfb 0 2024-04-23T14:50:04.701 INFO:tasks.workunit.client.1.smithi156.stdout:8/706: read - d5/d9/d10/d1d/d21/fec zero size 2024-04-23T14:50:04.701 INFO:tasks.workunit.client.1.smithi156.stdout:3/667: fsync d4/db/dd/d1d/d1e/d74/d93/dc4/fcb 0 2024-04-23T14:50:04.701 INFO:tasks.workunit.client.1.smithi156.stdout:7/770: truncate dc/d93/d6c/d88/fc1 4176499 0 2024-04-23T14:50:04.701 INFO:tasks.workunit.client.1.smithi156.stdout:7/771: creat dc/ff4 x:0 0 0 2024-04-23T14:50:04.701 INFO:tasks.workunit.client.1.smithi156.stdout:7/772: chown dc/d1d/d48/da6/ce0 1 1 2024-04-23T14:50:04.702 INFO:tasks.workunit.client.1.smithi156.stdout:1/738: truncate db/d1f/d28/f44 3696357 0 2024-04-23T14:50:04.702 INFO:tasks.workunit.client.1.smithi156.stdout:1/739: chown db/d1f/d28/l31 0 1 2024-04-23T14:50:04.714 INFO:tasks.workunit.client.1.smithi156.stdout:5/734: dread d1/d17/f1a [0,4194304] 0 2024-04-23T14:50:04.714 INFO:tasks.workunit.client.1.smithi156.stdout:5/735: chown d1/d17/f2e 29 1 2024-04-23T14:50:04.715 INFO:tasks.workunit.client.1.smithi156.stdout:5/736: read d1/d11/f13 [389178,96036] 0 2024-04-23T14:50:04.720 INFO:tasks.workunit.client.1.smithi156.stdout:0/732: write d0/d16/d3a/d2a/d1d/d2d/f73 [857730,60286] 0 2024-04-23T14:50:04.721 INFO:tasks.workunit.client.1.smithi156.stdout:7/773: symlink dc/d1d/lf5 0 2024-04-23T14:50:04.723 INFO:tasks.workunit.client.1.smithi156.stdout:1/740: unlink db/d25/d30/d38/d40/cd6 0 2024-04-23T14:50:04.723 INFO:tasks.workunit.client.1.smithi156.stdout:1/741: chown db/d1f/d2f 3009 1 2024-04-23T14:50:04.723 INFO:tasks.workunit.client.1.smithi156.stdout:5/737: mknod d1/d11/d18/d19/ce6 0 2024-04-23T14:50:04.723 INFO:tasks.workunit.client.1.smithi156.stdout:5/738: readlink d1/l45 0 2024-04-23T14:50:04.726 INFO:tasks.workunit.client.1.smithi156.stdout:7/774: link dc/d93/d6c/d88/l69 dc/d46/d58/lf6 0 2024-04-23T14:50:04.727 INFO:tasks.workunit.client.1.smithi156.stdout:8/707: dread d5/d9/d5a/f54 [0,4194304] 0 2024-04-23T14:50:04.727 INFO:tasks.workunit.client.1.smithi156.stdout:8/708: creat d5/d39/ffc x:0 0 0 2024-04-23T14:50:04.730 INFO:tasks.workunit.client.1.smithi156.stdout:9/621: dread d1/f51 [0,4194304] 0 2024-04-23T14:50:04.731 INFO:tasks.workunit.client.1.smithi156.stdout:1/742: mkdir db/de8 0 2024-04-23T14:50:04.737 INFO:tasks.workunit.client.0.smithi081.stdout:3/983: dwrite d4/d7/d7f/d91/f103 [0,4194304] 0 2024-04-23T14:50:04.737 INFO:tasks.workunit.client.0.smithi081.stdout:3/984: stat d4/d7/d32/da6/dc4/df7/f111 0 2024-04-23T14:50:04.737 INFO:tasks.workunit.client.0.smithi081.stdout:3/985: write d4/d7/d32/db0/db5/fea [1742830,76927] 0 2024-04-23T14:50:04.748 INFO:tasks.workunit.client.1.smithi156.stdout:7/775: read dc/d2a/f92 [1367896,3338] 0 2024-04-23T14:50:04.748 INFO:tasks.workunit.client.1.smithi156.stdout:7/776: chown dc/d1d/d24/d5a/f76 3 1 2024-04-23T14:50:04.748 INFO:tasks.workunit.client.1.smithi156.stdout:7/777: chown dc/c79 18285 1 2024-04-23T14:50:04.748 INFO:tasks.workunit.client.1.smithi156.stdout:5/739: truncate d1/d11/de0/f6c 1670638 0 2024-04-23T14:50:04.748 INFO:tasks.workunit.client.1.smithi156.stdout:5/740: chown d1/d3 6560942 1 2024-04-23T14:50:04.748 INFO:tasks.workunit.client.1.smithi156.stdout:8/709: link d5/d39/f9e d5/d9/d36/d60/db8/ffd 0 2024-04-23T14:50:04.748 INFO:tasks.workunit.client.1.smithi156.stdout:8/710: stat d5/d9/d10/f88 0 2024-04-23T14:50:04.749 INFO:tasks.workunit.client.1.smithi156.stdout:6/779: sync 2024-04-23T14:50:04.749 INFO:tasks.workunit.client.1.smithi156.stdout:6/780: dread - d3/da/f11e zero size 2024-04-23T14:50:04.749 INFO:tasks.workunit.client.1.smithi156.stdout:6/781: chown d3/da/d1d 13779 1 2024-04-23T14:50:04.749 INFO:tasks.workunit.client.1.smithi156.stdout:9/622: mkdir d1/d2/d3e/dd1 0 2024-04-23T14:50:04.749 INFO:tasks.workunit.client.1.smithi156.stdout:9/623: creat d1/d2/d3e/d80/fd2 x:0 0 0 2024-04-23T14:50:04.749 INFO:tasks.workunit.client.1.smithi156.stdout:9/624: fsync d1/d2/d3e/d80/f9b 0 2024-04-23T14:50:04.750 INFO:tasks.workunit.client.1.smithi156.stdout:1/743: rmdir db/d1f/d2d/d85 39 2024-04-23T14:50:04.754 INFO:tasks.workunit.client.1.smithi156.stdout:7/778: mknod dc/d2c/d68/cf7 0 2024-04-23T14:50:04.754 INFO:tasks.workunit.client.1.smithi156.stdout:5/741: creat d1/d11/d18/fe7 x:0 0 0 2024-04-23T14:50:04.757 INFO:tasks.workunit.client.1.smithi156.stdout:9/625: symlink d1/d2/d3e/ld3 0 2024-04-23T14:50:04.759 INFO:tasks.workunit.client.0.smithi081.stdout:7/996: dwrite d3/d20/dc9/f12d [4194304,4194304] 0 2024-04-23T14:50:04.759 INFO:tasks.workunit.client.0.smithi081.stdout:7/997: fsync d3/d21/d31/d50/fa7 0 2024-04-23T14:50:04.760 INFO:tasks.workunit.client.1.smithi156.stdout:2/724: dwrite d4/d21/d76/fcb [0,4194304] 0 2024-04-23T14:50:04.764 INFO:tasks.workunit.client.1.smithi156.stdout:8/711: symlink d5/d9/d36/d60/d7c/lfe 0 2024-04-23T14:50:04.764 INFO:tasks.workunit.client.1.smithi156.stdout:1/744: unlink db/d1f/l83 0 2024-04-23T14:50:04.764 INFO:tasks.workunit.client.1.smithi156.stdout:3/668: dwrite d4/db/dd/d1d/d1e/d13/f41 [0,4194304] 0 2024-04-23T14:50:04.764 INFO:tasks.workunit.client.1.smithi156.stdout:9/626: truncate d1/d2/d3e/d50/d7a/d17/d1f/f87 3420048 0 2024-04-23T14:50:04.765 INFO:tasks.workunit.client.0.smithi081.stdout:7/998: mkdir d3/d11/d2c/d75/d8e/dea/d162 0 2024-04-23T14:50:04.770 INFO:tasks.workunit.client.0.smithi081.stdout:7/999: mkdir d3/d163 0 2024-04-23T14:50:04.771 INFO:tasks.workunit.client.1.smithi156.stdout:1/745: mknod db/d1f/d2d/ce9 0 2024-04-23T14:50:04.772 INFO:tasks.workunit.client.1.smithi156.stdout:0/733: dwrite d0/d16/d3a/d2a/f99 [0,4194304] 0 2024-04-23T14:50:04.776 INFO:tasks.workunit.client.1.smithi156.stdout:6/782: dread d3/d16/f76 [0,4194304] 0 2024-04-23T14:50:04.777 INFO:tasks.workunit.client.1.smithi156.stdout:5/742: write d1/fc0 [4002491,40445] 0 2024-04-23T14:50:04.785 INFO:tasks.workunit.client.1.smithi156.stdout:3/669: rename d4/db/dd/d1d/d1e/d74/d93/laf to d4/db/dd/d1d/d1e/d13/d5a/dab/ld8 0 2024-04-23T14:50:04.786 INFO:tasks.workunit.client.1.smithi156.stdout:9/627: creat d1/fd4 x:0 0 0 2024-04-23T14:50:04.787 INFO:tasks.workunit.client.1.smithi156.stdout:8/712: dread d5/d9/d10/d1d/d21/f37 [0,4194304] 0 2024-04-23T14:50:04.790 INFO:tasks.workunit.client.1.smithi156.stdout:6/783: creat d3/da/d74/d93/dc3/f11f x:0 0 0 2024-04-23T14:50:04.791 INFO:tasks.workunit.client.1.smithi156.stdout:5/743: unlink d1/d17/c4a 0 2024-04-23T14:50:04.791 INFO:tasks.workunit.client.1.smithi156.stdout:8/713: symlink d5/d9/d36/d60/db8/ddd/de1/lff 0 2024-04-23T14:50:04.793 INFO:tasks.workunit.client.1.smithi156.stdout:6/784: unlink d3/d16/f100 0 2024-04-23T14:50:04.793 INFO:tasks.workunit.client.1.smithi156.stdout:6/785: chown d3/da/d1d/d27/d63/f96 10097015 1 2024-04-23T14:50:04.794 INFO:tasks.workunit.client.1.smithi156.stdout:5/744: link d1/d11/d18/fe7 d1/d3/da6/fe8 0 2024-04-23T14:50:04.796 INFO:tasks.workunit.client.1.smithi156.stdout:8/714: unlink d5/d39/d99/f9f 0 2024-04-23T14:50:04.798 INFO:tasks.workunit.client.1.smithi156.stdout:6/786: mkdir d3/da/d1d/d27/dfe/d97/dc8/d120 0 2024-04-23T14:50:04.798 INFO:tasks.workunit.client.1.smithi156.stdout:6/787: chown d3/da/d1d/d27/d63/l10e 469693 1 2024-04-23T14:50:04.799 INFO:tasks.workunit.client.1.smithi156.stdout:1/746: dread db/d25/d30/d38/d40/faa [0,4194304] 0 2024-04-23T14:50:04.802 INFO:tasks.workunit.client.1.smithi156.stdout:1/747: truncate db/d1f/d2d/f36 3050134 0 2024-04-23T14:50:04.802 INFO:tasks.workunit.client.1.smithi156.stdout:1/748: getdents db/d1f/dd1 0 2024-04-23T14:50:04.802 INFO:tasks.workunit.client.1.smithi156.stdout:1/749: chown db/d25/d30/d38/ddc/le1 1416786 1 2024-04-23T14:50:04.802 INFO:tasks.workunit.client.1.smithi156.stdout:1/750: write db/d1f/f76 [119414,60255] 0 2024-04-23T14:50:04.809 INFO:tasks.workunit.client.0.smithi081.stdout:3/986: dwrite d4/d7/df/f35 [0,4194304] 0 2024-04-23T14:50:04.813 INFO:tasks.workunit.client.1.smithi156.stdout:7/779: dwrite dc/d1d/d41/f84 [0,4194304] 0 2024-04-23T14:50:04.813 INFO:tasks.workunit.client.0.smithi081.stdout:3/987: rmdir d4/d7/d7f/d85/d9d/dac/dc7/dd3/df0 39 2024-04-23T14:50:04.814 INFO:tasks.workunit.client.1.smithi156.stdout:4/671: sync 2024-04-23T14:50:04.814 INFO:tasks.workunit.client.1.smithi156.stdout:4/672: write d0/df/d21/f69 [1010441,29846] 0 2024-04-23T14:50:04.815 INFO:tasks.workunit.client.1.smithi156.stdout:7/780: mkdir dc/d46/dca/df8 0 2024-04-23T14:50:04.815 INFO:tasks.workunit.client.1.smithi156.stdout:7/781: getdents dc/d2a 0 2024-04-23T14:50:04.816 INFO:tasks.workunit.client.1.smithi156.stdout:4/673: mkdir d0/df/d55/d68/d53/d91/ddc 0 2024-04-23T14:50:04.817 INFO:tasks.workunit.client.1.smithi156.stdout:4/674: write d0/d8/d1e/d4a/d77/dc1/fd9 [2762385,52959] 0 2024-04-23T14:50:04.817 INFO:tasks.workunit.client.0.smithi081.stdout:3/988: write d4/d41/dc6/f7e [4441352,71496] 0 2024-04-23T14:50:04.817 INFO:tasks.workunit.client.0.smithi081.stdout:3/989: write d4/d7/d32/da6/dc4/df7/d106/f107 [1039883,106326] 0 2024-04-23T14:50:04.818 INFO:tasks.workunit.client.1.smithi156.stdout:7/782: mkdir dc/d46/dca/df9 0 2024-04-23T14:50:04.818 INFO:tasks.workunit.client.1.smithi156.stdout:7/783: truncate dc/d1d/d24/fe9 602460 0 2024-04-23T14:50:04.819 INFO:tasks.workunit.client.0.smithi081.stdout:3/990: rename d4/dc/f125 to d4/d7/d32/da6/dc4/f141 0 2024-04-23T14:50:04.822 INFO:tasks.workunit.client.0.smithi081.stdout:3/991: unlink d4/d7/d7f/d91/lb8 0 2024-04-23T14:50:04.822 INFO:tasks.workunit.client.0.smithi081.stdout:3/992: write d4/d7/d7f/d85/d9d/f63 [5832035,84508] 0 2024-04-23T14:50:04.823 INFO:tasks.workunit.client.1.smithi156.stdout:4/675: creat d0/df/d55/d68/d53/d91/d95/db5/fdd x:0 0 0 2024-04-23T14:50:04.823 INFO:tasks.workunit.client.1.smithi156.stdout:4/676: truncate d0/d8/d1e/d4a/d77/dc1/fd9 3148032 0 2024-04-23T14:50:04.825 INFO:tasks.workunit.client.0.smithi081.stdout:3/993: fsync d4/d7/d7f/d91/fb7 0 2024-04-23T14:50:04.826 INFO:tasks.workunit.client.0.smithi081.stdout:3/994: creat d4/f142 x:0 0 0 2024-04-23T14:50:04.831 INFO:tasks.workunit.client.0.smithi081.stdout:9/955: sync 2024-04-23T14:50:04.883 INFO:tasks.workunit.client.0.smithi081.stdout:3/995: dwrite d4/f17 [0,4194304] 0 2024-04-23T14:50:04.885 INFO:tasks.workunit.client.0.smithi081.stdout:3/996: creat d4/d7/d7f/f143 x:0 0 0 2024-04-23T14:50:04.885 INFO:tasks.workunit.client.0.smithi081.stdout:3/997: getdents d4/d7/d7f/d85/d105 0 2024-04-23T14:50:04.887 INFO:tasks.workunit.client.0.smithi081.stdout:3/998: rmdir d4/d7/d2e/d136 0 2024-04-23T14:50:04.887 INFO:tasks.workunit.client.0.smithi081.stdout:3/999: creat d4/dc/d50/d9a/f144 x:0 0 0 2024-04-23T14:50:04.903 INFO:tasks.workunit.client.1.smithi156.stdout:2/725: dwrite d4/fb0 [0,4194304] 0 2024-04-23T14:50:04.903 INFO:tasks.workunit.client.1.smithi156.stdout:0/734: dwrite d0/d16/d3a/d2a/d1d/d2d/d6b/feb [0,4194304] 0 2024-04-23T14:50:04.903 INFO:tasks.workunit.client.1.smithi156.stdout:2/726: fsync d4/d13/d19/d4c/f68 0 2024-04-23T14:50:04.903 INFO:tasks.workunit.client.1.smithi156.stdout:2/727: fdatasync d4/d21/d76/fdb 0 2024-04-23T14:50:04.903 INFO:tasks.workunit.client.1.smithi156.stdout:2/728: write d4/d13/f95 [238672,46394] 0 2024-04-23T14:50:04.903 INFO:tasks.workunit.client.1.smithi156.stdout:2/729: read d4/d13/f95 [258251,122420] 0 2024-04-23T14:50:04.910 INFO:tasks.workunit.client.1.smithi156.stdout:0/735: mkdir d0/d16/dcd/ded 0 2024-04-23T14:50:04.910 INFO:tasks.workunit.client.1.smithi156.stdout:0/736: chown d0/d16/dbf/d3f/d5f/db2/ce3 183506442 1 2024-04-23T14:50:04.910 INFO:tasks.workunit.client.1.smithi156.stdout:0/737: write d0/d16/d3a/d2a/d1d/d2d/d6b/fc1 [40533,46999] 0 2024-04-23T14:50:04.910 INFO:tasks.workunit.client.1.smithi156.stdout:2/730: mkdir d4/d13/d19/d97/d104 0 2024-04-23T14:50:04.911 INFO:tasks.workunit.client.1.smithi156.stdout:0/738: getdents d0/d4/d22/d58 0 2024-04-23T14:50:04.921 INFO:tasks.workunit.client.1.smithi156.stdout:3/670: read d4/db/fb4 [2994305,61828] 0 2024-04-23T14:50:04.921 INFO:tasks.workunit.client.1.smithi156.stdout:3/671: readlink d4/db/dd/d1d/d1e/d13/d5a/dab/lc9 0 2024-04-23T14:50:04.922 INFO:tasks.workunit.client.1.smithi156.stdout:3/672: stat d4/db/dd/d1d/d1e/d42/ld6 0 2024-04-23T14:50:04.922 INFO:tasks.workunit.client.1.smithi156.stdout:1/751: dwrite db/d1f/d94/da1/fc7 [0,4194304] 0 2024-04-23T14:50:04.922 INFO:tasks.workunit.client.1.smithi156.stdout:1/752: fsync db/d25/d30/d38/f6c 0 2024-04-23T14:50:04.931 INFO:tasks.workunit.client.1.smithi156.stdout:2/731: write d4/d21/d76/fbe [2838512,50661] 0 2024-04-23T14:50:04.931 INFO:tasks.workunit.client.1.smithi156.stdout:2/732: creat d4/d21/d2f/f105 x:0 0 0 2024-04-23T14:50:04.932 INFO:tasks.workunit.client.1.smithi156.stdout:9/628: dwrite d1/d2/d3e/d50/d7a/d40/d35/f7d [0,4194304] 0 2024-04-23T14:50:04.933 INFO:tasks.workunit.client.1.smithi156.stdout:5/745: dwrite d1/d3/d24/da0/f4c [0,4194304] 0 2024-04-23T14:50:04.942 INFO:tasks.workunit.client.1.smithi156.stdout:5/746: mknod d1/d3/d43/ce9 0 2024-04-23T14:50:04.944 INFO:tasks.workunit.client.1.smithi156.stdout:9/629: mknod d1/d2/d3e/d55/d9c/d39/d6c/cd5 0 2024-04-23T14:50:04.945 INFO:tasks.workunit.client.1.smithi156.stdout:5/747: mkdir d1/d3/da6/dea 0 2024-04-23T14:50:04.947 INFO:tasks.workunit.client.1.smithi156.stdout:1/753: read db/d25/d30/d38/f73 [562957,106702] 0 2024-04-23T14:50:04.948 INFO:tasks.workunit.client.1.smithi156.stdout:5/748: creat d1/d3/d24/da0/ddd/feb x:0 0 0 2024-04-23T14:50:04.949 INFO:tasks.workunit.client.1.smithi156.stdout:5/749: chown d1/d11/d18/d52/d85/d96/dd3/cd8 283814983 1 2024-04-23T14:50:04.949 INFO:tasks.workunit.client.1.smithi156.stdout:4/677: dread d0/df/f6b [0,4194304] 0 2024-04-23T14:50:04.949 INFO:tasks.workunit.client.1.smithi156.stdout:4/678: write d0/df/d75/fcb [2692003,11198] 0 2024-04-23T14:50:04.950 INFO:tasks.workunit.client.1.smithi156.stdout:4/679: readlink d0/l1 0 2024-04-23T14:50:04.950 INFO:tasks.workunit.client.1.smithi156.stdout:4/680: fsync d0/f3 0 2024-04-23T14:50:04.950 INFO:tasks.workunit.client.1.smithi156.stdout:4/681: chown d0/d8/d1e 3855841 1 2024-04-23T14:50:04.956 INFO:tasks.workunit.client.1.smithi156.stdout:6/788: dwrite d3/da/d74/d93/fd3 [0,4194304] 0 2024-04-23T14:50:04.964 INFO:tasks.workunit.client.1.smithi156.stdout:5/750: rename d1/d17/f1a to d1/d3/d24/dbc/fec 0 2024-04-23T14:50:04.964 INFO:tasks.workunit.client.1.smithi156.stdout:5/751: write d1/d17/d7e/fa8 [348418,62315] 0 2024-04-23T14:50:04.968 INFO:tasks.workunit.client.1.smithi156.stdout:6/789: creat d3/da/d1d/d27/dfe/d3b/f121 x:0 0 0 2024-04-23T14:50:04.968 INFO:tasks.workunit.client.1.smithi156.stdout:5/752: rmdir d1/d11/d18/d19/d9a/dbe 39 2024-04-23T14:50:04.971 INFO:tasks.workunit.client.1.smithi156.stdout:4/682: write d0/df/d55/f2e [616362,78130] 0 2024-04-23T14:50:04.973 INFO:tasks.workunit.client.1.smithi156.stdout:4/683: mknod d0/df/d55/d68/d53/d9f/cde 0 2024-04-23T14:50:04.975 INFO:tasks.workunit.client.1.smithi156.stdout:4/684: symlink d0/d8/d1e/ldf 0 2024-04-23T14:50:04.977 INFO:tasks.workunit.client.1.smithi156.stdout:3/673: dwrite d4/db/dd/d20/fd5 [4194304,4194304] 0 2024-04-23T14:50:04.977 INFO:tasks.workunit.client.1.smithi156.stdout:4/685: mkdir d0/df/d55/d68/d53/de0 0 2024-04-23T14:50:04.978 INFO:tasks.workunit.client.1.smithi156.stdout:4/686: stat d0/d8/d1e/d4a/f7b 0 2024-04-23T14:50:04.978 INFO:tasks.workunit.client.1.smithi156.stdout:4/687: read d0/df/d55/f3c [807116,11098] 0 2024-04-23T14:50:04.985 INFO:tasks.workunit.client.1.smithi156.stdout:6/790: dread d3/d16/d10b/d77/fb7 [0,4194304] 0 2024-04-23T14:50:04.992 INFO:tasks.workunit.client.1.smithi156.stdout:3/674: rename d4/db/dd/l6b to d4/db/dd/d1d/d61/d8d/d8a/ld9 0 2024-04-23T14:50:04.992 INFO:tasks.workunit.client.1.smithi156.stdout:4/688: mknod d0/df/d55/d68/ce1 0 2024-04-23T14:50:04.993 INFO:tasks.workunit.client.1.smithi156.stdout:4/689: mknod d0/df/d55/d68/d53/d91/d95/ce2 0 2024-04-23T14:50:04.995 INFO:tasks.workunit.client.1.smithi156.stdout:4/690: rename d0/df/f17 to d0/d8/d1e/da0/fe3 0 2024-04-23T14:50:04.995 INFO:tasks.workunit.client.1.smithi156.stdout:4/691: stat d0/df/d55/d68/d85/lb3 0 2024-04-23T14:50:04.997 INFO:tasks.workunit.client.1.smithi156.stdout:4/692: rename d0/d8/d1e/d4a/d77/faf to d0/df/d55/d68/d53/d9f/dcc/fe4 0 2024-04-23T14:50:05.001 INFO:tasks.workunit.client.1.smithi156.stdout:1/754: dwrite db/d1f/d2d/d48/daf/f74 [0,4194304] 0 2024-04-23T14:50:05.007 INFO:tasks.workunit.client.1.smithi156.stdout:5/753: dwrite d1/f7c [0,4194304] 0 2024-04-23T14:50:05.007 INFO:tasks.workunit.client.1.smithi156.stdout:5/754: write d1/d11/d18/d52/d85/d96/dd3/fd6 [132990,13577] 0 2024-04-23T14:50:05.007 INFO:tasks.workunit.client.1.smithi156.stdout:5/755: fdatasync d1/d3/f49 0 2024-04-23T14:50:05.009 INFO:tasks.workunit.client.1.smithi156.stdout:5/756: symlink d1/d11/d18/d52/d85/led 0 2024-04-23T14:50:05.011 INFO:tasks.workunit.client.1.smithi156.stdout:5/757: mknod d1/d11/d18/d52/d85/d96/dd3/cee 0 2024-04-23T14:50:05.017 INFO:tasks.workunit.client.1.smithi156.stdout:7/784: sync 2024-04-23T14:50:05.017 INFO:tasks.workunit.client.1.smithi156.stdout:2/733: sync 2024-04-23T14:50:05.017 INFO:tasks.workunit.client.1.smithi156.stdout:8/715: sync 2024-04-23T14:50:05.017 INFO:tasks.workunit.client.1.smithi156.stdout:8/716: readlink d5/d9/d36/d9c/lfb 0 2024-04-23T14:50:05.017 INFO:tasks.workunit.client.1.smithi156.stdout:8/717: rename d5/d9/d36/d60/db8/d93 to d5/d9/d36/d60/db8/d93/d96/d100 22 2024-04-23T14:50:05.017 INFO:tasks.workunit.client.1.smithi156.stdout:0/739: sync 2024-04-23T14:50:05.017 INFO:tasks.workunit.client.1.smithi156.stdout:8/718: stat d5/d9/d36/db5 0 2024-04-23T14:50:05.017 INFO:tasks.workunit.client.1.smithi156.stdout:2/734: creat d4/d26/f106 x:0 0 0 2024-04-23T14:50:05.017 INFO:tasks.workunit.client.1.smithi156.stdout:8/719: stat d5/d9/d36/db5/d98/fc3 0 2024-04-23T14:50:05.017 INFO:tasks.workunit.client.1.smithi156.stdout:2/735: read d4/f7 [1561695,23660] 0 2024-04-23T14:50:05.017 INFO:tasks.workunit.client.1.smithi156.stdout:0/740: write d0/d16/d3a/d2a/d1d/d2d/f5b [4512931,103755] 0 2024-04-23T14:50:05.017 INFO:tasks.workunit.client.1.smithi156.stdout:9/630: sync 2024-04-23T14:50:05.018 INFO:tasks.workunit.client.1.smithi156.stdout:7/785: mkdir dc/d9d/dfa 0 2024-04-23T14:50:05.020 INFO:tasks.workunit.client.1.smithi156.stdout:0/741: rmdir d0/d16/dbf/d3f/d5f 39 2024-04-23T14:50:05.022 INFO:tasks.workunit.client.1.smithi156.stdout:8/720: rmdir d5/d9/d36/d60/db8/ddd/de1 39 2024-04-23T14:50:05.022 INFO:tasks.workunit.client.1.smithi156.stdout:8/721: chown d5/d39/fe9 20077 1 2024-04-23T14:50:05.026 INFO:tasks.workunit.client.1.smithi156.stdout:9/631: mkdir d1/d2/d3e/d55/d66/dd6 0 2024-04-23T14:50:05.026 INFO:tasks.workunit.client.1.smithi156.stdout:2/736: getdents d4/d21/d42/da1/ddf 0 2024-04-23T14:50:05.026 INFO:tasks.workunit.client.1.smithi156.stdout:9/632: stat d1/d2/d3e/d50/c7e 0 2024-04-23T14:50:05.027 INFO:tasks.workunit.client.1.smithi156.stdout:2/737: readlink d4/d13/d88/l9a 0 2024-04-23T14:50:05.027 INFO:tasks.workunit.client.1.smithi156.stdout:2/738: readlink d4/d13/l50 0 2024-04-23T14:50:05.027 INFO:tasks.workunit.client.1.smithi156.stdout:9/633: truncate d1/d2/d3e/d50/d7a/d17/f54 79573 0 2024-04-23T14:50:05.027 INFO:tasks.workunit.client.1.smithi156.stdout:9/634: truncate d1/d2/d3e/d55/d9c/d39/fcf 758479 0 2024-04-23T14:50:05.027 INFO:tasks.workunit.client.1.smithi156.stdout:3/675: dread d4/db/dd/d1d/d1e/f12 [0,4194304] 0 2024-04-23T14:50:05.027 INFO:tasks.workunit.client.1.smithi156.stdout:8/722: getdents d5/d9/d5a/dc8 0 2024-04-23T14:50:05.027 INFO:tasks.workunit.client.1.smithi156.stdout:8/723: chown d5/d9/d10/f88 4170658 1 2024-04-23T14:50:05.027 INFO:tasks.workunit.client.1.smithi156.stdout:8/724: truncate d5/d39/d99/fa8 89696 0 2024-04-23T14:50:05.028 INFO:tasks.workunit.client.1.smithi156.stdout:2/739: unlink d4/d13/d19/d4c/f91 0 2024-04-23T14:50:05.029 INFO:tasks.workunit.client.1.smithi156.stdout:8/725: rename d5/d39/f64 to d5/d9/d5a/f101 0 2024-04-23T14:50:05.029 INFO:tasks.workunit.client.1.smithi156.stdout:8/726: write d5/d9/d36/d60/db8/ddd/de1/ff0 [890468,105058] 0 2024-04-23T14:50:05.030 INFO:tasks.workunit.client.1.smithi156.stdout:7/786: truncate dc/f1c 1379200 0 2024-04-23T14:50:05.030 INFO:tasks.workunit.client.1.smithi156.stdout:2/740: unlink d4/d21/d42/d75/d79/fc5 0 2024-04-23T14:50:05.031 INFO:tasks.workunit.client.1.smithi156.stdout:2/741: creat d4/d13/d19/de8/f107 x:0 0 0 2024-04-23T14:50:05.032 INFO:tasks.workunit.client.1.smithi156.stdout:7/787: creat dc/d2a/da9/dcf/ffb x:0 0 0 2024-04-23T14:50:05.032 INFO:tasks.workunit.client.1.smithi156.stdout:7/788: stat l3 0 2024-04-23T14:50:05.033 INFO:tasks.workunit.client.1.smithi156.stdout:6/791: dwrite d3/da/d1d/d27/dfe/d3b/f121 [0,4194304] 0 2024-04-23T14:50:05.036 INFO:tasks.workunit.client.1.smithi156.stdout:7/789: mknod dc/cfc 0 2024-04-23T14:50:05.038 INFO:tasks.workunit.client.1.smithi156.stdout:6/792: symlink d3/da/d1d/d59/deb/l122 0 2024-04-23T14:50:05.038 INFO:tasks.workunit.client.1.smithi156.stdout:6/793: chown d3/da/d1d/f67 3694481 1 2024-04-23T14:50:05.048 INFO:tasks.workunit.client.1.smithi156.stdout:2/742: read d4/fba [384145,80425] 0 2024-04-23T14:50:05.050 INFO:tasks.workunit.client.1.smithi156.stdout:8/727: dread d5/d9/d36/d60/db8/ffd [0,4194304] 0 2024-04-23T14:50:05.050 INFO:tasks.workunit.client.1.smithi156.stdout:8/728: dread - d5/d9/d10/d1d/d21/fd2 zero size 2024-04-23T14:50:05.051 INFO:tasks.workunit.client.1.smithi156.stdout:8/729: creat d5/d9/d36/d60/db8/f102 x:0 0 0 2024-04-23T14:50:05.051 INFO:tasks.workunit.client.1.smithi156.stdout:8/730: chown d5/d9/d5a/cf7 1531552 1 2024-04-23T14:50:05.051 INFO:tasks.workunit.client.1.smithi156.stdout:8/731: read - d5/d9/d10/d1d/fb0 zero size 2024-04-23T14:50:05.052 INFO:tasks.workunit.client.1.smithi156.stdout:8/732: read - d5/d9/d36/d84/dc1/dcf/fda zero size 2024-04-23T14:50:05.059 INFO:tasks.workunit.client.1.smithi156.stdout:6/794: dread d3/da/d1d/d27/dfe/d6e/d8f/fc1 [0,4194304] 0 2024-04-23T14:50:05.061 INFO:tasks.workunit.client.1.smithi156.stdout:0/742: dread d0/d16/d43/dc2/f4c [0,4194304] 0 2024-04-23T14:50:05.061 INFO:tasks.workunit.client.1.smithi156.stdout:0/743: chown d0/d4/d22/d58/d9a/d44/de5 64064 1 2024-04-23T14:50:05.061 INFO:tasks.workunit.client.1.smithi156.stdout:0/744: write d0/d16/d3a/d1e/d80/faf [89954,54642] 0 2024-04-23T14:50:05.062 INFO:tasks.workunit.client.1.smithi156.stdout:9/635: read d1/d2/d3e/d55/d6f/fba [2291795,87873] 0 2024-04-23T14:50:05.062 INFO:tasks.workunit.client.1.smithi156.stdout:6/795: unlink d3/d16/d46/d9d/d9f/dad/f9b 0 2024-04-23T14:50:05.065 INFO:tasks.workunit.client.1.smithi156.stdout:2/743: read d4/d21/d42/f89 [56056,3827] 0 2024-04-23T14:50:05.065 INFO:tasks.workunit.client.1.smithi156.stdout:6/796: rename d3/da/d1d/d27/dfe/d6e/f11d to d3/da/d1d/d59/df3/f123 0 2024-04-23T14:50:05.065 INFO:tasks.workunit.client.1.smithi156.stdout:6/797: fdatasync d3/d16/d1e/f52 0 2024-04-23T14:50:05.066 INFO:tasks.workunit.client.1.smithi156.stdout:6/798: stat d3/da/d1d/d59/d72/f104 0 2024-04-23T14:50:05.066 INFO:tasks.workunit.client.1.smithi156.stdout:4/693: dwrite d0/d8/d1e/d4a/d77/dc1/fd9 [0,4194304] 0 2024-04-23T14:50:05.066 INFO:tasks.workunit.client.1.smithi156.stdout:0/745: mknod d0/d16/d3a/d2a/d1d/d2d/d6b/cee 0 2024-04-23T14:50:05.073 INFO:tasks.workunit.client.1.smithi156.stdout:6/799: creat d3/d16/d46/d9d/d9f/dad/dea/f124 x:0 0 0 2024-04-23T14:50:05.078 INFO:tasks.workunit.client.1.smithi156.stdout:5/758: dread d1/d11/d27/f2c [0,4194304] 0 2024-04-23T14:50:05.080 INFO:tasks.workunit.client.1.smithi156.stdout:1/755: dwrite db/d1f/d94/da1/fc7 [0,4194304] 0 2024-04-23T14:50:05.082 INFO:tasks.workunit.client.1.smithi156.stdout:2/744: rename d4/d13/d19/d58/f63 to d4/d13/d19/de8/f108 0 2024-04-23T14:50:05.082 INFO:tasks.workunit.client.1.smithi156.stdout:0/746: unlink d0/d4/d22/d58/d9a/f3e 0 2024-04-23T14:50:05.082 INFO:tasks.workunit.client.1.smithi156.stdout:4/694: symlink d0/d76/d63/le5 0 2024-04-23T14:50:05.082 INFO:tasks.workunit.client.1.smithi156.stdout:4/695: fsync d0/f80 0 2024-04-23T14:50:05.082 INFO:tasks.workunit.client.1.smithi156.stdout:0/747: chown d0/d16/d3a/d2a/d1d/d2d/d6b/f82 47 1 2024-04-23T14:50:05.082 INFO:tasks.workunit.client.1.smithi156.stdout:4/696: readlink d0/d30/l35 0 2024-04-23T14:50:05.082 INFO:tasks.workunit.client.1.smithi156.stdout:4/697: fdatasync d0/d8/d1e/da0/fb8 0 2024-04-23T14:50:05.083 INFO:tasks.workunit.client.1.smithi156.stdout:6/800: symlink d3/d16/d10b/d77/l125 0 2024-04-23T14:50:05.083 INFO:tasks.workunit.client.1.smithi156.stdout:6/801: creat d3/da/d1d/d27/dfe/d6e/f126 x:0 0 0 2024-04-23T14:50:05.091 INFO:tasks.workunit.client.1.smithi156.stdout:6/802: dread d3/da/fa0 [0,4194304] 0 2024-04-23T14:50:05.091 INFO:tasks.workunit.client.1.smithi156.stdout:6/803: chown d3/da/d1d/d27/d80/lbc 6 1 2024-04-23T14:50:05.091 INFO:tasks.workunit.client.1.smithi156.stdout:6/804: stat d3/da/d1d/d27/d63/l68 0 2024-04-23T14:50:05.094 INFO:tasks.workunit.client.1.smithi156.stdout:5/759: dread d1/d11/d18/d52/f7f [0,4194304] 0 2024-04-23T14:50:05.095 INFO:tasks.workunit.client.1.smithi156.stdout:1/756: mknod db/d1f/d2d/d48/dab/cea 0 2024-04-23T14:50:05.095 INFO:tasks.workunit.client.1.smithi156.stdout:2/745: symlink d4/d26/l109 0 2024-04-23T14:50:05.096 INFO:tasks.workunit.client.1.smithi156.stdout:0/748: rmdir d0/d16/d3a/d2a/d5e 39 2024-04-23T14:50:05.096 INFO:tasks.workunit.client.1.smithi156.stdout:4/698: creat d0/df/d55/d68/d85/fe6 x:0 0 0 2024-04-23T14:50:05.100 INFO:tasks.workunit.client.1.smithi156.stdout:7/790: dwrite dc/d2c/d68/f97 [0,4194304] 0 2024-04-23T14:50:05.114 INFO:tasks.workunit.client.1.smithi156.stdout:5/760: creat d1/d11/fef x:0 0 0 2024-04-23T14:50:05.115 INFO:tasks.workunit.client.1.smithi156.stdout:2/746: symlink d4/d13/d19/d4c/d5c/dd5/l10a 0 2024-04-23T14:50:05.115 INFO:tasks.workunit.client.1.smithi156.stdout:5/761: chown d1/d11/d18/d19/ce6 30 1 2024-04-23T14:50:05.115 INFO:tasks.workunit.client.1.smithi156.stdout:0/749: link d0/d16/d3a/d2a/d1d/d2d/la3 d0/d16/dbf/lef 0 2024-04-23T14:50:05.115 INFO:tasks.workunit.client.1.smithi156.stdout:2/747: dread - d4/d13/d19/d4c/d5c/dd5/ff0 zero size 2024-04-23T14:50:05.115 INFO:tasks.workunit.client.1.smithi156.stdout:2/748: fdatasync d4/f29 0 2024-04-23T14:50:05.115 INFO:tasks.workunit.client.1.smithi156.stdout:2/749: dread - d4/d13/d19/d97/fd1 zero size 2024-04-23T14:50:05.115 INFO:tasks.workunit.client.1.smithi156.stdout:2/750: creat d4/d21/d42/da1/f10b x:0 0 0 2024-04-23T14:50:05.115 INFO:tasks.workunit.client.1.smithi156.stdout:2/751: dread - d4/d13/d19/d4c/d5c/fb3 zero size 2024-04-23T14:50:05.122 INFO:tasks.workunit.client.1.smithi156.stdout:4/699: mkdir d0/d8/d1e/da0/de7 0 2024-04-23T14:50:05.122 INFO:tasks.workunit.client.1.smithi156.stdout:7/791: symlink dc/d93/d6c/lfd 0 2024-04-23T14:50:05.122 INFO:tasks.workunit.client.1.smithi156.stdout:7/792: write dc/d2a/fce [338275,69499] 0 2024-04-23T14:50:05.134 INFO:tasks.workunit.client.1.smithi156.stdout:5/762: truncate d1/d11/f4d 947450 0 2024-04-23T14:50:05.134 INFO:tasks.workunit.client.1.smithi156.stdout:0/750: rename d0/d16/d3a/f6a to d0/d16/d43/ff0 0 2024-04-23T14:50:05.134 INFO:tasks.workunit.client.1.smithi156.stdout:4/700: dread d0/d8/d1e/da0/fa7 [0,4194304] 0 2024-04-23T14:50:05.134 INFO:tasks.workunit.client.1.smithi156.stdout:4/701: creat d0/d30/fe8 x:0 0 0 2024-04-23T14:50:05.140 INFO:tasks.workunit.client.1.smithi156.stdout:2/752: creat d4/d26/d3c/dca/f10c x:0 0 0 2024-04-23T14:50:05.140 INFO:tasks.workunit.client.1.smithi156.stdout:2/753: write d4/d13/d19/d4c/f93 [53888,17743] 0 2024-04-23T14:50:05.140 INFO:tasks.workunit.client.1.smithi156.stdout:4/702: symlink d0/d8/d1e/d4a/d77/le9 0 2024-04-23T14:50:05.145 INFO:tasks.workunit.client.1.smithi156.stdout:4/703: creat d0/df/d55/d68/d53/d9f/fea x:0 0 0 2024-04-23T14:50:05.148 INFO:tasks.workunit.client.1.smithi156.stdout:5/763: dread d1/d3/da6/d86/fba [0,4194304] 0 2024-04-23T14:50:05.157 INFO:tasks.workunit.client.1.smithi156.stdout:9/636: dwrite d1/d2/d3e/d50/d7a/d17/d1f/d48/f91 [0,4194304] 0 2024-04-23T14:50:05.159 INFO:tasks.workunit.client.1.smithi156.stdout:0/751: dread d0/d16/f8d [0,4194304] 0 2024-04-23T14:50:05.162 INFO:tasks.workunit.client.1.smithi156.stdout:5/764: mknod d1/d11/d18/d52/d85/d96/dd3/cf0 0 2024-04-23T14:50:05.162 INFO:tasks.workunit.client.1.smithi156.stdout:4/704: getdents d0/df/d21 0 2024-04-23T14:50:05.162 INFO:tasks.workunit.client.1.smithi156.stdout:5/765: creat d1/d3/ff1 x:0 0 0 2024-04-23T14:50:05.164 INFO:tasks.workunit.client.1.smithi156.stdout:4/705: mknod d0/df/d55/d68/d85/dc4/ceb 0 2024-04-23T14:50:05.166 INFO:tasks.workunit.client.1.smithi156.stdout:4/706: mkdir d0/d8/d1e/d4a/d77/dc1/dec 0 2024-04-23T14:50:05.167 INFO:tasks.workunit.client.1.smithi156.stdout:1/757: dwrite db/d1f/d2d/fc5 [0,4194304] 0 2024-04-23T14:50:05.167 INFO:tasks.workunit.client.1.smithi156.stdout:1/758: fsync db/d25/d30/f43 0 2024-04-23T14:50:05.167 INFO:tasks.workunit.client.1.smithi156.stdout:8/733: dwrite d5/d9/d36/d60/db8/ddd/de1/ff0 [0,4194304] 0 2024-04-23T14:50:05.172 INFO:tasks.workunit.client.1.smithi156.stdout:0/752: write d0/d16/d3a/d2a/d1d/d2d/d6b/feb [181386,78383] 0 2024-04-23T14:50:05.173 INFO:tasks.workunit.client.0.smithi081.stdout:9/956: sync 2024-04-23T14:50:05.175 INFO:tasks.workunit.client.0.smithi081.stdout:9/957: symlink d3/de/d1d/d5b/d7b/d90/l13f 0 2024-04-23T14:50:05.176 INFO:tasks.workunit.client.0.smithi081.stdout:9/958: chown d3/de/d1d/d62/d114 0 1 2024-04-23T14:50:05.177 INFO:tasks.workunit.client.0.smithi081.stdout:9/959: getdents d3/d1a 0 2024-04-23T14:50:05.179 INFO:tasks.workunit.client.1.smithi156.stdout:1/759: write db/f11 [90126,6637] 0 2024-04-23T14:50:05.179 INFO:tasks.workunit.client.1.smithi156.stdout:1/760: dread - db/fa5 zero size 2024-04-23T14:50:05.179 INFO:tasks.workunit.client.1.smithi156.stdout:1/761: creat db/d1f/d2d/d48/daf/d68/feb x:0 0 0 2024-04-23T14:50:05.180 INFO:tasks.workunit.client.0.smithi081.stdout:9/960: creat d3/de/d1d/d54/f140 x:0 0 0 2024-04-23T14:50:05.184 INFO:tasks.workunit.client.0.smithi081.stdout:9/961: write d3/fa7 [109476,108140] 0 2024-04-23T14:50:05.185 INFO:tasks.workunit.client.0.smithi081.stdout:9/962: mkdir d3/de/d1d/dcc/d10f/d12e/d141 0 2024-04-23T14:50:05.186 INFO:tasks.workunit.client.1.smithi156.stdout:0/753: write d0/d4/d22/f7f [1128199,22883] 0 2024-04-23T14:50:05.189 INFO:tasks.workunit.client.0.smithi081.stdout:9/963: link d3/de/d1d/d73/fb4 d3/d5/f142 0 2024-04-23T14:50:05.193 INFO:tasks.workunit.client.1.smithi156.stdout:1/762: creat db/d1f/d2d/d48/daf/fec x:0 0 0 2024-04-23T14:50:05.193 INFO:tasks.workunit.client.1.smithi156.stdout:1/763: dread - db/d1f/d2d/d48/daf/fec zero size 2024-04-23T14:50:05.193 INFO:tasks.workunit.client.1.smithi156.stdout:1/764: chown db/d25/d30/l8b 0 1 2024-04-23T14:50:05.193 INFO:tasks.workunit.client.1.smithi156.stdout:1/765: chown db/d1f/l6a 7254664 1 2024-04-23T14:50:05.193 INFO:tasks.workunit.client.1.smithi156.stdout:1/766: write db/d25/d30/d38/f80 [1690267,33456] 0 2024-04-23T14:50:05.193 INFO:tasks.workunit.client.1.smithi156.stdout:6/805: dwrite d3/d16/f85 [0,4194304] 0 2024-04-23T14:50:05.213 INFO:tasks.workunit.client.1.smithi156.stdout:1/767: write db/d1f/d28/f44 [2748612,45613] 0 2024-04-23T14:50:05.230 INFO:tasks.workunit.client.1.smithi156.stdout:4/707: dwrite d0/df/d55/d68/d53/d9f/dcc/fda [0,4194304] 0 2024-04-23T14:50:05.234 INFO:tasks.workunit.client.0.smithi081.stdout:9/964: dwrite d3/de/d14/fea [0,4194304] 0 2024-04-23T14:50:05.234 INFO:tasks.workunit.client.0.smithi081.stdout:9/965: write d3/de/d1d/d54/f9b [4731486,121159] 0 2024-04-23T14:50:05.246 INFO:tasks.workunit.client.1.smithi156.stdout:1/768: dread db/d1f/d2d/fc5 [0,4194304] 0 2024-04-23T14:50:05.246 INFO:tasks.workunit.client.1.smithi156.stdout:1/769: fdatasync db/d1f/d2f/d47/f5f 0 2024-04-23T14:50:05.250 INFO:tasks.workunit.client.1.smithi156.stdout:2/754: dread d4/fb6 [0,4194304] 0 2024-04-23T14:50:05.250 INFO:tasks.workunit.client.1.smithi156.stdout:7/793: dwrite dc/d1d/d24/f4a [4194304,4194304] 0 2024-04-23T14:50:05.270 INFO:tasks.workunit.client.1.smithi156.stdout:8/734: dread d5/d9/f13 [4194304,4194304] 0 2024-04-23T14:50:05.272 INFO:tasks.workunit.client.1.smithi156.stdout:6/806: dread d3/da/fa2 [0,4194304] 0 2024-04-23T14:50:05.272 INFO:tasks.workunit.client.1.smithi156.stdout:6/807: chown d3/da/d1d/d27/dfe/c81 299 1 2024-04-23T14:50:05.274 INFO:tasks.workunit.client.1.smithi156.stdout:0/754: dwrite d0/d16/d3a/d2a/d1d/d2d/d6b/fc1 [0,4194304] 0 2024-04-23T14:50:05.275 INFO:tasks.workunit.client.1.smithi156.stdout:0/755: dread - d0/d16/d3a/d2a/d1d/d2d/fae zero size 2024-04-23T14:50:05.275 INFO:tasks.workunit.client.1.smithi156.stdout:0/756: truncate d0/d16/dbf/d3f/d45/fac 616891 0 2024-04-23T14:50:05.277 INFO:tasks.workunit.client.1.smithi156.stdout:9/637: dwrite d1/d2/d23/fa5 [0,4194304] 0 2024-04-23T14:50:05.277 INFO:tasks.workunit.client.1.smithi156.stdout:9/638: fsync d1/d2/d3e/fb4 0 2024-04-23T14:50:05.284 INFO:tasks.workunit.client.1.smithi156.stdout:8/735: dread d5/d9/d10/d1d/f8e [0,4194304] 0 2024-04-23T14:50:05.285 INFO:tasks.workunit.client.1.smithi156.stdout:9/639: dread d1/d2/d3e/d50/d7a/d17/f82 [0,4194304] 0 2024-04-23T14:50:05.287 INFO:tasks.workunit.client.1.smithi156.stdout:4/708: mknod d0/d30/ced 0 2024-04-23T14:50:05.287 INFO:tasks.workunit.client.1.smithi156.stdout:4/709: write d0/d8/d1e/d4a/d77/fb6 [854556,32415] 0 2024-04-23T14:50:05.289 INFO:tasks.workunit.client.0.smithi081.stdout:9/966: dwrite d3/d1a/f17 [0,4194304] 0 2024-04-23T14:50:05.310 INFO:tasks.workunit.client.1.smithi156.stdout:8/736: dread d5/d9/d36/d60/db8/ffd [0,4194304] 0 2024-04-23T14:50:05.311 INFO:tasks.workunit.client.1.smithi156.stdout:8/737: fsync d5/d9/d36/d84/d8c/faa 0 2024-04-23T14:50:05.311 INFO:tasks.workunit.client.1.smithi156.stdout:8/738: fsync d5/d9/d36/d60/fa5 0 2024-04-23T14:50:05.324 INFO:tasks.workunit.client.1.smithi156.stdout:7/794: dwrite dc/d1d/d24/d5a/f6f [0,4194304] 0 2024-04-23T14:50:05.324 INFO:tasks.workunit.client.1.smithi156.stdout:7/795: write dc/d1d/d24/fac [797033,65894] 0 2024-04-23T14:50:05.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:05 smithi081 ceph-mon[25540]: pgmap v41: 65 pgs: 65 active+clean; 3.1 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 190 MiB/s rd, 220 MiB/s wr, 338 op/s 2024-04-23T14:50:05.357 INFO:tasks.workunit.client.1.smithi156.stdout:1/770: unlink db/d15/l29 0 2024-04-23T14:50:05.358 INFO:tasks.workunit.client.1.smithi156.stdout:1/771: chown db/d25/d30/d38/ddc 2056489 1 2024-04-23T14:50:05.393 INFO:tasks.workunit.client.1.smithi156.stdout:2/755: symlink d4/d13/d19/d4c/d5c/dd5/l10d 0 2024-04-23T14:50:05.393 INFO:tasks.workunit.client.1.smithi156.stdout:2/756: dread - d4/d13/d19/d58/fbf zero size 2024-04-23T14:50:05.397 INFO:tasks.workunit.client.0.smithi081.stdout:9/967: link d3/de/c1b d3/d67/d77/d132/d116/c143 0 2024-04-23T14:50:05.398 INFO:tasks.workunit.client.0.smithi081.stdout:9/968: write d3/de/d1d/d5b/f104 [320080,71959] 0 2024-04-23T14:50:05.398 INFO:tasks.workunit.client.0.smithi081.stdout:9/969: read - d3/de/d1d/d5b/d7b/db2/f12c zero size 2024-04-23T14:50:05.402 INFO:tasks.workunit.client.0.smithi081.stdout:9/970: symlink d3/d67/d77/l144 0 2024-04-23T14:50:05.402 INFO:tasks.workunit.client.0.smithi081.stdout:9/971: dread - d3/de/d1d/d5b/f11a zero size 2024-04-23T14:50:05.406 INFO:tasks.workunit.client.0.smithi081.stdout:9/972: symlink d3/de/d1d/d5b/l145 0 2024-04-23T14:50:05.409 INFO:tasks.workunit.client.1.smithi156.stdout:7/796: dwrite dc/d1d/f35 [0,4194304] 0 2024-04-23T14:50:05.415 INFO:tasks.workunit.client.1.smithi156.stdout:1/772: dwrite db/d25/d30/f43 [0,4194304] 0 2024-04-23T14:50:05.415 INFO:tasks.workunit.client.1.smithi156.stdout:1/773: dread - db/d1f/d2f/f7b zero size 2024-04-23T14:50:05.431 INFO:tasks.workunit.client.0.smithi081.stdout:9/973: dread d3/de/d14/f38 [0,4194304] 0 2024-04-23T14:50:05.431 INFO:tasks.workunit.client.0.smithi081.stdout:9/974: readlink d3/de/d1d/d62/ld8 0 2024-04-23T14:50:05.431 INFO:tasks.workunit.client.0.smithi081.stdout:9/975: fdatasync d3/de/f64 0 2024-04-23T14:50:05.433 INFO:tasks.workunit.client.1.smithi156.stdout:9/640: unlink d1/d2/d3e/d50/d7a/d17/c97 0 2024-04-23T14:50:05.434 INFO:tasks.workunit.client.1.smithi156.stdout:4/710: mknod d0/df/d55/d68/d53/d9f/cee 0 2024-04-23T14:50:05.435 INFO:tasks.workunit.client.1.smithi156.stdout:4/711: chown d0/d76/d63/cc8 295210 1 2024-04-23T14:50:05.435 INFO:tasks.workunit.client.1.smithi156.stdout:8/739: mknod d5/d9/d36/d60/db8/ddd/c103 0 2024-04-23T14:50:05.442 INFO:tasks.workunit.client.1.smithi156.stdout:2/757: mkdir d4/d13/d19/d97/d104/d10e 0 2024-04-23T14:50:05.445 INFO:tasks.workunit.client.0.smithi081.stdout:9/976: dread d3/d67/da5/f10d [0,4194304] 0 2024-04-23T14:50:05.445 INFO:tasks.workunit.client.1.smithi156.stdout:4/712: mkdir d0/df/d55/d68/d53/d91/d95/def 0 2024-04-23T14:50:05.445 INFO:tasks.workunit.client.1.smithi156.stdout:4/713: chown d0/df/d55/d68/d53/d91/fd7 64267810 1 2024-04-23T14:50:05.446 INFO:tasks.workunit.client.1.smithi156.stdout:8/740: symlink d5/d9/d36/d84/dc1/l104 0 2024-04-23T14:50:05.446 INFO:tasks.workunit.client.1.smithi156.stdout:8/741: creat d5/f105 x:0 0 0 2024-04-23T14:50:05.449 INFO:tasks.workunit.client.1.smithi156.stdout:9/641: rmdir d1/d2/d3e/d80 39 2024-04-23T14:50:05.450 INFO:tasks.workunit.client.0.smithi081.stdout:9/977: truncate d3/de/d22/f5d 2539648 0 2024-04-23T14:50:05.454 INFO:tasks.workunit.client.1.smithi156.stdout:8/742: unlink d5/fd4 0 2024-04-23T14:50:05.454 INFO:tasks.workunit.client.1.smithi156.stdout:8/743: truncate d5/d9/d36/de8/df3/f7e 14054 0 2024-04-23T14:50:05.454 INFO:tasks.workunit.client.1.smithi156.stdout:9/642: getdents d1/d2/d3e/d55 0 2024-04-23T14:50:05.455 INFO:tasks.workunit.client.1.smithi156.stdout:4/714: dread d0/df/fa1 [0,4194304] 0 2024-04-23T14:50:05.458 INFO:tasks.workunit.client.0.smithi081.stdout:9/978: dread d3/de/d1d/d5b/d7b/fa6 [0,4194304] 0 2024-04-23T14:50:05.461 INFO:tasks.workunit.client.1.smithi156.stdout:8/744: mknod d5/d9/d10/d1d/d21/df1/c106 0 2024-04-23T14:50:05.461 INFO:tasks.workunit.client.1.smithi156.stdout:9/643: mkdir d1/d2/d3e/d50/d7a/d17/d1f/d48/dd7 0 2024-04-23T14:50:05.461 INFO:tasks.workunit.client.1.smithi156.stdout:4/715: mknod d0/df/d55/d68/d53/de0/cf0 0 2024-04-23T14:50:05.461 INFO:tasks.workunit.client.1.smithi156.stdout:4/716: chown d0/df/d55/d68/d85/c88 16159773 1 2024-04-23T14:50:05.462 INFO:tasks.workunit.client.1.smithi156.stdout:9/644: mkdir d1/d2/d3e/d50/d7a/d40/d35/dd8 0 2024-04-23T14:50:05.465 INFO:tasks.workunit.client.1.smithi156.stdout:9/645: unlink d1/d2/d23/d49/c8b 0 2024-04-23T14:50:05.477 INFO:tasks.workunit.client.1.smithi156.stdout:4/717: rename d0/d30 to d0/df/d55/d68/d53/d9f/dcc/df1 0 2024-04-23T14:50:05.477 INFO:tasks.workunit.client.1.smithi156.stdout:9/646: mknod d1/d2/d3e/d50/d7a/d17/d1f/d48/d4e/cd9 0 2024-04-23T14:50:05.477 INFO:tasks.workunit.client.1.smithi156.stdout:9/647: fdatasync d1/d2/d3e/d50/d7a/d17/d1f/d48/f91 0 2024-04-23T14:50:05.482 INFO:tasks.workunit.client.1.smithi156.stdout:7/797: dwrite dc/d9d/fa2 [0,4194304] 0 2024-04-23T14:50:05.483 INFO:tasks.workunit.client.0.smithi081.stdout:9/979: dread d3/d67/d77/d132/db5/ffa [0,4194304] 0 2024-04-23T14:50:05.485 INFO:tasks.workunit.client.0.smithi081.stdout:9/980: creat d3/de/d1d/d5b/d7b/db2/dd5/f146 x:0 0 0 2024-04-23T14:50:05.486 INFO:tasks.workunit.client.1.smithi156.stdout:9/648: truncate d1/fe 966150 0 2024-04-23T14:50:05.501 INFO:tasks.workunit.client.1.smithi156.stdout:9/649: creat d1/d2/d3e/d50/d7a/d17/fda x:0 0 0 2024-04-23T14:50:05.502 INFO:tasks.workunit.client.1.smithi156.stdout:9/650: creat d1/d2/d23/d49/d4b/fdb x:0 0 0 2024-04-23T14:50:05.507 INFO:tasks.workunit.client.1.smithi156.stdout:9/651: truncate d1/d2/d23/f27 1434621 0 2024-04-23T14:50:05.507 INFO:tasks.workunit.client.1.smithi156.stdout:9/652: write d1/d2/d3e/d50/d7a/d17/fbf [4426541,3867] 0 2024-04-23T14:50:05.507 INFO:tasks.workunit.client.1.smithi156.stdout:9/653: chown d1/d2/d3e/fb4 7642528 1 2024-04-23T14:50:05.507 INFO:tasks.workunit.client.1.smithi156.stdout:9/654: stat d1/d2 0 2024-04-23T14:50:05.507 INFO:tasks.workunit.client.1.smithi156.stdout:3/676: sync 2024-04-23T14:50:05.507 INFO:tasks.workunit.client.1.smithi156.stdout:3/677: dread - d4/db/dd/d1d/d1e/d2b/fc3 zero size 2024-04-23T14:50:05.507 INFO:tasks.workunit.client.1.smithi156.stdout:3/678: write d4/db/dd/d1d/d1e/d13/d5a/f6c [121908,5621] 0 2024-04-23T14:50:05.507 INFO:tasks.workunit.client.1.smithi156.stdout:3/679: dread - d4/db/dd/d1d/d61/f71 zero size 2024-04-23T14:50:05.508 INFO:tasks.workunit.client.1.smithi156.stdout:8/745: dwrite d5/d9/d36/de8/df3/f7b [4194304,4194304] 0 2024-04-23T14:50:05.512 INFO:tasks.workunit.client.1.smithi156.stdout:8/746: getdents d5/d9/d10/d1d/d21 0 2024-04-23T14:50:05.512 INFO:tasks.workunit.client.1.smithi156.stdout:8/747: write d5/d9/d36/d9c/f42 [4599413,18976] 0 2024-04-23T14:50:05.513 INFO:tasks.workunit.client.1.smithi156.stdout:8/748: symlink d5/d9/l107 0 2024-04-23T14:50:05.523 INFO:tasks.workunit.client.1.smithi156.stdout:3/680: symlink d4/db/lda 0 2024-04-23T14:50:05.523 INFO:tasks.workunit.client.1.smithi156.stdout:8/749: rename d5/d9/d36/d9c/f56 to d5/d9/d36/d60/db8/d93/f108 0 2024-04-23T14:50:05.523 INFO:tasks.workunit.client.1.smithi156.stdout:3/681: creat d4/db/dd1/fdb x:0 0 0 2024-04-23T14:50:05.524 INFO:tasks.workunit.client.1.smithi156.stdout:8/750: getdents d5/d9/d36/d84/d8c 0 2024-04-23T14:50:05.525 INFO:tasks.workunit.client.1.smithi156.stdout:3/682: mknod d4/db/dd/d1d/d1e/d42/d76/dba/cdc 0 2024-04-23T14:50:05.528 INFO:tasks.workunit.client.1.smithi156.stdout:6/808: mknod d3/da/d1d/d27/c127 0 2024-04-23T14:50:05.533 INFO:tasks.workunit.client.1.smithi156.stdout:2/758: dwrite d4/d26/fb1 [0,4194304] 0 2024-04-23T14:50:05.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:05 smithi156 ceph-mon[32341]: pgmap v41: 65 pgs: 65 active+clean; 3.1 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 190 MiB/s rd, 220 MiB/s wr, 338 op/s 2024-04-23T14:50:05.543 INFO:tasks.workunit.client.1.smithi156.stdout:0/757: symlink d0/d16/lf1 0 2024-04-23T14:50:05.543 INFO:tasks.workunit.client.1.smithi156.stdout:0/758: readlink d0/d16/d43/l4f 0 2024-04-23T14:50:05.543 INFO:tasks.workunit.client.1.smithi156.stdout:0/759: write d0/fcc [754032,26194] 0 2024-04-23T14:50:05.544 INFO:tasks.workunit.client.1.smithi156.stdout:6/809: write d3/da/f4f [127035,22277] 0 2024-04-23T14:50:05.544 INFO:tasks.workunit.client.1.smithi156.stdout:6/810: write d3/d16/f85 [4970413,67218] 0 2024-04-23T14:50:05.545 INFO:tasks.workunit.client.1.smithi156.stdout:0/760: link d0/d16/d43/fbb d0/d4/d22/d58/d9a/ff2 0 2024-04-23T14:50:05.548 INFO:tasks.workunit.client.1.smithi156.stdout:6/811: creat d3/da/d1d/d27/d80/da5/f128 x:0 0 0 2024-04-23T14:50:05.550 INFO:tasks.workunit.client.0.smithi081.stdout:9/981: rmdir d3/de/d1d/d5b/d7b/db2/dd5 39 2024-04-23T14:50:05.553 INFO:tasks.workunit.client.1.smithi156.stdout:2/759: write d4/d21/d42/d9f/fb8 [2601420,43549] 0 2024-04-23T14:50:05.553 INFO:tasks.workunit.client.1.smithi156.stdout:2/760: chown d4/l12 501336054 1 2024-04-23T14:50:05.553 INFO:tasks.workunit.client.1.smithi156.stdout:6/812: rename d3/d16/f76 to d3/da/d1d/d27/dfe/d97/dc8/f129 0 2024-04-23T14:50:05.557 INFO:tasks.workunit.client.1.smithi156.stdout:7/798: dwrite dc/ff4 [0,4194304] 0 2024-04-23T14:50:05.557 INFO:tasks.workunit.client.1.smithi156.stdout:7/799: chown dc/d2c/dbe/dc2 10523 1 2024-04-23T14:50:05.560 INFO:tasks.workunit.client.0.smithi081.stdout:9/982: rmdir d3/de/d1d/d62/d114 0 2024-04-23T14:50:05.560 INFO:tasks.workunit.client.0.smithi081.stdout:9/983: dread - d3/f107 zero size 2024-04-23T14:50:05.561 INFO:tasks.workunit.client.0.smithi081.stdout:9/984: chown d3/de/d47/cf1 329200 1 2024-04-23T14:50:05.563 INFO:tasks.workunit.client.1.smithi156.stdout:2/761: unlink d4/d13/d19/d4c/d5c/fb3 0 2024-04-23T14:50:05.563 INFO:tasks.workunit.client.1.smithi156.stdout:2/762: creat d4/d13/d19/d4c/d5c/f10f x:0 0 0 2024-04-23T14:50:05.563 INFO:tasks.workunit.client.1.smithi156.stdout:2/763: chown d4/d21/d42/f6e 7 1 2024-04-23T14:50:05.564 INFO:tasks.workunit.client.1.smithi156.stdout:7/800: dread dc/d1d/d24/fe9 [0,4194304] 0 2024-04-23T14:50:05.567 INFO:tasks.workunit.client.1.smithi156.stdout:6/813: rename d3/d16/d46/d9d/d9f/ff0 to d3/da/d1d/d27/dfe/d6e/d8f/f12a 0 2024-04-23T14:50:05.580 INFO:tasks.workunit.client.1.smithi156.stdout:2/764: rmdir d4/d13/d19/d4c/d5c/dd5 39 2024-04-23T14:50:05.582 INFO:tasks.workunit.client.1.smithi156.stdout:5/766: sync 2024-04-23T14:50:05.582 INFO:tasks.workunit.client.1.smithi156.stdout:6/814: write d3/d16/d46/d9d/fbe [1573154,108547] 0 2024-04-23T14:50:05.583 INFO:tasks.workunit.client.1.smithi156.stdout:5/767: write d1/d11/fef [310687,110641] 0 2024-04-23T14:50:05.585 INFO:tasks.workunit.client.1.smithi156.stdout:6/815: truncate d3/da/d1d/d27/dfe/d3b/d9e/fda 12919 0 2024-04-23T14:50:05.588 INFO:tasks.workunit.client.1.smithi156.stdout:6/816: getdents d3/da/d1d/d59/d72 0 2024-04-23T14:50:05.588 INFO:tasks.workunit.client.1.smithi156.stdout:6/817: stat d3/da/d1d/d27/f31 0 2024-04-23T14:50:05.590 INFO:tasks.workunit.client.1.smithi156.stdout:6/818: getdents d3/d16/d46/d9d/d9f/dad/dcd/de6 0 2024-04-23T14:50:05.590 INFO:tasks.workunit.client.1.smithi156.stdout:7/801: dread dc/d1d/d41/f3d [0,4194304] 0 2024-04-23T14:50:05.590 INFO:tasks.workunit.client.1.smithi156.stdout:7/802: creat dc/d2c/dbe/dc2/ffe x:0 0 0 2024-04-23T14:50:05.590 INFO:tasks.workunit.client.1.smithi156.stdout:6/819: mknod d3/d16/d46/d9d/d9f/c12b 0 2024-04-23T14:50:05.592 INFO:tasks.workunit.client.1.smithi156.stdout:0/761: dwrite d0/d16/d3a/d1e/f3d [0,4194304] 0 2024-04-23T14:50:05.593 INFO:tasks.workunit.client.1.smithi156.stdout:7/803: mknod dc/d46/d58/cff 0 2024-04-23T14:50:05.595 INFO:tasks.workunit.client.1.smithi156.stdout:7/804: getdents dc/d1d/d24/d5a/dd0 0 2024-04-23T14:50:05.598 INFO:tasks.workunit.client.1.smithi156.stdout:4/718: dwrite d0/df/d55/d68/d53/d9f/fbf [0,4194304] 0 2024-04-23T14:50:05.609 INFO:tasks.workunit.client.1.smithi156.stdout:4/719: rmdir d0/d8/d1e 39 2024-04-23T14:50:05.612 INFO:tasks.workunit.client.1.smithi156.stdout:4/720: rename d0/df/f25 to d0/df/d55/d68/d53/d91/d95/ff2 0 2024-04-23T14:50:05.612 INFO:tasks.workunit.client.1.smithi156.stdout:4/721: write d0/df/d55/d68/d53/d91/d95/fba [8034,43995] 0 2024-04-23T14:50:05.612 INFO:tasks.workunit.client.1.smithi156.stdout:4/722: write d0/df/f64 [2654067,88438] 0 2024-04-23T14:50:05.636 INFO:tasks.workunit.client.1.smithi156.stdout:4/723: dread d0/df/d55/d68/f38 [0,4194304] 0 2024-04-23T14:50:05.646 INFO:tasks.workunit.client.1.smithi156.stdout:2/765: dwrite d4/f24 [0,4194304] 0 2024-04-23T14:50:05.646 INFO:tasks.workunit.client.1.smithi156.stdout:2/766: chown d4/d13/d19/d97/d104/d10e 903108322 1 2024-04-23T14:50:05.646 INFO:tasks.workunit.client.1.smithi156.stdout:2/767: stat d4/d21 0 2024-04-23T14:50:05.646 INFO:tasks.workunit.client.1.smithi156.stdout:2/768: stat d4/d21/d42/f4e 0 2024-04-23T14:50:05.648 INFO:tasks.workunit.client.1.smithi156.stdout:2/769: mkdir d4/d21/d42/d75/d110 0 2024-04-23T14:50:05.650 INFO:tasks.workunit.client.1.smithi156.stdout:2/770: creat d4/d21/f111 x:0 0 0 2024-04-23T14:50:05.658 INFO:tasks.workunit.client.1.smithi156.stdout:8/751: dwrite d5/d9/d36/d9c/f42 [0,4194304] 0 2024-04-23T14:50:05.661 INFO:tasks.workunit.client.1.smithi156.stdout:8/752: creat d5/d9/d36/d60/db8/db7/f109 x:0 0 0 2024-04-23T14:50:05.665 INFO:tasks.workunit.client.1.smithi156.stdout:8/753: link d5/d9/d36/d84/fab d5/d9/d5a/d5c/f10a 0 2024-04-23T14:50:05.667 INFO:tasks.workunit.client.1.smithi156.stdout:8/754: unlink d5/d39/d99/ff2 0 2024-04-23T14:50:05.667 INFO:tasks.workunit.client.1.smithi156.stdout:5/768: dwrite d1/d11/d18/f9f [12582912,4194304] 0 2024-04-23T14:50:05.675 INFO:tasks.workunit.client.1.smithi156.stdout:8/755: rename d5/d9/f13 to d5/d9/d36/d60/db8/db7/f10b 0 2024-04-23T14:50:05.675 INFO:tasks.workunit.client.1.smithi156.stdout:5/769: creat d1/d11/d18/d19/d9a/ff2 x:0 0 0 2024-04-23T14:50:05.682 INFO:tasks.workunit.client.1.smithi156.stdout:6/820: dwrite d3/d16/d46/d9d/d9f/dad/f112 [0,4194304] 0 2024-04-23T14:50:05.683 INFO:tasks.workunit.client.1.smithi156.stdout:6/821: rmdir d3/da/d74 39 2024-04-23T14:50:05.700 INFO:tasks.workunit.client.1.smithi156.stdout:7/805: dwrite dc/d9d/fc6 [0,4194304] 0 2024-04-23T14:50:05.704 INFO:tasks.workunit.client.1.smithi156.stdout:0/762: dwrite d0/d16/d3a/d1e/f77 [0,4194304] 0 2024-04-23T14:50:05.710 INFO:tasks.workunit.client.1.smithi156.stdout:7/806: rename dc/d1d/d24/dd5/ldf to dc/d2c/dbe/l100 0 2024-04-23T14:50:05.712 INFO:tasks.workunit.client.1.smithi156.stdout:0/763: rename d0/d16/d3a/d2a/d1d/d2d/d6b/c70 to d0/d16/d43/cf3 0 2024-04-23T14:50:05.713 INFO:tasks.workunit.client.1.smithi156.stdout:7/807: mknod dc/d93/c101 0 2024-04-23T14:50:05.713 INFO:tasks.workunit.client.1.smithi156.stdout:4/724: dwrite d0/df/f58 [0,4194304] 0 2024-04-23T14:50:05.715 INFO:tasks.workunit.client.1.smithi156.stdout:2/771: dwrite d4/d13/d19/de8/f107 [0,4194304] 0 2024-04-23T14:50:05.715 INFO:tasks.workunit.client.1.smithi156.stdout:2/772: stat d4/d13/d19/d4c/d5c/dd5/l10a 0 2024-04-23T14:50:05.715 INFO:tasks.workunit.client.1.smithi156.stdout:2/773: chown d4/d13/d19/d58/le3 31857010 1 2024-04-23T14:50:05.715 INFO:tasks.workunit.client.1.smithi156.stdout:2/774: chown d4/l6 55045 1 2024-04-23T14:50:05.717 INFO:tasks.workunit.client.1.smithi156.stdout:1/774: sync 2024-04-23T14:50:05.718 INFO:tasks.workunit.client.1.smithi156.stdout:4/725: creat d0/df/d55/d68/d74/d8b/ff3 x:0 0 0 2024-04-23T14:50:05.721 INFO:tasks.workunit.client.1.smithi156.stdout:2/775: symlink d4/d21/d42/da1/l112 0 2024-04-23T14:50:05.722 INFO:tasks.workunit.client.1.smithi156.stdout:1/775: creat db/d1f/d28/d70/fed x:0 0 0 2024-04-23T14:50:05.722 INFO:tasks.workunit.client.1.smithi156.stdout:1/776: write db/d1f/f76 [68656,87373] 0 2024-04-23T14:50:05.725 INFO:tasks.workunit.client.1.smithi156.stdout:1/777: stat db/d1f/d2d/d48/fd2 0 2024-04-23T14:50:05.725 INFO:tasks.workunit.client.1.smithi156.stdout:1/778: write db/d1f/d28/f44 [176541,79582] 0 2024-04-23T14:50:05.725 INFO:tasks.workunit.client.1.smithi156.stdout:1/779: readlink db/le 0 2024-04-23T14:50:05.726 INFO:tasks.workunit.client.1.smithi156.stdout:4/726: unlink d0/df/d75/l99 0 2024-04-23T14:50:05.726 INFO:tasks.workunit.client.1.smithi156.stdout:4/727: truncate d0/df/d55/d68/f65 4745146 0 2024-04-23T14:50:05.726 INFO:tasks.workunit.client.1.smithi156.stdout:2/776: creat d4/d13/d19/d97/f113 x:0 0 0 2024-04-23T14:50:05.726 INFO:tasks.workunit.client.1.smithi156.stdout:2/777: dread - d4/d13/d19/de8/f101 zero size 2024-04-23T14:50:05.727 INFO:tasks.workunit.client.1.smithi156.stdout:4/728: mkdir d0/df4 0 2024-04-23T14:50:05.727 INFO:tasks.workunit.client.1.smithi156.stdout:4/729: dread - d0/df/d55/d68/d74/d8b/ff3 zero size 2024-04-23T14:50:05.729 INFO:tasks.workunit.client.1.smithi156.stdout:4/730: write d0/df/d55/d68/d53/f7e [4438595,36436] 0 2024-04-23T14:50:05.732 INFO:tasks.workunit.client.1.smithi156.stdout:1/780: dread db/d1f/d2f/d47/d71/fc8 [0,4194304] 0 2024-04-23T14:50:05.740 INFO:tasks.workunit.client.1.smithi156.stdout:5/770: write d1/f7c [1867513,86724] 0 2024-04-23T14:50:05.740 INFO:tasks.workunit.client.1.smithi156.stdout:5/771: write d1/d17/d7e/fc8 [324769,41914] 0 2024-04-23T14:50:05.742 INFO:tasks.workunit.client.1.smithi156.stdout:8/756: dwrite d5/d9/d10/fa2 [0,4194304] 0 2024-04-23T14:50:05.745 INFO:tasks.workunit.client.1.smithi156.stdout:5/772: creat d1/d11/d18/d19/d9a/dce/ff3 x:0 0 0 2024-04-23T14:50:05.745 INFO:tasks.workunit.client.1.smithi156.stdout:5/773: write d1/d11/de0/d97/fdf [765456,60458] 0 2024-04-23T14:50:05.745 INFO:tasks.workunit.client.1.smithi156.stdout:5/774: creat d1/d11/ff4 x:0 0 0 2024-04-23T14:50:05.746 INFO:tasks.workunit.client.1.smithi156.stdout:8/757: mknod d5/d39/d99/c10c 0 2024-04-23T14:50:05.746 INFO:tasks.workunit.client.1.smithi156.stdout:8/758: truncate d5/d39/fe9 598765 0 2024-04-23T14:50:05.747 INFO:tasks.workunit.client.1.smithi156.stdout:2/778: write d4/d21/d76/fcb [1123688,83842] 0 2024-04-23T14:50:05.752 INFO:tasks.workunit.client.1.smithi156.stdout:8/759: symlink d5/d9/d10/l10d 0 2024-04-23T14:50:05.760 INFO:tasks.workunit.client.1.smithi156.stdout:7/808: write dc/f14 [3178371,130356] 0 2024-04-23T14:50:05.760 INFO:tasks.workunit.client.1.smithi156.stdout:7/809: chown dc/d1d/dba/dd4/dd9 8 1 2024-04-23T14:50:05.760 INFO:tasks.workunit.client.1.smithi156.stdout:7/810: dread - dc/d2c/f91 zero size 2024-04-23T14:50:05.760 INFO:tasks.workunit.client.1.smithi156.stdout:7/811: chown dc/d2a/l3f 291641 1 2024-04-23T14:50:05.761 INFO:tasks.workunit.client.1.smithi156.stdout:6/822: dwrite d3/d16/d1e/f7d [0,4194304] 0 2024-04-23T14:50:05.761 INFO:tasks.workunit.client.1.smithi156.stdout:6/823: chown d3/d16/f85 7732309 1 2024-04-23T14:50:05.765 INFO:tasks.workunit.client.1.smithi156.stdout:6/824: mknod d3/da/d1d/d27/dfe/c12c 0 2024-04-23T14:50:05.771 INFO:tasks.workunit.client.1.smithi156.stdout:8/760: write d5/d9/fd [1281636,127903] 0 2024-04-23T14:50:05.775 INFO:tasks.workunit.client.1.smithi156.stdout:8/761: rmdir d5/d9/d36/d84/d8c 39 2024-04-23T14:50:05.775 INFO:tasks.workunit.client.1.smithi156.stdout:8/762: creat d5/d9/d10/d1d/f10e x:0 0 0 2024-04-23T14:50:05.781 INFO:tasks.workunit.client.1.smithi156.stdout:6/825: write d3/d16/d46/d9d/d9f/dad/f106 [183966,109605] 0 2024-04-23T14:50:05.792 INFO:tasks.workunit.client.1.smithi156.stdout:4/731: dwrite d0/df/d55/d68/d53/d91/d95/fba [0,4194304] 0 2024-04-23T14:50:05.802 INFO:tasks.workunit.client.1.smithi156.stdout:4/732: creat d0/d8/d1e/ff5 x:0 0 0 2024-04-23T14:50:05.803 INFO:tasks.workunit.client.1.smithi156.stdout:4/733: stat d0/d8/c56 0 2024-04-23T14:50:05.811 INFO:tasks.workunit.client.1.smithi156.stdout:4/734: symlink d0/df/d55/d68/d53/d9f/lf6 0 2024-04-23T14:50:05.817 INFO:tasks.workunit.client.1.smithi156.stdout:4/735: mknod d0/df/d55/d68/d53/d9f/dcc/cf7 0 2024-04-23T14:50:05.819 INFO:tasks.workunit.client.1.smithi156.stdout:4/736: link d0/df/d21/l6c d0/d8/d1e/d4a/lf8 0 2024-04-23T14:50:05.819 INFO:tasks.workunit.client.1.smithi156.stdout:4/737: stat d0/df/d21/ca6 0 2024-04-23T14:50:05.820 INFO:tasks.workunit.client.1.smithi156.stdout:4/738: readlink d0/df/d75/lca 0 2024-04-23T14:50:05.820 INFO:tasks.workunit.client.1.smithi156.stdout:4/739: chown d0/d8/c15 3386789 1 2024-04-23T14:50:05.821 INFO:tasks.workunit.client.1.smithi156.stdout:4/740: symlink d0/df/d55/d68/d85/lf9 0 2024-04-23T14:50:05.821 INFO:tasks.workunit.client.1.smithi156.stdout:4/741: stat d0/d8/fc 0 2024-04-23T14:50:05.823 INFO:tasks.workunit.client.1.smithi156.stdout:8/763: dwrite d5/d9/d36/d60/d7c/fb9 [0,4194304] 0 2024-04-23T14:50:05.825 INFO:tasks.workunit.client.1.smithi156.stdout:4/742: getdents d0/df/d55/d68/d74/d8b 0 2024-04-23T14:50:05.826 INFO:tasks.workunit.client.1.smithi156.stdout:4/743: getdents d0/d8/d1e/da0/de7 0 2024-04-23T14:50:05.826 INFO:tasks.workunit.client.1.smithi156.stdout:4/744: dread - d0/df/d55/d68/d53/f92 zero size 2024-04-23T14:50:05.829 INFO:tasks.workunit.client.1.smithi156.stdout:4/745: mkdir d0/df/d21/dfa 0 2024-04-23T14:50:05.831 INFO:tasks.workunit.client.1.smithi156.stdout:4/746: mknod d0/df/d55/d68/d53/d91/dd1/cfb 0 2024-04-23T14:50:05.834 INFO:tasks.workunit.client.1.smithi156.stdout:4/747: rename d0/df/d55/d68/d53/d91/d95/db5/cd3 to d0/d76/cfc 0 2024-04-23T14:50:05.842 INFO:tasks.workunit.client.1.smithi156.stdout:1/781: dwrite db/d1f/d28/f44 [0,4194304] 0 2024-04-23T14:50:05.849 INFO:tasks.workunit.client.1.smithi156.stdout:1/782: link db/d1f/d2f/d47/l58 db/d1f/d28/de7/lee 0 2024-04-23T14:50:05.849 INFO:tasks.workunit.client.1.smithi156.stdout:1/783: dread - db/d15/fc2 zero size 2024-04-23T14:50:05.849 INFO:tasks.workunit.client.1.smithi156.stdout:1/784: chown db/d1f/d2f/db5/fc9 169708960 1 2024-04-23T14:50:05.849 INFO:tasks.workunit.client.1.smithi156.stdout:1/785: chown db/d15/l8c 2665 1 2024-04-23T14:50:05.850 INFO:tasks.workunit.client.1.smithi156.stdout:1/786: creat db/d25/d30/fef x:0 0 0 2024-04-23T14:50:05.860 INFO:tasks.workunit.client.1.smithi156.stdout:7/812: dread dc/d1d/d24/f28 [0,4194304] 0 2024-04-23T14:50:05.860 INFO:tasks.workunit.client.1.smithi156.stdout:7/813: truncate dc/d2c/dbe/dc2/ff0 5821 0 2024-04-23T14:50:05.860 INFO:tasks.workunit.client.1.smithi156.stdout:6/826: dwrite d3/da/d1d/d27/dfe/f49 [0,4194304] 0 2024-04-23T14:50:05.864 INFO:tasks.workunit.client.1.smithi156.stdout:2/779: dwrite d4/d13/d19/de8/f108 [0,4194304] 0 2024-04-23T14:50:05.866 INFO:tasks.workunit.client.1.smithi156.stdout:6/827: mknod d3/da/d1d/d27/dfe/c12d 0 2024-04-23T14:50:05.873 INFO:tasks.workunit.client.1.smithi156.stdout:6/828: creat d3/da/d74/d93/f12e x:0 0 0 2024-04-23T14:50:05.873 INFO:tasks.workunit.client.1.smithi156.stdout:6/829: fdatasync d3/da/d1d/d27/dfe/d6e/ff1 0 2024-04-23T14:50:05.873 INFO:tasks.workunit.client.1.smithi156.stdout:6/830: fsync d3/da/d1d/f35 0 2024-04-23T14:50:05.890 INFO:tasks.workunit.client.1.smithi156.stdout:2/780: rename d4/d13/d88/dad to d4/d13/d19/d58/dfe/d114 0 2024-04-23T14:50:05.892 INFO:tasks.workunit.client.1.smithi156.stdout:4/748: write d0/df/d55/d68/d53/d9f/fbf [469056,114903] 0 2024-04-23T14:50:05.894 INFO:tasks.workunit.client.1.smithi156.stdout:2/781: read d4/d21/f37 [1472465,2033] 0 2024-04-23T14:50:05.895 INFO:tasks.workunit.client.1.smithi156.stdout:8/764: dwrite d5/d9/d36/d60/db8/d93/f108 [0,4194304] 0 2024-04-23T14:50:05.895 INFO:tasks.workunit.client.1.smithi156.stdout:8/765: chown d5/d4e/dc7/le5 3497 1 2024-04-23T14:50:05.898 INFO:tasks.workunit.client.1.smithi156.stdout:4/749: link d0/d76/l67 d0/df/d55/d68/d53/d9f/dcc/df1/d8a/lfd 0 2024-04-23T14:50:05.902 INFO:tasks.workunit.client.1.smithi156.stdout:8/766: creat d5/d9/d36/d60/d7c/f10f x:0 0 0 2024-04-23T14:50:05.902 INFO:tasks.workunit.client.1.smithi156.stdout:4/750: truncate d0/d8/d1e/d4a/d77/fb6 328116 0 2024-04-23T14:50:05.902 INFO:tasks.workunit.client.1.smithi156.stdout:8/767: fdatasync d5/d9/d10/d1d/fb0 0 2024-04-23T14:50:05.903 INFO:tasks.workunit.client.1.smithi156.stdout:4/751: write d0/df/d75/fcb [2521344,69925] 0 2024-04-23T14:50:05.903 INFO:tasks.workunit.client.1.smithi156.stdout:4/752: chown d0/df/d55/d68/d53/d9f/dcc/fda 28783922 1 2024-04-23T14:50:05.903 INFO:tasks.workunit.client.1.smithi156.stdout:8/768: write d5/d9/d36/d60/db8/d93/d96/fe6 [1026269,87484] 0 2024-04-23T14:50:05.910 INFO:tasks.workunit.client.1.smithi156.stdout:0/764: sync 2024-04-23T14:50:05.910 INFO:tasks.workunit.client.1.smithi156.stdout:3/683: sync 2024-04-23T14:50:05.910 INFO:tasks.workunit.client.1.smithi156.stdout:5/775: sync 2024-04-23T14:50:05.910 INFO:tasks.workunit.client.1.smithi156.stdout:5/776: readlink d1/d11/d18/l92 0 2024-04-23T14:50:05.910 INFO:tasks.workunit.client.1.smithi156.stdout:9/655: sync 2024-04-23T14:50:05.910 INFO:tasks.workunit.client.1.smithi156.stdout:5/777: dread - d1/d11/d27/fb5 zero size 2024-04-23T14:50:05.912 INFO:tasks.workunit.client.1.smithi156.stdout:0/765: creat d0/d4/ff4 x:0 0 0 2024-04-23T14:50:05.912 INFO:tasks.workunit.client.1.smithi156.stdout:3/684: getdents d4/db/dd/d1d/d61/d8d 0 2024-04-23T14:50:05.924 INFO:tasks.workunit.client.1.smithi156.stdout:9/656: getdents d1/d2/d3e/d55/d6f/d30 0 2024-04-23T14:50:05.925 INFO:tasks.workunit.client.1.smithi156.stdout:0/766: mkdir d0/d4/d22/d58/d9a/d44/de5/df5 0 2024-04-23T14:50:05.925 INFO:tasks.workunit.client.1.smithi156.stdout:9/657: read - d1/d2/d3e/d50/da9/fc7 zero size 2024-04-23T14:50:05.925 INFO:tasks.workunit.client.1.smithi156.stdout:0/767: rename d0/d16/d3a/d2a/d1d to d0/d16/d3a/d2a/d1d/d2d/dd5/df6 22 2024-04-23T14:50:05.930 INFO:tasks.workunit.client.1.smithi156.stdout:3/685: symlink d4/db/dd/d1d/d61/ldd 0 2024-04-23T14:50:05.931 INFO:tasks.workunit.client.1.smithi156.stdout:1/787: dwrite db/d25/d30/d38/d40/f9a [0,4194304] 0 2024-04-23T14:50:05.931 INFO:tasks.workunit.client.0.smithi081.stdout:9/985: sync 2024-04-23T14:50:05.931 INFO:tasks.workunit.client.0.smithi081.stdout:9/986: dread - d3/de/d1d/d5b/f11a zero size 2024-04-23T14:50:05.932 INFO:tasks.workunit.client.1.smithi156.stdout:1/788: symlink db/d1f/d28/d70/db3/dcc/lf0 0 2024-04-23T14:50:05.933 INFO:tasks.workunit.client.1.smithi156.stdout:1/789: write db/d15/fc2 [170100,105481] 0 2024-04-23T14:50:05.944 INFO:tasks.workunit.client.1.smithi156.stdout:6/831: dwrite d3/da/d1d/d27/dfe/d6e/f95 [0,4194304] 0 2024-04-23T14:50:05.952 INFO:tasks.workunit.client.1.smithi156.stdout:7/814: dwrite dc/d1d/d24/d5a/f9b [0,4194304] 0 2024-04-23T14:50:05.955 INFO:tasks.workunit.client.1.smithi156.stdout:3/686: write d4/db/dd/d1d/d1e/d42/f52 [3932151,125786] 0 2024-04-23T14:50:05.955 INFO:tasks.workunit.client.1.smithi156.stdout:3/687: fdatasync d4/db/dd/d1d/d61/f6a 0 2024-04-23T14:50:05.955 INFO:tasks.workunit.client.1.smithi156.stdout:2/782: dwrite d4/f7 [4194304,4194304] 0 2024-04-23T14:50:05.956 INFO:tasks.workunit.client.0.smithi081.stdout:9/987: write d3/d67/d77/d132/db5/fbd [2442249,47299] 0 2024-04-23T14:50:05.959 INFO:tasks.workunit.client.0.smithi081.stdout:9/988: getdents d3/de/d1d/d5b/d7b 0 2024-04-23T14:50:05.959 INFO:tasks.workunit.client.0.smithi081.stdout:9/989: fdatasync d3/de/d1d/d54/d68/fe3 0 2024-04-23T14:50:05.964 INFO:tasks.workunit.client.0.smithi081.stdout:9/990: link d3/de/l28 d3/d1a/l147 0 2024-04-23T14:50:05.964 INFO:tasks.workunit.client.0.smithi081.stdout:9/991: truncate d3/de/d1d/d5b/d7b/db2/fdb 689303 0 2024-04-23T14:50:05.964 INFO:tasks.workunit.client.0.smithi081.stdout:9/992: creat d3/de/d25/f148 x:0 0 0 2024-04-23T14:50:05.964 INFO:tasks.workunit.client.1.smithi156.stdout:3/688: unlink d4/db/c29 0 2024-04-23T14:50:05.965 INFO:tasks.workunit.client.1.smithi156.stdout:5/778: write d1/d3/d24/da0/f3c [3618827,35281] 0 2024-04-23T14:50:05.966 INFO:tasks.workunit.client.0.smithi081.stdout:9/993: creat d3/d67/d77/d132/f149 x:0 0 0 2024-04-23T14:50:05.966 INFO:tasks.workunit.client.1.smithi156.stdout:5/779: chown d1/cc 474723 1 2024-04-23T14:50:05.966 INFO:tasks.workunit.client.1.smithi156.stdout:5/780: truncate d1/d17/fbb 1008798 0 2024-04-23T14:50:05.966 INFO:tasks.workunit.client.1.smithi156.stdout:5/781: write d1/d11/f51 [3552382,14642] 0 2024-04-23T14:50:05.967 INFO:tasks.workunit.client.0.smithi081.stdout:9/994: stat d3/de/d1d/d62/ce0 0 2024-04-23T14:50:05.968 INFO:tasks.workunit.client.1.smithi156.stdout:5/782: mkdir d1/d3/d24/dbc/df5 0 2024-04-23T14:50:05.971 INFO:tasks.workunit.client.1.smithi156.stdout:0/768: read d0/fb1 [320663,60088] 0 2024-04-23T14:50:05.972 INFO:tasks.workunit.client.0.smithi081.stdout:9/995: rmdir d3/d5 39 2024-04-23T14:50:05.973 INFO:tasks.workunit.client.1.smithi156.stdout:9/658: write d1/d2/d3e/d50/d7a/d17/d1f/f37 [3441438,126645] 0 2024-04-23T14:50:05.973 INFO:tasks.workunit.client.1.smithi156.stdout:9/659: chown d1/d2/d3e/d50/d7a/d19 16328057 1 2024-04-23T14:50:05.974 INFO:tasks.workunit.client.1.smithi156.stdout:9/660: write d1/d2/d3e/d50/d7a/d40/f61 [1137420,19657] 0 2024-04-23T14:50:05.978 INFO:tasks.workunit.client.1.smithi156.stdout:1/790: write db/d1f/d2f/f56 [672061,26336] 0 2024-04-23T14:50:05.978 INFO:tasks.workunit.client.1.smithi156.stdout:8/769: dwrite d5/d9/d5a/d5c/f9d [0,4194304] 0 2024-04-23T14:50:05.978 INFO:tasks.workunit.client.0.smithi081.stdout:9/996: rename d3/de/d22/l4d to d3/de/d1d/d5b/l14a 0 2024-04-23T14:50:05.979 INFO:tasks.workunit.client.1.smithi156.stdout:9/661: creat d1/d2/d23/d49/d4c/fdc x:0 0 0 2024-04-23T14:50:05.979 INFO:tasks.workunit.client.1.smithi156.stdout:9/662: stat d1/d2/d3e/d50/c7e 0 2024-04-23T14:50:05.979 INFO:tasks.workunit.client.1.smithi156.stdout:9/663: write d1/d2/d23/d49/d4b/fdb [567217,12502] 0 2024-04-23T14:50:05.981 INFO:tasks.workunit.client.0.smithi081.stdout:9/997: link d3/d1a/laa d3/de/d14/d5e/d72/l14b 0 2024-04-23T14:50:05.982 INFO:tasks.workunit.client.1.smithi156.stdout:1/791: unlink db/d1f/d28/l31 0 2024-04-23T14:50:05.983 INFO:tasks.workunit.client.0.smithi081.stdout:9/998: symlink d3/de/d1d/d62/l14c 0 2024-04-23T14:50:05.983 INFO:tasks.workunit.client.0.smithi081.stdout:9/999: chown d3/de/d25/l83 237321037 1 2024-04-23T14:50:05.984 INFO:tasks.workunit.client.1.smithi156.stdout:8/770: truncate d5/d9/d36/de8/df3/f7b 5375731 0 2024-04-23T14:50:05.984 INFO:tasks.workunit.client.1.smithi156.stdout:8/771: creat d5/d9/d36/d60/db8/d93/d96/f110 x:0 0 0 2024-04-23T14:50:05.985 INFO:tasks.workunit.client.1.smithi156.stdout:8/772: creat d5/d39/d99/f111 x:0 0 0 2024-04-23T14:50:05.985 INFO:tasks.workunit.client.1.smithi156.stdout:8/773: dread - d5/d39/f61 zero size 2024-04-23T14:50:05.985 INFO:tasks.workunit.client.1.smithi156.stdout:8/774: write d5/d9/d36/d60/f89 [1011864,58206] 0 2024-04-23T14:50:05.985 INFO:tasks.workunit.client.1.smithi156.stdout:8/775: chown d5/d9/d5a/dc8/ce7 3332 1 2024-04-23T14:50:05.985 INFO:tasks.workunit.client.1.smithi156.stdout:1/792: mkdir db/d25/d30/df1 0 2024-04-23T14:50:05.992 INFO:tasks.workunit.client.1.smithi156.stdout:8/776: rmdir d5/d9/d36/d60/d7c 39 2024-04-23T14:50:05.993 INFO:tasks.workunit.client.1.smithi156.stdout:1/793: symlink db/d1f/d28/d70/db3/lf2 0 2024-04-23T14:50:05.995 INFO:tasks.workunit.client.0.smithi081.stderr:+ rm -rf -- ./tmp.RSOKr1HZk5 2024-04-23T14:50:05.997 INFO:tasks.workunit.client.1.smithi156.stdout:8/777: link d5/d9/d36/d84/d8c/cef d5/d9/d10/d1d/d21/c112 0 2024-04-23T14:50:05.998 INFO:tasks.workunit.client.1.smithi156.stdout:1/794: symlink db/d25/lf3 0 2024-04-23T14:50:06.002 INFO:tasks.workunit.client.1.smithi156.stdout:0/769: dread d0/d16/d3a/d1e/f77 [0,4194304] 0 2024-04-23T14:50:06.006 INFO:tasks.workunit.client.1.smithi156.stdout:0/770: creat d0/d16/dbf/d3f/ff7 x:0 0 0 2024-04-23T14:50:06.006 INFO:tasks.workunit.client.1.smithi156.stdout:0/771: stat d0/d16/d3a/dec 0 2024-04-23T14:50:06.006 INFO:tasks.workunit.client.1.smithi156.stdout:0/772: write d0/d16/d3a/d2a/d1d/d2d/fd8 [495071,21528] 0 2024-04-23T14:50:06.006 INFO:tasks.workunit.client.1.smithi156.stdout:0/773: read - d0/d16/dbf/d3f/fc8 zero size 2024-04-23T14:50:06.006 INFO:tasks.workunit.client.1.smithi156.stdout:0/774: dread - d0/d16/d3a/d2a/d1d/d2d/fae zero size 2024-04-23T14:50:06.007 INFO:tasks.workunit.client.1.smithi156.stdout:0/775: fdatasync d0/d16/dbf/d3f/d45/fac 0 2024-04-23T14:50:06.007 INFO:tasks.workunit.client.1.smithi156.stdout:5/783: write d1/d17/fe3 [2215910,86894] 0 2024-04-23T14:50:06.008 INFO:tasks.workunit.client.1.smithi156.stdout:2/783: dwrite d4/f16 [0,4194304] 0 2024-04-23T14:50:06.010 INFO:tasks.workunit.client.1.smithi156.stdout:5/784: truncate d1/d3/d43/fc1 1478397 0 2024-04-23T14:50:06.014 INFO:tasks.workunit.client.1.smithi156.stdout:5/785: unlink d1/c63 0 2024-04-23T14:50:06.018 INFO:tasks.workunit.client.1.smithi156.stdout:2/784: getdents d4/d26/d3c/dca 0 2024-04-23T14:50:06.018 INFO:tasks.workunit.client.1.smithi156.stdout:2/785: truncate d4/d13/d19/d58/fbf 359405 0 2024-04-23T14:50:06.020 INFO:tasks.workunit.client.1.smithi156.stdout:8/778: dread d5/d9/d36/f3e [0,4194304] 0 2024-04-23T14:50:06.024 INFO:tasks.workunit.client.1.smithi156.stdout:2/786: mkdir d4/d21/d42/d75/d79/d115 0 2024-04-23T14:50:06.027 INFO:tasks.workunit.client.1.smithi156.stdout:4/753: dwrite d0/df/d55/d68/d53/f7e [4194304,4194304] 0 2024-04-23T14:50:06.027 INFO:tasks.workunit.client.1.smithi156.stdout:1/795: dread db/d25/d30/d38/f6c [0,4194304] 0 2024-04-23T14:50:06.028 INFO:tasks.workunit.client.1.smithi156.stdout:1/796: fsync db/d1f/d94/da1/fe6 0 2024-04-23T14:50:06.034 INFO:tasks.workunit.client.1.smithi156.stdout:4/754: truncate d0/df/d75/f9a 4154937 0 2024-04-23T14:50:06.040 INFO:tasks.workunit.client.1.smithi156.stdout:1/797: rename db/d25/fce to db/d1f/d28/d70/ff4 0 2024-04-23T14:50:06.040 INFO:tasks.workunit.client.1.smithi156.stdout:6/832: write d3/da/fa0 [745283,129076] 0 2024-04-23T14:50:06.040 INFO:tasks.workunit.client.1.smithi156.stdout:6/833: chown d3/d16/d46/d9d/d9f/dad/f11c 521643 1 2024-04-23T14:50:06.040 INFO:tasks.workunit.client.1.smithi156.stdout:6/834: write d3/d16/d1e/f3d [1807847,71455] 0 2024-04-23T14:50:06.041 INFO:tasks.workunit.client.1.smithi156.stdout:8/779: rmdir d5/d9/d36/db5/d98 39 2024-04-23T14:50:06.053 INFO:tasks.workunit.client.1.smithi156.stdout:3/689: dwrite d4/db/dd/fb8 [0,4194304] 0 2024-04-23T14:50:06.053 INFO:tasks.workunit.client.1.smithi156.stdout:3/690: fdatasync d4/db/dd/d1d/d1e/d42/faa 0 2024-04-23T14:50:06.053 INFO:tasks.workunit.client.1.smithi156.stdout:3/691: truncate d4/db/dd1/fdb 51423 0 2024-04-23T14:50:06.057 INFO:tasks.workunit.client.1.smithi156.stdout:9/664: dwrite d1/d2/d3e/d50/d7a/d40/f72 [0,4194304] 0 2024-04-23T14:50:06.060 INFO:tasks.workunit.client.1.smithi156.stdout:9/665: creat d1/d2/d23/d49/d4c/fdd x:0 0 0 2024-04-23T14:50:06.060 INFO:tasks.workunit.client.1.smithi156.stdout:9/666: truncate d1/d2/d3e/d50/d7a/d17/d1f/d48/dc2/fb7 612967 0 2024-04-23T14:50:06.065 INFO:tasks.workunit.client.1.smithi156.stdout:4/755: link d0/ca d0/d8/d1e/d4a/d77/dc1/cfe 0 2024-04-23T14:50:06.068 INFO:tasks.workunit.client.1.smithi156.stdout:6/835: symlink d3/da/d1d/d59/deb/l12f 0 2024-04-23T14:50:06.072 INFO:tasks.workunit.client.1.smithi156.stdout:3/692: write d4/db/dd/d1d/d1e/d74/d90/f67 [3312538,73067] 0 2024-04-23T14:50:06.072 INFO:tasks.workunit.client.1.smithi156.stdout:8/780: creat d5/d9/d36/d84/d8c/f113 x:0 0 0 2024-04-23T14:50:06.072 INFO:tasks.workunit.client.1.smithi156.stdout:8/781: write d5/d9/fd [165890,16278] 0 2024-04-23T14:50:06.086 INFO:tasks.workunit.client.1.smithi156.stdout:2/787: write d4/d21/d76/f9b [1518801,122821] 0 2024-04-23T14:50:06.087 INFO:tasks.workunit.client.1.smithi156.stdout:0/776: dwrite d0/d4/d22/f96 [0,4194304] 0 2024-04-23T14:50:06.087 INFO:tasks.workunit.client.1.smithi156.stdout:0/777: chown d0/d4/d22/d58/d9a/d44/de5 100146624 1 2024-04-23T14:50:06.092 INFO:tasks.workunit.client.1.smithi156.stdout:5/786: dwrite d1/d3/ff1 [0,4194304] 0 2024-04-23T14:50:06.099 INFO:tasks.workunit.client.1.smithi156.stdout:4/756: dread d0/df/d55/d68/d53/d9f/dcc/fda [0,4194304] 0 2024-04-23T14:50:06.100 INFO:tasks.workunit.client.1.smithi156.stdout:3/693: mknod d4/db/dd/d1d/d61/d8d/d8a/d98/cde 0 2024-04-23T14:50:06.100 INFO:tasks.workunit.client.1.smithi156.stdout:3/694: chown d4/db/dd/d1d/d61/d7f/f9f 134 1 2024-04-23T14:50:06.100 INFO:tasks.workunit.client.1.smithi156.stdout:3/695: write d4/db/dd/d1d/d1e/f12 [1310844,55182] 0 2024-04-23T14:50:06.115 INFO:tasks.workunit.client.1.smithi156.stdout:1/798: dwrite db/d25/d30/d38/f6c [0,4194304] 0 2024-04-23T14:50:06.115 INFO:tasks.workunit.client.1.smithi156.stdout:1/799: write db/d1f/d2d/d48/dab/dcf/fd0 [1500633,125710] 0 2024-04-23T14:50:06.115 INFO:tasks.workunit.client.1.smithi156.stdout:1/800: fdatasync db/d1f/d2f/db5/fc9 0 2024-04-23T14:50:06.115 INFO:tasks.workunit.client.1.smithi156.stdout:1/801: write db/d25/d30/d38/d40/faa [1200731,62019] 0 2024-04-23T14:50:06.117 INFO:tasks.workunit.client.1.smithi156.stdout:2/788: truncate d4/d13/f86 2234732 0 2024-04-23T14:50:06.118 INFO:tasks.workunit.client.1.smithi156.stdout:0/778: getdents d0/d16/d3a/d2a/d1d 0 2024-04-23T14:50:06.120 INFO:tasks.workunit.client.1.smithi156.stdout:6/836: dwrite d3/da/d1d/d27/dfe/d6e/f95 [0,4194304] 0 2024-04-23T14:50:06.120 INFO:tasks.workunit.client.1.smithi156.stdout:6/837: readlink d3/d16/d46/l47 0 2024-04-23T14:50:06.129 INFO:tasks.workunit.client.1.smithi156.stdout:4/757: creat d0/df/d55/d68/d53/d91/ddc/fff x:0 0 0 2024-04-23T14:50:06.136 INFO:tasks.workunit.client.1.smithi156.stdout:0/779: mknod d0/d16/d3a/d2a/d1d/d2d/cf8 0 2024-04-23T14:50:06.136 INFO:tasks.workunit.client.1.smithi156.stdout:0/780: getdents d0/d4/d22/d58/d9a/d44/de5/df5 0 2024-04-23T14:50:06.137 INFO:tasks.workunit.client.1.smithi156.stdout:1/802: dread db/d1f/d2d/f6e [0,4194304] 0 2024-04-23T14:50:06.138 INFO:tasks.workunit.client.1.smithi156.stdout:1/803: write db/d1f/d2d/d48/daf/d68/fb7 [4759241,5181] 0 2024-04-23T14:50:06.139 INFO:tasks.workunit.client.1.smithi156.stdout:1/804: chown db/d1f/d94/da1/d81 19016698 1 2024-04-23T14:50:06.140 INFO:tasks.workunit.client.1.smithi156.stdout:6/838: symlink d3/d16/d5c/d6a/l130 0 2024-04-23T14:50:06.140 INFO:tasks.workunit.client.1.smithi156.stdout:1/805: write db/d1f/f7a [800285,106439] 0 2024-04-23T14:50:06.145 INFO:tasks.workunit.client.1.smithi156.stdout:0/781: mkdir d0/d4/d22/d58/df9 0 2024-04-23T14:50:06.145 INFO:tasks.workunit.client.1.smithi156.stdout:0/782: dread - d0/d16/d3a/d2a/d1d/d2d/d6b/f9f zero size 2024-04-23T14:50:06.147 INFO:tasks.workunit.client.1.smithi156.stdout:5/787: dwrite d1/d11/d18/d52/d85/d96/dd3/fd6 [0,4194304] 0 2024-04-23T14:50:06.152 INFO:tasks.workunit.client.1.smithi156.stdout:0/783: mkdir d0/d16/d3a/d2a/d1d/dfa 0 2024-04-23T14:50:06.153 INFO:tasks.workunit.client.1.smithi156.stdout:3/696: dread d4/db/dd/d1d/f36 [0,4194304] 0 2024-04-23T14:50:06.159 INFO:tasks.workunit.client.1.smithi156.stdout:9/667: dwrite d1/d2/d3e/d50/d7a/d40/f61 [0,4194304] 0 2024-04-23T14:50:06.162 INFO:tasks.workunit.client.1.smithi156.stdout:0/784: mknod d0/d16/dbf/d3f/d5f/cfb 0 2024-04-23T14:50:06.163 INFO:tasks.workunit.client.1.smithi156.stdout:3/697: creat d4/db/dd/d1d/d1e/d74/dcf/fdf x:0 0 0 2024-04-23T14:50:06.168 INFO:tasks.workunit.client.1.smithi156.stdout:1/806: read db/d1f/d2d/d93/fba [863749,76352] 0 2024-04-23T14:50:06.179 INFO:tasks.workunit.client.1.smithi156.stdout:0/785: creat d0/d16/d43/ffc x:0 0 0 2024-04-23T14:50:06.190 INFO:tasks.workunit.client.1.smithi156.stdout:2/789: dread d4/d21/d76/f9b [0,4194304] 0 2024-04-23T14:50:06.205 INFO:tasks.workunit.client.1.smithi156.stdout:0/786: symlink d0/lfd 0 2024-04-23T14:50:06.215 INFO:tasks.workunit.client.1.smithi156.stdout:5/788: dread d1/d11/d18/d52/f7f [0,4194304] 0 2024-04-23T14:50:06.241 INFO:tasks.workunit.client.1.smithi156.stdout:3/698: dwrite d4/db/dd/d1d/d1e/d74/d93/dc4/fcb [0,4194304] 0 2024-04-23T14:50:06.242 INFO:tasks.workunit.client.1.smithi156.stdout:9/668: dwrite d1/d2/d3e/fb4 [0,4194304] 0 2024-04-23T14:50:06.252 INFO:tasks.workunit.client.1.smithi156.stdout:9/669: mkdir d1/d2/d3e/d50/dde 0 2024-04-23T14:50:06.252 INFO:tasks.workunit.client.1.smithi156.stdout:9/670: write d1/d2/d3e/fcb [127928,47234] 0 2024-04-23T14:50:06.252 INFO:tasks.workunit.client.1.smithi156.stdout:9/671: chown d1/d2/d3e/d50/d7a/d17/l93 86 1 2024-04-23T14:50:06.254 INFO:tasks.workunit.client.1.smithi156.stdout:0/787: dread d0/d16/d3a/d2a/d1d/d2d/f73 [0,4194304] 0 2024-04-23T14:50:06.255 INFO:tasks.workunit.client.1.smithi156.stdout:0/788: truncate d0/d16/d43/d9c/fd7 169584 0 2024-04-23T14:50:06.260 INFO:tasks.workunit.client.1.smithi156.stdout:0/789: creat d0/d4/d22/d58/d9a/d44/de5/ffe x:0 0 0 2024-04-23T14:50:06.261 INFO:tasks.workunit.client.1.smithi156.stdout:4/758: dwrite d0/d8/f2f [4194304,4194304] 0 2024-04-23T14:50:06.262 INFO:tasks.workunit.client.1.smithi156.stdout:4/759: chown d0/l1 35712359 1 2024-04-23T14:50:06.264 INFO:tasks.workunit.client.1.smithi156.stdout:9/672: rename d1/d2/d3e/d50/d7a/c38 to d1/d2/d3e/d55/d6f/cdf 0 2024-04-23T14:50:06.269 INFO:tasks.workunit.client.1.smithi156.stdout:9/673: mkdir d1/d2/de0 0 2024-04-23T14:50:06.271 INFO:tasks.workunit.client.1.smithi156.stdout:1/807: dwrite db/d1f/d28/d70/fed [0,4194304] 0 2024-04-23T14:50:06.280 INFO:tasks.workunit.client.1.smithi156.stdout:5/789: dwrite d1/d3/d64/f65 [0,4194304] 0 2024-04-23T14:50:06.280 INFO:tasks.workunit.client.1.smithi156.stdout:2/790: dwrite d4/d13/d19/d97/f113 [0,4194304] 0 2024-04-23T14:50:06.288 INFO:tasks.workunit.client.1.smithi156.stdout:1/808: unlink db/c1d 0 2024-04-23T14:50:06.289 INFO:tasks.workunit.client.1.smithi156.stdout:4/760: write d0/df/d55/d68/d53/d91/d95/ff2 [576636,66650] 0 2024-04-23T14:50:06.299 INFO:tasks.workunit.client.1.smithi156.stdout:7/815: sync 2024-04-23T14:50:06.299 INFO:tasks.workunit.client.1.smithi156.stdout:7/816: write dc/d1d/d41/f43 [4464151,3275] 0 2024-04-23T14:50:06.302 INFO:tasks.workunit.client.1.smithi156.stdout:6/839: sync 2024-04-23T14:50:06.302 INFO:tasks.workunit.client.1.smithi156.stdout:8/782: sync 2024-04-23T14:50:06.304 INFO:tasks.workunit.client.1.smithi156.stdout:0/790: dwrite d0/d16/d3a/d1e/d80/fe2 [0,4194304] 0 2024-04-23T14:50:06.304 INFO:tasks.workunit.client.1.smithi156.stdout:0/791: truncate d0/fb1 1357906 0 2024-04-23T14:50:06.304 INFO:tasks.workunit.client.1.smithi156.stdout:2/791: mknod d4/d21/d42/d9f/c116 0 2024-04-23T14:50:06.304 INFO:tasks.workunit.client.1.smithi156.stdout:2/792: write d4/d21/d42/da1/f10b [1001860,27574] 0 2024-04-23T14:50:06.304 INFO:tasks.workunit.client.1.smithi156.stdout:2/793: chown d4/d13/d19/d4c/d5c/ffd 2 1 2024-04-23T14:50:06.304 INFO:tasks.workunit.client.1.smithi156.stdout:2/794: fdatasync d4/d21/d76/f9b 0 2024-04-23T14:50:06.304 INFO:tasks.workunit.client.1.smithi156.stdout:1/809: unlink db/d25/lf3 0 2024-04-23T14:50:06.307 INFO:tasks.workunit.client.1.smithi156.stdout:4/761: mkdir d0/df/d55/d68/d53/d91/d95/db5/d100 0 2024-04-23T14:50:06.307 INFO:tasks.workunit.client.1.smithi156.stdout:4/762: chown d0/lb9 2519891 1 2024-04-23T14:50:06.308 INFO:tasks.workunit.client.1.smithi156.stdout:7/817: mkdir dc/d2c/dbe/d102 0 2024-04-23T14:50:06.312 INFO:tasks.workunit.client.1.smithi156.stdout:4/763: dread d0/df/d55/d68/d53/d9f/dcc/fe4 [0,4194304] 0 2024-04-23T14:50:06.313 INFO:tasks.workunit.client.1.smithi156.stdout:4/764: readlink d0/df/d55/d68/d85/lf9 0 2024-04-23T14:50:06.318 INFO:tasks.workunit.client.1.smithi156.stdout:5/790: rmdir d1 39 2024-04-23T14:50:06.318 INFO:tasks.workunit.client.1.smithi156.stdout:5/791: write d1/d17/d7e/fc8 [1237873,75552] 0 2024-04-23T14:50:06.318 INFO:tasks.workunit.client.1.smithi156.stdout:5/792: fsync d1/d11/f51 0 2024-04-23T14:50:06.319 INFO:tasks.workunit.client.1.smithi156.stdout:6/840: link d3/f4e d3/da/f131 0 2024-04-23T14:50:06.323 INFO:tasks.workunit.client.1.smithi156.stdout:0/792: mkdir d0/d16/d43/d9c/dff 0 2024-04-23T14:50:06.327 INFO:tasks.workunit.client.1.smithi156.stdout:1/810: creat db/d1f/d28/d70/db3/d63/d9e/ff5 x:0 0 0 2024-04-23T14:50:06.327 INFO:tasks.workunit.client.1.smithi156.stdout:1/811: fdatasync db/d1f/d2d/d48/dab/dcf/fd0 0 2024-04-23T14:50:06.329 INFO:tasks.workunit.client.1.smithi156.stdout:7/818: truncate dc/d2c/d68/f75 1148598 0 2024-04-23T14:50:06.329 INFO:tasks.workunit.client.1.smithi156.stdout:7/819: dread - dc/d46/f70 zero size 2024-04-23T14:50:06.329 INFO:tasks.workunit.client.1.smithi156.stdout:7/820: fdatasync dc/d1d/d24/f49 0 2024-04-23T14:50:06.330 INFO:tasks.workunit.client.1.smithi156.stdout:6/841: rmdir d3/da/d1d/d27/dfe/d97 39 2024-04-23T14:50:06.330 INFO:tasks.workunit.client.1.smithi156.stdout:5/793: rmdir d1/d3/d64 39 2024-04-23T14:50:06.338 INFO:tasks.workunit.client.1.smithi156.stdout:2/795: rename d4/d21/d42/d75 to d4/d13/d19/d58/dfe/d114/d117 0 2024-04-23T14:50:06.342 INFO:tasks.workunit.client.1.smithi156.stdout:5/794: mknod d1/d3/d24/dbc/df5/cf6 0 2024-04-23T14:50:06.342 INFO:tasks.workunit.client.1.smithi156.stdout:5/795: write d1/d3/d43/fc7 [2744850,106184] 0 2024-04-23T14:50:06.355 INFO:tasks.workunit.client.1.smithi156.stdout:5/796: unlink d1/d11/f13 0 2024-04-23T14:50:06.359 INFO:tasks.workunit.client.1.smithi156.stdout:4/765: dwrite d0/df/d55/d68/f65 [4194304,4194304] 0 2024-04-23T14:50:06.359 INFO:tasks.workunit.client.1.smithi156.stdout:4/766: readlink d0/df/la5 0 2024-04-23T14:50:06.366 INFO:tasks.workunit.client.1.smithi156.stdout:4/767: creat d0/df/d21/dfa/f101 x:0 0 0 2024-04-23T14:50:06.366 INFO:tasks.workunit.client.1.smithi156.stdout:2/796: rmdir d4/d13/d19 39 2024-04-23T14:50:06.368 INFO:tasks.workunit.client.1.smithi156.stdout:2/797: creat d4/d26/d3c/dca/f118 x:0 0 0 2024-04-23T14:50:06.390 INFO:tasks.workunit.client.1.smithi156.stdout:8/783: dwrite d5/d9/d10/f46 [0,4194304] 0 2024-04-23T14:50:06.390 INFO:tasks.workunit.client.1.smithi156.stdout:6/842: dread d3/da/d74/fe9 [0,4194304] 0 2024-04-23T14:50:06.396 INFO:tasks.workunit.client.1.smithi156.stdout:6/843: link d3/da/d1d/fb5 d3/d16/d1e/f132 0 2024-04-23T14:50:06.398 INFO:tasks.workunit.client.1.smithi156.stdout:6/844: creat d3/d16/d46/d9d/d9f/dad/f133 x:0 0 0 2024-04-23T14:50:06.425 INFO:tasks.workunit.client.1.smithi156.stdout:6/845: dread d3/da/d1d/d59/d9c/fbd [0,4194304] 0 2024-04-23T14:50:06.426 INFO:tasks.workunit.client.1.smithi156.stdout:0/793: dwrite d0/d16/d3a/d1e/d80/fe2 [4194304,4194304] 0 2024-04-23T14:50:06.427 INFO:tasks.workunit.client.1.smithi156.stdout:6/846: unlink d3/da/d1d/d27/dfe/d3b/f69 0 2024-04-23T14:50:06.431 INFO:tasks.workunit.client.1.smithi156.stdout:6/847: unlink d3/da/d74/d93/f12e 0 2024-04-23T14:50:06.431 INFO:tasks.workunit.client.1.smithi156.stdout:6/848: fdatasync d3/da/d1d/d27/dfe/d6e/f108 0 2024-04-23T14:50:06.432 INFO:tasks.workunit.client.1.smithi156.stdout:5/797: dwrite d1/d3/d24/da0/f3c [0,4194304] 0 2024-04-23T14:50:06.433 INFO:tasks.workunit.client.1.smithi156.stdout:6/849: rmdir d3 39 2024-04-23T14:50:06.433 INFO:tasks.workunit.client.1.smithi156.stdout:6/850: chown d3/da/f10d 109546861 1 2024-04-23T14:50:06.438 INFO:tasks.workunit.client.1.smithi156.stdout:0/794: dread d0/d4/d22/d58/f69 [0,4194304] 0 2024-04-23T14:50:06.446 INFO:tasks.workunit.client.1.smithi156.stdout:0/795: symlink d0/d16/d3a/d2a/d1d/d2d/dd5/dde/l100 0 2024-04-23T14:50:06.451 INFO:tasks.workunit.client.1.smithi156.stdout:7/821: dwrite dc/d2a/f92 [0,4194304] 0 2024-04-23T14:50:06.451 INFO:tasks.workunit.client.1.smithi156.stdout:7/822: chown dc/d2a/f3a 199145 1 2024-04-23T14:50:06.451 INFO:tasks.workunit.client.1.smithi156.stdout:1/812: dwrite db/d1f/fb1 [0,4194304] 0 2024-04-23T14:50:06.451 INFO:tasks.workunit.client.1.smithi156.stdout:7/823: fdatasync dc/d46/dca/fe4 0 2024-04-23T14:50:06.455 INFO:tasks.workunit.client.1.smithi156.stdout:0/796: mkdir d0/d16/d3a/d2a/d1d/d2d/dd5/d101 0 2024-04-23T14:50:06.457 INFO:tasks.workunit.client.1.smithi156.stdout:6/851: dread d3/d16/d5c/d6a/f87 [0,4194304] 0 2024-04-23T14:50:06.465 INFO:tasks.workunit.client.1.smithi156.stdout:7/824: creat dc/d9d/dfa/f103 x:0 0 0 2024-04-23T14:50:06.469 INFO:tasks.workunit.client.1.smithi156.stdout:2/798: dread d4/d26/fb1 [0,4194304] 0 2024-04-23T14:50:06.470 INFO:tasks.workunit.client.1.smithi156.stdout:0/797: mknod d0/d16/dbf/d3f/d5f/db2/c102 0 2024-04-23T14:50:06.470 INFO:tasks.workunit.client.1.smithi156.stdout:0/798: dread - d0/d4/d22/d58/d9a/d44/fea zero size 2024-04-23T14:50:06.470 INFO:tasks.workunit.client.1.smithi156.stdout:0/799: readlink d0/d16/dbf/l27 0 2024-04-23T14:50:06.471 INFO:tasks.workunit.client.1.smithi156.stdout:0/800: creat d0/d4/d22/d58/d9a/d44/de5/f103 x:0 0 0 2024-04-23T14:50:06.471 INFO:tasks.workunit.client.1.smithi156.stdout:0/801: chown d0/d16/d3a/d2a/d1d/c26 1 1 2024-04-23T14:50:06.472 INFO:tasks.workunit.client.1.smithi156.stdout:8/784: dread d5/fb1 [0,4194304] 0 2024-04-23T14:50:06.472 INFO:tasks.workunit.client.1.smithi156.stdout:4/768: dwrite d0/d8/d1e/f22 [0,4194304] 0 2024-04-23T14:50:06.472 INFO:tasks.workunit.client.1.smithi156.stdout:4/769: truncate d0/d76/fb1 1020037 0 2024-04-23T14:50:06.472 INFO:tasks.workunit.client.1.smithi156.stdout:3/699: sync 2024-04-23T14:50:06.472 INFO:tasks.workunit.client.1.smithi156.stdout:9/674: sync 2024-04-23T14:50:06.472 INFO:tasks.workunit.client.1.smithi156.stdout:6/852: chown d3/fd 0 1 2024-04-23T14:50:06.477 INFO:tasks.workunit.client.1.smithi156.stdout:0/802: read d0/f15 [654841,82140] 0 2024-04-23T14:50:06.477 INFO:tasks.workunit.client.1.smithi156.stdout:0/803: fdatasync d0/d16/dbf/d3f/d5f/f71 0 2024-04-23T14:50:06.494 INFO:tasks.workunit.client.1.smithi156.stdout:8/785: getdents d5/d9/d36/d60 0 2024-04-23T14:50:06.495 INFO:tasks.workunit.client.1.smithi156.stdout:4/770: symlink d0/df/d55/d68/d53/d91/d95/def/l102 0 2024-04-23T14:50:06.495 INFO:tasks.workunit.client.1.smithi156.stdout:4/771: truncate d0/f3 943313 0 2024-04-23T14:50:06.496 INFO:tasks.workunit.client.1.smithi156.stdout:9/675: creat d1/d2/d3e/d50/d7a/fe1 x:0 0 0 2024-04-23T14:50:06.497 INFO:tasks.workunit.client.1.smithi156.stdout:3/700: truncate d4/db/dd/d1d/f2e 6994449 0 2024-04-23T14:50:06.499 INFO:tasks.workunit.client.1.smithi156.stdout:0/804: unlink d0/d16/d3a/d2a/d1d/f17 0 2024-04-23T14:50:06.500 INFO:tasks.workunit.client.1.smithi156.stdout:9/676: symlink d1/d2/d3e/d55/d6f/d30/le2 0 2024-04-23T14:50:06.501 INFO:tasks.workunit.client.1.smithi156.stdout:6/853: creat d3/da/d74/f134 x:0 0 0 2024-04-23T14:50:06.503 INFO:tasks.workunit.client.1.smithi156.stdout:6/854: mkdir d3/d16/d5c/d135 0 2024-04-23T14:50:06.503 INFO:tasks.workunit.client.1.smithi156.stdout:6/855: fdatasync d3/da/d74/fcb 0 2024-04-23T14:50:06.513 INFO:tasks.workunit.client.1.smithi156.stdout:9/677: dread d1/f51 [0,4194304] 0 2024-04-23T14:50:06.514 INFO:tasks.workunit.client.1.smithi156.stdout:9/678: mkdir d1/d2/d3e/d50/d7a/de3 0 2024-04-23T14:50:06.522 INFO:tasks.workunit.client.1.smithi156.stdout:6/856: dread d3/da/d74/fcb [0,4194304] 0 2024-04-23T14:50:06.522 INFO:tasks.workunit.client.1.smithi156.stdout:6/857: truncate d3/da/d1d/d27/dfe/d6e/f126 595984 0 2024-04-23T14:50:06.525 INFO:tasks.workunit.client.1.smithi156.stdout:6/858: getdents d3/da/d1d/d59/deb 0 2024-04-23T14:50:06.538 INFO:tasks.workunit.client.1.smithi156.stdout:6/859: write d3/da/d1d/d27/d63/f96 [298248,94604] 0 2024-04-23T14:50:06.538 INFO:tasks.workunit.client.1.smithi156.stdout:6/860: fdatasync d3/d16/d46/d9d/d9f/dad/f106 0 2024-04-23T14:50:06.541 INFO:tasks.workunit.client.1.smithi156.stdout:4/772: dwrite d0/df/d75/f9a [0,4194304] 0 2024-04-23T14:50:06.546 INFO:tasks.workunit.client.1.smithi156.stdout:9/679: read d1/d2/d3e/d50/d7a/dc/f8d [133305,64990] 0 2024-04-23T14:50:06.546 INFO:tasks.workunit.client.1.smithi156.stdout:9/680: chown d1/d2/d3e/d50/d7a/d40/l9d 112222 1 2024-04-23T14:50:06.553 INFO:tasks.workunit.client.1.smithi156.stdout:1/813: dwrite db/d25/f3d [0,4194304] 0 2024-04-23T14:50:06.553 INFO:tasks.workunit.client.1.smithi156.stdout:1/814: creat db/d1f/d28/d70/db3/d63/d9e/ff6 x:0 0 0 2024-04-23T14:50:06.558 INFO:tasks.workunit.client.1.smithi156.stdout:8/786: write d5/d4e/f52 [46864,102827] 0 2024-04-23T14:50:06.559 INFO:tasks.workunit.client.1.smithi156.stdout:8/787: creat d5/d9/d36/d60/db8/d93/d96/f114 x:0 0 0 2024-04-23T14:50:06.559 INFO:tasks.workunit.client.1.smithi156.stdout:3/701: dread d4/db/dd/d1d/f36 [0,4194304] 0 2024-04-23T14:50:06.569 INFO:tasks.workunit.client.1.smithi156.stdout:9/681: dread d1/d2/d23/d49/d4c/fb2 [0,4194304] 0 2024-04-23T14:50:06.576 INFO:tasks.workunit.client.1.smithi156.stdout:1/815: mknod db/d1f/d2d/d48/daf/d86/cf7 0 2024-04-23T14:50:06.576 INFO:tasks.workunit.client.1.smithi156.stdout:6/861: truncate d3/da/d1d/d27/dfe/d6e/f126 433562 0 2024-04-23T14:50:06.576 INFO:tasks.workunit.client.1.smithi156.stdout:6/862: read - d3/da/d1d/d27/dfe/d6e/f108 zero size 2024-04-23T14:50:06.576 INFO:tasks.workunit.client.1.smithi156.stdout:3/702: creat d4/db/dd/d1d/d1e/d42/fe0 x:0 0 0 2024-04-23T14:50:06.576 INFO:tasks.workunit.client.1.smithi156.stdout:3/703: write d4/db/dd/d1d/d1e/d42/d76/dba/fc5 [622591,25716] 0 2024-04-23T14:50:06.580 INFO:tasks.workunit.client.1.smithi156.stdout:9/682: truncate d1/d2/d3e/d50/d7a/d17/d1f/d48/dc2/fb7 177834 0 2024-04-23T14:50:06.582 INFO:tasks.workunit.client.1.smithi156.stdout:1/816: mkdir db/d1f/d2d/d48/dab/dcf/df8 0 2024-04-23T14:50:06.587 INFO:tasks.workunit.client.1.smithi156.stdout:6/863: mknod d3/d16/d119/c136 0 2024-04-23T14:50:06.587 INFO:tasks.workunit.client.1.smithi156.stdout:6/864: truncate d3/da/d1d/fd0 724230 0 2024-04-23T14:50:06.589 INFO:tasks.workunit.client.1.smithi156.stdout:9/683: rmdir d1/d2/d3e/d55/d6f/d30 39 2024-04-23T14:50:06.589 INFO:tasks.workunit.client.1.smithi156.stdout:9/684: readlink d1/d2/d23/d75/laf 0 2024-04-23T14:50:06.594 INFO:tasks.workunit.client.1.smithi156.stdout:5/798: sync 2024-04-23T14:50:06.597 INFO:tasks.workunit.client.1.smithi156.stdout:6/865: mknod d3/da/d1d/d27/dfe/c137 0 2024-04-23T14:50:06.599 INFO:tasks.workunit.client.1.smithi156.stdout:9/685: rename d1/d2/d3e/d80/f9b to d1/d2/d8c/fe4 0 2024-04-23T14:50:06.602 INFO:tasks.workunit.client.1.smithi156.stdout:8/788: dwrite d5/d9/d10/d1d/d21/fd2 [0,4194304] 0 2024-04-23T14:50:06.611 INFO:tasks.workunit.client.1.smithi156.stdout:8/789: link d5/d9/d5a/d5c/c95 d5/d9/d36/d60/db8/d93/d96/c115 0 2024-04-23T14:50:06.618 INFO:tasks.workunit.client.1.smithi156.stdout:6/866: write d3/da/d1d/d27/dfe/d6e/d8f/fc1 [2632024,18620] 0 2024-04-23T14:50:06.620 INFO:tasks.workunit.client.1.smithi156.stdout:6/867: unlink d3/da/d1d/d59/lc6 0 2024-04-23T14:50:06.623 INFO:tasks.workunit.client.1.smithi156.stdout:6/868: rename d3/d16/d5c/f86 to d3/da/d74/d93/dc3/f138 0 2024-04-23T14:50:06.624 INFO:tasks.workunit.client.1.smithi156.stdout:9/686: dread d1/d2/d3e/d55/d6f/fba [0,4194304] 0 2024-04-23T14:50:06.624 INFO:tasks.workunit.client.1.smithi156.stdout:6/869: readlink d3/da/d1d/d27/d63/l94 0 2024-04-23T14:50:06.624 INFO:tasks.workunit.client.1.smithi156.stdout:9/687: truncate d1/d2/d3e/d55/d6f/d30/fa6 168793 0 2024-04-23T14:50:06.629 INFO:tasks.workunit.client.1.smithi156.stdout:6/870: truncate d3/da/f4f 1874792 0 2024-04-23T14:50:06.650 INFO:tasks.workunit.client.1.smithi156.stdout:9/688: rmdir d1/d2/d3e/d50/d7a 39 2024-04-23T14:50:06.672 INFO:tasks.workunit.client.1.smithi156.stdout:1/817: dwrite db/d25/d30/f78 [0,4194304] 0 2024-04-23T14:50:06.687 INFO:tasks.workunit.client.1.smithi156.stdout:1/818: read db/d1f/d2d/f36 [2441170,87588] 0 2024-04-23T14:50:06.695 INFO:tasks.workunit.client.1.smithi156.stdout:1/819: dread db/f11 [0,4194304] 0 2024-04-23T14:50:06.712 INFO:tasks.workunit.client.1.smithi156.stdout:5/799: dwrite d1/d3/f25 [0,4194304] 0 2024-04-23T14:50:06.716 INFO:tasks.workunit.client.1.smithi156.stdout:5/800: write d1/d3/d43/fc1 [1123962,104076] 0 2024-04-23T14:50:06.719 INFO:tasks.workunit.client.1.smithi156.stdout:6/871: write d3/da/d1d/d59/d9c/fbd [1896931,117681] 0 2024-04-23T14:50:06.719 INFO:tasks.workunit.client.1.smithi156.stdout:0/805: sync 2024-04-23T14:50:06.720 INFO:tasks.workunit.client.1.smithi156.stdout:7/825: sync 2024-04-23T14:50:06.720 INFO:tasks.workunit.client.1.smithi156.stdout:2/799: sync 2024-04-23T14:50:06.720 INFO:tasks.workunit.client.1.smithi156.stdout:7/826: fdatasync dc/d1d/f78 0 2024-04-23T14:50:06.722 INFO:tasks.workunit.client.1.smithi156.stdout:0/806: rename d0/d16/d3a/d2a/d1d/d2d/d6b/f81 to d0/d16/dcd/ded/f104 0 2024-04-23T14:50:06.724 INFO:tasks.workunit.client.1.smithi156.stdout:2/800: creat d4/d13/d19/d97/d104/f119 x:0 0 0 2024-04-23T14:50:06.724 INFO:tasks.workunit.client.1.smithi156.stdout:2/801: chown d4/f29 6781745 1 2024-04-23T14:50:06.724 INFO:tasks.workunit.client.1.smithi156.stdout:2/802: dread - d4/d13/d19/de8/f101 zero size 2024-04-23T14:50:06.726 INFO:tasks.workunit.client.1.smithi156.stdout:7/827: mkdir dc/d46/dca/df8/d104 0 2024-04-23T14:50:06.727 INFO:tasks.workunit.client.1.smithi156.stdout:6/872: mkdir d3/d139 0 2024-04-23T14:50:06.729 INFO:tasks.workunit.client.1.smithi156.stdout:0/807: link d0/d16/d3a/d1e/d80/fe2 d0/d4/d22/d58/d9a/d44/de5/df5/f105 0 2024-04-23T14:50:06.731 INFO:tasks.workunit.client.1.smithi156.stdout:2/803: symlink d4/d13/d19/d97/ddd/l11a 0 2024-04-23T14:50:06.734 INFO:tasks.workunit.client.1.smithi156.stdout:2/804: symlink d4/d13/d19/dd8/l11b 0 2024-04-23T14:50:06.734 INFO:tasks.workunit.client.1.smithi156.stdout:2/805: chown d4/d13/d19/d4c/d5c/dd5/l10a 1982 1 2024-04-23T14:50:06.734 INFO:tasks.workunit.client.1.smithi156.stdout:2/806: write d4/d21/d76/fcb [1170982,116712] 0 2024-04-23T14:50:06.740 INFO:tasks.workunit.client.1.smithi156.stdout:0/808: rmdir d0/d16/d43 39 2024-04-23T14:50:06.740 INFO:tasks.workunit.client.1.smithi156.stdout:0/809: fdatasync d0/d4/d22/d58/fd0 0 2024-04-23T14:50:06.752 INFO:tasks.workunit.client.1.smithi156.stdout:8/790: dwrite d5/d39/d99/fc2 [0,4194304] 0 2024-04-23T14:50:06.764 INFO:tasks.workunit.client.1.smithi156.stdout:8/791: mknod d5/d9/d36/d84/d8c/c116 0 2024-04-23T14:50:06.765 INFO:tasks.workunit.client.1.smithi156.stdout:0/810: dread d0/d16/d43/dc2/f7e [4194304,4194304] 0 2024-04-23T14:50:06.768 INFO:tasks.workunit.client.1.smithi156.stdout:0/811: creat d0/d16/d43/dc2/f106 x:0 0 0 2024-04-23T14:50:06.768 INFO:tasks.workunit.client.1.smithi156.stdout:0/812: truncate d0/d16/dbf/d3f/fc8 754512 0 2024-04-23T14:50:06.768 INFO:tasks.workunit.client.1.smithi156.stdout:5/801: dwrite d1/d3/d64/fc9 [0,4194304] 0 2024-04-23T14:50:06.769 INFO:tasks.workunit.client.1.smithi156.stdout:6/873: dread d3/d16/f5a [0,4194304] 0 2024-04-23T14:50:06.769 INFO:tasks.workunit.client.1.smithi156.stdout:6/874: dread - d3/da/fec zero size 2024-04-23T14:50:06.769 INFO:tasks.workunit.client.1.smithi156.stdout:5/802: write d1/d3/d24/da0/fbf [630423,16858] 0 2024-04-23T14:50:06.771 INFO:tasks.workunit.client.1.smithi156.stdout:0/813: symlink d0/d16/d3a/d2a/d1d/da8/l107 0 2024-04-23T14:50:06.773 INFO:tasks.workunit.client.1.smithi156.stdout:6/875: creat d3/d139/f13a x:0 0 0 2024-04-23T14:50:06.774 INFO:tasks.workunit.client.1.smithi156.stdout:5/803: creat d1/d11/d18/d52/d85/d96/db4/ff7 x:0 0 0 2024-04-23T14:50:06.777 INFO:tasks.workunit.client.1.smithi156.stdout:6/876: creat d3/da/d1d/d27/f13b x:0 0 0 2024-04-23T14:50:06.778 INFO:tasks.workunit.client.1.smithi156.stdout:4/773: sync 2024-04-23T14:50:06.778 INFO:tasks.workunit.client.1.smithi156.stdout:3/704: sync 2024-04-23T14:50:06.778 INFO:tasks.workunit.client.1.smithi156.stdout:4/774: write d0/df/d55/d68/d53/d91/ddc/fff [283104,43712] 0 2024-04-23T14:50:06.778 INFO:tasks.workunit.client.1.smithi156.stdout:4/775: read - d0/df/d55/d68/d85/fe6 zero size 2024-04-23T14:50:06.778 INFO:tasks.workunit.client.1.smithi156.stdout:0/814: truncate d0/fcc 693064 0 2024-04-23T14:50:06.779 INFO:tasks.workunit.client.1.smithi156.stdout:6/877: mkdir d3/da/d1d/d59/d72/d13c 0 2024-04-23T14:50:06.780 INFO:tasks.workunit.client.1.smithi156.stdout:6/878: creat d3/d16/d5c/d6a/f13d x:0 0 0 2024-04-23T14:50:06.780 INFO:tasks.workunit.client.1.smithi156.stdout:6/879: stat d3/da/d1d/cb4 0 2024-04-23T14:50:06.784 INFO:tasks.workunit.client.1.smithi156.stdout:0/815: unlink d0/d16/dcd/cd9 0 2024-04-23T14:50:06.795 INFO:tasks.workunit.client.1.smithi156.stdout:7/828: dread dc/d93/d6c/f8b [0,4194304] 0 2024-04-23T14:50:06.797 INFO:tasks.workunit.client.1.smithi156.stdout:3/705: rmdir d4/db/dd/d1d/d1e/d42 39 2024-04-23T14:50:06.800 INFO:tasks.workunit.client.1.smithi156.stdout:0/816: rename d0/d16/dcd/dce to d0/d16/d3a/d1e/d108 0 2024-04-23T14:50:06.800 INFO:tasks.workunit.client.1.smithi156.stdout:0/817: chown d0/d16/l60 37832464 1 2024-04-23T14:50:06.800 INFO:tasks.workunit.client.1.smithi156.stdout:0/818: creat d0/d16/da4/f109 x:0 0 0 2024-04-23T14:50:06.800 INFO:tasks.workunit.client.1.smithi156.stdout:0/819: dread - d0/d16/d3a/d2a/d1d/d2d/d6b/f9f zero size 2024-04-23T14:50:06.805 INFO:tasks.workunit.client.1.smithi156.stdout:8/792: dread d5/d9/d10/d1d/d21/f77 [0,4194304] 0 2024-04-23T14:50:06.808 INFO:tasks.workunit.client.1.smithi156.stdout:3/706: chown d4/db/c32 9061193 1 2024-04-23T14:50:06.808 INFO:tasks.workunit.client.1.smithi156.stdout:3/707: creat d4/db/dd/d1d/d1e/d74/d90/fe1 x:0 0 0 2024-04-23T14:50:06.809 INFO:tasks.workunit.client.1.smithi156.stdout:2/807: dwrite d4/d21/d42/f89 [0,4194304] 0 2024-04-23T14:50:06.812 INFO:tasks.workunit.client.1.smithi156.stdout:0/820: mkdir d0/d16/dbf/d10a 0 2024-04-23T14:50:06.817 INFO:tasks.workunit.client.1.smithi156.stdout:8/793: creat d5/d4e/f117 x:0 0 0 2024-04-23T14:50:06.817 INFO:tasks.workunit.client.1.smithi156.stdout:8/794: truncate d5/d9/d36/d60/db8/ddd/de1/fb6 833358 0 2024-04-23T14:50:06.824 INFO:tasks.workunit.client.1.smithi156.stdout:8/795: mkdir d5/d9/d36/de8/df5/d118 0 2024-04-23T14:50:06.824 INFO:tasks.workunit.client.1.smithi156.stdout:8/796: write d5/d9/d36/d60/db8/fbc [4322656,57848] 0 2024-04-23T14:50:06.824 INFO:tasks.workunit.client.1.smithi156.stdout:3/708: mkdir d4/db/de2 0 2024-04-23T14:50:06.827 INFO:tasks.workunit.client.1.smithi156.stdout:6/880: dwrite d3/d16/d46/d9d/d9f/dad/fae [0,4194304] 0 2024-04-23T14:50:06.834 INFO:tasks.workunit.client.1.smithi156.stdout:8/797: symlink d5/d45/l119 0 2024-04-23T14:50:06.834 INFO:tasks.workunit.client.1.smithi156.stdout:8/798: dread - d5/d9/d36/d60/fa5 zero size 2024-04-23T14:50:06.834 INFO:tasks.workunit.client.1.smithi156.stdout:8/799: write d5/d9/f4d [1933617,6387] 0 2024-04-23T14:50:06.834 INFO:tasks.workunit.client.1.smithi156.stdout:8/800: truncate d5/d9/d36/d84/fde 1521563 0 2024-04-23T14:50:06.841 INFO:tasks.workunit.client.1.smithi156.stdout:1/820: sync 2024-04-23T14:50:06.841 INFO:tasks.workunit.client.1.smithi156.stdout:9/689: sync 2024-04-23T14:50:06.841 INFO:tasks.workunit.client.1.smithi156.stdout:9/690: write d1/d2/d3e/d50/f78 [680446,63256] 0 2024-04-23T14:50:06.845 INFO:tasks.workunit.client.1.smithi156.stdout:5/804: dwrite d1/d11/f5e [0,4194304] 0 2024-04-23T14:50:06.845 INFO:tasks.workunit.client.1.smithi156.stdout:5/805: write d1/d3/d24/da0/ddd/feb [170799,95748] 0 2024-04-23T14:50:06.849 INFO:tasks.workunit.client.1.smithi156.stdout:4/776: dwrite d0/f80 [0,4194304] 0 2024-04-23T14:50:06.852 INFO:tasks.workunit.client.1.smithi156.stdout:0/821: dread d0/d16/d3a/d2a/f2c [0,4194304] 0 2024-04-23T14:50:06.858 INFO:tasks.workunit.client.1.smithi156.stdout:8/801: symlink d5/d9/d5a/dc8/l11a 0 2024-04-23T14:50:06.860 INFO:tasks.workunit.client.1.smithi156.stdout:2/808: read d4/d21/d42/f89 [2070300,11783] 0 2024-04-23T14:50:06.862 INFO:tasks.workunit.client.1.smithi156.stdout:5/806: truncate d1/d3/d24/da0/f3c 3138104 0 2024-04-23T14:50:06.862 INFO:tasks.workunit.client.1.smithi156.stdout:5/807: dread - d1/d11/d18/d19/d9a/dce/ff3 zero size 2024-04-23T14:50:06.862 INFO:tasks.workunit.client.1.smithi156.stdout:5/808: stat d1/d17/d7e/f8b 0 2024-04-23T14:50:06.862 INFO:tasks.workunit.client.1.smithi156.stdout:5/809: dread - d1/d11/d18/d19/d9a/fb1 zero size 2024-04-23T14:50:06.862 INFO:tasks.workunit.client.1.smithi156.stdout:5/810: chown d1/d11/d27/lb9 9 1 2024-04-23T14:50:06.866 INFO:tasks.workunit.client.1.smithi156.stdout:4/777: mknod d0/d8/d1e/da0/de7/c103 0 2024-04-23T14:50:06.866 INFO:tasks.workunit.client.1.smithi156.stdout:4/778: dread - d0/df/d55/d68/d53/d9f/dcc/df1/fe8 zero size 2024-04-23T14:50:06.866 INFO:tasks.workunit.client.1.smithi156.stdout:8/802: creat d5/d9/d36/de8/df5/f11b x:0 0 0 2024-04-23T14:50:06.866 INFO:tasks.workunit.client.1.smithi156.stdout:7/829: dwrite dc/d1d/d24/f4a [0,4194304] 0 2024-04-23T14:50:06.871 INFO:tasks.workunit.client.1.smithi156.stdout:2/809: creat d4/d13/d19/d58/dfe/d114/d117/d110/f11c x:0 0 0 2024-04-23T14:50:06.871 INFO:tasks.workunit.client.1.smithi156.stdout:2/810: read - d4/d21/d42/fb7 zero size 2024-04-23T14:50:06.877 INFO:tasks.workunit.client.1.smithi156.stdout:3/709: dwrite d4/db/f77 [0,4194304] 0 2024-04-23T14:50:06.877 INFO:tasks.workunit.client.1.smithi156.stdout:3/710: stat d4 0 2024-04-23T14:50:06.877 INFO:tasks.workunit.client.1.smithi156.stdout:2/811: symlink d4/d21/d2f/l11d 0 2024-04-23T14:50:06.879 INFO:tasks.workunit.client.1.smithi156.stdout:2/812: creat d4/d21/f11e x:0 0 0 2024-04-23T14:50:06.886 INFO:tasks.workunit.client.1.smithi156.stdout:3/711: mkdir d4/db/dd/d1d/de3 0 2024-04-23T14:50:06.890 INFO:tasks.workunit.client.1.smithi156.stdout:8/803: rename d5/d9/d36/d60/db8/db7 to d5/d9/d36/d60/db8/d93/d96/dc0/d11c 0 2024-04-23T14:50:06.912 INFO:tasks.workunit.client.1.smithi156.stdout:6/881: dwrite d3/da/f18 [4194304,4194304] 0 2024-04-23T14:50:06.929 INFO:tasks.workunit.client.1.smithi156.stdout:5/811: dwrite d1/d11/d18/fe7 [0,4194304] 0 2024-04-23T14:50:06.929 INFO:tasks.workunit.client.1.smithi156.stdout:2/813: dread d4/fba [0,4194304] 0 2024-04-23T14:50:06.929 INFO:tasks.workunit.client.1.smithi156.stdout:2/814: getdents d4/d13/d19/d58/dfe/d114/d117/d79/d115 0 2024-04-23T14:50:06.929 INFO:tasks.workunit.client.1.smithi156.stdout:2/815: chown d4/d21/d2f/c61 11 1 2024-04-23T14:50:06.933 INFO:tasks.workunit.client.1.smithi156.stdout:7/830: dwrite dc/d93/f86 [0,4194304] 0 2024-04-23T14:50:06.934 INFO:tasks.workunit.client.1.smithi156.stdout:4/779: dread d0/df/d55/d68/f38 [0,4194304] 0 2024-04-23T14:50:06.935 INFO:tasks.workunit.client.1.smithi156.stdout:6/882: mknod d3/da/c13e 0 2024-04-23T14:50:06.935 INFO:tasks.workunit.client.1.smithi156.stdout:1/821: dwrite db/d25/f64 [0,4194304] 0 2024-04-23T14:50:06.935 INFO:tasks.workunit.client.1.smithi156.stdout:1/822: fdatasync db/d1f/d2f/d47/d71/fc8 0 2024-04-23T14:50:06.939 INFO:tasks.workunit.client.1.smithi156.stdout:2/816: rmdir d4/d21/d42/d9f 39 2024-04-23T14:50:06.945 INFO:tasks.workunit.client.1.smithi156.stdout:7/831: mknod dc/d1d/d24/c105 0 2024-04-23T14:50:06.945 INFO:tasks.workunit.client.1.smithi156.stdout:7/832: chown dc/d1d/d41/f9c 34673964 1 2024-04-23T14:50:06.946 INFO:tasks.workunit.client.1.smithi156.stdout:9/691: dwrite d1/d2/d3e/d50/d7a/d40/f61 [0,4194304] 0 2024-04-23T14:50:06.962 INFO:tasks.workunit.client.1.smithi156.stdout:6/883: creat d3/d16/d5c/d135/f13f x:0 0 0 2024-04-23T14:50:06.965 INFO:tasks.workunit.client.1.smithi156.stdout:1/823: dread db/d1f/d2f/f56 [0,4194304] 0 2024-04-23T14:50:06.968 INFO:tasks.workunit.client.1.smithi156.stdout:4/780: mknod d0/df/d55/d68/d53/d9f/dcc/c104 0 2024-04-23T14:50:06.969 INFO:tasks.workunit.client.1.smithi156.stdout:0/822: dwrite d0/d16/dbf/f4b [0,4194304] 0 2024-04-23T14:50:06.970 INFO:tasks.workunit.client.1.smithi156.stdout:6/884: mknod d3/da/d1d/d59/d72/c140 0 2024-04-23T14:50:06.970 INFO:tasks.workunit.client.1.smithi156.stdout:6/885: chown d3/d16/d46/d9d/d9f 3829 1 2024-04-23T14:50:06.970 INFO:tasks.workunit.client.1.smithi156.stdout:6/886: chown d3/da/d1d/d27/c127 10249695 1 2024-04-23T14:50:06.970 INFO:tasks.workunit.client.1.smithi156.stdout:6/887: chown d3/da/d1d/d27/fa6 5 1 2024-04-23T14:50:06.970 INFO:tasks.workunit.client.1.smithi156.stdout:6/888: chown d3/d16/d1e/d118 6950 1 2024-04-23T14:50:06.970 INFO:tasks.workunit.client.1.smithi156.stdout:6/889: chown d3/d16/d119 554 1 2024-04-23T14:50:06.972 INFO:tasks.workunit.client.1.smithi156.stdout:0/823: creat d0/d16/d3a/d2a/f10b x:0 0 0 2024-04-23T14:50:06.973 INFO:tasks.workunit.client.1.smithi156.stdout:5/812: dread d1/d17/f2e [0,4194304] 0 2024-04-23T14:50:06.973 INFO:tasks.workunit.client.1.smithi156.stdout:6/890: symlink d3/d16/d1e/d118/l141 0 2024-04-23T14:50:06.974 INFO:tasks.workunit.client.1.smithi156.stdout:0/824: getdents d0 0 2024-04-23T14:50:06.974 INFO:tasks.workunit.client.1.smithi156.stdout:0/825: stat d0/d16/d3a/d2a/d1d/da8 0 2024-04-23T14:50:06.974 INFO:tasks.workunit.client.1.smithi156.stdout:0/826: read d0/d16/d3a/d2a/d1d/d2d/d6b/feb [921288,122044] 0 2024-04-23T14:50:06.974 INFO:tasks.workunit.client.1.smithi156.stdout:5/813: link d1/d11/d18/d52/d85/f9b d1/d11/d18/d52/d85/ff8 0 2024-04-23T14:50:06.976 INFO:tasks.workunit.client.1.smithi156.stdout:3/712: dwrite d4/db/dd/d1d/d1e/d13/f34 [0,4194304] 0 2024-04-23T14:50:06.976 INFO:tasks.workunit.client.1.smithi156.stdout:3/713: readlink d4/db/dd/d1d/d61/ld4 0 2024-04-23T14:50:06.977 INFO:tasks.workunit.client.1.smithi156.stdout:5/814: rename d1/d3/ff1 to d1/d3/ff9 0 2024-04-23T14:50:06.981 INFO:tasks.workunit.client.1.smithi156.stdout:3/714: rename d4/db/dd/d1d/la0 to d4/db/dd/d1d/d1e/d74/le4 0 2024-04-23T14:50:06.985 INFO:tasks.workunit.client.1.smithi156.stdout:3/715: mkdir d4/db/dd/d1d/d1e/d42/d76/dba/de5 0 2024-04-23T14:50:06.988 INFO:tasks.workunit.client.1.smithi156.stdout:3/716: mkdir d4/db/dd/d1d/d1e/d74/d90/de6 0 2024-04-23T14:50:06.993 INFO:tasks.workunit.client.1.smithi156.stdout:3/717: mknod d4/db/dd/d1d/d1e/d74/d90/ce7 0 2024-04-23T14:50:07.016 INFO:tasks.workunit.client.1.smithi156.stdout:3/718: dread d4/db/dd/d1d/d1e/d42/d76/dba/fc5 [0,4194304] 0 2024-04-23T14:50:07.021 INFO:tasks.workunit.client.1.smithi156.stdout:2/817: dwrite d4/d21/d2f/fe0 [0,4194304] 0 2024-04-23T14:50:07.030 INFO:tasks.workunit.client.1.smithi156.stdout:2/818: rename d4/d21/d2f/l11d to d4/d21/d42/da1/ddf/l11f 0 2024-04-23T14:50:07.032 INFO:tasks.workunit.client.1.smithi156.stdout:2/819: creat d4/d21/d2f/f120 x:0 0 0 2024-04-23T14:50:07.033 INFO:tasks.workunit.client.1.smithi156.stdout:5/815: dread d1/d3/d64/f65 [0,4194304] 0 2024-04-23T14:50:07.033 INFO:tasks.workunit.client.1.smithi156.stdout:5/816: write d1/d11/d18/d19/d9a/dce/ff3 [138467,33928] 0 2024-04-23T14:50:07.035 INFO:tasks.workunit.client.1.smithi156.stdout:5/817: truncate d1/d3/d24/f58 486924 0 2024-04-23T14:50:07.040 INFO:tasks.workunit.client.1.smithi156.stdout:1/824: dwrite db/d1f/d94/da1/fc7 [4194304,4194304] 0 2024-04-23T14:50:07.043 INFO:tasks.workunit.client.1.smithi156.stdout:1/825: creat db/d1f/d2f/d47/d71/d75/ff9 x:0 0 0 2024-04-23T14:50:07.043 INFO:tasks.workunit.client.1.smithi156.stdout:1/826: chown db/d1f/d2d/d48/daf/d86/f67 797788466 1 2024-04-23T14:50:07.043 INFO:tasks.workunit.client.1.smithi156.stdout:1/827: write db/d1f/d2f/d47/d71/fc8 [1339215,86688] 0 2024-04-23T14:50:07.043 INFO:tasks.workunit.client.1.smithi156.stdout:1/828: chown db/d15/l2e 363 1 2024-04-23T14:50:07.047 INFO:tasks.workunit.client.1.smithi156.stdout:1/829: symlink db/d1f/d28/d70/db3/d63/d9e/lfa 0 2024-04-23T14:50:07.048 INFO:tasks.workunit.client.1.smithi156.stdout:4/781: dwrite d0/df/d55/d68/d53/d9f/fea [0,4194304] 0 2024-04-23T14:50:07.053 INFO:tasks.workunit.client.1.smithi156.stdout:4/782: rename d0/df4 to d0/d8/d105 0 2024-04-23T14:50:07.054 INFO:tasks.workunit.client.1.smithi156.stdout:2/820: dread d4/d21/d42/f6e [0,4194304] 0 2024-04-23T14:50:07.054 INFO:tasks.workunit.client.1.smithi156.stdout:0/827: dwrite d0/d4/d22/d58/d9a/d44/fea [0,4194304] 0 2024-04-23T14:50:07.057 INFO:tasks.workunit.client.1.smithi156.stdout:1/830: getdents db 0 2024-04-23T14:50:07.057 INFO:tasks.workunit.client.1.smithi156.stdout:1/831: chown db/de8 3368355 1 2024-04-23T14:50:07.066 INFO:tasks.workunit.client.1.smithi156.stdout:2/821: mknod d4/d13/d19/d4c/df9/c121 0 2024-04-23T14:50:07.066 INFO:tasks.workunit.client.1.smithi156.stdout:2/822: chown d4/d13/f95 74346 1 2024-04-23T14:50:07.067 INFO:tasks.workunit.client.1.smithi156.stdout:2/823: symlink d4/d13/l122 0 2024-04-23T14:50:07.067 INFO:tasks.workunit.client.1.smithi156.stdout:2/824: chown d4/f17 700660691 1 2024-04-23T14:50:07.070 INFO:tasks.workunit.client.1.smithi156.stdout:2/825: creat d4/d21/d42/d9f/f123 x:0 0 0 2024-04-23T14:50:07.070 INFO:tasks.workunit.client.1.smithi156.stdout:2/826: chown d4/d13/d19/dd8/l11b 8 1 2024-04-23T14:50:07.077 INFO:tasks.workunit.client.1.smithi156.stdout:2/827: creat d4/d13/d19/d58/dfe/d114/d117/d8e/dfa/f124 x:0 0 0 2024-04-23T14:50:07.077 INFO:tasks.workunit.client.1.smithi156.stdout:2/828: readlink d4/d13/d19/d58/l6a 0 2024-04-23T14:50:07.077 INFO:tasks.workunit.client.1.smithi156.stdout:2/829: dread - d4/d13/d19/d4c/d5c/f10f zero size 2024-04-23T14:50:07.084 INFO:tasks.workunit.client.1.smithi156.stdout:7/833: sync 2024-04-23T14:50:07.084 INFO:tasks.workunit.client.1.smithi156.stdout:8/804: sync 2024-04-23T14:50:07.087 INFO:tasks.workunit.client.1.smithi156.stdout:7/834: mkdir dc/d46/dca/df8/d104/d106 0 2024-04-23T14:50:07.087 INFO:tasks.workunit.client.1.smithi156.stdout:9/692: sync 2024-04-23T14:50:07.101 INFO:tasks.workunit.client.1.smithi156.stdout:5/818: dwrite d1/d3/d64/f65 [0,4194304] 0 2024-04-23T14:50:07.104 INFO:tasks.workunit.client.1.smithi156.stdout:4/783: dwrite d0/df/d21/dfa/f101 [0,4194304] 0 2024-04-23T14:50:07.105 INFO:tasks.workunit.client.1.smithi156.stdout:4/784: readlink d0/d76/l29 0 2024-04-23T14:50:07.128 INFO:tasks.workunit.client.1.smithi156.stdout:8/805: write d5/d9/d36/d60/db8/ddd/de1/fb6 [630841,32561] 0 2024-04-23T14:50:07.131 INFO:tasks.workunit.client.1.smithi156.stdout:8/806: link d5/d9/d10/d1d/f8e d5/d4e/dc7/f11d 0 2024-04-23T14:50:07.133 INFO:tasks.workunit.client.1.smithi156.stdout:8/807: mknod d5/d39/d99/c11e 0 2024-04-23T14:50:07.133 INFO:tasks.workunit.client.1.smithi156.stdout:8/808: write d5/d9/d10/d1d/d21/f40 [4935424,66779] 0 2024-04-23T14:50:07.133 INFO:tasks.workunit.client.1.smithi156.stdout:8/809: fsync d5/d39/d99/f111 0 2024-04-23T14:50:07.133 INFO:tasks.workunit.client.1.smithi156.stdout:8/810: truncate d5/d9/d36/d60/db8/fdf 46526 0 2024-04-23T14:50:07.133 INFO:tasks.workunit.client.1.smithi156.stdout:8/811: write d5/d9/d5a/dc8/fd0 [746242,23274] 0 2024-04-23T14:50:07.133 INFO:tasks.workunit.client.1.smithi156.stdout:8/812: creat d5/d9/d10/d1d/f11f x:0 0 0 2024-04-23T14:50:07.133 INFO:tasks.workunit.client.1.smithi156.stdout:5/819: dread d1/d11/de0/f6c [0,4194304] 0 2024-04-23T14:50:07.134 INFO:tasks.workunit.client.1.smithi156.stdout:8/813: truncate d5/d9/d10/f34 3989010 0 2024-04-23T14:50:07.149 INFO:tasks.workunit.client.1.smithi156.stdout:2/830: dwrite d4/d21/d2f/f49 [0,4194304] 0 2024-04-23T14:50:07.155 INFO:tasks.workunit.client.1.smithi156.stdout:2/831: creat d4/d13/d19/d97/ddd/f125 x:0 0 0 2024-04-23T14:50:07.155 INFO:tasks.workunit.client.1.smithi156.stdout:0/828: dwrite d0/d16/d43/ffc [0,4194304] 0 2024-04-23T14:50:07.157 INFO:tasks.workunit.client.1.smithi156.stdout:1/832: dread db/d1f/d2d/d48/fd2 [0,4194304] 0 2024-04-23T14:50:07.157 INFO:tasks.workunit.client.1.smithi156.stdout:1/833: fsync db/d1f/d2d/d93/fba 0 2024-04-23T14:50:07.178 INFO:tasks.workunit.client.1.smithi156.stdout:1/834: creat db/d1f/d28/d70/db3/dcc/ffb x:0 0 0 2024-04-23T14:50:07.178 INFO:tasks.workunit.client.1.smithi156.stdout:1/835: fsync db/d1f/d94/da1/fe6 0 2024-04-23T14:50:07.184 INFO:tasks.workunit.client.1.smithi156.stdout:8/814: dwrite d5/d9/d36/d60/db8/d93/d96/fe6 [0,4194304] 0 2024-04-23T14:50:07.186 INFO:tasks.workunit.client.1.smithi156.stdout:8/815: symlink d5/d9/d36/de8/l120 0 2024-04-23T14:50:07.186 INFO:tasks.workunit.client.1.smithi156.stdout:8/816: chown d5/d9/d36/de8/df3/lca 63250 1 2024-04-23T14:50:07.186 INFO:tasks.workunit.client.1.smithi156.stdout:3/719: sync 2024-04-23T14:50:07.186 INFO:tasks.workunit.client.1.smithi156.stdout:6/891: sync 2024-04-23T14:50:07.188 INFO:tasks.workunit.client.1.smithi156.stdout:3/720: getdents d4/db/dd/d73 0 2024-04-23T14:50:07.188 INFO:tasks.workunit.client.1.smithi156.stdout:3/721: truncate d4/f86 4800597 0 2024-04-23T14:50:07.188 INFO:tasks.workunit.client.1.smithi156.stdout:3/722: dread - d4/db/dd/d20/d57/f5f zero size 2024-04-23T14:50:07.190 INFO:tasks.workunit.client.1.smithi156.stdout:2/832: dwrite d4/d13/d19/d4c/f93 [0,4194304] 0 2024-04-23T14:50:07.191 INFO:tasks.workunit.client.1.smithi156.stdout:2/833: write d4/d21/d42/fc1 [567309,46117] 0 2024-04-23T14:50:07.194 INFO:tasks.workunit.client.1.smithi156.stdout:2/834: symlink d4/d13/d19/de8/l126 0 2024-04-23T14:50:07.195 INFO:tasks.workunit.client.1.smithi156.stdout:2/835: write d4/fba [4183205,93604] 0 2024-04-23T14:50:07.207 INFO:tasks.workunit.client.1.smithi156.stdout:1/836: dread db/d25/d30/d38/f6c [0,4194304] 0 2024-04-23T14:50:07.210 INFO:tasks.workunit.client.1.smithi156.stdout:1/837: symlink db/d1f/d2d/d48/dab/dcf/lfc 0 2024-04-23T14:50:07.210 INFO:tasks.workunit.client.1.smithi156.stdout:1/838: write db/d1f/d94/da1/fe6 [629653,71093] 0 2024-04-23T14:50:07.210 INFO:tasks.workunit.client.1.smithi156.stdout:1/839: readlink db/d1f/d28/d70/db3/d63/ldd 0 2024-04-23T14:50:07.211 INFO:tasks.workunit.client.1.smithi156.stdout:1/840: symlink db/d1f/d2f/lfd 0 2024-04-23T14:50:07.234 INFO:tasks.workunit.client.1.smithi156.stdout:3/723: read d4/db/dd/d1d/f2e [1201776,8717] 0 2024-04-23T14:50:07.239 INFO:tasks.workunit.client.1.smithi156.stdout:7/835: dwrite dc/d1d/d24/fe9 [0,4194304] 0 2024-04-23T14:50:07.240 INFO:tasks.workunit.client.1.smithi156.stdout:4/785: dwrite d0/df/d55/d68/d85/f90 [0,4194304] 0 2024-04-23T14:50:07.240 INFO:tasks.workunit.client.1.smithi156.stdout:4/786: write d0/d8/d1e/d4a/fb2 [290950,9330] 0 2024-04-23T14:50:07.242 INFO:tasks.workunit.client.1.smithi156.stdout:8/817: read d5/d9/d36/de8/df3/f7e [1137,107988] 0 2024-04-23T14:50:07.244 INFO:tasks.workunit.client.1.smithi156.stdout:9/693: dread d1/d2/d3e/d50/d7a/d17/d1f/f37 [0,4194304] 0 2024-04-23T14:50:07.244 INFO:tasks.workunit.client.1.smithi156.stdout:7/836: symlink dc/d1d/dba/dd4/l107 0 2024-04-23T14:50:07.244 INFO:tasks.workunit.client.1.smithi156.stdout:4/787: rmdir d0/df/d75 39 2024-04-23T14:50:07.245 INFO:tasks.workunit.client.1.smithi156.stdout:4/788: creat d0/df/d55/f106 x:0 0 0 2024-04-23T14:50:07.245 INFO:tasks.workunit.client.1.smithi156.stdout:4/789: write d0/df/d55/d68/d53/f79 [735624,30101] 0 2024-04-23T14:50:07.245 INFO:tasks.workunit.client.1.smithi156.stdout:4/790: chown d0/df 123 1 2024-04-23T14:50:07.245 INFO:tasks.workunit.client.1.smithi156.stdout:4/791: creat d0/df/d55/d68/d53/d9f/f107 x:0 0 0 2024-04-23T14:50:07.245 INFO:tasks.workunit.client.1.smithi156.stdout:4/792: chown d0/df/d55/d68/d53/d9f/f107 0 1 2024-04-23T14:50:07.246 INFO:tasks.workunit.client.1.smithi156.stdout:8/818: mkdir d5/d9/d36/d60/db8/d93/d96/dc0/d121 0 2024-04-23T14:50:07.246 INFO:tasks.workunit.client.1.smithi156.stdout:8/819: fsync d5/d9/d36/d60/db8/fdf 0 2024-04-23T14:50:07.246 INFO:tasks.workunit.client.1.smithi156.stdout:7/837: creat dc/d2c/f108 x:0 0 0 2024-04-23T14:50:07.249 INFO:tasks.workunit.client.1.smithi156.stdout:8/820: unlink d5/d9/d10/d1d/d21/fec 0 2024-04-23T14:50:07.254 INFO:tasks.workunit.client.1.smithi156.stdout:4/793: getdents d0/df/d55/d68/d53/d91/d95/db5 0 2024-04-23T14:50:07.259 INFO:tasks.workunit.client.1.smithi156.stdout:3/724: dread d4/db/dd/d1d/f37 [0,4194304] 0 2024-04-23T14:50:07.259 INFO:tasks.workunit.client.1.smithi156.stdout:3/725: read d4/db/dd/d1d/f3b [2674232,58496] 0 2024-04-23T14:50:07.260 INFO:tasks.workunit.client.1.smithi156.stdout:6/892: dwrite d3/da/f1a [4194304,4194304] 0 2024-04-23T14:50:07.260 INFO:tasks.workunit.client.1.smithi156.stdout:2/836: dread d4/d21/d2f/f35 [0,4194304] 0 2024-04-23T14:50:07.260 INFO:tasks.workunit.client.1.smithi156.stdout:2/837: fsync d4/d13/d19/de8/f101 0 2024-04-23T14:50:07.260 INFO:tasks.workunit.client.1.smithi156.stdout:5/820: dwrite d1/d3/d24/da0/f4c [0,4194304] 0 2024-04-23T14:50:07.263 INFO:tasks.workunit.client.1.smithi156.stdout:3/726: rename d4/db/dd/d1d/d1e/d13/d5a/l87 to d4/db/dd/d1d/d61/d8d/le8 0 2024-04-23T14:50:07.263 INFO:tasks.workunit.client.1.smithi156.stdout:3/727: stat d4/db/dd/d1d/d1e/d42/d76/dba/de5 0 2024-04-23T14:50:07.263 INFO:tasks.workunit.client.1.smithi156.stdout:6/893: unlink d3/d16/d1e/c33 0 2024-04-23T14:50:07.267 INFO:tasks.workunit.client.1.smithi156.stdout:2/838: creat d4/d13/d19/d4c/d5c/f127 x:0 0 0 2024-04-23T14:50:07.272 INFO:tasks.workunit.client.1.smithi156.stdout:6/894: mknod d3/d16/d46/d9d/d9f/dad/dcd/de6/c142 0 2024-04-23T14:50:07.272 INFO:tasks.workunit.client.1.smithi156.stdout:6/895: chown d3/da/l36 0 1 2024-04-23T14:50:07.272 INFO:tasks.workunit.client.1.smithi156.stdout:6/896: dread - d3/da/d1d/fe8 zero size 2024-04-23T14:50:07.272 INFO:tasks.workunit.client.1.smithi156.stdout:6/897: chown d3/d16/d46/d9d/fbe 5432 1 2024-04-23T14:50:07.276 INFO:tasks.workunit.client.1.smithi156.stdout:2/839: link d4/d13/d19/d58/c103 d4/d21/c128 0 2024-04-23T14:50:07.276 INFO:tasks.workunit.client.1.smithi156.stdout:2/840: creat d4/d13/d19/d4c/d5c/f129 x:0 0 0 2024-04-23T14:50:07.276 INFO:tasks.workunit.client.1.smithi156.stdout:2/841: write d4/fba [198259,4446] 0 2024-04-23T14:50:07.282 INFO:tasks.workunit.client.1.smithi156.stdout:2/842: mkdir d4/d21/d42/d12a 0 2024-04-23T14:50:07.282 INFO:tasks.workunit.client.1.smithi156.stdout:2/843: chown d4/fb6 374805 1 2024-04-23T14:50:07.282 INFO:tasks.workunit.client.1.smithi156.stdout:2/844: creat d4/d21/f12b x:0 0 0 2024-04-23T14:50:07.282 INFO:tasks.workunit.client.1.smithi156.stdout:2/845: stat d4/d13/d19/f77 0 2024-04-23T14:50:07.286 INFO:tasks.workunit.client.1.smithi156.stdout:2/846: symlink d4/d13/l12c 0 2024-04-23T14:50:07.294 INFO:tasks.workunit.client.1.smithi156.stdout:2/847: mknod d4/d13/d88/df8/c12d 0 2024-04-23T14:50:07.294 INFO:tasks.workunit.client.1.smithi156.stdout:2/848: fdatasync d4/d21/d42/f6e 0 2024-04-23T14:50:07.297 INFO:tasks.workunit.client.1.smithi156.stdout:2/849: symlink d4/d13/d19/d58/dfe/d114/d117/d8e/dfa/l12e 0 2024-04-23T14:50:07.297 INFO:tasks.workunit.client.1.smithi156.stdout:2/850: stat d4/d21/faa 0 2024-04-23T14:50:07.300 INFO:tasks.workunit.client.1.smithi156.stdout:2/851: creat d4/d13/d19/d97/d104/d10e/f12f x:0 0 0 2024-04-23T14:50:07.303 INFO:tasks.workunit.client.1.smithi156.stdout:2/852: creat d4/d13/d19/d58/dfe/d114/f130 x:0 0 0 2024-04-23T14:50:07.306 INFO:tasks.workunit.client.1.smithi156.stdout:1/841: dwrite db/d1f/d2f/f7b [0,4194304] 0 2024-04-23T14:50:07.309 INFO:tasks.workunit.client.1.smithi156.stdout:2/853: link d4/f17 d4/d13/d19/d58/dfe/d114/f131 0 2024-04-23T14:50:07.312 INFO:tasks.workunit.client.1.smithi156.stdout:1/842: creat db/d25/d4e/ffe x:0 0 0 2024-04-23T14:50:07.315 INFO:tasks.workunit.client.1.smithi156.stdout:1/843: truncate db/d25/d30/d38/f80 932527 0 2024-04-23T14:50:07.317 INFO:tasks.workunit.client.1.smithi156.stdout:1/844: rmdir db/d25/d6b 39 2024-04-23T14:50:07.319 INFO:tasks.workunit.client.1.smithi156.stdout:1/845: mkdir db/d1f/d2f/d47/dff 0 2024-04-23T14:50:07.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:07 smithi081 ceph-mon[25540]: pgmap v42: 65 pgs: 65 active+clean; 3.5 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 217 MiB/s rd, 257 MiB/s wr, 416 op/s 2024-04-23T14:50:07.329 INFO:tasks.workunit.client.1.smithi156.stdout:1/846: mknod db/d1f/d2f/d47/d71/d75/c100 0 2024-04-23T14:50:07.334 INFO:tasks.workunit.client.1.smithi156.stdout:1/847: rename db/c1b to db/d1f/d2d/d48/dd4/c101 0 2024-04-23T14:50:07.352 INFO:tasks.workunit.client.1.smithi156.stdout:8/821: dread d5/d4e/f52 [0,4194304] 0 2024-04-23T14:50:07.352 INFO:tasks.workunit.client.1.smithi156.stdout:8/822: dread - d5/d39/ffc zero size 2024-04-23T14:50:07.352 INFO:tasks.workunit.client.1.smithi156.stdout:9/694: dwrite d1/d2/d3e/d50/d7a/d40/f61 [0,4194304] 0 2024-04-23T14:50:07.352 INFO:tasks.workunit.client.1.smithi156.stdout:9/695: fsync d1/d2/d3e/d50/d7a/d17/d1f/f63 0 2024-04-23T14:50:07.353 INFO:tasks.workunit.client.1.smithi156.stdout:4/794: dwrite d0/df/d55/f106 [0,4194304] 0 2024-04-23T14:50:07.353 INFO:tasks.workunit.client.1.smithi156.stdout:4/795: write d0/d76/f4d [465664,18309] 0 2024-04-23T14:50:07.356 INFO:tasks.workunit.client.1.smithi156.stdout:9/696: mknod d1/d2/d3e/d50/d7a/d40/ce5 0 2024-04-23T14:50:07.356 INFO:tasks.workunit.client.1.smithi156.stdout:9/697: write d1/f1e [866512,86214] 0 2024-04-23T14:50:07.365 INFO:tasks.workunit.client.1.smithi156.stdout:4/796: mkdir d0/df/d55/d68/d53/d91/dd1/d108 0 2024-04-23T14:50:07.366 INFO:tasks.workunit.client.1.smithi156.stdout:9/698: rmdir d1/d2/d23/d75 39 2024-04-23T14:50:07.366 INFO:tasks.workunit.client.1.smithi156.stdout:9/699: chown d1/d2/d3e/d50/d7a/d17/d1f/fc1 205 1 2024-04-23T14:50:07.367 INFO:tasks.workunit.client.1.smithi156.stdout:5/821: dwrite d1/f38 [0,4194304] 0 2024-04-23T14:50:07.367 INFO:tasks.workunit.client.1.smithi156.stdout:5/822: fsync d1/fc0 0 2024-04-23T14:50:07.369 INFO:tasks.workunit.client.1.smithi156.stdout:4/797: symlink d0/df/d55/d68/d53/d91/d95/l109 0 2024-04-23T14:50:07.369 INFO:tasks.workunit.client.1.smithi156.stdout:4/798: fdatasync d0/d8/d1e/da0/fce 0 2024-04-23T14:50:07.370 INFO:tasks.workunit.client.1.smithi156.stdout:4/799: write d0/df/d55/f3c [4242958,76584] 0 2024-04-23T14:50:07.372 INFO:tasks.workunit.client.1.smithi156.stdout:9/700: rename d1/d2/d3e/d55/d9c/d39/fcf to d1/d2/d23/d75/fe6 0 2024-04-23T14:50:07.376 INFO:tasks.workunit.client.1.smithi156.stdout:7/838: dwrite dc/d1d/d24/f27 [0,4194304] 0 2024-04-23T14:50:07.381 INFO:tasks.workunit.client.1.smithi156.stdout:2/854: dwrite d4/d26/d3c/dca/f118 [0,4194304] 0 2024-04-23T14:50:07.381 INFO:tasks.workunit.client.1.smithi156.stdout:2/855: stat d4/d21/d2f/fc8 0 2024-04-23T14:50:07.397 INFO:tasks.workunit.client.1.smithi156.stdout:5/823: mkdir d1/d3/d64/dfa 0 2024-04-23T14:50:07.397 INFO:tasks.workunit.client.1.smithi156.stdout:5/824: chown d1/d11/d18/d19/l1d 1276 1 2024-04-23T14:50:07.397 INFO:tasks.workunit.client.1.smithi156.stdout:5/825: chown d1/d3/d64/dfa 151 1 2024-04-23T14:50:07.397 INFO:tasks.workunit.client.1.smithi156.stdout:5/826: write d1/d3/fd1 [324072,115810] 0 2024-04-23T14:50:07.400 INFO:tasks.workunit.client.1.smithi156.stdout:9/701: getdents d1/d2/d3e/d50/d7a/d40/d35 0 2024-04-23T14:50:07.401 INFO:tasks.workunit.client.1.smithi156.stdout:7/839: mkdir dc/d1d/d24/d5a/d109 0 2024-04-23T14:50:07.401 INFO:tasks.workunit.client.1.smithi156.stdout:9/702: read d1/d2/d23/d49/d4c/fb2 [4763604,3189] 0 2024-04-23T14:50:07.409 INFO:tasks.workunit.client.1.smithi156.stdout:5/827: link d1/d11/de0/d97/lb6 d1/d11/dcb/lfb 0 2024-04-23T14:50:07.410 INFO:tasks.workunit.client.1.smithi156.stdout:0/829: sync 2024-04-23T14:50:07.411 INFO:tasks.workunit.client.1.smithi156.stdout:9/703: symlink d1/d2/d3e/le7 0 2024-04-23T14:50:07.412 INFO:tasks.workunit.client.1.smithi156.stdout:2/856: mkdir d4/d132 0 2024-04-23T14:50:07.414 INFO:tasks.workunit.client.1.smithi156.stdout:5/828: creat d1/d11/de0/d97/ffc x:0 0 0 2024-04-23T14:50:07.418 INFO:tasks.workunit.client.1.smithi156.stdout:7/840: getdents dc/d1d/d24/dd5 0 2024-04-23T14:50:07.420 INFO:tasks.workunit.client.1.smithi156.stdout:6/898: write d3/d16/d46/d9d/d9f/fa3 [1140253,47467] 0 2024-04-23T14:50:07.424 INFO:tasks.workunit.client.1.smithi156.stdout:9/704: creat d1/d2/d3e/d50/d7a/d17/d1f/fe8 x:0 0 0 2024-04-23T14:50:07.424 INFO:tasks.workunit.client.1.smithi156.stdout:2/857: rmdir d4/d13/d19/d58/dfe/d114/d117/d8e 39 2024-04-23T14:50:07.428 INFO:tasks.workunit.client.1.smithi156.stdout:1/848: read db/d25/d30/f78 [1151394,113444] 0 2024-04-23T14:50:07.428 INFO:tasks.workunit.client.1.smithi156.stdout:0/830: read d0/d4/d22/d58/d9a/d44/fc7 [4124846,47827] 0 2024-04-23T14:50:07.432 INFO:tasks.workunit.client.1.smithi156.stdout:5/829: creat d1/d11/de0/ffd x:0 0 0 2024-04-23T14:50:07.432 INFO:tasks.workunit.client.1.smithi156.stdout:3/728: dwrite d4/db/dd/d1d/d1e/d74/d93/dad/fd0 [0,4194304] 0 2024-04-23T14:50:07.432 INFO:tasks.workunit.client.1.smithi156.stdout:3/729: stat d4/db/dd/d1d/d1e/d13/f79 0 2024-04-23T14:50:07.432 INFO:tasks.workunit.client.1.smithi156.stdout:7/841: creat dc/d46/dca/df8/f10a x:0 0 0 2024-04-23T14:50:07.433 INFO:tasks.workunit.client.1.smithi156.stdout:8/823: dwrite d5/f1c [0,4194304] 0 2024-04-23T14:50:07.438 INFO:tasks.workunit.client.1.smithi156.stdout:1/849: link db/d1f/d2d/d93/la6 db/d1f/d28/d70/db3/d63/l102 0 2024-04-23T14:50:07.444 INFO:tasks.workunit.client.1.smithi156.stdout:3/730: mkdir d4/db/dd/d1d/d1e/d74/d93/de9 0 2024-04-23T14:50:07.456 INFO:tasks.workunit.client.1.smithi156.stdout:8/824: creat d5/d9/d36/d60/f122 x:0 0 0 2024-04-23T14:50:07.457 INFO:tasks.workunit.client.1.smithi156.stdout:2/858: rmdir d4/d13/d19/d58/dfe/d114/d117/d110 39 2024-04-23T14:50:07.462 INFO:tasks.workunit.client.1.smithi156.stdout:6/899: rename d3/da/d1d/d59 to d3/da/d74/d143 0 2024-04-23T14:50:07.474 INFO:tasks.workunit.client.1.smithi156.stdout:4/800: dwrite d0/df/d55/d68/d53/d91/d95/fba [0,4194304] 0 2024-04-23T14:50:07.500 INFO:tasks.workunit.client.1.smithi156.stdout:1/850: write db/d1f/d2d/fc5 [2668791,6611] 0 2024-04-23T14:50:07.500 INFO:tasks.workunit.client.1.smithi156.stdout:4/801: write d0/df/d55/d68/d53/d91/ddc/fff [2622,33216] 0 2024-04-23T14:50:07.509 INFO:tasks.workunit.client.1.smithi156.stdout:0/831: dwrite d0/d16/d3a/d2a/f10b [0,4194304] 0 2024-04-23T14:50:07.513 INFO:tasks.workunit.client.1.smithi156.stdout:3/731: rmdir d4/db 39 2024-04-23T14:50:07.513 INFO:tasks.workunit.client.1.smithi156.stdout:3/732: chown d4/db/dd/d1d/d1e 30676435 1 2024-04-23T14:50:07.515 INFO:tasks.workunit.client.1.smithi156.stdout:9/705: dwrite d1/d2/d23/d49/d4c/f3b [0,4194304] 0 2024-04-23T14:50:07.522 INFO:tasks.workunit.client.1.smithi156.stdout:5/830: dwrite d1/d3/d24/f58 [0,4194304] 0 2024-04-23T14:50:07.523 INFO:tasks.workunit.client.1.smithi156.stdout:7/842: dwrite dc/d1d/d24/f28 [0,4194304] 0 2024-04-23T14:50:07.523 INFO:tasks.workunit.client.1.smithi156.stdout:9/706: dread d1/d2/d23/d75/fe6 [0,4194304] 0 2024-04-23T14:50:07.523 INFO:tasks.workunit.client.1.smithi156.stdout:7/843: write dc/d2c/dbe/dc2/ff0 [356163,98492] 0 2024-04-23T14:50:07.523 INFO:tasks.workunit.client.1.smithi156.stdout:8/825: rename d5/c7f to d5/d9/d36/d84/c123 0 2024-04-23T14:50:07.526 INFO:tasks.workunit.client.1.smithi156.stdout:1/851: creat db/de8/f103 x:0 0 0 2024-04-23T14:50:07.531 INFO:tasks.workunit.client.1.smithi156.stdout:0/832: mkdir d0/d10c 0 2024-04-23T14:50:07.531 INFO:tasks.workunit.client.1.smithi156.stdout:0/833: truncate d0/d4/f25 1747313 0 2024-04-23T14:50:07.532 INFO:tasks.workunit.client.1.smithi156.stdout:2/859: dwrite d4/d13/d19/de8/f101 [0,4194304] 0 2024-04-23T14:50:07.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:07 smithi156 ceph-mon[32341]: pgmap v42: 65 pgs: 65 active+clean; 3.5 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 217 MiB/s rd, 257 MiB/s wr, 416 op/s 2024-04-23T14:50:07.541 INFO:tasks.workunit.client.1.smithi156.stdout:9/707: dread d1/d2/d3e/d50/d7a/d17/d1f/d48/f4f [4194304,4194304] 0 2024-04-23T14:50:07.544 INFO:tasks.workunit.client.1.smithi156.stdout:4/802: dread d0/df/d75/fcb [0,4194304] 0 2024-04-23T14:50:07.546 INFO:tasks.workunit.client.1.smithi156.stdout:6/900: rmdir d3/d16 39 2024-04-23T14:50:07.549 INFO:tasks.workunit.client.1.smithi156.stdout:7/844: symlink dc/d2a/da9/l10b 0 2024-04-23T14:50:07.549 INFO:tasks.workunit.client.1.smithi156.stdout:7/845: dread - dc/d2c/dbe/dc2/ffe zero size 2024-04-23T14:50:07.554 INFO:tasks.workunit.client.1.smithi156.stdout:1/852: dread db/d1f/d2f/db5/fc9 [0,4194304] 0 2024-04-23T14:50:07.554 INFO:tasks.workunit.client.1.smithi156.stdout:0/834: rename d0/d16/d3a/d2a/d1d/d2d/d6b/feb to d0/d16/d3a/dec/f10d 0 2024-04-23T14:50:07.557 INFO:tasks.workunit.client.1.smithi156.stdout:2/860: symlink d4/d13/d19/d97/d104/l133 0 2024-04-23T14:50:07.557 INFO:tasks.workunit.client.1.smithi156.stdout:2/861: write d4/d13/d19/d4c/f68 [1960921,128366] 0 2024-04-23T14:50:07.558 INFO:tasks.workunit.client.1.smithi156.stdout:9/708: mknod d1/d2/d3e/d55/d9c/d39/ce9 0 2024-04-23T14:50:07.561 INFO:tasks.workunit.client.1.smithi156.stdout:6/901: readlink d3/da/d1d/d27/dfe/d3b/d9e/la7 0 2024-04-23T14:50:07.564 INFO:tasks.workunit.client.1.smithi156.stdout:6/902: write d3/d16/d1e/f20 [1892442,8588] 0 2024-04-23T14:50:07.566 INFO:tasks.workunit.client.1.smithi156.stdout:7/846: unlink dc/d93/d6c/d88/fc1 0 2024-04-23T14:50:07.568 INFO:tasks.workunit.client.1.smithi156.stdout:5/831: dread d1/d3/d24/da0/f33 [0,4194304] 0 2024-04-23T14:50:07.568 INFO:tasks.workunit.client.1.smithi156.stdout:5/832: getdents d1/d3/d64/dfa 0 2024-04-23T14:50:07.569 INFO:tasks.workunit.client.1.smithi156.stdout:1/853: rename db/d1f/l97 to db/d25/d30/df1/l104 0 2024-04-23T14:50:07.571 INFO:tasks.workunit.client.1.smithi156.stdout:2/862: creat d4/d13/d19/d58/dfe/d114/d117/f134 x:0 0 0 2024-04-23T14:50:07.572 INFO:tasks.workunit.client.1.smithi156.stdout:9/709: truncate d1/d2/d3e/d55/d6f/d30/fa6 531984 0 2024-04-23T14:50:07.573 INFO:tasks.workunit.client.1.smithi156.stdout:3/733: dwrite d4/db/dd/d1d/d61/d7f/f9f [0,4194304] 0 2024-04-23T14:50:07.573 INFO:tasks.workunit.client.1.smithi156.stdout:4/803: dread d0/f80 [0,4194304] 0 2024-04-23T14:50:07.575 INFO:tasks.workunit.client.1.smithi156.stdout:6/903: creat d3/da/d74/d143/df3/f144 x:0 0 0 2024-04-23T14:50:07.576 INFO:tasks.workunit.client.1.smithi156.stdout:0/835: write d0/d16/d43/dc2/f7e [6147862,46925] 0 2024-04-23T14:50:07.577 INFO:tasks.workunit.client.1.smithi156.stdout:5/833: link d1/d11/d27/faf d1/d3/d24/da0/ffe 0 2024-04-23T14:50:07.580 INFO:tasks.workunit.client.1.smithi156.stdout:8/826: dwrite d5/d9/d10/d1d/d21/f40 [0,4194304] 0 2024-04-23T14:50:07.580 INFO:tasks.workunit.client.1.smithi156.stdout:7/847: rename dc/f81 to dc/d2c/dbe/f10c 0 2024-04-23T14:50:07.580 INFO:tasks.workunit.client.1.smithi156.stdout:7/848: write dc/fa5 [935208,121507] 0 2024-04-23T14:50:07.581 INFO:tasks.workunit.client.1.smithi156.stdout:1/854: truncate db/d1f/d2d/d93/fa0 1503207 0 2024-04-23T14:50:07.582 INFO:tasks.workunit.client.1.smithi156.stdout:2/863: mkdir d4/d21/d135 0 2024-04-23T14:50:07.582 INFO:tasks.workunit.client.1.smithi156.stdout:2/864: write d4/d13/d19/f1e [834747,14392] 0 2024-04-23T14:50:07.582 INFO:tasks.workunit.client.1.smithi156.stdout:2/865: readlink d4/l6 0 2024-04-23T14:50:07.582 INFO:tasks.workunit.client.1.smithi156.stdout:2/866: chown d4/d26/l109 13060605 1 2024-04-23T14:50:07.582 INFO:tasks.workunit.client.1.smithi156.stdout:2/867: chown d4/d26/d3c/dca/ld4 0 1 2024-04-23T14:50:07.583 INFO:tasks.workunit.client.1.smithi156.stdout:2/868: read - d4/d13/d19/d4c/fcc zero size 2024-04-23T14:50:07.584 INFO:tasks.workunit.client.1.smithi156.stdout:5/834: dread d1/d3/d43/fc1 [0,4194304] 0 2024-04-23T14:50:07.586 INFO:tasks.workunit.client.1.smithi156.stdout:6/904: creat d3/d16/d1e/d118/f145 x:0 0 0 2024-04-23T14:50:07.590 INFO:tasks.workunit.client.1.smithi156.stdout:6/905: write d3/da/fa0 [153948,115976] 0 2024-04-23T14:50:07.592 INFO:tasks.workunit.client.1.smithi156.stdout:0/836: mknod d0/d16/d3a/d1e/d80/c10e 0 2024-04-23T14:50:07.594 INFO:tasks.workunit.client.1.smithi156.stdout:4/804: dread d0/df/f64 [0,4194304] 0 2024-04-23T14:50:07.594 INFO:tasks.workunit.client.1.smithi156.stdout:4/805: chown d0/df/d21/dfa/f101 209316 1 2024-04-23T14:50:07.594 INFO:tasks.workunit.client.1.smithi156.stdout:4/806: stat d0/d76/d63/le5 0 2024-04-23T14:50:07.597 INFO:tasks.workunit.client.1.smithi156.stdout:8/827: symlink d5/d9/d36/d60/d62/l124 0 2024-04-23T14:50:07.597 INFO:tasks.workunit.client.1.smithi156.stdout:8/828: write d5/d4e/dc7/fd5 [753745,76238] 0 2024-04-23T14:50:07.598 INFO:tasks.workunit.client.1.smithi156.stdout:3/734: read d4/f10 [4035947,59634] 0 2024-04-23T14:50:07.599 INFO:tasks.workunit.client.1.smithi156.stdout:9/710: rename d1/cae to d1/d2/d3e/d50/d7a/dc/cea 0 2024-04-23T14:50:07.600 INFO:tasks.workunit.client.1.smithi156.stdout:1/855: dread db/d25/f3d [0,4194304] 0 2024-04-23T14:50:07.602 INFO:tasks.workunit.client.1.smithi156.stdout:7/849: mkdir dc/d46/d58/d10d 0 2024-04-23T14:50:07.603 INFO:tasks.workunit.client.1.smithi156.stdout:2/869: stat d4/lb 0 2024-04-23T14:50:07.604 INFO:tasks.workunit.client.1.smithi156.stdout:5/835: rmdir d1/d3/d24/da0/ddd 39 2024-04-23T14:50:07.607 INFO:tasks.workunit.client.1.smithi156.stdout:6/906: symlink d3/da/d1d/d27/dfe/d3b/d9e/l146 0 2024-04-23T14:50:07.609 INFO:tasks.workunit.client.1.smithi156.stdout:8/829: link d5/d9/le d5/d9/d36/d60/db8/ddd/de1/l125 0 2024-04-23T14:50:07.611 INFO:tasks.workunit.client.1.smithi156.stdout:3/735: rename d4/db/dd/d1d/d1e/d42/d76/f95 to d4/db/dd/d1d/d1e/d2b/fea 0 2024-04-23T14:50:07.620 INFO:tasks.workunit.client.1.smithi156.stdout:9/711: dread d1/d2/d23/fbe [0,4194304] 0 2024-04-23T14:50:07.620 INFO:tasks.workunit.client.1.smithi156.stdout:9/712: chown d1/d2/d3e/d80 56217 1 2024-04-23T14:50:07.623 INFO:tasks.workunit.client.1.smithi156.stdout:1/856: mkdir db/d1f/d2d/d48/dab/dcf/d105 0 2024-04-23T14:50:07.623 INFO:tasks.workunit.client.1.smithi156.stdout:6/907: mkdir d3/d16/d147 0 2024-04-23T14:50:07.623 INFO:tasks.workunit.client.1.smithi156.stdout:8/830: creat d5/d9/d36/d60/d62/f126 x:0 0 0 2024-04-23T14:50:07.623 INFO:tasks.workunit.client.1.smithi156.stdout:6/908: write d3/da/d1d/fb5 [533946,79494] 0 2024-04-23T14:50:07.623 INFO:tasks.workunit.client.1.smithi156.stdout:6/909: fdatasync d3/da/d74/d143/df3/f123 0 2024-04-23T14:50:07.628 INFO:tasks.workunit.client.1.smithi156.stdout:9/713: symlink d1/d2/d3e/d55/d66/leb 0 2024-04-23T14:50:07.628 INFO:tasks.workunit.client.1.smithi156.stdout:9/714: write d1/d2/d3e/d50/d7a/d17/f82 [279314,105957] 0 2024-04-23T14:50:07.628 INFO:tasks.workunit.client.1.smithi156.stdout:0/837: dread d0/d16/d43/fbb [0,4194304] 0 2024-04-23T14:50:07.629 INFO:tasks.workunit.client.1.smithi156.stdout:8/831: mknod d5/d9/d36/de8/df5/c127 0 2024-04-23T14:50:07.629 INFO:tasks.workunit.client.1.smithi156.stdout:9/715: getdents d1/d2/d23/d49/d4b/dbc 0 2024-04-23T14:50:07.631 INFO:tasks.workunit.client.1.smithi156.stdout:0/838: creat d0/d16/d3a/d1e/d108/f10f x:0 0 0 2024-04-23T14:50:07.631 INFO:tasks.workunit.client.1.smithi156.stdout:0/839: readlink d0/l47 0 2024-04-23T14:50:07.631 INFO:tasks.workunit.client.1.smithi156.stdout:0/840: fdatasync d0/d16/d3a/d1e/d108/f10f 0 2024-04-23T14:50:07.632 INFO:tasks.workunit.client.1.smithi156.stdout:0/841: creat d0/d16/d3a/d2a/f110 x:0 0 0 2024-04-23T14:50:07.632 INFO:tasks.workunit.client.1.smithi156.stdout:8/832: mkdir d5/d4e/dc7/d128 0 2024-04-23T14:50:07.632 INFO:tasks.workunit.client.1.smithi156.stdout:9/716: mkdir d1/d2/d3e/d55/d66/dd6/dec 0 2024-04-23T14:50:07.632 INFO:tasks.workunit.client.1.smithi156.stdout:9/717: chown d1/d2/d3e/d50/c8f 604 1 2024-04-23T14:50:07.634 INFO:tasks.workunit.client.1.smithi156.stdout:0/842: truncate d0/d16/dbf/d3f/fc8 191856 0 2024-04-23T14:50:07.634 INFO:tasks.workunit.client.1.smithi156.stdout:0/843: chown d0/d16/d43/dc2/f4c 1569 1 2024-04-23T14:50:07.636 INFO:tasks.workunit.client.1.smithi156.stdout:8/833: mkdir d5/d9/d36/d60/db8/d93/d129 0 2024-04-23T14:50:07.636 INFO:tasks.workunit.client.1.smithi156.stdout:8/834: creat d5/d9/d10/d1d/f12a x:0 0 0 2024-04-23T14:50:07.636 INFO:tasks.workunit.client.1.smithi156.stdout:8/835: fsync d5/d9/d36/d60/db8/ffd 0 2024-04-23T14:50:07.636 INFO:tasks.workunit.client.1.smithi156.stdout:9/718: unlink d1/d2/d3e/d55/d9c/d39/ce9 0 2024-04-23T14:50:07.641 INFO:tasks.workunit.client.1.smithi156.stdout:0/844: rename d0/d16/dbf/d3f/l76 to d0/d16/dcd/l111 0 2024-04-23T14:50:07.645 INFO:tasks.workunit.client.1.smithi156.stdout:6/910: write d3/fd [2862832,75855] 0 2024-04-23T14:50:07.648 INFO:tasks.workunit.client.1.smithi156.stdout:6/911: creat d3/d16/d46/d9d/d9f/dad/dcd/de6/f148 x:0 0 0 2024-04-23T14:50:07.658 INFO:tasks.workunit.client.1.smithi156.stdout:7/850: write dc/d1d/d24/f27 [3274088,77383] 0 2024-04-23T14:50:07.660 INFO:tasks.workunit.client.1.smithi156.stdout:6/912: write d3/fb0 [605078,27803] 0 2024-04-23T14:50:07.660 INFO:tasks.workunit.client.1.smithi156.stdout:9/719: rename d1/d2/d3e/d50/d7a to d1/d2/d3e/d55/d66/dd6/ded 0 2024-04-23T14:50:07.660 INFO:tasks.workunit.client.1.smithi156.stdout:6/913: chown d3/d16/f85 0 1 2024-04-23T14:50:07.660 INFO:tasks.workunit.client.1.smithi156.stdout:6/914: chown d3/d16/d10b/d77/ld5 1711016 1 2024-04-23T14:50:07.661 INFO:tasks.workunit.client.1.smithi156.stdout:8/836: write d5/d9/d5a/f75 [493619,12676] 0 2024-04-23T14:50:07.665 INFO:tasks.workunit.client.1.smithi156.stdout:4/807: dwrite d0/df/d55/d68/fb7 [0,4194304] 0 2024-04-23T14:50:07.665 INFO:tasks.workunit.client.1.smithi156.stdout:7/851: rename dc/f1e to dc/f10e 0 2024-04-23T14:50:07.665 INFO:tasks.workunit.client.1.smithi156.stdout:7/852: truncate dc/d2c/dbe/dc2/ffe 484899 0 2024-04-23T14:50:07.666 INFO:tasks.workunit.client.1.smithi156.stdout:9/720: truncate d1/d2/d3e/d55/d6f/fa4 251072 0 2024-04-23T14:50:07.667 INFO:tasks.workunit.client.1.smithi156.stdout:2/870: dread d4/d13/d19/d4c/f68 [0,4194304] 0 2024-04-23T14:50:07.667 INFO:tasks.workunit.client.1.smithi156.stdout:2/871: truncate d4/d21/d2f/f49 5116109 0 2024-04-23T14:50:07.667 INFO:tasks.workunit.client.1.smithi156.stdout:2/872: write d4/d13/d19/d4c/fcc [365939,114501] 0 2024-04-23T14:50:07.667 INFO:tasks.workunit.client.1.smithi156.stdout:2/873: write d4/d21/d42/f55 [4094673,121391] 0 2024-04-23T14:50:07.670 INFO:tasks.workunit.client.1.smithi156.stdout:5/836: dwrite d1/d3/f5 [0,4194304] 0 2024-04-23T14:50:07.670 INFO:tasks.workunit.client.1.smithi156.stdout:5/837: chown d1/d3/d64 6977922 1 2024-04-23T14:50:07.670 INFO:tasks.workunit.client.1.smithi156.stdout:5/838: stat d1/d11/f51 0 2024-04-23T14:50:07.677 INFO:tasks.workunit.client.1.smithi156.stdout:4/808: symlink d0/df/d55/d68/d53/d91/dd1/l10a 0 2024-04-23T14:50:07.677 INFO:tasks.workunit.client.1.smithi156.stdout:9/721: symlink d1/d2/d3e/lee 0 2024-04-23T14:50:07.677 INFO:tasks.workunit.client.1.smithi156.stdout:2/874: symlink d4/d13/d88/df8/l136 0 2024-04-23T14:50:07.683 INFO:tasks.workunit.client.1.smithi156.stdout:9/722: dread d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/d48/dc2/fb7 [0,4194304] 0 2024-04-23T14:50:07.684 INFO:tasks.workunit.client.1.smithi156.stdout:3/736: dwrite d4/db/dd/d20/d57/fcc [0,4194304] 0 2024-04-23T14:50:07.684 INFO:tasks.workunit.client.1.smithi156.stdout:3/737: dread - d4/db/dd/d1d/d1e/d74/d90/fd7 zero size 2024-04-23T14:50:07.684 INFO:tasks.workunit.client.1.smithi156.stdout:3/738: chown d4/db/dd 118644 1 2024-04-23T14:50:07.684 INFO:tasks.workunit.client.1.smithi156.stdout:3/739: fdatasync d4/db/dd/d1d/d61/f71 0 2024-04-23T14:50:07.692 INFO:tasks.workunit.client.1.smithi156.stdout:6/915: rmdir d3/da/d1d/d27 39 2024-04-23T14:50:07.692 INFO:tasks.workunit.client.1.smithi156.stdout:6/916: chown d3/d16/cb1 133048 1 2024-04-23T14:50:07.692 INFO:tasks.workunit.client.1.smithi156.stdout:3/740: read d4/db/dd/d1d/d1e/d13/f1a [85571,91127] 0 2024-04-23T14:50:07.694 INFO:tasks.workunit.client.1.smithi156.stdout:4/809: dread d0/df/d55/d68/d74/f96 [0,4194304] 0 2024-04-23T14:50:07.699 INFO:tasks.workunit.client.1.smithi156.stdout:0/845: dwrite d0/d16/d3a/d2a/d1d/d2d/d6b/fb5 [0,4194304] 0 2024-04-23T14:50:07.700 INFO:tasks.workunit.client.1.smithi156.stdout:9/723: mkdir d1/d2/d23/def 0 2024-04-23T14:50:07.700 INFO:tasks.workunit.client.1.smithi156.stdout:9/724: read - d1/d2/d23/d49/d4c/fdd zero size 2024-04-23T14:50:07.700 INFO:tasks.workunit.client.1.smithi156.stdout:2/875: mkdir d4/d13/d19/d4c/d5c/dd5/de2/d137 0 2024-04-23T14:50:07.700 INFO:tasks.workunit.client.1.smithi156.stdout:2/876: truncate d4/d21/f111 316774 0 2024-04-23T14:50:07.700 INFO:tasks.workunit.client.1.smithi156.stdout:2/877: read - d4/d13/d19/d58/dfe/d114/d117/d8e/dfa/ffc zero size 2024-04-23T14:50:07.701 INFO:tasks.workunit.client.1.smithi156.stdout:6/917: mknod d3/d16/d5c/d135/c149 0 2024-04-23T14:50:07.702 INFO:tasks.workunit.client.1.smithi156.stdout:3/741: creat d4/db/dd/d1d/d1e/d13/d5a/feb x:0 0 0 2024-04-23T14:50:07.702 INFO:tasks.workunit.client.1.smithi156.stdout:3/742: readlink d4/db/dd/l8e 0 2024-04-23T14:50:07.703 INFO:tasks.workunit.client.1.smithi156.stdout:4/810: creat d0/d8/d1e/d4a/d77/d9c/f10b x:0 0 0 2024-04-23T14:50:07.705 INFO:tasks.workunit.client.1.smithi156.stdout:0/846: rename d0/d16/d43/d9c/dc0 to d0/d4/d22/d58/d9a/d44/d112 0 2024-04-23T14:50:07.706 INFO:tasks.workunit.client.1.smithi156.stdout:9/725: symlink d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/db9/lf0 0 2024-04-23T14:50:07.708 INFO:tasks.workunit.client.1.smithi156.stdout:2/878: unlink d4/l27 0 2024-04-23T14:50:07.709 INFO:tasks.workunit.client.1.smithi156.stdout:6/918: symlink d3/d16/d46/l14a 0 2024-04-23T14:50:07.711 INFO:tasks.workunit.client.1.smithi156.stdout:3/743: creat d4/db/dd/d1d/d61/d7f/fec x:0 0 0 2024-04-23T14:50:07.712 INFO:tasks.workunit.client.1.smithi156.stdout:4/811: mkdir d0/df/d55/d68/d53/d91/d95/db5/d100/d10c 0 2024-04-23T14:50:07.712 INFO:tasks.workunit.client.1.smithi156.stdout:4/812: chown d0/d76/f4d 2 1 2024-04-23T14:50:07.712 INFO:tasks.workunit.client.1.smithi156.stdout:4/813: readlink d0/d76/l67 0 2024-04-23T14:50:07.716 INFO:tasks.workunit.client.1.smithi156.stdout:0/847: mkdir d0/d16/da4/d113 0 2024-04-23T14:50:07.716 INFO:tasks.workunit.client.1.smithi156.stdout:0/848: chown d0/d16/d3a/d1e/d80/c10e 0 1 2024-04-23T14:50:07.718 INFO:tasks.workunit.client.1.smithi156.stdout:2/879: mknod d4/d26/d3c/dca/c138 0 2024-04-23T14:50:07.719 INFO:tasks.workunit.client.1.smithi156.stdout:2/880: creat d4/d13/d19/d97/ddd/f139 x:0 0 0 2024-04-23T14:50:07.722 INFO:tasks.workunit.client.1.smithi156.stdout:0/849: mknod d0/d16/d3a/d1e/c114 0 2024-04-23T14:50:07.727 INFO:tasks.workunit.client.1.smithi156.stdout:7/853: dread dc/d2a/fce [0,4194304] 0 2024-04-23T14:50:07.728 INFO:tasks.workunit.client.1.smithi156.stdout:6/919: link d3/da/d1d/d27/dfe/ca4 d3/d16/d46/d9d/d9f/c14b 0 2024-04-23T14:50:07.728 INFO:tasks.workunit.client.1.smithi156.stdout:1/857: dwrite db/d1f/d28/d70/f7d [0,4194304] 0 2024-04-23T14:50:07.728 INFO:tasks.workunit.client.1.smithi156.stdout:8/837: dread d5/d9/d5a/d5c/f72 [0,4194304] 0 2024-04-23T14:50:07.728 INFO:tasks.workunit.client.1.smithi156.stdout:8/838: readlink d5/d9/d5a/ldc 0 2024-04-23T14:50:07.728 INFO:tasks.workunit.client.1.smithi156.stdout:8/839: fdatasync d5/d9/d36/d9c/f41 0 2024-04-23T14:50:07.731 INFO:tasks.workunit.client.1.smithi156.stdout:8/840: symlink d5/d9/d5a/d5c/l12b 0 2024-04-23T14:50:07.734 INFO:tasks.workunit.client.1.smithi156.stdout:8/841: creat d5/d9/d36/de8/df3/f12c x:0 0 0 2024-04-23T14:50:07.742 INFO:tasks.workunit.client.1.smithi156.stdout:8/842: mknod d5/d9/d36/db5/d98/c12d 0 2024-04-23T14:50:07.742 INFO:tasks.workunit.client.1.smithi156.stdout:8/843: readlink d5/d9/d36/d60/db8/ddd/de1/l125 0 2024-04-23T14:50:07.742 INFO:tasks.workunit.client.1.smithi156.stdout:8/844: truncate d5/d9/d5a/f101 728001 0 2024-04-23T14:50:07.742 INFO:tasks.workunit.client.1.smithi156.stdout:2/881: dread d4/d21/d2f/f35 [0,4194304] 0 2024-04-23T14:50:07.742 INFO:tasks.workunit.client.1.smithi156.stdout:2/882: chown d4/d13/d19/dd8/lea 58202840 1 2024-04-23T14:50:07.744 INFO:tasks.workunit.client.1.smithi156.stdout:2/883: symlink d4/d21/d135/l13a 0 2024-04-23T14:50:07.744 INFO:tasks.workunit.client.1.smithi156.stdout:2/884: chown d4/f16 1331746 1 2024-04-23T14:50:07.761 INFO:tasks.workunit.client.1.smithi156.stdout:2/885: dread d4/d21/d42/da1/ddf/ff3 [0,4194304] 0 2024-04-23T14:50:07.763 INFO:tasks.workunit.client.1.smithi156.stdout:5/839: dwrite d1/fe2 [0,4194304] 0 2024-04-23T14:50:07.771 INFO:tasks.workunit.client.1.smithi156.stdout:9/726: dwrite d1/d2/d8c/fe4 [4194304,4194304] 0 2024-04-23T14:50:07.790 INFO:tasks.workunit.client.1.smithi156.stdout:1/858: dwrite db/d1f/d28/f37 [0,4194304] 0 2024-04-23T14:50:07.790 INFO:tasks.workunit.client.1.smithi156.stdout:2/886: read d4/d21/d42/da1/f10b [439885,75528] 0 2024-04-23T14:50:07.791 INFO:tasks.workunit.client.1.smithi156.stdout:2/887: chown d4/d13/d19/d58/dfe/d114/d117/lf1 9 1 2024-04-23T14:50:07.793 INFO:tasks.workunit.client.1.smithi156.stdout:1/859: mknod db/d25/c106 0 2024-04-23T14:50:07.800 INFO:tasks.workunit.client.1.smithi156.stdout:1/860: rename db/d1f/d2d/d48/daf/d68/fb7 to db/d1f/d94/da1/f107 0 2024-04-23T14:50:07.800 INFO:tasks.workunit.client.1.smithi156.stdout:1/861: fsync db/d1f/fdb 0 2024-04-23T14:50:07.801 INFO:tasks.workunit.client.1.smithi156.stdout:5/840: dread d1/d17/fbb [0,4194304] 0 2024-04-23T14:50:07.802 INFO:tasks.workunit.client.1.smithi156.stdout:8/845: dwrite d5/d9/d36/de8/df3/f7b [0,4194304] 0 2024-04-23T14:50:07.802 INFO:tasks.workunit.client.1.smithi156.stdout:8/846: dread - d5/d9/d36/de8/df5/f11b zero size 2024-04-23T14:50:07.810 INFO:tasks.workunit.client.1.smithi156.stdout:8/847: symlink d5/d9/l12e 0 2024-04-23T14:50:07.814 INFO:tasks.workunit.client.1.smithi156.stdout:2/888: dread d4/d21/d42/f6e [0,4194304] 0 2024-04-23T14:50:07.814 INFO:tasks.workunit.client.1.smithi156.stdout:2/889: readlink d4/d13/d19/d58/dfe/d114/d117/lf1 0 2024-04-23T14:50:07.816 INFO:tasks.workunit.client.1.smithi156.stdout:2/890: creat d4/d13/d19/f13b x:0 0 0 2024-04-23T14:50:07.817 INFO:tasks.workunit.client.1.smithi156.stdout:5/841: dread d1/d11/d18/d52/d85/ff8 [4194304,4194304] 0 2024-04-23T14:50:07.817 INFO:tasks.workunit.client.1.smithi156.stdout:7/854: dwrite dc/fa5 [0,4194304] 0 2024-04-23T14:50:07.821 INFO:tasks.workunit.client.1.smithi156.stdout:1/862: dread db/d25/d30/f78 [0,4194304] 0 2024-04-23T14:50:07.831 INFO:tasks.workunit.client.1.smithi156.stdout:2/891: read d4/d26/fb1 [1410988,118836] 0 2024-04-23T14:50:07.835 INFO:tasks.workunit.client.1.smithi156.stdout:7/855: write dc/d2c/dbe/dc2/fbc [2999806,115299] 0 2024-04-23T14:50:07.849 INFO:tasks.workunit.client.1.smithi156.stdout:5/842: mkdir d1/d11/d18/d52/d85/d96/dd3/dff 0 2024-04-23T14:50:07.849 INFO:tasks.workunit.client.1.smithi156.stdout:5/843: chown d1/d11/d18/d52/d75 5349 1 2024-04-23T14:50:07.849 INFO:tasks.workunit.client.1.smithi156.stdout:1/863: mknod db/d25/d30/c108 0 2024-04-23T14:50:07.850 INFO:tasks.workunit.client.1.smithi156.stdout:1/864: dread - db/d1f/fdb zero size 2024-04-23T14:50:07.855 INFO:tasks.workunit.client.1.smithi156.stdout:7/856: link dc/d46/f31 dc/d46/dca/df9/f10f 0 2024-04-23T14:50:07.855 INFO:tasks.workunit.client.1.smithi156.stdout:7/857: chown dc/d1d/f32 7230 1 2024-04-23T14:50:07.855 INFO:tasks.workunit.client.1.smithi156.stdout:7/858: fdatasync dc/d1d/d24/f28 0 2024-04-23T14:50:07.855 INFO:tasks.workunit.client.1.smithi156.stdout:7/859: fsync dc/d1d/d48/f6b 0 2024-04-23T14:50:07.855 INFO:tasks.workunit.client.1.smithi156.stdout:7/860: fdatasync dc/ff4 0 2024-04-23T14:50:07.855 INFO:tasks.workunit.client.1.smithi156.stdout:7/861: truncate dc/d1d/d24/d5a/dd0/ff1 1032242 0 2024-04-23T14:50:07.856 INFO:tasks.workunit.client.1.smithi156.stdout:5/844: mkdir d1/d11/d18/d19/d100 0 2024-04-23T14:50:07.857 INFO:tasks.workunit.client.1.smithi156.stdout:1/865: getdents db/d25/d30/d38/ddc 0 2024-04-23T14:50:07.858 INFO:tasks.workunit.client.1.smithi156.stdout:1/866: truncate db/d1f/fdb 799650 0 2024-04-23T14:50:07.863 INFO:tasks.workunit.client.1.smithi156.stdout:7/862: creat dc/d93/d6c/f110 x:0 0 0 2024-04-23T14:50:07.863 INFO:tasks.workunit.client.1.smithi156.stdout:5/845: truncate d1/d3/d64/f65 2480210 0 2024-04-23T14:50:07.885 INFO:tasks.workunit.client.1.smithi156.stdout:5/846: dread d1/d17/d7e/fc8 [0,4194304] 0 2024-04-23T14:50:07.893 INFO:tasks.workunit.client.1.smithi156.stdout:8/848: dwrite d5/d9/f4b [0,4194304] 0 2024-04-23T14:50:07.893 INFO:tasks.workunit.client.1.smithi156.stdout:5/847: dread d1/d11/d18/d19/d9a/dce/ff3 [0,4194304] 0 2024-04-23T14:50:07.897 INFO:tasks.workunit.client.1.smithi156.stdout:8/849: dread d5/d9/d5a/f101 [0,4194304] 0 2024-04-23T14:50:07.898 INFO:tasks.workunit.client.1.smithi156.stdout:8/850: truncate d5/d9/d10/d1d/d21/f77 927612 0 2024-04-23T14:50:07.899 INFO:tasks.workunit.client.1.smithi156.stdout:2/892: dwrite d4/d21/f11e [0,4194304] 0 2024-04-23T14:50:07.904 INFO:tasks.workunit.client.1.smithi156.stdout:8/851: creat d5/d9/d36/f12f x:0 0 0 2024-04-23T14:50:07.905 INFO:tasks.workunit.client.1.smithi156.stdout:8/852: mknod d5/d4e/c130 0 2024-04-23T14:50:07.905 INFO:tasks.workunit.client.1.smithi156.stdout:8/853: chown d5/d9/d36/d60/f122 3885 1 2024-04-23T14:50:07.909 INFO:tasks.workunit.client.1.smithi156.stdout:4/814: sync 2024-04-23T14:50:07.909 INFO:tasks.workunit.client.1.smithi156.stdout:9/727: sync 2024-04-23T14:50:07.911 INFO:tasks.workunit.client.1.smithi156.stdout:1/867: dwrite db/d1f/d2d/d48/daf/f74 [0,4194304] 0 2024-04-23T14:50:07.911 INFO:tasks.workunit.client.1.smithi156.stdout:9/728: symlink d1/d2/d3e/d55/d66/dd6/dec/lf1 0 2024-04-23T14:50:07.913 INFO:tasks.workunit.client.1.smithi156.stdout:1/868: creat db/d1f/d2d/d48/dab/dcf/df8/f109 x:0 0 0 2024-04-23T14:50:07.922 INFO:tasks.workunit.client.1.smithi156.stdout:1/869: mknod db/d1f/d28/d70/db3/c10a 0 2024-04-23T14:50:07.931 INFO:tasks.workunit.client.1.smithi156.stdout:3/744: sync 2024-04-23T14:50:07.931 INFO:tasks.workunit.client.1.smithi156.stdout:6/920: sync 2024-04-23T14:50:07.932 INFO:tasks.workunit.client.1.smithi156.stdout:0/850: sync 2024-04-23T14:50:07.934 INFO:tasks.workunit.client.1.smithi156.stdout:3/745: rename d4/db/dd/l69 to d4/db/de2/led 0 2024-04-23T14:50:07.939 INFO:tasks.workunit.client.1.smithi156.stdout:0/851: creat d0/d16/dbf/d3f/d5f/f115 x:0 0 0 2024-04-23T14:50:07.939 INFO:tasks.workunit.client.1.smithi156.stdout:0/852: chown d0/d16/dbf/d3f/d45/l79 624 1 2024-04-23T14:50:07.941 INFO:tasks.workunit.client.1.smithi156.stdout:3/746: creat d4/db/dd/d1d/d1e/d74/d93/dad/fee x:0 0 0 2024-04-23T14:50:07.941 INFO:tasks.workunit.client.1.smithi156.stdout:3/747: dread - d4/db/dd/d1d/d1e/d2b/fc3 zero size 2024-04-23T14:50:07.967 INFO:tasks.workunit.client.1.smithi156.stdout:5/848: dread d1/fc0 [0,4194304] 0 2024-04-23T14:50:07.968 INFO:tasks.workunit.client.1.smithi156.stdout:7/863: dwrite dc/d1d/f32 [0,4194304] 0 2024-04-23T14:50:07.998 INFO:tasks.workunit.client.1.smithi156.stdout:8/854: dwrite d5/d9/d36/d60/db8/fdf [0,4194304] 0 2024-04-23T14:50:08.005 INFO:tasks.workunit.client.1.smithi156.stdout:2/893: dwrite d4/fba [4194304,4194304] 0 2024-04-23T14:50:08.005 INFO:tasks.workunit.client.1.smithi156.stdout:2/894: stat d4/d13/d19/f77 0 2024-04-23T14:50:08.008 INFO:tasks.workunit.client.1.smithi156.stdout:6/921: dwrite d3/da/d74/f134 [0,4194304] 0 2024-04-23T14:50:08.009 INFO:tasks.workunit.client.1.smithi156.stdout:6/922: fsync d3/da/d1d/d27/fb6 0 2024-04-23T14:50:08.013 INFO:tasks.workunit.client.1.smithi156.stdout:8/855: unlink d5/d9/l1b 0 2024-04-23T14:50:08.022 INFO:tasks.workunit.client.1.smithi156.stdout:7/864: read dc/d2a/f92 [590661,39734] 0 2024-04-23T14:50:08.022 INFO:tasks.workunit.client.1.smithi156.stdout:7/865: chown dc/d1d/f52 22663286 1 2024-04-23T14:50:08.022 INFO:tasks.workunit.client.1.smithi156.stdout:7/866: truncate dc/d1d/d24/f7b 853451 0 2024-04-23T14:50:08.023 INFO:tasks.workunit.client.1.smithi156.stdout:7/867: symlink dc/d1d/dba/l111 0 2024-04-23T14:50:08.023 INFO:tasks.workunit.client.1.smithi156.stdout:8/856: dread d5/d9/d10/d1d/fae [0,4194304] 0 2024-04-23T14:50:08.024 INFO:tasks.workunit.client.1.smithi156.stdout:3/748: dwrite d4/db/dd1/fdb [0,4194304] 0 2024-04-23T14:50:08.025 INFO:tasks.workunit.client.1.smithi156.stdout:0/853: dwrite d0/d16/d3a/d2a/d1d/d2d/f85 [0,4194304] 0 2024-04-23T14:50:08.025 INFO:tasks.workunit.client.1.smithi156.stdout:7/868: creat dc/d1d/f112 x:0 0 0 2024-04-23T14:50:08.025 INFO:tasks.workunit.client.1.smithi156.stdout:8/857: mknod d5/d9/d10/d1d/d21/c131 0 2024-04-23T14:50:08.026 INFO:tasks.workunit.client.1.smithi156.stdout:1/870: dwrite db/d1f/fdb [0,4194304] 0 2024-04-23T14:50:08.026 INFO:tasks.workunit.client.1.smithi156.stdout:9/729: dwrite d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/d48/dc2/fa3 [0,4194304] 0 2024-04-23T14:50:08.028 INFO:tasks.workunit.client.1.smithi156.stdout:5/849: dwrite d1/d11/d18/d19/d9a/dbe/fd7 [0,4194304] 0 2024-04-23T14:50:08.031 INFO:tasks.workunit.client.1.smithi156.stdout:6/923: write d3/d16/f85 [256570,74337] 0 2024-04-23T14:50:08.032 INFO:tasks.workunit.client.1.smithi156.stdout:3/749: creat d4/db/dd/d1d/d61/d8d/d8a/d98/fef x:0 0 0 2024-04-23T14:50:08.034 INFO:tasks.workunit.client.1.smithi156.stdout:0/854: link d0/l36 d0/d16/d3a/d2a/d1d/d2d/d6b/l116 0 2024-04-23T14:50:08.037 INFO:tasks.workunit.client.1.smithi156.stdout:7/869: truncate dc/d2a/fce 31600 0 2024-04-23T14:50:08.037 INFO:tasks.workunit.client.1.smithi156.stdout:7/870: fsync dc/d93/d6c/f110 0 2024-04-23T14:50:08.053 INFO:tasks.workunit.client.1.smithi156.stdout:9/730: link d1/d2/d3e/d55/d66/dd6/ded/d17/f82 d1/d2/d3e/d55/d66/dd6/ff2 0 2024-04-23T14:50:08.053 INFO:tasks.workunit.client.1.smithi156.stdout:0/855: dread d0/d16/d3a/d2a/f87 [0,4194304] 0 2024-04-23T14:50:08.061 INFO:tasks.workunit.client.1.smithi156.stdout:5/850: rename d1/d17/d7e to d1/d11/d27/d101 0 2024-04-23T14:50:08.066 INFO:tasks.workunit.client.1.smithi156.stdout:1/871: rmdir db/d1f/d28/d70/db3/dcc 39 2024-04-23T14:50:08.066 INFO:tasks.workunit.client.1.smithi156.stdout:9/731: stat d1/d2/d3e/d55/d66/dd6/ded/dc/cea 0 2024-04-23T14:50:08.066 INFO:tasks.workunit.client.1.smithi156.stdout:9/732: write d1/d2/d3e/d55/d6f/fba [2017829,101185] 0 2024-04-23T14:50:08.072 INFO:tasks.workunit.client.1.smithi156.stdout:5/851: mknod d1/d11/d18/d52/d85/c102 0 2024-04-23T14:50:08.072 INFO:tasks.workunit.client.1.smithi156.stdout:4/815: sync 2024-04-23T14:50:08.073 INFO:tasks.workunit.client.1.smithi156.stdout:1/872: creat db/d15/f10b x:0 0 0 2024-04-23T14:50:08.075 INFO:tasks.workunit.client.1.smithi156.stdout:3/750: rename d4/db/dd/d1d/d1e/d42/d76/dba/cdc to d4/db/dd/d1d/d1e/d74/d93/dc4/cf0 0 2024-04-23T14:50:08.075 INFO:tasks.workunit.client.1.smithi156.stdout:3/751: dread - d4/db/dd/d1d/d1e/d42/f8f zero size 2024-04-23T14:50:08.080 INFO:tasks.workunit.client.1.smithi156.stdout:5/852: mkdir d1/d11/de0/d103 0 2024-04-23T14:50:08.081 INFO:tasks.workunit.client.1.smithi156.stdout:3/752: symlink d4/db/dd/d1d/d1e/d42/d76/dba/de5/lf1 0 2024-04-23T14:50:08.083 INFO:tasks.workunit.client.1.smithi156.stdout:5/853: getdents d1 0 2024-04-23T14:50:08.093 INFO:tasks.workunit.client.1.smithi156.stdout:4/816: write d0/d8/f2f [6709163,29727] 0 2024-04-23T14:50:08.094 INFO:tasks.workunit.client.1.smithi156.stdout:1/873: dread db/d1f/d2f/f55 [0,4194304] 0 2024-04-23T14:50:08.099 INFO:tasks.workunit.client.1.smithi156.stdout:3/753: getdents d4/db/dd/d1d/d1e/d74/d93 0 2024-04-23T14:50:08.099 INFO:tasks.workunit.client.1.smithi156.stdout:1/874: truncate db/d1f/d94/da1/f107 3930948 0 2024-04-23T14:50:08.103 INFO:tasks.workunit.client.1.smithi156.stdout:7/871: dwrite dc/d1d/d24/f62 [4194304,4194304] 0 2024-04-23T14:50:08.104 INFO:tasks.workunit.client.1.smithi156.stdout:4/817: dread d0/d8/f8e [0,4194304] 0 2024-04-23T14:50:08.106 INFO:tasks.workunit.client.1.smithi156.stdout:7/872: mknod dc/d93/d6c/c113 0 2024-04-23T14:50:08.107 INFO:tasks.workunit.client.1.smithi156.stdout:4/818: symlink d0/df/d55/d68/d53/d91/dd1/l10d 0 2024-04-23T14:50:08.110 INFO:tasks.workunit.client.1.smithi156.stdout:7/873: rename dc/d1d/d24/c5e to dc/d46/d58/db7/c114 0 2024-04-23T14:50:08.114 INFO:tasks.workunit.client.1.smithi156.stdout:0/856: dwrite d0/d16/d43/dc2/f7e [0,4194304] 0 2024-04-23T14:50:08.118 INFO:tasks.workunit.client.1.smithi156.stdout:4/819: rename d0/df/d21/c97 to d0/df/d55/d68/d53/d91/d95/db5/d100/c10e 0 2024-04-23T14:50:08.118 INFO:tasks.workunit.client.1.smithi156.stdout:4/820: write d0/d76/f4d [9387247,34174] 0 2024-04-23T14:50:08.119 INFO:tasks.workunit.client.1.smithi156.stdout:3/754: write d4/db/dd/d1d/d1e/d74/d93/dad/fd0 [1512864,93844] 0 2024-04-23T14:50:08.119 INFO:tasks.workunit.client.1.smithi156.stdout:6/924: dwrite d3/da/d1d/d27/dfe/d6e/d8f/f103 [0,4194304] 0 2024-04-23T14:50:08.119 INFO:tasks.workunit.client.1.smithi156.stdout:6/925: truncate d3/da/d1d/d27/dfe/d6e/f95 4842530 0 2024-04-23T14:50:08.123 INFO:tasks.workunit.client.1.smithi156.stdout:8/858: dwrite d5/d9/d10/f34 [0,4194304] 0 2024-04-23T14:50:08.125 INFO:tasks.workunit.client.1.smithi156.stdout:0/857: mkdir d0/d16/d3a/d2a/d1d/d2d/d117 0 2024-04-23T14:50:08.125 INFO:tasks.workunit.client.1.smithi156.stdout:0/858: rename d0/d4/d22 to d0/d4/d22/d58/d9a/d44/d112/d118 22 2024-04-23T14:50:08.125 INFO:tasks.workunit.client.1.smithi156.stdout:0/859: dread - d0/d16/dcd/ded/f104 zero size 2024-04-23T14:50:08.125 INFO:tasks.workunit.client.1.smithi156.stdout:0/860: readlink d0/d16/dbf/d3f/d45/l79 0 2024-04-23T14:50:08.125 INFO:tasks.workunit.client.1.smithi156.stdout:0/861: write d0/d16/d3a/d1e/fc5 [1365867,111045] 0 2024-04-23T14:50:08.129 INFO:tasks.workunit.client.1.smithi156.stdout:4/821: link d0/df/d55/d68/d53/d91/ddc/fff d0/df/d55/d68/f10f 0 2024-04-23T14:50:08.132 INFO:tasks.workunit.client.1.smithi156.stdout:6/926: unlink d3/da/fa2 0 2024-04-23T14:50:08.138 INFO:tasks.workunit.client.1.smithi156.stdout:8/859: truncate d5/d9/d36/d9c/f42 2672476 0 2024-04-23T14:50:08.139 INFO:tasks.workunit.client.1.smithi156.stdout:4/822: rmdir d0/df/d21/dc2 39 2024-04-23T14:50:08.139 INFO:tasks.workunit.client.1.smithi156.stdout:4/823: fsync d0/df/d55/d68/d53/d91/fd7 0 2024-04-23T14:50:08.139 INFO:tasks.workunit.client.1.smithi156.stdout:4/824: truncate d0/df/d55/d68/d53/d91/fc0 63404 0 2024-04-23T14:50:08.144 INFO:tasks.workunit.client.1.smithi156.stdout:4/825: mkdir d0/df/d55/d68/d53/d91/d95/def/d110 0 2024-04-23T14:50:08.144 INFO:tasks.workunit.client.1.smithi156.stdout:4/826: stat d0/df/d75 0 2024-04-23T14:50:08.155 INFO:tasks.workunit.client.1.smithi156.stdout:4/827: getdents d0/df/d55/d68/d53/d91/ddc 0 2024-04-23T14:50:08.157 INFO:tasks.workunit.client.1.smithi156.stdout:4/828: getdents d0/df/d55/d68/d53/d91/d95/db5/d100/d10c 0 2024-04-23T14:50:08.157 INFO:tasks.workunit.client.1.smithi156.stdout:4/829: write d0/df/d55/d68/d85/fa4 [842669,79542] 0 2024-04-23T14:50:08.161 INFO:tasks.workunit.client.1.smithi156.stdout:4/830: creat d0/df/d55/d68/d53/d91/ddc/f111 x:0 0 0 2024-04-23T14:50:08.168 INFO:tasks.workunit.client.1.smithi156.stdout:4/831: mkdir d0/df/d55/d68/d53/d91/dd1/d108/d112 0 2024-04-23T14:50:08.168 INFO:tasks.workunit.client.1.smithi156.stdout:4/832: chown d0/df/d21/dfa 28228 1 2024-04-23T14:50:08.169 INFO:tasks.workunit.client.1.smithi156.stdout:6/927: dread d3/da/d1d/d27/dfe/d3b/d9e/fda [0,4194304] 0 2024-04-23T14:50:08.169 INFO:tasks.workunit.client.1.smithi156.stdout:3/755: dwrite d4/db/dd/d1d/d1e/d13/f79 [0,4194304] 0 2024-04-23T14:50:08.170 INFO:tasks.workunit.client.1.smithi156.stdout:4/833: write d0/df/d55/d68/f43 [838023,93005] 0 2024-04-23T14:50:08.173 INFO:tasks.workunit.client.1.smithi156.stdout:6/928: link d3/da/c13e d3/da/d74/d143/c14c 0 2024-04-23T14:50:08.174 INFO:tasks.workunit.client.1.smithi156.stdout:5/854: dwrite d1/d11/d18/d19/d9a/fb1 [0,4194304] 0 2024-04-23T14:50:08.178 INFO:tasks.workunit.client.1.smithi156.stdout:7/874: dwrite dc/d1d/d41/f9c [0,4194304] 0 2024-04-23T14:50:08.180 INFO:tasks.workunit.client.1.smithi156.stdout:4/834: creat d0/f113 x:0 0 0 2024-04-23T14:50:08.182 INFO:tasks.workunit.client.1.smithi156.stdout:6/929: mkdir d3/d16/d5c/ded/d14d 0 2024-04-23T14:50:08.182 INFO:tasks.workunit.client.1.smithi156.stdout:6/930: stat d3/da/d1d/f35 0 2024-04-23T14:50:08.182 INFO:tasks.workunit.client.1.smithi156.stdout:6/931: stat d3/d16/d119 0 2024-04-23T14:50:08.191 INFO:tasks.workunit.client.1.smithi156.stdout:1/875: dwrite db/d1f/d2d/d48/daf/f74 [4194304,4194304] 0 2024-04-23T14:50:08.193 INFO:tasks.workunit.client.1.smithi156.stdout:0/862: dwrite d0/d16/d3a/d1e/fc5 [0,4194304] 0 2024-04-23T14:50:08.204 INFO:tasks.workunit.client.1.smithi156.stdout:8/860: dwrite d5/d9/d5a/f2e [0,4194304] 0 2024-04-23T14:50:08.204 INFO:tasks.workunit.client.1.smithi156.stdout:8/861: write d5/d9/d10/fe2 [285467,101262] 0 2024-04-23T14:50:08.206 INFO:tasks.workunit.client.1.smithi156.stdout:5/855: rename d1/d3/da6/fe8 to d1/d11/de0/d97/f104 0 2024-04-23T14:50:08.211 INFO:tasks.workunit.client.1.smithi156.stdout:4/835: symlink d0/df/d55/d68/d53/d91/d95/db5/dbe/l114 0 2024-04-23T14:50:08.211 INFO:tasks.workunit.client.1.smithi156.stdout:6/932: creat d3/da/d1d/d27/f14e x:0 0 0 2024-04-23T14:50:08.212 INFO:tasks.workunit.client.1.smithi156.stdout:1/876: symlink db/d1f/d28/d70/db3/dcc/l10c 0 2024-04-23T14:50:08.212 INFO:tasks.workunit.client.1.smithi156.stdout:1/877: rename db/d1f/d2d to db/d1f/d2d/d48/daf/d86/d10d 22 2024-04-23T14:50:08.212 INFO:tasks.workunit.client.1.smithi156.stdout:1/878: write db/d1f/d2f/d47/f5f [4314444,19704] 0 2024-04-23T14:50:08.213 INFO:tasks.workunit.client.1.smithi156.stdout:5/856: mkdir d1/d3/d24/da0/d105 0 2024-04-23T14:50:08.213 INFO:tasks.workunit.client.1.smithi156.stdout:5/857: chown d1/d11/d18/d52/d85/d96/dd3/fd6 5732 1 2024-04-23T14:50:08.220 INFO:tasks.workunit.client.1.smithi156.stdout:0/863: dread d0/d4/fe [0,4194304] 0 2024-04-23T14:50:08.220 INFO:tasks.workunit.client.1.smithi156.stdout:5/858: creat d1/d3/d24/da0/d105/f106 x:0 0 0 2024-04-23T14:50:08.220 INFO:tasks.workunit.client.1.smithi156.stdout:1/879: getdents db/d1f/d2d/d48/daf/d68 0 2024-04-23T14:50:08.222 INFO:tasks.workunit.client.1.smithi156.stdout:0/864: mknod d0/d16/dbf/c119 0 2024-04-23T14:50:08.223 INFO:tasks.workunit.client.1.smithi156.stdout:8/862: dread d5/d4e/f52 [0,4194304] 0 2024-04-23T14:50:08.224 INFO:tasks.workunit.client.1.smithi156.stdout:5/859: creat d1/d11/d18/d52/d85/d96/f107 x:0 0 0 2024-04-23T14:50:08.224 INFO:tasks.workunit.client.1.smithi156.stdout:1/880: rmdir db/d1f/d2d/d85 39 2024-04-23T14:50:08.225 INFO:tasks.workunit.client.1.smithi156.stdout:0/865: creat d0/d16/d3a/f11a x:0 0 0 2024-04-23T14:50:08.228 INFO:tasks.workunit.client.1.smithi156.stdout:8/863: rename d5/d9/d5a/f75 to d5/d39/f132 0 2024-04-23T14:50:08.229 INFO:tasks.workunit.client.1.smithi156.stdout:5/860: symlink d1/d11/d18/d19/d100/l108 0 2024-04-23T14:50:08.230 INFO:tasks.workunit.client.1.smithi156.stdout:1/881: mknod db/d1f/d2f/da9/c10e 0 2024-04-23T14:50:08.232 INFO:tasks.workunit.client.1.smithi156.stdout:0/866: symlink d0/d4/d22/d58/d9a/d44/de5/l11b 0 2024-04-23T14:50:08.232 INFO:tasks.workunit.client.1.smithi156.stdout:0/867: write d0/d16/d3a/d2a/f12 [2278498,106942] 0 2024-04-23T14:50:08.232 INFO:tasks.workunit.client.1.smithi156.stdout:0/868: truncate d0/d16/d3a/d1e/d80/faf 995246 0 2024-04-23T14:50:08.232 INFO:tasks.workunit.client.1.smithi156.stdout:0/869: rename d0 to d0/d16/d43/dc2/d11c 22 2024-04-23T14:50:08.232 INFO:tasks.workunit.client.1.smithi156.stdout:0/870: chown d0/d16/d3a/d2a/d1d/d2d/f5b 1478010 1 2024-04-23T14:50:08.235 INFO:tasks.workunit.client.1.smithi156.stdout:8/864: getdents d5/d9/d5a/d57 0 2024-04-23T14:50:08.235 INFO:tasks.workunit.client.1.smithi156.stdout:1/882: symlink db/d1f/d2d/d93/l10f 0 2024-04-23T14:50:08.238 INFO:tasks.workunit.client.1.smithi156.stdout:3/756: write d4/f86 [1420596,112514] 0 2024-04-23T14:50:08.240 INFO:tasks.workunit.client.1.smithi156.stdout:5/861: truncate d1/d11/d18/f9f 3193464 0 2024-04-23T14:50:08.241 INFO:tasks.workunit.client.1.smithi156.stdout:3/757: creat d4/db/dd/d1d/d1e/d13/d5a/dab/ff2 x:0 0 0 2024-04-23T14:50:08.245 INFO:tasks.workunit.client.1.smithi156.stdout:2/895: sync 2024-04-23T14:50:08.249 INFO:tasks.workunit.client.1.smithi156.stdout:5/862: dread d1/d17/fbb [0,4194304] 0 2024-04-23T14:50:08.252 INFO:tasks.workunit.client.1.smithi156.stdout:9/733: sync 2024-04-23T14:50:08.252 INFO:tasks.workunit.client.1.smithi156.stdout:1/883: dread db/d1f/d2f/f7b [0,4194304] 0 2024-04-23T14:50:08.254 INFO:tasks.workunit.client.1.smithi156.stdout:9/734: mknod d1/d2/d3e/d55/d66/dd6/ded/d40/cf3 0 2024-04-23T14:50:08.254 INFO:tasks.workunit.client.1.smithi156.stdout:9/735: chown d1/d2/d3e/d80/fd2 10093243 1 2024-04-23T14:50:08.254 INFO:tasks.workunit.client.1.smithi156.stdout:9/736: readlink d1/lcd 0 2024-04-23T14:50:08.256 INFO:tasks.workunit.client.1.smithi156.stdout:1/884: getdents db/d1f/d2d/d48/daf 0 2024-04-23T14:50:08.263 INFO:tasks.workunit.client.1.smithi156.stdout:0/871: dread d0/d16/dbf/d3f/d5f/f35 [0,4194304] 0 2024-04-23T14:50:08.263 INFO:tasks.workunit.client.1.smithi156.stdout:0/872: truncate d0/d16/d43/fe4 532848 0 2024-04-23T14:50:08.276 INFO:tasks.workunit.client.1.smithi156.stdout:7/875: dwrite dc/d1d/d24/d5a/faa [4194304,4194304] 0 2024-04-23T14:50:08.278 INFO:tasks.workunit.client.1.smithi156.stdout:2/896: read d4/d21/f96 [4125006,69166] 0 2024-04-23T14:50:08.278 INFO:tasks.workunit.client.1.smithi156.stdout:2/897: stat d4/d13/d19/d4c/d5c/dd5/de2 0 2024-04-23T14:50:08.287 INFO:tasks.workunit.client.1.smithi156.stdout:2/898: mkdir d4/d13/d19/d13c 0 2024-04-23T14:50:08.290 INFO:tasks.workunit.client.1.smithi156.stdout:2/899: creat d4/d13/d19/d4c/f13d x:0 0 0 2024-04-23T14:50:08.307 INFO:tasks.workunit.client.1.smithi156.stdout:1/885: write db/d1f/d2f/d47/f5f [3086479,75095] 0 2024-04-23T14:50:08.308 INFO:tasks.workunit.client.1.smithi156.stdout:1/886: readlink db/d15/l3e 0 2024-04-23T14:50:08.308 INFO:tasks.workunit.client.1.smithi156.stdout:1/887: stat db/d25/d30/d38/d40/l49 0 2024-04-23T14:50:08.327 INFO:tasks.workunit.client.1.smithi156.stdout:0/873: dread d0/d16/d3a/d2a/f2c [4194304,4194304] 0 2024-04-23T14:50:08.332 INFO:tasks.workunit.client.1.smithi156.stdout:7/876: write dc/d93/d6c/fda [3072828,25364] 0 2024-04-23T14:50:08.334 INFO:tasks.workunit.client.1.smithi156.stdout:8/865: dwrite d5/d9/d10/d1d/d21/fd2 [0,4194304] 0 2024-04-23T14:50:08.336 INFO:tasks.workunit.client.1.smithi156.stdout:7/877: creat dc/d46/dca/df8/d104/d106/f115 x:0 0 0 2024-04-23T14:50:08.338 INFO:tasks.workunit.client.1.smithi156.stdout:8/866: symlink d5/d9/d36/d60/d62/l133 0 2024-04-23T14:50:08.338 INFO:tasks.workunit.client.1.smithi156.stdout:8/867: chown d5/d9/d5a/d57/l78 114450760 1 2024-04-23T14:50:08.347 INFO:tasks.workunit.client.1.smithi156.stdout:8/868: rmdir d5/d39 39 2024-04-23T14:50:08.347 INFO:tasks.workunit.client.1.smithi156.stdout:2/900: dread d4/d21/d2f/fe0 [0,4194304] 0 2024-04-23T14:50:08.347 INFO:tasks.workunit.client.1.smithi156.stdout:2/901: stat d4/d13/d19/d58/ce4 0 2024-04-23T14:50:08.352 INFO:tasks.workunit.client.1.smithi156.stdout:8/869: symlink d5/d4e/dc7/d128/l134 0 2024-04-23T14:50:08.353 INFO:tasks.workunit.client.1.smithi156.stdout:8/870: write d5/d9/d36/d84/dc1/dcf/fda [1504608,96433] 0 2024-04-23T14:50:08.353 INFO:tasks.workunit.client.1.smithi156.stdout:8/871: truncate d5/d9/d5a/d5c/f10a 1430647 0 2024-04-23T14:50:08.353 INFO:tasks.workunit.client.1.smithi156.stdout:8/872: truncate d5/d9/d10/d1d/d21/f22 4676111 0 2024-04-23T14:50:08.353 INFO:tasks.workunit.client.1.smithi156.stdout:8/873: fdatasync d5/d9/d36/db5/d98/fc3 0 2024-04-23T14:50:08.353 INFO:tasks.workunit.client.1.smithi156.stdout:4/836: dwrite d0/df/d55/fcf [0,4194304] 0 2024-04-23T14:50:08.353 INFO:tasks.workunit.client.1.smithi156.stdout:2/902: link d4/d13/d19/de8/f101 d4/d13/d19/d4c/d5c/dd5/de2/df5/f13e 0 2024-04-23T14:50:08.353 INFO:tasks.workunit.client.1.smithi156.stdout:4/837: write d0/df/d55/d68/d53/d91/fc0 [538917,108804] 0 2024-04-23T14:50:08.353 INFO:tasks.workunit.client.1.smithi156.stdout:3/758: dwrite d4/db/dd/d1d/f36 [0,4194304] 0 2024-04-23T14:50:08.354 INFO:tasks.workunit.client.1.smithi156.stdout:1/888: write db/f17 [11338742,32375] 0 2024-04-23T14:50:08.364 INFO:tasks.workunit.client.1.smithi156.stdout:2/903: mknod d4/d13/d19/d4c/d5c/dd5/de2/d137/c13f 0 2024-04-23T14:50:08.364 INFO:tasks.workunit.client.1.smithi156.stdout:2/904: creat d4/d21/d42/da1/f140 x:0 0 0 2024-04-23T14:50:08.364 INFO:tasks.workunit.client.1.smithi156.stdout:3/759: mkdir d4/df3 0 2024-04-23T14:50:08.364 INFO:tasks.workunit.client.1.smithi156.stdout:3/760: readlink d4/db/dd/d1d/d1e/d13/d5a/l97 0 2024-04-23T14:50:08.364 INFO:tasks.workunit.client.1.smithi156.stdout:4/838: dread d0/df/d55/d68/d53/d9f/dcc/fe4 [0,4194304] 0 2024-04-23T14:50:08.365 INFO:tasks.workunit.client.1.smithi156.stdout:4/839: fdatasync d0/df/d55/f106 0 2024-04-23T14:50:08.369 INFO:tasks.workunit.client.1.smithi156.stdout:2/905: dread - d4/d13/d19/d97/d104/d10e/f12f zero size 2024-04-23T14:50:08.385 INFO:tasks.workunit.client.1.smithi156.stdout:0/874: dread d0/d16/d3a/d2a/f12 [0,4194304] 0 2024-04-23T14:50:08.389 INFO:tasks.workunit.client.1.smithi156.stdout:2/906: mkdir d4/d21/d76/d141 0 2024-04-23T14:50:08.390 INFO:tasks.workunit.client.1.smithi156.stdout:4/840: dread d0/df/d55/d68/d53/d91/d95/fba [0,4194304] 0 2024-04-23T14:50:08.391 INFO:tasks.workunit.client.1.smithi156.stdout:5/863: dwrite d1/d11/d18/d19/f36 [0,4194304] 0 2024-04-23T14:50:08.398 INFO:tasks.workunit.client.1.smithi156.stdout:2/907: unlink d4/d13/d19/d4c/d5c/dd5/de2/d137/c13f 0 2024-04-23T14:50:08.401 INFO:tasks.workunit.client.1.smithi156.stdout:5/864: creat d1/d11/d18/d52/d75/f109 x:0 0 0 2024-04-23T14:50:08.401 INFO:tasks.workunit.client.1.smithi156.stdout:5/865: chown d1/d11/d18/c55 1182264 1 2024-04-23T14:50:08.407 INFO:tasks.workunit.client.1.smithi156.stdout:2/908: mknod d4/d21/d2f/c142 0 2024-04-23T14:50:08.413 INFO:tasks.workunit.client.1.smithi156.stdout:4/841: dread d0/df/d55/d68/d53/d91/d95/ff2 [0,4194304] 0 2024-04-23T14:50:08.413 INFO:tasks.workunit.client.1.smithi156.stdout:6/933: dwrite d3/da/d74/fcb [0,4194304] 0 2024-04-23T14:50:08.421 INFO:tasks.workunit.client.1.smithi156.stdout:8/874: dwrite d5/d39/ffc [0,4194304] 0 2024-04-23T14:50:08.425 INFO:tasks.workunit.client.1.smithi156.stdout:4/842: link d0/d8/d1e/d4a/d77/d9c/fc5 d0/df/d55/d68/d53/d91/d95/db5/dbe/f115 0 2024-04-23T14:50:08.428 INFO:tasks.workunit.client.1.smithi156.stdout:6/934: creat d3/d16/d5c/f14f x:0 0 0 2024-04-23T14:50:08.428 INFO:tasks.workunit.client.1.smithi156.stdout:3/761: dwrite d4/db/dd/d1d/d1e/d13/f34 [0,4194304] 0 2024-04-23T14:50:08.431 INFO:tasks.workunit.client.1.smithi156.stdout:7/878: dwrite dc/d1d/d48/fdb [0,4194304] 0 2024-04-23T14:50:08.452 INFO:tasks.workunit.client.1.smithi156.stdout:6/935: rmdir d3/da/d1d/d27/dfe/d6e 39 2024-04-23T14:50:08.452 INFO:tasks.workunit.client.1.smithi156.stdout:6/936: chown d3/d16/d1e/f5f 9040 1 2024-04-23T14:50:08.452 INFO:tasks.workunit.client.1.smithi156.stdout:6/937: write d3/d16/d46/d9d/fe7 [508775,8281] 0 2024-04-23T14:50:08.458 INFO:tasks.workunit.client.1.smithi156.stdout:3/762: symlink d4/db/dd/d1d/d1e/d42/d76/dba/lf4 0 2024-04-23T14:50:08.460 INFO:tasks.workunit.client.1.smithi156.stdout:7/879: mknod dc/d2c/dbe/d102/c116 0 2024-04-23T14:50:08.462 INFO:tasks.workunit.client.1.smithi156.stdout:6/938: mknod d3/d16/d46/d9d/d9f/dad/dcd/c150 0 2024-04-23T14:50:08.463 INFO:tasks.workunit.client.1.smithi156.stdout:6/939: mknod d3/da/d74/d143/df3/c151 0 2024-04-23T14:50:08.464 INFO:tasks.workunit.client.1.smithi156.stdout:6/940: write d3/da/d74/d143/df3/f123 [34271,101163] 0 2024-04-23T14:50:08.478 INFO:tasks.workunit.client.1.smithi156.stdout:8/875: write d5/d9/d36/d60/f89 [23664,110725] 0 2024-04-23T14:50:08.489 INFO:tasks.workunit.client.1.smithi156.stdout:8/876: link d5/d9/d36/d9c/l3d d5/d9/d36/d60/db8/d93/d96/dc0/d11c/l135 0 2024-04-23T14:50:08.502 INFO:tasks.workunit.client.1.smithi156.stdout:3/763: dread d4/db/dd/d1d/d1e/d42/d76/dba/fc5 [0,4194304] 0 2024-04-23T14:50:08.502 INFO:tasks.workunit.client.1.smithi156.stdout:0/875: dwrite d0/d4/d22/f34 [0,4194304] 0 2024-04-23T14:50:08.505 INFO:tasks.workunit.client.1.smithi156.stdout:3/764: symlink d4/db/dd/d1d/d1e/d13/d5a/dab/lf5 0 2024-04-23T14:50:08.509 INFO:tasks.workunit.client.1.smithi156.stdout:2/909: dwrite d4/d13/d19/d58/f64 [0,4194304] 0 2024-04-23T14:50:08.509 INFO:tasks.workunit.client.1.smithi156.stdout:2/910: chown d4/d13/d19/d4c/l9c 966114 1 2024-04-23T14:50:08.509 INFO:tasks.workunit.client.1.smithi156.stdout:2/911: write d4/d26/d3c/dca/f10c [72974,29687] 0 2024-04-23T14:50:08.511 INFO:tasks.workunit.client.1.smithi156.stdout:3/765: getdents d4/db/dd/d1d/d1e/d42/d76/dba/de5 0 2024-04-23T14:50:08.511 INFO:tasks.workunit.client.1.smithi156.stdout:3/766: chown d4/l5 13 1 2024-04-23T14:50:08.513 INFO:tasks.workunit.client.1.smithi156.stdout:0/876: rename d0/d16/dbf/d3f/d5f/db2/ce3 to d0/d16/d8e/c11d 0 2024-04-23T14:50:08.513 INFO:tasks.workunit.client.1.smithi156.stdout:8/877: write d5/d9/d10/fa2 [666339,44713] 0 2024-04-23T14:50:08.515 INFO:tasks.workunit.client.1.smithi156.stdout:5/866: dwrite d1/d11/de0/ffd [0,4194304] 0 2024-04-23T14:50:08.515 INFO:tasks.workunit.client.1.smithi156.stdout:5/867: fdatasync d1/d11/de0/f73 0 2024-04-23T14:50:08.520 INFO:tasks.workunit.client.1.smithi156.stdout:4/843: dwrite d0/df/d55/d68/d53/d91/d95/ff2 [0,4194304] 0 2024-04-23T14:50:08.522 INFO:tasks.workunit.client.1.smithi156.stdout:6/941: dwrite d3/da/d1d/d27/fb6 [4194304,4194304] 0 2024-04-23T14:50:08.530 INFO:tasks.workunit.client.1.smithi156.stdout:0/877: getdents d0/d16/d3a/d2a/d1d/da8 0 2024-04-23T14:50:08.531 INFO:tasks.workunit.client.1.smithi156.stdout:3/767: mkdir d4/db/dd/d1d/d1e/d42/d76/dba/de5/df6 0 2024-04-23T14:50:08.531 INFO:tasks.workunit.client.1.smithi156.stdout:3/768: chown d4/f10 16597028 1 2024-04-23T14:50:08.538 INFO:tasks.workunit.client.1.smithi156.stdout:5/868: rmdir d1/d11/d18/d19/d9a/dbe 39 2024-04-23T14:50:08.538 INFO:tasks.workunit.client.1.smithi156.stdout:5/869: write d1/d3/da6/d86/fba [850600,88856] 0 2024-04-23T14:50:08.551 INFO:tasks.workunit.client.1.smithi156.stdout:2/912: rename d4/d13/d19/d97/l99 to d4/d13/d19/de8/dfb/l143 0 2024-04-23T14:50:08.551 INFO:tasks.workunit.client.1.smithi156.stdout:2/913: truncate d4/d13/d19/d97/d104/f119 477541 0 2024-04-23T14:50:08.552 INFO:tasks.workunit.client.1.smithi156.stdout:0/878: creat d0/d16/d43/d9c/dff/f11e x:0 0 0 2024-04-23T14:50:08.552 INFO:tasks.workunit.client.1.smithi156.stdout:0/879: fdatasync d0/d16/d8e/fe9 0 2024-04-23T14:50:08.552 INFO:tasks.workunit.client.1.smithi156.stdout:0/880: readlink d0/d4/d22/d58/d9a/d44/l64 0 2024-04-23T14:50:08.552 INFO:tasks.workunit.client.1.smithi156.stdout:5/870: mknod d1/d11/d18/d19/d9a/c10a 0 2024-04-23T14:50:08.556 INFO:tasks.workunit.client.1.smithi156.stdout:2/914: mknod d4/d26/d3c/c144 0 2024-04-23T14:50:08.569 INFO:tasks.workunit.client.1.smithi156.stdout:5/871: getdents d1/d11/d18/d19/d100 0 2024-04-23T14:50:08.574 INFO:tasks.workunit.client.1.smithi156.stdout:2/915: rename d4/d13/d19/d4c/d5c/ffd to d4/d132/f145 0 2024-04-23T14:50:08.575 INFO:tasks.workunit.client.1.smithi156.stdout:5/872: mknod d1/d3/d43/c10b 0 2024-04-23T14:50:08.578 INFO:tasks.workunit.client.1.smithi156.stdout:9/737: sync 2024-04-23T14:50:08.581 INFO:tasks.workunit.client.1.smithi156.stdout:2/916: unlink d4/d13/l12c 0 2024-04-23T14:50:08.582 INFO:tasks.workunit.client.1.smithi156.stdout:2/917: chown d4/d13/d19/d97 1254086 1 2024-04-23T14:50:08.582 INFO:tasks.workunit.client.1.smithi156.stdout:1/889: sync 2024-04-23T14:50:08.584 INFO:tasks.workunit.client.1.smithi156.stdout:3/769: dwrite d4/db/dd/d1d/d61/d8d/f72 [4194304,4194304] 0 2024-04-23T14:50:08.584 INFO:tasks.workunit.client.1.smithi156.stdout:4/844: dwrite d0/d8/d1e/d4a/f50 [4194304,4194304] 0 2024-04-23T14:50:08.587 INFO:tasks.workunit.client.1.smithi156.stdout:6/942: write d3/d16/f37 [1167362,103804] 0 2024-04-23T14:50:08.587 INFO:tasks.workunit.client.1.smithi156.stdout:2/918: mkdir d4/d13/d88/d146 0 2024-04-23T14:50:08.589 INFO:tasks.workunit.client.1.smithi156.stdout:4/845: creat d0/d76/f116 x:0 0 0 2024-04-23T14:50:08.598 INFO:tasks.workunit.client.1.smithi156.stdout:8/878: dwrite d5/d9/d36/d60/d7c/fac [0,4194304] 0 2024-04-23T14:50:08.600 INFO:tasks.workunit.client.1.smithi156.stdout:6/943: mkdir d3/da/d1d/d27/dfe/d6e/d152 0 2024-04-23T14:50:08.610 INFO:tasks.workunit.client.1.smithi156.stdout:8/879: creat d5/d9/d10/d1d/d21/df1/f136 x:0 0 0 2024-04-23T14:50:08.613 INFO:tasks.workunit.client.1.smithi156.stdout:7/880: dwrite dc/d1d/d24/f4a [8388608,4194304] 0 2024-04-23T14:50:08.614 INFO:tasks.workunit.client.1.smithi156.stdout:2/919: symlink d4/l147 0 2024-04-23T14:50:08.619 INFO:tasks.workunit.client.1.smithi156.stdout:9/738: dread d1/d2/d8c/fe4 [4194304,4194304] 0 2024-04-23T14:50:08.619 INFO:tasks.workunit.client.1.smithi156.stdout:6/944: dread d3/da/f131 [0,4194304] 0 2024-04-23T14:50:08.619 INFO:tasks.workunit.client.1.smithi156.stdout:6/945: write d3/d16/d5c/d6a/f13d [414256,19767] 0 2024-04-23T14:50:08.621 INFO:tasks.workunit.client.1.smithi156.stdout:5/873: rmdir d1/d11 39 2024-04-23T14:50:08.622 INFO:tasks.workunit.client.1.smithi156.stdout:2/920: mkdir d4/d13/d19/d148 0 2024-04-23T14:50:08.625 INFO:tasks.workunit.client.1.smithi156.stdout:9/739: creat d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/d48/dc2/ff4 x:0 0 0 2024-04-23T14:50:08.631 INFO:tasks.workunit.client.1.smithi156.stdout:2/921: mkdir d4/d21/d42/d9f/d149 0 2024-04-23T14:50:08.636 INFO:tasks.workunit.client.1.smithi156.stdout:9/740: mkdir d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/d48/d4e/df5 0 2024-04-23T14:50:08.637 INFO:tasks.workunit.client.1.smithi156.stdout:9/741: fsync d1/d2/d8c/fe4 0 2024-04-23T14:50:08.641 INFO:tasks.workunit.client.1.smithi156.stdout:6/946: write d3/da/f18 [8269601,40143] 0 2024-04-23T14:50:08.641 INFO:tasks.workunit.client.1.smithi156.stdout:6/947: dread - d3/da/d1d/d27/dfe/d3b/fd9 zero size 2024-04-23T14:50:08.641 INFO:tasks.workunit.client.1.smithi156.stdout:2/922: creat d4/d13/d19/d58/dfe/d114/d117/d110/f14a x:0 0 0 2024-04-23T14:50:08.645 INFO:tasks.workunit.client.1.smithi156.stdout:9/742: mknod d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/d48/d4e/cf6 0 2024-04-23T14:50:08.646 INFO:tasks.workunit.client.1.smithi156.stdout:3/770: dwrite d4/db/dd/d1d/d1e/d13/f79 [0,4194304] 0 2024-04-23T14:50:08.647 INFO:tasks.workunit.client.1.smithi156.stdout:6/948: mkdir d3/d16/d46/d9d/d9f/de2/d153 0 2024-04-23T14:50:08.648 INFO:tasks.workunit.client.1.smithi156.stdout:6/949: write d3/d16/d5c/d6a/fc9 [981105,31545] 0 2024-04-23T14:50:08.651 INFO:tasks.workunit.client.1.smithi156.stdout:2/923: unlink d4/d13/l122 0 2024-04-23T14:50:08.652 INFO:tasks.workunit.client.1.smithi156.stdout:2/924: creat d4/d13/d19/d4c/d5c/f14b x:0 0 0 2024-04-23T14:50:08.652 INFO:tasks.workunit.client.1.smithi156.stdout:2/925: write d4/d21/d76/fcb [2766999,22625] 0 2024-04-23T14:50:08.658 INFO:tasks.workunit.client.1.smithi156.stdout:9/743: getdents d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/d48 0 2024-04-23T14:50:08.658 INFO:tasks.workunit.client.1.smithi156.stdout:9/744: fdatasync d1/d2/d23/d49/d4c/fb5 0 2024-04-23T14:50:08.658 INFO:tasks.workunit.client.1.smithi156.stdout:9/745: chown d1/d2/d3e/d55/d66/dd6/ded/d19/f89 445268 1 2024-04-23T14:50:08.658 INFO:tasks.workunit.client.1.smithi156.stdout:9/746: getdents d1/d2/d23/d49/d4b/dbc 0 2024-04-23T14:50:08.658 INFO:tasks.workunit.client.1.smithi156.stdout:9/747: stat d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/d48/dd7 0 2024-04-23T14:50:08.659 INFO:tasks.workunit.client.1.smithi156.stdout:0/881: dwrite d0/d16/d3a/d2a/d1d/d2d/f85 [0,4194304] 0 2024-04-23T14:50:08.659 INFO:tasks.workunit.client.1.smithi156.stdout:6/950: creat d3/d16/d5c/ded/f154 x:0 0 0 2024-04-23T14:50:08.660 INFO:tasks.workunit.client.1.smithi156.stdout:6/951: fdatasync d3/da/d1d/d27/dfe/d3b/d9e/fe4 0 2024-04-23T14:50:08.662 INFO:tasks.workunit.client.1.smithi156.stdout:1/890: dwrite db/d25/d30/d38/f9f [4194304,4194304] 0 2024-04-23T14:50:08.665 INFO:tasks.workunit.client.1.smithi156.stdout:5/874: dread d1/d11/d18/d52/d85/d96/dd3/fd6 [0,4194304] 0 2024-04-23T14:50:08.665 INFO:tasks.workunit.client.1.smithi156.stdout:5/875: chown d1/d11/d18/d19/d9a/ff2 14 1 2024-04-23T14:50:08.672 INFO:tasks.workunit.client.1.smithi156.stdout:0/882: rename d0/d16/dbf/d3f/c61 to d0/d16/d3a/d1e/d80/c11f 0 2024-04-23T14:50:08.672 INFO:tasks.workunit.client.1.smithi156.stdout:7/881: dread dc/d1d/d41/f9c [0,4194304] 0 2024-04-23T14:50:08.676 INFO:tasks.workunit.client.1.smithi156.stdout:2/926: rmdir d4/d21/d42/d9f 39 2024-04-23T14:50:08.676 INFO:tasks.workunit.client.1.smithi156.stdout:9/748: write d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/d48/f91 [458857,60325] 0 2024-04-23T14:50:08.677 INFO:tasks.workunit.client.1.smithi156.stdout:9/749: write d1/d2/d3e/fcb [264892,80444] 0 2024-04-23T14:50:08.677 INFO:tasks.workunit.client.1.smithi156.stdout:9/750: fdatasync d1/d2/d3e/d55/d6f/fa4 0 2024-04-23T14:50:08.677 INFO:tasks.workunit.client.1.smithi156.stdout:9/751: read - d1/d2/d3e/d80/fd2 zero size 2024-04-23T14:50:08.678 INFO:tasks.workunit.client.1.smithi156.stdout:4/846: dwrite d0/d8/fd [0,4194304] 0 2024-04-23T14:50:08.679 INFO:tasks.workunit.client.1.smithi156.stdout:4/847: stat d0/df/d55/d68/d53/d91/ddc/fff 0 2024-04-23T14:50:08.682 INFO:tasks.workunit.client.1.smithi156.stdout:4/848: write d0/df/d55/d68/d85/fa4 [471496,114420] 0 2024-04-23T14:50:08.685 INFO:tasks.workunit.client.1.smithi156.stdout:6/952: rename d3/c6 to d3/d16/d46/c155 0 2024-04-23T14:50:08.686 INFO:tasks.workunit.client.1.smithi156.stdout:2/927: stat d4/d13/d19/l1c 0 2024-04-23T14:50:08.688 INFO:tasks.workunit.client.1.smithi156.stdout:1/891: dread db/d1f/d94/da1/fc7 [4194304,4194304] 0 2024-04-23T14:50:08.688 INFO:tasks.workunit.client.1.smithi156.stdout:1/892: chown db/d25/d30/d38/d40/l7e 78988279 1 2024-04-23T14:50:08.689 INFO:tasks.workunit.client.1.smithi156.stdout:1/893: chown db/d25/f3d 1 1 2024-04-23T14:50:08.703 INFO:tasks.workunit.client.1.smithi156.stdout:9/752: creat d1/d2/d8c/ff7 x:0 0 0 2024-04-23T14:50:08.704 INFO:tasks.workunit.client.1.smithi156.stdout:4/849: symlink d0/df/d55/d68/d53/d9f/dcc/l117 0 2024-04-23T14:50:08.708 INFO:tasks.workunit.client.1.smithi156.stdout:1/894: write db/d1f/d94/da1/fc7 [888328,111852] 0 2024-04-23T14:50:08.708 INFO:tasks.workunit.client.1.smithi156.stdout:7/882: getdents dc/d2c/dbe/dc2 0 2024-04-23T14:50:08.708 INFO:tasks.workunit.client.1.smithi156.stdout:6/953: unlink d3/da/d1d/fb5 0 2024-04-23T14:50:08.708 INFO:tasks.workunit.client.1.smithi156.stdout:2/928: creat d4/d13/d19/de8/dfb/f14c x:0 0 0 2024-04-23T14:50:08.708 INFO:tasks.workunit.client.1.smithi156.stdout:2/929: chown d4/d13/d19/d148 330621113 1 2024-04-23T14:50:08.708 INFO:tasks.workunit.client.1.smithi156.stdout:2/930: dread - d4/d13/d19/d58/dfe/d114/d117/d8e/dfa/ffc zero size 2024-04-23T14:50:08.708 INFO:tasks.workunit.client.1.smithi156.stdout:2/931: readlink d4/d13/d19/lef 0 2024-04-23T14:50:08.709 INFO:tasks.workunit.client.1.smithi156.stdout:2/932: chown d4/fe1 79675789 1 2024-04-23T14:50:08.709 INFO:tasks.workunit.client.1.smithi156.stdout:2/933: write d4/d21/d42/f43 [1065654,46347] 0 2024-04-23T14:50:08.709 INFO:tasks.workunit.client.1.smithi156.stdout:2/934: dread - d4/d13/d19/d58/dfe/d114/d117/d8e/dfa/ffc zero size 2024-04-23T14:50:08.709 INFO:tasks.workunit.client.1.smithi156.stdout:2/935: write d4/d13/d19/d58/dfe/d114/d117/f134 [606043,34508] 0 2024-04-23T14:50:08.709 INFO:tasks.workunit.client.1.smithi156.stdout:2/936: write d4/d21/d42/f5e [1423001,44609] 0 2024-04-23T14:50:08.709 INFO:tasks.workunit.client.1.smithi156.stdout:9/753: link d1/cb d1/d2/d3e/d80/cf8 0 2024-04-23T14:50:08.709 INFO:tasks.workunit.client.1.smithi156.stdout:9/754: readlink d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/d48/l64 0 2024-04-23T14:50:08.720 INFO:tasks.workunit.client.1.smithi156.stdout:7/883: symlink dc/d46/dca/l117 0 2024-04-23T14:50:08.720 INFO:tasks.workunit.client.1.smithi156.stdout:7/884: chown dc/d2c/l38 3063 1 2024-04-23T14:50:08.720 INFO:tasks.workunit.client.1.smithi156.stdout:7/885: stat dc/d9d/dd2/ce8 0 2024-04-23T14:50:08.720 INFO:tasks.workunit.client.1.smithi156.stdout:2/937: write d4/d13/d19/d58/fbf [307041,92668] 0 2024-04-23T14:50:08.720 INFO:tasks.workunit.client.1.smithi156.stdout:7/886: dread - dc/d93/d6c/fd7 zero size 2024-04-23T14:50:08.720 INFO:tasks.workunit.client.1.smithi156.stdout:2/938: chown d4/d26/l109 83 1 2024-04-23T14:50:08.721 INFO:tasks.workunit.client.1.smithi156.stdout:3/771: dwrite d4/db/dd/d1d/f2e [0,4194304] 0 2024-04-23T14:50:08.722 INFO:tasks.workunit.client.1.smithi156.stdout:1/895: dread db/d1f/f7a [0,4194304] 0 2024-04-23T14:50:08.726 INFO:tasks.workunit.client.1.smithi156.stdout:7/887: creat dc/d46/d58/db7/ddd/f118 x:0 0 0 2024-04-23T14:50:08.727 INFO:tasks.workunit.client.1.smithi156.stdout:7/888: write dc/d1d/d24/f27 [2846006,87082] 0 2024-04-23T14:50:08.727 INFO:tasks.workunit.client.1.smithi156.stdout:7/889: fdatasync dc/d46/dca/df8/f10a 0 2024-04-23T14:50:08.730 INFO:tasks.workunit.client.1.smithi156.stdout:9/755: dread d1/d2/d3e/d50/f99 [0,4194304] 0 2024-04-23T14:50:08.731 INFO:tasks.workunit.client.1.smithi156.stdout:6/954: read d3/d16/d10b/d77/fb7 [4075889,46429] 0 2024-04-23T14:50:08.732 INFO:tasks.workunit.client.1.smithi156.stdout:3/772: mknod d4/db/dd/d1d/d61/d8d/d8a/cf7 0 2024-04-23T14:50:08.732 INFO:tasks.workunit.client.1.smithi156.stdout:7/890: mkdir dc/d2c/dbe/dc2/d119 0 2024-04-23T14:50:08.733 INFO:tasks.workunit.client.1.smithi156.stdout:7/891: fsync dc/d1d/d24/d5a/f76 0 2024-04-23T14:50:08.734 INFO:tasks.workunit.client.1.smithi156.stdout:6/955: mkdir d3/d16/d1e/d118/d156 0 2024-04-23T14:50:08.734 INFO:tasks.workunit.client.1.smithi156.stdout:6/956: dread - d3/da/d74/d143/d72/dcc/ffc zero size 2024-04-23T14:50:08.734 INFO:tasks.workunit.client.1.smithi156.stdout:6/957: fdatasync d3/da/d74/fef 0 2024-04-23T14:50:08.735 INFO:tasks.workunit.client.1.smithi156.stdout:7/892: symlink dc/d1d/d24/dc9/l11a 0 2024-04-23T14:50:08.737 INFO:tasks.workunit.client.1.smithi156.stdout:6/958: symlink d3/d16/d10b/l157 0 2024-04-23T14:50:08.737 INFO:tasks.workunit.client.1.smithi156.stdout:6/959: fsync d3/d16/d46/d9d/d9f/f111 0 2024-04-23T14:50:08.739 INFO:tasks.workunit.client.1.smithi156.stdout:7/893: mknod dc/d9d/c11b 0 2024-04-23T14:50:08.741 INFO:tasks.workunit.client.1.smithi156.stdout:7/894: mknod dc/d93/d6c/d88/c11c 0 2024-04-23T14:50:08.745 INFO:tasks.workunit.client.1.smithi156.stdout:6/960: rename d3/da/d1d/d27/l42 to d3/da/d1d/d27/dfe/d97/dc8/d120/l158 0 2024-04-23T14:50:08.758 INFO:tasks.workunit.client.1.smithi156.stdout:6/961: truncate d3/d16/d1e/f5f 1417161 0 2024-04-23T14:50:08.758 INFO:tasks.workunit.client.1.smithi156.stdout:5/876: dwrite d1/d17/f2e [0,4194304] 0 2024-04-23T14:50:08.763 INFO:tasks.workunit.client.1.smithi156.stdout:5/877: link d1/d11/d18/c2f d1/d11/d18/d19/d100/c10c 0 2024-04-23T14:50:08.764 INFO:tasks.workunit.client.1.smithi156.stdout:5/878: readlink d1/d3/l8f 0 2024-04-23T14:50:08.764 INFO:tasks.workunit.client.1.smithi156.stdout:5/879: fdatasync d1/fe2 0 2024-04-23T14:50:08.764 INFO:tasks.workunit.client.1.smithi156.stdout:5/880: chown d1/d3/d24/c78 1 1 2024-04-23T14:50:08.770 INFO:tasks.workunit.client.1.smithi156.stdout:5/881: rename d1/d11/d18/d19/d9a/dbe/fd7 to d1/d11/de0/f10d 0 2024-04-23T14:50:08.783 INFO:tasks.workunit.client.1.smithi156.stdout:4/850: dwrite d0/df/d55/d68/f65 [4194304,4194304] 0 2024-04-23T14:50:08.786 INFO:tasks.workunit.client.1.smithi156.stdout:4/851: mkdir d0/df/d55/d68/d53/d9f/dcc/df1/d118 0 2024-04-23T14:50:08.788 INFO:tasks.workunit.client.1.smithi156.stdout:4/852: mkdir d0/df/d119 0 2024-04-23T14:50:08.790 INFO:tasks.workunit.client.1.smithi156.stdout:4/853: link d0/df/d55/d68/c59 d0/df/d119/c11a 0 2024-04-23T14:50:08.792 INFO:tasks.workunit.client.1.smithi156.stdout:4/854: mknod d0/df/d55/d68/d53/d9f/dcc/df1/d8a/c11b 0 2024-04-23T14:50:08.802 INFO:tasks.workunit.client.1.smithi156.stdout:2/939: dwrite d4/d13/d19/d97/fa0 [0,4194304] 0 2024-04-23T14:50:08.807 INFO:tasks.workunit.client.1.smithi156.stdout:2/940: truncate d4/d21/d42/f89 1624144 0 2024-04-23T14:50:08.807 INFO:tasks.workunit.client.1.smithi156.stdout:0/883: dwrite d0/d16/d3a/d1e/f77 [4194304,4194304] 0 2024-04-23T14:50:08.810 INFO:tasks.workunit.client.1.smithi156.stdout:1/896: dwrite db/d25/d30/d38/f73 [0,4194304] 0 2024-04-23T14:50:08.810 INFO:tasks.workunit.client.1.smithi156.stdout:1/897: chown db/d1f/f76 5 1 2024-04-23T14:50:08.810 INFO:tasks.workunit.client.1.smithi156.stdout:0/884: unlink d0/d4/f4e 0 2024-04-23T14:50:08.814 INFO:tasks.workunit.client.1.smithi156.stdout:1/898: rmdir db/d1f/d2d/d85 39 2024-04-23T14:50:08.818 INFO:tasks.workunit.client.1.smithi156.stdout:1/899: rmdir db/d1f/d2f/da9 39 2024-04-23T14:50:08.821 INFO:tasks.workunit.client.1.smithi156.stdout:1/900: mknod db/d1f/d2d/d93/c110 0 2024-04-23T14:50:08.826 INFO:tasks.workunit.client.1.smithi156.stdout:1/901: creat db/d25/f111 x:0 0 0 2024-04-23T14:50:08.826 INFO:tasks.workunit.client.1.smithi156.stdout:1/902: fdatasync db/d1f/d2d/d48/db4/db9/fbf 0 2024-04-23T14:50:08.830 INFO:tasks.workunit.client.1.smithi156.stdout:1/903: mknod db/d25/d30/d38/c112 0 2024-04-23T14:50:08.830 INFO:tasks.workunit.client.1.smithi156.stdout:7/895: dread dc/f1c [0,4194304] 0 2024-04-23T14:50:08.839 INFO:tasks.workunit.client.1.smithi156.stdout:3/773: dwrite d4/db/dd/d1d/d1e/d13/d5a/dab/fb2 [0,4194304] 0 2024-04-23T14:50:08.840 INFO:tasks.workunit.client.1.smithi156.stdout:5/882: dwrite d1/d3/da6/d86/fb3 [0,4194304] 0 2024-04-23T14:50:08.842 INFO:tasks.workunit.client.1.smithi156.stdout:5/883: mkdir d1/d3/d43/d10e 0 2024-04-23T14:50:08.842 INFO:tasks.workunit.client.1.smithi156.stdout:5/884: readlink d1/d3/d24/l99 0 2024-04-23T14:50:08.842 INFO:tasks.workunit.client.1.smithi156.stdout:5/885: fdatasync d1/d11/d18/d52/d85/f9b 0 2024-04-23T14:50:08.845 INFO:tasks.workunit.client.1.smithi156.stdout:5/886: rename d1/d3/f4f to d1/f10f 0 2024-04-23T14:50:08.845 INFO:tasks.workunit.client.1.smithi156.stdout:5/887: stat d1/d3/d24/l99 0 2024-04-23T14:50:08.846 INFO:tasks.workunit.client.1.smithi156.stdout:5/888: truncate d1/d3/f4b 1474359 0 2024-04-23T14:50:08.848 INFO:tasks.workunit.client.1.smithi156.stdout:5/889: mkdir d1/d17/d110 0 2024-04-23T14:50:08.848 INFO:tasks.workunit.client.1.smithi156.stdout:5/890: write d1/d11/d18/fe7 [4953612,129929] 0 2024-04-23T14:50:08.850 INFO:tasks.workunit.client.1.smithi156.stdout:5/891: getdents d1/d11/d18/d52/d85 0 2024-04-23T14:50:08.850 INFO:tasks.workunit.client.1.smithi156.stdout:9/756: dwrite d1/d2/d3e/d55/d66/dd6/ded/d40/f61 [0,4194304] 0 2024-04-23T14:50:08.859 INFO:tasks.workunit.client.1.smithi156.stdout:7/896: dread dc/d1d/d24/f28 [0,4194304] 0 2024-04-23T14:50:08.874 INFO:tasks.workunit.client.1.smithi156.stdout:5/892: mknod d1/d11/d18/d52/c111 0 2024-04-23T14:50:08.874 INFO:tasks.workunit.client.1.smithi156.stdout:5/893: chown d1/d11/de0/d97/lb6 0 1 2024-04-23T14:50:08.875 INFO:tasks.workunit.client.1.smithi156.stdout:0/885: dwrite d0/d16/d3a/d1e/f3d [0,4194304] 0 2024-04-23T14:50:08.876 INFO:tasks.workunit.client.1.smithi156.stdout:7/897: rename dc/d1d/d24/l8f to dc/d46/d58/db7/l11d 0 2024-04-23T14:50:08.876 INFO:tasks.workunit.client.1.smithi156.stdout:7/898: readlink dc/d2a/l3f 0 2024-04-23T14:50:08.878 INFO:tasks.workunit.client.1.smithi156.stdout:0/886: link d0/d16/d3a/d2a/d1d/d2d/d6b/f82 d0/d16/d8e/f120 0 2024-04-23T14:50:08.879 INFO:tasks.workunit.client.1.smithi156.stdout:5/894: mknod d1/d3/da6/d86/c112 0 2024-04-23T14:50:08.883 INFO:tasks.workunit.client.1.smithi156.stdout:4/855: dread d0/df/d55/d68/f4f [0,4194304] 0 2024-04-23T14:50:08.884 INFO:tasks.workunit.client.1.smithi156.stdout:4/856: symlink d0/df/d75/l11c 0 2024-04-23T14:50:08.887 INFO:tasks.workunit.client.1.smithi156.stdout:1/904: dwrite db/d1f/d2d/d48/daf/d86/f89 [0,4194304] 0 2024-04-23T14:50:08.887 INFO:tasks.workunit.client.1.smithi156.stdout:7/899: dread dc/d2c/d68/f8e [0,4194304] 0 2024-04-23T14:50:08.889 INFO:tasks.workunit.client.1.smithi156.stdout:8/880: sync 2024-04-23T14:50:08.902 INFO:tasks.workunit.client.1.smithi156.stdout:8/881: write d5/d9/d5a/d5c/f72 [299182,76360] 0 2024-04-23T14:50:08.902 INFO:tasks.workunit.client.1.smithi156.stdout:8/882: fsync d5/d9/d36/d60/d62/f126 0 2024-04-23T14:50:08.907 INFO:tasks.workunit.client.1.smithi156.stdout:0/887: write d0/d4/d22/d58/d9a/d44/fea [3495626,54393] 0 2024-04-23T14:50:08.911 INFO:tasks.workunit.client.1.smithi156.stdout:6/962: dwrite d3/d16/d46/d9d/d9f/dad/f106 [0,4194304] 0 2024-04-23T14:50:08.911 INFO:tasks.workunit.client.1.smithi156.stdout:6/963: fdatasync d3/da/d1d/d27/f14e 0 2024-04-23T14:50:08.915 INFO:tasks.workunit.client.1.smithi156.stdout:9/757: dread d1/d2/d3e/fcb [0,4194304] 0 2024-04-23T14:50:08.915 INFO:tasks.workunit.client.1.smithi156.stdout:9/758: read - d1/d2/d3e/d55/d66/dd6/ded/d17/fda zero size 2024-04-23T14:50:08.920 INFO:tasks.workunit.client.1.smithi156.stdout:9/759: truncate d1/d2/d3e/d55/d66/dd6/ded/d17/fbf 1758202 0 2024-04-23T14:50:08.922 INFO:tasks.workunit.client.1.smithi156.stdout:1/905: dread db/d15/fc2 [0,4194304] 0 2024-04-23T14:50:08.922 INFO:tasks.workunit.client.1.smithi156.stdout:9/760: rename d1/d2/d3e/lad to d1/d2/d3e/d55/d6f/d8e/lf9 0 2024-04-23T14:50:08.923 INFO:tasks.workunit.client.1.smithi156.stdout:1/906: stat db/d15/c69 0 2024-04-23T14:50:08.924 INFO:tasks.workunit.client.1.smithi156.stdout:9/761: link d1/d2/d3e/d55/d9c/d39/f42 d1/d2/d3e/d55/ffa 0 2024-04-23T14:50:08.925 INFO:tasks.workunit.client.1.smithi156.stdout:3/774: dwrite d4/db/f77 [0,4194304] 0 2024-04-23T14:50:08.925 INFO:tasks.workunit.client.1.smithi156.stdout:9/762: truncate d1/d2/d3e/d50/f78 33595 0 2024-04-23T14:50:08.926 INFO:tasks.workunit.client.1.smithi156.stdout:9/763: truncate d1/d2/d23/d49/d4b/fdb 1488859 0 2024-04-23T14:50:08.926 INFO:tasks.workunit.client.1.smithi156.stdout:1/907: mkdir db/d1f/d2f/d113 0 2024-04-23T14:50:08.932 INFO:tasks.workunit.client.1.smithi156.stdout:9/764: getdents d1/d2/d3e/d55/d66/dd6 0 2024-04-23T14:50:08.933 INFO:tasks.workunit.client.1.smithi156.stdout:9/765: chown d1/d2/d3e/d80 0 1 2024-04-23T14:50:08.935 INFO:tasks.workunit.client.1.smithi156.stdout:9/766: rename d1/d2/d3e/d55/d66/dd6/ded/d19/f89 to d1/d2/d23/d49/d4b/ffb 0 2024-04-23T14:50:08.938 INFO:tasks.workunit.client.1.smithi156.stdout:9/767: symlink d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/d48/d4e/df5/lfc 0 2024-04-23T14:50:08.940 INFO:tasks.workunit.client.1.smithi156.stdout:9/768: mknod d1/d2/d3e/d80/cfd 0 2024-04-23T14:50:08.943 INFO:tasks.workunit.client.1.smithi156.stdout:1/908: write db/f4f [839472,53774] 0 2024-04-23T14:50:08.948 INFO:tasks.workunit.client.1.smithi156.stdout:9/769: creat d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/db9/ffe x:0 0 0 2024-04-23T14:50:08.953 INFO:tasks.workunit.client.1.smithi156.stdout:1/909: creat db/d1f/d28/d70/db3/d63/f114 x:0 0 0 2024-04-23T14:50:08.953 INFO:tasks.workunit.client.1.smithi156.stdout:1/910: creat db/d1f/d2d/d93/f115 x:0 0 0 2024-04-23T14:50:08.954 INFO:tasks.workunit.client.1.smithi156.stdout:9/770: mkdir d1/d2/de0/dff 0 2024-04-23T14:50:08.954 INFO:tasks.workunit.client.1.smithi156.stdout:9/771: fdatasync d1/d2/d23/d49/d4b/ffb 0 2024-04-23T14:50:08.963 INFO:tasks.workunit.client.1.smithi156.stdout:5/895: dwrite d1/d11/de0/ffd [0,4194304] 0 2024-04-23T14:50:08.966 INFO:tasks.workunit.client.1.smithi156.stdout:5/896: truncate d1/d11/d18/d19/d9a/fb1 1902845 0 2024-04-23T14:50:08.966 INFO:tasks.workunit.client.1.smithi156.stdout:5/897: readlink d1/d3/d43/lac 0 2024-04-23T14:50:08.969 INFO:tasks.workunit.client.1.smithi156.stdout:5/898: getdents d1/d11/dcb 0 2024-04-23T14:50:08.971 INFO:tasks.workunit.client.1.smithi156.stdout:5/899: symlink d1/d11/d27/d101/l113 0 2024-04-23T14:50:08.973 INFO:tasks.workunit.client.1.smithi156.stdout:5/900: getdents d1/d3/da6/d86 0 2024-04-23T14:50:08.988 INFO:tasks.workunit.client.1.smithi156.stdout:5/901: dread d1/d3/d24/da0/ddd/feb [0,4194304] 0 2024-04-23T14:50:08.988 INFO:tasks.workunit.client.1.smithi156.stdout:5/902: fdatasync d1/d17/f7d 0 2024-04-23T14:50:08.988 INFO:tasks.workunit.client.1.smithi156.stdout:5/903: fsync d1/d3/d64/fc9 0 2024-04-23T14:50:08.988 INFO:tasks.workunit.client.1.smithi156.stdout:9/772: dread d1/d2/d3e/d55/d6f/d30/f6d [0,4194304] 0 2024-04-23T14:50:08.990 INFO:tasks.workunit.client.1.smithi156.stdout:8/883: dwrite d5/d9/d36/d60/db8/d93/d96/dc0/d11c/f10b [4194304,4194304] 0 2024-04-23T14:50:08.990 INFO:tasks.workunit.client.1.smithi156.stdout:5/904: truncate d1/d3/d24/da0/fbf 629609 0 2024-04-23T14:50:08.992 INFO:tasks.workunit.client.1.smithi156.stdout:3/775: dwrite d4/db/dd/d1d/d61/f71 [0,4194304] 0 2024-04-23T14:50:08.992 INFO:tasks.workunit.client.1.smithi156.stdout:3/776: readlink d4/l3d 0 2024-04-23T14:50:08.992 INFO:tasks.workunit.client.1.smithi156.stdout:3/777: creat d4/db/dd/d1d/d1e/d13/d5a/ff8 x:0 0 0 2024-04-23T14:50:08.994 INFO:tasks.workunit.client.1.smithi156.stdout:9/773: creat d1/d2/d3e/d55/d66/dd6/ded/d40/d35/dd8/f100 x:0 0 0 2024-04-23T14:50:08.997 INFO:tasks.workunit.client.1.smithi156.stdout:8/884: creat d5/d9/d36/d60/db8/ddd/de1/f137 x:0 0 0 2024-04-23T14:50:08.999 INFO:tasks.workunit.client.1.smithi156.stdout:5/905: mkdir d1/d3/d114 0 2024-04-23T14:50:08.999 INFO:tasks.workunit.client.1.smithi156.stdout:5/906: stat d1/d11/d18/d19/d74/f80 0 2024-04-23T14:50:09.015 INFO:tasks.workunit.client.1.smithi156.stdout:8/885: rmdir d5/d9/d36/d60/db8 39 2024-04-23T14:50:09.015 INFO:tasks.workunit.client.1.smithi156.stdout:4/857: dwrite d0/f80 [0,4194304] 0 2024-04-23T14:50:09.015 INFO:tasks.workunit.client.1.smithi156.stdout:6/964: dwrite d3/d16/d5c/d6a/fc9 [0,4194304] 0 2024-04-23T14:50:09.019 INFO:tasks.workunit.client.1.smithi156.stdout:5/907: rmdir d1/d3/da6 39 2024-04-23T14:50:09.021 INFO:tasks.workunit.client.1.smithi156.stdout:8/886: link d5/f1c d5/d39/f138 0 2024-04-23T14:50:09.028 INFO:tasks.workunit.client.1.smithi156.stdout:8/887: mkdir d5/d9/d10/d1d/d21/d139 0 2024-04-23T14:50:09.031 INFO:tasks.workunit.client.1.smithi156.stdout:1/911: dwrite db/d1f/d2f/d47/d71/fd3 [0,4194304] 0 2024-04-23T14:50:09.033 INFO:tasks.workunit.client.1.smithi156.stdout:1/912: mknod db/d1f/d2d/c116 0 2024-04-23T14:50:09.034 INFO:tasks.workunit.client.1.smithi156.stdout:1/913: creat db/d25/d30/d38/ddc/f117 x:0 0 0 2024-04-23T14:50:09.036 INFO:tasks.workunit.client.1.smithi156.stdout:1/914: mkdir db/d25/d30/d38/d118 0 2024-04-23T14:50:09.037 INFO:tasks.workunit.client.1.smithi156.stdout:1/915: read - db/d25/d30/fef zero size 2024-04-23T14:50:09.037 INFO:tasks.workunit.client.1.smithi156.stdout:1/916: creat db/d25/d30/d38/ddc/f119 x:0 0 0 2024-04-23T14:50:09.039 INFO:tasks.workunit.client.1.smithi156.stdout:2/941: sync 2024-04-23T14:50:09.039 INFO:tasks.workunit.client.1.smithi156.stdout:2/942: creat d4/d13/d19/d58/dfe/d114/f14d x:0 0 0 2024-04-23T14:50:09.048 INFO:tasks.workunit.client.1.smithi156.stdout:2/943: dread d4/d21/d42/da1/f10b [0,4194304] 0 2024-04-23T14:50:09.053 INFO:tasks.workunit.client.1.smithi156.stdout:9/774: dread d1/d2/d3e/d55/d66/dd6/ded/d40/f72 [0,4194304] 0 2024-04-23T14:50:09.053 INFO:tasks.workunit.client.1.smithi156.stdout:3/778: dwrite d4/db/dd/d1d/d1e/d42/faa [0,4194304] 0 2024-04-23T14:50:09.054 INFO:tasks.workunit.client.1.smithi156.stdout:2/944: dread d4/f17 [0,4194304] 0 2024-04-23T14:50:09.057 INFO:tasks.workunit.client.1.smithi156.stdout:2/945: rmdir d4/d13/d88 39 2024-04-23T14:50:09.060 INFO:tasks.workunit.client.1.smithi156.stdout:9/775: read d1/d2/d3e/d50/f7c [223876,123230] 0 2024-04-23T14:50:09.061 INFO:tasks.workunit.client.1.smithi156.stdout:9/776: mknod d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/d48/d4e/c101 0 2024-04-23T14:50:09.061 INFO:tasks.workunit.client.1.smithi156.stdout:9/777: chown d1/d2/d3e/d55/d66/dd6/ded/de3 91 1 2024-04-23T14:50:09.062 INFO:tasks.workunit.client.1.smithi156.stdout:9/778: mknod d1/d2/d3e/d55/c102 0 2024-04-23T14:50:09.063 INFO:tasks.workunit.client.1.smithi156.stdout:9/779: rename d1/d2/d3e/d55/d66/dd6/ded/dc/fac to d1/d2/d23/d49/d4c/f103 0 2024-04-23T14:50:09.065 INFO:tasks.workunit.client.1.smithi156.stdout:4/858: dwrite d0/f46 [0,4194304] 0 2024-04-23T14:50:09.068 INFO:tasks.workunit.client.1.smithi156.stdout:9/780: creat d1/d2/d23/d49/d4b/dbc/f104 x:0 0 0 2024-04-23T14:50:09.073 INFO:tasks.workunit.client.1.smithi156.stdout:9/781: creat d1/d2/d3e/d55/d66/dd6/ded/f105 x:0 0 0 2024-04-23T14:50:09.079 INFO:tasks.workunit.client.1.smithi156.stdout:9/782: getdents d1/d2/d23/d49 0 2024-04-23T14:50:09.081 INFO:tasks.workunit.client.1.smithi156.stdout:9/783: truncate d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/d48/d4e/f6e 1732783 0 2024-04-23T14:50:09.084 INFO:tasks.workunit.client.1.smithi156.stdout:2/946: dread d4/d13/d19/d4c/f93 [0,4194304] 0 2024-04-23T14:50:09.084 INFO:tasks.workunit.client.1.smithi156.stdout:2/947: fdatasync d4/d26/d3c/dca/f10c 0 2024-04-23T14:50:09.087 INFO:tasks.workunit.client.1.smithi156.stdout:4/859: read d0/d8/d1e/d4a/f7b [1765918,35659] 0 2024-04-23T14:50:09.087 INFO:tasks.workunit.client.1.smithi156.stdout:4/860: dread - d0/df/d55/d68/d53/d9f/f107 zero size 2024-04-23T14:50:09.087 INFO:tasks.workunit.client.1.smithi156.stdout:2/948: creat d4/d13/d19/d4c/d5c/dd5/de2/d137/f14e x:0 0 0 2024-04-23T14:50:09.093 INFO:tasks.workunit.client.1.smithi156.stdout:4/861: rename d0/df/d55/d68/f4f to d0/df/d119/f11d 0 2024-04-23T14:50:09.093 INFO:tasks.workunit.client.1.smithi156.stdout:2/949: mknod d4/d13/d19/d58/c14f 0 2024-04-23T14:50:09.095 INFO:tasks.workunit.client.1.smithi156.stdout:2/950: mknod d4/d21/d42/d9f/c150 0 2024-04-23T14:50:09.099 INFO:tasks.workunit.client.1.smithi156.stdout:4/862: link d0/df/d55/d68/d53/d9f/dcc/df1/f3f d0/df/d55/d68/d53/d91/d95/db5/d100/f11e 0 2024-04-23T14:50:09.099 INFO:tasks.workunit.client.1.smithi156.stdout:4/863: stat d0/df/d55/fcf 0 2024-04-23T14:50:09.101 INFO:tasks.workunit.client.1.smithi156.stdout:5/908: dwrite d1/d11/d18/d19/f36 [4194304,4194304] 0 2024-04-23T14:50:09.101 INFO:tasks.workunit.client.1.smithi156.stdout:5/909: write d1/d11/de0/f73 [942930,44756] 0 2024-04-23T14:50:09.102 INFO:tasks.workunit.client.1.smithi156.stdout:2/951: getdents d4/d13/d19/d58/dfe/d114/d117 0 2024-04-23T14:50:09.102 INFO:tasks.workunit.client.1.smithi156.stdout:2/952: write d4/d21/d42/f4e [364755,66674] 0 2024-04-23T14:50:09.106 INFO:tasks.workunit.client.1.smithi156.stdout:2/953: creat d4/d13/d19/d58/f151 x:0 0 0 2024-04-23T14:50:09.117 INFO:tasks.workunit.client.1.smithi156.stdout:4/864: dread d0/df/f64 [0,4194304] 0 2024-04-23T14:50:09.120 INFO:tasks.workunit.client.1.smithi156.stdout:4/865: creat d0/d8/d1e/da0/de7/f11f x:0 0 0 2024-04-23T14:50:09.123 INFO:tasks.workunit.client.1.smithi156.stdout:4/866: creat d0/d8/d1e/d4a/d77/f120 x:0 0 0 2024-04-23T14:50:09.123 INFO:tasks.workunit.client.1.smithi156.stdout:5/910: dread d1/f10f [0,4194304] 0 2024-04-23T14:50:09.127 INFO:tasks.workunit.client.1.smithi156.stdout:4/867: symlink d0/df/d55/d68/d85/dc4/l121 0 2024-04-23T14:50:09.130 INFO:tasks.workunit.client.1.smithi156.stdout:4/868: write d0/df/d55/d68/d53/d91/fc0 [428604,122315] 0 2024-04-23T14:50:09.136 INFO:tasks.workunit.client.1.smithi156.stdout:5/911: dread d1/d11/f51 [0,4194304] 0 2024-04-23T14:50:09.140 INFO:tasks.workunit.client.1.smithi156.stdout:5/912: creat d1/d11/d18/d19/f115 x:0 0 0 2024-04-23T14:50:09.140 INFO:tasks.workunit.client.1.smithi156.stdout:7/900: sync 2024-04-23T14:50:09.140 INFO:tasks.workunit.client.1.smithi156.stdout:0/888: sync 2024-04-23T14:50:09.140 INFO:tasks.workunit.client.1.smithi156.stdout:0/889: chown d0/d16/d43/dc2/f106 948004 1 2024-04-23T14:50:09.143 INFO:tasks.workunit.client.1.smithi156.stdout:5/913: mkdir d1/d3/d24/dbc/df5/d116 0 2024-04-23T14:50:09.143 INFO:tasks.workunit.client.1.smithi156.stdout:5/914: fdatasync d1/d3/da6/d86/fb3 0 2024-04-23T14:50:09.145 INFO:tasks.workunit.client.1.smithi156.stdout:7/901: getdents dc/d9d/dfa 0 2024-04-23T14:50:09.146 INFO:tasks.workunit.client.1.smithi156.stdout:4/869: dread d0/df/d75/f9a [0,4194304] 0 2024-04-23T14:50:09.147 INFO:tasks.workunit.client.1.smithi156.stdout:5/915: mknod d1/d11/d18/d19/c117 0 2024-04-23T14:50:09.147 INFO:tasks.workunit.client.1.smithi156.stdout:5/916: fsync d1/d11/de0/d97/fdf 0 2024-04-23T14:50:09.147 INFO:tasks.workunit.client.1.smithi156.stdout:5/917: fdatasync d1/d11/f29 0 2024-04-23T14:50:09.149 INFO:tasks.workunit.client.1.smithi156.stdout:7/902: rename dc/d1d/d24/f62 to dc/d93/f11e 0 2024-04-23T14:50:09.151 INFO:tasks.workunit.client.1.smithi156.stdout:4/870: symlink d0/df/d55/d68/d53/d91/dd1/l122 0 2024-04-23T14:50:09.154 INFO:tasks.workunit.client.1.smithi156.stdout:5/918: creat d1/d3/d43/f118 x:0 0 0 2024-04-23T14:50:09.155 INFO:tasks.workunit.client.1.smithi156.stdout:7/903: dread dc/d2c/dbe/dc2/ff0 [0,4194304] 0 2024-04-23T14:50:09.157 INFO:tasks.workunit.client.1.smithi156.stdout:5/919: creat d1/d11/d27/d101/f119 x:0 0 0 2024-04-23T14:50:09.159 INFO:tasks.workunit.client.1.smithi156.stdout:7/904: rename dc/d93/f86 to dc/d46/dca/f11f 0 2024-04-23T14:50:09.175 INFO:tasks.workunit.client.1.smithi156.stdout:5/920: write d1/d11/de0/f10d [671938,123381] 0 2024-04-23T14:50:09.182 INFO:tasks.workunit.client.1.smithi156.stdout:0/890: dread d0/f7c [0,4194304] 0 2024-04-23T14:50:09.182 INFO:tasks.workunit.client.1.smithi156.stdout:0/891: chown d0/d4/d22/d58/d9a/d44/f7d 1 1 2024-04-23T14:50:09.185 INFO:tasks.workunit.client.1.smithi156.stdout:0/892: symlink d0/d16/dbf/d3f/d5f/l121 0 2024-04-23T14:50:09.189 INFO:tasks.workunit.client.1.smithi156.stdout:0/893: creat d0/d16/d3a/d2a/d1d/d2d/dd5/dde/f122 x:0 0 0 2024-04-23T14:50:09.189 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:09 smithi081 ceph-mon[25540]: pgmap v43: 65 pgs: 65 active+clean; 3.5 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 151 MiB/s rd, 179 MiB/s wr, 278 op/s 2024-04-23T14:50:09.194 INFO:tasks.workunit.client.1.smithi156.stdout:5/921: write d1/d11/d18/f9f [1599817,69723] 0 2024-04-23T14:50:09.202 INFO:tasks.workunit.client.1.smithi156.stdout:5/922: creat d1/d11/d18/d19/d9a/f11a x:0 0 0 2024-04-23T14:50:09.208 INFO:tasks.workunit.client.1.smithi156.stdout:5/923: getdents d1/d11/d18/d52/d85/d96/dd3 0 2024-04-23T14:50:09.211 INFO:tasks.workunit.client.1.smithi156.stdout:5/924: mkdir d1/d11/d27/d101/d11b 0 2024-04-23T14:50:09.215 INFO:tasks.workunit.client.1.smithi156.stdout:3/779: dwrite d4/db/dd/d1d/d61/f62 [0,4194304] 0 2024-04-23T14:50:09.215 INFO:tasks.workunit.client.1.smithi156.stdout:3/780: chown d4/db/dd/d1d/l33 637519 1 2024-04-23T14:50:09.220 INFO:tasks.workunit.client.1.smithi156.stdout:4/871: dwrite d0/df/d55/d68/f10f [0,4194304] 0 2024-04-23T14:50:09.225 INFO:tasks.workunit.client.1.smithi156.stdout:0/894: dread d0/d4/d22/d58/d9a/d44/de5/df5/f105 [4194304,4194304] 0 2024-04-23T14:50:09.226 INFO:tasks.workunit.client.1.smithi156.stdout:0/895: write d0/d4/d22/d58/d9a/d44/de5/f103 [507705,54610] 0 2024-04-23T14:50:09.226 INFO:tasks.workunit.client.1.smithi156.stdout:0/896: fdatasync d0/d16/d3a/d2a/d1d/d2d/d6b/fca 0 2024-04-23T14:50:09.227 INFO:tasks.workunit.client.1.smithi156.stdout:3/781: rmdir d4/db/dd/d1d/d61/d8d/d8a 39 2024-04-23T14:50:09.233 INFO:tasks.workunit.client.1.smithi156.stdout:4/872: creat d0/d8/d1e/d4a/f123 x:0 0 0 2024-04-23T14:50:09.233 INFO:tasks.workunit.client.1.smithi156.stdout:4/873: chown d0/d76/l29 5 1 2024-04-23T14:50:09.233 INFO:tasks.workunit.client.1.smithi156.stdout:4/874: chown d0/df/d55/d68/d53/d91 1572342 1 2024-04-23T14:50:09.236 INFO:tasks.workunit.client.1.smithi156.stdout:3/782: symlink d4/db/dd/d1d/d1e/d42/lf9 0 2024-04-23T14:50:09.236 INFO:tasks.workunit.client.1.smithi156.stdout:3/783: chown d4/db/dd/d1d/f2e 1713022 1 2024-04-23T14:50:09.236 INFO:tasks.workunit.client.1.smithi156.stdout:3/784: write d4/db/dd/d20/d57/fcd [1988219,5500] 0 2024-04-23T14:50:09.236 INFO:tasks.workunit.client.1.smithi156.stdout:3/785: chown d4/db/dd/d1d/d61/l75 49025687 1 2024-04-23T14:50:09.237 INFO:tasks.workunit.client.1.smithi156.stdout:3/786: creat d4/db/dd/d1d/d1e/d13/d5a/dab/ffa x:0 0 0 2024-04-23T14:50:09.245 INFO:tasks.workunit.client.1.smithi156.stdout:0/897: dread d0/d16/fe0 [0,4194304] 0 2024-04-23T14:50:09.252 INFO:tasks.workunit.client.1.smithi156.stdout:4/875: dread d0/df/f64 [0,4194304] 0 2024-04-23T14:50:09.253 INFO:tasks.workunit.client.1.smithi156.stdout:4/876: chown d0/l31 1561532 1 2024-04-23T14:50:09.254 INFO:tasks.workunit.client.1.smithi156.stdout:3/787: dread d4/db/dd/d1d/d1e/d13/d5a/f6c [0,4194304] 0 2024-04-23T14:50:09.254 INFO:tasks.workunit.client.1.smithi156.stdout:3/788: chown d4/db/dd/d1d/d1e/d74/d93/dad/cb1 8191780 1 2024-04-23T14:50:09.256 INFO:tasks.workunit.client.1.smithi156.stdout:3/789: unlink d4/db/dd/d1d/d61/d8d/c9b 0 2024-04-23T14:50:09.258 INFO:tasks.workunit.client.1.smithi156.stdout:3/790: write d4/db/dd/d1d/d61/d8d/d91/f92 [796179,19107] 0 2024-04-23T14:50:09.259 INFO:tasks.workunit.client.1.smithi156.stdout:3/791: chown d4/db/dd/d1d/d1e/d13/f79 1863200 1 2024-04-23T14:50:09.259 INFO:tasks.workunit.client.1.smithi156.stdout:3/792: chown d4/db/dd/d1d/d1e/d13/d5a/dab/ld8 7 1 2024-04-23T14:50:09.259 INFO:tasks.workunit.client.1.smithi156.stdout:3/793: creat d4/db/dd/d1d/d1e/d13/d5a/ffb x:0 0 0 2024-04-23T14:50:09.260 INFO:tasks.workunit.client.1.smithi156.stdout:7/905: write dc/f10e [2028704,117699] 0 2024-04-23T14:50:09.260 INFO:tasks.workunit.client.1.smithi156.stdout:7/906: fsync dc/d2c/d68/f97 0 2024-04-23T14:50:09.261 INFO:tasks.workunit.client.1.smithi156.stdout:0/898: dread d0/d16/d43/fbb [0,4194304] 0 2024-04-23T14:50:09.264 INFO:tasks.workunit.client.1.smithi156.stdout:7/907: mkdir dc/d46/dca/d120 0 2024-04-23T14:50:09.270 INFO:tasks.workunit.client.1.smithi156.stdout:0/899: unlink d0/d16/d3a/d1e/d80/fe2 0 2024-04-23T14:50:09.270 INFO:tasks.workunit.client.1.smithi156.stdout:0/900: fsync d0/d16/d3a/d1e/f3d 0 2024-04-23T14:50:09.273 INFO:tasks.workunit.client.1.smithi156.stdout:7/908: symlink dc/d46/dca/df8/d104/l121 0 2024-04-23T14:50:09.276 INFO:tasks.workunit.client.1.smithi156.stdout:0/901: mkdir d0/d16/d3a/d2a/d5e/d123 0 2024-04-23T14:50:09.276 INFO:tasks.workunit.client.1.smithi156.stdout:0/902: stat d0/d16/d3a/d2a/cd4 0 2024-04-23T14:50:09.278 INFO:tasks.workunit.client.1.smithi156.stdout:0/903: symlink d0/d16/d3a/d2a/d1d/dfa/l124 0 2024-04-23T14:50:09.278 INFO:tasks.workunit.client.1.smithi156.stdout:0/904: write d0/d4/d22/d58/f8b [4524836,82744] 0 2024-04-23T14:50:09.287 INFO:tasks.workunit.client.1.smithi156.stdout:0/905: dread d0/d16/d3a/d1e/f5d [0,4194304] 0 2024-04-23T14:50:09.289 INFO:tasks.workunit.client.1.smithi156.stdout:2/954: dwrite d4/d13/f14 [4194304,4194304] 0 2024-04-23T14:50:09.292 INFO:tasks.workunit.client.1.smithi156.stdout:6/965: sync 2024-04-23T14:50:09.294 INFO:tasks.workunit.client.1.smithi156.stdout:2/955: creat d4/d13/d88/d146/f152 x:0 0 0 2024-04-23T14:50:09.295 INFO:tasks.workunit.client.1.smithi156.stdout:2/956: write d4/d13/d19/d58/fa7 [700992,108423] 0 2024-04-23T14:50:09.295 INFO:tasks.workunit.client.1.smithi156.stdout:2/957: dread - d4/d21/d42/d9f/f123 zero size 2024-04-23T14:50:09.295 INFO:tasks.workunit.client.1.smithi156.stdout:2/958: creat d4/d13/d19/d58/f153 x:0 0 0 2024-04-23T14:50:09.295 INFO:tasks.workunit.client.1.smithi156.stdout:2/959: truncate d4/d13/d19/d58/dfe/d114/d117/d8e/fcf 482196 0 2024-04-23T14:50:09.300 INFO:tasks.workunit.client.1.smithi156.stdout:5/925: dwrite d1/d11/d27/d101/f119 [0,4194304] 0 2024-04-23T14:50:09.303 INFO:tasks.workunit.client.1.smithi156.stdout:6/966: mkdir d3/da/d74/d93/dc3/d159 0 2024-04-23T14:50:09.303 INFO:tasks.workunit.client.1.smithi156.stdout:6/967: fsync d3/da/d1d/d27/f14e 0 2024-04-23T14:50:09.304 INFO:tasks.workunit.client.1.smithi156.stdout:3/794: dwrite d4/db/dd/d1d/d1e/d42/fe0 [0,4194304] 0 2024-04-23T14:50:09.309 INFO:tasks.workunit.client.1.smithi156.stdout:4/877: dwrite d0/df/d55/d68/d53/f7e [0,4194304] 0 2024-04-23T14:50:09.309 INFO:tasks.workunit.client.1.smithi156.stdout:4/878: write d0/df/d119/f11d [717093,98011] 0 2024-04-23T14:50:09.314 INFO:tasks.workunit.client.1.smithi156.stdout:2/960: getdents d4/d26 0 2024-04-23T14:50:09.314 INFO:tasks.workunit.client.1.smithi156.stdout:2/961: dread - d4/d13/d19/d58/dfe/d114/d117/d8e/dfa/f124 zero size 2024-04-23T14:50:09.316 INFO:tasks.workunit.client.1.smithi156.stdout:0/906: dread d0/d4/d22/d58/f8b [0,4194304] 0 2024-04-23T14:50:09.316 INFO:tasks.workunit.client.1.smithi156.stdout:0/907: chown d0/d16/dbf/c7b 366532716 1 2024-04-23T14:50:09.326 INFO:tasks.workunit.client.1.smithi156.stdout:5/926: rename d1/d3/d24/l99 to d1/d11/d18/d52/d85/d96/dd3/dff/l11c 0 2024-04-23T14:50:09.327 INFO:tasks.workunit.client.1.smithi156.stdout:2/962: write d4/d21/d2f/f74 [1560830,77643] 0 2024-04-23T14:50:09.327 INFO:tasks.workunit.client.1.smithi156.stdout:6/968: creat d3/da/d1d/d27/dfe/d6e/d152/f15a x:0 0 0 2024-04-23T14:50:09.327 INFO:tasks.workunit.client.1.smithi156.stdout:6/969: chown d3/da/f11e 0 1 2024-04-23T14:50:09.329 INFO:tasks.workunit.client.1.smithi156.stdout:1/917: sync 2024-04-23T14:50:09.329 INFO:tasks.workunit.client.1.smithi156.stdout:9/784: sync 2024-04-23T14:50:09.329 INFO:tasks.workunit.client.1.smithi156.stdout:8/888: sync 2024-04-23T14:50:09.330 INFO:tasks.workunit.client.1.smithi156.stdout:3/795: mknod d4/db/dd/d1d/d1e/cfc 0 2024-04-23T14:50:09.338 INFO:tasks.workunit.client.1.smithi156.stdout:4/879: unlink d0/d8/d1e/d4a/d77/fb6 0 2024-04-23T14:50:09.342 INFO:tasks.workunit.client.1.smithi156.stdout:0/908: symlink d0/d4/d22/d58/df9/l125 0 2024-04-23T14:50:09.342 INFO:tasks.workunit.client.1.smithi156.stdout:2/963: truncate d4/d13/d19/d97/fa0 2072213 0 2024-04-23T14:50:09.343 INFO:tasks.workunit.client.1.smithi156.stdout:2/964: chown d4/f17 12 1 2024-04-23T14:50:09.345 INFO:tasks.workunit.client.1.smithi156.stdout:6/970: chown d3/da/d1d/d27/dfe/c12d 390339 1 2024-04-23T14:50:09.345 INFO:tasks.workunit.client.1.smithi156.stdout:1/918: rename db/d25/d4e/ccb to db/de8/c11a 0 2024-04-23T14:50:09.345 INFO:tasks.workunit.client.1.smithi156.stdout:8/889: symlink d5/d9/d5a/d5c/l13a 0 2024-04-23T14:50:09.348 INFO:tasks.workunit.client.1.smithi156.stdout:0/909: creat d0/d16/da4/d113/f126 x:0 0 0 2024-04-23T14:50:09.348 INFO:tasks.workunit.client.1.smithi156.stdout:0/910: fsync d0/d16/d3a/d2a/f99 0 2024-04-23T14:50:09.352 INFO:tasks.workunit.client.1.smithi156.stdout:1/919: creat db/d1f/d94/f11b x:0 0 0 2024-04-23T14:50:09.352 INFO:tasks.workunit.client.1.smithi156.stdout:4/880: rename d0/d8/d1e/da0/de7/c103 to d0/d76/c124 0 2024-04-23T14:50:09.352 INFO:tasks.workunit.client.1.smithi156.stdout:3/796: truncate d4/db/dd/d1d/d1e/d42/f52 1610826 0 2024-04-23T14:50:09.352 INFO:tasks.workunit.client.1.smithi156.stdout:1/920: write db/d15/fc2 [5148194,108924] 0 2024-04-23T14:50:09.352 INFO:tasks.workunit.client.1.smithi156.stdout:8/890: link d5/d4e/dc7/f11d d5/d9/d36/d60/db8/d93/d96/dc0/f13b 0 2024-04-23T14:50:09.357 INFO:tasks.workunit.client.1.smithi156.stdout:4/881: mknod d0/d8/d1e/c125 0 2024-04-23T14:50:09.368 INFO:tasks.workunit.client.1.smithi156.stdout:3/797: creat d4/db/dd/d73/ffd x:0 0 0 2024-04-23T14:50:09.372 INFO:tasks.workunit.client.1.smithi156.stdout:1/921: rename db/d25/d30/df1/l104 to db/d1f/d28/de7/l11c 0 2024-04-23T14:50:09.372 INFO:tasks.workunit.client.1.smithi156.stdout:1/922: write db/d15/f22 [1793851,12318] 0 2024-04-23T14:50:09.377 INFO:tasks.workunit.client.1.smithi156.stdout:1/923: rmdir db/d1f/d2d 39 2024-04-23T14:50:09.385 INFO:tasks.workunit.client.1.smithi156.stdout:2/965: write d4/d13/d19/de8/f107 [524351,106621] 0 2024-04-23T14:50:09.385 INFO:tasks.workunit.client.1.smithi156.stdout:2/966: chown d4/d13/d88/l9a 193771300 1 2024-04-23T14:50:09.385 INFO:tasks.workunit.client.1.smithi156.stdout:2/967: write d4/d13/d19/d97/fa0 [2189722,87460] 0 2024-04-23T14:50:09.385 INFO:tasks.workunit.client.1.smithi156.stdout:2/968: dread - d4/d13/d19/d58/dfe/d114/d117/d8e/dfa/ffc zero size 2024-04-23T14:50:09.389 INFO:tasks.workunit.client.1.smithi156.stdout:4/882: write d0/df/d55/fcf [3052026,37287] 0 2024-04-23T14:50:09.389 INFO:tasks.workunit.client.1.smithi156.stdout:4/883: readlink d0/df/d55/d68/d53/d9f/dcc/l117 0 2024-04-23T14:50:09.391 INFO:tasks.workunit.client.1.smithi156.stdout:5/927: dwrite d1/d3/d64/fc9 [0,4194304] 0 2024-04-23T14:50:09.393 INFO:tasks.workunit.client.1.smithi156.stdout:4/884: mkdir d0/d8/d1e/d126 0 2024-04-23T14:50:09.393 INFO:tasks.workunit.client.1.smithi156.stdout:4/885: chown d0/d8/d1e/d4a/f7b 140741 1 2024-04-23T14:50:09.395 INFO:tasks.workunit.client.1.smithi156.stdout:5/928: rename d1/d3/da6/d86/c112 to d1/d11/d18/d19/d9a/dce/c11d 0 2024-04-23T14:50:09.398 INFO:tasks.workunit.client.1.smithi156.stdout:2/969: dread d4/d13/d19/d58/fe6 [0,4194304] 0 2024-04-23T14:50:09.398 INFO:tasks.workunit.client.1.smithi156.stdout:4/886: link d0/d8/c56 d0/d76/d63/c127 0 2024-04-23T14:50:09.398 INFO:tasks.workunit.client.1.smithi156.stdout:4/887: getdents d0/df/d55/d68/d53 0 2024-04-23T14:50:09.399 INFO:tasks.workunit.client.1.smithi156.stdout:4/888: chown d0/d8/d1e/d4a/d77/cc6 1 1 2024-04-23T14:50:09.412 INFO:tasks.workunit.client.1.smithi156.stdout:1/924: dread db/d1f/fdb [0,4194304] 0 2024-04-23T14:50:09.414 INFO:tasks.workunit.client.1.smithi156.stdout:6/971: dread d3/d16/d46/d9d/d9f/dad/f112 [0,4194304] 0 2024-04-23T14:50:09.417 INFO:tasks.workunit.client.1.smithi156.stdout:9/785: dwrite d1/d2/d3e/d55/f6b [0,4194304] 0 2024-04-23T14:50:09.417 INFO:tasks.workunit.client.1.smithi156.stdout:9/786: chown d1/d2/d3e/d55/c102 30 1 2024-04-23T14:50:09.417 INFO:tasks.workunit.client.1.smithi156.stdout:1/925: mknod db/d25/d6b/c11d 0 2024-04-23T14:50:09.417 INFO:tasks.workunit.client.1.smithi156.stdout:1/926: truncate db/d1f/d2d/d48/dab/fb6 812416 0 2024-04-23T14:50:09.420 INFO:tasks.workunit.client.1.smithi156.stdout:4/889: dread d0/d8/d1e/d4a/d77/fa3 [0,4194304] 0 2024-04-23T14:50:09.420 INFO:tasks.workunit.client.1.smithi156.stdout:4/890: fsync d0/d76/f70 0 2024-04-23T14:50:09.420 INFO:tasks.workunit.client.1.smithi156.stdout:4/891: stat d0/df/d55/f62 0 2024-04-23T14:50:09.420 INFO:tasks.workunit.client.1.smithi156.stdout:4/892: readlink d0/d8/d1e/d4a/d77/d9c/ldb 0 2024-04-23T14:50:09.420 INFO:tasks.workunit.client.1.smithi156.stdout:4/893: write d0/df/f86 [956853,49487] 0 2024-04-23T14:50:09.421 INFO:tasks.workunit.client.1.smithi156.stdout:1/927: unlink db/d1f/d2d/d48/daf/c65 0 2024-04-23T14:50:09.425 INFO:tasks.workunit.client.1.smithi156.stdout:4/894: rename d0/df/d55/d68/f10f to d0/d8/f128 0 2024-04-23T14:50:09.431 INFO:tasks.workunit.client.1.smithi156.stdout:0/911: dwrite d0/d16/d3a/d2a/fb9 [0,4194304] 0 2024-04-23T14:50:09.431 INFO:tasks.workunit.client.1.smithi156.stdout:0/912: readlink d0/d4/d22/d58/d9a/l30 0 2024-04-23T14:50:09.431 INFO:tasks.workunit.client.1.smithi156.stdout:2/970: dread d4/f81 [0,4194304] 0 2024-04-23T14:50:09.451 INFO:tasks.workunit.client.1.smithi156.stdout:4/895: write d0/df/d55/f106 [3508879,92999] 0 2024-04-23T14:50:09.451 INFO:tasks.workunit.client.1.smithi156.stdout:5/929: dwrite d1/d11/d18/d19/d74/f80 [4194304,4194304] 0 2024-04-23T14:50:09.452 INFO:tasks.workunit.client.1.smithi156.stdout:4/896: symlink d0/d8/d1e/d4a/d77/d9c/l129 0 2024-04-23T14:50:09.453 INFO:tasks.workunit.client.1.smithi156.stdout:4/897: mknod d0/df/d55/d68/d53/d91/ddc/c12a 0 2024-04-23T14:50:09.463 INFO:tasks.workunit.client.1.smithi156.stdout:5/930: dread d1/d11/f4d [0,4194304] 0 2024-04-23T14:50:09.473 INFO:tasks.workunit.client.1.smithi156.stdout:1/928: dwrite db/d1f/d2d/d48/daf/fec [0,4194304] 0 2024-04-23T14:50:09.506 INFO:tasks.workunit.client.1.smithi156.stdout:1/929: mkdir db/d1f/d11e 0 2024-04-23T14:50:09.508 INFO:tasks.workunit.client.1.smithi156.stdout:1/930: unlink db/d1f/d28/fa8 0 2024-04-23T14:50:09.512 INFO:tasks.workunit.client.1.smithi156.stdout:7/909: sync 2024-04-23T14:50:09.521 INFO:tasks.workunit.client.1.smithi156.stdout:1/931: truncate db/d1f/fb1 3918081 0 2024-04-23T14:50:09.521 INFO:tasks.workunit.client.1.smithi156.stdout:1/932: readlink db/d1f/d28/d70/db3/dcc/l10c 0 2024-04-23T14:50:09.521 INFO:tasks.workunit.client.1.smithi156.stdout:8/891: dwrite d5/d9/d36/de8/df3/f7e [0,4194304] 0 2024-04-23T14:50:09.527 INFO:tasks.workunit.client.1.smithi156.stdout:7/910: dread dc/f10e [0,4194304] 0 2024-04-23T14:50:09.529 INFO:tasks.workunit.client.1.smithi156.stdout:6/972: dwrite d3/d16/f30 [0,4194304] 0 2024-04-23T14:50:09.529 INFO:tasks.workunit.client.1.smithi156.stdout:6/973: creat d3/da/d1d/d27/dfe/d6e/d152/f15b x:0 0 0 2024-04-23T14:50:09.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:09 smithi156 ceph-mon[32341]: pgmap v43: 65 pgs: 65 active+clean; 3.5 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 151 MiB/s rd, 179 MiB/s wr, 278 op/s 2024-04-23T14:50:09.558 INFO:tasks.workunit.client.1.smithi156.stdout:9/787: dwrite d1/d2/d3e/d55/d66/dd6/ded/d17/f2c [0,4194304] 0 2024-04-23T14:50:09.558 INFO:tasks.workunit.client.1.smithi156.stdout:9/788: readlink d1/d2/d3e/d55/d6f/d30/le2 0 2024-04-23T14:50:09.558 INFO:tasks.workunit.client.1.smithi156.stdout:9/789: fdatasync d1/d2/d3e/d55/d66/dd6/ded/dc/f22 0 2024-04-23T14:50:09.559 INFO:tasks.workunit.client.1.smithi156.stdout:6/974: read d3/d16/d46/d9d/fe5 [2749331,85964] 0 2024-04-23T14:50:09.559 INFO:tasks.workunit.client.1.smithi156.stdout:6/975: fsync d3/da/d1d/f35 0 2024-04-23T14:50:09.559 INFO:tasks.workunit.client.1.smithi156.stdout:6/976: fsync d3/da/f3a 0 2024-04-23T14:50:09.564 INFO:tasks.workunit.client.1.smithi156.stdout:9/790: creat d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/d48/d4e/df5/f106 x:0 0 0 2024-04-23T14:50:09.564 INFO:tasks.workunit.client.1.smithi156.stdout:5/931: dwrite d1/d3/da6/d86/fb3 [0,4194304] 0 2024-04-23T14:50:09.568 INFO:tasks.workunit.client.1.smithi156.stdout:4/898: dwrite d0/df/fa1 [0,4194304] 0 2024-04-23T14:50:09.568 INFO:tasks.workunit.client.1.smithi156.stdout:4/899: chown d0/d8/d1e/cd4 2957 1 2024-04-23T14:50:09.574 INFO:tasks.workunit.client.1.smithi156.stdout:4/900: symlink d0/df/d55/d68/d53/d9f/dcc/df1/d8a/l12b 0 2024-04-23T14:50:09.577 INFO:tasks.workunit.client.1.smithi156.stdout:4/901: mkdir d0/df/d55/d68/d53/d91/d95/def/d110/d12c 0 2024-04-23T14:50:09.577 INFO:tasks.workunit.client.1.smithi156.stdout:4/902: dread - d0/df/d55/d68/d53/f92 zero size 2024-04-23T14:50:09.578 INFO:tasks.workunit.client.1.smithi156.stdout:2/971: dwrite d4/d21/faa [0,4194304] 0 2024-04-23T14:50:09.578 INFO:tasks.workunit.client.1.smithi156.stdout:2/972: truncate d4/d21/d2f/f74 5447842 0 2024-04-23T14:50:09.583 INFO:tasks.workunit.client.1.smithi156.stdout:2/973: link d4/d13/d19/f77 d4/d13/d19/f154 0 2024-04-23T14:50:09.584 INFO:tasks.workunit.client.1.smithi156.stdout:6/977: dread d3/da/f131 [0,4194304] 0 2024-04-23T14:50:09.584 INFO:tasks.workunit.client.1.smithi156.stdout:2/974: mkdir d4/d13/d19/de8/dfb/d155 0 2024-04-23T14:50:09.585 INFO:tasks.workunit.client.1.smithi156.stdout:2/975: write d4/d13/d19/d58/fce [5219452,106436] 0 2024-04-23T14:50:09.585 INFO:tasks.workunit.client.1.smithi156.stdout:2/976: write d4/d21/d2f/f120 [48008,104233] 0 2024-04-23T14:50:09.585 INFO:tasks.workunit.client.1.smithi156.stdout:2/977: chown d4/d21/d76/f9b 1183 1 2024-04-23T14:50:09.589 INFO:tasks.workunit.client.1.smithi156.stdout:9/791: write d1/d2/d3e/d55/d9c/d39/f42 [2819130,10369] 0 2024-04-23T14:50:09.589 INFO:tasks.workunit.client.1.smithi156.stdout:9/792: creat d1/d2/d23/d49/d4b/dbc/f107 x:0 0 0 2024-04-23T14:50:09.593 INFO:tasks.workunit.client.1.smithi156.stdout:6/978: symlink d3/d16/d46/l15c 0 2024-04-23T14:50:09.596 INFO:tasks.workunit.client.1.smithi156.stdout:2/978: dread d4/d13/d19/d58/dfe/d114/d117/d8e/fb4 [0,4194304] 0 2024-04-23T14:50:09.597 INFO:tasks.workunit.client.1.smithi156.stdout:9/793: creat d1/d2/d23/d75/f108 x:0 0 0 2024-04-23T14:50:09.599 INFO:tasks.workunit.client.1.smithi156.stdout:9/794: link d1/fe d1/d2/d3e/d55/d66/dd6/ded/d40/d35/db6/dc5/f109 0 2024-04-23T14:50:09.599 INFO:tasks.workunit.client.1.smithi156.stdout:9/795: readlink d1/d2/d3e/le7 0 2024-04-23T14:50:09.602 INFO:tasks.workunit.client.1.smithi156.stdout:8/892: dwrite d5/d9/d36/d60/db8/d93/d96/dc0/f13b [0,4194304] 0 2024-04-23T14:50:09.602 INFO:tasks.workunit.client.1.smithi156.stdout:8/893: truncate d5/d9/d5a/f43 992735 0 2024-04-23T14:50:09.608 INFO:tasks.workunit.client.1.smithi156.stdout:8/894: rename d5/f105 to d5/d9/d36/d60/d7c/f13c 0 2024-04-23T14:50:09.612 INFO:tasks.workunit.client.1.smithi156.stdout:1/933: dwrite db/d25/d30/d38/f73 [0,4194304] 0 2024-04-23T14:50:09.612 INFO:tasks.workunit.client.1.smithi156.stdout:1/934: chown db/d1f/d2d/d48/dab/cea 11707783 1 2024-04-23T14:50:09.616 INFO:tasks.workunit.client.1.smithi156.stdout:1/935: mkdir db/d1f/d11f 0 2024-04-23T14:50:09.618 INFO:tasks.workunit.client.1.smithi156.stdout:1/936: symlink db/d1f/d2d/d48/db4/l120 0 2024-04-23T14:50:09.627 INFO:tasks.workunit.client.1.smithi156.stdout:8/895: dread d5/d9/d10/d1d/d21/fcc [0,4194304] 0 2024-04-23T14:50:09.634 INFO:tasks.workunit.client.1.smithi156.stdout:5/932: dwrite d1/d11/d18/d52/d85/d96/dd3/fd6 [0,4194304] 0 2024-04-23T14:50:09.662 INFO:tasks.workunit.client.1.smithi156.stdout:0/913: sync 2024-04-23T14:50:09.662 INFO:tasks.workunit.client.1.smithi156.stdout:3/798: sync 2024-04-23T14:50:09.666 INFO:tasks.workunit.client.1.smithi156.stdout:0/914: unlink d0/fb1 0 2024-04-23T14:50:09.668 INFO:tasks.workunit.client.1.smithi156.stdout:0/915: mkdir d0/d4/d127 0 2024-04-23T14:50:09.668 INFO:tasks.workunit.client.1.smithi156.stdout:0/916: creat d0/d16/d3a/d2a/d1d/d2d/dd5/dde/f128 x:0 0 0 2024-04-23T14:50:09.668 INFO:tasks.workunit.client.1.smithi156.stdout:0/917: chown d0/d4/d22/d58/d9a/d44/f52 104 1 2024-04-23T14:50:09.670 INFO:tasks.workunit.client.1.smithi156.stdout:0/918: unlink d0/d16/d3a/d2a/d5e/c75 0 2024-04-23T14:50:09.679 INFO:tasks.workunit.client.1.smithi156.stdout:0/919: getdents d0/d4 0 2024-04-23T14:50:09.679 INFO:tasks.workunit.client.1.smithi156.stdout:0/920: fdatasync d0/fdd 0 2024-04-23T14:50:09.686 INFO:tasks.workunit.client.1.smithi156.stdout:3/799: dread d4/db/dd/d1d/d1e/d13/f79 [0,4194304] 0 2024-04-23T14:50:09.686 INFO:tasks.workunit.client.1.smithi156.stdout:8/896: dwrite d5/d4e/dc7/f11d [0,4194304] 0 2024-04-23T14:50:09.689 INFO:tasks.workunit.client.1.smithi156.stdout:3/800: creat d4/db/dd/d1d/d1e/d2b/ffe x:0 0 0 2024-04-23T14:50:09.692 INFO:tasks.workunit.client.1.smithi156.stdout:3/801: mknod d4/db/dd/d1d/d1e/d74/d90/cff 0 2024-04-23T14:50:09.692 INFO:tasks.workunit.client.1.smithi156.stdout:3/802: fsync d4/db/fb4 0 2024-04-23T14:50:09.709 INFO:tasks.workunit.client.1.smithi156.stdout:8/897: dread d5/d9/d36/d60/d7c/fb9 [0,4194304] 0 2024-04-23T14:50:09.709 INFO:tasks.workunit.client.1.smithi156.stdout:8/898: write d5/d9/d10/d1d/fae [390546,32392] 0 2024-04-23T14:50:09.714 INFO:tasks.workunit.client.1.smithi156.stdout:8/899: symlink d5/d9/d36/de8/df3/l13d 0 2024-04-23T14:50:09.714 INFO:tasks.workunit.client.1.smithi156.stdout:8/900: fsync d5/d9/f67 0 2024-04-23T14:50:09.717 INFO:tasks.workunit.client.1.smithi156.stdout:8/901: creat d5/d9/d36/d60/d7c/f13e x:0 0 0 2024-04-23T14:50:09.717 INFO:tasks.workunit.client.1.smithi156.stdout:8/902: chown d5/d9/d5a/fd9 1025 1 2024-04-23T14:50:09.724 INFO:tasks.workunit.client.1.smithi156.stdout:8/903: rename d5/d9/d10/f88 to d5/d9/d36/d9c/f13f 0 2024-04-23T14:50:09.724 INFO:tasks.workunit.client.1.smithi156.stdout:0/921: dwrite d0/d16/da4/fbe [0,4194304] 0 2024-04-23T14:50:09.724 INFO:tasks.workunit.client.1.smithi156.stdout:0/922: write d0/d4/fad [315487,78711] 0 2024-04-23T14:50:09.728 INFO:tasks.workunit.client.1.smithi156.stdout:0/923: mknod d0/d4/d22/d58/d9a/d44/de5/c129 0 2024-04-23T14:50:09.728 INFO:tasks.workunit.client.1.smithi156.stdout:0/924: write d0/d4/d22/d58/d9a/ff2 [5669040,11134] 0 2024-04-23T14:50:09.728 INFO:tasks.workunit.client.1.smithi156.stdout:0/925: dread - d0/d16/d3a/d1e/d108/f10f zero size 2024-04-23T14:50:09.728 INFO:tasks.workunit.client.1.smithi156.stdout:0/926: readlink d0/d16/d3a/d2a/d1d/da8/l107 0 2024-04-23T14:50:09.730 INFO:tasks.workunit.client.1.smithi156.stdout:0/927: creat d0/d16/d3a/d2a/d1d/d2d/dd5/d101/f12a x:0 0 0 2024-04-23T14:50:09.751 INFO:tasks.workunit.client.1.smithi156.stdout:0/928: write d0/d4/d22/d58/d9a/ff2 [5217064,114212] 0 2024-04-23T14:50:09.752 INFO:tasks.workunit.client.1.smithi156.stdout:0/929: creat d0/d16/dbf/d3f/f12b x:0 0 0 2024-04-23T14:50:09.758 INFO:tasks.workunit.client.1.smithi156.stdout:0/930: dread d0/d4/d22/d58/d9a/d44/f52 [0,4194304] 0 2024-04-23T14:50:09.762 INFO:tasks.workunit.client.1.smithi156.stdout:3/803: dwrite d4/db/dd/d20/d57/fcd [0,4194304] 0 2024-04-23T14:50:09.763 INFO:tasks.workunit.client.1.smithi156.stdout:3/804: chown d4/db/dd/d20/cc2 1669903 1 2024-04-23T14:50:09.768 INFO:tasks.workunit.client.1.smithi156.stdout:4/903: dwrite d0/df/f6b [0,4194304] 0 2024-04-23T14:50:09.768 INFO:tasks.workunit.client.1.smithi156.stdout:9/796: write d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/f63 [3772592,107713] 0 2024-04-23T14:50:09.770 INFO:tasks.workunit.client.1.smithi156.stdout:6/979: dwrite d3/d16/d5c/ded/f154 [0,4194304] 0 2024-04-23T14:50:09.773 INFO:tasks.workunit.client.1.smithi156.stdout:2/979: dwrite d4/d26/fb1 [4194304,4194304] 0 2024-04-23T14:50:09.775 INFO:tasks.workunit.client.1.smithi156.stdout:9/797: rename d1/d2/d23/d49/d4c/fb5 to d1/d2/d3e/d55/d66/f10a 0 2024-04-23T14:50:09.775 INFO:tasks.workunit.client.1.smithi156.stdout:9/798: write d1/d2/d3e/fb4 [4320253,69737] 0 2024-04-23T14:50:09.778 INFO:tasks.workunit.client.1.smithi156.stdout:9/799: symlink d1/d2/d3e/d80/l10b 0 2024-04-23T14:50:09.783 INFO:tasks.workunit.client.1.smithi156.stdout:2/980: rename d4/d26/d3c to d4/d13/d19/de8/dfb/d156 0 2024-04-23T14:50:09.784 INFO:tasks.workunit.client.1.smithi156.stdout:1/937: dwrite db/d1f/d28/d70/db3/dcc/ffb [0,4194304] 0 2024-04-23T14:50:09.789 INFO:tasks.workunit.client.1.smithi156.stdout:8/904: dwrite d5/d9/d10/d1d/f8e [4194304,4194304] 0 2024-04-23T14:50:09.789 INFO:tasks.workunit.client.1.smithi156.stdout:1/938: creat db/d1f/d11e/f121 x:0 0 0 2024-04-23T14:50:09.793 INFO:tasks.workunit.client.1.smithi156.stdout:7/911: sync 2024-04-23T14:50:09.795 INFO:tasks.workunit.client.1.smithi156.stdout:8/905: dread d5/d9/d5a/f101 [0,4194304] 0 2024-04-23T14:50:09.801 INFO:tasks.workunit.client.1.smithi156.stdout:7/912: rmdir dc/d46/dca/d120 0 2024-04-23T14:50:09.804 INFO:tasks.workunit.client.1.smithi156.stdout:9/800: dread d1/f51 [0,4194304] 0 2024-04-23T14:50:09.804 INFO:tasks.workunit.client.1.smithi156.stdout:9/801: dread - d1/d2/d3e/d55/d66/dd6/ded/f105 zero size 2024-04-23T14:50:09.804 INFO:tasks.workunit.client.1.smithi156.stdout:9/802: readlink d1/d2/d23/d49/d4b/la0 0 2024-04-23T14:50:09.804 INFO:tasks.workunit.client.1.smithi156.stdout:8/906: mkdir d5/d9/d36/d60/db8/ddd/de1/d140 0 2024-04-23T14:50:09.807 INFO:tasks.workunit.client.1.smithi156.stdout:2/981: dread d4/f62 [0,4194304] 0 2024-04-23T14:50:09.808 INFO:tasks.workunit.client.1.smithi156.stdout:1/939: write db/d25/d30/d38/d40/f9a [486448,114179] 0 2024-04-23T14:50:09.808 INFO:tasks.workunit.client.1.smithi156.stdout:1/940: read - db/d1f/d28/d70/db3/d63/f114 zero size 2024-04-23T14:50:09.810 INFO:tasks.workunit.client.1.smithi156.stdout:2/982: creat d4/d13/d19/d148/f157 x:0 0 0 2024-04-23T14:50:09.814 INFO:tasks.workunit.client.1.smithi156.stdout:1/941: getdents db/d1f/d94 0 2024-04-23T14:50:09.814 INFO:tasks.workunit.client.1.smithi156.stdout:1/942: stat db/d1f/d11e 0 2024-04-23T14:50:09.814 INFO:tasks.workunit.client.1.smithi156.stdout:1/943: write db/d25/d30/d38/ddc/f119 [415747,58263] 0 2024-04-23T14:50:09.820 INFO:tasks.workunit.client.1.smithi156.stdout:1/944: unlink db/d1f/d2f/f55 0 2024-04-23T14:50:09.820 INFO:tasks.workunit.client.1.smithi156.stdout:1/945: chown db/d25/d30/d38 6786 1 2024-04-23T14:50:09.821 INFO:tasks.workunit.client.1.smithi156.stdout:7/913: write dc/d1d/d24/d5a/f6f [2743582,51903] 0 2024-04-23T14:50:09.839 INFO:tasks.workunit.client.1.smithi156.stdout:4/904: read d0/df/d55/d68/f38 [4070828,62680] 0 2024-04-23T14:50:09.840 INFO:tasks.workunit.client.1.smithi156.stdout:1/946: link db/d1f/d2d/d93/c110 db/d1f/d28/de7/c122 0 2024-04-23T14:50:09.840 INFO:tasks.workunit.client.1.smithi156.stdout:1/947: dread - db/d1f/d2d/d48/dab/fe5 zero size 2024-04-23T14:50:09.840 INFO:tasks.workunit.client.1.smithi156.stdout:1/948: stat db/l62 0 2024-04-23T14:50:09.841 INFO:tasks.workunit.client.1.smithi156.stdout:1/949: write db/d1f/d28/d70/db3/d63/d9e/ff5 [84933,104589] 0 2024-04-23T14:50:09.843 INFO:tasks.workunit.client.1.smithi156.stdout:7/914: mknod dc/d9d/dfa/c122 0 2024-04-23T14:50:09.845 INFO:tasks.workunit.client.1.smithi156.stdout:7/915: symlink dc/d1d/d48/da6/l123 0 2024-04-23T14:50:09.845 INFO:tasks.workunit.client.1.smithi156.stdout:7/916: chown dc/d1d 26165669 1 2024-04-23T14:50:09.845 INFO:tasks.workunit.client.1.smithi156.stdout:7/917: dread - dc/d46/d58/f65 zero size 2024-04-23T14:50:09.845 INFO:tasks.workunit.client.1.smithi156.stdout:7/918: chown dc/d46/dca/led 10996 1 2024-04-23T14:50:09.846 INFO:tasks.workunit.client.1.smithi156.stdout:7/919: mkdir dc/d46/d58/d124 0 2024-04-23T14:50:09.847 INFO:tasks.workunit.client.1.smithi156.stdout:3/805: read d4/db/dd/d20/d57/f7d [369248,119323] 0 2024-04-23T14:50:09.847 INFO:tasks.workunit.client.1.smithi156.stdout:7/920: symlink dc/d9d/l125 0 2024-04-23T14:50:09.847 INFO:tasks.workunit.client.1.smithi156.stdout:0/931: dwrite d0/d16/d3a/d2a/f12 [0,4194304] 0 2024-04-23T14:50:09.848 INFO:tasks.workunit.client.1.smithi156.stdout:0/932: readlink d0/d16/d3a/d2a/d1d/da8/l107 0 2024-04-23T14:50:09.848 INFO:tasks.workunit.client.1.smithi156.stdout:3/806: getdents d4/db/dd/d1d/d61 0 2024-04-23T14:50:09.848 INFO:tasks.workunit.client.1.smithi156.stdout:3/807: readlink d4/db/dd/d1d/d1e/d42/d76/l7a 0 2024-04-23T14:50:09.850 INFO:tasks.workunit.client.1.smithi156.stdout:0/933: creat d0/d16/d43/da6/f12c x:0 0 0 2024-04-23T14:50:09.852 INFO:tasks.workunit.client.1.smithi156.stdout:3/808: link d4/db/dd/d1d/d1e/d2b/ffe d4/db/dd/d1d/d1e/d74/d90/de6/f100 0 2024-04-23T14:50:09.855 INFO:tasks.workunit.client.1.smithi156.stdout:3/809: rename d4/db/dd/d1d/d1e/d42/d76/fb0 to d4/db/dd/d73/f101 0 2024-04-23T14:50:09.857 INFO:tasks.workunit.client.1.smithi156.stdout:8/907: dwrite d5/d9/d36/db5/d98/fc3 [0,4194304] 0 2024-04-23T14:50:09.862 INFO:tasks.workunit.client.1.smithi156.stdout:5/933: sync 2024-04-23T14:50:09.862 INFO:tasks.workunit.client.1.smithi156.stdout:3/810: truncate d4/db/dd/d1d/d1e/d13/d5a/f6c 1893500 0 2024-04-23T14:50:09.862 INFO:tasks.workunit.client.1.smithi156.stdout:3/811: stat d4/db/dd/d1d/d1e/d13/d5a/fc6 0 2024-04-23T14:50:09.862 INFO:tasks.workunit.client.1.smithi156.stdout:3/812: fsync d4/db/dd/d1d/d1e/d42/fe0 0 2024-04-23T14:50:09.862 INFO:tasks.workunit.client.1.smithi156.stdout:5/934: chown d1/d11/d18/d19/c2b 6491692 1 2024-04-23T14:50:09.869 INFO:tasks.workunit.client.1.smithi156.stdout:6/980: dwrite d3/d16/d10b/d77/dd6/fdb [0,4194304] 0 2024-04-23T14:50:09.869 INFO:tasks.workunit.client.1.smithi156.stdout:0/934: dread d0/d16/d3a/d2a/d1d/d2d/f8c [0,4194304] 0 2024-04-23T14:50:09.883 INFO:tasks.workunit.client.1.smithi156.stdout:0/935: dread d0/d16/d3a/d1e/f40 [0,4194304] 0 2024-04-23T14:50:09.885 INFO:tasks.workunit.client.1.smithi156.stdout:0/936: symlink d0/d16/d3a/d1e/l12d 0 2024-04-23T14:50:09.886 INFO:tasks.workunit.client.1.smithi156.stdout:0/937: write d0/d16/d43/dc2/f7e [6927705,69357] 0 2024-04-23T14:50:09.886 INFO:tasks.workunit.client.1.smithi156.stdout:0/938: truncate d0/d16/d3a/d2a/d1d/d2d/fae 353768 0 2024-04-23T14:50:09.886 INFO:tasks.workunit.client.1.smithi156.stdout:0/939: chown d0/l36 46476950 1 2024-04-23T14:50:09.886 INFO:tasks.workunit.client.1.smithi156.stdout:0/940: readlink d0/d16/dbf/d3f/d45/l49 0 2024-04-23T14:50:09.887 INFO:tasks.workunit.client.1.smithi156.stdout:0/941: creat d0/d4/d22/d58/df9/f12e x:0 0 0 2024-04-23T14:50:09.888 INFO:tasks.workunit.client.1.smithi156.stdout:0/942: mkdir d0/d16/d8e/d12f 0 2024-04-23T14:50:09.893 INFO:tasks.workunit.client.1.smithi156.stdout:3/813: read d4/f55 [446013,101000] 0 2024-04-23T14:50:09.895 INFO:tasks.workunit.client.1.smithi156.stdout:3/814: mkdir d4/df3/d102 0 2024-04-23T14:50:09.897 INFO:tasks.workunit.client.1.smithi156.stdout:3/815: rename d4/db/dd/d1d/d61/d8d/f72 to d4/db/dd/d1d/d61/d8d/d8a/f103 0 2024-04-23T14:50:09.899 INFO:tasks.workunit.client.1.smithi156.stdout:3/816: creat d4/df3/d102/f104 x:0 0 0 2024-04-23T14:50:09.912 INFO:tasks.workunit.client.1.smithi156.stdout:1/950: dwrite db/d1f/d2d/d48/dab/fe5 [0,4194304] 0 2024-04-23T14:50:09.917 INFO:tasks.workunit.client.1.smithi156.stdout:3/817: read d4/db/dd/d1d/d1e/d13/d5a/dab/fb2 [3516836,5045] 0 2024-04-23T14:50:09.917 INFO:tasks.workunit.client.1.smithi156.stdout:0/943: dread d0/d4/d22/d58/d9a/d44/fc7 [0,4194304] 0 2024-04-23T14:50:09.919 INFO:tasks.workunit.client.1.smithi156.stdout:0/944: rename d0/d4/d22/d58/d9a/ff2 to d0/d4/d22/d58/d9a/d44/de5/f130 0 2024-04-23T14:50:09.919 INFO:tasks.workunit.client.1.smithi156.stdout:2/983: dwrite d4/d21/d2f/f49 [0,4194304] 0 2024-04-23T14:50:09.919 INFO:tasks.workunit.client.1.smithi156.stdout:2/984: write d4/d21/d76/fe5 [992547,17920] 0 2024-04-23T14:50:09.924 INFO:tasks.workunit.client.1.smithi156.stdout:3/818: creat d4/db/dd/d1d/d61/d8d/d8a/d98/f105 x:0 0 0 2024-04-23T14:50:09.924 INFO:tasks.workunit.client.1.smithi156.stdout:3/819: chown d4/l1c 368 1 2024-04-23T14:50:09.925 INFO:tasks.workunit.client.1.smithi156.stdout:2/985: mknod d4/d13/d19/d97/ddd/c158 0 2024-04-23T14:50:09.928 INFO:tasks.workunit.client.1.smithi156.stdout:2/986: mknod d4/d13/d19/d4c/d5c/dd5/c159 0 2024-04-23T14:50:09.928 INFO:tasks.workunit.client.1.smithi156.stdout:2/987: fsync d4/d13/d19/d148/f157 0 2024-04-23T14:50:09.929 INFO:tasks.workunit.client.1.smithi156.stdout:2/988: getdents d4/d13/d19/de8/dfb/d156 0 2024-04-23T14:50:09.931 INFO:tasks.workunit.client.1.smithi156.stdout:2/989: symlink d4/d13/d88/l15a 0 2024-04-23T14:50:09.931 INFO:tasks.workunit.client.1.smithi156.stdout:2/990: creat d4/d13/d19/d58/dfe/d114/d117/d110/f15b x:0 0 0 2024-04-23T14:50:09.931 INFO:tasks.workunit.client.1.smithi156.stdout:2/991: truncate d4/d13/d19/d97/ddd/f125 116395 0 2024-04-23T14:50:09.932 INFO:tasks.workunit.client.1.smithi156.stdout:2/992: mkdir d4/d13/d19/d13c/d15c 0 2024-04-23T14:50:09.939 INFO:tasks.workunit.client.1.smithi156.stdout:8/908: dwrite d5/d9/d36/d60/db8/d93/d96/f110 [0,4194304] 0 2024-04-23T14:50:09.946 INFO:tasks.workunit.client.1.smithi156.stdout:8/909: symlink d5/d9/d36/de8/l141 0 2024-04-23T14:50:09.957 INFO:tasks.workunit.client.1.smithi156.stdout:8/910: dread d5/d9/d36/d9c/f5b [0,4194304] 0 2024-04-23T14:50:09.957 INFO:tasks.workunit.client.1.smithi156.stdout:8/911: fsync d5/d9/d36/d60/db8/fbc 0 2024-04-23T14:50:09.960 INFO:tasks.workunit.client.1.smithi156.stdout:4/905: dwrite d0/d76/d63/f72 [0,4194304] 0 2024-04-23T14:50:09.964 INFO:tasks.workunit.client.1.smithi156.stdout:4/906: mknod d0/df/d55/d68/d53/d9f/c12d 0 2024-04-23T14:50:09.968 INFO:tasks.workunit.client.1.smithi156.stdout:4/907: mknod d0/df/d55/c12e 0 2024-04-23T14:50:09.971 INFO:tasks.workunit.client.1.smithi156.stdout:4/908: rename d0/df/d55/d68/d53/d91/ddc/fff to d0/df/d119/f12f 0 2024-04-23T14:50:09.993 INFO:tasks.workunit.client.1.smithi156.stdout:1/951: dwrite db/d25/d30/d38/f9f [0,4194304] 0 2024-04-23T14:50:10.011 INFO:tasks.workunit.client.1.smithi156.stdout:1/952: rename db/d1f/d28/d70/db3/d63 to db/d25/d30/d38/ddc/d123 0 2024-04-23T14:50:10.013 INFO:tasks.workunit.client.1.smithi156.stdout:1/953: mkdir db/d1f/d2d/d48/dab/d124 0 2024-04-23T14:50:10.014 INFO:tasks.workunit.client.1.smithi156.stdout:1/954: mkdir db/d25/d6b/d125 0 2024-04-23T14:50:10.016 INFO:tasks.workunit.client.1.smithi156.stdout:6/981: dwrite d3/d16/fc4 [0,4194304] 0 2024-04-23T14:50:10.016 INFO:tasks.workunit.client.1.smithi156.stdout:6/982: stat d3/d16/cb1 0 2024-04-23T14:50:10.021 INFO:tasks.workunit.client.1.smithi156.stdout:1/955: link db/d1f/d2f/d47/lbe db/d1f/d2f/d47/d71/d75/l126 0 2024-04-23T14:50:10.021 INFO:tasks.workunit.client.1.smithi156.stdout:0/945: dwrite d0/d16/d3a/d2a/d1d/d2d/d6b/fb5 [0,4194304] 0 2024-04-23T14:50:10.022 INFO:tasks.workunit.client.1.smithi156.stdout:0/946: creat d0/d16/d3a/d2a/d1d/da8/f131 x:0 0 0 2024-04-23T14:50:10.023 INFO:tasks.workunit.client.1.smithi156.stdout:0/947: mknod d0/d16/d3a/d2a/d1d/dfa/c132 0 2024-04-23T14:50:10.023 INFO:tasks.workunit.client.1.smithi156.stdout:0/948: readlink d0/d4/d22/l90 0 2024-04-23T14:50:10.023 INFO:tasks.workunit.client.1.smithi156.stdout:0/949: truncate d0/d16/dbf/d3f/d45/f86 257239 0 2024-04-23T14:50:10.027 INFO:tasks.workunit.client.1.smithi156.stdout:8/912: dwrite d5/d9/d5a/f101 [0,4194304] 0 2024-04-23T14:50:10.028 INFO:tasks.workunit.client.1.smithi156.stdout:8/913: chown d5/d39/f63 15411509 1 2024-04-23T14:50:10.028 INFO:tasks.workunit.client.1.smithi156.stdout:8/914: chown d5/d9/d36/de8/df3/fd3 4998 1 2024-04-23T14:50:10.028 INFO:tasks.workunit.client.1.smithi156.stdout:0/950: link d0/d4/f25 d0/d16/d3a/d2a/d1d/d2d/f133 0 2024-04-23T14:50:10.028 INFO:tasks.workunit.client.1.smithi156.stdout:0/951: fdatasync d0/d4/d22/d58/d9a/d44/f52 0 2024-04-23T14:50:10.028 INFO:tasks.workunit.client.1.smithi156.stdout:3/820: dwrite d4/db/dd1/fdb [0,4194304] 0 2024-04-23T14:50:10.029 INFO:tasks.workunit.client.1.smithi156.stdout:3/821: readlink d4/l3d 0 2024-04-23T14:50:10.029 INFO:tasks.workunit.client.1.smithi156.stdout:3/822: read d4/db/dd/d1d/d1e/d13/d5a/f6c [423031,93038] 0 2024-04-23T14:50:10.029 INFO:tasks.workunit.client.1.smithi156.stdout:0/952: link d0/d4/fad d0/d16/d3a/d2a/d5e/f134 0 2024-04-23T14:50:10.031 INFO:tasks.workunit.client.1.smithi156.stdout:0/953: rename d0/d16/d3a/d2a/f10b to d0/d16/d3a/dec/f135 0 2024-04-23T14:50:10.033 INFO:tasks.workunit.client.1.smithi156.stdout:5/935: dwrite d1/d11/d18/d19/d9a/fb1 [0,4194304] 0 2024-04-23T14:50:10.036 INFO:tasks.workunit.client.1.smithi156.stdout:1/956: write db/d1f/d2f/d47/f8f [1889434,39949] 0 2024-04-23T14:50:10.036 INFO:tasks.workunit.client.1.smithi156.stdout:1/957: creat db/d1f/d2f/d47/d71/d75/f127 x:0 0 0 2024-04-23T14:50:10.040 INFO:tasks.workunit.client.1.smithi156.stdout:2/993: dwrite d4/d13/d19/d4c/d5c/f129 [0,4194304] 0 2024-04-23T14:50:10.040 INFO:tasks.workunit.client.1.smithi156.stdout:2/994: fdatasync d4/d13/f95 0 2024-04-23T14:50:10.042 INFO:tasks.workunit.client.1.smithi156.stdout:0/954: mknod d0/d16/d3a/d1e/d80/c136 0 2024-04-23T14:50:10.047 INFO:tasks.workunit.client.1.smithi156.stdout:3/823: write d4/db/dd/d1d/d1e/d13/f34 [2058460,79900] 0 2024-04-23T14:50:10.047 INFO:tasks.workunit.client.1.smithi156.stdout:5/936: link d1/d11/de0/d97/ffc d1/d11/d27/d101/f11e 0 2024-04-23T14:50:10.048 INFO:tasks.workunit.client.1.smithi156.stdout:5/937: write d1/d11/d27/f95 [4510530,65289] 0 2024-04-23T14:50:10.049 INFO:tasks.workunit.client.1.smithi156.stdout:1/958: getdents db/d25/d30/df1 0 2024-04-23T14:50:10.058 INFO:tasks.workunit.client.1.smithi156.stdout:6/983: dread d3/da/f38 [0,4194304] 0 2024-04-23T14:50:10.059 INFO:tasks.workunit.client.1.smithi156.stdout:4/909: dwrite d0/df/d55/d68/d74/d8b/ff3 [0,4194304] 0 2024-04-23T14:50:10.061 INFO:tasks.workunit.client.1.smithi156.stdout:2/995: mknod d4/d21/d76/d141/c15d 0 2024-04-23T14:50:10.061 INFO:tasks.workunit.client.1.smithi156.stdout:2/996: chown d4/d21/d42/da1/ddf 415 1 2024-04-23T14:50:10.063 INFO:tasks.workunit.client.1.smithi156.stdout:0/955: creat d0/d16/d3a/dec/f137 x:0 0 0 2024-04-23T14:50:10.067 INFO:tasks.workunit.client.1.smithi156.stdout:3/824: read d4/db/dd/d1d/d1e/d42/d76/f88 [23065,80361] 0 2024-04-23T14:50:10.067 INFO:tasks.workunit.client.1.smithi156.stdout:3/825: dread - d4/db/dd/d1d/d61/d8d/d8a/d98/f105 zero size 2024-04-23T14:50:10.072 INFO:tasks.workunit.client.1.smithi156.stdout:5/938: creat d1/d11/d18/d19/d74/f11f x:0 0 0 2024-04-23T14:50:10.072 INFO:tasks.workunit.client.1.smithi156.stdout:5/939: fsync d1/d3/d43/f118 0 2024-04-23T14:50:10.073 INFO:tasks.workunit.client.1.smithi156.stdout:1/959: creat db/d1f/d94/da1/d81/f128 x:0 0 0 2024-04-23T14:50:10.079 INFO:tasks.workunit.client.1.smithi156.stdout:6/984: mknod d3/d16/d5c/ded/d14d/c15d 0 2024-04-23T14:50:10.085 INFO:tasks.workunit.client.1.smithi156.stdout:0/956: mkdir d0/d16/da4/d138 0 2024-04-23T14:50:10.085 INFO:tasks.workunit.client.1.smithi156.stdout:0/957: chown d0/d16/d3a/d2a/d1d/d2d/d6b/fc1 6670716 1 2024-04-23T14:50:10.086 INFO:tasks.workunit.client.1.smithi156.stdout:3/826: rename d4/db/dd/d1d/d1e/d13/d5a/dab/ff2 to d4/f106 0 2024-04-23T14:50:10.088 INFO:tasks.workunit.client.1.smithi156.stdout:1/960: mknod db/d25/d6b/c129 0 2024-04-23T14:50:10.090 INFO:tasks.workunit.client.1.smithi156.stdout:6/985: link d3/d16/c41 d3/da/d74/d93/dc3/c15e 0 2024-04-23T14:50:10.090 INFO:tasks.workunit.client.1.smithi156.stdout:7/921: sync 2024-04-23T14:50:10.090 INFO:tasks.workunit.client.1.smithi156.stdout:9/803: sync 2024-04-23T14:50:10.090 INFO:tasks.workunit.client.1.smithi156.stdout:7/922: write dc/d2c/d68/f8e [1412997,88421] 0 2024-04-23T14:50:10.090 INFO:tasks.workunit.client.1.smithi156.stdout:9/804: write d1/d2/d23/d49/d4c/fdc [682144,56876] 0 2024-04-23T14:50:10.092 INFO:tasks.workunit.client.1.smithi156.stdout:8/915: dwrite d5/d9/d36/d84/dc1/dcf/fee [0,4194304] 0 2024-04-23T14:50:10.093 INFO:tasks.workunit.client.1.smithi156.stdout:4/910: getdents d0/df/d55/d68/d85 0 2024-04-23T14:50:10.095 INFO:tasks.workunit.client.1.smithi156.stdout:0/958: creat d0/d10c/f139 x:0 0 0 2024-04-23T14:50:10.097 INFO:tasks.workunit.client.1.smithi156.stdout:1/961: mknod db/d1f/d2d/d48/dd4/c12a 0 2024-04-23T14:50:10.099 INFO:tasks.workunit.client.1.smithi156.stdout:6/986: mknod d3/da/d1d/d27/dfe/d97/c15f 0 2024-04-23T14:50:10.100 INFO:tasks.workunit.client.1.smithi156.stdout:6/987: chown d3/d16/d10b/f90 4 1 2024-04-23T14:50:10.100 INFO:tasks.workunit.client.1.smithi156.stdout:6/988: write d3/da/d1d/d27/f8e [1323030,46693] 0 2024-04-23T14:50:10.114 INFO:tasks.workunit.client.1.smithi156.stdout:1/962: dread db/d1f/d2f/d47/d71/fa4 [0,4194304] 0 2024-04-23T14:50:10.115 INFO:tasks.workunit.client.1.smithi156.stdout:7/923: mknod dc/d1d/d48/c126 0 2024-04-23T14:50:10.115 INFO:tasks.workunit.client.1.smithi156.stdout:7/924: stat dc/d1d/d24/d5a/f6f 0 2024-04-23T14:50:10.118 INFO:tasks.workunit.client.1.smithi156.stdout:9/805: unlink d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/fe8 0 2024-04-23T14:50:10.118 INFO:tasks.workunit.client.1.smithi156.stdout:9/806: fsync d1/d2/d23/fbe 0 2024-04-23T14:50:10.123 INFO:tasks.workunit.client.1.smithi156.stdout:7/925: dread dc/d1d/d24/d5a/dd0/ff1 [0,4194304] 0 2024-04-23T14:50:10.124 INFO:tasks.workunit.client.1.smithi156.stdout:8/916: mkdir d5/d9/d36/d60/db8/ddd/de1/d142 0 2024-04-23T14:50:10.124 INFO:tasks.workunit.client.1.smithi156.stdout:8/917: write d5/d4e/f52 [702565,21575] 0 2024-04-23T14:50:10.125 INFO:tasks.workunit.client.1.smithi156.stdout:0/959: symlink d0/d16/d8e/l13a 0 2024-04-23T14:50:10.125 INFO:tasks.workunit.client.1.smithi156.stdout:4/911: read d0/df/d21/dfa/f101 [3770191,73538] 0 2024-04-23T14:50:10.126 INFO:tasks.workunit.client.1.smithi156.stdout:6/989: truncate d3/da/d1d/d27/dfe/d3b/f121 2807658 0 2024-04-23T14:50:10.126 INFO:tasks.workunit.client.1.smithi156.stdout:2/997: dwrite d4/d13/d19/de8/dfb/f14c [0,4194304] 0 2024-04-23T14:50:10.127 INFO:tasks.workunit.client.1.smithi156.stdout:5/940: dwrite d1/f7c [4194304,4194304] 0 2024-04-23T14:50:10.127 INFO:tasks.workunit.client.1.smithi156.stdout:1/963: stat db/d1f/d28/d70/db3/l8d 0 2024-04-23T14:50:10.127 INFO:tasks.workunit.client.1.smithi156.stdout:1/964: creat db/d1f/d2d/d48/db4/db9/f12b x:0 0 0 2024-04-23T14:50:10.128 INFO:tasks.workunit.client.1.smithi156.stdout:8/918: symlink d5/d39/de0/l143 0 2024-04-23T14:50:10.128 INFO:tasks.workunit.client.1.smithi156.stdout:8/919: fdatasync d5/d9/d10/d1d/d21/f40 0 2024-04-23T14:50:10.131 INFO:tasks.workunit.client.1.smithi156.stdout:5/941: write d1/d11/de0/d97/fdf [381070,1719] 0 2024-04-23T14:50:10.131 INFO:tasks.workunit.client.1.smithi156.stdout:5/942: read d1/d11/de0/f10d [2894852,70158] 0 2024-04-23T14:50:10.133 INFO:tasks.workunit.client.1.smithi156.stdout:3/827: dwrite d4/db/d4b/f81 [4194304,4194304] 0 2024-04-23T14:50:10.133 INFO:tasks.workunit.client.1.smithi156.stdout:3/828: write d4/db/dd/d73/f9e [791478,92271] 0 2024-04-23T14:50:10.144 INFO:tasks.workunit.client.1.smithi156.stdout:6/990: link d3/da/d74/fef d3/d16/d119/f160 0 2024-04-23T14:50:10.145 INFO:tasks.workunit.client.1.smithi156.stdout:4/912: creat d0/d8/d1e/d4a/d77/dc1/dec/f130 x:0 0 0 2024-04-23T14:50:10.145 INFO:tasks.workunit.client.1.smithi156.stdout:2/998: creat d4/d13/d88/f15e x:0 0 0 2024-04-23T14:50:10.145 INFO:tasks.workunit.client.1.smithi156.stdout:9/807: dread d1/d2/d8c/fe4 [4194304,4194304] 0 2024-04-23T14:50:10.145 INFO:tasks.workunit.client.1.smithi156.stdout:1/965: unlink db/d25/lb2 0 2024-04-23T14:50:10.145 INFO:tasks.workunit.client.1.smithi156.stdout:5/943: creat d1/d11/d18/d52/d85/d96/db4/f120 x:0 0 0 2024-04-23T14:50:10.149 INFO:tasks.workunit.client.1.smithi156.stdout:2/999: mknod d4/d13/d19/d58/c15f 0 2024-04-23T14:50:10.153 INFO:tasks.workunit.client.1.smithi156.stdout:8/920: dread d5/d4e/f52 [0,4194304] 0 2024-04-23T14:50:10.153 INFO:tasks.workunit.client.1.smithi156.stdout:8/921: creat d5/d9/d10/d1d/f144 x:0 0 0 2024-04-23T14:50:10.153 INFO:tasks.workunit.client.1.smithi156.stdout:5/944: rename d1/d11/d18/d19/d9a/dce/ff3 to d1/d11/d18/f121 0 2024-04-23T14:50:10.158 INFO:tasks.workunit.client.1.smithi156.stdout:1/966: getdents db/d25/d30/d38/ddc 0 2024-04-23T14:50:10.158 INFO:tasks.workunit.client.1.smithi156.stdout:1/967: dread - db/d25/d30/d38/ddc/f117 zero size 2024-04-23T14:50:10.163 INFO:tasks.workunit.client.1.smithi156.stdout:3/829: read d4/db/dd/d1d/f3b [6855806,37013] 0 2024-04-23T14:50:10.168 INFO:tasks.workunit.client.1.smithi156.stdout:1/968: mkdir db/d1f/d2d/d85/d12c 0 2024-04-23T14:50:10.172 INFO:tasks.workunit.client.1.smithi156.stdout:8/922: getdents d5/d9/d36/d60/db8/d93/d96 0 2024-04-23T14:50:10.180 INFO:tasks.workunit.client.1.smithi156.stdout:1/969: rename db/d25/d30/d38/ddc/le3 to db/d1f/d2d/d48/dab/dcf/l12d 0 2024-04-23T14:50:10.183 INFO:tasks.workunit.client.1.smithi156.stdout:6/991: dwrite d3/da/d1d/d27/d80/da5/faa [8388608,4194304] 0 2024-04-23T14:50:10.189 INFO:tasks.workunit.client.1.smithi156.stdout:8/923: symlink d5/d9/d36/d84/dc1/l145 0 2024-04-23T14:50:10.189 INFO:tasks.workunit.client.1.smithi156.stdout:1/970: mkdir db/d1f/d2d/d85/d12c/d12e 0 2024-04-23T14:50:10.189 INFO:tasks.workunit.client.1.smithi156.stdout:8/924: truncate d5/d9/d36/d60/db8/d93/d96/dc0/d11c/f109 834905 0 2024-04-23T14:50:10.189 INFO:tasks.workunit.client.1.smithi156.stdout:8/925: creat d5/d9/d10/d1d/f146 x:0 0 0 2024-04-23T14:50:10.199 INFO:tasks.workunit.client.1.smithi156.stdout:6/992: symlink d3/d16/d46/d9d/d9f/dad/dcd/l161 0 2024-04-23T14:50:10.199 INFO:tasks.workunit.client.1.smithi156.stdout:6/993: chown d3/d16/d10b/d77/cc2 1 1 2024-04-23T14:50:10.200 INFO:tasks.workunit.client.1.smithi156.stdout:8/926: symlink d5/d9/l147 0 2024-04-23T14:50:10.202 INFO:tasks.workunit.client.1.smithi156.stdout:1/971: fdatasync db/d1f/d2f/d47/f8f 0 2024-04-23T14:50:10.207 INFO:tasks.workunit.client.1.smithi156.stdout:6/994: rename d3/d16/f39 to d3/d16/d5c/ded/d14d/f162 0 2024-04-23T14:50:10.211 INFO:tasks.workunit.client.1.smithi156.stdout:8/927: rmdir d5/d9/d36/d60/db8/ddd/de1 39 2024-04-23T14:50:10.211 INFO:tasks.workunit.client.1.smithi156.stdout:8/928: readlink d5/d9/d36/d60/db8/d93/d96/dc0/d11c/l135 0 2024-04-23T14:50:10.211 INFO:tasks.workunit.client.1.smithi156.stdout:8/929: write d5/d9/d36/d60/db8/ddd/de1/f137 [482166,41637] 0 2024-04-23T14:50:10.213 INFO:tasks.workunit.client.1.smithi156.stdout:8/930: link d5/d9/d5a/d5c/f9d d5/d9/d36/d84/f148 0 2024-04-23T14:50:10.214 INFO:tasks.workunit.client.1.smithi156.stdout:8/931: dread - d5/d9/d36/d60/d7c/f13e zero size 2024-04-23T14:50:10.214 INFO:tasks.workunit.client.1.smithi156.stdout:7/926: dwrite dc/d46/d58/f65 [0,4194304] 0 2024-04-23T14:50:10.218 INFO:tasks.workunit.client.1.smithi156.stdout:8/932: mknod d5/d9/d5a/dc8/c149 0 2024-04-23T14:50:10.218 INFO:tasks.workunit.client.1.smithi156.stdout:8/933: write d5/d9/d10/d1d/d21/f77 [1713238,85278] 0 2024-04-23T14:50:10.218 INFO:tasks.workunit.client.1.smithi156.stdout:0/960: dwrite d0/d16/d43/da6/f12c [0,4194304] 0 2024-04-23T14:50:10.219 INFO:tasks.workunit.client.1.smithi156.stdout:8/934: creat d5/d4e/dc7/f14a x:0 0 0 2024-04-23T14:50:10.219 INFO:tasks.workunit.client.1.smithi156.stdout:0/961: creat d0/d16/d8e/f13b x:0 0 0 2024-04-23T14:50:10.225 INFO:tasks.workunit.client.1.smithi156.stdout:5/945: dwrite d1/d11/d27/fb5 [0,4194304] 0 2024-04-23T14:50:10.225 INFO:tasks.workunit.client.1.smithi156.stdout:5/946: read - d1/d11/de0/d97/ffc zero size 2024-04-23T14:50:10.230 INFO:tasks.workunit.client.1.smithi156.stdout:4/913: dwrite d0/d8/d1e/d4a/d77/d9c/f10b [0,4194304] 0 2024-04-23T14:50:10.230 INFO:tasks.workunit.client.1.smithi156.stdout:3/830: dwrite d4/db/dd/d1d/d1e/d2b/ffe [0,4194304] 0 2024-04-23T14:50:10.231 INFO:tasks.workunit.client.1.smithi156.stdout:7/927: write dc/d9d/fa2 [2203865,28811] 0 2024-04-23T14:50:10.232 INFO:tasks.workunit.client.1.smithi156.stdout:3/831: read d4/db/dd/f26 [139952,71633] 0 2024-04-23T14:50:10.239 INFO:tasks.workunit.client.1.smithi156.stdout:8/935: dread d5/d9/d36/d60/db8/d93/d96/dc0/f13b [4194304,4194304] 0 2024-04-23T14:50:10.252 INFO:tasks.workunit.client.1.smithi156.stdout:7/928: read dc/d2c/d68/f97 [1127733,95246] 0 2024-04-23T14:50:10.252 INFO:tasks.workunit.client.1.smithi156.stdout:7/929: chown dc/d1d/d48/c126 51 1 2024-04-23T14:50:10.263 INFO:tasks.workunit.client.1.smithi156.stdout:1/972: dwrite db/d25/d30/d38/ddc/f119 [0,4194304] 0 2024-04-23T14:50:10.263 INFO:tasks.workunit.client.1.smithi156.stdout:1/973: creat db/d1f/d28/d70/f12f x:0 0 0 2024-04-23T14:50:10.301 INFO:tasks.workunit.client.1.smithi156.stdout:7/930: dwrite dc/d1d/f35 [0,4194304] 0 2024-04-23T14:50:10.321 INFO:tasks.workunit.client.1.smithi156.stdout:0/962: mknod d0/d4/d127/c13c 0 2024-04-23T14:50:10.321 INFO:tasks.workunit.client.1.smithi156.stdout:0/963: creat d0/d16/dbf/d3f/f13d x:0 0 0 2024-04-23T14:50:10.330 INFO:tasks.workunit.client.1.smithi156.stdout:5/947: getdents d1/d3/d24/dbc 0 2024-04-23T14:50:10.343 INFO:tasks.workunit.client.1.smithi156.stdout:0/964: dread d0/d4/d22/d58/f8b [0,4194304] 0 2024-04-23T14:50:10.343 INFO:tasks.workunit.client.1.smithi156.stdout:0/965: write d0/d16/da4/f109 [611758,67453] 0 2024-04-23T14:50:10.344 INFO:tasks.workunit.client.1.smithi156.stdout:0/966: write d0/d16/d3a/d2a/d1d/d2d/d6b/fca [103920,49746] 0 2024-04-23T14:50:10.358 INFO:tasks.workunit.client.1.smithi156.stdout:4/914: symlink d0/df/d55/d68/d53/d91/d95/def/l131 0 2024-04-23T14:50:10.358 INFO:tasks.workunit.client.1.smithi156.stdout:4/915: fdatasync d0/d8/fc 0 2024-04-23T14:50:10.371 INFO:tasks.workunit.client.1.smithi156.stdout:3/832: symlink d4/db/d4b/l107 0 2024-04-23T14:50:10.371 INFO:tasks.workunit.client.1.smithi156.stdout:3/833: getdents d4/db/dd/d1d/d1e/d42/d76/dba/de5/df6 0 2024-04-23T14:50:10.380 INFO:tasks.workunit.client.1.smithi156.stdout:8/936: symlink d5/d9/d5a/dc8/l14b 0 2024-04-23T14:50:10.387 INFO:tasks.workunit.client.1.smithi156.stdout:3/834: write d4/db/dd/d1d/f36 [419134,124152] 0 2024-04-23T14:50:10.470 INFO:tasks.workunit.client.1.smithi156.stdout:1/974: link db/d25/d6b/c11d db/d1f/d2f/d47/c130 0 2024-04-23T14:50:10.499 INFO:tasks.workunit.client.1.smithi156.stdout:5/948: unlink d1/d3/d24/da0/f4c 0 2024-04-23T14:50:10.502 INFO:tasks.workunit.client.1.smithi156.stdout:6/995: rename d3/d16/d5c/ded to d3/d16/d119/d163 0 2024-04-23T14:50:10.502 INFO:tasks.workunit.client.1.smithi156.stdout:6/996: chown d3/d16/d46/d9d/fbe 1634 1 2024-04-23T14:50:10.503 INFO:tasks.workunit.client.1.smithi156.stdout:6/997: read d3/da/d1d/d27/dfe/d3b/d9e/fe4 [22945,11482] 0 2024-04-23T14:50:10.503 INFO:tasks.workunit.client.1.smithi156.stdout:7/931: rename dc to dc/d1d/d24/d127 22 2024-04-23T14:50:10.503 INFO:tasks.workunit.client.1.smithi156.stdout:7/932: truncate dc/d46/f70 119449 0 2024-04-23T14:50:10.506 INFO:tasks.workunit.client.1.smithi156.stdout:0/967: symlink d0/d16/d3a/d2a/d5e/l13e 0 2024-04-23T14:50:10.510 INFO:tasks.workunit.client.1.smithi156.stdout:4/916: creat d0/df/d55/d68/d53/d9f/dcc/df1/f132 x:0 0 0 2024-04-23T14:50:10.510 INFO:tasks.workunit.client.1.smithi156.stdout:4/917: creat d0/d8/d1e/d4a/f133 x:0 0 0 2024-04-23T14:50:10.511 INFO:tasks.workunit.client.1.smithi156.stdout:8/937: creat d5/d9/d36/d9c/f14c x:0 0 0 2024-04-23T14:50:10.512 INFO:tasks.workunit.client.1.smithi156.stdout:8/938: creat d5/d9/d10/d1d/d21/df1/f14d x:0 0 0 2024-04-23T14:50:10.517 INFO:tasks.workunit.client.1.smithi156.stdout:3/835: rmdir d4/db/dd/d20/d57 39 2024-04-23T14:50:10.525 INFO:tasks.workunit.client.1.smithi156.stdout:5/949: write d1/d11/d18/d52/d85/d96/dd3/fd6 [2395491,71710] 0 2024-04-23T14:50:10.525 INFO:tasks.workunit.client.1.smithi156.stdout:5/950: read d1/d11/d27/d101/fc8 [74276,89708] 0 2024-04-23T14:50:10.525 INFO:tasks.workunit.client.1.smithi156.stdout:7/933: rmdir dc/d46/dca/df8/d104 39 2024-04-23T14:50:10.525 INFO:tasks.workunit.client.1.smithi156.stdout:7/934: truncate dc/d1d/d24/dd5/ff2 212985 0 2024-04-23T14:50:10.535 INFO:tasks.workunit.client.1.smithi156.stdout:4/918: link d0/f113 d0/d76/d63/f134 0 2024-04-23T14:50:10.536 INFO:tasks.workunit.client.1.smithi156.stdout:5/951: dread d1/d11/d18/f121 [0,4194304] 0 2024-04-23T14:50:10.541 INFO:tasks.workunit.client.1.smithi156.stdout:4/919: mkdir d0/df/d21/dc2/d135 0 2024-04-23T14:50:10.547 INFO:tasks.workunit.client.1.smithi156.stdout:5/952: dread d1/d11/de0/f73 [0,4194304] 0 2024-04-23T14:50:10.550 INFO:tasks.workunit.client.1.smithi156.stdout:4/920: rmdir d0/d8/d1e/d4a/d77 39 2024-04-23T14:50:10.552 INFO:tasks.workunit.client.1.smithi156.stdout:5/953: creat d1/d17/f122 x:0 0 0 2024-04-23T14:50:10.556 INFO:tasks.workunit.client.1.smithi156.stdout:4/921: creat d0/d8/d1e/d4a/d77/dc1/f136 x:0 0 0 2024-04-23T14:50:10.556 INFO:tasks.workunit.client.1.smithi156.stdout:4/922: fdatasync d0/df/d55/d68/d53/d9f/dcc/df1/f8f 0 2024-04-23T14:50:10.556 INFO:tasks.workunit.client.1.smithi156.stdout:4/923: readlink d0/df/d55/d68/d53/d91/d95/def/l102 0 2024-04-23T14:50:10.556 INFO:tasks.workunit.client.1.smithi156.stdout:4/924: truncate d0/d8/d1e/d4a/fb2 1223926 0 2024-04-23T14:50:10.556 INFO:tasks.workunit.client.1.smithi156.stdout:4/925: creat d0/df/d55/d68/d53/d91/ddc/f137 x:0 0 0 2024-04-23T14:50:10.557 INFO:tasks.workunit.client.1.smithi156.stdout:3/836: dwrite d4/db/dd/d1d/d1e/d74/dcf/fdf [0,4194304] 0 2024-04-23T14:50:10.558 INFO:tasks.workunit.client.1.smithi156.stdout:6/998: dwrite d3/f4e [0,4194304] 0 2024-04-23T14:50:10.559 INFO:tasks.workunit.client.1.smithi156.stdout:4/926: creat d0/df/d55/d68/d74/f138 x:0 0 0 2024-04-23T14:50:10.562 INFO:tasks.workunit.client.1.smithi156.stdout:3/837: unlink d4/db/dd/d1d/d61/ld4 0 2024-04-23T14:50:10.564 INFO:tasks.workunit.client.1.smithi156.stdout:4/927: mkdir d0/d8/d1e/d4a/d77/d9c/d139 0 2024-04-23T14:50:10.565 INFO:tasks.workunit.client.1.smithi156.stdout:3/838: symlink d4/db/dd/d1d/d1e/d74/d90/l108 0 2024-04-23T14:50:10.575 INFO:tasks.workunit.client.1.smithi156.stdout:5/954: write d1/d11/d18/f47 [2568666,120814] 0 2024-04-23T14:50:10.575 INFO:tasks.workunit.client.1.smithi156.stdout:7/935: dwrite dc/d1d/d41/f9c [0,4194304] 0 2024-04-23T14:50:10.579 INFO:tasks.workunit.client.1.smithi156.stdout:5/955: creat d1/d3/f123 x:0 0 0 2024-04-23T14:50:10.584 INFO:tasks.workunit.client.1.smithi156.stdout:7/936: truncate dc/f54 18057 0 2024-04-23T14:50:10.584 INFO:tasks.workunit.client.1.smithi156.stdout:4/928: dread d0/df/f14 [0,4194304] 0 2024-04-23T14:50:10.585 INFO:tasks.workunit.client.1.smithi156.stdout:4/929: truncate d0/df/d55/d68/f38 3358327 0 2024-04-23T14:50:10.585 INFO:tasks.workunit.client.1.smithi156.stdout:4/930: creat d0/d8/d1e/d126/f13a x:0 0 0 2024-04-23T14:50:10.613 INFO:tasks.workunit.client.1.smithi156.stdout:7/937: dread dc/d1d/d24/f27 [0,4194304] 0 2024-04-23T14:50:10.613 INFO:tasks.workunit.client.1.smithi156.stdout:7/938: write dc/d2c/d68/f97 [1469596,39842] 0 2024-04-23T14:50:10.614 INFO:tasks.workunit.client.1.smithi156.stdout:7/939: rmdir dc/d1d/d48 39 2024-04-23T14:50:10.623 INFO:tasks.workunit.client.1.smithi156.stdout:3/839: dwrite d4/db/dd/d1d/d1e/d42/f52 [0,4194304] 0 2024-04-23T14:50:10.627 INFO:tasks.workunit.client.1.smithi156.stdout:0/968: mknod d0/d4/c13f 0 2024-04-23T14:50:10.629 INFO:tasks.workunit.client.1.smithi156.stdout:7/940: read dc/d1d/f32 [3066620,50357] 0 2024-04-23T14:50:10.631 INFO:tasks.workunit.client.1.smithi156.stdout:7/941: rename dc/d1d/dba/lcb to dc/d2c/dbe/d102/l128 0 2024-04-23T14:50:10.633 INFO:tasks.workunit.client.1.smithi156.stdout:7/942: truncate dc/d2c/dbe/dc2/ffe 235025 0 2024-04-23T14:50:10.633 INFO:tasks.workunit.client.1.smithi156.stdout:7/943: getdents dc/d1d/dba/dd4/dd9 0 2024-04-23T14:50:10.636 INFO:tasks.workunit.client.1.smithi156.stdout:6/999: dwrite d3/da/d1d/f67 [4194304,4194304] 0 2024-04-23T14:50:10.646 INFO:tasks.workunit.client.1.smithi156.stdout:1/975: creat db/d1f/d2d/d48/dab/f131 x:0 0 0 2024-04-23T14:50:10.646 INFO:tasks.workunit.client.1.smithi156.stdout:1/976: chown db/d25/d30/d38/ddc/d123/d9e/ff5 2338 1 2024-04-23T14:50:10.646 INFO:tasks.workunit.client.1.smithi156.stdout:1/977: creat db/d1f/d28/d70/f132 x:0 0 0 2024-04-23T14:50:10.650 INFO:tasks.workunit.client.1.smithi156.stdout:1/978: creat db/d1f/d2f/da9/f133 x:0 0 0 2024-04-23T14:50:10.664 INFO:tasks.workunit.client.1.smithi156.stdout:0/969: dwrite d0/d16/d3a/d1e/d80/faf [0,4194304] 0 2024-04-23T14:50:10.664 INFO:tasks.workunit.client.1.smithi156.stdout:0/970: chown d0/d16/dcd/ded 1 1 2024-04-23T14:50:10.680 INFO:tasks.workunit.client.1.smithi156.stdout:9/808: sync 2024-04-23T14:50:10.682 INFO:tasks.workunit.client.1.smithi156.stdout:9/809: creat d1/d2/d3e/d80/f10c x:0 0 0 2024-04-23T14:50:10.698 INFO:tasks.workunit.client.1.smithi156.stdout:7/944: creat dc/d46/d58/f129 x:0 0 0 2024-04-23T14:50:10.699 INFO:tasks.workunit.client.1.smithi156.stdout:7/945: read - dc/d1d/d24/f98 zero size 2024-04-23T14:50:10.699 INFO:tasks.workunit.client.1.smithi156.stdout:3/840: creat d4/db/dd/d1d/d1e/d13/f109 x:0 0 0 2024-04-23T14:50:10.700 INFO:tasks.workunit.client.1.smithi156.stdout:3/841: chown d4/db/dd/d1d/d1e/d42/ld6 4 1 2024-04-23T14:50:10.700 INFO:tasks.workunit.client.1.smithi156.stdout:3/842: write d4/db/dd/d73/f101 [1104682,35370] 0 2024-04-23T14:50:10.700 INFO:tasks.workunit.client.1.smithi156.stdout:3/843: fdatasync d4/db/dd/d1d/d1e/d74/d90/f67 0 2024-04-23T14:50:10.706 INFO:tasks.workunit.client.1.smithi156.stdout:9/810: rmdir d1/d2/d3e/d55/d66/dd6/ded/de3 0 2024-04-23T14:50:10.708 INFO:tasks.workunit.client.1.smithi156.stdout:9/811: mknod d1/d2/d3e/d55/d9c/c10d 0 2024-04-23T14:50:10.709 INFO:tasks.workunit.client.1.smithi156.stdout:8/939: creat d5/d9/d36/f14e x:0 0 0 2024-04-23T14:50:10.709 INFO:tasks.workunit.client.1.smithi156.stdout:8/940: dread - d5/d9/d36/d60/db8/f102 zero size 2024-04-23T14:50:10.712 INFO:tasks.workunit.client.1.smithi156.stdout:8/941: rmdir d5/d9/d5a/d5c 39 2024-04-23T14:50:10.713 INFO:tasks.workunit.client.1.smithi156.stdout:8/942: mknod d5/d39/d99/c14f 0 2024-04-23T14:50:10.713 INFO:tasks.workunit.client.1.smithi156.stdout:8/943: stat d5/d9/d36/d84/d8c/fa7 0 2024-04-23T14:50:10.714 INFO:tasks.workunit.client.1.smithi156.stdout:4/931: mkdir d0/df/d55/d68/d13b 0 2024-04-23T14:50:10.717 INFO:tasks.workunit.client.1.smithi156.stdout:8/944: write d5/d9/d36/d84/dc1/dcf/fda [54086,66832] 0 2024-04-23T14:50:10.718 INFO:tasks.workunit.client.1.smithi156.stdout:8/945: read - d5/d39/d99/f111 zero size 2024-04-23T14:50:10.718 INFO:tasks.workunit.client.1.smithi156.stdout:8/946: dread - d5/d9/d36/d60/d7c/f13e zero size 2024-04-23T14:50:10.718 INFO:tasks.workunit.client.1.smithi156.stdout:1/979: fsync db/d1f/d2f/da9/f133 0 2024-04-23T14:50:10.719 INFO:tasks.workunit.client.1.smithi156.stdout:8/947: truncate d5/d9/d36/de8/df3/fd3 3765839 0 2024-04-23T14:50:10.722 INFO:tasks.workunit.client.1.smithi156.stdout:8/948: creat d5/d39/d99/f150 x:0 0 0 2024-04-23T14:50:10.722 INFO:tasks.workunit.client.1.smithi156.stdout:8/949: chown d5/d9/d10/f34 8012 1 2024-04-23T14:50:10.722 INFO:tasks.workunit.client.1.smithi156.stdout:8/950: chown d5/d9/d36/d60/db8/d93/d96/f114 2819 1 2024-04-23T14:50:10.722 INFO:tasks.workunit.client.1.smithi156.stdout:8/951: dread - d5/d9/d10/d1d/f10e zero size 2024-04-23T14:50:10.722 INFO:tasks.workunit.client.1.smithi156.stdout:8/952: write d5/d9/d36/d60/d62/f126 [791751,113446] 0 2024-04-23T14:50:10.723 INFO:tasks.workunit.client.1.smithi156.stdout:0/971: mkdir d0/d16/d3a/d2a/d1d/d2d/d140 0 2024-04-23T14:50:10.724 INFO:tasks.workunit.client.1.smithi156.stdout:8/953: mknod d5/d9/d36/d60/db8/d93/d96/dc0/d11c/c151 0 2024-04-23T14:50:10.724 INFO:tasks.workunit.client.1.smithi156.stdout:8/954: readlink d5/d4e/dc7/le5 0 2024-04-23T14:50:10.726 INFO:tasks.workunit.client.1.smithi156.stdout:0/972: mkdir d0/d16/d43/d9c/dff/d141 0 2024-04-23T14:50:10.726 INFO:tasks.workunit.client.1.smithi156.stdout:0/973: fsync d0/d16/da4/d113/f126 0 2024-04-23T14:50:10.730 INFO:tasks.workunit.client.1.smithi156.stdout:8/955: unlink d5/d39/ffc 0 2024-04-23T14:50:10.731 INFO:tasks.workunit.client.1.smithi156.stdout:8/956: chown d5/d39/de0 267246743 1 2024-04-23T14:50:10.732 INFO:tasks.workunit.client.1.smithi156.stdout:0/974: mknod d0/d16/d43/da6/c142 0 2024-04-23T14:50:10.732 INFO:tasks.workunit.client.1.smithi156.stdout:0/975: stat d0/d16/d3a/d2a/d5e/d123 0 2024-04-23T14:50:10.734 INFO:tasks.workunit.client.1.smithi156.stdout:0/976: mknod d0/d16/d3a/d1e/c143 0 2024-04-23T14:50:10.738 INFO:tasks.workunit.client.1.smithi156.stdout:4/932: dread d0/d8/f128 [0,4194304] 0 2024-04-23T14:50:10.738 INFO:tasks.workunit.client.1.smithi156.stdout:4/933: write d0/df/d55/d68/d85/f90 [4689251,17110] 0 2024-04-23T14:50:10.738 INFO:tasks.workunit.client.1.smithi156.stdout:4/934: fdatasync d0/f113 0 2024-04-23T14:50:10.738 INFO:tasks.workunit.client.1.smithi156.stdout:4/935: fsync d0/df/d55/d68/d53/d9f/f107 0 2024-04-23T14:50:10.738 INFO:tasks.workunit.client.1.smithi156.stdout:4/936: chown d0/df/d55/d68/c89 31720 1 2024-04-23T14:50:10.752 INFO:tasks.workunit.client.1.smithi156.stdout:1/980: dread db/d1f/fdb [0,4194304] 0 2024-04-23T14:50:10.753 INFO:tasks.workunit.client.1.smithi156.stdout:4/937: dread d0/d8/d1e/d4a/d77/fa3 [0,4194304] 0 2024-04-23T14:50:10.758 INFO:tasks.workunit.client.1.smithi156.stdout:3/844: dwrite d4/db/dd/d1d/d61/f6a [0,4194304] 0 2024-04-23T14:50:10.760 INFO:tasks.workunit.client.1.smithi156.stdout:4/938: creat d0/df/d55/d68/d53/d9f/dcc/f13c x:0 0 0 2024-04-23T14:50:10.765 INFO:tasks.workunit.client.1.smithi156.stdout:4/939: rename d0/d8/d1e/l6e to d0/df/d55/d68/d53/d91/d95/db5/d100/l13d 0 2024-04-23T14:50:10.765 INFO:tasks.workunit.client.1.smithi156.stdout:4/940: dread - d0/df/d55/d68/d53/d91/ddc/f111 zero size 2024-04-23T14:50:10.771 INFO:tasks.workunit.client.1.smithi156.stdout:9/812: dwrite d1/d2/d3e/d55/d66/dd6/ded/d17/fbf [0,4194304] 0 2024-04-23T14:50:10.778 INFO:tasks.workunit.client.1.smithi156.stdout:9/813: mknod d1/d2/d3e/d55/d6f/c10e 0 2024-04-23T14:50:10.784 INFO:tasks.workunit.client.1.smithi156.stdout:9/814: symlink d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/d48/d4e/l10f 0 2024-04-23T14:50:10.784 INFO:tasks.workunit.client.1.smithi156.stdout:9/815: write d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/f63 [290206,36984] 0 2024-04-23T14:50:10.785 INFO:tasks.workunit.client.1.smithi156.stdout:1/981: read db/d25/f3d [1130584,103965] 0 2024-04-23T14:50:10.792 INFO:tasks.workunit.client.1.smithi156.stdout:0/977: dwrite d0/d16/dbf/d3f/f13d [0,4194304] 0 2024-04-23T14:50:10.792 INFO:tasks.workunit.client.1.smithi156.stdout:0/978: readlink d0/d4/d22/d58/df9/l125 0 2024-04-23T14:50:10.792 INFO:tasks.workunit.client.1.smithi156.stdout:0/979: chown d0/d4/d22/d58/f8b 0 1 2024-04-23T14:50:10.792 INFO:tasks.workunit.client.1.smithi156.stdout:5/956: sync 2024-04-23T14:50:10.800 INFO:tasks.workunit.client.1.smithi156.stdout:0/980: unlink d0/d16/d3a/d2a/d1d/d2d/d6b/fc1 0 2024-04-23T14:50:10.801 INFO:tasks.workunit.client.1.smithi156.stdout:5/957: symlink d1/d11/d18/d52/d85/l124 0 2024-04-23T14:50:10.803 INFO:tasks.workunit.client.1.smithi156.stdout:0/981: symlink d0/d16/d3a/d2a/d1d/d2d/dd5/l144 0 2024-04-23T14:50:10.805 INFO:tasks.workunit.client.1.smithi156.stdout:5/958: symlink d1/d3/d43/l125 0 2024-04-23T14:50:10.805 INFO:tasks.workunit.client.1.smithi156.stdout:5/959: readlink d1/d11/d18/d52/lb7 0 2024-04-23T14:50:10.808 INFO:tasks.workunit.client.1.smithi156.stdout:0/982: link d0/d16/d8e/fdb d0/d10c/f145 0 2024-04-23T14:50:10.808 INFO:tasks.workunit.client.1.smithi156.stdout:0/983: write d0/d4/d22/d58/d9a/d44/fea [4240592,45695] 0 2024-04-23T14:50:10.810 INFO:tasks.workunit.client.1.smithi156.stdout:5/960: link d1/d3/l7 d1/d3/d24/dbc/df5/l126 0 2024-04-23T14:50:10.810 INFO:tasks.workunit.client.1.smithi156.stdout:5/961: write d1/d11/d18/f9f [262226,66550] 0 2024-04-23T14:50:10.813 INFO:tasks.workunit.client.1.smithi156.stdout:0/984: creat d0/d16/d3a/d2a/d5e/d123/f146 x:0 0 0 2024-04-23T14:50:10.824 INFO:tasks.workunit.client.1.smithi156.stdout:9/816: fsync d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/f63 0 2024-04-23T14:50:10.825 INFO:tasks.workunit.client.1.smithi156.stdout:9/817: fsync d1/d2/d3e/d55/d66/dd6/ded/d17/f82 0 2024-04-23T14:50:10.826 INFO:tasks.workunit.client.1.smithi156.stdout:5/962: write d1/d11/d27/d101/f119 [2322764,80282] 0 2024-04-23T14:50:10.844 INFO:tasks.workunit.client.1.smithi156.stdout:0/985: dread d0/d16/d3a/d2a/fb9 [0,4194304] 0 2024-04-23T14:50:10.853 INFO:tasks.workunit.client.1.smithi156.stdout:4/941: dwrite d0/df/d55/d68/d53/d91/d95/db5/dbe/f115 [0,4194304] 0 2024-04-23T14:50:10.853 INFO:tasks.workunit.client.1.smithi156.stdout:4/942: readlink d0/d8/d1e/d4a/d77/d9c/la2 0 2024-04-23T14:50:10.867 INFO:tasks.workunit.client.1.smithi156.stdout:9/818: dread d1/d2/d23/d49/d4c/f3b [0,4194304] 0 2024-04-23T14:50:10.867 INFO:tasks.workunit.client.1.smithi156.stdout:9/819: chown d1/d2/d3e/d55/d66/dd6/ded/d17/f2c 1086890 1 2024-04-23T14:50:10.869 INFO:tasks.workunit.client.1.smithi156.stdout:1/982: dwrite db/fa5 [0,4194304] 0 2024-04-23T14:50:10.870 INFO:tasks.workunit.client.1.smithi156.stdout:1/983: truncate db/d1f/d2d/d48/daf/d68/feb 888391 0 2024-04-23T14:50:10.870 INFO:tasks.workunit.client.1.smithi156.stdout:4/943: dread d0/d8/d1e/d4a/d77/dc1/fd9 [4194304,4194304] 0 2024-04-23T14:50:10.870 INFO:tasks.workunit.client.1.smithi156.stdout:5/963: dwrite d1/d3/d24/da0/f3c [0,4194304] 0 2024-04-23T14:50:10.871 INFO:tasks.workunit.client.1.smithi156.stdout:9/820: truncate d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/f63 1639759 0 2024-04-23T14:50:10.871 INFO:tasks.workunit.client.1.smithi156.stdout:9/821: write d1/fe [281138,13368] 0 2024-04-23T14:50:10.886 INFO:tasks.workunit.client.1.smithi156.stdout:1/984: mknod db/d25/d30/d38/ddc/d123/c134 0 2024-04-23T14:50:10.887 INFO:tasks.workunit.client.1.smithi156.stdout:0/986: dwrite d0/d16/d3a/d2a/d1d/da8/f131 [0,4194304] 0 2024-04-23T14:50:10.888 INFO:tasks.workunit.client.1.smithi156.stdout:7/946: sync 2024-04-23T14:50:10.888 INFO:tasks.workunit.client.1.smithi156.stdout:7/947: chown dc/d2c/dbe/dc2/fbc 13 1 2024-04-23T14:50:10.888 INFO:tasks.workunit.client.1.smithi156.stdout:7/948: chown dc/d9d/c11b 13168788 1 2024-04-23T14:50:10.888 INFO:tasks.workunit.client.1.smithi156.stdout:4/944: mknod d0/df/d55/d68/d53/d91/dd1/d108/c13e 0 2024-04-23T14:50:10.889 INFO:tasks.workunit.client.1.smithi156.stdout:5/964: creat d1/d3/d24/dbc/df5/f127 x:0 0 0 2024-04-23T14:50:10.889 INFO:tasks.workunit.client.1.smithi156.stdout:5/965: chown d1/d11/d18/d52/d85 0 1 2024-04-23T14:50:10.891 INFO:tasks.workunit.client.1.smithi156.stdout:3/845: sync 2024-04-23T14:50:10.891 INFO:tasks.workunit.client.1.smithi156.stdout:8/957: sync 2024-04-23T14:50:10.891 INFO:tasks.workunit.client.1.smithi156.stdout:3/846: chown d4/db/dd/d20/l8b 252800 1 2024-04-23T14:50:10.891 INFO:tasks.workunit.client.1.smithi156.stdout:3/847: write d4/db/dd/d1d/d61/d8d/d8a/d98/fef [23512,67261] 0 2024-04-23T14:50:10.892 INFO:tasks.workunit.client.1.smithi156.stdout:9/822: mknod d1/d2/d8c/c110 0 2024-04-23T14:50:10.892 INFO:tasks.workunit.client.1.smithi156.stdout:1/985: mknod db/d25/c135 0 2024-04-23T14:50:10.896 INFO:tasks.workunit.client.1.smithi156.stdout:0/987: getdents d0/d4/d22 0 2024-04-23T14:50:10.900 INFO:tasks.workunit.client.1.smithi156.stdout:4/945: unlink d0/d76/l29 0 2024-04-23T14:50:10.901 INFO:tasks.workunit.client.1.smithi156.stdout:8/958: unlink d5/d9/d5a/ff9 0 2024-04-23T14:50:10.903 INFO:tasks.workunit.client.1.smithi156.stdout:3/848: symlink d4/db/dd/d1d/d1e/d42/d76/dba/de5/df6/l10a 0 2024-04-23T14:50:10.904 INFO:tasks.workunit.client.1.smithi156.stdout:3/849: chown d4/db/dd/d1d/d1e/d2b/ffe 59447 1 2024-04-23T14:50:10.904 INFO:tasks.workunit.client.1.smithi156.stdout:3/850: truncate d4/db/dd/d1d/d1e/d13/f1a 785220 0 2024-04-23T14:50:10.904 INFO:tasks.workunit.client.1.smithi156.stdout:9/823: mkdir d1/d2/d3e/d55/d66/dd6/ded/d40/d35/db6/dc5/d111 0 2024-04-23T14:50:10.906 INFO:tasks.workunit.client.1.smithi156.stdout:7/949: dread dc/d1d/d41/f47 [0,4194304] 0 2024-04-23T14:50:10.906 INFO:tasks.workunit.client.1.smithi156.stdout:1/986: rename db/d1f/d2d/d48/db4/l120 to db/d25/d6b/d125/l136 0 2024-04-23T14:50:10.907 INFO:tasks.workunit.client.1.smithi156.stdout:0/988: mkdir d0/d16/da4/d113/d147 0 2024-04-23T14:50:10.909 INFO:tasks.workunit.client.1.smithi156.stdout:4/946: unlink d0/df/d55/d68/f43 0 2024-04-23T14:50:10.910 INFO:tasks.workunit.client.1.smithi156.stdout:8/959: rename d5/d9/d10/d1d/d21/fcc to d5/d9/d10/d1d/d21/f152 0 2024-04-23T14:50:10.912 INFO:tasks.workunit.client.1.smithi156.stdout:7/950: creat dc/d2c/dbe/f12a x:0 0 0 2024-04-23T14:50:10.912 INFO:tasks.workunit.client.1.smithi156.stdout:7/951: chown dc/d1d/d48/c5d 2 1 2024-04-23T14:50:10.912 INFO:tasks.workunit.client.1.smithi156.stdout:7/952: chown dc/cfc 1403301 1 2024-04-23T14:50:10.913 INFO:tasks.workunit.client.1.smithi156.stdout:1/987: truncate db/d1f/d94/da1/f107 1704321 0 2024-04-23T14:50:10.913 INFO:tasks.workunit.client.1.smithi156.stdout:1/988: chown db/d1f/d2d/d48/dab/dcf/lfc 103145985 1 2024-04-23T14:50:10.916 INFO:tasks.workunit.client.1.smithi156.stdout:0/989: symlink d0/d16/d3a/dec/l148 0 2024-04-23T14:50:10.916 INFO:tasks.workunit.client.1.smithi156.stdout:4/947: mknod d0/df/d55/d68/d53/d91/ddc/c13f 0 2024-04-23T14:50:10.917 INFO:tasks.workunit.client.1.smithi156.stdout:7/953: mknod dc/d2c/dbe/dc2/d119/c12b 0 2024-04-23T14:50:10.917 INFO:tasks.workunit.client.1.smithi156.stdout:4/948: fsync d0/df/d55/d68/d53/d9f/dcc/df1/fe8 0 2024-04-23T14:50:10.927 INFO:tasks.workunit.client.1.smithi156.stdout:7/954: creat dc/d46/dca/f12c x:0 0 0 2024-04-23T14:50:10.927 INFO:tasks.workunit.client.1.smithi156.stdout:4/949: stat d0/d76/c9e 0 2024-04-23T14:50:10.932 INFO:tasks.workunit.client.1.smithi156.stdout:7/955: rmdir dc/d46/d58/d124 0 2024-04-23T14:50:10.937 INFO:tasks.workunit.client.1.smithi156.stdout:4/950: rename d0/d8/d1e/d126 to d0/df/d55/d68/d53/d91/d95/def/d110/d12c/d140 0 2024-04-23T14:50:10.942 INFO:tasks.workunit.client.1.smithi156.stdout:4/951: mkdir d0/df/d55/d68/d53/d9f/dcc/df1/d118/d141 0 2024-04-23T14:50:10.942 INFO:tasks.workunit.client.1.smithi156.stdout:4/952: chown d0/df/d55/c7d 7835218 1 2024-04-23T14:50:10.962 INFO:tasks.workunit.client.1.smithi156.stdout:4/953: dread d0/d8/f2f [0,4194304] 0 2024-04-23T14:50:10.962 INFO:tasks.workunit.client.1.smithi156.stdout:4/954: write d0/df/d55/f3c [3952598,79762] 0 2024-04-23T14:50:10.967 INFO:tasks.workunit.client.1.smithi156.stdout:8/960: dwrite d5/d9/d36/d84/dc1/fc5 [0,4194304] 0 2024-04-23T14:50:10.967 INFO:tasks.workunit.client.1.smithi156.stdout:1/989: dread db/d1f/d2f/d47/d71/fa4 [0,4194304] 0 2024-04-23T14:50:10.967 INFO:tasks.workunit.client.1.smithi156.stdout:1/990: chown db/d1f/d2d/d48/dab/dcf/d105 1519 1 2024-04-23T14:50:10.969 INFO:tasks.workunit.client.1.smithi156.stdout:8/961: creat d5/d9/d36/d60/db8/ddd/f153 x:0 0 0 2024-04-23T14:50:10.972 INFO:tasks.workunit.client.1.smithi156.stdout:1/991: symlink db/d25/d6b/l137 0 2024-04-23T14:50:10.974 INFO:tasks.workunit.client.1.smithi156.stdout:8/962: mknod d5/d9/d36/d60/db8/d93/d129/c154 0 2024-04-23T14:50:10.993 INFO:tasks.workunit.client.1.smithi156.stdout:3/851: dwrite d4/db/dd/d73/f101 [0,4194304] 0 2024-04-23T14:50:10.993 INFO:tasks.workunit.client.1.smithi156.stdout:5/966: dwrite d1/d17/f7d [4194304,4194304] 0 2024-04-23T14:50:10.993 INFO:tasks.workunit.client.1.smithi156.stdout:5/967: write d1/d11/d27/f2c [1288392,112185] 0 2024-04-23T14:50:11.011 INFO:tasks.workunit.client.1.smithi156.stdout:9/824: dwrite d1/d2/d3e/d50/da9/fc7 [0,4194304] 0 2024-04-23T14:50:11.019 INFO:tasks.workunit.client.1.smithi156.stdout:9/825: link d1/d2/d3e/d55/d66/f10a d1/d2/d3e/d55/d66/dd6/ded/d40/d35/db6/f112 0 2024-04-23T14:50:11.029 INFO:tasks.workunit.client.1.smithi156.stdout:8/963: write d5/d9/d10/d1d/fe3 [3882650,17538] 0 2024-04-23T14:50:11.032 INFO:tasks.workunit.client.1.smithi156.stdout:7/956: dwrite dc/d2a/fce [0,4194304] 0 2024-04-23T14:50:11.038 INFO:tasks.workunit.client.1.smithi156.stdout:3/852: read d4/db/dd/d1d/d1e/d13/f1f [748160,62591] 0 2024-04-23T14:50:11.039 INFO:tasks.workunit.client.1.smithi156.stdout:4/955: dwrite d0/df/f58 [0,4194304] 0 2024-04-23T14:50:11.039 INFO:tasks.workunit.client.1.smithi156.stdout:4/956: write d0/df/d75/f87 [101854,109813] 0 2024-04-23T14:50:11.039 INFO:tasks.workunit.client.1.smithi156.stdout:4/957: dread - d0/df/d55/d68/d53/d91/ddc/f111 zero size 2024-04-23T14:50:11.039 INFO:tasks.workunit.client.1.smithi156.stdout:4/958: creat d0/df/d55/d68/d74/f142 x:0 0 0 2024-04-23T14:50:11.041 INFO:tasks.workunit.client.1.smithi156.stdout:5/968: dwrite d1/d11/de0/f10d [0,4194304] 0 2024-04-23T14:50:11.045 INFO:tasks.workunit.client.1.smithi156.stdout:3/853: creat d4/db/dd/d1d/d1e/d74/d93/de9/f10b x:0 0 0 2024-04-23T14:50:11.049 INFO:tasks.workunit.client.1.smithi156.stdout:8/964: write d5/d9/d36/d84/dc1/fc5 [2968782,128712] 0 2024-04-23T14:50:11.049 INFO:tasks.workunit.client.1.smithi156.stdout:8/965: chown d5/d9/d36/d60/db8/ddd/de1/lf6 612 1 2024-04-23T14:50:11.049 INFO:tasks.workunit.client.1.smithi156.stdout:8/966: fdatasync d5/d9/d36/d60/d7c/f10f 0 2024-04-23T14:50:11.052 INFO:tasks.workunit.client.1.smithi156.stdout:4/959: rename d0/d76/d63 to d0/df/d55/d68/d53/de0/d143 0 2024-04-23T14:50:11.052 INFO:tasks.workunit.client.1.smithi156.stdout:7/957: write dc/d46/dca/f11f [1776307,80711] 0 2024-04-23T14:50:11.052 INFO:tasks.workunit.client.1.smithi156.stdout:1/992: dwrite db/d1f/d2d/d48/daf/d86/f67 [0,4194304] 0 2024-04-23T14:50:11.055 INFO:tasks.workunit.client.1.smithi156.stdout:3/854: mknod d4/db/dd/d1d/d1e/d74/d90/c10c 0 2024-04-23T14:50:11.055 INFO:tasks.workunit.client.1.smithi156.stdout:8/967: truncate d5/d9/d10/f46 896080 0 2024-04-23T14:50:11.055 INFO:tasks.workunit.client.1.smithi156.stdout:3/855: fsync d4/db/dd/d1d/d1e/d74/d90/f67 0 2024-04-23T14:50:11.072 INFO:tasks.workunit.client.1.smithi156.stdout:1/993: unlink db/d25/c106 0 2024-04-23T14:50:11.072 INFO:tasks.workunit.client.1.smithi156.stdout:3/856: creat d4/db/dd/d1d/d1e/d42/f10d x:0 0 0 2024-04-23T14:50:11.074 INFO:tasks.workunit.client.1.smithi156.stdout:8/968: truncate d5/d9/f48 1878444 0 2024-04-23T14:50:11.074 INFO:tasks.workunit.client.1.smithi156.stdout:8/969: dread - d5/d9/d36/de8/df5/f11b zero size 2024-04-23T14:50:11.074 INFO:tasks.workunit.client.1.smithi156.stdout:8/970: chown d5/d9/d36/d84/f148 1089867 1 2024-04-23T14:50:11.078 INFO:tasks.workunit.client.1.smithi156.stdout:4/960: rmdir d0/d76 39 2024-04-23T14:50:11.083 INFO:tasks.workunit.client.1.smithi156.stdout:1/994: rmdir db/d1f/d2f 39 2024-04-23T14:50:11.083 INFO:tasks.workunit.client.1.smithi156.stdout:8/971: rename d5/d9/d5a/ldc to d5/d9/l155 0 2024-04-23T14:50:11.084 INFO:tasks.workunit.client.1.smithi156.stdout:8/972: chown d5/d9/d36/d84 41742901 1 2024-04-23T14:50:11.084 INFO:tasks.workunit.client.1.smithi156.stdout:8/973: chown d5/d39/d99/c11e 0 1 2024-04-23T14:50:11.090 INFO:tasks.workunit.client.1.smithi156.stdout:1/995: unlink db/d1f/d28/d70/db3/c10a 0 2024-04-23T14:50:11.094 INFO:tasks.workunit.client.1.smithi156.stdout:3/857: read d4/db/dd/d1d/d1e/d2b/ffe [922206,59947] 0 2024-04-23T14:50:11.098 INFO:tasks.workunit.client.1.smithi156.stdout:3/858: link d4/db/dd/d1d/d61/d8d/d8a/d98/cde d4/db/dd/d20/d57/c10e 0 2024-04-23T14:50:11.103 INFO:tasks.workunit.client.1.smithi156.stdout:3/859: mknod d4/db/dd/d1d/d1e/d13/d5a/dab/c10f 0 2024-04-23T14:50:11.107 INFO:tasks.workunit.client.1.smithi156.stdout:5/969: dwrite d1/d11/d18/d52/f7f [0,4194304] 0 2024-04-23T14:50:11.107 INFO:tasks.workunit.client.1.smithi156.stdout:5/970: readlink d1/d3/d24/dbc/df5/l126 0 2024-04-23T14:50:11.111 INFO:tasks.workunit.client.1.smithi156.stdout:3/860: rename d4/db/dd/d1d/d1e/d74/lbb to d4/db/dd/d1d/d1e/d13/l110 0 2024-04-23T14:50:11.111 INFO:tasks.workunit.client.1.smithi156.stdout:3/861: write d4/db/dd/d1d/d1e/d13/d5a/dab/fb2 [2257647,61432] 0 2024-04-23T14:50:11.124 INFO:tasks.workunit.client.1.smithi156.stdout:7/958: dwrite dc/d46/d58/db7/ddd/f118 [0,4194304] 0 2024-04-23T14:50:11.124 INFO:tasks.workunit.client.1.smithi156.stdout:7/959: readlink dc/d9d/l125 0 2024-04-23T14:50:11.127 INFO:tasks.workunit.client.1.smithi156.stdout:7/960: write dc/d1d/d48/fa0 [453718,87368] 0 2024-04-23T14:50:11.137 INFO:tasks.workunit.client.1.smithi156.stdout:1/996: dwrite db/d25/d30/d38/d40/faa [0,4194304] 0 2024-04-23T14:50:11.141 INFO:tasks.workunit.client.1.smithi156.stdout:7/961: dread dc/f1c [0,4194304] 0 2024-04-23T14:50:11.144 INFO:tasks.workunit.client.1.smithi156.stdout:5/971: dread d1/d3/f25 [0,4194304] 0 2024-04-23T14:50:11.144 INFO:tasks.workunit.client.1.smithi156.stdout:8/974: dwrite d5/d9/d36/d84/f8f [0,4194304] 0 2024-04-23T14:50:11.144 INFO:tasks.workunit.client.1.smithi156.stdout:5/972: chown d1/d11/f4d 30772 1 2024-04-23T14:50:11.144 INFO:tasks.workunit.client.1.smithi156.stdout:5/973: chown d1/d3/ce 1084524 1 2024-04-23T14:50:11.145 INFO:tasks.workunit.client.1.smithi156.stdout:1/997: rename db/d25/lbd to db/d1f/d2f/l138 0 2024-04-23T14:50:11.149 INFO:tasks.workunit.client.1.smithi156.stdout:0/990: sync 2024-04-23T14:50:11.150 INFO:tasks.workunit.client.1.smithi156.stdout:7/962: creat dc/d2a/da9/def/f12d x:0 0 0 2024-04-23T14:50:11.156 INFO:tasks.workunit.client.1.smithi156.stdout:5/974: mkdir d1/d11/d18/d52/d128 0 2024-04-23T14:50:11.159 INFO:tasks.workunit.client.1.smithi156.stdout:1/998: rename db/d1f/d2d/d48/dab/dcf/fd0 to db/d25/d30/d38/d40/f139 0 2024-04-23T14:50:11.162 INFO:tasks.workunit.client.1.smithi156.stdout:8/975: link d5/d9/d10/f46 d5/d9/d36/d60/d7c/f156 0 2024-04-23T14:50:11.164 INFO:tasks.workunit.client.1.smithi156.stdout:0/991: read d0/d4/f3 [302613,126274] 0 2024-04-23T14:50:11.169 INFO:tasks.workunit.client.1.smithi156.stdout:7/963: dread dc/d1d/d41/f3d [0,4194304] 0 2024-04-23T14:50:11.171 INFO:tasks.workunit.client.1.smithi156.stdout:5/975: read d1/fe2 [387040,10770] 0 2024-04-23T14:50:11.175 INFO:tasks.workunit.client.1.smithi156.stdout:8/976: link d5/d9/d36/d9c/f42 d5/d9/d5a/dc8/f157 0 2024-04-23T14:50:11.175 INFO:tasks.workunit.client.1.smithi156.stdout:0/992: creat d0/d16/d3a/d1e/d108/f149 x:0 0 0 2024-04-23T14:50:11.175 INFO:tasks.workunit.client.1.smithi156.stdout:0/993: write d0/d16/d3a/d2a/d1d/d2d/f73 [2441899,46491] 0 2024-04-23T14:50:11.175 INFO:tasks.workunit.client.1.smithi156.stdout:0/994: stat d0/d16/d3a/d1e/f77 0 2024-04-23T14:50:11.175 INFO:tasks.workunit.client.1.smithi156.stdout:8/977: write d5/d9/d10/d1d/f144 [999577,74575] 0 2024-04-23T14:50:11.175 INFO:tasks.workunit.client.1.smithi156.stdout:0/995: write d0/d16/dbf/d3f/fe7 [795750,55118] 0 2024-04-23T14:50:11.185 INFO:tasks.workunit.client.1.smithi156.stdout:5/976: mknod d1/d11/d18/d52/d85/d96/dd3/c129 0 2024-04-23T14:50:11.186 INFO:tasks.workunit.client.1.smithi156.stdout:5/977: stat d1/d11/ff4 0 2024-04-23T14:50:11.187 INFO:tasks.workunit.client.1.smithi156.stdout:0/996: unlink d0/d16/dbf/d3f/d5f/f1f 0 2024-04-23T14:50:11.196 INFO:tasks.workunit.client.1.smithi156.stdout:9/826: sync 2024-04-23T14:50:11.196 INFO:tasks.workunit.client.1.smithi156.stdout:5/978: getdents d1/d3/d43 0 2024-04-23T14:50:11.205 INFO:tasks.workunit.client.1.smithi156.stdout:9/827: truncate d1/d2/d3e/d55/d66/dd6/ded/d40/f72 307828 0 2024-04-23T14:50:11.206 INFO:tasks.workunit.client.1.smithi156.stdout:5/979: creat d1/d3/da6/d86/f12a x:0 0 0 2024-04-23T14:50:11.208 INFO:tasks.workunit.client.1.smithi156.stdout:5/980: mkdir d1/d3/d64/dfa/d12b 0 2024-04-23T14:50:11.211 INFO:tasks.workunit.client.1.smithi156.stdout:1/999: dwrite db/d1f/d94/da1/f107 [0,4194304] 0 2024-04-23T14:50:11.217 INFO:tasks.workunit.client.1.smithi156.stdout:0/997: rmdir d0/d16/dbf/d3f 39 2024-04-23T14:50:11.226 INFO:tasks.workunit.client.1.smithi156.stdout:7/964: dwrite dc/d2c/f108 [0,4194304] 0 2024-04-23T14:50:11.226 INFO:tasks.workunit.client.1.smithi156.stdout:7/965: write dc/d46/dca/df9/f10f [2037000,18585] 0 2024-04-23T14:50:11.226 INFO:tasks.workunit.client.1.smithi156.stdout:7/966: readlink dc/d46/dca/l117 0 2024-04-23T14:50:11.227 INFO:tasks.workunit.client.1.smithi156.stdout:7/967: readlink dc/d46/dca/led 0 2024-04-23T14:50:11.247 INFO:tasks.workunit.client.1.smithi156.stdout:7/968: dread dc/d2c/dbe/dc2/ff0 [0,4194304] 0 2024-04-23T14:50:11.249 INFO:tasks.workunit.client.1.smithi156.stdout:7/969: mknod dc/d2a/da9/def/c12e 0 2024-04-23T14:50:11.256 INFO:tasks.workunit.client.1.smithi156.stdout:4/961: sync 2024-04-23T14:50:11.256 INFO:tasks.workunit.client.1.smithi156.stdout:3/862: sync 2024-04-23T14:50:11.256 INFO:tasks.workunit.client.1.smithi156.stdout:4/962: fsync d0/d8/d1e/d4a/d77/f7c 0 2024-04-23T14:50:11.256 INFO:tasks.workunit.client.1.smithi156.stdout:4/963: fdatasync d0/df/d55/d68/d85/fe6 0 2024-04-23T14:50:11.274 INFO:tasks.workunit.client.1.smithi156.stdout:5/981: dwrite d1/d3/d24/da0/ddd/feb [0,4194304] 0 2024-04-23T14:50:11.279 INFO:tasks.workunit.client.1.smithi156.stdout:0/998: dwrite d0/d16/d43/d9c/fd7 [0,4194304] 0 2024-04-23T14:50:11.279 INFO:tasks.workunit.client.1.smithi156.stdout:3/863: write d4/db/d4b/f81 [8032616,22238] 0 2024-04-23T14:50:11.279 INFO:tasks.workunit.client.1.smithi156.stdout:3/864: stat d4/db/d4b/f81 0 2024-04-23T14:50:11.279 INFO:tasks.workunit.client.1.smithi156.stdout:3/865: fsync d4/db/dd/d1d/d1e/d13/d5a/f6c 0 2024-04-23T14:50:11.281 INFO:tasks.workunit.client.1.smithi156.stdout:5/982: mknod d1/d3/d24/c12c 0 2024-04-23T14:50:11.286 INFO:tasks.workunit.client.1.smithi156.stdout:9/828: dwrite d1/d2/d23/fbe [0,4194304] 0 2024-04-23T14:50:11.286 INFO:tasks.workunit.client.1.smithi156.stdout:3/866: mkdir d4/db/de2/d111 0 2024-04-23T14:50:11.287 INFO:tasks.workunit.client.1.smithi156.stdout:3/867: dread - d4/db/dd/d20/d57/f5f zero size 2024-04-23T14:50:11.287 INFO:tasks.workunit.client.1.smithi156.stdout:5/983: mknod d1/d3/d24/c12d 0 2024-04-23T14:50:11.291 INFO:tasks.workunit.client.1.smithi156.stdout:3/868: truncate d4/db/dd/d1d/f2e 2173078 0 2024-04-23T14:50:11.295 INFO:tasks.workunit.client.1.smithi156.stdout:5/984: truncate d1/d11/d18/d52/d85/d96/dd3/fd6 3585244 0 2024-04-23T14:50:11.295 INFO:tasks.workunit.client.1.smithi156.stdout:5/985: write d1/d11/de0/f73 [2024681,66413] 0 2024-04-23T14:50:11.295 INFO:tasks.workunit.client.1.smithi156.stdout:5/986: fdatasync d1/f38 0 2024-04-23T14:50:11.295 INFO:tasks.workunit.client.1.smithi156.stdout:9/829: dread d1/d2/d3e/d55/d66/dd6/ded/d40/f72 [0,4194304] 0 2024-04-23T14:50:11.296 INFO:tasks.workunit.client.1.smithi156.stdout:3/869: unlink d4/db/dd/d1d/d1e/la7 0 2024-04-23T14:50:11.296 INFO:tasks.workunit.client.1.smithi156.stdout:3/870: truncate d4/df3/d102/f104 329531 0 2024-04-23T14:50:11.296 INFO:tasks.workunit.client.1.smithi156.stdout:3/871: read - d4/db/dd/d1d/d1e/d13/d5a/fc6 zero size 2024-04-23T14:50:11.298 INFO:tasks.workunit.client.1.smithi156.stdout:5/987: link d1/d3/cc4 d1/d11/d18/d52/d85/d96/db4/c12e 0 2024-04-23T14:50:11.300 INFO:tasks.workunit.client.1.smithi156.stdout:0/999: read d0/d16/d3a/d2a/f12 [2519298,14439] 0 2024-04-23T14:50:11.301 INFO:tasks.workunit.client.1.smithi156.stdout:7/970: dwrite dc/d1d/f112 [0,4194304] 0 2024-04-23T14:50:11.316 INFO:tasks.workunit.client.1.smithi156.stdout:7/971: rmdir dc/d2a/da9/def 39 2024-04-23T14:50:11.316 INFO:tasks.workunit.client.1.smithi156.stdout:7/972: chown dc/d93/d6c/c113 14 1 2024-04-23T14:50:11.319 INFO:tasks.workunit.client.1.smithi156.stdout:7/973: creat dc/d2a/f12f x:0 0 0 2024-04-23T14:50:11.321 INFO:tasks.workunit.client.1.smithi156.stdout:7/974: mknod dc/d1d/d24/dc9/c130 0 2024-04-23T14:50:11.321 INFO:tasks.workunit.client.1.smithi156.stdout:3/872: truncate d4/db/dd/d1d/f2e 1854178 0 2024-04-23T14:50:11.321 INFO:tasks.workunit.client.1.smithi156.stdout:3/873: read - d4/db/dd/d1d/d1e/d13/f109 zero size 2024-04-23T14:50:11.323 INFO:tasks.workunit.client.1.smithi156.stdout:3/874: mkdir d4/db/de2/d111/d112 0 2024-04-23T14:50:11.326 INFO:tasks.workunit.client.1.smithi156.stdout:3/875: rename d4/db/dd/d1d/d1e/d42/f52 to d4/db/dd/d1d/d61/d8d/d91/f113 0 2024-04-23T14:50:11.326 INFO:tasks.workunit.client.1.smithi156.stdout:3/876: fdatasync d4/db/dd/d1d/d1e/d13/d5a/dab/ffa 0 2024-04-23T14:50:11.326 INFO:tasks.workunit.client.1.smithi156.stdout:3/877: fsync d4/db/dd/d1d/d1e/d13/f1f 0 2024-04-23T14:50:11.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:11 smithi081 ceph-mon[25540]: pgmap v44: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 215 MiB/s rd, 261 MiB/s wr, 411 op/s 2024-04-23T14:50:11.329 INFO:tasks.workunit.client.1.smithi156.stdout:3/878: creat d4/db/dd/d1d/d1e/d74/d93/f114 x:0 0 0 2024-04-23T14:50:11.331 INFO:tasks.workunit.client.1.smithi156.stdout:8/978: sync 2024-04-23T14:50:11.333 INFO:tasks.workunit.client.1.smithi156.stdout:8/979: creat d5/d9/d5a/f158 x:0 0 0 2024-04-23T14:50:11.336 INFO:tasks.workunit.client.1.smithi156.stdout:8/980: getdents d5/d9/d36/d60/db8/d93 0 2024-04-23T14:50:11.336 INFO:tasks.workunit.client.1.smithi156.stdout:8/981: fdatasync d5/d9/d5a/d5c/f10a 0 2024-04-23T14:50:11.337 INFO:tasks.workunit.client.1.smithi156.stdout:8/982: mknod d5/d9/d36/d60/db8/d8a/c159 0 2024-04-23T14:50:11.349 INFO:tasks.workunit.client.1.smithi156.stdout:5/988: dread d1/d11/d27/f77 [0,4194304] 0 2024-04-23T14:50:11.354 INFO:tasks.workunit.client.1.smithi156.stdout:8/983: read d5/d9/d10/d1d/f8e [7735425,55149] 0 2024-04-23T14:50:11.354 INFO:tasks.workunit.client.1.smithi156.stdout:8/984: creat d5/d9/d36/d60/f15a x:0 0 0 2024-04-23T14:50:11.355 INFO:tasks.workunit.client.1.smithi156.stdout:8/985: read - d5/d9/d36/d60/db8/f102 zero size 2024-04-23T14:50:11.356 INFO:tasks.workunit.client.1.smithi156.stdout:8/986: rmdir d5/d9/d5a/d57 39 2024-04-23T14:50:11.358 INFO:tasks.workunit.client.1.smithi156.stdout:8/987: symlink d5/d9/d10/d1d/d21/d139/l15b 0 2024-04-23T14:50:11.367 INFO:tasks.workunit.client.1.smithi156.stdout:8/988: dread d5/d9/d36/d60/db8/ddd/de1/f137 [0,4194304] 0 2024-04-23T14:50:11.367 INFO:tasks.workunit.client.1.smithi156.stdout:9/830: dwrite d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/f87 [0,4194304] 0 2024-04-23T14:50:11.368 INFO:tasks.workunit.client.1.smithi156.stdout:8/989: rename d5/d39/f61 to d5/f15c 0 2024-04-23T14:50:11.370 INFO:tasks.workunit.client.1.smithi156.stdout:9/831: link d1/d2/d3e/d55/d66/dd6/ded/d17/l24 d1/d2/d3e/d55/dce/l113 0 2024-04-23T14:50:11.371 INFO:tasks.workunit.client.1.smithi156.stdout:5/989: write d1/d3/d24/f58 [325765,66073] 0 2024-04-23T14:50:11.371 INFO:tasks.workunit.client.1.smithi156.stdout:5/990: chown d1/d11/d18/d52/d85/ca3 12522796 1 2024-04-23T14:50:11.375 INFO:tasks.workunit.client.1.smithi156.stdout:8/990: rmdir d5/d9/d36/d60/db8/d93 39 2024-04-23T14:50:11.379 INFO:tasks.workunit.client.1.smithi156.stdout:9/832: rmdir d1/d2 39 2024-04-23T14:50:11.379 INFO:tasks.workunit.client.1.smithi156.stdout:5/991: getdents d1/d11/de0 0 2024-04-23T14:50:11.379 INFO:tasks.workunit.client.1.smithi156.stdout:7/975: dwrite dc/d9d/fa2 [4194304,4194304] 0 2024-04-23T14:50:11.379 INFO:tasks.workunit.client.1.smithi156.stdout:9/833: creat d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/db9/f114 x:0 0 0 2024-04-23T14:50:11.385 INFO:tasks.workunit.client.1.smithi156.stdout:5/992: creat d1/d11/d18/d19/f12f x:0 0 0 2024-04-23T14:50:11.386 INFO:tasks.workunit.client.1.smithi156.stdout:7/976: truncate dc/d2c/f108 1982034 0 2024-04-23T14:50:11.389 INFO:tasks.workunit.client.1.smithi156.stdout:9/834: symlink d1/d2/d23/d75/l115 0 2024-04-23T14:50:11.391 INFO:tasks.workunit.client.1.smithi156.stdout:7/977: creat dc/d1d/dba/dd4/dd9/f131 x:0 0 0 2024-04-23T14:50:11.394 INFO:tasks.workunit.client.1.smithi156.stdout:9/835: mknod d1/d2/d23/d49/d4b/dbc/c116 0 2024-04-23T14:50:11.401 INFO:tasks.workunit.client.1.smithi156.stdout:7/978: unlink dc/d46/d58/c7c 0 2024-04-23T14:50:11.403 INFO:tasks.workunit.client.1.smithi156.stdout:8/991: write d5/d9/d36/db5/d98/fc3 [1016467,118149] 0 2024-04-23T14:50:11.403 INFO:tasks.workunit.client.1.smithi156.stdout:8/992: truncate d5/d9/d36/d84/d8c/faa 4803855 0 2024-04-23T14:50:11.403 INFO:tasks.workunit.client.1.smithi156.stdout:9/836: creat d1/d2/d3e/dd1/f117 x:0 0 0 2024-04-23T14:50:11.404 INFO:tasks.workunit.client.1.smithi156.stdout:3/879: dwrite d4/db/dd/d1d/d1e/d13/f41 [0,4194304] 0 2024-04-23T14:50:11.407 INFO:tasks.workunit.client.1.smithi156.stdout:7/979: getdents dc/d1d/d48 0 2024-04-23T14:50:11.411 INFO:tasks.workunit.client.1.smithi156.stdout:4/964: sync 2024-04-23T14:50:11.412 INFO:tasks.workunit.client.1.smithi156.stdout:8/993: getdents d5/d9/d36/d84/dc1/dcf 0 2024-04-23T14:50:11.417 INFO:tasks.workunit.client.1.smithi156.stdout:9/837: mkdir d1/d2/d3e/d80/d118 0 2024-04-23T14:50:11.418 INFO:tasks.workunit.client.1.smithi156.stdout:4/965: mkdir d0/df/d55/d68/d53/de0/d144 0 2024-04-23T14:50:11.420 INFO:tasks.workunit.client.1.smithi156.stdout:8/994: truncate d5/d9/d36/d60/d7c/fac 2504877 0 2024-04-23T14:50:11.421 INFO:tasks.workunit.client.1.smithi156.stdout:4/966: unlink d0/df/d55/d68/d53/d91/la9 0 2024-04-23T14:50:11.422 INFO:tasks.workunit.client.1.smithi156.stdout:4/967: write d0/df/d55/d68/d53/de0/d143/f134 [69514,122249] 0 2024-04-23T14:50:11.423 INFO:tasks.workunit.client.1.smithi156.stdout:8/995: symlink d5/d9/d36/d60/db8/ddd/l15d 0 2024-04-23T14:50:11.425 INFO:tasks.workunit.client.1.smithi156.stdout:5/993: dwrite d1/d3/d24/f57 [0,4194304] 0 2024-04-23T14:50:11.425 INFO:tasks.workunit.client.1.smithi156.stdout:5/994: read d1/d3/d43/fc7 [2952341,27810] 0 2024-04-23T14:50:11.431 INFO:tasks.workunit.client.1.smithi156.stdout:5/995: unlink d1/d3/d24/f57 0 2024-04-23T14:50:11.431 INFO:tasks.workunit.client.1.smithi156.stdout:5/996: truncate d1/d11/d27/d101/f11e 975030 0 2024-04-23T14:50:11.431 INFO:tasks.workunit.client.1.smithi156.stdout:5/997: fsync d1/d11/d27/f77 0 2024-04-23T14:50:11.433 INFO:tasks.workunit.client.1.smithi156.stdout:8/996: dread d5/d9/d36/d84/fde [0,4194304] 0 2024-04-23T14:50:11.433 INFO:tasks.workunit.client.1.smithi156.stdout:5/998: symlink d1/l130 0 2024-04-23T14:50:11.437 INFO:tasks.workunit.client.1.smithi156.stdout:5/999: symlink d1/d11/d18/d19/d9a/l131 0 2024-04-23T14:50:11.444 INFO:tasks.workunit.client.1.smithi156.stdout:9/838: write d1/f51 [3262603,53594] 0 2024-04-23T14:50:11.444 INFO:tasks.workunit.client.1.smithi156.stdout:9/839: chown d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/f36 29352 1 2024-04-23T14:50:11.446 INFO:tasks.workunit.client.1.smithi156.stdout:9/840: symlink d1/d2/d3e/dd1/l119 0 2024-04-23T14:50:11.448 INFO:tasks.workunit.client.1.smithi156.stdout:9/841: symlink d1/d2/d23/def/l11a 0 2024-04-23T14:50:11.449 INFO:tasks.workunit.client.1.smithi156.stdout:9/842: dread - d1/d2/d3e/d50/fa8 zero size 2024-04-23T14:50:11.450 INFO:tasks.workunit.client.1.smithi156.stdout:4/968: dread d0/d76/f4d [4194304,4194304] 0 2024-04-23T14:50:11.476 INFO:tasks.workunit.client.1.smithi156.stdout:3/880: dwrite d4/db/dd/d1d/d61/f71 [0,4194304] 0 2024-04-23T14:50:11.476 INFO:tasks.workunit.client.1.smithi156.stdout:3/881: fsync d4/db/dd/d1d/d61/f6a 0 2024-04-23T14:50:11.479 INFO:tasks.workunit.client.1.smithi156.stdout:3/882: creat d4/db/de2/d111/d112/f115 x:0 0 0 2024-04-23T14:50:11.482 INFO:tasks.workunit.client.1.smithi156.stdout:7/980: dwrite dc/d46/d58/db7/fc5 [0,4194304] 0 2024-04-23T14:50:11.484 INFO:tasks.workunit.client.1.smithi156.stdout:3/883: creat d4/db/dd/d1d/f116 x:0 0 0 2024-04-23T14:50:11.485 INFO:tasks.workunit.client.1.smithi156.stdout:3/884: creat d4/db/dd/d1d/d61/d7f/f117 x:0 0 0 2024-04-23T14:50:11.485 INFO:tasks.workunit.client.1.smithi156.stdout:3/885: dread - d4/db/dd/d1d/f116 zero size 2024-04-23T14:50:11.485 INFO:tasks.workunit.client.1.smithi156.stdout:8/997: dwrite d5/d45/f4f [0,4194304] 0 2024-04-23T14:50:11.485 INFO:tasks.workunit.client.1.smithi156.stdout:8/998: chown d5/d9/d36/d60/db8/d93/fbf 34044 1 2024-04-23T14:50:11.485 INFO:tasks.workunit.client.1.smithi156.stdout:8/999: dread - d5/d9/d10/d1d/f12a zero size 2024-04-23T14:50:11.490 INFO:tasks.workunit.client.1.smithi156.stdout:7/981: creat dc/d1d/d48/da6/f132 x:0 0 0 2024-04-23T14:50:11.493 INFO:tasks.workunit.client.1.smithi156.stdout:3/886: mkdir d4/db/dd/d1d/d1e/d42/d76/dba/de5/d118 0 2024-04-23T14:50:11.496 INFO:tasks.workunit.client.1.smithi156.stdout:7/982: link dc/d1d/lf5 dc/d93/d6c/l133 0 2024-04-23T14:50:11.521 INFO:tasks.workunit.client.1.smithi156.stdout:4/969: dwrite d0/df/d55/fcf [0,4194304] 0 2024-04-23T14:50:11.521 INFO:tasks.workunit.client.1.smithi156.stdout:4/970: chown d0/d8/d1e 161 1 2024-04-23T14:50:11.521 INFO:tasks.workunit.client.1.smithi156.stdout:4/971: dread - d0/df/d55/d68/d53/d9f/f107 zero size 2024-04-23T14:50:11.528 INFO:tasks.workunit.client.1.smithi156.stdout:4/972: rmdir d0/df/d55/d68/d53/d9f/dcc/df1/d8a 39 2024-04-23T14:50:11.531 INFO:tasks.workunit.client.1.smithi156.stdout:4/973: write d0/d8/d1e/d4a/d77/fa3 [171509,42555] 0 2024-04-23T14:50:11.531 INFO:tasks.workunit.client.1.smithi156.stdout:4/974: stat d0/c2b 0 2024-04-23T14:50:11.534 INFO:tasks.workunit.client.1.smithi156.stdout:4/975: truncate d0/d76/f4d 748155 0 2024-04-23T14:50:11.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:11 smithi156 ceph-mon[32341]: pgmap v44: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 215 MiB/s rd, 261 MiB/s wr, 411 op/s 2024-04-23T14:50:11.536 INFO:tasks.workunit.client.1.smithi156.stdout:4/976: write d0/d8/d1e/da0/fb8 [428012,79546] 0 2024-04-23T14:50:11.538 INFO:tasks.workunit.client.1.smithi156.stdout:4/977: creat d0/df/d55/d68/d53/d91/d95/db5/dbe/f145 x:0 0 0 2024-04-23T14:50:11.538 INFO:tasks.workunit.client.1.smithi156.stdout:4/978: creat d0/df/d55/d68/d53/d9f/dcc/f146 x:0 0 0 2024-04-23T14:50:11.538 INFO:tasks.workunit.client.1.smithi156.stdout:4/979: creat d0/d8/d1e/d4a/f147 x:0 0 0 2024-04-23T14:50:11.545 INFO:tasks.workunit.client.1.smithi156.stdout:9/843: dwrite d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/f87 [4194304,4194304] 0 2024-04-23T14:50:11.551 INFO:tasks.workunit.client.1.smithi156.stdout:9/844: read d1/d2/f13 [284497,92785] 0 2024-04-23T14:50:11.552 INFO:tasks.workunit.client.1.smithi156.stdout:9/845: creat d1/d2/d23/d49/d4c/f11b x:0 0 0 2024-04-23T14:50:11.552 INFO:tasks.workunit.client.1.smithi156.stdout:9/846: truncate d1/d2/d3e/d55/d66/dd6/ded/d40/d35/db6/dc5/f109 712011 0 2024-04-23T14:50:11.552 INFO:tasks.workunit.client.1.smithi156.stdout:9/847: chown d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/db9/ffe 116 1 2024-04-23T14:50:11.559 INFO:tasks.workunit.client.1.smithi156.stdout:9/848: unlink d1/d2/d3e/d55/d6f/cdf 0 2024-04-23T14:50:11.561 INFO:tasks.workunit.client.1.smithi156.stdout:3/887: dwrite d4/db/dd/d1d/d1e/d74/d93/dad/fee [0,4194304] 0 2024-04-23T14:50:11.561 INFO:tasks.workunit.client.1.smithi156.stdout:3/888: chown d4/db/dd/d1d/d1e/d42/d76/dba/de5 1483 1 2024-04-23T14:50:11.561 INFO:tasks.workunit.client.1.smithi156.stdout:3/889: truncate d4/db/dd/d1d/d1e/d13/d5a/ff8 880821 0 2024-04-23T14:50:11.564 INFO:tasks.workunit.client.1.smithi156.stdout:9/849: link d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/db9/ffe d1/d2/d3e/d55/d66/dd6/ded/d17/f11c 0 2024-04-23T14:50:11.576 INFO:tasks.workunit.client.1.smithi156.stdout:3/890: symlink d4/db/dd/d1d/d1e/d74/d93/l119 0 2024-04-23T14:50:11.576 INFO:tasks.workunit.client.1.smithi156.stdout:3/891: stat d4/db/dd/d1d/l85 0 2024-04-23T14:50:11.577 INFO:tasks.workunit.client.1.smithi156.stdout:9/850: symlink d1/d2/d3e/d55/d66/dd6/dec/l11d 0 2024-04-23T14:50:11.578 INFO:tasks.workunit.client.1.smithi156.stdout:3/892: symlink d4/db/dd/d20/l11a 0 2024-04-23T14:50:11.579 INFO:tasks.workunit.client.1.smithi156.stdout:9/851: symlink d1/d2/d23/d49/l11e 0 2024-04-23T14:50:11.580 INFO:tasks.workunit.client.1.smithi156.stdout:3/893: unlink d4/db/dd/d1d/d61/d8d/d8a/d98/f105 0 2024-04-23T14:50:11.585 INFO:tasks.workunit.client.1.smithi156.stdout:4/980: dwrite d0/d8/d1e/da0/de7/f11f [0,4194304] 0 2024-04-23T14:50:11.591 INFO:tasks.workunit.client.1.smithi156.stdout:4/981: mkdir d0/df/d55/d68/d53/d9f/d148 0 2024-04-23T14:50:11.601 INFO:tasks.workunit.client.1.smithi156.stdout:7/983: sync 2024-04-23T14:50:11.605 INFO:tasks.workunit.client.1.smithi156.stdout:4/982: dread d0/df/d55/d68/d85/f90 [0,4194304] 0 2024-04-23T14:50:11.606 INFO:tasks.workunit.client.1.smithi156.stdout:4/983: write d0/df/f6b [5122171,76349] 0 2024-04-23T14:50:11.608 INFO:tasks.workunit.client.1.smithi156.stdout:7/984: dread dc/d2a/f6a [0,4194304] 0 2024-04-23T14:50:11.608 INFO:tasks.workunit.client.1.smithi156.stdout:7/985: creat dc/d46/dca/df8/f134 x:0 0 0 2024-04-23T14:50:11.610 INFO:tasks.workunit.client.1.smithi156.stdout:4/984: rename d0/c10 to d0/df/d55/d68/d53/d9f/c149 0 2024-04-23T14:50:11.612 INFO:tasks.workunit.client.1.smithi156.stdout:7/986: mknod dc/d2c/dbe/c135 0 2024-04-23T14:50:11.612 INFO:tasks.workunit.client.1.smithi156.stdout:7/987: readlink dc/d46/d58/db7/ddd/ld3 0 2024-04-23T14:50:11.612 INFO:tasks.workunit.client.1.smithi156.stdout:7/988: readlink dc/d2c/dbe/dc2/lc8 0 2024-04-23T14:50:11.615 INFO:tasks.workunit.client.1.smithi156.stdout:7/989: rename dc/d46/d58/db7/ddd/f118 to dc/d2c/dbe/dc2/d119/f136 0 2024-04-23T14:50:11.615 INFO:tasks.workunit.client.1.smithi156.stdout:7/990: chown dc/d1d/d48/fdb 297945855 1 2024-04-23T14:50:11.618 INFO:tasks.workunit.client.1.smithi156.stdout:3/894: dwrite d4/db/de2/d111/d112/f115 [0,4194304] 0 2024-04-23T14:50:11.621 INFO:tasks.workunit.client.1.smithi156.stdout:3/895: mkdir d4/db/dd/d20/d57/d11b 0 2024-04-23T14:50:11.632 INFO:tasks.workunit.client.1.smithi156.stdout:7/991: dread dc/d46/dca/f11f [0,4194304] 0 2024-04-23T14:50:11.639 INFO:tasks.workunit.client.1.smithi156.stdout:3/896: read d4/db/dd/d1d/d61/d8d/d91/f113 [1019378,67159] 0 2024-04-23T14:50:11.641 INFO:tasks.workunit.client.1.smithi156.stdout:3/897: mknod d4/db/dd/d1d/d1e/d74/c11c 0 2024-04-23T14:50:11.641 INFO:tasks.workunit.client.1.smithi156.stdout:3/898: chown d4/db/dd/d20/d57/c99 5496670 1 2024-04-23T14:50:11.641 INFO:tasks.workunit.client.1.smithi156.stdout:3/899: chown d4/db/dd/d1d/f3b 2489073 1 2024-04-23T14:50:11.641 INFO:tasks.workunit.client.1.smithi156.stdout:3/900: chown d4/db/dd/d1d/d61/d8d/d8a/f103 73229792 1 2024-04-23T14:50:11.641 INFO:tasks.workunit.client.1.smithi156.stdout:3/901: truncate d4/db/dd/d1d/d1e/d74/d93/dad/fd0 5008693 0 2024-04-23T14:50:11.642 INFO:tasks.workunit.client.1.smithi156.stdout:3/902: mkdir d4/db/dd/d73/d11d 0 2024-04-23T14:50:11.642 INFO:tasks.workunit.client.1.smithi156.stdout:3/903: write d4/db/dd/f66 [662807,51509] 0 2024-04-23T14:50:11.643 INFO:tasks.workunit.client.1.smithi156.stdout:3/904: mknod d4/db/dd/d20/d57/d11b/c11e 0 2024-04-23T14:50:11.664 INFO:tasks.workunit.client.1.smithi156.stdout:3/905: write d4/db/dd/d1d/d1e/d42/faa [2921531,67107] 0 2024-04-23T14:50:11.664 INFO:tasks.workunit.client.1.smithi156.stdout:3/906: chown d4/db/dd/d1d/d61/d8d/d8a 28 1 2024-04-23T14:50:11.665 INFO:tasks.workunit.client.1.smithi156.stdout:3/907: chown d4/db/dd/d1d/d1e/d42/d76/dc1 154 1 2024-04-23T14:50:11.670 INFO:tasks.workunit.client.1.smithi156.stdout:3/908: rename d4/db/dd/d1d/d61/d7f/f117 to d4/db/dd/d1d/d1e/d42/d76/dba/de5/f11f 0 2024-04-23T14:50:11.673 INFO:tasks.workunit.client.1.smithi156.stdout:3/909: unlink d4/db/dd/d1d/d1e/d13/d5a/dab/lc9 0 2024-04-23T14:50:11.676 INFO:tasks.workunit.client.1.smithi156.stdout:3/910: mknod d4/db/dd/d1d/d1e/d42/d76/c120 0 2024-04-23T14:50:11.679 INFO:tasks.workunit.client.1.smithi156.stdout:3/911: mkdir d4/db/dd/d1d/d61/d8d/d91/d121 0 2024-04-23T14:50:11.680 INFO:tasks.workunit.client.1.smithi156.stdout:3/912: dread - d4/db/dd/d1d/d1e/d42/d76/dba/fbd zero size 2024-04-23T14:50:11.681 INFO:tasks.workunit.client.1.smithi156.stdout:4/985: dwrite d0/df/d55/d68/d53/d9f/dcc/df1/f8f [0,4194304] 0 2024-04-23T14:50:11.688 INFO:tasks.workunit.client.1.smithi156.stdout:7/992: dwrite dc/d9d/fa2 [4194304,4194304] 0 2024-04-23T14:50:11.688 INFO:tasks.workunit.client.1.smithi156.stdout:3/913: rename d4/db/dd/d20/d57/l9c to d4/db/l122 0 2024-04-23T14:50:11.688 INFO:tasks.workunit.client.1.smithi156.stdout:3/914: write d4/db/dd/d1d/d61/d8d/d91/f113 [3047866,30496] 0 2024-04-23T14:50:11.690 INFO:tasks.workunit.client.1.smithi156.stdout:4/986: getdents d0/df/d55/d68/d53/d91 0 2024-04-23T14:50:11.690 INFO:tasks.workunit.client.1.smithi156.stdout:4/987: readlink d0/df/d55/d68/d53/d91/dd1/l10d 0 2024-04-23T14:50:11.690 INFO:tasks.workunit.client.1.smithi156.stdout:4/988: write d0/df/d55/d68/d53/d91/fc0 [1185306,116408] 0 2024-04-23T14:50:11.690 INFO:tasks.workunit.client.1.smithi156.stdout:4/989: dread - d0/df/d55/d68/d53/d9f/dcc/f146 zero size 2024-04-23T14:50:11.692 INFO:tasks.workunit.client.1.smithi156.stdout:7/993: rename dc/d1d/d48/lb4 to dc/d9d/dfa/l137 0 2024-04-23T14:50:11.692 INFO:tasks.workunit.client.1.smithi156.stdout:7/994: creat dc/d93/d6c/f138 x:0 0 0 2024-04-23T14:50:11.694 INFO:tasks.workunit.client.1.smithi156.stdout:3/915: creat d4/db/dd/d20/d57/d11b/f123 x:0 0 0 2024-04-23T14:50:11.694 INFO:tasks.workunit.client.1.smithi156.stdout:3/916: write d4/db/dd/d1d/f116 [189205,27837] 0 2024-04-23T14:50:11.694 INFO:tasks.workunit.client.1.smithi156.stdout:3/917: chown d4/db/lda 109971292 1 2024-04-23T14:50:11.699 INFO:tasks.workunit.client.1.smithi156.stdout:3/918: symlink d4/db/dd/d1d/d1e/d42/d76/dba/l124 0 2024-04-23T14:50:11.702 INFO:tasks.workunit.client.1.smithi156.stdout:4/990: dread d0/d76/f4d [0,4194304] 0 2024-04-23T14:50:11.718 INFO:tasks.workunit.client.1.smithi156.stdout:3/919: link d4/db/dd/d1d/d1e/d42/d76/c78 d4/db/dd/d1d/d1e/d74/d93/de9/c125 0 2024-04-23T14:50:11.718 INFO:tasks.workunit.client.1.smithi156.stdout:3/920: stat d4/db/dd/d1d/d61/d8d/d91 0 2024-04-23T14:50:11.723 INFO:tasks.workunit.client.1.smithi156.stdout:9/852: sync 2024-04-23T14:50:11.723 INFO:tasks.workunit.client.1.smithi156.stdout:9/853: chown d1/d2/d23/d49 29148939 1 2024-04-23T14:50:11.726 INFO:tasks.workunit.client.1.smithi156.stdout:9/854: creat d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/d48/dd7/f11f x:0 0 0 2024-04-23T14:50:11.727 INFO:tasks.workunit.client.1.smithi156.stdout:9/855: mkdir d1/d2/d3e/d55/dce/d120 0 2024-04-23T14:50:11.728 INFO:tasks.workunit.client.1.smithi156.stdout:9/856: symlink d1/d2/d3e/d55/d66/dd6/ded/d40/d35/db6/dc5/l121 0 2024-04-23T14:50:11.729 INFO:tasks.workunit.client.1.smithi156.stdout:9/857: write d1/d2/d3e/d55/d6f/fba [765499,127868] 0 2024-04-23T14:50:11.729 INFO:tasks.workunit.client.1.smithi156.stdout:9/858: write d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/fc1 [935706,130940] 0 2024-04-23T14:50:11.731 INFO:tasks.workunit.client.1.smithi156.stdout:9/859: unlink d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/f87 0 2024-04-23T14:50:11.737 INFO:tasks.workunit.client.1.smithi156.stdout:9/860: rmdir d1/d2/de0/dff 0 2024-04-23T14:50:11.738 INFO:tasks.workunit.client.1.smithi156.stdout:9/861: truncate d1/d2/d3e/d55/d66/dd6/ded/d40/d35/db6/f112 2149444 0 2024-04-23T14:50:11.738 INFO:tasks.workunit.client.1.smithi156.stdout:9/862: write d1/d2/d3e/d50/fa8 [482985,43863] 0 2024-04-23T14:50:11.742 INFO:tasks.workunit.client.1.smithi156.stdout:9/863: creat d1/d2/d3e/d50/dde/f122 x:0 0 0 2024-04-23T14:50:11.743 INFO:tasks.workunit.client.1.smithi156.stdout:9/864: dread - d1/d2/d3e/d55/d66/dd6/ded/fe1 zero size 2024-04-23T14:50:11.743 INFO:tasks.workunit.client.1.smithi156.stdout:9/865: creat d1/d2/d3e/d50/dde/f123 x:0 0 0 2024-04-23T14:50:11.743 INFO:tasks.workunit.client.1.smithi156.stdout:9/866: write d1/d2/d3e/d55/d66/dd6/ded/d17/f54 [686216,56074] 0 2024-04-23T14:50:11.751 INFO:tasks.workunit.client.1.smithi156.stdout:7/995: dwrite dc/f14 [0,4194304] 0 2024-04-23T14:50:11.757 INFO:tasks.workunit.client.1.smithi156.stdout:7/996: symlink dc/d93/d6c/l139 0 2024-04-23T14:50:11.757 INFO:tasks.workunit.client.1.smithi156.stdout:7/997: fsync dc/d2a/da9/def/f12d 0 2024-04-23T14:50:11.757 INFO:tasks.workunit.client.1.smithi156.stdout:7/998: fsync dc/d46/fb9 0 2024-04-23T14:50:11.760 INFO:tasks.workunit.client.1.smithi156.stdout:7/999: mknod dc/d9d/dd2/c13a 0 2024-04-23T14:50:11.794 INFO:tasks.workunit.client.1.smithi156.stdout:3/921: dwrite d4/db/dd/d1d/d1e/d74/d90/fe1 [0,4194304] 0 2024-04-23T14:50:11.809 INFO:tasks.workunit.client.1.smithi156.stdout:4/991: dwrite d0/f3 [0,4194304] 0 2024-04-23T14:50:11.817 INFO:tasks.workunit.client.1.smithi156.stdout:4/992: mknod d0/df/d55/d68/d13b/c14a 0 2024-04-23T14:50:11.853 INFO:tasks.workunit.client.1.smithi156.stdout:9/867: dwrite d1/d2/d23/d75/f108 [0,4194304] 0 2024-04-23T14:50:11.853 INFO:tasks.workunit.client.1.smithi156.stdout:9/868: write d1/d2/d3e/d55/d6f/fba [3167140,42465] 0 2024-04-23T14:50:11.853 INFO:tasks.workunit.client.1.smithi156.stdout:9/869: truncate d1/d2/d3e/d55/d66/dd6/ded/d17/f54 1061873 0 2024-04-23T14:50:11.860 INFO:tasks.workunit.client.1.smithi156.stdout:9/870: getdents d1/d2/d3e/d55/dce 0 2024-04-23T14:50:11.860 INFO:tasks.workunit.client.1.smithi156.stdout:9/871: dread - d1/d2/d3e/d50/dde/f122 zero size 2024-04-23T14:50:11.862 INFO:tasks.workunit.client.1.smithi156.stdout:9/872: mkdir d1/d2/d3e/d55/d9c/d124 0 2024-04-23T14:50:11.863 INFO:tasks.workunit.client.1.smithi156.stdout:9/873: creat d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/d48/dc2/f125 x:0 0 0 2024-04-23T14:50:11.863 INFO:tasks.workunit.client.1.smithi156.stdout:9/874: chown d1/d2/d3e/d55/d66/dd6/ded/d17/fda 1 1 2024-04-23T14:50:11.868 INFO:tasks.workunit.client.1.smithi156.stdout:4/993: dwrite d0/d8/f40 [0,4194304] 0 2024-04-23T14:50:11.869 INFO:tasks.workunit.client.1.smithi156.stdout:9/875: link d1/d2/d23/f76 d1/d2/d23/dab/f126 0 2024-04-23T14:50:11.869 INFO:tasks.workunit.client.1.smithi156.stdout:9/876: truncate d1/d2/d3e/d80/fd2 57249 0 2024-04-23T14:50:11.869 INFO:tasks.workunit.client.1.smithi156.stdout:9/877: chown d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/db9/lf0 113 1 2024-04-23T14:50:11.869 INFO:tasks.workunit.client.1.smithi156.stdout:9/878: readlink d1/d2/d3e/ld3 0 2024-04-23T14:50:11.875 INFO:tasks.workunit.client.1.smithi156.stdout:4/994: creat d0/df/f14b x:0 0 0 2024-04-23T14:50:11.875 INFO:tasks.workunit.client.1.smithi156.stdout:4/995: write d0/df/d119/f11d [3938545,31179] 0 2024-04-23T14:50:11.878 INFO:tasks.workunit.client.1.smithi156.stdout:9/879: unlink d1/d2/d3e/d55/d6f/laa 0 2024-04-23T14:50:11.885 INFO:tasks.workunit.client.1.smithi156.stdout:4/996: unlink d0/df/f64 0 2024-04-23T14:50:11.889 INFO:tasks.workunit.client.1.smithi156.stdout:9/880: rename d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/d48/l64 to d1/d2/d3e/d80/l127 0 2024-04-23T14:50:11.890 INFO:tasks.workunit.client.1.smithi156.stdout:9/881: write d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/db9/f114 [847970,29075] 0 2024-04-23T14:50:11.890 INFO:tasks.workunit.client.1.smithi156.stdout:9/882: chown d1/d2/d3e/d55/d9c/d39/d6c/cd5 175455873 1 2024-04-23T14:50:11.901 INFO:tasks.workunit.client.1.smithi156.stdout:9/883: mknod d1/d2/d3e/d55/d6f/c128 0 2024-04-23T14:50:11.902 INFO:tasks.workunit.client.1.smithi156.stdout:3/922: sync 2024-04-23T14:50:11.903 INFO:tasks.workunit.client.1.smithi156.stdout:9/884: mkdir d1/d2/d3e/d55/d66/dd6/ded/d40/d35/db6/dc5/d129 0 2024-04-23T14:50:11.906 INFO:tasks.workunit.client.1.smithi156.stdout:9/885: mkdir d1/d2/d23/d12a 0 2024-04-23T14:50:11.907 INFO:tasks.workunit.client.1.smithi156.stdout:3/923: symlink d4/db/dd/d1d/d1e/d74/d93/dc4/l126 0 2024-04-23T14:50:11.907 INFO:tasks.workunit.client.1.smithi156.stdout:3/924: fsync d4/db/dd/d1d/d1e/d74/d90/fd7 0 2024-04-23T14:50:11.911 INFO:tasks.workunit.client.1.smithi156.stdout:9/886: mkdir d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/d48/dc2/d12b 0 2024-04-23T14:50:11.913 INFO:tasks.workunit.client.1.smithi156.stdout:9/887: unlink d1/d2/d3e/d50/f78 0 2024-04-23T14:50:11.919 INFO:tasks.workunit.client.1.smithi156.stdout:9/888: dread d1/d2/d23/d49/d4c/fb2 [4194304,4194304] 0 2024-04-23T14:50:11.920 INFO:tasks.workunit.client.1.smithi156.stdout:9/889: rmdir d1/d2/d3e/d55/d66/dd6/dec 39 2024-04-23T14:50:11.927 INFO:tasks.workunit.client.1.smithi156.stdout:4/997: dwrite d0/df/d55/d68/d53/f79 [0,4194304] 0 2024-04-23T14:50:11.928 INFO:tasks.workunit.client.1.smithi156.stdout:3/925: dread d4/db/dd/d1d/d61/f62 [0,4194304] 0 2024-04-23T14:50:11.932 INFO:tasks.workunit.client.1.smithi156.stdout:9/890: dread d1/f1e [0,4194304] 0 2024-04-23T14:50:11.932 INFO:tasks.workunit.client.1.smithi156.stdout:4/998: symlink d0/df/d55/d68/d53/d91/d95/def/l14c 0 2024-04-23T14:50:11.934 INFO:tasks.workunit.client.1.smithi156.stdout:3/926: creat d4/db/dd/d1d/d61/d8d/d8a/f127 x:0 0 0 2024-04-23T14:50:11.935 INFO:tasks.workunit.client.1.smithi156.stdout:9/891: creat d1/d2/d23/d49/f12c x:0 0 0 2024-04-23T14:50:11.935 INFO:tasks.workunit.client.1.smithi156.stdout:9/892: readlink d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/l84 0 2024-04-23T14:50:11.935 INFO:tasks.workunit.client.1.smithi156.stdout:9/893: chown d1/d2/d3e/d55/d6f 486308 1 2024-04-23T14:50:11.935 INFO:tasks.workunit.client.1.smithi156.stdout:4/999: creat d0/df/d55/d68/d53/d91/d95/f14d x:0 0 0 2024-04-23T14:50:11.937 INFO:tasks.workunit.client.1.smithi156.stdout:9/894: rmdir d1/d2/d3e/dd1 39 2024-04-23T14:50:11.959 INFO:tasks.workunit.client.1.smithi156.stdout:3/927: dread d4/db/dd/d20/d57/f7d [0,4194304] 0 2024-04-23T14:50:12.017 INFO:tasks.workunit.client.1.smithi156.stdout:9/895: dwrite d1/d2/d23/f76 [0,4194304] 0 2024-04-23T14:50:12.017 INFO:tasks.workunit.client.1.smithi156.stdout:9/896: chown d1/d2/d3e/d55/d66/dd6/ded/d17/f82 493 1 2024-04-23T14:50:12.018 INFO:tasks.workunit.client.1.smithi156.stdout:9/897: truncate d1/d2/d3e/d55/d6f/f65 522270 0 2024-04-23T14:50:12.028 INFO:tasks.workunit.client.1.smithi156.stdout:3/928: dwrite d4/db/dd/d1d/d61/d8d/d8a/d98/fef [0,4194304] 0 2024-04-23T14:50:12.033 INFO:tasks.workunit.client.1.smithi156.stdout:3/929: symlink d4/df3/l128 0 2024-04-23T14:50:12.036 INFO:tasks.workunit.client.1.smithi156.stdout:3/930: unlink d4/db/dd/l8e 0 2024-04-23T14:50:12.037 INFO:tasks.workunit.client.1.smithi156.stdout:9/898: dread d1/d2/d3e/d55/d66/dd6/ded/d17/f54 [0,4194304] 0 2024-04-23T14:50:12.038 INFO:tasks.workunit.client.1.smithi156.stdout:9/899: chown d1/d2/d3e/d80/cf8 53688768 1 2024-04-23T14:50:12.039 INFO:tasks.workunit.client.1.smithi156.stdout:3/931: creat d4/db/dd/d1d/d1e/d74/dcf/f129 x:0 0 0 2024-04-23T14:50:12.039 INFO:tasks.workunit.client.1.smithi156.stdout:3/932: write d4/db/dd/d73/f9e [1511949,109384] 0 2024-04-23T14:50:12.042 INFO:tasks.workunit.client.1.smithi156.stdout:3/933: chown d4/db/dd/d1d/d1e/d74/d93/dc4/ld2 62007360 1 2024-04-23T14:50:12.042 INFO:tasks.workunit.client.1.smithi156.stdout:3/934: creat d4/db/dd/d1d/d1e/d74/d93/dad/f12a x:0 0 0 2024-04-23T14:50:12.047 INFO:tasks.workunit.client.1.smithi156.stdout:3/935: symlink d4/db/dd/l12b 0 2024-04-23T14:50:12.047 INFO:tasks.workunit.client.1.smithi156.stdout:3/936: write d4/db/dd/d1d/d1e/d13/d5a/fc6 [174202,103235] 0 2024-04-23T14:50:12.048 INFO:tasks.workunit.client.1.smithi156.stdout:9/900: write d1/d2/d3e/d55/d66/f10a [1499935,124197] 0 2024-04-23T14:50:12.048 INFO:tasks.workunit.client.1.smithi156.stdout:9/901: creat d1/d2/d23/d75/f12d x:0 0 0 2024-04-23T14:50:12.054 INFO:tasks.workunit.client.1.smithi156.stdout:9/902: creat d1/d2/d3e/d55/d9c/f12e x:0 0 0 2024-04-23T14:50:12.060 INFO:tasks.workunit.client.1.smithi156.stdout:3/937: dread d4/db/dd/d20/d57/fcd [0,4194304] 0 2024-04-23T14:50:12.061 INFO:tasks.workunit.client.1.smithi156.stdout:9/903: dread d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/f7f [0,4194304] 0 2024-04-23T14:50:12.062 INFO:tasks.workunit.client.1.smithi156.stdout:3/938: rmdir d4/db/dd/d1d/d1e/d42/d76 39 2024-04-23T14:50:12.062 INFO:tasks.workunit.client.1.smithi156.stdout:3/939: fsync d4/db/dd/d1d/d1e/d13/d5a/ff8 0 2024-04-23T14:50:12.065 INFO:tasks.workunit.client.1.smithi156.stdout:9/904: mkdir d1/d2/d3e/d55/d66/dd6/ded/d12f 0 2024-04-23T14:50:12.065 INFO:tasks.workunit.client.1.smithi156.stdout:9/905: truncate d1/d2/d3e/d55/d66/dd6/ded/d17/f11c 408635 0 2024-04-23T14:50:12.065 INFO:tasks.workunit.client.1.smithi156.stdout:9/906: fdatasync d1/d2/d3e/d55/d66/dd6/ded/d17/f2c 0 2024-04-23T14:50:12.066 INFO:tasks.workunit.client.1.smithi156.stdout:9/907: fdatasync d1/d2/d3e/d55/d66/dd6/ded/d40/d35/fc4 0 2024-04-23T14:50:12.066 INFO:tasks.workunit.client.1.smithi156.stdout:9/908: creat d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/d48/dc2/f130 x:0 0 0 2024-04-23T14:50:12.066 INFO:tasks.workunit.client.1.smithi156.stdout:9/909: readlink d1/d2/d3e/d55/d66/dd6/dec/lf1 0 2024-04-23T14:50:12.069 INFO:tasks.workunit.client.1.smithi156.stdout:9/910: mkdir d1/d2/d3e/d55/d66/dd6/ded/d17/d131 0 2024-04-23T14:50:12.075 INFO:tasks.workunit.client.1.smithi156.stdout:9/911: symlink d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/d48/dd7/l132 0 2024-04-23T14:50:12.075 INFO:tasks.workunit.client.1.smithi156.stdout:9/912: fdatasync d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/d48/f4f 0 2024-04-23T14:50:12.082 INFO:tasks.workunit.client.1.smithi156.stdout:3/940: dread d4/db/dd/d1d/d1e/d13/f1f [0,4194304] 0 2024-04-23T14:50:12.084 INFO:tasks.workunit.client.1.smithi156.stdout:3/941: mknod d4/db/dd/d1d/d1e/d74/d93/c12c 0 2024-04-23T14:50:12.084 INFO:tasks.workunit.client.1.smithi156.stdout:3/942: chown d4/db/dd/d1d/d61/d8d/d91/f113 2 1 2024-04-23T14:50:12.107 INFO:tasks.workunit.client.1.smithi156.stdout:3/943: dread d4/db/dd1/fdb [0,4194304] 0 2024-04-23T14:50:12.125 INFO:tasks.workunit.client.1.smithi156.stdout:3/944: read d4/db/dd1/fdb [887786,10036] 0 2024-04-23T14:50:12.129 INFO:tasks.workunit.client.1.smithi156.stdout:9/913: dwrite d1/d2/d3e/d55/d66/dd6/ded/d40/d35/f7d [0,4194304] 0 2024-04-23T14:50:12.140 INFO:tasks.workunit.client.1.smithi156.stdout:3/945: dread d4/db/dd/d20/fd5 [0,4194304] 0 2024-04-23T14:50:12.189 INFO:tasks.workunit.client.1.smithi156.stdout:3/946: dwrite d4/db/dd/d73/ffd [0,4194304] 0 2024-04-23T14:50:12.189 INFO:tasks.workunit.client.1.smithi156.stdout:3/947: read d4/db/dd/d1d/d1e/d13/f1f [3061839,7592] 0 2024-04-23T14:50:12.189 INFO:tasks.workunit.client.1.smithi156.stdout:3/948: fsync d4/db/dd/d1d/d1e/d42/d76/f88 0 2024-04-23T14:50:12.189 INFO:tasks.workunit.client.1.smithi156.stdout:3/949: write d4/db/dd/d1d/d1e/d42/f10d [321901,82399] 0 2024-04-23T14:50:12.189 INFO:tasks.workunit.client.1.smithi156.stdout:3/950: readlink d4/db/dd/d1d/d1e/d13/d5a/dab/lc0 0 2024-04-23T14:50:12.193 INFO:tasks.workunit.client.1.smithi156.stdout:3/951: mknod d4/db/dd/d1d/d1e/d42/d76/c12d 0 2024-04-23T14:50:12.195 INFO:tasks.workunit.client.1.smithi156.stdout:3/952: rmdir d4/db/dd/d1d/d1e/d74 39 2024-04-23T14:50:12.213 INFO:tasks.workunit.client.1.smithi156.stdout:3/953: read d4/db/dd/d1d/d1e/d74/d93/dc4/fcb [3062743,87853] 0 2024-04-23T14:50:12.214 INFO:tasks.workunit.client.1.smithi156.stdout:3/954: write d4/db/dd/d1d/d1e/d42/d76/dba/de5/f11f [106166,130175] 0 2024-04-23T14:50:12.214 INFO:tasks.workunit.client.1.smithi156.stdout:3/955: readlink d4/db/dd/d1d/d61/d8d/la1 0 2024-04-23T14:50:12.221 INFO:tasks.workunit.client.1.smithi156.stdout:3/956: write d4/db/dd/d73/f9e [748017,63772] 0 2024-04-23T14:50:12.223 INFO:tasks.workunit.client.1.smithi156.stdout:3/957: mknod d4/db/de2/d111/d112/c12e 0 2024-04-23T14:50:12.225 INFO:tasks.workunit.client.1.smithi156.stdout:3/958: write d4/db/dd/d1d/d1e/d42/f10d [17447,103649] 0 2024-04-23T14:50:12.228 INFO:tasks.workunit.client.1.smithi156.stdout:3/959: link d4/db/dd/d1d/d1e/d2b/cc8 d4/db/dd/d1d/d1e/d74/d93/dad/c12f 0 2024-04-23T14:50:12.229 INFO:tasks.workunit.client.1.smithi156.stdout:3/960: stat d4/db/dd/d1d/d1e/d13/d5a/f6c 0 2024-04-23T14:50:12.238 INFO:tasks.workunit.client.1.smithi156.stdout:3/961: rename d4/db/dd/d1d/d1e/d13 to d4/db/dd/d130 0 2024-04-23T14:50:12.250 INFO:tasks.workunit.client.1.smithi156.stdout:3/962: dread d4/db/dd/d130/f1f [4194304,4194304] 0 2024-04-23T14:50:12.260 INFO:tasks.workunit.client.1.smithi156.stdout:9/914: sync 2024-04-23T14:50:12.265 INFO:tasks.workunit.client.1.smithi156.stdout:3/963: dread d4/db/dd/d1d/d1e/d74/d90/f4d [0,4194304] 0 2024-04-23T14:50:12.266 INFO:tasks.workunit.client.1.smithi156.stdout:3/964: fsync d4/db/dd/d1d/d1e/d74/dcf/fdf 0 2024-04-23T14:50:12.268 INFO:tasks.workunit.client.1.smithi156.stdout:3/965: mkdir d4/db/dd/d1d/d1e/d74/d90/d131 0 2024-04-23T14:50:12.280 INFO:tasks.workunit.client.1.smithi156.stdout:3/966: creat d4/df3/f132 x:0 0 0 2024-04-23T14:50:12.281 INFO:tasks.workunit.client.1.smithi156.stdout:3/967: read d4/db/dd/d130/f46 [997644,99872] 0 2024-04-23T14:50:12.283 INFO:tasks.workunit.client.1.smithi156.stdout:3/968: mknod d4/db/dd/d1d/d61/d8d/d91/d121/c133 0 2024-04-23T14:50:12.283 INFO:tasks.workunit.client.1.smithi156.stdout:3/969: fdatasync d4/db/dd/d1d/d1e/d74/d93/dad/f12a 0 2024-04-23T14:50:12.284 INFO:tasks.workunit.client.1.smithi156.stdout:3/970: write d4/db/dd/d130/f1a [1216013,77433] 0 2024-04-23T14:50:12.284 INFO:tasks.workunit.client.1.smithi156.stdout:3/971: write d4/f55 [1607014,72267] 0 2024-04-23T14:50:12.285 INFO:tasks.workunit.client.1.smithi156.stdout:3/972: symlink d4/db/dd/d1d/d1e/d74/dcf/l134 0 2024-04-23T14:50:12.287 INFO:tasks.workunit.client.1.smithi156.stdout:3/973: mkdir d4/db/dd/d1d/d1e/d74/d93/dad/d135 0 2024-04-23T14:50:12.287 INFO:tasks.workunit.client.1.smithi156.stdout:3/974: chown d4/db/dd/d130/d5a/dab 1369383 1 2024-04-23T14:50:12.311 INFO:tasks.workunit.client.1.smithi156.stdout:3/975: write d4/db/dd/d73/f9e [1204108,24075] 0 2024-04-23T14:50:12.326 INFO:tasks.workunit.client.1.smithi156.stdout:3/976: dread d4/db/dd/d1d/d1e/d42/d76/f88 [0,4194304] 0 2024-04-23T14:50:12.328 INFO:tasks.workunit.client.1.smithi156.stdout:3/977: unlink d4/db/dd/d1d/d1e/d2b/cc8 0 2024-04-23T14:50:12.349 INFO:tasks.workunit.client.1.smithi156.stdout:9/915: dwrite d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/d48/dc2/f130 [0,4194304] 0 2024-04-23T14:50:12.349 INFO:tasks.workunit.client.1.smithi156.stdout:9/916: truncate d1/d2/d3e/d80/f10c 28386 0 2024-04-23T14:50:12.383 INFO:tasks.workunit.client.1.smithi156.stdout:3/978: dwrite d4/db/dd/d1d/d1e/d74/d90/fe1 [4194304,4194304] 0 2024-04-23T14:50:12.384 INFO:tasks.workunit.client.1.smithi156.stdout:3/979: fsync d4/db/dd/d1d/d61/d7f/f9f 0 2024-04-23T14:50:12.384 INFO:tasks.workunit.client.1.smithi156.stdout:3/980: fdatasync d4/db/dd/d20/fd5 0 2024-04-23T14:50:12.384 INFO:tasks.workunit.client.1.smithi156.stdout:9/917: dread d1/d2/d23/f76 [0,4194304] 0 2024-04-23T14:50:12.390 INFO:tasks.workunit.client.1.smithi156.stdout:3/981: dread d4/db/dd/d1d/f2e [0,4194304] 0 2024-04-23T14:50:12.394 INFO:tasks.workunit.client.1.smithi156.stdout:9/918: dread d1/d2/d3e/d55/d6f/f65 [0,4194304] 0 2024-04-23T14:50:12.394 INFO:tasks.workunit.client.1.smithi156.stdout:9/919: creat d1/d2/d23/d49/d4b/dbc/f133 x:0 0 0 2024-04-23T14:50:12.397 INFO:tasks.workunit.client.1.smithi156.stdout:9/920: creat d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/d48/f134 x:0 0 0 2024-04-23T14:50:12.399 INFO:tasks.workunit.client.1.smithi156.stdout:9/921: creat d1/d2/d3e/d55/d66/dd6/ded/d17/d131/f135 x:0 0 0 2024-04-23T14:50:12.403 INFO:tasks.workunit.client.1.smithi156.stdout:9/922: link d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/d48/d4e/df5/f106 d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/d48/dc2/f136 0 2024-04-23T14:50:12.403 INFO:tasks.workunit.client.1.smithi156.stdout:9/923: chown d1/d2/d23/fbe 1 1 2024-04-23T14:50:12.403 INFO:tasks.workunit.client.1.smithi156.stdout:9/924: truncate d1/f1e 1724503 0 2024-04-23T14:50:12.403 INFO:tasks.workunit.client.1.smithi156.stdout:9/925: write d1/d2/d3e/d80/fd2 [1037996,91468] 0 2024-04-23T14:50:12.404 INFO:tasks.workunit.client.1.smithi156.stdout:3/982: dread d4/f10 [0,4194304] 0 2024-04-23T14:50:12.404 INFO:tasks.workunit.client.1.smithi156.stdout:3/983: chown d4/df3/d102/f104 4533 1 2024-04-23T14:50:12.406 INFO:tasks.workunit.client.1.smithi156.stdout:9/926: mkdir d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/d48/dc2/d12b/d137 0 2024-04-23T14:50:12.406 INFO:tasks.workunit.client.1.smithi156.stdout:9/927: stat d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/d48/d4e/l10f 0 2024-04-23T14:50:12.410 INFO:tasks.workunit.client.1.smithi156.stdout:9/928: mknod d1/d2/d3e/d50/dde/c138 0 2024-04-23T14:50:12.415 INFO:tasks.workunit.client.1.smithi156.stdout:3/984: dread d4/db/dd/d1d/f36 [0,4194304] 0 2024-04-23T14:50:12.429 INFO:tasks.workunit.client.1.smithi156.stdout:9/929: read d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/d48/dc2/fa3 [329086,108120] 0 2024-04-23T14:50:12.429 INFO:tasks.workunit.client.1.smithi156.stdout:9/930: creat d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/db9/f139 x:0 0 0 2024-04-23T14:50:12.432 INFO:tasks.workunit.client.1.smithi156.stdout:9/931: creat d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/f13a x:0 0 0 2024-04-23T14:50:12.433 INFO:tasks.workunit.client.1.smithi156.stdout:9/932: write d1/d2/d3e/d80/f10c [293862,127843] 0 2024-04-23T14:50:12.433 INFO:tasks.workunit.client.1.smithi156.stdout:9/933: write d1/d2/d3e/dd1/f117 [61212,83608] 0 2024-04-23T14:50:12.457 INFO:tasks.workunit.client.1.smithi156.stdout:9/934: dread d1/d2/f13 [0,4194304] 0 2024-04-23T14:50:12.458 INFO:tasks.workunit.client.1.smithi156.stdout:9/935: symlink d1/d2/d23/l13b 0 2024-04-23T14:50:12.460 INFO:tasks.workunit.client.1.smithi156.stdout:9/936: link d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/d48/dd7/l132 d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/d48/d4e/l13c 0 2024-04-23T14:50:12.460 INFO:tasks.workunit.client.1.smithi156.stdout:9/937: fsync d1/d2/d3e/d50/f99 0 2024-04-23T14:50:12.460 INFO:tasks.workunit.client.1.smithi156.stdout:9/938: stat d1/d2/d3e/d55/d66/dd6/dec/lf1 0 2024-04-23T14:50:12.462 INFO:tasks.workunit.client.1.smithi156.stdout:9/939: creat d1/d2/d3e/d55/d66/dd6/ded/dc/f13d x:0 0 0 2024-04-23T14:50:12.466 INFO:tasks.workunit.client.1.smithi156.stdout:9/940: getdents d1/d2/d3e/d55/d9c 0 2024-04-23T14:50:12.466 INFO:tasks.workunit.client.1.smithi156.stdout:9/941: truncate d1/d2/d8c/ff7 245814 0 2024-04-23T14:50:12.472 INFO:tasks.workunit.client.1.smithi156.stdout:3/985: dwrite d4/db/dd/d1d/d1e/d42/d76/f7c [0,4194304] 0 2024-04-23T14:50:12.483 INFO:tasks.workunit.client.1.smithi156.stdout:9/942: dread d1/d2/d23/fa5 [0,4194304] 0 2024-04-23T14:50:12.486 INFO:tasks.workunit.client.1.smithi156.stdout:9/943: unlink d1/d2/d3e/d55/d6f/l67 0 2024-04-23T14:50:12.521 INFO:tasks.workunit.client.1.smithi156.stdout:9/944: dwrite d1/d2/d8c/ff7 [0,4194304] 0 2024-04-23T14:50:12.529 INFO:tasks.workunit.client.1.smithi156.stdout:9/945: creat d1/d2/d3e/dd1/f13e x:0 0 0 2024-04-23T14:50:12.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:12 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:50:12.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:12 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:50:12.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:12 smithi156 ceph-mon[32341]: Reconfiguring node-exporter.smithi156 (dependencies changed)... 2024-04-23T14:50:12.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:12 smithi156 ceph-mon[32341]: Reconfiguring daemon node-exporter.smithi156 on smithi156 2024-04-23T14:50:12.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:12 smithi156 ceph-mon[32341]: pgmap v45: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 132 MiB/s rd, 168 MiB/s wr, 264 op/s 2024-04-23T14:50:12.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:12 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:50:12.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:12 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:50:12.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:12 smithi081 ceph-mon[25540]: Reconfiguring node-exporter.smithi156 (dependencies changed)... 2024-04-23T14:50:12.578 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:12 smithi081 ceph-mon[25540]: Reconfiguring daemon node-exporter.smithi156 on smithi156 2024-04-23T14:50:12.578 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:12 smithi081 ceph-mon[25540]: pgmap v45: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 132 MiB/s rd, 168 MiB/s wr, 264 op/s 2024-04-23T14:50:12.595 INFO:tasks.workunit.client.1.smithi156.stdout:9/946: dwrite d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/d48/dc2/f136 [0,4194304] 0 2024-04-23T14:50:12.598 INFO:tasks.workunit.client.1.smithi156.stdout:3/986: sync 2024-04-23T14:50:12.600 INFO:tasks.workunit.client.1.smithi156.stdout:9/947: mknod d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/d48/dc2/c13f 0 2024-04-23T14:50:12.600 INFO:tasks.workunit.client.1.smithi156.stdout:9/948: creat d1/d2/d23/d49/d4b/dbc/f140 x:0 0 0 2024-04-23T14:50:12.602 INFO:tasks.workunit.client.1.smithi156.stdout:3/987: creat d4/db/dd/d1d/d61/d8d/d91/f136 x:0 0 0 2024-04-23T14:50:12.607 INFO:tasks.workunit.client.1.smithi156.stdout:9/949: link d1/d2/d3e/d55/ffa d1/d2/d3e/d55/d66/dd6/ded/d40/d35/db6/f141 0 2024-04-23T14:50:12.607 INFO:tasks.workunit.client.1.smithi156.stdout:9/950: chown d1/d2/d3e 5 1 2024-04-23T14:50:12.610 INFO:tasks.workunit.client.1.smithi156.stdout:3/988: rename d4/ld3 to d4/db/dd/d1d/d1e/d74/d90/de6/l137 0 2024-04-23T14:50:12.610 INFO:tasks.workunit.client.1.smithi156.stdout:3/989: read - d4/db/dd/d130/f109 zero size 2024-04-23T14:50:12.611 INFO:tasks.workunit.client.1.smithi156.stdout:9/951: mkdir d1/d2/d3e/d55/d6f/d30/d142 0 2024-04-23T14:50:12.612 INFO:tasks.workunit.client.1.smithi156.stdout:3/990: mkdir d4/db/d4b/d138 0 2024-04-23T14:50:12.614 INFO:tasks.workunit.client.1.smithi156.stdout:9/952: unlink d1/d2/d23/d49/ca1 0 2024-04-23T14:50:12.616 INFO:tasks.workunit.client.1.smithi156.stdout:3/991: mknod d4/db/dd/d1d/d1e/d74/d90/c139 0 2024-04-23T14:50:12.619 INFO:tasks.workunit.client.1.smithi156.stdout:9/953: rename d1/d2/d23/d75/f108 to d1/d2/d3e/f143 0 2024-04-23T14:50:12.619 INFO:tasks.workunit.client.1.smithi156.stdout:9/954: readlink d1/d2/d3e/ld3 0 2024-04-23T14:50:12.619 INFO:tasks.workunit.client.1.smithi156.stdout:9/955: creat d1/d2/d8c/f144 x:0 0 0 2024-04-23T14:50:12.629 INFO:tasks.workunit.client.1.smithi156.stdout:3/992: mknod d4/db/c13a 0 2024-04-23T14:50:12.729 INFO:tasks.workunit.client.1.smithi156.stdout:9/956: dwrite d1/d2/d3e/d55/d6f/d30/fa6 [0,4194304] 0 2024-04-23T14:50:12.730 INFO:tasks.workunit.client.1.smithi156.stdout:3/993: dwrite d4/db/d4b/f81 [0,4194304] 0 2024-04-23T14:50:12.748 INFO:tasks.workunit.client.1.smithi156.stdout:3/994: rmdir d4/db/dd/d130/d5a/dab 39 2024-04-23T14:50:12.748 INFO:tasks.workunit.client.1.smithi156.stdout:3/995: write d4/db/dd/d1d/f2e [2486820,117763] 0 2024-04-23T14:50:12.767 INFO:tasks.workunit.client.1.smithi156.stdout:3/996: write d4/db/dd/d20/d57/fcd [2013571,35713] 0 2024-04-23T14:50:12.792 INFO:tasks.workunit.client.1.smithi156.stdout:3/997: dread d4/db/dd/d20/d57/fcc [0,4194304] 0 2024-04-23T14:50:12.793 INFO:tasks.workunit.client.1.smithi156.stdout:9/957: dwrite d1/d2/d3e/d50/dde/f123 [0,4194304] 0 2024-04-23T14:50:12.797 INFO:tasks.workunit.client.1.smithi156.stdout:3/998: truncate d4/db/dd/d1d/d1e/d42/fe0 1329681 0 2024-04-23T14:50:12.798 INFO:tasks.workunit.client.1.smithi156.stdout:9/958: mknod d1/d2/d23/d49/d4b/c145 0 2024-04-23T14:50:12.799 INFO:tasks.workunit.client.1.smithi156.stdout:9/959: readlink d1/d2/d23/def/l11a 0 2024-04-23T14:50:12.801 INFO:tasks.workunit.client.1.smithi156.stdout:9/960: mknod d1/d2/d23/d49/d4b/c146 0 2024-04-23T14:50:12.804 INFO:tasks.workunit.client.1.smithi156.stdout:3/999: creat d4/db/dd/d1d/d1e/d74/d93/dad/d135/f13b x:0 0 0 2024-04-23T14:50:12.807 INFO:tasks.workunit.client.1.smithi156.stdout:9/961: symlink d1/d2/d23/dab/l147 0 2024-04-23T14:50:12.815 INFO:tasks.workunit.client.1.smithi156.stdout:9/962: dread d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/f37 [4194304,4194304] 0 2024-04-23T14:50:12.886 INFO:tasks.workunit.client.1.smithi156.stdout:9/963: sync 2024-04-23T14:50:12.888 INFO:tasks.workunit.client.1.smithi156.stdout:9/964: symlink d1/d2/d3e/d55/d66/dd6/dec/l148 0 2024-04-23T14:50:12.888 INFO:tasks.workunit.client.1.smithi156.stdout:9/965: readlink d1/d2/d3e/d55/d66/dd6/ded/d40/d35/db6/dc5/l121 0 2024-04-23T14:50:12.888 INFO:tasks.workunit.client.1.smithi156.stdout:9/966: readlink d1/d2/d3e/d55/d66/dd6/dec/l11d 0 2024-04-23T14:50:12.892 INFO:tasks.workunit.client.1.smithi156.stdout:9/967: rename d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/d48/f134 to d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/d48/dc2/d12b/f149 0 2024-04-23T14:50:12.892 INFO:tasks.workunit.client.1.smithi156.stdout:9/968: write d1/d2/d3e/d55/d66/dd6/ded/f105 [95451,8768] 0 2024-04-23T14:50:12.894 INFO:tasks.workunit.client.1.smithi156.stdout:9/969: truncate d1/d2/d3e/d55/d66/dd6/ded/d40/d35/db6/f141 3489061 0 2024-04-23T14:50:12.897 INFO:tasks.workunit.client.1.smithi156.stdout:9/970: rename d1/d2/d3e/d55/d66/dd6/ded/fe1 to d1/d2/d3e/d55/d66/dd6/ded/d12f/f14a 0 2024-04-23T14:50:12.974 INFO:tasks.workunit.client.1.smithi156.stdout:9/971: dwrite d1/d2/d23/d49/f12c [0,4194304] 0 2024-04-23T14:50:12.975 INFO:tasks.workunit.client.1.smithi156.stdout:9/972: creat d1/d2/d3e/d80/f14b x:0 0 0 2024-04-23T14:50:13.040 INFO:tasks.workunit.client.1.smithi156.stdout:9/973: dwrite d1/d2/d3e/d55/f6b [0,4194304] 0 2024-04-23T14:50:13.043 INFO:tasks.workunit.client.1.smithi156.stdout:9/974: rename d1/d2/d3e/d55/d6f/d30/d142 to d1/d2/d3e/d80/d118/d14c 0 2024-04-23T14:50:13.046 INFO:tasks.workunit.client.1.smithi156.stdout:9/975: truncate d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/d48/d4e/f6e 1502374 0 2024-04-23T14:50:13.047 INFO:tasks.workunit.client.1.smithi156.stdout:9/976: mknod d1/d2/d3e/d50/da9/c14d 0 2024-04-23T14:50:13.050 INFO:tasks.workunit.client.1.smithi156.stdout:9/977: truncate d1/d2/d23/f76 3568209 0 2024-04-23T14:50:13.149 INFO:tasks.workunit.client.1.smithi156.stdout:9/978: dwrite d1/d2/d3e/d55/d9c/d39/f42 [0,4194304] 0 2024-04-23T14:50:13.263 INFO:tasks.workunit.client.1.smithi156.stdout:9/979: dwrite d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/d48/f4f [0,4194304] 0 2024-04-23T14:50:13.266 INFO:tasks.workunit.client.1.smithi156.stdout:9/980: creat d1/d2/d23/d12a/f14e x:0 0 0 2024-04-23T14:50:13.270 INFO:tasks.workunit.client.1.smithi156.stdout:9/981: link d1/d2/d3e/d80/cfd d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/c14f 0 2024-04-23T14:50:13.272 INFO:tasks.workunit.client.1.smithi156.stdout:9/982: mkdir d1/d2/d3e/d55/d6f/d8e/d150 0 2024-04-23T14:50:13.272 INFO:tasks.workunit.client.1.smithi156.stdout:9/983: creat d1/d2/d3e/d55/d66/dd6/ded/dc/f151 x:0 0 0 2024-04-23T14:50:13.272 INFO:tasks.workunit.client.1.smithi156.stdout:9/984: chown d1/d2/d23/d49/d4b/dbc 281670 1 2024-04-23T14:50:13.277 INFO:tasks.workunit.client.1.smithi156.stdout:9/985: rename d1/d2/d23/d49/d4b/dbc/f140 to d1/d2/d3e/d55/d9c/d39/d6c/f152 0 2024-04-23T14:50:13.277 INFO:tasks.workunit.client.1.smithi156.stdout:9/986: read - d1/d2/d23/d49/d4c/fdd zero size 2024-04-23T14:50:13.277 INFO:tasks.workunit.client.1.smithi156.stdout:9/987: chown d1/d2/d3e/d55/d66/dd6/ded/d17/fbf 40 1 2024-04-23T14:50:13.281 INFO:tasks.workunit.client.1.smithi156.stdout:9/988: symlink d1/d2/d23/dab/l153 0 2024-04-23T14:50:13.284 INFO:tasks.workunit.client.1.smithi156.stdout:9/989: symlink d1/d2/d3e/d55/d66/dd6/l154 0 2024-04-23T14:50:13.284 INFO:tasks.workunit.client.1.smithi156.stdout:9/990: creat d1/d2/d23/d12a/f155 x:0 0 0 2024-04-23T14:50:13.284 INFO:tasks.workunit.client.1.smithi156.stdout:9/991: dread - d1/d2/d3e/d55/d66/dd6/ded/d12f/f14a zero size 2024-04-23T14:50:13.293 INFO:tasks.workunit.client.1.smithi156.stdout:9/992: dread d1/d2/d3e/d55/d66/dd6/ded/d40/d35/db6/dc5/f109 [0,4194304] 0 2024-04-23T14:50:13.293 INFO:tasks.workunit.client.1.smithi156.stdout:9/993: readlink d1/d2/d3e/d55/d9c/d39/d6c/l74 0 2024-04-23T14:50:13.293 INFO:tasks.workunit.client.1.smithi156.stdout:9/994: stat d1/d2/d3e/d55/d6f/cca 0 2024-04-23T14:50:13.294 INFO:tasks.workunit.client.1.smithi156.stdout:9/995: read - d1/d2/d3e/d55/d66/dd6/ded/dc/f13d zero size 2024-04-23T14:50:13.294 INFO:tasks.workunit.client.1.smithi156.stdout:9/996: chown d1/d2/d3e/d50/f7c 225098285 1 2024-04-23T14:50:13.294 INFO:tasks.workunit.client.1.smithi156.stdout:9/997: mknod d1/d2/d3e/d55/d66/dd6/ded/d17/d1f/d48/dc2/d12b/c156 0 2024-04-23T14:50:13.297 INFO:tasks.workunit.client.1.smithi156.stdout:9/998: write d1/d2/d3e/d55/d66/dd6/ded/d40/d35/db6/dc5/f109 [16814,84705] 0 2024-04-23T14:50:13.297 INFO:tasks.workunit.client.1.smithi156.stdout:9/999: truncate d1/d2/d3e/fb4 5429298 0 2024-04-23T14:50:13.301 INFO:tasks.workunit.client.1.smithi156.stderr:+ rm -rf -- ./tmp.gnYReM5lR9 2024-04-23T14:50:15.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:14 smithi156 ceph-mon[32341]: pgmap v46: 65 pgs: 65 active+clean; 3.8 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 142 MiB/s rd, 185 MiB/s wr, 294 op/s 2024-04-23T14:50:15.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:14 smithi081 ceph-mon[25540]: pgmap v46: 65 pgs: 65 active+clean; 3.8 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 142 MiB/s rd, 185 MiB/s wr, 294 op/s 2024-04-23T14:50:16.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:16 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:50:16.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:16 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:50:16.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:16 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-23T14:50:16.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:16 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-23T14:50:16.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:16 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-23T14:50:16.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:16 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:50:16.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:16 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:50:16.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:16 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:50:16.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:16 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-23T14:50:16.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:16 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-23T14:50:16.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:16 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-23T14:50:16.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:16 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:50:17.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:17 smithi081 ceph-mon[25540]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-23T14:50:17.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:17 smithi081 ceph-mon[25540]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-23T14:50:17.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:17 smithi081 ceph-mon[25540]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-23T14:50:17.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:17 smithi081 ceph-mon[25540]: Upgrade: Need to upgrade myself (mgr.smithi156.ounwyj) 2024-04-23T14:50:17.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:17 smithi081 ceph-mon[25540]: Upgrade: Need to upgrade myself (mgr.smithi156.ounwyj) 2024-04-23T14:50:17.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:17 smithi081 ceph-mon[25540]: pgmap v47: 65 pgs: 65 active+clean; 3.7 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 147 MiB/s rd, 191 MiB/s wr, 344 op/s 2024-04-23T14:50:17.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:17 smithi156 ceph-mon[32341]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-23T14:50:17.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:17 smithi156 ceph-mon[32341]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-23T14:50:17.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:17 smithi156 ceph-mon[32341]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-23T14:50:17.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:17 smithi156 ceph-mon[32341]: Upgrade: Need to upgrade myself (mgr.smithi156.ounwyj) 2024-04-23T14:50:17.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:17 smithi156 ceph-mon[32341]: Upgrade: Need to upgrade myself (mgr.smithi156.ounwyj) 2024-04-23T14:50:17.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:17 smithi156 ceph-mon[32341]: pgmap v47: 65 pgs: 65 active+clean; 3.7 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 147 MiB/s rd, 191 MiB/s wr, 344 op/s 2024-04-23T14:50:18.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:18 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:50:18.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:18 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:50:19.533 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:19 smithi081 ceph-mon[25540]: pgmap v48: 65 pgs: 65 active+clean; 3.7 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 100 MiB/s rd, 130 MiB/s wr, 245 op/s 2024-04-23T14:50:19.534 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:19 smithi081 ceph-mon[25540]: Upgrade: Updating mgr.smithi081.ldghvq 2024-04-23T14:50:19.534 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:19 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:50:19.534 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:19 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi081.ldghvq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-23T14:50:19.534 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:19 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi081.ldghvq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-23T14:50:19.534 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:19 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-23T14:50:19.534 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:19 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:50:19.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:19 smithi156 ceph-mon[32341]: pgmap v48: 65 pgs: 65 active+clean; 3.7 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 100 MiB/s rd, 130 MiB/s wr, 245 op/s 2024-04-23T14:50:19.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:19 smithi156 ceph-mon[32341]: Upgrade: Updating mgr.smithi081.ldghvq 2024-04-23T14:50:19.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:19 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:50:19.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:19 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi081.ldghvq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-23T14:50:19.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:19 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi081.ldghvq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-23T14:50:19.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:19 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-23T14:50:19.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:19 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:50:20.525 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:20 smithi081 ceph-mon[25540]: Deploying daemon mgr.smithi081.ldghvq on smithi081 2024-04-23T14:50:20.525 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:20 smithi081 ceph-mon[25540]: mgrmap e26: smithi156.ounwyj(active, since 91s), standbys: smithi081.ldghvq 2024-04-23T14:50:20.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:20 smithi156 ceph-mon[32341]: Deploying daemon mgr.smithi081.ldghvq on smithi081 2024-04-23T14:50:20.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:20 smithi156 ceph-mon[32341]: mgrmap e26: smithi156.ounwyj(active, since 91s), standbys: smithi081.ldghvq 2024-04-23T14:50:21.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:21 smithi081 ceph-mon[25540]: pgmap v49: 65 pgs: 65 active+clean; 2.9 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 101 MiB/s rd, 130 MiB/s wr, 317 op/s 2024-04-23T14:50:21.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:21 smithi156 ceph-mon[32341]: pgmap v49: 65 pgs: 65 active+clean; 2.9 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 101 MiB/s rd, 130 MiB/s wr, 317 op/s 2024-04-23T14:50:22.302 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:22 smithi081 ceph-mon[25540]: pgmap v50: 65 pgs: 65 active+clean; 2.9 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 38 MiB/s rd, 48 MiB/s wr, 184 op/s 2024-04-23T14:50:22.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:22 smithi156 ceph-mon[32341]: pgmap v50: 65 pgs: 65 active+clean; 2.9 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 38 MiB/s rd, 48 MiB/s wr, 184 op/s 2024-04-23T14:50:25.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:24 smithi156 ceph-mon[32341]: pgmap v51: 65 pgs: 65 active+clean; 2.5 GiB data, 9.8 GiB used, 527 GiB / 536 GiB avail; 38 MiB/s rd, 48 MiB/s wr, 196 op/s 2024-04-23T14:50:25.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:24 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:50:25.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:24 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:50:25.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:24 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:50:25.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:24 smithi081 ceph-mon[25540]: pgmap v51: 65 pgs: 65 active+clean; 2.5 GiB data, 9.8 GiB used, 527 GiB / 536 GiB avail; 38 MiB/s rd, 48 MiB/s wr, 196 op/s 2024-04-23T14:50:25.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:24 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:50:25.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:24 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:50:25.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:24 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:50:26.305 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:26 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:50:26.305 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:26 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:50:26.305 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:26 smithi081 ceph-mon[25540]: pgmap v52: 65 pgs: 65 active+clean; 1.8 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 28 MiB/s rd, 32 MiB/s wr, 229 op/s 2024-04-23T14:50:26.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:26 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:50:26.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:26 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:50:26.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:26 smithi156 ceph-mon[32341]: pgmap v52: 65 pgs: 65 active+clean; 1.8 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 28 MiB/s rd, 32 MiB/s wr, 229 op/s 2024-04-23T14:50:26.913 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-23T14:50:26.913 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-23T14:50:28.977 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:28 smithi081 ceph-mon[25540]: pgmap v53: 65 pgs: 65 active+clean; 1.8 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 974 KiB/s rd, 1.0 MiB/s wr, 146 op/s 2024-04-23T14:50:29.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:28 smithi156 ceph-mon[32341]: pgmap v53: 65 pgs: 65 active+clean; 1.8 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 974 KiB/s rd, 1.0 MiB/s wr, 146 op/s 2024-04-23T14:50:31.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:30 smithi081 ceph-mon[25540]: pgmap v54: 65 pgs: 65 active+clean; 1.0 GiB data, 4.9 GiB used, 531 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 213 op/s 2024-04-23T14:50:31.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:30 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:50:31.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:30 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:50:31.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:30 smithi156 ceph-mon[32341]: pgmap v54: 65 pgs: 65 active+clean; 1.0 GiB data, 4.9 GiB used, 531 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 213 op/s 2024-04-23T14:50:31.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:30 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:50:31.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:30 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:50:32.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.358+0000 7fa098a00700 1 -- 172.21.15.81:0/1197372379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0940fcc30 msgr2=0x7fa0940fd040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:32.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.358+0000 7fa098a00700 1 --2- 172.21.15.81:0/1197372379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0940fcc30 0x7fa0940fd040 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa084004940 tx=0x7fa084009e30 comp rx=0 tx=0).stop 2024-04-23T14:50:32.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.358+0000 7fa098a00700 1 -- 172.21.15.81:0/1197372379 shutdown_connections 2024-04-23T14:50:32.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.358+0000 7fa098a00700 1 --2- 172.21.15.81:0/1197372379 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0940fdee0 0x7fa0940fe350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:32.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.358+0000 7fa098a00700 1 --2- 172.21.15.81:0/1197372379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0940fcc30 0x7fa0940fd040 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:32.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.358+0000 7fa098a00700 1 -- 172.21.15.81:0/1197372379 >> 172.21.15.81:0/1197372379 conn(0x7fa0940f83d0 msgr2=0x7fa0940fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:32.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.358+0000 7fa098a00700 1 -- 172.21.15.81:0/1197372379 shutdown_connections 2024-04-23T14:50:32.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.358+0000 7fa098a00700 1 -- 172.21.15.81:0/1197372379 wait complete. 2024-04-23T14:50:32.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.359+0000 7fa098a00700 1 Processor -- start 2024-04-23T14:50:32.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.359+0000 7fa098a00700 1 -- start start 2024-04-23T14:50:32.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.360+0000 7fa098a00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0940fcc30 0x7fa09410d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:32.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.360+0000 7fa098a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0940fdee0 0x7fa09410dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:32.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.360+0000 7fa098a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09410e410 con 0x7fa0940fdee0 2024-04-23T14:50:32.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.360+0000 7fa098a00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09410ec00 con 0x7fa0940fcc30 2024-04-23T14:50:32.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.360+0000 7fa091e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0940fdee0 0x7fa09410dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:32.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.360+0000 7fa091e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0940fdee0 0x7fa09410dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48054/0 (socket says 172.21.15.81:48054) 2024-04-23T14:50:32.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.360+0000 7fa091e00700 1 -- 172.21.15.81:0/2827942707 learned_addr learned my addr 172.21.15.81:0/2827942707 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:50:32.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.360+0000 7fa092800700 1 --2- 172.21.15.81:0/2827942707 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0940fcc30 0x7fa09410d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:32.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.361+0000 7fa091e00700 1 -- 172.21.15.81:0/2827942707 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0940fcc30 msgr2=0x7fa09410d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:32.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.361+0000 7fa091e00700 1 --2- 172.21.15.81:0/2827942707 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0940fcc30 0x7fa09410d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:32.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.361+0000 7fa091e00700 1 -- 172.21.15.81:0/2827942707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa084005040 con 0x7fa0940fdee0 2024-04-23T14:50:32.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.361+0000 7fa092800700 1 --2- 172.21.15.81:0/2827942707 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0940fcc30 0x7fa09410d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:50:32.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.361+0000 7fa091e00700 1 --2- 172.21.15.81:0/2827942707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0940fdee0 0x7fa09410dd80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa08000b790 tx=0x7fa080009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:32.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.362+0000 7fa08aa00700 1 -- 172.21.15.81:0/2827942707 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa08000f770 con 0x7fa0940fdee0 2024-04-23T14:50:32.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.362+0000 7fa098a00700 1 -- 172.21.15.81:0/2827942707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa09410eee0 con 0x7fa0940fdee0 2024-04-23T14:50:32.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.362+0000 7fa08aa00700 1 -- 172.21.15.81:0/2827942707 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa08000fda0 con 0x7fa0940fdee0 2024-04-23T14:50:32.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.362+0000 7fa08aa00700 1 -- 172.21.15.81:0/2827942707 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa08000d310 con 0x7fa0940fdee0 2024-04-23T14:50:32.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.362+0000 7fa098a00700 1 -- 172.21.15.81:0/2827942707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa09410f4a0 con 0x7fa0940fdee0 2024-04-23T14:50:32.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.364+0000 7fa098a00700 1 -- 172.21.15.81:0/2827942707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0740052e0 con 0x7fa0940fdee0 2024-04-23T14:50:32.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.366+0000 7fa08aa00700 1 -- 172.21.15.81:0/2827942707 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) v1 ==== 89550+0+0 (secure 0 0 0) 0x7fa08000f8d0 con 0x7fa0940fdee0 2024-04-23T14:50:32.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.367+0000 7fa08aa00700 1 --2- 172.21.15.81:0/2827942707 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fa07806bbe0 0x7fa07806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:32.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.367+0000 7fa08aa00700 1 -- 172.21.15.81:0/2827942707 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fa08008a6e0 con 0x7fa0940fdee0 2024-04-23T14:50:32.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.368+0000 7fa092800700 1 --2- 172.21.15.81:0/2827942707 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fa07806bbe0 0x7fa07806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:32.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.369+0000 7fa092800700 1 --2- 172.21.15.81:0/2827942707 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fa07806bbe0 0x7fa07806e090 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa08400b7a0 tx=0x7fa084009e30 comp rx=0 tx=0).ready entity=mgr.24373 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:32.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.373+0000 7fa08aa00700 1 -- 172.21.15.81:0/2827942707 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7fa080057ab0 con 0x7fa0940fdee0 2024-04-23T14:50:32.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.700+0000 7fa098a00700 1 -- 172.21.15.81:0/2827942707 --> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa074000bf0 con 0x7fa07806bbe0 2024-04-23T14:50:32.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.704+0000 7fa08aa00700 1 -- 172.21.15.81:0/2827942707 <== mgr.24373 v2:172.21.15.156:6828/100981835 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7fa074000bf0 con 0x7fa07806bbe0 2024-04-23T14:50:32.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.708+0000 7fa098a00700 1 -- 172.21.15.81:0/2827942707 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fa07806bbe0 msgr2=0x7fa07806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:32.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.708+0000 7fa098a00700 1 --2- 172.21.15.81:0/2827942707 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fa07806bbe0 0x7fa07806e090 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa08400b7a0 tx=0x7fa084009e30 comp rx=0 tx=0).stop 2024-04-23T14:50:32.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.708+0000 7fa098a00700 1 -- 172.21.15.81:0/2827942707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0940fdee0 msgr2=0x7fa09410dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:32.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.708+0000 7fa098a00700 1 --2- 172.21.15.81:0/2827942707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0940fdee0 0x7fa09410dd80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa08000b790 tx=0x7fa080009250 comp rx=0 tx=0).stop 2024-04-23T14:50:32.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.708+0000 7fa098a00700 1 -- 172.21.15.81:0/2827942707 shutdown_connections 2024-04-23T14:50:32.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.708+0000 7fa098a00700 1 --2- 172.21.15.81:0/2827942707 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fa07806bbe0 0x7fa07806e090 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:32.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.708+0000 7fa098a00700 1 --2- 172.21.15.81:0/2827942707 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0940fcc30 0x7fa09410d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:32.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.708+0000 7fa098a00700 1 --2- 172.21.15.81:0/2827942707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0940fdee0 0x7fa09410dd80 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:32.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.708+0000 7fa098a00700 1 -- 172.21.15.81:0/2827942707 >> 172.21.15.81:0/2827942707 conn(0x7fa0940f83d0 msgr2=0x7fa0940f9980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:32.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.709+0000 7fa098a00700 1 -- 172.21.15.81:0/2827942707 shutdown_connections 2024-04-23T14:50:32.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:32.709+0000 7fa098a00700 1 -- 172.21.15.81:0/2827942707 wait complete. 2024-04-23T14:50:32.731 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-04-23T14:50:33.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:32 smithi081 ceph-mon[25540]: pgmap v55: 65 pgs: 65 active+clean; 1.0 GiB data, 4.9 GiB used, 531 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 141 op/s 2024-04-23T14:50:33.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:32 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:50:33.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:32 smithi156 ceph-mon[32341]: pgmap v55: 65 pgs: 65 active+clean; 1.0 GiB data, 4.9 GiB used, 531 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 141 op/s 2024-04-23T14:50:33.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:32 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:50:34.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.366+0000 7f976b600700 1 -- 172.21.15.81:0/59480677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9764102370 msgr2=0x7f9764104750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:34.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.366+0000 7f976b600700 1 --2- 172.21.15.81:0/59480677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9764102370 0x7f9764104750 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9750004940 tx=0x7f9750009e30 comp rx=0 tx=0).stop 2024-04-23T14:50:34.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.367+0000 7f976b600700 1 -- 172.21.15.81:0/59480677 shutdown_connections 2024-04-23T14:50:34.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.367+0000 7f976b600700 1 --2- 172.21.15.81:0/59480677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9764102370 0x7f9764104750 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.367+0000 7f976b600700 1 --2- 172.21.15.81:0/59480677 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97640662f0 0x7f9764101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.367+0000 7f976b600700 1 -- 172.21.15.81:0/59480677 >> 172.21.15.81:0/59480677 conn(0x7f97640f74c0 msgr2=0x7f97640f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:34.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.367+0000 7f976b600700 1 -- 172.21.15.81:0/59480677 shutdown_connections 2024-04-23T14:50:34.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.367+0000 7f976b600700 1 -- 172.21.15.81:0/59480677 wait complete. 2024-04-23T14:50:34.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.368+0000 7f976b600700 1 Processor -- start 2024-04-23T14:50:34.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.368+0000 7f976b600700 1 -- start start 2024-04-23T14:50:34.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.369+0000 7f976b600700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97640662f0 0x7f976410fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.369+0000 7f976b600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9764102370 0x7f9764110190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.369+0000 7f976b600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9764110790 con 0x7f9764102370 2024-04-23T14:50:34.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.369+0000 7f976b600700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9764110fe0 con 0x7f97640662f0 2024-04-23T14:50:34.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.369+0000 7f9763e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9764102370 0x7f9764110190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.369+0000 7f9763e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9764102370 0x7f9764110190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37974/0 (socket says 172.21.15.81:37974) 2024-04-23T14:50:34.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.369+0000 7f9763e00700 1 -- 172.21.15.81:0/3515480519 learned_addr learned my addr 172.21.15.81:0/3515480519 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:50:34.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.369+0000 7f9768c00700 1 --2- 172.21.15.81:0/3515480519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97640662f0 0x7f976410fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.370+0000 7f9763e00700 1 -- 172.21.15.81:0/3515480519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97640662f0 msgr2=0x7f976410fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:34.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.370+0000 7f9763e00700 1 --2- 172.21.15.81:0/3515480519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97640662f0 0x7f976410fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.370+0000 7f9763e00700 1 -- 172.21.15.81:0/3515480519 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9750005040 con 0x7f9764102370 2024-04-23T14:50:34.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.371+0000 7f9763e00700 1 --2- 172.21.15.81:0/3515480519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9764102370 0x7f9764110190 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9750009150 tx=0x7f9750009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:34.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.372+0000 7f9760c00700 1 -- 172.21.15.81:0/3515480519 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f975000e040 con 0x7f9764102370 2024-04-23T14:50:34.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.372+0000 7f9760c00700 1 -- 172.21.15.81:0/3515480519 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f975000bbf0 con 0x7f9764102370 2024-04-23T14:50:34.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.372+0000 7f976b600700 1 -- 172.21.15.81:0/3515480519 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9764111260 con 0x7f9764102370 2024-04-23T14:50:34.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.372+0000 7f9760c00700 1 -- 172.21.15.81:0/3515480519 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f975001c630 con 0x7f9764102370 2024-04-23T14:50:34.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.372+0000 7f976b600700 1 -- 172.21.15.81:0/3515480519 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97641117a0 con 0x7f9764102370 2024-04-23T14:50:34.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.374+0000 7f976b600700 1 -- 172.21.15.81:0/3515480519 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f976405f5f0 con 0x7f9764102370 2024-04-23T14:50:34.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.376+0000 7f9760c00700 1 -- 172.21.15.81:0/3515480519 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) v1 ==== 89550+0+0 (secure 0 0 0) 0x7f975000bd60 con 0x7f9764102370 2024-04-23T14:50:34.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.377+0000 7f9760c00700 1 --2- 172.21.15.81:0/3515480519 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f974c06bcb0 0x7f974c06e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.377+0000 7f9760c00700 1 -- 172.21.15.81:0/3515480519 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f975008c6d0 con 0x7f9764102370 2024-04-23T14:50:34.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.378+0000 7f9768c00700 1 --2- 172.21.15.81:0/3515480519 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f974c06bcb0 0x7f974c06e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.380+0000 7f9768c00700 1 --2- 172.21.15.81:0/3515480519 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f974c06bcb0 0x7f974c06e160 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9764066030 tx=0x7f975800b040 comp rx=0 tx=0).ready entity=mgr.24373 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:34.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.386+0000 7f9760c00700 1 -- 172.21.15.81:0/3515480519 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f97500599e0 con 0x7f9764102370 2024-04-23T14:50:34.685 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:34 smithi081 ceph-mon[25540]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:50:34.685 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:34 smithi081 ceph-mon[25540]: pgmap v56: 65 pgs: 65 active+clean; 889 MiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 157 op/s 2024-04-23T14:50:34.738 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:34 smithi156 ceph-mon[32341]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:50:34.738 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:34 smithi156 ceph-mon[32341]: pgmap v56: 65 pgs: 65 active+clean; 889 MiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 157 op/s 2024-04-23T14:50:34.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.750+0000 7f976b600700 1 -- 172.21.15.81:0/3515480519 --> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9764111b70 con 0x7f974c06bcb0 2024-04-23T14:50:34.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.752+0000 7f9760c00700 1 -- 172.21.15.81:0/3515480519 <== mgr.24373 v2:172.21.15.156:6828/100981835 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7f9764111b70 con 0x7f974c06bcb0 2024-04-23T14:50:34.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.756+0000 7f976b600700 1 -- 172.21.15.81:0/3515480519 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f974c06bcb0 msgr2=0x7f974c06e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:34.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.756+0000 7f976b600700 1 --2- 172.21.15.81:0/3515480519 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f974c06bcb0 0x7f974c06e160 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9764066030 tx=0x7f975800b040 comp rx=0 tx=0).stop 2024-04-23T14:50:34.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.756+0000 7f976b600700 1 -- 172.21.15.81:0/3515480519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9764102370 msgr2=0x7f9764110190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:34.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.756+0000 7f976b600700 1 --2- 172.21.15.81:0/3515480519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9764102370 0x7f9764110190 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9750009150 tx=0x7f9750009e30 comp rx=0 tx=0).stop 2024-04-23T14:50:34.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.756+0000 7f976b600700 1 -- 172.21.15.81:0/3515480519 shutdown_connections 2024-04-23T14:50:34.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.756+0000 7f976b600700 1 --2- 172.21.15.81:0/3515480519 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f974c06bcb0 0x7f974c06e160 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.756+0000 7f976b600700 1 --2- 172.21.15.81:0/3515480519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97640662f0 0x7f976410fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.756+0000 7f976b600700 1 --2- 172.21.15.81:0/3515480519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9764102370 0x7f9764110190 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.756+0000 7f976b600700 1 -- 172.21.15.81:0/3515480519 >> 172.21.15.81:0/3515480519 conn(0x7f97640f74c0 msgr2=0x7f97640f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:34.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.756+0000 7f976b600700 1 -- 172.21.15.81:0/3515480519 shutdown_connections 2024-04-23T14:50:34.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.756+0000 7f976b600700 1 -- 172.21.15.81:0/3515480519 wait complete. 2024-04-23T14:50:34.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.946+0000 7f144e200700 1 -- 172.21.15.81:0/2358655911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14480ffda0 msgr2=0x7f1448102180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:34.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.946+0000 7f144e200700 1 --2- 172.21.15.81:0/2358655911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14480ffda0 0x7f1448102180 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1434004940 tx=0x7f1434009e30 comp rx=0 tx=0).stop 2024-04-23T14:50:34.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.946+0000 7f144e200700 1 -- 172.21.15.81:0/2358655911 shutdown_connections 2024-04-23T14:50:34.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.946+0000 7f144e200700 1 --2- 172.21.15.81:0/2358655911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14480ffda0 0x7f1448102180 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.946+0000 7f144e200700 1 --2- 172.21.15.81:0/2358655911 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1448066290 0x7f14480ff860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.946+0000 7f144e200700 1 -- 172.21.15.81:0/2358655911 >> 172.21.15.81:0/2358655911 conn(0x7f14480f7270 msgr2=0x7f14480f96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:34.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.946+0000 7f144e200700 1 -- 172.21.15.81:0/2358655911 shutdown_connections 2024-04-23T14:50:34.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.946+0000 7f144e200700 1 -- 172.21.15.81:0/2358655911 wait complete. 2024-04-23T14:50:34.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.947+0000 7f144e200700 1 Processor -- start 2024-04-23T14:50:34.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.947+0000 7f144e200700 1 -- start start 2024-04-23T14:50:34.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.947+0000 7f144e200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1448066290 0x7f144810faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.947+0000 7f144e200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14480ffda0 0x7f1448110030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.947+0000 7f144e200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1448110630 con 0x7f1448066290 2024-04-23T14:50:34.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.947+0000 7f144e200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1448110e80 con 0x7f14480ffda0 2024-04-23T14:50:34.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.948+0000 7f144ce00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1448066290 0x7f144810faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.948+0000 7f144ce00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1448066290 0x7f144810faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37992/0 (socket says 172.21.15.81:37992) 2024-04-23T14:50:34.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.948+0000 7f144ce00700 1 -- 172.21.15.81:0/47934830 learned_addr learned my addr 172.21.15.81:0/47934830 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:50:34.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.948+0000 7f144ce00700 1 -- 172.21.15.81:0/47934830 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14480ffda0 msgr2=0x7f1448110030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:34.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.948+0000 7f144ce00700 1 --2- 172.21.15.81:0/47934830 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14480ffda0 0x7f1448110030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:34.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.948+0000 7f144ce00700 1 -- 172.21.15.81:0/47934830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1434005040 con 0x7f1448066290 2024-04-23T14:50:34.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.948+0000 7f144ce00700 1 --2- 172.21.15.81:0/47934830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1448066290 0x7f144810faf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f143c00c8b0 tx=0x7f143c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:34.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.949+0000 7f1444c00700 1 -- 172.21.15.81:0/47934830 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f143c00a760 con 0x7f1448066290 2024-04-23T14:50:34.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.949+0000 7f1444c00700 1 -- 172.21.15.81:0/47934830 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f143c00ad90 con 0x7f1448066290 2024-04-23T14:50:34.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.949+0000 7f1444c00700 1 -- 172.21.15.81:0/47934830 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f143c0113a0 con 0x7f1448066290 2024-04-23T14:50:34.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.949+0000 7f144e200700 1 -- 172.21.15.81:0/47934830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1448111160 con 0x7f1448066290 2024-04-23T14:50:34.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.949+0000 7f144e200700 1 -- 172.21.15.81:0/47934830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14481116a0 con 0x7f1448066290 2024-04-23T14:50:34.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.951+0000 7f144e200700 1 -- 172.21.15.81:0/47934830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14480f8df0 con 0x7f1448066290 2024-04-23T14:50:34.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.951+0000 7f1444c00700 1 -- 172.21.15.81:0/47934830 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) v1 ==== 89550+0+0 (secure 0 0 0) 0x7f143c012400 con 0x7f1448066290 2024-04-23T14:50:34.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.954+0000 7f1444c00700 1 --2- 172.21.15.81:0/47934830 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f143006bca0 0x7f143006e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:34.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.955+0000 7f1444c00700 1 -- 172.21.15.81:0/47934830 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f143c08a770 con 0x7f1448066290 2024-04-23T14:50:34.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.955+0000 7f1447e00700 1 --2- 172.21.15.81:0/47934830 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f143006bca0 0x7f143006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:34.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.957+0000 7f1447e00700 1 --2- 172.21.15.81:0/47934830 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f143006bca0 0x7f143006e150 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1434004f90 tx=0x7f1434009e30 comp rx=0 tx=0).ready entity=mgr.24373 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:34.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:34.959+0000 7f1444c00700 1 -- 172.21.15.81:0/47934830 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f143c057b40 con 0x7f1448066290 2024-04-23T14:50:35.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.276+0000 7f144e200700 1 -- 172.21.15.81:0/47934830 --> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1448111980 con 0x7f143006bca0 2024-04-23T14:50:35.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.316+0000 7f1444c00700 1 -- 172.21.15.81:0/47934830 <== mgr.24373 v2:172.21.15.156:6828/100981835 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f1448111980 con 0x7f143006bca0 2024-04-23T14:50:35.322 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-23T14:50:35.322 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 starting - - - - 2024-04-23T14:50:35.322 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (11m) 87s ago 11m 6660k - 17.2.7-884-g70d0cb4b cafd8ddac8fa 6ae90c81b232 2024-04-23T14:50:35.322 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi156 smithi156 running (10m) 5s ago 10m 6660k - 17.2.7-884-g70d0cb4b cafd8ddac8fa ecc141919f37 2024-04-23T14:50:35.322 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 starting - - - - 2024-04-23T14:50:35.322 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.vcoywg smithi081 running (4m) 87s ago 4m 125M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 2ca7601ab60f 2024-04-23T14:50:35.322 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.wydgcg smithi081 running (4m) 87s ago 4m 68.8M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 58eb1a961b61 2024-04-23T14:50:35.322 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.rhbtxt smithi156 running (4m) 5s ago 4m 12.3M - 17.2.7-884-g70d0cb4b cafd8ddac8fa db3cb5034381 2024-04-23T14:50:35.322 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.vynkxn smithi156 running (4m) 5s ago 4m 12.4M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 1c8f2219e7fd 2024-04-23T14:50:35.323 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.ldghvq smithi081 *:8443,9283,8765 starting - - - - 2024-04-23T14:50:35.323 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi156.ounwyj smithi156 *:8443,9283 running (2m) 5s ago 10m 506M - 19.0.0-3126-gd44fddd9 76e77f280c74 4aef254a3b16 2024-04-23T14:50:35.323 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (13m) 87s ago 13m 49.1M 2048M 17.2.7-884-g70d0cb4b cafd8ddac8fa 6e43d934b336 2024-04-23T14:50:35.323 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi156 smithi156 running (10m) 5s ago 10m 41.5M 2048M 17.2.7-884-g70d0cb4b cafd8ddac8fa d9127540d3bb 2024-04-23T14:50:35.323 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 starting - - - - 2024-04-23T14:50:35.323 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi156 smithi156 *:9100 running (20s) 5s ago 10m 6413k - 1.5.0 0da6a335fe13 91a7c5e86d47 2024-04-23T14:50:35.323 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (9m) 87s ago 9m 92.2M 1557M 17.2.7-884-g70d0cb4b cafd8ddac8fa 272ca032bec1 2024-04-23T14:50:35.323 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (8m) 87s ago 8m 96.6M 1557M 17.2.7-884-g70d0cb4b cafd8ddac8fa ee6d0c8af6ed 2024-04-23T14:50:35.323 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (8m) 87s ago 8m 84.9M 1557M 17.2.7-884-g70d0cb4b cafd8ddac8fa c26c640828a2 2024-04-23T14:50:35.323 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi156 running (7m) 5s ago 7m 241M 2581M 17.2.7-884-g70d0cb4b cafd8ddac8fa c1c261b1ee90 2024-04-23T14:50:35.323 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi156 running (7m) 5s ago 7m 212M 2581M 17.2.7-884-g70d0cb4b cafd8ddac8fa 83f996ee64de 2024-04-23T14:50:35.323 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi156 running (6m) 5s ago 6m 204M 2581M 17.2.7-884-g70d0cb4b cafd8ddac8fa b754244bef18 2024-04-23T14:50:35.323 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 starting - - - - 2024-04-23T14:50:35.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.320+0000 7f144e200700 1 -- 172.21.15.81:0/47934830 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f143006bca0 msgr2=0x7f143006e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:35.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.320+0000 7f144e200700 1 --2- 172.21.15.81:0/47934830 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f143006bca0 0x7f143006e150 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1434004f90 tx=0x7f1434009e30 comp rx=0 tx=0).stop 2024-04-23T14:50:35.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.320+0000 7f144e200700 1 -- 172.21.15.81:0/47934830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1448066290 msgr2=0x7f144810faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:35.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.320+0000 7f144e200700 1 --2- 172.21.15.81:0/47934830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1448066290 0x7f144810faf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f143c00c8b0 tx=0x7f143c004470 comp rx=0 tx=0).stop 2024-04-23T14:50:35.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.321+0000 7f144e200700 1 -- 172.21.15.81:0/47934830 shutdown_connections 2024-04-23T14:50:35.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.321+0000 7f144e200700 1 --2- 172.21.15.81:0/47934830 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f143006bca0 0x7f143006e150 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:35.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.321+0000 7f144e200700 1 --2- 172.21.15.81:0/47934830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1448066290 0x7f144810faf0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:35.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.321+0000 7f144e200700 1 --2- 172.21.15.81:0/47934830 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14480ffda0 0x7f1448110030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:35.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.321+0000 7f144e200700 1 -- 172.21.15.81:0/47934830 >> 172.21.15.81:0/47934830 conn(0x7f14480f7270 msgr2=0x7f14480fb980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:35.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.321+0000 7f144e200700 1 -- 172.21.15.81:0/47934830 shutdown_connections 2024-04-23T14:50:35.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.321+0000 7f144e200700 1 -- 172.21.15.81:0/47934830 wait complete. 2024-04-23T14:50:35.397 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-23T14:50:35.397 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-04-23T14:50:35.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.499+0000 7f8f8dc00700 1 -- 172.21.15.81:0/2683390653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f880fcff0 msgr2=0x7f8f880fd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:35.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.499+0000 7f8f8dc00700 1 --2- 172.21.15.81:0/2683390653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f880fcff0 0x7f8f880fd460 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8f74004880 tx=0x7f8f74009e30 comp rx=0 tx=0).stop 2024-04-23T14:50:35.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.499+0000 7f8f8dc00700 1 -- 172.21.15.81:0/2683390653 shutdown_connections 2024-04-23T14:50:35.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.499+0000 7f8f8dc00700 1 --2- 172.21.15.81:0/2683390653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f880fcff0 0x7f8f880fd460 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:35.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.499+0000 7f8f8dc00700 1 --2- 172.21.15.81:0/2683390653 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f880fbd40 0x7f8f880fc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:35.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.499+0000 7f8f8dc00700 1 -- 172.21.15.81:0/2683390653 >> 172.21.15.81:0/2683390653 conn(0x7f8f880f74c0 msgr2=0x7f8f880f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:35.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.500+0000 7f8f8dc00700 1 -- 172.21.15.81:0/2683390653 shutdown_connections 2024-04-23T14:50:35.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.500+0000 7f8f8dc00700 1 -- 172.21.15.81:0/2683390653 wait complete. 2024-04-23T14:50:35.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.501+0000 7f8f8dc00700 1 Processor -- start 2024-04-23T14:50:35.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.501+0000 7f8f8dc00700 1 -- start start 2024-04-23T14:50:35.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.501+0000 7f8f8dc00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f880fbd40 0x7f8f8810fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:35.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.501+0000 7f8f8dc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f880fcff0 0x7f8f881100d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:35.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.501+0000 7f8f8dc00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f881106d0 con 0x7f8f880fcff0 2024-04-23T14:50:35.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.501+0000 7f8f8dc00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f88110f20 con 0x7f8f880fbd40 2024-04-23T14:50:35.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.502+0000 7f8f86000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f880fcff0 0x7f8f881100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:35.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.502+0000 7f8f86000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f880fcff0 0x7f8f881100d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38020/0 (socket says 172.21.15.81:38020) 2024-04-23T14:50:35.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.502+0000 7f8f86000700 1 -- 172.21.15.81:0/3582839472 learned_addr learned my addr 172.21.15.81:0/3582839472 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:50:35.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.502+0000 7f8f86a00700 1 --2- 172.21.15.81:0/3582839472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f880fbd40 0x7f8f8810fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:35.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.502+0000 7f8f86000700 1 -- 172.21.15.81:0/3582839472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f880fbd40 msgr2=0x7f8f8810fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:35.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.502+0000 7f8f86000700 1 --2- 172.21.15.81:0/3582839472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f880fbd40 0x7f8f8810fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:35.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.502+0000 7f8f86000700 1 -- 172.21.15.81:0/3582839472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f74005040 con 0x7f8f880fcff0 2024-04-23T14:50:35.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.503+0000 7f8f86000700 1 --2- 172.21.15.81:0/3582839472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f880fcff0 0x7f8f881100d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8f74011a50 tx=0x7f8f74009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:35.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.503+0000 7f8f7ea00700 1 -- 172.21.15.81:0/3582839472 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f74011af0 con 0x7f8f880fcff0 2024-04-23T14:50:35.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.503+0000 7f8f7ea00700 1 -- 172.21.15.81:0/3582839472 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8f74011c50 con 0x7f8f880fcff0 2024-04-23T14:50:35.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.503+0000 7f8f8dc00700 1 -- 172.21.15.81:0/3582839472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f881111a0 con 0x7f8f880fcff0 2024-04-23T14:50:35.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.504+0000 7f8f8dc00700 1 -- 172.21.15.81:0/3582839472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f881116e0 con 0x7f8f880fcff0 2024-04-23T14:50:35.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.504+0000 7f8f7ea00700 1 -- 172.21.15.81:0/3582839472 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f7401a630 con 0x7f8f880fcff0 2024-04-23T14:50:35.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.505+0000 7f8f8dc00700 1 -- 172.21.15.81:0/3582839472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f680052e0 con 0x7f8f880fcff0 2024-04-23T14:50:35.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.508+0000 7f8f7ea00700 1 -- 172.21.15.81:0/3582839472 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) v1 ==== 89550+0+0 (secure 0 0 0) 0x7f8f74024410 con 0x7f8f880fcff0 2024-04-23T14:50:35.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.509+0000 7f8f7ea00700 1 --2- 172.21.15.81:0/3582839472 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f8f6c06bcf0 0x7f8f6c06e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:35.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.509+0000 7f8f7ea00700 1 -- 172.21.15.81:0/3582839472 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f8f7408c050 con 0x7f8f880fcff0 2024-04-23T14:50:35.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.510+0000 7f8f86a00700 1 --2- 172.21.15.81:0/3582839472 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f8f6c06bcf0 0x7f8f6c06e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:35.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.511+0000 7f8f86a00700 1 --2- 172.21.15.81:0/3582839472 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f8f6c06bcf0 0x7f8f6c06e1a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8f78009b80 tx=0x7f8f7800b040 comp rx=0 tx=0).ready entity=mgr.24373 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:35.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:35.513+0000 7f8f7ea00700 1 -- 172.21.15.81:0/3582839472 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f8f74059420 con 0x7f8f880fcff0 2024-04-23T14:50:35.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:35 smithi081 ceph-mon[25540]: from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:50:35.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:35 smithi156 ceph-mon[32341]: from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:50:36.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.002+0000 7f8f8dc00700 1 -- 172.21.15.81:0/3582839472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8f68005860 con 0x7f8f880fcff0 2024-04-23T14:50:36.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.003+0000 7f8f7ea00700 1 -- 172.21.15.81:0/3582839472 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7f8f74058fb0 con 0x7f8f880fcff0 2024-04-23T14:50:36.005 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:50:36.005 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-04-23T14:50:36.005 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 2 2024-04-23T14:50:36.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:50:36.005 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-04-23T14:50:36.005 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 1, 2024-04-23T14:50:36.005 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 1 2024-04-23T14:50:36.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:50:36.005 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-04-23T14:50:36.005 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 6 2024-04-23T14:50:36.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:50:36.005 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-04-23T14:50:36.006 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 4 2024-04-23T14:50:36.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:50:36.006 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-04-23T14:50:36.006 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 13, 2024-04-23T14:50:36.006 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 1 2024-04-23T14:50:36.006 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-23T14:50:36.006 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:50:36.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.006+0000 7f8f8dc00700 1 -- 172.21.15.81:0/3582839472 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f8f6c06bcf0 msgr2=0x7f8f6c06e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:36.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.006+0000 7f8f8dc00700 1 --2- 172.21.15.81:0/3582839472 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f8f6c06bcf0 0x7f8f6c06e1a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8f78009b80 tx=0x7f8f7800b040 comp rx=0 tx=0).stop 2024-04-23T14:50:36.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.006+0000 7f8f8dc00700 1 -- 172.21.15.81:0/3582839472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f880fcff0 msgr2=0x7f8f881100d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:36.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.006+0000 7f8f8dc00700 1 --2- 172.21.15.81:0/3582839472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f880fcff0 0x7f8f881100d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8f74011a50 tx=0x7f8f74009e30 comp rx=0 tx=0).stop 2024-04-23T14:50:36.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.006+0000 7f8f8dc00700 1 -- 172.21.15.81:0/3582839472 shutdown_connections 2024-04-23T14:50:36.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.006+0000 7f8f8dc00700 1 --2- 172.21.15.81:0/3582839472 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f8f6c06bcf0 0x7f8f6c06e1a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:36.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.006+0000 7f8f8dc00700 1 --2- 172.21.15.81:0/3582839472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f880fbd40 0x7f8f8810fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:36.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.006+0000 7f8f8dc00700 1 --2- 172.21.15.81:0/3582839472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f880fcff0 0x7f8f881100d0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:36.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.006+0000 7f8f8dc00700 1 -- 172.21.15.81:0/3582839472 >> 172.21.15.81:0/3582839472 conn(0x7f8f880f74c0 msgr2=0x7f8f880f8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:36.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.006+0000 7f8f8dc00700 1 -- 172.21.15.81:0/3582839472 shutdown_connections 2024-04-23T14:50:36.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.006+0000 7f8f8dc00700 1 -- 172.21.15.81:0/3582839472 wait complete. 2024-04-23T14:50:36.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.168+0000 7f4646c00700 1 -- 172.21.15.81:0/3459895433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4640071e40 msgr2=0x7f4640070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:36.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.168+0000 7f4646c00700 1 --2- 172.21.15.81:0/3459895433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4640071e40 0x7f4640070350 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4630004940 tx=0x7f4630009e30 comp rx=0 tx=0).stop 2024-04-23T14:50:36.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.168+0000 7f4646c00700 1 -- 172.21.15.81:0/3459895433 shutdown_connections 2024-04-23T14:50:36.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.168+0000 7f4646c00700 1 --2- 172.21.15.81:0/3459895433 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4640070890 0x7f4640070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:36.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.168+0000 7f4646c00700 1 --2- 172.21.15.81:0/3459895433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4640071e40 0x7f4640070350 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:36.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.168+0000 7f4646c00700 1 -- 172.21.15.81:0/3459895433 >> 172.21.15.81:0/3459895433 conn(0x7f46400f85c0 msgr2=0x7f46400faa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:36.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.168+0000 7f4646c00700 1 -- 172.21.15.81:0/3459895433 shutdown_connections 2024-04-23T14:50:36.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.168+0000 7f4646c00700 1 -- 172.21.15.81:0/3459895433 wait complete. 2024-04-23T14:50:36.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.169+0000 7f4646c00700 1 Processor -- start 2024-04-23T14:50:36.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.169+0000 7f4646c00700 1 -- start start 2024-04-23T14:50:36.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.169+0000 7f4646c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4640070890 0x7f464010fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:36.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.169+0000 7f4646c00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4640071e40 0x7f4640110270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:36.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.169+0000 7f4646c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4640110f80 con 0x7f4640070890 2024-04-23T14:50:36.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.169+0000 7f4646c00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46401110f0 con 0x7f4640071e40 2024-04-23T14:50:36.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.170+0000 7f463fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4640070890 0x7f464010fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:36.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.170+0000 7f463fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4640070890 0x7f464010fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38036/0 (socket says 172.21.15.81:38036) 2024-04-23T14:50:36.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.170+0000 7f463fe00700 1 -- 172.21.15.81:0/2413453242 learned_addr learned my addr 172.21.15.81:0/2413453242 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:50:36.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.170+0000 7f463f400700 1 --2- 172.21.15.81:0/2413453242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4640071e40 0x7f4640110270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:36.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.170+0000 7f463fe00700 1 -- 172.21.15.81:0/2413453242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4640071e40 msgr2=0x7f4640110270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:36.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.170+0000 7f463fe00700 1 --2- 172.21.15.81:0/2413453242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4640071e40 0x7f4640110270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:36.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.170+0000 7f463fe00700 1 -- 172.21.15.81:0/2413453242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4630005040 con 0x7f4640070890 2024-04-23T14:50:36.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.171+0000 7f463fe00700 1 --2- 172.21.15.81:0/2413453242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4640070890 0x7f464010fd30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f463000b970 tx=0x7f4630009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:36.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.171+0000 7f4637e00700 1 -- 172.21.15.81:0/2413453242 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f463000e040 con 0x7f4640070890 2024-04-23T14:50:36.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.171+0000 7f4637e00700 1 -- 172.21.15.81:0/2413453242 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4630004290 con 0x7f4640070890 2024-04-23T14:50:36.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.171+0000 7f4646c00700 1 -- 172.21.15.81:0/2413453242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4640111370 con 0x7f4640070890 2024-04-23T14:50:36.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.172+0000 7f4637e00700 1 -- 172.21.15.81:0/2413453242 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f463001c630 con 0x7f4640070890 2024-04-23T14:50:36.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.172+0000 7f4646c00700 1 -- 172.21.15.81:0/2413453242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4640111930 con 0x7f4640070890 2024-04-23T14:50:36.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.173+0000 7f4646c00700 1 -- 172.21.15.81:0/2413453242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f464005f5f0 con 0x7f4640070890 2024-04-23T14:50:36.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.176+0000 7f4637e00700 1 -- 172.21.15.81:0/2413453242 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) v1 ==== 89550+0+0 (secure 0 0 0) 0x7f463000bbf0 con 0x7f4640070890 2024-04-23T14:50:36.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.177+0000 7f4637e00700 1 --2- 172.21.15.81:0/2413453242 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f462406bbe0 0x7f462406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:36.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.178+0000 7f4637e00700 1 -- 172.21.15.81:0/2413453242 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f463008c330 con 0x7f4640070890 2024-04-23T14:50:36.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.178+0000 7f463f400700 1 --2- 172.21.15.81:0/2413453242 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f462406bbe0 0x7f462406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:36.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.180+0000 7f463f400700 1 --2- 172.21.15.81:0/2413453242 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f462406bbe0 0x7f462406e090 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f462c006fd0 tx=0x7f462c008040 comp rx=0 tx=0).ready entity=mgr.24373 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:36.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.184+0000 7f4637e00700 1 -- 172.21.15.81:0/2413453242 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f4630059640 con 0x7f4640070890 2024-04-23T14:50:36.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.449+0000 7f4637e00700 1 -- 172.21.15.81:0/2413453242 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 27) v1 ==== 92469+0+0 (secure 0 0 0) 0x7f4630055ee0 con 0x7f4640070890 2024-04-23T14:50:36.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.548+0000 7f4646c00700 1 -- 172.21.15.81:0/2413453242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4640107b90 con 0x7f4640070890 2024-04-23T14:50:36.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.549+0000 7f4637e00700 1 -- 172.21.15.81:0/2413453242 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1837 (secure 0 0 0) 0x7f46300797f0 con 0x7f4640070890 2024-04-23T14:50:36.551 INFO:teuthology.orchestra.run.smithi081.stdout:e18 2024-04-23T14:50:36.551 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-23T14:50:36.551 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:50:36.551 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-04-23T14:50:36.552 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:50:36.552 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-04-23T14:50:36.552 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-04-23T14:50:36.552 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 17 2024-04-23T14:50:36.552 INFO:teuthology.orchestra.run.smithi081.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-23T14:50:36.552 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-04-23T14:45:51.264703+0000 2024-04-23T14:50:36.552 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-04-23T14:46:12.782992+0000 2024-04-23T14:50:36.552 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-04-23T14:50:36.552 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-04-23T14:50:36.552 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-04-23T14:50:36.552 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-04-23T14:50:36.552 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-04-23T14:50:36.552 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-04-23T14:50:36.552 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-04-23T14:50:36.552 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 47 2024-04-23T14:50:36.553 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:50:36.553 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 1 2024-04-23T14:50:36.553 INFO:teuthology.orchestra.run.smithi081.stdout:in 0 2024-04-23T14:50:36.553 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=14472} 2024-04-23T14:50:36.553 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-04-23T14:50:36.553 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-04-23T14:50:36.553 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-04-23T14:50:36.553 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-04-23T14:50:36.553 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-04-23T14:50:36.553 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-04-23T14:50:36.553 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-04-23T14:50:36.553 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-04-23T14:50:36.553 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.vcoywg{0:14472} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.81:6828/2563365650,v1:172.21.15.81:6829/2563365650] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:50:36.553 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.wydgcg{0:14482} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.81:6826/759909104,v1:172.21.15.81:6827/759909104] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:50:36.554 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:50:36.554 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:50:36.554 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-04-23T14:50:36.554 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:50:36.554 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.vynkxn{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.156:6826/1794690362,v1:172.21.15.156:6827/1794690362] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:50:36.554 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.rhbtxt{-1:24263} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.156:6824/3854041261,v1:172.21.15.156:6825/3854041261] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:50:36.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.552+0000 7f4646c00700 1 -- 172.21.15.81:0/2413453242 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f462406bbe0 msgr2=0x7f462406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:36.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.552+0000 7f4646c00700 1 --2- 172.21.15.81:0/2413453242 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f462406bbe0 0x7f462406e090 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f462c006fd0 tx=0x7f462c008040 comp rx=0 tx=0).stop 2024-04-23T14:50:36.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.552+0000 7f4646c00700 1 -- 172.21.15.81:0/2413453242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4640070890 msgr2=0x7f464010fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:36.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.552+0000 7f4646c00700 1 --2- 172.21.15.81:0/2413453242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4640070890 0x7f464010fd30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f463000b970 tx=0x7f4630009e30 comp rx=0 tx=0).stop 2024-04-23T14:50:36.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.552+0000 7f4646c00700 1 -- 172.21.15.81:0/2413453242 shutdown_connections 2024-04-23T14:50:36.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.552+0000 7f4646c00700 1 --2- 172.21.15.81:0/2413453242 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f462406bbe0 0x7f462406e090 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:36.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.552+0000 7f4646c00700 1 --2- 172.21.15.81:0/2413453242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4640070890 0x7f464010fd30 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:36.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.552+0000 7f4646c00700 1 --2- 172.21.15.81:0/2413453242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4640071e40 0x7f4640110270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:36.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.552+0000 7f4646c00700 1 -- 172.21.15.81:0/2413453242 >> 172.21.15.81:0/2413453242 conn(0x7f46400f85c0 msgr2=0x7f46400f9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:36.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.553+0000 7f4646c00700 1 -- 172.21.15.81:0/2413453242 shutdown_connections 2024-04-23T14:50:36.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.553+0000 7f4646c00700 1 -- 172.21.15.81:0/2413453242 wait complete. 2024-04-23T14:50:36.556 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 18 2024-04-23T14:50:36.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.733+0000 7f0585e00700 1 -- 172.21.15.81:0/2144942304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0580070890 msgr2=0x7f0580070d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:36.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.733+0000 7f0585e00700 1 --2- 172.21.15.81:0/2144942304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0580070890 0x7f0580070d00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f056c004940 tx=0x7f056c009e30 comp rx=0 tx=0).stop 2024-04-23T14:50:36.735 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:36 smithi081 ceph-mon[25540]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:50:36.735 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:36 smithi081 ceph-mon[25540]: pgmap v57: 65 pgs: 65 active+clean; 591 MiB data, 3.9 GiB used, 533 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 197 op/s 2024-04-23T14:50:36.735 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:36 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/3582839472' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:50:36.735 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:36 smithi081 ceph-mon[25540]: Standby manager daemon smithi081.ldghvq restarted 2024-04-23T14:50:36.735 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:36 smithi081 ceph-mon[25540]: Standby manager daemon smithi081.ldghvq started 2024-04-23T14:50:36.735 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:36 smithi081 ceph-mon[25540]: from='mgr.? 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi081.ldghvq/crt"}]: dispatch 2024-04-23T14:50:36.735 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:36 smithi081 ceph-mon[25540]: from='mgr.? 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-23T14:50:36.736 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:36 smithi081 ceph-mon[25540]: from='mgr.? 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi081.ldghvq/key"}]: dispatch 2024-04-23T14:50:36.736 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:36 smithi081 ceph-mon[25540]: from='mgr.? 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-23T14:50:36.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.733+0000 7f0585e00700 1 -- 172.21.15.81:0/2144942304 shutdown_connections 2024-04-23T14:50:36.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.733+0000 7f0585e00700 1 --2- 172.21.15.81:0/2144942304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0580070890 0x7f0580070d00 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:36.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.733+0000 7f0585e00700 1 --2- 172.21.15.81:0/2144942304 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0580071e50 0x7f0580070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:36.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.733+0000 7f0585e00700 1 -- 172.21.15.81:0/2144942304 >> 172.21.15.81:0/2144942304 conn(0x7f05800f8540 msgr2=0x7f05800fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:36.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.734+0000 7f0585e00700 1 -- 172.21.15.81:0/2144942304 shutdown_connections 2024-04-23T14:50:36.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.734+0000 7f0585e00700 1 -- 172.21.15.81:0/2144942304 wait complete. 2024-04-23T14:50:36.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.735+0000 7f0585e00700 1 Processor -- start 2024-04-23T14:50:36.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.735+0000 7f0585e00700 1 -- start start 2024-04-23T14:50:36.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.735+0000 7f0585e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0580070890 0x7f058010fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:36.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.735+0000 7f0585e00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0580071e50 0x7f0580110260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:36.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.735+0000 7f0585e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0580110f70 con 0x7f0580070890 2024-04-23T14:50:36.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.735+0000 7f0585e00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05801110e0 con 0x7f0580071e50 2024-04-23T14:50:36.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.735+0000 7f057ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0580070890 0x7f058010fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:36.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.735+0000 7f057ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0580070890 0x7f058010fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38054/0 (socket says 172.21.15.81:38054) 2024-04-23T14:50:36.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.735+0000 7f057ea00700 1 -- 172.21.15.81:0/2941187337 learned_addr learned my addr 172.21.15.81:0/2941187337 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:50:36.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.736+0000 7f057e000700 1 --2- 172.21.15.81:0/2941187337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0580071e50 0x7f0580110260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:36.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.736+0000 7f057ea00700 1 -- 172.21.15.81:0/2941187337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0580071e50 msgr2=0x7f0580110260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:36.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.736+0000 7f057ea00700 1 --2- 172.21.15.81:0/2941187337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0580071e50 0x7f0580110260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:36.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.736+0000 7f057ea00700 1 -- 172.21.15.81:0/2941187337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056c005040 con 0x7f0580070890 2024-04-23T14:50:36.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.736+0000 7f057ea00700 1 --2- 172.21.15.81:0/2941187337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0580070890 0x7f058010fd20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f057000b790 tx=0x7f0570009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:36.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.737+0000 7f0576a00700 1 -- 172.21.15.81:0/2941187337 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f057000f6f0 con 0x7f0580070890 2024-04-23T14:50:36.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.737+0000 7f0576a00700 1 -- 172.21.15.81:0/2941187337 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f057000fd20 con 0x7f0580070890 2024-04-23T14:50:36.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.737+0000 7f0576a00700 1 -- 172.21.15.81:0/2941187337 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05700103a0 con 0x7f0580070890 2024-04-23T14:50:36.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.737+0000 7f0585e00700 1 -- 172.21.15.81:0/2941187337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05801113c0 con 0x7f0580070890 2024-04-23T14:50:36.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.737+0000 7f0585e00700 1 -- 172.21.15.81:0/2941187337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0580111980 con 0x7f0580070890 2024-04-23T14:50:36.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.738+0000 7f0585e00700 1 -- 172.21.15.81:0/2941187337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f058005f5f0 con 0x7f0580070890 2024-04-23T14:50:36.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.740+0000 7f0576a00700 1 -- 172.21.15.81:0/2941187337 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) v1 ==== 92469+0+0 (secure 0 0 0) 0x7f0570011400 con 0x7f0580070890 2024-04-23T14:50:36.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.741+0000 7f0576a00700 1 --2- 172.21.15.81:0/2941187337 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f056406e510 0x7f05640709c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:36.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.741+0000 7f0576a00700 1 -- 172.21.15.81:0/2941187337 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f057008dd70 con 0x7f0580070890 2024-04-23T14:50:36.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.742+0000 7f057e000700 1 --2- 172.21.15.81:0/2941187337 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f056406e510 0x7f05640709c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:36.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.743+0000 7f057e000700 1 --2- 172.21.15.81:0/2941187337 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f056406e510 0x7f05640709c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f056c009fd0 tx=0x7f056c009e30 comp rx=0 tx=0).ready entity=mgr.24373 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:36.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:36.744+0000 7f0576a00700 1 -- 172.21.15.81:0/2941187337 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f057005b140 con 0x7f0580070890 2024-04-23T14:50:36.789 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:36 smithi156 ceph-mon[32341]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:50:36.789 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:36 smithi156 ceph-mon[32341]: pgmap v57: 65 pgs: 65 active+clean; 591 MiB data, 3.9 GiB used, 533 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 197 op/s 2024-04-23T14:50:36.789 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:36 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/3582839472' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:50:36.789 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:36 smithi156 ceph-mon[32341]: Standby manager daemon smithi081.ldghvq restarted 2024-04-23T14:50:36.789 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:36 smithi156 ceph-mon[32341]: Standby manager daemon smithi081.ldghvq started 2024-04-23T14:50:36.789 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:36 smithi156 ceph-mon[32341]: from='mgr.? 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi081.ldghvq/crt"}]: dispatch 2024-04-23T14:50:36.789 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:36 smithi156 ceph-mon[32341]: from='mgr.? 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-23T14:50:36.789 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:36 smithi156 ceph-mon[32341]: from='mgr.? 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi081.ldghvq/key"}]: dispatch 2024-04-23T14:50:36.789 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:36 smithi156 ceph-mon[32341]: from='mgr.? 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-23T14:50:37.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.105+0000 7f0585e00700 1 -- 172.21.15.81:0/2941187337 --> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0580107bf0 con 0x7f056406e510 2024-04-23T14:50:37.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.108+0000 7f0576a00700 1 -- 172.21.15.81:0/2941187337 <== mgr.24373 v2:172.21.15.156:6828/100981835 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7f0580107bf0 con 0x7f056406e510 2024-04-23T14:50:37.109 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:50:37.109 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd", 2024-04-23T14:50:37.110 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-04-23T14:50:37.110 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-23T14:50:37.110 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [], 2024-04-23T14:50:37.110 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "", 2024-04-23T14:50:37.110 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "Currently upgrading mgr daemons", 2024-04-23T14:50:37.110 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-04-23T14:50:37.110 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:50:37.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.111+0000 7f0585e00700 1 -- 172.21.15.81:0/2941187337 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f056406e510 msgr2=0x7f05640709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:37.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.111+0000 7f0585e00700 1 --2- 172.21.15.81:0/2941187337 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f056406e510 0x7f05640709c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f056c009fd0 tx=0x7f056c009e30 comp rx=0 tx=0).stop 2024-04-23T14:50:37.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.111+0000 7f0585e00700 1 -- 172.21.15.81:0/2941187337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0580070890 msgr2=0x7f058010fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:37.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.111+0000 7f0585e00700 1 --2- 172.21.15.81:0/2941187337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0580070890 0x7f058010fd20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f057000b790 tx=0x7f0570009220 comp rx=0 tx=0).stop 2024-04-23T14:50:37.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.111+0000 7f0585e00700 1 -- 172.21.15.81:0/2941187337 shutdown_connections 2024-04-23T14:50:37.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.111+0000 7f0585e00700 1 --2- 172.21.15.81:0/2941187337 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7f056406e510 0x7f05640709c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:37.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.111+0000 7f0585e00700 1 --2- 172.21.15.81:0/2941187337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0580070890 0x7f058010fd20 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:37.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.111+0000 7f0585e00700 1 --2- 172.21.15.81:0/2941187337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0580071e50 0x7f0580110260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:37.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.111+0000 7f0585e00700 1 -- 172.21.15.81:0/2941187337 >> 172.21.15.81:0/2941187337 conn(0x7f05800f8540 msgr2=0x7f05800f9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:37.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.111+0000 7f0585e00700 1 -- 172.21.15.81:0/2941187337 shutdown_connections 2024-04-23T14:50:37.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.112+0000 7f0585e00700 1 -- 172.21.15.81:0/2941187337 wait complete. 2024-04-23T14:50:37.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.272+0000 7fe48e800700 1 -- 172.21.15.81:0/751086434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4880fe040 msgr2=0x7fe4880fe4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:37.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.272+0000 7fe48e800700 1 --2- 172.21.15.81:0/751086434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4880fe040 0x7fe4880fe4b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe474004880 tx=0x7fe474009e30 comp rx=0 tx=0).stop 2024-04-23T14:50:37.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.273+0000 7fe48e800700 1 -- 172.21.15.81:0/751086434 shutdown_connections 2024-04-23T14:50:37.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.273+0000 7fe48e800700 1 --2- 172.21.15.81:0/751086434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4880fe040 0x7fe4880fe4b0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:37.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.273+0000 7fe48e800700 1 --2- 172.21.15.81:0/751086434 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4880fce40 0x7fe4880fd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:37.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.273+0000 7fe48e800700 1 -- 172.21.15.81:0/751086434 >> 172.21.15.81:0/751086434 conn(0x7fe4880f8530 msgr2=0x7fe4880fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:37.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.273+0000 7fe48e800700 1 -- 172.21.15.81:0/751086434 shutdown_connections 2024-04-23T14:50:37.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.273+0000 7fe48e800700 1 -- 172.21.15.81:0/751086434 wait complete. 2024-04-23T14:50:37.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.274+0000 7fe48e800700 1 Processor -- start 2024-04-23T14:50:37.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.274+0000 7fe48e800700 1 -- start start 2024-04-23T14:50:37.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.274+0000 7fe48e800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4880fce40 0x7fe488071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:37.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.274+0000 7fe48e800700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4880fe040 0x7fe488070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:37.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.274+0000 7fe48e800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4880708c0 con 0x7fe4880fce40 2024-04-23T14:50:37.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.274+0000 7fe48e800700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe488070a30 con 0x7fe4880fe040 2024-04-23T14:50:37.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.275+0000 7fe487400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4880fce40 0x7fe488071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:37.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.275+0000 7fe487400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4880fce40 0x7fe488071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38076/0 (socket says 172.21.15.81:38076) 2024-04-23T14:50:37.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.275+0000 7fe487400700 1 -- 172.21.15.81:0/961381007 learned_addr learned my addr 172.21.15.81:0/961381007 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:50:37.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.275+0000 7fe486a00700 1 --2- 172.21.15.81:0/961381007 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4880fe040 0x7fe488070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:37.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.275+0000 7fe487400700 1 -- 172.21.15.81:0/961381007 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4880fe040 msgr2=0x7fe488070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:37.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.275+0000 7fe487400700 1 --2- 172.21.15.81:0/961381007 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4880fe040 0x7fe488070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:37.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.275+0000 7fe487400700 1 -- 172.21.15.81:0/961381007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe474005040 con 0x7fe4880fce40 2024-04-23T14:50:37.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.276+0000 7fe487400700 1 --2- 172.21.15.81:0/961381007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4880fce40 0x7fe488071e40 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe47800eb40 tx=0x7fe47800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:37.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.276+0000 7fe47f400700 1 -- 172.21.15.81:0/961381007 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe478007cc0 con 0x7fe4880fce40 2024-04-23T14:50:37.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.276+0000 7fe47f400700 1 -- 172.21.15.81:0/961381007 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe47800f040 con 0x7fe4880fce40 2024-04-23T14:50:37.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.276+0000 7fe48e800700 1 -- 172.21.15.81:0/961381007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe488070d10 con 0x7fe4880fce40 2024-04-23T14:50:37.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.276+0000 7fe47f400700 1 -- 172.21.15.81:0/961381007 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe478009680 con 0x7fe4880fce40 2024-04-23T14:50:37.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.276+0000 7fe48e800700 1 -- 172.21.15.81:0/961381007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe488115a70 con 0x7fe4880fce40 2024-04-23T14:50:37.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.277+0000 7fe48e800700 1 -- 172.21.15.81:0/961381007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4680052e0 con 0x7fe4880fce40 2024-04-23T14:50:37.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.278+0000 7fe47f400700 1 -- 172.21.15.81:0/961381007 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) v1 ==== 92469+0+0 (secure 0 0 0) 0x7fe4780097e0 con 0x7fe4880fce40 2024-04-23T14:50:37.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.279+0000 7fe47f400700 1 --2- 172.21.15.81:0/961381007 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fe46c06e5c0 0x7fe46c070a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:50:37.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.280+0000 7fe47f400700 1 -- 172.21.15.81:0/961381007 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fe47808d6b0 con 0x7fe4880fce40 2024-04-23T14:50:37.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.280+0000 7fe486a00700 1 --2- 172.21.15.81:0/961381007 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fe46c06e5c0 0x7fe46c070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:50:37.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.282+0000 7fe486a00700 1 --2- 172.21.15.81:0/961381007 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fe46c06e5c0 0x7fe46c070a70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe474009fd0 tx=0x7fe474009e30 comp rx=0 tx=0).ready entity=mgr.24373 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:50:37.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.286+0000 7fe47f400700 1 -- 172.21.15.81:0/961381007 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7fe47805ab30 con 0x7fe4880fce40 2024-04-23T14:50:37.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.706+0000 7fe48e800700 1 -- 172.21.15.81:0/961381007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe468005590 con 0x7fe4880fce40 2024-04-23T14:50:37.708 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:37 smithi081 ceph-mon[25540]: mgrmap e27: smithi156.ounwyj(active, since 108s), standbys: smithi081.ldghvq 2024-04-23T14:50:37.709 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:37 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/2413453242' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:50:37.709 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:37 smithi081 ceph-mon[25540]: from='client.14762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:50:37.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.707+0000 7fe47f400700 1 -- 172.21.15.81:0/961381007 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fe47805a6c0 con 0x7fe4880fce40 2024-04-23T14:50:37.709 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-04-23T14:50:37.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.711+0000 7fe48e800700 1 -- 172.21.15.81:0/961381007 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fe46c06e5c0 msgr2=0x7fe46c070a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:37.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.711+0000 7fe48e800700 1 --2- 172.21.15.81:0/961381007 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fe46c06e5c0 0x7fe46c070a70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe474009fd0 tx=0x7fe474009e30 comp rx=0 tx=0).stop 2024-04-23T14:50:37.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.711+0000 7fe48e800700 1 -- 172.21.15.81:0/961381007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4880fce40 msgr2=0x7fe488071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:50:37.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.711+0000 7fe48e800700 1 --2- 172.21.15.81:0/961381007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4880fce40 0x7fe488071e40 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe47800eb40 tx=0x7fe47800b040 comp rx=0 tx=0).stop 2024-04-23T14:50:37.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.712+0000 7fe48e800700 1 -- 172.21.15.81:0/961381007 shutdown_connections 2024-04-23T14:50:37.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.712+0000 7fe48e800700 1 --2- 172.21.15.81:0/961381007 >> [v2:172.21.15.156:6828/100981835,v1:172.21.15.156:6829/100981835] conn(0x7fe46c06e5c0 0x7fe46c070a70 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:37.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.712+0000 7fe48e800700 1 --2- 172.21.15.81:0/961381007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4880fce40 0x7fe488071e40 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:37.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.712+0000 7fe48e800700 1 --2- 172.21.15.81:0/961381007 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4880fe040 0x7fe488070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:50:37.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.712+0000 7fe48e800700 1 -- 172.21.15.81:0/961381007 >> 172.21.15.81:0/961381007 conn(0x7fe4880f8530 msgr2=0x7fe4880f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:50:37.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.712+0000 7fe48e800700 1 -- 172.21.15.81:0/961381007 shutdown_connections 2024-04-23T14:50:37.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:50:37.712+0000 7fe48e800700 1 -- 172.21.15.81:0/961381007 wait complete. 2024-04-23T14:50:37.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:37 smithi156 ceph-mon[32341]: mgrmap e27: smithi156.ounwyj(active, since 108s), standbys: smithi081.ldghvq 2024-04-23T14:50:37.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:37 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/2413453242' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:50:37.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:37 smithi156 ceph-mon[32341]: from='client.14762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:50:38.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:38 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/961381007' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:50:38.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:38 smithi156 ceph-mon[32341]: pgmap v58: 65 pgs: 65 active+clean; 591 MiB data, 3.9 GiB used, 533 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 134 op/s 2024-04-23T14:50:38.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:38 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/961381007' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:50:38.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:38 smithi081 ceph-mon[25540]: pgmap v58: 65 pgs: 65 active+clean; 591 MiB data, 3.9 GiB used, 533 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 134 op/s 2024-04-23T14:50:41.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:40 smithi156 ceph-mon[32341]: pgmap v59: 65 pgs: 65 active+clean; 313 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 244 op/s 2024-04-23T14:50:41.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:40 smithi081 ceph-mon[25540]: pgmap v59: 65 pgs: 65 active+clean; 313 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 244 op/s 2024-04-23T14:50:43.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:42 smithi156 ceph-mon[32341]: pgmap v60: 65 pgs: 65 active+clean; 313 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 177 op/s 2024-04-23T14:50:43.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:42 smithi081 ceph-mon[25540]: pgmap v60: 65 pgs: 65 active+clean; 313 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 177 op/s 2024-04-23T14:50:45.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:44 smithi156 ceph-mon[32341]: pgmap v61: 65 pgs: 65 active+clean; 319 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 230 op/s 2024-04-23T14:50:45.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:44 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:50:45.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:44 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:50:45.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:44 smithi081 ceph-mon[25540]: pgmap v61: 65 pgs: 65 active+clean; 319 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 230 op/s 2024-04-23T14:50:45.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:44 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:50:45.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:44 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:50:47.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:46 smithi156 ceph-mon[32341]: pgmap v62: 65 pgs: 65 active+clean; 318 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 260 op/s 2024-04-23T14:50:47.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:46 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:50:47.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:46 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:50:47.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:46 smithi081 ceph-mon[25540]: pgmap v62: 65 pgs: 65 active+clean; 318 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 260 op/s 2024-04-23T14:50:47.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:46 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:50:47.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:46 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:50:49.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:48 smithi081 ceph-mon[25540]: pgmap v63: 65 pgs: 65 active+clean; 318 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 208 op/s 2024-04-23T14:50:49.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:48 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:50:49.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:48 smithi156 ceph-mon[32341]: pgmap v63: 65 pgs: 65 active+clean; 318 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 208 op/s 2024-04-23T14:50:49.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:48 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:50:51.034 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:50 smithi081 ceph-mon[25540]: pgmap v64: 65 pgs: 65 active+clean; 325 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 271 op/s 2024-04-23T14:50:51.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:50 smithi156 ceph-mon[32341]: pgmap v64: 65 pgs: 65 active+clean; 325 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 271 op/s 2024-04-23T14:50:53.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:52 smithi156 ceph-mon[32341]: pgmap v65: 65 pgs: 65 active+clean; 325 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 161 op/s 2024-04-23T14:50:53.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:52 smithi081 ceph-mon[25540]: pgmap v65: 65 pgs: 65 active+clean; 325 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 161 op/s 2024-04-23T14:50:55.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:54 smithi156 ceph-mon[32341]: pgmap v66: 65 pgs: 65 active+clean; 323 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 222 op/s 2024-04-23T14:50:55.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:54 smithi081 ceph-mon[25540]: pgmap v66: 65 pgs: 65 active+clean; 323 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 222 op/s 2024-04-23T14:50:56.141 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:56 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:50:56.141 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:56 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:50:56.141 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:56 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:50:56.141 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:56 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:50:56.141 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:56 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:50:56.141 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:56 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:50:56.141 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:56 smithi081 ceph-mon[25540]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "mgr fail", "who": "smithi156.ounwyj"}]: dispatch 2024-04-23T14:50:56.141 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:56 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "mgr fail", "who": "smithi156.ounwyj"}]: dispatch 2024-04-23T14:50:56.141 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:56 smithi081 ceph-mon[25540]: Activating manager daemon smithi081.ldghvq 2024-04-23T14:50:56.141 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:56 smithi081 ceph-mon[25540]: osdmap e49: 6 total, 6 up, 6 in 2024-04-23T14:50:56.141 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:56 smithi081 ceph-mon[25540]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' cmd='[{"prefix": "mgr fail", "who": "smithi156.ounwyj"}]': finished 2024-04-23T14:50:56.141 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:56 smithi081 ceph-mon[25540]: mgrmap e28: smithi081.ldghvq(active, starting, since 0.0102294s) 2024-04-23T14:50:56.141 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:56 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi081"}]: dispatch 2024-04-23T14:50:56.141 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:56 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2024-04-23T14:50:56.142 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:56 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi081.vcoywg"}]: dispatch 2024-04-23T14:50:56.142 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:56 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi081.wydgcg"}]: dispatch 2024-04-23T14:50:56.142 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:56 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi156.vynkxn"}]: dispatch 2024-04-23T14:50:56.142 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:56 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi156.rhbtxt"}]: dispatch 2024-04-23T14:50:56.142 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:56 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mgr metadata", "who": "smithi081.ldghvq", "id": "smithi081.ldghvq"}]: dispatch 2024-04-23T14:50:56.142 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:56 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:50:56.142 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:56 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T14:50:56.142 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:56 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T14:50:56.142 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:56 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T14:50:56.142 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:56 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T14:50:56.142 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:56 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T14:50:56.142 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:56 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-23T14:50:56.142 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:56 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-23T14:50:56.142 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:56 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-23T14:50:56.143 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:56 smithi081 ceph-mon[25540]: Manager daemon smithi081.ldghvq is now available 2024-04-23T14:50:56.143 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:56 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:50:56.143 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:56 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:50:56.143 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:56 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi081.ldghvq/mirror_snapshot_schedule"}]: dispatch 2024-04-23T14:50:56.143 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:56 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi081.ldghvq/trash_purge_schedule"}]: dispatch 2024-04-23T14:50:56.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:56 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:50:56.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:56 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:50:56.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:56 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:50:56.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:56 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:50:56.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:56 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' 2024-04-23T14:50:56.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:56 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:50:56.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:56 smithi156 ceph-mon[32341]: from='mgr.24373 172.21.15.156:0/4291022711' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "mgr fail", "who": "smithi156.ounwyj"}]: dispatch 2024-04-23T14:50:56.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:56 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "mgr fail", "who": "smithi156.ounwyj"}]: dispatch 2024-04-23T14:50:56.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:56 smithi156 ceph-mon[32341]: Activating manager daemon smithi081.ldghvq 2024-04-23T14:50:56.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:56 smithi156 ceph-mon[32341]: osdmap e49: 6 total, 6 up, 6 in 2024-04-23T14:50:56.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:56 smithi156 ceph-mon[32341]: from='mgr.24373 ' entity='mgr.smithi156.ounwyj' cmd='[{"prefix": "mgr fail", "who": "smithi156.ounwyj"}]': finished 2024-04-23T14:50:56.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:56 smithi156 ceph-mon[32341]: mgrmap e28: smithi081.ldghvq(active, starting, since 0.0102294s) 2024-04-23T14:50:56.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:56 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi081"}]: dispatch 2024-04-23T14:50:56.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:56 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2024-04-23T14:50:56.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:56 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi081.vcoywg"}]: dispatch 2024-04-23T14:50:56.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:56 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi081.wydgcg"}]: dispatch 2024-04-23T14:50:56.539 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:56 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi156.vynkxn"}]: dispatch 2024-04-23T14:50:56.539 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:56 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi156.rhbtxt"}]: dispatch 2024-04-23T14:50:56.539 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:56 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mgr metadata", "who": "smithi081.ldghvq", "id": "smithi081.ldghvq"}]: dispatch 2024-04-23T14:50:56.539 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:56 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:50:56.539 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:56 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T14:50:56.539 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:56 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T14:50:56.539 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:56 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T14:50:56.539 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:56 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T14:50:56.539 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:56 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T14:50:56.539 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:56 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-23T14:50:56.539 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:56 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-23T14:50:56.539 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:56 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-23T14:50:56.539 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:56 smithi156 ceph-mon[32341]: Manager daemon smithi081.ldghvq is now available 2024-04-23T14:50:56.539 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:56 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:50:56.539 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:56 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:50:56.539 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:56 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi081.ldghvq/mirror_snapshot_schedule"}]: dispatch 2024-04-23T14:50:56.539 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:56 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi081.ldghvq/trash_purge_schedule"}]: dispatch 2024-04-23T14:50:57.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:57 smithi156 ceph-mon[32341]: [23/Apr/2024:14:50:56] ENGINE Bus STARTING 2024-04-23T14:50:57.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:57 smithi156 ceph-mon[32341]: [23/Apr/2024:14:50:56] ENGINE Serving on http://172.21.15.81:8765 2024-04-23T14:50:57.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:57 smithi156 ceph-mon[32341]: mgrmap e29: smithi081.ldghvq(active, since 1.01399s) 2024-04-23T14:50:57.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:57 smithi156 ceph-mon[32341]: pgmap v3: 65 pgs: 65 active+clean; 331 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail 2024-04-23T14:50:57.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:57 smithi156 ceph-mon[32341]: [23/Apr/2024:14:50:56] ENGINE Serving on https://172.21.15.81:7150 2024-04-23T14:50:57.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:57 smithi156 ceph-mon[32341]: [23/Apr/2024:14:50:56] ENGINE Bus STARTED 2024-04-23T14:50:57.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:57 smithi081 ceph-mon[25540]: [23/Apr/2024:14:50:56] ENGINE Bus STARTING 2024-04-23T14:50:57.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:57 smithi081 ceph-mon[25540]: [23/Apr/2024:14:50:56] ENGINE Serving on http://172.21.15.81:8765 2024-04-23T14:50:57.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:57 smithi081 ceph-mon[25540]: mgrmap e29: smithi081.ldghvq(active, since 1.01399s) 2024-04-23T14:50:57.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:57 smithi081 ceph-mon[25540]: pgmap v3: 65 pgs: 65 active+clean; 331 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail 2024-04-23T14:50:57.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:57 smithi081 ceph-mon[25540]: [23/Apr/2024:14:50:56] ENGINE Serving on https://172.21.15.81:7150 2024-04-23T14:50:57.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:57 smithi081 ceph-mon[25540]: [23/Apr/2024:14:50:56] ENGINE Bus STARTED 2024-04-23T14:50:58.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:58 smithi156 ceph-mon[32341]: pgmap v4: 65 pgs: 65 active+clean; 331 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail 2024-04-23T14:50:58.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:58 smithi081 ceph-mon[25540]: pgmap v4: 65 pgs: 65 active+clean; 331 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail 2024-04-23T14:50:59.716 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:50:59 smithi081 ceph-mon[25540]: mgrmap e30: smithi081.ldghvq(active, since 3s) 2024-04-23T14:50:59.772 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:50:59 smithi156 ceph-mon[32341]: mgrmap e30: smithi081.ldghvq(active, since 3s) 2024-04-23T14:51:00.705 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:00 smithi081 ceph-mon[25540]: pgmap v5: 65 pgs: 65 active+clean; 331 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail 2024-04-23T14:51:00.705 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:00 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:00.705 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:00 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:00.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:00 smithi156 ceph-mon[32341]: pgmap v5: 65 pgs: 65 active+clean; 331 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail 2024-04-23T14:51:00.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:00 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:00.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:00 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:02.784 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:02 smithi081 ceph-mon[25540]: pgmap v6: 65 pgs: 65 active+clean; 336 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 807 KiB/s rd, 1.2 MiB/s wr, 135 op/s 2024-04-23T14:51:02.785 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:02 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:02.785 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:02 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:02.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:02 smithi156 ceph-mon[32341]: pgmap v6: 65 pgs: 65 active+clean; 336 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 807 KiB/s rd, 1.2 MiB/s wr, 135 op/s 2024-04-23T14:51:02.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:02 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:02.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:02 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:05.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:04 smithi156 ceph-mon[32341]: pgmap v7: 65 pgs: 65 active+clean; 332 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 315 op/s 2024-04-23T14:51:05.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:04 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:05.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:04 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:05.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:04 smithi081 ceph-mon[25540]: pgmap v7: 65 pgs: 65 active+clean; 332 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 315 op/s 2024-04-23T14:51:05.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:04 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:05.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:04 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:07.269 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:06 smithi081 ceph-mon[25540]: pgmap v8: 65 pgs: 65 active+clean; 332 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 915 KiB/s rd, 1016 KiB/s wr, 245 op/s 2024-04-23T14:51:07.269 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:06 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:07.269 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:06 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:07.269 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:06 smithi081 ceph-mon[25540]: Standby manager daemon smithi156.ounwyj started 2024-04-23T14:51:07.269 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:06 smithi081 ceph-mon[25540]: from='mgr.? 172.21.15.156:0/1257127066' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi156.ounwyj/crt"}]: dispatch 2024-04-23T14:51:07.269 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:06 smithi081 ceph-mon[25540]: from='mgr.? 172.21.15.156:0/1257127066' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-23T14:51:07.269 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:06 smithi081 ceph-mon[25540]: from='mgr.? 172.21.15.156:0/1257127066' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi156.ounwyj/key"}]: dispatch 2024-04-23T14:51:07.270 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:06 smithi081 ceph-mon[25540]: from='mgr.? 172.21.15.156:0/1257127066' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-23T14:51:07.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:06 smithi156 ceph-mon[32341]: pgmap v8: 65 pgs: 65 active+clean; 332 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 915 KiB/s rd, 1016 KiB/s wr, 245 op/s 2024-04-23T14:51:07.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:06 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:07.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:06 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:07.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:06 smithi156 ceph-mon[32341]: Standby manager daemon smithi156.ounwyj started 2024-04-23T14:51:07.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:06 smithi156 ceph-mon[32341]: from='mgr.? 172.21.15.156:0/1257127066' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi156.ounwyj/crt"}]: dispatch 2024-04-23T14:51:07.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:06 smithi156 ceph-mon[32341]: from='mgr.? 172.21.15.156:0/1257127066' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-23T14:51:07.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:06 smithi156 ceph-mon[32341]: from='mgr.? 172.21.15.156:0/1257127066' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi156.ounwyj/key"}]: dispatch 2024-04-23T14:51:07.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:06 smithi156 ceph-mon[32341]: from='mgr.? 172.21.15.156:0/1257127066' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-23T14:51:07.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:07.914+0000 7fd448400700 1 -- 172.21.15.81:0/3168749705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4400662f0 msgr2=0x7fd4400ffa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:07.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:07.914+0000 7fd448400700 1 --2- 172.21.15.81:0/3168749705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4400662f0 0x7fd4400ffa30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd434004940 tx=0x7fd434009e30 comp rx=0 tx=0).stop 2024-04-23T14:51:07.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:07.915+0000 7fd448400700 1 -- 172.21.15.81:0/3168749705 shutdown_connections 2024-04-23T14:51:07.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:07.915+0000 7fd448400700 1 --2- 172.21.15.81:0/3168749705 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4400fff70 0x7fd440102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:07.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:07.915+0000 7fd448400700 1 --2- 172.21.15.81:0/3168749705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4400662f0 0x7fd4400ffa30 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:07.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:07.915+0000 7fd448400700 1 -- 172.21.15.81:0/3168749705 >> 172.21.15.81:0/3168749705 conn(0x7fd4400f74c0 msgr2=0x7fd4400f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:07.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:07.915+0000 7fd448400700 1 -- 172.21.15.81:0/3168749705 shutdown_connections 2024-04-23T14:51:07.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:07.915+0000 7fd448400700 1 -- 172.21.15.81:0/3168749705 wait complete. 2024-04-23T14:51:07.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:07.916+0000 7fd448400700 1 Processor -- start 2024-04-23T14:51:07.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:07.916+0000 7fd448400700 1 -- start start 2024-04-23T14:51:07.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:07.917+0000 7fd448400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4400662f0 0x7fd44010da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:07.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:07.917+0000 7fd448400700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4400fff70 0x7fd44010dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:07.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:07.917+0000 7fd448400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44010e660 con 0x7fd4400662f0 2024-04-23T14:51:07.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:07.917+0000 7fd448400700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44010ee00 con 0x7fd4400fff70 2024-04-23T14:51:07.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:07.917+0000 7fd445a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4400662f0 0x7fd44010da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:07.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:07.917+0000 7fd445a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4400662f0 0x7fd44010da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51962/0 (socket says 172.21.15.81:51962) 2024-04-23T14:51:07.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:07.917+0000 7fd445a00700 1 -- 172.21.15.81:0/3200358260 learned_addr learned my addr 172.21.15.81:0/3200358260 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:51:07.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:07.918+0000 7fd445a00700 1 -- 172.21.15.81:0/3200358260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4400fff70 msgr2=0x7fd44010dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:07.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:07.918+0000 7fd445a00700 1 --2- 172.21.15.81:0/3200358260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4400fff70 0x7fd44010dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:07.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:07.918+0000 7fd445a00700 1 -- 172.21.15.81:0/3200358260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd434005040 con 0x7fd4400662f0 2024-04-23T14:51:07.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:07.918+0000 7fd445a00700 1 --2- 172.21.15.81:0/3200358260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4400662f0 0x7fd44010da90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd43400b970 tx=0x7fd434009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:07.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:07.918+0000 7fd43d600700 1 -- 172.21.15.81:0/3200358260 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd43400e040 con 0x7fd4400662f0 2024-04-23T14:51:07.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:07.918+0000 7fd43d600700 1 -- 172.21.15.81:0/3200358260 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd434004290 con 0x7fd4400662f0 2024-04-23T14:51:07.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:07.918+0000 7fd448400700 1 -- 172.21.15.81:0/3200358260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd44010f080 con 0x7fd4400662f0 2024-04-23T14:51:07.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:07.919+0000 7fd43d600700 1 -- 172.21.15.81:0/3200358260 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd43401c630 con 0x7fd4400662f0 2024-04-23T14:51:07.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:07.919+0000 7fd448400700 1 -- 172.21.15.81:0/3200358260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd44010f640 con 0x7fd4400662f0 2024-04-23T14:51:07.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:07.920+0000 7fd448400700 1 -- 172.21.15.81:0/3200358260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd44005f5f0 con 0x7fd4400662f0 2024-04-23T14:51:07.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:07.921+0000 7fd43d600700 1 -- 172.21.15.81:0/3200358260 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 31) v1 ==== 92569+0+0 (secure 0 0 0) 0x7fd43400bbf0 con 0x7fd4400662f0 2024-04-23T14:51:07.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:07.922+0000 7fd43d600700 1 --2- 172.21.15.81:0/3200358260 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7fd42806e620 0x7fd428070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:07.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:07.922+0000 7fd43d600700 1 -- 172.21.15.81:0/3200358260 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fd43408f3d0 con 0x7fd4400662f0 2024-04-23T14:51:07.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:07.923+0000 7fd445000700 1 --2- 172.21.15.81:0/3200358260 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7fd42806e620 0x7fd428070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:07.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:07.924+0000 7fd445000700 1 --2- 172.21.15.81:0/3200358260 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7fd42806e620 0x7fd428070ad0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd42c006fd0 tx=0x7fd42c006db0 comp rx=0 tx=0).ready entity=mgr.14738 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:07.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:07.928+0000 7fd43d600700 1 -- 172.21.15.81:0/3200358260 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7fd43405c450 con 0x7fd4400662f0 2024-04-23T14:51:08.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.207+0000 7fd448400700 1 -- 172.21.15.81:0/3200358260 --> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd44010fa20 con 0x7fd42806e620 2024-04-23T14:51:08.208 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:08 smithi081 ceph-mon[25540]: mgrmap e31: smithi081.ldghvq(active, since 11s), standbys: smithi156.ounwyj 2024-04-23T14:51:08.208 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:08 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mgr metadata", "who": "smithi156.ounwyj", "id": "smithi156.ounwyj"}]: dispatch 2024-04-23T14:51:08.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.223+0000 7fd43d600700 1 -- 172.21.15.81:0/3200358260 <== mgr.14738 v2:172.21.15.81:6800/1880997914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fd44010fa20 con 0x7fd42806e620 2024-04-23T14:51:08.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.238+0000 7fd448400700 1 -- 172.21.15.81:0/3200358260 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7fd42806e620 msgr2=0x7fd428070ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:08.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.238+0000 7fd448400700 1 --2- 172.21.15.81:0/3200358260 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7fd42806e620 0x7fd428070ad0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd42c006fd0 tx=0x7fd42c006db0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.238+0000 7fd448400700 1 -- 172.21.15.81:0/3200358260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4400662f0 msgr2=0x7fd44010da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:08.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.238+0000 7fd448400700 1 --2- 172.21.15.81:0/3200358260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4400662f0 0x7fd44010da90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd43400b970 tx=0x7fd434009e30 comp rx=0 tx=0).stop 2024-04-23T14:51:08.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.238+0000 7fd448400700 1 -- 172.21.15.81:0/3200358260 shutdown_connections 2024-04-23T14:51:08.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.238+0000 7fd448400700 1 --2- 172.21.15.81:0/3200358260 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7fd42806e620 0x7fd428070ad0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.238+0000 7fd448400700 1 --2- 172.21.15.81:0/3200358260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4400662f0 0x7fd44010da90 secure :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd43400b970 tx=0x7fd434009e30 comp rx=0 tx=0).stop 2024-04-23T14:51:08.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.238+0000 7fd448400700 1 --2- 172.21.15.81:0/3200358260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4400fff70 0x7fd44010dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.238+0000 7fd448400700 1 -- 172.21.15.81:0/3200358260 >> 172.21.15.81:0/3200358260 conn(0x7fd4400f74c0 msgr2=0x7fd4400f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:08.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.244+0000 7fd448400700 1 -- 172.21.15.81:0/3200358260 shutdown_connections 2024-04-23T14:51:08.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.244+0000 7fd448400700 1 -- 172.21.15.81:0/3200358260 wait complete. 2024-04-23T14:51:08.271 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-04-23T14:51:08.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:08 smithi156 ceph-mon[32341]: mgrmap e31: smithi081.ldghvq(active, since 11s), standbys: smithi156.ounwyj 2024-04-23T14:51:08.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:08 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mgr metadata", "who": "smithi156.ounwyj", "id": "smithi156.ounwyj"}]: dispatch 2024-04-23T14:51:08.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.425+0000 7fbb23e00700 1 -- 172.21.15.81:0/466483416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb240fee00 msgr2=0x7fbb240ff210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:08.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.425+0000 7fbb23e00700 1 --2- 172.21.15.81:0/466483416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb240fee00 0x7fbb240ff210 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbb10004940 tx=0x7fbb10009e30 comp rx=0 tx=0).stop 2024-04-23T14:51:08.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.425+0000 7fbb23e00700 1 -- 172.21.15.81:0/466483416 shutdown_connections 2024-04-23T14:51:08.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.425+0000 7fbb23e00700 1 --2- 172.21.15.81:0/466483416 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb240ff750 0x7fbb241000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.425+0000 7fbb23e00700 1 --2- 172.21.15.81:0/466483416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb240fee00 0x7fbb240ff210 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.425+0000 7fbb23e00700 1 -- 172.21.15.81:0/466483416 >> 172.21.15.81:0/466483416 conn(0x7fbb240fa5d0 msgr2=0x7fbb240fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:08.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.425+0000 7fbb23e00700 1 -- 172.21.15.81:0/466483416 shutdown_connections 2024-04-23T14:51:08.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.425+0000 7fbb23e00700 1 -- 172.21.15.81:0/466483416 wait complete. 2024-04-23T14:51:08.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.426+0000 7fbb23e00700 1 Processor -- start 2024-04-23T14:51:08.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.426+0000 7fbb23e00700 1 -- start start 2024-04-23T14:51:08.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.427+0000 7fbb23e00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb240fee00 0x7fbb2410faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:08.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.427+0000 7fbb23e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb240ff750 0x7fbb2410ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:08.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.427+0000 7fbb23e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb24110670 con 0x7fbb240ff750 2024-04-23T14:51:08.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.427+0000 7fbb23e00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb24110e60 con 0x7fbb240fee00 2024-04-23T14:51:08.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.427+0000 7fbb22000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb240ff750 0x7fbb2410ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:08.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.427+0000 7fbb22000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb240ff750 0x7fbb2410ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51978/0 (socket says 172.21.15.81:51978) 2024-04-23T14:51:08.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.427+0000 7fbb22000700 1 -- 172.21.15.81:0/2720529376 learned_addr learned my addr 172.21.15.81:0/2720529376 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:51:08.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.427+0000 7fbb22a00700 1 --2- 172.21.15.81:0/2720529376 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb240fee00 0x7fbb2410faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:08.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.428+0000 7fbb22000700 1 -- 172.21.15.81:0/2720529376 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb240fee00 msgr2=0x7fbb2410faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:08.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.428+0000 7fbb22000700 1 --2- 172.21.15.81:0/2720529376 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb240fee00 0x7fbb2410faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.428+0000 7fbb22000700 1 -- 172.21.15.81:0/2720529376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb10005040 con 0x7fbb240ff750 2024-04-23T14:51:08.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.428+0000 7fbb22000700 1 --2- 172.21.15.81:0/2720529376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb240ff750 0x7fbb2410ffe0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbb1400b790 tx=0x7fbb14009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:08.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.428+0000 7fbb1aa00700 1 -- 172.21.15.81:0/2720529376 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb1400f6f0 con 0x7fbb240ff750 2024-04-23T14:51:08.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.428+0000 7fbb1aa00700 1 -- 172.21.15.81:0/2720529376 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbb1400fd20 con 0x7fbb240ff750 2024-04-23T14:51:08.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.428+0000 7fbb1aa00700 1 -- 172.21.15.81:0/2720529376 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb140103a0 con 0x7fbb240ff750 2024-04-23T14:51:08.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.428+0000 7fbb23e00700 1 -- 172.21.15.81:0/2720529376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb24111140 con 0x7fbb240ff750 2024-04-23T14:51:08.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.429+0000 7fbb23e00700 1 -- 172.21.15.81:0/2720529376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb24111700 con 0x7fbb240ff750 2024-04-23T14:51:08.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.430+0000 7fbb23e00700 1 -- 172.21.15.81:0/2720529376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb2405f5f0 con 0x7fbb240ff750 2024-04-23T14:51:08.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.432+0000 7fbb1aa00700 1 -- 172.21.15.81:0/2720529376 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 31) v1 ==== 92569+0+0 (secure 0 0 0) 0x7fbb14011400 con 0x7fbb240ff750 2024-04-23T14:51:08.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.432+0000 7fbb1aa00700 1 --2- 172.21.15.81:0/2720529376 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7fbb0806e800 0x7fbb08070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:08.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.432+0000 7fbb1aa00700 1 -- 172.21.15.81:0/2720529376 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fbb1408e8c0 con 0x7fbb240ff750 2024-04-23T14:51:08.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.433+0000 7fbb22a00700 1 --2- 172.21.15.81:0/2720529376 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7fbb0806e800 0x7fbb08070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:08.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.435+0000 7fbb22a00700 1 --2- 172.21.15.81:0/2720529376 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7fbb0806e800 0x7fbb08070cb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbb10004890 tx=0x7fbb10009e30 comp rx=0 tx=0).ready entity=mgr.14738 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:08.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.441+0000 7fbb1aa00700 1 -- 172.21.15.81:0/2720529376 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7fbb1405b990 con 0x7fbb240ff750 2024-04-23T14:51:08.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.738+0000 7fbb23e00700 1 -- 172.21.15.81:0/2720529376 --> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb24111ae0 con 0x7fbb0806e800 2024-04-23T14:51:08.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.740+0000 7fbb1aa00700 1 -- 172.21.15.81:0/2720529376 <== mgr.14738 v2:172.21.15.81:6800/1880997914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fbb24111ae0 con 0x7fbb0806e800 2024-04-23T14:51:08.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.743+0000 7fbb23e00700 1 -- 172.21.15.81:0/2720529376 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7fbb0806e800 msgr2=0x7fbb08070cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:08.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.743+0000 7fbb23e00700 1 --2- 172.21.15.81:0/2720529376 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7fbb0806e800 0x7fbb08070cb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbb10004890 tx=0x7fbb10009e30 comp rx=0 tx=0).stop 2024-04-23T14:51:08.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.743+0000 7fbb23e00700 1 -- 172.21.15.81:0/2720529376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb240ff750 msgr2=0x7fbb2410ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:08.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.743+0000 7fbb23e00700 1 --2- 172.21.15.81:0/2720529376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb240ff750 0x7fbb2410ffe0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbb1400b790 tx=0x7fbb14009220 comp rx=0 tx=0).stop 2024-04-23T14:51:08.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.743+0000 7fbb23e00700 1 -- 172.21.15.81:0/2720529376 shutdown_connections 2024-04-23T14:51:08.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.743+0000 7fbb23e00700 1 --2- 172.21.15.81:0/2720529376 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7fbb0806e800 0x7fbb08070cb0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.743+0000 7fbb23e00700 1 --2- 172.21.15.81:0/2720529376 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb240fee00 0x7fbb2410faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.743+0000 7fbb23e00700 1 --2- 172.21.15.81:0/2720529376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb240ff750 0x7fbb2410ffe0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.743+0000 7fbb23e00700 1 -- 172.21.15.81:0/2720529376 >> 172.21.15.81:0/2720529376 conn(0x7fbb240fa5d0 msgr2=0x7fbb240fbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:08.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.744+0000 7fbb23e00700 1 -- 172.21.15.81:0/2720529376 shutdown_connections 2024-04-23T14:51:08.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.744+0000 7fbb23e00700 1 -- 172.21.15.81:0/2720529376 wait complete. 2024-04-23T14:51:08.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.944+0000 7f8d85400700 1 -- 172.21.15.81:0/2760684606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d800fcdc0 msgr2=0x7f8d800fd1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:08.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.944+0000 7f8d85400700 1 --2- 172.21.15.81:0/2760684606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d800fcdc0 0x7f8d800fd1d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f8d70004940 tx=0x7f8d70009e30 comp rx=0 tx=0).stop 2024-04-23T14:51:08.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.944+0000 7f8d85400700 1 -- 172.21.15.81:0/2760684606 shutdown_connections 2024-04-23T14:51:08.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.944+0000 7f8d85400700 1 --2- 172.21.15.81:0/2760684606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d800fd710 0x7f8d800fe070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.944+0000 7f8d85400700 1 --2- 172.21.15.81:0/2760684606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d800fcdc0 0x7f8d800fd1d0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.944+0000 7f8d85400700 1 -- 172.21.15.81:0/2760684606 >> 172.21.15.81:0/2760684606 conn(0x7f8d800f8540 msgr2=0x7f8d800fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:08.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.945+0000 7f8d85400700 1 -- 172.21.15.81:0/2760684606 shutdown_connections 2024-04-23T14:51:08.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.945+0000 7f8d85400700 1 -- 172.21.15.81:0/2760684606 wait complete. 2024-04-23T14:51:08.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.946+0000 7f8d85400700 1 Processor -- start 2024-04-23T14:51:08.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.946+0000 7f8d85400700 1 -- start start 2024-04-23T14:51:08.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.946+0000 7f8d85400700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d800fcdc0 0x7f8d8010fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:08.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.946+0000 7f8d85400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d800fd710 0x7f8d80110280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:08.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.946+0000 7f8d85400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d80110880 con 0x7f8d800fd710 2024-04-23T14:51:08.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.946+0000 7f8d85400700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d80110fc0 con 0x7f8d800fcdc0 2024-04-23T14:51:08.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.947+0000 7f8d7de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d800fd710 0x7f8d80110280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:08.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.947+0000 7f8d7de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d800fd710 0x7f8d80110280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51990/0 (socket says 172.21.15.81:51990) 2024-04-23T14:51:08.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.947+0000 7f8d7de00700 1 -- 172.21.15.81:0/1849882202 learned_addr learned my addr 172.21.15.81:0/1849882202 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:51:08.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.947+0000 7f8d7e800700 1 --2- 172.21.15.81:0/1849882202 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d800fcdc0 0x7f8d8010fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:08.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.948+0000 7f8d7de00700 1 -- 172.21.15.81:0/1849882202 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d800fcdc0 msgr2=0x7f8d8010fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:08.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.948+0000 7f8d7de00700 1 --2- 172.21.15.81:0/1849882202 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d800fcdc0 0x7f8d8010fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:08.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.948+0000 7f8d7de00700 1 -- 172.21.15.81:0/1849882202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d70005040 con 0x7f8d800fd710 2024-04-23T14:51:08.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.948+0000 7f8d7de00700 1 --2- 172.21.15.81:0/1849882202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d800fd710 0x7f8d80110280 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c002a50 tx=0x7f8d6c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:08.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.948+0000 7f8d76a00700 1 -- 172.21.15.81:0/1849882202 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d6c007cc0 con 0x7f8d800fd710 2024-04-23T14:51:08.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.948+0000 7f8d76a00700 1 -- 172.21.15.81:0/1849882202 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8d6c00f040 con 0x7f8d800fd710 2024-04-23T14:51:08.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.948+0000 7f8d76a00700 1 -- 172.21.15.81:0/1849882202 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d6c00d9c0 con 0x7f8d800fd710 2024-04-23T14:51:08.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.948+0000 7f8d85400700 1 -- 172.21.15.81:0/1849882202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d801112a0 con 0x7f8d800fd710 2024-04-23T14:51:08.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.949+0000 7f8d85400700 1 -- 172.21.15.81:0/1849882202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d80111810 con 0x7f8d800fd710 2024-04-23T14:51:08.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.951+0000 7f8d85400700 1 -- 172.21.15.81:0/1849882202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d80101a60 con 0x7f8d800fd710 2024-04-23T14:51:08.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.952+0000 7f8d76a00700 1 -- 172.21.15.81:0/1849882202 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 31) v1 ==== 92569+0+0 (secure 0 0 0) 0x7f8d6c00dbf0 con 0x7f8d800fd710 2024-04-23T14:51:08.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.952+0000 7f8d76a00700 1 --2- 172.21.15.81:0/1849882202 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f8d6406e620 0x7f8d64070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:08.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.953+0000 7f8d76a00700 1 -- 172.21.15.81:0/1849882202 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f8d6c08dfb0 con 0x7f8d800fd710 2024-04-23T14:51:08.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.953+0000 7f8d7e800700 1 --2- 172.21.15.81:0/1849882202 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f8d6406e620 0x7f8d64070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:08.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.955+0000 7f8d7e800700 1 --2- 172.21.15.81:0/1849882202 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f8d6406e620 0x7f8d64070ad0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8d7000b3b0 tx=0x7f8d70009e30 comp rx=0 tx=0).ready entity=mgr.14738 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:08.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:08.962+0000 7f8d76a00700 1 -- 172.21.15.81:0/1849882202 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f8d6c0c2930 con 0x7f8d800fd710 2024-04-23T14:51:09.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.274+0000 7f8d85400700 1 -- 172.21.15.81:0/1849882202 --> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d80111a80 con 0x7f8d6406e620 2024-04-23T14:51:09.275 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:09 smithi081 ceph-mon[25540]: pgmap v9: 65 pgs: 65 active+clean; 330 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 772 op/s 2024-04-23T14:51:09.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:09 smithi156 ceph-mon[32341]: pgmap v9: 65 pgs: 65 active+clean; 330 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 772 op/s 2024-04-23T14:51:09.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.298+0000 7f8d76a00700 1 -- 172.21.15.81:0/1849882202 <== mgr.14738 v2:172.21.15.81:6800/1880997914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f8d80111a80 con 0x7f8d6406e620 2024-04-23T14:51:09.303 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-23T14:51:09.303 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (89s) 5s ago 12m 14.7M - 0.25.0 c8568f914cd2 63876b2abc27 2024-04-23T14:51:09.303 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (12m) 5s ago 12m 6660k - 17.2.7-884-g70d0cb4b cafd8ddac8fa 6ae90c81b232 2024-04-23T14:51:09.303 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi156 smithi156 running (11m) 9s ago 11m 6660k - 17.2.7-884-g70d0cb4b cafd8ddac8fa ecc141919f37 2024-04-23T14:51:09.303 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (71s) 5s ago 11m 74.2M - 9.4.7 954c08fa6188 fbad3cef0883 2024-04-23T14:51:09.303 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.vcoywg smithi081 running (5m) 5s ago 5m 221M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 2ca7601ab60f 2024-04-23T14:51:09.303 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.wydgcg smithi081 running (5m) 5s ago 5m 151M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 58eb1a961b61 2024-04-23T14:51:09.303 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.rhbtxt smithi156 running (5m) 9s ago 5m 12.5M - 17.2.7-884-g70d0cb4b cafd8ddac8fa db3cb5034381 2024-04-23T14:51:09.304 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.vynkxn smithi156 running (5m) 9s ago 5m 12.6M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 1c8f2219e7fd 2024-04-23T14:51:09.304 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.ldghvq smithi081 *:8443,9283,8765 running (45s) 5s ago 13m 476M - 19.0.0-3126-gd44fddd9 76e77f280c74 6bf23484a1c9 2024-04-23T14:51:09.304 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi156.ounwyj smithi156 *:8443,9283 running (2m) 9s ago 10m 69.9M - 19.0.0-3126-gd44fddd9 76e77f280c74 4aef254a3b16 2024-04-23T14:51:09.304 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (13m) 5s ago 14m 52.6M 2048M 17.2.7-884-g70d0cb4b cafd8ddac8fa 6e43d934b336 2024-04-23T14:51:09.304 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi156 smithi156 running (10m) 9s ago 10m 42.6M 2048M 17.2.7-884-g70d0cb4b cafd8ddac8fa d9127540d3bb 2024-04-23T14:51:09.304 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (112s) 5s ago 12m 7348k - 1.5.0 0da6a335fe13 197b27809010 2024-04-23T14:51:09.304 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi156 smithi156 *:9100 running (54s) 9s ago 11m 7818k - 1.5.0 0da6a335fe13 91a7c5e86d47 2024-04-23T14:51:09.304 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (9m) 5s ago 9m 201M 1557M 17.2.7-884-g70d0cb4b cafd8ddac8fa 272ca032bec1 2024-04-23T14:51:09.304 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (9m) 5s ago 9m 212M 1557M 17.2.7-884-g70d0cb4b cafd8ddac8fa ee6d0c8af6ed 2024-04-23T14:51:09.304 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (8m) 5s ago 8m 173M 1557M 17.2.7-884-g70d0cb4b cafd8ddac8fa c26c640828a2 2024-04-23T14:51:09.304 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi156 running (8m) 9s ago 8m 244M 2581M 17.2.7-884-g70d0cb4b cafd8ddac8fa c1c261b1ee90 2024-04-23T14:51:09.304 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi156 running (7m) 9s ago 7m 215M 2581M 17.2.7-884-g70d0cb4b cafd8ddac8fa 83f996ee64de 2024-04-23T14:51:09.304 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi156 running (7m) 9s ago 7m 199M 2581M 17.2.7-884-g70d0cb4b cafd8ddac8fa b754244bef18 2024-04-23T14:51:09.304 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (58s) 5s ago 11m 44.8M - 2.43.0 a07b618ecd1d 9705d448f48d 2024-04-23T14:51:09.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.302+0000 7f8d85400700 1 -- 172.21.15.81:0/1849882202 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f8d6406e620 msgr2=0x7f8d64070ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:09.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.302+0000 7f8d85400700 1 --2- 172.21.15.81:0/1849882202 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f8d6406e620 0x7f8d64070ad0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8d7000b3b0 tx=0x7f8d70009e30 comp rx=0 tx=0).stop 2024-04-23T14:51:09.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.302+0000 7f8d85400700 1 -- 172.21.15.81:0/1849882202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d800fd710 msgr2=0x7f8d80110280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:09.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.302+0000 7f8d85400700 1 --2- 172.21.15.81:0/1849882202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d800fd710 0x7f8d80110280 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c002a50 tx=0x7f8d6c004600 comp rx=0 tx=0).stop 2024-04-23T14:51:09.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.305+0000 7f8d85400700 1 -- 172.21.15.81:0/1849882202 shutdown_connections 2024-04-23T14:51:09.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.305+0000 7f8d85400700 1 --2- 172.21.15.81:0/1849882202 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f8d6406e620 0x7f8d64070ad0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.305+0000 7f8d85400700 1 --2- 172.21.15.81:0/1849882202 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d800fcdc0 0x7f8d8010fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.305+0000 7f8d85400700 1 --2- 172.21.15.81:0/1849882202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d800fd710 0x7f8d80110280 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.305+0000 7f8d85400700 1 -- 172.21.15.81:0/1849882202 >> 172.21.15.81:0/1849882202 conn(0x7f8d800f8540 msgr2=0x7f8d800f9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:09.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.305+0000 7f8d85400700 1 -- 172.21.15.81:0/1849882202 shutdown_connections 2024-04-23T14:51:09.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.305+0000 7f8d85400700 1 -- 172.21.15.81:0/1849882202 wait complete. 2024-04-23T14:51:09.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.540+0000 7f80fe000700 1 -- 172.21.15.81:0/3955322767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80f80709a0 msgr2=0x7f80f8070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:09.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.540+0000 7f80fe000700 1 --2- 172.21.15.81:0/3955322767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80f80709a0 0x7f80f8070e10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f80e4004940 tx=0x7f80e4009e30 comp rx=0 tx=0).stop 2024-04-23T14:51:09.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.540+0000 7f80fe000700 1 -- 172.21.15.81:0/3955322767 shutdown_connections 2024-04-23T14:51:09.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.540+0000 7f80fe000700 1 --2- 172.21.15.81:0/3955322767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80f80709a0 0x7f80f8070e10 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.540+0000 7f80fe000700 1 --2- 172.21.15.81:0/3955322767 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80f8071f50 0x7f80f8070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.540+0000 7f80fe000700 1 -- 172.21.15.81:0/3955322767 >> 172.21.15.81:0/3955322767 conn(0x7f80f80f8530 msgr2=0x7f80f80fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:09.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.541+0000 7f80fe000700 1 -- 172.21.15.81:0/3955322767 shutdown_connections 2024-04-23T14:51:09.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.541+0000 7f80fe000700 1 -- 172.21.15.81:0/3955322767 wait complete. 2024-04-23T14:51:09.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.542+0000 7f80fe000700 1 Processor -- start 2024-04-23T14:51:09.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.542+0000 7f80fe000700 1 -- start start 2024-04-23T14:51:09.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.543+0000 7f80fe000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80f80709a0 0x7f80f8114040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.543+0000 7f80fe000700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80f8071f50 0x7f80f8114580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.543+0000 7f80fe000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f8114b80 con 0x7f80f80709a0 2024-04-23T14:51:09.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.543+0000 7f80fe000700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f81153d0 con 0x7f80f8071f50 2024-04-23T14:51:09.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.543+0000 7f80f7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80f80709a0 0x7f80f8114040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.544+0000 7f80f7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80f80709a0 0x7f80f8114040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52018/0 (socket says 172.21.15.81:52018) 2024-04-23T14:51:09.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.544+0000 7f80f7400700 1 -- 172.21.15.81:0/1405957947 learned_addr learned my addr 172.21.15.81:0/1405957947 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:51:09.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.544+0000 7f80f6a00700 1 --2- 172.21.15.81:0/1405957947 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80f8071f50 0x7f80f8114580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.544+0000 7f80f6a00700 1 -- 172.21.15.81:0/1405957947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80f80709a0 msgr2=0x7f80f8114040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:09.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.544+0000 7f80f6a00700 1 --2- 172.21.15.81:0/1405957947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80f80709a0 0x7f80f8114040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:09.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.544+0000 7f80f6a00700 1 -- 172.21.15.81:0/1405957947 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e4005040 con 0x7f80f8071f50 2024-04-23T14:51:09.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.545+0000 7f80f6a00700 1 --2- 172.21.15.81:0/1405957947 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80f8071f50 0x7f80f8114580 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f80e400b970 tx=0x7f80e4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:09.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.545+0000 7f80ef400700 1 -- 172.21.15.81:0/1405957947 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80e400e040 con 0x7f80f8071f50 2024-04-23T14:51:09.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.545+0000 7f80fe000700 1 -- 172.21.15.81:0/1405957947 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80f8115650 con 0x7f80f8071f50 2024-04-23T14:51:09.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.545+0000 7f80ef400700 1 -- 172.21.15.81:0/1405957947 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f80e4004290 con 0x7f80f8071f50 2024-04-23T14:51:09.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.546+0000 7f80fe000700 1 -- 172.21.15.81:0/1405957947 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80f8115b90 con 0x7f80f8071f50 2024-04-23T14:51:09.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.546+0000 7f80ef400700 1 -- 172.21.15.81:0/1405957947 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80e401c630 con 0x7f80f8071f50 2024-04-23T14:51:09.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.547+0000 7f80fe000700 1 -- 172.21.15.81:0/1405957947 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80f805f5f0 con 0x7f80f8071f50 2024-04-23T14:51:09.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.549+0000 7f80ef400700 1 -- 172.21.15.81:0/1405957947 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 31) v1 ==== 92569+0+0 (secure 0 0 0) 0x7f80e400bbf0 con 0x7f80f8071f50 2024-04-23T14:51:09.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.550+0000 7f80ef400700 1 --2- 172.21.15.81:0/1405957947 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f80dc06e670 0x7f80dc070b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:09.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.551+0000 7f80ef400700 1 -- 172.21.15.81:0/1405957947 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f80e408f510 con 0x7f80f8071f50 2024-04-23T14:51:09.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.551+0000 7f80f7400700 1 --2- 172.21.15.81:0/1405957947 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f80dc06e670 0x7f80dc070b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:09.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.552+0000 7f80f7400700 1 --2- 172.21.15.81:0/1405957947 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f80dc06e670 0x7f80dc070b20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f80e8004a10 tx=0x7f80e8007ab0 comp rx=0 tx=0).ready entity=mgr.14738 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:09.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.556+0000 7f80ef400700 1 -- 172.21.15.81:0/1405957947 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f80e405c450 con 0x7f80f8071f50 2024-04-23T14:51:10.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.998+0000 7f80fe000700 1 -- 172.21.15.81:0/1405957947 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f80f8115e70 con 0x7f80f8071f50 2024-04-23T14:51:10.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:09.999+0000 7f80ef400700 1 -- 172.21.15.81:0/1405957947 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f80e4013e60 con 0x7f80f8071f50 2024-04-23T14:51:10.001 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:51:10.001 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-04-23T14:51:10.001 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 2 2024-04-23T14:51:10.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:51:10.001 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-04-23T14:51:10.001 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T14:51:10.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:51:10.001 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-04-23T14:51:10.002 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 6 2024-04-23T14:51:10.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:51:10.002 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-04-23T14:51:10.002 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 4 2024-04-23T14:51:10.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:51:10.002 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-04-23T14:51:10.002 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 12, 2024-04-23T14:51:10.002 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T14:51:10.002 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-23T14:51:10.002 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:51:10.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.002+0000 7f80fe000700 1 -- 172.21.15.81:0/1405957947 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f80dc06e670 msgr2=0x7f80dc070b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:10.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.002+0000 7f80fe000700 1 --2- 172.21.15.81:0/1405957947 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f80dc06e670 0x7f80dc070b20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f80e8004a10 tx=0x7f80e8007ab0 comp rx=0 tx=0).stop 2024-04-23T14:51:10.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.002+0000 7f80fe000700 1 -- 172.21.15.81:0/1405957947 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80f8071f50 msgr2=0x7f80f8114580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:10.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.002+0000 7f80fe000700 1 --2- 172.21.15.81:0/1405957947 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80f8071f50 0x7f80f8114580 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f80e400b970 tx=0x7f80e4009e30 comp rx=0 tx=0).stop 2024-04-23T14:51:10.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.003+0000 7f80fe000700 1 -- 172.21.15.81:0/1405957947 shutdown_connections 2024-04-23T14:51:10.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.003+0000 7f80fe000700 1 --2- 172.21.15.81:0/1405957947 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f80dc06e670 0x7f80dc070b20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:10.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.003+0000 7f80fe000700 1 --2- 172.21.15.81:0/1405957947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80f80709a0 0x7f80f8114040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:10.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.003+0000 7f80fe000700 1 --2- 172.21.15.81:0/1405957947 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80f8071f50 0x7f80f8114580 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:10.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.003+0000 7f80fe000700 1 -- 172.21.15.81:0/1405957947 >> 172.21.15.81:0/1405957947 conn(0x7f80f80f8530 msgr2=0x7f80f80f9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:10.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.003+0000 7f80fe000700 1 -- 172.21.15.81:0/1405957947 shutdown_connections 2024-04-23T14:51:10.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.003+0000 7f80fe000700 1 -- 172.21.15.81:0/1405957947 wait complete. 2024-04-23T14:51:10.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.183+0000 7f178d400700 1 -- 172.21.15.81:0/605248976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17880fe0e0 msgr2=0x7f17880fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:10.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.183+0000 7f178d400700 1 --2- 172.21.15.81:0/605248976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17880fe0e0 0x7f17880fe550 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1774004940 tx=0x7f1774009e30 comp rx=0 tx=0).stop 2024-04-23T14:51:10.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.184+0000 7f178d400700 1 -- 172.21.15.81:0/605248976 shutdown_connections 2024-04-23T14:51:10.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.184+0000 7f178d400700 1 --2- 172.21.15.81:0/605248976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17880fe0e0 0x7f17880fe550 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:10.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.184+0000 7f178d400700 1 --2- 172.21.15.81:0/605248976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17880fcef0 0x7f17880fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:10.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.184+0000 7f178d400700 1 -- 172.21.15.81:0/605248976 >> 172.21.15.81:0/605248976 conn(0x7f17880f8530 msgr2=0x7f17880fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:10.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.184+0000 7f178d400700 1 -- 172.21.15.81:0/605248976 shutdown_connections 2024-04-23T14:51:10.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.184+0000 7f178d400700 1 -- 172.21.15.81:0/605248976 wait complete. 2024-04-23T14:51:10.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.185+0000 7f178d400700 1 Processor -- start 2024-04-23T14:51:10.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.185+0000 7f178d400700 1 -- start start 2024-04-23T14:51:10.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.186+0000 7f178d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17880fcef0 0x7f1788114050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:10.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.186+0000 7f178d400700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17880fe0e0 0x7f1788114590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:10.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.186+0000 7f178d400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1788114b90 con 0x7f17880fcef0 2024-04-23T14:51:10.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.186+0000 7f178d400700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17881153e0 con 0x7f17880fe0e0 2024-04-23T14:51:10.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.186+0000 7f1786800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17880fcef0 0x7f1788114050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:10.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.186+0000 7f1786800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17880fcef0 0x7f1788114050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52046/0 (socket says 172.21.15.81:52046) 2024-04-23T14:51:10.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.186+0000 7f1786800700 1 -- 172.21.15.81:0/2115404547 learned_addr learned my addr 172.21.15.81:0/2115404547 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:51:10.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.186+0000 7f1785e00700 1 --2- 172.21.15.81:0/2115404547 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17880fe0e0 0x7f1788114590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:10.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.187+0000 7f1786800700 1 -- 172.21.15.81:0/2115404547 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17880fe0e0 msgr2=0x7f1788114590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:10.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.187+0000 7f1786800700 1 --2- 172.21.15.81:0/2115404547 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17880fe0e0 0x7f1788114590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:10.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.187+0000 7f1786800700 1 -- 172.21.15.81:0/2115404547 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1774005040 con 0x7f17880fcef0 2024-04-23T14:51:10.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.187+0000 7f1786800700 1 --2- 172.21.15.81:0/2115404547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17880fcef0 0x7f1788114050 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f177800c8b0 tx=0x7f1778004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:10.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.188+0000 7f177ea00700 1 -- 172.21.15.81:0/2115404547 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17780106f0 con 0x7f17880fcef0 2024-04-23T14:51:10.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.188+0000 7f177ea00700 1 -- 172.21.15.81:0/2115404547 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1778010d20 con 0x7f17880fcef0 2024-04-23T14:51:10.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.188+0000 7f177ea00700 1 -- 172.21.15.81:0/2115404547 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1778012e90 con 0x7f17880fcef0 2024-04-23T14:51:10.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.188+0000 7f178d400700 1 -- 172.21.15.81:0/2115404547 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17881156c0 con 0x7f17880fcef0 2024-04-23T14:51:10.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.188+0000 7f178d400700 1 -- 172.21.15.81:0/2115404547 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1788115bb0 con 0x7f17880fcef0 2024-04-23T14:51:10.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.190+0000 7f178d400700 1 -- 172.21.15.81:0/2115404547 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1788101a70 con 0x7f17880fcef0 2024-04-23T14:51:10.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.191+0000 7f177ea00700 1 -- 172.21.15.81:0/2115404547 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 31) v1 ==== 92569+0+0 (secure 0 0 0) 0x7f1778010850 con 0x7f17880fcef0 2024-04-23T14:51:10.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.192+0000 7f177ea00700 1 --2- 172.21.15.81:0/2115404547 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f176c06e620 0x7f176c070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:10.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.193+0000 7f1785e00700 1 --2- 172.21.15.81:0/2115404547 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f176c06e620 0x7f176c070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:10.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.193+0000 7f177ea00700 1 -- 172.21.15.81:0/2115404547 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f177808df80 con 0x7f17880fcef0 2024-04-23T14:51:10.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.194+0000 7f1785e00700 1 --2- 172.21.15.81:0/2115404547 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f176c06e620 0x7f176c070ad0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f177400b3b0 tx=0x7f1774009e30 comp rx=0 tx=0).ready entity=mgr.14738 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:10.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.201+0000 7f177ea00700 1 -- 172.21.15.81:0/2115404547 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f17780c2930 con 0x7f17880fcef0 2024-04-23T14:51:10.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:10 smithi156 ceph-mon[32341]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:51:10.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:10 smithi156 ceph-mon[32341]: from='client.14800 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:51:10.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:10 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/1405957947' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:51:10.330 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:10 smithi081 ceph-mon[25540]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:51:10.330 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:10 smithi081 ceph-mon[25540]: from='client.14800 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:51:10.331 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:10 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/1405957947' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:51:10.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.687+0000 7f178d400700 1 -- 172.21.15.81:0/2115404547 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f178805f5f0 con 0x7f17880fcef0 2024-04-23T14:51:10.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.690+0000 7f177ea00700 1 -- 172.21.15.81:0/2115404547 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1837 (secure 0 0 0) 0x7f177805b010 con 0x7f17880fcef0 2024-04-23T14:51:10.692 INFO:teuthology.orchestra.run.smithi081.stdout:e18 2024-04-23T14:51:10.692 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-23T14:51:10.692 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:51:10.693 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-04-23T14:51:10.693 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:51:10.693 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-04-23T14:51:10.693 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-04-23T14:51:10.693 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 17 2024-04-23T14:51:10.693 INFO:teuthology.orchestra.run.smithi081.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-23T14:51:10.693 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-04-23T14:45:51.264703+0000 2024-04-23T14:51:10.693 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-04-23T14:46:12.782992+0000 2024-04-23T14:51:10.693 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-04-23T14:51:10.693 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-04-23T14:51:10.693 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-04-23T14:51:10.693 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-04-23T14:51:10.693 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-04-23T14:51:10.693 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-04-23T14:51:10.693 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-04-23T14:51:10.694 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 47 2024-04-23T14:51:10.694 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:51:10.694 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 1 2024-04-23T14:51:10.694 INFO:teuthology.orchestra.run.smithi081.stdout:in 0 2024-04-23T14:51:10.694 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=14472} 2024-04-23T14:51:10.694 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-04-23T14:51:10.694 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-04-23T14:51:10.694 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-04-23T14:51:10.694 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-04-23T14:51:10.694 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-04-23T14:51:10.694 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-04-23T14:51:10.694 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-04-23T14:51:10.694 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-04-23T14:51:10.694 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.vcoywg{0:14472} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.81:6828/2563365650,v1:172.21.15.81:6829/2563365650] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:51:10.695 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.wydgcg{0:14482} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.81:6826/759909104,v1:172.21.15.81:6827/759909104] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:51:10.695 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:51:10.695 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:51:10.695 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-04-23T14:51:10.695 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:51:10.695 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.vynkxn{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.156:6826/1794690362,v1:172.21.15.156:6827/1794690362] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:51:10.695 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.rhbtxt{-1:24263} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.156:6824/3854041261,v1:172.21.15.156:6825/3854041261] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:51:10.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.693+0000 7f178d400700 1 -- 172.21.15.81:0/2115404547 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f176c06e620 msgr2=0x7f176c070ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:10.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.693+0000 7f178d400700 1 --2- 172.21.15.81:0/2115404547 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f176c06e620 0x7f176c070ad0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f177400b3b0 tx=0x7f1774009e30 comp rx=0 tx=0).stop 2024-04-23T14:51:10.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.693+0000 7f178d400700 1 -- 172.21.15.81:0/2115404547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17880fcef0 msgr2=0x7f1788114050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:10.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.693+0000 7f178d400700 1 --2- 172.21.15.81:0/2115404547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17880fcef0 0x7f1788114050 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f177800c8b0 tx=0x7f1778004470 comp rx=0 tx=0).stop 2024-04-23T14:51:10.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.694+0000 7f178d400700 1 -- 172.21.15.81:0/2115404547 shutdown_connections 2024-04-23T14:51:10.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.694+0000 7f178d400700 1 --2- 172.21.15.81:0/2115404547 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f176c06e620 0x7f176c070ad0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:10.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.694+0000 7f178d400700 1 --2- 172.21.15.81:0/2115404547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17880fcef0 0x7f1788114050 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:10.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.694+0000 7f178d400700 1 --2- 172.21.15.81:0/2115404547 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17880fe0e0 0x7f1788114590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:10.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.694+0000 7f178d400700 1 -- 172.21.15.81:0/2115404547 >> 172.21.15.81:0/2115404547 conn(0x7f17880f8530 msgr2=0x7f17880f9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:10.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.694+0000 7f178d400700 1 -- 172.21.15.81:0/2115404547 shutdown_connections 2024-04-23T14:51:10.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.694+0000 7f178d400700 1 -- 172.21.15.81:0/2115404547 wait complete. 2024-04-23T14:51:10.702 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 18 2024-04-23T14:51:10.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.915+0000 7fda8b200700 1 -- 172.21.15.81:0/2556748555 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda841002d0 msgr2=0x7fda84100740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:10.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.915+0000 7fda8b200700 1 --2- 172.21.15.81:0/2556748555 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda841002d0 0x7fda84100740 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fda70004940 tx=0x7fda70009e30 comp rx=0 tx=0).stop 2024-04-23T14:51:10.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.915+0000 7fda8b200700 1 -- 172.21.15.81:0/2556748555 shutdown_connections 2024-04-23T14:51:10.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.915+0000 7fda8b200700 1 --2- 172.21.15.81:0/2556748555 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda841002d0 0x7fda84100740 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:10.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.915+0000 7fda8b200700 1 --2- 172.21.15.81:0/2556748555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda840ff020 0x7fda840ff430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:10.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.915+0000 7fda8b200700 1 -- 172.21.15.81:0/2556748555 >> 172.21.15.81:0/2556748555 conn(0x7fda840fa950 msgr2=0x7fda840fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:10.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.915+0000 7fda8b200700 1 -- 172.21.15.81:0/2556748555 shutdown_connections 2024-04-23T14:51:10.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.915+0000 7fda8b200700 1 -- 172.21.15.81:0/2556748555 wait complete. 2024-04-23T14:51:10.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.916+0000 7fda8b200700 1 Processor -- start 2024-04-23T14:51:10.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.916+0000 7fda8b200700 1 -- start start 2024-04-23T14:51:10.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.916+0000 7fda8b200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda840ff020 0x7fda8406fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:10.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.916+0000 7fda8b200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda841002d0 0x7fda8406e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:10.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.916+0000 7fda8b200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8406e960 con 0x7fda841002d0 2024-04-23T14:51:10.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.916+0000 7fda8b200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8406ead0 con 0x7fda840ff020 2024-04-23T14:51:10.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.917+0000 7fda83400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda841002d0 0x7fda8406e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:10.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.917+0000 7fda83400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda841002d0 0x7fda8406e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52072/0 (socket says 172.21.15.81:52072) 2024-04-23T14:51:10.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.917+0000 7fda83400700 1 -- 172.21.15.81:0/346281720 learned_addr learned my addr 172.21.15.81:0/346281720 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:51:10.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.917+0000 7fda83e00700 1 --2- 172.21.15.81:0/346281720 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda840ff020 0x7fda8406fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:10.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.917+0000 7fda83400700 1 -- 172.21.15.81:0/346281720 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda840ff020 msgr2=0x7fda8406fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:10.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.917+0000 7fda83400700 1 --2- 172.21.15.81:0/346281720 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda840ff020 0x7fda8406fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:10.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.917+0000 7fda83400700 1 -- 172.21.15.81:0/346281720 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda70005040 con 0x7fda841002d0 2024-04-23T14:51:10.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.918+0000 7fda83400700 1 --2- 172.21.15.81:0/346281720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda841002d0 0x7fda8406e360 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fda70013870 tx=0x7fda70009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:10.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.918+0000 7fda7be00700 1 -- 172.21.15.81:0/346281720 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda7000e040 con 0x7fda841002d0 2024-04-23T14:51:10.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.918+0000 7fda8b200700 1 -- 172.21.15.81:0/346281720 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda8406ed50 con 0x7fda841002d0 2024-04-23T14:51:10.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.918+0000 7fda8b200700 1 -- 172.21.15.81:0/346281720 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda8411df80 con 0x7fda841002d0 2024-04-23T14:51:10.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.918+0000 7fda7be00700 1 -- 172.21.15.81:0/346281720 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fda70013c20 con 0x7fda841002d0 2024-04-23T14:51:10.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.918+0000 7fda7be00700 1 -- 172.21.15.81:0/346281720 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda700123c0 con 0x7fda841002d0 2024-04-23T14:51:10.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.920+0000 7fda79600700 1 -- 172.21.15.81:0/346281720 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda5c0052b0 con 0x7fda841002d0 2024-04-23T14:51:10.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.923+0000 7fda7be00700 1 -- 172.21.15.81:0/346281720 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 31) v1 ==== 92569+0+0 (secure 0 0 0) 0x7fda7000b340 con 0x7fda841002d0 2024-04-23T14:51:10.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.924+0000 7fda7be00700 1 --2- 172.21.15.81:0/346281720 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7fda6806e700 0x7fda68070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:10.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.924+0000 7fda7be00700 1 -- 172.21.15.81:0/346281720 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fda7008f090 con 0x7fda841002d0 2024-04-23T14:51:10.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.926+0000 7fda83e00700 1 --2- 172.21.15.81:0/346281720 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7fda6806e700 0x7fda68070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:10.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.927+0000 7fda83e00700 1 --2- 172.21.15.81:0/346281720 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7fda6806e700 0x7fda68070bb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fda74004600 tx=0x7fda7400b040 comp rx=0 tx=0).ready entity=mgr.14738 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:10.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:10.929+0000 7fda7be00700 1 -- 172.21.15.81:0/346281720 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7fda7005c100 con 0x7fda841002d0 2024-04-23T14:51:11.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:11 smithi156 ceph-mon[32341]: from='client.14804 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:51:11.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:11 smithi156 ceph-mon[32341]: pgmap v10: 65 pgs: 65 active+clean; 330 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 707 op/s 2024-04-23T14:51:11.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:11 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:51:11.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:11 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/2115404547' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:51:11.307 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:11 smithi081 ceph-mon[25540]: from='client.14804 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:51:11.307 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:11 smithi081 ceph-mon[25540]: pgmap v10: 65 pgs: 65 active+clean; 330 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 707 op/s 2024-04-23T14:51:11.307 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:11 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:51:11.307 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:11 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/2115404547' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:51:11.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.306+0000 7fda79600700 1 -- 172.21.15.81:0/346281720 --> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fda5c000bc0 con 0x7fda6806e700 2024-04-23T14:51:11.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.307+0000 7fda7be00700 1 -- 172.21.15.81:0/346281720 <== mgr.14738 v2:172.21.15.81:6800/1880997914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fda5c000bc0 con 0x7fda6806e700 2024-04-23T14:51:11.309 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:51:11.309 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd", 2024-04-23T14:51:11.309 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-04-23T14:51:11.309 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-23T14:51:11.309 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [ 2024-04-23T14:51:11.309 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr" 2024-04-23T14:51:11.309 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-04-23T14:51:11.309 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "2/21 daemons upgraded", 2024-04-23T14:51:11.309 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "", 2024-04-23T14:51:11.309 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-04-23T14:51:11.309 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:51:11.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.310+0000 7fda79600700 1 -- 172.21.15.81:0/346281720 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7fda6806e700 msgr2=0x7fda68070bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:11.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.310+0000 7fda79600700 1 --2- 172.21.15.81:0/346281720 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7fda6806e700 0x7fda68070bb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fda74004600 tx=0x7fda7400b040 comp rx=0 tx=0).stop 2024-04-23T14:51:11.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.310+0000 7fda79600700 1 -- 172.21.15.81:0/346281720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda841002d0 msgr2=0x7fda8406e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:11.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.310+0000 7fda79600700 1 --2- 172.21.15.81:0/346281720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda841002d0 0x7fda8406e360 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fda70013870 tx=0x7fda70009e30 comp rx=0 tx=0).stop 2024-04-23T14:51:11.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.310+0000 7fda79600700 1 -- 172.21.15.81:0/346281720 shutdown_connections 2024-04-23T14:51:11.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.310+0000 7fda79600700 1 --2- 172.21.15.81:0/346281720 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7fda6806e700 0x7fda68070bb0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:11.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.310+0000 7fda79600700 1 --2- 172.21.15.81:0/346281720 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda840ff020 0x7fda8406fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:11.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.310+0000 7fda79600700 1 --2- 172.21.15.81:0/346281720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda841002d0 0x7fda8406e360 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:11.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.310+0000 7fda79600700 1 -- 172.21.15.81:0/346281720 >> 172.21.15.81:0/346281720 conn(0x7fda840fa950 msgr2=0x7fda840fceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:11.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.311+0000 7fda79600700 1 -- 172.21.15.81:0/346281720 shutdown_connections 2024-04-23T14:51:11.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.311+0000 7fda79600700 1 -- 172.21.15.81:0/346281720 wait complete. 2024-04-23T14:51:11.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.514+0000 7f3b2f400700 1 -- 172.21.15.81:0/260776713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b280fdd60 msgr2=0x7f3b281001e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:11.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.514+0000 7f3b2f400700 1 --2- 172.21.15.81:0/260776713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b280fdd60 0x7f3b281001e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f3b14004940 tx=0x7f3b14009e30 comp rx=0 tx=0).stop 2024-04-23T14:51:11.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.514+0000 7f3b2f400700 1 -- 172.21.15.81:0/260776713 shutdown_connections 2024-04-23T14:51:11.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.514+0000 7f3b2f400700 1 --2- 172.21.15.81:0/260776713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b280fdd60 0x7f3b281001e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:11.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.514+0000 7f3b2f400700 1 --2- 172.21.15.81:0/260776713 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b280662f0 0x7f3b280fd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:11.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.514+0000 7f3b2f400700 1 -- 172.21.15.81:0/260776713 >> 172.21.15.81:0/260776713 conn(0x7f3b280f74c0 msgr2=0x7f3b280f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:11.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.515+0000 7f3b2f400700 1 -- 172.21.15.81:0/260776713 shutdown_connections 2024-04-23T14:51:11.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.515+0000 7f3b2f400700 1 -- 172.21.15.81:0/260776713 wait complete. 2024-04-23T14:51:11.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.516+0000 7f3b2f400700 1 Processor -- start 2024-04-23T14:51:11.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.516+0000 7f3b2f400700 1 -- start start 2024-04-23T14:51:11.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.517+0000 7f3b2f400700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b280662f0 0x7f3b28113ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:11.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.517+0000 7f3b2f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b280fdd60 0x7f3b28114530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:11.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.517+0000 7f3b2f400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b28114b30 con 0x7f3b280fdd60 2024-04-23T14:51:11.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.517+0000 7f3b2f400700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b28115330 con 0x7f3b280662f0 2024-04-23T14:51:11.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.517+0000 7f3b2ca00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b280662f0 0x7f3b28113ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:11.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.517+0000 7f3b2ca00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b280662f0 0x7f3b28113ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.81:42148/0 (socket says 172.21.15.81:42148) 2024-04-23T14:51:11.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.517+0000 7f3b2ca00700 1 -- 172.21.15.81:0/931296834 learned_addr learned my addr 172.21.15.81:0/931296834 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:51:11.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.517+0000 7f3b27e00700 1 --2- 172.21.15.81:0/931296834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b280fdd60 0x7f3b28114530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:11.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.518+0000 7f3b2ca00700 1 -- 172.21.15.81:0/931296834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b280fdd60 msgr2=0x7f3b28114530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:11.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.518+0000 7f3b2ca00700 1 --2- 172.21.15.81:0/931296834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b280fdd60 0x7f3b28114530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:11.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.518+0000 7f3b2ca00700 1 -- 172.21.15.81:0/931296834 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b14005040 con 0x7f3b280662f0 2024-04-23T14:51:11.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.518+0000 7f3b2ca00700 1 --2- 172.21.15.81:0/931296834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b280662f0 0x7f3b28113ff0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c00eb40 tx=0x7f3b1c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:11.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.519+0000 7f3b24c00700 1 -- 172.21.15.81:0/931296834 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b1c007cc0 con 0x7f3b280662f0 2024-04-23T14:51:11.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.519+0000 7f3b2f400700 1 -- 172.21.15.81:0/931296834 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b281155b0 con 0x7f3b280662f0 2024-04-23T14:51:11.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.519+0000 7f3b2f400700 1 -- 172.21.15.81:0/931296834 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b28115af0 con 0x7f3b280662f0 2024-04-23T14:51:11.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.519+0000 7f3b24c00700 1 -- 172.21.15.81:0/931296834 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3b1c00f040 con 0x7f3b280662f0 2024-04-23T14:51:11.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.519+0000 7f3b24c00700 1 -- 172.21.15.81:0/931296834 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b1c00c950 con 0x7f3b280662f0 2024-04-23T14:51:11.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.521+0000 7f3b2f400700 1 -- 172.21.15.81:0/931296834 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b080052e0 con 0x7f3b280662f0 2024-04-23T14:51:11.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.523+0000 7f3b24c00700 1 -- 172.21.15.81:0/931296834 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 31) v1 ==== 92569+0+0 (secure 0 0 0) 0x7f3b1c00cab0 con 0x7f3b280662f0 2024-04-23T14:51:11.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.524+0000 7f3b24c00700 1 --2- 172.21.15.81:0/931296834 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f3b1006e670 0x7f3b10070b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:11.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.524+0000 7f3b24c00700 1 -- 172.21.15.81:0/931296834 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f3b1c08dcb0 con 0x7f3b280662f0 2024-04-23T14:51:11.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.524+0000 7f3b27e00700 1 --2- 172.21.15.81:0/931296834 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f3b1006e670 0x7f3b10070b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:11.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.525+0000 7f3b27e00700 1 --2- 172.21.15.81:0/931296834 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f3b1006e670 0x7f3b10070b20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3b14009fd0 tx=0x7f3b14009e30 comp rx=0 tx=0).ready entity=mgr.14738 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:11.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.533+0000 7f3b24c00700 1 -- 172.21.15.81:0/931296834 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f3b1c05ad20 con 0x7f3b280662f0 2024-04-23T14:51:11.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.972+0000 7f3b2f400700 1 -- 172.21.15.81:0/931296834 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f3b08005860 con 0x7f3b280662f0 2024-04-23T14:51:11.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.973+0000 7f3b24c00700 1 -- 172.21.15.81:0/931296834 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f3b1c05a8b0 con 0x7f3b280662f0 2024-04-23T14:51:11.974 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-04-23T14:51:11.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.977+0000 7f3b2f400700 1 -- 172.21.15.81:0/931296834 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f3b1006e670 msgr2=0x7f3b10070b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:11.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.977+0000 7f3b2f400700 1 --2- 172.21.15.81:0/931296834 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f3b1006e670 0x7f3b10070b20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3b14009fd0 tx=0x7f3b14009e30 comp rx=0 tx=0).stop 2024-04-23T14:51:11.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.977+0000 7f3b2f400700 1 -- 172.21.15.81:0/931296834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b280662f0 msgr2=0x7f3b28113ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:11.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.977+0000 7f3b2f400700 1 --2- 172.21.15.81:0/931296834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b280662f0 0x7f3b28113ff0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c00eb40 tx=0x7f3b1c00b040 comp rx=0 tx=0).stop 2024-04-23T14:51:11.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.977+0000 7f3b2f400700 1 -- 172.21.15.81:0/931296834 shutdown_connections 2024-04-23T14:51:11.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.977+0000 7f3b2f400700 1 --2- 172.21.15.81:0/931296834 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f3b1006e670 0x7f3b10070b20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:11.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.977+0000 7f3b2f400700 1 --2- 172.21.15.81:0/931296834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b280662f0 0x7f3b28113ff0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:11.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.977+0000 7f3b2f400700 1 --2- 172.21.15.81:0/931296834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b280fdd60 0x7f3b28114530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:11.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.977+0000 7f3b2f400700 1 -- 172.21.15.81:0/931296834 >> 172.21.15.81:0/931296834 conn(0x7f3b280f74c0 msgr2=0x7f3b280f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:11.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.977+0000 7f3b2f400700 1 -- 172.21.15.81:0/931296834 shutdown_connections 2024-04-23T14:51:11.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:11.977+0000 7f3b2f400700 1 -- 172.21.15.81:0/931296834 wait complete. 2024-04-23T14:51:12.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:12 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/931296834' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:51:12.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:12 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/931296834' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:51:13.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:13 smithi081 ceph-mon[25540]: from='client.14816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:51:13.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:13 smithi081 ceph-mon[25540]: pgmap v11: 65 pgs: 65 active+clean; 330 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 707 op/s 2024-04-23T14:51:13.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:13 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:13.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:13 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:13.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:13 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:51:13.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:13 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:51:13.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:13 smithi156 ceph-mon[32341]: from='client.14816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:51:13.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:13 smithi156 ceph-mon[32341]: pgmap v11: 65 pgs: 65 active+clean; 330 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 707 op/s 2024-04-23T14:51:13.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:13 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:13.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:13 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:13.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:13 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:51:13.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:13 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:51:14.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:14 smithi081 ceph-mon[25540]: Updating smithi081:/etc/ceph/ceph.conf 2024-04-23T14:51:14.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:14 smithi081 ceph-mon[25540]: Updating smithi156:/etc/ceph/ceph.conf 2024-04-23T14:51:14.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:14 smithi156 ceph-mon[32341]: Updating smithi081:/etc/ceph/ceph.conf 2024-04-23T14:51:14.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:14 smithi156 ceph-mon[32341]: Updating smithi156:/etc/ceph/ceph.conf 2024-04-23T14:51:15.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:15 smithi081 ceph-mon[25540]: Updating smithi081:/var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:51:15.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:15 smithi081 ceph-mon[25540]: Updating smithi156:/var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:51:15.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:15 smithi081 ceph-mon[25540]: pgmap v12: 65 pgs: 65 active+clean; 313 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 1.00k op/s 2024-04-23T14:51:15.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:15 smithi081 ceph-mon[25540]: Updating smithi156:/etc/ceph/ceph.client.admin.keyring 2024-04-23T14:51:15.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:15 smithi081 ceph-mon[25540]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-04-23T14:51:15.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:15 smithi156 ceph-mon[32341]: Updating smithi081:/var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:51:15.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:15 smithi156 ceph-mon[32341]: Updating smithi156:/var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:51:15.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:15 smithi156 ceph-mon[32341]: pgmap v12: 65 pgs: 65 active+clean; 313 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 1.00k op/s 2024-04-23T14:51:15.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:15 smithi156 ceph-mon[32341]: Updating smithi156:/etc/ceph/ceph.client.admin.keyring 2024-04-23T14:51:15.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:15 smithi156 ceph-mon[32341]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-04-23T14:51:16.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:16 smithi081 ceph-mon[25540]: Updating smithi156:/var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T14:51:16.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:16 smithi081 ceph-mon[25540]: Updating smithi081:/var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T14:51:16.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:16 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:16.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:16 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:16.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:16 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:16.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:16 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:16.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:16 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:16.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:16 smithi156 ceph-mon[32341]: Updating smithi156:/var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T14:51:16.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:16 smithi156 ceph-mon[32341]: Updating smithi081:/var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T14:51:16.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:16 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:16.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:16 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:16.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:16 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:16.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:16 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:16.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:16 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:17.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:17 smithi081 ceph-mon[25540]: pgmap v13: 65 pgs: 65 active+clean; 313 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 875 op/s 2024-04-23T14:51:17.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:17 smithi081 ceph-mon[25540]: Reconfiguring prometheus.smithi081 (dependencies changed)... 2024-04-23T14:51:17.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:17 smithi081 ceph-mon[25540]: Reconfiguring daemon prometheus.smithi081 on smithi081 2024-04-23T14:51:17.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:17 smithi156 ceph-mon[32341]: pgmap v13: 65 pgs: 65 active+clean; 313 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 875 op/s 2024-04-23T14:51:17.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:17 smithi156 ceph-mon[32341]: Reconfiguring prometheus.smithi081 (dependencies changed)... 2024-04-23T14:51:17.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:17 smithi156 ceph-mon[32341]: Reconfiguring daemon prometheus.smithi081 on smithi081 2024-04-23T14:51:19.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:19 smithi081 ceph-mon[25540]: pgmap v14: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 1.23k op/s 2024-04-23T14:51:19.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:19 smithi156 ceph-mon[32341]: pgmap v14: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 1.23k op/s 2024-04-23T14:51:21.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:21 smithi081 ceph-mon[25540]: pgmap v15: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 709 op/s 2024-04-23T14:51:21.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:21 smithi156 ceph-mon[32341]: pgmap v15: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 709 op/s 2024-04-23T14:51:23.510 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:23 smithi081 ceph-mon[25540]: pgmap v16: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 729 op/s 2024-04-23T14:51:23.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:23 smithi156 ceph-mon[32341]: pgmap v16: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 729 op/s 2024-04-23T14:51:25.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:25 smithi156 ceph-mon[32341]: pgmap v17: 65 pgs: 65 active+clean; 288 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 885 op/s 2024-04-23T14:51:25.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:25 smithi081 ceph-mon[25540]: pgmap v17: 65 pgs: 65 active+clean; 288 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 885 op/s 2024-04-23T14:51:26.247 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:26 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:51:26.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:26 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:51:27.362 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:27 smithi081 ceph-mon[25540]: pgmap v18: 65 pgs: 65 active+clean; 288 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 533 op/s 2024-04-23T14:51:27.438 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:27 smithi156 ceph-mon[32341]: pgmap v18: 65 pgs: 65 active+clean; 288 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 533 op/s 2024-04-23T14:51:29.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:29 smithi156 ceph-mon[32341]: pgmap v19: 65 pgs: 65 active+clean; 281 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 653 op/s 2024-04-23T14:51:29.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:29 smithi081 ceph-mon[25540]: pgmap v19: 65 pgs: 65 active+clean; 281 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 653 op/s 2024-04-23T14:51:31.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:31 smithi156 ceph-mon[32341]: pgmap v20: 65 pgs: 65 active+clean; 281 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 296 op/s 2024-04-23T14:51:31.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:31 smithi081 ceph-mon[25540]: pgmap v20: 65 pgs: 65 active+clean; 281 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 296 op/s 2024-04-23T14:51:33.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:33 smithi156 ceph-mon[32341]: pgmap v21: 65 pgs: 65 active+clean; 283 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 348 op/s 2024-04-23T14:51:33.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:33 smithi081 ceph-mon[25540]: pgmap v21: 65 pgs: 65 active+clean; 283 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 348 op/s 2024-04-23T14:51:35.388 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:35 smithi156 ceph-mon[32341]: pgmap v22: 65 pgs: 65 active+clean; 275 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 576 op/s 2024-04-23T14:51:35.388 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:35 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:35.388 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:35 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:35.388 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:35 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-23T14:51:35.388 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:35 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:51:35.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:35 smithi081 ceph-mon[25540]: pgmap v22: 65 pgs: 65 active+clean; 275 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 576 op/s 2024-04-23T14:51:35.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:35 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:35.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:35 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:35.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:35 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-23T14:51:35.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:35 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:51:36.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:36 smithi156 ceph-mon[32341]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-23T14:51:36.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:36 smithi081 ceph-mon[25540]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-23T14:51:37.522 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:37 smithi156 ceph-mon[32341]: pgmap v23: 65 pgs: 65 active+clean; 275 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 421 op/s 2024-04-23T14:51:37.523 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:37 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi156.ounwyj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-23T14:51:37.523 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:37 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-23T14:51:37.523 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:37 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:51:37.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:37 smithi081 ceph-mon[25540]: pgmap v23: 65 pgs: 65 active+clean; 275 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 421 op/s 2024-04-23T14:51:37.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:37 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi156.ounwyj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-23T14:51:37.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:37 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-23T14:51:37.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:37 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:51:38.481 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:38 smithi156 ceph-mon[32341]: Upgrade: Updating mgr.smithi156.ounwyj 2024-04-23T14:51:38.481 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:38 smithi156 ceph-mon[32341]: Deploying daemon mgr.smithi156.ounwyj on smithi156 2024-04-23T14:51:38.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:38 smithi081 ceph-mon[25540]: Upgrade: Updating mgr.smithi156.ounwyj 2024-04-23T14:51:38.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:38 smithi081 ceph-mon[25540]: Deploying daemon mgr.smithi156.ounwyj on smithi156 2024-04-23T14:51:39.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:39 smithi156 ceph-mon[32341]: pgmap v24: 65 pgs: 65 active+clean; 266 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 568 op/s 2024-04-23T14:51:39.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:39 smithi081 ceph-mon[25540]: pgmap v24: 65 pgs: 65 active+clean; 266 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 568 op/s 2024-04-23T14:51:41.448 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:41 smithi156 ceph-mon[32341]: pgmap v25: 65 pgs: 65 active+clean; 266 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 447 op/s 2024-04-23T14:51:41.448 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:41 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:51:41.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:41 smithi081 ceph-mon[25540]: pgmap v25: 65 pgs: 65 active+clean; 266 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 447 op/s 2024-04-23T14:51:41.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:41 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:51:42.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.183+0000 7f1037200700 1 -- 172.21.15.81:0/3640832705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10300fe0e0 msgr2=0x7f10300fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:42.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.183+0000 7f1037200700 1 --2- 172.21.15.81:0/3640832705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10300fe0e0 0x7f10300fe550 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1020004880 tx=0x7f1020009e30 comp rx=0 tx=0).stop 2024-04-23T14:51:42.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.183+0000 7f1037200700 1 -- 172.21.15.81:0/3640832705 shutdown_connections 2024-04-23T14:51:42.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.183+0000 7f1037200700 1 --2- 172.21.15.81:0/3640832705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10300fe0e0 0x7f10300fe550 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:42.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.183+0000 7f1037200700 1 --2- 172.21.15.81:0/3640832705 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10300fcef0 0x7f10300fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:42.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.183+0000 7f1037200700 1 -- 172.21.15.81:0/3640832705 >> 172.21.15.81:0/3640832705 conn(0x7f10300f8530 msgr2=0x7f10300fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:42.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.184+0000 7f1037200700 1 -- 172.21.15.81:0/3640832705 shutdown_connections 2024-04-23T14:51:42.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.184+0000 7f1037200700 1 -- 172.21.15.81:0/3640832705 wait complete. 2024-04-23T14:51:42.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.185+0000 7f1037200700 1 Processor -- start 2024-04-23T14:51:42.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.185+0000 7f1037200700 1 -- start start 2024-04-23T14:51:42.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.186+0000 7f1037200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10300fcef0 0x7f103010b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:42.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.186+0000 7f1037200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f103010beb0 0x7f103010cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:42.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.186+0000 7f1037200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103010c370 con 0x7f103010beb0 2024-04-23T14:51:42.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.186+0000 7f1037200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103010c4e0 con 0x7f10300fcef0 2024-04-23T14:51:42.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.186+0000 7f102f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f103010beb0 0x7f103010cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:42.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.186+0000 7f102f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f103010beb0 0x7f103010cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49894/0 (socket says 172.21.15.81:49894) 2024-04-23T14:51:42.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.186+0000 7f102f400700 1 -- 172.21.15.81:0/2308323281 learned_addr learned my addr 172.21.15.81:0/2308323281 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:51:42.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.187+0000 7f102f400700 1 -- 172.21.15.81:0/2308323281 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10300fcef0 msgr2=0x7f103010b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:42.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.187+0000 7f102f400700 1 --2- 172.21.15.81:0/2308323281 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10300fcef0 0x7f103010b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:42.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.187+0000 7f102f400700 1 -- 172.21.15.81:0/2308323281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1020005040 con 0x7f103010beb0 2024-04-23T14:51:42.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.187+0000 7f102f400700 1 --2- 172.21.15.81:0/2308323281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f103010beb0 0x7f103010cd50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1020000c00 tx=0x7f1020009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:42.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.188+0000 7f1027e00700 1 -- 172.21.15.81:0/2308323281 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f102000e030 con 0x7f103010beb0 2024-04-23T14:51:42.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.188+0000 7f1037200700 1 -- 172.21.15.81:0/2308323281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f103010d350 con 0x7f103010beb0 2024-04-23T14:51:42.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.188+0000 7f1037200700 1 -- 172.21.15.81:0/2308323281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f103010d8c0 con 0x7f103010beb0 2024-04-23T14:51:42.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.188+0000 7f1027e00700 1 -- 172.21.15.81:0/2308323281 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1020013e90 con 0x7f103010beb0 2024-04-23T14:51:42.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.188+0000 7f1027e00700 1 -- 172.21.15.81:0/2308323281 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f102001ce30 con 0x7f103010beb0 2024-04-23T14:51:42.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.190+0000 7f1037200700 1 -- 172.21.15.81:0/2308323281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10100052e0 con 0x7f103010beb0 2024-04-23T14:51:42.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.191+0000 7f1027e00700 1 -- 172.21.15.81:0/2308323281 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 31) v1 ==== 92569+0+0 (secure 0 0 0) 0x7f102001c690 con 0x7f103010beb0 2024-04-23T14:51:42.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.192+0000 7f1027e00700 1 --2- 172.21.15.81:0/2308323281 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f101406e670 0x7f1014070b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:42.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.192+0000 7f1027e00700 1 -- 172.21.15.81:0/2308323281 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f102008fa50 con 0x7f103010beb0 2024-04-23T14:51:42.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.193+0000 7f102fe00700 1 --2- 172.21.15.81:0/2308323281 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f101406e670 0x7f1014070b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:42.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.194+0000 7f102fe00700 1 --2- 172.21.15.81:0/2308323281 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f101406e670 0x7f1014070b20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f103010b700 tx=0x7f101c00b040 comp rx=0 tx=0).ready entity=mgr.14738 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:42.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.206+0000 7f1027e00700 1 -- 172.21.15.81:0/2308323281 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f1020058ee0 con 0x7f103010beb0 2024-04-23T14:51:42.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.533+0000 7f1037200700 1 -- 172.21.15.81:0/2308323281 --> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1010000bf0 con 0x7f101406e670 2024-04-23T14:51:42.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.535+0000 7f1027e00700 1 -- 172.21.15.81:0/2308323281 <== mgr.14738 v2:172.21.15.81:6800/1880997914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7f1010000bf0 con 0x7f101406e670 2024-04-23T14:51:42.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.539+0000 7f1037200700 1 -- 172.21.15.81:0/2308323281 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f101406e670 msgr2=0x7f1014070b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:42.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.539+0000 7f1037200700 1 --2- 172.21.15.81:0/2308323281 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f101406e670 0x7f1014070b20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f103010b700 tx=0x7f101c00b040 comp rx=0 tx=0).stop 2024-04-23T14:51:42.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.539+0000 7f1037200700 1 -- 172.21.15.81:0/2308323281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f103010beb0 msgr2=0x7f103010cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:42.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.539+0000 7f1037200700 1 --2- 172.21.15.81:0/2308323281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f103010beb0 0x7f103010cd50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1020000c00 tx=0x7f1020009e30 comp rx=0 tx=0).stop 2024-04-23T14:51:42.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.539+0000 7f1037200700 1 -- 172.21.15.81:0/2308323281 shutdown_connections 2024-04-23T14:51:42.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.539+0000 7f1037200700 1 --2- 172.21.15.81:0/2308323281 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f101406e670 0x7f1014070b20 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:42.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.539+0000 7f1037200700 1 --2- 172.21.15.81:0/2308323281 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10300fcef0 0x7f103010b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:42.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.539+0000 7f1037200700 1 --2- 172.21.15.81:0/2308323281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f103010beb0 0x7f103010cd50 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:42.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.539+0000 7f1037200700 1 -- 172.21.15.81:0/2308323281 >> 172.21.15.81:0/2308323281 conn(0x7f10300f8530 msgr2=0x7f10300f9db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:42.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.539+0000 7f1037200700 1 -- 172.21.15.81:0/2308323281 shutdown_connections 2024-04-23T14:51:42.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.539+0000 7f1037200700 1 -- 172.21.15.81:0/2308323281 wait complete. 2024-04-23T14:51:42.557 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-04-23T14:51:42.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.724+0000 7ffbca000700 1 -- 172.21.15.81:0/2818383962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbc40708f0 msgr2=0x7ffbc4070d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:42.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.724+0000 7ffbca000700 1 --2- 172.21.15.81:0/2818383962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbc40708f0 0x7ffbc4070d60 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0004940 tx=0x7ffbb0009e30 comp rx=0 tx=0).stop 2024-04-23T14:51:42.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.724+0000 7ffbca000700 1 -- 172.21.15.81:0/2818383962 shutdown_connections 2024-04-23T14:51:42.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.724+0000 7ffbca000700 1 --2- 172.21.15.81:0/2818383962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbc40708f0 0x7ffbc4070d60 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:42.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.724+0000 7ffbca000700 1 --2- 172.21.15.81:0/2818383962 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbc4071ea0 0x7ffbc40703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:42.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.724+0000 7ffbca000700 1 -- 172.21.15.81:0/2818383962 >> 172.21.15.81:0/2818383962 conn(0x7ffbc40f8530 msgr2=0x7ffbc40fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:42.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.725+0000 7ffbca000700 1 -- 172.21.15.81:0/2818383962 shutdown_connections 2024-04-23T14:51:42.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.725+0000 7ffbca000700 1 -- 172.21.15.81:0/2818383962 wait complete. 2024-04-23T14:51:42.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.726+0000 7ffbca000700 1 Processor -- start 2024-04-23T14:51:42.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.726+0000 7ffbca000700 1 -- start start 2024-04-23T14:51:42.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.726+0000 7ffbca000700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbc40708f0 0x7ffbc406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:42.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.726+0000 7ffbca000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbc4071ea0 0x7ffbc406e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:42.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.726+0000 7ffbca000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc406ff80 con 0x7ffbc4071ea0 2024-04-23T14:51:42.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.726+0000 7ffbca000700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc406edc0 con 0x7ffbc40708f0 2024-04-23T14:51:42.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.727+0000 7ffbc3400700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbc40708f0 0x7ffbc406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:42.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.727+0000 7ffbc2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbc4071ea0 0x7ffbc406e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:42.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.727+0000 7ffbc2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbc4071ea0 0x7ffbc406e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49914/0 (socket says 172.21.15.81:49914) 2024-04-23T14:51:42.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.727+0000 7ffbc2a00700 1 -- 172.21.15.81:0/831263078 learned_addr learned my addr 172.21.15.81:0/831263078 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:51:42.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.727+0000 7ffbc2a00700 1 -- 172.21.15.81:0/831263078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbc40708f0 msgr2=0x7ffbc406e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:42.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.727+0000 7ffbc2a00700 1 --2- 172.21.15.81:0/831263078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbc40708f0 0x7ffbc406e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:42.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.727+0000 7ffbc2a00700 1 -- 172.21.15.81:0/831263078 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb0005040 con 0x7ffbc4071ea0 2024-04-23T14:51:42.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.728+0000 7ffbc2a00700 1 --2- 172.21.15.81:0/831263078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbc4071ea0 0x7ffbc406e880 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0000c00 tx=0x7ffbb0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:42.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.728+0000 7ffbbb400700 1 -- 172.21.15.81:0/831263078 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbb000e040 con 0x7ffbc4071ea0 2024-04-23T14:51:42.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.728+0000 7ffbbb400700 1 -- 172.21.15.81:0/831263078 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffbb0013bc0 con 0x7ffbc4071ea0 2024-04-23T14:51:42.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.728+0000 7ffbbb400700 1 -- 172.21.15.81:0/831263078 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbb0012600 con 0x7ffbc4071ea0 2024-04-23T14:51:42.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.728+0000 7ffbca000700 1 -- 172.21.15.81:0/831263078 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbc406f040 con 0x7ffbc4071ea0 2024-04-23T14:51:42.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.729+0000 7ffbca000700 1 -- 172.21.15.81:0/831263078 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc4122520 con 0x7ffbc4071ea0 2024-04-23T14:51:42.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.730+0000 7ffbca000700 1 -- 172.21.15.81:0/831263078 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbc405f5f0 con 0x7ffbc4071ea0 2024-04-23T14:51:42.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.732+0000 7ffbbb400700 1 -- 172.21.15.81:0/831263078 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 31) v1 ==== 92569+0+0 (secure 0 0 0) 0x7ffbb000ba70 con 0x7ffbc4071ea0 2024-04-23T14:51:42.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.733+0000 7ffbbb400700 1 --2- 172.21.15.81:0/831263078 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7ffba806e620 0x7ffba8070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:42.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.733+0000 7ffbbb400700 1 -- 172.21.15.81:0/831263078 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7ffbb008ea90 con 0x7ffbc4071ea0 2024-04-23T14:51:42.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.734+0000 7ffbc3400700 1 --2- 172.21.15.81:0/831263078 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7ffba806e620 0x7ffba8070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:42.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.735+0000 7ffbc3400700 1 --2- 172.21.15.81:0/831263078 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7ffba806e620 0x7ffba8070ad0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4004600 tx=0x7ffbb400b040 comp rx=0 tx=0).ready entity=mgr.14738 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:42.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:42.738+0000 7ffbbb400700 1 -- 172.21.15.81:0/831263078 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7ffbb0057ea0 con 0x7ffbc4071ea0 2024-04-23T14:51:43.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.092+0000 7ffbca000700 1 -- 172.21.15.81:0/831263078 --> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffbc40ff930 con 0x7ffba806e620 2024-04-23T14:51:43.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.093+0000 7ffbbb400700 1 -- 172.21.15.81:0/831263078 <== mgr.14738 v2:172.21.15.81:6800/1880997914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7ffbc40ff930 con 0x7ffba806e620 2024-04-23T14:51:43.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.096+0000 7ffbca000700 1 -- 172.21.15.81:0/831263078 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7ffba806e620 msgr2=0x7ffba8070ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:43.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.096+0000 7ffbca000700 1 --2- 172.21.15.81:0/831263078 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7ffba806e620 0x7ffba8070ad0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4004600 tx=0x7ffbb400b040 comp rx=0 tx=0).stop 2024-04-23T14:51:43.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.096+0000 7ffbca000700 1 -- 172.21.15.81:0/831263078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbc4071ea0 msgr2=0x7ffbc406e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:43.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.096+0000 7ffbca000700 1 --2- 172.21.15.81:0/831263078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbc4071ea0 0x7ffbc406e880 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0000c00 tx=0x7ffbb0009e30 comp rx=0 tx=0).stop 2024-04-23T14:51:43.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.096+0000 7ffbca000700 1 -- 172.21.15.81:0/831263078 shutdown_connections 2024-04-23T14:51:43.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.096+0000 7ffbca000700 1 --2- 172.21.15.81:0/831263078 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7ffba806e620 0x7ffba8070ad0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:43.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.096+0000 7ffbca000700 1 --2- 172.21.15.81:0/831263078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbc40708f0 0x7ffbc406e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:43.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.096+0000 7ffbca000700 1 --2- 172.21.15.81:0/831263078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbc4071ea0 0x7ffbc406e880 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:43.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.096+0000 7ffbca000700 1 -- 172.21.15.81:0/831263078 >> 172.21.15.81:0/831263078 conn(0x7ffbc40f8530 msgr2=0x7ffbc40f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:43.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.096+0000 7ffbca000700 1 -- 172.21.15.81:0/831263078 shutdown_connections 2024-04-23T14:51:43.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.096+0000 7ffbca000700 1 -- 172.21.15.81:0/831263078 wait complete. 2024-04-23T14:51:43.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.303+0000 7fb4cf000700 1 -- 172.21.15.81:0/1887050420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c80fcff0 msgr2=0x7fb4c80fd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:43.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.303+0000 7fb4cf000700 1 --2- 172.21.15.81:0/1887050420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c80fcff0 0x7fb4c80fd460 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4004940 tx=0x7fb4b4009e30 comp rx=0 tx=0).stop 2024-04-23T14:51:43.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.303+0000 7fb4cf000700 1 -- 172.21.15.81:0/1887050420 shutdown_connections 2024-04-23T14:51:43.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.303+0000 7fb4cf000700 1 --2- 172.21.15.81:0/1887050420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c80fcff0 0x7fb4c80fd460 secure :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4004940 tx=0x7fb4b4009e30 comp rx=0 tx=0).stop 2024-04-23T14:51:43.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.303+0000 7fb4cf000700 1 --2- 172.21.15.81:0/1887050420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4c80fbd40 0x7fb4c80fc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:43.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.303+0000 7fb4cf000700 1 -- 172.21.15.81:0/1887050420 >> 172.21.15.81:0/1887050420 conn(0x7fb4c80f74c0 msgr2=0x7fb4c80f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:43.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.304+0000 7fb4cf000700 1 -- 172.21.15.81:0/1887050420 shutdown_connections 2024-04-23T14:51:43.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.304+0000 7fb4cf000700 1 -- 172.21.15.81:0/1887050420 wait complete. 2024-04-23T14:51:43.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.305+0000 7fb4cf000700 1 Processor -- start 2024-04-23T14:51:43.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.306+0000 7fb4cf000700 1 -- start start 2024-04-23T14:51:43.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.306+0000 7fb4cf000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c80fbd40 0x7fb4c810b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:43.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.306+0000 7fb4cf000700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4c810be30 0x7fb4c810ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:43.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.306+0000 7fb4cf000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c810c2f0 con 0x7fb4c80fbd40 2024-04-23T14:51:43.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.306+0000 7fb4cf000700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c810c460 con 0x7fb4c810be30 2024-04-23T14:51:43.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.307+0000 7fb4c7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c80fbd40 0x7fb4c810b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:43.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.307+0000 7fb4c7400700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4c810be30 0x7fb4c810ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:43.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.307+0000 7fb4c7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c80fbd40 0x7fb4c810b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49940/0 (socket says 172.21.15.81:49940) 2024-04-23T14:51:43.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.307+0000 7fb4c7e00700 1 -- 172.21.15.81:0/672453406 learned_addr learned my addr 172.21.15.81:0/672453406 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:51:43.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.307+0000 7fb4c7400700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4c810be30 0x7fb4c810ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.81:37864/0 (socket says 172.21.15.81:37864) 2024-04-23T14:51:43.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.308+0000 7fb4c7400700 1 -- 172.21.15.81:0/672453406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c80fbd40 msgr2=0x7fb4c810b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:43.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.308+0000 7fb4c7400700 1 --2- 172.21.15.81:0/672453406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c80fbd40 0x7fb4c810b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:43.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.308+0000 7fb4c7400700 1 -- 172.21.15.81:0/672453406 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b8005040 con 0x7fb4c810be30 2024-04-23T14:51:43.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.309+0000 7fb4c7e00700 1 --2- 172.21.15.81:0/672453406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c80fbd40 0x7fb4c810b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:51:43.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.309+0000 7fb4c7400700 1 --2- 172.21.15.81:0/672453406 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4c810be30 0x7fb4c810ccd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4008000 tx=0x7fb4b4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.310+0000 7fb4bfe00700 1 -- 172.21.15.81:0/672453406 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4b4020070 con 0x7fb4c810be30 2024-04-23T14:51:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.311+0000 7fb4bfe00700 1 -- 172.21.15.81:0/672453406 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb4b40093e0 con 0x7fb4c810be30 2024-04-23T14:51:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.311+0000 7fb4cf000700 1 -- 172.21.15.81:0/672453406 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4b4005040 con 0x7fb4c810be30 2024-04-23T14:51:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.311+0000 7fb4bfe00700 1 -- 172.21.15.81:0/672453406 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4b400e070 con 0x7fb4c810be30 2024-04-23T14:51:43.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.311+0000 7fb4cf000700 1 -- 172.21.15.81:0/672453406 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c810d620 con 0x7fb4c810be30 2024-04-23T14:51:43.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.314+0000 7fb4cf000700 1 -- 172.21.15.81:0/672453406 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4c805f5f0 con 0x7fb4c810be30 2024-04-23T14:51:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.316+0000 7fb4bfe00700 1 -- 172.21.15.81:0/672453406 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 31) v1 ==== 92569+0+0 (secure 0 0 0) 0x7fb4b401c400 con 0x7fb4c810be30 2024-04-23T14:51:43.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.317+0000 7fb4bfe00700 1 --2- 172.21.15.81:0/672453406 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7fb4ac06e7b0 0x7fb4ac070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:43.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.317+0000 7fb4bfe00700 1 -- 172.21.15.81:0/672453406 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fb4b408ef10 con 0x7fb4c810be30 2024-04-23T14:51:43.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.318+0000 7fb4c7e00700 1 --2- 172.21.15.81:0/672453406 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7fb4ac06e7b0 0x7fb4ac070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:43.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.319+0000 7fb4c7e00700 1 --2- 172.21.15.81:0/672453406 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7fb4ac06e7b0 0x7fb4ac070c60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb4c810b680 tx=0x7fb4b800b040 comp rx=0 tx=0).ready entity=mgr.14738 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:43.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.324+0000 7fb4bfe00700 1 -- 172.21.15.81:0/672453406 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7fb4b40583a0 con 0x7fb4c810be30 2024-04-23T14:51:43.515 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:43 smithi081 ceph-mon[25540]: pgmap v26: 65 pgs: 65 active+clean; 268 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 520 op/s 2024-04-23T14:51:43.515 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:43 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:43.515 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:43 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:43.515 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:43 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:51:43.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:43 smithi156 ceph-mon[32341]: pgmap v26: 65 pgs: 65 active+clean; 268 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 520 op/s 2024-04-23T14:51:43.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:43 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:43.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:43 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:43.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:43 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:51:43.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.722+0000 7fb4cf000700 1 -- 172.21.15.81:0/672453406 --> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb4c810d900 con 0x7fb4ac06e7b0 2024-04-23T14:51:43.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.737+0000 7fb4bfe00700 1 -- 172.21.15.81:0/672453406 <== mgr.14738 v2:172.21.15.81:6800/1880997914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fb4c810d900 con 0x7fb4ac06e7b0 2024-04-23T14:51:43.738 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-23T14:51:43.738 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (2m) 40s ago 12m 14.7M - 0.25.0 c8568f914cd2 63876b2abc27 2024-04-23T14:51:43.738 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (13m) 40s ago 13m 6660k - 17.2.7-884-g70d0cb4b cafd8ddac8fa 6ae90c81b232 2024-04-23T14:51:43.738 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi156 smithi156 running (11m) 43s ago 11m 6660k - 17.2.7-884-g70d0cb4b cafd8ddac8fa ecc141919f37 2024-04-23T14:51:43.738 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (105s) 40s ago 12m 74.2M - 9.4.7 954c08fa6188 fbad3cef0883 2024-04-23T14:51:43.738 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.vcoywg smithi081 running (5m) 40s ago 5m 221M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 2ca7601ab60f 2024-04-23T14:51:43.738 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.wydgcg smithi081 running (5m) 40s ago 5m 151M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 58eb1a961b61 2024-04-23T14:51:43.738 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.rhbtxt smithi156 running (5m) 43s ago 5m 12.5M - 17.2.7-884-g70d0cb4b cafd8ddac8fa db3cb5034381 2024-04-23T14:51:43.738 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.vynkxn smithi156 running (5m) 43s ago 5m 12.6M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 1c8f2219e7fd 2024-04-23T14:51:43.739 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.ldghvq smithi081 *:8443,9283,8765 running (80s) 40s ago 14m 476M - 19.0.0-3126-gd44fddd9 76e77f280c74 6bf23484a1c9 2024-04-23T14:51:43.739 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi156.ounwyj smithi156 *:8443,9283,8765 starting - - - - 2024-04-23T14:51:43.739 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (14m) 40s ago 14m 52.6M 2048M 17.2.7-884-g70d0cb4b cafd8ddac8fa 6e43d934b336 2024-04-23T14:51:43.739 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi156 smithi156 running (11m) 43s ago 11m 42.6M 2048M 17.2.7-884-g70d0cb4b cafd8ddac8fa d9127540d3bb 2024-04-23T14:51:43.739 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (2m) 40s ago 12m 7348k - 1.5.0 0da6a335fe13 197b27809010 2024-04-23T14:51:43.739 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi156 smithi156 *:9100 running (89s) 43s ago 11m 7818k - 1.5.0 0da6a335fe13 91a7c5e86d47 2024-04-23T14:51:43.739 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (10m) 40s ago 10m 201M 1557M 17.2.7-884-g70d0cb4b cafd8ddac8fa 272ca032bec1 2024-04-23T14:51:43.739 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (9m) 40s ago 9m 212M 1557M 17.2.7-884-g70d0cb4b cafd8ddac8fa ee6d0c8af6ed 2024-04-23T14:51:43.739 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (9m) 40s ago 9m 173M 1557M 17.2.7-884-g70d0cb4b cafd8ddac8fa c26c640828a2 2024-04-23T14:51:43.739 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi156 running (8m) 43s ago 8m 244M 2581M 17.2.7-884-g70d0cb4b cafd8ddac8fa c1c261b1ee90 2024-04-23T14:51:43.739 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi156 running (8m) 43s ago 8m 215M 2581M 17.2.7-884-g70d0cb4b cafd8ddac8fa 83f996ee64de 2024-04-23T14:51:43.739 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi156 running (7m) 43s ago 7m 199M 2581M 17.2.7-884-g70d0cb4b cafd8ddac8fa b754244bef18 2024-04-23T14:51:43.740 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 starting - - - - 2024-04-23T14:51:43.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.740+0000 7fb4cf000700 1 -- 172.21.15.81:0/672453406 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7fb4ac06e7b0 msgr2=0x7fb4ac070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:43.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.740+0000 7fb4cf000700 1 --2- 172.21.15.81:0/672453406 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7fb4ac06e7b0 0x7fb4ac070c60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb4c810b680 tx=0x7fb4b800b040 comp rx=0 tx=0).stop 2024-04-23T14:51:43.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.740+0000 7fb4cf000700 1 -- 172.21.15.81:0/672453406 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4c810be30 msgr2=0x7fb4c810ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:43.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.740+0000 7fb4cf000700 1 --2- 172.21.15.81:0/672453406 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4c810be30 0x7fb4c810ccd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4008000 tx=0x7fb4b4009e30 comp rx=0 tx=0).stop 2024-04-23T14:51:43.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.741+0000 7fb4cf000700 1 -- 172.21.15.81:0/672453406 shutdown_connections 2024-04-23T14:51:43.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.741+0000 7fb4cf000700 1 --2- 172.21.15.81:0/672453406 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7fb4ac06e7b0 0x7fb4ac070c60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:43.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.741+0000 7fb4cf000700 1 --2- 172.21.15.81:0/672453406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c80fbd40 0x7fb4c810b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:43.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.741+0000 7fb4cf000700 1 --2- 172.21.15.81:0/672453406 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4c810be30 0x7fb4c810ccd0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:43.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.741+0000 7fb4cf000700 1 -- 172.21.15.81:0/672453406 >> 172.21.15.81:0/672453406 conn(0x7fb4c80f74c0 msgr2=0x7fb4c80f8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:43.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.741+0000 7fb4cf000700 1 -- 172.21.15.81:0/672453406 shutdown_connections 2024-04-23T14:51:43.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.741+0000 7fb4cf000700 1 -- 172.21.15.81:0/672453406 wait complete. 2024-04-23T14:51:43.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.909+0000 7fdf01e00700 1 -- 172.21.15.81:0/1720536733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdefc0fe0e0 msgr2=0x7fdefc0fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:43.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.909+0000 7fdf01e00700 1 --2- 172.21.15.81:0/1720536733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdefc0fe0e0 0x7fdefc0fe550 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fdee8004940 tx=0x7fdee8009e30 comp rx=0 tx=0).stop 2024-04-23T14:51:43.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.909+0000 7fdf01e00700 1 -- 172.21.15.81:0/1720536733 shutdown_connections 2024-04-23T14:51:43.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.909+0000 7fdf01e00700 1 --2- 172.21.15.81:0/1720536733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdefc0fe0e0 0x7fdefc0fe550 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:43.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.909+0000 7fdf01e00700 1 --2- 172.21.15.81:0/1720536733 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdefc0fcef0 0x7fdefc0fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:43.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.909+0000 7fdf01e00700 1 -- 172.21.15.81:0/1720536733 >> 172.21.15.81:0/1720536733 conn(0x7fdefc0f8530 msgr2=0x7fdefc0fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:43.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.909+0000 7fdf01e00700 1 -- 172.21.15.81:0/1720536733 shutdown_connections 2024-04-23T14:51:43.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.909+0000 7fdf01e00700 1 -- 172.21.15.81:0/1720536733 wait complete. 2024-04-23T14:51:43.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.910+0000 7fdf01e00700 1 Processor -- start 2024-04-23T14:51:43.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.910+0000 7fdf01e00700 1 -- start start 2024-04-23T14:51:43.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.911+0000 7fdf01e00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdefc0fcef0 0x7fdefc10fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:43.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.911+0000 7fdf01e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdefc0fe0e0 0x7fdefc1101a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:43.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.911+0000 7fdf01e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc1107a0 con 0x7fdefc0fe0e0 2024-04-23T14:51:43.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.911+0000 7fdf01e00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc110ff0 con 0x7fdefc0fcef0 2024-04-23T14:51:43.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.911+0000 7fdefa000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdefc0fe0e0 0x7fdefc1101a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:43.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.911+0000 7fdefa000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdefc0fe0e0 0x7fdefc1101a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41262/0 (socket says 172.21.15.81:41262) 2024-04-23T14:51:43.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.911+0000 7fdefa000700 1 -- 172.21.15.81:0/1522197074 learned_addr learned my addr 172.21.15.81:0/1522197074 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:51:43.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.911+0000 7fdefaa00700 1 --2- 172.21.15.81:0/1522197074 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdefc0fcef0 0x7fdefc10fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:43.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.912+0000 7fdefa000700 1 -- 172.21.15.81:0/1522197074 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdefc0fcef0 msgr2=0x7fdefc10fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:43.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.912+0000 7fdefa000700 1 --2- 172.21.15.81:0/1522197074 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdefc0fcef0 0x7fdefc10fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:43.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.912+0000 7fdefa000700 1 -- 172.21.15.81:0/1522197074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee8005040 con 0x7fdefc0fe0e0 2024-04-23T14:51:43.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.912+0000 7fdefa000700 1 --2- 172.21.15.81:0/1522197074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdefc0fe0e0 0x7fdefc1101a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fdee800b3b0 tx=0x7fdee8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:43.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.912+0000 7fdef2a00700 1 -- 172.21.15.81:0/1522197074 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdee800e040 con 0x7fdefc0fe0e0 2024-04-23T14:51:43.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.912+0000 7fdef2a00700 1 -- 172.21.15.81:0/1522197074 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdee800bbf0 con 0x7fdefc0fe0e0 2024-04-23T14:51:43.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.912+0000 7fdf01e00700 1 -- 172.21.15.81:0/1522197074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdefc111270 con 0x7fdefc0fe0e0 2024-04-23T14:51:43.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.913+0000 7fdef2a00700 1 -- 172.21.15.81:0/1522197074 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdee801c630 con 0x7fdefc0fe0e0 2024-04-23T14:51:43.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.913+0000 7fdf01e00700 1 -- 172.21.15.81:0/1522197074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdefc1117b0 con 0x7fdefc0fe0e0 2024-04-23T14:51:43.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.914+0000 7fdf01e00700 1 -- 172.21.15.81:0/1522197074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdefc101a70 con 0x7fdefc0fe0e0 2024-04-23T14:51:43.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.915+0000 7fdef2a00700 1 -- 172.21.15.81:0/1522197074 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 31) v1 ==== 92569+0+0 (secure 0 0 0) 0x7fdee800bd60 con 0x7fdefc0fe0e0 2024-04-23T14:51:43.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.916+0000 7fdef2a00700 1 --2- 172.21.15.81:0/1522197074 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7fdee006e620 0x7fdee0070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:43.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.917+0000 7fdef2a00700 1 -- 172.21.15.81:0/1522197074 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fdee808ed40 con 0x7fdefc0fe0e0 2024-04-23T14:51:43.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.917+0000 7fdefaa00700 1 --2- 172.21.15.81:0/1522197074 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7fdee006e620 0x7fdee0070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:43.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.917+0000 7fdefaa00700 1 --2- 172.21.15.81:0/1522197074 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7fdee006e620 0x7fdee0070ad0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdefc0fcc30 tx=0x7fdeec00b040 comp rx=0 tx=0).ready entity=mgr.14738 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:43.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:43.924+0000 7fdef2a00700 1 -- 172.21.15.81:0/1522197074 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7fdee805bd00 con 0x7fdefc0fe0e0 2024-04-23T14:51:44.167 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:44 smithi156 ceph-mon[32341]: from='client.14824 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:51:44.167 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:44 smithi156 ceph-mon[32341]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:51:44.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.348+0000 7fdf01e00700 1 -- 172.21.15.81:0/1522197074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdefc04bed0 con 0x7fdefc0fe0e0 2024-04-23T14:51:44.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.350+0000 7fdef2a00700 1 -- 172.21.15.81:0/1522197074 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7fdee805b890 con 0x7fdefc0fe0e0 2024-04-23T14:51:44.351 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:51:44.351 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-04-23T14:51:44.352 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 2 2024-04-23T14:51:44.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:51:44.352 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-04-23T14:51:44.352 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T14:51:44.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:51:44.352 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-04-23T14:51:44.352 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 6 2024-04-23T14:51:44.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:51:44.352 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-04-23T14:51:44.352 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 4 2024-04-23T14:51:44.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:51:44.352 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-04-23T14:51:44.352 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 12, 2024-04-23T14:51:44.353 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T14:51:44.353 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-23T14:51:44.353 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:51:44.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.355+0000 7fdf01e00700 1 -- 172.21.15.81:0/1522197074 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7fdee006e620 msgr2=0x7fdee0070ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:44.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.355+0000 7fdf01e00700 1 --2- 172.21.15.81:0/1522197074 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7fdee006e620 0x7fdee0070ad0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdefc0fcc30 tx=0x7fdeec00b040 comp rx=0 tx=0).stop 2024-04-23T14:51:44.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.355+0000 7fdf01e00700 1 -- 172.21.15.81:0/1522197074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdefc0fe0e0 msgr2=0x7fdefc1101a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:44.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.355+0000 7fdf01e00700 1 --2- 172.21.15.81:0/1522197074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdefc0fe0e0 0x7fdefc1101a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fdee800b3b0 tx=0x7fdee8009e30 comp rx=0 tx=0).stop 2024-04-23T14:51:44.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.356+0000 7fdf01e00700 1 -- 172.21.15.81:0/1522197074 shutdown_connections 2024-04-23T14:51:44.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.356+0000 7fdf01e00700 1 --2- 172.21.15.81:0/1522197074 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7fdee006e620 0x7fdee0070ad0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:44.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.356+0000 7fdf01e00700 1 --2- 172.21.15.81:0/1522197074 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdefc0fcef0 0x7fdefc10fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:44.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.356+0000 7fdf01e00700 1 --2- 172.21.15.81:0/1522197074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdefc0fe0e0 0x7fdefc1101a0 secure :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fdee800b3b0 tx=0x7fdee8009e30 comp rx=0 tx=0).stop 2024-04-23T14:51:44.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.356+0000 7fdf01e00700 1 -- 172.21.15.81:0/1522197074 >> 172.21.15.81:0/1522197074 conn(0x7fdefc0f8530 msgr2=0x7fdefc0f9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:44.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.357+0000 7fdf01e00700 1 -- 172.21.15.81:0/1522197074 shutdown_connections 2024-04-23T14:51:44.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.358+0000 7fdf01e00700 1 -- 172.21.15.81:0/1522197074 wait complete. 2024-04-23T14:51:44.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:44 smithi081 ceph-mon[25540]: from='client.14824 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:51:44.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:44 smithi081 ceph-mon[25540]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:51:44.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.588+0000 7fef0a800700 1 -- 172.21.15.81:0/4274532309 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef040fd710 msgr2=0x7fef040fe070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:44.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.588+0000 7fef0a800700 1 --2- 172.21.15.81:0/4274532309 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef040fd710 0x7fef040fe070 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7feeec004940 tx=0x7feeec009e30 comp rx=0 tx=0).stop 2024-04-23T14:51:44.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.588+0000 7fef0a800700 1 -- 172.21.15.81:0/4274532309 shutdown_connections 2024-04-23T14:51:44.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.588+0000 7fef0a800700 1 --2- 172.21.15.81:0/4274532309 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef040fd710 0x7fef040fe070 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:44.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.588+0000 7fef0a800700 1 --2- 172.21.15.81:0/4274532309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef040fcdc0 0x7fef040fd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:44.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.588+0000 7fef0a800700 1 -- 172.21.15.81:0/4274532309 >> 172.21.15.81:0/4274532309 conn(0x7fef040f8540 msgr2=0x7fef040fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:44.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.588+0000 7fef0a800700 1 -- 172.21.15.81:0/4274532309 shutdown_connections 2024-04-23T14:51:44.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.589+0000 7fef0a800700 1 -- 172.21.15.81:0/4274532309 wait complete. 2024-04-23T14:51:44.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.589+0000 7fef0a800700 1 Processor -- start 2024-04-23T14:51:44.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.590+0000 7fef0a800700 1 -- start start 2024-04-23T14:51:44.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.591+0000 7fef0a800700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef040fcdc0 0x7fef0410b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:44.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.591+0000 7fef0a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef040fd710 0x7fef0410bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:44.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.591+0000 7fef0a800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0410c320 con 0x7fef040fd710 2024-04-23T14:51:44.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.591+0000 7fef0a800700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0410cb70 con 0x7fef040fcdc0 2024-04-23T14:51:44.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.591+0000 7fef03400700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef040fcdc0 0x7fef0410b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:44.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.592+0000 7feefbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef040fd710 0x7fef0410bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:44.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.592+0000 7feefbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef040fd710 0x7fef0410bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41278/0 (socket says 172.21.15.81:41278) 2024-04-23T14:51:44.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.592+0000 7feefbe00700 1 -- 172.21.15.81:0/3286040298 learned_addr learned my addr 172.21.15.81:0/3286040298 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:51:44.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.593+0000 7feefbe00700 1 -- 172.21.15.81:0/3286040298 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef040fcdc0 msgr2=0x7fef0410b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:44.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.593+0000 7feefbe00700 1 --2- 172.21.15.81:0/3286040298 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef040fcdc0 0x7fef0410b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:44.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.593+0000 7feefbe00700 1 -- 172.21.15.81:0/3286040298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef40048f0 con 0x7fef040fd710 2024-04-23T14:51:44.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.593+0000 7feefbe00700 1 --2- 172.21.15.81:0/3286040298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef040fd710 0x7fef0410bcd0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7feeec00b0d0 tx=0x7feeec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:44.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.594+0000 7feefb400700 1 -- 172.21.15.81:0/3286040298 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feeec00e040 con 0x7fef040fd710 2024-04-23T14:51:44.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.594+0000 7fef0a800700 1 -- 172.21.15.81:0/3286040298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeec005040 con 0x7fef040fd710 2024-04-23T14:51:44.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.594+0000 7fef0a800700 1 -- 172.21.15.81:0/3286040298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef0410d220 con 0x7fef040fd710 2024-04-23T14:51:44.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.594+0000 7feefb400700 1 -- 172.21.15.81:0/3286040298 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feeec013bc0 con 0x7fef040fd710 2024-04-23T14:51:44.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.594+0000 7feefb400700 1 -- 172.21.15.81:0/3286040298 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feeec0263b0 con 0x7fef040fd710 2024-04-23T14:51:44.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.596+0000 7fef0a800700 1 -- 172.21.15.81:0/3286040298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feee00052e0 con 0x7fef040fd710 2024-04-23T14:51:44.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.598+0000 7feefb400700 1 -- 172.21.15.81:0/3286040298 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 31) v1 ==== 92569+0+0 (secure 0 0 0) 0x7feeec0123c0 con 0x7fef040fd710 2024-04-23T14:51:44.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.599+0000 7feefb400700 1 --2- 172.21.15.81:0/3286040298 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7feee806e670 0x7feee8070b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:44.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.599+0000 7feefb400700 1 -- 172.21.15.81:0/3286040298 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7feeec08eda0 con 0x7fef040fd710 2024-04-23T14:51:44.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.600+0000 7fef03400700 1 --2- 172.21.15.81:0/3286040298 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7feee806e670 0x7feee8070b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:44.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.601+0000 7fef03400700 1 --2- 172.21.15.81:0/3286040298 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7feee806e670 0x7feee8070b20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7feef4004fd0 tx=0x7feef4009ca0 comp rx=0 tx=0).ready entity=mgr.14738 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:44.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.608+0000 7feefb400700 1 -- 172.21.15.81:0/3286040298 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7feeec058260 con 0x7fef040fd710 2024-04-23T14:51:44.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.954+0000 7fef0a800700 1 -- 172.21.15.81:0/3286040298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7feee0005860 con 0x7fef040fd710 2024-04-23T14:51:44.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.954+0000 7feefb400700 1 -- 172.21.15.81:0/3286040298 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1837 (secure 0 0 0) 0x7feeec022070 con 0x7fef040fd710 2024-04-23T14:51:44.956 INFO:teuthology.orchestra.run.smithi081.stdout:e18 2024-04-23T14:51:44.956 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-23T14:51:44.956 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:51:44.956 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-04-23T14:51:44.956 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:51:44.957 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-04-23T14:51:44.957 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-04-23T14:51:44.957 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 17 2024-04-23T14:51:44.957 INFO:teuthology.orchestra.run.smithi081.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-23T14:51:44.957 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-04-23T14:45:51.264703+0000 2024-04-23T14:51:44.957 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-04-23T14:46:12.782992+0000 2024-04-23T14:51:44.957 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-04-23T14:51:44.957 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-04-23T14:51:44.957 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-04-23T14:51:44.957 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-04-23T14:51:44.957 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-04-23T14:51:44.957 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-04-23T14:51:44.957 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-04-23T14:51:44.957 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 47 2024-04-23T14:51:44.958 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:51:44.958 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 1 2024-04-23T14:51:44.958 INFO:teuthology.orchestra.run.smithi081.stdout:in 0 2024-04-23T14:51:44.958 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=14472} 2024-04-23T14:51:44.958 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-04-23T14:51:44.958 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-04-23T14:51:44.958 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-04-23T14:51:44.958 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-04-23T14:51:44.958 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-04-23T14:51:44.958 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-04-23T14:51:44.958 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-04-23T14:51:44.958 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-04-23T14:51:44.958 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.vcoywg{0:14472} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.81:6828/2563365650,v1:172.21.15.81:6829/2563365650] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:51:44.958 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.wydgcg{0:14482} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.81:6826/759909104,v1:172.21.15.81:6827/759909104] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:51:44.959 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:51:44.959 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:51:44.959 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-04-23T14:51:44.959 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:51:44.959 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.vynkxn{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.156:6826/1794690362,v1:172.21.15.156:6827/1794690362] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:51:44.959 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.rhbtxt{-1:24263} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.156:6824/3854041261,v1:172.21.15.156:6825/3854041261] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:51:44.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.958+0000 7fef0a800700 1 -- 172.21.15.81:0/3286040298 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7feee806e670 msgr2=0x7feee8070b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:44.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.958+0000 7fef0a800700 1 --2- 172.21.15.81:0/3286040298 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7feee806e670 0x7feee8070b20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7feef4004fd0 tx=0x7feef4009ca0 comp rx=0 tx=0).stop 2024-04-23T14:51:44.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.958+0000 7fef0a800700 1 -- 172.21.15.81:0/3286040298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef040fd710 msgr2=0x7fef0410bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:44.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.958+0000 7fef0a800700 1 --2- 172.21.15.81:0/3286040298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef040fd710 0x7fef0410bcd0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7feeec00b0d0 tx=0x7feeec009e30 comp rx=0 tx=0).stop 2024-04-23T14:51:44.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.958+0000 7fef0a800700 1 -- 172.21.15.81:0/3286040298 shutdown_connections 2024-04-23T14:51:44.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.958+0000 7fef0a800700 1 --2- 172.21.15.81:0/3286040298 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7feee806e670 0x7feee8070b20 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:44.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.958+0000 7fef0a800700 1 --2- 172.21.15.81:0/3286040298 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef040fcdc0 0x7fef0410b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:44.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.958+0000 7fef0a800700 1 --2- 172.21.15.81:0/3286040298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef040fd710 0x7fef0410bcd0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:44.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.958+0000 7fef0a800700 1 -- 172.21.15.81:0/3286040298 >> 172.21.15.81:0/3286040298 conn(0x7fef040f8540 msgr2=0x7fef040f9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:44.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.959+0000 7fef0a800700 1 -- 172.21.15.81:0/3286040298 shutdown_connections 2024-04-23T14:51:44.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:44.959+0000 7fef0a800700 1 -- 172.21.15.81:0/3286040298 wait complete. 2024-04-23T14:51:44.961 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 18 2024-04-23T14:51:45.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.154+0000 7f6ac9600700 1 -- 172.21.15.81:0/2894817252 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ab800bc70 con 0x7f6acc1002b0 2024-04-23T14:51:45.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.154+0000 7f6ad1800700 1 -- 172.21.15.81:0/2894817252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6acc1002b0 msgr2=0x7f6acc100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:45.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.154+0000 7f6ad1800700 1 --2- 172.21.15.81:0/2894817252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6acc1002b0 0x7f6acc100720 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8004940 tx=0x7f6ab8009e30 comp rx=0 tx=0).stop 2024-04-23T14:51:45.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.155+0000 7f6ad1800700 1 -- 172.21.15.81:0/2894817252 shutdown_connections 2024-04-23T14:51:45.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.155+0000 7f6ad1800700 1 --2- 172.21.15.81:0/2894817252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6acc1002b0 0x7f6acc100720 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:45.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.155+0000 7f6ad1800700 1 --2- 172.21.15.81:0/2894817252 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6acc0ff000 0x7f6acc0ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:45.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.155+0000 7f6ad1800700 1 -- 172.21.15.81:0/2894817252 >> 172.21.15.81:0/2894817252 conn(0x7f6acc0fa950 msgr2=0x7f6acc0fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:45.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.156+0000 7f6ad1800700 1 -- 172.21.15.81:0/2894817252 shutdown_connections 2024-04-23T14:51:45.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.157+0000 7f6ad1800700 1 -- 172.21.15.81:0/2894817252 wait complete. 2024-04-23T14:51:45.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.158+0000 7f6ad1800700 1 Processor -- start 2024-04-23T14:51:45.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.159+0000 7f6ad1800700 1 -- start start 2024-04-23T14:51:45.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.160+0000 7f6ad1800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6acc0ff000 0x7f6acc10b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:45.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.160+0000 7f6ad1800700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6acc1002b0 0x7f6acc10bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:45.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.160+0000 7f6ad1800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc10c2f0 con 0x7f6acc0ff000 2024-04-23T14:51:45.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.161+0000 7f6ad1800700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc10cb40 con 0x7f6acc1002b0 2024-04-23T14:51:45.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.161+0000 7f6aca000700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6acc1002b0 0x7f6acc10bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:45.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.161+0000 7f6aca000700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6acc1002b0 0x7f6acc10bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.81:34104/0 (socket says 172.21.15.81:34104) 2024-04-23T14:51:45.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.161+0000 7f6aca000700 1 -- 172.21.15.81:0/3074673971 learned_addr learned my addr 172.21.15.81:0/3074673971 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:51:45.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.162+0000 7f6aca000700 1 -- 172.21.15.81:0/3074673971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6acc0ff000 msgr2=0x7f6acc10b760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-23T14:51:45.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.162+0000 7f6acaa00700 1 --2- 172.21.15.81:0/3074673971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6acc0ff000 0x7f6acc10b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:45.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.162+0000 7f6aca000700 1 --2- 172.21.15.81:0/3074673971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6acc0ff000 0x7f6acc10b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:45.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.162+0000 7f6aca000700 1 -- 172.21.15.81:0/3074673971 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab8005040 con 0x7f6acc1002b0 2024-04-23T14:51:45.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.163+0000 7f6aca000700 1 --2- 172.21.15.81:0/3074673971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6acc1002b0 0x7f6acc10bca0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6ab800b3b0 tx=0x7f6ab8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:45.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.164+0000 7f6ac2a00700 1 -- 172.21.15.81:0/3074673971 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ab800e030 con 0x7f6acc1002b0 2024-04-23T14:51:45.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.164+0000 7f6ad1800700 1 -- 172.21.15.81:0/3074673971 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6acc10cdc0 con 0x7f6acc1002b0 2024-04-23T14:51:45.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.165+0000 7f6ad1800700 1 -- 172.21.15.81:0/3074673971 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6acc10d380 con 0x7f6acc1002b0 2024-04-23T14:51:45.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.165+0000 7f6ac2a00700 1 -- 172.21.15.81:0/3074673971 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6ab800bbf0 con 0x7f6acc1002b0 2024-04-23T14:51:45.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.165+0000 7f6ac2a00700 1 -- 172.21.15.81:0/3074673971 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ab8013d90 con 0x7f6acc1002b0 2024-04-23T14:51:45.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.166+0000 7f6ad1800700 1 -- 172.21.15.81:0/3074673971 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aac0052e0 con 0x7f6acc1002b0 2024-04-23T14:51:45.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.169+0000 7f6ac2a00700 1 -- 172.21.15.81:0/3074673971 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 31) v1 ==== 92569+0+0 (secure 0 0 0) 0x7f6ab800bd60 con 0x7f6acc1002b0 2024-04-23T14:51:45.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.171+0000 7f6ac2a00700 1 --2- 172.21.15.81:0/3074673971 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f6ab006e670 0x7f6ab0070b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:45.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.171+0000 7f6ac2a00700 1 -- 172.21.15.81:0/3074673971 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f6ab80900a0 con 0x7f6acc1002b0 2024-04-23T14:51:45.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.173+0000 7f6acaa00700 1 --2- 172.21.15.81:0/3074673971 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f6ab006e670 0x7f6ab0070b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:45.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.174+0000 7f6acaa00700 1 --2- 172.21.15.81:0/3074673971 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f6ab006e670 0x7f6ab0070b20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6acc10b4f0 tx=0x7f6abc00b040 comp rx=0 tx=0).ready entity=mgr.14738 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:45.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.178+0000 7f6ac2a00700 1 -- 172.21.15.81:0/3074673971 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f6ab8059530 con 0x7f6acc1002b0 2024-04-23T14:51:45.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:45 smithi081 ceph-mon[25540]: pgmap v27: 65 pgs: 65 active+clean; 257 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 851 op/s 2024-04-23T14:51:45.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:45 smithi081 ceph-mon[25540]: from='client.24533 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:51:45.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:45 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/1522197074' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:51:45.328 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:45 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/3286040298' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:51:45.443 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:45 smithi156 ceph-mon[32341]: pgmap v27: 65 pgs: 65 active+clean; 257 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 851 op/s 2024-04-23T14:51:45.443 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:45 smithi156 ceph-mon[32341]: from='client.24533 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:51:45.443 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:45 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/1522197074' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:51:45.443 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:45 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/3286040298' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:51:45.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.588+0000 7f6ad1800700 1 -- 172.21.15.81:0/3074673971 --> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6aac000bf0 con 0x7f6ab006e670 2024-04-23T14:51:45.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.592+0000 7f6ac2a00700 1 -- 172.21.15.81:0/3074673971 <== mgr.14738 v2:172.21.15.81:6800/1880997914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7f6aac000bf0 con 0x7f6ab006e670 2024-04-23T14:51:45.592 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:51:45.592 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd", 2024-04-23T14:51:45.593 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-04-23T14:51:45.593 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-23T14:51:45.593 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [], 2024-04-23T14:51:45.593 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "", 2024-04-23T14:51:45.593 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "Currently upgrading mgr daemons", 2024-04-23T14:51:45.593 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-04-23T14:51:45.593 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:51:45.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.597+0000 7f6ad1800700 1 -- 172.21.15.81:0/3074673971 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f6ab006e670 msgr2=0x7f6ab0070b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:45.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.597+0000 7f6ad1800700 1 --2- 172.21.15.81:0/3074673971 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f6ab006e670 0x7f6ab0070b20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6acc10b4f0 tx=0x7f6abc00b040 comp rx=0 tx=0).stop 2024-04-23T14:51:45.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.597+0000 7f6ad1800700 1 -- 172.21.15.81:0/3074673971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6acc1002b0 msgr2=0x7f6acc10bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:45.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.597+0000 7f6ad1800700 1 --2- 172.21.15.81:0/3074673971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6acc1002b0 0x7f6acc10bca0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6ab800b3b0 tx=0x7f6ab8009e30 comp rx=0 tx=0).stop 2024-04-23T14:51:45.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.597+0000 7f6ad1800700 1 -- 172.21.15.81:0/3074673971 shutdown_connections 2024-04-23T14:51:45.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.597+0000 7f6ad1800700 1 --2- 172.21.15.81:0/3074673971 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f6ab006e670 0x7f6ab0070b20 secure :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6acc10b4f0 tx=0x7f6abc00b040 comp rx=0 tx=0).stop 2024-04-23T14:51:45.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.597+0000 7f6ad1800700 1 --2- 172.21.15.81:0/3074673971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6acc0ff000 0x7f6acc10b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:45.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.597+0000 7f6ad1800700 1 --2- 172.21.15.81:0/3074673971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6acc1002b0 0x7f6acc10bca0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:45.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.597+0000 7f6ad1800700 1 -- 172.21.15.81:0/3074673971 >> 172.21.15.81:0/3074673971 conn(0x7f6acc0fa950 msgr2=0x7f6acc1014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:45.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.599+0000 7f6ad1800700 1 -- 172.21.15.81:0/3074673971 shutdown_connections 2024-04-23T14:51:45.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.599+0000 7f6ad1800700 1 -- 172.21.15.81:0/3074673971 wait complete. 2024-04-23T14:51:45.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.813+0000 7f0dbe600700 1 -- 172.21.15.81:0/268552950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0db80fe0e0 msgr2=0x7f0db80fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:45.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.813+0000 7f0dbe600700 1 --2- 172.21.15.81:0/268552950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0db80fe0e0 0x7f0db80fe550 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0da4004940 tx=0x7f0da4009e30 comp rx=0 tx=0).stop 2024-04-23T14:51:45.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.814+0000 7f0dbe600700 1 -- 172.21.15.81:0/268552950 shutdown_connections 2024-04-23T14:51:45.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.814+0000 7f0dbe600700 1 --2- 172.21.15.81:0/268552950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0db80fe0e0 0x7f0db80fe550 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:45.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.814+0000 7f0dbe600700 1 --2- 172.21.15.81:0/268552950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0db80fcef0 0x7f0db80fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:45.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.814+0000 7f0dbe600700 1 -- 172.21.15.81:0/268552950 >> 172.21.15.81:0/268552950 conn(0x7f0db80f8530 msgr2=0x7f0db80fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:45.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.814+0000 7f0dbe600700 1 -- 172.21.15.81:0/268552950 shutdown_connections 2024-04-23T14:51:45.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.814+0000 7f0dbe600700 1 -- 172.21.15.81:0/268552950 wait complete. 2024-04-23T14:51:45.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.815+0000 7f0dbe600700 1 Processor -- start 2024-04-23T14:51:45.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.815+0000 7f0dbe600700 1 -- start start 2024-04-23T14:51:45.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.815+0000 7f0dbe600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0db80fcef0 0x7f0db810fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:45.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.815+0000 7f0dbe600700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0db80fe0e0 0x7f0db81101a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:45.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.815+0000 7f0dbe600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db81107a0 con 0x7f0db80fcef0 2024-04-23T14:51:45.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.815+0000 7f0dbe600700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db8110f80 con 0x7f0db80fe0e0 2024-04-23T14:51:45.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.815+0000 7f0db7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0db80fcef0 0x7f0db810fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:45.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.815+0000 7f0db7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0db80fcef0 0x7f0db810fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41300/0 (socket says 172.21.15.81:41300) 2024-04-23T14:51:45.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.815+0000 7f0db7400700 1 -- 172.21.15.81:0/1573465869 learned_addr learned my addr 172.21.15.81:0/1573465869 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:51:45.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.816+0000 7f0db6a00700 1 --2- 172.21.15.81:0/1573465869 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0db80fe0e0 0x7f0db81101a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:45.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.816+0000 7f0db7400700 1 -- 172.21.15.81:0/1573465869 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0db80fe0e0 msgr2=0x7f0db81101a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:45.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.816+0000 7f0db7400700 1 --2- 172.21.15.81:0/1573465869 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0db80fe0e0 0x7f0db81101a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:45.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.816+0000 7f0db7400700 1 -- 172.21.15.81:0/1573465869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da4005040 con 0x7f0db80fcef0 2024-04-23T14:51:45.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.816+0000 7f0db6a00700 1 --2- 172.21.15.81:0/1573465869 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0db80fe0e0 0x7f0db81101a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T14:51:45.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.817+0000 7f0db7400700 1 --2- 172.21.15.81:0/1573465869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0db80fcef0 0x7f0db810fc60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0da8002a80 tx=0x7f0da8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:45.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.817+0000 7f0daf400700 1 -- 172.21.15.81:0/1573465869 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0da8007cc0 con 0x7f0db80fcef0 2024-04-23T14:51:45.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.817+0000 7f0daf400700 1 -- 172.21.15.81:0/1573465869 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0da800f040 con 0x7f0db80fcef0 2024-04-23T14:51:45.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.817+0000 7f0dbe600700 1 -- 172.21.15.81:0/1573465869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db8111260 con 0x7f0db80fcef0 2024-04-23T14:51:45.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.817+0000 7f0daf400700 1 -- 172.21.15.81:0/1573465869 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0da800da30 con 0x7f0db80fcef0 2024-04-23T14:51:45.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.817+0000 7f0dbe600700 1 -- 172.21.15.81:0/1573465869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db81117a0 con 0x7f0db80fcef0 2024-04-23T14:51:45.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.818+0000 7f0dbe600700 1 -- 172.21.15.81:0/1573465869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db8101a70 con 0x7f0db80fcef0 2024-04-23T14:51:45.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.820+0000 7f0daf400700 1 -- 172.21.15.81:0/1573465869 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 31) v1 ==== 92569+0+0 (secure 0 0 0) 0x7f0da800db90 con 0x7f0db80fcef0 2024-04-23T14:51:45.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.822+0000 7f0daf400700 1 --2- 172.21.15.81:0/1573465869 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f0d9c06e620 0x7f0d9c070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:51:45.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.822+0000 7f0daf400700 1 -- 172.21.15.81:0/1573465869 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f0da808de20 con 0x7f0db80fcef0 2024-04-23T14:51:45.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.823+0000 7f0db6a00700 1 --2- 172.21.15.81:0/1573465869 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f0d9c06e620 0x7f0d9c070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:51:45.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.823+0000 7f0db6a00700 1 --2- 172.21.15.81:0/1573465869 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f0d9c06e620 0x7f0d9c070ad0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0da400b3b0 tx=0x7f0da4009e30 comp rx=0 tx=0).ready entity=mgr.14738 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:51:45.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:45.826+0000 7f0daf400700 1 -- 172.21.15.81:0/1573465869 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f0da805ae00 con 0x7f0db80fcef0 2024-04-23T14:51:46.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:46.329+0000 7f0dbe600700 1 -- 172.21.15.81:0/1573465869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0db805f5f0 con 0x7f0db80fcef0 2024-04-23T14:51:46.331 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-04-23T14:51:46.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:46.331+0000 7f0daf400700 1 -- 172.21.15.81:0/1573465869 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f0da805a990 con 0x7f0db80fcef0 2024-04-23T14:51:46.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:46.335+0000 7f0dbe600700 1 -- 172.21.15.81:0/1573465869 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f0d9c06e620 msgr2=0x7f0d9c070ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:46.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:46.335+0000 7f0dbe600700 1 --2- 172.21.15.81:0/1573465869 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f0d9c06e620 0x7f0d9c070ad0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0da400b3b0 tx=0x7f0da4009e30 comp rx=0 tx=0).stop 2024-04-23T14:51:46.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:46.335+0000 7f0dbe600700 1 -- 172.21.15.81:0/1573465869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0db80fcef0 msgr2=0x7f0db810fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:51:46.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:46.335+0000 7f0dbe600700 1 --2- 172.21.15.81:0/1573465869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0db80fcef0 0x7f0db810fc60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0da8002a80 tx=0x7f0da8004600 comp rx=0 tx=0).stop 2024-04-23T14:51:46.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:46.336+0000 7f0dbe600700 1 -- 172.21.15.81:0/1573465869 shutdown_connections 2024-04-23T14:51:46.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:46.336+0000 7f0dbe600700 1 --2- 172.21.15.81:0/1573465869 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f0d9c06e620 0x7f0d9c070ad0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:46.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:46.336+0000 7f0dbe600700 1 --2- 172.21.15.81:0/1573465869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0db80fcef0 0x7f0db810fc60 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:46.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:46.336+0000 7f0dbe600700 1 --2- 172.21.15.81:0/1573465869 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0db80fe0e0 0x7f0db81101a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:51:46.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:46.336+0000 7f0dbe600700 1 -- 172.21.15.81:0/1573465869 >> 172.21.15.81:0/1573465869 conn(0x7f0db80f8530 msgr2=0x7f0db80f9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:51:46.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:46.337+0000 7f0dbe600700 1 -- 172.21.15.81:0/1573465869 shutdown_connections 2024-04-23T14:51:46.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:51:46.338+0000 7f0dbe600700 1 -- 172.21.15.81:0/1573465869 wait complete. 2024-04-23T14:51:46.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:46 smithi156 ceph-mon[32341]: pgmap v28: 65 pgs: 65 active+clean; 257 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 601 op/s 2024-04-23T14:51:46.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:46 smithi156 ceph-mon[32341]: from='client.24545 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:51:46.545 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:46 smithi081 ceph-mon[25540]: pgmap v28: 65 pgs: 65 active+clean; 257 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 601 op/s 2024-04-23T14:51:46.545 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:46 smithi081 ceph-mon[25540]: from='client.24545 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:51:47.512 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:47 smithi081 ceph-mon[25540]: from='client.? 172.21.15.81:0/1573465869' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:51:47.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:47 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/1573465869' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:51:48.987 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:48 smithi156 ceph-mon[32341]: pgmap v29: 65 pgs: 65 active+clean; 245 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 907 op/s 2024-04-23T14:51:48.987 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:48 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:48.987 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:48 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:49.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:48 smithi081 ceph-mon[25540]: pgmap v29: 65 pgs: 65 active+clean; 245 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 907 op/s 2024-04-23T14:51:49.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:48 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:49.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:48 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:51.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:50 smithi156 ceph-mon[32341]: pgmap v30: 65 pgs: 65 active+clean; 245 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 991 KiB/s rd, 1.2 MiB/s wr, 761 op/s 2024-04-23T14:51:51.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:50 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:51.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:50 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:51.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:50 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:51.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:50 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:51.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:50 smithi081 ceph-mon[25540]: pgmap v30: 65 pgs: 65 active+clean; 245 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 991 KiB/s rd, 1.2 MiB/s wr, 761 op/s 2024-04-23T14:51:51.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:50 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:51.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:50 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:51.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:50 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:51.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:50 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:52.968 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:52 smithi156 ceph-mon[32341]: pgmap v31: 65 pgs: 65 active+clean; 242 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 873 op/s 2024-04-23T14:51:53.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:52 smithi081 ceph-mon[25540]: pgmap v31: 65 pgs: 65 active+clean; 242 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 873 op/s 2024-04-23T14:51:54.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:53 smithi156 ceph-mon[32341]: Standby manager daemon smithi156.ounwyj restarted 2024-04-23T14:51:54.071 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:53 smithi156 ceph-mon[32341]: Standby manager daemon smithi156.ounwyj started 2024-04-23T14:51:54.072 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:53 smithi156 ceph-mon[32341]: from='mgr.? 172.21.15.156:0/2365035679' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi156.ounwyj/crt"}]: dispatch 2024-04-23T14:51:54.072 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:53 smithi156 ceph-mon[32341]: from='mgr.? 172.21.15.156:0/2365035679' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-23T14:51:54.072 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:53 smithi156 ceph-mon[32341]: from='mgr.? 172.21.15.156:0/2365035679' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi156.ounwyj/key"}]: dispatch 2024-04-23T14:51:54.072 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:53 smithi156 ceph-mon[32341]: from='mgr.? 172.21.15.156:0/2365035679' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-23T14:51:54.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:53 smithi081 ceph-mon[25540]: Standby manager daemon smithi156.ounwyj restarted 2024-04-23T14:51:54.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:53 smithi081 ceph-mon[25540]: Standby manager daemon smithi156.ounwyj started 2024-04-23T14:51:54.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:53 smithi081 ceph-mon[25540]: from='mgr.? 172.21.15.156:0/2365035679' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi156.ounwyj/crt"}]: dispatch 2024-04-23T14:51:54.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:53 smithi081 ceph-mon[25540]: from='mgr.? 172.21.15.156:0/2365035679' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-23T14:51:54.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:53 smithi081 ceph-mon[25540]: from='mgr.? 172.21.15.156:0/2365035679' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi156.ounwyj/key"}]: dispatch 2024-04-23T14:51:54.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:53 smithi081 ceph-mon[25540]: from='mgr.? 172.21.15.156:0/2365035679' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-23T14:51:55.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:54 smithi081 ceph-mon[25540]: pgmap v32: 65 pgs: 65 active+clean; 235 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 844 op/s 2024-04-23T14:51:55.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:54 smithi081 ceph-mon[25540]: mgrmap e32: smithi081.ldghvq(active, since 58s), standbys: smithi156.ounwyj 2024-04-23T14:51:55.265 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:54 smithi156 ceph-mon[32341]: pgmap v32: 65 pgs: 65 active+clean; 235 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 844 op/s 2024-04-23T14:51:55.265 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:54 smithi156 ceph-mon[32341]: mgrmap e32: smithi081.ldghvq(active, since 58s), standbys: smithi156.ounwyj 2024-04-23T14:51:56.778 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:56 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:56.778 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:56 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:56.778 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:56 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:51:56.778 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:56 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:51:56.778 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:56 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:56.779 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:56 smithi081 ceph-mon[25540]: pgmap v33: 65 pgs: 65 active+clean; 235 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 461 op/s 2024-04-23T14:51:56.779 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:56 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:51:56.779 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:56 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:51:56.779 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:56 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:51:56.779 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:56 smithi081 ceph-mon[25540]: Upgrade: Setting container_image for all mgr 2024-04-23T14:51:56.779 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:56 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:56.779 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:56 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi081.ldghvq"}]: dispatch 2024-04-23T14:51:56.779 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:56 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi081.ldghvq"}]': finished 2024-04-23T14:51:56.779 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:56 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi156.ounwyj"}]: dispatch 2024-04-23T14:51:56.779 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:56 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi156.ounwyj"}]': finished 2024-04-23T14:51:56.779 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:56 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-23T14:51:56.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:56 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:56.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:56 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:56.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:56 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:51:56.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:56 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:51:56.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:56 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:56.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:56 smithi156 ceph-mon[32341]: pgmap v33: 65 pgs: 65 active+clean; 235 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 461 op/s 2024-04-23T14:51:56.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:56 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:51:56.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:56 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:51:56.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:56 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:51:56.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:56 smithi156 ceph-mon[32341]: Upgrade: Setting container_image for all mgr 2024-04-23T14:51:56.788 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:56 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:56.788 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:56 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi081.ldghvq"}]: dispatch 2024-04-23T14:51:56.788 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:56 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi081.ldghvq"}]': finished 2024-04-23T14:51:56.788 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:56 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi156.ounwyj"}]: dispatch 2024-04-23T14:51:56.788 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:56 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi156.ounwyj"}]': finished 2024-04-23T14:51:56.788 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:56 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-23T14:51:56.904 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-23T14:51:56.904 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-23T14:51:58.386 DEBUG:teuthology.parallel:result is None 2024-04-23T14:51:58.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:58 smithi156 ceph-mon[32341]: pgmap v34: 65 pgs: 65 active+clean; 227 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 612 op/s 2024-04-23T14:51:58.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:58 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:58.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:58 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T14:51:58.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:58 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-23T14:51:58.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:58 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:51:58.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:58 smithi081 ceph-mon[25540]: pgmap v34: 65 pgs: 65 active+clean; 227 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 612 op/s 2024-04-23T14:51:58.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:58 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' 2024-04-23T14:51:58.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:58 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T14:51:58.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:58 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-23T14:51:58.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:58 smithi081 ceph-mon[25540]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:51:59.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:59 smithi156 ceph-mon[32341]: Upgrade: Updating mon.smithi081 2024-04-23T14:51:59.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:51:59 smithi156 ceph-mon[32341]: Deploying daemon mon.smithi081 on smithi081 2024-04-23T14:51:59.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:59 smithi081 ceph-mon[25540]: Upgrade: Updating mon.smithi081 2024-04-23T14:51:59.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:51:59 smithi081 ceph-mon[25540]: Deploying daemon mon.smithi081 on smithi081 2024-04-23T14:52:00.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:00 smithi081 ceph-mon[25540]: pgmap v35: 65 pgs: 65 active+clean; 227 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 306 op/s 2024-04-23T14:52:00.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:00 smithi156 ceph-mon[32341]: pgmap v35: 65 pgs: 65 active+clean; 227 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 306 op/s 2024-04-23T14:52:02.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:02 smithi081 ceph-mon[25540]: pgmap v36: 65 pgs: 65 active+clean; 223 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 418 op/s 2024-04-23T14:52:02.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:02 smithi081 systemd[1]: Stopping Ceph mon.smithi081 for 7a641bea-017e-11ef-bc93-c7b262605968... 2024-04-23T14:52:03.024 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:02 smithi156 ceph-mon[32341]: pgmap v36: 65 pgs: 65 active+clean; 223 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 418 op/s 2024-04-23T14:52:03.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:03 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi081[25536]: 2024-04-23T14:52:03.005+0000 7f340b800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi081 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T14:52:03.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:03 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi081[25536]: 2024-04-23T14:52:03.005+0000 7f340b800700 -1 mon.smithi081@0(leader) e2 *** Got Signal Terminated *** 2024-04-23T14:52:03.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:03 smithi081 podman[90278]: 2024-04-23 14:52:03.223100964 +0000 UTC m=+0.361393567 container died 6e43d934b3363fcd52d6e0fbea127fe2882aab6077bc3f6253422d6c650ca0f5 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi081, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=quincy-70d0cb4, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux ) 2024-04-23T14:52:03.593 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-04-23T14:52:03.593 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-04-23T14:52:04.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:03 smithi081 podman[90278]: 2024-04-23 14:52:03.735370297 +0000 UTC m=+0.873662893 container cleanup 6e43d934b3363fcd52d6e0fbea127fe2882aab6077bc3f6253422d6c650ca0f5 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi081, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, RELEASE=quincy-70d0cb4, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T14:52:04.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:03 smithi081 bash[90278]: ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi081 2024-04-23T14:52:04.575 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:04 smithi081 podman[90303]: 2024-04-23 14:52:04.137178666 +0000 UTC m=+0.899778639 container remove 6e43d934b3363fcd52d6e0fbea127fe2882aab6077bc3f6253422d6c650ca0f5 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi081, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=quincy-70d0cb4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux ) 2024-04-23T14:52:04.675 DEBUG:teuthology.parallel:result is None 2024-04-23T14:52:04.676 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-23T14:52:05.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:04 smithi081 systemd[1]: ceph-7a641bea-017e-11ef-bc93-c7b262605968@mon.smithi081.service: Deactivated successfully. 2024-04-23T14:52:05.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:04 smithi081 systemd[1]: Stopped Ceph mon.smithi081 for 7a641bea-017e-11ef-bc93-c7b262605968. 2024-04-23T14:52:05.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:04 smithi081 systemd[1]: ceph-7a641bea-017e-11ef-bc93-c7b262605968@mon.smithi081.service: Consumed 24.707s CPU time. 2024-04-23T14:52:05.303 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-23T14:52:05.303 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-04-23T14:52:05.394 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-04-23T14:52:05.394 DEBUG:teuthology.parallel:result is None 2024-04-23T14:52:05.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:05 smithi081 systemd[1]: Starting Ceph mon.smithi081 for 7a641bea-017e-11ef-bc93-c7b262605968... 2024-04-23T14:52:06.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:05 smithi081 podman[90449]: 2024-04-23 14:52:05.570454229 +0000 UTC m=+0.033651999 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T14:52:11.136 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:10 smithi081 podman[90449]: 2024-04-23 14:52:10.855955231 +0000 UTC m=+5.319153038 container create fbf9f9a59ac21faf47d8e5ff49a2189f8c339d10a5367facae413f9eb37ebccc (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi081, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-04-23T14:52:11.578 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 podman[90449]: 2024-04-23 14:52:11.135121297 +0000 UTC m=+5.598319148 container init fbf9f9a59ac21faf47d8e5ff49a2189f8c339d10a5367facae413f9eb37ebccc (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi081, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd) 2024-04-23T14:52:11.578 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 podman[90449]: 2024-04-23 14:52:11.14633376 +0000 UTC m=+5.609531547 container start fbf9f9a59ac21faf47d8e5ff49a2189f8c339d10a5367facae413f9eb37ebccc (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi081, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-04-23T14:52:11.578 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: set uid:gid to 167:167 (ceph:ceph) 2024-04-23T14:52:11.578 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev), process ceph-mon, pid 2 2024-04-23T14:52:11.578 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: pidfile_write: ignore empty --pid-file 2024-04-23T14:52:11.578 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: load: jerasure load: lrc 2024-04-23T14:52:11.579 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: RocksDB version: 7.9.2 2024-04-23T14:52:11.579 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Git sha 0 2024-04-23T14:52:11.579 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Compile date 2024-04-22 13:15:13 2024-04-23T14:52:11.579 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: DB SUMMARY 2024-04-23T14:52:11.579 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: DB Session ID: Z05N2J0FCPLGG39SJ4PB 2024-04-23T14:52:11.579 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: CURRENT file: CURRENT 2024-04-23T14:52:11.579 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: IDENTITY file: IDENTITY 2024-04-23T14:52:11.579 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1144 Bytes 2024-04-23T14:52:11.579 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi081/store.db dir, Total Num: 1, files: 000033.sst 2024-04-23T14:52:11.579 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi081/store.db: 000031.log size: 2639959 ; 2024-04-23T14:52:11.579 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.error_if_exists: 0 2024-04-23T14:52:11.579 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.create_if_missing: 0 2024-04-23T14:52:11.579 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.paranoid_checks: 1 2024-04-23T14:52:11.579 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-23T14:52:11.579 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-23T14:52:11.579 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-23T14:52:11.580 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.env: 0x558400808cc0 2024-04-23T14:52:11.580 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.fs: PosixFileSystem 2024-04-23T14:52:11.580 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.info_log: 0x558411e9bb00 2024-04-23T14:52:11.580 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.max_file_opening_threads: 16 2024-04-23T14:52:11.580 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.statistics: (nil) 2024-04-23T14:52:11.581 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.use_fsync: 0 2024-04-23T14:52:11.581 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.max_log_file_size: 0 2024-04-23T14:52:11.581 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-23T14:52:11.581 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-23T14:52:11.581 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.keep_log_file_num: 1000 2024-04-23T14:52:11.581 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.recycle_log_file_num: 0 2024-04-23T14:52:11.581 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.allow_fallocate: 1 2024-04-23T14:52:11.581 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.allow_mmap_reads: 0 2024-04-23T14:52:11.581 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.allow_mmap_writes: 0 2024-04-23T14:52:11.581 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.use_direct_reads: 0 2024-04-23T14:52:11.581 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-23T14:52:11.581 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.create_missing_column_families: 0 2024-04-23T14:52:11.581 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.db_log_dir: 2024-04-23T14:52:11.581 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.wal_dir: 2024-04-23T14:52:11.581 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-23T14:52:11.582 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-23T14:52:11.582 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-23T14:52:11.582 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-23T14:52:11.582 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-23T14:52:11.582 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-23T14:52:11.582 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.advise_random_on_open: 1 2024-04-23T14:52:11.582 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.db_write_buffer_size: 0 2024-04-23T14:52:11.582 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.write_buffer_manager: 0x558411e6a1e0 2024-04-23T14:52:11.582 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-23T14:52:11.582 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-23T14:52:11.582 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-23T14:52:11.582 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.rate_limiter: (nil) 2024-04-23T14:52:11.582 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-23T14:52:11.582 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.wal_recovery_mode: 2 2024-04-23T14:52:11.583 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.enable_thread_tracking: 0 2024-04-23T14:52:11.583 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.enable_pipelined_write: 0 2024-04-23T14:52:11.583 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.unordered_write: 0 2024-04-23T14:52:11.583 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-23T14:52:11.583 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-23T14:52:11.583 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-23T14:52:11.583 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-23T14:52:11.583 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.row_cache: None 2024-04-23T14:52:11.583 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.wal_filter: None 2024-04-23T14:52:11.583 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-23T14:52:11.583 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.allow_ingest_behind: 0 2024-04-23T14:52:11.583 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.two_write_queues: 0 2024-04-23T14:52:11.583 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.manual_wal_flush: 0 2024-04-23T14:52:11.583 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.wal_compression: 0 2024-04-23T14:52:11.583 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.atomic_flush: 0 2024-04-23T14:52:11.584 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-23T14:52:11.584 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-23T14:52:11.584 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-23T14:52:11.584 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.log_readahead_size: 0 2024-04-23T14:52:11.584 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-23T14:52:11.584 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.best_efforts_recovery: 0 2024-04-23T14:52:11.584 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-23T14:52:11.584 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-23T14:52:11.584 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.allow_data_in_errors: 0 2024-04-23T14:52:11.584 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.db_host_id: __hostname__ 2024-04-23T14:52:11.584 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-23T14:52:11.584 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.max_background_jobs: 2 2024-04-23T14:52:11.584 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.max_background_compactions: -1 2024-04-23T14:52:11.584 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.max_subcompactions: 1 2024-04-23T14:52:11.585 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-23T14:52:11.585 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-23T14:52:11.585 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-23T14:52:11.585 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.max_total_wal_size: 0 2024-04-23T14:52:11.585 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-23T14:52:11.585 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-23T14:52:11.585 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-23T14:52:11.585 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-23T14:52:11.585 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.max_open_files: -1 2024-04-23T14:52:11.585 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.bytes_per_sync: 0 2024-04-23T14:52:11.585 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-23T14:52:11.585 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-23T14:52:11.585 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.compaction_readahead_size: 0 2024-04-23T14:52:11.586 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.max_background_flushes: -1 2024-04-23T14:52:11.586 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Compression algorithms supported: 2024-04-23T14:52:11.586 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-23T14:52:11.586 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: kZSTD supported: 0 2024-04-23T14:52:11.586 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: kXpressCompression supported: 0 2024-04-23T14:52:11.586 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: kLZ4HCCompression supported: 1 2024-04-23T14:52:11.586 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: kZlibCompression supported: 1 2024-04-23T14:52:11.586 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: kSnappyCompression supported: 1 2024-04-23T14:52:11.587 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: kLZ4Compression supported: 1 2024-04-23T14:52:11.588 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: kBZip2Compression supported: 0 2024-04-23T14:52:11.588 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-23T14:52:11.588 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-23T14:52:11.588 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi081/store.db/MANIFEST-000015 2024-04-23T14:52:11.588 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-23T14:52:11.588 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-23T14:52:11.588 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.merge_operator: 2024-04-23T14:52:11.588 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.compaction_filter: None 2024-04-23T14:52:11.588 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.compaction_filter_factory: None 2024-04-23T14:52:11.588 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.sst_partitioner_factory: None 2024-04-23T14:52:11.588 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-23T14:52:11.588 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-23T14:52:11.588 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x558411e9bce0) 2024-04-23T14:52:11.588 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: cache_index_and_filter_blocks: 1 2024-04-23T14:52:11.589 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-23T14:52:11.589 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-23T14:52:11.589 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: pin_top_level_index_and_filter: 1 2024-04-23T14:52:11.589 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: index_type: 0 2024-04-23T14:52:11.589 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: data_block_index_type: 0 2024-04-23T14:52:11.589 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: index_shortening: 1 2024-04-23T14:52:11.589 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-23T14:52:11.589 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: checksum: 4 2024-04-23T14:52:11.589 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: no_block_cache: 0 2024-04-23T14:52:11.589 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: block_cache: 0x558411e9d090 2024-04-23T14:52:11.589 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: block_cache_name: BinnedLRUCache 2024-04-23T14:52:11.589 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: block_cache_options: 2024-04-23T14:52:11.589 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: capacity : 536870912 2024-04-23T14:52:11.589 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: num_shard_bits : 4 2024-04-23T14:52:11.589 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: strict_capacity_limit : 0 2024-04-23T14:52:11.590 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: high_pri_pool_ratio: 0.000 2024-04-23T14:52:11.590 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: block_cache_compressed: (nil) 2024-04-23T14:52:11.590 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: persistent_cache: (nil) 2024-04-23T14:52:11.590 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: block_size: 4096 2024-04-23T14:52:11.590 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: block_size_deviation: 10 2024-04-23T14:52:11.590 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: block_restart_interval: 16 2024-04-23T14:52:11.590 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: index_block_restart_interval: 1 2024-04-23T14:52:11.590 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: metadata_block_size: 4096 2024-04-23T14:52:11.590 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: partition_filters: 0 2024-04-23T14:52:11.590 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: use_delta_encoding: 1 2024-04-23T14:52:11.590 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: filter_policy: bloomfilter 2024-04-23T14:52:11.590 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: whole_key_filtering: 1 2024-04-23T14:52:11.590 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: verify_compression: 0 2024-04-23T14:52:11.590 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: read_amp_bytes_per_bit: 0 2024-04-23T14:52:11.591 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: format_version: 5 2024-04-23T14:52:11.591 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: enable_index_compression: 1 2024-04-23T14:52:11.591 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: block_align: 0 2024-04-23T14:52:11.591 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: max_auto_readahead_size: 262144 2024-04-23T14:52:11.591 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: prepopulate_block_cache: 0 2024-04-23T14:52:11.591 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: initial_auto_readahead_size: 8192 2024-04-23T14:52:11.591 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: num_file_reads_for_auto_readahead: 2 2024-04-23T14:52:11.591 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.write_buffer_size: 33554432 2024-04-23T14:52:11.591 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.max_write_buffer_number: 2 2024-04-23T14:52:11.591 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.compression: NoCompression 2024-04-23T14:52:11.591 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.bottommost_compression: Disabled 2024-04-23T14:52:11.591 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.prefix_extractor: nullptr 2024-04-23T14:52:11.591 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-23T14:52:11.591 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.num_levels: 7 2024-04-23T14:52:11.591 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-23T14:52:11.592 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-23T14:52:11.592 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-23T14:52:11.592 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-23T14:52:11.592 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-23T14:52:11.592 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-23T14:52:11.592 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-23T14:52:11.592 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-23T14:52:11.592 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-23T14:52:11.592 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-23T14:52:11.592 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-23T14:52:11.592 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-23T14:52:11.592 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-23T14:52:11.592 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.compression_opts.level: 32767 2024-04-23T14:52:11.592 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.compression_opts.strategy: 0 2024-04-23T14:52:11.592 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-23T14:52:11.593 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-23T14:52:11.593 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-23T14:52:11.593 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-23T14:52:11.593 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.compression_opts.enabled: false 2024-04-23T14:52:11.593 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-23T14:52:11.593 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-23T14:52:11.593 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-23T14:52:11.593 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-23T14:52:11.593 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.target_file_size_base: 67108864 2024-04-23T14:52:11.593 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-23T14:52:11.593 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-23T14:52:11.593 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-23T14:52:11.593 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-23T14:52:11.593 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-23T14:52:11.593 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-23T14:52:11.594 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-23T14:52:11.594 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-23T14:52:11.594 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-23T14:52:11.594 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-23T14:52:11.594 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-23T14:52:11.594 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-23T14:52:11.594 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-23T14:52:11.594 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-23T14:52:11.594 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.arena_block_size: 1048576 2024-04-23T14:52:11.594 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-23T14:52:11.594 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-23T14:52:11.594 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.disable_auto_compactions: 0 2024-04-23T14:52:11.594 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-23T14:52:11.594 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-23T14:52:11.594 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-23T14:52:11.595 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-23T14:52:11.595 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-23T14:52:11.595 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-23T14:52:11.595 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-23T14:52:11.595 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-23T14:52:11.595 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-23T14:52:11.595 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-23T14:52:11.595 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-23T14:52:11.595 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.inplace_update_support: 0 2024-04-23T14:52:11.595 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-23T14:52:11.595 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-23T14:52:11.595 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-23T14:52:11.595 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-23T14:52:11.595 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.bloom_locality: 0 2024-04-23T14:52:11.595 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.max_successive_merges: 0 2024-04-23T14:52:11.595 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-23T14:52:11.596 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.paranoid_file_checks: 0 2024-04-23T14:52:11.596 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.force_consistency_checks: 1 2024-04-23T14:52:11.596 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.report_bg_io_stats: 0 2024-04-23T14:52:11.596 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.ttl: 2592000 2024-04-23T14:52:11.596 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-23T14:52:11.596 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-23T14:52:11.596 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-23T14:52:11.596 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.enable_blob_files: false 2024-04-23T14:52:11.596 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.min_blob_size: 0 2024-04-23T14:52:11.596 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.blob_file_size: 268435456 2024-04-23T14:52:11.596 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-23T14:52:11.596 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-23T14:52:11.596 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-23T14:52:11.596 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-23T14:52:11.596 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-23T14:52:11.596 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.blob_file_starting_level: 0 2024-04-23T14:52:11.596 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-23T14:52:11.597 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 33.sst 2024-04-23T14:52:11.597 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-23T14:52:11.597 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi081/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 35, last_sequence is 11801, log_number is 31,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-23T14:52:11.597 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 31 2024-04-23T14:52:11.597 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 2dad8224-b58f-4a04-9af3-24c09c15ca67 2024-04-23T14:52:11.597 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713883931204181, "job": 1, "event": "recovery_started", "wal_files": [31]} 2024-04-23T14:52:11.597 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #31 mode 2 2024-04-23T14:52:11.597 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713883931217842, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 36, "file_size": 2425512, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 11802, "largest_seqno": 13072, "table_properties": {"data_size": 2419112, "index_size": 3947, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1413, "raw_key_size": 12622, "raw_average_key_size": 22, "raw_value_size": 2407044, "raw_average_value_size": 4321, "num_data_blocks": 180, "num_entries": 557, "num_filter_entries": 557, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1713883931, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "2dad8224-b58f-4a04-9af3-24c09c15ca67", "db_session_id": "Z05N2J0FCPLGG39SJ4PB", "orig_file_number": 36, "seqno_to_time_mapping": "N/A"}} 2024-04-23T14:52:11.597 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713883931218038, "job": 1, "event": "recovery_finished"} 2024-04-23T14:52:11.597 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: [db/version_set.cc:5047] Creating manifest 38 2024-04-23T14:52:11.597 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-23T14:52:11.597 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi081/store.db/000031.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-23T14:52:11.597 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x558411f8a000 2024-04-23T14:52:11.597 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: DB pointer 0x558411f74000 2024-04-23T14:52:11.598 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-23T14:52:11.598 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-23T14:52:11.598 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: ** DB Stats ** 2024-04-23T14:52:11.598 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-23T14:52:11.598 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-23T14:52:11.598 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-23T14:52:11.598 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-23T14:52:11.598 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-23T14:52:11.598 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-23T14:52:11.598 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-23T14:52:11.598 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: 2024-04-23T14:52:11.598 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: ** Compaction Stats [default] ** 2024-04-23T14:52:11.598 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-23T14:52:11.598 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-23T14:52:11.599 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: L0 1/0 2.31 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 364.0 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-04-23T14:52:11.599 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: L6 1/0 5.44 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-04-23T14:52:11.599 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Sum 2/0 7.75 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 364.0 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-04-23T14:52:11.599 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 364.0 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-04-23T14:52:11.599 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: 2024-04-23T14:52:11.599 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: ** Compaction Stats [default] ** 2024-04-23T14:52:11.599 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-23T14:52:11.599 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-23T14:52:11.599 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 364.0 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-04-23T14:52:11.599 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: 2024-04-23T14:52:11.599 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-23T14:52:11.599 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: 2024-04-23T14:52:11.599 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-23T14:52:11.599 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-04-23T14:52:11.599 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-23T14:52:11.600 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-23T14:52:11.600 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-23T14:52:11.600 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-23T14:52:11.600 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Cumulative compaction: 0.00 GB write, 122.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-23T14:52:11.600 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Interval compaction: 0.00 GB write, 122.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-23T14:52:11.600 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-23T14:52:11.600 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Block cache BinnedLRUCache@0x558411e9d090#2 capacity: 512.00 MB usage: 5.61 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.5e-05 secs_since: 0 2024-04-23T14:52:11.600 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.53 KB,0.000292063%) IndexBlock(1,4.08 KB,0.000777841%) Misc(1,0.00 KB,0%) 2024-04-23T14:52:11.600 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: 2024-04-23T14:52:11.600 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-23T14:52:11.600 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: starting mon.smithi081 rank 0 at public addrs [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] at bind addrs [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi081 fsid 7a641bea-017e-11ef-bc93-c7b262605968 2024-04-23T14:52:11.600 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: mon.smithi081@-1(???) e2 preinit fsid 7a641bea-017e-11ef-bc93-c7b262605968 2024-04-23T14:52:11.600 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: mon.smithi081@-1(???).mds e18 new map 2024-04-23T14:52:11.600 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: mon.smithi081@-1(???).mds e18 print_map 2024-04-23T14:52:11.600 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: e18 2024-04-23T14:52:11.601 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-23T14:52:11.601 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:52:11.601 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: legacy client fscid: 1 2024-04-23T14:52:11.601 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: 2024-04-23T14:52:11.601 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Filesystem 'cephfs' (1) 2024-04-23T14:52:11.601 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: fs_name cephfs 2024-04-23T14:52:11.601 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: epoch 17 2024-04-23T14:52:11.601 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-23T14:52:11.601 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: created 2024-04-23T14:45:51.264703+0000 2024-04-23T14:52:11.601 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: modified 2024-04-23T14:46:12.782992+0000 2024-04-23T14:52:11.601 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: tableserver 0 2024-04-23T14:52:11.601 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: root 0 2024-04-23T14:52:11.601 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: session_timeout 60 2024-04-23T14:52:11.601 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: session_autoclose 300 2024-04-23T14:52:11.601 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: max_file_size 1099511627776 2024-04-23T14:52:11.602 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: max_xattr_size 65536 2024-04-23T14:52:11.602 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: required_client_features {} 2024-04-23T14:52:11.602 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: last_failure 0 2024-04-23T14:52:11.602 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: last_failure_osd_epoch 47 2024-04-23T14:52:11.602 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:52:11.602 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: max_mds 1 2024-04-23T14:52:11.602 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: in 0 2024-04-23T14:52:11.602 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: up {0=14472} 2024-04-23T14:52:11.602 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: failed 2024-04-23T14:52:11.602 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: damaged 2024-04-23T14:52:11.602 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: stopped 2024-04-23T14:52:11.602 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: data_pools [3] 2024-04-23T14:52:11.602 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: metadata_pool 2 2024-04-23T14:52:11.602 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: inline_data disabled 2024-04-23T14:52:11.603 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: balancer 2024-04-23T14:52:11.603 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: bal_rank_mask -1 2024-04-23T14:52:11.603 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: standby_count_wanted 1 2024-04-23T14:52:11.603 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: qdb_cluster leader: 0 members: 2024-04-23T14:52:11.603 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: [mds.cephfs.smithi081.vcoywg{0:14472} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.81:6828/2563365650,v1:172.21.15.81:6829/2563365650] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:52:11.603 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: [mds.cephfs.smithi081.wydgcg{0:14482} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.81:6826/759909104,v1:172.21.15.81:6827/759909104] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:52:11.603 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: 2024-04-23T14:52:11.603 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: 2024-04-23T14:52:11.603 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: Standby daemons: 2024-04-23T14:52:11.603 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: 2024-04-23T14:52:11.603 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: [mds.cephfs.smithi156.vynkxn{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.156:6826/1794690362,v1:172.21.15.156:6827/1794690362] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:52:11.603 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout: [mds.cephfs.smithi156.rhbtxt{-1:24263} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.156:6824/3854041261,v1:172.21.15.156:6825/3854041261] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:52:11.603 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: mon.smithi081@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-04-23T14:52:11.603 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: mon.smithi081@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-04-23T14:52:11.603 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: mon.smithi081@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-04-23T14:52:11.604 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: mon.smithi081@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-04-23T14:52:11.604 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 ceph-mon[90469]: mon.smithi081@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2024-04-23T14:52:11.604 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 bash[90449]: fbf9f9a59ac21faf47d8e5ff49a2189f8c339d10a5367facae413f9eb37ebccc 2024-04-23T14:52:11.604 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:11 smithi081 systemd[1]: Started Ceph mon.smithi081 for 7a641bea-017e-11ef-bc93-c7b262605968. 2024-04-23T14:52:17.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:17 smithi081 ceph-mon[90469]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi081"}]: dispatch 2024-04-23T14:52:17.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:17 smithi081 ceph-mon[90469]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2024-04-23T14:52:17.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:17 smithi081 ceph-mon[90469]: pgmap v37: 65 pgs: 65 active+clean; 217 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 961 KiB/s rd, 1.0 MiB/s wr, 350 op/s 2024-04-23T14:52:17.828 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:17 smithi081 ceph-mon[90469]: pgmap v38: 65 pgs: 65 active+clean; 217 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 958 KiB/s rd, 1004 KiB/s wr, 307 op/s 2024-04-23T14:52:17.828 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:17 smithi081 ceph-mon[90469]: pgmap v39: 65 pgs: 65 active+clean; 205 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 377 op/s 2024-04-23T14:52:17.828 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:17 smithi081 ceph-mon[90469]: pgmap v40: 65 pgs: 65 active+clean; 205 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 691 KiB/s rd, 624 KiB/s wr, 226 op/s 2024-04-23T14:52:17.828 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:17 smithi081 ceph-mon[90469]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:52:17.828 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:17 smithi081 ceph-mon[90469]: pgmap v41: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 693 KiB/s rd, 626 KiB/s wr, 228 op/s 2024-04-23T14:52:17.828 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:17 smithi081 ceph-mon[90469]: pgmap v42: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 218 KiB/s rd, 209 KiB/s wr, 116 op/s 2024-04-23T14:52:17.828 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:17 smithi081 ceph-mon[90469]: pgmap v43: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 218 KiB/s rd, 205 KiB/s wr, 71 op/s 2024-04-23T14:52:17.828 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:17 smithi081 ceph-mon[90469]: mon.smithi156 calling monitor election 2024-04-23T14:52:17.828 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:17 smithi081 ceph-mon[90469]: mon.smithi081 calling monitor election 2024-04-23T14:52:17.828 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:17 smithi081 ceph-mon[90469]: mon.smithi081 is new leader, mons smithi081,smithi156 in quorum (ranks 0,1) 2024-04-23T14:52:17.828 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:17 smithi081 ceph-mon[90469]: monmap epoch 2 2024-04-23T14:52:17.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:17 smithi081 ceph-mon[90469]: fsid 7a641bea-017e-11ef-bc93-c7b262605968 2024-04-23T14:52:17.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:17 smithi081 ceph-mon[90469]: last_changed 2024-04-23T14:40:15.732440+0000 2024-04-23T14:52:17.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:17 smithi081 ceph-mon[90469]: created 2024-04-23T14:37:02.223037+0000 2024-04-23T14:52:17.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:17 smithi081 ceph-mon[90469]: min_mon_release 17 (quincy) 2024-04-23T14:52:17.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:17 smithi081 ceph-mon[90469]: election_strategy: 1 2024-04-23T14:52:17.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:17 smithi081 ceph-mon[90469]: 0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.smithi081 2024-04-23T14:52:17.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:17 smithi081 ceph-mon[90469]: 1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.smithi156 2024-04-23T14:52:17.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:17 smithi081 ceph-mon[90469]: fsmap cephfs:1 {0=cephfs.smithi081.vcoywg=up:active} 1 up:standby-replay 2 up:standby 2024-04-23T14:52:17.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:17 smithi081 ceph-mon[90469]: osdmap e49: 6 total, 6 up, 6 in 2024-04-23T14:52:17.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:17 smithi081 ceph-mon[90469]: mgrmap e32: smithi081.ldghvq(active, since 82s), standbys: smithi156.ounwyj 2024-04-23T14:52:17.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:17 smithi081 ceph-mon[90469]: overall HEALTH_OK 2024-04-23T14:52:17.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:17 smithi081 ceph-mon[90469]: from='mgr.14738 ' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:17.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:17 smithi081 ceph-mon[90469]: mgrmap e33: smithi081.ldghvq(active, since 82s), standbys: smithi156.ounwyj 2024-04-23T14:52:17.839 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:17 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi081"}]: dispatch 2024-04-23T14:52:17.839 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:17 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2024-04-23T14:52:17.839 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:17 smithi156 ceph-mon[32341]: pgmap v37: 65 pgs: 65 active+clean; 217 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 961 KiB/s rd, 1.0 MiB/s wr, 350 op/s 2024-04-23T14:52:17.839 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:17 smithi156 ceph-mon[32341]: pgmap v38: 65 pgs: 65 active+clean; 217 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 958 KiB/s rd, 1004 KiB/s wr, 307 op/s 2024-04-23T14:52:17.839 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:17 smithi156 ceph-mon[32341]: pgmap v39: 65 pgs: 65 active+clean; 205 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 377 op/s 2024-04-23T14:52:17.840 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:17 smithi156 ceph-mon[32341]: pgmap v40: 65 pgs: 65 active+clean; 205 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 691 KiB/s rd, 624 KiB/s wr, 226 op/s 2024-04-23T14:52:17.840 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:17 smithi156 ceph-mon[32341]: from='mgr.14738 172.21.15.81:0/123856085' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:52:17.840 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:17 smithi156 ceph-mon[32341]: pgmap v41: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 693 KiB/s rd, 626 KiB/s wr, 228 op/s 2024-04-23T14:52:17.840 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:17 smithi156 ceph-mon[32341]: pgmap v42: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 218 KiB/s rd, 209 KiB/s wr, 116 op/s 2024-04-23T14:52:17.840 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:17 smithi156 ceph-mon[32341]: pgmap v43: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 218 KiB/s rd, 205 KiB/s wr, 71 op/s 2024-04-23T14:52:17.840 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:17 smithi156 ceph-mon[32341]: mon.smithi156 calling monitor election 2024-04-23T14:52:17.840 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:17 smithi156 ceph-mon[32341]: mon.smithi081 calling monitor election 2024-04-23T14:52:17.840 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:17 smithi156 ceph-mon[32341]: mon.smithi081 is new leader, mons smithi081,smithi156 in quorum (ranks 0,1) 2024-04-23T14:52:17.840 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:17 smithi156 ceph-mon[32341]: monmap epoch 2 2024-04-23T14:52:17.840 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:17 smithi156 ceph-mon[32341]: fsid 7a641bea-017e-11ef-bc93-c7b262605968 2024-04-23T14:52:17.840 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:17 smithi156 ceph-mon[32341]: last_changed 2024-04-23T14:40:15.732440+0000 2024-04-23T14:52:17.841 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:17 smithi156 ceph-mon[32341]: created 2024-04-23T14:37:02.223037+0000 2024-04-23T14:52:17.841 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:17 smithi156 ceph-mon[32341]: min_mon_release 17 (quincy) 2024-04-23T14:52:17.841 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:17 smithi156 ceph-mon[32341]: election_strategy: 1 2024-04-23T14:52:17.841 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:17 smithi156 ceph-mon[32341]: 0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.smithi081 2024-04-23T14:52:17.841 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:17 smithi156 ceph-mon[32341]: 1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.smithi156 2024-04-23T14:52:17.841 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:17 smithi156 ceph-mon[32341]: fsmap cephfs:1 {0=cephfs.smithi081.vcoywg=up:active} 1 up:standby-replay 2 up:standby 2024-04-23T14:52:17.841 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:17 smithi156 ceph-mon[32341]: osdmap e49: 6 total, 6 up, 6 in 2024-04-23T14:52:17.841 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:17 smithi156 ceph-mon[32341]: mgrmap e32: smithi081.ldghvq(active, since 82s), standbys: smithi156.ounwyj 2024-04-23T14:52:17.841 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:17 smithi156 ceph-mon[32341]: overall HEALTH_OK 2024-04-23T14:52:17.841 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:17 smithi156 ceph-mon[32341]: from='mgr.14738 ' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:17.841 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:17 smithi156 ceph-mon[32341]: mgrmap e33: smithi081.ldghvq(active, since 82s), standbys: smithi156.ounwyj 2024-04-23T14:52:17.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:17.921+0000 7f48fe200700 1 -- 172.21.15.81:0/371414501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48f8071ea0 msgr2=0x7f48f80703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:17.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:17.921+0000 7f48fe200700 1 --2- 172.21.15.81:0/371414501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48f8071ea0 0x7f48f80703b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f48ec004960 tx=0x7f48ec00b040 comp rx=0 tx=0).stop 2024-04-23T14:52:17.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:17.921+0000 7f48fe200700 1 -- 172.21.15.81:0/371414501 shutdown_connections 2024-04-23T14:52:17.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:17.921+0000 7f48fe200700 1 --2- 172.21.15.81:0/371414501 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48f80708f0 0x7f48f8070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:17.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:17.921+0000 7f48fe200700 1 --2- 172.21.15.81:0/371414501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48f8071ea0 0x7f48f80703b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:17.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:17.921+0000 7f48fe200700 1 -- 172.21.15.81:0/371414501 >> 172.21.15.81:0/371414501 conn(0x7f48f80f83d0 msgr2=0x7f48f80fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:17.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:17.921+0000 7f48fe200700 1 -- 172.21.15.81:0/371414501 shutdown_connections 2024-04-23T14:52:17.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:17.921+0000 7f48fe200700 1 -- 172.21.15.81:0/371414501 wait complete. 2024-04-23T14:52:17.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:17.922+0000 7f48fe200700 1 Processor -- start 2024-04-23T14:52:17.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:17.923+0000 7f48fe200700 1 -- start start 2024-04-23T14:52:17.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:17.923+0000 7f48fe200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48f80708f0 0x7f48f810fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:17.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:17.923+0000 7f48fe200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48f8071ea0 0x7f48f810ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:17.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:17.923+0000 7f48fe200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f8110550 con 0x7f48f8071ea0 2024-04-23T14:52:17.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:17.923+0000 7f48fe200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f8110da0 con 0x7f48f80708f0 2024-04-23T14:52:17.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:17.924+0000 7f48f7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48f8071ea0 0x7f48f810ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:17.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:17.924+0000 7f48f7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48f8071ea0 0x7f48f810ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60916/0 (socket says 172.21.15.81:60916) 2024-04-23T14:52:17.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:17.924+0000 7f48f7e00700 1 -- 172.21.15.81:0/2544342601 learned_addr learned my addr 172.21.15.81:0/2544342601 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:52:17.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:17.924+0000 7f48fce00700 1 --2- 172.21.15.81:0/2544342601 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48f80708f0 0x7f48f810fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:17.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:17.924+0000 7f48f7e00700 1 -- 172.21.15.81:0/2544342601 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48f80708f0 msgr2=0x7f48f810fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:17.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:17.924+0000 7f48f7e00700 1 --2- 172.21.15.81:0/2544342601 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48f80708f0 0x7f48f810fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:17.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:17.924+0000 7f48f7e00700 1 -- 172.21.15.81:0/2544342601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ec005040 con 0x7f48f8071ea0 2024-04-23T14:52:17.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:17.924+0000 7f48f7e00700 1 --2- 172.21.15.81:0/2544342601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48f8071ea0 0x7f48f810ff50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f48e4010bf0 tx=0x7f48e400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:17.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:17.925+0000 7f48f4c00700 1 -- 172.21.15.81:0/2544342601 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48e4007ea0 con 0x7f48f8071ea0 2024-04-23T14:52:17.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:17.925+0000 7f48f4c00700 1 -- 172.21.15.81:0/2544342601 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f48e400f040 con 0x7f48f8071ea0 2024-04-23T14:52:17.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:17.925+0000 7f48fe200700 1 -- 172.21.15.81:0/2544342601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48f8111080 con 0x7f48f8071ea0 2024-04-23T14:52:17.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:17.925+0000 7f48f4c00700 1 -- 172.21.15.81:0/2544342601 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48e4009840 con 0x7f48f8071ea0 2024-04-23T14:52:17.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:17.925+0000 7f48fe200700 1 -- 172.21.15.81:0/2544342601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48f81115c0 con 0x7f48f8071ea0 2024-04-23T14:52:17.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:17.926+0000 7f48fe200700 1 -- 172.21.15.81:0/2544342601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48f805f5f0 con 0x7f48f8071ea0 2024-04-23T14:52:17.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:17.927+0000 7f48f4c00700 1 -- 172.21.15.81:0/2544342601 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 33) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f48e400e630 con 0x7f48f8071ea0 2024-04-23T14:52:17.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:17.928+0000 7f48f4c00700 1 --2- 172.21.15.81:0/2544342601 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f48e006ed20 0x7f48e00711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:17.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:17.928+0000 7f48f4c00700 1 -- 172.21.15.81:0/2544342601 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f48e408edb0 con 0x7f48f8071ea0 2024-04-23T14:52:17.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:17.928+0000 7f48fce00700 1 -- 172.21.15.81:0/2544342601 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f48e006ed20 msgr2=0x7f48e00711d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/1880997914 2024-04-23T14:52:17.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:17.928+0000 7f48fce00700 1 --2- 172.21.15.81:0/2544342601 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f48e006ed20 0x7f48e00711d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T14:52:17.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:17.934+0000 7f48f4c00700 1 -- 172.21.15.81:0/2544342601 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f48e405b5f0 con 0x7f48f8071ea0 2024-04-23T14:52:18.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:18.129+0000 7f48fce00700 1 -- 172.21.15.81:0/2544342601 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f48e006ed20 msgr2=0x7f48e00711d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/1880997914 2024-04-23T14:52:18.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:18.129+0000 7f48fce00700 1 --2- 172.21.15.81:0/2544342601 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f48e006ed20 0x7f48e00711d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-23T14:52:18.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:18.204+0000 7f48fe200700 1 -- 172.21.15.81:0/2544342601 --> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f48f8111890 con 0x7f48e006ed20 2024-04-23T14:52:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:18.530+0000 7f48fce00700 1 -- 172.21.15.81:0/2544342601 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f48e006ed20 msgr2=0x7f48e00711d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/1880997914 2024-04-23T14:52:18.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:18.530+0000 7f48fce00700 1 --2- 172.21.15.81:0/2544342601 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f48e006ed20 0x7f48e00711d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-23T14:52:19.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:19.331+0000 7f48fce00700 1 -- 172.21.15.81:0/2544342601 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f48e006ed20 msgr2=0x7f48e00711d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/1880997914 2024-04-23T14:52:19.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:19.331+0000 7f48fce00700 1 --2- 172.21.15.81:0/2544342601 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f48e006ed20 0x7f48e00711d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-23T14:52:20.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:20.933+0000 7f48fce00700 1 -- 172.21.15.81:0/2544342601 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f48e006ed20 msgr2=0x7f48e00711d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/1880997914 2024-04-23T14:52:20.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:20.933+0000 7f48fce00700 1 --2- 172.21.15.81:0/2544342601 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f48e006ed20 0x7f48e00711d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-23T14:52:24.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:24.136+0000 7f48fce00700 1 -- 172.21.15.81:0/2544342601 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f48e006ed20 msgr2=0x7f48e00711d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/1880997914 2024-04-23T14:52:24.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:24.136+0000 7f48fce00700 1 --2- 172.21.15.81:0/2544342601 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f48e006ed20 0x7f48e00711d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-23T14:52:26.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:26.450+0000 7f48f4c00700 1 -- 172.21.15.81:0/2544342601 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 34) v1 ==== 92370+0+0 (secure 0 0 0) 0x7f48e4057e90 con 0x7f48f8071ea0 2024-04-23T14:52:26.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:26.450+0000 7f48f4c00700 1 -- 172.21.15.81:0/2544342601 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f48e006ed20 msgr2=0x7f48e00711d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-23T14:52:26.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:26.450+0000 7f48f4c00700 1 --2- 172.21.15.81:0/2544342601 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f48e006ed20 0x7f48e00711d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:26.671 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:26 smithi156 ceph-mon[32341]: Standby manager daemon smithi156.ounwyj restarted 2024-04-23T14:52:26.671 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:26 smithi156 ceph-mon[32341]: Standby manager daemon smithi156.ounwyj started 2024-04-23T14:52:26.672 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:26 smithi156 ceph-mon[32341]: from='mgr.? 172.21.15.156:0/3493160569' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi156.ounwyj/crt"}]: dispatch 2024-04-23T14:52:26.672 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:26 smithi156 ceph-mon[32341]: from='mgr.? 172.21.15.156:0/3493160569' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-23T14:52:26.672 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:26 smithi156 ceph-mon[32341]: from='mgr.? 172.21.15.156:0/3493160569' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi156.ounwyj/key"}]: dispatch 2024-04-23T14:52:26.672 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:26 smithi156 ceph-mon[32341]: from='mgr.? 172.21.15.156:0/3493160569' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-23T14:52:26.672 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:26 smithi156 ceph-mon[32341]: Active manager daemon smithi081.ldghvq restarted 2024-04-23T14:52:26.672 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:26 smithi156 ceph-mon[32341]: Activating manager daemon smithi081.ldghvq 2024-04-23T14:52:26.672 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:26 smithi156 ceph-mon[32341]: osdmap e50: 6 total, 6 up, 6 in 2024-04-23T14:52:26.672 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:26 smithi156 ceph-mon[32341]: mgrmap e34: smithi081.ldghvq(active, starting, since 0.0204805s), standbys: smithi156.ounwyj 2024-04-23T14:52:26.672 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:26 smithi156 ceph-mon[32341]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi081"}]: dispatch 2024-04-23T14:52:26.672 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:26 smithi156 ceph-mon[32341]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2024-04-23T14:52:26.672 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:26 smithi156 ceph-mon[32341]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi081.vcoywg"}]: dispatch 2024-04-23T14:52:26.672 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:26 smithi156 ceph-mon[32341]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi081.wydgcg"}]: dispatch 2024-04-23T14:52:26.672 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:26 smithi156 ceph-mon[32341]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi156.vynkxn"}]: dispatch 2024-04-23T14:52:26.672 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:26 smithi156 ceph-mon[32341]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi156.rhbtxt"}]: dispatch 2024-04-23T14:52:26.673 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:26 smithi156 ceph-mon[32341]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mgr metadata", "who": "smithi081.ldghvq", "id": "smithi081.ldghvq"}]: dispatch 2024-04-23T14:52:26.673 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:26 smithi156 ceph-mon[32341]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mgr metadata", "who": "smithi156.ounwyj", "id": "smithi156.ounwyj"}]: dispatch 2024-04-23T14:52:26.673 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:26 smithi156 ceph-mon[32341]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:52:26.673 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:26 smithi156 ceph-mon[32341]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T14:52:26.673 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:26 smithi156 ceph-mon[32341]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T14:52:26.673 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:26 smithi156 ceph-mon[32341]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T14:52:26.673 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:26 smithi156 ceph-mon[32341]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T14:52:26.673 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:26 smithi156 ceph-mon[32341]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T14:52:26.673 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:26 smithi156 ceph-mon[32341]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-23T14:52:26.673 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:26 smithi156 ceph-mon[32341]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-23T14:52:26.673 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:26 smithi156 ceph-mon[32341]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-23T14:52:26.684 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:26 smithi081 ceph-mon[90469]: Standby manager daemon smithi156.ounwyj restarted 2024-04-23T14:52:26.684 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:26 smithi081 ceph-mon[90469]: Standby manager daemon smithi156.ounwyj started 2024-04-23T14:52:26.684 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:26 smithi081 ceph-mon[90469]: from='mgr.? 172.21.15.156:0/3493160569' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi156.ounwyj/crt"}]: dispatch 2024-04-23T14:52:26.684 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:26 smithi081 ceph-mon[90469]: from='mgr.? 172.21.15.156:0/3493160569' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-23T14:52:26.684 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:26 smithi081 ceph-mon[90469]: from='mgr.? 172.21.15.156:0/3493160569' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi156.ounwyj/key"}]: dispatch 2024-04-23T14:52:26.684 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:26 smithi081 ceph-mon[90469]: from='mgr.? 172.21.15.156:0/3493160569' entity='mgr.smithi156.ounwyj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-23T14:52:26.684 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:26 smithi081 ceph-mon[90469]: Active manager daemon smithi081.ldghvq restarted 2024-04-23T14:52:26.684 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:26 smithi081 ceph-mon[90469]: Activating manager daemon smithi081.ldghvq 2024-04-23T14:52:26.685 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:26 smithi081 ceph-mon[90469]: osdmap e50: 6 total, 6 up, 6 in 2024-04-23T14:52:26.685 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:26 smithi081 ceph-mon[90469]: mgrmap e34: smithi081.ldghvq(active, starting, since 0.0204805s), standbys: smithi156.ounwyj 2024-04-23T14:52:26.685 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:26 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi081"}]: dispatch 2024-04-23T14:52:26.685 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:26 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2024-04-23T14:52:26.685 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:26 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi081.vcoywg"}]: dispatch 2024-04-23T14:52:26.685 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:26 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi081.wydgcg"}]: dispatch 2024-04-23T14:52:26.685 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:26 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi156.vynkxn"}]: dispatch 2024-04-23T14:52:26.685 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:26 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi156.rhbtxt"}]: dispatch 2024-04-23T14:52:26.685 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:26 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mgr metadata", "who": "smithi081.ldghvq", "id": "smithi081.ldghvq"}]: dispatch 2024-04-23T14:52:26.685 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:26 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mgr metadata", "who": "smithi156.ounwyj", "id": "smithi156.ounwyj"}]: dispatch 2024-04-23T14:52:26.685 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:26 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:52:26.685 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:26 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T14:52:26.685 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:26 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T14:52:26.686 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:26 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T14:52:26.686 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:26 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T14:52:26.686 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:26 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T14:52:26.686 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:26 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-23T14:52:26.686 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:26 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-23T14:52:26.686 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:26 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-23T14:52:27.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.486+0000 7f48f4c00700 1 -- 172.21.15.81:0/2544342601 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mgrmap(e 35) v1 ==== 92497+0+0 (secure 0 0 0) 0x7f48e40464b0 con 0x7f48f8071ea0 2024-04-23T14:52:27.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.487+0000 7f48f4c00700 1 --2- 172.21.15.81:0/2544342601 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f48e001dbf0 0x7f48e0078980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:27.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.487+0000 7f48f4c00700 1 -- 172.21.15.81:0/2544342601 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f48f8111890 con 0x7f48e001dbf0 2024-04-23T14:52:27.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.488+0000 7f48fce00700 1 --2- 172.21.15.81:0/2544342601 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f48e001dbf0 0x7f48e0078980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:27.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.489+0000 7f48fce00700 1 --2- 172.21.15.81:0/2544342601 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f48e001dbf0 0x7f48e0078980 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f48ec0093c0 tx=0x7f48ec00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:27.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.492+0000 7f48f4c00700 1 -- 172.21.15.81:0/2544342601 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f48f8111890 con 0x7f48e001dbf0 2024-04-23T14:52:27.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.495+0000 7f48fe200700 1 -- 172.21.15.81:0/2544342601 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f48e001dbf0 msgr2=0x7f48e0078980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:27.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.495+0000 7f48fe200700 1 --2- 172.21.15.81:0/2544342601 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f48e001dbf0 0x7f48e0078980 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f48ec0093c0 tx=0x7f48ec00b040 comp rx=0 tx=0).stop 2024-04-23T14:52:27.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.495+0000 7f48fe200700 1 -- 172.21.15.81:0/2544342601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48f8071ea0 msgr2=0x7f48f810ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:27.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.495+0000 7f48fe200700 1 --2- 172.21.15.81:0/2544342601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48f8071ea0 0x7f48f810ff50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f48e4010bf0 tx=0x7f48e400b040 comp rx=0 tx=0).stop 2024-04-23T14:52:27.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.495+0000 7f48fe200700 1 -- 172.21.15.81:0/2544342601 shutdown_connections 2024-04-23T14:52:27.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.495+0000 7f48fe200700 1 --2- 172.21.15.81:0/2544342601 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f48e001dbf0 0x7f48e0078980 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:27.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.495+0000 7f48fe200700 1 --2- 172.21.15.81:0/2544342601 >> [v2:172.21.15.81:6800/1880997914,v1:172.21.15.81:6801/1880997914] conn(0x7f48e006ed20 0x7f48e00711d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:27.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.495+0000 7f48fe200700 1 --2- 172.21.15.81:0/2544342601 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48f80708f0 0x7f48f810fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:27.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.495+0000 7f48fe200700 1 --2- 172.21.15.81:0/2544342601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48f8071ea0 0x7f48f810ff50 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:27.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.495+0000 7f48fe200700 1 -- 172.21.15.81:0/2544342601 >> 172.21.15.81:0/2544342601 conn(0x7f48f80f83d0 msgr2=0x7f48f80f9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:27.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.496+0000 7f48fe200700 1 -- 172.21.15.81:0/2544342601 shutdown_connections 2024-04-23T14:52:27.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.496+0000 7f48fe200700 1 -- 172.21.15.81:0/2544342601 wait complete. 2024-04-23T14:52:27.521 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-04-23T14:52:27.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.673+0000 7f9326600700 1 -- 172.21.15.81:0/3367181794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93201023d0 msgr2=0x7f93201047b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:27.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.673+0000 7f9326600700 1 --2- 172.21.15.81:0/3367181794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93201023d0 0x7f93201047b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f930c004940 tx=0x7f930c009e30 comp rx=0 tx=0).stop 2024-04-23T14:52:27.674 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:27 smithi081 ceph-mon[90469]: Manager daemon smithi081.ldghvq is now available 2024-04-23T14:52:27.674 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:27 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:52:27.674 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:27 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:52:27.674 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:27 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi081.ldghvq/mirror_snapshot_schedule"}]: dispatch 2024-04-23T14:52:27.674 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:27 smithi081 ceph-mon[90469]: from='mgr.34102 ' entity='mgr.smithi081.ldghvq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi081.ldghvq/mirror_snapshot_schedule"}]: dispatch 2024-04-23T14:52:27.674 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:27 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi081.ldghvq/trash_purge_schedule"}]: dispatch 2024-04-23T14:52:27.674 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:27 smithi081 ceph-mon[90469]: from='mgr.34102 ' entity='mgr.smithi081.ldghvq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi081.ldghvq/trash_purge_schedule"}]: dispatch 2024-04-23T14:52:27.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.673+0000 7f9326600700 1 -- 172.21.15.81:0/3367181794 shutdown_connections 2024-04-23T14:52:27.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.673+0000 7f9326600700 1 --2- 172.21.15.81:0/3367181794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93201023d0 0x7f93201047b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:27.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.673+0000 7f9326600700 1 --2- 172.21.15.81:0/3367181794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9320066290 0x7f9320101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:27.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.673+0000 7f9326600700 1 -- 172.21.15.81:0/3367181794 >> 172.21.15.81:0/3367181794 conn(0x7f93200f74c0 msgr2=0x7f93200f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:27.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.673+0000 7f9326600700 1 -- 172.21.15.81:0/3367181794 shutdown_connections 2024-04-23T14:52:27.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.673+0000 7f9326600700 1 -- 172.21.15.81:0/3367181794 wait complete. 2024-04-23T14:52:27.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.674+0000 7f9326600700 1 Processor -- start 2024-04-23T14:52:27.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.675+0000 7f9326600700 1 -- start start 2024-04-23T14:52:27.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.675+0000 7f9326600700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9320066290 0x7f932010fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:27.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.675+0000 7f9326600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93201023d0 0x7f9320110170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:27.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.675+0000 7f9326600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9320110770 con 0x7f93201023d0 2024-04-23T14:52:27.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.675+0000 7f9326600700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9320110fc0 con 0x7f9320066290 2024-04-23T14:52:27.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.675+0000 7f931f400700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9320066290 0x7f932010fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:27.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.676+0000 7f931f400700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9320066290 0x7f932010fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.81:54868/0 (socket says 172.21.15.81:54868) 2024-04-23T14:52:27.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.676+0000 7f931f400700 1 -- 172.21.15.81:0/70784201 learned_addr learned my addr 172.21.15.81:0/70784201 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:52:27.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.676+0000 7f931ea00700 1 --2- 172.21.15.81:0/70784201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93201023d0 0x7f9320110170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:27.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.676+0000 7f931ea00700 1 -- 172.21.15.81:0/70784201 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9320066290 msgr2=0x7f932010fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:27.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.676+0000 7f931ea00700 1 --2- 172.21.15.81:0/70784201 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9320066290 0x7f932010fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:27.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.676+0000 7f931ea00700 1 -- 172.21.15.81:0/70784201 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f930c005040 con 0x7f93201023d0 2024-04-23T14:52:27.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.677+0000 7f931ea00700 1 --2- 172.21.15.81:0/70784201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93201023d0 0x7f9320110170 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f930c00b970 tx=0x7f930c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:27.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.677+0000 7f9317400700 1 -- 172.21.15.81:0/70784201 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f930c00e040 con 0x7f93201023d0 2024-04-23T14:52:27.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.677+0000 7f9317400700 1 -- 172.21.15.81:0/70784201 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f930c004290 con 0x7f93201023d0 2024-04-23T14:52:27.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.677+0000 7f9317400700 1 -- 172.21.15.81:0/70784201 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f930c01c3f0 con 0x7f93201023d0 2024-04-23T14:52:27.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.678+0000 7f9326600700 1 -- 172.21.15.81:0/70784201 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9320111240 con 0x7f93201023d0 2024-04-23T14:52:27.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.678+0000 7f9326600700 1 -- 172.21.15.81:0/70784201 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9320111780 con 0x7f93201023d0 2024-04-23T14:52:27.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.679+0000 7f9326600700 1 -- 172.21.15.81:0/70784201 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f932005f5f0 con 0x7f93201023d0 2024-04-23T14:52:27.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.681+0000 7f9317400700 1 -- 172.21.15.81:0/70784201 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 35) v1 ==== 92497+0+0 (secure 0 0 0) 0x7f930c00bbf0 con 0x7f93201023d0 2024-04-23T14:52:27.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.682+0000 7f9317400700 1 --2- 172.21.15.81:0/70784201 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f930406e900 0x7f9304070db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:27.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.682+0000 7f9317400700 1 -- 172.21.15.81:0/70784201 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f930c08f560 con 0x7f93201023d0 2024-04-23T14:52:27.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.682+0000 7f931f400700 1 --2- 172.21.15.81:0/70784201 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f930406e900 0x7f9304070db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:27.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.683+0000 7f931f400700 1 --2- 172.21.15.81:0/70784201 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f930406e900 0x7f9304070db0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9310010210 tx=0x7f931000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:27.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.691+0000 7f9317400700 1 -- 172.21.15.81:0/70784201 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f930c0586c0 con 0x7f93201023d0 2024-04-23T14:52:27.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:27 smithi156 ceph-mon[32341]: Manager daemon smithi081.ldghvq is now available 2024-04-23T14:52:27.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:27 smithi156 ceph-mon[32341]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:52:27.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:27 smithi156 ceph-mon[32341]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:52:27.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:27 smithi156 ceph-mon[32341]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi081.ldghvq/mirror_snapshot_schedule"}]: dispatch 2024-04-23T14:52:27.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:27 smithi156 ceph-mon[32341]: from='mgr.34102 ' entity='mgr.smithi081.ldghvq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi081.ldghvq/mirror_snapshot_schedule"}]: dispatch 2024-04-23T14:52:27.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:27 smithi156 ceph-mon[32341]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi081.ldghvq/trash_purge_schedule"}]: dispatch 2024-04-23T14:52:27.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:27 smithi156 ceph-mon[32341]: from='mgr.34102 ' entity='mgr.smithi081.ldghvq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi081.ldghvq/trash_purge_schedule"}]: dispatch 2024-04-23T14:52:27.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.945+0000 7f9326600700 1 -- 172.21.15.81:0/70784201 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9320111bc0 con 0x7f930406e900 2024-04-23T14:52:27.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.948+0000 7f9317400700 1 -- 172.21.15.81:0/70784201 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f9320111bc0 con 0x7f930406e900 2024-04-23T14:52:27.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.950+0000 7f9326600700 1 -- 172.21.15.81:0/70784201 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f930406e900 msgr2=0x7f9304070db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:27.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.950+0000 7f9326600700 1 --2- 172.21.15.81:0/70784201 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f930406e900 0x7f9304070db0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9310010210 tx=0x7f931000b040 comp rx=0 tx=0).stop 2024-04-23T14:52:27.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.950+0000 7f9326600700 1 -- 172.21.15.81:0/70784201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93201023d0 msgr2=0x7f9320110170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:27.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.950+0000 7f9326600700 1 --2- 172.21.15.81:0/70784201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93201023d0 0x7f9320110170 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f930c00b970 tx=0x7f930c009e30 comp rx=0 tx=0).stop 2024-04-23T14:52:27.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.950+0000 7f9326600700 1 -- 172.21.15.81:0/70784201 shutdown_connections 2024-04-23T14:52:27.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.950+0000 7f9326600700 1 --2- 172.21.15.81:0/70784201 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f930406e900 0x7f9304070db0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:27.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.950+0000 7f9326600700 1 --2- 172.21.15.81:0/70784201 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9320066290 0x7f932010fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:27.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.950+0000 7f9326600700 1 --2- 172.21.15.81:0/70784201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93201023d0 0x7f9320110170 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:27.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.950+0000 7f9326600700 1 -- 172.21.15.81:0/70784201 >> 172.21.15.81:0/70784201 conn(0x7f93200f74c0 msgr2=0x7f93200f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:27.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.950+0000 7f9326600700 1 -- 172.21.15.81:0/70784201 shutdown_connections 2024-04-23T14:52:27.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:27.950+0000 7f9326600700 1 -- 172.21.15.81:0/70784201 wait complete. 2024-04-23T14:52:28.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.097+0000 7f5e0d400700 1 -- 172.21.15.81:0/982027851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e080709a0 msgr2=0x7f5e08070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:28.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.097+0000 7f5e0d400700 1 --2- 172.21.15.81:0/982027851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e080709a0 0x7f5e08070e10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5df4004940 tx=0x7f5df4009e30 comp rx=0 tx=0).stop 2024-04-23T14:52:28.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.097+0000 7f5e0d400700 1 -- 172.21.15.81:0/982027851 shutdown_connections 2024-04-23T14:52:28.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.097+0000 7f5e0d400700 1 --2- 172.21.15.81:0/982027851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e080709a0 0x7f5e08070e10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:28.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.097+0000 7f5e0d400700 1 --2- 172.21.15.81:0/982027851 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e08071f50 0x7f5e08070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:28.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.097+0000 7f5e0d400700 1 -- 172.21.15.81:0/982027851 >> 172.21.15.81:0/982027851 conn(0x7f5e080f8530 msgr2=0x7f5e080fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:28.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.098+0000 7f5e0d400700 1 -- 172.21.15.81:0/982027851 shutdown_connections 2024-04-23T14:52:28.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.098+0000 7f5e0d400700 1 -- 172.21.15.81:0/982027851 wait complete. 2024-04-23T14:52:28.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.099+0000 7f5e0d400700 1 Processor -- start 2024-04-23T14:52:28.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.099+0000 7f5e0d400700 1 -- start start 2024-04-23T14:52:28.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.099+0000 7f5e0d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e080709a0 0x7f5e0810fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:28.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.099+0000 7f5e0d400700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e08071f50 0x7f5e08110190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:28.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.099+0000 7f5e0d400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e08110820 con 0x7f5e080709a0 2024-04-23T14:52:28.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.099+0000 7f5e0d400700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e08111010 con 0x7f5e08071f50 2024-04-23T14:52:28.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.100+0000 7f5e06800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e080709a0 0x7f5e0810fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:28.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.100+0000 7f5e06800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e080709a0 0x7f5e0810fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44500/0 (socket says 172.21.15.81:44500) 2024-04-23T14:52:28.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.100+0000 7f5e06800700 1 -- 172.21.15.81:0/2059228910 learned_addr learned my addr 172.21.15.81:0/2059228910 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:52:28.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.100+0000 7f5e05e00700 1 --2- 172.21.15.81:0/2059228910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e08071f50 0x7f5e08110190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:28.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.100+0000 7f5e06800700 1 -- 172.21.15.81:0/2059228910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e08071f50 msgr2=0x7f5e08110190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:28.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.100+0000 7f5e06800700 1 --2- 172.21.15.81:0/2059228910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e08071f50 0x7f5e08110190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:28.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.100+0000 7f5e06800700 1 -- 172.21.15.81:0/2059228910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df4005040 con 0x7f5e080709a0 2024-04-23T14:52:28.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.100+0000 7f5e05e00700 1 --2- 172.21.15.81:0/2059228910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e08071f50 0x7f5e08110190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:52:28.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.100+0000 7f5e06800700 1 --2- 172.21.15.81:0/2059228910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e080709a0 0x7f5e0810fc50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5df800b790 tx=0x7f5df8009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:28.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.101+0000 7f5dfea00700 1 -- 172.21.15.81:0/2059228910 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5df800f6f0 con 0x7f5e080709a0 2024-04-23T14:52:28.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.101+0000 7f5dfea00700 1 -- 172.21.15.81:0/2059228910 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5df800fd20 con 0x7f5e080709a0 2024-04-23T14:52:28.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.101+0000 7f5e0d400700 1 -- 172.21.15.81:0/2059228910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e081112f0 con 0x7f5e080709a0 2024-04-23T14:52:28.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.101+0000 7f5dfea00700 1 -- 172.21.15.81:0/2059228910 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5df80103a0 con 0x7f5e080709a0 2024-04-23T14:52:28.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.101+0000 7f5e0d400700 1 -- 172.21.15.81:0/2059228910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e081118b0 con 0x7f5e080709a0 2024-04-23T14:52:28.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.102+0000 7f5e0d400700 1 -- 172.21.15.81:0/2059228910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e081095c0 con 0x7f5e080709a0 2024-04-23T14:52:28.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.104+0000 7f5dfea00700 1 -- 172.21.15.81:0/2059228910 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 35) v1 ==== 92497+0+0 (secure 0 0 0) 0x7f5df8011400 con 0x7f5e080709a0 2024-04-23T14:52:28.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.105+0000 7f5dfea00700 1 --2- 172.21.15.81:0/2059228910 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f5dec06e900 0x7f5dec070db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:28.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.105+0000 7f5dfea00700 1 -- 172.21.15.81:0/2059228910 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f5df808e1c0 con 0x7f5e080709a0 2024-04-23T14:52:28.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.105+0000 7f5e05e00700 1 --2- 172.21.15.81:0/2059228910 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f5dec06e900 0x7f5dec070db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:28.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.106+0000 7f5e05e00700 1 --2- 172.21.15.81:0/2059228910 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f5dec06e900 0x7f5dec070db0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5df400b020 tx=0x7f5df4009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:28.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.114+0000 7f5dfea00700 1 -- 172.21.15.81:0/2059228910 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f5df8057220 con 0x7f5e080709a0 2024-04-23T14:52:28.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.351+0000 7f5e0d400700 1 -- 172.21.15.81:0/2059228910 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e08111ca0 con 0x7f5dec06e900 2024-04-23T14:52:28.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.371+0000 7f5dfea00700 1 -- 172.21.15.81:0/2059228910 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f5e08111ca0 con 0x7f5dec06e900 2024-04-23T14:52:28.372 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-23T14:52:28.372 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (2m) 37s ago 13m 14.8M - 0.25.0 c8568f914cd2 63876b2abc27 2024-04-23T14:52:28.372 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (13m) 37s ago 13m 6660k - 17.2.7-884-g70d0cb4b cafd8ddac8fa 6ae90c81b232 2024-04-23T14:52:28.372 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi156 smithi156 running (12m) 40s ago 12m 6660k - 17.2.7-884-g70d0cb4b cafd8ddac8fa ecc141919f37 2024-04-23T14:52:28.372 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (2m) 37s ago 13m 74.9M - 9.4.7 954c08fa6188 fbad3cef0883 2024-04-23T14:52:28.373 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.vcoywg smithi081 running (6m) 37s ago 6m 216M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 2ca7601ab60f 2024-04-23T14:52:28.373 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.wydgcg smithi081 running (6m) 37s ago 6m 128M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 58eb1a961b61 2024-04-23T14:52:28.373 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.rhbtxt smithi156 running (6m) 40s ago 6m 12.8M - 17.2.7-884-g70d0cb4b cafd8ddac8fa db3cb5034381 2024-04-23T14:52:28.373 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.vynkxn smithi156 running (6m) 40s ago 6m 12.9M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 1c8f2219e7fd 2024-04-23T14:52:28.373 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.ldghvq smithi081 *:8443,9283,8765 running (2m) 37s ago 15m 493M - 19.0.0-3126-gd44fddd9 76e77f280c74 6bf23484a1c9 2024-04-23T14:52:28.373 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi156.ounwyj smithi156 *:8443,9283,8765 running (46s) 40s ago 12m 69.1M - 19.0.0-3126-gd44fddd9 76e77f280c74 a6c0dd9f89f2 2024-04-23T14:52:28.373 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (15m) 37s ago 15m 52.7M 2048M 17.2.7-884-g70d0cb4b cafd8ddac8fa 6e43d934b336 2024-04-23T14:52:28.373 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi156 smithi156 running (12m) 40s ago 12m 41.8M 2048M 17.2.7-884-g70d0cb4b cafd8ddac8fa d9127540d3bb 2024-04-23T14:52:28.373 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (3m) 37s ago 13m 7922k - 1.5.0 0da6a335fe13 197b27809010 2024-04-23T14:52:28.373 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi156 smithi156 *:9100 running (2m) 40s ago 12m 7478k - 1.5.0 0da6a335fe13 91a7c5e86d47 2024-04-23T14:52:28.373 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (11m) 37s ago 11m 234M 1557M 17.2.7-884-g70d0cb4b cafd8ddac8fa 272ca032bec1 2024-04-23T14:52:28.373 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (10m) 37s ago 10m 244M 1557M 17.2.7-884-g70d0cb4b cafd8ddac8fa ee6d0c8af6ed 2024-04-23T14:52:28.373 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (10m) 37s ago 10m 204M 1557M 17.2.7-884-g70d0cb4b cafd8ddac8fa c26c640828a2 2024-04-23T14:52:28.373 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi156 running (9m) 40s ago 9m 274M 2581M 17.2.7-884-g70d0cb4b cafd8ddac8fa c1c261b1ee90 2024-04-23T14:52:28.374 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi156 running (8m) 40s ago 8m 246M 2581M 17.2.7-884-g70d0cb4b cafd8ddac8fa 83f996ee64de 2024-04-23T14:52:28.374 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi156 running (8m) 40s ago 8m 227M 2581M 17.2.7-884-g70d0cb4b cafd8ddac8fa b754244bef18 2024-04-23T14:52:28.374 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (54s) 37s ago 12m 43.5M - 2.43.0 a07b618ecd1d 35558adb166d 2024-04-23T14:52:28.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.374+0000 7f5e0d400700 1 -- 172.21.15.81:0/2059228910 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f5dec06e900 msgr2=0x7f5dec070db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:28.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.374+0000 7f5e0d400700 1 --2- 172.21.15.81:0/2059228910 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f5dec06e900 0x7f5dec070db0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5df400b020 tx=0x7f5df4009e30 comp rx=0 tx=0).stop 2024-04-23T14:52:28.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.374+0000 7f5e0d400700 1 -- 172.21.15.81:0/2059228910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e080709a0 msgr2=0x7f5e0810fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:28.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.374+0000 7f5e0d400700 1 --2- 172.21.15.81:0/2059228910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e080709a0 0x7f5e0810fc50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5df800b790 tx=0x7f5df8009220 comp rx=0 tx=0).stop 2024-04-23T14:52:28.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.374+0000 7f5e0d400700 1 -- 172.21.15.81:0/2059228910 shutdown_connections 2024-04-23T14:52:28.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.374+0000 7f5e0d400700 1 --2- 172.21.15.81:0/2059228910 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f5dec06e900 0x7f5dec070db0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:28.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.374+0000 7f5e0d400700 1 --2- 172.21.15.81:0/2059228910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e080709a0 0x7f5e0810fc50 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:28.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.374+0000 7f5e0d400700 1 --2- 172.21.15.81:0/2059228910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e08071f50 0x7f5e08110190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:28.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.374+0000 7f5e0d400700 1 -- 172.21.15.81:0/2059228910 >> 172.21.15.81:0/2059228910 conn(0x7f5e080f8530 msgr2=0x7f5e08102d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:28.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.374+0000 7f5e0d400700 1 -- 172.21.15.81:0/2059228910 shutdown_connections 2024-04-23T14:52:28.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.374+0000 7f5e0d400700 1 -- 172.21.15.81:0/2059228910 wait complete. 2024-04-23T14:52:28.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.524+0000 7ffa87000700 1 -- 172.21.15.81:0/1377615785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa800fe0e0 msgr2=0x7ffa800fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:28.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.524+0000 7ffa87000700 1 --2- 172.21.15.81:0/1377615785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa800fe0e0 0x7ffa800fe550 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c004940 tx=0x7ffa6c009e30 comp rx=0 tx=0).stop 2024-04-23T14:52:28.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.524+0000 7ffa87000700 1 -- 172.21.15.81:0/1377615785 shutdown_connections 2024-04-23T14:52:28.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.524+0000 7ffa87000700 1 --2- 172.21.15.81:0/1377615785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa800fe0e0 0x7ffa800fe550 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:28.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.524+0000 7ffa87000700 1 --2- 172.21.15.81:0/1377615785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa800fcef0 0x7ffa800fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:28.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.524+0000 7ffa87000700 1 -- 172.21.15.81:0/1377615785 >> 172.21.15.81:0/1377615785 conn(0x7ffa800f8530 msgr2=0x7ffa800fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:28.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.525+0000 7ffa87000700 1 -- 172.21.15.81:0/1377615785 shutdown_connections 2024-04-23T14:52:28.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.525+0000 7ffa87000700 1 -- 172.21.15.81:0/1377615785 wait complete. 2024-04-23T14:52:28.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.525+0000 7ffa87000700 1 Processor -- start 2024-04-23T14:52:28.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.525+0000 7ffa87000700 1 -- start start 2024-04-23T14:52:28.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.526+0000 7ffa87000700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa800fcef0 0x7ffa8010fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:28.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.526+0000 7ffa87000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa800fe0e0 0x7ffa801101a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:28.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.526+0000 7ffa87000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa801107a0 con 0x7ffa800fe0e0 2024-04-23T14:52:28.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.526+0000 7ffa87000700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa80110ff0 con 0x7ffa800fcef0 2024-04-23T14:52:28.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.526+0000 7ffa7f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa800fe0e0 0x7ffa801101a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:28.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.526+0000 7ffa7f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa800fe0e0 0x7ffa801101a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44518/0 (socket says 172.21.15.81:44518) 2024-04-23T14:52:28.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.526+0000 7ffa7f400700 1 -- 172.21.15.81:0/33694561 learned_addr learned my addr 172.21.15.81:0/33694561 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:52:28.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.527+0000 7ffa7f400700 1 -- 172.21.15.81:0/33694561 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa800fcef0 msgr2=0x7ffa8010fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:28.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.527+0000 7ffa7f400700 1 --2- 172.21.15.81:0/33694561 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa800fcef0 0x7ffa8010fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:28.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.527+0000 7ffa7f400700 1 -- 172.21.15.81:0/33694561 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa6c005040 con 0x7ffa800fe0e0 2024-04-23T14:52:28.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.527+0000 7ffa7f400700 1 --2- 172.21.15.81:0/33694561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa800fe0e0 0x7ffa801101a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c009150 tx=0x7ffa6c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:28.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.527+0000 7ffa77e00700 1 -- 172.21.15.81:0/33694561 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa6c00e040 con 0x7ffa800fe0e0 2024-04-23T14:52:28.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.527+0000 7ffa77e00700 1 -- 172.21.15.81:0/33694561 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffa6c00bcc0 con 0x7ffa800fe0e0 2024-04-23T14:52:28.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.527+0000 7ffa77e00700 1 -- 172.21.15.81:0/33694561 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa6c01c630 con 0x7ffa800fe0e0 2024-04-23T14:52:28.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.527+0000 7ffa87000700 1 -- 172.21.15.81:0/33694561 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa80111270 con 0x7ffa800fe0e0 2024-04-23T14:52:28.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.527+0000 7ffa87000700 1 -- 172.21.15.81:0/33694561 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa80111760 con 0x7ffa800fe0e0 2024-04-23T14:52:28.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.529+0000 7ffa87000700 1 -- 172.21.15.81:0/33694561 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa80101a70 con 0x7ffa800fe0e0 2024-04-23T14:52:28.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.530+0000 7ffa77e00700 1 -- 172.21.15.81:0/33694561 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 36) v1 ==== 92791+0+0 (secure 0 0 0) 0x7ffa6c013420 con 0x7ffa800fe0e0 2024-04-23T14:52:28.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.531+0000 7ffa77e00700 1 --2- 172.21.15.81:0/33694561 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7ffa6406eca0 0x7ffa64071150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:28.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.531+0000 7ffa77e00700 1 -- 172.21.15.81:0/33694561 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7ffa6c08f660 con 0x7ffa800fe0e0 2024-04-23T14:52:28.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.531+0000 7ffa7fe00700 1 --2- 172.21.15.81:0/33694561 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7ffa6406eca0 0x7ffa64071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:28.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.532+0000 7ffa7fe00700 1 --2- 172.21.15.81:0/33694561 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7ffa6406eca0 0x7ffa64071150 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ffa800fcc30 tx=0x7ffa70007d60 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:28.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.536+0000 7ffa77e00700 1 -- 172.21.15.81:0/33694561 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7ffa6c05be90 con 0x7ffa800fe0e0 2024-04-23T14:52:28.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:28 smithi156 ceph-mon[32341]: [23/Apr/2024:14:52:26] ENGINE Bus STARTING 2024-04-23T14:52:28.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:28 smithi156 ceph-mon[32341]: [23/Apr/2024:14:52:27] ENGINE Serving on https://172.21.15.81:7150 2024-04-23T14:52:28.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:28 smithi156 ceph-mon[32341]: [23/Apr/2024:14:52:27] ENGINE Serving on http://172.21.15.81:8765 2024-04-23T14:52:28.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:28 smithi156 ceph-mon[32341]: [23/Apr/2024:14:52:27] ENGINE Bus STARTED 2024-04-23T14:52:28.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:28 smithi156 ceph-mon[32341]: mgrmap e35: smithi081.ldghvq(active, since 1.05737s), standbys: smithi156.ounwyj 2024-04-23T14:52:28.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:28 smithi156 ceph-mon[32341]: from='client.34106 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:52:28.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:28 smithi156 ceph-mon[32341]: pgmap v3: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-23T14:52:28.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:28 smithi081 ceph-mon[90469]: [23/Apr/2024:14:52:26] ENGINE Bus STARTING 2024-04-23T14:52:28.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:28 smithi081 ceph-mon[90469]: [23/Apr/2024:14:52:27] ENGINE Serving on https://172.21.15.81:7150 2024-04-23T14:52:28.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:28 smithi081 ceph-mon[90469]: [23/Apr/2024:14:52:27] ENGINE Serving on http://172.21.15.81:8765 2024-04-23T14:52:28.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:28 smithi081 ceph-mon[90469]: [23/Apr/2024:14:52:27] ENGINE Bus STARTED 2024-04-23T14:52:28.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:28 smithi081 ceph-mon[90469]: mgrmap e35: smithi081.ldghvq(active, since 1.05737s), standbys: smithi156.ounwyj 2024-04-23T14:52:28.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:28 smithi081 ceph-mon[90469]: from='client.34106 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:52:28.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:28 smithi081 ceph-mon[90469]: pgmap v3: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-23T14:52:28.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.909+0000 7ffa87000700 1 -- 172.21.15.81:0/33694561 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ffa8004bed0 con 0x7ffa800fe0e0 2024-04-23T14:52:28.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.910+0000 7ffa77e00700 1 -- 172.21.15.81:0/33694561 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+843 (secure 0 0 0) 0x7ffa6c05ba20 con 0x7ffa800fe0e0 2024-04-23T14:52:28.911 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:52:28.911 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-04-23T14:52:28.911 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 1, 2024-04-23T14:52:28.911 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 1 2024-04-23T14:52:28.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:52:28.911 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-04-23T14:52:28.911 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T14:52:28.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:52:28.911 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-04-23T14:52:28.911 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 6 2024-04-23T14:52:28.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:52:28.912 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-04-23T14:52:28.912 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 4 2024-04-23T14:52:28.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:52:28.912 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-04-23T14:52:28.912 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 11, 2024-04-23T14:52:28.912 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 3 2024-04-23T14:52:28.912 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-23T14:52:28.912 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:52:28.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.913+0000 7ffa87000700 1 -- 172.21.15.81:0/33694561 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7ffa6406eca0 msgr2=0x7ffa64071150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:28.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.913+0000 7ffa87000700 1 --2- 172.21.15.81:0/33694561 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7ffa6406eca0 0x7ffa64071150 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ffa800fcc30 tx=0x7ffa70007d60 comp rx=0 tx=0).stop 2024-04-23T14:52:28.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.913+0000 7ffa87000700 1 -- 172.21.15.81:0/33694561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa800fe0e0 msgr2=0x7ffa801101a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:28.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.913+0000 7ffa87000700 1 --2- 172.21.15.81:0/33694561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa800fe0e0 0x7ffa801101a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c009150 tx=0x7ffa6c009e30 comp rx=0 tx=0).stop 2024-04-23T14:52:28.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.913+0000 7ffa87000700 1 -- 172.21.15.81:0/33694561 shutdown_connections 2024-04-23T14:52:28.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.913+0000 7ffa87000700 1 --2- 172.21.15.81:0/33694561 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7ffa6406eca0 0x7ffa64071150 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:28.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.913+0000 7ffa87000700 1 --2- 172.21.15.81:0/33694561 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa800fcef0 0x7ffa8010fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:28.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.913+0000 7ffa87000700 1 --2- 172.21.15.81:0/33694561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa800fe0e0 0x7ffa801101a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:28.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.913+0000 7ffa87000700 1 -- 172.21.15.81:0/33694561 >> 172.21.15.81:0/33694561 conn(0x7ffa800f8530 msgr2=0x7ffa800f9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:28.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.913+0000 7ffa87000700 1 -- 172.21.15.81:0/33694561 shutdown_connections 2024-04-23T14:52:28.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:28.913+0000 7ffa87000700 1 -- 172.21.15.81:0/33694561 wait complete. 2024-04-23T14:52:29.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.055+0000 7fa2b3000700 1 -- 172.21.15.81:0/3459090158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2ac0fff70 msgr2=0x7fa2ac102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:29.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.055+0000 7fa2b3000700 1 --2- 172.21.15.81:0/3459090158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2ac0fff70 0x7fa2ac102390 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa298004940 tx=0x7fa298009e30 comp rx=0 tx=0).stop 2024-04-23T14:52:29.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.055+0000 7fa2b3000700 1 -- 172.21.15.81:0/3459090158 shutdown_connections 2024-04-23T14:52:29.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.055+0000 7fa2b3000700 1 --2- 172.21.15.81:0/3459090158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2ac0fff70 0x7fa2ac102390 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.055+0000 7fa2b3000700 1 --2- 172.21.15.81:0/3459090158 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2ac0662f0 0x7fa2ac0ffa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.055+0000 7fa2b3000700 1 -- 172.21.15.81:0/3459090158 >> 172.21.15.81:0/3459090158 conn(0x7fa2ac0f74c0 msgr2=0x7fa2ac0f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:29.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.055+0000 7fa2b3000700 1 -- 172.21.15.81:0/3459090158 shutdown_connections 2024-04-23T14:52:29.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.056+0000 7fa2b3000700 1 -- 172.21.15.81:0/3459090158 wait complete. 2024-04-23T14:52:29.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.056+0000 7fa2b3000700 1 Processor -- start 2024-04-23T14:52:29.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.056+0000 7fa2b3000700 1 -- start start 2024-04-23T14:52:29.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.057+0000 7fa2b3000700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2ac0662f0 0x7fa2ac10fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:29.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.057+0000 7fa2b3000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2ac0fff70 0x7fa2ac1101a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:29.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.057+0000 7fa2b3000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac1107a0 con 0x7fa2ac0fff70 2024-04-23T14:52:29.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.057+0000 7fa2b3000700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac110ff0 con 0x7fa2ac0662f0 2024-04-23T14:52:29.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.057+0000 7fa2ab400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2ac0fff70 0x7fa2ac1101a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:29.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.057+0000 7fa2ab400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2ac0fff70 0x7fa2ac1101a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44554/0 (socket says 172.21.15.81:44554) 2024-04-23T14:52:29.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.057+0000 7fa2ab400700 1 -- 172.21.15.81:0/3952072026 learned_addr learned my addr 172.21.15.81:0/3952072026 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:52:29.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.057+0000 7fa2abe00700 1 --2- 172.21.15.81:0/3952072026 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2ac0662f0 0x7fa2ac10fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:29.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.057+0000 7fa2ab400700 1 -- 172.21.15.81:0/3952072026 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2ac0662f0 msgr2=0x7fa2ac10fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:29.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.057+0000 7fa2ab400700 1 --2- 172.21.15.81:0/3952072026 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2ac0662f0 0x7fa2ac10fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.057+0000 7fa2ab400700 1 -- 172.21.15.81:0/3952072026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa298005040 con 0x7fa2ac0fff70 2024-04-23T14:52:29.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.058+0000 7fa2ab400700 1 --2- 172.21.15.81:0/3952072026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2ac0fff70 0x7fa2ac1101a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa29800b3b0 tx=0x7fa298009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:29.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.058+0000 7fa2a3e00700 1 -- 172.21.15.81:0/3952072026 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa29800e040 con 0x7fa2ac0fff70 2024-04-23T14:52:29.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.058+0000 7fa2a3e00700 1 -- 172.21.15.81:0/3952072026 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa298004290 con 0x7fa2ac0fff70 2024-04-23T14:52:29.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.058+0000 7fa2b3000700 1 -- 172.21.15.81:0/3952072026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2ac111270 con 0x7fa2ac0fff70 2024-04-23T14:52:29.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.058+0000 7fa2a3e00700 1 -- 172.21.15.81:0/3952072026 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa29801c630 con 0x7fa2ac0fff70 2024-04-23T14:52:29.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.058+0000 7fa2b3000700 1 -- 172.21.15.81:0/3952072026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2ac1117b0 con 0x7fa2ac0fff70 2024-04-23T14:52:29.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.059+0000 7fa2b3000700 1 -- 172.21.15.81:0/3952072026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2ac0f8ff0 con 0x7fa2ac0fff70 2024-04-23T14:52:29.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.060+0000 7fa2a3e00700 1 -- 172.21.15.81:0/3952072026 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 36) v1 ==== 92791+0+0 (secure 0 0 0) 0x7fa29800bbf0 con 0x7fa2ac0fff70 2024-04-23T14:52:29.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.061+0000 7fa2a3e00700 1 --2- 172.21.15.81:0/3952072026 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa29006eca0 0x7fa290071150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:29.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.061+0000 7fa2a3e00700 1 -- 172.21.15.81:0/3952072026 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fa29808fe80 con 0x7fa2ac0fff70 2024-04-23T14:52:29.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.061+0000 7fa2abe00700 1 --2- 172.21.15.81:0/3952072026 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa29006eca0 0x7fa290071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:29.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.062+0000 7fa2abe00700 1 --2- 172.21.15.81:0/3952072026 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa29006eca0 0x7fa290071150 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa29c0041d0 tx=0x7fa29c009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:29.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.066+0000 7fa2a3e00700 1 -- 172.21.15.81:0/3952072026 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fa29805c630 con 0x7fa2ac0fff70 2024-04-23T14:52:29.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.359+0000 7fa2b3000700 1 -- 172.21.15.81:0/3952072026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa2ac04bed0 con 0x7fa2ac0fff70 2024-04-23T14:52:29.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.360+0000 7fa2a3e00700 1 -- 172.21.15.81:0/3952072026 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1907 (secure 0 0 0) 0x7fa29805c1c0 con 0x7fa2ac0fff70 2024-04-23T14:52:29.361 INFO:teuthology.orchestra.run.smithi081.stdout:e18 2024-04-23T14:52:29.361 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-23T14:52:29.361 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:52:29.361 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-04-23T14:52:29.362 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:52:29.362 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-04-23T14:52:29.362 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-04-23T14:52:29.362 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 17 2024-04-23T14:52:29.362 INFO:teuthology.orchestra.run.smithi081.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-23T14:52:29.362 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-04-23T14:45:51.264703+0000 2024-04-23T14:52:29.362 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-04-23T14:46:12.782992+0000 2024-04-23T14:52:29.362 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-04-23T14:52:29.362 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-04-23T14:52:29.362 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-04-23T14:52:29.362 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-04-23T14:52:29.362 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-04-23T14:52:29.362 INFO:teuthology.orchestra.run.smithi081.stdout:max_xattr_size 65536 2024-04-23T14:52:29.363 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-04-23T14:52:29.363 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-04-23T14:52:29.363 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 47 2024-04-23T14:52:29.363 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:52:29.363 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 1 2024-04-23T14:52:29.363 INFO:teuthology.orchestra.run.smithi081.stdout:in 0 2024-04-23T14:52:29.363 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=14472} 2024-04-23T14:52:29.363 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-04-23T14:52:29.363 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-04-23T14:52:29.363 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-04-23T14:52:29.363 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-04-23T14:52:29.363 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-04-23T14:52:29.363 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-04-23T14:52:29.364 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-04-23T14:52:29.364 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-04-23T14:52:29.364 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-04-23T14:52:29.364 INFO:teuthology.orchestra.run.smithi081.stdout:qdb_cluster leader: 0 members: 2024-04-23T14:52:29.364 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.vcoywg{0:14472} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.81:6828/2563365650,v1:172.21.15.81:6829/2563365650] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:52:29.364 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.wydgcg{0:14482} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.81:6826/759909104,v1:172.21.15.81:6827/759909104] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:52:29.364 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:52:29.364 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:52:29.364 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-04-23T14:52:29.364 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:52:29.364 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.vynkxn{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.156:6826/1794690362,v1:172.21.15.156:6827/1794690362] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:52:29.364 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.rhbtxt{-1:24263} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.156:6824/3854041261,v1:172.21.15.156:6825/3854041261] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:52:29.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.363+0000 7fa2b3000700 1 -- 172.21.15.81:0/3952072026 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa29006eca0 msgr2=0x7fa290071150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:29.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.363+0000 7fa2b3000700 1 --2- 172.21.15.81:0/3952072026 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa29006eca0 0x7fa290071150 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa29c0041d0 tx=0x7fa29c009040 comp rx=0 tx=0).stop 2024-04-23T14:52:29.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.363+0000 7fa2b3000700 1 -- 172.21.15.81:0/3952072026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2ac0fff70 msgr2=0x7fa2ac1101a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:29.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.363+0000 7fa2b3000700 1 --2- 172.21.15.81:0/3952072026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2ac0fff70 0x7fa2ac1101a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa29800b3b0 tx=0x7fa298009e30 comp rx=0 tx=0).stop 2024-04-23T14:52:29.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.363+0000 7fa2b3000700 1 -- 172.21.15.81:0/3952072026 shutdown_connections 2024-04-23T14:52:29.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.363+0000 7fa2b3000700 1 --2- 172.21.15.81:0/3952072026 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa29006eca0 0x7fa290071150 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.363+0000 7fa2b3000700 1 --2- 172.21.15.81:0/3952072026 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2ac0662f0 0x7fa2ac10fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.363+0000 7fa2b3000700 1 --2- 172.21.15.81:0/3952072026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2ac0fff70 0x7fa2ac1101a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.363+0000 7fa2b3000700 1 -- 172.21.15.81:0/3952072026 >> 172.21.15.81:0/3952072026 conn(0x7fa2ac0f74c0 msgr2=0x7fa2ac0fbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:29.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.363+0000 7fa2b3000700 1 -- 172.21.15.81:0/3952072026 shutdown_connections 2024-04-23T14:52:29.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.363+0000 7fa2b3000700 1 -- 172.21.15.81:0/3952072026 wait complete. 2024-04-23T14:52:29.366 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 18 2024-04-23T14:52:29.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.513+0000 7f842f800700 1 -- 172.21.15.81:0/1552379264 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84280fcef0 msgr2=0x7f84280fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:29.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.513+0000 7f842f800700 1 --2- 172.21.15.81:0/1552379264 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84280fcef0 0x7f84280fd320 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f841c0048b0 tx=0x7f841c009e30 comp rx=0 tx=0).stop 2024-04-23T14:52:29.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.513+0000 7f842f800700 1 -- 172.21.15.81:0/1552379264 shutdown_connections 2024-04-23T14:52:29.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.513+0000 7f842f800700 1 --2- 172.21.15.81:0/1552379264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84280fe0e0 0x7f84280fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.513+0000 7f842f800700 1 --2- 172.21.15.81:0/1552379264 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84280fcef0 0x7f84280fd320 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.513+0000 7f842f800700 1 -- 172.21.15.81:0/1552379264 >> 172.21.15.81:0/1552379264 conn(0x7f84280f8530 msgr2=0x7f84280fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:29.514 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:29 smithi081 ceph-mon[90469]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:52:29.515 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:29 smithi081 ceph-mon[90469]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:52:29.515 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:29 smithi081 ceph-mon[90469]: pgmap v4: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-23T14:52:29.515 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:29 smithi081 ceph-mon[90469]: mgrmap e36: smithi081.ldghvq(active, since 2s), standbys: smithi156.ounwyj 2024-04-23T14:52:29.515 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:29 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/33694561' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:52:29.515 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:29 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/3952072026' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:52:29.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.513+0000 7f842f800700 1 -- 172.21.15.81:0/1552379264 shutdown_connections 2024-04-23T14:52:29.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.513+0000 7f842f800700 1 -- 172.21.15.81:0/1552379264 wait complete. 2024-04-23T14:52:29.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.514+0000 7f842f800700 1 Processor -- start 2024-04-23T14:52:29.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.514+0000 7f842f800700 1 -- start start 2024-04-23T14:52:29.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.515+0000 7f842f800700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84280fcef0 0x7f842810fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:29.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.515+0000 7f842f800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84280fe0e0 0x7f8428110100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:29.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.515+0000 7f842f800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8428110700 con 0x7f84280fe0e0 2024-04-23T14:52:29.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.515+0000 7f842f800700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8428110f50 con 0x7f84280fcef0 2024-04-23T14:52:29.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.515+0000 7f8427e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84280fe0e0 0x7f8428110100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:29.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.515+0000 7f8427e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84280fe0e0 0x7f8428110100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44566/0 (socket says 172.21.15.81:44566) 2024-04-23T14:52:29.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.515+0000 7f8427e00700 1 -- 172.21.15.81:0/3552735306 learned_addr learned my addr 172.21.15.81:0/3552735306 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:52:29.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.516+0000 7f842ce00700 1 --2- 172.21.15.81:0/3552735306 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84280fcef0 0x7f842810fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:29.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.516+0000 7f8427e00700 1 -- 172.21.15.81:0/3552735306 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84280fcef0 msgr2=0x7f842810fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:29.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.516+0000 7f8427e00700 1 --2- 172.21.15.81:0/3552735306 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84280fcef0 0x7f842810fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.516+0000 7f8427e00700 1 -- 172.21.15.81:0/3552735306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f841c005040 con 0x7f84280fe0e0 2024-04-23T14:52:29.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.516+0000 7f8427e00700 1 --2- 172.21.15.81:0/3552735306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84280fe0e0 0x7f8428110100 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f84140041d0 tx=0x7f841400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:29.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.516+0000 7f8424c00700 1 -- 172.21.15.81:0/3552735306 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8414007cc0 con 0x7f84280fe0e0 2024-04-23T14:52:29.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.516+0000 7f8424c00700 1 -- 172.21.15.81:0/3552735306 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f841400f040 con 0x7f84280fe0e0 2024-04-23T14:52:29.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.516+0000 7f842f800700 1 -- 172.21.15.81:0/3552735306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84281111d0 con 0x7f84280fe0e0 2024-04-23T14:52:29.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.516+0000 7f8424c00700 1 -- 172.21.15.81:0/3552735306 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f841400cb50 con 0x7f84280fe0e0 2024-04-23T14:52:29.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.516+0000 7f842f800700 1 -- 172.21.15.81:0/3552735306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8428111710 con 0x7f84280fe0e0 2024-04-23T14:52:29.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.518+0000 7f842f800700 1 -- 172.21.15.81:0/3552735306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8428101a70 con 0x7f84280fe0e0 2024-04-23T14:52:29.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.519+0000 7f8424c00700 1 -- 172.21.15.81:0/3552735306 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 36) v1 ==== 92791+0+0 (secure 0 0 0) 0x7f841400ccb0 con 0x7f84280fe0e0 2024-04-23T14:52:29.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.520+0000 7f8424c00700 1 --2- 172.21.15.81:0/3552735306 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f841006eca0 0x7f8410071150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:29.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.521+0000 7f8424c00700 1 -- 172.21.15.81:0/3552735306 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f841408e540 con 0x7f84280fe0e0 2024-04-23T14:52:29.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.521+0000 7f842ce00700 1 --2- 172.21.15.81:0/3552735306 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f841006eca0 0x7f8410071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:29.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.521+0000 7f842ce00700 1 --2- 172.21.15.81:0/3552735306 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f841006eca0 0x7f8410071150 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f841c004fb0 tx=0x7f841c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:29.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.525+0000 7f8424c00700 1 -- 172.21.15.81:0/3552735306 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f841405ada0 con 0x7f84280fe0e0 2024-04-23T14:52:29.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.774+0000 7f842f800700 1 -- 172.21.15.81:0/3552735306 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8428111980 con 0x7f841006eca0 2024-04-23T14:52:29.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.776+0000 7f8424c00700 1 -- 172.21.15.81:0/3552735306 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f8428111980 con 0x7f841006eca0 2024-04-23T14:52:29.776 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:52:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd", 2024-04-23T14:52:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-04-23T14:52:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-23T14:52:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [ 2024-04-23T14:52:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr" 2024-04-23T14:52:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-04-23T14:52:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "2/21 daemons upgraded", 2024-04-23T14:52:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "", 2024-04-23T14:52:29.777 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-04-23T14:52:29.777 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:52:29.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.778+0000 7f842f800700 1 -- 172.21.15.81:0/3552735306 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f841006eca0 msgr2=0x7f8410071150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:29.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.778+0000 7f842f800700 1 --2- 172.21.15.81:0/3552735306 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f841006eca0 0x7f8410071150 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f841c004fb0 tx=0x7f841c009e30 comp rx=0 tx=0).stop 2024-04-23T14:52:29.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.778+0000 7f842f800700 1 -- 172.21.15.81:0/3552735306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84280fe0e0 msgr2=0x7f8428110100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:29.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.778+0000 7f842f800700 1 --2- 172.21.15.81:0/3552735306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84280fe0e0 0x7f8428110100 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f84140041d0 tx=0x7f841400b040 comp rx=0 tx=0).stop 2024-04-23T14:52:29.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.779+0000 7f842f800700 1 -- 172.21.15.81:0/3552735306 shutdown_connections 2024-04-23T14:52:29.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.779+0000 7f842f800700 1 --2- 172.21.15.81:0/3552735306 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f841006eca0 0x7f8410071150 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.779+0000 7f842f800700 1 --2- 172.21.15.81:0/3552735306 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84280fcef0 0x7f842810fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.779+0000 7f842f800700 1 --2- 172.21.15.81:0/3552735306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84280fe0e0 0x7f8428110100 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.779+0000 7f842f800700 1 -- 172.21.15.81:0/3552735306 >> 172.21.15.81:0/3552735306 conn(0x7f84280f8530 msgr2=0x7f84280f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:29.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.779+0000 7f842f800700 1 -- 172.21.15.81:0/3552735306 shutdown_connections 2024-04-23T14:52:29.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.779+0000 7f842f800700 1 -- 172.21.15.81:0/3552735306 wait complete. 2024-04-23T14:52:29.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:29 smithi156 ceph-mon[32341]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:52:29.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:29 smithi156 ceph-mon[32341]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:52:29.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:29 smithi156 ceph-mon[32341]: pgmap v4: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-23T14:52:29.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:29 smithi156 ceph-mon[32341]: mgrmap e36: smithi081.ldghvq(active, since 2s), standbys: smithi156.ounwyj 2024-04-23T14:52:29.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:29 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/33694561' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:52:29.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:29 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/3952072026' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:52:29.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.923+0000 7f2ca1a00700 1 -- 172.21.15.81:0/2035427975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c9c071ea0 msgr2=0x7f2c9c0703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:29.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.923+0000 7f2ca1a00700 1 --2- 172.21.15.81:0/2035427975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c9c071ea0 0x7f2c9c0703b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c004940 tx=0x7f2c8c009e30 comp rx=0 tx=0).stop 2024-04-23T14:52:29.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.923+0000 7f2ca1a00700 1 -- 172.21.15.81:0/2035427975 shutdown_connections 2024-04-23T14:52:29.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.923+0000 7f2ca1a00700 1 --2- 172.21.15.81:0/2035427975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c9c0708f0 0x7f2c9c070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.923+0000 7f2ca1a00700 1 --2- 172.21.15.81:0/2035427975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c9c071ea0 0x7f2c9c0703b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.923+0000 7f2ca1a00700 1 -- 172.21.15.81:0/2035427975 >> 172.21.15.81:0/2035427975 conn(0x7f2c9c0f8530 msgr2=0x7f2c9c0fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:29.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.923+0000 7f2ca1a00700 1 -- 172.21.15.81:0/2035427975 shutdown_connections 2024-04-23T14:52:29.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.923+0000 7f2ca1a00700 1 -- 172.21.15.81:0/2035427975 wait complete. 2024-04-23T14:52:29.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.924+0000 7f2ca1a00700 1 Processor -- start 2024-04-23T14:52:29.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.924+0000 7f2ca1a00700 1 -- start start 2024-04-23T14:52:29.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.924+0000 7f2ca1a00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c9c0708f0 0x7f2c9c114050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:29.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.924+0000 7f2ca1a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c9c071ea0 0x7f2c9c114590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:29.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.924+0000 7f2ca1a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9c114c20 con 0x7f2c9c071ea0 2024-04-23T14:52:29.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.924+0000 7f2ca1a00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9c115410 con 0x7f2c9c0708f0 2024-04-23T14:52:29.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.925+0000 7f2c92000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c9c071ea0 0x7f2c9c114590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:29.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.925+0000 7f2c92000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c9c071ea0 0x7f2c9c114590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44588/0 (socket says 172.21.15.81:44588) 2024-04-23T14:52:29.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.925+0000 7f2c92000700 1 -- 172.21.15.81:0/2859924724 learned_addr learned my addr 172.21.15.81:0/2859924724 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:52:29.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.925+0000 7f2c92000700 1 -- 172.21.15.81:0/2859924724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c9c0708f0 msgr2=0x7f2c9c114050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:29.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.925+0000 7f2c92000700 1 --2- 172.21.15.81:0/2859924724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c9c0708f0 0x7f2c9c114050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:29.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.925+0000 7f2c92000700 1 -- 172.21.15.81:0/2859924724 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c8c005040 con 0x7f2c9c071ea0 2024-04-23T14:52:29.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.925+0000 7f2c92000700 1 --2- 172.21.15.81:0/2859924724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c9c071ea0 0x7f2c9c114590 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2c8400b790 tx=0x7f2c84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:29.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.926+0000 7f2c93400700 1 -- 172.21.15.81:0/2859924724 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c8400f770 con 0x7f2c9c071ea0 2024-04-23T14:52:29.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.926+0000 7f2c93400700 1 -- 172.21.15.81:0/2859924724 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2c8400fda0 con 0x7f2c9c071ea0 2024-04-23T14:52:29.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.926+0000 7f2c93400700 1 -- 172.21.15.81:0/2859924724 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c8400d310 con 0x7f2c9c071ea0 2024-04-23T14:52:29.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.926+0000 7f2ca1a00700 1 -- 172.21.15.81:0/2859924724 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c9c1156f0 con 0x7f2c9c071ea0 2024-04-23T14:52:29.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.926+0000 7f2ca1a00700 1 -- 172.21.15.81:0/2859924724 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c9c115c60 con 0x7f2c9c071ea0 2024-04-23T14:52:29.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.927+0000 7f2ca1a00700 1 -- 172.21.15.81:0/2859924724 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c9c05f5f0 con 0x7f2c9c071ea0 2024-04-23T14:52:29.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.928+0000 7f2c93400700 1 -- 172.21.15.81:0/2859924724 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 36) v1 ==== 92791+0+0 (secure 0 0 0) 0x7f2c84010420 con 0x7f2c9c071ea0 2024-04-23T14:52:29.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.929+0000 7f2c93400700 1 --2- 172.21.15.81:0/2859924724 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f2c8006eca0 0x7f2c80071150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:52:29.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.929+0000 7f2c93400700 1 -- 172.21.15.81:0/2859924724 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f2c8408e9a0 con 0x7f2c9c071ea0 2024-04-23T14:52:29.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.929+0000 7f2c9aa00700 1 --2- 172.21.15.81:0/2859924724 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f2c8006eca0 0x7f2c80071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:52:29.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.930+0000 7f2c9aa00700 1 --2- 172.21.15.81:0/2859924724 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f2c8006eca0 0x7f2c80071150 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c004f90 tx=0x7f2c8c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:52:29.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:29.934+0000 7f2c93400700 1 -- 172.21.15.81:0/2859924724 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f2c8405b260 con 0x7f2c9c071ea0 2024-04-23T14:52:30.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:30.250+0000 7f2ca1a00700 1 -- 172.21.15.81:0/2859924724 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f2c9c04bed0 con 0x7f2c9c071ea0 2024-04-23T14:52:30.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:30.250+0000 7f2c93400700 1 -- 172.21.15.81:0/2859924724 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f2c8405adf0 con 0x7f2c9c071ea0 2024-04-23T14:52:30.251 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-04-23T14:52:30.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:30.253+0000 7f2ca1a00700 1 -- 172.21.15.81:0/2859924724 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f2c8006eca0 msgr2=0x7f2c80071150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:30.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:30.253+0000 7f2ca1a00700 1 --2- 172.21.15.81:0/2859924724 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f2c8006eca0 0x7f2c80071150 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c004f90 tx=0x7f2c8c009e30 comp rx=0 tx=0).stop 2024-04-23T14:52:30.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:30.253+0000 7f2ca1a00700 1 -- 172.21.15.81:0/2859924724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c9c071ea0 msgr2=0x7f2c9c114590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:52:30.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:30.253+0000 7f2ca1a00700 1 --2- 172.21.15.81:0/2859924724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c9c071ea0 0x7f2c9c114590 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2c8400b790 tx=0x7f2c84009250 comp rx=0 tx=0).stop 2024-04-23T14:52:30.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:30.253+0000 7f2ca1a00700 1 -- 172.21.15.81:0/2859924724 shutdown_connections 2024-04-23T14:52:30.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:30.253+0000 7f2ca1a00700 1 --2- 172.21.15.81:0/2859924724 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f2c8006eca0 0x7f2c80071150 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:30.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:30.253+0000 7f2ca1a00700 1 --2- 172.21.15.81:0/2859924724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c9c0708f0 0x7f2c9c114050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:30.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:30.253+0000 7f2ca1a00700 1 --2- 172.21.15.81:0/2859924724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c9c071ea0 0x7f2c9c114590 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:52:30.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:30.253+0000 7f2ca1a00700 1 -- 172.21.15.81:0/2859924724 >> 172.21.15.81:0/2859924724 conn(0x7f2c9c0f8530 msgr2=0x7f2c9c0f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:52:30.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:30.253+0000 7f2ca1a00700 1 -- 172.21.15.81:0/2859924724 shutdown_connections 2024-04-23T14:52:30.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:52:30.253+0000 7f2ca1a00700 1 -- 172.21.15.81:0/2859924724 wait complete. 2024-04-23T14:52:30.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:30 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/2859924724' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:52:30.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:30 smithi156 ceph-mon[32341]: from='client.? 172.21.15.81:0/2859924724' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:52:31.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:31 smithi156 ceph-mon[32341]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:52:31.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:31 smithi156 ceph-mon[32341]: pgmap v5: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-23T14:52:31.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:31 smithi156 ceph-mon[32341]: mgrmap e37: smithi081.ldghvq(active, since 4s), standbys: smithi156.ounwyj 2024-04-23T14:52:31.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:31 smithi156 ceph-mon[32341]: from='mgr.34102 ' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:31.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:31 smithi156 ceph-mon[32341]: from='mgr.34102 ' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:31.809 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:31 smithi081 ceph-mon[90469]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:52:31.809 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:31 smithi081 ceph-mon[90469]: pgmap v5: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-23T14:52:31.809 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:31 smithi081 ceph-mon[90469]: mgrmap e37: smithi081.ldghvq(active, since 4s), standbys: smithi156.ounwyj 2024-04-23T14:52:31.809 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:31 smithi081 ceph-mon[90469]: from='mgr.34102 ' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:31.809 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:31 smithi081 ceph-mon[90469]: from='mgr.34102 ' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:33.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:33 smithi156 ceph-mon[32341]: pgmap v6: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-23T14:52:33.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:33 smithi156 ceph-mon[32341]: from='mgr.34102 ' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:33.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:33 smithi156 ceph-mon[32341]: from='mgr.34102 ' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:33.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:33 smithi081 ceph-mon[90469]: pgmap v6: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-23T14:52:33.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:33 smithi081 ceph-mon[90469]: from='mgr.34102 ' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:33.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:33 smithi081 ceph-mon[90469]: from='mgr.34102 ' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:35.132 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:34 smithi156 ceph-mon[32341]: from='mgr.34102 ' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:35.132 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:34 smithi156 ceph-mon[32341]: from='mgr.34102 ' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:35.132 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:34 smithi156 ceph-mon[32341]: pgmap v7: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 18 op/s 2024-04-23T14:52:35.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:34 smithi081 ceph-mon[90469]: from='mgr.34102 ' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:35.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:34 smithi081 ceph-mon[90469]: from='mgr.34102 ' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:35.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:34 smithi081 ceph-mon[90469]: pgmap v7: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 18 op/s 2024-04-23T14:52:37.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:36 smithi156 ceph-mon[32341]: from='mgr.34102 ' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:37.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:36 smithi156 ceph-mon[32341]: from='mgr.34102 ' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:37.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:36 smithi156 ceph-mon[32341]: pgmap v8: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-23T14:52:37.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:36 smithi081 ceph-mon[90469]: from='mgr.34102 ' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:37.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:36 smithi081 ceph-mon[90469]: from='mgr.34102 ' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:37.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:36 smithi081 ceph-mon[90469]: pgmap v8: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-23T14:52:40.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:39 smithi156 ceph-mon[32341]: pgmap v9: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-23T14:52:40.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:39 smithi156 ceph-mon[32341]: from='mgr.34102 ' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:40.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:39 smithi156 ceph-mon[32341]: from='mgr.34102 ' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:40.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:39 smithi156 ceph-mon[32341]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:52:40.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:39 smithi156 ceph-mon[32341]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:52:40.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:39 smithi156 ceph-mon[32341]: Updating smithi081:/etc/ceph/ceph.conf 2024-04-23T14:52:40.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:39 smithi156 ceph-mon[32341]: Updating smithi156:/etc/ceph/ceph.conf 2024-04-23T14:52:40.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:39 smithi081 ceph-mon[90469]: pgmap v9: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-23T14:52:40.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:39 smithi081 ceph-mon[90469]: from='mgr.34102 ' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:40.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:39 smithi081 ceph-mon[90469]: from='mgr.34102 ' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:40.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:39 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:52:40.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:39 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:52:40.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:39 smithi081 ceph-mon[90469]: Updating smithi081:/etc/ceph/ceph.conf 2024-04-23T14:52:40.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:39 smithi081 ceph-mon[90469]: Updating smithi156:/etc/ceph/ceph.conf 2024-04-23T14:52:41.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:40 smithi156 ceph-mon[32341]: Updating smithi081:/var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:52:41.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:40 smithi156 ceph-mon[32341]: Updating smithi156:/var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:52:41.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:40 smithi081 ceph-mon[90469]: Updating smithi081:/var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:52:41.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:40 smithi081 ceph-mon[90469]: Updating smithi156:/var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T14:52:42.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:41 smithi156 ceph-mon[32341]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-04-23T14:52:42.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:41 smithi156 ceph-mon[32341]: Updating smithi156:/etc/ceph/ceph.client.admin.keyring 2024-04-23T14:52:42.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:41 smithi156 ceph-mon[32341]: pgmap v10: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 11 op/s 2024-04-23T14:52:42.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:41 smithi156 ceph-mon[32341]: from='mgr.34102 ' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:42.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:41 smithi156 ceph-mon[32341]: from='mgr.34102 ' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:42.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:41 smithi156 ceph-mon[32341]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:52:42.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:41 smithi081 ceph-mon[90469]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-04-23T14:52:42.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:41 smithi081 ceph-mon[90469]: Updating smithi156:/etc/ceph/ceph.client.admin.keyring 2024-04-23T14:52:42.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:41 smithi081 ceph-mon[90469]: pgmap v10: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 11 op/s 2024-04-23T14:52:42.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:41 smithi081 ceph-mon[90469]: from='mgr.34102 ' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:42.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:41 smithi081 ceph-mon[90469]: from='mgr.34102 ' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:42.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:41 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:52:43.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:42 smithi156 ceph-mon[32341]: Updating smithi081:/var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T14:52:43.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:42 smithi156 ceph-mon[32341]: Updating smithi156:/var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T14:52:43.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:42 smithi156 ceph-mon[32341]: from='mgr.34102 ' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:43.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:42 smithi156 ceph-mon[32341]: from='mgr.34102 ' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:43.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:42 smithi156 ceph-mon[32341]: from='mgr.34102 ' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:43.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:42 smithi156 ceph-mon[32341]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:52:43.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:42 smithi156 ceph-mon[32341]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:52:43.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:42 smithi156 ceph-mon[32341]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-23T14:52:43.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:42 smithi081 ceph-mon[90469]: Updating smithi081:/var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T14:52:43.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:42 smithi081 ceph-mon[90469]: Updating smithi156:/var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T14:52:43.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:42 smithi081 ceph-mon[90469]: from='mgr.34102 ' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:43.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:42 smithi081 ceph-mon[90469]: from='mgr.34102 ' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:43.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:42 smithi081 ceph-mon[90469]: from='mgr.34102 ' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:43.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:42 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:52:43.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:42 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:52:43.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:42 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-23T14:52:43.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:43 smithi081 ceph-mon[90469]: pgmap v11: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 11 op/s 2024-04-23T14:52:44.020 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:43 smithi156 ceph-mon[32341]: pgmap v11: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 11 op/s 2024-04-23T14:52:45.689 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:45 smithi156 ceph-mon[32341]: Upgrade: Updating mon.smithi156 2024-04-23T14:52:45.690 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:45 smithi156 ceph-mon[32341]: from='mgr.34102 ' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:45.690 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:45 smithi156 ceph-mon[32341]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T14:52:45.690 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:45 smithi156 ceph-mon[32341]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-23T14:52:45.690 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:45 smithi156 ceph-mon[32341]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:52:45.690 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:45 smithi156 ceph-mon[32341]: Deploying daemon mon.smithi156 on smithi156 2024-04-23T14:52:45.690 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:45 smithi156 ceph-mon[32341]: pgmap v12: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-23T14:52:45.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:45 smithi081 ceph-mon[90469]: Upgrade: Updating mon.smithi156 2024-04-23T14:52:45.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:45 smithi081 ceph-mon[90469]: from='mgr.34102 ' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:45.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:45 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T14:52:45.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:45 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-23T14:52:45.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:45 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:52:45.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:45 smithi081 ceph-mon[90469]: Deploying daemon mon.smithi156 on smithi156 2024-04-23T14:52:45.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:45 smithi081 ceph-mon[90469]: pgmap v12: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-23T14:52:47.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:46 smithi156 systemd[1]: Stopping Ceph mon.smithi156 for 7a641bea-017e-11ef-bc93-c7b262605968... 2024-04-23T14:52:47.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:47 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi156[32337]: 2024-04-23T14:52:47.464+0000 7f8beb600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi156 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T14:52:47.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:47 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi156[32337]: 2024-04-23T14:52:47.464+0000 7f8beb600700 -1 mon.smithi156@1(peon) e2 *** Got Signal Terminated *** 2024-04-23T14:52:47.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:47 smithi156 podman[77574]: 2024-04-23 14:52:47.56813671 +0000 UTC m=+0.261325465 container died d9127540d3bbee23319d4759bdab29035952e95c1fcc3bd9c128d99991cffc33 (image=quay.ceph.io/ceph-ci/ceph@sha256:3890cd726bd5e73ae623dabdf4ed76dd5df81c936b8bd8d761026babda969466, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi156, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, RELEASE=quincy-70d0cb4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux ) 2024-04-23T14:52:48.199 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:47 smithi156 podman[77574]: 2024-04-23 14:52:47.954456945 +0000 UTC m=+0.647645705 container cleanup d9127540d3bbee23319d4759bdab29035952e95c1fcc3bd9c128d99991cffc33 (image=quay.ceph.io/ceph-ci/ceph@sha256:3890cd726bd5e73ae623dabdf4ed76dd5df81c936b8bd8d761026babda969466, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi156, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=quincy-70d0cb4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2) 2024-04-23T14:52:48.199 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:47 smithi156 bash[77574]: ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi156 2024-04-23T14:52:48.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:48 smithi156 podman[77588]: 2024-04-23 14:52:48.197852301 +0000 UTC m=+0.617338157 container remove d9127540d3bbee23319d4759bdab29035952e95c1fcc3bd9c128d99991cffc33 (image=quay.ceph.io/ceph-ci/ceph@sha256:3890cd726bd5e73ae623dabdf4ed76dd5df81c936b8bd8d761026babda969466, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi156, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=quincy-70d0cb4, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-04-23T14:52:49.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:48 smithi156 systemd[1]: ceph-7a641bea-017e-11ef-bc93-c7b262605968@mon.smithi156.service: Deactivated successfully. 2024-04-23T14:52:49.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:48 smithi156 systemd[1]: Stopped Ceph mon.smithi156 for 7a641bea-017e-11ef-bc93-c7b262605968. 2024-04-23T14:52:49.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:48 smithi156 systemd[1]: ceph-7a641bea-017e-11ef-bc93-c7b262605968@mon.smithi156.service: Consumed 15.820s CPU time. 2024-04-23T14:52:49.489 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 systemd[1]: Starting Ceph mon.smithi156 for 7a641bea-017e-11ef-bc93-c7b262605968... 2024-04-23T14:52:49.778 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 podman[77719]: 2024-04-23 14:52:49.39284523 +0000 UTC m=+0.032125484 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T14:52:49.779 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 podman[77719]: 2024-04-23 14:52:49.50694123 +0000 UTC m=+0.146221506 container create 36409886998fdb911fa0eb143466f7e0fc276a32a810577dde9966c1130fc767 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi156, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-04-23T14:52:49.859 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 podman[77719]: 2024-04-23 14:52:49.777834054 +0000 UTC m=+0.417114345 container init 36409886998fdb911fa0eb143466f7e0fc276a32a810577dde9966c1130fc767 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi156, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True) 2024-04-23T14:52:49.859 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 podman[77719]: 2024-04-23 14:52:49.787548415 +0000 UTC m=+0.426828669 container start 36409886998fdb911fa0eb143466f7e0fc276a32a810577dde9966c1130fc767 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi156, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-04-23T14:52:49.859 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: set uid:gid to 167:167 (ceph:ceph) 2024-04-23T14:52:49.859 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev), process ceph-mon, pid 2 2024-04-23T14:52:49.859 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: pidfile_write: ignore empty --pid-file 2024-04-23T14:52:49.860 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: load: jerasure load: lrc 2024-04-23T14:52:49.860 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: RocksDB version: 7.9.2 2024-04-23T14:52:49.860 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Git sha 0 2024-04-23T14:52:49.860 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Compile date 2024-04-22 13:15:13 2024-04-23T14:52:49.860 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: DB SUMMARY 2024-04-23T14:52:49.860 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: DB Session ID: ZPRYUVYKDX29FKQRRJW3 2024-04-23T14:52:49.860 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: CURRENT file: CURRENT 2024-04-23T14:52:49.860 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: IDENTITY file: IDENTITY 2024-04-23T14:52:49.860 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: MANIFEST file: MANIFEST-000009 size: 1069 Bytes 2024-04-23T14:52:49.860 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi156/store.db dir, Total Num: 1, files: 000027.sst 2024-04-23T14:52:49.860 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi156/store.db: 000025.log size: 6598806 ; 2024-04-23T14:52:49.860 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.error_if_exists: 0 2024-04-23T14:52:49.860 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.create_if_missing: 0 2024-04-23T14:52:49.860 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.paranoid_checks: 1 2024-04-23T14:52:49.861 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-23T14:52:49.861 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-23T14:52:49.861 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-23T14:52:49.861 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.env: 0x5634c19fecc0 2024-04-23T14:52:49.861 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.fs: PosixFileSystem 2024-04-23T14:52:49.861 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.info_log: 0x5634ecdadb00 2024-04-23T14:52:49.861 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.max_file_opening_threads: 16 2024-04-23T14:52:49.862 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.statistics: (nil) 2024-04-23T14:52:49.862 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.use_fsync: 0 2024-04-23T14:52:49.862 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.max_log_file_size: 0 2024-04-23T14:52:49.862 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-23T14:52:49.862 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-23T14:52:49.862 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.keep_log_file_num: 1000 2024-04-23T14:52:49.862 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.recycle_log_file_num: 0 2024-04-23T14:52:49.862 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.allow_fallocate: 1 2024-04-23T14:52:49.862 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.allow_mmap_reads: 0 2024-04-23T14:52:49.862 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.allow_mmap_writes: 0 2024-04-23T14:52:49.863 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.use_direct_reads: 0 2024-04-23T14:52:49.863 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-23T14:52:49.863 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.create_missing_column_families: 0 2024-04-23T14:52:49.863 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.db_log_dir: 2024-04-23T14:52:49.863 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.wal_dir: 2024-04-23T14:52:49.863 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-23T14:52:49.863 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-23T14:52:49.863 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-23T14:52:49.863 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-23T14:52:49.863 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-23T14:52:49.863 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-23T14:52:49.863 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.advise_random_on_open: 1 2024-04-23T14:52:49.863 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.db_write_buffer_size: 0 2024-04-23T14:52:49.863 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.write_buffer_manager: 0x5634ecd7c1e0 2024-04-23T14:52:49.863 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-23T14:52:49.864 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-23T14:52:49.864 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-23T14:52:49.864 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.rate_limiter: (nil) 2024-04-23T14:52:49.864 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-23T14:52:49.864 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.wal_recovery_mode: 2 2024-04-23T14:52:49.864 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.enable_thread_tracking: 0 2024-04-23T14:52:49.864 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.enable_pipelined_write: 0 2024-04-23T14:52:49.864 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.unordered_write: 0 2024-04-23T14:52:49.864 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-23T14:52:49.864 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-23T14:52:49.864 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-23T14:52:49.864 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-23T14:52:49.864 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.row_cache: None 2024-04-23T14:52:49.864 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.wal_filter: None 2024-04-23T14:52:49.865 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-23T14:52:49.865 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.allow_ingest_behind: 0 2024-04-23T14:52:49.865 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.two_write_queues: 0 2024-04-23T14:52:49.865 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.manual_wal_flush: 0 2024-04-23T14:52:49.865 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.wal_compression: 0 2024-04-23T14:52:49.865 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.atomic_flush: 0 2024-04-23T14:52:49.865 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-23T14:52:49.865 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-23T14:52:49.865 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-23T14:52:49.865 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.log_readahead_size: 0 2024-04-23T14:52:49.865 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-23T14:52:49.865 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.best_efforts_recovery: 0 2024-04-23T14:52:49.865 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-23T14:52:49.865 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-23T14:52:49.865 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.allow_data_in_errors: 0 2024-04-23T14:52:49.865 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.db_host_id: __hostname__ 2024-04-23T14:52:49.866 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-23T14:52:49.866 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.max_background_jobs: 2 2024-04-23T14:52:49.866 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.max_background_compactions: -1 2024-04-23T14:52:49.866 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.max_subcompactions: 1 2024-04-23T14:52:49.866 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-23T14:52:49.866 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-23T14:52:49.866 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-23T14:52:49.866 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.max_total_wal_size: 0 2024-04-23T14:52:49.866 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-23T14:52:49.866 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-23T14:52:49.866 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-23T14:52:49.866 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-23T14:52:49.866 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.max_open_files: -1 2024-04-23T14:52:49.866 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.bytes_per_sync: 0 2024-04-23T14:52:49.867 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-23T14:52:49.867 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-23T14:52:49.867 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.compaction_readahead_size: 0 2024-04-23T14:52:49.867 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.max_background_flushes: -1 2024-04-23T14:52:49.867 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Compression algorithms supported: 2024-04-23T14:52:49.867 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-23T14:52:49.867 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: kZSTD supported: 0 2024-04-23T14:52:49.867 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: kXpressCompression supported: 0 2024-04-23T14:52:49.867 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: kLZ4HCCompression supported: 1 2024-04-23T14:52:49.867 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: kZlibCompression supported: 1 2024-04-23T14:52:49.867 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: kSnappyCompression supported: 1 2024-04-23T14:52:49.867 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: kLZ4Compression supported: 1 2024-04-23T14:52:49.867 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: kBZip2Compression supported: 0 2024-04-23T14:52:49.867 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-23T14:52:49.868 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-23T14:52:49.868 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi156/store.db/MANIFEST-000009 2024-04-23T14:52:49.868 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-23T14:52:49.868 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-23T14:52:49.868 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.merge_operator: 2024-04-23T14:52:49.868 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.compaction_filter: None 2024-04-23T14:52:49.868 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.compaction_filter_factory: None 2024-04-23T14:52:49.868 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.sst_partitioner_factory: None 2024-04-23T14:52:49.868 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-23T14:52:49.868 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-23T14:52:49.868 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5634ecdadce0) 2024-04-23T14:52:49.868 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: cache_index_and_filter_blocks: 1 2024-04-23T14:52:49.868 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-23T14:52:49.868 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-23T14:52:49.868 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: pin_top_level_index_and_filter: 1 2024-04-23T14:52:49.869 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: index_type: 0 2024-04-23T14:52:49.869 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: data_block_index_type: 0 2024-04-23T14:52:49.869 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: index_shortening: 1 2024-04-23T14:52:49.869 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-23T14:52:49.869 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: checksum: 4 2024-04-23T14:52:49.869 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: no_block_cache: 0 2024-04-23T14:52:49.869 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: block_cache: 0x5634ecdaf090 2024-04-23T14:52:49.869 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: block_cache_name: BinnedLRUCache 2024-04-23T14:52:49.869 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: block_cache_options: 2024-04-23T14:52:49.869 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: capacity : 536870912 2024-04-23T14:52:49.869 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: num_shard_bits : 4 2024-04-23T14:52:49.869 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: strict_capacity_limit : 0 2024-04-23T14:52:49.869 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: high_pri_pool_ratio: 0.000 2024-04-23T14:52:49.869 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: block_cache_compressed: (nil) 2024-04-23T14:52:49.869 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: persistent_cache: (nil) 2024-04-23T14:52:49.870 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: block_size: 4096 2024-04-23T14:52:49.870 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: block_size_deviation: 10 2024-04-23T14:52:49.870 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: block_restart_interval: 16 2024-04-23T14:52:49.870 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: index_block_restart_interval: 1 2024-04-23T14:52:49.870 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: metadata_block_size: 4096 2024-04-23T14:52:49.870 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: partition_filters: 0 2024-04-23T14:52:49.870 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: use_delta_encoding: 1 2024-04-23T14:52:49.870 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: filter_policy: bloomfilter 2024-04-23T14:52:49.870 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: whole_key_filtering: 1 2024-04-23T14:52:49.870 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: verify_compression: 0 2024-04-23T14:52:49.870 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: read_amp_bytes_per_bit: 0 2024-04-23T14:52:49.870 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: format_version: 5 2024-04-23T14:52:49.870 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: enable_index_compression: 1 2024-04-23T14:52:49.870 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: block_align: 0 2024-04-23T14:52:49.870 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: max_auto_readahead_size: 262144 2024-04-23T14:52:49.870 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: prepopulate_block_cache: 0 2024-04-23T14:52:49.871 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: initial_auto_readahead_size: 8192 2024-04-23T14:52:49.871 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: num_file_reads_for_auto_readahead: 2 2024-04-23T14:52:49.871 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.write_buffer_size: 33554432 2024-04-23T14:52:49.871 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.max_write_buffer_number: 2 2024-04-23T14:52:49.871 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.compression: NoCompression 2024-04-23T14:52:49.871 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.bottommost_compression: Disabled 2024-04-23T14:52:49.872 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.prefix_extractor: nullptr 2024-04-23T14:52:49.872 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-23T14:52:49.872 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.num_levels: 7 2024-04-23T14:52:49.872 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-23T14:52:49.872 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-23T14:52:49.872 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-23T14:52:49.872 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-23T14:52:49.872 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-23T14:52:49.872 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-23T14:52:49.872 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-23T14:52:49.872 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-23T14:52:49.872 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-23T14:52:49.872 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-23T14:52:49.872 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-23T14:52:49.872 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-23T14:52:49.873 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-23T14:52:49.873 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.compression_opts.level: 32767 2024-04-23T14:52:49.873 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.compression_opts.strategy: 0 2024-04-23T14:52:49.873 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-23T14:52:49.873 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-23T14:52:49.873 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-23T14:52:49.873 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-23T14:52:49.873 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.compression_opts.enabled: false 2024-04-23T14:52:49.873 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-23T14:52:49.873 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-23T14:52:49.873 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-23T14:52:49.873 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-23T14:52:49.873 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.target_file_size_base: 67108864 2024-04-23T14:52:49.873 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-23T14:52:49.873 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-23T14:52:49.873 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-23T14:52:49.874 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-23T14:52:49.874 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-23T14:52:49.874 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-23T14:52:49.874 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-23T14:52:49.874 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-23T14:52:49.874 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-23T14:52:49.874 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-23T14:52:49.874 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-23T14:52:49.874 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-23T14:52:49.874 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-23T14:52:49.874 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-23T14:52:49.874 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.arena_block_size: 1048576 2024-04-23T14:52:49.874 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-23T14:52:49.874 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-23T14:52:49.874 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.disable_auto_compactions: 0 2024-04-23T14:52:49.875 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-23T14:52:49.875 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-23T14:52:49.875 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-23T14:52:49.875 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-23T14:52:49.875 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-23T14:52:49.875 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-23T14:52:49.875 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-23T14:52:49.875 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-23T14:52:49.875 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-23T14:52:49.875 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-23T14:52:49.875 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-23T14:52:49.875 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.inplace_update_support: 0 2024-04-23T14:52:49.875 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-23T14:52:49.875 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-23T14:52:49.875 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-23T14:52:49.876 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-23T14:52:49.876 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.bloom_locality: 0 2024-04-23T14:52:49.876 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.max_successive_merges: 0 2024-04-23T14:52:49.876 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-23T14:52:49.876 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.paranoid_file_checks: 0 2024-04-23T14:52:49.876 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.force_consistency_checks: 1 2024-04-23T14:52:49.876 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.report_bg_io_stats: 0 2024-04-23T14:52:49.876 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.ttl: 2592000 2024-04-23T14:52:49.876 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-23T14:52:49.876 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-23T14:52:49.876 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-23T14:52:49.876 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.enable_blob_files: false 2024-04-23T14:52:49.876 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.min_blob_size: 0 2024-04-23T14:52:49.876 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.blob_file_size: 268435456 2024-04-23T14:52:49.876 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-23T14:52:49.877 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-23T14:52:49.877 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-23T14:52:49.877 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-23T14:52:49.877 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-23T14:52:49.877 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.blob_file_starting_level: 0 2024-04-23T14:52:49.877 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-23T14:52:49.877 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 27.sst 2024-04-23T14:52:49.877 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-23T14:52:49.877 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi156/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 29, last_sequence is 11935, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-23T14:52:49.877 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-04-23T14:52:49.877 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 4f9377e5-bedd-4293-bb80-1b7a54d7ef18 2024-04-23T14:52:49.877 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713883969846346, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-04-23T14:52:49.877 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-04-23T14:52:50.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713883969871288, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 3985364, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 11941, "largest_seqno": 13879, "table_properties": {"data_size": 3976850, "index_size": 5484, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1989, "raw_key_size": 18027, "raw_average_key_size": 22, "raw_value_size": 3960018, "raw_average_value_size": 5031, "num_data_blocks": 250, "num_entries": 787, "num_filter_entries": 787, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1713883969, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "4f9377e5-bedd-4293-bb80-1b7a54d7ef18", "db_session_id": "ZPRYUVYKDX29FKQRRJW3", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-04-23T14:52:50.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713883969871503, "job": 1, "event": "recovery_finished"} 2024-04-23T14:52:50.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-04-23T14:52:50.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-23T14:52:50.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi156/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-23T14:52:50.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5634ece9c000 2024-04-23T14:52:50.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: DB pointer 0x5634ece86000 2024-04-23T14:52:50.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-23T14:52:50.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-23T14:52:50.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: ** DB Stats ** 2024-04-23T14:52:50.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-23T14:52:50.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-23T14:52:50.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-23T14:52:50.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-23T14:52:50.039 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-23T14:52:50.039 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-23T14:52:50.039 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-23T14:52:50.039 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: 2024-04-23T14:52:50.039 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: ** Compaction Stats [default] ** 2024-04-23T14:52:50.039 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-23T14:52:50.039 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-23T14:52:50.039 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: L0 1/0 3.80 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 508.0 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-04-23T14:52:50.039 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: L6 1/0 5.44 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-04-23T14:52:50.039 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Sum 2/0 9.24 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 508.0 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-04-23T14:52:50.039 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 508.0 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-04-23T14:52:50.039 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: 2024-04-23T14:52:50.039 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: ** Compaction Stats [default] ** 2024-04-23T14:52:50.039 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-23T14:52:50.039 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-23T14:52:50.039 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 508.0 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-04-23T14:52:50.040 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: 2024-04-23T14:52:50.040 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-23T14:52:50.040 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: 2024-04-23T14:52:50.040 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-23T14:52:50.040 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Flush(GB): cumulative 0.004, interval 0.004 2024-04-23T14:52:50.040 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-23T14:52:50.040 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-23T14:52:50.040 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-23T14:52:50.040 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-23T14:52:50.040 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Cumulative compaction: 0.00 GB write, 124.28 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-23T14:52:50.040 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Interval compaction: 0.00 GB write, 124.28 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-23T14:52:50.040 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-23T14:52:50.040 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Block cache BinnedLRUCache@0x5634ecdaf090#2 capacity: 512.00 MB usage: 8.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 2.8e-05 secs_since: 0 2024-04-23T14:52:50.040 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.03 KB,0.00038743%) IndexBlock(1,6.08 KB,0.00115931%) Misc(1,0.00 KB,0%) 2024-04-23T14:52:50.040 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: 2024-04-23T14:52:50.040 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-23T14:52:50.041 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: starting mon.smithi156 rank 1 at public addrs [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] at bind addrs [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi156 fsid 7a641bea-017e-11ef-bc93-c7b262605968 2024-04-23T14:52:50.041 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: mon.smithi156@-1(???) e2 preinit fsid 7a641bea-017e-11ef-bc93-c7b262605968 2024-04-23T14:52:50.041 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: mon.smithi156@-1(???).mds e18 new map 2024-04-23T14:52:50.041 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: mon.smithi156@-1(???).mds e18 print_map 2024-04-23T14:52:50.041 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: e18 2024-04-23T14:52:50.041 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-23T14:52:50.041 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:52:50.041 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: legacy client fscid: 1 2024-04-23T14:52:50.041 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: 2024-04-23T14:52:50.041 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Filesystem 'cephfs' (1) 2024-04-23T14:52:50.041 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: fs_name cephfs 2024-04-23T14:52:50.041 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: epoch 17 2024-04-23T14:52:50.041 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-23T14:52:50.042 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: created 2024-04-23T14:45:51.264703+0000 2024-04-23T14:52:50.042 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: modified 2024-04-23T14:46:12.782992+0000 2024-04-23T14:52:50.042 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: tableserver 0 2024-04-23T14:52:50.042 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: root 0 2024-04-23T14:52:50.042 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: session_timeout 60 2024-04-23T14:52:50.042 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: session_autoclose 300 2024-04-23T14:52:50.042 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: max_file_size 1099511627776 2024-04-23T14:52:50.042 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: max_xattr_size 65536 2024-04-23T14:52:50.042 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: required_client_features {} 2024-04-23T14:52:50.042 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: last_failure 0 2024-04-23T14:52:50.042 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: last_failure_osd_epoch 47 2024-04-23T14:52:50.042 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:52:50.043 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: max_mds 1 2024-04-23T14:52:50.043 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: in 0 2024-04-23T14:52:50.043 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: up {0=14472} 2024-04-23T14:52:50.043 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: failed 2024-04-23T14:52:50.043 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: damaged 2024-04-23T14:52:50.043 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: stopped 2024-04-23T14:52:50.043 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: data_pools [3] 2024-04-23T14:52:50.043 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: metadata_pool 2 2024-04-23T14:52:50.043 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: inline_data disabled 2024-04-23T14:52:50.043 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: balancer 2024-04-23T14:52:50.043 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: bal_rank_mask -1 2024-04-23T14:52:50.043 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: standby_count_wanted 1 2024-04-23T14:52:50.043 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: qdb_cluster leader: 0 members: 2024-04-23T14:52:50.043 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: [mds.cephfs.smithi081.vcoywg{0:14472} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.81:6828/2563365650,v1:172.21.15.81:6829/2563365650] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:52:50.044 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: [mds.cephfs.smithi081.wydgcg{0:14482} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.81:6826/759909104,v1:172.21.15.81:6827/759909104] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:52:50.044 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: 2024-04-23T14:52:50.044 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: 2024-04-23T14:52:50.044 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: Standby daemons: 2024-04-23T14:52:50.044 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: 2024-04-23T14:52:50.044 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: [mds.cephfs.smithi156.vynkxn{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.156:6826/1794690362,v1:172.21.15.156:6827/1794690362] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:52:50.044 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout: [mds.cephfs.smithi156.rhbtxt{-1:24263} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.156:6824/3854041261,v1:172.21.15.156:6825/3854041261] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:52:50.044 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: mon.smithi156@-1(???).osd e50 crush map has features 3314933000852226048, adjusting msgr requires 2024-04-23T14:52:50.044 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: mon.smithi156@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-04-23T14:52:50.044 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: mon.smithi156@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-04-23T14:52:50.044 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: mon.smithi156@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-04-23T14:52:50.044 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 ceph-mon[77738]: mon.smithi156@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-04-23T14:52:50.044 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 bash[77719]: 36409886998fdb911fa0eb143466f7e0fc276a32a810577dde9966c1130fc767 2024-04-23T14:52:50.044 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:49 smithi156 systemd[1]: Started Ceph mon.smithi156 for 7a641bea-017e-11ef-bc93-c7b262605968. 2024-04-23T14:52:50.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:50 smithi081 ceph-mon[90469]: pgmap v13: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:52:50.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:50 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi081"}]: dispatch 2024-04-23T14:52:50.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:50 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2024-04-23T14:52:51.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:50 smithi156 ceph-mon[77738]: pgmap v13: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:52:51.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:50 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi081"}]: dispatch 2024-04-23T14:52:51.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:50 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2024-04-23T14:52:51.926 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:51 smithi156 ceph-mon[77738]: pgmap v15: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:52:51.926 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:51 smithi156 ceph-mon[77738]: osdmap e50: 6 total, 6 up, 6 in 2024-04-23T14:52:51.926 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:51 smithi156 ceph-mon[77738]: mgrmap e37: smithi081.ldghvq(active, since 24s), standbys: smithi156.ounwyj 2024-04-23T14:52:51.926 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:51 smithi156 ceph-mon[77738]: overall HEALTH_OK 2024-04-23T14:52:51.926 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:51 smithi156 ceph-mon[77738]: mon.smithi156 calling monitor election 2024-04-23T14:52:51.926 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:51 smithi156 ceph-mon[77738]: mon.smithi081 calling monitor election 2024-04-23T14:52:51.926 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:51 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi081"}]: dispatch 2024-04-23T14:52:51.926 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:51 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2024-04-23T14:52:51.926 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:51 smithi156 ceph-mon[77738]: mon.smithi081 is new leader, mons smithi081,smithi156 in quorum (ranks 0,1) 2024-04-23T14:52:51.926 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:51 smithi156 ceph-mon[77738]: monmap epoch 3 2024-04-23T14:52:51.926 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:51 smithi156 ceph-mon[77738]: fsid 7a641bea-017e-11ef-bc93-c7b262605968 2024-04-23T14:52:51.926 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:51 smithi156 ceph-mon[77738]: last_changed 2024-04-23T14:52:50.568977+0000 2024-04-23T14:52:51.927 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:51 smithi156 ceph-mon[77738]: created 2024-04-23T14:37:02.223037+0000 2024-04-23T14:52:51.927 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:51 smithi156 ceph-mon[77738]: min_mon_release 19 (squid) 2024-04-23T14:52:51.927 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:51 smithi156 ceph-mon[77738]: election_strategy: 1 2024-04-23T14:52:51.927 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:51 smithi156 ceph-mon[77738]: 0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.smithi081 2024-04-23T14:52:51.927 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:51 smithi156 ceph-mon[77738]: 1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.smithi156 2024-04-23T14:52:51.927 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:51 smithi156 ceph-mon[77738]: fsmap cephfs:1 {0=cephfs.smithi081.vcoywg=up:active} 1 up:standby-replay 2 up:standby 2024-04-23T14:52:51.927 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:51 smithi156 ceph-mon[77738]: osdmap e50: 6 total, 6 up, 6 in 2024-04-23T14:52:51.927 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:51 smithi156 ceph-mon[77738]: mgrmap e37: smithi081.ldghvq(active, since 24s), standbys: smithi156.ounwyj 2024-04-23T14:52:51.927 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:51 smithi156 ceph-mon[77738]: overall HEALTH_OK 2024-04-23T14:52:51.927 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:51 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:51.927 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:51 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:51.927 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:51 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:52:52.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:51 smithi081 ceph-mon[90469]: pgmap v15: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:52:52.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:51 smithi081 ceph-mon[90469]: osdmap e50: 6 total, 6 up, 6 in 2024-04-23T14:52:52.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:51 smithi081 ceph-mon[90469]: mgrmap e37: smithi081.ldghvq(active, since 24s), standbys: smithi156.ounwyj 2024-04-23T14:52:52.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:51 smithi081 ceph-mon[90469]: overall HEALTH_OK 2024-04-23T14:52:52.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:51 smithi081 ceph-mon[90469]: mon.smithi156 calling monitor election 2024-04-23T14:52:52.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:51 smithi081 ceph-mon[90469]: mon.smithi081 calling monitor election 2024-04-23T14:52:52.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:51 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi081"}]: dispatch 2024-04-23T14:52:52.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:51 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mon metadata", "id": "smithi156"}]: dispatch 2024-04-23T14:52:52.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:51 smithi081 ceph-mon[90469]: mon.smithi081 is new leader, mons smithi081,smithi156 in quorum (ranks 0,1) 2024-04-23T14:52:52.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:51 smithi081 ceph-mon[90469]: monmap epoch 3 2024-04-23T14:52:52.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:51 smithi081 ceph-mon[90469]: fsid 7a641bea-017e-11ef-bc93-c7b262605968 2024-04-23T14:52:52.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:51 smithi081 ceph-mon[90469]: last_changed 2024-04-23T14:52:50.568977+0000 2024-04-23T14:52:52.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:51 smithi081 ceph-mon[90469]: created 2024-04-23T14:37:02.223037+0000 2024-04-23T14:52:52.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:51 smithi081 ceph-mon[90469]: min_mon_release 19 (squid) 2024-04-23T14:52:52.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:51 smithi081 ceph-mon[90469]: election_strategy: 1 2024-04-23T14:52:52.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:51 smithi081 ceph-mon[90469]: 0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.smithi081 2024-04-23T14:52:52.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:51 smithi081 ceph-mon[90469]: 1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.smithi156 2024-04-23T14:52:52.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:51 smithi081 ceph-mon[90469]: fsmap cephfs:1 {0=cephfs.smithi081.vcoywg=up:active} 1 up:standby-replay 2 up:standby 2024-04-23T14:52:52.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:51 smithi081 ceph-mon[90469]: osdmap e50: 6 total, 6 up, 6 in 2024-04-23T14:52:52.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:51 smithi081 ceph-mon[90469]: mgrmap e37: smithi081.ldghvq(active, since 24s), standbys: smithi156.ounwyj 2024-04-23T14:52:52.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:51 smithi081 ceph-mon[90469]: overall HEALTH_OK 2024-04-23T14:52:52.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:51 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:52.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:51 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:52.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:51 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:52:53.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:53 smithi081 ceph-mon[90469]: pgmap v16: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:52:54.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:53 smithi156 ceph-mon[77738]: pgmap v16: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:52:56.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:55 smithi156 ceph-mon[77738]: pgmap v17: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:52:56.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:55 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:56.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:55 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:56.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:55 smithi081 ceph-mon[90469]: pgmap v17: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:52:56.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:55 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:56.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:55 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:57.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:56 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:52:57.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:56 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:52:57.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:57 smithi081 ceph-mon[90469]: pgmap v18: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-23T14:52:57.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:57 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:57.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:57 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:57.928 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:57 smithi156 ceph-mon[77738]: pgmap v18: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-23T14:52:57.928 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:57 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:57.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:57 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:52:59.919 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:52:59 smithi156 ceph-mon[77738]: pgmap v19: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:53:00.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:52:59 smithi081 ceph-mon[90469]: pgmap v19: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:53:00.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.418+0000 7f1aece00700 1 -- 172.21.15.81:0/1674825907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ae81002d0 msgr2=0x7f1ae8100740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:00.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.418+0000 7f1aece00700 1 --2- 172.21.15.81:0/1674825907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ae81002d0 0x7f1ae8100740 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4004940 tx=0x7f1ad4009e30 comp rx=0 tx=0).stop 2024-04-23T14:53:00.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.418+0000 7f1aece00700 1 -- 172.21.15.81:0/1674825907 shutdown_connections 2024-04-23T14:53:00.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.418+0000 7f1aece00700 1 --2- 172.21.15.81:0/1674825907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ae81002d0 0x7f1ae8100740 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:00.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.418+0000 7f1aece00700 1 --2- 172.21.15.81:0/1674825907 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ae80ff020 0x7f1ae80ff430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:00.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.418+0000 7f1aece00700 1 -- 172.21.15.81:0/1674825907 >> 172.21.15.81:0/1674825907 conn(0x7f1ae80fa950 msgr2=0x7f1ae80fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:00.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.418+0000 7f1aece00700 1 -- 172.21.15.81:0/1674825907 shutdown_connections 2024-04-23T14:53:00.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.418+0000 7f1aece00700 1 -- 172.21.15.81:0/1674825907 wait complete. 2024-04-23T14:53:00.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.419+0000 7f1aece00700 1 Processor -- start 2024-04-23T14:53:00.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.419+0000 7f1aece00700 1 -- start start 2024-04-23T14:53:00.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.420+0000 7f1aece00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ae80ff020 0x7f1ae810fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:00.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.420+0000 7f1aece00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ae81002d0 0x7f1ae81100b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:00.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.420+0000 7f1aece00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae81106b0 con 0x7f1ae81002d0 2024-04-23T14:53:00.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.420+0000 7f1aece00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae8110820 con 0x7f1ae80ff020 2024-04-23T14:53:00.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.420+0000 7f1ae5400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ae81002d0 0x7f1ae81100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:00.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.420+0000 7f1ae5400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ae81002d0 0x7f1ae81100b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41524/0 (socket says 172.21.15.81:41524) 2024-04-23T14:53:00.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.420+0000 7f1ae5e00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ae80ff020 0x7f1ae810fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:00.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.420+0000 7f1ae5400700 1 -- 172.21.15.81:0/3796032137 learned_addr learned my addr 172.21.15.81:0/3796032137 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:53:00.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.420+0000 7f1ae5400700 1 -- 172.21.15.81:0/3796032137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ae80ff020 msgr2=0x7f1ae810fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:00.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.420+0000 7f1ae5400700 1 --2- 172.21.15.81:0/3796032137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ae80ff020 0x7f1ae810fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:00.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.420+0000 7f1ae5400700 1 -- 172.21.15.81:0/3796032137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad4005040 con 0x7f1ae81002d0 2024-04-23T14:53:00.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.421+0000 7f1ae5400700 1 --2- 172.21.15.81:0/3796032137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ae81002d0 0x7f1ae81100b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4009150 tx=0x7f1ad4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:00.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.421+0000 7f1ade000700 1 -- 172.21.15.81:0/3796032137 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ad400e040 con 0x7f1ae81002d0 2024-04-23T14:53:00.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.421+0000 7f1ade000700 1 -- 172.21.15.81:0/3796032137 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1ad400bbf0 con 0x7f1ae81002d0 2024-04-23T14:53:00.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.421+0000 7f1ade000700 1 -- 172.21.15.81:0/3796032137 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ad401c630 con 0x7f1ae81002d0 2024-04-23T14:53:00.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.421+0000 7f1aece00700 1 -- 172.21.15.81:0/3796032137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ae8115220 con 0x7f1ae81002d0 2024-04-23T14:53:00.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.421+0000 7f1aece00700 1 -- 172.21.15.81:0/3796032137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ae81157e0 con 0x7f1ae81002d0 2024-04-23T14:53:00.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.422+0000 7f1aece00700 1 -- 172.21.15.81:0/3796032137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ae804c710 con 0x7f1ae81002d0 2024-04-23T14:53:00.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.423+0000 7f1ade000700 1 -- 172.21.15.81:0/3796032137 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f1ad400bd60 con 0x7f1ae81002d0 2024-04-23T14:53:00.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.424+0000 7f1ade000700 1 --2- 172.21.15.81:0/3796032137 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f1acc06ed30 0x7f1acc0711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:00.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.425+0000 7f1ade000700 1 -- 172.21.15.81:0/3796032137 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f1ad408fe90 con 0x7f1ae81002d0 2024-04-23T14:53:00.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.425+0000 7f1ae5e00700 1 --2- 172.21.15.81:0/3796032137 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f1acc06ed30 0x7f1acc0711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:00.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.426+0000 7f1ae5e00700 1 --2- 172.21.15.81:0/3796032137 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f1acc06ed30 0x7f1acc0711e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8004f40 tx=0x7f1ad800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:00.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.431+0000 7f1ade000700 1 -- 172.21.15.81:0/3796032137 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f1ad405c580 con 0x7f1ae81002d0 2024-04-23T14:53:00.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.682+0000 7f1aece00700 1 -- 172.21.15.81:0/3796032137 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ae81045f0 con 0x7f1acc06ed30 2024-04-23T14:53:00.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.684+0000 7f1ade000700 1 -- 172.21.15.81:0/3796032137 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f1ae81045f0 con 0x7f1acc06ed30 2024-04-23T14:53:00.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.687+0000 7f1aece00700 1 -- 172.21.15.81:0/3796032137 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f1acc06ed30 msgr2=0x7f1acc0711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:00.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.687+0000 7f1aece00700 1 --2- 172.21.15.81:0/3796032137 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f1acc06ed30 0x7f1acc0711e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8004f40 tx=0x7f1ad800b040 comp rx=0 tx=0).stop 2024-04-23T14:53:00.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.687+0000 7f1aece00700 1 -- 172.21.15.81:0/3796032137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ae81002d0 msgr2=0x7f1ae81100b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:00.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.687+0000 7f1aece00700 1 --2- 172.21.15.81:0/3796032137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ae81002d0 0x7f1ae81100b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4009150 tx=0x7f1ad4009e30 comp rx=0 tx=0).stop 2024-04-23T14:53:00.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.688+0000 7f1aece00700 1 -- 172.21.15.81:0/3796032137 shutdown_connections 2024-04-23T14:53:00.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.688+0000 7f1aece00700 1 --2- 172.21.15.81:0/3796032137 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f1acc06ed30 0x7f1acc0711e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:00.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.688+0000 7f1aece00700 1 --2- 172.21.15.81:0/3796032137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ae80ff020 0x7f1ae810fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:00.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.688+0000 7f1aece00700 1 --2- 172.21.15.81:0/3796032137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ae81002d0 0x7f1ae81100b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:00.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.688+0000 7f1aece00700 1 -- 172.21.15.81:0/3796032137 >> 172.21.15.81:0/3796032137 conn(0x7f1ae80fa950 msgr2=0x7f1ae80fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:00.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.688+0000 7f1aece00700 1 -- 172.21.15.81:0/3796032137 shutdown_connections 2024-04-23T14:53:00.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.688+0000 7f1aece00700 1 -- 172.21.15.81:0/3796032137 wait complete. 2024-04-23T14:53:00.705 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-04-23T14:53:00.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.842+0000 7ff829200700 1 -- 172.21.15.81:0/3915086091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff824103420 msgr2=0x7ff824103830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:00.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.842+0000 7ff829200700 1 --2- 172.21.15.81:0/3915086091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff824103420 0x7ff824103830 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff814004940 tx=0x7ff814009e30 comp rx=0 tx=0).stop 2024-04-23T14:53:00.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.842+0000 7ff829200700 1 -- 172.21.15.81:0/3915086091 shutdown_connections 2024-04-23T14:53:00.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.842+0000 7ff829200700 1 --2- 172.21.15.81:0/3915086091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8241046d0 0x7ff824104b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:00.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.842+0000 7ff829200700 1 --2- 172.21.15.81:0/3915086091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff824103420 0x7ff824103830 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:00.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.842+0000 7ff829200700 1 -- 172.21.15.81:0/3915086091 >> 172.21.15.81:0/3915086091 conn(0x7ff824072640 msgr2=0x7ff824074a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:00.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.842+0000 7ff829200700 1 -- 172.21.15.81:0/3915086091 shutdown_connections 2024-04-23T14:53:00.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.842+0000 7ff829200700 1 -- 172.21.15.81:0/3915086091 wait complete. 2024-04-23T14:53:00.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.843+0000 7ff829200700 1 Processor -- start 2024-04-23T14:53:00.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.843+0000 7ff829200700 1 -- start start 2024-04-23T14:53:00.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.843+0000 7ff829200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff824103420 0x7ff824113f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:00.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.843+0000 7ff829200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8241046d0 0x7ff8241144a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:00.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.843+0000 7ff829200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff824114aa0 con 0x7ff824103420 2024-04-23T14:53:00.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.843+0000 7ff829200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff824114c10 con 0x7ff8241046d0 2024-04-23T14:53:00.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.844+0000 7ff821e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff824103420 0x7ff824113f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:00.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.844+0000 7ff821e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff824103420 0x7ff824113f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41540/0 (socket says 172.21.15.81:41540) 2024-04-23T14:53:00.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.844+0000 7ff821e00700 1 -- 172.21.15.81:0/4079552424 learned_addr learned my addr 172.21.15.81:0/4079552424 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:53:00.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.844+0000 7ff821400700 1 --2- 172.21.15.81:0/4079552424 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8241046d0 0x7ff8241144a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:00.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.844+0000 7ff821e00700 1 -- 172.21.15.81:0/4079552424 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8241046d0 msgr2=0x7ff8241144a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:00.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.844+0000 7ff821e00700 1 --2- 172.21.15.81:0/4079552424 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8241046d0 0x7ff8241144a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:00.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.844+0000 7ff821e00700 1 -- 172.21.15.81:0/4079552424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff814005040 con 0x7ff824103420 2024-04-23T14:53:00.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.844+0000 7ff821e00700 1 --2- 172.21.15.81:0/4079552424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff824103420 0x7ff824113f60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff814009150 tx=0x7ff814009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:00.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.845+0000 7ff81a000700 1 -- 172.21.15.81:0/4079552424 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff81400e040 con 0x7ff824103420 2024-04-23T14:53:00.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.845+0000 7ff81a000700 1 -- 172.21.15.81:0/4079552424 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff81400bbf0 con 0x7ff824103420 2024-04-23T14:53:00.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.845+0000 7ff81a000700 1 -- 172.21.15.81:0/4079552424 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff81401c630 con 0x7ff824103420 2024-04-23T14:53:00.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.845+0000 7ff829200700 1 -- 172.21.15.81:0/4079552424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff824119610 con 0x7ff824103420 2024-04-23T14:53:00.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.845+0000 7ff829200700 1 -- 172.21.15.81:0/4079552424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff824119bd0 con 0x7ff824103420 2024-04-23T14:53:00.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.846+0000 7ff829200700 1 -- 172.21.15.81:0/4079552424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff82404c710 con 0x7ff824103420 2024-04-23T14:53:00.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.847+0000 7ff81a000700 1 -- 172.21.15.81:0/4079552424 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7ff81400bd60 con 0x7ff824103420 2024-04-23T14:53:00.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.848+0000 7ff81a000700 1 --2- 172.21.15.81:0/4079552424 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7ff80806ed30 0x7ff8080711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:00.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.848+0000 7ff81a000700 1 -- 172.21.15.81:0/4079552424 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7ff81408fe90 con 0x7ff824103420 2024-04-23T14:53:00.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.848+0000 7ff821400700 1 --2- 172.21.15.81:0/4079552424 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7ff80806ed30 0x7ff8080711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:00.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.849+0000 7ff821400700 1 --2- 172.21.15.81:0/4079552424 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7ff80806ed30 0x7ff8080711e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff810007fd0 tx=0x7ff810009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:00.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:00.853+0000 7ff81a000700 1 -- 172.21.15.81:0/4079552424 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7ff81405c600 con 0x7ff824103420 2024-04-23T14:53:01.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.080+0000 7ff829200700 1 -- 172.21.15.81:0/4079552424 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff824108a60 con 0x7ff80806ed30 2024-04-23T14:53:01.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.082+0000 7ff81a000700 1 -- 172.21.15.81:0/4079552424 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7ff824108a60 con 0x7ff80806ed30 2024-04-23T14:53:01.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.085+0000 7ff829200700 1 -- 172.21.15.81:0/4079552424 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7ff80806ed30 msgr2=0x7ff8080711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:01.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.085+0000 7ff829200700 1 --2- 172.21.15.81:0/4079552424 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7ff80806ed30 0x7ff8080711e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff810007fd0 tx=0x7ff810009040 comp rx=0 tx=0).stop 2024-04-23T14:53:01.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.085+0000 7ff829200700 1 -- 172.21.15.81:0/4079552424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff824103420 msgr2=0x7ff824113f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:01.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.085+0000 7ff829200700 1 --2- 172.21.15.81:0/4079552424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff824103420 0x7ff824113f60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff814009150 tx=0x7ff814009e30 comp rx=0 tx=0).stop 2024-04-23T14:53:01.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.085+0000 7ff829200700 1 -- 172.21.15.81:0/4079552424 shutdown_connections 2024-04-23T14:53:01.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.085+0000 7ff829200700 1 --2- 172.21.15.81:0/4079552424 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7ff80806ed30 0x7ff8080711e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:01.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.085+0000 7ff829200700 1 --2- 172.21.15.81:0/4079552424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff824103420 0x7ff824113f60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:01.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.085+0000 7ff829200700 1 --2- 172.21.15.81:0/4079552424 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8241046d0 0x7ff8241144a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:01.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.085+0000 7ff829200700 1 -- 172.21.15.81:0/4079552424 >> 172.21.15.81:0/4079552424 conn(0x7ff824072640 msgr2=0x7ff824073d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:01.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.085+0000 7ff829200700 1 -- 172.21.15.81:0/4079552424 shutdown_connections 2024-04-23T14:53:01.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.085+0000 7ff829200700 1 -- 172.21.15.81:0/4079552424 wait complete. 2024-04-23T14:53:01.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.230+0000 7f7439200700 1 -- 172.21.15.81:0/2537488203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74340fce80 msgr2=0x7f74340fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:01.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.230+0000 7f7439200700 1 --2- 172.21.15.81:0/2537488203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74340fce80 0x7f74340fd290 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7424004940 tx=0x7f7424009e30 comp rx=0 tx=0).stop 2024-04-23T14:53:01.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.231+0000 7f7439200700 1 -- 172.21.15.81:0/2537488203 shutdown_connections 2024-04-23T14:53:01.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.231+0000 7f7439200700 1 --2- 172.21.15.81:0/2537488203 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74340fdff0 0x7f74340fe460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:01.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.231+0000 7f7439200700 1 --2- 172.21.15.81:0/2537488203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74340fce80 0x7f74340fd290 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:01.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.231+0000 7f7439200700 1 -- 172.21.15.81:0/2537488203 >> 172.21.15.81:0/2537488203 conn(0x7f74340f8580 msgr2=0x7f74340fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:01.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.231+0000 7f7439200700 1 -- 172.21.15.81:0/2537488203 shutdown_connections 2024-04-23T14:53:01.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.231+0000 7f7439200700 1 -- 172.21.15.81:0/2537488203 wait complete. 2024-04-23T14:53:01.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.231+0000 7f7439200700 1 Processor -- start 2024-04-23T14:53:01.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.232+0000 7f7439200700 1 -- start start 2024-04-23T14:53:01.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.232+0000 7f7439200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74340fce80 0x7f7434071c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:01.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.232+0000 7f7439200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74340fdff0 0x7f7434070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:01.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.232+0000 7f7439200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7434072260 con 0x7f74340fdff0 2024-04-23T14:53:01.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.232+0000 7f7439200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7434070850 con 0x7f74340fce80 2024-04-23T14:53:01.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.232+0000 7f7431400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74340fdff0 0x7f7434070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:01.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.232+0000 7f7431400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74340fdff0 0x7f7434070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41552/0 (socket says 172.21.15.81:41552) 2024-04-23T14:53:01.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.232+0000 7f7431400700 1 -- 172.21.15.81:0/4138404814 learned_addr learned my addr 172.21.15.81:0/4138404814 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:53:01.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.232+0000 7f7431e00700 1 --2- 172.21.15.81:0/4138404814 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74340fce80 0x7f7434071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:01.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.233+0000 7f7431400700 1 -- 172.21.15.81:0/4138404814 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74340fce80 msgr2=0x7f7434071c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:01.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.233+0000 7f7431400700 1 --2- 172.21.15.81:0/4138404814 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74340fce80 0x7f7434071c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:01.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.233+0000 7f7431400700 1 -- 172.21.15.81:0/4138404814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7424005040 con 0x7f74340fdff0 2024-04-23T14:53:01.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.233+0000 7f7431400700 1 --2- 172.21.15.81:0/4138404814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74340fdff0 0x7f7434070310 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f742000c8c0 tx=0x7f74200044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:01.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.233+0000 7f742a000700 1 -- 172.21.15.81:0/4138404814 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f742000a760 con 0x7f74340fdff0 2024-04-23T14:53:01.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.233+0000 7f742a000700 1 -- 172.21.15.81:0/4138404814 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f742000ad90 con 0x7f74340fdff0 2024-04-23T14:53:01.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.233+0000 7f742a000700 1 -- 172.21.15.81:0/4138404814 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74200113a0 con 0x7f74340fdff0 2024-04-23T14:53:01.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.234+0000 7f7439200700 1 -- 172.21.15.81:0/4138404814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7434070b00 con 0x7f74340fdff0 2024-04-23T14:53:01.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.234+0000 7f7439200700 1 -- 172.21.15.81:0/4138404814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74340710c0 con 0x7f74340fdff0 2024-04-23T14:53:01.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.235+0000 7f7439200700 1 -- 172.21.15.81:0/4138404814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f743404c710 con 0x7f74340fdff0 2024-04-23T14:53:01.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.236+0000 7f742a000700 1 -- 172.21.15.81:0/4138404814 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f7420012400 con 0x7f74340fdff0 2024-04-23T14:53:01.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.237+0000 7f742a000700 1 --2- 172.21.15.81:0/4138404814 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f741806ed30 0x7f74180711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:01.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.237+0000 7f742a000700 1 -- 172.21.15.81:0/4138404814 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f742008e9b0 con 0x7f74340fdff0 2024-04-23T14:53:01.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.237+0000 7f7431e00700 1 --2- 172.21.15.81:0/4138404814 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f741806ed30 0x7f74180711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:01.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.238+0000 7f7431e00700 1 --2- 172.21.15.81:0/4138404814 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f741806ed30 0x7f74180711e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f742400b3b0 tx=0x7f7424009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:01.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.242+0000 7f742a000700 1 -- 172.21.15.81:0/4138404814 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f742005b230 con 0x7f74340fdff0 2024-04-23T14:53:01.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.462+0000 7f7439200700 1 -- 172.21.15.81:0/4138404814 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7434102380 con 0x7f741806ed30 2024-04-23T14:53:01.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.481+0000 7f742a000700 1 -- 172.21.15.81:0/4138404814 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f7434102380 con 0x7f741806ed30 2024-04-23T14:53:01.483 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-23T14:53:01.483 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (3m) 27s ago 14m 14.0M - 0.25.0 c8568f914cd2 63876b2abc27 2024-04-23T14:53:01.483 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (14m) 27s ago 14m 6660k - 17.2.7-884-g70d0cb4b cafd8ddac8fa 6ae90c81b232 2024-04-23T14:53:01.483 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi156 smithi156 running (13m) 6s ago 13m 6660k - 17.2.7-884-g70d0cb4b cafd8ddac8fa ecc141919f37 2024-04-23T14:53:01.483 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (3m) 27s ago 13m 75.3M - 9.4.7 954c08fa6188 fbad3cef0883 2024-04-23T14:53:01.483 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.vcoywg smithi081 running (6m) 27s ago 6m 148M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 2ca7601ab60f 2024-04-23T14:53:01.483 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.wydgcg smithi081 running (7m) 27s ago 7m 108M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 58eb1a961b61 2024-04-23T14:53:01.483 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.rhbtxt smithi156 running (7m) 6s ago 7m 13.4M - 17.2.7-884-g70d0cb4b cafd8ddac8fa db3cb5034381 2024-04-23T14:53:01.483 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.vynkxn smithi156 running (6m) 6s ago 6m 13.6M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 1c8f2219e7fd 2024-04-23T14:53:01.484 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.ldghvq smithi081 *:8443,9283,8765 running (2m) 27s ago 15m 478M - 19.0.0-3126-gd44fddd9 76e77f280c74 6bf23484a1c9 2024-04-23T14:53:01.484 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi156.ounwyj smithi156 *:8443,9283,8765 running (79s) 6s ago 12m 449M - 19.0.0-3126-gd44fddd9 76e77f280c74 a6c0dd9f89f2 2024-04-23T14:53:01.484 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (55s) 27s ago 15m 30.8M 2048M 19.0.0-3126-gd44fddd9 76e77f280c74 fbf9f9a59ac2 2024-04-23T14:53:01.484 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi156 smithi156 running (12s) 6s ago 12m 22.7M 2048M 19.0.0-3126-gd44fddd9 76e77f280c74 36409886998f 2024-04-23T14:53:01.484 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (3m) 27s ago 14m 7348k - 1.5.0 0da6a335fe13 197b27809010 2024-04-23T14:53:01.484 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi156 smithi156 *:9100 running (2m) 6s ago 12m 7549k - 1.5.0 0da6a335fe13 91a7c5e86d47 2024-04-23T14:53:01.484 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (11m) 27s ago 11m 246M 1557M 17.2.7-884-g70d0cb4b cafd8ddac8fa 272ca032bec1 2024-04-23T14:53:01.484 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (11m) 27s ago 11m 253M 1557M 17.2.7-884-g70d0cb4b cafd8ddac8fa ee6d0c8af6ed 2024-04-23T14:53:01.484 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (10m) 27s ago 10m 216M 1557M 17.2.7-884-g70d0cb4b cafd8ddac8fa c26c640828a2 2024-04-23T14:53:01.484 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi156 running (10m) 6s ago 10m 286M 2581M 17.2.7-884-g70d0cb4b cafd8ddac8fa c1c261b1ee90 2024-04-23T14:53:01.484 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi156 running (9m) 6s ago 9m 255M 2581M 17.2.7-884-g70d0cb4b cafd8ddac8fa 83f996ee64de 2024-04-23T14:53:01.484 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi156 running (8m) 6s ago 8m 239M 2581M 17.2.7-884-g70d0cb4b cafd8ddac8fa b754244bef18 2024-04-23T14:53:01.484 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (87s) 27s ago 13m 49.2M - 2.43.0 a07b618ecd1d 35558adb166d 2024-04-23T14:53:01.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.484+0000 7f7439200700 1 -- 172.21.15.81:0/4138404814 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f741806ed30 msgr2=0x7f74180711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:01.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.484+0000 7f7439200700 1 --2- 172.21.15.81:0/4138404814 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f741806ed30 0x7f74180711e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f742400b3b0 tx=0x7f7424009e30 comp rx=0 tx=0).stop 2024-04-23T14:53:01.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.484+0000 7f7439200700 1 -- 172.21.15.81:0/4138404814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74340fdff0 msgr2=0x7f7434070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:01.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.484+0000 7f7439200700 1 --2- 172.21.15.81:0/4138404814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74340fdff0 0x7f7434070310 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f742000c8c0 tx=0x7f74200044c0 comp rx=0 tx=0).stop 2024-04-23T14:53:01.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.484+0000 7f7439200700 1 -- 172.21.15.81:0/4138404814 shutdown_connections 2024-04-23T14:53:01.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.484+0000 7f7439200700 1 --2- 172.21.15.81:0/4138404814 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f741806ed30 0x7f74180711e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:01.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.484+0000 7f7439200700 1 --2- 172.21.15.81:0/4138404814 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74340fce80 0x7f7434071c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:01.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.484+0000 7f7439200700 1 --2- 172.21.15.81:0/4138404814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74340fdff0 0x7f7434070310 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:01.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.484+0000 7f7439200700 1 -- 172.21.15.81:0/4138404814 >> 172.21.15.81:0/4138404814 conn(0x7f74340f8580 msgr2=0x7f74340f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:01.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.484+0000 7f7439200700 1 -- 172.21.15.81:0/4138404814 shutdown_connections 2024-04-23T14:53:01.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.484+0000 7f7439200700 1 -- 172.21.15.81:0/4138404814 wait complete. 2024-04-23T14:53:01.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.621+0000 7fa12e200700 1 -- 172.21.15.81:0/1137535356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1280fc110 msgr2=0x7fa1280fc520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:01.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.621+0000 7fa12e200700 1 --2- 172.21.15.81:0/1137535356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1280fc110 0x7fa1280fc520 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa11c004940 tx=0x7fa11c009e30 comp rx=0 tx=0).stop 2024-04-23T14:53:01.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.621+0000 7fa12e200700 1 -- 172.21.15.81:0/1137535356 shutdown_connections 2024-04-23T14:53:01.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.621+0000 7fa12e200700 1 --2- 172.21.15.81:0/1137535356 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1280fca60 0x7fa1280fced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:01.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.621+0000 7fa12e200700 1 --2- 172.21.15.81:0/1137535356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1280fc110 0x7fa1280fc520 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:01.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.621+0000 7fa12e200700 1 -- 172.21.15.81:0/1137535356 >> 172.21.15.81:0/1137535356 conn(0x7fa1280f6a00 msgr2=0x7fa1280f8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:01.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.621+0000 7fa12e200700 1 -- 172.21.15.81:0/1137535356 shutdown_connections 2024-04-23T14:53:01.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.621+0000 7fa12e200700 1 -- 172.21.15.81:0/1137535356 wait complete. 2024-04-23T14:53:01.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.622+0000 7fa12e200700 1 Processor -- start 2024-04-23T14:53:01.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.622+0000 7fa12e200700 1 -- start start 2024-04-23T14:53:01.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.623+0000 7fa12e200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1280fc110 0x7fa12810fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:01.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.623+0000 7fa12e200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1280fca60 0x7fa1281100d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:01.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.623+0000 7fa12e200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa128110760 con 0x7fa1280fc110 2024-04-23T14:53:01.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.623+0000 7fa12e200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa128110f50 con 0x7fa1280fca60 2024-04-23T14:53:01.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.623+0000 7fa12ce00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1280fc110 0x7fa12810fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:01.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.623+0000 7fa12ce00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1280fc110 0x7fa12810fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41572/0 (socket says 172.21.15.81:41572) 2024-04-23T14:53:01.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.623+0000 7fa12ce00700 1 -- 172.21.15.81:0/3532588904 learned_addr learned my addr 172.21.15.81:0/3532588904 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:53:01.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.623+0000 7fa12ce00700 1 -- 172.21.15.81:0/3532588904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1280fca60 msgr2=0x7fa1281100d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:01.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.623+0000 7fa12ce00700 1 --2- 172.21.15.81:0/3532588904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1280fca60 0x7fa1281100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:01.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.623+0000 7fa12ce00700 1 -- 172.21.15.81:0/3532588904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa11c005040 con 0x7fa1280fc110 2024-04-23T14:53:01.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.624+0000 7fa12ce00700 1 --2- 172.21.15.81:0/3532588904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1280fc110 0x7fa12810fb90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa11c00b3b0 tx=0x7fa11c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:01.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.624+0000 7fa124c00700 1 -- 172.21.15.81:0/3532588904 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa11c00e040 con 0x7fa1280fc110 2024-04-23T14:53:01.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.624+0000 7fa124c00700 1 -- 172.21.15.81:0/3532588904 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa11c004290 con 0x7fa1280fc110 2024-04-23T14:53:01.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.624+0000 7fa12e200700 1 -- 172.21.15.81:0/3532588904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1281111d0 con 0x7fa1280fc110 2024-04-23T14:53:01.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.624+0000 7fa124c00700 1 -- 172.21.15.81:0/3532588904 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa11c01c3f0 con 0x7fa1280fc110 2024-04-23T14:53:01.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.624+0000 7fa12e200700 1 -- 172.21.15.81:0/3532588904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa128111790 con 0x7fa1280fc110 2024-04-23T14:53:01.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.625+0000 7fa12e200700 1 -- 172.21.15.81:0/3532588904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa128101860 con 0x7fa1280fc110 2024-04-23T14:53:01.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.626+0000 7fa124c00700 1 -- 172.21.15.81:0/3532588904 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7fa11c013420 con 0x7fa1280fc110 2024-04-23T14:53:01.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.627+0000 7fa124c00700 1 --2- 172.21.15.81:0/3532588904 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa11006ed20 0x7fa1100711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:01.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.627+0000 7fa124c00700 1 -- 172.21.15.81:0/3532588904 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fa11c08fdc0 con 0x7fa1280fc110 2024-04-23T14:53:01.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.627+0000 7fa127e00700 1 --2- 172.21.15.81:0/3532588904 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa11006ed20 0x7fa1100711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:01.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.628+0000 7fa127e00700 1 --2- 172.21.15.81:0/3532588904 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa11006ed20 0x7fa1100711d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa114006fd0 tx=0x7fa114006db0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:01.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.632+0000 7fa124c00700 1 -- 172.21.15.81:0/3532588904 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fa11c093030 con 0x7fa1280fc110 2024-04-23T14:53:01.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:01 smithi156 ceph-mon[77738]: pgmap v20: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-23T14:53:01.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:01 smithi156 ceph-mon[77738]: from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:53:01.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:01 smithi081 ceph-mon[90469]: pgmap v20: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-23T14:53:01.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:01 smithi081 ceph-mon[90469]: from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:53:01.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.926+0000 7fa12e200700 1 -- 172.21.15.81:0/3532588904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa12804bed0 con 0x7fa1280fc110 2024-04-23T14:53:01.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.927+0000 7fa124c00700 1 -- 172.21.15.81:0/3532588904 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7fa11c05c4b0 con 0x7fa1280fc110 2024-04-23T14:53:01.929 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:53:01.929 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-04-23T14:53:01.929 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T14:53:01.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:53:01.929 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-04-23T14:53:01.929 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T14:53:01.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:53:01.930 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-04-23T14:53:01.930 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 6 2024-04-23T14:53:01.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:53:01.930 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-04-23T14:53:01.930 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 4 2024-04-23T14:53:01.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:53:01.930 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-04-23T14:53:01.930 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 10, 2024-04-23T14:53:01.930 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 4 2024-04-23T14:53:01.930 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-23T14:53:01.930 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:53:01.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.930+0000 7fa12e200700 1 -- 172.21.15.81:0/3532588904 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa11006ed20 msgr2=0x7fa1100711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:01.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.930+0000 7fa12e200700 1 --2- 172.21.15.81:0/3532588904 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa11006ed20 0x7fa1100711d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa114006fd0 tx=0x7fa114006db0 comp rx=0 tx=0).stop 2024-04-23T14:53:01.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.930+0000 7fa12e200700 1 -- 172.21.15.81:0/3532588904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1280fc110 msgr2=0x7fa12810fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:01.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.930+0000 7fa12e200700 1 --2- 172.21.15.81:0/3532588904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1280fc110 0x7fa12810fb90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa11c00b3b0 tx=0x7fa11c009e30 comp rx=0 tx=0).stop 2024-04-23T14:53:01.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.930+0000 7fa12e200700 1 -- 172.21.15.81:0/3532588904 shutdown_connections 2024-04-23T14:53:01.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.930+0000 7fa12e200700 1 --2- 172.21.15.81:0/3532588904 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa11006ed20 0x7fa1100711d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:01.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.930+0000 7fa12e200700 1 --2- 172.21.15.81:0/3532588904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1280fc110 0x7fa12810fb90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:01.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.930+0000 7fa12e200700 1 --2- 172.21.15.81:0/3532588904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1280fca60 0x7fa1281100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:01.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.930+0000 7fa12e200700 1 -- 172.21.15.81:0/3532588904 >> 172.21.15.81:0/3532588904 conn(0x7fa1280f6a00 msgr2=0x7fa1280fb460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:01.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.930+0000 7fa12e200700 1 -- 172.21.15.81:0/3532588904 shutdown_connections 2024-04-23T14:53:01.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:01.930+0000 7fa12e200700 1 -- 172.21.15.81:0/3532588904 wait complete. 2024-04-23T14:53:02.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.076+0000 7fc09ca00700 1 -- 172.21.15.81:0/3356285515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0980fcef0 msgr2=0x7fc0980fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:02.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.076+0000 7fc09ca00700 1 --2- 172.21.15.81:0/3356285515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0980fcef0 0x7fc0980fd320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc088004940 tx=0x7fc088009e30 comp rx=0 tx=0).stop 2024-04-23T14:53:02.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.076+0000 7fc09ca00700 1 -- 172.21.15.81:0/3356285515 shutdown_connections 2024-04-23T14:53:02.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.076+0000 7fc09ca00700 1 --2- 172.21.15.81:0/3356285515 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc0980fe0e0 0x7fc0980fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:02.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.076+0000 7fc09ca00700 1 --2- 172.21.15.81:0/3356285515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0980fcef0 0x7fc0980fd320 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:02.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.076+0000 7fc09ca00700 1 -- 172.21.15.81:0/3356285515 >> 172.21.15.81:0/3356285515 conn(0x7fc0980f8530 msgr2=0x7fc0980fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:02.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.076+0000 7fc09ca00700 1 -- 172.21.15.81:0/3356285515 shutdown_connections 2024-04-23T14:53:02.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.076+0000 7fc09ca00700 1 -- 172.21.15.81:0/3356285515 wait complete. 2024-04-23T14:53:02.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.077+0000 7fc09ca00700 1 Processor -- start 2024-04-23T14:53:02.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.078+0000 7fc09ca00700 1 -- start start 2024-04-23T14:53:02.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.078+0000 7fc09ca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0980fcef0 0x7fc098071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:02.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.078+0000 7fc09ca00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc0980fe0e0 0x7fc098070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:02.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.078+0000 7fc09ca00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc098070950 con 0x7fc0980fcef0 2024-04-23T14:53:02.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.078+0000 7fc09ca00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc098070ac0 con 0x7fc0980fe0e0 2024-04-23T14:53:02.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.078+0000 7fc095e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0980fcef0 0x7fc098071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:02.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.079+0000 7fc095e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0980fcef0 0x7fc098071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41596/0 (socket says 172.21.15.81:41596) 2024-04-23T14:53:02.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.079+0000 7fc095e00700 1 -- 172.21.15.81:0/1397712869 learned_addr learned my addr 172.21.15.81:0/1397712869 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:53:02.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.079+0000 7fc095400700 1 --2- 172.21.15.81:0/1397712869 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc0980fe0e0 0x7fc098070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:02.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.079+0000 7fc095e00700 1 -- 172.21.15.81:0/1397712869 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc0980fe0e0 msgr2=0x7fc098070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:02.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.079+0000 7fc095e00700 1 --2- 172.21.15.81:0/1397712869 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc0980fe0e0 0x7fc098070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:02.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.079+0000 7fc095e00700 1 -- 172.21.15.81:0/1397712869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc088005040 con 0x7fc0980fcef0 2024-04-23T14:53:02.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.079+0000 7fc095e00700 1 --2- 172.21.15.81:0/1397712869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0980fcef0 0x7fc098071e40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc088000c00 tx=0x7fc088009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:02.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.080+0000 7fc08e000700 1 -- 172.21.15.81:0/1397712869 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc08800e040 con 0x7fc0980fcef0 2024-04-23T14:53:02.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.080+0000 7fc08e000700 1 -- 172.21.15.81:0/1397712869 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc08800bcc0 con 0x7fc0980fcef0 2024-04-23T14:53:02.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.080+0000 7fc09ca00700 1 -- 172.21.15.81:0/1397712869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc098070d40 con 0x7fc0980fcef0 2024-04-23T14:53:02.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.080+0000 7fc08e000700 1 -- 172.21.15.81:0/1397712869 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc08801c630 con 0x7fc0980fcef0 2024-04-23T14:53:02.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.080+0000 7fc09ca00700 1 -- 172.21.15.81:0/1397712869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc098115a60 con 0x7fc0980fcef0 2024-04-23T14:53:02.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.081+0000 7fc09ca00700 1 -- 172.21.15.81:0/1397712869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc09805f5f0 con 0x7fc0980fcef0 2024-04-23T14:53:02.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.082+0000 7fc08e000700 1 -- 172.21.15.81:0/1397712869 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7fc088013980 con 0x7fc0980fcef0 2024-04-23T14:53:02.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.083+0000 7fc08e000700 1 --2- 172.21.15.81:0/1397712869 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc07c06ed20 0x7fc07c0711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:02.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.083+0000 7fc08e000700 1 -- 172.21.15.81:0/1397712869 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fc08808fd40 con 0x7fc0980fcef0 2024-04-23T14:53:02.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.083+0000 7fc095400700 1 --2- 172.21.15.81:0/1397712869 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc07c06ed20 0x7fc07c0711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:02.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.084+0000 7fc095400700 1 --2- 172.21.15.81:0/1397712869 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc07c06ed20 0x7fc07c0711d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc084009b10 tx=0x7fc084008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:02.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.088+0000 7fc08e000700 1 -- 172.21.15.81:0/1397712869 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fc088058af0 con 0x7fc0980fcef0 2024-04-23T14:53:02.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.362+0000 7fc09ca00700 1 -- 172.21.15.81:0/1397712869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc09804bed0 con 0x7fc0980fcef0 2024-04-23T14:53:02.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.364+0000 7fc08e000700 1 -- 172.21.15.81:0/1397712869 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1907 (secure 0 0 0) 0x7fc08805c1b0 con 0x7fc0980fcef0 2024-04-23T14:53:02.367 INFO:teuthology.orchestra.run.smithi081.stdout:e18 2024-04-23T14:53:02.367 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-23T14:53:02.368 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:53:02.368 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-04-23T14:53:02.368 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:53:02.368 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-04-23T14:53:02.368 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-04-23T14:53:02.368 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 17 2024-04-23T14:53:02.369 INFO:teuthology.orchestra.run.smithi081.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-23T14:53:02.369 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-04-23T14:45:51.264703+0000 2024-04-23T14:53:02.369 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-04-23T14:46:12.782992+0000 2024-04-23T14:53:02.369 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-04-23T14:53:02.369 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-04-23T14:53:02.369 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-04-23T14:53:02.370 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-04-23T14:53:02.370 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-04-23T14:53:02.370 INFO:teuthology.orchestra.run.smithi081.stdout:max_xattr_size 65536 2024-04-23T14:53:02.370 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-04-23T14:53:02.370 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-04-23T14:53:02.370 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 47 2024-04-23T14:53:02.371 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:53:02.371 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 1 2024-04-23T14:53:02.371 INFO:teuthology.orchestra.run.smithi081.stdout:in 0 2024-04-23T14:53:02.371 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=14472} 2024-04-23T14:53:02.371 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-04-23T14:53:02.371 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-04-23T14:53:02.372 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-04-23T14:53:02.372 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-04-23T14:53:02.372 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-04-23T14:53:02.372 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-04-23T14:53:02.372 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-04-23T14:53:02.372 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-04-23T14:53:02.372 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-04-23T14:53:02.373 INFO:teuthology.orchestra.run.smithi081.stdout:qdb_cluster leader: 0 members: 2024-04-23T14:53:02.373 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.vcoywg{0:14472} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.81:6828/2563365650,v1:172.21.15.81:6829/2563365650] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:53:02.373 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.wydgcg{0:14482} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.81:6826/759909104,v1:172.21.15.81:6827/759909104] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:53:02.373 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:53:02.373 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:53:02.373 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-04-23T14:53:02.373 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:53:02.373 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.vynkxn{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.156:6826/1794690362,v1:172.21.15.156:6827/1794690362] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:53:02.373 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.rhbtxt{-1:24263} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.156:6824/3854041261,v1:172.21.15.156:6825/3854041261] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:53:02.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.368+0000 7fc09ca00700 1 -- 172.21.15.81:0/1397712869 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc07c06ed20 msgr2=0x7fc07c0711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:02.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.368+0000 7fc09ca00700 1 --2- 172.21.15.81:0/1397712869 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc07c06ed20 0x7fc07c0711d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc084009b10 tx=0x7fc084008040 comp rx=0 tx=0).stop 2024-04-23T14:53:02.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.368+0000 7fc09ca00700 1 -- 172.21.15.81:0/1397712869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0980fcef0 msgr2=0x7fc098071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:02.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.368+0000 7fc09ca00700 1 --2- 172.21.15.81:0/1397712869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0980fcef0 0x7fc098071e40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc088000c00 tx=0x7fc088009e30 comp rx=0 tx=0).stop 2024-04-23T14:53:02.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.368+0000 7fc09ca00700 1 -- 172.21.15.81:0/1397712869 shutdown_connections 2024-04-23T14:53:02.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.368+0000 7fc09ca00700 1 --2- 172.21.15.81:0/1397712869 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc07c06ed20 0x7fc07c0711d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:02.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.368+0000 7fc09ca00700 1 --2- 172.21.15.81:0/1397712869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0980fcef0 0x7fc098071e40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:02.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.368+0000 7fc09ca00700 1 --2- 172.21.15.81:0/1397712869 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc0980fe0e0 0x7fc098070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:02.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.368+0000 7fc09ca00700 1 -- 172.21.15.81:0/1397712869 >> 172.21.15.81:0/1397712869 conn(0x7fc0980f8530 msgr2=0x7fc0980f9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:02.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.368+0000 7fc09ca00700 1 -- 172.21.15.81:0/1397712869 shutdown_connections 2024-04-23T14:53:02.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.368+0000 7fc09ca00700 1 -- 172.21.15.81:0/1397712869 wait complete. 2024-04-23T14:53:02.376 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 18 2024-04-23T14:53:02.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.518+0000 7f6f35e00700 1 -- 172.21.15.81:0/177045194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f30066290 msgr2=0x7f6f300ffa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:02.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.518+0000 7f6f35e00700 1 --2- 172.21.15.81:0/177045194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f30066290 0x7f6f300ffa90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6f20004940 tx=0x7f6f20009e30 comp rx=0 tx=0).stop 2024-04-23T14:53:02.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.518+0000 7f6f35e00700 1 -- 172.21.15.81:0/177045194 shutdown_connections 2024-04-23T14:53:02.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.518+0000 7f6f35e00700 1 --2- 172.21.15.81:0/177045194 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f300fffd0 0x7f6f301023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:02.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.518+0000 7f6f35e00700 1 --2- 172.21.15.81:0/177045194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f30066290 0x7f6f300ffa90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:02.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.518+0000 7f6f35e00700 1 -- 172.21.15.81:0/177045194 >> 172.21.15.81:0/177045194 conn(0x7f6f300f74c0 msgr2=0x7f6f300f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:02.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.518+0000 7f6f35e00700 1 -- 172.21.15.81:0/177045194 shutdown_connections 2024-04-23T14:53:02.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.518+0000 7f6f35e00700 1 -- 172.21.15.81:0/177045194 wait complete. 2024-04-23T14:53:02.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.519+0000 7f6f35e00700 1 Processor -- start 2024-04-23T14:53:02.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.519+0000 7f6f35e00700 1 -- start start 2024-04-23T14:53:02.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.519+0000 7f6f35e00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f30066290 0x7f6f3010fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:02.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.520+0000 7f6f35e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f300fffd0 0x7f6f301101f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:02.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.520+0000 7f6f35e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f30110880 con 0x7f6f300fffd0 2024-04-23T14:53:02.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.520+0000 7f6f35e00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f30111000 con 0x7f6f30066290 2024-04-23T14:53:02.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.520+0000 7f6f2e000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f300fffd0 0x7f6f301101f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:02.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.520+0000 7f6f2e000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f300fffd0 0x7f6f301101f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41618/0 (socket says 172.21.15.81:41618) 2024-04-23T14:53:02.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.520+0000 7f6f2e000700 1 -- 172.21.15.81:0/166270118 learned_addr learned my addr 172.21.15.81:0/166270118 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:53:02.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.520+0000 7f6f2ea00700 1 --2- 172.21.15.81:0/166270118 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f30066290 0x7f6f3010fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:02.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.520+0000 7f6f2e000700 1 -- 172.21.15.81:0/166270118 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f30066290 msgr2=0x7f6f3010fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:02.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.520+0000 7f6f2e000700 1 --2- 172.21.15.81:0/166270118 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f30066290 0x7f6f3010fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:02.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.520+0000 7f6f2e000700 1 -- 172.21.15.81:0/166270118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f20005040 con 0x7f6f300fffd0 2024-04-23T14:53:02.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.520+0000 7f6f2ea00700 1 --2- 172.21.15.81:0/166270118 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f30066290 0x7f6f3010fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:53:02.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.521+0000 7f6f2e000700 1 --2- 172.21.15.81:0/166270118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f300fffd0 0x7f6f301101f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c00b790 tx=0x7f6f1c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:02.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.521+0000 7f6f26a00700 1 -- 172.21.15.81:0/166270118 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f1c00f770 con 0x7f6f300fffd0 2024-04-23T14:53:02.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.521+0000 7f6f26a00700 1 -- 172.21.15.81:0/166270118 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6f1c00fda0 con 0x7f6f300fffd0 2024-04-23T14:53:02.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.521+0000 7f6f26a00700 1 -- 172.21.15.81:0/166270118 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f1c00d310 con 0x7f6f300fffd0 2024-04-23T14:53:02.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.521+0000 7f6f35e00700 1 -- 172.21.15.81:0/166270118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f301112e0 con 0x7f6f300fffd0 2024-04-23T14:53:02.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.521+0000 7f6f35e00700 1 -- 172.21.15.81:0/166270118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f301118a0 con 0x7f6f300fffd0 2024-04-23T14:53:02.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.522+0000 7f6f35e00700 1 -- 172.21.15.81:0/166270118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f3005f5f0 con 0x7f6f300fffd0 2024-04-23T14:53:02.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.523+0000 7f6f26a00700 1 -- 172.21.15.81:0/166270118 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f6f1c010420 con 0x7f6f300fffd0 2024-04-23T14:53:02.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.524+0000 7f6f26a00700 1 --2- 172.21.15.81:0/166270118 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6f1406ed20 0x7f6f140711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:02.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.524+0000 7f6f26a00700 1 -- 172.21.15.81:0/166270118 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f6f1c08e9b0 con 0x7f6f300fffd0 2024-04-23T14:53:02.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.524+0000 7f6f2ea00700 1 --2- 172.21.15.81:0/166270118 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6f1406ed20 0x7f6f140711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:02.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.525+0000 7f6f2ea00700 1 --2- 172.21.15.81:0/166270118 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6f1406ed20 0x7f6f140711d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6f2000b7a0 tx=0x7f6f20009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:02.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.529+0000 7f6f26a00700 1 -- 172.21.15.81:0/166270118 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f6f1c05b230 con 0x7f6f300fffd0 2024-04-23T14:53:02.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.768+0000 7f6f35e00700 1 -- 172.21.15.81:0/166270118 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f30111be0 con 0x7f6f1406ed20 2024-04-23T14:53:02.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.770+0000 7f6f26a00700 1 -- 172.21.15.81:0/166270118 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f6f30111be0 con 0x7f6f1406ed20 2024-04-23T14:53:02.772 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:53:02.772 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd", 2024-04-23T14:53:02.772 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-04-23T14:53:02.772 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-23T14:53:02.772 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [ 2024-04-23T14:53:02.772 INFO:teuthology.orchestra.run.smithi081.stdout: "mon", 2024-04-23T14:53:02.772 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr" 2024-04-23T14:53:02.772 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-04-23T14:53:02.772 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "4/21 daemons upgraded", 2024-04-23T14:53:02.772 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "Currently upgrading mon daemons", 2024-04-23T14:53:02.772 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-04-23T14:53:02.772 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:53:02.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.773+0000 7f6f35e00700 1 -- 172.21.15.81:0/166270118 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6f1406ed20 msgr2=0x7f6f140711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:02.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.773+0000 7f6f35e00700 1 --2- 172.21.15.81:0/166270118 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6f1406ed20 0x7f6f140711d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6f2000b7a0 tx=0x7f6f20009e30 comp rx=0 tx=0).stop 2024-04-23T14:53:02.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.773+0000 7f6f35e00700 1 -- 172.21.15.81:0/166270118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f300fffd0 msgr2=0x7f6f301101f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:02.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.773+0000 7f6f35e00700 1 --2- 172.21.15.81:0/166270118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f300fffd0 0x7f6f301101f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c00b790 tx=0x7f6f1c009250 comp rx=0 tx=0).stop 2024-04-23T14:53:02.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.773+0000 7f6f35e00700 1 -- 172.21.15.81:0/166270118 shutdown_connections 2024-04-23T14:53:02.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.773+0000 7f6f35e00700 1 --2- 172.21.15.81:0/166270118 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6f1406ed20 0x7f6f140711d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:02.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.773+0000 7f6f35e00700 1 --2- 172.21.15.81:0/166270118 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f30066290 0x7f6f3010fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:02.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.773+0000 7f6f35e00700 1 --2- 172.21.15.81:0/166270118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f300fffd0 0x7f6f301101f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:02.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.773+0000 7f6f35e00700 1 -- 172.21.15.81:0/166270118 >> 172.21.15.81:0/166270118 conn(0x7f6f300f74c0 msgr2=0x7f6f300fbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:02.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.773+0000 7f6f35e00700 1 -- 172.21.15.81:0/166270118 shutdown_connections 2024-04-23T14:53:02.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.773+0000 7f6f35e00700 1 -- 172.21.15.81:0/166270118 wait complete. 2024-04-23T14:53:02.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.919+0000 7f396da00700 1 -- 172.21.15.81:0/806836326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3968071f50 msgr2=0x7f3968070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:02.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.919+0000 7f396da00700 1 --2- 172.21.15.81:0/806836326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3968071f50 0x7f3968070460 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3958004940 tx=0x7f3958009e30 comp rx=0 tx=0).stop 2024-04-23T14:53:02.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.919+0000 7f396da00700 1 -- 172.21.15.81:0/806836326 shutdown_connections 2024-04-23T14:53:02.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.919+0000 7f396da00700 1 --2- 172.21.15.81:0/806836326 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39680709a0 0x7f3968070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:02.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.919+0000 7f396da00700 1 --2- 172.21.15.81:0/806836326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3968071f50 0x7f3968070460 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:02.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.919+0000 7f396da00700 1 -- 172.21.15.81:0/806836326 >> 172.21.15.81:0/806836326 conn(0x7f39680f8530 msgr2=0x7f39680fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:02.921 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:02 smithi081 ceph-mon[90469]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:53:02.921 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:02 smithi081 ceph-mon[90469]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:53:02.921 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:02 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/3532588904' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:53:02.921 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:02 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:02.921 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:02 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/1397712869' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:53:02.922 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:02 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:02.922 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:02 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:02.922 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:02 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:53:02.922 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:02 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:02.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.920+0000 7f396da00700 1 -- 172.21.15.81:0/806836326 shutdown_connections 2024-04-23T14:53:02.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.920+0000 7f396da00700 1 -- 172.21.15.81:0/806836326 wait complete. 2024-04-23T14:53:02.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.921+0000 7f396da00700 1 Processor -- start 2024-04-23T14:53:02.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.921+0000 7f396da00700 1 -- start start 2024-04-23T14:53:02.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.921+0000 7f396da00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39680709a0 0x7f396810fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:02.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.922+0000 7f396da00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3968071f50 0x7f3968110270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:02.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.922+0000 7f396da00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3968110870 con 0x7f3968071f50 2024-04-23T14:53:02.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.922+0000 7f396da00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3968110fb0 con 0x7f39680709a0 2024-04-23T14:53:02.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.922+0000 7f3966000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3968071f50 0x7f3968110270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:02.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.922+0000 7f3966000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3968071f50 0x7f3968110270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41624/0 (socket says 172.21.15.81:41624) 2024-04-23T14:53:02.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.922+0000 7f3966000700 1 -- 172.21.15.81:0/666324543 learned_addr learned my addr 172.21.15.81:0/666324543 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:53:02.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.922+0000 7f3966a00700 1 --2- 172.21.15.81:0/666324543 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39680709a0 0x7f396810fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:02.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.923+0000 7f3966000700 1 -- 172.21.15.81:0/666324543 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39680709a0 msgr2=0x7f396810fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:02.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.923+0000 7f3966000700 1 --2- 172.21.15.81:0/666324543 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39680709a0 0x7f396810fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:02.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.923+0000 7f3966000700 1 -- 172.21.15.81:0/666324543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3958005040 con 0x7f3968071f50 2024-04-23T14:53:02.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.923+0000 7f3966000700 1 --2- 172.21.15.81:0/666324543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3968071f50 0x7f3968110270 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f395400c830 tx=0x7f3954004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:02.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.923+0000 7f395ea00700 1 -- 172.21.15.81:0/666324543 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39540106f0 con 0x7f3968071f50 2024-04-23T14:53:02.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.923+0000 7f395ea00700 1 -- 172.21.15.81:0/666324543 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3954010d20 con 0x7f3968071f50 2024-04-23T14:53:02.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.923+0000 7f395ea00700 1 -- 172.21.15.81:0/666324543 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39540113a0 con 0x7f3968071f50 2024-04-23T14:53:02.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.923+0000 7f396da00700 1 -- 172.21.15.81:0/666324543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3968111290 con 0x7f3968071f50 2024-04-23T14:53:02.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.924+0000 7f396da00700 1 -- 172.21.15.81:0/666324543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3968111850 con 0x7f3968071f50 2024-04-23T14:53:02.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.925+0000 7f396da00700 1 -- 172.21.15.81:0/666324543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f396805f5f0 con 0x7f3968071f50 2024-04-23T14:53:02.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.927+0000 7f395ea00700 1 -- 172.21.15.81:0/666324543 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f3954012400 con 0x7f3968071f50 2024-04-23T14:53:02.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.928+0000 7f395ea00700 1 --2- 172.21.15.81:0/666324543 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f394c06ed20 0x7f394c0711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:02.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.928+0000 7f395ea00700 1 -- 172.21.15.81:0/666324543 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f395408ec00 con 0x7f3968071f50 2024-04-23T14:53:02.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.929+0000 7f3966a00700 1 --2- 172.21.15.81:0/666324543 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f394c06ed20 0x7f394c0711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:02.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.929+0000 7f3966a00700 1 --2- 172.21.15.81:0/666324543 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f394c06ed20 0x7f394c0711d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f395800b970 tx=0x7f3958009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:02.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:02.932+0000 7f395ea00700 1 -- 172.21.15.81:0/666324543 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f395405b540 con 0x7f3968071f50 2024-04-23T14:53:03.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:02 smithi156 ceph-mon[77738]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:53:03.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:02 smithi156 ceph-mon[77738]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:53:03.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:02 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/3532588904' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:53:03.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:02 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:03.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:02 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/1397712869' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:53:03.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:02 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:03.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:02 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:03.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:02 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:53:03.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:02 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:03.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:03.239+0000 7f396da00700 1 -- 172.21.15.81:0/666324543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f396804bed0 con 0x7f3968071f50 2024-04-23T14:53:03.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:03.240+0000 7f395ea00700 1 -- 172.21.15.81:0/666324543 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f3954020020 con 0x7f3968071f50 2024-04-23T14:53:03.241 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-04-23T14:53:03.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:03.242+0000 7f396da00700 1 -- 172.21.15.81:0/666324543 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f394c06ed20 msgr2=0x7f394c0711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:03.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:03.242+0000 7f396da00700 1 --2- 172.21.15.81:0/666324543 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f394c06ed20 0x7f394c0711d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f395800b970 tx=0x7f3958009e30 comp rx=0 tx=0).stop 2024-04-23T14:53:03.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:03.242+0000 7f396da00700 1 -- 172.21.15.81:0/666324543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3968071f50 msgr2=0x7f3968110270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:03.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:03.242+0000 7f396da00700 1 --2- 172.21.15.81:0/666324543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3968071f50 0x7f3968110270 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f395400c830 tx=0x7f3954004470 comp rx=0 tx=0).stop 2024-04-23T14:53:03.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:03.242+0000 7f396da00700 1 -- 172.21.15.81:0/666324543 shutdown_connections 2024-04-23T14:53:03.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:03.242+0000 7f396da00700 1 --2- 172.21.15.81:0/666324543 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f394c06ed20 0x7f394c0711d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:03.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:03.242+0000 7f396da00700 1 --2- 172.21.15.81:0/666324543 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39680709a0 0x7f396810fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:03.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:03.242+0000 7f396da00700 1 --2- 172.21.15.81:0/666324543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3968071f50 0x7f3968110270 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:03.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:03.242+0000 7f396da00700 1 -- 172.21.15.81:0/666324543 >> 172.21.15.81:0/666324543 conn(0x7f39680f8530 msgr2=0x7f39680f9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:03.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:03.243+0000 7f396da00700 1 -- 172.21.15.81:0/666324543 shutdown_connections 2024-04-23T14:53:03.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:03.243+0000 7f396da00700 1 -- 172.21.15.81:0/666324543 wait complete. 2024-04-23T14:53:03.750 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:03 smithi081 ceph-mon[90469]: pgmap v21: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:53:03.750 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:03 smithi081 ceph-mon[90469]: Reconfiguring mon.smithi081 (monmap changed)... 2024-04-23T14:53:03.750 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:03 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T14:53:03.750 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:03 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-23T14:53:03.751 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:03 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:03.751 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:03 smithi081 ceph-mon[90469]: Reconfiguring daemon mon.smithi081 on smithi081 2024-04-23T14:53:03.751 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:03 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/666324543' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:53:04.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:03 smithi156 ceph-mon[77738]: pgmap v21: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:53:04.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:03 smithi156 ceph-mon[77738]: Reconfiguring mon.smithi081 (monmap changed)... 2024-04-23T14:53:04.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:03 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T14:53:04.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:03 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-23T14:53:04.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:03 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:04.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:03 smithi156 ceph-mon[77738]: Reconfiguring daemon mon.smithi081 on smithi081 2024-04-23T14:53:04.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:03 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/666324543' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:53:05.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:04 smithi156 ceph-mon[77738]: from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:53:05.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:04 smithi081 ceph-mon[90469]: from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:53:05.896 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:05 smithi081 ceph-mon[90469]: pgmap v22: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:53:05.896 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:05 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:05.897 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:05 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:05.897 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:05 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi081.ldghvq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-23T14:53:05.897 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:05 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-23T14:53:05.897 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:05 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:06.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:05 smithi156 ceph-mon[77738]: pgmap v22: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:53:06.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:05 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:06.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:05 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:06.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:05 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi081.ldghvq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-23T14:53:06.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:05 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-23T14:53:06.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:05 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:06.907 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:06 smithi081 ceph-mon[90469]: Reconfiguring mgr.smithi081.ldghvq (monmap changed)... 2024-04-23T14:53:06.907 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:06 smithi081 ceph-mon[90469]: Reconfiguring daemon mgr.smithi081.ldghvq on smithi081 2024-04-23T14:53:07.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:06 smithi156 ceph-mon[77738]: Reconfiguring mgr.smithi081.ldghvq (monmap changed)... 2024-04-23T14:53:07.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:06 smithi156 ceph-mon[77738]: Reconfiguring daemon mgr.smithi081.ldghvq on smithi081 2024-04-23T14:53:07.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:07 smithi081 ceph-mon[90469]: pgmap v23: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:53:07.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:07 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:07.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:07 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:07.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:07 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi081", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-23T14:53:07.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:07 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:08.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:07 smithi156 ceph-mon[77738]: pgmap v23: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:53:08.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:07 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:08.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:07 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:08.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:07 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi081", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-23T14:53:08.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:07 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:08.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:08 smithi081 ceph-mon[90469]: Reconfiguring crash.smithi081 (monmap changed)... 2024-04-23T14:53:08.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:08 smithi081 ceph-mon[90469]: Reconfiguring daemon crash.smithi081 on smithi081 2024-04-23T14:53:09.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:08 smithi156 ceph-mon[77738]: Reconfiguring crash.smithi081 (monmap changed)... 2024-04-23T14:53:09.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:08 smithi156 ceph-mon[77738]: Reconfiguring daemon crash.smithi081 on smithi081 2024-04-23T14:53:10.025 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:09 smithi156 ceph-mon[77738]: pgmap v24: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:53:10.025 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:09 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:10.025 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:09 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:10.025 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:09 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-23T14:53:10.025 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:09 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:10.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:09 smithi081 ceph-mon[90469]: pgmap v24: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:53:10.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:09 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:10.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:09 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:10.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:09 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-23T14:53:10.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:09 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:11.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:10 smithi156 ceph-mon[77738]: Reconfiguring osd.0 (monmap changed)... 2024-04-23T14:53:11.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:10 smithi156 ceph-mon[77738]: Reconfiguring daemon osd.0 on smithi081 2024-04-23T14:53:11.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:10 smithi081 ceph-mon[90469]: Reconfiguring osd.0 (monmap changed)... 2024-04-23T14:53:11.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:10 smithi081 ceph-mon[90469]: Reconfiguring daemon osd.0 on smithi081 2024-04-23T14:53:11.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:11 smithi081 ceph-mon[90469]: pgmap v25: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:53:11.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:11 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:53:12.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:11 smithi156 ceph-mon[77738]: pgmap v25: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:53:12.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:11 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:53:13.022 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:12 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:13.023 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:12 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:13.023 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:12 smithi081 ceph-mon[90469]: Reconfiguring osd.1 (monmap changed)... 2024-04-23T14:53:13.023 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:12 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-23T14:53:13.023 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:12 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:13.023 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:12 smithi081 ceph-mon[90469]: Reconfiguring daemon osd.1 on smithi081 2024-04-23T14:53:13.023 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:12 smithi081 ceph-mon[90469]: pgmap v26: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:53:13.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:12 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:13.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:12 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:13.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:12 smithi156 ceph-mon[77738]: Reconfiguring osd.1 (monmap changed)... 2024-04-23T14:53:13.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:12 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-23T14:53:13.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:12 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:13.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:12 smithi156 ceph-mon[77738]: Reconfiguring daemon osd.1 on smithi081 2024-04-23T14:53:13.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:12 smithi156 ceph-mon[77738]: pgmap v26: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:53:15.463 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:15 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:15.463 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:15 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:15.463 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:15 smithi081 ceph-mon[90469]: Reconfiguring osd.2 (monmap changed)... 2024-04-23T14:53:15.463 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:15 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-23T14:53:15.463 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:15 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:15.463 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:15 smithi081 ceph-mon[90469]: Reconfiguring daemon osd.2 on smithi081 2024-04-23T14:53:15.464 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:15 smithi081 ceph-mon[90469]: pgmap v27: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:53:15.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:15 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:15.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:15 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:15.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:15 smithi156 ceph-mon[77738]: Reconfiguring osd.2 (monmap changed)... 2024-04-23T14:53:15.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:15 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-23T14:53:15.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:15 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:15.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:15 smithi156 ceph-mon[77738]: Reconfiguring daemon osd.2 on smithi081 2024-04-23T14:53:15.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:15 smithi156 ceph-mon[77738]: pgmap v27: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:53:17.761 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:17 smithi081 ceph-mon[90469]: pgmap v28: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:53:17.762 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:17 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:17.762 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:17 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:17.762 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:17 smithi081 ceph-mon[90469]: Reconfiguring mds.cephfs.smithi081.wydgcg (monmap changed)... 2024-04-23T14:53:17.762 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:17 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi081.wydgcg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:53:17.762 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:17 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:17.762 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:17 smithi081 ceph-mon[90469]: Reconfiguring daemon mds.cephfs.smithi081.wydgcg on smithi081 2024-04-23T14:53:17.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:17 smithi156 ceph-mon[77738]: pgmap v28: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:53:17.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:17 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:17.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:17 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:17.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:17 smithi156 ceph-mon[77738]: Reconfiguring mds.cephfs.smithi081.wydgcg (monmap changed)... 2024-04-23T14:53:17.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:17 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi081.wydgcg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:53:17.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:17 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:17.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:17 smithi156 ceph-mon[77738]: Reconfiguring daemon mds.cephfs.smithi081.wydgcg on smithi081 2024-04-23T14:53:19.665 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:19 smithi081 ceph-mon[90469]: pgmap v29: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:53:19.665 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:19 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:19.665 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:19 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:19.665 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:19 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi081.vcoywg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:53:19.665 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:19 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:19.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:19 smithi156 ceph-mon[77738]: pgmap v29: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:53:19.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:19 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:19.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:19 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:19.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:19 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi081.vcoywg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:53:19.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:19 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:20.733 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:20 smithi081 ceph-mon[90469]: Reconfiguring mds.cephfs.smithi081.vcoywg (monmap changed)... 2024-04-23T14:53:20.733 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:20 smithi081 ceph-mon[90469]: Reconfiguring daemon mds.cephfs.smithi081.vcoywg on smithi081 2024-04-23T14:53:21.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:20 smithi156 ceph-mon[77738]: Reconfiguring mds.cephfs.smithi081.vcoywg (monmap changed)... 2024-04-23T14:53:21.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:20 smithi156 ceph-mon[77738]: Reconfiguring daemon mds.cephfs.smithi081.vcoywg on smithi081 2024-04-23T14:53:21.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:21 smithi081 ceph-mon[90469]: pgmap v30: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:53:21.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:21 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:21.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:21 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:21.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:21 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi156", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-23T14:53:21.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:21 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:21.853 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:21 smithi156 ceph-mon[77738]: pgmap v30: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:53:21.853 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:21 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:21.853 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:21 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:21.854 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:21 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi156", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-23T14:53:21.854 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:21 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:22.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:22 smithi081 ceph-mon[90469]: Reconfiguring crash.smithi156 (monmap changed)... 2024-04-23T14:53:22.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:22 smithi081 ceph-mon[90469]: Reconfiguring daemon crash.smithi156 on smithi156 2024-04-23T14:53:22.900 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:22 smithi156 ceph-mon[77738]: Reconfiguring crash.smithi156 (monmap changed)... 2024-04-23T14:53:22.900 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:22 smithi156 ceph-mon[77738]: Reconfiguring daemon crash.smithi156 on smithi156 2024-04-23T14:53:23.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:23 smithi081 ceph-mon[90469]: pgmap v31: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:53:23.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:23 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:23.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:23 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:23.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:23 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi156.ounwyj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-23T14:53:23.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:23 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-23T14:53:23.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:23 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:24.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:23 smithi156 ceph-mon[77738]: pgmap v31: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:53:24.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:23 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:24.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:23 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:24.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:23 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi156.ounwyj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-23T14:53:24.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:23 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-23T14:53:24.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:23 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:24.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:24 smithi156 ceph-mon[77738]: Reconfiguring mgr.smithi156.ounwyj (monmap changed)... 2024-04-23T14:53:24.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:24 smithi156 ceph-mon[77738]: Reconfiguring daemon mgr.smithi156.ounwyj on smithi156 2024-04-23T14:53:24.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:24 smithi081 ceph-mon[90469]: Reconfiguring mgr.smithi156.ounwyj (monmap changed)... 2024-04-23T14:53:24.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:24 smithi081 ceph-mon[90469]: Reconfiguring daemon mgr.smithi156.ounwyj on smithi156 2024-04-23T14:53:25.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:25 smithi081 ceph-mon[90469]: pgmap v32: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:53:25.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:25 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:25.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:25 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:25.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:25 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T14:53:25.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:25 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-23T14:53:25.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:25 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:25.978 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:25 smithi156 ceph-mon[77738]: pgmap v32: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:53:25.978 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:25 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:25.978 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:25 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:25.978 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:25 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T14:53:25.978 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:25 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-23T14:53:25.978 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:25 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:27.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:26 smithi156 ceph-mon[77738]: Reconfiguring mon.smithi156 (monmap changed)... 2024-04-23T14:53:27.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:26 smithi156 ceph-mon[77738]: Reconfiguring daemon mon.smithi156 on smithi156 2024-04-23T14:53:27.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:26 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:53:27.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:26 smithi081 ceph-mon[90469]: Reconfiguring mon.smithi156 (monmap changed)... 2024-04-23T14:53:27.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:26 smithi081 ceph-mon[90469]: Reconfiguring daemon mon.smithi156 on smithi156 2024-04-23T14:53:27.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:26 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:53:27.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:27 smithi081 ceph-mon[90469]: pgmap v33: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:53:28.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:27 smithi156 ceph-mon[77738]: pgmap v33: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:53:29.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:28 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:29.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:28 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:29.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:28 smithi156 ceph-mon[77738]: Reconfiguring osd.3 (monmap changed)... 2024-04-23T14:53:29.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:28 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-23T14:53:29.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:28 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:29.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:28 smithi156 ceph-mon[77738]: Reconfiguring daemon osd.3 on smithi156 2024-04-23T14:53:29.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:28 smithi156 ceph-mon[77738]: pgmap v34: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:53:29.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:28 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:29.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:28 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:29.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:28 smithi081 ceph-mon[90469]: Reconfiguring osd.3 (monmap changed)... 2024-04-23T14:53:29.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:28 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-23T14:53:29.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:28 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:29.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:28 smithi081 ceph-mon[90469]: Reconfiguring daemon osd.3 on smithi156 2024-04-23T14:53:29.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:28 smithi081 ceph-mon[90469]: pgmap v34: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:53:31.443 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:31 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:31.443 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:31 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:31.443 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:31 smithi156 ceph-mon[77738]: Reconfiguring osd.4 (monmap changed)... 2024-04-23T14:53:31.443 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:31 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-23T14:53:31.443 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:31 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:31.444 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:31 smithi156 ceph-mon[77738]: Reconfiguring daemon osd.4 on smithi156 2024-04-23T14:53:31.444 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:31 smithi156 ceph-mon[77738]: pgmap v35: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-23T14:53:31.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:31 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:31.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:31 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:31.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:31 smithi081 ceph-mon[90469]: Reconfiguring osd.4 (monmap changed)... 2024-04-23T14:53:31.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:31 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-23T14:53:31.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:31 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:31.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:31 smithi081 ceph-mon[90469]: Reconfiguring daemon osd.4 on smithi156 2024-04-23T14:53:31.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:31 smithi081 ceph-mon[90469]: pgmap v35: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-23T14:53:33.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.410+0000 7f62d1000700 1 -- 172.21.15.81:0/4288964081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62cc0709a0 msgr2=0x7f62cc070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:33.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.410+0000 7f62d1000700 1 --2- 172.21.15.81:0/4288964081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62cc0709a0 0x7f62cc070e10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f62b4004940 tx=0x7f62b4009e30 comp rx=0 tx=0).stop 2024-04-23T14:53:33.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.410+0000 7f62d1000700 1 -- 172.21.15.81:0/4288964081 shutdown_connections 2024-04-23T14:53:33.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.410+0000 7f62d1000700 1 --2- 172.21.15.81:0/4288964081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62cc0709a0 0x7f62cc070e10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:33.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.410+0000 7f62d1000700 1 --2- 172.21.15.81:0/4288964081 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62cc071f50 0x7f62cc070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:33.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.410+0000 7f62d1000700 1 -- 172.21.15.81:0/4288964081 >> 172.21.15.81:0/4288964081 conn(0x7f62cc0f8530 msgr2=0x7f62cc0fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:33.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.410+0000 7f62d1000700 1 -- 172.21.15.81:0/4288964081 shutdown_connections 2024-04-23T14:53:33.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.410+0000 7f62d1000700 1 -- 172.21.15.81:0/4288964081 wait complete. 2024-04-23T14:53:33.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.411+0000 7f62d1000700 1 Processor -- start 2024-04-23T14:53:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.411+0000 7f62d1000700 1 -- start start 2024-04-23T14:53:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.412+0000 7f62d1000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62cc0709a0 0x7f62cc10fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.412+0000 7f62d1000700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62cc071f50 0x7f62cc110100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.412+0000 7f62d1000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62cc110700 con 0x7f62cc0709a0 2024-04-23T14:53:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.412+0000 7f62d1000700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62cc110f50 con 0x7f62cc071f50 2024-04-23T14:53:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.412+0000 7f62c9e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62cc0709a0 0x7f62cc10fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.412+0000 7f62c9e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62cc0709a0 0x7f62cc10fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44558/0 (socket says 172.21.15.81:44558) 2024-04-23T14:53:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.412+0000 7f62c9e00700 1 -- 172.21.15.81:0/466528881 learned_addr learned my addr 172.21.15.81:0/466528881 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:53:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.412+0000 7f62c3e00700 1 --2- 172.21.15.81:0/466528881 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62cc071f50 0x7f62cc110100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.412+0000 7f62c9e00700 1 -- 172.21.15.81:0/466528881 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62cc071f50 msgr2=0x7f62cc110100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.412+0000 7f62c9e00700 1 --2- 172.21.15.81:0/466528881 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62cc071f50 0x7f62cc110100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.412+0000 7f62c9e00700 1 -- 172.21.15.81:0/466528881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b4005040 con 0x7f62cc0709a0 2024-04-23T14:53:33.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.413+0000 7f62c9e00700 1 --2- 172.21.15.81:0/466528881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62cc0709a0 0x7f62cc10fbc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f62bc00eb70 tx=0x7f62bc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:33.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.413+0000 7f62c2000700 1 -- 172.21.15.81:0/466528881 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62bc007cc0 con 0x7f62cc0709a0 2024-04-23T14:53:33.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.413+0000 7f62c2000700 1 -- 172.21.15.81:0/466528881 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f62bc00f040 con 0x7f62cc0709a0 2024-04-23T14:53:33.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.413+0000 7f62c2000700 1 -- 172.21.15.81:0/466528881 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62bc00cb20 con 0x7f62cc0709a0 2024-04-23T14:53:33.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.413+0000 7f62d1000700 1 -- 172.21.15.81:0/466528881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62cc1111d0 con 0x7f62cc0709a0 2024-04-23T14:53:33.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.413+0000 7f62d1000700 1 -- 172.21.15.81:0/466528881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62cc1116c0 con 0x7f62cc0709a0 2024-04-23T14:53:33.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.415+0000 7f62d1000700 1 -- 172.21.15.81:0/466528881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62cc05f5f0 con 0x7f62cc0709a0 2024-04-23T14:53:33.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.416+0000 7f62c2000700 1 -- 172.21.15.81:0/466528881 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f62bc00cc80 con 0x7f62cc0709a0 2024-04-23T14:53:33.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.417+0000 7f62c2000700 1 --2- 172.21.15.81:0/466528881 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f62b006ed20 0x7f62b00711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:33.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.417+0000 7f62c2000700 1 -- 172.21.15.81:0/466528881 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f62bc08e570 con 0x7f62cc0709a0 2024-04-23T14:53:33.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.417+0000 7f62c3e00700 1 --2- 172.21.15.81:0/466528881 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f62b006ed20 0x7f62b00711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:33.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.418+0000 7f62c3e00700 1 --2- 172.21.15.81:0/466528881 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f62b006ed20 0x7f62b00711d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f62b4009fd0 tx=0x7f62b4009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:33.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.423+0000 7f62c2000700 1 -- 172.21.15.81:0/466528881 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f62bc05ac90 con 0x7f62cc0709a0 2024-04-23T14:53:33.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.665+0000 7f62d1000700 1 -- 172.21.15.81:0/466528881 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f62cc111af0 con 0x7f62b006ed20 2024-04-23T14:53:33.666 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:33 smithi081 ceph-mon[90469]: pgmap v36: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:53:33.666 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:33.666 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:33.667 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:33 smithi081 ceph-mon[90469]: Reconfiguring osd.5 (monmap changed)... 2024-04-23T14:53:33.667 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-23T14:53:33.667 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:33.667 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:33 smithi081 ceph-mon[90469]: Reconfiguring daemon osd.5 on smithi156 2024-04-23T14:53:33.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.667+0000 7f62c2000700 1 -- 172.21.15.81:0/466528881 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f62cc111af0 con 0x7f62b006ed20 2024-04-23T14:53:33.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.670+0000 7f62d1000700 1 -- 172.21.15.81:0/466528881 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f62b006ed20 msgr2=0x7f62b00711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:33.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.670+0000 7f62d1000700 1 --2- 172.21.15.81:0/466528881 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f62b006ed20 0x7f62b00711d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f62b4009fd0 tx=0x7f62b4009e30 comp rx=0 tx=0).stop 2024-04-23T14:53:33.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.670+0000 7f62d1000700 1 -- 172.21.15.81:0/466528881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62cc0709a0 msgr2=0x7f62cc10fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:33.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.670+0000 7f62d1000700 1 --2- 172.21.15.81:0/466528881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62cc0709a0 0x7f62cc10fbc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f62bc00eb70 tx=0x7f62bc00b040 comp rx=0 tx=0).stop 2024-04-23T14:53:33.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.670+0000 7f62d1000700 1 -- 172.21.15.81:0/466528881 shutdown_connections 2024-04-23T14:53:33.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.670+0000 7f62d1000700 1 --2- 172.21.15.81:0/466528881 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f62b006ed20 0x7f62b00711d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:33.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.670+0000 7f62d1000700 1 --2- 172.21.15.81:0/466528881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62cc0709a0 0x7f62cc10fbc0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:33.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.670+0000 7f62d1000700 1 --2- 172.21.15.81:0/466528881 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62cc071f50 0x7f62cc110100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:33.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.670+0000 7f62d1000700 1 -- 172.21.15.81:0/466528881 >> 172.21.15.81:0/466528881 conn(0x7f62cc0f8530 msgr2=0x7f62cc0f9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:33.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.670+0000 7f62d1000700 1 -- 172.21.15.81:0/466528881 shutdown_connections 2024-04-23T14:53:33.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.670+0000 7f62d1000700 1 -- 172.21.15.81:0/466528881 wait complete. 2024-04-23T14:53:33.686 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-04-23T14:53:33.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:33 smithi156 ceph-mon[77738]: pgmap v36: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:53:33.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:33.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:33.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:33 smithi156 ceph-mon[77738]: Reconfiguring osd.5 (monmap changed)... 2024-04-23T14:53:33.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-23T14:53:33.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:33.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:33 smithi156 ceph-mon[77738]: Reconfiguring daemon osd.5 on smithi156 2024-04-23T14:53:33.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.823+0000 7f2ed7000700 1 -- 172.21.15.81:0/1736402004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ed00feff0 msgr2=0x7f2ed00ff400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:33.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.823+0000 7f2ed7000700 1 --2- 172.21.15.81:0/1736402004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ed00feff0 0x7f2ed00ff400 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0004940 tx=0x7f2ec0009e30 comp rx=0 tx=0).stop 2024-04-23T14:53:33.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.824+0000 7f2ed7000700 1 -- 172.21.15.81:0/1736402004 shutdown_connections 2024-04-23T14:53:33.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.824+0000 7f2ed7000700 1 --2- 172.21.15.81:0/1736402004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ed01002a0 0x7f2ed0100710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:33.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.824+0000 7f2ed7000700 1 --2- 172.21.15.81:0/1736402004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ed00feff0 0x7f2ed00ff400 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:33.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.824+0000 7f2ed7000700 1 -- 172.21.15.81:0/1736402004 >> 172.21.15.81:0/1736402004 conn(0x7f2ed00fa790 msgr2=0x7f2ed00fcba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:33.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.824+0000 7f2ed7000700 1 -- 172.21.15.81:0/1736402004 shutdown_connections 2024-04-23T14:53:33.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.824+0000 7f2ed7000700 1 -- 172.21.15.81:0/1736402004 wait complete. 2024-04-23T14:53:33.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.825+0000 7f2ed7000700 1 Processor -- start 2024-04-23T14:53:33.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.825+0000 7f2ed7000700 1 -- start start 2024-04-23T14:53:33.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.825+0000 7f2ed7000700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ed00feff0 0x7f2ed010fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:33.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.825+0000 7f2ed7000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ed01002a0 0x7f2ed0110060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:33.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.825+0000 7f2ed7000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed01106f0 con 0x7f2ed01002a0 2024-04-23T14:53:33.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.825+0000 7f2ed7000700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed0115090 con 0x7f2ed00feff0 2024-04-23T14:53:33.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.825+0000 7f2ecf400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ed01002a0 0x7f2ed0110060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:33.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.825+0000 7f2ecf400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ed01002a0 0x7f2ed0110060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38924/0 (socket says 172.21.15.81:38924) 2024-04-23T14:53:33.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.825+0000 7f2ecf400700 1 -- 172.21.15.81:0/866046062 learned_addr learned my addr 172.21.15.81:0/866046062 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:53:33.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.826+0000 7f2ecfe00700 1 --2- 172.21.15.81:0/866046062 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ed00feff0 0x7f2ed010fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:33.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.826+0000 7f2ecf400700 1 -- 172.21.15.81:0/866046062 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ed00feff0 msgr2=0x7f2ed010fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:33.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.826+0000 7f2ecf400700 1 --2- 172.21.15.81:0/866046062 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ed00feff0 0x7f2ed010fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:33.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.826+0000 7f2ecf400700 1 -- 172.21.15.81:0/866046062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec0005040 con 0x7f2ed01002a0 2024-04-23T14:53:33.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.826+0000 7f2ecf400700 1 --2- 172.21.15.81:0/866046062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ed01002a0 0x7f2ed0110060 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc00b790 tx=0x7f2ebc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:33.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.826+0000 7f2ec7e00700 1 -- 172.21.15.81:0/866046062 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ebc00f770 con 0x7f2ed01002a0 2024-04-23T14:53:33.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.826+0000 7f2ec7e00700 1 -- 172.21.15.81:0/866046062 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2ebc00fda0 con 0x7f2ed01002a0 2024-04-23T14:53:33.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.827+0000 7f2ed7000700 1 -- 172.21.15.81:0/866046062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed01152f0 con 0x7f2ed01002a0 2024-04-23T14:53:33.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.827+0000 7f2ec7e00700 1 -- 172.21.15.81:0/866046062 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ebc00d310 con 0x7f2ed01002a0 2024-04-23T14:53:33.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.827+0000 7f2ed7000700 1 -- 172.21.15.81:0/866046062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed0115860 con 0x7f2ed01002a0 2024-04-23T14:53:33.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.828+0000 7f2ed7000700 1 -- 172.21.15.81:0/866046062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed004c710 con 0x7f2ed01002a0 2024-04-23T14:53:33.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.829+0000 7f2ec7e00700 1 -- 172.21.15.81:0/866046062 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f2ebc010420 con 0x7f2ed01002a0 2024-04-23T14:53:33.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.830+0000 7f2ec7e00700 1 --2- 172.21.15.81:0/866046062 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f2eb406ed30 0x7f2eb40711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:33.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.830+0000 7f2ec7e00700 1 -- 172.21.15.81:0/866046062 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f2ebc08ea90 con 0x7f2ed01002a0 2024-04-23T14:53:33.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.830+0000 7f2ecfe00700 1 --2- 172.21.15.81:0/866046062 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f2eb406ed30 0x7f2eb40711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:33.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.831+0000 7f2ecfe00700 1 --2- 172.21.15.81:0/866046062 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f2eb406ed30 0x7f2eb40711e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2ec000b3b0 tx=0x7f2ec0009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:33.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:33.835+0000 7f2ec7e00700 1 -- 172.21.15.81:0/866046062 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f2ebc05b290 con 0x7f2ed01002a0 2024-04-23T14:53:34.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.077+0000 7f2ed7000700 1 -- 172.21.15.81:0/866046062 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ed0104540 con 0x7f2eb406ed30 2024-04-23T14:53:34.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.080+0000 7f2ec7e00700 1 -- 172.21.15.81:0/866046062 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f2ed0104540 con 0x7f2eb406ed30 2024-04-23T14:53:34.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.083+0000 7f2ed7000700 1 -- 172.21.15.81:0/866046062 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f2eb406ed30 msgr2=0x7f2eb40711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:34.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.083+0000 7f2ed7000700 1 --2- 172.21.15.81:0/866046062 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f2eb406ed30 0x7f2eb40711e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2ec000b3b0 tx=0x7f2ec0009e30 comp rx=0 tx=0).stop 2024-04-23T14:53:34.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.083+0000 7f2ed7000700 1 -- 172.21.15.81:0/866046062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ed01002a0 msgr2=0x7f2ed0110060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:34.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.083+0000 7f2ed7000700 1 --2- 172.21.15.81:0/866046062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ed01002a0 0x7f2ed0110060 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc00b790 tx=0x7f2ebc009250 comp rx=0 tx=0).stop 2024-04-23T14:53:34.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.083+0000 7f2ed7000700 1 -- 172.21.15.81:0/866046062 shutdown_connections 2024-04-23T14:53:34.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.083+0000 7f2ed7000700 1 --2- 172.21.15.81:0/866046062 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f2eb406ed30 0x7f2eb40711e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:34.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.083+0000 7f2ed7000700 1 --2- 172.21.15.81:0/866046062 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ed00feff0 0x7f2ed010fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:34.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.083+0000 7f2ed7000700 1 --2- 172.21.15.81:0/866046062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ed01002a0 0x7f2ed0110060 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:34.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.083+0000 7f2ed7000700 1 -- 172.21.15.81:0/866046062 >> 172.21.15.81:0/866046062 conn(0x7f2ed00fa790 msgr2=0x7f2ed00fbd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:34.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.084+0000 7f2ed7000700 1 -- 172.21.15.81:0/866046062 shutdown_connections 2024-04-23T14:53:34.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.084+0000 7f2ed7000700 1 -- 172.21.15.81:0/866046062 wait complete. 2024-04-23T14:53:34.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.224+0000 7ffab2200700 1 -- 172.21.15.81:0/1808625206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaac071e40 msgr2=0x7ffaac070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:34.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.224+0000 7ffab2200700 1 --2- 172.21.15.81:0/1808625206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaac071e40 0x7ffaac070350 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0004940 tx=0x7ffaa0009e30 comp rx=0 tx=0).stop 2024-04-23T14:53:34.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.224+0000 7ffab2200700 1 -- 172.21.15.81:0/1808625206 shutdown_connections 2024-04-23T14:53:34.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.224+0000 7ffab2200700 1 --2- 172.21.15.81:0/1808625206 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffaac070890 0x7ffaac070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:34.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.224+0000 7ffab2200700 1 --2- 172.21.15.81:0/1808625206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaac071e40 0x7ffaac070350 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:34.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.224+0000 7ffab2200700 1 -- 172.21.15.81:0/1808625206 >> 172.21.15.81:0/1808625206 conn(0x7ffaac0f83a0 msgr2=0x7ffaac0fa7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:34.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.224+0000 7ffab2200700 1 -- 172.21.15.81:0/1808625206 shutdown_connections 2024-04-23T14:53:34.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.224+0000 7ffab2200700 1 -- 172.21.15.81:0/1808625206 wait complete. 2024-04-23T14:53:34.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.225+0000 7ffab2200700 1 Processor -- start 2024-04-23T14:53:34.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.225+0000 7ffab2200700 1 -- start start 2024-04-23T14:53:34.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.225+0000 7ffab2200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaac070890 0x7ffaac10fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:34.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.225+0000 7ffab2200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffaac071e40 0x7ffaac10ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:34.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.225+0000 7ffab2200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac110590 con 0x7ffaac070890 2024-04-23T14:53:34.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.225+0000 7ffab2200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac110de0 con 0x7ffaac071e40 2024-04-23T14:53:34.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.226+0000 7ffab0e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaac070890 0x7ffaac10fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:34.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.226+0000 7ffab0e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaac070890 0x7ffaac10fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38944/0 (socket says 172.21.15.81:38944) 2024-04-23T14:53:34.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.226+0000 7ffab0e00700 1 -- 172.21.15.81:0/473415115 learned_addr learned my addr 172.21.15.81:0/473415115 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:53:34.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.226+0000 7ffaabe00700 1 --2- 172.21.15.81:0/473415115 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffaac071e40 0x7ffaac10ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:34.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.226+0000 7ffab0e00700 1 -- 172.21.15.81:0/473415115 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffaac071e40 msgr2=0x7ffaac10ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:34.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.226+0000 7ffab0e00700 1 --2- 172.21.15.81:0/473415115 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffaac071e40 0x7ffaac10ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:34.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.226+0000 7ffab0e00700 1 -- 172.21.15.81:0/473415115 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa0005040 con 0x7ffaac070890 2024-04-23T14:53:34.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.226+0000 7ffaabe00700 1 --2- 172.21.15.81:0/473415115 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffaac071e40 0x7ffaac10ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:53:34.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.226+0000 7ffab0e00700 1 --2- 172.21.15.81:0/473415115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaac070890 0x7ffaac10fa50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ffaa000b970 tx=0x7ffaa0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:34.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.227+0000 7ffaa8c00700 1 -- 172.21.15.81:0/473415115 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaa000e040 con 0x7ffaac070890 2024-04-23T14:53:34.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.227+0000 7ffaa8c00700 1 -- 172.21.15.81:0/473415115 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffaa000bbf0 con 0x7ffaac070890 2024-04-23T14:53:34.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.227+0000 7ffaa8c00700 1 -- 172.21.15.81:0/473415115 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaa001c630 con 0x7ffaac070890 2024-04-23T14:53:34.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.227+0000 7ffab2200700 1 -- 172.21.15.81:0/473415115 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaac111060 con 0x7ffaac070890 2024-04-23T14:53:34.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.227+0000 7ffab2200700 1 -- 172.21.15.81:0/473415115 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaac1115a0 con 0x7ffaac070890 2024-04-23T14:53:34.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.228+0000 7ffab2200700 1 -- 172.21.15.81:0/473415115 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaac0fc020 con 0x7ffaac070890 2024-04-23T14:53:34.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.229+0000 7ffaa8c00700 1 -- 172.21.15.81:0/473415115 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7ffaa000bd60 con 0x7ffaac070890 2024-04-23T14:53:34.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.230+0000 7ffaa8c00700 1 --2- 172.21.15.81:0/473415115 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7ffa9406ed30 0x7ffa940711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:34.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.230+0000 7ffaa8c00700 1 -- 172.21.15.81:0/473415115 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7ffaa008fe50 con 0x7ffaac070890 2024-04-23T14:53:34.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.230+0000 7ffaabe00700 1 --2- 172.21.15.81:0/473415115 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7ffa9406ed30 0x7ffa940711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:34.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.231+0000 7ffaabe00700 1 --2- 172.21.15.81:0/473415115 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7ffa9406ed30 0x7ffa940711e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ffa98009fd0 tx=0x7ffa98009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:34.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.234+0000 7ffaa8c00700 1 -- 172.21.15.81:0/473415115 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7ffaa005c5c0 con 0x7ffaac070890 2024-04-23T14:53:34.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.455+0000 7ffab2200700 1 -- 172.21.15.81:0/473415115 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ffaac1119e0 con 0x7ffa9406ed30 2024-04-23T14:53:34.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.472+0000 7ffaa8c00700 1 -- 172.21.15.81:0/473415115 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7ffaac1119e0 con 0x7ffa9406ed30 2024-04-23T14:53:34.473 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-23T14:53:34.473 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (3m) 60s ago 14m 14.0M - 0.25.0 c8568f914cd2 63876b2abc27 2024-04-23T14:53:34.473 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (14m) 60s ago 14m 6660k - 17.2.7-884-g70d0cb4b cafd8ddac8fa 6ae90c81b232 2024-04-23T14:53:34.473 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi156 smithi156 running (13m) 39s ago 13m 6660k - 17.2.7-884-g70d0cb4b cafd8ddac8fa ecc141919f37 2024-04-23T14:53:34.473 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (3m) 60s ago 14m 75.3M - 9.4.7 954c08fa6188 fbad3cef0883 2024-04-23T14:53:34.474 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.vcoywg smithi081 running (7m) 60s ago 7m 148M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 2ca7601ab60f 2024-04-23T14:53:34.474 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.wydgcg smithi081 running (7m) 60s ago 7m 108M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 58eb1a961b61 2024-04-23T14:53:34.474 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.rhbtxt smithi156 running (7m) 39s ago 7m 13.4M - 17.2.7-884-g70d0cb4b cafd8ddac8fa db3cb5034381 2024-04-23T14:53:34.474 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.vynkxn smithi156 running (7m) 39s ago 7m 13.6M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 1c8f2219e7fd 2024-04-23T14:53:34.474 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.ldghvq smithi081 *:8443,9283,8765 running (3m) 60s ago 16m 478M - 19.0.0-3126-gd44fddd9 76e77f280c74 6bf23484a1c9 2024-04-23T14:53:34.474 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi156.ounwyj smithi156 *:8443,9283,8765 running (112s) 39s ago 13m 449M - 19.0.0-3126-gd44fddd9 76e77f280c74 a6c0dd9f89f2 2024-04-23T14:53:34.474 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (88s) 60s ago 16m 30.8M 2048M 19.0.0-3126-gd44fddd9 76e77f280c74 fbf9f9a59ac2 2024-04-23T14:53:34.474 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi156 smithi156 running (45s) 39s ago 13m 22.7M 2048M 19.0.0-3126-gd44fddd9 76e77f280c74 36409886998f 2024-04-23T14:53:34.474 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (4m) 60s ago 14m 7348k - 1.5.0 0da6a335fe13 197b27809010 2024-04-23T14:53:34.474 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi156 smithi156 *:9100 running (3m) 39s ago 13m 7549k - 1.5.0 0da6a335fe13 91a7c5e86d47 2024-04-23T14:53:34.474 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (12m) 60s ago 12m 246M 1557M 17.2.7-884-g70d0cb4b cafd8ddac8fa 272ca032bec1 2024-04-23T14:53:34.474 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (11m) 60s ago 11m 253M 1557M 17.2.7-884-g70d0cb4b cafd8ddac8fa ee6d0c8af6ed 2024-04-23T14:53:34.474 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (11m) 60s ago 11m 216M 1557M 17.2.7-884-g70d0cb4b cafd8ddac8fa c26c640828a2 2024-04-23T14:53:34.474 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi156 running (10m) 39s ago 10m 286M 2581M 17.2.7-884-g70d0cb4b cafd8ddac8fa c1c261b1ee90 2024-04-23T14:53:34.475 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi156 running (10m) 39s ago 10m 255M 2581M 17.2.7-884-g70d0cb4b cafd8ddac8fa 83f996ee64de 2024-04-23T14:53:34.475 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi156 running (9m) 39s ago 9m 239M 2581M 17.2.7-884-g70d0cb4b cafd8ddac8fa b754244bef18 2024-04-23T14:53:34.475 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (2m) 60s ago 14m 49.2M - 2.43.0 a07b618ecd1d 35558adb166d 2024-04-23T14:53:34.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.475+0000 7ffab2200700 1 -- 172.21.15.81:0/473415115 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7ffa9406ed30 msgr2=0x7ffa940711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:34.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.475+0000 7ffab2200700 1 --2- 172.21.15.81:0/473415115 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7ffa9406ed30 0x7ffa940711e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ffa98009fd0 tx=0x7ffa98009ee0 comp rx=0 tx=0).stop 2024-04-23T14:53:34.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.475+0000 7ffab2200700 1 -- 172.21.15.81:0/473415115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaac070890 msgr2=0x7ffaac10fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:34.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.475+0000 7ffab2200700 1 --2- 172.21.15.81:0/473415115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaac070890 0x7ffaac10fa50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ffaa000b970 tx=0x7ffaa0009e30 comp rx=0 tx=0).stop 2024-04-23T14:53:34.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.475+0000 7ffab2200700 1 -- 172.21.15.81:0/473415115 shutdown_connections 2024-04-23T14:53:34.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.475+0000 7ffab2200700 1 --2- 172.21.15.81:0/473415115 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7ffa9406ed30 0x7ffa940711e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:34.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.476+0000 7ffab2200700 1 --2- 172.21.15.81:0/473415115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaac070890 0x7ffaac10fa50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:34.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.476+0000 7ffab2200700 1 --2- 172.21.15.81:0/473415115 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffaac071e40 0x7ffaac10ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:34.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.476+0000 7ffab2200700 1 -- 172.21.15.81:0/473415115 >> 172.21.15.81:0/473415115 conn(0x7ffaac0f83a0 msgr2=0x7ffaac0f9a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:34.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.476+0000 7ffab2200700 1 -- 172.21.15.81:0/473415115 shutdown_connections 2024-04-23T14:53:34.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.476+0000 7ffab2200700 1 -- 172.21.15.81:0/473415115 wait complete. 2024-04-23T14:53:34.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.626+0000 7f57fe000700 1 -- 172.21.15.81:0/403127906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57f81046d0 msgr2=0x7f57f8104b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:34.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.626+0000 7f57fe000700 1 --2- 172.21.15.81:0/403127906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57f81046d0 0x7f57f8104b40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f57e4004940 tx=0x7f57e4009e30 comp rx=0 tx=0).stop 2024-04-23T14:53:34.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.626+0000 7f57fe000700 1 -- 172.21.15.81:0/403127906 shutdown_connections 2024-04-23T14:53:34.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.626+0000 7f57fe000700 1 --2- 172.21.15.81:0/403127906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57f81046d0 0x7f57f8104b40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:34.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.626+0000 7f57fe000700 1 --2- 172.21.15.81:0/403127906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57f8103420 0x7f57f8103830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:34.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.626+0000 7f57fe000700 1 -- 172.21.15.81:0/403127906 >> 172.21.15.81:0/403127906 conn(0x7f57f8072640 msgr2=0x7f57f8074a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:34.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.626+0000 7f57fe000700 1 -- 172.21.15.81:0/403127906 shutdown_connections 2024-04-23T14:53:34.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.626+0000 7f57fe000700 1 -- 172.21.15.81:0/403127906 wait complete. 2024-04-23T14:53:34.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.627+0000 7f57fe000700 1 Processor -- start 2024-04-23T14:53:34.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.627+0000 7f57fe000700 1 -- start start 2024-04-23T14:53:34.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.627+0000 7f57fe000700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57f8103420 0x7f57f8113f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:34.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.627+0000 7f57fe000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57f81046d0 0x7f57f8114490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:34.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.627+0000 7f57fe000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f8114a90 con 0x7f57f81046d0 2024-04-23T14:53:34.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.627+0000 7f57fe000700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f8114c00 con 0x7f57f8103420 2024-04-23T14:53:34.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.627+0000 7f57f6a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57f81046d0 0x7f57f8114490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:34.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.627+0000 7f57f6a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57f81046d0 0x7f57f8114490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38960/0 (socket says 172.21.15.81:38960) 2024-04-23T14:53:34.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.627+0000 7f57f6a00700 1 -- 172.21.15.81:0/1643484573 learned_addr learned my addr 172.21.15.81:0/1643484573 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:53:34.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.628+0000 7f57f7400700 1 --2- 172.21.15.81:0/1643484573 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57f8103420 0x7f57f8113f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:34.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.628+0000 7f57f6a00700 1 -- 172.21.15.81:0/1643484573 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57f8103420 msgr2=0x7f57f8113f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:34.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.628+0000 7f57f6a00700 1 --2- 172.21.15.81:0/1643484573 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57f8103420 0x7f57f8113f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:34.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.628+0000 7f57f6a00700 1 -- 172.21.15.81:0/1643484573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e4005040 con 0x7f57f81046d0 2024-04-23T14:53:34.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.628+0000 7f57f6a00700 1 --2- 172.21.15.81:0/1643484573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57f81046d0 0x7f57f8114490 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f57e4009150 tx=0x7f57e4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:34.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.628+0000 7f57ef400700 1 -- 172.21.15.81:0/1643484573 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57e400e040 con 0x7f57f81046d0 2024-04-23T14:53:34.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.629+0000 7f57fe000700 1 -- 172.21.15.81:0/1643484573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57f8119600 con 0x7f57f81046d0 2024-04-23T14:53:34.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.629+0000 7f57ef400700 1 -- 172.21.15.81:0/1643484573 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f57e400bbf0 con 0x7f57f81046d0 2024-04-23T14:53:34.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.629+0000 7f57fe000700 1 -- 172.21.15.81:0/1643484573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57f8119bc0 con 0x7f57f81046d0 2024-04-23T14:53:34.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.629+0000 7f57ef400700 1 -- 172.21.15.81:0/1643484573 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57e40255e0 con 0x7f57f81046d0 2024-04-23T14:53:34.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.630+0000 7f57fe000700 1 -- 172.21.15.81:0/1643484573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57f804c710 con 0x7f57f81046d0 2024-04-23T14:53:34.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.631+0000 7f57ef400700 1 -- 172.21.15.81:0/1643484573 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f57e400bd60 con 0x7f57f81046d0 2024-04-23T14:53:34.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.632+0000 7f57ef400700 1 --2- 172.21.15.81:0/1643484573 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f57dc06ed30 0x7f57dc0711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:34.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.632+0000 7f57ef400700 1 -- 172.21.15.81:0/1643484573 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f57e408ff40 con 0x7f57f81046d0 2024-04-23T14:53:34.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.632+0000 7f57f7400700 1 --2- 172.21.15.81:0/1643484573 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f57dc06ed30 0x7f57dc0711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:34.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.633+0000 7f57f7400700 1 --2- 172.21.15.81:0/1643484573 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f57dc06ed30 0x7f57dc0711e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f57e8004990 tx=0x7f57e8009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:34.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.637+0000 7f57ef400700 1 -- 172.21.15.81:0/1643484573 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f57e405c630 con 0x7f57f81046d0 2024-04-23T14:53:34.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:34 smithi081 ceph-mon[90469]: from='client.34186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:53:34.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.960+0000 7f57fe000700 1 -- 172.21.15.81:0/1643484573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f57f8119f20 con 0x7f57f81046d0 2024-04-23T14:53:34.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.961+0000 7f57ef400700 1 -- 172.21.15.81:0/1643484573 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7f57e405c1c0 con 0x7f57f81046d0 2024-04-23T14:53:34.961 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:53:34.961 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-04-23T14:53:34.962 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T14:53:34.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:53:34.962 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-04-23T14:53:34.962 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T14:53:34.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:53:34.962 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-04-23T14:53:34.962 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 6 2024-04-23T14:53:34.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:53:34.962 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-04-23T14:53:34.962 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 4 2024-04-23T14:53:34.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:53:34.962 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-04-23T14:53:34.962 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 10, 2024-04-23T14:53:34.962 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 4 2024-04-23T14:53:34.962 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-23T14:53:34.963 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:53:34.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.963+0000 7f57fe000700 1 -- 172.21.15.81:0/1643484573 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f57dc06ed30 msgr2=0x7f57dc0711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:34.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.963+0000 7f57fe000700 1 --2- 172.21.15.81:0/1643484573 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f57dc06ed30 0x7f57dc0711e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f57e8004990 tx=0x7f57e8009ee0 comp rx=0 tx=0).stop 2024-04-23T14:53:34.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.963+0000 7f57fe000700 1 -- 172.21.15.81:0/1643484573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57f81046d0 msgr2=0x7f57f8114490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:34.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.963+0000 7f57fe000700 1 --2- 172.21.15.81:0/1643484573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57f81046d0 0x7f57f8114490 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f57e4009150 tx=0x7f57e4009e30 comp rx=0 tx=0).stop 2024-04-23T14:53:34.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.964+0000 7f57fe000700 1 -- 172.21.15.81:0/1643484573 shutdown_connections 2024-04-23T14:53:34.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.964+0000 7f57fe000700 1 --2- 172.21.15.81:0/1643484573 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f57dc06ed30 0x7f57dc0711e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:34.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.964+0000 7f57fe000700 1 --2- 172.21.15.81:0/1643484573 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57f8103420 0x7f57f8113f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:34.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.964+0000 7f57fe000700 1 --2- 172.21.15.81:0/1643484573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57f81046d0 0x7f57f8114490 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:34.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.964+0000 7f57fe000700 1 -- 172.21.15.81:0/1643484573 >> 172.21.15.81:0/1643484573 conn(0x7f57f8072640 msgr2=0x7f57f8073d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:34.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.964+0000 7f57fe000700 1 -- 172.21.15.81:0/1643484573 shutdown_connections 2024-04-23T14:53:34.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:34.964+0000 7f57fe000700 1 -- 172.21.15.81:0/1643484573 wait complete. 2024-04-23T14:53:35.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:34 smithi156 ceph-mon[77738]: from='client.34186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:53:35.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.108+0000 7f1f69a00700 1 -- 172.21.15.81:0/1511860158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f64103420 msgr2=0x7f1f64103830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:35.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.108+0000 7f1f69a00700 1 --2- 172.21.15.81:0/1511860158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f64103420 0x7f1f64103830 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1f54004940 tx=0x7f1f54009e30 comp rx=0 tx=0).stop 2024-04-23T14:53:35.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.109+0000 7f1f69a00700 1 -- 172.21.15.81:0/1511860158 shutdown_connections 2024-04-23T14:53:35.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.109+0000 7f1f69a00700 1 --2- 172.21.15.81:0/1511860158 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f641046d0 0x7f1f64104b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:35.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.109+0000 7f1f69a00700 1 --2- 172.21.15.81:0/1511860158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f64103420 0x7f1f64103830 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:35.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.109+0000 7f1f69a00700 1 -- 172.21.15.81:0/1511860158 >> 172.21.15.81:0/1511860158 conn(0x7f1f64072640 msgr2=0x7f1f64074a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:35.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.109+0000 7f1f69a00700 1 -- 172.21.15.81:0/1511860158 shutdown_connections 2024-04-23T14:53:35.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.109+0000 7f1f69a00700 1 -- 172.21.15.81:0/1511860158 wait complete. 2024-04-23T14:53:35.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.109+0000 7f1f69a00700 1 Processor -- start 2024-04-23T14:53:35.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.110+0000 7f1f69a00700 1 -- start start 2024-04-23T14:53:35.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.110+0000 7f1f69a00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f64103420 0x7f1f64113f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.110+0000 7f1f69a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f641046d0 0x7f1f641144a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.110+0000 7f1f69a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f64114aa0 con 0x7f1f641046d0 2024-04-23T14:53:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.110+0000 7f1f69a00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f64114c10 con 0x7f1f64103420 2024-04-23T14:53:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.110+0000 7f1f62000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f641046d0 0x7f1f641144a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.110+0000 7f1f62000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f641046d0 0x7f1f641144a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38980/0 (socket says 172.21.15.81:38980) 2024-04-23T14:53:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.110+0000 7f1f62a00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f64103420 0x7f1f64113f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.110+0000 7f1f62000700 1 -- 172.21.15.81:0/1047468011 learned_addr learned my addr 172.21.15.81:0/1047468011 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:53:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.111+0000 7f1f62000700 1 -- 172.21.15.81:0/1047468011 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f64103420 msgr2=0x7f1f64113f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.111+0000 7f1f62000700 1 --2- 172.21.15.81:0/1047468011 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f64103420 0x7f1f64113f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.111+0000 7f1f62000700 1 -- 172.21.15.81:0/1047468011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f54005040 con 0x7f1f641046d0 2024-04-23T14:53:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.111+0000 7f1f62a00700 1 --2- 172.21.15.81:0/1047468011 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f64103420 0x7f1f64113f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T14:53:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.111+0000 7f1f62000700 1 --2- 172.21.15.81:0/1047468011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f641046d0 0x7f1f641144a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1f50002a50 tx=0x7f1f500046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.111+0000 7f1f5aa00700 1 -- 172.21.15.81:0/1047468011 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f50007cc0 con 0x7f1f641046d0 2024-04-23T14:53:35.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.112+0000 7f1f5aa00700 1 -- 172.21.15.81:0/1047468011 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1f5000f040 con 0x7f1f641046d0 2024-04-23T14:53:35.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.112+0000 7f1f69a00700 1 -- 172.21.15.81:0/1047468011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f64119670 con 0x7f1f641046d0 2024-04-23T14:53:35.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.112+0000 7f1f5aa00700 1 -- 172.21.15.81:0/1047468011 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f5000da30 con 0x7f1f641046d0 2024-04-23T14:53:35.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.112+0000 7f1f69a00700 1 -- 172.21.15.81:0/1047468011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f64119c30 con 0x7f1f641046d0 2024-04-23T14:53:35.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.113+0000 7f1f69a00700 1 -- 172.21.15.81:0/1047468011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f6404c710 con 0x7f1f641046d0 2024-04-23T14:53:35.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.114+0000 7f1f5aa00700 1 -- 172.21.15.81:0/1047468011 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f1f5000db90 con 0x7f1f641046d0 2024-04-23T14:53:35.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.115+0000 7f1f5aa00700 1 --2- 172.21.15.81:0/1047468011 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f1f4806ed30 0x7f1f480711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:35.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.115+0000 7f1f5aa00700 1 -- 172.21.15.81:0/1047468011 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f1f5008e8f0 con 0x7f1f641046d0 2024-04-23T14:53:35.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.115+0000 7f1f62a00700 1 --2- 172.21.15.81:0/1047468011 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f1f4806ed30 0x7f1f480711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:35.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.115+0000 7f1f62a00700 1 --2- 172.21.15.81:0/1047468011 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f1f4806ed30 0x7f1f480711e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1f5400b3b0 tx=0x7f1f54009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:35.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.120+0000 7f1f5aa00700 1 -- 172.21.15.81:0/1047468011 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f1f5005af60 con 0x7f1f641046d0 2024-04-23T14:53:35.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.381+0000 7f1f69a00700 1 -- 172.21.15.81:0/1047468011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1f6411a080 con 0x7f1f641046d0 2024-04-23T14:53:35.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.382+0000 7f1f5aa00700 1 -- 172.21.15.81:0/1047468011 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1907 (secure 0 0 0) 0x7f1f5005aaf0 con 0x7f1f641046d0 2024-04-23T14:53:35.383 INFO:teuthology.orchestra.run.smithi081.stdout:e18 2024-04-23T14:53:35.383 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-23T14:53:35.383 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:53:35.383 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-04-23T14:53:35.384 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:53:35.384 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-04-23T14:53:35.384 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-04-23T14:53:35.384 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 17 2024-04-23T14:53:35.384 INFO:teuthology.orchestra.run.smithi081.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-23T14:53:35.384 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-04-23T14:45:51.264703+0000 2024-04-23T14:53:35.384 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-04-23T14:46:12.782992+0000 2024-04-23T14:53:35.384 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-04-23T14:53:35.384 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-04-23T14:53:35.384 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-04-23T14:53:35.384 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-04-23T14:53:35.384 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-04-23T14:53:35.384 INFO:teuthology.orchestra.run.smithi081.stdout:max_xattr_size 65536 2024-04-23T14:53:35.384 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-04-23T14:53:35.384 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-04-23T14:53:35.384 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 47 2024-04-23T14:53:35.385 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:53:35.385 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 1 2024-04-23T14:53:35.385 INFO:teuthology.orchestra.run.smithi081.stdout:in 0 2024-04-23T14:53:35.385 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=14472} 2024-04-23T14:53:35.385 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-04-23T14:53:35.385 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-04-23T14:53:35.385 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-04-23T14:53:35.385 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-04-23T14:53:35.385 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-04-23T14:53:35.385 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-04-23T14:53:35.385 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-04-23T14:53:35.385 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-04-23T14:53:35.385 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-04-23T14:53:35.385 INFO:teuthology.orchestra.run.smithi081.stdout:qdb_cluster leader: 0 members: 2024-04-23T14:53:35.386 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.vcoywg{0:14472} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.81:6828/2563365650,v1:172.21.15.81:6829/2563365650] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:53:35.386 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.wydgcg{0:14482} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.81:6826/759909104,v1:172.21.15.81:6827/759909104] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:53:35.386 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:53:35.386 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:53:35.386 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-04-23T14:53:35.386 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:53:35.386 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.vynkxn{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.156:6826/1794690362,v1:172.21.15.156:6827/1794690362] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:53:35.386 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.rhbtxt{-1:24263} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.156:6824/3854041261,v1:172.21.15.156:6825/3854041261] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:53:35.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.385+0000 7f1f69a00700 1 -- 172.21.15.81:0/1047468011 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f1f4806ed30 msgr2=0x7f1f480711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:35.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.385+0000 7f1f69a00700 1 --2- 172.21.15.81:0/1047468011 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f1f4806ed30 0x7f1f480711e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1f5400b3b0 tx=0x7f1f54009e30 comp rx=0 tx=0).stop 2024-04-23T14:53:35.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.385+0000 7f1f69a00700 1 -- 172.21.15.81:0/1047468011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f641046d0 msgr2=0x7f1f641144a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:35.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.385+0000 7f1f69a00700 1 --2- 172.21.15.81:0/1047468011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f641046d0 0x7f1f641144a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1f50002a50 tx=0x7f1f500046b0 comp rx=0 tx=0).stop 2024-04-23T14:53:35.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.385+0000 7f1f69a00700 1 -- 172.21.15.81:0/1047468011 shutdown_connections 2024-04-23T14:53:35.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.385+0000 7f1f69a00700 1 --2- 172.21.15.81:0/1047468011 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f1f4806ed30 0x7f1f480711e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:35.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.385+0000 7f1f69a00700 1 --2- 172.21.15.81:0/1047468011 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f64103420 0x7f1f64113f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:35.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.385+0000 7f1f69a00700 1 --2- 172.21.15.81:0/1047468011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f641046d0 0x7f1f641144a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:35.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.385+0000 7f1f69a00700 1 -- 172.21.15.81:0/1047468011 >> 172.21.15.81:0/1047468011 conn(0x7f1f64072640 msgr2=0x7f1f64073d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:35.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.385+0000 7f1f69a00700 1 -- 172.21.15.81:0/1047468011 shutdown_connections 2024-04-23T14:53:35.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.385+0000 7f1f69a00700 1 -- 172.21.15.81:0/1047468011 wait complete. 2024-04-23T14:53:35.388 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 18 2024-04-23T14:53:35.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.530+0000 7fa76a200700 1 -- 172.21.15.81:0/4274576458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7640fdff0 msgr2=0x7fa7640fe460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:35.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.530+0000 7fa76a200700 1 --2- 172.21.15.81:0/4274576458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7640fdff0 0x7fa7640fe460 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa750004940 tx=0x7fa750009e30 comp rx=0 tx=0).stop 2024-04-23T14:53:35.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.531+0000 7fa76a200700 1 -- 172.21.15.81:0/4274576458 shutdown_connections 2024-04-23T14:53:35.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.531+0000 7fa76a200700 1 --2- 172.21.15.81:0/4274576458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7640fdff0 0x7fa7640fe460 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:35.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.531+0000 7fa76a200700 1 --2- 172.21.15.81:0/4274576458 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7640fce80 0x7fa7640fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:35.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.531+0000 7fa76a200700 1 -- 172.21.15.81:0/4274576458 >> 172.21.15.81:0/4274576458 conn(0x7fa7640f8580 msgr2=0x7fa7640fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:35.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.531+0000 7fa76a200700 1 -- 172.21.15.81:0/4274576458 shutdown_connections 2024-04-23T14:53:35.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.531+0000 7fa76a200700 1 -- 172.21.15.81:0/4274576458 wait complete. 2024-04-23T14:53:35.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.532+0000 7fa76a200700 1 Processor -- start 2024-04-23T14:53:35.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.532+0000 7fa76a200700 1 -- start start 2024-04-23T14:53:35.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.533+0000 7fa76a200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7640fce80 0x7fa76410d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:35.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.533+0000 7fa76a200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7640fdff0 0x7fa76410de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:35.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.533+0000 7fa76a200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76410e470 con 0x7fa7640fdff0 2024-04-23T14:53:35.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.533+0000 7fa76a200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76410e5e0 con 0x7fa7640fce80 2024-04-23T14:53:35.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.533+0000 7fa762a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7640fdff0 0x7fa76410de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:35.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.533+0000 7fa762a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7640fdff0 0x7fa76410de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39006/0 (socket says 172.21.15.81:39006) 2024-04-23T14:53:35.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.533+0000 7fa762a00700 1 -- 172.21.15.81:0/3280448672 learned_addr learned my addr 172.21.15.81:0/3280448672 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:53:35.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.533+0000 7fa763400700 1 --2- 172.21.15.81:0/3280448672 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7640fce80 0x7fa76410d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:35.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.534+0000 7fa762a00700 1 -- 172.21.15.81:0/3280448672 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7640fce80 msgr2=0x7fa76410d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:35.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.534+0000 7fa762a00700 1 --2- 172.21.15.81:0/3280448672 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7640fce80 0x7fa76410d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:35.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.534+0000 7fa762a00700 1 -- 172.21.15.81:0/3280448672 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa750005040 con 0x7fa7640fdff0 2024-04-23T14:53:35.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.534+0000 7fa763400700 1 --2- 172.21.15.81:0/3280448672 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7640fce80 0x7fa76410d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:53:35.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.534+0000 7fa762a00700 1 --2- 172.21.15.81:0/3280448672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7640fdff0 0x7fa76410de70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa75000b3b0 tx=0x7fa750009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:35.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.534+0000 7fa75b400700 1 -- 172.21.15.81:0/3280448672 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa75000e040 con 0x7fa7640fdff0 2024-04-23T14:53:35.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.534+0000 7fa75b400700 1 -- 172.21.15.81:0/3280448672 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa750004290 con 0x7fa7640fdff0 2024-04-23T14:53:35.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.534+0000 7fa76a200700 1 -- 172.21.15.81:0/3280448672 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa764112fe0 con 0x7fa7640fdff0 2024-04-23T14:53:35.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.534+0000 7fa75b400700 1 -- 172.21.15.81:0/3280448672 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa75001c630 con 0x7fa7640fdff0 2024-04-23T14:53:35.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.535+0000 7fa76a200700 1 -- 172.21.15.81:0/3280448672 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa764113570 con 0x7fa7640fdff0 2024-04-23T14:53:35.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.536+0000 7fa76a200700 1 -- 172.21.15.81:0/3280448672 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa76404c710 con 0x7fa7640fdff0 2024-04-23T14:53:35.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.537+0000 7fa75b400700 1 -- 172.21.15.81:0/3280448672 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7fa75000bbf0 con 0x7fa7640fdff0 2024-04-23T14:53:35.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.537+0000 7fa75b400700 1 --2- 172.21.15.81:0/3280448672 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa74806ed30 0x7fa7480711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:35.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.538+0000 7fa75b400700 1 -- 172.21.15.81:0/3280448672 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fa75008feb0 con 0x7fa7640fdff0 2024-04-23T14:53:35.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.538+0000 7fa763400700 1 --2- 172.21.15.81:0/3280448672 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa74806ed30 0x7fa7480711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:35.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.539+0000 7fa763400700 1 --2- 172.21.15.81:0/3280448672 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa74806ed30 0x7fa7480711e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa754007fd0 tx=0x7fa754009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:35.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.543+0000 7fa75b400700 1 -- 172.21.15.81:0/3280448672 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fa75005c620 con 0x7fa7640fdff0 2024-04-23T14:53:35.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.776+0000 7fa76a200700 1 -- 172.21.15.81:0/3280448672 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa764102380 con 0x7fa74806ed30 2024-04-23T14:53:35.777 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:35 smithi081 ceph-mon[90469]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:53:35.777 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:35 smithi081 ceph-mon[90469]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:53:35.777 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:35 smithi081 ceph-mon[90469]: pgmap v37: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:53:35.777 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:35 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:35.777 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:35 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:35.777 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:35 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi156.rhbtxt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:53:35.777 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:35 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:35.777 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:35 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/1643484573' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:53:35.777 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:35 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/1047468011' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:53:35.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.778+0000 7fa75b400700 1 -- 172.21.15.81:0/3280448672 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fa764102380 con 0x7fa74806ed30 2024-04-23T14:53:35.778 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:53:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd", 2024-04-23T14:53:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-04-23T14:53:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-23T14:53:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [ 2024-04-23T14:53:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: "mon", 2024-04-23T14:53:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr" 2024-04-23T14:53:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-04-23T14:53:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "4/21 daemons upgraded", 2024-04-23T14:53:35.779 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "Currently upgrading mon daemons", 2024-04-23T14:53:35.779 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-04-23T14:53:35.779 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:53:35.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.780+0000 7fa76a200700 1 -- 172.21.15.81:0/3280448672 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa74806ed30 msgr2=0x7fa7480711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:35.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.780+0000 7fa76a200700 1 --2- 172.21.15.81:0/3280448672 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa74806ed30 0x7fa7480711e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa754007fd0 tx=0x7fa754009040 comp rx=0 tx=0).stop 2024-04-23T14:53:35.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.780+0000 7fa76a200700 1 -- 172.21.15.81:0/3280448672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7640fdff0 msgr2=0x7fa76410de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:35.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.780+0000 7fa76a200700 1 --2- 172.21.15.81:0/3280448672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7640fdff0 0x7fa76410de70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa75000b3b0 tx=0x7fa750009e30 comp rx=0 tx=0).stop 2024-04-23T14:53:35.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.780+0000 7fa76a200700 1 -- 172.21.15.81:0/3280448672 shutdown_connections 2024-04-23T14:53:35.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.781+0000 7fa76a200700 1 --2- 172.21.15.81:0/3280448672 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa74806ed30 0x7fa7480711e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:35.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.781+0000 7fa76a200700 1 --2- 172.21.15.81:0/3280448672 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7640fce80 0x7fa76410d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:35.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.781+0000 7fa76a200700 1 --2- 172.21.15.81:0/3280448672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7640fdff0 0x7fa76410de70 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:35.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.781+0000 7fa76a200700 1 -- 172.21.15.81:0/3280448672 >> 172.21.15.81:0/3280448672 conn(0x7fa7640f8580 msgr2=0x7fa7640f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:35.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.781+0000 7fa76a200700 1 -- 172.21.15.81:0/3280448672 shutdown_connections 2024-04-23T14:53:35.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.781+0000 7fa76a200700 1 -- 172.21.15.81:0/3280448672 wait complete. 2024-04-23T14:53:35.870 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:35 smithi156 ceph-mon[77738]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:53:35.870 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:35 smithi156 ceph-mon[77738]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:53:35.870 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:35 smithi156 ceph-mon[77738]: pgmap v37: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:53:35.870 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:35 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:35.870 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:35 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:35.870 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:35 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi156.rhbtxt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:53:35.870 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:35 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:35.870 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:35 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/1643484573' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:53:35.870 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:35 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/1047468011' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:53:35.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.918+0000 7f2357a00700 1 -- 172.21.15.81:0/891638578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23501046d0 msgr2=0x7f2350104b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:35.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.918+0000 7f2357a00700 1 --2- 172.21.15.81:0/891638578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23501046d0 0x7f2350104b40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f233c004940 tx=0x7f233c009e30 comp rx=0 tx=0).stop 2024-04-23T14:53:35.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.918+0000 7f2357a00700 1 -- 172.21.15.81:0/891638578 shutdown_connections 2024-04-23T14:53:35.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.918+0000 7f2357a00700 1 --2- 172.21.15.81:0/891638578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23501046d0 0x7f2350104b40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:35.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.918+0000 7f2357a00700 1 --2- 172.21.15.81:0/891638578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2350103420 0x7f2350103830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:35.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.918+0000 7f2357a00700 1 -- 172.21.15.81:0/891638578 >> 172.21.15.81:0/891638578 conn(0x7f2350072640 msgr2=0x7f2350074a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:35.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.918+0000 7f2357a00700 1 -- 172.21.15.81:0/891638578 shutdown_connections 2024-04-23T14:53:35.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.918+0000 7f2357a00700 1 -- 172.21.15.81:0/891638578 wait complete. 2024-04-23T14:53:35.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.919+0000 7f2357a00700 1 Processor -- start 2024-04-23T14:53:35.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.919+0000 7f2357a00700 1 -- start start 2024-04-23T14:53:35.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.920+0000 7f2357a00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2350103420 0x7f2350113f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:35.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.920+0000 7f2357a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23501046d0 0x7f2350114490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:35.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.920+0000 7f2357a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2350114a90 con 0x7f23501046d0 2024-04-23T14:53:35.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.920+0000 7f2357a00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2350114c00 con 0x7f2350103420 2024-04-23T14:53:35.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.920+0000 7f234fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23501046d0 0x7f2350114490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:35.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.920+0000 7f234fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23501046d0 0x7f2350114490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39020/0 (socket says 172.21.15.81:39020) 2024-04-23T14:53:35.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.920+0000 7f234fe00700 1 -- 172.21.15.81:0/3124928112 learned_addr learned my addr 172.21.15.81:0/3124928112 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:53:35.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.920+0000 7f2355000700 1 --2- 172.21.15.81:0/3124928112 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2350103420 0x7f2350113f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:35.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.920+0000 7f234fe00700 1 -- 172.21.15.81:0/3124928112 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2350103420 msgr2=0x7f2350113f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:35.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.920+0000 7f234fe00700 1 --2- 172.21.15.81:0/3124928112 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2350103420 0x7f2350113f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:35.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.920+0000 7f234fe00700 1 -- 172.21.15.81:0/3124928112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233c005040 con 0x7f23501046d0 2024-04-23T14:53:35.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.920+0000 7f2355000700 1 --2- 172.21.15.81:0/3124928112 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2350103420 0x7f2350113f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:53:35.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.921+0000 7f234fe00700 1 --2- 172.21.15.81:0/3124928112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23501046d0 0x7f2350114490 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f233c00b3b0 tx=0x7f233c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:35.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.921+0000 7f234cc00700 1 -- 172.21.15.81:0/3124928112 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f233c00e040 con 0x7f23501046d0 2024-04-23T14:53:35.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.921+0000 7f234cc00700 1 -- 172.21.15.81:0/3124928112 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f233c004290 con 0x7f23501046d0 2024-04-23T14:53:35.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.921+0000 7f2357a00700 1 -- 172.21.15.81:0/3124928112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2350119600 con 0x7f23501046d0 2024-04-23T14:53:35.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.921+0000 7f234cc00700 1 -- 172.21.15.81:0/3124928112 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f233c01c630 con 0x7f23501046d0 2024-04-23T14:53:35.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.921+0000 7f2357a00700 1 -- 172.21.15.81:0/3124928112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2350119bc0 con 0x7f23501046d0 2024-04-23T14:53:35.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.922+0000 7f2357a00700 1 -- 172.21.15.81:0/3124928112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f235004c710 con 0x7f23501046d0 2024-04-23T14:53:35.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.923+0000 7f234cc00700 1 -- 172.21.15.81:0/3124928112 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f233c00bbf0 con 0x7f23501046d0 2024-04-23T14:53:35.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.924+0000 7f234cc00700 1 --2- 172.21.15.81:0/3124928112 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f233806ed30 0x7f23380711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:53:35.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.924+0000 7f234cc00700 1 -- 172.21.15.81:0/3124928112 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f233c08fe00 con 0x7f23501046d0 2024-04-23T14:53:35.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.924+0000 7f2355000700 1 --2- 172.21.15.81:0/3124928112 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f233806ed30 0x7f23380711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:53:35.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.925+0000 7f2355000700 1 --2- 172.21.15.81:0/3124928112 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f233806ed30 0x7f23380711e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2344007fd0 tx=0x7f2344009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:53:35.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:35.929+0000 7f234cc00700 1 -- 172.21.15.81:0/3124928112 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f233c05c630 con 0x7f23501046d0 2024-04-23T14:53:36.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:36.221+0000 7f2357a00700 1 -- 172.21.15.81:0/3124928112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f235011a060 con 0x7f23501046d0 2024-04-23T14:53:36.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:36.222+0000 7f234cc00700 1 -- 172.21.15.81:0/3124928112 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f233c05c1c0 con 0x7f23501046d0 2024-04-23T14:53:36.222 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-04-23T14:53:36.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:36.225+0000 7f2357a00700 1 -- 172.21.15.81:0/3124928112 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f233806ed30 msgr2=0x7f23380711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:36.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:36.225+0000 7f2357a00700 1 --2- 172.21.15.81:0/3124928112 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f233806ed30 0x7f23380711e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2344007fd0 tx=0x7f2344009040 comp rx=0 tx=0).stop 2024-04-23T14:53:36.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:36.225+0000 7f2357a00700 1 -- 172.21.15.81:0/3124928112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23501046d0 msgr2=0x7f2350114490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:53:36.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:36.225+0000 7f2357a00700 1 --2- 172.21.15.81:0/3124928112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23501046d0 0x7f2350114490 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f233c00b3b0 tx=0x7f233c009e30 comp rx=0 tx=0).stop 2024-04-23T14:53:36.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:36.225+0000 7f2357a00700 1 -- 172.21.15.81:0/3124928112 shutdown_connections 2024-04-23T14:53:36.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:36.225+0000 7f2357a00700 1 --2- 172.21.15.81:0/3124928112 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f233806ed30 0x7f23380711e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:36.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:36.225+0000 7f2357a00700 1 --2- 172.21.15.81:0/3124928112 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2350103420 0x7f2350113f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:36.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:36.225+0000 7f2357a00700 1 --2- 172.21.15.81:0/3124928112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23501046d0 0x7f2350114490 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:53:36.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:36.225+0000 7f2357a00700 1 -- 172.21.15.81:0/3124928112 >> 172.21.15.81:0/3124928112 conn(0x7f2350072640 msgr2=0x7f2350073d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:53:36.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:36.225+0000 7f2357a00700 1 -- 172.21.15.81:0/3124928112 shutdown_connections 2024-04-23T14:53:36.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:53:36.225+0000 7f2357a00700 1 -- 172.21.15.81:0/3124928112 wait complete. 2024-04-23T14:53:36.879 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:36 smithi156 ceph-mon[77738]: Reconfiguring mds.cephfs.smithi156.rhbtxt (monmap changed)... 2024-04-23T14:53:36.879 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:36 smithi156 ceph-mon[77738]: Reconfiguring daemon mds.cephfs.smithi156.rhbtxt on smithi156 2024-04-23T14:53:36.879 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:36 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/3124928112' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:53:37.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:36 smithi081 ceph-mon[90469]: Reconfiguring mds.cephfs.smithi156.rhbtxt (monmap changed)... 2024-04-23T14:53:37.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:36 smithi081 ceph-mon[90469]: Reconfiguring daemon mds.cephfs.smithi156.rhbtxt on smithi156 2024-04-23T14:53:37.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:36 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/3124928112' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:53:37.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:37 smithi081 ceph-mon[90469]: from='client.34206 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:53:37.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:37 smithi081 ceph-mon[90469]: pgmap v38: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:53:37.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:37 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:37.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:37 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:37.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:37 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi156.vynkxn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:53:37.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:37 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:38.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:37 smithi156 ceph-mon[77738]: from='client.34206 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:53:38.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:37 smithi156 ceph-mon[77738]: pgmap v38: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:53:38.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:37 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:38.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:37 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:38.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:37 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi156.vynkxn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:53:38.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:37 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:38.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:38 smithi156 ceph-mon[77738]: Reconfiguring mds.cephfs.smithi156.vynkxn (monmap changed)... 2024-04-23T14:53:38.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:38 smithi156 ceph-mon[77738]: Reconfiguring daemon mds.cephfs.smithi156.vynkxn on smithi156 2024-04-23T14:53:39.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:38 smithi081 ceph-mon[90469]: Reconfiguring mds.cephfs.smithi156.vynkxn (monmap changed)... 2024-04-23T14:53:39.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:38 smithi081 ceph-mon[90469]: Reconfiguring daemon mds.cephfs.smithi156.vynkxn on smithi156 2024-04-23T14:53:40.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:39 smithi156 ceph-mon[77738]: pgmap v39: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:53:40.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:39 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:40.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:39 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:40.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:39 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:53:40.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:39 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:53:40.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:39 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:53:40.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:39 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:40.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:39 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi081"}]: dispatch 2024-04-23T14:53:40.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:39 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi081"}]': finished 2024-04-23T14:53:40.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:39 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi156"}]: dispatch 2024-04-23T14:53:40.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:39 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi156"}]': finished 2024-04-23T14:53:40.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:39 smithi081 ceph-mon[90469]: pgmap v39: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:53:40.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:39 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:40.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:39 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:40.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:39 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:53:40.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:39 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:53:40.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:39 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:53:40.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:39 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:40.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:39 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi081"}]: dispatch 2024-04-23T14:53:40.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:39 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi081"}]': finished 2024-04-23T14:53:40.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:39 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi156"}]: dispatch 2024-04-23T14:53:40.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:39 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi156"}]': finished 2024-04-23T14:53:40.755 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:40 smithi081 ceph-mon[90469]: Upgrade: Setting container_image for all mon 2024-04-23T14:53:41.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:40 smithi156 ceph-mon[77738]: Upgrade: Setting container_image for all mon 2024-04-23T14:53:41.781 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:41 smithi081 ceph-mon[90469]: pgmap v40: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:53:41.781 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:41 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:53:42.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:41 smithi156 ceph-mon[77738]: pgmap v40: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:53:42.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:41 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:53:43.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:42 smithi081 ceph-mon[90469]: Upgrade: Updating crash.smithi081 (1/2) 2024-04-23T14:53:43.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:42 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:43.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:42 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi081", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-23T14:53:43.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:42 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:43.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:42 smithi081 ceph-mon[90469]: Deploying daemon crash.smithi081 on smithi081 2024-04-23T14:53:43.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:42 smithi081 ceph-mon[90469]: pgmap v41: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:53:43.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:42 smithi156 ceph-mon[77738]: Upgrade: Updating crash.smithi081 (1/2) 2024-04-23T14:53:43.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:42 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:43.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:42 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi081", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-23T14:53:43.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:42 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:43.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:42 smithi156 ceph-mon[77738]: Deploying daemon crash.smithi081 on smithi081 2024-04-23T14:53:43.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:42 smithi156 ceph-mon[77738]: pgmap v41: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:53:45.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:45 smithi081 ceph-mon[90469]: pgmap v42: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:53:46.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:45 smithi156 ceph-mon[77738]: pgmap v42: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:53:47.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:47 smithi081 ceph-mon[90469]: pgmap v43: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:53:47.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:47 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:47.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:47 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:48.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:47 smithi156 ceph-mon[77738]: pgmap v43: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:53:48.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:47 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:48.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:47 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:49.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:49 smithi081 ceph-mon[90469]: pgmap v44: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:53:50.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:49 smithi156 ceph-mon[77738]: pgmap v44: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:53:50.966 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:50 smithi156 ceph-mon[77738]: Upgrade: Updating crash.smithi156 (2/2) 2024-04-23T14:53:50.966 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:50 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:50.967 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:50 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi156", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-23T14:53:50.967 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:50 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:50.967 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:50 smithi156 ceph-mon[77738]: Deploying daemon crash.smithi156 on smithi156 2024-04-23T14:53:50.967 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:50 smithi156 ceph-mon[77738]: pgmap v45: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:53:51.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:50 smithi081 ceph-mon[90469]: Upgrade: Updating crash.smithi156 (2/2) 2024-04-23T14:53:51.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:50 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:51.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:50 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi156", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-23T14:53:51.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:50 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:53:51.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:50 smithi081 ceph-mon[90469]: Deploying daemon crash.smithi156 on smithi156 2024-04-23T14:53:51.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:50 smithi081 ceph-mon[90469]: pgmap v45: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:53:53.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:53 smithi156 ceph-mon[77738]: pgmap v46: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:53:53.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:53 smithi081 ceph-mon[90469]: pgmap v46: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:53:55.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:55 smithi081 ceph-mon[90469]: pgmap v47: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:53:55.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:55 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:55.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:55 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:55.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:55 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:53:55.890 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:55 smithi156 ceph-mon[77738]: pgmap v47: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:53:55.890 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:55 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:55.890 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:55 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:55.890 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:55 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:53:56.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:56 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:53:56.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:56 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:53:57.731 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:57 smithi081 ceph-mon[90469]: pgmap v48: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:53:58.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:57 smithi156 ceph-mon[77738]: pgmap v48: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:53:59.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:59 smithi081 ceph-mon[90469]: pgmap v49: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-23T14:53:59.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:59 smithi081 ceph-mon[90469]: mgrmap e38: smithi081.ldghvq(active, since 92s), standbys: smithi156.ounwyj 2024-04-23T14:53:59.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:59 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:53:59.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:53:59 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:00.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:59 smithi156 ceph-mon[77738]: pgmap v49: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-23T14:54:00.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:59 smithi156 ceph-mon[77738]: mgrmap e38: smithi081.ldghvq(active, since 92s), standbys: smithi156.ounwyj 2024-04-23T14:54:00.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:59 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:00.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:53:59 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:02.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:01 smithi156 ceph-mon[77738]: pgmap v50: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-23T14:54:02.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:01 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:02.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:01 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:02.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:01 smithi081 ceph-mon[90469]: pgmap v50: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-23T14:54:02.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:01 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:02.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:01 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:03.366 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:03 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:03.366 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:03 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:03.369 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:03 smithi156 ceph-mon[77738]: pgmap v51: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-23T14:54:03.509 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:03 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:03.510 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:03 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:03.510 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:03 smithi081 ceph-mon[90469]: pgmap v51: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-23T14:54:05.522 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:05 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:05.522 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:05 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:05.522 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:05 smithi081 ceph-mon[90469]: pgmap v52: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-23T14:54:05.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:05 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:05.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:05 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:05.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:05 smithi156 ceph-mon[77738]: pgmap v52: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-23T14:54:06.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.390+0000 7f93b3a00700 1 -- 172.21.15.81:0/2055533757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93ac1002b0 msgr2=0x7f93ac100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:06.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.390+0000 7f93b3a00700 1 --2- 172.21.15.81:0/2055533757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93ac1002b0 0x7f93ac100720 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9398004940 tx=0x7f9398009e30 comp rx=0 tx=0).stop 2024-04-23T14:54:06.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.390+0000 7f93b3a00700 1 -- 172.21.15.81:0/2055533757 shutdown_connections 2024-04-23T14:54:06.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.390+0000 7f93b3a00700 1 --2- 172.21.15.81:0/2055533757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93ac1002b0 0x7f93ac100720 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:06.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.390+0000 7f93b3a00700 1 --2- 172.21.15.81:0/2055533757 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f93ac0ff000 0x7f93ac0ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:06.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.390+0000 7f93b3a00700 1 -- 172.21.15.81:0/2055533757 >> 172.21.15.81:0/2055533757 conn(0x7f93ac0fa950 msgr2=0x7f93ac0fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:06.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.390+0000 7f93b3a00700 1 -- 172.21.15.81:0/2055533757 shutdown_connections 2024-04-23T14:54:06.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.390+0000 7f93b3a00700 1 -- 172.21.15.81:0/2055533757 wait complete. 2024-04-23T14:54:06.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.391+0000 7f93b3a00700 1 Processor -- start 2024-04-23T14:54:06.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.392+0000 7f93b3a00700 1 -- start start 2024-04-23T14:54:06.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.392+0000 7f93b3a00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f93ac0ff000 0x7f93ac10fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:06.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.392+0000 7f93b3a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93ac1002b0 0x7f93ac110170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:06.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.392+0000 7f93b3a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac110770 con 0x7f93ac1002b0 2024-04-23T14:54:06.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.392+0000 7f93b3a00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac110fc0 con 0x7f93ac0ff000 2024-04-23T14:54:06.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.392+0000 7f93abe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93ac1002b0 0x7f93ac110170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:06.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.392+0000 7f93abe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93ac1002b0 0x7f93ac110170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46828/0 (socket says 172.21.15.81:46828) 2024-04-23T14:54:06.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.392+0000 7f93abe00700 1 -- 172.21.15.81:0/3068955134 learned_addr learned my addr 172.21.15.81:0/3068955134 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:54:06.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.393+0000 7f93b1000700 1 --2- 172.21.15.81:0/3068955134 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f93ac0ff000 0x7f93ac10fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:06.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.393+0000 7f93abe00700 1 -- 172.21.15.81:0/3068955134 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f93ac0ff000 msgr2=0x7f93ac10fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:06.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.393+0000 7f93abe00700 1 --2- 172.21.15.81:0/3068955134 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f93ac0ff000 0x7f93ac10fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:06.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.393+0000 7f93abe00700 1 -- 172.21.15.81:0/3068955134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9398005040 con 0x7f93ac1002b0 2024-04-23T14:54:06.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.393+0000 7f93abe00700 1 --2- 172.21.15.81:0/3068955134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93ac1002b0 0x7f93ac110170 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9398009150 tx=0x7f9398009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:06.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.394+0000 7f93a8c00700 1 -- 172.21.15.81:0/3068955134 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f939800e040 con 0x7f93ac1002b0 2024-04-23T14:54:06.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.394+0000 7f93a8c00700 1 -- 172.21.15.81:0/3068955134 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f939800bbf0 con 0x7f93ac1002b0 2024-04-23T14:54:06.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.394+0000 7f93a8c00700 1 -- 172.21.15.81:0/3068955134 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f939801c630 con 0x7f93ac1002b0 2024-04-23T14:54:06.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.394+0000 7f93b3a00700 1 -- 172.21.15.81:0/3068955134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93ac111240 con 0x7f93ac1002b0 2024-04-23T14:54:06.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.394+0000 7f93b3a00700 1 -- 172.21.15.81:0/3068955134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93ac111780 con 0x7f93ac1002b0 2024-04-23T14:54:06.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.395+0000 7f93b3a00700 1 -- 172.21.15.81:0/3068955134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93ac05f5f0 con 0x7f93ac1002b0 2024-04-23T14:54:06.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.396+0000 7f93a8c00700 1 -- 172.21.15.81:0/3068955134 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f939800bd60 con 0x7f93ac1002b0 2024-04-23T14:54:06.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.398+0000 7f93a8c00700 1 --2- 172.21.15.81:0/3068955134 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f939406ec10 0x7f93940710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:06.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.398+0000 7f93a8c00700 1 -- 172.21.15.81:0/3068955134 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f939808fbe0 con 0x7f93ac1002b0 2024-04-23T14:54:06.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.398+0000 7f93b1000700 1 --2- 172.21.15.81:0/3068955134 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f939406ec10 0x7f93940710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:06.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.399+0000 7f93b1000700 1 --2- 172.21.15.81:0/3068955134 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f939406ec10 0x7f93940710c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f93a0007fd0 tx=0x7f93a0009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:06.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.403+0000 7f93a8c00700 1 -- 172.21.15.81:0/3068955134 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f939805c570 con 0x7f93ac1002b0 2024-04-23T14:54:06.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.666+0000 7f93b3a00700 1 -- 172.21.15.81:0/3068955134 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f93ac111b50 con 0x7f939406ec10 2024-04-23T14:54:06.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.668+0000 7f93a8c00700 1 -- 172.21.15.81:0/3068955134 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+402 (secure 0 0 0) 0x7f93ac111b50 con 0x7f939406ec10 2024-04-23T14:54:06.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.671+0000 7f93b3a00700 1 -- 172.21.15.81:0/3068955134 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f939406ec10 msgr2=0x7f93940710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:06.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.671+0000 7f93b3a00700 1 --2- 172.21.15.81:0/3068955134 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f939406ec10 0x7f93940710c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f93a0007fd0 tx=0x7f93a0009040 comp rx=0 tx=0).stop 2024-04-23T14:54:06.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.671+0000 7f93b3a00700 1 -- 172.21.15.81:0/3068955134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93ac1002b0 msgr2=0x7f93ac110170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:06.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.671+0000 7f93b3a00700 1 --2- 172.21.15.81:0/3068955134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93ac1002b0 0x7f93ac110170 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9398009150 tx=0x7f9398009e30 comp rx=0 tx=0).stop 2024-04-23T14:54:06.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.671+0000 7f93b3a00700 1 -- 172.21.15.81:0/3068955134 shutdown_connections 2024-04-23T14:54:06.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.671+0000 7f93b3a00700 1 --2- 172.21.15.81:0/3068955134 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f939406ec10 0x7f93940710c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:06.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.671+0000 7f93b3a00700 1 --2- 172.21.15.81:0/3068955134 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f93ac0ff000 0x7f93ac10fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:06.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.671+0000 7f93b3a00700 1 --2- 172.21.15.81:0/3068955134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93ac1002b0 0x7f93ac110170 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:06.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.671+0000 7f93b3a00700 1 -- 172.21.15.81:0/3068955134 >> 172.21.15.81:0/3068955134 conn(0x7f93ac0fa950 msgr2=0x7f93ac0fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:06.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.671+0000 7f93b3a00700 1 -- 172.21.15.81:0/3068955134 shutdown_connections 2024-04-23T14:54:06.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.671+0000 7f93b3a00700 1 -- 172.21.15.81:0/3068955134 wait complete. 2024-04-23T14:54:06.688 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-04-23T14:54:06.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.829+0000 7fb768000700 1 -- 172.21.15.81:0/3522087160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7601002d0 msgr2=0x7fb760100740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:06.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.829+0000 7fb768000700 1 --2- 172.21.15.81:0/3522087160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7601002d0 0x7fb760100740 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb74c004940 tx=0x7fb74c009e30 comp rx=0 tx=0).stop 2024-04-23T14:54:06.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.830+0000 7fb768000700 1 -- 172.21.15.81:0/3522087160 shutdown_connections 2024-04-23T14:54:06.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.830+0000 7fb768000700 1 --2- 172.21.15.81:0/3522087160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7601002d0 0x7fb760100740 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:06.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.830+0000 7fb768000700 1 --2- 172.21.15.81:0/3522087160 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7600ff020 0x7fb7600ff430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:06.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.830+0000 7fb768000700 1 -- 172.21.15.81:0/3522087160 >> 172.21.15.81:0/3522087160 conn(0x7fb7600fa950 msgr2=0x7fb7600fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:06.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.830+0000 7fb768000700 1 -- 172.21.15.81:0/3522087160 shutdown_connections 2024-04-23T14:54:06.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.830+0000 7fb768000700 1 -- 172.21.15.81:0/3522087160 wait complete. 2024-04-23T14:54:06.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.831+0000 7fb768000700 1 Processor -- start 2024-04-23T14:54:06.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.831+0000 7fb768000700 1 -- start start 2024-04-23T14:54:06.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.831+0000 7fb768000700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7600ff020 0x7fb76010fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:06.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.831+0000 7fb768000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7601002d0 0x7fb7601100b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:06.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.831+0000 7fb768000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7601106b0 con 0x7fb7601002d0 2024-04-23T14:54:06.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.831+0000 7fb768000700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb760110820 con 0x7fb7600ff020 2024-04-23T14:54:06.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.831+0000 7fb764c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7601002d0 0x7fb7601100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:06.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.831+0000 7fb764c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7601002d0 0x7fb7601100b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46848/0 (socket says 172.21.15.81:46848) 2024-04-23T14:54:06.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.831+0000 7fb764c00700 1 -- 172.21.15.81:0/3859366598 learned_addr learned my addr 172.21.15.81:0/3859366598 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:54:06.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.832+0000 7fb765600700 1 --2- 172.21.15.81:0/3859366598 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7600ff020 0x7fb76010fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:06.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.832+0000 7fb764c00700 1 -- 172.21.15.81:0/3859366598 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7600ff020 msgr2=0x7fb76010fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:06.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.832+0000 7fb764c00700 1 --2- 172.21.15.81:0/3859366598 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7600ff020 0x7fb76010fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:06.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.832+0000 7fb764c00700 1 -- 172.21.15.81:0/3859366598 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb74c005040 con 0x7fb7601002d0 2024-04-23T14:54:06.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.832+0000 7fb764c00700 1 --2- 172.21.15.81:0/3859366598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7601002d0 0x7fb7601100b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb74c00b3b0 tx=0x7fb74c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:06.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.832+0000 7fb75d600700 1 -- 172.21.15.81:0/3859366598 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb74c00e040 con 0x7fb7601002d0 2024-04-23T14:54:06.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.833+0000 7fb75d600700 1 -- 172.21.15.81:0/3859366598 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb74c004290 con 0x7fb7601002d0 2024-04-23T14:54:06.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.833+0000 7fb768000700 1 -- 172.21.15.81:0/3859366598 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb760115220 con 0x7fb7601002d0 2024-04-23T14:54:06.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.833+0000 7fb75d600700 1 -- 172.21.15.81:0/3859366598 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb74c01c630 con 0x7fb7601002d0 2024-04-23T14:54:06.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.833+0000 7fb768000700 1 -- 172.21.15.81:0/3859366598 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7601157e0 con 0x7fb7601002d0 2024-04-23T14:54:06.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.834+0000 7fb768000700 1 -- 172.21.15.81:0/3859366598 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb76004c710 con 0x7fb7601002d0 2024-04-23T14:54:06.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.835+0000 7fb75d600700 1 -- 172.21.15.81:0/3859366598 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fb74c00bbf0 con 0x7fb7601002d0 2024-04-23T14:54:06.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.836+0000 7fb75d600700 1 --2- 172.21.15.81:0/3859366598 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fb74806ec00 0x7fb7480710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:06.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.836+0000 7fb75d600700 1 -- 172.21.15.81:0/3859366598 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fb74c08fc80 con 0x7fb7601002d0 2024-04-23T14:54:06.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.836+0000 7fb765600700 1 --2- 172.21.15.81:0/3859366598 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fb74806ec00 0x7fb7480710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:06.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.837+0000 7fb765600700 1 --2- 172.21.15.81:0/3859366598 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fb74806ec00 0x7fb7480710b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb754007fd0 tx=0x7fb754009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:06.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:06.841+0000 7fb75d600700 1 -- 172.21.15.81:0/3859366598 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fb74c05c610 con 0x7fb7601002d0 2024-04-23T14:54:07.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.096+0000 7fb768000700 1 -- 172.21.15.81:0/3859366598 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb7601045f0 con 0x7fb74806ec00 2024-04-23T14:54:07.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.100+0000 7fb75d600700 1 -- 172.21.15.81:0/3859366598 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+402 (secure 0 0 0) 0x7fb7601045f0 con 0x7fb74806ec00 2024-04-23T14:54:07.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.102+0000 7fb768000700 1 -- 172.21.15.81:0/3859366598 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fb74806ec00 msgr2=0x7fb7480710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:07.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.102+0000 7fb768000700 1 --2- 172.21.15.81:0/3859366598 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fb74806ec00 0x7fb7480710b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb754007fd0 tx=0x7fb754009040 comp rx=0 tx=0).stop 2024-04-23T14:54:07.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.103+0000 7fb768000700 1 -- 172.21.15.81:0/3859366598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7601002d0 msgr2=0x7fb7601100b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:07.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.103+0000 7fb768000700 1 --2- 172.21.15.81:0/3859366598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7601002d0 0x7fb7601100b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb74c00b3b0 tx=0x7fb74c009e30 comp rx=0 tx=0).stop 2024-04-23T14:54:07.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.103+0000 7fb768000700 1 -- 172.21.15.81:0/3859366598 shutdown_connections 2024-04-23T14:54:07.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.103+0000 7fb768000700 1 --2- 172.21.15.81:0/3859366598 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fb74806ec00 0x7fb7480710b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:07.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.103+0000 7fb768000700 1 --2- 172.21.15.81:0/3859366598 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7600ff020 0x7fb76010fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:07.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.103+0000 7fb768000700 1 --2- 172.21.15.81:0/3859366598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7601002d0 0x7fb7601100b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:07.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.103+0000 7fb768000700 1 -- 172.21.15.81:0/3859366598 >> 172.21.15.81:0/3859366598 conn(0x7fb7600fa950 msgr2=0x7fb7600fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:07.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.103+0000 7fb768000700 1 -- 172.21.15.81:0/3859366598 shutdown_connections 2024-04-23T14:54:07.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.103+0000 7fb768000700 1 -- 172.21.15.81:0/3859366598 wait complete. 2024-04-23T14:54:07.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.256+0000 7fab7a400700 1 -- 172.21.15.81:0/1186483634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab740fe040 msgr2=0x7fab740fe4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:07.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.256+0000 7fab7a400700 1 --2- 172.21.15.81:0/1186483634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab740fe040 0x7fab740fe4b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fab60004940 tx=0x7fab60009e30 comp rx=0 tx=0).stop 2024-04-23T14:54:07.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.256+0000 7fab7a400700 1 -- 172.21.15.81:0/1186483634 shutdown_connections 2024-04-23T14:54:07.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.256+0000 7fab7a400700 1 --2- 172.21.15.81:0/1186483634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab740fe040 0x7fab740fe4b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:07.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.256+0000 7fab7a400700 1 --2- 172.21.15.81:0/1186483634 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab740fce40 0x7fab740fd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:07.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.256+0000 7fab7a400700 1 -- 172.21.15.81:0/1186483634 >> 172.21.15.81:0/1186483634 conn(0x7fab740f8590 msgr2=0x7fab740fa9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:07.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.256+0000 7fab7a400700 1 -- 172.21.15.81:0/1186483634 shutdown_connections 2024-04-23T14:54:07.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.256+0000 7fab7a400700 1 -- 172.21.15.81:0/1186483634 wait complete. 2024-04-23T14:54:07.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.257+0000 7fab7a400700 1 Processor -- start 2024-04-23T14:54:07.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.257+0000 7fab7a400700 1 -- start start 2024-04-23T14:54:07.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.258+0000 7fab7a400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab740fce40 0x7fab7410fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:07.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.258+0000 7fab7a400700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab740fe040 0x7fab741100f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:07.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.258+0000 7fab7a400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab741106f0 con 0x7fab740fce40 2024-04-23T14:54:07.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.258+0000 7fab7a400700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab74110f40 con 0x7fab740fe040 2024-04-23T14:54:07.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.258+0000 7fab73400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab740fce40 0x7fab7410fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:07.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.258+0000 7fab73400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab740fce40 0x7fab7410fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46870/0 (socket says 172.21.15.81:46870) 2024-04-23T14:54:07.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.258+0000 7fab73400700 1 -- 172.21.15.81:0/1984341733 learned_addr learned my addr 172.21.15.81:0/1984341733 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:54:07.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.259+0000 7fab72a00700 1 --2- 172.21.15.81:0/1984341733 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab740fe040 0x7fab741100f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:07.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.259+0000 7fab73400700 1 -- 172.21.15.81:0/1984341733 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab740fe040 msgr2=0x7fab741100f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:07.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.259+0000 7fab73400700 1 --2- 172.21.15.81:0/1984341733 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab740fe040 0x7fab741100f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:07.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.259+0000 7fab73400700 1 -- 172.21.15.81:0/1984341733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab60005040 con 0x7fab740fce40 2024-04-23T14:54:07.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.259+0000 7fab73400700 1 --2- 172.21.15.81:0/1984341733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab740fce40 0x7fab7410fbb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fab6400eb70 tx=0x7fab6400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:07.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.259+0000 7fab6b400700 1 -- 172.21.15.81:0/1984341733 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab64007cc0 con 0x7fab740fce40 2024-04-23T14:54:07.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.260+0000 7fab6b400700 1 -- 172.21.15.81:0/1984341733 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fab6400f040 con 0x7fab740fce40 2024-04-23T14:54:07.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.260+0000 7fab6b400700 1 -- 172.21.15.81:0/1984341733 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab6400cbd0 con 0x7fab740fce40 2024-04-23T14:54:07.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.260+0000 7fab7a400700 1 -- 172.21.15.81:0/1984341733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab741111c0 con 0x7fab740fce40 2024-04-23T14:54:07.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.260+0000 7fab7a400700 1 -- 172.21.15.81:0/1984341733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab74111700 con 0x7fab740fce40 2024-04-23T14:54:07.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.261+0000 7fab7a400700 1 -- 172.21.15.81:0/1984341733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab741019d0 con 0x7fab740fce40 2024-04-23T14:54:07.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.263+0000 7fab6b400700 1 -- 172.21.15.81:0/1984341733 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fab6400cd30 con 0x7fab740fce40 2024-04-23T14:54:07.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.264+0000 7fab6b400700 1 --2- 172.21.15.81:0/1984341733 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fab5806ec10 0x7fab580710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:07.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.264+0000 7fab6b400700 1 -- 172.21.15.81:0/1984341733 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fab6408e320 con 0x7fab740fce40 2024-04-23T14:54:07.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.264+0000 7fab72a00700 1 --2- 172.21.15.81:0/1984341733 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fab5806ec10 0x7fab580710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:07.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.265+0000 7fab72a00700 1 --2- 172.21.15.81:0/1984341733 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fab5806ec10 0x7fab580710c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fab6000b0d0 tx=0x7fab60009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:07.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.269+0000 7fab6b400700 1 -- 172.21.15.81:0/1984341733 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fab6405ace0 con 0x7fab740fce40 2024-04-23T14:54:07.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.515+0000 7fab7a400700 1 -- 172.21.15.81:0/1984341733 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fab74105a10 con 0x7fab5806ec10 2024-04-23T14:54:07.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.527+0000 7fab6b400700 1 -- 172.21.15.81:0/1984341733 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fab74105a10 con 0x7fab5806ec10 2024-04-23T14:54:07.528 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-23T14:54:07.528 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (4m) 5s ago 15m 14.0M - 0.25.0 c8568f914cd2 63876b2abc27 2024-04-23T14:54:07.528 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (20s) 5s ago 15m 6665k - 19.0.0-3126-gd44fddd9 76e77f280c74 b486fe2ef19b 2024-04-23T14:54:07.528 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi156 smithi156 running (12s) 8s ago 14m 6656k - 19.0.0-3126-gd44fddd9 76e77f280c74 5d9aa5ecf264 2024-04-23T14:54:07.528 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (4m) 5s ago 14m 74.2M - 9.4.7 954c08fa6188 fbad3cef0883 2024-04-23T14:54:07.528 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.vcoywg smithi081 running (8m) 5s ago 8m 147M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 2ca7601ab60f 2024-04-23T14:54:07.528 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.wydgcg smithi081 running (8m) 5s ago 8m 107M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 58eb1a961b61 2024-04-23T14:54:07.528 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.rhbtxt smithi156 running (8m) 8s ago 8m 13.7M - 17.2.7-884-g70d0cb4b cafd8ddac8fa db3cb5034381 2024-04-23T14:54:07.528 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.vynkxn smithi156 running (7m) 8s ago 7m 13.9M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 1c8f2219e7fd 2024-04-23T14:54:07.528 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.ldghvq smithi081 *:8443,9283,8765 running (3m) 5s ago 16m 500M - 19.0.0-3126-gd44fddd9 76e77f280c74 6bf23484a1c9 2024-04-23T14:54:07.528 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi156.ounwyj smithi156 *:8443,9283,8765 running (2m) 8s ago 13m 450M - 19.0.0-3126-gd44fddd9 76e77f280c74 a6c0dd9f89f2 2024-04-23T14:54:07.528 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (2m) 5s ago 17m 40.4M 2048M 19.0.0-3126-gd44fddd9 76e77f280c74 fbf9f9a59ac2 2024-04-23T14:54:07.528 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi156 smithi156 running (78s) 8s ago 13m 32.2M 2048M 19.0.0-3126-gd44fddd9 76e77f280c74 36409886998f 2024-04-23T14:54:07.529 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (4m) 5s ago 15m 7596k - 1.5.0 0da6a335fe13 197b27809010 2024-04-23T14:54:07.529 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi156 smithi156 *:9100 running (3m) 8s ago 14m 8154k - 1.5.0 0da6a335fe13 91a7c5e86d47 2024-04-23T14:54:07.529 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (12m) 5s ago 12m 247M 1557M 17.2.7-884-g70d0cb4b cafd8ddac8fa 272ca032bec1 2024-04-23T14:54:07.529 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (12m) 5s ago 12m 255M 1557M 17.2.7-884-g70d0cb4b cafd8ddac8fa ee6d0c8af6ed 2024-04-23T14:54:07.529 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (11m) 5s ago 11m 217M 1557M 17.2.7-884-g70d0cb4b cafd8ddac8fa c26c640828a2 2024-04-23T14:54:07.529 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi156 running (11m) 8s ago 11m 286M 2581M 17.2.7-884-g70d0cb4b cafd8ddac8fa c1c261b1ee90 2024-04-23T14:54:07.529 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi156 running (10m) 8s ago 10m 256M 2581M 17.2.7-884-g70d0cb4b cafd8ddac8fa 83f996ee64de 2024-04-23T14:54:07.529 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi156 running (10m) 8s ago 10m 239M 2581M 17.2.7-884-g70d0cb4b cafd8ddac8fa b754244bef18 2024-04-23T14:54:07.529 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (2m) 5s ago 14m 53.7M - 2.43.0 a07b618ecd1d 35558adb166d 2024-04-23T14:54:07.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.530+0000 7fab7a400700 1 -- 172.21.15.81:0/1984341733 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fab5806ec10 msgr2=0x7fab580710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:07.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.530+0000 7fab7a400700 1 --2- 172.21.15.81:0/1984341733 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fab5806ec10 0x7fab580710c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fab6000b0d0 tx=0x7fab60009e30 comp rx=0 tx=0).stop 2024-04-23T14:54:07.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.530+0000 7fab7a400700 1 -- 172.21.15.81:0/1984341733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab740fce40 msgr2=0x7fab7410fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:07.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.530+0000 7fab7a400700 1 --2- 172.21.15.81:0/1984341733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab740fce40 0x7fab7410fbb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fab6400eb70 tx=0x7fab6400b040 comp rx=0 tx=0).stop 2024-04-23T14:54:07.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.530+0000 7fab7a400700 1 -- 172.21.15.81:0/1984341733 shutdown_connections 2024-04-23T14:54:07.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.530+0000 7fab7a400700 1 --2- 172.21.15.81:0/1984341733 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fab5806ec10 0x7fab580710c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:07.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.530+0000 7fab7a400700 1 --2- 172.21.15.81:0/1984341733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab740fce40 0x7fab7410fbb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:07.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.530+0000 7fab7a400700 1 --2- 172.21.15.81:0/1984341733 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab740fe040 0x7fab741100f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:07.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.530+0000 7fab7a400700 1 -- 172.21.15.81:0/1984341733 >> 172.21.15.81:0/1984341733 conn(0x7fab740f8590 msgr2=0x7fab740f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:07.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.531+0000 7fab7a400700 1 -- 172.21.15.81:0/1984341733 shutdown_connections 2024-04-23T14:54:07.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.531+0000 7fab7a400700 1 -- 172.21.15.81:0/1984341733 wait complete. 2024-04-23T14:54:07.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.678+0000 7f6165a00700 1 -- 172.21.15.81:0/365373821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61600709a0 msgr2=0x7f6160070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:07.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.678+0000 7f6165a00700 1 --2- 172.21.15.81:0/365373821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61600709a0 0x7f6160070e10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f614c004940 tx=0x7f614c009e30 comp rx=0 tx=0).stop 2024-04-23T14:54:07.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.678+0000 7f6165a00700 1 -- 172.21.15.81:0/365373821 shutdown_connections 2024-04-23T14:54:07.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.678+0000 7f6165a00700 1 --2- 172.21.15.81:0/365373821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61600709a0 0x7f6160070e10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:07.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.678+0000 7f6165a00700 1 --2- 172.21.15.81:0/365373821 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6160071f50 0x7f6160070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:07.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.678+0000 7f6165a00700 1 -- 172.21.15.81:0/365373821 >> 172.21.15.81:0/365373821 conn(0x7f61600f8530 msgr2=0x7f61600fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:07.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.678+0000 7f6165a00700 1 -- 172.21.15.81:0/365373821 shutdown_connections 2024-04-23T14:54:07.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.678+0000 7f6165a00700 1 -- 172.21.15.81:0/365373821 wait complete. 2024-04-23T14:54:07.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.679+0000 7f6165a00700 1 Processor -- start 2024-04-23T14:54:07.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.679+0000 7f6165a00700 1 -- start start 2024-04-23T14:54:07.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.680+0000 7f6165a00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61600709a0 0x7f616010fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:07.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.680+0000 7f6165a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6160071f50 0x7f6160110190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:07.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.680+0000 7f6165a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6160110820 con 0x7f6160071f50 2024-04-23T14:54:07.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.680+0000 7f6165a00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6160111010 con 0x7f61600709a0 2024-04-23T14:54:07.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.681+0000 7f615ea00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61600709a0 0x7f616010fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:07.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.681+0000 7f615ea00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61600709a0 0x7f616010fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.81:43708/0 (socket says 172.21.15.81:43708) 2024-04-23T14:54:07.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.681+0000 7f615ea00700 1 -- 172.21.15.81:0/487746694 learned_addr learned my addr 172.21.15.81:0/487746694 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:54:07.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.681+0000 7f615e000700 1 --2- 172.21.15.81:0/487746694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6160071f50 0x7f6160110190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:07.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.681+0000 7f615ea00700 1 -- 172.21.15.81:0/487746694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6160071f50 msgr2=0x7f6160110190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:07.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.682+0000 7f615ea00700 1 --2- 172.21.15.81:0/487746694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6160071f50 0x7f6160110190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:07.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.682+0000 7f615ea00700 1 -- 172.21.15.81:0/487746694 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614c005040 con 0x7f61600709a0 2024-04-23T14:54:07.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.682+0000 7f615ea00700 1 --2- 172.21.15.81:0/487746694 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61600709a0 0x7f616010fc50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f615000b790 tx=0x7f6150009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:07.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.683+0000 7f6156a00700 1 -- 172.21.15.81:0/487746694 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f615000f6f0 con 0x7f61600709a0 2024-04-23T14:54:07.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.683+0000 7f6165a00700 1 -- 172.21.15.81:0/487746694 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61601112f0 con 0x7f61600709a0 2024-04-23T14:54:07.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.683+0000 7f6165a00700 1 -- 172.21.15.81:0/487746694 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61601118b0 con 0x7f61600709a0 2024-04-23T14:54:07.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.683+0000 7f6156a00700 1 -- 172.21.15.81:0/487746694 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f615000fd20 con 0x7f61600709a0 2024-04-23T14:54:07.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.683+0000 7f6156a00700 1 -- 172.21.15.81:0/487746694 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61500103a0 con 0x7f61600709a0 2024-04-23T14:54:07.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.684+0000 7f6165a00700 1 -- 172.21.15.81:0/487746694 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61400052e0 con 0x7f61600709a0 2024-04-23T14:54:07.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.686+0000 7f6156a00700 1 -- 172.21.15.81:0/487746694 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f615000f850 con 0x7f61600709a0 2024-04-23T14:54:07.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.689+0000 7f6156a00700 1 --2- 172.21.15.81:0/487746694 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f614406ec10 0x7f61440710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:07.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.689+0000 7f6156a00700 1 -- 172.21.15.81:0/487746694 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f615008ea40 con 0x7f61600709a0 2024-04-23T14:54:07.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.689+0000 7f615e000700 1 --2- 172.21.15.81:0/487746694 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f614406ec10 0x7f61440710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:07.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.690+0000 7f615e000700 1 --2- 172.21.15.81:0/487746694 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f614406ec10 0x7f61440710c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f614c009fd0 tx=0x7f614c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:07.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:07.702+0000 7f6156a00700 1 -- 172.21.15.81:0/487746694 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f615005b3d0 con 0x7f61600709a0 2024-04-23T14:54:07.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:07 smithi081 ceph-mon[90469]: pgmap v53: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-23T14:54:07.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:07 smithi081 ceph-mon[90469]: from='client.34214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:54:07.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:07 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:07.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:07 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:08.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.028+0000 7f6165a00700 1 -- 172.21.15.81:0/487746694 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6140005860 con 0x7f61600709a0 2024-04-23T14:54:08.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.029+0000 7f6156a00700 1 -- 172.21.15.81:0/487746694 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7f6150057070 con 0x7f61600709a0 2024-04-23T14:54:08.030 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:54:08.030 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-04-23T14:54:08.030 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T14:54:08.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:54:08.030 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-04-23T14:54:08.030 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T14:54:08.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:54:08.030 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-04-23T14:54:08.030 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 6 2024-04-23T14:54:08.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:54:08.030 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-04-23T14:54:08.031 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 4 2024-04-23T14:54:08.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:54:08.031 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-04-23T14:54:08.031 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 10, 2024-04-23T14:54:08.031 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 4 2024-04-23T14:54:08.031 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-23T14:54:08.031 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:54:08.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.032+0000 7f6165a00700 1 -- 172.21.15.81:0/487746694 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f614406ec10 msgr2=0x7f61440710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:08.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.032+0000 7f6165a00700 1 --2- 172.21.15.81:0/487746694 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f614406ec10 0x7f61440710c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f614c009fd0 tx=0x7f614c009e30 comp rx=0 tx=0).stop 2024-04-23T14:54:08.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.032+0000 7f6165a00700 1 -- 172.21.15.81:0/487746694 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61600709a0 msgr2=0x7f616010fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:08.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.032+0000 7f6165a00700 1 --2- 172.21.15.81:0/487746694 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61600709a0 0x7f616010fc50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f615000b790 tx=0x7f6150009220 comp rx=0 tx=0).stop 2024-04-23T14:54:08.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.032+0000 7f6165a00700 1 -- 172.21.15.81:0/487746694 shutdown_connections 2024-04-23T14:54:08.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.032+0000 7f6165a00700 1 --2- 172.21.15.81:0/487746694 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f614406ec10 0x7f61440710c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:08.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.032+0000 7f6165a00700 1 --2- 172.21.15.81:0/487746694 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61600709a0 0x7f616010fc50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:08.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.032+0000 7f6165a00700 1 --2- 172.21.15.81:0/487746694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6160071f50 0x7f6160110190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:08.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.032+0000 7f6165a00700 1 -- 172.21.15.81:0/487746694 >> 172.21.15.81:0/487746694 conn(0x7f61600f8530 msgr2=0x7f6160102d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:08.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.032+0000 7f6165a00700 1 -- 172.21.15.81:0/487746694 shutdown_connections 2024-04-23T14:54:08.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.033+0000 7f6165a00700 1 -- 172.21.15.81:0/487746694 wait complete. 2024-04-23T14:54:08.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:07 smithi156 ceph-mon[77738]: pgmap v53: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-23T14:54:08.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:07 smithi156 ceph-mon[77738]: from='client.34214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:54:08.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:07 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:08.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:07 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:08.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.190+0000 7f309b200700 1 -- 172.21.15.81:0/1891293345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f309c0ffd40 msgr2=0x7f309c102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:08.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.190+0000 7f309b200700 1 --2- 172.21.15.81:0/1891293345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f309c0ffd40 0x7f309c102160 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3088004940 tx=0x7f3088009e30 comp rx=0 tx=0).stop 2024-04-23T14:54:08.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.190+0000 7f309b200700 1 -- 172.21.15.81:0/1891293345 shutdown_connections 2024-04-23T14:54:08.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.190+0000 7f309b200700 1 --2- 172.21.15.81:0/1891293345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f309c0ffd40 0x7f309c102160 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:08.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.190+0000 7f309b200700 1 --2- 172.21.15.81:0/1891293345 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f309c0662f0 0x7f309c0ff800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:08.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.190+0000 7f309b200700 1 -- 172.21.15.81:0/1891293345 >> 172.21.15.81:0/1891293345 conn(0x7f309c0f7270 msgr2=0x7f309c0f96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:08.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.191+0000 7f309b200700 1 -- 172.21.15.81:0/1891293345 shutdown_connections 2024-04-23T14:54:08.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.191+0000 7f309b200700 1 -- 172.21.15.81:0/1891293345 wait complete. 2024-04-23T14:54:08.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.191+0000 7f309b200700 1 Processor -- start 2024-04-23T14:54:08.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.192+0000 7f309b200700 1 -- start start 2024-04-23T14:54:08.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.192+0000 7f309b200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f309c0662f0 0x7f309c10fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:08.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.192+0000 7f309b200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f309c0ffd40 0x7f309c110000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:08.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.192+0000 7f309b200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309c110600 con 0x7f309c0ffd40 2024-04-23T14:54:08.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.192+0000 7f309b200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309c110e50 con 0x7f309c0662f0 2024-04-23T14:54:08.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.192+0000 7f3099400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f309c0ffd40 0x7f309c110000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:08.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.193+0000 7f3099400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f309c0ffd40 0x7f309c110000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46900/0 (socket says 172.21.15.81:46900) 2024-04-23T14:54:08.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.193+0000 7f3099400700 1 -- 172.21.15.81:0/1484407406 learned_addr learned my addr 172.21.15.81:0/1484407406 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:54:08.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.193+0000 7f3099e00700 1 --2- 172.21.15.81:0/1484407406 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f309c0662f0 0x7f309c10fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:08.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.193+0000 7f3099400700 1 -- 172.21.15.81:0/1484407406 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f309c0662f0 msgr2=0x7f309c10fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:08.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.193+0000 7f3099400700 1 --2- 172.21.15.81:0/1484407406 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f309c0662f0 0x7f309c10fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:08.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.193+0000 7f3099400700 1 -- 172.21.15.81:0/1484407406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3088005040 con 0x7f309c0ffd40 2024-04-23T14:54:08.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.193+0000 7f3099400700 1 --2- 172.21.15.81:0/1484407406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f309c0ffd40 0x7f309c110000 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f308800b3b0 tx=0x7f3088009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:08.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.194+0000 7f3092000700 1 -- 172.21.15.81:0/1484407406 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f308800e040 con 0x7f309c0ffd40 2024-04-23T14:54:08.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.194+0000 7f3092000700 1 -- 172.21.15.81:0/1484407406 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3088004290 con 0x7f309c0ffd40 2024-04-23T14:54:08.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.194+0000 7f309b200700 1 -- 172.21.15.81:0/1484407406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f309c1110d0 con 0x7f309c0ffd40 2024-04-23T14:54:08.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.194+0000 7f3092000700 1 -- 172.21.15.81:0/1484407406 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f308801c630 con 0x7f309c0ffd40 2024-04-23T14:54:08.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.194+0000 7f309b200700 1 -- 172.21.15.81:0/1484407406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f309c111610 con 0x7f309c0ffd40 2024-04-23T14:54:08.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.195+0000 7f309b200700 1 -- 172.21.15.81:0/1484407406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f309c05f5f0 con 0x7f309c0ffd40 2024-04-23T14:54:08.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.197+0000 7f3092000700 1 -- 172.21.15.81:0/1484407406 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f308800bbf0 con 0x7f309c0ffd40 2024-04-23T14:54:08.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.198+0000 7f3092000700 1 --2- 172.21.15.81:0/1484407406 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f308006ec10 0x7f30800710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:08.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.198+0000 7f3092000700 1 -- 172.21.15.81:0/1484407406 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f308808fc40 con 0x7f309c0ffd40 2024-04-23T14:54:08.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.198+0000 7f3099e00700 1 --2- 172.21.15.81:0/1484407406 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f308006ec10 0x7f30800710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:08.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.199+0000 7f3099e00700 1 --2- 172.21.15.81:0/1484407406 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f308006ec10 0x7f30800710c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f309c066030 tx=0x7f308c009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:08.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.203+0000 7f3092000700 1 -- 172.21.15.81:0/1484407406 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f308805c5d0 con 0x7f309c0ffd40 2024-04-23T14:54:08.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.504+0000 7f309b200700 1 -- 172.21.15.81:0/1484407406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f309c04bed0 con 0x7f309c0ffd40 2024-04-23T14:54:08.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.505+0000 7f3092000700 1 -- 172.21.15.81:0/1484407406 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1907 (secure 0 0 0) 0x7f308805c160 con 0x7f309c0ffd40 2024-04-23T14:54:08.505 INFO:teuthology.orchestra.run.smithi081.stdout:e18 2024-04-23T14:54:08.506 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-23T14:54:08.506 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:54:08.506 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-04-23T14:54:08.506 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:54:08.506 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-04-23T14:54:08.506 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-04-23T14:54:08.506 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 17 2024-04-23T14:54:08.506 INFO:teuthology.orchestra.run.smithi081.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-23T14:54:08.506 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-04-23T14:45:51.264703+0000 2024-04-23T14:54:08.507 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-04-23T14:46:12.782992+0000 2024-04-23T14:54:08.507 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-04-23T14:54:08.507 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-04-23T14:54:08.507 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-04-23T14:54:08.507 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-04-23T14:54:08.507 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-04-23T14:54:08.507 INFO:teuthology.orchestra.run.smithi081.stdout:max_xattr_size 65536 2024-04-23T14:54:08.507 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-04-23T14:54:08.507 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-04-23T14:54:08.507 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 47 2024-04-23T14:54:08.507 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:54:08.508 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 1 2024-04-23T14:54:08.508 INFO:teuthology.orchestra.run.smithi081.stdout:in 0 2024-04-23T14:54:08.508 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=14472} 2024-04-23T14:54:08.508 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-04-23T14:54:08.508 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-04-23T14:54:08.508 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-04-23T14:54:08.508 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-04-23T14:54:08.508 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-04-23T14:54:08.508 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-04-23T14:54:08.508 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-04-23T14:54:08.508 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-04-23T14:54:08.508 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-04-23T14:54:08.508 INFO:teuthology.orchestra.run.smithi081.stdout:qdb_cluster leader: 0 members: 2024-04-23T14:54:08.508 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.vcoywg{0:14472} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.81:6828/2563365650,v1:172.21.15.81:6829/2563365650] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:54:08.509 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.wydgcg{0:14482} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.81:6826/759909104,v1:172.21.15.81:6827/759909104] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:54:08.509 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:54:08.509 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:54:08.509 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-04-23T14:54:08.509 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:54:08.509 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.vynkxn{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.156:6826/1794690362,v1:172.21.15.156:6827/1794690362] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:54:08.509 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.rhbtxt{-1:24263} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.156:6824/3854041261,v1:172.21.15.156:6825/3854041261] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:54:08.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.508+0000 7f309b200700 1 -- 172.21.15.81:0/1484407406 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f308006ec10 msgr2=0x7f30800710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:08.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.508+0000 7f309b200700 1 --2- 172.21.15.81:0/1484407406 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f308006ec10 0x7f30800710c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f309c066030 tx=0x7f308c009ee0 comp rx=0 tx=0).stop 2024-04-23T14:54:08.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.508+0000 7f309b200700 1 -- 172.21.15.81:0/1484407406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f309c0ffd40 msgr2=0x7f309c110000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:08.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.508+0000 7f309b200700 1 --2- 172.21.15.81:0/1484407406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f309c0ffd40 0x7f309c110000 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f308800b3b0 tx=0x7f3088009e30 comp rx=0 tx=0).stop 2024-04-23T14:54:08.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.508+0000 7f309b200700 1 -- 172.21.15.81:0/1484407406 shutdown_connections 2024-04-23T14:54:08.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.508+0000 7f309b200700 1 --2- 172.21.15.81:0/1484407406 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f308006ec10 0x7f30800710c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:08.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.508+0000 7f309b200700 1 --2- 172.21.15.81:0/1484407406 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f309c0662f0 0x7f309c10fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:08.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.508+0000 7f309b200700 1 --2- 172.21.15.81:0/1484407406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f309c0ffd40 0x7f309c110000 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:08.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.508+0000 7f309b200700 1 -- 172.21.15.81:0/1484407406 >> 172.21.15.81:0/1484407406 conn(0x7f309c0f7270 msgr2=0x7f309c0fb900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:08.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.509+0000 7f309b200700 1 -- 172.21.15.81:0/1484407406 shutdown_connections 2024-04-23T14:54:08.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.509+0000 7f309b200700 1 -- 172.21.15.81:0/1484407406 wait complete. 2024-04-23T14:54:08.511 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 18 2024-04-23T14:54:08.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.656+0000 7ff315000700 1 -- 172.21.15.81:0/1272340673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3100fdee0 msgr2=0x7ff3100fe350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:08.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.656+0000 7ff315000700 1 --2- 172.21.15.81:0/1272340673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3100fdee0 0x7ff3100fe350 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc004940 tx=0x7ff2fc009e30 comp rx=0 tx=0).stop 2024-04-23T14:54:08.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.656+0000 7ff315000700 1 -- 172.21.15.81:0/1272340673 shutdown_connections 2024-04-23T14:54:08.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.656+0000 7ff315000700 1 --2- 172.21.15.81:0/1272340673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3100fdee0 0x7ff3100fe350 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:08.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.656+0000 7ff315000700 1 --2- 172.21.15.81:0/1272340673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff3100fcc30 0x7ff3100fd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:08.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.656+0000 7ff315000700 1 -- 172.21.15.81:0/1272340673 >> 172.21.15.81:0/1272340673 conn(0x7ff3100f83d0 msgr2=0x7ff3100fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:08.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.656+0000 7ff315000700 1 -- 172.21.15.81:0/1272340673 shutdown_connections 2024-04-23T14:54:08.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.656+0000 7ff315000700 1 -- 172.21.15.81:0/1272340673 wait complete. 2024-04-23T14:54:08.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.657+0000 7ff315000700 1 Processor -- start 2024-04-23T14:54:08.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.657+0000 7ff315000700 1 -- start start 2024-04-23T14:54:08.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.658+0000 7ff315000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3100fcc30 0x7ff310113f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:08.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.658+0000 7ff315000700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff3100fdee0 0x7ff310114440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:08.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.658+0000 7ff315000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff310114a40 con 0x7ff3100fcc30 2024-04-23T14:54:08.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.658+0000 7ff315000700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff310115190 con 0x7ff3100fdee0 2024-04-23T14:54:08.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.658+0000 7ff30f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3100fcc30 0x7ff310113f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:08.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.658+0000 7ff30f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3100fcc30 0x7ff310113f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46914/0 (socket says 172.21.15.81:46914) 2024-04-23T14:54:08.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.658+0000 7ff30f400700 1 -- 172.21.15.81:0/1878561059 learned_addr learned my addr 172.21.15.81:0/1878561059 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:54:08.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.659+0000 7ff30f400700 1 -- 172.21.15.81:0/1878561059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff3100fdee0 msgr2=0x7ff310114440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:08.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.659+0000 7ff30f400700 1 --2- 172.21.15.81:0/1878561059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff3100fdee0 0x7ff310114440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:08.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.659+0000 7ff30f400700 1 -- 172.21.15.81:0/1878561059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2fc005040 con 0x7ff3100fcc30 2024-04-23T14:54:08.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.659+0000 7ff30f400700 1 --2- 172.21.15.81:0/1878561059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3100fcc30 0x7ff310113f00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff30000c8c0 tx=0x7ff3000044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:08.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.659+0000 7ff307400700 1 -- 172.21.15.81:0/1878561059 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff30000a980 con 0x7ff3100fcc30 2024-04-23T14:54:08.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.660+0000 7ff307400700 1 -- 172.21.15.81:0/1878561059 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff30000ce60 con 0x7ff3100fcc30 2024-04-23T14:54:08.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.660+0000 7ff307400700 1 -- 172.21.15.81:0/1878561059 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3000115e0 con 0x7ff3100fcc30 2024-04-23T14:54:08.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.660+0000 7ff315000700 1 -- 172.21.15.81:0/1878561059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff310115470 con 0x7ff3100fcc30 2024-04-23T14:54:08.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.660+0000 7ff315000700 1 -- 172.21.15.81:0/1878561059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff310115a30 con 0x7ff3100fcc30 2024-04-23T14:54:08.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.661+0000 7ff315000700 1 -- 172.21.15.81:0/1878561059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff310101870 con 0x7ff3100fcc30 2024-04-23T14:54:08.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.662+0000 7ff307400700 1 -- 172.21.15.81:0/1878561059 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7ff30000aae0 con 0x7ff3100fcc30 2024-04-23T14:54:08.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.663+0000 7ff307400700 1 --2- 172.21.15.81:0/1878561059 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7ff2f406ec10 0x7ff2f40710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:08.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.664+0000 7ff307400700 1 -- 172.21.15.81:0/1878561059 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7ff30008e830 con 0x7ff3100fcc30 2024-04-23T14:54:08.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.664+0000 7ff30ea00700 1 --2- 172.21.15.81:0/1878561059 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7ff2f406ec10 0x7ff2f40710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:08.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.664+0000 7ff30ea00700 1 --2- 172.21.15.81:0/1878561059 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7ff2f406ec10 0x7ff2f40710c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc004f90 tx=0x7ff2fc009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:08.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.668+0000 7ff307400700 1 -- 172.21.15.81:0/1878561059 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7ff30005b280 con 0x7ff3100fcc30 2024-04-23T14:54:08.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:08 smithi081 ceph-mon[90469]: from='client.34218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:54:08.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:08 smithi081 ceph-mon[90469]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:54:08.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:08 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/487746694' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:54:08.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:08 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/1484407406' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:54:08.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.903+0000 7ff315000700 1 -- 172.21.15.81:0/1878561059 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff310115d60 con 0x7ff2f406ec10 2024-04-23T14:54:08.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.905+0000 7ff307400700 1 -- 172.21.15.81:0/1878561059 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+402 (secure 0 0 0) 0x7ff310115d60 con 0x7ff2f406ec10 2024-04-23T14:54:08.905 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:54:08.905 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd", 2024-04-23T14:54:08.905 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-04-23T14:54:08.905 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-23T14:54:08.906 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [ 2024-04-23T14:54:08.906 INFO:teuthology.orchestra.run.smithi081.stdout: "mon", 2024-04-23T14:54:08.906 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-04-23T14:54:08.906 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr" 2024-04-23T14:54:08.906 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-04-23T14:54:08.906 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "6/21 daemons upgraded", 2024-04-23T14:54:08.906 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "Currently upgrading crash daemons", 2024-04-23T14:54:08.906 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-04-23T14:54:08.906 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:54:08.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.908+0000 7ff315000700 1 -- 172.21.15.81:0/1878561059 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7ff2f406ec10 msgr2=0x7ff2f40710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:08.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.908+0000 7ff315000700 1 --2- 172.21.15.81:0/1878561059 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7ff2f406ec10 0x7ff2f40710c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc004f90 tx=0x7ff2fc009e30 comp rx=0 tx=0).stop 2024-04-23T14:54:08.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.908+0000 7ff315000700 1 -- 172.21.15.81:0/1878561059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3100fcc30 msgr2=0x7ff310113f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:08.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.908+0000 7ff315000700 1 --2- 172.21.15.81:0/1878561059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3100fcc30 0x7ff310113f00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff30000c8c0 tx=0x7ff3000044c0 comp rx=0 tx=0).stop 2024-04-23T14:54:08.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.908+0000 7ff315000700 1 -- 172.21.15.81:0/1878561059 shutdown_connections 2024-04-23T14:54:08.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.908+0000 7ff315000700 1 --2- 172.21.15.81:0/1878561059 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7ff2f406ec10 0x7ff2f40710c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:08.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.908+0000 7ff315000700 1 --2- 172.21.15.81:0/1878561059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3100fcc30 0x7ff310113f00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:08.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.908+0000 7ff315000700 1 --2- 172.21.15.81:0/1878561059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff3100fdee0 0x7ff310114440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:08.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.908+0000 7ff315000700 1 -- 172.21.15.81:0/1878561059 >> 172.21.15.81:0/1878561059 conn(0x7ff3100f83d0 msgr2=0x7ff3100f9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:08.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.908+0000 7ff315000700 1 -- 172.21.15.81:0/1878561059 shutdown_connections 2024-04-23T14:54:08.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:08.908+0000 7ff315000700 1 -- 172.21.15.81:0/1878561059 wait complete. 2024-04-23T14:54:09.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:08 smithi156 ceph-mon[77738]: from='client.34218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:54:09.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:08 smithi156 ceph-mon[77738]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:54:09.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:08 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/487746694' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:54:09.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:08 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/1484407406' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:54:09.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.057+0000 7f453d600700 1 -- 172.21.15.81:0/3055720484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45381046b0 msgr2=0x7f4538104b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:09.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.057+0000 7f453d600700 1 --2- 172.21.15.81:0/3055720484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45381046b0 0x7f4538104b20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4524004940 tx=0x7f4524009e30 comp rx=0 tx=0).stop 2024-04-23T14:54:09.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.057+0000 7f453d600700 1 -- 172.21.15.81:0/3055720484 shutdown_connections 2024-04-23T14:54:09.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.057+0000 7f453d600700 1 --2- 172.21.15.81:0/3055720484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45381046b0 0x7f4538104b20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:09.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.057+0000 7f453d600700 1 --2- 172.21.15.81:0/3055720484 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4538103400 0x7f4538103810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:09.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.057+0000 7f453d600700 1 -- 172.21.15.81:0/3055720484 >> 172.21.15.81:0/3055720484 conn(0x7f45380725e0 msgr2=0x7f4538074a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:09.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.057+0000 7f453d600700 1 -- 172.21.15.81:0/3055720484 shutdown_connections 2024-04-23T14:54:09.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.057+0000 7f453d600700 1 -- 172.21.15.81:0/3055720484 wait complete. 2024-04-23T14:54:09.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.058+0000 7f453d600700 1 Processor -- start 2024-04-23T14:54:09.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.058+0000 7f453d600700 1 -- start start 2024-04-23T14:54:09.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.059+0000 7f453d600700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4538103400 0x7f4538113f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:09.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.059+0000 7f453d600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45381046b0 0x7f4538114450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:09.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.059+0000 7f453d600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4538114a50 con 0x7f45381046b0 2024-04-23T14:54:09.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.059+0000 7f453d600700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4538114bc0 con 0x7f4538103400 2024-04-23T14:54:09.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.059+0000 7f4536000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45381046b0 0x7f4538114450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:09.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.059+0000 7f4536000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45381046b0 0x7f4538114450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46926/0 (socket says 172.21.15.81:46926) 2024-04-23T14:54:09.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.059+0000 7f4536000700 1 -- 172.21.15.81:0/2233771359 learned_addr learned my addr 172.21.15.81:0/2233771359 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:54:09.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.059+0000 7f4536a00700 1 --2- 172.21.15.81:0/2233771359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4538103400 0x7f4538113f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:09.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.060+0000 7f4536000700 1 -- 172.21.15.81:0/2233771359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4538103400 msgr2=0x7f4538113f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:09.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.060+0000 7f4536000700 1 --2- 172.21.15.81:0/2233771359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4538103400 0x7f4538113f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:09.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.060+0000 7f4536000700 1 -- 172.21.15.81:0/2233771359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4524005040 con 0x7f45381046b0 2024-04-23T14:54:09.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.060+0000 7f4536000700 1 --2- 172.21.15.81:0/2233771359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45381046b0 0x7f4538114450 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4524009150 tx=0x7f4524009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:09.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.060+0000 7f452ea00700 1 -- 172.21.15.81:0/2233771359 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f452400e040 con 0x7f45381046b0 2024-04-23T14:54:09.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.060+0000 7f452ea00700 1 -- 172.21.15.81:0/2233771359 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f452400bbf0 con 0x7f45381046b0 2024-04-23T14:54:09.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.060+0000 7f453d600700 1 -- 172.21.15.81:0/2233771359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45381195c0 con 0x7f45381046b0 2024-04-23T14:54:09.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.060+0000 7f452ea00700 1 -- 172.21.15.81:0/2233771359 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f452401c630 con 0x7f45381046b0 2024-04-23T14:54:09.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.061+0000 7f453d600700 1 -- 172.21.15.81:0/2233771359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4538119b80 con 0x7f45381046b0 2024-04-23T14:54:09.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.062+0000 7f453d600700 1 -- 172.21.15.81:0/2233771359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f453804c710 con 0x7f45381046b0 2024-04-23T14:54:09.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.063+0000 7f452ea00700 1 -- 172.21.15.81:0/2233771359 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f452400bd60 con 0x7f45381046b0 2024-04-23T14:54:09.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.064+0000 7f452ea00700 1 --2- 172.21.15.81:0/2233771359 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f451c06ec00 0x7f451c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:09.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.064+0000 7f452ea00700 1 -- 172.21.15.81:0/2233771359 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f452408fb60 con 0x7f45381046b0 2024-04-23T14:54:09.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.064+0000 7f4536a00700 1 --2- 172.21.15.81:0/2233771359 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f451c06ec00 0x7f451c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:09.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.065+0000 7f4536a00700 1 --2- 172.21.15.81:0/2233771359 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f451c06ec00 0x7f451c0710b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4528004990 tx=0x7f4528009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:09.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.069+0000 7f452ea00700 1 -- 172.21.15.81:0/2233771359 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f452405c5b0 con 0x7f45381046b0 2024-04-23T14:54:09.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.388+0000 7f453d600700 1 -- 172.21.15.81:0/2233771359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f4538119fd0 con 0x7f45381046b0 2024-04-23T14:54:09.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.389+0000 7f452ea00700 1 -- 172.21.15.81:0/2233771359 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f452405c140 con 0x7f45381046b0 2024-04-23T14:54:09.390 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-04-23T14:54:09.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.392+0000 7f453d600700 1 -- 172.21.15.81:0/2233771359 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f451c06ec00 msgr2=0x7f451c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:09.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.392+0000 7f453d600700 1 --2- 172.21.15.81:0/2233771359 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f451c06ec00 0x7f451c0710b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4528004990 tx=0x7f4528009ee0 comp rx=0 tx=0).stop 2024-04-23T14:54:09.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.392+0000 7f453d600700 1 -- 172.21.15.81:0/2233771359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45381046b0 msgr2=0x7f4538114450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:09.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.392+0000 7f453d600700 1 --2- 172.21.15.81:0/2233771359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45381046b0 0x7f4538114450 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4524009150 tx=0x7f4524009e30 comp rx=0 tx=0).stop 2024-04-23T14:54:09.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.392+0000 7f453d600700 1 -- 172.21.15.81:0/2233771359 shutdown_connections 2024-04-23T14:54:09.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.392+0000 7f453d600700 1 --2- 172.21.15.81:0/2233771359 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f451c06ec00 0x7f451c0710b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:09.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.392+0000 7f453d600700 1 --2- 172.21.15.81:0/2233771359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4538103400 0x7f4538113f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:09.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.392+0000 7f453d600700 1 --2- 172.21.15.81:0/2233771359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45381046b0 0x7f4538114450 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:09.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.392+0000 7f453d600700 1 -- 172.21.15.81:0/2233771359 >> 172.21.15.81:0/2233771359 conn(0x7f45380725e0 msgr2=0x7f4538073c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:09.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.392+0000 7f453d600700 1 -- 172.21.15.81:0/2233771359 shutdown_connections 2024-04-23T14:54:09.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:09.393+0000 7f453d600700 1 -- 172.21.15.81:0/2233771359 wait complete. 2024-04-23T14:54:09.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:09 smithi081 ceph-mon[90469]: pgmap v54: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-23T14:54:09.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:09 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/2233771359' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:54:10.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:09 smithi156 ceph-mon[77738]: pgmap v54: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-23T14:54:10.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:09 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/2233771359' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:54:10.910 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:10 smithi081 ceph-mon[90469]: from='client.34234 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:54:10.910 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:10 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:10.910 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:10 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:10.910 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:10 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:54:10.910 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:10 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:54:10.910 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:10 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:10.910 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:10 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:54:10.910 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:10 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:54:10.910 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:10 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:54:10.910 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:10 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:54:10.910 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:10 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:10.911 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:10 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi081"}]: dispatch 2024-04-23T14:54:10.911 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:10 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi081"}]': finished 2024-04-23T14:54:10.911 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:10 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi156"}]: dispatch 2024-04-23T14:54:10.911 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:10 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi156"}]': finished 2024-04-23T14:54:10.911 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:10 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-23T14:54:11.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:10 smithi156 ceph-mon[77738]: from='client.34234 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:54:11.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:10 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:11.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:10 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:11.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:10 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:54:11.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:10 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:54:11.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:10 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:11.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:10 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:54:11.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:10 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:54:11.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:10 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:54:11.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:10 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:54:11.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:10 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:11.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:10 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi081"}]: dispatch 2024-04-23T14:54:11.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:10 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi081"}]': finished 2024-04-23T14:54:11.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:10 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi156"}]: dispatch 2024-04-23T14:54:11.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:10 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi156"}]': finished 2024-04-23T14:54:11.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:10 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-23T14:54:12.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:11 smithi156 ceph-mon[77738]: Upgrade: Setting container_image for all crash 2024-04-23T14:54:12.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:11 smithi156 ceph-mon[77738]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-23T14:54:12.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:11 smithi156 ceph-mon[77738]: Upgrade: osd.0 is safe to restart 2024-04-23T14:54:12.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:11 smithi156 ceph-mon[77738]: pgmap v55: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:54:12.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:11 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:54:12.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:11 smithi081 ceph-mon[90469]: Upgrade: Setting container_image for all crash 2024-04-23T14:54:12.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:11 smithi081 ceph-mon[90469]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-23T14:54:12.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:11 smithi081 ceph-mon[90469]: Upgrade: osd.0 is safe to restart 2024-04-23T14:54:12.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:11 smithi081 ceph-mon[90469]: pgmap v55: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:54:12.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:11 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:54:13.438 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:13 smithi081 ceph-mon[90469]: Upgrade: Updating osd.0 2024-04-23T14:54:13.439 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:13 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:13.439 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:13 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-23T14:54:13.439 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:13 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:54:13.439 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:13 smithi081 ceph-mon[90469]: Deploying daemon osd.0 on smithi081 2024-04-23T14:54:13.439 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:13 smithi081 ceph-mon[90469]: pgmap v56: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:54:13.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:13 smithi156 ceph-mon[77738]: Upgrade: Updating osd.0 2024-04-23T14:54:13.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:13 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:13.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:13 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-23T14:54:13.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:13 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:54:13.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:13 smithi156 ceph-mon[77738]: Deploying daemon osd.0 on smithi081 2024-04-23T14:54:13.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:13 smithi156 ceph-mon[77738]: pgmap v56: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:54:15.753 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:15 smithi081 ceph-mon[90469]: pgmap v57: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:54:16.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:15 smithi156 ceph-mon[77738]: pgmap v57: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:54:17.327 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:16 smithi081 systemd[1]: Stopping Ceph osd.0 for 7a641bea-017e-11ef-bc93-c7b262605968... 2024-04-23T14:54:17.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:17 smithi081 ceph-mon[90469]: pgmap v58: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:54:17.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:17 smithi081 ceph-mon[90469]: osd.0 marked itself down and dead 2024-04-23T14:54:17.827 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:17 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0[43985]: 2024-04-23T14:54:17.368+0000 7f8bcb200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T14:54:17.827 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:17 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0[43985]: 2024-04-23T14:54:17.368+0000 7f8bcb200700 -1 osd.0 50 *** Got signal Terminated *** 2024-04-23T14:54:17.827 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:17 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0[43985]: 2024-04-23T14:54:17.368+0000 7f8bcb200700 -1 osd.0 50 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-23T14:54:18.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:17 smithi156 ceph-mon[77738]: pgmap v58: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:54:18.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:17 smithi156 ceph-mon[77738]: osd.0 marked itself down and dead 2024-04-23T14:54:18.564 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:18 smithi081 podman[98976]: 2024-04-23 14:54:18.283707705 +0000 UTC m=+1.037559360 container died 272ca032bec1f3ea23d471118834142dd74f578e493d72bd9a7ca0648e1f4f36 (image=quay.ceph.io/ceph-ci/ceph@sha256:3890cd726bd5e73ae623dabdf4ed76dd5df81c936b8bd8d761026babda969466, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=quincy-70d0cb4, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True) 2024-04-23T14:54:18.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:18 smithi081 ceph-mon[90469]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-23T14:54:18.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:18 smithi081 ceph-mon[90469]: osdmap e51: 6 total, 5 up, 6 in 2024-04-23T14:54:18.826 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:18 smithi081 podman[98976]: 2024-04-23 14:54:18.745036029 +0000 UTC m=+1.498887657 container cleanup 272ca032bec1f3ea23d471118834142dd74f578e493d72bd9a7ca0648e1f4f36 (image=quay.ceph.io/ceph-ci/ceph@sha256:3890cd726bd5e73ae623dabdf4ed76dd5df81c936b8bd8d761026babda969466, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0, org.label-schema.schema-version=1.0, RELEASE=quincy-70d0cb4, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T14:54:18.826 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:18 smithi081 bash[98976]: ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0 2024-04-23T14:54:19.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:18 smithi156 ceph-mon[77738]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-23T14:54:19.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:18 smithi156 ceph-mon[77738]: osdmap e51: 6 total, 5 up, 6 in 2024-04-23T14:54:19.326 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:18 smithi081 podman[98994]: 2024-04-23 14:54:18.979693427 +0000 UTC m=+0.680712526 container remove 272ca032bec1f3ea23d471118834142dd74f578e493d72bd9a7ca0648e1f4f36 (image=quay.ceph.io/ceph-ci/ceph@sha256:3890cd726bd5e73ae623dabdf4ed76dd5df81c936b8bd8d761026babda969466, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=quincy-70d0cb4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS) 2024-04-23T14:54:19.930 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:19 smithi081 ceph-mon[90469]: pgmap v60: 65 pgs: 9 stale+active+clean, 56 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-23T14:54:19.930 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:19 smithi081 ceph-mon[90469]: osdmap e52: 6 total, 5 up, 6 in 2024-04-23T14:54:19.930 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:19 smithi081 podman[99080]: 2024-04-23 14:54:19.657547191 +0000 UTC m=+0.031635820 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T14:54:19.930 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:19 smithi081 podman[99080]: 2024-04-23 14:54:19.772550842 +0000 UTC m=+0.146639502 container create e85f0274f061d56949609a6786ef0908f9db05f59bd1be2a98eae2ee5fc1654d (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2) 2024-04-23T14:54:20.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:19 smithi156 ceph-mon[77738]: pgmap v60: 65 pgs: 9 stale+active+clean, 56 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-23T14:54:20.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:19 smithi156 ceph-mon[77738]: osdmap e52: 6 total, 5 up, 6 in 2024-04-23T14:54:20.326 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:20 smithi081 podman[99080]: 2024-04-23 14:54:20.060160621 +0000 UTC m=+0.434249291 container init e85f0274f061d56949609a6786ef0908f9db05f59bd1be2a98eae2ee5fc1654d (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-04-23T14:54:20.327 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:20 smithi081 podman[99080]: 2024-04-23 14:54:20.07334344 +0000 UTC m=+0.447432082 container start e85f0274f061d56949609a6786ef0908f9db05f59bd1be2a98eae2ee5fc1654d (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2) 2024-04-23T14:54:20.327 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:20 smithi081 podman[99080]: 2024-04-23 14:54:20.149975723 +0000 UTC m=+0.524064427 container attach e85f0274f061d56949609a6786ef0908f9db05f59bd1be2a98eae2ee5fc1654d (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-04-23T14:54:20.827 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:20 smithi081 podman[99080]: 2024-04-23 14:54:20.529068897 +0000 UTC m=+0.903157551 container died e85f0274f061d56949609a6786ef0908f9db05f59bd1be2a98eae2ee5fc1654d (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0-deactivate, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd) 2024-04-23T14:54:21.577 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:21 smithi081 podman[99106]: 2024-04-23 14:54:21.186781067 +0000 UTC m=+0.641712030 container remove e85f0274f061d56949609a6786ef0908f9db05f59bd1be2a98eae2ee5fc1654d (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0-deactivate, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-04-23T14:54:21.577 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:21 smithi081 systemd[1]: ceph-7a641bea-017e-11ef-bc93-c7b262605968@osd.0.service: Deactivated successfully. 2024-04-23T14:54:21.577 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:21 smithi081 systemd[1]: Stopped Ceph osd.0 for 7a641bea-017e-11ef-bc93-c7b262605968. 2024-04-23T14:54:21.577 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:21 smithi081 systemd[1]: ceph-7a641bea-017e-11ef-bc93-c7b262605968@osd.0.service: Consumed 1min 37.655s CPU time. 2024-04-23T14:54:21.984 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:21 smithi081 ceph-mon[90469]: pgmap v62: 65 pgs: 9 stale+active+clean, 56 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:54:21.984 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:21 smithi081 systemd[1]: Starting Ceph osd.0 for 7a641bea-017e-11ef-bc93-c7b262605968... 2024-04-23T14:54:22.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:21 smithi156 ceph-mon[77738]: pgmap v62: 65 pgs: 9 stale+active+clean, 56 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:54:22.285 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:21 smithi081 podman[99205]: 2024-04-23 14:54:21.889533639 +0000 UTC m=+0.034220344 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T14:54:22.285 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:22 smithi081 podman[99205]: 2024-04-23 14:54:22.021703988 +0000 UTC m=+0.166390728 container create f94ab1de15aacc9b85f224a56efb1cba6cf533b51c90f8759cdbd712c4e7533a (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0-activate, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-04-23T14:54:22.285 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:22 smithi081 podman[99205]: 2024-04-23 14:54:22.283967888 +0000 UTC m=+0.428654638 container init f94ab1de15aacc9b85f224a56efb1cba6cf533b51c90f8759cdbd712c4e7533a (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0-activate, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd) 2024-04-23T14:54:22.576 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:22 smithi081 podman[99205]: 2024-04-23 14:54:22.296301124 +0000 UTC m=+0.440987868 container start f94ab1de15aacc9b85f224a56efb1cba6cf533b51c90f8759cdbd712c4e7533a (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0-activate, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-04-23T14:54:22.577 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:22 smithi081 podman[99205]: 2024-04-23 14:54:22.374401973 +0000 UTC m=+0.519088750 container attach f94ab1de15aacc9b85f224a56efb1cba6cf533b51c90f8759cdbd712c4e7533a (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0-activate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416) 2024-04-23T14:54:23.511 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:23 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0-activate[99220]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-23T14:54:23.511 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:23 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0-activate[99220]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-23T14:54:23.511 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:23 smithi081 bash[99205]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-23T14:54:23.511 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:23 smithi081 bash[99205]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-23T14:54:23.511 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:23 smithi081 bash[99205]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-23T14:54:23.511 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:23 smithi081 bash[99205]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-23T14:54:23.511 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:23 smithi081 bash[99205]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-23T14:54:23.511 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:23 smithi081 bash[99205]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-23T14:54:23.511 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:23 smithi081 bash[99205]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-04-23T14:54:23.511 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:23 smithi081 bash[99205]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-23T14:54:23.511 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:23 smithi081 bash[99205]: --> ceph-volume raw activate successful for osd ID: 0 2024-04-23T14:54:23.512 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:23 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0-activate[99220]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-23T14:54:23.512 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:23 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0-activate[99220]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-23T14:54:23.512 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:23 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0-activate[99220]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-23T14:54:23.512 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:23 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0-activate[99220]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-23T14:54:23.512 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:23 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0-activate[99220]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-04-23T14:54:23.512 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:23 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0-activate[99220]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-23T14:54:23.512 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:23 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0-activate[99220]: --> ceph-volume raw activate successful for osd ID: 0 2024-04-23T14:54:23.512 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:23 smithi081 podman[99205]: 2024-04-23 14:54:23.297930069 +0000 UTC m=+1.442616849 container died f94ab1de15aacc9b85f224a56efb1cba6cf533b51c90f8759cdbd712c4e7533a (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0-activate, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-04-23T14:54:23.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:23 smithi081 ceph-mon[90469]: pgmap v63: 65 pgs: 9 stale+active+clean, 56 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-04-23T14:54:24.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:23 smithi156 ceph-mon[77738]: pgmap v63: 65 pgs: 9 stale+active+clean, 56 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-04-23T14:54:24.445 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:24 smithi081 podman[99354]: 2024-04-23 14:54:24.103605689 +0000 UTC m=+0.783096667 container remove f94ab1de15aacc9b85f224a56efb1cba6cf533b51c90f8759cdbd712c4e7533a (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0-activate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-04-23T14:54:24.769 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:24 smithi081 ceph-mon[90469]: Health check failed: Degraded data redundancy: 44/222 objects degraded (19.820%), 17 pgs degraded (PG_DEGRADED) 2024-04-23T14:54:24.770 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:24 smithi081 podman[99415]: 2024-04-23 14:54:24.350763844 +0000 UTC m=+0.033992549 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T14:54:24.770 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:24 smithi081 podman[99415]: 2024-04-23 14:54:24.462807091 +0000 UTC m=+0.146035828 container create 24bc24b37de5a0bf1ee9d1f48ca12f7e252c1859cd58426d85d5f24d200a24b6 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0) 2024-04-23T14:54:25.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:24 smithi156 ceph-mon[77738]: Health check failed: Degraded data redundancy: 44/222 objects degraded (19.820%), 17 pgs degraded (PG_DEGRADED) 2024-04-23T14:54:25.076 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:24 smithi081 podman[99415]: 2024-04-23 14:54:24.769418206 +0000 UTC m=+0.452646936 container init 24bc24b37de5a0bf1ee9d1f48ca12f7e252c1859cd58426d85d5f24d200a24b6 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-04-23T14:54:25.076 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:24 smithi081 podman[99415]: 2024-04-23 14:54:24.783141385 +0000 UTC m=+0.466370124 container start 24bc24b37de5a0bf1ee9d1f48ca12f7e252c1859cd58426d85d5f24d200a24b6 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T14:54:25.076 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:24 smithi081 ceph-osd[99434]: -- 172.21.15.81:0/2664012990 <== mon.0 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ebbb651680 con 0x55ebbb61ac00 2024-04-23T14:54:25.076 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:24 smithi081 bash[99415]: 24bc24b37de5a0bf1ee9d1f48ca12f7e252c1859cd58426d85d5f24d200a24b6 2024-04-23T14:54:25.077 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:24 smithi081 systemd[1]: Started Ceph osd.0 for 7a641bea-017e-11ef-bc93-c7b262605968. 2024-04-23T14:54:25.651 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:25 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0[99430]: 2024-04-23T14:54:25.369+0000 7fe19cef87c0 -1 Falling back to public interface 2024-04-23T14:54:26.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:25 smithi156 ceph-mon[77738]: pgmap v64: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 44/222 objects degraded (19.820%) 2024-04-23T14:54:26.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:25 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:26.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:25 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:26.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:25 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:54:26.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:25 smithi081 ceph-mon[90469]: pgmap v64: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 44/222 objects degraded (19.820%) 2024-04-23T14:54:26.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:25 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:26.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:25 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:26.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:25 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:54:27.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:27 smithi081 ceph-mon[90469]: pgmap v65: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 573 B/s rd, 1 op/s; 44/222 objects degraded (19.820%) 2024-04-23T14:54:27.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:27 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:27.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:27 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:54:28.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:27 smithi156 ceph-mon[77738]: pgmap v65: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 573 B/s rd, 1 op/s; 44/222 objects degraded (19.820%) 2024-04-23T14:54:28.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:27 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:28.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:27 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:54:29.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:29 smithi081 ceph-mon[90469]: pgmap v66: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 44/222 objects degraded (19.820%) 2024-04-23T14:54:29.839 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:29 smithi156 ceph-mon[77738]: pgmap v66: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 44/222 objects degraded (19.820%) 2024-04-23T14:54:31.577 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:31 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0[99430]: 2024-04-23T14:54:31.168+0000 7fe19cef87c0 -1 osd.0 50 log_to_monitors true 2024-04-23T14:54:31.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:31 smithi156 ceph-mon[77738]: pgmap v67: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 859 B/s rd, 1 op/s; 44/222 objects degraded (19.820%) 2024-04-23T14:54:31.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:31 smithi156 ceph-mon[77738]: from='osd.0 [v2:172.21.15.81:6802/754768728,v1:172.21.15.81:6803/754768728]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-23T14:54:32.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:31 smithi081 ceph-mon[90469]: pgmap v67: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 859 B/s rd, 1 op/s; 44/222 objects degraded (19.820%) 2024-04-23T14:54:32.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:31 smithi081 ceph-mon[90469]: from='osd.0 [v2:172.21.15.81:6802/754768728,v1:172.21.15.81:6803/754768728]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-23T14:54:32.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:32 smithi156 ceph-mon[77738]: from='osd.0 [v2:172.21.15.81:6802/754768728,v1:172.21.15.81:6803/754768728]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-23T14:54:32.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:32 smithi156 ceph-mon[77738]: osdmap e53: 6 total, 5 up, 6 in 2024-04-23T14:54:32.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:32 smithi156 ceph-mon[77738]: from='osd.0 [v2:172.21.15.81:6802/754768728,v1:172.21.15.81:6803/754768728]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-04-23T14:54:32.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:32 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:32.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:32 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:33.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:32 smithi081 ceph-mon[90469]: from='osd.0 [v2:172.21.15.81:6802/754768728,v1:172.21.15.81:6803/754768728]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-23T14:54:33.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:32 smithi081 ceph-mon[90469]: osdmap e53: 6 total, 5 up, 6 in 2024-04-23T14:54:33.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:32 smithi081 ceph-mon[90469]: from='osd.0 [v2:172.21.15.81:6802/754768728,v1:172.21.15.81:6803/754768728]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-04-23T14:54:33.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:32 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:33.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:32 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:33.077 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 14:54:32 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0[99430]: 2024-04-23T14:54:32.682+0000 7fe187200700 -1 osd.0 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T14:54:33.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:33 smithi081 ceph-mon[90469]: pgmap v69: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 44/222 objects degraded (19.820%) 2024-04-23T14:54:33.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:33 smithi081 ceph-mon[90469]: from='osd.0 [v2:172.21.15.81:6802/754768728,v1:172.21.15.81:6803/754768728]' entity='osd.0' 2024-04-23T14:54:34.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:33 smithi156 ceph-mon[77738]: pgmap v69: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 44/222 objects degraded (19.820%) 2024-04-23T14:54:34.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:33 smithi156 ceph-mon[77738]: from='osd.0 [v2:172.21.15.81:6802/754768728,v1:172.21.15.81:6803/754768728]' entity='osd.0' 2024-04-23T14:54:35.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:34 smithi156 ceph-mon[77738]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-23T14:54:35.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:34 smithi156 ceph-mon[77738]: osd.0 [v2:172.21.15.81:6802/754768728,v1:172.21.15.81:6803/754768728] boot 2024-04-23T14:54:35.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:34 smithi156 ceph-mon[77738]: osdmap e54: 6 total, 6 up, 6 in 2024-04-23T14:54:35.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:34 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:54:35.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:34 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:35.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:34 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:35.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:34 smithi081 ceph-mon[90469]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-23T14:54:35.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:34 smithi081 ceph-mon[90469]: osd.0 [v2:172.21.15.81:6802/754768728,v1:172.21.15.81:6803/754768728] boot 2024-04-23T14:54:35.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:34 smithi081 ceph-mon[90469]: osdmap e54: 6 total, 6 up, 6 in 2024-04-23T14:54:35.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:34 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T14:54:35.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:34 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:35.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:34 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:35.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:35 smithi081 ceph-mon[90469]: pgmap v71: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 44/222 objects degraded (19.820%) 2024-04-23T14:54:35.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:35 smithi081 ceph-mon[90469]: osdmap e55: 6 total, 6 up, 6 in 2024-04-23T14:54:36.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:35 smithi156 ceph-mon[77738]: pgmap v71: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 44/222 objects degraded (19.820%) 2024-04-23T14:54:36.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:35 smithi156 ceph-mon[77738]: osdmap e55: 6 total, 6 up, 6 in 2024-04-23T14:54:37.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:37 smithi081 ceph-mon[90469]: pgmap v73: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 44/222 objects degraded (19.820%) 2024-04-23T14:54:38.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:37 smithi156 ceph-mon[77738]: pgmap v73: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 44/222 objects degraded (19.820%) 2024-04-23T14:54:38.928 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:38 smithi081 ceph-mon[90469]: pgmap v74: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-23T14:54:39.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:38 smithi156 ceph-mon[77738]: pgmap v74: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-23T14:54:39.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.562+0000 7f9d8fe00700 1 -- 172.21.15.81:0/2496754809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d90100070 msgr2=0x7f9d901004e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:39.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.562+0000 7f9d8fe00700 1 --2- 172.21.15.81:0/2496754809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d90100070 0x7f9d901004e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c004940 tx=0x7f9d7c009e30 comp rx=0 tx=0).stop 2024-04-23T14:54:39.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.562+0000 7f9d8fe00700 1 -- 172.21.15.81:0/2496754809 shutdown_connections 2024-04-23T14:54:39.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.562+0000 7f9d8fe00700 1 --2- 172.21.15.81:0/2496754809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d90100070 0x7f9d901004e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:39.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.562+0000 7f9d8fe00700 1 --2- 172.21.15.81:0/2496754809 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d900fef00 0x7f9d900ff310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:39.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.562+0000 7f9d8fe00700 1 -- 172.21.15.81:0/2496754809 >> 172.21.15.81:0/2496754809 conn(0x7f9d900fa790 msgr2=0x7f9d900fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:39.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.562+0000 7f9d8fe00700 1 -- 172.21.15.81:0/2496754809 shutdown_connections 2024-04-23T14:54:39.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.562+0000 7f9d8fe00700 1 -- 172.21.15.81:0/2496754809 wait complete. 2024-04-23T14:54:39.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.563+0000 7f9d8fe00700 1 Processor -- start 2024-04-23T14:54:39.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.563+0000 7f9d8fe00700 1 -- start start 2024-04-23T14:54:39.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.563+0000 7f9d8fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d900fef00 0x7f9d9010fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:39.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.563+0000 7f9d8fe00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d90100070 0x7f9d9010ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:39.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.564+0000 7f9d8fe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d901105b0 con 0x7f9d900fef00 2024-04-23T14:54:39.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.564+0000 7f9d8fe00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d90110e00 con 0x7f9d90100070 2024-04-23T14:54:39.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.564+0000 7f9d8ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d900fef00 0x7f9d9010fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:39.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.564+0000 7f9d8ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d900fef00 0x7f9d9010fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49940/0 (socket says 172.21.15.81:49940) 2024-04-23T14:54:39.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.564+0000 7f9d8ea00700 1 -- 172.21.15.81:0/3928133678 learned_addr learned my addr 172.21.15.81:0/3928133678 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:54:39.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.564+0000 7f9d8e000700 1 --2- 172.21.15.81:0/3928133678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d90100070 0x7f9d9010ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:39.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.564+0000 7f9d8ea00700 1 -- 172.21.15.81:0/3928133678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d90100070 msgr2=0x7f9d9010ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:39.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.564+0000 7f9d8ea00700 1 --2- 172.21.15.81:0/3928133678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d90100070 0x7f9d9010ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:39.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.564+0000 7f9d8ea00700 1 -- 172.21.15.81:0/3928133678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7c005040 con 0x7f9d900fef00 2024-04-23T14:54:39.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.565+0000 7f9d8ea00700 1 --2- 172.21.15.81:0/3928133678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d900fef00 0x7f9d9010fa70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9d8000c830 tx=0x7f9d80004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:39.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.565+0000 7f9d86a00700 1 -- 172.21.15.81:0/3928133678 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d8000a760 con 0x7f9d900fef00 2024-04-23T14:54:39.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.565+0000 7f9d86a00700 1 -- 172.21.15.81:0/3928133678 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9d8000ad90 con 0x7f9d900fef00 2024-04-23T14:54:39.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.565+0000 7f9d8fe00700 1 -- 172.21.15.81:0/3928133678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d901110e0 con 0x7f9d900fef00 2024-04-23T14:54:39.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.565+0000 7f9d86a00700 1 -- 172.21.15.81:0/3928133678 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d800113a0 con 0x7f9d900fef00 2024-04-23T14:54:39.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.565+0000 7f9d8fe00700 1 -- 172.21.15.81:0/3928133678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d90111620 con 0x7f9d900fef00 2024-04-23T14:54:39.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.566+0000 7f9d8fe00700 1 -- 172.21.15.81:0/3928133678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d900fe290 con 0x7f9d900fef00 2024-04-23T14:54:39.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.567+0000 7f9d86a00700 1 -- 172.21.15.81:0/3928133678 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f9d80012400 con 0x7f9d900fef00 2024-04-23T14:54:39.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.569+0000 7f9d86a00700 1 --2- 172.21.15.81:0/3928133678 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f9d7406ec00 0x7f9d740710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:39.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.569+0000 7f9d86a00700 1 -- 172.21.15.81:0/3928133678 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f9d8008e860 con 0x7f9d900fef00 2024-04-23T14:54:39.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.569+0000 7f9d8e000700 1 --2- 172.21.15.81:0/3928133678 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f9d7406ec00 0x7f9d740710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:39.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.570+0000 7f9d8e000700 1 --2- 172.21.15.81:0/3928133678 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f9d7406ec00 0x7f9d740710b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c00b3b0 tx=0x7f9d7c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:39.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.574+0000 7f9d86a00700 1 -- 172.21.15.81:0/3928133678 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f9d8005b1f0 con 0x7f9d900fef00 2024-04-23T14:54:39.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.822+0000 7f9d8fe00700 1 -- 172.21.15.81:0/3928133678 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d90111a70 con 0x7f9d7406ec00 2024-04-23T14:54:39.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.826+0000 7f9d86a00700 1 -- 172.21.15.81:0/3928133678 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f9d90111a70 con 0x7f9d7406ec00 2024-04-23T14:54:39.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.829+0000 7f9d8fe00700 1 -- 172.21.15.81:0/3928133678 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f9d7406ec00 msgr2=0x7f9d740710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:39.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.829+0000 7f9d8fe00700 1 --2- 172.21.15.81:0/3928133678 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f9d7406ec00 0x7f9d740710b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c00b3b0 tx=0x7f9d7c009e30 comp rx=0 tx=0).stop 2024-04-23T14:54:39.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.829+0000 7f9d8fe00700 1 -- 172.21.15.81:0/3928133678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d900fef00 msgr2=0x7f9d9010fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:39.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.829+0000 7f9d8fe00700 1 --2- 172.21.15.81:0/3928133678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d900fef00 0x7f9d9010fa70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9d8000c830 tx=0x7f9d80004470 comp rx=0 tx=0).stop 2024-04-23T14:54:39.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.830+0000 7f9d8fe00700 1 -- 172.21.15.81:0/3928133678 shutdown_connections 2024-04-23T14:54:39.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.830+0000 7f9d8fe00700 1 --2- 172.21.15.81:0/3928133678 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f9d7406ec00 0x7f9d740710b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:39.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.830+0000 7f9d8fe00700 1 --2- 172.21.15.81:0/3928133678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d900fef00 0x7f9d9010fa70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.830+0000 7f9d8fe00700 1 --2- 172.21.15.81:0/3928133678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d90100070 0x7f9d9010ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.830+0000 7f9d8fe00700 1 -- 172.21.15.81:0/3928133678 >> 172.21.15.81:0/3928133678 conn(0x7f9d900fa790 msgr2=0x7f9d900fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.830+0000 7f9d8fe00700 1 -- 172.21.15.81:0/3928133678 shutdown_connections 2024-04-23T14:54:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.830+0000 7f9d8fe00700 1 -- 172.21.15.81:0/3928133678 wait complete. 2024-04-23T14:54:39.848 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-04-23T14:54:39.978 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:39 smithi081 ceph-mon[90469]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 44/222 objects degraded (19.820%), 17 pgs degraded) 2024-04-23T14:54:39.978 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:39 smithi081 ceph-mon[90469]: Cluster is now healthy 2024-04-23T14:54:39.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.985+0000 7fecc4400700 1 -- 172.21.15.81:0/1681310206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecbc0fcef0 msgr2=0x7fecbc0fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:39.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.985+0000 7fecc4400700 1 --2- 172.21.15.81:0/1681310206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecbc0fcef0 0x7fecbc0fd320 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fecb0009ce0 tx=0x7fecb0004d10 comp rx=0 tx=0).stop 2024-04-23T14:54:39.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.986+0000 7fecc4400700 1 -- 172.21.15.81:0/1681310206 shutdown_connections 2024-04-23T14:54:39.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.986+0000 7fecc4400700 1 --2- 172.21.15.81:0/1681310206 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecbc0fe0e0 0x7fecbc0fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:39.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.986+0000 7fecc4400700 1 --2- 172.21.15.81:0/1681310206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecbc0fcef0 0x7fecbc0fd320 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:39.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.986+0000 7fecc4400700 1 -- 172.21.15.81:0/1681310206 >> 172.21.15.81:0/1681310206 conn(0x7fecbc0f8530 msgr2=0x7fecbc0fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:39.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.986+0000 7fecc4400700 1 -- 172.21.15.81:0/1681310206 shutdown_connections 2024-04-23T14:54:39.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.986+0000 7fecc4400700 1 -- 172.21.15.81:0/1681310206 wait complete. 2024-04-23T14:54:39.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.987+0000 7fecc4400700 1 Processor -- start 2024-04-23T14:54:39.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.987+0000 7fecc4400700 1 -- start start 2024-04-23T14:54:39.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.987+0000 7fecc4400700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecbc0fcef0 0x7fecbc107190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:39.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.987+0000 7fecc4400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecbc0fe0e0 0x7fecbc1076d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:39.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.987+0000 7fecc4400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc107d20 con 0x7fecbc0fe0e0 2024-04-23T14:54:39.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.987+0000 7fecc4400700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc108570 con 0x7fecbc0fcef0 2024-04-23T14:54:39.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.988+0000 7fecc1000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecbc0fe0e0 0x7fecbc1076d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.988+0000 7fecc1000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecbc0fe0e0 0x7fecbc1076d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49952/0 (socket says 172.21.15.81:49952) 2024-04-23T14:54:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.988+0000 7fecc1000700 1 -- 172.21.15.81:0/3393771178 learned_addr learned my addr 172.21.15.81:0/3393771178 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:54:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.988+0000 7fecc1a00700 1 --2- 172.21.15.81:0/3393771178 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecbc0fcef0 0x7fecbc107190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.988+0000 7fecc1000700 1 -- 172.21.15.81:0/3393771178 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecbc0fcef0 msgr2=0x7fecbc107190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.988+0000 7fecc1000700 1 --2- 172.21.15.81:0/3393771178 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecbc0fcef0 0x7fecbc107190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.988+0000 7fecc1000700 1 -- 172.21.15.81:0/3393771178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb0009940 con 0x7fecbc0fe0e0 2024-04-23T14:54:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.988+0000 7fecc1000700 1 --2- 172.21.15.81:0/3393771178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecbc0fe0e0 0x7fecbc1076d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7feca800c8c0 tx=0x7feca80044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.989+0000 7fecb9600700 1 -- 172.21.15.81:0/3393771178 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feca800a980 con 0x7fecbc0fe0e0 2024-04-23T14:54:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.989+0000 7fecb9600700 1 -- 172.21.15.81:0/3393771178 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feca800ce60 con 0x7fecbc0fe0e0 2024-04-23T14:54:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.989+0000 7fecc4400700 1 -- 172.21.15.81:0/3393771178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecbc108850 con 0x7fecbc0fe0e0 2024-04-23T14:54:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.989+0000 7fecb9600700 1 -- 172.21.15.81:0/3393771178 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feca80115e0 con 0x7fecbc0fe0e0 2024-04-23T14:54:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.989+0000 7fecc4400700 1 -- 172.21.15.81:0/3393771178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecbc108e10 con 0x7fecbc0fe0e0 2024-04-23T14:54:39.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.990+0000 7fecc4400700 1 -- 172.21.15.81:0/3393771178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecbc101a70 con 0x7fecbc0fe0e0 2024-04-23T14:54:39.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.991+0000 7fecb9600700 1 -- 172.21.15.81:0/3393771178 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7feca8012400 con 0x7fecbc0fe0e0 2024-04-23T14:54:39.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.992+0000 7fecb9600700 1 --2- 172.21.15.81:0/3393771178 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7feca406ec10 0x7feca40710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:39.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.993+0000 7fecb9600700 1 -- 172.21.15.81:0/3393771178 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6410+0+0 (secure 0 0 0) 0x7feca808e9d0 con 0x7fecbc0fe0e0 2024-04-23T14:54:39.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.993+0000 7fecc1a00700 1 --2- 172.21.15.81:0/3393771178 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7feca406ec10 0x7feca40710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:39.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.994+0000 7fecc1a00700 1 --2- 172.21.15.81:0/3393771178 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7feca406ec10 0x7feca40710c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fecb00094a0 tx=0x7fecb0004d10 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:39.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:39.997+0000 7fecb9600700 1 -- 172.21.15.81:0/3393771178 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7feca80577b0 con 0x7fecbc0fe0e0 2024-04-23T14:54:40.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:39 smithi156 ceph-mon[77738]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 44/222 objects degraded (19.820%), 17 pgs degraded) 2024-04-23T14:54:40.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:39 smithi156 ceph-mon[77738]: Cluster is now healthy 2024-04-23T14:54:40.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.251+0000 7fecc4400700 1 -- 172.21.15.81:0/3393771178 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fecbc105a90 con 0x7feca406ec10 2024-04-23T14:54:40.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.254+0000 7fecb9600700 1 -- 172.21.15.81:0/3393771178 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fecbc105a90 con 0x7feca406ec10 2024-04-23T14:54:40.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.257+0000 7fecc4400700 1 -- 172.21.15.81:0/3393771178 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7feca406ec10 msgr2=0x7feca40710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:40.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.257+0000 7fecc4400700 1 --2- 172.21.15.81:0/3393771178 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7feca406ec10 0x7feca40710c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fecb00094a0 tx=0x7fecb0004d10 comp rx=0 tx=0).stop 2024-04-23T14:54:40.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.257+0000 7fecc4400700 1 -- 172.21.15.81:0/3393771178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecbc0fe0e0 msgr2=0x7fecbc1076d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:40.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.257+0000 7fecc4400700 1 --2- 172.21.15.81:0/3393771178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecbc0fe0e0 0x7fecbc1076d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7feca800c8c0 tx=0x7feca80044c0 comp rx=0 tx=0).stop 2024-04-23T14:54:40.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.257+0000 7fecc4400700 1 -- 172.21.15.81:0/3393771178 shutdown_connections 2024-04-23T14:54:40.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.257+0000 7fecc4400700 1 --2- 172.21.15.81:0/3393771178 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7feca406ec10 0x7feca40710c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:40.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.257+0000 7fecc4400700 1 --2- 172.21.15.81:0/3393771178 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecbc0fcef0 0x7fecbc107190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:40.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.257+0000 7fecc4400700 1 --2- 172.21.15.81:0/3393771178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecbc0fe0e0 0x7fecbc1076d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:40.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.258+0000 7fecc4400700 1 -- 172.21.15.81:0/3393771178 >> 172.21.15.81:0/3393771178 conn(0x7fecbc0f8530 msgr2=0x7fecbc0f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:40.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.258+0000 7fecc4400700 1 -- 172.21.15.81:0/3393771178 shutdown_connections 2024-04-23T14:54:40.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.258+0000 7fecc4400700 1 -- 172.21.15.81:0/3393771178 wait complete. 2024-04-23T14:54:40.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.413+0000 7fdb5f400700 1 -- 172.21.15.81:0/587007210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb580709a0 msgr2=0x7fdb58070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:40.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.413+0000 7fdb5f400700 1 --2- 172.21.15.81:0/587007210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb580709a0 0x7fdb58070e10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdb44004940 tx=0x7fdb44009e30 comp rx=0 tx=0).stop 2024-04-23T14:54:40.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.413+0000 7fdb5f400700 1 -- 172.21.15.81:0/587007210 shutdown_connections 2024-04-23T14:54:40.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.413+0000 7fdb5f400700 1 --2- 172.21.15.81:0/587007210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb580709a0 0x7fdb58070e10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:40.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.413+0000 7fdb5f400700 1 --2- 172.21.15.81:0/587007210 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb58071f50 0x7fdb58070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:40.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.413+0000 7fdb5f400700 1 -- 172.21.15.81:0/587007210 >> 172.21.15.81:0/587007210 conn(0x7fdb580f8530 msgr2=0x7fdb580fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:40.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.413+0000 7fdb5f400700 1 -- 172.21.15.81:0/587007210 shutdown_connections 2024-04-23T14:54:40.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.413+0000 7fdb5f400700 1 -- 172.21.15.81:0/587007210 wait complete. 2024-04-23T14:54:40.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.414+0000 7fdb5f400700 1 Processor -- start 2024-04-23T14:54:40.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.414+0000 7fdb5f400700 1 -- start start 2024-04-23T14:54:40.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.415+0000 7fdb5f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb580709a0 0x7fdb58114070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:40.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.415+0000 7fdb5f400700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb58071f50 0x7fdb581145b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:40.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.415+0000 7fdb5f400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb58114c40 con 0x7fdb580709a0 2024-04-23T14:54:40.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.415+0000 7fdb5f400700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb581153c0 con 0x7fdb58071f50 2024-04-23T14:54:40.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.415+0000 7fdb5ca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb580709a0 0x7fdb58114070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:40.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.415+0000 7fdb5ca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb580709a0 0x7fdb58114070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49960/0 (socket says 172.21.15.81:49960) 2024-04-23T14:54:40.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.415+0000 7fdb5ca00700 1 -- 172.21.15.81:0/3289186657 learned_addr learned my addr 172.21.15.81:0/3289186657 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:54:40.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.415+0000 7fdb57e00700 1 --2- 172.21.15.81:0/3289186657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb58071f50 0x7fdb581145b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:40.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.415+0000 7fdb5ca00700 1 -- 172.21.15.81:0/3289186657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb58071f50 msgr2=0x7fdb581145b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:40.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.415+0000 7fdb5ca00700 1 --2- 172.21.15.81:0/3289186657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb58071f50 0x7fdb581145b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:40.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.415+0000 7fdb5ca00700 1 -- 172.21.15.81:0/3289186657 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb44005040 con 0x7fdb580709a0 2024-04-23T14:54:40.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.415+0000 7fdb57e00700 1 --2- 172.21.15.81:0/3289186657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb58071f50 0x7fdb581145b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:54:40.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.416+0000 7fdb5ca00700 1 --2- 172.21.15.81:0/3289186657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb580709a0 0x7fdb58114070 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c00b790 tx=0x7fdb4c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:40.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.416+0000 7fdb54c00700 1 -- 172.21.15.81:0/3289186657 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb4c00f6f0 con 0x7fdb580709a0 2024-04-23T14:54:40.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.416+0000 7fdb5f400700 1 -- 172.21.15.81:0/3289186657 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb581156a0 con 0x7fdb580709a0 2024-04-23T14:54:40.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.416+0000 7fdb54c00700 1 -- 172.21.15.81:0/3289186657 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdb4c00fd20 con 0x7fdb580709a0 2024-04-23T14:54:40.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.416+0000 7fdb54c00700 1 -- 172.21.15.81:0/3289186657 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb4c0103a0 con 0x7fdb580709a0 2024-04-23T14:54:40.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.416+0000 7fdb5f400700 1 -- 172.21.15.81:0/3289186657 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb58115c60 con 0x7fdb580709a0 2024-04-23T14:54:40.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.418+0000 7fdb5f400700 1 -- 172.21.15.81:0/3289186657 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb5805f5f0 con 0x7fdb580709a0 2024-04-23T14:54:40.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.419+0000 7fdb54c00700 1 -- 172.21.15.81:0/3289186657 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fdb4c011400 con 0x7fdb580709a0 2024-04-23T14:54:40.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.420+0000 7fdb54c00700 1 --2- 172.21.15.81:0/3289186657 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fdb4006ec10 0x7fdb400710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:40.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.420+0000 7fdb54c00700 1 -- 172.21.15.81:0/3289186657 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fdb4c08e6d0 con 0x7fdb580709a0 2024-04-23T14:54:40.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.420+0000 7fdb57e00700 1 --2- 172.21.15.81:0/3289186657 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fdb4006ec10 0x7fdb400710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:40.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.421+0000 7fdb57e00700 1 --2- 172.21.15.81:0/3289186657 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fdb4006ec10 0x7fdb400710c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400b7a0 tx=0x7fdb44009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:40.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.424+0000 7fdb54c00700 1 -- 172.21.15.81:0/3289186657 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fdb4c05b000 con 0x7fdb580709a0 2024-04-23T14:54:40.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.674+0000 7fdb5f400700 1 -- 172.21.15.81:0/3289186657 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdb58115f80 con 0x7fdb4006ec10 2024-04-23T14:54:40.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.699+0000 7fdb54c00700 1 -- 172.21.15.81:0/3289186657 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fdb58115f80 con 0x7fdb4006ec10 2024-04-23T14:54:40.701 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-23T14:54:40.701 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (5m) 8s ago 15m 14.0M - 0.25.0 c8568f914cd2 63876b2abc27 2024-04-23T14:54:40.701 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (54s) 8s ago 16m 6665k - 19.0.0-3126-gd44fddd9 76e77f280c74 b486fe2ef19b 2024-04-23T14:54:40.701 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi156 smithi156 running (46s) 41s ago 14m 6656k - 19.0.0-3126-gd44fddd9 76e77f280c74 5d9aa5ecf264 2024-04-23T14:54:40.701 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (4m) 8s ago 15m 74.5M - 9.4.7 954c08fa6188 fbad3cef0883 2024-04-23T14:54:40.701 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.vcoywg smithi081 running (8m) 8s ago 8m 147M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 2ca7601ab60f 2024-04-23T14:54:40.701 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.wydgcg smithi081 running (8m) 8s ago 8m 107M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 58eb1a961b61 2024-04-23T14:54:40.701 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.rhbtxt smithi156 running (8m) 41s ago 8m 13.7M - 17.2.7-884-g70d0cb4b cafd8ddac8fa db3cb5034381 2024-04-23T14:54:40.701 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.vynkxn smithi156 running (8m) 41s ago 8m 13.9M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 1c8f2219e7fd 2024-04-23T14:54:40.701 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.ldghvq smithi081 *:8443,9283,8765 running (4m) 8s ago 17m 502M - 19.0.0-3126-gd44fddd9 76e77f280c74 6bf23484a1c9 2024-04-23T14:54:40.701 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi156.ounwyj smithi156 *:8443,9283,8765 running (2m) 41s ago 14m 450M - 19.0.0-3126-gd44fddd9 76e77f280c74 a6c0dd9f89f2 2024-04-23T14:54:40.702 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (2m) 8s ago 17m 43.3M 2048M 19.0.0-3126-gd44fddd9 76e77f280c74 fbf9f9a59ac2 2024-04-23T14:54:40.702 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi156 smithi156 running (111s) 41s ago 14m 32.2M 2048M 19.0.0-3126-gd44fddd9 76e77f280c74 36409886998f 2024-04-23T14:54:40.702 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (5m) 8s ago 15m 7708k - 1.5.0 0da6a335fe13 197b27809010 2024-04-23T14:54:40.702 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi156 smithi156 *:9100 running (4m) 41s ago 14m 8154k - 1.5.0 0da6a335fe13 91a7c5e86d47 2024-04-23T14:54:40.702 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (16s) 8s ago 13m 11.1M 1557M 19.0.0-3126-gd44fddd9 76e77f280c74 24bc24b37de5 2024-04-23T14:54:40.702 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (12m) 8s ago 12m 255M 1557M 17.2.7-884-g70d0cb4b cafd8ddac8fa ee6d0c8af6ed 2024-04-23T14:54:40.702 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (12m) 8s ago 12m 217M 1557M 17.2.7-884-g70d0cb4b cafd8ddac8fa c26c640828a2 2024-04-23T14:54:40.702 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi156 running (11m) 41s ago 11m 286M 2581M 17.2.7-884-g70d0cb4b cafd8ddac8fa c1c261b1ee90 2024-04-23T14:54:40.702 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi156 running (11m) 41s ago 11m 256M 2581M 17.2.7-884-g70d0cb4b cafd8ddac8fa 83f996ee64de 2024-04-23T14:54:40.702 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi156 running (10m) 41s ago 10m 239M 2581M 17.2.7-884-g70d0cb4b cafd8ddac8fa b754244bef18 2024-04-23T14:54:40.703 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (3m) 8s ago 15m 54.6M - 2.43.0 a07b618ecd1d 35558adb166d 2024-04-23T14:54:40.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.702+0000 7fdb5f400700 1 -- 172.21.15.81:0/3289186657 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fdb4006ec10 msgr2=0x7fdb400710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:40.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.702+0000 7fdb5f400700 1 --2- 172.21.15.81:0/3289186657 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fdb4006ec10 0x7fdb400710c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400b7a0 tx=0x7fdb44009e30 comp rx=0 tx=0).stop 2024-04-23T14:54:40.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.703+0000 7fdb5f400700 1 -- 172.21.15.81:0/3289186657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb580709a0 msgr2=0x7fdb58114070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:40.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.703+0000 7fdb5f400700 1 --2- 172.21.15.81:0/3289186657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb580709a0 0x7fdb58114070 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c00b790 tx=0x7fdb4c009220 comp rx=0 tx=0).stop 2024-04-23T14:54:40.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.703+0000 7fdb5f400700 1 -- 172.21.15.81:0/3289186657 shutdown_connections 2024-04-23T14:54:40.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.703+0000 7fdb5f400700 1 --2- 172.21.15.81:0/3289186657 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fdb4006ec10 0x7fdb400710c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:40.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.703+0000 7fdb5f400700 1 --2- 172.21.15.81:0/3289186657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb580709a0 0x7fdb58114070 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:40.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.703+0000 7fdb5f400700 1 --2- 172.21.15.81:0/3289186657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb58071f50 0x7fdb581145b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:40.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.703+0000 7fdb5f400700 1 -- 172.21.15.81:0/3289186657 >> 172.21.15.81:0/3289186657 conn(0x7fdb580f8530 msgr2=0x7fdb580f9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:40.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.703+0000 7fdb5f400700 1 -- 172.21.15.81:0/3289186657 shutdown_connections 2024-04-23T14:54:40.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.703+0000 7fdb5f400700 1 -- 172.21.15.81:0/3289186657 wait complete. 2024-04-23T14:54:40.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.849+0000 7fdcbf000700 1 -- 172.21.15.81:0/350789937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb8071f50 msgr2=0x7fdcb8070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:40.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.849+0000 7fdcbf000700 1 --2- 172.21.15.81:0/350789937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb8071f50 0x7fdcb8070460 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdca8004940 tx=0x7fdca8009e30 comp rx=0 tx=0).stop 2024-04-23T14:54:40.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.849+0000 7fdcbf000700 1 -- 172.21.15.81:0/350789937 shutdown_connections 2024-04-23T14:54:40.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.849+0000 7fdcbf000700 1 --2- 172.21.15.81:0/350789937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdcb80709a0 0x7fdcb8070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:40.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.849+0000 7fdcbf000700 1 --2- 172.21.15.81:0/350789937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb8071f50 0x7fdcb8070460 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:40.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.849+0000 7fdcbf000700 1 -- 172.21.15.81:0/350789937 >> 172.21.15.81:0/350789937 conn(0x7fdcb80f8530 msgr2=0x7fdcb80fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:40.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.849+0000 7fdcbf000700 1 -- 172.21.15.81:0/350789937 shutdown_connections 2024-04-23T14:54:40.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.849+0000 7fdcbf000700 1 -- 172.21.15.81:0/350789937 wait complete. 2024-04-23T14:54:40.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.850+0000 7fdcbf000700 1 Processor -- start 2024-04-23T14:54:40.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.850+0000 7fdcbf000700 1 -- start start 2024-04-23T14:54:40.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.850+0000 7fdcbf000700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdcb80709a0 0x7fdcb810fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:40.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.850+0000 7fdcbf000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb8071f50 0x7fdcb8110170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:40.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.850+0000 7fdcbf000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb8110800 con 0x7fdcb8071f50 2024-04-23T14:54:40.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.850+0000 7fdcbf000700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb8110f80 con 0x7fdcb80709a0 2024-04-23T14:54:40.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.851+0000 7fdcb7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb8071f50 0x7fdcb8110170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:40.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.851+0000 7fdcb7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb8071f50 0x7fdcb8110170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49980/0 (socket says 172.21.15.81:49980) 2024-04-23T14:54:40.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.851+0000 7fdcb7400700 1 -- 172.21.15.81:0/1795357488 learned_addr learned my addr 172.21.15.81:0/1795357488 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:54:40.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.851+0000 7fdcb7e00700 1 --2- 172.21.15.81:0/1795357488 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdcb80709a0 0x7fdcb810fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:40.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.851+0000 7fdcb7400700 1 -- 172.21.15.81:0/1795357488 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdcb80709a0 msgr2=0x7fdcb810fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:40.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.851+0000 7fdcb7400700 1 --2- 172.21.15.81:0/1795357488 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdcb80709a0 0x7fdcb810fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:40.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.851+0000 7fdcb7400700 1 -- 172.21.15.81:0/1795357488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca8005040 con 0x7fdcb8071f50 2024-04-23T14:54:40.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.851+0000 7fdcb7400700 1 --2- 172.21.15.81:0/1795357488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb8071f50 0x7fdcb8110170 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdca400b790 tx=0x7fdca4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:40.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.852+0000 7fdcafe00700 1 -- 172.21.15.81:0/1795357488 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdca400f770 con 0x7fdcb8071f50 2024-04-23T14:54:40.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.852+0000 7fdcbf000700 1 -- 172.21.15.81:0/1795357488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb8111260 con 0x7fdcb8071f50 2024-04-23T14:54:40.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.852+0000 7fdcafe00700 1 -- 172.21.15.81:0/1795357488 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdca400fda0 con 0x7fdcb8071f50 2024-04-23T14:54:40.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.852+0000 7fdcafe00700 1 -- 172.21.15.81:0/1795357488 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdca400d310 con 0x7fdcb8071f50 2024-04-23T14:54:40.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.852+0000 7fdcbf000700 1 -- 172.21.15.81:0/1795357488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcb8111820 con 0x7fdcb8071f50 2024-04-23T14:54:40.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.853+0000 7fdcbf000700 1 -- 172.21.15.81:0/1795357488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcb81095a0 con 0x7fdcb8071f50 2024-04-23T14:54:40.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.854+0000 7fdcafe00700 1 -- 172.21.15.81:0/1795357488 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fdca4010420 con 0x7fdcb8071f50 2024-04-23T14:54:40.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.856+0000 7fdcafe00700 1 --2- 172.21.15.81:0/1795357488 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fdc9c06ec10 0x7fdc9c0710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:40.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.856+0000 7fdcafe00700 1 -- 172.21.15.81:0/1795357488 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fdca408e840 con 0x7fdcb8071f50 2024-04-23T14:54:40.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.856+0000 7fdcb7e00700 1 --2- 172.21.15.81:0/1795357488 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fdc9c06ec10 0x7fdc9c0710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:40.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.857+0000 7fdcb7e00700 1 --2- 172.21.15.81:0/1795357488 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fdc9c06ec10 0x7fdc9c0710c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdca800b3b0 tx=0x7fdca8009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:40.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:40.861+0000 7fdcafe00700 1 -- 172.21.15.81:0/1795357488 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fdca405b1d0 con 0x7fdcb8071f50 2024-04-23T14:54:41.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.178+0000 7fdcbf000700 1 -- 172.21.15.81:0/1795357488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdcb8111af0 con 0x7fdcb8071f50 2024-04-23T14:54:41.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.179+0000 7fdcafe00700 1 -- 172.21.15.81:0/1795357488 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7fdca405ad60 con 0x7fdcb8071f50 2024-04-23T14:54:41.181 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:54:41.181 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-04-23T14:54:41.181 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T14:54:41.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:54:41.181 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-04-23T14:54:41.181 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T14:54:41.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:54:41.181 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-04-23T14:54:41.182 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 5, 2024-04-23T14:54:41.182 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 1 2024-04-23T14:54:41.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:54:41.182 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-04-23T14:54:41.182 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 4 2024-04-23T14:54:41.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:54:41.182 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-04-23T14:54:41.182 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 9, 2024-04-23T14:54:41.182 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 5 2024-04-23T14:54:41.182 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-23T14:54:41.182 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:54:41.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.182+0000 7fdcbf000700 1 -- 172.21.15.81:0/1795357488 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fdc9c06ec10 msgr2=0x7fdc9c0710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:41.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.182+0000 7fdcbf000700 1 --2- 172.21.15.81:0/1795357488 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fdc9c06ec10 0x7fdc9c0710c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdca800b3b0 tx=0x7fdca8009e30 comp rx=0 tx=0).stop 2024-04-23T14:54:41.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.182+0000 7fdcbf000700 1 -- 172.21.15.81:0/1795357488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb8071f50 msgr2=0x7fdcb8110170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:41.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.182+0000 7fdcbf000700 1 --2- 172.21.15.81:0/1795357488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb8071f50 0x7fdcb8110170 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdca400b790 tx=0x7fdca4009250 comp rx=0 tx=0).stop 2024-04-23T14:54:41.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.182+0000 7fdcbf000700 1 -- 172.21.15.81:0/1795357488 shutdown_connections 2024-04-23T14:54:41.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.182+0000 7fdcbf000700 1 --2- 172.21.15.81:0/1795357488 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fdc9c06ec10 0x7fdc9c0710c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:41.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.182+0000 7fdcbf000700 1 --2- 172.21.15.81:0/1795357488 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdcb80709a0 0x7fdcb810fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:41.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.182+0000 7fdcbf000700 1 --2- 172.21.15.81:0/1795357488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb8071f50 0x7fdcb8110170 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:41.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.182+0000 7fdcbf000700 1 -- 172.21.15.81:0/1795357488 >> 172.21.15.81:0/1795357488 conn(0x7fdcb80f8530 msgr2=0x7fdcb8102d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:41.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.182+0000 7fdcbf000700 1 -- 172.21.15.81:0/1795357488 shutdown_connections 2024-04-23T14:54:41.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.182+0000 7fdcbf000700 1 -- 172.21.15.81:0/1795357488 wait complete. 2024-04-23T14:54:41.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:41 smithi156 ceph-mon[77738]: from='client.34246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:54:41.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:41 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:41.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:41 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:41.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:41 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:54:41.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:41 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:54:41.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:41 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:41.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:41 smithi156 ceph-mon[77738]: from='client.34250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:54:41.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:41 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:54:41.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:41 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:54:41.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:41 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:54:41.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:41 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:54:41.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:41 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-23T14:54:41.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:41 smithi156 ceph-mon[77738]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-23T14:54:41.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:41 smithi156 ceph-mon[77738]: Upgrade: osd.1 is safe to restart 2024-04-23T14:54:41.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:41 smithi156 ceph-mon[77738]: pgmap v75: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:54:41.288 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:41 smithi156 ceph-mon[77738]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:54:41.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:41 smithi081 ceph-mon[90469]: from='client.34246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:54:41.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:41 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:41.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:41 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:41.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:41 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:54:41.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:41 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:54:41.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:41 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:41.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:41 smithi081 ceph-mon[90469]: from='client.34250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:54:41.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:41 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:54:41.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:41 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:54:41.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:41 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:54:41.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:41 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:54:41.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:41 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-23T14:54:41.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:41 smithi081 ceph-mon[90469]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-23T14:54:41.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:41 smithi081 ceph-mon[90469]: Upgrade: osd.1 is safe to restart 2024-04-23T14:54:41.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:41 smithi081 ceph-mon[90469]: pgmap v75: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:54:41.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:41 smithi081 ceph-mon[90469]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:54:41.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.326+0000 7f18c6c00700 1 -- 172.21.15.81:0/132667185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18c0066230 msgr2=0x7f18c00ff8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:41.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.326+0000 7f18c6c00700 1 --2- 172.21.15.81:0/132667185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18c0066230 0x7f18c00ff8c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f18b4004940 tx=0x7f18b4009e30 comp rx=0 tx=0).stop 2024-04-23T14:54:41.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.326+0000 7f18c6c00700 1 -- 172.21.15.81:0/132667185 shutdown_connections 2024-04-23T14:54:41.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.326+0000 7f18c6c00700 1 --2- 172.21.15.81:0/132667185 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18c00ffe00 0x7f18c01021e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:41.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.326+0000 7f18c6c00700 1 --2- 172.21.15.81:0/132667185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18c0066230 0x7f18c00ff8c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:41.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.326+0000 7f18c6c00700 1 -- 172.21.15.81:0/132667185 >> 172.21.15.81:0/132667185 conn(0x7f18c00f7270 msgr2=0x7f18c00f96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:41.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.326+0000 7f18c6c00700 1 -- 172.21.15.81:0/132667185 shutdown_connections 2024-04-23T14:54:41.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.327+0000 7f18c6c00700 1 -- 172.21.15.81:0/132667185 wait complete. 2024-04-23T14:54:41.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.327+0000 7f18c6c00700 1 Processor -- start 2024-04-23T14:54:41.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.328+0000 7f18c6c00700 1 -- start start 2024-04-23T14:54:41.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.328+0000 7f18c6c00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18c0066230 0x7f18c010fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:41.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.328+0000 7f18c6c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18c00ffe00 0x7f18c0110060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:41.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.328+0000 7f18c6c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c0110660 con 0x7f18c00ffe00 2024-04-23T14:54:41.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.328+0000 7f18c6c00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c0110eb0 con 0x7f18c0066230 2024-04-23T14:54:41.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.329+0000 7f18c4e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18c00ffe00 0x7f18c0110060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:41.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.329+0000 7f18c4e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18c00ffe00 0x7f18c0110060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50008/0 (socket says 172.21.15.81:50008) 2024-04-23T14:54:41.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.329+0000 7f18c4e00700 1 -- 172.21.15.81:0/2670962631 learned_addr learned my addr 172.21.15.81:0/2670962631 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:54:41.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.329+0000 7f18c5800700 1 --2- 172.21.15.81:0/2670962631 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18c0066230 0x7f18c010fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:41.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.329+0000 7f18c4e00700 1 -- 172.21.15.81:0/2670962631 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18c0066230 msgr2=0x7f18c010fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:41.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.329+0000 7f18c4e00700 1 --2- 172.21.15.81:0/2670962631 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18c0066230 0x7f18c010fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:41.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.329+0000 7f18c4e00700 1 -- 172.21.15.81:0/2670962631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b4005040 con 0x7f18c00ffe00 2024-04-23T14:54:41.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.330+0000 7f18c4e00700 1 --2- 172.21.15.81:0/2670962631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18c00ffe00 0x7f18c0110060 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f18ac002a80 tx=0x7f18ac004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:41.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.330+0000 7f18bd600700 1 -- 172.21.15.81:0/2670962631 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18ac007cc0 con 0x7f18c00ffe00 2024-04-23T14:54:41.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.330+0000 7f18bd600700 1 -- 172.21.15.81:0/2670962631 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f18ac00f040 con 0x7f18c00ffe00 2024-04-23T14:54:41.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.330+0000 7f18c6c00700 1 -- 172.21.15.81:0/2670962631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18c0111190 con 0x7f18c00ffe00 2024-04-23T14:54:41.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.330+0000 7f18c6c00700 1 -- 172.21.15.81:0/2670962631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18c01116d0 con 0x7f18c00ffe00 2024-04-23T14:54:41.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.331+0000 7f18bd600700 1 -- 172.21.15.81:0/2670962631 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18ac00daf0 con 0x7f18c00ffe00 2024-04-23T14:54:41.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.332+0000 7f18c6c00700 1 -- 172.21.15.81:0/2670962631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18a00052e0 con 0x7f18c00ffe00 2024-04-23T14:54:41.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.333+0000 7f18bd600700 1 -- 172.21.15.81:0/2670962631 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f18ac00dd30 con 0x7f18c00ffe00 2024-04-23T14:54:41.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.335+0000 7f18bd600700 1 --2- 172.21.15.81:0/2670962631 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f18a806ec10 0x7f18a80710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:41.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.335+0000 7f18bd600700 1 -- 172.21.15.81:0/2670962631 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f18ac08de60 con 0x7f18c00ffe00 2024-04-23T14:54:41.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.335+0000 7f18c5800700 1 --2- 172.21.15.81:0/2670962631 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f18a806ec10 0x7f18a80710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:41.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.336+0000 7f18c5800700 1 --2- 172.21.15.81:0/2670962631 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f18a806ec10 0x7f18a80710c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f18b4000c00 tx=0x7f18b4009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:41.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.339+0000 7f18bd600700 1 -- 172.21.15.81:0/2670962631 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f18ac05a770 con 0x7f18c00ffe00 2024-04-23T14:54:41.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.616+0000 7f18c6c00700 1 -- 172.21.15.81:0/2670962631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f18a0005da0 con 0x7f18c00ffe00 2024-04-23T14:54:41.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.617+0000 7f18bd600700 1 -- 172.21.15.81:0/2670962631 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1907 (secure 0 0 0) 0x7f18ac05a300 con 0x7f18c00ffe00 2024-04-23T14:54:41.619 INFO:teuthology.orchestra.run.smithi081.stdout:e18 2024-04-23T14:54:41.619 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-23T14:54:41.619 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:54:41.619 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-04-23T14:54:41.619 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:54:41.620 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-04-23T14:54:41.620 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-04-23T14:54:41.620 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 17 2024-04-23T14:54:41.620 INFO:teuthology.orchestra.run.smithi081.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-23T14:54:41.620 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-04-23T14:45:51.264703+0000 2024-04-23T14:54:41.620 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-04-23T14:46:12.782992+0000 2024-04-23T14:54:41.620 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-04-23T14:54:41.620 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-04-23T14:54:41.620 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-04-23T14:54:41.620 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-04-23T14:54:41.620 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-04-23T14:54:41.620 INFO:teuthology.orchestra.run.smithi081.stdout:max_xattr_size 65536 2024-04-23T14:54:41.620 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-04-23T14:54:41.620 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-04-23T14:54:41.621 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 47 2024-04-23T14:54:41.621 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:54:41.621 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 1 2024-04-23T14:54:41.621 INFO:teuthology.orchestra.run.smithi081.stdout:in 0 2024-04-23T14:54:41.621 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=14472} 2024-04-23T14:54:41.621 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-04-23T14:54:41.621 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-04-23T14:54:41.621 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-04-23T14:54:41.621 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-04-23T14:54:41.621 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-04-23T14:54:41.621 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-04-23T14:54:41.621 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-04-23T14:54:41.622 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-04-23T14:54:41.622 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-04-23T14:54:41.622 INFO:teuthology.orchestra.run.smithi081.stdout:qdb_cluster leader: 0 members: 2024-04-23T14:54:41.622 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.vcoywg{0:14472} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.81:6828/2563365650,v1:172.21.15.81:6829/2563365650] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:54:41.622 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.wydgcg{0:14482} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.81:6826/759909104,v1:172.21.15.81:6827/759909104] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:54:41.622 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:54:41.622 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:54:41.622 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-04-23T14:54:41.622 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:54:41.623 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.vynkxn{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.156:6826/1794690362,v1:172.21.15.156:6827/1794690362] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:54:41.623 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.rhbtxt{-1:24263} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.156:6824/3854041261,v1:172.21.15.156:6825/3854041261] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:54:41.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.620+0000 7f18c6c00700 1 -- 172.21.15.81:0/2670962631 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f18a806ec10 msgr2=0x7f18a80710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:41.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.620+0000 7f18c6c00700 1 --2- 172.21.15.81:0/2670962631 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f18a806ec10 0x7f18a80710c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f18b4000c00 tx=0x7f18b4009e30 comp rx=0 tx=0).stop 2024-04-23T14:54:41.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.620+0000 7f18c6c00700 1 -- 172.21.15.81:0/2670962631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18c00ffe00 msgr2=0x7f18c0110060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:41.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.620+0000 7f18c6c00700 1 --2- 172.21.15.81:0/2670962631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18c00ffe00 0x7f18c0110060 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f18ac002a80 tx=0x7f18ac004630 comp rx=0 tx=0).stop 2024-04-23T14:54:41.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.620+0000 7f18c6c00700 1 -- 172.21.15.81:0/2670962631 shutdown_connections 2024-04-23T14:54:41.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.620+0000 7f18c6c00700 1 --2- 172.21.15.81:0/2670962631 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f18a806ec10 0x7f18a80710c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:41.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.621+0000 7f18c6c00700 1 --2- 172.21.15.81:0/2670962631 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18c0066230 0x7f18c010fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:41.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.621+0000 7f18c6c00700 1 --2- 172.21.15.81:0/2670962631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18c00ffe00 0x7f18c0110060 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:41.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.621+0000 7f18c6c00700 1 -- 172.21.15.81:0/2670962631 >> 172.21.15.81:0/2670962631 conn(0x7f18c00f7270 msgr2=0x7f18c0100a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:41.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.622+0000 7f18c6c00700 1 -- 172.21.15.81:0/2670962631 shutdown_connections 2024-04-23T14:54:41.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.622+0000 7f18c6c00700 1 -- 172.21.15.81:0/2670962631 wait complete. 2024-04-23T14:54:41.625 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 18 2024-04-23T14:54:41.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.766+0000 7f7db1e00700 1 -- 172.21.15.81:0/764385018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dac100070 msgr2=0x7f7dac1004e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:41.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.766+0000 7f7db1e00700 1 --2- 172.21.15.81:0/764385018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dac100070 0x7f7dac1004e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7d94004940 tx=0x7f7d94009e30 comp rx=0 tx=0).stop 2024-04-23T14:54:41.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.766+0000 7f7db1e00700 1 -- 172.21.15.81:0/764385018 shutdown_connections 2024-04-23T14:54:41.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.766+0000 7f7db1e00700 1 --2- 172.21.15.81:0/764385018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dac100070 0x7f7dac1004e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:41.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.766+0000 7f7db1e00700 1 --2- 172.21.15.81:0/764385018 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7dac0fef00 0x7f7dac0ff310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:41.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.766+0000 7f7db1e00700 1 -- 172.21.15.81:0/764385018 >> 172.21.15.81:0/764385018 conn(0x7f7dac0fa790 msgr2=0x7f7dac0fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:41.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.766+0000 7f7db1e00700 1 -- 172.21.15.81:0/764385018 shutdown_connections 2024-04-23T14:54:41.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.766+0000 7f7db1e00700 1 -- 172.21.15.81:0/764385018 wait complete. 2024-04-23T14:54:41.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.767+0000 7f7db1e00700 1 Processor -- start 2024-04-23T14:54:41.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.767+0000 7f7db1e00700 1 -- start start 2024-04-23T14:54:41.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.768+0000 7f7db1e00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7dac0fef00 0x7f7dac10fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:41.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.768+0000 7f7db1e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dac100070 0x7f7dac10ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:41.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.768+0000 7f7db1e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac110650 con 0x7f7dac100070 2024-04-23T14:54:41.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.768+0000 7f7db1e00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac110e40 con 0x7f7dac0fef00 2024-04-23T14:54:41.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.768+0000 7f7da3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dac100070 0x7f7dac10ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:41.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.768+0000 7f7da3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dac100070 0x7f7dac10ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50026/0 (socket says 172.21.15.81:50026) 2024-04-23T14:54:41.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.768+0000 7f7da3e00700 1 -- 172.21.15.81:0/2214998115 learned_addr learned my addr 172.21.15.81:0/2214998115 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:54:41.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.768+0000 7f7da3e00700 1 -- 172.21.15.81:0/2214998115 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7dac0fef00 msgr2=0x7f7dac10fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:41.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.768+0000 7f7da3e00700 1 --2- 172.21.15.81:0/2214998115 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7dac0fef00 0x7f7dac10fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:41.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.768+0000 7f7da3e00700 1 -- 172.21.15.81:0/2214998115 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d94005040 con 0x7f7dac100070 2024-04-23T14:54:41.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.769+0000 7f7da3e00700 1 --2- 172.21.15.81:0/2214998115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dac100070 0x7f7dac10ffc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7d94009150 tx=0x7f7d94009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:41.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.769+0000 7f7da9600700 1 -- 172.21.15.81:0/2214998115 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d9400e040 con 0x7f7dac100070 2024-04-23T14:54:41.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.769+0000 7f7da9600700 1 -- 172.21.15.81:0/2214998115 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7d9400bbf0 con 0x7f7dac100070 2024-04-23T14:54:41.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.769+0000 7f7da9600700 1 -- 172.21.15.81:0/2214998115 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d9401c630 con 0x7f7dac100070 2024-04-23T14:54:41.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.769+0000 7f7db1e00700 1 -- 172.21.15.81:0/2214998115 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dac1110c0 con 0x7f7dac100070 2024-04-23T14:54:41.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.769+0000 7f7db1e00700 1 -- 172.21.15.81:0/2214998115 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dac111680 con 0x7f7dac100070 2024-04-23T14:54:41.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.770+0000 7f7db1e00700 1 -- 172.21.15.81:0/2214998115 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dac0fe290 con 0x7f7dac100070 2024-04-23T14:54:41.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.771+0000 7f7da9600700 1 -- 172.21.15.81:0/2214998115 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f7d9400bd60 con 0x7f7dac100070 2024-04-23T14:54:41.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.772+0000 7f7da9600700 1 --2- 172.21.15.81:0/2214998115 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f7d9006ec00 0x7f7d900710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:41.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.772+0000 7f7da9600700 1 -- 172.21.15.81:0/2214998115 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f7d9408fbe0 con 0x7f7dac100070 2024-04-23T14:54:41.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.772+0000 7f7db0a00700 1 --2- 172.21.15.81:0/2214998115 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f7d9006ec00 0x7f7d900710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:41.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.773+0000 7f7db0a00700 1 --2- 172.21.15.81:0/2214998115 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f7d9006ec00 0x7f7d900710b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c006fd0 tx=0x7f7d9c006db0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:41.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:41.777+0000 7f7da9600700 1 -- 172.21.15.81:0/2214998115 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f7d9405c570 con 0x7f7dac100070 2024-04-23T14:54:42.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.011+0000 7f7db1e00700 1 -- 172.21.15.81:0/2214998115 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7dac111ac0 con 0x7f7d9006ec00 2024-04-23T14:54:42.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.013+0000 7f7da9600700 1 -- 172.21.15.81:0/2214998115 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f7dac111ac0 con 0x7f7d9006ec00 2024-04-23T14:54:42.014 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:54:42.015 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd", 2024-04-23T14:54:42.015 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-04-23T14:54:42.015 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-23T14:54:42.015 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [ 2024-04-23T14:54:42.015 INFO:teuthology.orchestra.run.smithi081.stdout: "mon", 2024-04-23T14:54:42.015 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-04-23T14:54:42.015 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr" 2024-04-23T14:54:42.015 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-04-23T14:54:42.015 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "7/21 daemons upgraded", 2024-04-23T14:54:42.015 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "Currently upgrading osd daemons", 2024-04-23T14:54:42.015 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-04-23T14:54:42.015 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:54:42.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.016+0000 7f7db1e00700 1 -- 172.21.15.81:0/2214998115 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f7d9006ec00 msgr2=0x7f7d900710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:42.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.016+0000 7f7db1e00700 1 --2- 172.21.15.81:0/2214998115 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f7d9006ec00 0x7f7d900710b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c006fd0 tx=0x7f7d9c006db0 comp rx=0 tx=0).stop 2024-04-23T14:54:42.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.016+0000 7f7db1e00700 1 -- 172.21.15.81:0/2214998115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dac100070 msgr2=0x7f7dac10ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:42.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.016+0000 7f7db1e00700 1 --2- 172.21.15.81:0/2214998115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dac100070 0x7f7dac10ffc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7d94009150 tx=0x7f7d94009e30 comp rx=0 tx=0).stop 2024-04-23T14:54:42.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.016+0000 7f7db1e00700 1 -- 172.21.15.81:0/2214998115 shutdown_connections 2024-04-23T14:54:42.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.016+0000 7f7db1e00700 1 --2- 172.21.15.81:0/2214998115 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f7d9006ec00 0x7f7d900710b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:42.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.016+0000 7f7db1e00700 1 --2- 172.21.15.81:0/2214998115 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7dac0fef00 0x7f7dac10fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:42.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.016+0000 7f7db1e00700 1 --2- 172.21.15.81:0/2214998115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dac100070 0x7f7dac10ffc0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:42.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.016+0000 7f7db1e00700 1 -- 172.21.15.81:0/2214998115 >> 172.21.15.81:0/2214998115 conn(0x7f7dac0fa790 msgr2=0x7f7dac0fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:42.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.016+0000 7f7db1e00700 1 -- 172.21.15.81:0/2214998115 shutdown_connections 2024-04-23T14:54:42.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.016+0000 7f7db1e00700 1 -- 172.21.15.81:0/2214998115 wait complete. 2024-04-23T14:54:42.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.173+0000 7f50f7a00700 1 -- 172.21.15.81:0/2541341988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50f00ff020 msgr2=0x7f50f00ff430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:42.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.173+0000 7f50f7a00700 1 --2- 172.21.15.81:0/2541341988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50f00ff020 0x7f50f00ff430 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f50e4004940 tx=0x7f50e4009e30 comp rx=0 tx=0).stop 2024-04-23T14:54:42.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.173+0000 7f50f7a00700 1 -- 172.21.15.81:0/2541341988 shutdown_connections 2024-04-23T14:54:42.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.173+0000 7f50f7a00700 1 --2- 172.21.15.81:0/2541341988 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50f01002d0 0x7f50f0100740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:42.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.173+0000 7f50f7a00700 1 --2- 172.21.15.81:0/2541341988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50f00ff020 0x7f50f00ff430 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:42.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.173+0000 7f50f7a00700 1 -- 172.21.15.81:0/2541341988 >> 172.21.15.81:0/2541341988 conn(0x7f50f00fa950 msgr2=0x7f50f00fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:42.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.173+0000 7f50f7a00700 1 -- 172.21.15.81:0/2541341988 shutdown_connections 2024-04-23T14:54:42.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.174+0000 7f50f7a00700 1 -- 172.21.15.81:0/2541341988 wait complete. 2024-04-23T14:54:42.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.174+0000 7f50f7a00700 1 Processor -- start 2024-04-23T14:54:42.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.174+0000 7f50f7a00700 1 -- start start 2024-04-23T14:54:42.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.175+0000 7f50f7a00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50f00ff020 0x7f50f010fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:42.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.175+0000 7f50f7a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50f01002d0 0x7f50f0110020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:42.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.175+0000 7f50f7a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f0110620 con 0x7f50f01002d0 2024-04-23T14:54:42.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.175+0000 7f50f7a00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f0110790 con 0x7f50f00ff020 2024-04-23T14:54:42.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.175+0000 7f50efe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50f01002d0 0x7f50f0110020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:42.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.175+0000 7f50efe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50f01002d0 0x7f50f0110020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50038/0 (socket says 172.21.15.81:50038) 2024-04-23T14:54:42.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.175+0000 7f50efe00700 1 -- 172.21.15.81:0/590131817 learned_addr learned my addr 172.21.15.81:0/590131817 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:54:42.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.175+0000 7f50f5000700 1 --2- 172.21.15.81:0/590131817 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50f00ff020 0x7f50f010fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:42.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.175+0000 7f50efe00700 1 -- 172.21.15.81:0/590131817 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50f00ff020 msgr2=0x7f50f010fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:42.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.176+0000 7f50efe00700 1 --2- 172.21.15.81:0/590131817 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50f00ff020 0x7f50f010fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:42.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.176+0000 7f50efe00700 1 -- 172.21.15.81:0/590131817 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e4005040 con 0x7f50f01002d0 2024-04-23T14:54:42.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.176+0000 7f50efe00700 1 --2- 172.21.15.81:0/590131817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50f01002d0 0x7f50f0110020 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f50e000eb40 tx=0x7f50e000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:42.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.176+0000 7f50ecc00700 1 -- 172.21.15.81:0/590131817 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50e0007cc0 con 0x7f50f01002d0 2024-04-23T14:54:42.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.176+0000 7f50ecc00700 1 -- 172.21.15.81:0/590131817 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f50e000f040 con 0x7f50f01002d0 2024-04-23T14:54:42.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.176+0000 7f50f7a00700 1 -- 172.21.15.81:0/590131817 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50f0115190 con 0x7f50f01002d0 2024-04-23T14:54:42.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.176+0000 7f50ecc00700 1 -- 172.21.15.81:0/590131817 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50e0009620 con 0x7f50f01002d0 2024-04-23T14:54:42.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.176+0000 7f50f7a00700 1 -- 172.21.15.81:0/590131817 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50f01156d0 con 0x7f50f01002d0 2024-04-23T14:54:42.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.177+0000 7f50f7a00700 1 -- 172.21.15.81:0/590131817 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50f004c710 con 0x7f50f01002d0 2024-04-23T14:54:42.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.179+0000 7f50ecc00700 1 -- 172.21.15.81:0/590131817 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f50e0009780 con 0x7f50f01002d0 2024-04-23T14:54:42.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.180+0000 7f50ecc00700 1 --2- 172.21.15.81:0/590131817 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f50d806ec00 0x7f50d80710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:54:42.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.180+0000 7f50ecc00700 1 -- 172.21.15.81:0/590131817 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f50e008e4b0 con 0x7f50f01002d0 2024-04-23T14:54:42.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.180+0000 7f50f5000700 1 --2- 172.21.15.81:0/590131817 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f50d806ec00 0x7f50d80710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:54:42.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.181+0000 7f50f5000700 1 --2- 172.21.15.81:0/590131817 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f50d806ec00 0x7f50d80710b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f50e4000c00 tx=0x7f50e4009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:54:42.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.185+0000 7f50ecc00700 1 -- 172.21.15.81:0/590131817 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f50e005aeb0 con 0x7f50f01002d0 2024-04-23T14:54:42.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:42 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/1795357488' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:54:42.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:42 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:42.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:42 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:54:42.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:42 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/2670962631' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:54:42.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:42 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/1795357488' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:54:42.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:42 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:42.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:42 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:54:42.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:42 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/2670962631' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:54:42.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.509+0000 7f50f7a00700 1 -- 172.21.15.81:0/590131817 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f50f0115b70 con 0x7f50f01002d0 2024-04-23T14:54:42.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.511+0000 7f50ecc00700 1 -- 172.21.15.81:0/590131817 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f50e005aa40 con 0x7f50f01002d0 2024-04-23T14:54:42.512 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-04-23T14:54:42.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.514+0000 7f50f7a00700 1 -- 172.21.15.81:0/590131817 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f50d806ec00 msgr2=0x7f50d80710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:42.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.514+0000 7f50f7a00700 1 --2- 172.21.15.81:0/590131817 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f50d806ec00 0x7f50d80710b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f50e4000c00 tx=0x7f50e4009e30 comp rx=0 tx=0).stop 2024-04-23T14:54:42.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.514+0000 7f50f7a00700 1 -- 172.21.15.81:0/590131817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50f01002d0 msgr2=0x7f50f0110020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:54:42.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.514+0000 7f50f7a00700 1 --2- 172.21.15.81:0/590131817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50f01002d0 0x7f50f0110020 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f50e000eb40 tx=0x7f50e000b040 comp rx=0 tx=0).stop 2024-04-23T14:54:42.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.514+0000 7f50f7a00700 1 -- 172.21.15.81:0/590131817 shutdown_connections 2024-04-23T14:54:42.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.514+0000 7f50f7a00700 1 --2- 172.21.15.81:0/590131817 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f50d806ec00 0x7f50d80710b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:42.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.514+0000 7f50f7a00700 1 --2- 172.21.15.81:0/590131817 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50f00ff020 0x7f50f010fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:42.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.514+0000 7f50f7a00700 1 --2- 172.21.15.81:0/590131817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50f01002d0 0x7f50f0110020 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:54:42.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.514+0000 7f50f7a00700 1 -- 172.21.15.81:0/590131817 >> 172.21.15.81:0/590131817 conn(0x7f50f00fa950 msgr2=0x7f50f00fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:54:42.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.515+0000 7f50f7a00700 1 -- 172.21.15.81:0/590131817 shutdown_connections 2024-04-23T14:54:42.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:54:42.515+0000 7f50f7a00700 1 -- 172.21.15.81:0/590131817 wait complete. 2024-04-23T14:54:43.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:43 smithi081 ceph-mon[90469]: from='client.34266 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:54:43.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:43 smithi081 ceph-mon[90469]: Upgrade: Updating osd.1 2024-04-23T14:54:43.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:43 smithi081 ceph-mon[90469]: pgmap v76: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 580 B/s rd, 1 op/s 2024-04-23T14:54:43.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:43 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:43.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:43 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/590131817' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:54:43.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:43 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-23T14:54:43.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:43 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:54:43.578 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:43 smithi081 ceph-mon[90469]: Deploying daemon osd.1 on smithi081 2024-04-23T14:54:43.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:43 smithi156 ceph-mon[77738]: from='client.34266 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:54:43.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:43 smithi156 ceph-mon[77738]: Upgrade: Updating osd.1 2024-04-23T14:54:43.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:43 smithi156 ceph-mon[77738]: pgmap v76: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 580 B/s rd, 1 op/s 2024-04-23T14:54:43.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:43 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:43.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:43 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/590131817' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:54:43.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:43 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-23T14:54:43.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:43 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:54:43.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:43 smithi156 ceph-mon[77738]: Deploying daemon osd.1 on smithi081 2024-04-23T14:54:45.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:45 smithi156 ceph-mon[77738]: pgmap v77: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-23T14:54:45.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:45 smithi081 ceph-mon[90469]: pgmap v77: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-23T14:54:47.577 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:47 smithi081 systemd[1]: Stopping Ceph osd.1 for 7a641bea-017e-11ef-bc93-c7b262605968... 2024-04-23T14:54:48.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:47 smithi156 ceph-mon[77738]: pgmap v78: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 867 B/s rd, 1 op/s 2024-04-23T14:54:48.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:47 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:48.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:47 smithi081 ceph-mon[90469]: pgmap v78: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 867 B/s rd, 1 op/s 2024-04-23T14:54:48.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:47 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:48.077 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:47 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1[51599]: 2024-04-23T14:54:47.755+0000 7f7f74000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T14:54:48.077 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:47 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1[51599]: 2024-04-23T14:54:47.755+0000 7f7f74000700 -1 osd.1 55 *** Got signal Terminated *** 2024-04-23T14:54:48.077 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:47 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1[51599]: 2024-04-23T14:54:47.755+0000 7f7f74000700 -1 osd.1 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-23T14:54:49.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:48 smithi156 ceph-mon[77738]: osd.1 marked itself down and dead 2024-04-23T14:54:49.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:48 smithi081 ceph-mon[90469]: osd.1 marked itself down and dead 2024-04-23T14:54:49.475 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:49 smithi081 podman[104304]: 2024-04-23 14:54:49.154092323 +0000 UTC m=+1.552757791 container stop ee6d0c8af6ed108806b95dea6602dc94cc0203e9bb75d431b193490a608a6ea3 (image=quay.ceph.io/ceph-ci/ceph@sha256:3890cd726bd5e73ae623dabdf4ed76dd5df81c936b8bd8d761026babda969466, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=quincy-70d0cb4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True) 2024-04-23T14:54:49.475 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:49 smithi081 podman[104304]: 2024-04-23 14:54:49.18174888 +0000 UTC m=+1.580414348 container died ee6d0c8af6ed108806b95dea6602dc94cc0203e9bb75d431b193490a608a6ea3 (image=quay.ceph.io/ceph-ci/ceph@sha256:3890cd726bd5e73ae623dabdf4ed76dd5df81c936b8bd8d761026babda969466, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1, RELEASE=quincy-70d0cb4, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True) 2024-04-23T14:54:49.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:49 smithi081 ceph-mon[90469]: pgmap v79: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:54:49.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:49 smithi081 ceph-mon[90469]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-23T14:54:49.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:49 smithi081 ceph-mon[90469]: osdmap e56: 6 total, 5 up, 6 in 2024-04-23T14:54:49.827 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:49 smithi081 podman[104304]: 2024-04-23 14:54:49.674991419 +0000 UTC m=+2.073656896 container cleanup ee6d0c8af6ed108806b95dea6602dc94cc0203e9bb75d431b193490a608a6ea3 (image=quay.ceph.io/ceph-ci/ceph@sha256:3890cd726bd5e73ae623dabdf4ed76dd5df81c936b8bd8d761026babda969466, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240416, RELEASE=quincy-70d0cb4) 2024-04-23T14:54:49.827 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:49 smithi081 bash[104304]: ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1 2024-04-23T14:54:50.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:49 smithi156 ceph-mon[77738]: pgmap v79: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:54:50.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:49 smithi156 ceph-mon[77738]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-23T14:54:50.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:49 smithi156 ceph-mon[77738]: osdmap e56: 6 total, 5 up, 6 in 2024-04-23T14:54:50.326 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:49 smithi081 podman[104325]: 2024-04-23 14:54:49.985175465 +0000 UTC m=+0.814337774 container remove ee6d0c8af6ed108806b95dea6602dc94cc0203e9bb75d431b193490a608a6ea3 (image=quay.ceph.io/ceph-ci/ceph@sha256:3890cd726bd5e73ae623dabdf4ed76dd5df81c936b8bd8d761026babda969466, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-70d0cb4, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T14:54:50.901 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:50 smithi081 ceph-mon[90469]: osdmap e57: 6 total, 5 up, 6 in 2024-04-23T14:54:51.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:50 smithi156 ceph-mon[77738]: osdmap e57: 6 total, 5 up, 6 in 2024-04-23T14:54:51.228 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:50 smithi081 podman[104415]: 2024-04-23 14:54:50.806102876 +0000 UTC m=+0.032252702 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T14:54:51.229 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:50 smithi081 podman[104415]: 2024-04-23 14:54:50.936396206 +0000 UTC m=+0.162546069 container create 2a315f5d2dca6a96b8ec2c6346c50df117ecb64c6f7ffe0560b12f5c21b46ec1 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd) 2024-04-23T14:54:51.229 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:51 smithi081 podman[104415]: 2024-04-23 14:54:51.227771399 +0000 UTC m=+0.453921269 container init 2a315f5d2dca6a96b8ec2c6346c50df117ecb64c6f7ffe0560b12f5c21b46ec1 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T14:54:51.576 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:51 smithi081 podman[104415]: 2024-04-23 14:54:51.239092071 +0000 UTC m=+0.465241941 container start 2a315f5d2dca6a96b8ec2c6346c50df117ecb64c6f7ffe0560b12f5c21b46ec1 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux ) 2024-04-23T14:54:51.577 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:51 smithi081 podman[104415]: 2024-04-23 14:54:51.355879526 +0000 UTC m=+0.582029396 container attach 2a315f5d2dca6a96b8ec2c6346c50df117ecb64c6f7ffe0560b12f5c21b46ec1 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1-deactivate, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.build-date=20240416) 2024-04-23T14:54:52.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:51 smithi156 ceph-mon[77738]: pgmap v82: 65 pgs: 12 stale+active+clean, 53 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:54:52.075 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:51 smithi081 ceph-mon[90469]: pgmap v82: 65 pgs: 12 stale+active+clean, 53 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:54:52.076 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:51 smithi081 podman[104415]: 2024-04-23 14:54:51.689601988 +0000 UTC m=+0.915751857 container died 2a315f5d2dca6a96b8ec2c6346c50df117ecb64c6f7ffe0560b12f5c21b46ec1 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-04-23T14:54:52.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:52 smithi081 ceph-mon[90469]: Health check failed: Degraded data redundancy: 2/222 objects degraded (0.901%), 2 pgs degraded (PG_DEGRADED) 2024-04-23T14:54:52.827 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:52 smithi081 podman[104440]: 2024-04-23 14:54:52.484601027 +0000 UTC m=+0.775166270 container remove 2a315f5d2dca6a96b8ec2c6346c50df117ecb64c6f7ffe0560b12f5c21b46ec1 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-04-23T14:54:52.827 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:52 smithi081 systemd[1]: ceph-7a641bea-017e-11ef-bc93-c7b262605968@osd.1.service: Deactivated successfully. 2024-04-23T14:54:52.827 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:52 smithi081 systemd[1]: Stopped Ceph osd.1 for 7a641bea-017e-11ef-bc93-c7b262605968. 2024-04-23T14:54:52.827 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:52 smithi081 systemd[1]: ceph-7a641bea-017e-11ef-bc93-c7b262605968@osd.1.service: Consumed 1min 40.084s CPU time. 2024-04-23T14:54:53.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:52 smithi156 ceph-mon[77738]: Health check failed: Degraded data redundancy: 2/222 objects degraded (0.901%), 2 pgs degraded (PG_DEGRADED) 2024-04-23T14:54:53.274 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:52 smithi081 systemd[1]: Starting Ceph osd.1 for 7a641bea-017e-11ef-bc93-c7b262605968... 2024-04-23T14:54:53.577 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:53 smithi081 podman[104545]: 2024-04-23 14:54:53.178171229 +0000 UTC m=+0.035975586 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T14:54:53.577 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:53 smithi081 podman[104545]: 2024-04-23 14:54:53.318894031 +0000 UTC m=+0.176698417 container create 472dfb30e25f5ac9edcc2db8f1cc1565ad789a29b4477d6dc80cd79203cc2549 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1-activate, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-04-23T14:54:54.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:53 smithi156 ceph-mon[77738]: pgmap v83: 65 pgs: 2 active+undersized+degraded, 9 stale+active+clean, 3 active+undersized, 51 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 2/222 objects degraded (0.901%) 2024-04-23T14:54:54.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:53 smithi081 ceph-mon[90469]: pgmap v83: 65 pgs: 2 active+undersized+degraded, 9 stale+active+clean, 3 active+undersized, 51 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 2/222 objects degraded (0.901%) 2024-04-23T14:54:54.076 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:53 smithi081 podman[104545]: 2024-04-23 14:54:53.597854528 +0000 UTC m=+0.455658966 container init 472dfb30e25f5ac9edcc2db8f1cc1565ad789a29b4477d6dc80cd79203cc2549 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1-activate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=) 2024-04-23T14:54:54.076 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:53 smithi081 podman[104545]: 2024-04-23 14:54:53.609141488 +0000 UTC m=+0.466945900 container start 472dfb30e25f5ac9edcc2db8f1cc1565ad789a29b4477d6dc80cd79203cc2549 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1-activate, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-04-23T14:54:54.076 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:53 smithi081 podman[104545]: 2024-04-23 14:54:53.704997101 +0000 UTC m=+0.562801530 container attach 472dfb30e25f5ac9edcc2db8f1cc1565ad789a29b4477d6dc80cd79203cc2549 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1-activate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T14:54:54.828 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:54 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1-activate[104560]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-23T14:54:54.828 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:54 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1-activate[104560]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-23T14:54:54.828 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:54 smithi081 bash[104545]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-23T14:54:54.828 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:54 smithi081 bash[104545]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-23T14:54:54.828 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:54 smithi081 bash[104545]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-23T14:54:54.828 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:54 smithi081 bash[104545]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-23T14:54:54.828 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:54 smithi081 bash[104545]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-23T14:54:54.828 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:54 smithi081 bash[104545]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-23T14:54:54.828 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:54 smithi081 bash[104545]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-04-23T14:54:54.828 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:54 smithi081 bash[104545]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-23T14:54:54.828 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:54 smithi081 bash[104545]: --> ceph-volume raw activate successful for osd ID: 1 2024-04-23T14:54:54.828 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:54 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1-activate[104560]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-23T14:54:54.828 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:54 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1-activate[104560]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-23T14:54:54.829 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:54 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1-activate[104560]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-23T14:54:54.829 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:54 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1-activate[104560]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-23T14:54:54.829 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:54 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1-activate[104560]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-04-23T14:54:54.829 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:54 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1-activate[104560]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-23T14:54:54.829 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:54 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1-activate[104560]: --> ceph-volume raw activate successful for osd ID: 1 2024-04-23T14:54:54.829 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:54 smithi081 podman[104545]: 2024-04-23 14:54:54.598310193 +0000 UTC m=+1.456114582 container died 472dfb30e25f5ac9edcc2db8f1cc1565ad789a29b4477d6dc80cd79203cc2549 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1-activate, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-04-23T14:54:55.696 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:55 smithi081 podman[104704]: 2024-04-23 14:54:55.417560051 +0000 UTC m=+0.799211405 container remove 472dfb30e25f5ac9edcc2db8f1cc1565ad789a29b4477d6dc80cd79203cc2549 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2) 2024-04-23T14:54:56.008 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:55 smithi081 podman[104766]: 2024-04-23 14:54:55.68165464 +0000 UTC m=+0.033990592 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T14:54:56.008 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:55 smithi081 podman[104766]: 2024-04-23 14:54:55.81008726 +0000 UTC m=+0.162423242 container create 18d0179b558a936a2053a174f7f2c87381e7309eab798b4f3e7e6f6aae9ed7a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T14:54:56.008 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:55 smithi081 ceph-mon[90469]: pgmap v84: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 32/222 objects degraded (14.414%) 2024-04-23T14:54:56.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:55 smithi156 ceph-mon[77738]: pgmap v84: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 32/222 objects degraded (14.414%) 2024-04-23T14:54:56.576 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:56 smithi081 podman[104766]: 2024-04-23 14:54:56.09753634 +0000 UTC m=+0.449872325 container init 18d0179b558a936a2053a174f7f2c87381e7309eab798b4f3e7e6f6aae9ed7a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-04-23T14:54:56.576 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:56 smithi081 podman[104766]: 2024-04-23 14:54:56.109374743 +0000 UTC m=+0.461710735 container start 18d0179b558a936a2053a174f7f2c87381e7309eab798b4f3e7e6f6aae9ed7a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True) 2024-04-23T14:54:56.576 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:56 smithi081 ceph-osd[104785]: -- 172.21.15.81:0/2912339361 <== mon.0 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56256a7d5680 con 0x56256a79f000 2024-04-23T14:54:56.577 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:56 smithi081 bash[104766]: 18d0179b558a936a2053a174f7f2c87381e7309eab798b4f3e7e6f6aae9ed7a8 2024-04-23T14:54:56.577 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:56 smithi081 systemd[1]: Started Ceph osd.1 for 7a641bea-017e-11ef-bc93-c7b262605968. 2024-04-23T14:54:57.076 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:54:56 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1[104781]: 2024-04-23T14:54:56.670+0000 7f01231c97c0 -1 Falling back to public interface 2024-04-23T14:54:57.514 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:57 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:57.514 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:57 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:57.514 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:57 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:54:57.514 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:57 smithi081 ceph-mon[90469]: pgmap v85: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-04-23T14:54:57.514 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:57 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:57.514 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:57 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:54:57.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:57 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:57.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:57 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:57.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:57 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:54:57.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:57 smithi156 ceph-mon[77738]: pgmap v85: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-04-23T14:54:57.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:57 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:54:57.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:57 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:54:59.810 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:54:59 smithi081 ceph-mon[90469]: pgmap v86: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s; 32/222 objects degraded (14.414%) 2024-04-23T14:55:00.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:54:59 smithi156 ceph-mon[77738]: pgmap v86: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s; 32/222 objects degraded (14.414%) 2024-04-23T14:55:01.724 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:01 smithi081 ceph-mon[90469]: pgmap v87: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 940 B/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-04-23T14:55:01.724 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:01 smithi081 ceph-mon[90469]: Health check update: Degraded data redundancy: 32/222 objects degraded (14.414%), 13 pgs degraded (PG_DEGRADED) 2024-04-23T14:55:02.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:01 smithi156 ceph-mon[77738]: pgmap v87: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 940 B/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-04-23T14:55:02.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:01 smithi156 ceph-mon[77738]: Health check update: Degraded data redundancy: 32/222 objects degraded (14.414%), 13 pgs degraded (PG_DEGRADED) 2024-04-23T14:55:03.076 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:55:02 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1[104781]: 2024-04-23T14:55:02.613+0000 7f01231c97c0 -1 osd.1 55 log_to_monitors true 2024-04-23T14:55:04.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:03 smithi156 ceph-mon[77738]: pgmap v88: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-04-23T14:55:04.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:03 smithi156 ceph-mon[77738]: from='osd.1 [v2:172.21.15.81:6810/3551141175,v1:172.21.15.81:6811/3551141175]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-23T14:55:04.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:03 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:04.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:03 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:04.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:03 smithi081 ceph-mon[90469]: pgmap v88: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-04-23T14:55:04.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:03 smithi081 ceph-mon[90469]: from='osd.1 [v2:172.21.15.81:6810/3551141175,v1:172.21.15.81:6811/3551141175]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-23T14:55:04.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:03 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:04.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:03 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:05.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:04 smithi156 ceph-mon[77738]: from='osd.1 [v2:172.21.15.81:6810/3551141175,v1:172.21.15.81:6811/3551141175]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-23T14:55:05.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:04 smithi156 ceph-mon[77738]: osdmap e58: 6 total, 5 up, 6 in 2024-04-23T14:55:05.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:04 smithi156 ceph-mon[77738]: from='osd.1 [v2:172.21.15.81:6810/3551141175,v1:172.21.15.81:6811/3551141175]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-04-23T14:55:05.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:04 smithi081 ceph-mon[90469]: from='osd.1 [v2:172.21.15.81:6810/3551141175,v1:172.21.15.81:6811/3551141175]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-23T14:55:05.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:04 smithi081 ceph-mon[90469]: osdmap e58: 6 total, 5 up, 6 in 2024-04-23T14:55:05.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:04 smithi081 ceph-mon[90469]: from='osd.1 [v2:172.21.15.81:6810/3551141175,v1:172.21.15.81:6811/3551141175]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-04-23T14:55:05.077 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 14:55:04 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1[104781]: 2024-04-23T14:55:04.677+0000 7f010d600700 -1 osd.1 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T14:55:06.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:05 smithi156 ceph-mon[77738]: pgmap v90: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-04-23T14:55:06.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:05 smithi156 ceph-mon[77738]: from='osd.1 [v2:172.21.15.81:6810/3551141175,v1:172.21.15.81:6811/3551141175]' entity='osd.1' 2024-04-23T14:55:06.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:05 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:06.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:05 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:06.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:05 smithi081 ceph-mon[90469]: pgmap v90: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-04-23T14:55:06.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:05 smithi081 ceph-mon[90469]: from='osd.1 [v2:172.21.15.81:6810/3551141175,v1:172.21.15.81:6811/3551141175]' entity='osd.1' 2024-04-23T14:55:06.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:05 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:06.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:05 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:07.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:06 smithi156 ceph-mon[77738]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-23T14:55:07.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:06 smithi156 ceph-mon[77738]: osd.1 [v2:172.21.15.81:6810/3551141175,v1:172.21.15.81:6811/3551141175] boot 2024-04-23T14:55:07.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:06 smithi156 ceph-mon[77738]: osdmap e59: 6 total, 6 up, 6 in 2024-04-23T14:55:07.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T14:55:07.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:06 smithi081 ceph-mon[90469]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-23T14:55:07.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:06 smithi081 ceph-mon[90469]: osd.1 [v2:172.21.15.81:6810/3551141175,v1:172.21.15.81:6811/3551141175] boot 2024-04-23T14:55:07.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:06 smithi081 ceph-mon[90469]: osdmap e59: 6 total, 6 up, 6 in 2024-04-23T14:55:07.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T14:55:07.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:07 smithi081 ceph-mon[90469]: pgmap v92: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-04-23T14:55:07.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:07 smithi081 ceph-mon[90469]: osdmap e60: 6 total, 6 up, 6 in 2024-04-23T14:55:08.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:07 smithi156 ceph-mon[77738]: pgmap v92: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-04-23T14:55:08.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:07 smithi156 ceph-mon[77738]: osdmap e60: 6 total, 6 up, 6 in 2024-04-23T14:55:09.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:08 smithi156 ceph-mon[77738]: pgmap v94: 65 pgs: 2 peering, 7 active+undersized+degraded, 5 active+undersized, 51 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 16/222 objects degraded (7.207%) 2024-04-23T14:55:09.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:08 smithi156 ceph-mon[77738]: Health check update: Degraded data redundancy: 16/222 objects degraded (7.207%), 7 pgs degraded (PG_DEGRADED) 2024-04-23T14:55:09.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:08 smithi081 ceph-mon[90469]: pgmap v94: 65 pgs: 2 peering, 7 active+undersized+degraded, 5 active+undersized, 51 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 16/222 objects degraded (7.207%) 2024-04-23T14:55:09.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:08 smithi081 ceph-mon[90469]: Health check update: Degraded data redundancy: 16/222 objects degraded (7.207%), 7 pgs degraded (PG_DEGRADED) 2024-04-23T14:55:10.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:10 smithi081 ceph-mon[90469]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/222 objects degraded (7.207%), 7 pgs degraded) 2024-04-23T14:55:10.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:10 smithi081 ceph-mon[90469]: Cluster is now healthy 2024-04-23T14:55:11.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:10 smithi156 ceph-mon[77738]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/222 objects degraded (7.207%), 7 pgs degraded) 2024-04-23T14:55:11.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:10 smithi156 ceph-mon[77738]: Cluster is now healthy 2024-04-23T14:55:12.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:11 smithi156 ceph-mon[77738]: pgmap v95: 65 pgs: 2 peering, 63 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 739 B/s rd, 1 op/s 2024-04-23T14:55:12.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:11 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:12.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:11 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:12.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:11 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:55:12.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:11 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:55:12.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:11 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:12.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:11 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:55:12.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:11 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:55:12.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:11 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:55:12.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:11 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:55:12.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:11 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-23T14:55:12.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:11 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:12.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:11 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:55:12.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:11 smithi081 ceph-mon[90469]: pgmap v95: 65 pgs: 2 peering, 63 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 739 B/s rd, 1 op/s 2024-04-23T14:55:12.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:11 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:12.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:11 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:12.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:11 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:55:12.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:11 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:55:12.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:11 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:12.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:11 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:55:12.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:11 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:55:12.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:11 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:55:12.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:11 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:55:12.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:11 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-23T14:55:12.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:11 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:12.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:11 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:55:12.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.687+0000 7f3f1ac00700 1 -- 172.21.15.81:0/1100718747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f14071e40 msgr2=0x7f3f14070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:12.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.687+0000 7f3f1ac00700 1 --2- 172.21.15.81:0/1100718747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f14071e40 0x7f3f14070350 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3f04004940 tx=0x7f3f04009e30 comp rx=0 tx=0).stop 2024-04-23T14:55:12.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.687+0000 7f3f1ac00700 1 -- 172.21.15.81:0/1100718747 shutdown_connections 2024-04-23T14:55:12.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.687+0000 7f3f1ac00700 1 --2- 172.21.15.81:0/1100718747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f14070890 0x7f3f14070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:12.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.687+0000 7f3f1ac00700 1 --2- 172.21.15.81:0/1100718747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f14071e40 0x7f3f14070350 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:12.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.687+0000 7f3f1ac00700 1 -- 172.21.15.81:0/1100718747 >> 172.21.15.81:0/1100718747 conn(0x7f3f140f8580 msgr2=0x7f3f140fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:12.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.688+0000 7f3f1ac00700 1 -- 172.21.15.81:0/1100718747 shutdown_connections 2024-04-23T14:55:12.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.688+0000 7f3f1ac00700 1 -- 172.21.15.81:0/1100718747 wait complete. 2024-04-23T14:55:12.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.689+0000 7f3f1ac00700 1 Processor -- start 2024-04-23T14:55:12.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.689+0000 7f3f1ac00700 1 -- start start 2024-04-23T14:55:12.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.689+0000 7f3f1ac00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f14070890 0x7f3f1410fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:12.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.689+0000 7f3f1ac00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f14071e40 0x7f3f14110280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:12.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.689+0000 7f3f1ac00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f14110880 con 0x7f3f14070890 2024-04-23T14:55:12.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.689+0000 7f3f1ac00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f14110fc0 con 0x7f3f14071e40 2024-04-23T14:55:12.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.689+0000 7f3f13e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f14070890 0x7f3f1410fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:12.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.689+0000 7f3f13e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f14070890 0x7f3f1410fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33178/0 (socket says 172.21.15.81:33178) 2024-04-23T14:55:12.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.689+0000 7f3f13e00700 1 -- 172.21.15.81:0/394731143 learned_addr learned my addr 172.21.15.81:0/394731143 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:55:12.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.690+0000 7f3f13400700 1 --2- 172.21.15.81:0/394731143 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f14071e40 0x7f3f14110280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:12.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.690+0000 7f3f13e00700 1 -- 172.21.15.81:0/394731143 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f14071e40 msgr2=0x7f3f14110280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:12.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.690+0000 7f3f13e00700 1 --2- 172.21.15.81:0/394731143 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f14071e40 0x7f3f14110280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:12.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.690+0000 7f3f13e00700 1 -- 172.21.15.81:0/394731143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f04005040 con 0x7f3f14070890 2024-04-23T14:55:12.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.690+0000 7f3f13e00700 1 --2- 172.21.15.81:0/394731143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f14070890 0x7f3f1410fd40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3f0400b970 tx=0x7f3f04009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:12.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.690+0000 7f3f0be00700 1 -- 172.21.15.81:0/394731143 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f0400e040 con 0x7f3f14070890 2024-04-23T14:55:12.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.691+0000 7f3f0be00700 1 -- 172.21.15.81:0/394731143 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3f0400bbf0 con 0x7f3f14070890 2024-04-23T14:55:12.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.691+0000 7f3f0be00700 1 -- 172.21.15.81:0/394731143 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f0401c630 con 0x7f3f14070890 2024-04-23T14:55:12.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.691+0000 7f3f1ac00700 1 -- 172.21.15.81:0/394731143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f14111240 con 0x7f3f14070890 2024-04-23T14:55:12.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.691+0000 7f3f1ac00700 1 -- 172.21.15.81:0/394731143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f14111800 con 0x7f3f14070890 2024-04-23T14:55:12.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.692+0000 7f3f1ac00700 1 -- 172.21.15.81:0/394731143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f1405f5f0 con 0x7f3f14070890 2024-04-23T14:55:12.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.694+0000 7f3f0be00700 1 -- 172.21.15.81:0/394731143 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f3f0400bd60 con 0x7f3f14070890 2024-04-23T14:55:12.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.695+0000 7f3f0be00700 1 --2- 172.21.15.81:0/394731143 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f3ef806ec10 0x7f3ef80710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:12.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.695+0000 7f3f0be00700 1 -- 172.21.15.81:0/394731143 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f3f0408fb30 con 0x7f3f14070890 2024-04-23T14:55:12.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.695+0000 7f3f13400700 1 --2- 172.21.15.81:0/394731143 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f3ef806ec10 0x7f3ef80710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:12.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.696+0000 7f3f13400700 1 --2- 172.21.15.81:0/394731143 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f3ef806ec10 0x7f3ef80710c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3f00007fd0 tx=0x7f3f00009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:12.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.701+0000 7f3f0be00700 1 -- 172.21.15.81:0/394731143 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f3f0405c580 con 0x7f3f14070890 2024-04-23T14:55:12.964 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:12 smithi081 ceph-mon[90469]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-23T14:55:12.964 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:12 smithi081 ceph-mon[90469]: Upgrade: osd.2 is safe to restart 2024-04-23T14:55:12.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.961+0000 7f3f1ac00700 1 -- 172.21.15.81:0/394731143 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f14111b50 con 0x7f3ef806ec10 2024-04-23T14:55:12.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.964+0000 7f3f0be00700 1 -- 172.21.15.81:0/394731143 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f3f14111b50 con 0x7f3ef806ec10 2024-04-23T14:55:12.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.967+0000 7f3f1ac00700 1 -- 172.21.15.81:0/394731143 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f3ef806ec10 msgr2=0x7f3ef80710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:12.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.967+0000 7f3f1ac00700 1 --2- 172.21.15.81:0/394731143 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f3ef806ec10 0x7f3ef80710c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3f00007fd0 tx=0x7f3f00009040 comp rx=0 tx=0).stop 2024-04-23T14:55:12.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.967+0000 7f3f1ac00700 1 -- 172.21.15.81:0/394731143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f14070890 msgr2=0x7f3f1410fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:12.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.967+0000 7f3f1ac00700 1 --2- 172.21.15.81:0/394731143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f14070890 0x7f3f1410fd40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3f0400b970 tx=0x7f3f04009e30 comp rx=0 tx=0).stop 2024-04-23T14:55:12.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.968+0000 7f3f1ac00700 1 -- 172.21.15.81:0/394731143 shutdown_connections 2024-04-23T14:55:12.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.968+0000 7f3f1ac00700 1 --2- 172.21.15.81:0/394731143 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f3ef806ec10 0x7f3ef80710c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:12.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.968+0000 7f3f1ac00700 1 --2- 172.21.15.81:0/394731143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f14070890 0x7f3f1410fd40 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:12.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.968+0000 7f3f1ac00700 1 --2- 172.21.15.81:0/394731143 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f14071e40 0x7f3f14110280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:12.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.968+0000 7f3f1ac00700 1 -- 172.21.15.81:0/394731143 >> 172.21.15.81:0/394731143 conn(0x7f3f140f8580 msgr2=0x7f3f140f9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:12.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.968+0000 7f3f1ac00700 1 -- 172.21.15.81:0/394731143 shutdown_connections 2024-04-23T14:55:12.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:12.968+0000 7f3f1ac00700 1 -- 172.21.15.81:0/394731143 wait complete. 2024-04-23T14:55:12.984 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-04-23T14:55:13.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:12 smithi156 ceph-mon[77738]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-23T14:55:13.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:12 smithi156 ceph-mon[77738]: Upgrade: osd.2 is safe to restart 2024-04-23T14:55:13.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.123+0000 7fc637200700 1 -- 172.21.15.81:0/2706876328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6380ffdc0 msgr2=0x7fc6381021a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:13.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.123+0000 7fc637200700 1 --2- 172.21.15.81:0/2706876328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6380ffdc0 0x7fc6381021a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc624004940 tx=0x7fc624009e30 comp rx=0 tx=0).stop 2024-04-23T14:55:13.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.124+0000 7fc637200700 1 -- 172.21.15.81:0/2706876328 shutdown_connections 2024-04-23T14:55:13.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.124+0000 7fc637200700 1 --2- 172.21.15.81:0/2706876328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6380ffdc0 0x7fc6381021a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:13.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.124+0000 7fc637200700 1 --2- 172.21.15.81:0/2706876328 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc638066b20 0x7fc6380ff880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:13.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.124+0000 7fc637200700 1 -- 172.21.15.81:0/2706876328 >> 172.21.15.81:0/2706876328 conn(0x7fc6380f7270 msgr2=0x7fc6380f96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:13.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.124+0000 7fc637200700 1 -- 172.21.15.81:0/2706876328 shutdown_connections 2024-04-23T14:55:13.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.124+0000 7fc637200700 1 -- 172.21.15.81:0/2706876328 wait complete. 2024-04-23T14:55:13.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.124+0000 7fc637200700 1 Processor -- start 2024-04-23T14:55:13.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.125+0000 7fc637200700 1 -- start start 2024-04-23T14:55:13.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.125+0000 7fc637200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc638066b20 0x7fc63810fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:13.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.125+0000 7fc637200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6380ffdc0 0x7fc638110020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:13.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.125+0000 7fc637200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc638110620 con 0x7fc6380ffdc0 2024-04-23T14:55:13.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.125+0000 7fc637200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc638110e70 con 0x7fc638066b20 2024-04-23T14:55:13.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.125+0000 7fc635400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6380ffdc0 0x7fc638110020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:13.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.125+0000 7fc635400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6380ffdc0 0x7fc638110020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33196/0 (socket says 172.21.15.81:33196) 2024-04-23T14:55:13.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.125+0000 7fc635400700 1 -- 172.21.15.81:0/1489779159 learned_addr learned my addr 172.21.15.81:0/1489779159 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:55:13.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.126+0000 7fc635e00700 1 --2- 172.21.15.81:0/1489779159 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc638066b20 0x7fc63810fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:13.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.126+0000 7fc635400700 1 -- 172.21.15.81:0/1489779159 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc638066b20 msgr2=0x7fc63810fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:13.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.126+0000 7fc635400700 1 --2- 172.21.15.81:0/1489779159 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc638066b20 0x7fc63810fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:13.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.126+0000 7fc635400700 1 -- 172.21.15.81:0/1489779159 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc624005040 con 0x7fc6380ffdc0 2024-04-23T14:55:13.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.126+0000 7fc635400700 1 --2- 172.21.15.81:0/1489779159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6380ffdc0 0x7fc638110020 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc624009380 tx=0x7fc624009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:13.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.126+0000 7fc62e000700 1 -- 172.21.15.81:0/1489779159 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc62400e040 con 0x7fc6380ffdc0 2024-04-23T14:55:13.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.126+0000 7fc62e000700 1 -- 172.21.15.81:0/1489779159 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc62400bd90 con 0x7fc6380ffdc0 2024-04-23T14:55:13.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.126+0000 7fc637200700 1 -- 172.21.15.81:0/1489779159 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6381110f0 con 0x7fc6380ffdc0 2024-04-23T14:55:13.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.127+0000 7fc62e000700 1 -- 172.21.15.81:0/1489779159 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc62401c630 con 0x7fc6380ffdc0 2024-04-23T14:55:13.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.127+0000 7fc637200700 1 -- 172.21.15.81:0/1489779159 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc638111630 con 0x7fc6380ffdc0 2024-04-23T14:55:13.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.128+0000 7fc637200700 1 -- 172.21.15.81:0/1489779159 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6380f8e10 con 0x7fc6380ffdc0 2024-04-23T14:55:13.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.129+0000 7fc62e000700 1 -- 172.21.15.81:0/1489779159 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fc6240139f0 con 0x7fc6380ffdc0 2024-04-23T14:55:13.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.130+0000 7fc62e000700 1 --2- 172.21.15.81:0/1489779159 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc61c06ec00 0x7fc61c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:13.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.130+0000 7fc62e000700 1 -- 172.21.15.81:0/1489779159 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fc62408fd00 con 0x7fc6380ffdc0 2024-04-23T14:55:13.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.130+0000 7fc635e00700 1 --2- 172.21.15.81:0/1489779159 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc61c06ec00 0x7fc61c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:13.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.131+0000 7fc635e00700 1 --2- 172.21.15.81:0/1489779159 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc61c06ec00 0x7fc61c0710b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc628009fd0 tx=0x7fc628009f00 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:13.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.134+0000 7fc62e000700 1 -- 172.21.15.81:0/1489779159 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fc62405c610 con 0x7fc6380ffdc0 2024-04-23T14:55:13.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.385+0000 7fc637200700 1 -- 172.21.15.81:0/1489779159 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc638111910 con 0x7fc61c06ec00 2024-04-23T14:55:13.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.387+0000 7fc62e000700 1 -- 172.21.15.81:0/1489779159 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fc638111910 con 0x7fc61c06ec00 2024-04-23T14:55:13.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.390+0000 7fc637200700 1 -- 172.21.15.81:0/1489779159 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc61c06ec00 msgr2=0x7fc61c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:13.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.390+0000 7fc637200700 1 --2- 172.21.15.81:0/1489779159 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc61c06ec00 0x7fc61c0710b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc628009fd0 tx=0x7fc628009f00 comp rx=0 tx=0).stop 2024-04-23T14:55:13.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.390+0000 7fc637200700 1 -- 172.21.15.81:0/1489779159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6380ffdc0 msgr2=0x7fc638110020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.390+0000 7fc637200700 1 --2- 172.21.15.81:0/1489779159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6380ffdc0 0x7fc638110020 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc624009380 tx=0x7fc624009e30 comp rx=0 tx=0).stop 2024-04-23T14:55:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.390+0000 7fc637200700 1 -- 172.21.15.81:0/1489779159 shutdown_connections 2024-04-23T14:55:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.390+0000 7fc637200700 1 --2- 172.21.15.81:0/1489779159 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc61c06ec00 0x7fc61c0710b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.390+0000 7fc637200700 1 --2- 172.21.15.81:0/1489779159 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc638066b20 0x7fc63810fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.390+0000 7fc637200700 1 --2- 172.21.15.81:0/1489779159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6380ffdc0 0x7fc638110020 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.390+0000 7fc637200700 1 -- 172.21.15.81:0/1489779159 >> 172.21.15.81:0/1489779159 conn(0x7fc6380f7270 msgr2=0x7fc6380fb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.390+0000 7fc637200700 1 -- 172.21.15.81:0/1489779159 shutdown_connections 2024-04-23T14:55:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.390+0000 7fc637200700 1 -- 172.21.15.81:0/1489779159 wait complete. 2024-04-23T14:55:13.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.547+0000 7f7240e00700 1 -- 172.21.15.81:0/594614901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f723c0fe260 msgr2=0x7f723c0fe670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:13.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.547+0000 7f7240e00700 1 --2- 172.21.15.81:0/594614901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f723c0fe260 0x7f723c0fe670 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f722c004940 tx=0x7f722c009e30 comp rx=0 tx=0).stop 2024-04-23T14:55:13.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.547+0000 7f7240e00700 1 -- 172.21.15.81:0/594614901 shutdown_connections 2024-04-23T14:55:13.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.547+0000 7f7240e00700 1 --2- 172.21.15.81:0/594614901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f723c0febb0 0x7f723c0facf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:13.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.547+0000 7f7240e00700 1 --2- 172.21.15.81:0/594614901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f723c0fe260 0x7f723c0fe670 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:13.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.547+0000 7f7240e00700 1 -- 172.21.15.81:0/594614901 >> 172.21.15.81:0/594614901 conn(0x7f723c0f6a00 msgr2=0x7f723c0f8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:13.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.547+0000 7f7240e00700 1 -- 172.21.15.81:0/594614901 shutdown_connections 2024-04-23T14:55:13.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.548+0000 7f7240e00700 1 -- 172.21.15.81:0/594614901 wait complete. 2024-04-23T14:55:13.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.548+0000 7f7240e00700 1 Processor -- start 2024-04-23T14:55:13.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.549+0000 7f7240e00700 1 -- start start 2024-04-23T14:55:13.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.549+0000 7f7240e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f723c0fe260 0x7f723c0fda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:13.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.549+0000 7f7240e00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f723c0febb0 0x7f723c0fbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:13.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.549+0000 7f7240e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723c111560 con 0x7f723c0fe260 2024-04-23T14:55:13.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.549+0000 7f7240e00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723c1116d0 con 0x7f723c0febb0 2024-04-23T14:55:13.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.549+0000 7f723b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f723c0fe260 0x7f723c0fda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:13.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.549+0000 7f723b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f723c0fe260 0x7f723c0fda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33226/0 (socket says 172.21.15.81:33226) 2024-04-23T14:55:13.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.549+0000 7f723b400700 1 -- 172.21.15.81:0/587547826 learned_addr learned my addr 172.21.15.81:0/587547826 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:55:13.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.550+0000 7f723aa00700 1 --2- 172.21.15.81:0/587547826 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f723c0febb0 0x7f723c0fbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:13.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.550+0000 7f723b400700 1 -- 172.21.15.81:0/587547826 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f723c0febb0 msgr2=0x7f723c0fbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:13.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.550+0000 7f723b400700 1 --2- 172.21.15.81:0/587547826 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f723c0febb0 0x7f723c0fbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:13.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.550+0000 7f723b400700 1 -- 172.21.15.81:0/587547826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f722c005040 con 0x7f723c0fe260 2024-04-23T14:55:13.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.550+0000 7f723b400700 1 --2- 172.21.15.81:0/587547826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f723c0fe260 0x7f723c0fda50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f722c0090d0 tx=0x7f722c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:13.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.550+0000 7f7233400700 1 -- 172.21.15.81:0/587547826 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f722c00e040 con 0x7f723c0fe260 2024-04-23T14:55:13.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.551+0000 7f7233400700 1 -- 172.21.15.81:0/587547826 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f722c004290 con 0x7f723c0fe260 2024-04-23T14:55:13.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.551+0000 7f7240e00700 1 -- 172.21.15.81:0/587547826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f723c0fc520 con 0x7f723c0fe260 2024-04-23T14:55:13.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.551+0000 7f7240e00700 1 -- 172.21.15.81:0/587547826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f723c0fca90 con 0x7f723c0fe260 2024-04-23T14:55:13.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.551+0000 7f7233400700 1 -- 172.21.15.81:0/587547826 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f722c013420 con 0x7f723c0fe260 2024-04-23T14:55:13.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.552+0000 7f7240e00700 1 -- 172.21.15.81:0/587547826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f723c05f5f0 con 0x7f723c0fe260 2024-04-23T14:55:13.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.554+0000 7f7233400700 1 -- 172.21.15.81:0/587547826 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f722c013690 con 0x7f723c0fe260 2024-04-23T14:55:13.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.555+0000 7f7233400700 1 --2- 172.21.15.81:0/587547826 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f722006ec10 0x7f72200710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:13.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.555+0000 7f7233400700 1 -- 172.21.15.81:0/587547826 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f722c08fe10 con 0x7f723c0fe260 2024-04-23T14:55:13.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.555+0000 7f723aa00700 1 --2- 172.21.15.81:0/587547826 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f722006ec10 0x7f72200710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:13.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.556+0000 7f723aa00700 1 --2- 172.21.15.81:0/587547826 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f722006ec10 0x7f72200710c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f72280041d0 tx=0x7f7228009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:13.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.558+0000 7f7233400700 1 -- 172.21.15.81:0/587547826 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f722c058c70 con 0x7f723c0fe260 2024-04-23T14:55:13.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.799+0000 7f7240e00700 1 -- 172.21.15.81:0/587547826 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f723c1023c0 con 0x7f722006ec10 2024-04-23T14:55:13.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.820+0000 7f7233400700 1 -- 172.21.15.81:0/587547826 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f723c1023c0 con 0x7f722006ec10 2024-04-23T14:55:13.821 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-23T14:55:13.821 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (5m) 10s ago 16m 14.0M - 0.25.0 c8568f914cd2 63876b2abc27 2024-04-23T14:55:13.821 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (87s) 10s ago 16m 6665k - 19.0.0-3126-gd44fddd9 76e77f280c74 b486fe2ef19b 2024-04-23T14:55:13.821 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi156 smithi156 running (79s) 74s ago 15m 6656k - 19.0.0-3126-gd44fddd9 76e77f280c74 5d9aa5ecf264 2024-04-23T14:55:13.821 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (5m) 10s ago 15m 73.5M - 9.4.7 954c08fa6188 fbad3cef0883 2024-04-23T14:55:13.821 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.vcoywg smithi081 running (9m) 10s ago 9m 147M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 2ca7601ab60f 2024-04-23T14:55:13.821 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.wydgcg smithi081 running (9m) 10s ago 9m 107M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 58eb1a961b61 2024-04-23T14:55:13.821 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.rhbtxt smithi156 running (9m) 74s ago 9m 13.7M - 17.2.7-884-g70d0cb4b cafd8ddac8fa db3cb5034381 2024-04-23T14:55:13.821 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.vynkxn smithi156 running (9m) 74s ago 9m 13.9M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 1c8f2219e7fd 2024-04-23T14:55:13.821 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.ldghvq smithi081 *:8443,9283,8765 running (4m) 10s ago 17m 504M - 19.0.0-3126-gd44fddd9 76e77f280c74 6bf23484a1c9 2024-04-23T14:55:13.821 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi156.ounwyj smithi156 *:8443,9283,8765 running (3m) 74s ago 15m 450M - 19.0.0-3126-gd44fddd9 76e77f280c74 a6c0dd9f89f2 2024-04-23T14:55:13.821 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (3m) 10s ago 18m 44.2M 2048M 19.0.0-3126-gd44fddd9 76e77f280c74 fbf9f9a59ac2 2024-04-23T14:55:13.821 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi156 smithi156 running (2m) 74s ago 14m 32.2M 2048M 19.0.0-3126-gd44fddd9 76e77f280c74 36409886998f 2024-04-23T14:55:13.822 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (5m) 10s ago 16m 7864k - 1.5.0 0da6a335fe13 197b27809010 2024-04-23T14:55:13.822 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi156 smithi156 *:9100 running (4m) 74s ago 15m 8154k - 1.5.0 0da6a335fe13 91a7c5e86d47 2024-04-23T14:55:13.822 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (49s) 10s ago 14m 97.7M 1557M 19.0.0-3126-gd44fddd9 76e77f280c74 24bc24b37de5 2024-04-23T14:55:13.822 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (18s) 10s ago 13m 11.1M 1557M 19.0.0-3126-gd44fddd9 76e77f280c74 18d0179b558a 2024-04-23T14:55:13.822 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (12m) 10s ago 12m 217M 1557M 17.2.7-884-g70d0cb4b cafd8ddac8fa c26c640828a2 2024-04-23T14:55:13.822 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi156 running (12m) 74s ago 12m 286M 2581M 17.2.7-884-g70d0cb4b cafd8ddac8fa c1c261b1ee90 2024-04-23T14:55:13.822 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi156 running (11m) 74s ago 11m 256M 2581M 17.2.7-884-g70d0cb4b cafd8ddac8fa 83f996ee64de 2024-04-23T14:55:13.822 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi156 running (11m) 74s ago 11m 239M 2581M 17.2.7-884-g70d0cb4b cafd8ddac8fa b754244bef18 2024-04-23T14:55:13.822 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (3m) 10s ago 15m 54.7M - 2.43.0 a07b618ecd1d 35558adb166d 2024-04-23T14:55:13.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.823+0000 7f7240e00700 1 -- 172.21.15.81:0/587547826 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f722006ec10 msgr2=0x7f72200710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:13.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.823+0000 7f7240e00700 1 --2- 172.21.15.81:0/587547826 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f722006ec10 0x7f72200710c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f72280041d0 tx=0x7f7228009040 comp rx=0 tx=0).stop 2024-04-23T14:55:13.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.823+0000 7f7240e00700 1 -- 172.21.15.81:0/587547826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f723c0fe260 msgr2=0x7f723c0fda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:13.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.823+0000 7f7240e00700 1 --2- 172.21.15.81:0/587547826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f723c0fe260 0x7f723c0fda50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f722c0090d0 tx=0x7f722c009e30 comp rx=0 tx=0).stop 2024-04-23T14:55:13.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.823+0000 7f7240e00700 1 -- 172.21.15.81:0/587547826 shutdown_connections 2024-04-23T14:55:13.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.823+0000 7f7240e00700 1 --2- 172.21.15.81:0/587547826 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f722006ec10 0x7f72200710c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:13.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.823+0000 7f7240e00700 1 --2- 172.21.15.81:0/587547826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f723c0fe260 0x7f723c0fda50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:13.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.823+0000 7f7240e00700 1 --2- 172.21.15.81:0/587547826 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f723c0febb0 0x7f723c0fbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:13.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.823+0000 7f7240e00700 1 -- 172.21.15.81:0/587547826 >> 172.21.15.81:0/587547826 conn(0x7f723c0f6a00 msgr2=0x7f723c0f8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:13.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.823+0000 7f7240e00700 1 -- 172.21.15.81:0/587547826 shutdown_connections 2024-04-23T14:55:13.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.823+0000 7f7240e00700 1 -- 172.21.15.81:0/587547826 wait complete. 2024-04-23T14:55:13.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.974+0000 7f9d28400700 1 -- 172.21.15.81:0/2932643267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d20071f50 msgr2=0x7f9d20070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:13.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.974+0000 7f9d28400700 1 --2- 172.21.15.81:0/2932643267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d20071f50 0x7f9d20070460 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9d14004940 tx=0x7f9d14009e30 comp rx=0 tx=0).stop 2024-04-23T14:55:13.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.974+0000 7f9d28400700 1 -- 172.21.15.81:0/2932643267 shutdown_connections 2024-04-23T14:55:13.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.974+0000 7f9d28400700 1 --2- 172.21.15.81:0/2932643267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d200709a0 0x7f9d20070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:13.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.974+0000 7f9d28400700 1 --2- 172.21.15.81:0/2932643267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d20071f50 0x7f9d20070460 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:13.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.974+0000 7f9d28400700 1 -- 172.21.15.81:0/2932643267 >> 172.21.15.81:0/2932643267 conn(0x7f9d200f8530 msgr2=0x7f9d200fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:13.976 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:13 smithi081 ceph-mon[90469]: pgmap v96: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-04-23T14:55:13.976 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:13 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:13.976 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:13 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-23T14:55:13.976 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:13 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:55:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.975+0000 7f9d28400700 1 -- 172.21.15.81:0/2932643267 shutdown_connections 2024-04-23T14:55:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.975+0000 7f9d28400700 1 -- 172.21.15.81:0/2932643267 wait complete. 2024-04-23T14:55:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.976+0000 7f9d28400700 1 Processor -- start 2024-04-23T14:55:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.976+0000 7f9d28400700 1 -- start start 2024-04-23T14:55:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.976+0000 7f9d28400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d200709a0 0x7f9d2010fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.976+0000 7f9d28400700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d20071f50 0x7f9d20110290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.976+0000 7f9d28400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d20110890 con 0x7f9d200709a0 2024-04-23T14:55:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.976+0000 7f9d28400700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d20110fd0 con 0x7f9d20071f50 2024-04-23T14:55:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.977+0000 7f9d25a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d200709a0 0x7f9d2010fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.977+0000 7f9d25a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d200709a0 0x7f9d2010fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39190/0 (socket says 172.21.15.81:39190) 2024-04-23T14:55:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.977+0000 7f9d25a00700 1 -- 172.21.15.81:0/464387423 learned_addr learned my addr 172.21.15.81:0/464387423 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:55:13.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.977+0000 7f9d25000700 1 --2- 172.21.15.81:0/464387423 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d20071f50 0x7f9d20110290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:13.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.977+0000 7f9d25a00700 1 -- 172.21.15.81:0/464387423 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d20071f50 msgr2=0x7f9d20110290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:13.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.977+0000 7f9d25a00700 1 --2- 172.21.15.81:0/464387423 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d20071f50 0x7f9d20110290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:13.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.977+0000 7f9d25a00700 1 -- 172.21.15.81:0/464387423 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d14005040 con 0x7f9d200709a0 2024-04-23T14:55:13.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.977+0000 7f9d25a00700 1 --2- 172.21.15.81:0/464387423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d200709a0 0x7f9d2010fd50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9d1400b970 tx=0x7f9d14009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:13.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.978+0000 7f9d1d600700 1 -- 172.21.15.81:0/464387423 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d1400e040 con 0x7f9d200709a0 2024-04-23T14:55:13.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.978+0000 7f9d1d600700 1 -- 172.21.15.81:0/464387423 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9d1400bbf0 con 0x7f9d200709a0 2024-04-23T14:55:13.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.978+0000 7f9d28400700 1 -- 172.21.15.81:0/464387423 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d20111250 con 0x7f9d200709a0 2024-04-23T14:55:13.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.978+0000 7f9d1d600700 1 -- 172.21.15.81:0/464387423 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d1401c630 con 0x7f9d200709a0 2024-04-23T14:55:13.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.978+0000 7f9d28400700 1 -- 172.21.15.81:0/464387423 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d20111810 con 0x7f9d200709a0 2024-04-23T14:55:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.980+0000 7f9d28400700 1 -- 172.21.15.81:0/464387423 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d2005f5f0 con 0x7f9d200709a0 2024-04-23T14:55:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.980+0000 7f9d1d600700 1 -- 172.21.15.81:0/464387423 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f9d1400bd60 con 0x7f9d200709a0 2024-04-23T14:55:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.981+0000 7f9d1d600700 1 --2- 172.21.15.81:0/464387423 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f9d0806ec10 0x7f9d080710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.982+0000 7f9d1d600700 1 -- 172.21.15.81:0/464387423 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f9d1408fbd0 con 0x7f9d200709a0 2024-04-23T14:55:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.982+0000 7f9d25000700 1 --2- 172.21.15.81:0/464387423 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f9d0806ec10 0x7f9d080710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.982+0000 7f9d25000700 1 --2- 172.21.15.81:0/464387423 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f9d0806ec10 0x7f9d080710c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c004d60 tx=0x7f9d0c00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:13.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:13.986+0000 7f9d1d600700 1 -- 172.21.15.81:0/464387423 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f9d1405c560 con 0x7f9d200709a0 2024-04-23T14:55:14.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:13 smithi156 ceph-mon[77738]: pgmap v96: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-04-23T14:55:14.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:13 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:14.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:13 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-23T14:55:14.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:13 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:55:14.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.331+0000 7f9d28400700 1 -- 172.21.15.81:0/464387423 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9d20107bb0 con 0x7f9d200709a0 2024-04-23T14:55:14.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.332+0000 7f9d1d600700 1 -- 172.21.15.81:0/464387423 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f9d1405c0f0 con 0x7f9d200709a0 2024-04-23T14:55:14.332 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:55:14.333 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-04-23T14:55:14.333 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T14:55:14.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:55:14.333 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-04-23T14:55:14.333 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T14:55:14.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:55:14.333 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-04-23T14:55:14.333 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 4, 2024-04-23T14:55:14.333 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T14:55:14.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:55:14.333 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-04-23T14:55:14.333 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 4 2024-04-23T14:55:14.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:55:14.333 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-04-23T14:55:14.334 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 8, 2024-04-23T14:55:14.334 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 6 2024-04-23T14:55:14.334 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-23T14:55:14.334 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:55:14.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.336+0000 7f9d28400700 1 -- 172.21.15.81:0/464387423 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f9d0806ec10 msgr2=0x7f9d080710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:14.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.336+0000 7f9d28400700 1 --2- 172.21.15.81:0/464387423 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f9d0806ec10 0x7f9d080710c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c004d60 tx=0x7f9d0c00b040 comp rx=0 tx=0).stop 2024-04-23T14:55:14.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.336+0000 7f9d28400700 1 -- 172.21.15.81:0/464387423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d200709a0 msgr2=0x7f9d2010fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:14.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.336+0000 7f9d28400700 1 --2- 172.21.15.81:0/464387423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d200709a0 0x7f9d2010fd50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9d1400b970 tx=0x7f9d14009e30 comp rx=0 tx=0).stop 2024-04-23T14:55:14.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.336+0000 7f9d28400700 1 -- 172.21.15.81:0/464387423 shutdown_connections 2024-04-23T14:55:14.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.336+0000 7f9d28400700 1 --2- 172.21.15.81:0/464387423 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f9d0806ec10 0x7f9d080710c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:14.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.336+0000 7f9d28400700 1 --2- 172.21.15.81:0/464387423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d200709a0 0x7f9d2010fd50 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:14.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.336+0000 7f9d28400700 1 --2- 172.21.15.81:0/464387423 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d20071f50 0x7f9d20110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:14.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.336+0000 7f9d28400700 1 -- 172.21.15.81:0/464387423 >> 172.21.15.81:0/464387423 conn(0x7f9d200f8530 msgr2=0x7f9d200f9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:14.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.336+0000 7f9d28400700 1 -- 172.21.15.81:0/464387423 shutdown_connections 2024-04-23T14:55:14.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.336+0000 7f9d28400700 1 -- 172.21.15.81:0/464387423 wait complete. 2024-04-23T14:55:14.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.487+0000 7f874ba00700 1 -- 172.21.15.81:0/2036722283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87440fe040 msgr2=0x7f87440fe4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:14.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.487+0000 7f874ba00700 1 --2- 172.21.15.81:0/2036722283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87440fe040 0x7f87440fe4b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8730004940 tx=0x7f8730009e30 comp rx=0 tx=0).stop 2024-04-23T14:55:14.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.487+0000 7f874ba00700 1 -- 172.21.15.81:0/2036722283 shutdown_connections 2024-04-23T14:55:14.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.487+0000 7f874ba00700 1 --2- 172.21.15.81:0/2036722283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87440fe040 0x7f87440fe4b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:14.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.487+0000 7f874ba00700 1 --2- 172.21.15.81:0/2036722283 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87440fce40 0x7f87440fd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:14.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.487+0000 7f874ba00700 1 -- 172.21.15.81:0/2036722283 >> 172.21.15.81:0/2036722283 conn(0x7f87440f8530 msgr2=0x7f87440fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:14.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.487+0000 7f874ba00700 1 -- 172.21.15.81:0/2036722283 shutdown_connections 2024-04-23T14:55:14.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.487+0000 7f874ba00700 1 -- 172.21.15.81:0/2036722283 wait complete. 2024-04-23T14:55:14.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.488+0000 7f874ba00700 1 Processor -- start 2024-04-23T14:55:14.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.488+0000 7f874ba00700 1 -- start start 2024-04-23T14:55:14.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.488+0000 7f874ba00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87440fce40 0x7f8744071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:14.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.488+0000 7f874ba00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87440fe040 0x7f8744070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:14.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.488+0000 7f874ba00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87440708c0 con 0x7f87440fe040 2024-04-23T14:55:14.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.489+0000 7f874ba00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8744070a30 con 0x7f87440fce40 2024-04-23T14:55:14.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.489+0000 7f8743e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87440fe040 0x7f8744070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:14.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.489+0000 7f8743e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87440fe040 0x7f8744070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39198/0 (socket says 172.21.15.81:39198) 2024-04-23T14:55:14.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.489+0000 7f8743e00700 1 -- 172.21.15.81:0/3179569398 learned_addr learned my addr 172.21.15.81:0/3179569398 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:55:14.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.489+0000 7f8749000700 1 --2- 172.21.15.81:0/3179569398 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87440fce40 0x7f8744071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:14.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.489+0000 7f8743e00700 1 -- 172.21.15.81:0/3179569398 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87440fce40 msgr2=0x7f8744071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:14.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.489+0000 7f8743e00700 1 --2- 172.21.15.81:0/3179569398 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87440fce40 0x7f8744071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:14.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.489+0000 7f8743e00700 1 -- 172.21.15.81:0/3179569398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8730005040 con 0x7f87440fe040 2024-04-23T14:55:14.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.490+0000 7f8743e00700 1 --2- 172.21.15.81:0/3179569398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87440fe040 0x7f8744070310 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f873000b3b0 tx=0x7f8730009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:14.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.490+0000 7f8740c00700 1 -- 172.21.15.81:0/3179569398 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f873000e040 con 0x7f87440fe040 2024-04-23T14:55:14.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.490+0000 7f8740c00700 1 -- 172.21.15.81:0/3179569398 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8730004290 con 0x7f87440fe040 2024-04-23T14:55:14.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.490+0000 7f874ba00700 1 -- 172.21.15.81:0/3179569398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8744070cb0 con 0x7f87440fe040 2024-04-23T14:55:14.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.490+0000 7f8740c00700 1 -- 172.21.15.81:0/3179569398 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f873001c630 con 0x7f87440fe040 2024-04-23T14:55:14.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.490+0000 7f874ba00700 1 -- 172.21.15.81:0/3179569398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8744115a70 con 0x7f87440fe040 2024-04-23T14:55:14.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.491+0000 7f874ba00700 1 -- 172.21.15.81:0/3179569398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f874405f5f0 con 0x7f87440fe040 2024-04-23T14:55:14.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.492+0000 7f8740c00700 1 -- 172.21.15.81:0/3179569398 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f873000bbf0 con 0x7f87440fe040 2024-04-23T14:55:14.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.493+0000 7f8740c00700 1 --2- 172.21.15.81:0/3179569398 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f872c06ec10 0x7f872c0710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:14.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.493+0000 7f8740c00700 1 -- 172.21.15.81:0/3179569398 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f873008fd10 con 0x7f87440fe040 2024-04-23T14:55:14.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.493+0000 7f8749000700 1 --2- 172.21.15.81:0/3179569398 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f872c06ec10 0x7f872c0710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:14.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.494+0000 7f8749000700 1 --2- 172.21.15.81:0/3179569398 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f872c06ec10 0x7f872c0710c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8738007fd0 tx=0x7f8738009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:14.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.498+0000 7f8740c00700 1 -- 172.21.15.81:0/3179569398 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f8730058af0 con 0x7f87440fe040 2024-04-23T14:55:14.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.786+0000 7f874ba00700 1 -- 172.21.15.81:0/3179569398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8744115cc0 con 0x7f87440fe040 2024-04-23T14:55:14.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.787+0000 7f8740c00700 1 -- 172.21.15.81:0/3179569398 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1907 (secure 0 0 0) 0x7f873005c1b0 con 0x7f87440fe040 2024-04-23T14:55:14.788 INFO:teuthology.orchestra.run.smithi081.stdout:e18 2024-04-23T14:55:14.788 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-23T14:55:14.788 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:55:14.788 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-04-23T14:55:14.789 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:55:14.789 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-04-23T14:55:14.789 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-04-23T14:55:14.789 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 17 2024-04-23T14:55:14.789 INFO:teuthology.orchestra.run.smithi081.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-23T14:55:14.789 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-04-23T14:45:51.264703+0000 2024-04-23T14:55:14.789 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-04-23T14:46:12.782992+0000 2024-04-23T14:55:14.789 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-04-23T14:55:14.790 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-04-23T14:55:14.790 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-04-23T14:55:14.790 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-04-23T14:55:14.790 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-04-23T14:55:14.790 INFO:teuthology.orchestra.run.smithi081.stdout:max_xattr_size 65536 2024-04-23T14:55:14.790 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-04-23T14:55:14.790 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-04-23T14:55:14.791 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 47 2024-04-23T14:55:14.791 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:55:14.791 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 1 2024-04-23T14:55:14.791 INFO:teuthology.orchestra.run.smithi081.stdout:in 0 2024-04-23T14:55:14.791 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=14472} 2024-04-23T14:55:14.791 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-04-23T14:55:14.792 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-04-23T14:55:14.792 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-04-23T14:55:14.792 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-04-23T14:55:14.792 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-04-23T14:55:14.792 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-04-23T14:55:14.792 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-04-23T14:55:14.792 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-04-23T14:55:14.793 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-04-23T14:55:14.793 INFO:teuthology.orchestra.run.smithi081.stdout:qdb_cluster leader: 0 members: 2024-04-23T14:55:14.793 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.vcoywg{0:14472} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.81:6828/2563365650,v1:172.21.15.81:6829/2563365650] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:55:14.793 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.wydgcg{0:14482} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.81:6826/759909104,v1:172.21.15.81:6827/759909104] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:55:14.793 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:55:14.793 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:55:14.794 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-04-23T14:55:14.794 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:55:14.794 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.vynkxn{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.156:6826/1794690362,v1:172.21.15.156:6827/1794690362] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:55:14.794 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.rhbtxt{-1:24263} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.156:6824/3854041261,v1:172.21.15.156:6825/3854041261] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:55:14.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.790+0000 7f874ba00700 1 -- 172.21.15.81:0/3179569398 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f872c06ec10 msgr2=0x7f872c0710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:14.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.790+0000 7f874ba00700 1 --2- 172.21.15.81:0/3179569398 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f872c06ec10 0x7f872c0710c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8738007fd0 tx=0x7f8738009040 comp rx=0 tx=0).stop 2024-04-23T14:55:14.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.790+0000 7f874ba00700 1 -- 172.21.15.81:0/3179569398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87440fe040 msgr2=0x7f8744070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:14.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.790+0000 7f874ba00700 1 --2- 172.21.15.81:0/3179569398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87440fe040 0x7f8744070310 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f873000b3b0 tx=0x7f8730009e30 comp rx=0 tx=0).stop 2024-04-23T14:55:14.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.790+0000 7f874ba00700 1 -- 172.21.15.81:0/3179569398 shutdown_connections 2024-04-23T14:55:14.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.790+0000 7f874ba00700 1 --2- 172.21.15.81:0/3179569398 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f872c06ec10 0x7f872c0710c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:14.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.790+0000 7f874ba00700 1 --2- 172.21.15.81:0/3179569398 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87440fce40 0x7f8744071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:14.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.790+0000 7f874ba00700 1 --2- 172.21.15.81:0/3179569398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87440fe040 0x7f8744070310 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:14.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.790+0000 7f874ba00700 1 -- 172.21.15.81:0/3179569398 >> 172.21.15.81:0/3179569398 conn(0x7f87440f8530 msgr2=0x7f87440f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:14.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.790+0000 7f874ba00700 1 -- 172.21.15.81:0/3179569398 shutdown_connections 2024-04-23T14:55:14.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.791+0000 7f874ba00700 1 -- 172.21.15.81:0/3179569398 wait complete. 2024-04-23T14:55:14.797 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 18 2024-04-23T14:55:14.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.935+0000 7f45fcc00700 1 -- 172.21.15.81:0/1494421973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45f81046b0 msgr2=0x7f45f8104b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:14.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.935+0000 7f45fcc00700 1 --2- 172.21.15.81:0/1494421973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45f81046b0 0x7f45f8104b20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f45e4004940 tx=0x7f45e4009e30 comp rx=0 tx=0).stop 2024-04-23T14:55:14.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.935+0000 7f45fcc00700 1 -- 172.21.15.81:0/1494421973 shutdown_connections 2024-04-23T14:55:14.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.935+0000 7f45fcc00700 1 --2- 172.21.15.81:0/1494421973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45f81046b0 0x7f45f8104b20 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:14.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.935+0000 7f45fcc00700 1 --2- 172.21.15.81:0/1494421973 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45f8103400 0x7f45f8103810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:14.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.935+0000 7f45fcc00700 1 -- 172.21.15.81:0/1494421973 >> 172.21.15.81:0/1494421973 conn(0x7f45f80725e0 msgr2=0x7f45f8074a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:14.936 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:14 smithi081 ceph-mon[90469]: from='client.34278 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:55:14.936 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:14 smithi081 ceph-mon[90469]: from='client.34282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:55:14.936 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:14 smithi081 ceph-mon[90469]: Upgrade: Updating osd.2 2024-04-23T14:55:14.936 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:14 smithi081 ceph-mon[90469]: Deploying daemon osd.2 on smithi081 2024-04-23T14:55:14.936 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:14 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/464387423' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:55:14.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.935+0000 7f45fcc00700 1 -- 172.21.15.81:0/1494421973 shutdown_connections 2024-04-23T14:55:14.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.935+0000 7f45fcc00700 1 -- 172.21.15.81:0/1494421973 wait complete. 2024-04-23T14:55:14.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.936+0000 7f45fcc00700 1 Processor -- start 2024-04-23T14:55:14.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.936+0000 7f45fcc00700 1 -- start start 2024-04-23T14:55:14.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.936+0000 7f45fcc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45f8103400 0x7f45f8113ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:14.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.936+0000 7f45fcc00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45f81046b0 0x7f45f8114410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:14.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.936+0000 7f45fcc00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f8114aa0 con 0x7f45f8103400 2024-04-23T14:55:14.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.936+0000 7f45fcc00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f8119440 con 0x7f45f81046b0 2024-04-23T14:55:14.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.937+0000 7f45f5e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45f8103400 0x7f45f8113ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:14.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.937+0000 7f45f5e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45f8103400 0x7f45f8113ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39220/0 (socket says 172.21.15.81:39220) 2024-04-23T14:55:14.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.937+0000 7f45f5e00700 1 -- 172.21.15.81:0/3491756102 learned_addr learned my addr 172.21.15.81:0/3491756102 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:55:14.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.937+0000 7f45f5400700 1 --2- 172.21.15.81:0/3491756102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45f81046b0 0x7f45f8114410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:14.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.937+0000 7f45f5e00700 1 -- 172.21.15.81:0/3491756102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45f81046b0 msgr2=0x7f45f8114410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:14.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.937+0000 7f45f5e00700 1 --2- 172.21.15.81:0/3491756102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45f81046b0 0x7f45f8114410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:14.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.937+0000 7f45f5e00700 1 -- 172.21.15.81:0/3491756102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e4005040 con 0x7f45f8103400 2024-04-23T14:55:14.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.938+0000 7f45f5e00700 1 --2- 172.21.15.81:0/3491756102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45f8103400 0x7f45f8113ed0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f45e800b790 tx=0x7f45e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:14.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.938+0000 7f45ee000700 1 -- 172.21.15.81:0/3491756102 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45e800f770 con 0x7f45f8103400 2024-04-23T14:55:14.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.938+0000 7f45ee000700 1 -- 172.21.15.81:0/3491756102 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f45e800fda0 con 0x7f45f8103400 2024-04-23T14:55:14.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.938+0000 7f45ee000700 1 -- 172.21.15.81:0/3491756102 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45e800d310 con 0x7f45f8103400 2024-04-23T14:55:14.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.938+0000 7f45fcc00700 1 -- 172.21.15.81:0/3491756102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f81196a0 con 0x7f45f8103400 2024-04-23T14:55:14.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.938+0000 7f45fcc00700 1 -- 172.21.15.81:0/3491756102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f8119be0 con 0x7f45f8103400 2024-04-23T14:55:14.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.939+0000 7f45fcc00700 1 -- 172.21.15.81:0/3491756102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f804c710 con 0x7f45f8103400 2024-04-23T14:55:14.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.941+0000 7f45ee000700 1 -- 172.21.15.81:0/3491756102 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f45e8010420 con 0x7f45f8103400 2024-04-23T14:55:14.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.941+0000 7f45ee000700 1 --2- 172.21.15.81:0/3491756102 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f45dc06ec00 0x7f45dc0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:14.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.942+0000 7f45ee000700 1 -- 172.21.15.81:0/3491756102 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f45e808e920 con 0x7f45f8103400 2024-04-23T14:55:14.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.942+0000 7f45f5400700 1 --2- 172.21.15.81:0/3491756102 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f45dc06ec00 0x7f45dc0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:14.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.943+0000 7f45f5400700 1 --2- 172.21.15.81:0/3491756102 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f45dc06ec00 0x7f45dc0710b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f45e400b970 tx=0x7f45e4009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:14.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:14.946+0000 7f45ee000700 1 -- 172.21.15.81:0/3491756102 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f45e805b230 con 0x7f45f8103400 2024-04-23T14:55:15.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:14 smithi156 ceph-mon[77738]: from='client.34278 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:55:15.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:14 smithi156 ceph-mon[77738]: from='client.34282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:55:15.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:14 smithi156 ceph-mon[77738]: Upgrade: Updating osd.2 2024-04-23T14:55:15.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:14 smithi156 ceph-mon[77738]: Deploying daemon osd.2 on smithi081 2024-04-23T14:55:15.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:14 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/464387423' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:55:15.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.196+0000 7f45fcc00700 1 -- 172.21.15.81:0/3491756102 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f45f81088f0 con 0x7f45dc06ec00 2024-04-23T14:55:15.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.198+0000 7f45ee000700 1 -- 172.21.15.81:0/3491756102 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f45f81088f0 con 0x7f45dc06ec00 2024-04-23T14:55:15.199 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:55:15.199 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd", 2024-04-23T14:55:15.199 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-04-23T14:55:15.199 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-23T14:55:15.199 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [ 2024-04-23T14:55:15.199 INFO:teuthology.orchestra.run.smithi081.stdout: "mon", 2024-04-23T14:55:15.199 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-04-23T14:55:15.200 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr" 2024-04-23T14:55:15.200 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-04-23T14:55:15.200 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "8/21 daemons upgraded", 2024-04-23T14:55:15.200 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "Currently upgrading osd daemons", 2024-04-23T14:55:15.200 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-04-23T14:55:15.200 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:55:15.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.201+0000 7f45fcc00700 1 -- 172.21.15.81:0/3491756102 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f45dc06ec00 msgr2=0x7f45dc0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:15.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.201+0000 7f45fcc00700 1 --2- 172.21.15.81:0/3491756102 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f45dc06ec00 0x7f45dc0710b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f45e400b970 tx=0x7f45e4009e30 comp rx=0 tx=0).stop 2024-04-23T14:55:15.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.201+0000 7f45fcc00700 1 -- 172.21.15.81:0/3491756102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45f8103400 msgr2=0x7f45f8113ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:15.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.201+0000 7f45fcc00700 1 --2- 172.21.15.81:0/3491756102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45f8103400 0x7f45f8113ed0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f45e800b790 tx=0x7f45e8009250 comp rx=0 tx=0).stop 2024-04-23T14:55:15.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.201+0000 7f45fcc00700 1 -- 172.21.15.81:0/3491756102 shutdown_connections 2024-04-23T14:55:15.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.201+0000 7f45fcc00700 1 --2- 172.21.15.81:0/3491756102 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f45dc06ec00 0x7f45dc0710b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:15.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.201+0000 7f45fcc00700 1 --2- 172.21.15.81:0/3491756102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45f8103400 0x7f45f8113ed0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:15.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.201+0000 7f45fcc00700 1 --2- 172.21.15.81:0/3491756102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45f81046b0 0x7f45f8114410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:15.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.201+0000 7f45fcc00700 1 -- 172.21.15.81:0/3491756102 >> 172.21.15.81:0/3491756102 conn(0x7f45f80725e0 msgr2=0x7f45f8073c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:15.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.202+0000 7f45fcc00700 1 -- 172.21.15.81:0/3491756102 shutdown_connections 2024-04-23T14:55:15.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.202+0000 7f45fcc00700 1 -- 172.21.15.81:0/3491756102 wait complete. 2024-04-23T14:55:15.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.356+0000 7f391fc00700 1 -- 172.21.15.81:0/2481563609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3918103420 msgr2=0x7f3918103830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:15.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.356+0000 7f391fc00700 1 --2- 172.21.15.81:0/2481563609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3918103420 0x7f3918103830 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f390c004940 tx=0x7f390c009e30 comp rx=0 tx=0).stop 2024-04-23T14:55:15.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.356+0000 7f391fc00700 1 -- 172.21.15.81:0/2481563609 shutdown_connections 2024-04-23T14:55:15.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.356+0000 7f391fc00700 1 --2- 172.21.15.81:0/2481563609 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39181046d0 0x7f3918104b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:15.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.356+0000 7f391fc00700 1 --2- 172.21.15.81:0/2481563609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3918103420 0x7f3918103830 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:15.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.356+0000 7f391fc00700 1 -- 172.21.15.81:0/2481563609 >> 172.21.15.81:0/2481563609 conn(0x7f3918072640 msgr2=0x7f3918074a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:15.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.356+0000 7f391fc00700 1 -- 172.21.15.81:0/2481563609 shutdown_connections 2024-04-23T14:55:15.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.356+0000 7f391fc00700 1 -- 172.21.15.81:0/2481563609 wait complete. 2024-04-23T14:55:15.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.357+0000 7f391fc00700 1 Processor -- start 2024-04-23T14:55:15.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.358+0000 7f391fc00700 1 -- start start 2024-04-23T14:55:15.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.358+0000 7f391fc00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3918103420 0x7f3918113f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:15.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.358+0000 7f391fc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39181046d0 0x7f39181144a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:15.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.358+0000 7f391fc00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3918114aa0 con 0x7f39181046d0 2024-04-23T14:55:15.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.358+0000 7f391fc00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3918114c10 con 0x7f3918103420 2024-04-23T14:55:15.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.358+0000 7f3917e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39181046d0 0x7f39181144a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:15.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.358+0000 7f3917e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39181046d0 0x7f39181144a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39242/0 (socket says 172.21.15.81:39242) 2024-04-23T14:55:15.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.358+0000 7f3917e00700 1 -- 172.21.15.81:0/3932473688 learned_addr learned my addr 172.21.15.81:0/3932473688 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:55:15.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.359+0000 7f391d200700 1 --2- 172.21.15.81:0/3932473688 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3918103420 0x7f3918113f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:15.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.359+0000 7f3917e00700 1 -- 172.21.15.81:0/3932473688 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3918103420 msgr2=0x7f3918113f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:15.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.359+0000 7f3917e00700 1 --2- 172.21.15.81:0/3932473688 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3918103420 0x7f3918113f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:15.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.359+0000 7f3917e00700 1 -- 172.21.15.81:0/3932473688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390c005040 con 0x7f39181046d0 2024-04-23T14:55:15.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.359+0000 7f3917e00700 1 --2- 172.21.15.81:0/3932473688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39181046d0 0x7f39181144a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3904002a50 tx=0x7f39040046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:15.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.359+0000 7f3914c00700 1 -- 172.21.15.81:0/3932473688 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3904007cc0 con 0x7f39181046d0 2024-04-23T14:55:15.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.360+0000 7f3914c00700 1 -- 172.21.15.81:0/3932473688 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f390400f040 con 0x7f39181046d0 2024-04-23T14:55:15.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.360+0000 7f3914c00700 1 -- 172.21.15.81:0/3932473688 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3904009640 con 0x7f39181046d0 2024-04-23T14:55:15.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.360+0000 7f391fc00700 1 -- 172.21.15.81:0/3932473688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3918119670 con 0x7f39181046d0 2024-04-23T14:55:15.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.360+0000 7f391fc00700 1 -- 172.21.15.81:0/3932473688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3918119c30 con 0x7f39181046d0 2024-04-23T14:55:15.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.361+0000 7f391fc00700 1 -- 172.21.15.81:0/3932473688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f391804c710 con 0x7f39181046d0 2024-04-23T14:55:15.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.362+0000 7f3914c00700 1 -- 172.21.15.81:0/3932473688 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f39040097a0 con 0x7f39181046d0 2024-04-23T14:55:15.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.364+0000 7f3914c00700 1 --2- 172.21.15.81:0/3932473688 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f390006ecd0 0x7f3900071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:15.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.364+0000 7f3914c00700 1 -- 172.21.15.81:0/3932473688 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f390408e600 con 0x7f39181046d0 2024-04-23T14:55:15.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.364+0000 7f391d200700 1 --2- 172.21.15.81:0/3932473688 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f390006ecd0 0x7f3900071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:15.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.365+0000 7f391d200700 1 --2- 172.21.15.81:0/3932473688 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f390006ecd0 0x7f3900071180 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f390c00b3b0 tx=0x7f390c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:15.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.368+0000 7f3914c00700 1 -- 172.21.15.81:0/3932473688 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f390405af10 con 0x7f39181046d0 2024-04-23T14:55:15.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.682+0000 7f391fc00700 1 -- 172.21.15.81:0/3932473688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f391810bf10 con 0x7f39181046d0 2024-04-23T14:55:15.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.682+0000 7f3914c00700 1 -- 172.21.15.81:0/3932473688 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f390405aaa0 con 0x7f39181046d0 2024-04-23T14:55:15.683 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-04-23T14:55:15.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.685+0000 7f391fc00700 1 -- 172.21.15.81:0/3932473688 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f390006ecd0 msgr2=0x7f3900071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:15.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.685+0000 7f391fc00700 1 --2- 172.21.15.81:0/3932473688 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f390006ecd0 0x7f3900071180 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f390c00b3b0 tx=0x7f390c009e30 comp rx=0 tx=0).stop 2024-04-23T14:55:15.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.685+0000 7f391fc00700 1 -- 172.21.15.81:0/3932473688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39181046d0 msgr2=0x7f39181144a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:15.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.685+0000 7f391fc00700 1 --2- 172.21.15.81:0/3932473688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39181046d0 0x7f39181144a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3904002a50 tx=0x7f39040046b0 comp rx=0 tx=0).stop 2024-04-23T14:55:15.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.686+0000 7f391fc00700 1 -- 172.21.15.81:0/3932473688 shutdown_connections 2024-04-23T14:55:15.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.686+0000 7f391fc00700 1 --2- 172.21.15.81:0/3932473688 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f390006ecd0 0x7f3900071180 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:15.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.686+0000 7f391fc00700 1 --2- 172.21.15.81:0/3932473688 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3918103420 0x7f3918113f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:15.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.686+0000 7f391fc00700 1 --2- 172.21.15.81:0/3932473688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39181046d0 0x7f39181144a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:15.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.686+0000 7f391fc00700 1 -- 172.21.15.81:0/3932473688 >> 172.21.15.81:0/3932473688 conn(0x7f3918072640 msgr2=0x7f3918073d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:15.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.686+0000 7f391fc00700 1 -- 172.21.15.81:0/3932473688 shutdown_connections 2024-04-23T14:55:15.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:15.686+0000 7f391fc00700 1 -- 172.21.15.81:0/3932473688 wait complete. 2024-04-23T14:55:15.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:15 smithi081 ceph-mon[90469]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:55:15.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:15 smithi081 ceph-mon[90469]: pgmap v97: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-23T14:55:15.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:15 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/3179569398' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:55:16.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:15 smithi156 ceph-mon[77738]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:55:16.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:15 smithi156 ceph-mon[77738]: pgmap v97: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-23T14:55:16.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:15 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/3179569398' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:55:17.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:16 smithi156 ceph-mon[77738]: from='client.34298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:55:17.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:16 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/3932473688' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:55:17.055 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:16 smithi081 ceph-mon[90469]: from='client.34298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:55:17.055 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:16 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/3932473688' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:55:17.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:17 smithi081 ceph-mon[90469]: pgmap v98: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-23T14:55:18.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:17 smithi156 ceph-mon[77738]: pgmap v98: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-23T14:55:18.576 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:18 smithi081 systemd[1]: Stopping Ceph osd.2 for 7a641bea-017e-11ef-bc93-c7b262605968... 2024-04-23T14:55:19.077 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:18 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2[58883]: 2024-04-23T14:55:18.678+0000 7fc3a2000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T14:55:19.077 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:18 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2[58883]: 2024-04-23T14:55:18.678+0000 7fc3a2000700 -1 osd.2 60 *** Got signal Terminated *** 2024-04-23T14:55:19.077 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:18 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2[58883]: 2024-04-23T14:55:18.678+0000 7fc3a2000700 -1 osd.2 60 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-23T14:55:20.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:19 smithi156 ceph-mon[77738]: pgmap v99: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-23T14:55:20.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:19 smithi156 ceph-mon[77738]: osd.2 marked itself down and dead 2024-04-23T14:55:20.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:19 smithi081 ceph-mon[90469]: pgmap v99: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-23T14:55:20.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:19 smithi081 ceph-mon[90469]: osd.2 marked itself down and dead 2024-04-23T14:55:20.620 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:20 smithi081 podman[109657]: 2024-04-23 14:55:20.33436464 +0000 UTC m=+1.784790027 container died c26c640828a25790913587354eeaad4e257a26f1339040ce40934e55b1bde5df (image=quay.ceph.io/ceph-ci/ceph@sha256:3890cd726bd5e73ae623dabdf4ed76dd5df81c936b8bd8d761026babda969466, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, RELEASE=quincy-70d0cb4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-04-23T14:55:21.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:20 smithi156 ceph-mon[77738]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-23T14:55:21.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:20 smithi156 ceph-mon[77738]: osdmap e61: 6 total, 5 up, 6 in 2024-04-23T14:55:21.074 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:20 smithi081 ceph-mon[90469]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-23T14:55:21.074 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:20 smithi081 ceph-mon[90469]: osdmap e61: 6 total, 5 up, 6 in 2024-04-23T14:55:21.075 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:20 smithi081 podman[109657]: 2024-04-23 14:55:20.83926698 +0000 UTC m=+2.289692367 container cleanup c26c640828a25790913587354eeaad4e257a26f1339040ce40934e55b1bde5df (image=quay.ceph.io/ceph-ci/ceph@sha256:3890cd726bd5e73ae623dabdf4ed76dd5df81c936b8bd8d761026babda969466, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2, RELEASE=quincy-70d0cb4, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T14:55:21.075 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:20 smithi081 bash[109657]: ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2 2024-04-23T14:55:21.326 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:21 smithi081 podman[109676]: 2024-04-23 14:55:21.074128391 +0000 UTC m=+0.721815176 container remove c26c640828a25790913587354eeaad4e257a26f1339040ce40934e55b1bde5df (image=quay.ceph.io/ceph-ci/ceph@sha256:3890cd726bd5e73ae623dabdf4ed76dd5df81c936b8bd8d761026babda969466, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, RELEASE=quincy-70d0cb4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0) 2024-04-23T14:55:22.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:21 smithi156 ceph-mon[77738]: pgmap v101: 65 pgs: 9 stale+active+clean, 56 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-23T14:55:22.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:21 smithi156 ceph-mon[77738]: osdmap e62: 6 total, 5 up, 6 in 2024-04-23T14:55:22.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:21 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:22.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:21 smithi081 ceph-mon[90469]: pgmap v101: 65 pgs: 9 stale+active+clean, 56 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-23T14:55:22.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:21 smithi081 ceph-mon[90469]: osdmap e62: 6 total, 5 up, 6 in 2024-04-23T14:55:22.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:21 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:22.077 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:21 smithi081 podman[109764]: 2024-04-23 14:55:21.891756049 +0000 UTC m=+0.126644442 container create 7fec543a9d132ea909fef919a2dc9e234c66c33232b8b02c0283777225a19135 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2-deactivate, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-04-23T14:55:22.077 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:21 smithi081 podman[109764]: 2024-04-23 14:55:21.797939379 +0000 UTC m=+0.032827736 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T14:55:22.576 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:22 smithi081 podman[109764]: 2024-04-23 14:55:22.204043614 +0000 UTC m=+0.438932013 container init 7fec543a9d132ea909fef919a2dc9e234c66c33232b8b02c0283777225a19135 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T14:55:22.577 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:22 smithi081 podman[109764]: 2024-04-23 14:55:22.215121047 +0000 UTC m=+0.450009460 container start 7fec543a9d132ea909fef919a2dc9e234c66c33232b8b02c0283777225a19135 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, maintainer=Guillaume Abrioux ) 2024-04-23T14:55:22.577 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:22 smithi081 podman[109764]: 2024-04-23 14:55:22.302585896 +0000 UTC m=+0.537474336 container attach 7fec543a9d132ea909fef919a2dc9e234c66c33232b8b02c0283777225a19135 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, ceph=True) 2024-04-23T14:55:23.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:22 smithi156 ceph-mon[77738]: pgmap v103: 65 pgs: 3 active+undersized+degraded, 6 stale+active+clean, 5 active+undersized, 51 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 9/222 objects degraded (4.054%) 2024-04-23T14:55:23.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:22 smithi156 ceph-mon[77738]: Health check failed: Degraded data redundancy: 9/222 objects degraded (4.054%), 3 pgs degraded (PG_DEGRADED) 2024-04-23T14:55:23.072 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:22 smithi081 ceph-mon[90469]: pgmap v103: 65 pgs: 3 active+undersized+degraded, 6 stale+active+clean, 5 active+undersized, 51 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 9/222 objects degraded (4.054%) 2024-04-23T14:55:23.073 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:22 smithi081 ceph-mon[90469]: Health check failed: Degraded data redundancy: 9/222 objects degraded (4.054%), 3 pgs degraded (PG_DEGRADED) 2024-04-23T14:55:23.073 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:22 smithi081 podman[109764]: 2024-04-23 14:55:22.66653923 +0000 UTC m=+0.901427630 container died 7fec543a9d132ea909fef919a2dc9e234c66c33232b8b02c0283777225a19135 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0) 2024-04-23T14:55:23.827 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:23 smithi081 podman[109790]: 2024-04-23 14:55:23.473799028 +0000 UTC m=+0.788812435 container remove 7fec543a9d132ea909fef919a2dc9e234c66c33232b8b02c0283777225a19135 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-04-23T14:55:23.827 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:23 smithi081 systemd[1]: ceph-7a641bea-017e-11ef-bc93-c7b262605968@osd.2.service: Deactivated successfully. 2024-04-23T14:55:23.827 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:23 smithi081 systemd[1]: Stopped Ceph osd.2 for 7a641bea-017e-11ef-bc93-c7b262605968. 2024-04-23T14:55:23.827 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:23 smithi081 systemd[1]: ceph-7a641bea-017e-11ef-bc93-c7b262605968@osd.2.service: Consumed 1min 27.487s CPU time. 2024-04-23T14:55:24.262 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:23 smithi081 systemd[1]: Starting Ceph osd.2 for 7a641bea-017e-11ef-bc93-c7b262605968... 2024-04-23T14:55:24.545 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:24 smithi081 podman[109891]: 2024-04-23 14:55:24.169369907 +0000 UTC m=+0.038754944 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T14:55:24.546 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:24 smithi081 podman[109891]: 2024-04-23 14:55:24.283139166 +0000 UTC m=+0.152524240 container create acf6bb463750a44ce7a04ec9cf5251319d6a1fc20db601a266afe7ed9851e841 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2-activate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-04-23T14:55:24.546 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:24 smithi081 podman[109891]: 2024-04-23 14:55:24.545240833 +0000 UTC m=+0.414625914 container init acf6bb463750a44ce7a04ec9cf5251319d6a1fc20db601a266afe7ed9851e841 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2-activate, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=) 2024-04-23T14:55:24.826 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:24 smithi081 podman[109891]: 2024-04-23 14:55:24.556086754 +0000 UTC m=+0.425471832 container start acf6bb463750a44ce7a04ec9cf5251319d6a1fc20db601a266afe7ed9851e841 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2-activate, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-04-23T14:55:24.826 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:24 smithi081 podman[109891]: 2024-04-23 14:55:24.660860709 +0000 UTC m=+0.530245771 container attach acf6bb463750a44ce7a04ec9cf5251319d6a1fc20db601a266afe7ed9851e841 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2-activate, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T14:55:25.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:25 smithi081 ceph-mon[90469]: pgmap v104: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-04-23T14:55:25.827 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:25 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2-activate[109906]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-23T14:55:25.828 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:25 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2-activate[109906]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-23T14:55:25.828 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:25 smithi081 bash[109891]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-23T14:55:25.828 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:25 smithi081 bash[109891]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-23T14:55:25.828 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:25 smithi081 bash[109891]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-23T14:55:25.828 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:25 smithi081 bash[109891]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-23T14:55:25.828 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:25 smithi081 bash[109891]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-23T14:55:25.828 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:25 smithi081 bash[109891]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-23T14:55:25.828 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:25 smithi081 bash[109891]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-04-23T14:55:25.828 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:25 smithi081 bash[109891]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-23T14:55:25.828 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:25 smithi081 bash[109891]: --> ceph-volume raw activate successful for osd ID: 2 2024-04-23T14:55:25.828 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:25 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2-activate[109906]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-23T14:55:25.828 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:25 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2-activate[109906]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-23T14:55:25.828 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:25 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2-activate[109906]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-23T14:55:25.829 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:25 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2-activate[109906]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-23T14:55:25.829 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:25 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2-activate[109906]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-04-23T14:55:25.829 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:25 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2-activate[109906]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-23T14:55:25.829 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:25 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2-activate[109906]: --> ceph-volume raw activate successful for osd ID: 2 2024-04-23T14:55:25.829 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:25 smithi081 podman[109891]: 2024-04-23 14:55:25.542418727 +0000 UTC m=+1.411803808 container died acf6bb463750a44ce7a04ec9cf5251319d6a1fc20db601a266afe7ed9851e841 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2-activate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T14:55:26.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:25 smithi156 ceph-mon[77738]: pgmap v104: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-04-23T14:55:26.576 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:26 smithi081 podman[110045]: 2024-04-23 14:55:26.289879094 +0000 UTC m=+0.722383675 container remove acf6bb463750a44ce7a04ec9cf5251319d6a1fc20db601a266afe7ed9851e841 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2-activate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd) 2024-04-23T14:55:26.929 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:26 smithi081 podman[110107]: 2024-04-23 14:55:26.559595767 +0000 UTC m=+0.037411116 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T14:55:26.929 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:26 smithi081 podman[110107]: 2024-04-23 14:55:26.732763333 +0000 UTC m=+0.210578700 container create 421a62ef6990c9b7af50f06793137cbc88f2e5400468a6d857eb2f43a2803b6e (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T14:55:27.327 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:27 smithi081 podman[110107]: 2024-04-23 14:55:27.027944791 +0000 UTC m=+0.505760165 container init 421a62ef6990c9b7af50f06793137cbc88f2e5400468a6d857eb2f43a2803b6e (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-23T14:55:27.327 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:27 smithi081 podman[110107]: 2024-04-23 14:55:27.038341263 +0000 UTC m=+0.516156600 container start 421a62ef6990c9b7af50f06793137cbc88f2e5400468a6d857eb2f43a2803b6e (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-04-23T14:55:27.327 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:27 smithi081 ceph-osd[110126]: -- 172.21.15.81:0/299319230 <== mon.0 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bedbdb7680 con 0x55bedbd80c00 2024-04-23T14:55:27.327 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:27 smithi081 bash[110107]: 421a62ef6990c9b7af50f06793137cbc88f2e5400468a6d857eb2f43a2803b6e 2024-04-23T14:55:27.328 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:27 smithi081 systemd[1]: Started Ceph osd.2 for 7a641bea-017e-11ef-bc93-c7b262605968. 2024-04-23T14:55:27.613 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:27 smithi081 ceph-mon[90469]: pgmap v105: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 0 op/s; 32/222 objects degraded (14.414%) 2024-04-23T14:55:27.613 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:27 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:27.613 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:27 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:55:27.613 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:27 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:27.613 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:27 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:27.613 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:27 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:55:28.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:27 smithi156 ceph-mon[77738]: pgmap v105: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 0 op/s; 32/222 objects degraded (14.414%) 2024-04-23T14:55:28.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:27 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:28.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:27 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:55:28.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:27 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:28.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:27 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:28.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:27 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:55:28.042 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:27 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2[110122]: 2024-04-23T14:55:27.611+0000 7f060ace27c0 -1 Falling back to public interface 2024-04-23T14:55:29.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:29 smithi081 ceph-mon[90469]: pgmap v106: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 810 B/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-04-23T14:55:29.839 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:29 smithi156 ceph-mon[77738]: pgmap v106: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 810 B/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-04-23T14:55:31.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:31 smithi156 ceph-mon[77738]: pgmap v107: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 716 B/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-04-23T14:55:31.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:31 smithi156 ceph-mon[77738]: Health check update: Degraded data redundancy: 32/222 objects degraded (14.414%), 11 pgs degraded (PG_DEGRADED) 2024-04-23T14:55:31.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:31 smithi081 ceph-mon[90469]: pgmap v107: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 716 B/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-04-23T14:55:31.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:31 smithi081 ceph-mon[90469]: Health check update: Degraded data redundancy: 32/222 objects degraded (14.414%), 11 pgs degraded (PG_DEGRADED) 2024-04-23T14:55:33.076 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:32 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2[110122]: 2024-04-23T14:55:32.820+0000 7f060ace27c0 -1 osd.2 60 log_to_monitors true 2024-04-23T14:55:34.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:33 smithi156 ceph-mon[77738]: pgmap v108: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 605 B/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-04-23T14:55:34.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:33 smithi156 ceph-mon[77738]: from='osd.2 [v2:172.21.15.81:6818/3628575897,v1:172.21.15.81:6819/3628575897]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-23T14:55:34.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:33 smithi081 ceph-mon[90469]: pgmap v108: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 605 B/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-04-23T14:55:34.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:33 smithi081 ceph-mon[90469]: from='osd.2 [v2:172.21.15.81:6818/3628575897,v1:172.21.15.81:6819/3628575897]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-23T14:55:34.077 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 14:55:33 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2[110122]: 2024-04-23T14:55:33.600+0000 7f05fa000700 -1 osd.2 60 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T14:55:35.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:34 smithi156 ceph-mon[77738]: from='osd.2 [v2:172.21.15.81:6818/3628575897,v1:172.21.15.81:6819/3628575897]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-23T14:55:35.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:34 smithi156 ceph-mon[77738]: osdmap e63: 6 total, 5 up, 6 in 2024-04-23T14:55:35.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:34 smithi156 ceph-mon[77738]: from='osd.2 [v2:172.21.15.81:6818/3628575897,v1:172.21.15.81:6819/3628575897]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-04-23T14:55:35.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:34 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:35.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:34 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:35.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:34 smithi081 ceph-mon[90469]: from='osd.2 [v2:172.21.15.81:6818/3628575897,v1:172.21.15.81:6819/3628575897]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-23T14:55:35.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:34 smithi081 ceph-mon[90469]: osdmap e63: 6 total, 5 up, 6 in 2024-04-23T14:55:35.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:34 smithi081 ceph-mon[90469]: from='osd.2 [v2:172.21.15.81:6818/3628575897,v1:172.21.15.81:6819/3628575897]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-04-23T14:55:35.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:34 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:35.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:34 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:36.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:35 smithi156 ceph-mon[77738]: pgmap v110: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 197 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-04-23T14:55:36.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:35 smithi156 ceph-mon[77738]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-23T14:55:36.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:35 smithi156 ceph-mon[77738]: osd.2 [v2:172.21.15.81:6818/3628575897,v1:172.21.15.81:6819/3628575897] boot 2024-04-23T14:55:36.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:35 smithi156 ceph-mon[77738]: osdmap e64: 6 total, 6 up, 6 in 2024-04-23T14:55:36.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:35 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T14:55:36.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:35 smithi156 ceph-mon[77738]: osdmap e65: 6 total, 6 up, 6 in 2024-04-23T14:55:36.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:35 smithi081 ceph-mon[90469]: pgmap v110: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 197 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-04-23T14:55:36.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:35 smithi081 ceph-mon[90469]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-23T14:55:36.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:35 smithi081 ceph-mon[90469]: osd.2 [v2:172.21.15.81:6818/3628575897,v1:172.21.15.81:6819/3628575897] boot 2024-04-23T14:55:36.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:35 smithi081 ceph-mon[90469]: osdmap e64: 6 total, 6 up, 6 in 2024-04-23T14:55:36.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:35 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T14:55:36.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:35 smithi081 ceph-mon[90469]: osdmap e65: 6 total, 6 up, 6 in 2024-04-23T14:55:37.505 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:37 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:37.505 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:37 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:37.505 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:37 smithi081 ceph-mon[90469]: pgmap v113: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 197 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-04-23T14:55:37.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:37 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:37.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:37 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:37.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:37 smithi156 ceph-mon[77738]: pgmap v113: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 197 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-04-23T14:55:38.796 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:38 smithi081 ceph-mon[90469]: Health check update: Degraded data redundancy: 20/222 objects degraded (9.009%), 6 pgs degraded (PG_DEGRADED) 2024-04-23T14:55:39.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:38 smithi156 ceph-mon[77738]: Health check update: Degraded data redundancy: 20/222 objects degraded (9.009%), 6 pgs degraded (PG_DEGRADED) 2024-04-23T14:55:39.791 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:39 smithi081 ceph-mon[90469]: pgmap v114: 65 pgs: 6 active+undersized+degraded, 6 active+undersized, 53 active+clean; 197 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 20/222 objects degraded (9.009%) 2024-04-23T14:55:40.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:39 smithi156 ceph-mon[77738]: pgmap v114: 65 pgs: 6 active+undersized+degraded, 6 active+undersized, 53 active+clean; 197 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 20/222 objects degraded (9.009%) 2024-04-23T14:55:41.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:40 smithi156 ceph-mon[77738]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 20/222 objects degraded (9.009%), 6 pgs degraded) 2024-04-23T14:55:41.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:40 smithi156 ceph-mon[77738]: Cluster is now healthy 2024-04-23T14:55:41.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:40 smithi081 ceph-mon[90469]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 20/222 objects degraded (9.009%), 6 pgs degraded) 2024-04-23T14:55:41.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:40 smithi081 ceph-mon[90469]: Cluster is now healthy 2024-04-23T14:55:42.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:41 smithi156 ceph-mon[77738]: pgmap v115: 65 pgs: 65 active+clean; 197 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 588 B/s rd, 1 op/s 2024-04-23T14:55:42.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:41 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:42.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:41 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:42.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:41 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:55:42.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:41 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:55:42.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:41 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:42.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:41 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:42.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:41 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:55:42.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:41 smithi081 ceph-mon[90469]: pgmap v115: 65 pgs: 65 active+clean; 197 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 588 B/s rd, 1 op/s 2024-04-23T14:55:42.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:41 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:42.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:41 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:42.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:41 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:55:42.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:41 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:55:42.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:41 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:42.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:41 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:42.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:41 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:55:42.961 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:42 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:55:42.961 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:42 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:55:42.961 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:42 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:55:42.961 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:42 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:55:42.961 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:42 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-23T14:55:43.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:42 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:55:43.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:42 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:55:43.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:42 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:55:43.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:42 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:55:43.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:42 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-23T14:55:44.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:43 smithi156 ceph-mon[77738]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-23T14:55:44.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:43 smithi156 ceph-mon[77738]: Upgrade: osd.3 is safe to restart 2024-04-23T14:55:44.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:43 smithi156 ceph-mon[77738]: pgmap v116: 65 pgs: 65 active+clean; 197 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 0 op/s 2024-04-23T14:55:44.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:43 smithi081 ceph-mon[90469]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-23T14:55:44.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:43 smithi081 ceph-mon[90469]: Upgrade: osd.3 is safe to restart 2024-04-23T14:55:44.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:43 smithi081 ceph-mon[90469]: pgmap v116: 65 pgs: 65 active+clean; 197 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 0 op/s 2024-04-23T14:55:45.433 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:45 smithi156 ceph-mon[77738]: Upgrade: Updating osd.3 2024-04-23T14:55:45.433 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:45 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:45.434 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:45 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-23T14:55:45.434 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:45 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:55:45.434 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:45 smithi156 ceph-mon[77738]: Deploying daemon osd.3 on smithi156 2024-04-23T14:55:45.434 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:45 smithi156 ceph-mon[77738]: pgmap v117: 65 pgs: 65 active+clean; 197 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 926 B/s rd, 1 op/s 2024-04-23T14:55:45.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:45 smithi081 ceph-mon[90469]: Upgrade: Updating osd.3 2024-04-23T14:55:45.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:45 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:45.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:45 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-23T14:55:45.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:45 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:55:45.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:45 smithi081 ceph-mon[90469]: Deploying daemon osd.3 on smithi156 2024-04-23T14:55:45.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:45 smithi081 ceph-mon[90469]: pgmap v117: 65 pgs: 65 active+clean; 197 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 926 B/s rd, 1 op/s 2024-04-23T14:55:45.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:45.852+0000 7f1a19a00700 1 -- 172.21.15.81:0/2211850637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a140ff020 msgr2=0x7f1a140ff430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:45.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:45.852+0000 7f1a19a00700 1 --2- 172.21.15.81:0/2211850637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a140ff020 0x7f1a140ff430 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1a04004940 tx=0x7f1a04009e30 comp rx=0 tx=0).stop 2024-04-23T14:55:45.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:45.852+0000 7f1a19a00700 1 -- 172.21.15.81:0/2211850637 shutdown_connections 2024-04-23T14:55:45.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:45.852+0000 7f1a19a00700 1 --2- 172.21.15.81:0/2211850637 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a141002d0 0x7f1a14100740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:45.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:45.852+0000 7f1a19a00700 1 --2- 172.21.15.81:0/2211850637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a140ff020 0x7f1a140ff430 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:45.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:45.852+0000 7f1a19a00700 1 -- 172.21.15.81:0/2211850637 >> 172.21.15.81:0/2211850637 conn(0x7f1a140fa950 msgr2=0x7f1a140fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:45.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:45.852+0000 7f1a19a00700 1 -- 172.21.15.81:0/2211850637 shutdown_connections 2024-04-23T14:55:45.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:45.852+0000 7f1a19a00700 1 -- 172.21.15.81:0/2211850637 wait complete. 2024-04-23T14:55:45.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:45.853+0000 7f1a19a00700 1 Processor -- start 2024-04-23T14:55:45.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:45.853+0000 7f1a19a00700 1 -- start start 2024-04-23T14:55:45.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:45.853+0000 7f1a19a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a140ff020 0x7f1a1410fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:45.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:45.854+0000 7f1a19a00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a141002d0 0x7f1a14110020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:45.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:45.854+0000 7f1a19a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a14110620 con 0x7f1a140ff020 2024-04-23T14:55:45.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:45.854+0000 7f1a19a00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a14110790 con 0x7f1a141002d0 2024-04-23T14:55:45.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:45.854+0000 7f1a12a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a140ff020 0x7f1a1410fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:45.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:45.854+0000 7f1a12a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a140ff020 0x7f1a1410fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56090/0 (socket says 172.21.15.81:56090) 2024-04-23T14:55:45.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:45.854+0000 7f1a12a00700 1 -- 172.21.15.81:0/1897505070 learned_addr learned my addr 172.21.15.81:0/1897505070 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:55:45.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:45.854+0000 7f1a12000700 1 --2- 172.21.15.81:0/1897505070 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a141002d0 0x7f1a14110020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:45.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:45.854+0000 7f1a12a00700 1 -- 172.21.15.81:0/1897505070 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a141002d0 msgr2=0x7f1a14110020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:45.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:45.854+0000 7f1a12a00700 1 --2- 172.21.15.81:0/1897505070 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a141002d0 0x7f1a14110020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:45.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:45.854+0000 7f1a12a00700 1 -- 172.21.15.81:0/1897505070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a04005040 con 0x7f1a140ff020 2024-04-23T14:55:45.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:45.855+0000 7f1a12a00700 1 --2- 172.21.15.81:0/1897505070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a140ff020 0x7f1a1410fae0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1a04013870 tx=0x7f1a04009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:45.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:45.855+0000 7f1a0aa00700 1 -- 172.21.15.81:0/1897505070 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a0400e070 con 0x7f1a140ff020 2024-04-23T14:55:45.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:45.855+0000 7f1a0aa00700 1 -- 172.21.15.81:0/1897505070 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1a0401c400 con 0x7f1a140ff020 2024-04-23T14:55:45.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:45.855+0000 7f1a19a00700 1 -- 172.21.15.81:0/1897505070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a14115190 con 0x7f1a140ff020 2024-04-23T14:55:45.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:45.855+0000 7f1a0aa00700 1 -- 172.21.15.81:0/1897505070 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a0400b650 con 0x7f1a140ff020 2024-04-23T14:55:45.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:45.855+0000 7f1a19a00700 1 -- 172.21.15.81:0/1897505070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a14115670 con 0x7f1a140ff020 2024-04-23T14:55:45.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:45.856+0000 7f1a19a00700 1 -- 172.21.15.81:0/1897505070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a1404c710 con 0x7f1a140ff020 2024-04-23T14:55:45.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:45.857+0000 7f1a0aa00700 1 -- 172.21.15.81:0/1897505070 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f1a0401c570 con 0x7f1a140ff020 2024-04-23T14:55:45.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:45.858+0000 7f1a0aa00700 1 --2- 172.21.15.81:0/1897505070 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f19f806ec00 0x7f19f80710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:45.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:45.858+0000 7f1a0aa00700 1 -- 172.21.15.81:0/1897505070 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f1a0408ff30 con 0x7f1a140ff020 2024-04-23T14:55:45.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:45.859+0000 7f1a12000700 1 --2- 172.21.15.81:0/1897505070 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f19f806ec00 0x7f19f80710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:45.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:45.859+0000 7f1a12000700 1 --2- 172.21.15.81:0/1897505070 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f19f806ec00 0x7f19f80710b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1a00004600 tx=0x7f1a0000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:45.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:45.863+0000 7f1a0aa00700 1 -- 172.21.15.81:0/1897505070 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f1a0405c8c0 con 0x7f1a140ff020 2024-04-23T14:55:46.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.107+0000 7f1a19a00700 1 -- 172.21.15.81:0/1897505070 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a141045a0 con 0x7f19f806ec00 2024-04-23T14:55:46.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.109+0000 7f1a0aa00700 1 -- 172.21.15.81:0/1897505070 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f1a141045a0 con 0x7f19f806ec00 2024-04-23T14:55:46.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.112+0000 7f1a19a00700 1 -- 172.21.15.81:0/1897505070 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f19f806ec00 msgr2=0x7f19f80710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:46.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.112+0000 7f1a19a00700 1 --2- 172.21.15.81:0/1897505070 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f19f806ec00 0x7f19f80710b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1a00004600 tx=0x7f1a0000b040 comp rx=0 tx=0).stop 2024-04-23T14:55:46.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.112+0000 7f1a19a00700 1 -- 172.21.15.81:0/1897505070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a140ff020 msgr2=0x7f1a1410fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:46.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.112+0000 7f1a19a00700 1 --2- 172.21.15.81:0/1897505070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a140ff020 0x7f1a1410fae0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1a04013870 tx=0x7f1a04009e30 comp rx=0 tx=0).stop 2024-04-23T14:55:46.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.112+0000 7f1a19a00700 1 -- 172.21.15.81:0/1897505070 shutdown_connections 2024-04-23T14:55:46.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.112+0000 7f1a19a00700 1 --2- 172.21.15.81:0/1897505070 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f19f806ec00 0x7f19f80710b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:46.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.112+0000 7f1a19a00700 1 --2- 172.21.15.81:0/1897505070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a140ff020 0x7f1a1410fae0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:46.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.112+0000 7f1a19a00700 1 --2- 172.21.15.81:0/1897505070 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a141002d0 0x7f1a14110020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:46.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.112+0000 7f1a19a00700 1 -- 172.21.15.81:0/1897505070 >> 172.21.15.81:0/1897505070 conn(0x7f1a140fa950 msgr2=0x7f1a140fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:46.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.112+0000 7f1a19a00700 1 -- 172.21.15.81:0/1897505070 shutdown_connections 2024-04-23T14:55:46.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.112+0000 7f1a19a00700 1 -- 172.21.15.81:0/1897505070 wait complete. 2024-04-23T14:55:46.127 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-04-23T14:55:46.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.264+0000 7f0b36000700 1 -- 172.21.15.81:0/3251916404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b300fce80 msgr2=0x7f0b300fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:46.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.264+0000 7f0b36000700 1 --2- 172.21.15.81:0/3251916404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b300fce80 0x7f0b300fd290 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0b20004940 tx=0x7f0b20009e30 comp rx=0 tx=0).stop 2024-04-23T14:55:46.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.264+0000 7f0b36000700 1 -- 172.21.15.81:0/3251916404 shutdown_connections 2024-04-23T14:55:46.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.264+0000 7f0b36000700 1 --2- 172.21.15.81:0/3251916404 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b300fdff0 0x7f0b300fe460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:46.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.264+0000 7f0b36000700 1 --2- 172.21.15.81:0/3251916404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b300fce80 0x7f0b300fd290 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:46.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.264+0000 7f0b36000700 1 -- 172.21.15.81:0/3251916404 >> 172.21.15.81:0/3251916404 conn(0x7f0b300f8580 msgr2=0x7f0b300fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:46.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.264+0000 7f0b36000700 1 -- 172.21.15.81:0/3251916404 shutdown_connections 2024-04-23T14:55:46.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.264+0000 7f0b36000700 1 -- 172.21.15.81:0/3251916404 wait complete. 2024-04-23T14:55:46.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.265+0000 7f0b36000700 1 Processor -- start 2024-04-23T14:55:46.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.265+0000 7f0b36000700 1 -- start start 2024-04-23T14:55:46.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.266+0000 7f0b36000700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b300fce80 0x7f0b3010d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:46.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.266+0000 7f0b36000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b300fdff0 0x7f0b3010de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:46.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.266+0000 7f0b36000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3010e470 con 0x7f0b300fdff0 2024-04-23T14:55:46.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.266+0000 7f0b36000700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3010e5e0 con 0x7f0b300fce80 2024-04-23T14:55:46.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.266+0000 7f0b26a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b300fdff0 0x7f0b3010de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:46.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.266+0000 7f0b26a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b300fdff0 0x7f0b3010de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56110/0 (socket says 172.21.15.81:56110) 2024-04-23T14:55:46.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.266+0000 7f0b26a00700 1 -- 172.21.15.81:0/1850387893 learned_addr learned my addr 172.21.15.81:0/1850387893 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:55:46.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.266+0000 7f0b2f400700 1 --2- 172.21.15.81:0/1850387893 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b300fce80 0x7f0b3010d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:46.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.266+0000 7f0b26a00700 1 -- 172.21.15.81:0/1850387893 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b300fce80 msgr2=0x7f0b3010d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:46.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.266+0000 7f0b26a00700 1 --2- 172.21.15.81:0/1850387893 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b300fce80 0x7f0b3010d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:46.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.266+0000 7f0b26a00700 1 -- 172.21.15.81:0/1850387893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b20005040 con 0x7f0b300fdff0 2024-04-23T14:55:46.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.267+0000 7f0b26a00700 1 --2- 172.21.15.81:0/1850387893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b300fdff0 0x7f0b3010de70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0b1800c830 tx=0x7f0b18004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:46.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.267+0000 7f0b27e00700 1 -- 172.21.15.81:0/1850387893 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b1800a760 con 0x7f0b300fdff0 2024-04-23T14:55:46.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.267+0000 7f0b27e00700 1 -- 172.21.15.81:0/1850387893 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0b1800ad90 con 0x7f0b300fdff0 2024-04-23T14:55:46.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.267+0000 7f0b36000700 1 -- 172.21.15.81:0/1850387893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b30113040 con 0x7f0b300fdff0 2024-04-23T14:55:46.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.267+0000 7f0b27e00700 1 -- 172.21.15.81:0/1850387893 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b180113a0 con 0x7f0b300fdff0 2024-04-23T14:55:46.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.268+0000 7f0b36000700 1 -- 172.21.15.81:0/1850387893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b301135d0 con 0x7f0b300fdff0 2024-04-23T14:55:46.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.269+0000 7f0b36000700 1 -- 172.21.15.81:0/1850387893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b3004c710 con 0x7f0b300fdff0 2024-04-23T14:55:46.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.269+0000 7f0b27e00700 1 -- 172.21.15.81:0/1850387893 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f0b18012400 con 0x7f0b300fdff0 2024-04-23T14:55:46.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.270+0000 7f0b27e00700 1 --2- 172.21.15.81:0/1850387893 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f0b1406ec00 0x7f0b140710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:46.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.270+0000 7f0b27e00700 1 -- 172.21.15.81:0/1850387893 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f0b1808e900 con 0x7f0b300fdff0 2024-04-23T14:55:46.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.271+0000 7f0b2f400700 1 --2- 172.21.15.81:0/1850387893 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f0b1406ec00 0x7f0b140710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:46.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.271+0000 7f0b2f400700 1 --2- 172.21.15.81:0/1850387893 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f0b1406ec00 0x7f0b140710b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0b2000b970 tx=0x7f0b20009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:46.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.276+0000 7f0b27e00700 1 -- 172.21.15.81:0/1850387893 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f0b1805b210 con 0x7f0b300fdff0 2024-04-23T14:55:46.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.520+0000 7f0b36000700 1 -- 172.21.15.81:0/1850387893 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0b30102400 con 0x7f0b1406ec00 2024-04-23T14:55:46.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.523+0000 7f0b27e00700 1 -- 172.21.15.81:0/1850387893 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f0b30102400 con 0x7f0b1406ec00 2024-04-23T14:55:46.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.527+0000 7f0b36000700 1 -- 172.21.15.81:0/1850387893 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f0b1406ec00 msgr2=0x7f0b140710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:46.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.527+0000 7f0b36000700 1 --2- 172.21.15.81:0/1850387893 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f0b1406ec00 0x7f0b140710b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0b2000b970 tx=0x7f0b20009e30 comp rx=0 tx=0).stop 2024-04-23T14:55:46.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.527+0000 7f0b36000700 1 -- 172.21.15.81:0/1850387893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b300fdff0 msgr2=0x7f0b3010de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:46.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.527+0000 7f0b36000700 1 --2- 172.21.15.81:0/1850387893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b300fdff0 0x7f0b3010de70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0b1800c830 tx=0x7f0b18004470 comp rx=0 tx=0).stop 2024-04-23T14:55:46.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.527+0000 7f0b36000700 1 -- 172.21.15.81:0/1850387893 shutdown_connections 2024-04-23T14:55:46.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.527+0000 7f0b36000700 1 --2- 172.21.15.81:0/1850387893 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f0b1406ec00 0x7f0b140710b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:46.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.527+0000 7f0b36000700 1 --2- 172.21.15.81:0/1850387893 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b300fce80 0x7f0b3010d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:46.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.527+0000 7f0b36000700 1 --2- 172.21.15.81:0/1850387893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b300fdff0 0x7f0b3010de70 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:46.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.527+0000 7f0b36000700 1 -- 172.21.15.81:0/1850387893 >> 172.21.15.81:0/1850387893 conn(0x7f0b300f8580 msgr2=0x7f0b300f9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:46.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.527+0000 7f0b36000700 1 -- 172.21.15.81:0/1850387893 shutdown_connections 2024-04-23T14:55:46.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.527+0000 7f0b36000700 1 -- 172.21.15.81:0/1850387893 wait complete. 2024-04-23T14:55:46.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.678+0000 7fac26800700 1 -- 172.21.15.81:0/2152200756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac200fff70 msgr2=0x7fac20102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:46.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.678+0000 7fac26800700 1 --2- 172.21.15.81:0/2152200756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac200fff70 0x7fac20102390 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fac0c004940 tx=0x7fac0c009e30 comp rx=0 tx=0).stop 2024-04-23T14:55:46.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.678+0000 7fac26800700 1 -- 172.21.15.81:0/2152200756 shutdown_connections 2024-04-23T14:55:46.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.678+0000 7fac26800700 1 --2- 172.21.15.81:0/2152200756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac200fff70 0x7fac20102390 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:46.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.678+0000 7fac26800700 1 --2- 172.21.15.81:0/2152200756 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fac200662f0 0x7fac200ffa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:46.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.678+0000 7fac26800700 1 -- 172.21.15.81:0/2152200756 >> 172.21.15.81:0/2152200756 conn(0x7fac200f74c0 msgr2=0x7fac200f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:46.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.678+0000 7fac26800700 1 -- 172.21.15.81:0/2152200756 shutdown_connections 2024-04-23T14:55:46.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.678+0000 7fac26800700 1 -- 172.21.15.81:0/2152200756 wait complete. 2024-04-23T14:55:46.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.679+0000 7fac26800700 1 Processor -- start 2024-04-23T14:55:46.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.679+0000 7fac26800700 1 -- start start 2024-04-23T14:55:46.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.680+0000 7fac26800700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fac200662f0 0x7fac2010da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:46.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.680+0000 7fac26800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac200fff70 0x7fac2010dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:46.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.680+0000 7fac26800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2010e5c0 con 0x7fac200fff70 2024-04-23T14:55:46.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.680+0000 7fac26800700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2010ed70 con 0x7fac200662f0 2024-04-23T14:55:46.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.680+0000 7fac1ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac200fff70 0x7fac2010dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:46.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.680+0000 7fac1ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac200fff70 0x7fac2010dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56126/0 (socket says 172.21.15.81:56126) 2024-04-23T14:55:46.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.680+0000 7fac1ea00700 1 -- 172.21.15.81:0/712308004 learned_addr learned my addr 172.21.15.81:0/712308004 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:55:46.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.680+0000 7fac1f400700 1 --2- 172.21.15.81:0/712308004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fac200662f0 0x7fac2010da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:46.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.681+0000 7fac1ea00700 1 -- 172.21.15.81:0/712308004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fac200662f0 msgr2=0x7fac2010da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:46.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.681+0000 7fac1ea00700 1 --2- 172.21.15.81:0/712308004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fac200662f0 0x7fac2010da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:46.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.681+0000 7fac1ea00700 1 -- 172.21.15.81:0/712308004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac0c005040 con 0x7fac200fff70 2024-04-23T14:55:46.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.681+0000 7fac1ea00700 1 --2- 172.21.15.81:0/712308004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac200fff70 0x7fac2010dfc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00b0d0 tx=0x7fac0c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:46.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.681+0000 7fac17400700 1 -- 172.21.15.81:0/712308004 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac0c00e030 con 0x7fac200fff70 2024-04-23T14:55:46.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.681+0000 7fac17400700 1 -- 172.21.15.81:0/712308004 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fac0c01c400 con 0x7fac200fff70 2024-04-23T14:55:46.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.681+0000 7fac17400700 1 -- 172.21.15.81:0/712308004 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac0c00b630 con 0x7fac200fff70 2024-04-23T14:55:46.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.681+0000 7fac26800700 1 -- 172.21.15.81:0/712308004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac2010eff0 con 0x7fac200fff70 2024-04-23T14:55:46.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.681+0000 7fac26800700 1 -- 172.21.15.81:0/712308004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac2010f530 con 0x7fac200fff70 2024-04-23T14:55:46.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.682+0000 7fac26800700 1 -- 172.21.15.81:0/712308004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac2005f5f0 con 0x7fac200fff70 2024-04-23T14:55:46.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.684+0000 7fac17400700 1 -- 172.21.15.81:0/712308004 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fac0c01c570 con 0x7fac200fff70 2024-04-23T14:55:46.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.684+0000 7fac17400700 1 --2- 172.21.15.81:0/712308004 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fac0406ec00 0x7fac040710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:46.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.685+0000 7fac17400700 1 -- 172.21.15.81:0/712308004 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fac0c090080 con 0x7fac200fff70 2024-04-23T14:55:46.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.685+0000 7fac1f400700 1 --2- 172.21.15.81:0/712308004 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fac0406ec00 0x7fac040710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:46.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.686+0000 7fac1f400700 1 --2- 172.21.15.81:0/712308004 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fac0406ec00 0x7fac040710b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fac10009b80 tx=0x7fac1000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:46.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.690+0000 7fac17400700 1 -- 172.21.15.81:0/712308004 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fac0c05ca10 con 0x7fac200fff70 2024-04-23T14:55:46.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.915+0000 7fac26800700 1 -- 172.21.15.81:0/712308004 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fac2010f970 con 0x7fac0406ec00 2024-04-23T14:55:46.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.934+0000 7fac17400700 1 -- 172.21.15.81:0/712308004 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fac2010f970 con 0x7fac0406ec00 2024-04-23T14:55:46.935 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-23T14:55:46.935 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (6m) 12s ago 16m 14.2M - 0.25.0 c8568f914cd2 63876b2abc27 2024-04-23T14:55:46.935 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (2m) 12s ago 17m 6665k - 19.0.0-3126-gd44fddd9 76e77f280c74 b486fe2ef19b 2024-04-23T14:55:46.935 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi156 smithi156 running (112s) 107s ago 15m 6656k - 19.0.0-3126-gd44fddd9 76e77f280c74 5d9aa5ecf264 2024-04-23T14:55:46.935 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (5m) 12s ago 16m 74.0M - 9.4.7 954c08fa6188 fbad3cef0883 2024-04-23T14:55:46.935 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.vcoywg smithi081 running (9m) 12s ago 9m 147M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 2ca7601ab60f 2024-04-23T14:55:46.935 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.wydgcg smithi081 running (9m) 12s ago 9m 107M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 58eb1a961b61 2024-04-23T14:55:46.935 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.rhbtxt smithi156 running (9m) 107s ago 9m 13.7M - 17.2.7-884-g70d0cb4b cafd8ddac8fa db3cb5034381 2024-04-23T14:55:46.935 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.vynkxn smithi156 running (9m) 107s ago 9m 13.9M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 1c8f2219e7fd 2024-04-23T14:55:46.936 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.ldghvq smithi081 *:8443,9283,8765 running (5m) 12s ago 18m 505M - 19.0.0-3126-gd44fddd9 76e77f280c74 6bf23484a1c9 2024-04-23T14:55:46.936 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi156.ounwyj smithi156 *:8443,9283,8765 running (4m) 107s ago 15m 450M - 19.0.0-3126-gd44fddd9 76e77f280c74 a6c0dd9f89f2 2024-04-23T14:55:46.936 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (3m) 12s ago 18m 50.0M 2048M 19.0.0-3126-gd44fddd9 76e77f280c74 fbf9f9a59ac2 2024-04-23T14:55:46.936 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi156 smithi156 running (2m) 107s ago 15m 32.2M 2048M 19.0.0-3126-gd44fddd9 76e77f280c74 36409886998f 2024-04-23T14:55:46.936 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (6m) 12s ago 17m 7860k - 1.5.0 0da6a335fe13 197b27809010 2024-04-23T14:55:46.936 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi156 smithi156 *:9100 running (5m) 107s ago 15m 8154k - 1.5.0 0da6a335fe13 91a7c5e86d47 2024-04-23T14:55:46.936 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (82s) 12s ago 14m 99.5M 1557M 19.0.0-3126-gd44fddd9 76e77f280c74 24bc24b37de5 2024-04-23T14:55:46.936 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (51s) 12s ago 13m 105M 1557M 19.0.0-3126-gd44fddd9 76e77f280c74 18d0179b558a 2024-04-23T14:55:46.936 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (20s) 12s ago 13m 11.1M 1557M 19.0.0-3126-gd44fddd9 76e77f280c74 421a62ef6990 2024-04-23T14:55:46.936 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi156 running (12m) 107s ago 12m 286M 2581M 17.2.7-884-g70d0cb4b cafd8ddac8fa c1c261b1ee90 2024-04-23T14:55:46.936 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi156 running (12m) 107s ago 12m 256M 2581M 17.2.7-884-g70d0cb4b cafd8ddac8fa 83f996ee64de 2024-04-23T14:55:46.936 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi156 running (11m) 107s ago 11m 239M 2581M 17.2.7-884-g70d0cb4b cafd8ddac8fa b754244bef18 2024-04-23T14:55:46.936 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (4m) 12s ago 16m 56.0M - 2.43.0 a07b618ecd1d 35558adb166d 2024-04-23T14:55:46.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.937+0000 7fac26800700 1 -- 172.21.15.81:0/712308004 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fac0406ec00 msgr2=0x7fac040710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:46.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.937+0000 7fac26800700 1 --2- 172.21.15.81:0/712308004 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fac0406ec00 0x7fac040710b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fac10009b80 tx=0x7fac1000b040 comp rx=0 tx=0).stop 2024-04-23T14:55:46.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.937+0000 7fac26800700 1 -- 172.21.15.81:0/712308004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac200fff70 msgr2=0x7fac2010dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:46.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.937+0000 7fac26800700 1 --2- 172.21.15.81:0/712308004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac200fff70 0x7fac2010dfc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00b0d0 tx=0x7fac0c009e30 comp rx=0 tx=0).stop 2024-04-23T14:55:46.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.937+0000 7fac26800700 1 -- 172.21.15.81:0/712308004 shutdown_connections 2024-04-23T14:55:46.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.937+0000 7fac26800700 1 --2- 172.21.15.81:0/712308004 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fac0406ec00 0x7fac040710b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:46.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.937+0000 7fac26800700 1 --2- 172.21.15.81:0/712308004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fac200662f0 0x7fac2010da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:46.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.937+0000 7fac26800700 1 --2- 172.21.15.81:0/712308004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac200fff70 0x7fac2010dfc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:46.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.937+0000 7fac26800700 1 -- 172.21.15.81:0/712308004 >> 172.21.15.81:0/712308004 conn(0x7fac200f74c0 msgr2=0x7fac200f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:46.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.938+0000 7fac26800700 1 -- 172.21.15.81:0/712308004 shutdown_connections 2024-04-23T14:55:46.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:46.938+0000 7fac26800700 1 -- 172.21.15.81:0/712308004 wait complete. 2024-04-23T14:55:47.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.080+0000 7fc9d4e00700 1 -- 172.21.15.81:0/3323511911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9d00fff20 msgr2=0x7fc9d0102340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:47.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.080+0000 7fc9d4e00700 1 --2- 172.21.15.81:0/3323511911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9d00fff20 0x7fc9d0102340 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8004940 tx=0x7fc9b8009e30 comp rx=0 tx=0).stop 2024-04-23T14:55:47.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.080+0000 7fc9d4e00700 1 -- 172.21.15.81:0/3323511911 shutdown_connections 2024-04-23T14:55:47.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.080+0000 7fc9d4e00700 1 --2- 172.21.15.81:0/3323511911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9d00fff20 0x7fc9d0102340 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:47.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.080+0000 7fc9d4e00700 1 --2- 172.21.15.81:0/3323511911 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9d0066b80 0x7fc9d00ff9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:47.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.080+0000 7fc9d4e00700 1 -- 172.21.15.81:0/3323511911 >> 172.21.15.81:0/3323511911 conn(0x7fc9d00f7450 msgr2=0x7fc9d00f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:47.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.080+0000 7fc9d4e00700 1 -- 172.21.15.81:0/3323511911 shutdown_connections 2024-04-23T14:55:47.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.080+0000 7fc9d4e00700 1 -- 172.21.15.81:0/3323511911 wait complete. 2024-04-23T14:55:47.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.081+0000 7fc9d4e00700 1 Processor -- start 2024-04-23T14:55:47.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.081+0000 7fc9d4e00700 1 -- start start 2024-04-23T14:55:47.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.081+0000 7fc9d4e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9d0066b80 0x7fc9d010fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:47.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.081+0000 7fc9d4e00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9d00fff20 0x7fc9d01102b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:47.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.081+0000 7fc9d4e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d01108b0 con 0x7fc9d0066b80 2024-04-23T14:55:47.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.081+0000 7fc9d4e00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d0110ff0 con 0x7fc9d00fff20 2024-04-23T14:55:47.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.082+0000 7fc9cde00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9d0066b80 0x7fc9d010fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:47.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.082+0000 7fc9cde00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9d0066b80 0x7fc9d010fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56138/0 (socket says 172.21.15.81:56138) 2024-04-23T14:55:47.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.082+0000 7fc9cde00700 1 -- 172.21.15.81:0/4159036676 learned_addr learned my addr 172.21.15.81:0/4159036676 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:55:47.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.082+0000 7fc9cde00700 1 -- 172.21.15.81:0/4159036676 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9d00fff20 msgr2=0x7fc9d01102b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:47.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.082+0000 7fc9c7e00700 1 --2- 172.21.15.81:0/4159036676 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9d00fff20 0x7fc9d01102b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:47.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.082+0000 7fc9cde00700 1 --2- 172.21.15.81:0/4159036676 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9d00fff20 0x7fc9d01102b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:47.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.082+0000 7fc9cde00700 1 -- 172.21.15.81:0/4159036676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b8005040 con 0x7fc9d0066b80 2024-04-23T14:55:47.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.083+0000 7fc9cde00700 1 --2- 172.21.15.81:0/4159036676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9d0066b80 0x7fc9d010fd70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc9c000c800 tx=0x7fc9c0004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:47.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.083+0000 7fc9c6000700 1 -- 172.21.15.81:0/4159036676 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9c000a760 con 0x7fc9d0066b80 2024-04-23T14:55:47.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.083+0000 7fc9c6000700 1 -- 172.21.15.81:0/4159036676 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc9c000ad90 con 0x7fc9d0066b80 2024-04-23T14:55:47.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.083+0000 7fc9d4e00700 1 -- 172.21.15.81:0/4159036676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d01112d0 con 0x7fc9d0066b80 2024-04-23T14:55:47.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.083+0000 7fc9c6000700 1 -- 172.21.15.81:0/4159036676 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9c00113a0 con 0x7fc9d0066b80 2024-04-23T14:55:47.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.083+0000 7fc9d4e00700 1 -- 172.21.15.81:0/4159036676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d0111890 con 0x7fc9d0066b80 2024-04-23T14:55:47.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.084+0000 7fc9d4e00700 1 -- 172.21.15.81:0/4159036676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9d00f8fd0 con 0x7fc9d0066b80 2024-04-23T14:55:47.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.085+0000 7fc9c6000700 1 -- 172.21.15.81:0/4159036676 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fc9c0012400 con 0x7fc9d0066b80 2024-04-23T14:55:47.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.086+0000 7fc9c6000700 1 --2- 172.21.15.81:0/4159036676 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc9b406ec10 0x7fc9b40710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:47.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.086+0000 7fc9c6000700 1 -- 172.21.15.81:0/4159036676 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fc9c008e840 con 0x7fc9d0066b80 2024-04-23T14:55:47.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.086+0000 7fc9c7e00700 1 --2- 172.21.15.81:0/4159036676 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc9b406ec10 0x7fc9b40710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:47.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.087+0000 7fc9c7e00700 1 --2- 172.21.15.81:0/4159036676 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc9b406ec10 0x7fc9b40710c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc9b800b970 tx=0x7fc9b8009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:47.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.091+0000 7fc9c6000700 1 -- 172.21.15.81:0/4159036676 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fc9c005b1f0 con 0x7fc9d0066b80 2024-04-23T14:55:47.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.399+0000 7fc9d4e00700 1 -- 172.21.15.81:0/4159036676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc9d005f5f0 con 0x7fc9d0066b80 2024-04-23T14:55:47.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.400+0000 7fc9c6000700 1 -- 172.21.15.81:0/4159036676 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7fc9c005ad80 con 0x7fc9d0066b80 2024-04-23T14:55:47.400 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:55:47.400 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-04-23T14:55:47.400 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T14:55:47.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:55:47.401 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-04-23T14:55:47.401 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T14:55:47.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:55:47.401 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-04-23T14:55:47.401 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 3, 2024-04-23T14:55:47.401 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 3 2024-04-23T14:55:47.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:55:47.401 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-04-23T14:55:47.401 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 4 2024-04-23T14:55:47.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:55:47.401 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-04-23T14:55:47.401 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 7, 2024-04-23T14:55:47.401 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 7 2024-04-23T14:55:47.401 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-23T14:55:47.402 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:55:47.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.403+0000 7fc9d4e00700 1 -- 172.21.15.81:0/4159036676 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc9b406ec10 msgr2=0x7fc9b40710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:47.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.403+0000 7fc9d4e00700 1 --2- 172.21.15.81:0/4159036676 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc9b406ec10 0x7fc9b40710c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc9b800b970 tx=0x7fc9b8009e30 comp rx=0 tx=0).stop 2024-04-23T14:55:47.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.403+0000 7fc9d4e00700 1 -- 172.21.15.81:0/4159036676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9d0066b80 msgr2=0x7fc9d010fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:47.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.403+0000 7fc9d4e00700 1 --2- 172.21.15.81:0/4159036676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9d0066b80 0x7fc9d010fd70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc9c000c800 tx=0x7fc9c0004470 comp rx=0 tx=0).stop 2024-04-23T14:55:47.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.403+0000 7fc9d4e00700 1 -- 172.21.15.81:0/4159036676 shutdown_connections 2024-04-23T14:55:47.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.403+0000 7fc9d4e00700 1 --2- 172.21.15.81:0/4159036676 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc9b406ec10 0x7fc9b40710c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:47.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.403+0000 7fc9d4e00700 1 --2- 172.21.15.81:0/4159036676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9d0066b80 0x7fc9d010fd70 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:47.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.403+0000 7fc9d4e00700 1 --2- 172.21.15.81:0/4159036676 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9d00fff20 0x7fc9d01102b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:47.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.403+0000 7fc9d4e00700 1 -- 172.21.15.81:0/4159036676 >> 172.21.15.81:0/4159036676 conn(0x7fc9d00f7450 msgr2=0x7fc9d00fbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:47.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.403+0000 7fc9d4e00700 1 -- 172.21.15.81:0/4159036676 shutdown_connections 2024-04-23T14:55:47.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.403+0000 7fc9d4e00700 1 -- 172.21.15.81:0/4159036676 wait complete. 2024-04-23T14:55:47.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.554+0000 7f1881600700 1 -- 172.21.15.81:0/2294024220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f187c072820 msgr2=0x7f187c072c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:47.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.554+0000 7f1881600700 1 --2- 172.21.15.81:0/2294024220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f187c072820 0x7f187c072c30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f186c004940 tx=0x7f186c009e30 comp rx=0 tx=0).stop 2024-04-23T14:55:47.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.554+0000 7f1881600700 1 -- 172.21.15.81:0/2294024220 shutdown_connections 2024-04-23T14:55:47.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.554+0000 7f1881600700 1 --2- 172.21.15.81:0/2294024220 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f187c073170 0x7f187c073b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:47.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.554+0000 7f1881600700 1 --2- 172.21.15.81:0/2294024220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f187c072820 0x7f187c072c30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:47.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.554+0000 7f1881600700 1 -- 172.21.15.81:0/2294024220 >> 172.21.15.81:0/2294024220 conn(0x7f187c0fa790 msgr2=0x7f187c0fcba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:47.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.554+0000 7f1881600700 1 -- 172.21.15.81:0/2294024220 shutdown_connections 2024-04-23T14:55:47.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.554+0000 7f1881600700 1 -- 172.21.15.81:0/2294024220 wait complete. 2024-04-23T14:55:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.555+0000 7f1881600700 1 Processor -- start 2024-04-23T14:55:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.555+0000 7f1881600700 1 -- start start 2024-04-23T14:55:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.556+0000 7f1881600700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f187c072820 0x7f187c113ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.556+0000 7f1881600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f187c114410 0x7f187c119440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.556+0000 7f1881600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187c1148d0 con 0x7f187c114410 2024-04-23T14:55:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.556+0000 7f1881600700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187c114a10 con 0x7f187c072820 2024-04-23T14:55:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.556+0000 7f187a000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f187c114410 0x7f187c119440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.556+0000 7f187a000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f187c114410 0x7f187c119440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56152/0 (socket says 172.21.15.81:56152) 2024-04-23T14:55:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.556+0000 7f187a000700 1 -- 172.21.15.81:0/1212579324 learned_addr learned my addr 172.21.15.81:0/1212579324 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:55:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.556+0000 7f187aa00700 1 --2- 172.21.15.81:0/1212579324 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f187c072820 0x7f187c113ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.556+0000 7f187a000700 1 -- 172.21.15.81:0/1212579324 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f187c072820 msgr2=0x7f187c113ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.556+0000 7f187a000700 1 --2- 172.21.15.81:0/1212579324 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f187c072820 0x7f187c113ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.556+0000 7f187a000700 1 -- 172.21.15.81:0/1212579324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186c005040 con 0x7f187c114410 2024-04-23T14:55:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.557+0000 7f187a000700 1 --2- 172.21.15.81:0/1212579324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f187c114410 0x7f187c119440 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f186800eb40 tx=0x7f186800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.557+0000 7f1872a00700 1 -- 172.21.15.81:0/1212579324 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1868007cc0 con 0x7f187c114410 2024-04-23T14:55:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.557+0000 7f1872a00700 1 -- 172.21.15.81:0/1212579324 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f186800f040 con 0x7f187c114410 2024-04-23T14:55:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.557+0000 7f1881600700 1 -- 172.21.15.81:0/1212579324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f187c119980 con 0x7f187c114410 2024-04-23T14:55:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.557+0000 7f1872a00700 1 -- 172.21.15.81:0/1212579324 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f186800ca10 con 0x7f187c114410 2024-04-23T14:55:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.557+0000 7f1881600700 1 -- 172.21.15.81:0/1212579324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f187c119ef0 con 0x7f187c114410 2024-04-23T14:55:47.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.558+0000 7f1881600700 1 -- 172.21.15.81:0/1212579324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f187c04c710 con 0x7f187c114410 2024-04-23T14:55:47.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.559+0000 7f1872a00700 1 -- 172.21.15.81:0/1212579324 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f186800cb70 con 0x7f187c114410 2024-04-23T14:55:47.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.560+0000 7f1872a00700 1 --2- 172.21.15.81:0/1212579324 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f186006ec00 0x7f18600710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:47.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.560+0000 7f1872a00700 1 -- 172.21.15.81:0/1212579324 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f186808e320 con 0x7f187c114410 2024-04-23T14:55:47.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.561+0000 7f187aa00700 1 --2- 172.21.15.81:0/1212579324 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f186006ec00 0x7f18600710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:47.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.561+0000 7f187aa00700 1 --2- 172.21.15.81:0/1212579324 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f186006ec00 0x7f18600710b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f186c013870 tx=0x7f186c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:47.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.565+0000 7f1872a00700 1 -- 172.21.15.81:0/1212579324 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f186805ad80 con 0x7f187c114410 2024-04-23T14:55:47.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:47 smithi156 ceph-mon[77738]: from='client.34310 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:55:47.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:47 smithi156 ceph-mon[77738]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:55:47.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:47 smithi156 ceph-mon[77738]: pgmap v118: 65 pgs: 65 active+clean; 197 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 842 B/s rd, 1 op/s 2024-04-23T14:55:47.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:47 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:47.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:47 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/4159036676' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:55:47.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:47 smithi081 ceph-mon[90469]: from='client.34310 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:55:47.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:47 smithi081 ceph-mon[90469]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:55:47.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:47 smithi081 ceph-mon[90469]: pgmap v118: 65 pgs: 65 active+clean; 197 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 842 B/s rd, 1 op/s 2024-04-23T14:55:47.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:47 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:47.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:47 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/4159036676' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:55:47.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.844+0000 7f1881600700 1 -- 172.21.15.81:0/1212579324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f187c073350 con 0x7f187c114410 2024-04-23T14:55:47.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.845+0000 7f1872a00700 1 -- 172.21.15.81:0/1212579324 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1907 (secure 0 0 0) 0x7f186805a910 con 0x7f187c114410 2024-04-23T14:55:47.845 INFO:teuthology.orchestra.run.smithi081.stdout:e18 2024-04-23T14:55:47.845 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-23T14:55:47.846 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:55:47.846 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-04-23T14:55:47.846 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:55:47.846 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-04-23T14:55:47.846 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-04-23T14:55:47.846 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 17 2024-04-23T14:55:47.846 INFO:teuthology.orchestra.run.smithi081.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-23T14:55:47.846 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-04-23T14:45:51.264703+0000 2024-04-23T14:55:47.846 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-04-23T14:46:12.782992+0000 2024-04-23T14:55:47.846 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-04-23T14:55:47.846 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-04-23T14:55:47.847 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-04-23T14:55:47.847 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-04-23T14:55:47.847 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-04-23T14:55:47.847 INFO:teuthology.orchestra.run.smithi081.stdout:max_xattr_size 65536 2024-04-23T14:55:47.847 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-04-23T14:55:47.847 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-04-23T14:55:47.847 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 47 2024-04-23T14:55:47.847 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:55:47.847 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 1 2024-04-23T14:55:47.847 INFO:teuthology.orchestra.run.smithi081.stdout:in 0 2024-04-23T14:55:47.847 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=14472} 2024-04-23T14:55:47.847 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-04-23T14:55:47.847 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-04-23T14:55:47.848 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-04-23T14:55:47.848 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-04-23T14:55:47.848 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-04-23T14:55:47.848 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-04-23T14:55:47.848 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-04-23T14:55:47.848 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-04-23T14:55:47.848 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-04-23T14:55:47.848 INFO:teuthology.orchestra.run.smithi081.stdout:qdb_cluster leader: 0 members: 2024-04-23T14:55:47.848 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.vcoywg{0:14472} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.81:6828/2563365650,v1:172.21.15.81:6829/2563365650] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:55:47.848 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.wydgcg{0:14482} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.81:6826/759909104,v1:172.21.15.81:6827/759909104] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:55:47.848 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:55:47.848 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:55:47.848 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-04-23T14:55:47.848 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:55:47.848 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.vynkxn{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.156:6826/1794690362,v1:172.21.15.156:6827/1794690362] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:55:47.849 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.rhbtxt{-1:24263} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.156:6824/3854041261,v1:172.21.15.156:6825/3854041261] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:55:47.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.848+0000 7f1881600700 1 -- 172.21.15.81:0/1212579324 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f186006ec00 msgr2=0x7f18600710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:47.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.848+0000 7f1881600700 1 --2- 172.21.15.81:0/1212579324 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f186006ec00 0x7f18600710b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f186c013870 tx=0x7f186c009e30 comp rx=0 tx=0).stop 2024-04-23T14:55:47.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.848+0000 7f1881600700 1 -- 172.21.15.81:0/1212579324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f187c114410 msgr2=0x7f187c119440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:47.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.848+0000 7f1881600700 1 --2- 172.21.15.81:0/1212579324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f187c114410 0x7f187c119440 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f186800eb40 tx=0x7f186800b040 comp rx=0 tx=0).stop 2024-04-23T14:55:47.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.848+0000 7f1881600700 1 -- 172.21.15.81:0/1212579324 shutdown_connections 2024-04-23T14:55:47.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.848+0000 7f1881600700 1 --2- 172.21.15.81:0/1212579324 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f186006ec00 0x7f18600710b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:47.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.848+0000 7f1881600700 1 --2- 172.21.15.81:0/1212579324 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f187c072820 0x7f187c113ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:47.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.848+0000 7f1881600700 1 --2- 172.21.15.81:0/1212579324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f187c114410 0x7f187c119440 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:47.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.848+0000 7f1881600700 1 -- 172.21.15.81:0/1212579324 >> 172.21.15.81:0/1212579324 conn(0x7f187c0fa790 msgr2=0x7f187c0fbdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:47.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.849+0000 7f1881600700 1 -- 172.21.15.81:0/1212579324 shutdown_connections 2024-04-23T14:55:47.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.849+0000 7f1881600700 1 -- 172.21.15.81:0/1212579324 wait complete. 2024-04-23T14:55:47.850 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 18 2024-04-23T14:55:47.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.997+0000 7f3970400700 1 -- 172.21.15.81:0/2837047467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39680ff020 msgr2=0x7f39680ff430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:47.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.997+0000 7f3970400700 1 --2- 172.21.15.81:0/2837047467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39680ff020 0x7f39680ff430 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f395c004940 tx=0x7f395c009e30 comp rx=0 tx=0).stop 2024-04-23T14:55:47.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.997+0000 7f3970400700 1 -- 172.21.15.81:0/2837047467 shutdown_connections 2024-04-23T14:55:47.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.997+0000 7f3970400700 1 --2- 172.21.15.81:0/2837047467 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39681002d0 0x7f3968100740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:47.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.997+0000 7f3970400700 1 --2- 172.21.15.81:0/2837047467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39680ff020 0x7f39680ff430 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:47.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.997+0000 7f3970400700 1 -- 172.21.15.81:0/2837047467 >> 172.21.15.81:0/2837047467 conn(0x7f39680fa950 msgr2=0x7f39680fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:47.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.997+0000 7f3970400700 1 -- 172.21.15.81:0/2837047467 shutdown_connections 2024-04-23T14:55:47.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.997+0000 7f3970400700 1 -- 172.21.15.81:0/2837047467 wait complete. 2024-04-23T14:55:48.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.998+0000 7f3970400700 1 Processor -- start 2024-04-23T14:55:48.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.998+0000 7f3970400700 1 -- start start 2024-04-23T14:55:48.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.999+0000 7f3970400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39680ff020 0x7f396810fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:48.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.999+0000 7f3970400700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39681002d0 0x7f3968110090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:48.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.999+0000 7f3970400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3968110720 con 0x7f39680ff020 2024-04-23T14:55:48.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.999+0000 7f3970400700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39681150c0 con 0x7f39681002d0 2024-04-23T14:55:48.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.999+0000 7f396da00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39680ff020 0x7f396810fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:48.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.999+0000 7f396da00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39680ff020 0x7f396810fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56168/0 (socket says 172.21.15.81:56168) 2024-04-23T14:55:48.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.999+0000 7f396da00700 1 -- 172.21.15.81:0/109646363 learned_addr learned my addr 172.21.15.81:0/109646363 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:55:48.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.999+0000 7f396da00700 1 -- 172.21.15.81:0/109646363 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39681002d0 msgr2=0x7f3968110090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:48.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.999+0000 7f396da00700 1 --2- 172.21.15.81:0/109646363 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39681002d0 0x7f3968110090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:48.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:47.999+0000 7f396da00700 1 -- 172.21.15.81:0/109646363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f395c005040 con 0x7f39680ff020 2024-04-23T14:55:48.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.000+0000 7f396da00700 1 --2- 172.21.15.81:0/109646363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39680ff020 0x7f396810fb50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f395c00b3b0 tx=0x7f395c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:48.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.000+0000 7f3965600700 1 -- 172.21.15.81:0/109646363 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f395c00e040 con 0x7f39680ff020 2024-04-23T14:55:48.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.000+0000 7f3965600700 1 -- 172.21.15.81:0/109646363 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f395c004290 con 0x7f39680ff020 2024-04-23T14:55:48.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.000+0000 7f3965600700 1 -- 172.21.15.81:0/109646363 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f395c01c630 con 0x7f39680ff020 2024-04-23T14:55:48.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.000+0000 7f3970400700 1 -- 172.21.15.81:0/109646363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39681152c0 con 0x7f39680ff020 2024-04-23T14:55:48.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.000+0000 7f3970400700 1 -- 172.21.15.81:0/109646363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3968115830 con 0x7f39680ff020 2024-04-23T14:55:48.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.001+0000 7f3970400700 1 -- 172.21.15.81:0/109646363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f396804c710 con 0x7f39680ff020 2024-04-23T14:55:48.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.002+0000 7f3965600700 1 -- 172.21.15.81:0/109646363 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f395c00bbf0 con 0x7f39680ff020 2024-04-23T14:55:48.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.003+0000 7f3965600700 1 --2- 172.21.15.81:0/109646363 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f395006ec00 0x7f39500710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:48.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.003+0000 7f3965600700 1 -- 172.21.15.81:0/109646363 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f395c08fc40 con 0x7f39680ff020 2024-04-23T14:55:48.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.003+0000 7f396d000700 1 --2- 172.21.15.81:0/109646363 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f395006ec00 0x7f39500710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:48.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.004+0000 7f396d000700 1 --2- 172.21.15.81:0/109646363 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f395006ec00 0x7f39500710b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3954006fd0 tx=0x7f3954006db0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:48.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.008+0000 7f3965600700 1 -- 172.21.15.81:0/109646363 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f395c05c5d0 con 0x7f39680ff020 2024-04-23T14:55:48.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.236+0000 7f3970400700 1 -- 172.21.15.81:0/109646363 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3968115aa0 con 0x7f395006ec00 2024-04-23T14:55:48.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.239+0000 7f3965600700 1 -- 172.21.15.81:0/109646363 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f3968115aa0 con 0x7f395006ec00 2024-04-23T14:55:48.240 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:55:48.240 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd", 2024-04-23T14:55:48.240 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-04-23T14:55:48.240 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-23T14:55:48.240 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [ 2024-04-23T14:55:48.240 INFO:teuthology.orchestra.run.smithi081.stdout: "mon", 2024-04-23T14:55:48.240 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-04-23T14:55:48.240 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr" 2024-04-23T14:55:48.240 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-04-23T14:55:48.240 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "9/21 daemons upgraded", 2024-04-23T14:55:48.240 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "Currently upgrading osd daemons", 2024-04-23T14:55:48.240 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-04-23T14:55:48.240 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:55:48.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.242+0000 7f3970400700 1 -- 172.21.15.81:0/109646363 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f395006ec00 msgr2=0x7f39500710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:48.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.242+0000 7f3970400700 1 --2- 172.21.15.81:0/109646363 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f395006ec00 0x7f39500710b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3954006fd0 tx=0x7f3954006db0 comp rx=0 tx=0).stop 2024-04-23T14:55:48.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.242+0000 7f3970400700 1 -- 172.21.15.81:0/109646363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39680ff020 msgr2=0x7f396810fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:48.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.242+0000 7f3970400700 1 --2- 172.21.15.81:0/109646363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39680ff020 0x7f396810fb50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f395c00b3b0 tx=0x7f395c009e30 comp rx=0 tx=0).stop 2024-04-23T14:55:48.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.242+0000 7f3970400700 1 -- 172.21.15.81:0/109646363 shutdown_connections 2024-04-23T14:55:48.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.242+0000 7f3970400700 1 --2- 172.21.15.81:0/109646363 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f395006ec00 0x7f39500710b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:48.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.242+0000 7f3970400700 1 --2- 172.21.15.81:0/109646363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39680ff020 0x7f396810fb50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:48.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.242+0000 7f3970400700 1 --2- 172.21.15.81:0/109646363 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39681002d0 0x7f3968110090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:48.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.242+0000 7f3970400700 1 -- 172.21.15.81:0/109646363 >> 172.21.15.81:0/109646363 conn(0x7f39680fa950 msgr2=0x7f39680fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:48.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.242+0000 7f3970400700 1 -- 172.21.15.81:0/109646363 shutdown_connections 2024-04-23T14:55:48.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.242+0000 7f3970400700 1 -- 172.21.15.81:0/109646363 wait complete. 2024-04-23T14:55:48.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.390+0000 7f083e800700 1 -- 172.21.15.81:0/1988491758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0838103420 msgr2=0x7f0838103830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:48.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.390+0000 7f083e800700 1 --2- 172.21.15.81:0/1988491758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0838103420 0x7f0838103830 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0828004940 tx=0x7f0828009e30 comp rx=0 tx=0).stop 2024-04-23T14:55:48.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.390+0000 7f083e800700 1 -- 172.21.15.81:0/1988491758 shutdown_connections 2024-04-23T14:55:48.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.390+0000 7f083e800700 1 --2- 172.21.15.81:0/1988491758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08381046d0 0x7f0838104b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:48.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.390+0000 7f083e800700 1 --2- 172.21.15.81:0/1988491758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0838103420 0x7f0838103830 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:48.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.390+0000 7f083e800700 1 -- 172.21.15.81:0/1988491758 >> 172.21.15.81:0/1988491758 conn(0x7f0838072640 msgr2=0x7f0838074a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:48.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.391+0000 7f083e800700 1 -- 172.21.15.81:0/1988491758 shutdown_connections 2024-04-23T14:55:48.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.391+0000 7f083e800700 1 -- 172.21.15.81:0/1988491758 wait complete. 2024-04-23T14:55:48.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.391+0000 7f083e800700 1 Processor -- start 2024-04-23T14:55:48.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.392+0000 7f083e800700 1 -- start start 2024-04-23T14:55:48.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.392+0000 7f083e800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0838103420 0x7f0838113f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:48.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.392+0000 7f083e800700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08381046d0 0x7f0838114490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:48.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.392+0000 7f083e800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0838114b20 con 0x7f0838103420 2024-04-23T14:55:48.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.392+0000 7f083e800700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08381194c0 con 0x7f08381046d0 2024-04-23T14:55:48.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.392+0000 7f0837400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0838103420 0x7f0838113f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:48.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.392+0000 7f0837400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0838103420 0x7f0838113f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56182/0 (socket says 172.21.15.81:56182) 2024-04-23T14:55:48.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.392+0000 7f0837400700 1 -- 172.21.15.81:0/4095860206 learned_addr learned my addr 172.21.15.81:0/4095860206 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:55:48.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.393+0000 7f0837400700 1 -- 172.21.15.81:0/4095860206 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08381046d0 msgr2=0x7f0838114490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:48.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.393+0000 7f0837400700 1 --2- 172.21.15.81:0/4095860206 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08381046d0 0x7f0838114490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:48.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.393+0000 7f0837400700 1 -- 172.21.15.81:0/4095860206 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0828005040 con 0x7f0838103420 2024-04-23T14:55:48.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.393+0000 7f0837400700 1 --2- 172.21.15.81:0/4095860206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0838103420 0x7f0838113f50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f082800b3b0 tx=0x7f0828009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:48.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.393+0000 7f082f400700 1 -- 172.21.15.81:0/4095860206 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f082800e040 con 0x7f0838103420 2024-04-23T14:55:48.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.393+0000 7f082f400700 1 -- 172.21.15.81:0/4095860206 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0828004290 con 0x7f0838103420 2024-04-23T14:55:48.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.393+0000 7f082f400700 1 -- 172.21.15.81:0/4095860206 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f082801c630 con 0x7f0838103420 2024-04-23T14:55:48.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.393+0000 7f083e800700 1 -- 172.21.15.81:0/4095860206 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08381196c0 con 0x7f0838103420 2024-04-23T14:55:48.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.393+0000 7f083e800700 1 -- 172.21.15.81:0/4095860206 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0838119c30 con 0x7f0838103420 2024-04-23T14:55:48.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.394+0000 7f083e800700 1 -- 172.21.15.81:0/4095860206 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f083804c710 con 0x7f0838103420 2024-04-23T14:55:48.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.395+0000 7f082f400700 1 -- 172.21.15.81:0/4095860206 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f082800bbf0 con 0x7f0838103420 2024-04-23T14:55:48.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.396+0000 7f082f400700 1 --2- 172.21.15.81:0/4095860206 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f081c06ec00 0x7f081c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:55:48.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.396+0000 7f082f400700 1 -- 172.21.15.81:0/4095860206 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f082808fc40 con 0x7f0838103420 2024-04-23T14:55:48.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.396+0000 7f0836a00700 1 --2- 172.21.15.81:0/4095860206 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f081c06ec00 0x7f081c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:55:48.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.397+0000 7f0836a00700 1 --2- 172.21.15.81:0/4095860206 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f081c06ec00 0x7f081c0710b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0824006fd0 tx=0x7f0824006db0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:55:48.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.401+0000 7f082f400700 1 -- 172.21.15.81:0/4095860206 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f082805c5d0 con 0x7f0838103420 2024-04-23T14:55:48.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.713+0000 7f083e800700 1 -- 172.21.15.81:0/4095860206 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f083810bf90 con 0x7f0838103420 2024-04-23T14:55:48.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.714+0000 7f082f400700 1 -- 172.21.15.81:0/4095860206 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f082805c160 con 0x7f0838103420 2024-04-23T14:55:48.714 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-04-23T14:55:48.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.717+0000 7f083e800700 1 -- 172.21.15.81:0/4095860206 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f081c06ec00 msgr2=0x7f081c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:48.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.717+0000 7f083e800700 1 --2- 172.21.15.81:0/4095860206 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f081c06ec00 0x7f081c0710b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0824006fd0 tx=0x7f0824006db0 comp rx=0 tx=0).stop 2024-04-23T14:55:48.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.717+0000 7f083e800700 1 -- 172.21.15.81:0/4095860206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0838103420 msgr2=0x7f0838113f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:55:48.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.717+0000 7f083e800700 1 --2- 172.21.15.81:0/4095860206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0838103420 0x7f0838113f50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f082800b3b0 tx=0x7f0828009e30 comp rx=0 tx=0).stop 2024-04-23T14:55:48.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.717+0000 7f083e800700 1 -- 172.21.15.81:0/4095860206 shutdown_connections 2024-04-23T14:55:48.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.717+0000 7f083e800700 1 --2- 172.21.15.81:0/4095860206 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f081c06ec00 0x7f081c0710b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:48.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.717+0000 7f083e800700 1 --2- 172.21.15.81:0/4095860206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0838103420 0x7f0838113f50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:48.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.717+0000 7f083e800700 1 --2- 172.21.15.81:0/4095860206 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08381046d0 0x7f0838114490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:55:48.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.717+0000 7f083e800700 1 -- 172.21.15.81:0/4095860206 >> 172.21.15.81:0/4095860206 conn(0x7f0838072640 msgr2=0x7f0838073cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:55:48.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.717+0000 7f083e800700 1 -- 172.21.15.81:0/4095860206 shutdown_connections 2024-04-23T14:55:48.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:55:48.717+0000 7f083e800700 1 -- 172.21.15.81:0/4095860206 wait complete. 2024-04-23T14:55:48.919 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:48 smithi156 ceph-mon[77738]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:55:48.919 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:48 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/1212579324' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:55:49.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:48 smithi081 ceph-mon[90469]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:55:49.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:48 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/1212579324' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:55:49.286 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:48 smithi156 systemd[1]: Stopping Ceph osd.3 for 7a641bea-017e-11ef-bc93-c7b262605968... 2024-04-23T14:55:49.653 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:49 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3[37802]: 2024-04-23T14:55:49.336+0000 7f7720600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T14:55:49.653 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:49 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3[37802]: 2024-04-23T14:55:49.336+0000 7f7720600700 -1 osd.3 65 *** Got signal Terminated *** 2024-04-23T14:55:49.653 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:49 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3[37802]: 2024-04-23T14:55:49.336+0000 7f7720600700 -1 osd.3 65 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-23T14:55:50.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:49 smithi156 ceph-mon[77738]: from='client.34330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:55:50.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:49 smithi156 ceph-mon[77738]: pgmap v119: 65 pgs: 65 active+clean; 197 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:55:50.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:49 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/4095860206' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:55:50.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:49 smithi156 ceph-mon[77738]: osd.3 marked itself down and dead 2024-04-23T14:55:50.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:49 smithi081 ceph-mon[90469]: from='client.34330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:55:50.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:49 smithi081 ceph-mon[90469]: pgmap v119: 65 pgs: 65 active+clean; 197 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:55:50.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:49 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/4095860206' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:55:50.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:49 smithi081 ceph-mon[90469]: osd.3 marked itself down and dead 2024-04-23T14:55:50.611 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:50 smithi156 podman[86632]: 2024-04-23 14:55:50.335571849 +0000 UTC m=+1.127709246 container died c1c261b1ee90c8fa340d68eb037645b1a8a3a0ec87fff08a8e7a0dbe571a5f3f (image=quay.ceph.io/ceph-ci/ceph@sha256:3890cd726bd5e73ae623dabdf4ed76dd5df81c936b8bd8d761026babda969466, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-70d0cb4) 2024-04-23T14:55:50.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:50 smithi156 ceph-mon[77738]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-23T14:55:50.931 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:50 smithi156 ceph-mon[77738]: osdmap e66: 6 total, 5 up, 6 in 2024-04-23T14:55:50.931 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:50 smithi156 podman[86632]: 2024-04-23 14:55:50.745863857 +0000 UTC m=+1.538001244 container cleanup c1c261b1ee90c8fa340d68eb037645b1a8a3a0ec87fff08a8e7a0dbe571a5f3f (image=quay.ceph.io/ceph-ci/ceph@sha256:3890cd726bd5e73ae623dabdf4ed76dd5df81c936b8bd8d761026babda969466, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=quincy-70d0cb4, org.label-schema.schema-version=1.0, ceph=True) 2024-04-23T14:55:50.931 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:50 smithi156 bash[86632]: ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3 2024-04-23T14:55:51.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:50 smithi081 ceph-mon[90469]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-23T14:55:51.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:50 smithi081 ceph-mon[90469]: osdmap e66: 6 total, 5 up, 6 in 2024-04-23T14:55:51.286 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:50 smithi156 podman[86650]: 2024-04-23 14:55:50.930366832 +0000 UTC m=+0.578395695 container remove c1c261b1ee90c8fa340d68eb037645b1a8a3a0ec87fff08a8e7a0dbe571a5f3f (image=quay.ceph.io/ceph-ci/ceph@sha256:3890cd726bd5e73ae623dabdf4ed76dd5df81c936b8bd8d761026babda969466, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=quincy-70d0cb4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T14:55:51.982 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:51 smithi156 ceph-mon[77738]: pgmap v121: 65 pgs: 16 stale+active+clean, 49 active+clean; 197 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-23T14:55:51.982 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:51 smithi156 ceph-mon[77738]: osdmap e67: 6 total, 5 up, 6 in 2024-04-23T14:55:51.983 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:51 smithi156 podman[86735]: 2024-04-23 14:55:51.656824391 +0000 UTC m=+0.033394941 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T14:55:51.983 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:51 smithi156 podman[86735]: 2024-04-23 14:55:51.789636019 +0000 UTC m=+0.166206601 container create 6deb498831ee61e440f2640390c74d18bf1e2d017e3ae26e59396bd2abcc5387 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T14:55:52.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:51 smithi081 ceph-mon[90469]: pgmap v121: 65 pgs: 16 stale+active+clean, 49 active+clean; 197 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-23T14:55:52.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:51 smithi081 ceph-mon[90469]: osdmap e67: 6 total, 5 up, 6 in 2024-04-23T14:55:52.286 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:52 smithi156 podman[86735]: 2024-04-23 14:55:52.11117587 +0000 UTC m=+0.487746471 container init 6deb498831ee61e440f2640390c74d18bf1e2d017e3ae26e59396bd2abcc5387 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=) 2024-04-23T14:55:52.287 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:52 smithi156 podman[86735]: 2024-04-23 14:55:52.124262558 +0000 UTC m=+0.500833102 container start 6deb498831ee61e440f2640390c74d18bf1e2d017e3ae26e59396bd2abcc5387 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS) 2024-04-23T14:55:52.287 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:52 smithi156 podman[86735]: 2024-04-23 14:55:52.217295409 +0000 UTC m=+0.593865997 container attach 6deb498831ee61e440f2640390c74d18bf1e2d017e3ae26e59396bd2abcc5387 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS) 2024-04-23T14:55:52.992 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:52 smithi156 ceph-mon[77738]: Health check failed: Degraded data redundancy: 18/222 objects degraded (8.108%), 6 pgs degraded (PG_DEGRADED) 2024-04-23T14:55:52.992 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:52 smithi156 podman[86735]: 2024-04-23 14:55:52.583796832 +0000 UTC m=+0.960367424 container died 6deb498831ee61e440f2640390c74d18bf1e2d017e3ae26e59396bd2abcc5387 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True) 2024-04-23T14:55:53.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:52 smithi081 ceph-mon[90469]: Health check failed: Degraded data redundancy: 18/222 objects degraded (8.108%), 6 pgs degraded (PG_DEGRADED) 2024-04-23T14:55:53.733 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:53 smithi156 podman[86761]: 2024-04-23 14:55:53.320856147 +0000 UTC m=+0.720219760 container remove 6deb498831ee61e440f2640390c74d18bf1e2d017e3ae26e59396bd2abcc5387 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T14:55:53.734 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:53 smithi156 systemd[1]: ceph-7a641bea-017e-11ef-bc93-c7b262605968@osd.3.service: Deactivated successfully. 2024-04-23T14:55:53.734 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:53 smithi156 systemd[1]: Stopped Ceph osd.3 for 7a641bea-017e-11ef-bc93-c7b262605968. 2024-04-23T14:55:53.734 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:53 smithi156 systemd[1]: ceph-7a641bea-017e-11ef-bc93-c7b262605968@osd.3.service: Consumed 2min 17.585s CPU time. 2024-04-23T14:55:54.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:53 smithi156 ceph-mon[77738]: pgmap v123: 65 pgs: 6 active+undersized+degraded, 10 stale+active+clean, 10 active+undersized, 39 active+clean; 197 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 18/222 objects degraded (8.108%) 2024-04-23T14:55:54.036 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:53 smithi156 systemd[1]: Starting Ceph osd.3 for 7a641bea-017e-11ef-bc93-c7b262605968... 2024-04-23T14:55:54.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:53 smithi081 ceph-mon[90469]: pgmap v123: 65 pgs: 6 active+undersized+degraded, 10 stale+active+clean, 10 active+undersized, 39 active+clean; 197 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 18/222 objects degraded (8.108%) 2024-04-23T14:55:54.387 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:54 smithi156 podman[86859]: 2024-04-23 14:55:54.033170923 +0000 UTC m=+0.034512279 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T14:55:54.388 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:54 smithi156 podman[86859]: 2024-04-23 14:55:54.138317479 +0000 UTC m=+0.139658874 container create d4dbd6389e1c0acc1ad11898511d091ed552fbd1228d6285f9a880d8c965c5b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3-activate, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, ceph=True, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux ) 2024-04-23T14:55:54.388 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:54 smithi156 podman[86859]: 2024-04-23 14:55:54.374976371 +0000 UTC m=+0.376317770 container init d4dbd6389e1c0acc1ad11898511d091ed552fbd1228d6285f9a880d8c965c5b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3-activate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-04-23T14:55:54.388 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:54 smithi156 podman[86859]: 2024-04-23 14:55:54.386779898 +0000 UTC m=+0.388121320 container start d4dbd6389e1c0acc1ad11898511d091ed552fbd1228d6285f9a880d8c965c5b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3-activate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2) 2024-04-23T14:55:54.746 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:54 smithi156 podman[86859]: 2024-04-23 14:55:54.465435662 +0000 UTC m=+0.466777022 container attach d4dbd6389e1c0acc1ad11898511d091ed552fbd1228d6285f9a880d8c965c5b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3-activate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240416, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T14:55:55.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:54 smithi156 ceph-mon[77738]: pgmap v124: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 197 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 48/222 objects degraded (21.622%) 2024-04-23T14:55:55.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:54 smithi081 ceph-mon[90469]: pgmap v124: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 197 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 48/222 objects degraded (21.622%) 2024-04-23T14:55:55.769 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:55 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3-activate[86873]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-23T14:55:55.769 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:55 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3-activate[86873]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-23T14:55:55.769 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:55 smithi156 bash[86859]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-23T14:55:55.769 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:55 smithi156 bash[86859]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-23T14:55:55.769 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:55 smithi156 bash[86859]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-23T14:55:55.769 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:55 smithi156 bash[86859]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-23T14:55:55.769 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:55 smithi156 bash[86859]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-23T14:55:55.770 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:55 smithi156 bash[86859]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-23T14:55:55.770 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:55 smithi156 bash[86859]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-04-23T14:55:55.770 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:55 smithi156 bash[86859]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-23T14:55:55.770 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:55 smithi156 bash[86859]: --> ceph-volume raw activate successful for osd ID: 3 2024-04-23T14:55:55.770 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:55 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3-activate[86873]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-23T14:55:55.770 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:55 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3-activate[86873]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-23T14:55:55.770 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:55 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3-activate[86873]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-23T14:55:55.770 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:55 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3-activate[86873]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-23T14:55:55.770 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:55 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3-activate[86873]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-04-23T14:55:55.770 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:55 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3-activate[86873]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-23T14:55:55.770 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:55 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3-activate[86873]: --> ceph-volume raw activate successful for osd ID: 3 2024-04-23T14:55:55.770 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:55 smithi156 podman[86859]: 2024-04-23 14:55:55.400436887 +0000 UTC m=+1.401778286 container died d4dbd6389e1c0acc1ad11898511d091ed552fbd1228d6285f9a880d8c965c5b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, ceph=True, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-04-23T14:55:56.494 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:56 smithi156 podman[87003]: 2024-04-23 14:55:56.127529728 +0000 UTC m=+0.708709283 container remove d4dbd6389e1c0acc1ad11898511d091ed552fbd1228d6285f9a880d8c965c5b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3-activate, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-04-23T14:55:56.765 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:56 smithi156 podman[87064]: 2024-04-23 14:55:56.494823879 +0000 UTC m=+0.129171129 container create 9af3ca1ff69b02c8cb529438bdd86766712138dc040189b4e5c566520240de80 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True) 2024-04-23T14:55:56.765 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:56 smithi156 podman[87064]: 2024-04-23 14:55:56.402348281 +0000 UTC m=+0.036695515 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T14:55:57.037 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:56 smithi156 podman[87064]: 2024-04-23 14:55:56.765305999 +0000 UTC m=+0.399653268 container init 9af3ca1ff69b02c8cb529438bdd86766712138dc040189b4e5c566520240de80 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS) 2024-04-23T14:55:57.037 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:56 smithi156 podman[87064]: 2024-04-23 14:55:56.776149839 +0000 UTC m=+0.410497074 container start 9af3ca1ff69b02c8cb529438bdd86766712138dc040189b4e5c566520240de80 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T14:55:57.037 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:56 smithi156 ceph-osd[87083]: -- 172.21.15.156:0/3412670039 <== mon.1 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cc305f9680 con 0x55cc305c2c00 2024-04-23T14:55:57.037 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:56 smithi156 bash[87064]: 9af3ca1ff69b02c8cb529438bdd86766712138dc040189b4e5c566520240de80 2024-04-23T14:55:57.037 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:56 smithi156 systemd[1]: Started Ceph osd.3 for 7a641bea-017e-11ef-bc93-c7b262605968. 2024-04-23T14:55:57.781 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:57 smithi081 ceph-mon[90469]: pgmap v125: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 197 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 48/222 objects degraded (21.622%) 2024-04-23T14:55:57.781 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:57 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:57.781 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:57 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:55:57.781 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:57 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:57.781 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:57 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:57.781 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:57 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:55:57.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:57 smithi156 ceph-mon[77738]: pgmap v125: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 197 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 48/222 objects degraded (21.622%) 2024-04-23T14:55:57.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:57 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:57.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:57 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:55:57.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:57 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:57.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:57 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:55:57.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:57 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:55:57.786 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:55:57 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3[87079]: 2024-04-23T14:55:57.347+0000 7f456c3bd7c0 -1 Falling back to public interface 2024-04-23T14:55:59.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:55:59 smithi156 ceph-mon[77738]: pgmap v126: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 197 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 48/222 objects degraded (21.622%) 2024-04-23T14:55:59.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:55:59 smithi081 ceph-mon[90469]: pgmap v126: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 197 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 48/222 objects degraded (21.622%) 2024-04-23T14:56:01.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:01 smithi081 ceph-mon[90469]: pgmap v127: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 197 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 48/222 objects degraded (21.622%) 2024-04-23T14:56:01.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:01 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:01.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:01 smithi081 ceph-mon[90469]: Health check update: Degraded data redundancy: 48/222 objects degraded (21.622%), 17 pgs degraded (PG_DEGRADED) 2024-04-23T14:56:01.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:01 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:02.030 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:01 smithi156 ceph-mon[77738]: pgmap v127: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 197 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 48/222 objects degraded (21.622%) 2024-04-23T14:56:02.030 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:01 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:02.030 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:01 smithi156 ceph-mon[77738]: Health check update: Degraded data redundancy: 48/222 objects degraded (21.622%), 17 pgs degraded (PG_DEGRADED) 2024-04-23T14:56:02.031 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:01 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:03.786 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:56:03 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3[87079]: 2024-04-23T14:56:03.365+0000 7f456c3bd7c0 -1 osd.3 65 log_to_monitors true 2024-04-23T14:56:03.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:03 smithi156 ceph-mon[77738]: pgmap v128: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 197 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 48/222 objects degraded (21.622%) 2024-04-23T14:56:03.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:03 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:03.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:03 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:03.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:03 smithi156 ceph-mon[77738]: from='osd.3 [v2:172.21.15.156:6800/3882389280,v1:172.21.15.156:6801/3882389280]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-23T14:56:03.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:03 smithi156 ceph-mon[77738]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-23T14:56:03.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:03 smithi081 ceph-mon[90469]: pgmap v128: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 197 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 48/222 objects degraded (21.622%) 2024-04-23T14:56:03.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:03 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:03.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:03 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:03.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:03 smithi081 ceph-mon[90469]: from='osd.3 [v2:172.21.15.156:6800/3882389280,v1:172.21.15.156:6801/3882389280]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-23T14:56:03.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:03 smithi081 ceph-mon[90469]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-23T14:56:05.381 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 14:56:05 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3[87079]: 2024-04-23T14:56:05.279+0000 7f4556800700 -1 osd.3 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T14:56:05.382 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:05 smithi156 ceph-mon[77738]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-23T14:56:05.382 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:05 smithi156 ceph-mon[77738]: osdmap e68: 6 total, 5 up, 6 in 2024-04-23T14:56:05.382 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:05 smithi156 ceph-mon[77738]: from='osd.3 [v2:172.21.15.156:6800/3882389280,v1:172.21.15.156:6801/3882389280]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-23T14:56:05.382 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:05 smithi156 ceph-mon[77738]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-23T14:56:05.382 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:05 smithi156 ceph-mon[77738]: pgmap v130: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 48/222 objects degraded (21.622%) 2024-04-23T14:56:05.382 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:05 smithi156 ceph-mon[77738]: from='osd.3 ' entity='osd.3' 2024-04-23T14:56:05.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:05 smithi081 ceph-mon[90469]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-23T14:56:05.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:05 smithi081 ceph-mon[90469]: osdmap e68: 6 total, 5 up, 6 in 2024-04-23T14:56:05.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:05 smithi081 ceph-mon[90469]: from='osd.3 [v2:172.21.15.156:6800/3882389280,v1:172.21.15.156:6801/3882389280]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-23T14:56:05.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:05 smithi081 ceph-mon[90469]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-23T14:56:05.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:05 smithi081 ceph-mon[90469]: pgmap v130: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 48/222 objects degraded (21.622%) 2024-04-23T14:56:05.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:05 smithi081 ceph-mon[90469]: from='osd.3 ' entity='osd.3' 2024-04-23T14:56:06.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:06 smithi081 ceph-mon[90469]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-23T14:56:06.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:06 smithi081 ceph-mon[90469]: osd.3 [v2:172.21.15.156:6800/3882389280,v1:172.21.15.156:6801/3882389280] boot 2024-04-23T14:56:06.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:06 smithi081 ceph-mon[90469]: osdmap e69: 6 total, 6 up, 6 in 2024-04-23T14:56:06.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T14:56:06.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:06 smithi156 ceph-mon[77738]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-23T14:56:06.788 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:06 smithi156 ceph-mon[77738]: osd.3 [v2:172.21.15.156:6800/3882389280,v1:172.21.15.156:6801/3882389280] boot 2024-04-23T14:56:06.788 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:06 smithi156 ceph-mon[77738]: osdmap e69: 6 total, 6 up, 6 in 2024-04-23T14:56:06.788 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T14:56:07.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:07 smithi081 ceph-mon[90469]: pgmap v132: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 48/222 objects degraded (21.622%) 2024-04-23T14:56:07.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:07 smithi081 ceph-mon[90469]: osdmap e70: 6 total, 6 up, 6 in 2024-04-23T14:56:07.778 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:07 smithi156 ceph-mon[77738]: pgmap v132: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 48/222 objects degraded (21.622%) 2024-04-23T14:56:07.778 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:07 smithi156 ceph-mon[77738]: osdmap e70: 6 total, 6 up, 6 in 2024-04-23T14:56:09.031 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:08 smithi081 ceph-mon[90469]: Health check update: Degraded data redundancy: 37/222 objects degraded (16.667%), 14 pgs degraded (PG_DEGRADED) 2024-04-23T14:56:09.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:08 smithi156 ceph-mon[77738]: Health check update: Degraded data redundancy: 37/222 objects degraded (16.667%), 14 pgs degraded (PG_DEGRADED) 2024-04-23T14:56:10.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:09 smithi156 ceph-mon[77738]: pgmap v134: 65 pgs: 4 peering, 14 active+undersized+degraded, 12 active+undersized, 35 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 37/222 objects degraded (16.667%) 2024-04-23T14:56:10.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:09 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:10.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:09 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:10.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:09 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:56:10.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:09 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:56:10.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:09 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:10.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:09 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:56:10.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:09 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:56:10.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:09 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:56:10.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:09 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:56:10.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:09 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-23T14:56:10.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:09 smithi081 ceph-mon[90469]: pgmap v134: 65 pgs: 4 peering, 14 active+undersized+degraded, 12 active+undersized, 35 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 37/222 objects degraded (16.667%) 2024-04-23T14:56:10.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:09 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:10.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:09 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:10.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:09 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:56:10.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:09 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:56:10.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:09 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:10.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:09 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:56:10.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:09 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:56:10.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:09 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:56:10.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:09 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:56:10.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:09 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-23T14:56:11.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:10 smithi156 ceph-mon[77738]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-23T14:56:11.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:10 smithi156 ceph-mon[77738]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-04-23T14:56:11.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:10 smithi081 ceph-mon[90469]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-23T14:56:11.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:10 smithi081 ceph-mon[90469]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-04-23T14:56:12.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:11 smithi156 ceph-mon[77738]: pgmap v135: 65 pgs: 4 peering, 61 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 654 B/s rd, 1 op/s 2024-04-23T14:56:12.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:11 smithi156 ceph-mon[77738]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 37/222 objects degraded (16.667%), 14 pgs degraded) 2024-04-23T14:56:12.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:11 smithi156 ceph-mon[77738]: Cluster is now healthy 2024-04-23T14:56:12.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:11 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:12.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:11 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:56:12.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:11 smithi081 ceph-mon[90469]: pgmap v135: 65 pgs: 4 peering, 61 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 654 B/s rd, 1 op/s 2024-04-23T14:56:12.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:11 smithi081 ceph-mon[90469]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 37/222 objects degraded (16.667%), 14 pgs degraded) 2024-04-23T14:56:12.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:11 smithi081 ceph-mon[90469]: Cluster is now healthy 2024-04-23T14:56:12.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:11 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:12.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:11 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:56:13.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:12 smithi156 ceph-mon[77738]: pgmap v136: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 1 op/s 2024-04-23T14:56:13.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:12 smithi081 ceph-mon[90469]: pgmap v136: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 1 op/s 2024-04-23T14:56:16.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:15 smithi156 ceph-mon[77738]: pgmap v137: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-23T14:56:16.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:15 smithi081 ceph-mon[90469]: pgmap v137: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-23T14:56:17.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:17 smithi156 ceph-mon[77738]: pgmap v138: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s 2024-04-23T14:56:17.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:17 smithi081 ceph-mon[90469]: pgmap v138: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s 2024-04-23T14:56:18.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:18.880+0000 7f9faf200700 1 -- 172.21.15.81:0/3252439079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fa8103420 msgr2=0x7f9fa8103830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:18.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:18.880+0000 7f9faf200700 1 --2- 172.21.15.81:0/3252439079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fa8103420 0x7f9fa8103830 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9f98004940 tx=0x7f9f98009e30 comp rx=0 tx=0).stop 2024-04-23T14:56:18.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:18.880+0000 7f9faf200700 1 -- 172.21.15.81:0/3252439079 shutdown_connections 2024-04-23T14:56:18.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:18.880+0000 7f9faf200700 1 --2- 172.21.15.81:0/3252439079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fa81046d0 0x7f9fa8104b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:18.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:18.880+0000 7f9faf200700 1 --2- 172.21.15.81:0/3252439079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fa8103420 0x7f9fa8103830 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:18.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:18.880+0000 7f9faf200700 1 -- 172.21.15.81:0/3252439079 >> 172.21.15.81:0/3252439079 conn(0x7f9fa8072640 msgr2=0x7f9fa8074a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:18.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:18.880+0000 7f9faf200700 1 -- 172.21.15.81:0/3252439079 shutdown_connections 2024-04-23T14:56:18.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:18.880+0000 7f9faf200700 1 -- 172.21.15.81:0/3252439079 wait complete. 2024-04-23T14:56:18.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:18.881+0000 7f9faf200700 1 Processor -- start 2024-04-23T14:56:18.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:18.882+0000 7f9faf200700 1 -- start start 2024-04-23T14:56:18.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:18.882+0000 7f9faf200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fa8103420 0x7f9fa8113f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:18.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:18.882+0000 7f9faf200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fa81046d0 0x7f9fa81144a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:18.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:18.882+0000 7f9faf200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa8114aa0 con 0x7f9fa81046d0 2024-04-23T14:56:18.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:18.882+0000 7f9faf200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa8114c10 con 0x7f9fa8103420 2024-04-23T14:56:18.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:18.882+0000 7f9f9f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fa81046d0 0x7f9fa81144a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:18.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:18.883+0000 7f9f9f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fa81046d0 0x7f9fa81144a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48196/0 (socket says 172.21.15.81:48196) 2024-04-23T14:56:18.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:18.883+0000 7f9f9f400700 1 -- 172.21.15.81:0/4119463935 learned_addr learned my addr 172.21.15.81:0/4119463935 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:56:18.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:18.883+0000 7f9fa7e00700 1 --2- 172.21.15.81:0/4119463935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fa8103420 0x7f9fa8113f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:18.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:18.883+0000 7f9f9f400700 1 -- 172.21.15.81:0/4119463935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fa8103420 msgr2=0x7f9fa8113f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:18.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:18.883+0000 7f9f9f400700 1 --2- 172.21.15.81:0/4119463935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fa8103420 0x7f9fa8113f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:18.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:18.883+0000 7f9f9f400700 1 -- 172.21.15.81:0/4119463935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f98005040 con 0x7f9fa81046d0 2024-04-23T14:56:18.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:18.883+0000 7f9f9f400700 1 --2- 172.21.15.81:0/4119463935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fa81046d0 0x7f9fa81144a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9f9000c830 tx=0x7f9f90004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:18.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:18.883+0000 7f9fa4c00700 1 -- 172.21.15.81:0/4119463935 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f9000a760 con 0x7f9fa81046d0 2024-04-23T14:56:18.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:18.884+0000 7f9faf200700 1 -- 172.21.15.81:0/4119463935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa8119670 con 0x7f9fa81046d0 2024-04-23T14:56:18.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:18.884+0000 7f9fa4c00700 1 -- 172.21.15.81:0/4119463935 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9f9000ad90 con 0x7f9fa81046d0 2024-04-23T14:56:18.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:18.884+0000 7f9fa4c00700 1 -- 172.21.15.81:0/4119463935 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f900113a0 con 0x7f9fa81046d0 2024-04-23T14:56:18.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:18.884+0000 7f9faf200700 1 -- 172.21.15.81:0/4119463935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa8119c30 con 0x7f9fa81046d0 2024-04-23T14:56:18.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:18.885+0000 7f9faf200700 1 -- 172.21.15.81:0/4119463935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fa804c710 con 0x7f9fa81046d0 2024-04-23T14:56:18.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:18.886+0000 7f9fa4c00700 1 -- 172.21.15.81:0/4119463935 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f9f90012400 con 0x7f9fa81046d0 2024-04-23T14:56:18.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:18.887+0000 7f9fa4c00700 1 --2- 172.21.15.81:0/4119463935 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f9f8c06ec00 0x7f9f8c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:18.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:18.887+0000 7f9fa4c00700 1 -- 172.21.15.81:0/4119463935 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f9f9008e940 con 0x7f9fa81046d0 2024-04-23T14:56:18.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:18.887+0000 7f9fa7e00700 1 --2- 172.21.15.81:0/4119463935 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f9f8c06ec00 0x7f9f8c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:18.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:18.888+0000 7f9fa7e00700 1 --2- 172.21.15.81:0/4119463935 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f9f8c06ec00 0x7f9f8c0710b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9f9800b3b0 tx=0x7f9f98009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:18.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:18.891+0000 7f9fa4c00700 1 -- 172.21.15.81:0/4119463935 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f9f9005b250 con 0x7f9fa81046d0 2024-04-23T14:56:19.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.137+0000 7f9faf200700 1 -- 172.21.15.81:0/4119463935 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9fa8108a60 con 0x7f9f8c06ec00 2024-04-23T14:56:19.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.140+0000 7f9fa4c00700 1 -- 172.21.15.81:0/4119463935 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f9fa8108a60 con 0x7f9f8c06ec00 2024-04-23T14:56:19.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.143+0000 7f9faf200700 1 -- 172.21.15.81:0/4119463935 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f9f8c06ec00 msgr2=0x7f9f8c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:19.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.143+0000 7f9faf200700 1 --2- 172.21.15.81:0/4119463935 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f9f8c06ec00 0x7f9f8c0710b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9f9800b3b0 tx=0x7f9f98009e30 comp rx=0 tx=0).stop 2024-04-23T14:56:19.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.143+0000 7f9faf200700 1 -- 172.21.15.81:0/4119463935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fa81046d0 msgr2=0x7f9fa81144a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:19.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.143+0000 7f9faf200700 1 --2- 172.21.15.81:0/4119463935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fa81046d0 0x7f9fa81144a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9f9000c830 tx=0x7f9f90004470 comp rx=0 tx=0).stop 2024-04-23T14:56:19.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.143+0000 7f9faf200700 1 -- 172.21.15.81:0/4119463935 shutdown_connections 2024-04-23T14:56:19.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.143+0000 7f9faf200700 1 --2- 172.21.15.81:0/4119463935 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f9f8c06ec00 0x7f9f8c0710b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:19.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.143+0000 7f9faf200700 1 --2- 172.21.15.81:0/4119463935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fa8103420 0x7f9fa8113f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:19.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.143+0000 7f9faf200700 1 --2- 172.21.15.81:0/4119463935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fa81046d0 0x7f9fa81144a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:19.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.143+0000 7f9faf200700 1 -- 172.21.15.81:0/4119463935 >> 172.21.15.81:0/4119463935 conn(0x7f9fa8072640 msgr2=0x7f9fa8073d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:19.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.143+0000 7f9faf200700 1 -- 172.21.15.81:0/4119463935 shutdown_connections 2024-04-23T14:56:19.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.143+0000 7f9faf200700 1 -- 172.21.15.81:0/4119463935 wait complete. 2024-04-23T14:56:19.160 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-04-23T14:56:19.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.297+0000 7f2293e00700 1 -- 172.21.15.81:0/2263637728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22940fdee0 msgr2=0x7f22940fe350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:19.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.297+0000 7f2293e00700 1 --2- 172.21.15.81:0/2263637728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22940fdee0 0x7f22940fe350 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2280004940 tx=0x7f2280009e30 comp rx=0 tx=0).stop 2024-04-23T14:56:19.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.297+0000 7f2293e00700 1 -- 172.21.15.81:0/2263637728 shutdown_connections 2024-04-23T14:56:19.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.297+0000 7f2293e00700 1 --2- 172.21.15.81:0/2263637728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22940fdee0 0x7f22940fe350 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:19.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.297+0000 7f2293e00700 1 --2- 172.21.15.81:0/2263637728 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22940fcc30 0x7f22940fd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:19.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.297+0000 7f2293e00700 1 -- 172.21.15.81:0/2263637728 >> 172.21.15.81:0/2263637728 conn(0x7f22940f83d0 msgr2=0x7f22940fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:19.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.297+0000 7f2293e00700 1 -- 172.21.15.81:0/2263637728 shutdown_connections 2024-04-23T14:56:19.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.297+0000 7f2293e00700 1 -- 172.21.15.81:0/2263637728 wait complete. 2024-04-23T14:56:19.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.298+0000 7f2293e00700 1 Processor -- start 2024-04-23T14:56:19.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.298+0000 7f2293e00700 1 -- start start 2024-04-23T14:56:19.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.298+0000 7f2293e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22940fcc30 0x7f2294071df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:19.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.298+0000 7f2293e00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22940fdee0 0x7f2294070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:19.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.298+0000 7f2293e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2294070930 con 0x7f22940fcc30 2024-04-23T14:56:19.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.298+0000 7f2293e00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2294070a70 con 0x7f22940fdee0 2024-04-23T14:56:19.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.299+0000 7f2292a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22940fcc30 0x7f2294071df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:19.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.299+0000 7f2292a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22940fcc30 0x7f2294071df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48220/0 (socket says 172.21.15.81:48220) 2024-04-23T14:56:19.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.299+0000 7f2292a00700 1 -- 172.21.15.81:0/2667646646 learned_addr learned my addr 172.21.15.81:0/2667646646 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:56:19.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.299+0000 7f2292000700 1 --2- 172.21.15.81:0/2667646646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22940fdee0 0x7f2294070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:19.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.299+0000 7f2292a00700 1 -- 172.21.15.81:0/2667646646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22940fdee0 msgr2=0x7f2294070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:19.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.299+0000 7f2292a00700 1 --2- 172.21.15.81:0/2667646646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22940fdee0 0x7f2294070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:19.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.299+0000 7f2292a00700 1 -- 172.21.15.81:0/2667646646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2280005040 con 0x7f22940fcc30 2024-04-23T14:56:19.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.299+0000 7f2292000700 1 --2- 172.21.15.81:0/2667646646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22940fdee0 0x7f2294070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:56:19.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.299+0000 7f2292a00700 1 --2- 172.21.15.81:0/2667646646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22940fcc30 0x7f2294071df0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f228400b790 tx=0x7f2284009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:19.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.300+0000 7f228aa00700 1 -- 172.21.15.81:0/2667646646 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f228400f770 con 0x7f22940fcc30 2024-04-23T14:56:19.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.300+0000 7f228aa00700 1 -- 172.21.15.81:0/2667646646 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f228400fda0 con 0x7f22940fcc30 2024-04-23T14:56:19.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.300+0000 7f2293e00700 1 -- 172.21.15.81:0/2667646646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2294070d50 con 0x7f22940fcc30 2024-04-23T14:56:19.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.300+0000 7f228aa00700 1 -- 172.21.15.81:0/2667646646 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f228400d310 con 0x7f22940fcc30 2024-04-23T14:56:19.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.300+0000 7f2293e00700 1 -- 172.21.15.81:0/2667646646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22941158d0 con 0x7f22940fcc30 2024-04-23T14:56:19.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.301+0000 7f2293e00700 1 -- 172.21.15.81:0/2667646646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f229405f5f0 con 0x7f22940fcc30 2024-04-23T14:56:19.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.302+0000 7f228aa00700 1 -- 172.21.15.81:0/2667646646 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f2284010420 con 0x7f22940fcc30 2024-04-23T14:56:19.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.303+0000 7f228aa00700 1 --2- 172.21.15.81:0/2667646646 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f227806ec10 0x7f22780710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:19.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.303+0000 7f228aa00700 1 -- 172.21.15.81:0/2667646646 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f228408e900 con 0x7f22940fcc30 2024-04-23T14:56:19.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.303+0000 7f2292000700 1 --2- 172.21.15.81:0/2667646646 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f227806ec10 0x7f22780710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:19.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.304+0000 7f2292000700 1 --2- 172.21.15.81:0/2667646646 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f227806ec10 0x7f22780710c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2280004f90 tx=0x7f2280009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:19.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.308+0000 7f228aa00700 1 -- 172.21.15.81:0/2667646646 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f22840576e0 con 0x7f22940fcc30 2024-04-23T14:56:19.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.550+0000 7f2293e00700 1 -- 172.21.15.81:0/2667646646 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f22941021c0 con 0x7f227806ec10 2024-04-23T14:56:19.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.553+0000 7f228aa00700 1 -- 172.21.15.81:0/2667646646 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f22941021c0 con 0x7f227806ec10 2024-04-23T14:56:19.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.555+0000 7f2293e00700 1 -- 172.21.15.81:0/2667646646 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f227806ec10 msgr2=0x7f22780710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:19.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.555+0000 7f2293e00700 1 --2- 172.21.15.81:0/2667646646 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f227806ec10 0x7f22780710c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2280004f90 tx=0x7f2280009e30 comp rx=0 tx=0).stop 2024-04-23T14:56:19.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.555+0000 7f2293e00700 1 -- 172.21.15.81:0/2667646646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22940fcc30 msgr2=0x7f2294071df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:19.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.555+0000 7f2293e00700 1 --2- 172.21.15.81:0/2667646646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22940fcc30 0x7f2294071df0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f228400b790 tx=0x7f2284009250 comp rx=0 tx=0).stop 2024-04-23T14:56:19.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.556+0000 7f2293e00700 1 -- 172.21.15.81:0/2667646646 shutdown_connections 2024-04-23T14:56:19.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.556+0000 7f2293e00700 1 --2- 172.21.15.81:0/2667646646 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f227806ec10 0x7f22780710c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:19.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.556+0000 7f2293e00700 1 --2- 172.21.15.81:0/2667646646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22940fcc30 0x7f2294071df0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:19.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.556+0000 7f2293e00700 1 --2- 172.21.15.81:0/2667646646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22940fdee0 0x7f2294070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:19.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.556+0000 7f2293e00700 1 -- 172.21.15.81:0/2667646646 >> 172.21.15.81:0/2667646646 conn(0x7f22940f83d0 msgr2=0x7f22940f99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:19.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.556+0000 7f2293e00700 1 -- 172.21.15.81:0/2667646646 shutdown_connections 2024-04-23T14:56:19.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.556+0000 7f2293e00700 1 -- 172.21.15.81:0/2667646646 wait complete. 2024-04-23T14:56:19.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.703+0000 7fdecc000700 1 -- 172.21.15.81:0/1910503793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdec4103420 msgr2=0x7fdec4103830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:19.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.703+0000 7fdecc000700 1 --2- 172.21.15.81:0/1910503793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdec4103420 0x7fdec4103830 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8004940 tx=0x7fdeb8009e30 comp rx=0 tx=0).stop 2024-04-23T14:56:19.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.704+0000 7fdecc000700 1 -- 172.21.15.81:0/1910503793 shutdown_connections 2024-04-23T14:56:19.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.704+0000 7fdecc000700 1 --2- 172.21.15.81:0/1910503793 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdec41046d0 0x7fdec4104b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:19.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.704+0000 7fdecc000700 1 --2- 172.21.15.81:0/1910503793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdec4103420 0x7fdec4103830 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:19.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.704+0000 7fdecc000700 1 -- 172.21.15.81:0/1910503793 >> 172.21.15.81:0/1910503793 conn(0x7fdec4072640 msgr2=0x7fdec4074a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:19.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.704+0000 7fdecc000700 1 -- 172.21.15.81:0/1910503793 shutdown_connections 2024-04-23T14:56:19.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.704+0000 7fdecc000700 1 -- 172.21.15.81:0/1910503793 wait complete. 2024-04-23T14:56:19.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.705+0000 7fdecc000700 1 Processor -- start 2024-04-23T14:56:19.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.705+0000 7fdecc000700 1 -- start start 2024-04-23T14:56:19.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.705+0000 7fdecc000700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdec4103420 0x7fdec4113f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:19.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.705+0000 7fdecc000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdec41046d0 0x7fdec4114490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:19.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.705+0000 7fdecc000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec4114b20 con 0x7fdec41046d0 2024-04-23T14:56:19.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.705+0000 7fdecc000700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec41194c0 con 0x7fdec4103420 2024-04-23T14:56:19.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.705+0000 7fdec8c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdec41046d0 0x7fdec4114490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:19.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.705+0000 7fdec8c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdec41046d0 0x7fdec4114490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48238/0 (socket says 172.21.15.81:48238) 2024-04-23T14:56:19.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.705+0000 7fdec8c00700 1 -- 172.21.15.81:0/3335874098 learned_addr learned my addr 172.21.15.81:0/3335874098 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:56:19.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.706+0000 7fdec9600700 1 --2- 172.21.15.81:0/3335874098 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdec4103420 0x7fdec4113f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:19.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.706+0000 7fdec8c00700 1 -- 172.21.15.81:0/3335874098 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdec4103420 msgr2=0x7fdec4113f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:19.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.706+0000 7fdec8c00700 1 --2- 172.21.15.81:0/3335874098 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdec4103420 0x7fdec4113f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:19.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.706+0000 7fdec8c00700 1 -- 172.21.15.81:0/3335874098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb8005040 con 0x7fdec41046d0 2024-04-23T14:56:19.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.706+0000 7fdec8c00700 1 --2- 172.21.15.81:0/3335874098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdec41046d0 0x7fdec4114490 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdeb400b790 tx=0x7fdeb4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:19.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.706+0000 7fdec1600700 1 -- 172.21.15.81:0/3335874098 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdeb400f770 con 0x7fdec41046d0 2024-04-23T14:56:19.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.706+0000 7fdec1600700 1 -- 172.21.15.81:0/3335874098 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdeb400fda0 con 0x7fdec41046d0 2024-04-23T14:56:19.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.706+0000 7fdec1600700 1 -- 172.21.15.81:0/3335874098 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdeb400d310 con 0x7fdec41046d0 2024-04-23T14:56:19.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.706+0000 7fdecc000700 1 -- 172.21.15.81:0/3335874098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdec4119720 con 0x7fdec41046d0 2024-04-23T14:56:19.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.707+0000 7fdecc000700 1 -- 172.21.15.81:0/3335874098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec4119c90 con 0x7fdec41046d0 2024-04-23T14:56:19.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.708+0000 7fdecc000700 1 -- 172.21.15.81:0/3335874098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdec404c710 con 0x7fdec41046d0 2024-04-23T14:56:19.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.709+0000 7fdec1600700 1 -- 172.21.15.81:0/3335874098 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fdeb4010420 con 0x7fdec41046d0 2024-04-23T14:56:19.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.709+0000 7fdec1600700 1 --2- 172.21.15.81:0/3335874098 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fdeac06ec00 0x7fdeac0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:19.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.710+0000 7fdec1600700 1 -- 172.21.15.81:0/3335874098 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fdeb408e840 con 0x7fdec41046d0 2024-04-23T14:56:19.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.710+0000 7fdec9600700 1 --2- 172.21.15.81:0/3335874098 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fdeac06ec00 0x7fdeac0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:19.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.710+0000 7fdec9600700 1 --2- 172.21.15.81:0/3335874098 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fdeac06ec00 0x7fdeac0710b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdeb800b970 tx=0x7fdeb8009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:19.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.714+0000 7fdec1600700 1 -- 172.21.15.81:0/3335874098 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fdeb405b1d0 con 0x7fdec41046d0 2024-04-23T14:56:19.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:19 smithi081 ceph-mon[90469]: pgmap v139: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 818 B/s rd, 1 op/s 2024-04-23T14:56:19.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.946+0000 7fdecc000700 1 -- 172.21.15.81:0/3335874098 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdec4108970 con 0x7fdeac06ec00 2024-04-23T14:56:19.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.975+0000 7fdec1600700 1 -- 172.21.15.81:0/3335874098 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fdec4108970 con 0x7fdeac06ec00 2024-04-23T14:56:19.977 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-23T14:56:19.977 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (6m) 45s ago 17m 14.2M - 0.25.0 c8568f914cd2 63876b2abc27 2024-04-23T14:56:19.977 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (2m) 45s ago 17m 6665k - 19.0.0-3126-gd44fddd9 76e77f280c74 b486fe2ef19b 2024-04-23T14:56:19.977 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi156 smithi156 running (2m) 18s ago 16m 6656k - 19.0.0-3126-gd44fddd9 76e77f280c74 5d9aa5ecf264 2024-04-23T14:56:19.977 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (6m) 45s ago 17m 74.0M - 9.4.7 954c08fa6188 fbad3cef0883 2024-04-23T14:56:19.977 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.vcoywg smithi081 running (10m) 45s ago 10m 147M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 2ca7601ab60f 2024-04-23T14:56:19.977 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.wydgcg smithi081 running (10m) 45s ago 10m 107M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 58eb1a961b61 2024-04-23T14:56:19.977 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.rhbtxt smithi156 running (10m) 18s ago 10m 14.2M - 17.2.7-884-g70d0cb4b cafd8ddac8fa db3cb5034381 2024-04-23T14:56:19.977 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.vynkxn smithi156 running (10m) 18s ago 10m 14.4M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 1c8f2219e7fd 2024-04-23T14:56:19.977 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.ldghvq smithi081 *:8443,9283,8765 running (5m) 45s ago 19m 505M - 19.0.0-3126-gd44fddd9 76e77f280c74 6bf23484a1c9 2024-04-23T14:56:19.978 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi156.ounwyj smithi156 *:8443,9283,8765 running (4m) 18s ago 16m 451M - 19.0.0-3126-gd44fddd9 76e77f280c74 a6c0dd9f89f2 2024-04-23T14:56:19.978 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (4m) 45s ago 19m 50.0M 2048M 19.0.0-3126-gd44fddd9 76e77f280c74 fbf9f9a59ac2 2024-04-23T14:56:19.978 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi156 smithi156 running (3m) 18s ago 16m 34.1M 2048M 19.0.0-3126-gd44fddd9 76e77f280c74 36409886998f 2024-04-23T14:56:19.978 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (7m) 45s ago 17m 7860k - 1.5.0 0da6a335fe13 197b27809010 2024-04-23T14:56:19.978 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi156 smithi156 *:9100 running (6m) 18s ago 16m 7646k - 1.5.0 0da6a335fe13 91a7c5e86d47 2024-04-23T14:56:19.978 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (115s) 45s ago 15m 99.5M 1557M 19.0.0-3126-gd44fddd9 76e77f280c74 24bc24b37de5 2024-04-23T14:56:19.978 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (84s) 45s ago 14m 105M 1557M 19.0.0-3126-gd44fddd9 76e77f280c74 18d0179b558a 2024-04-23T14:56:19.978 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (53s) 45s ago 13m 11.1M 1557M 19.0.0-3126-gd44fddd9 76e77f280c74 421a62ef6990 2024-04-23T14:56:19.978 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi156 running (23s) 18s ago 13m 11.1M 2581M 19.0.0-3126-gd44fddd9 76e77f280c74 9af3ca1ff69b 2024-04-23T14:56:19.978 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi156 running (12m) 18s ago 12m 257M 2581M 17.2.7-884-g70d0cb4b cafd8ddac8fa 83f996ee64de 2024-04-23T14:56:19.978 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi156 running (12m) 18s ago 12m 238M 2581M 17.2.7-884-g70d0cb4b cafd8ddac8fa b754244bef18 2024-04-23T14:56:19.978 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (4m) 45s ago 16m 56.0M - 2.43.0 a07b618ecd1d 35558adb166d 2024-04-23T14:56:19.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.978+0000 7fdecc000700 1 -- 172.21.15.81:0/3335874098 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fdeac06ec00 msgr2=0x7fdeac0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:19.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.978+0000 7fdecc000700 1 --2- 172.21.15.81:0/3335874098 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fdeac06ec00 0x7fdeac0710b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdeb800b970 tx=0x7fdeb8009e30 comp rx=0 tx=0).stop 2024-04-23T14:56:19.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.978+0000 7fdecc000700 1 -- 172.21.15.81:0/3335874098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdec41046d0 msgr2=0x7fdec4114490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:19.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.978+0000 7fdecc000700 1 --2- 172.21.15.81:0/3335874098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdec41046d0 0x7fdec4114490 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdeb400b790 tx=0x7fdeb4009250 comp rx=0 tx=0).stop 2024-04-23T14:56:19.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.978+0000 7fdecc000700 1 -- 172.21.15.81:0/3335874098 shutdown_connections 2024-04-23T14:56:19.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.978+0000 7fdecc000700 1 --2- 172.21.15.81:0/3335874098 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fdeac06ec00 0x7fdeac0710b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:19.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.978+0000 7fdecc000700 1 --2- 172.21.15.81:0/3335874098 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdec4103420 0x7fdec4113f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:19.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.978+0000 7fdecc000700 1 --2- 172.21.15.81:0/3335874098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdec41046d0 0x7fdec4114490 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:19.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.978+0000 7fdecc000700 1 -- 172.21.15.81:0/3335874098 >> 172.21.15.81:0/3335874098 conn(0x7fdec4072640 msgr2=0x7fdec4073cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:19.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.979+0000 7fdecc000700 1 -- 172.21.15.81:0/3335874098 shutdown_connections 2024-04-23T14:56:19.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:19.979+0000 7fdecc000700 1 -- 172.21.15.81:0/3335874098 wait complete. 2024-04-23T14:56:20.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:19 smithi156 ceph-mon[77738]: pgmap v139: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 818 B/s rd, 1 op/s 2024-04-23T14:56:20.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.123+0000 7f4337400700 1 -- 172.21.15.81:0/831967418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4330071e40 msgr2=0x7f4330070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:20.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.123+0000 7f4337400700 1 --2- 172.21.15.81:0/831967418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4330071e40 0x7f4330070350 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4324004940 tx=0x7f4324009e30 comp rx=0 tx=0).stop 2024-04-23T14:56:20.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.123+0000 7f4337400700 1 -- 172.21.15.81:0/831967418 shutdown_connections 2024-04-23T14:56:20.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.123+0000 7f4337400700 1 --2- 172.21.15.81:0/831967418 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4330070890 0x7f4330070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:20.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.123+0000 7f4337400700 1 --2- 172.21.15.81:0/831967418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4330071e40 0x7f4330070350 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:20.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.123+0000 7f4337400700 1 -- 172.21.15.81:0/831967418 >> 172.21.15.81:0/831967418 conn(0x7f43300f8580 msgr2=0x7f43300fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:20.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.123+0000 7f4337400700 1 -- 172.21.15.81:0/831967418 shutdown_connections 2024-04-23T14:56:20.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.123+0000 7f4337400700 1 -- 172.21.15.81:0/831967418 wait complete. 2024-04-23T14:56:20.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.124+0000 7f4337400700 1 Processor -- start 2024-04-23T14:56:20.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.125+0000 7f4337400700 1 -- start start 2024-04-23T14:56:20.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.125+0000 7f4337400700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4330070890 0x7f433010fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:20.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.125+0000 7f4337400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4330071e40 0x7f4330110090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:20.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.125+0000 7f4337400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4330110720 con 0x7f4330071e40 2024-04-23T14:56:20.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.125+0000 7f4337400700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43301150c0 con 0x7f4330070890 2024-04-23T14:56:20.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.125+0000 7f432fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4330071e40 0x7f4330110090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:20.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.125+0000 7f432fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4330071e40 0x7f4330110090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48262/0 (socket says 172.21.15.81:48262) 2024-04-23T14:56:20.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.125+0000 7f432fe00700 1 -- 172.21.15.81:0/859053495 learned_addr learned my addr 172.21.15.81:0/859053495 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:56:20.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.126+0000 7f4334a00700 1 --2- 172.21.15.81:0/859053495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4330070890 0x7f433010fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:20.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.126+0000 7f432fe00700 1 -- 172.21.15.81:0/859053495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4330070890 msgr2=0x7f433010fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:20.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.126+0000 7f432fe00700 1 --2- 172.21.15.81:0/859053495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4330070890 0x7f433010fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:20.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.126+0000 7f432fe00700 1 -- 172.21.15.81:0/859053495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4324005040 con 0x7f4330071e40 2024-04-23T14:56:20.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.126+0000 7f432fe00700 1 --2- 172.21.15.81:0/859053495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4330071e40 0x7f4330110090 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f431c00b790 tx=0x7f431c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:20.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.126+0000 7f432cc00700 1 -- 172.21.15.81:0/859053495 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f431c00f770 con 0x7f4330071e40 2024-04-23T14:56:20.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.126+0000 7f432cc00700 1 -- 172.21.15.81:0/859053495 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f431c00fda0 con 0x7f4330071e40 2024-04-23T14:56:20.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.126+0000 7f4337400700 1 -- 172.21.15.81:0/859053495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4330115320 con 0x7f4330071e40 2024-04-23T14:56:20.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.127+0000 7f432cc00700 1 -- 172.21.15.81:0/859053495 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f431c00d310 con 0x7f4330071e40 2024-04-23T14:56:20.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.127+0000 7f4337400700 1 -- 172.21.15.81:0/859053495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4330115890 con 0x7f4330071e40 2024-04-23T14:56:20.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.128+0000 7f4337400700 1 -- 172.21.15.81:0/859053495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f433004c710 con 0x7f4330071e40 2024-04-23T14:56:20.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.129+0000 7f432cc00700 1 -- 172.21.15.81:0/859053495 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f431c010420 con 0x7f4330071e40 2024-04-23T14:56:20.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.130+0000 7f432cc00700 1 --2- 172.21.15.81:0/859053495 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f431806ec00 0x7f43180710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:20.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.130+0000 7f432cc00700 1 -- 172.21.15.81:0/859053495 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f431c08e900 con 0x7f4330071e40 2024-04-23T14:56:20.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.130+0000 7f4334a00700 1 --2- 172.21.15.81:0/859053495 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f431806ec00 0x7f43180710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:20.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.131+0000 7f4334a00700 1 --2- 172.21.15.81:0/859053495 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f431806ec00 0x7f43180710b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f432400b3b0 tx=0x7f4324009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:20.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.134+0000 7f432cc00700 1 -- 172.21.15.81:0/859053495 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f431c05b210 con 0x7f4330071e40 2024-04-23T14:56:20.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.429+0000 7f4337400700 1 -- 172.21.15.81:0/859053495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4330107b60 con 0x7f4330071e40 2024-04-23T14:56:20.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.430+0000 7f432cc00700 1 -- 172.21.15.81:0/859053495 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f431c05ada0 con 0x7f4330071e40 2024-04-23T14:56:20.431 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:56:20.431 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-04-23T14:56:20.432 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T14:56:20.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:56:20.432 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-04-23T14:56:20.432 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T14:56:20.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:56:20.432 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-04-23T14:56:20.432 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 2, 2024-04-23T14:56:20.432 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 4 2024-04-23T14:56:20.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:56:20.432 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-04-23T14:56:20.432 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 4 2024-04-23T14:56:20.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:56:20.432 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-04-23T14:56:20.432 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 6, 2024-04-23T14:56:20.433 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 8 2024-04-23T14:56:20.433 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-23T14:56:20.433 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:56:20.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.433+0000 7f4337400700 1 -- 172.21.15.81:0/859053495 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f431806ec00 msgr2=0x7f43180710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:20.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.433+0000 7f4337400700 1 --2- 172.21.15.81:0/859053495 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f431806ec00 0x7f43180710b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f432400b3b0 tx=0x7f4324009e30 comp rx=0 tx=0).stop 2024-04-23T14:56:20.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.433+0000 7f4337400700 1 -- 172.21.15.81:0/859053495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4330071e40 msgr2=0x7f4330110090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:20.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.433+0000 7f4337400700 1 --2- 172.21.15.81:0/859053495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4330071e40 0x7f4330110090 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f431c00b790 tx=0x7f431c009250 comp rx=0 tx=0).stop 2024-04-23T14:56:20.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.433+0000 7f4337400700 1 -- 172.21.15.81:0/859053495 shutdown_connections 2024-04-23T14:56:20.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.433+0000 7f4337400700 1 --2- 172.21.15.81:0/859053495 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f431806ec00 0x7f43180710b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:20.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.433+0000 7f4337400700 1 --2- 172.21.15.81:0/859053495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4330070890 0x7f433010fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:20.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.433+0000 7f4337400700 1 --2- 172.21.15.81:0/859053495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4330071e40 0x7f4330110090 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:20.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.433+0000 7f4337400700 1 -- 172.21.15.81:0/859053495 >> 172.21.15.81:0/859053495 conn(0x7f43300f8580 msgr2=0x7f43300f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:20.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.433+0000 7f4337400700 1 -- 172.21.15.81:0/859053495 shutdown_connections 2024-04-23T14:56:20.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.433+0000 7f4337400700 1 -- 172.21.15.81:0/859053495 wait complete. 2024-04-23T14:56:20.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.580+0000 7fc224400700 1 -- 172.21.15.81:0/506168728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc21c0fe0e0 msgr2=0x7fc21c0fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:20.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.580+0000 7fc224400700 1 --2- 172.21.15.81:0/506168728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc21c0fe0e0 0x7fc21c0fe550 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc208004940 tx=0x7fc208009e30 comp rx=0 tx=0).stop 2024-04-23T14:56:20.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.581+0000 7fc224400700 1 -- 172.21.15.81:0/506168728 shutdown_connections 2024-04-23T14:56:20.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.581+0000 7fc224400700 1 --2- 172.21.15.81:0/506168728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc21c0fe0e0 0x7fc21c0fe550 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:20.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.581+0000 7fc224400700 1 --2- 172.21.15.81:0/506168728 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc21c0fcef0 0x7fc21c0fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:20.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.581+0000 7fc224400700 1 -- 172.21.15.81:0/506168728 >> 172.21.15.81:0/506168728 conn(0x7fc21c0f8530 msgr2=0x7fc21c0fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:20.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.581+0000 7fc224400700 1 -- 172.21.15.81:0/506168728 shutdown_connections 2024-04-23T14:56:20.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.581+0000 7fc224400700 1 -- 172.21.15.81:0/506168728 wait complete. 2024-04-23T14:56:20.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.582+0000 7fc224400700 1 Processor -- start 2024-04-23T14:56:20.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.582+0000 7fc224400700 1 -- start start 2024-04-23T14:56:20.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.582+0000 7fc224400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc21c0fcef0 0x7fc21c10fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:20.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.582+0000 7fc224400700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc21c0fe0e0 0x7fc21c110270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:20.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.582+0000 7fc224400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c110f80 con 0x7fc21c0fcef0 2024-04-23T14:56:20.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.582+0000 7fc224400700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c1110f0 con 0x7fc21c0fe0e0 2024-04-23T14:56:20.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.583+0000 7fc221a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc21c0fcef0 0x7fc21c10fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:20.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.583+0000 7fc221a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc21c0fcef0 0x7fc21c10fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48272/0 (socket says 172.21.15.81:48272) 2024-04-23T14:56:20.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.583+0000 7fc221a00700 1 -- 172.21.15.81:0/107126836 learned_addr learned my addr 172.21.15.81:0/107126836 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:56:20.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.583+0000 7fc221000700 1 --2- 172.21.15.81:0/107126836 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc21c0fe0e0 0x7fc21c110270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:20.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.583+0000 7fc221a00700 1 -- 172.21.15.81:0/107126836 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc21c0fe0e0 msgr2=0x7fc21c110270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:20.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.583+0000 7fc221a00700 1 --2- 172.21.15.81:0/107126836 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc21c0fe0e0 0x7fc21c110270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:20.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.583+0000 7fc221a00700 1 -- 172.21.15.81:0/107126836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc208005040 con 0x7fc21c0fcef0 2024-04-23T14:56:20.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.583+0000 7fc221a00700 1 --2- 172.21.15.81:0/107126836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc21c0fcef0 0x7fc21c10fd30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc21000b790 tx=0x7fc210009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:20.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.584+0000 7fc219600700 1 -- 172.21.15.81:0/107126836 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc21000f6f0 con 0x7fc21c0fcef0 2024-04-23T14:56:20.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.584+0000 7fc219600700 1 -- 172.21.15.81:0/107126836 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc21000fd20 con 0x7fc21c0fcef0 2024-04-23T14:56:20.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.584+0000 7fc224400700 1 -- 172.21.15.81:0/107126836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc21c1113d0 con 0x7fc21c0fcef0 2024-04-23T14:56:20.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.584+0000 7fc219600700 1 -- 172.21.15.81:0/107126836 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2100103a0 con 0x7fc21c0fcef0 2024-04-23T14:56:20.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.584+0000 7fc224400700 1 -- 172.21.15.81:0/107126836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc21c111990 con 0x7fc21c0fcef0 2024-04-23T14:56:20.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.585+0000 7fc224400700 1 -- 172.21.15.81:0/107126836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc21c101a70 con 0x7fc21c0fcef0 2024-04-23T14:56:20.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.586+0000 7fc219600700 1 -- 172.21.15.81:0/107126836 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fc210011400 con 0x7fc21c0fcef0 2024-04-23T14:56:20.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.587+0000 7fc219600700 1 --2- 172.21.15.81:0/107126836 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc20406ec10 0x7fc2040710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:20.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.587+0000 7fc219600700 1 -- 172.21.15.81:0/107126836 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fc21008e6a0 con 0x7fc21c0fcef0 2024-04-23T14:56:20.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.588+0000 7fc221000700 1 --2- 172.21.15.81:0/107126836 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc20406ec10 0x7fc2040710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:20.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.588+0000 7fc221000700 1 --2- 172.21.15.81:0/107126836 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc20406ec10 0x7fc2040710c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc20800b970 tx=0x7fc208009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:20.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.592+0000 7fc219600700 1 -- 172.21.15.81:0/107126836 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fc21005afb0 con 0x7fc21c0fcef0 2024-04-23T14:56:20.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:20 smithi081 ceph-mon[90469]: from='client.34340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:56:20.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:20 smithi081 ceph-mon[90469]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:56:20.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:20 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/859053495' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:56:20.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.864+0000 7fc224400700 1 -- 172.21.15.81:0/107126836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc21c111d60 con 0x7fc21c0fcef0 2024-04-23T14:56:20.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.864+0000 7fc219600700 1 -- 172.21.15.81:0/107126836 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1907 (secure 0 0 0) 0x7fc21005ab40 con 0x7fc21c0fcef0 2024-04-23T14:56:20.866 INFO:teuthology.orchestra.run.smithi081.stdout:e18 2024-04-23T14:56:20.866 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-23T14:56:20.866 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:56:20.866 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-04-23T14:56:20.866 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:56:20.867 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-04-23T14:56:20.867 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-04-23T14:56:20.867 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 17 2024-04-23T14:56:20.867 INFO:teuthology.orchestra.run.smithi081.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-23T14:56:20.867 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-04-23T14:45:51.264703+0000 2024-04-23T14:56:20.867 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-04-23T14:46:12.782992+0000 2024-04-23T14:56:20.867 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-04-23T14:56:20.867 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-04-23T14:56:20.867 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-04-23T14:56:20.867 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-04-23T14:56:20.867 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-04-23T14:56:20.867 INFO:teuthology.orchestra.run.smithi081.stdout:max_xattr_size 65536 2024-04-23T14:56:20.867 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-04-23T14:56:20.867 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-04-23T14:56:20.867 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 47 2024-04-23T14:56:20.868 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:56:20.868 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 1 2024-04-23T14:56:20.868 INFO:teuthology.orchestra.run.smithi081.stdout:in 0 2024-04-23T14:56:20.868 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=14472} 2024-04-23T14:56:20.868 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-04-23T14:56:20.868 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-04-23T14:56:20.868 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-04-23T14:56:20.868 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-04-23T14:56:20.868 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-04-23T14:56:20.868 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-04-23T14:56:20.868 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-04-23T14:56:20.868 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-04-23T14:56:20.868 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-04-23T14:56:20.868 INFO:teuthology.orchestra.run.smithi081.stdout:qdb_cluster leader: 0 members: 2024-04-23T14:56:20.868 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.vcoywg{0:14472} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.81:6828/2563365650,v1:172.21.15.81:6829/2563365650] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:56:20.869 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.wydgcg{0:14482} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.81:6826/759909104,v1:172.21.15.81:6827/759909104] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:56:20.869 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:56:20.869 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:56:20.869 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-04-23T14:56:20.869 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:56:20.869 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.vynkxn{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.156:6826/1794690362,v1:172.21.15.156:6827/1794690362] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:56:20.869 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.rhbtxt{-1:24263} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.156:6824/3854041261,v1:172.21.15.156:6825/3854041261] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:56:20.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.867+0000 7fc224400700 1 -- 172.21.15.81:0/107126836 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc20406ec10 msgr2=0x7fc2040710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:20.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.867+0000 7fc224400700 1 --2- 172.21.15.81:0/107126836 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc20406ec10 0x7fc2040710c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc20800b970 tx=0x7fc208009e30 comp rx=0 tx=0).stop 2024-04-23T14:56:20.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.867+0000 7fc224400700 1 -- 172.21.15.81:0/107126836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc21c0fcef0 msgr2=0x7fc21c10fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:20.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.867+0000 7fc224400700 1 --2- 172.21.15.81:0/107126836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc21c0fcef0 0x7fc21c10fd30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc21000b790 tx=0x7fc210009220 comp rx=0 tx=0).stop 2024-04-23T14:56:20.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.867+0000 7fc224400700 1 -- 172.21.15.81:0/107126836 shutdown_connections 2024-04-23T14:56:20.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.867+0000 7fc224400700 1 --2- 172.21.15.81:0/107126836 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc20406ec10 0x7fc2040710c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:20.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.867+0000 7fc224400700 1 --2- 172.21.15.81:0/107126836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc21c0fcef0 0x7fc21c10fd30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:20.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.867+0000 7fc224400700 1 --2- 172.21.15.81:0/107126836 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc21c0fe0e0 0x7fc21c110270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:20.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.868+0000 7fc224400700 1 -- 172.21.15.81:0/107126836 >> 172.21.15.81:0/107126836 conn(0x7fc21c0f8530 msgr2=0x7fc21c0f9b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:20.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.868+0000 7fc224400700 1 -- 172.21.15.81:0/107126836 shutdown_connections 2024-04-23T14:56:20.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:20.868+0000 7fc224400700 1 -- 172.21.15.81:0/107126836 wait complete. 2024-04-23T14:56:20.871 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 18 2024-04-23T14:56:21.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.009+0000 7f9ae4800700 1 -- 172.21.15.81:0/533965115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9adc0662f0 msgr2=0x7f9adc0ffa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:21.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.009+0000 7f9ae4800700 1 --2- 172.21.15.81:0/533965115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9adc0662f0 0x7f9adc0ffa30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0004940 tx=0x7f9ad0009e30 comp rx=0 tx=0).stop 2024-04-23T14:56:21.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.010+0000 7f9ae4800700 1 -- 172.21.15.81:0/533965115 shutdown_connections 2024-04-23T14:56:21.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.010+0000 7f9ae4800700 1 --2- 172.21.15.81:0/533965115 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9adc0fff70 0x7f9adc102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:21.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.010+0000 7f9ae4800700 1 --2- 172.21.15.81:0/533965115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9adc0662f0 0x7f9adc0ffa30 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:21.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.010+0000 7f9ae4800700 1 -- 172.21.15.81:0/533965115 >> 172.21.15.81:0/533965115 conn(0x7f9adc0f74c0 msgr2=0x7f9adc0f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:21.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.010+0000 7f9ae4800700 1 -- 172.21.15.81:0/533965115 shutdown_connections 2024-04-23T14:56:21.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.010+0000 7f9ae4800700 1 -- 172.21.15.81:0/533965115 wait complete. 2024-04-23T14:56:21.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.010+0000 7f9ae4800700 1 Processor -- start 2024-04-23T14:56:21.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.011+0000 7f9ae4800700 1 -- start start 2024-04-23T14:56:21.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.011+0000 7f9ae4800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9adc0662f0 0x7f9adc10fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:21.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.011+0000 7f9ae4800700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9adc0fff70 0x7f9adc1101e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:21.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.011+0000 7f9ae4800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9adc110870 con 0x7f9adc0662f0 2024-04-23T14:56:21.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.011+0000 7f9ae4800700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9adc111010 con 0x7f9adc0fff70 2024-04-23T14:56:21.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.011+0000 7f9ae1e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9adc0662f0 0x7f9adc10fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:21.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.011+0000 7f9ae1e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9adc0662f0 0x7f9adc10fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48302/0 (socket says 172.21.15.81:48302) 2024-04-23T14:56:21.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.011+0000 7f9ae1e00700 1 -- 172.21.15.81:0/2634642549 learned_addr learned my addr 172.21.15.81:0/2634642549 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:56:21.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.012+0000 7f9ae1e00700 1 -- 172.21.15.81:0/2634642549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9adc0fff70 msgr2=0x7f9adc1101e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:21.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.012+0000 7f9ae1e00700 1 --2- 172.21.15.81:0/2634642549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9adc0fff70 0x7f9adc1101e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:21.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.012+0000 7f9ae1e00700 1 -- 172.21.15.81:0/2634642549 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad0005040 con 0x7f9adc0662f0 2024-04-23T14:56:21.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.012+0000 7f9ae1e00700 1 --2- 172.21.15.81:0/2634642549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9adc0662f0 0x7f9adc10fca0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9ad000b970 tx=0x7f9ad0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:21.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.012+0000 7f9ad6000700 1 -- 172.21.15.81:0/2634642549 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ad000e040 con 0x7f9adc0662f0 2024-04-23T14:56:21.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.012+0000 7f9ad6000700 1 -- 172.21.15.81:0/2634642549 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9ad0004290 con 0x7f9adc0662f0 2024-04-23T14:56:21.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.012+0000 7f9ad6000700 1 -- 172.21.15.81:0/2634642549 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ad001c630 con 0x7f9adc0662f0 2024-04-23T14:56:21.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.012+0000 7f9ae4800700 1 -- 172.21.15.81:0/2634642549 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9adc111290 con 0x7f9adc0662f0 2024-04-23T14:56:21.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.012+0000 7f9ae4800700 1 -- 172.21.15.81:0/2634642549 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9adc111850 con 0x7f9adc0662f0 2024-04-23T14:56:21.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.013+0000 7f9ae4800700 1 -- 172.21.15.81:0/2634642549 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9adc05f5f0 con 0x7f9adc0662f0 2024-04-23T14:56:21.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.014+0000 7f9ad6000700 1 -- 172.21.15.81:0/2634642549 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f9ad000bbf0 con 0x7f9adc0662f0 2024-04-23T14:56:21.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.016+0000 7f9ad6000700 1 --2- 172.21.15.81:0/2634642549 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f9ac406ec10 0x7f9ac40710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:21.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.016+0000 7f9ad6000700 1 -- 172.21.15.81:0/2634642549 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f9ad008fc70 con 0x7f9adc0662f0 2024-04-23T14:56:21.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.016+0000 7f9ae1400700 1 --2- 172.21.15.81:0/2634642549 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f9ac406ec10 0x7f9ac40710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:21.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.017+0000 7f9ae1400700 1 --2- 172.21.15.81:0/2634642549 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f9ac406ec10 0x7f9ac40710c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9acc006fd0 tx=0x7f9acc006db0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:21.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.021+0000 7f9ad6000700 1 -- 172.21.15.81:0/2634642549 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f9ad0096080 con 0x7f9adc0662f0 2024-04-23T14:56:21.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:20 smithi156 ceph-mon[77738]: from='client.34340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:56:21.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:20 smithi156 ceph-mon[77738]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:56:21.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:20 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/859053495' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:56:21.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.250+0000 7f9ae4800700 1 -- 172.21.15.81:0/2634642549 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9adc111b80 con 0x7f9ac406ec10 2024-04-23T14:56:21.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.252+0000 7f9ad6000700 1 -- 172.21.15.81:0/2634642549 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f9adc111b80 con 0x7f9ac406ec10 2024-04-23T14:56:21.253 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:56:21.254 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd", 2024-04-23T14:56:21.254 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-04-23T14:56:21.254 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-23T14:56:21.254 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [ 2024-04-23T14:56:21.254 INFO:teuthology.orchestra.run.smithi081.stdout: "mon", 2024-04-23T14:56:21.254 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-04-23T14:56:21.254 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr" 2024-04-23T14:56:21.254 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-04-23T14:56:21.254 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "10/21 daemons upgraded", 2024-04-23T14:56:21.254 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "Currently upgrading osd daemons", 2024-04-23T14:56:21.254 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-04-23T14:56:21.254 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:56:21.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.256+0000 7f9ae4800700 1 -- 172.21.15.81:0/2634642549 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f9ac406ec10 msgr2=0x7f9ac40710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:21.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.256+0000 7f9ae4800700 1 --2- 172.21.15.81:0/2634642549 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f9ac406ec10 0x7f9ac40710c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9acc006fd0 tx=0x7f9acc006db0 comp rx=0 tx=0).stop 2024-04-23T14:56:21.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.256+0000 7f9ae4800700 1 -- 172.21.15.81:0/2634642549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9adc0662f0 msgr2=0x7f9adc10fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:21.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.256+0000 7f9ae4800700 1 --2- 172.21.15.81:0/2634642549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9adc0662f0 0x7f9adc10fca0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9ad000b970 tx=0x7f9ad0009e30 comp rx=0 tx=0).stop 2024-04-23T14:56:21.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.256+0000 7f9ae4800700 1 -- 172.21.15.81:0/2634642549 shutdown_connections 2024-04-23T14:56:21.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.256+0000 7f9ae4800700 1 --2- 172.21.15.81:0/2634642549 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f9ac406ec10 0x7f9ac40710c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:21.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.256+0000 7f9ae4800700 1 --2- 172.21.15.81:0/2634642549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9adc0662f0 0x7f9adc10fca0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:21.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.256+0000 7f9ae4800700 1 --2- 172.21.15.81:0/2634642549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9adc0fff70 0x7f9adc1101e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:21.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.256+0000 7f9ae4800700 1 -- 172.21.15.81:0/2634642549 >> 172.21.15.81:0/2634642549 conn(0x7f9adc0f74c0 msgr2=0x7f9adc0fbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:21.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.257+0000 7f9ae4800700 1 -- 172.21.15.81:0/2634642549 shutdown_connections 2024-04-23T14:56:21.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.257+0000 7f9ae4800700 1 -- 172.21.15.81:0/2634642549 wait complete. 2024-04-23T14:56:21.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.409+0000 7f0a1ca00700 1 -- 172.21.15.81:0/1671228192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a18070870 msgr2=0x7f0a18070ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:21.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.409+0000 7f0a1ca00700 1 --2- 172.21.15.81:0/1671228192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a18070870 0x7f0a18070ce0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0a04004940 tx=0x7f0a04009e30 comp rx=0 tx=0).stop 2024-04-23T14:56:21.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.409+0000 7f0a1ca00700 1 -- 172.21.15.81:0/1671228192 shutdown_connections 2024-04-23T14:56:21.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.409+0000 7f0a1ca00700 1 --2- 172.21.15.81:0/1671228192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a18070870 0x7f0a18070ce0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:21.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.409+0000 7f0a1ca00700 1 --2- 172.21.15.81:0/1671228192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a18071e20 0x7f0a18070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:21.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.409+0000 7f0a1ca00700 1 -- 172.21.15.81:0/1671228192 >> 172.21.15.81:0/1671228192 conn(0x7f0a180f8580 msgr2=0x7f0a180fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:21.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.410+0000 7f0a1ca00700 1 -- 172.21.15.81:0/1671228192 shutdown_connections 2024-04-23T14:56:21.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.410+0000 7f0a1ca00700 1 -- 172.21.15.81:0/1671228192 wait complete. 2024-04-23T14:56:21.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.410+0000 7f0a1ca00700 1 Processor -- start 2024-04-23T14:56:21.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.410+0000 7f0a1ca00700 1 -- start start 2024-04-23T14:56:21.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.411+0000 7f0a1ca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a18070870 0x7f0a1810fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:21.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.411+0000 7f0a1ca00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a18071e20 0x7f0a18110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:21.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.411+0000 7f0a1ca00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a18110680 con 0x7f0a18070870 2024-04-23T14:56:21.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.411+0000 7f0a1ca00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a181107f0 con 0x7f0a18071e20 2024-04-23T14:56:21.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.411+0000 7f0a15e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a18070870 0x7f0a1810fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:21.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.411+0000 7f0a15e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a18070870 0x7f0a1810fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48316/0 (socket says 172.21.15.81:48316) 2024-04-23T14:56:21.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.411+0000 7f0a15e00700 1 -- 172.21.15.81:0/4222752174 learned_addr learned my addr 172.21.15.81:0/4222752174 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:56:21.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.411+0000 7f0a15e00700 1 -- 172.21.15.81:0/4222752174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a18071e20 msgr2=0x7f0a18110080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:21.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.411+0000 7f0a15e00700 1 --2- 172.21.15.81:0/4222752174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a18071e20 0x7f0a18110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:21.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.411+0000 7f0a15e00700 1 -- 172.21.15.81:0/4222752174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a04005040 con 0x7f0a18070870 2024-04-23T14:56:21.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.412+0000 7f0a15e00700 1 --2- 172.21.15.81:0/4222752174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a18070870 0x7f0a1810fb40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0a08002a80 tx=0x7f0a08004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:21.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.412+0000 7f0a0e000700 1 -- 172.21.15.81:0/4222752174 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a08007cc0 con 0x7f0a18070870 2024-04-23T14:56:21.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.412+0000 7f0a0e000700 1 -- 172.21.15.81:0/4222752174 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0a0800f040 con 0x7f0a18070870 2024-04-23T14:56:21.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.412+0000 7f0a1ca00700 1 -- 172.21.15.81:0/4222752174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a18115250 con 0x7f0a18070870 2024-04-23T14:56:21.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.412+0000 7f0a0e000700 1 -- 172.21.15.81:0/4222752174 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a0800dad0 con 0x7f0a18070870 2024-04-23T14:56:21.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.412+0000 7f0a1ca00700 1 -- 172.21.15.81:0/4222752174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a18115810 con 0x7f0a18070870 2024-04-23T14:56:21.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.413+0000 7f0a1ca00700 1 -- 172.21.15.81:0/4222752174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a1804c710 con 0x7f0a18070870 2024-04-23T14:56:21.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.414+0000 7f0a0e000700 1 -- 172.21.15.81:0/4222752174 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f0a0800dc30 con 0x7f0a18070870 2024-04-23T14:56:21.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.415+0000 7f0a0e000700 1 --2- 172.21.15.81:0/4222752174 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f09fc06ec00 0x7f09fc0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:21.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.416+0000 7f0a0e000700 1 -- 172.21.15.81:0/4222752174 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f0a0808e530 con 0x7f0a18070870 2024-04-23T14:56:21.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.416+0000 7f0a15400700 1 --2- 172.21.15.81:0/4222752174 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f09fc06ec00 0x7f09fc0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:21.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.416+0000 7f0a15400700 1 --2- 172.21.15.81:0/4222752174 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f09fc06ec00 0x7f09fc0710b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0a04004f90 tx=0x7f0a04009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:21.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.420+0000 7f0a0e000700 1 -- 172.21.15.81:0/4222752174 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f0a0805aee0 con 0x7f0a18070870 2024-04-23T14:56:21.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.739+0000 7f0a1ca00700 1 -- 172.21.15.81:0/4222752174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0a18107ae0 con 0x7f0a18070870 2024-04-23T14:56:21.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.740+0000 7f0a0e000700 1 -- 172.21.15.81:0/4222752174 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f0a0805aa70 con 0x7f0a18070870 2024-04-23T14:56:21.741 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-04-23T14:56:21.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.743+0000 7f0a1ca00700 1 -- 172.21.15.81:0/4222752174 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f09fc06ec00 msgr2=0x7f09fc0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:21.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.743+0000 7f0a1ca00700 1 --2- 172.21.15.81:0/4222752174 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f09fc06ec00 0x7f09fc0710b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0a04004f90 tx=0x7f0a04009e30 comp rx=0 tx=0).stop 2024-04-23T14:56:21.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.743+0000 7f0a1ca00700 1 -- 172.21.15.81:0/4222752174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a18070870 msgr2=0x7f0a1810fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:21.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.743+0000 7f0a1ca00700 1 --2- 172.21.15.81:0/4222752174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a18070870 0x7f0a1810fb40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0a08002a80 tx=0x7f0a08004600 comp rx=0 tx=0).stop 2024-04-23T14:56:21.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.743+0000 7f0a1ca00700 1 -- 172.21.15.81:0/4222752174 shutdown_connections 2024-04-23T14:56:21.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.743+0000 7f0a1ca00700 1 --2- 172.21.15.81:0/4222752174 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f09fc06ec00 0x7f09fc0710b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:21.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.743+0000 7f0a1ca00700 1 --2- 172.21.15.81:0/4222752174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a18070870 0x7f0a1810fb40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:21.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.743+0000 7f0a1ca00700 1 --2- 172.21.15.81:0/4222752174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a18071e20 0x7f0a18110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:21.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.743+0000 7f0a1ca00700 1 -- 172.21.15.81:0/4222752174 >> 172.21.15.81:0/4222752174 conn(0x7f0a180f8580 msgr2=0x7f0a180f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:21.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.743+0000 7f0a1ca00700 1 -- 172.21.15.81:0/4222752174 shutdown_connections 2024-04-23T14:56:21.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:21.743+0000 7f0a1ca00700 1 -- 172.21.15.81:0/4222752174 wait complete. 2024-04-23T14:56:22.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:21 smithi156 ceph-mon[77738]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:56:22.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:21 smithi156 ceph-mon[77738]: pgmap v140: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-23T14:56:22.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:21 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/107126836' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:56:22.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:21 smithi081 ceph-mon[90469]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:56:22.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:21 smithi081 ceph-mon[90469]: pgmap v140: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-23T14:56:22.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:21 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/107126836' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:56:23.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:22 smithi156 ceph-mon[77738]: from='client.34360 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:56:23.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:22 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:23.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:22 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/4222752174' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:56:23.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:22 smithi081 ceph-mon[90469]: from='client.34360 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:56:23.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:22 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:23.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:22 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/4222752174' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:56:24.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:23 smithi156 ceph-mon[77738]: pgmap v141: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T14:56:24.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:23 smithi081 ceph-mon[90469]: pgmap v141: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T14:56:24.960 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:24 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-23T14:56:25.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:24 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-23T14:56:26.007 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:25 smithi156 ceph-mon[77738]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-23T14:56:26.007 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:25 smithi156 ceph-mon[77738]: Upgrade: osd.4 is safe to restart 2024-04-23T14:56:26.007 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:25 smithi156 ceph-mon[77738]: pgmap v142: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:56:26.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:25 smithi081 ceph-mon[90469]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-23T14:56:26.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:25 smithi081 ceph-mon[90469]: Upgrade: osd.4 is safe to restart 2024-04-23T14:56:26.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:25 smithi081 ceph-mon[90469]: pgmap v142: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:56:27.464 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:27 smithi156 ceph-mon[77738]: Upgrade: Updating osd.4 2024-04-23T14:56:27.464 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:27 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:27.464 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:27 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-23T14:56:27.464 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:27 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:56:27.464 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:27 smithi156 ceph-mon[77738]: Deploying daemon osd.4 on smithi156 2024-04-23T14:56:27.464 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:27 smithi156 ceph-mon[77738]: pgmap v143: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:56:27.464 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:27 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:56:27.512 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:27 smithi081 ceph-mon[90469]: Upgrade: Updating osd.4 2024-04-23T14:56:27.512 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:27 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:27.512 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:27 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-23T14:56:27.513 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:27 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:56:27.513 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:27 smithi081 ceph-mon[90469]: Deploying daemon osd.4 on smithi156 2024-04-23T14:56:27.513 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:27 smithi081 ceph-mon[90469]: pgmap v143: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:56:27.513 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:27 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:56:29.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:29 smithi156 ceph-mon[77738]: pgmap v144: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T14:56:30.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:29 smithi081 ceph-mon[90469]: pgmap v144: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T14:56:31.286 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:30 smithi156 systemd[1]: Stopping Ceph osd.4 for 7a641bea-017e-11ef-bc93-c7b262605968... 2024-04-23T14:56:31.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:31 smithi156 ceph-mon[77738]: pgmap v145: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:56:31.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:31 smithi156 ceph-mon[77738]: osd.4 marked itself down and dead 2024-04-23T14:56:31.787 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:31 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4[44635]: 2024-04-23T14:56:31.443+0000 7fac39800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T14:56:31.787 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:31 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4[44635]: 2024-04-23T14:56:31.443+0000 7fac39800700 -1 osd.4 70 *** Got signal Terminated *** 2024-04-23T14:56:31.787 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:31 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4[44635]: 2024-04-23T14:56:31.443+0000 7fac39800700 -1 osd.4 70 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-23T14:56:32.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:31 smithi081 ceph-mon[90469]: pgmap v145: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:56:32.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:31 smithi081 ceph-mon[90469]: osd.4 marked itself down and dead 2024-04-23T14:56:32.385 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:32 smithi156 podman[91884]: 2024-04-23 14:56:32.082424343 +0000 UTC m=+0.797419434 container died 83f996ee64dea772302bdd87e91fb0ad0344a28f05235243304598d1ee12e702 (image=quay.ceph.io/ceph-ci/ceph@sha256:3890cd726bd5e73ae623dabdf4ed76dd5df81c936b8bd8d761026babda969466, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=quincy-70d0cb4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-04-23T14:56:32.645 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:32 smithi156 ceph-mon[77738]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-23T14:56:32.645 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:32 smithi156 ceph-mon[77738]: osdmap e71: 6 total, 5 up, 6 in 2024-04-23T14:56:32.646 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:32 smithi156 podman[91884]: 2024-04-23 14:56:32.501701768 +0000 UTC m=+1.216696862 container cleanup 83f996ee64dea772302bdd87e91fb0ad0344a28f05235243304598d1ee12e702 (image=quay.ceph.io/ceph-ci/ceph@sha256:3890cd726bd5e73ae623dabdf4ed76dd5df81c936b8bd8d761026babda969466, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=quincy-70d0cb4, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-23T14:56:32.646 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:32 smithi156 bash[91884]: ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4 2024-04-23T14:56:33.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:32 smithi156 ceph-mon[77738]: osdmap e72: 6 total, 5 up, 6 in 2024-04-23T14:56:33.036 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:32 smithi156 podman[91901]: 2024-04-23 14:56:32.794660196 +0000 UTC m=+0.695774669 container remove 83f996ee64dea772302bdd87e91fb0ad0344a28f05235243304598d1ee12e702 (image=quay.ceph.io/ceph-ci/ceph@sha256:3890cd726bd5e73ae623dabdf4ed76dd5df81c936b8bd8d761026babda969466, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=quincy-70d0cb4, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-04-23T14:56:33.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:32 smithi081 ceph-mon[90469]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-23T14:56:33.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:32 smithi081 ceph-mon[90469]: osdmap e71: 6 total, 5 up, 6 in 2024-04-23T14:56:33.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:32 smithi081 ceph-mon[90469]: osdmap e72: 6 total, 5 up, 6 in 2024-04-23T14:56:33.883 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:33 smithi156 ceph-mon[77738]: pgmap v147: 65 pgs: 5 peering, 5 stale+active+clean, 55 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-23T14:56:33.883 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:33 smithi156 ceph-mon[77738]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-04-23T14:56:33.883 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:33 smithi156 podman[91990]: 2024-04-23 14:56:33.455331381 +0000 UTC m=+0.032563081 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T14:56:33.883 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:33 smithi156 podman[91990]: 2024-04-23 14:56:33.587421462 +0000 UTC m=+0.164653199 container create 924634d0504fa9ad0e94a05243abc6a77736810676409f74d7fcaae1239d987d (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2) 2024-04-23T14:56:34.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:33 smithi081 ceph-mon[90469]: pgmap v147: 65 pgs: 5 peering, 5 stale+active+clean, 55 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-23T14:56:34.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:33 smithi081 ceph-mon[90469]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-04-23T14:56:34.286 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:33 smithi156 podman[91990]: 2024-04-23 14:56:33.882743222 +0000 UTC m=+0.459974965 container init 924634d0504fa9ad0e94a05243abc6a77736810676409f74d7fcaae1239d987d (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.vendor=CentOS) 2024-04-23T14:56:34.287 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:33 smithi156 podman[91990]: 2024-04-23 14:56:33.894128479 +0000 UTC m=+0.471360188 container start 924634d0504fa9ad0e94a05243abc6a77736810676409f74d7fcaae1239d987d (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240416, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T14:56:34.287 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:33 smithi156 podman[91990]: 2024-04-23 14:56:33.981288613 +0000 UTC m=+0.558520339 container attach 924634d0504fa9ad0e94a05243abc6a77736810676409f74d7fcaae1239d987d (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4-deactivate, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-04-23T14:56:34.666 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:34 smithi156 podman[91990]: 2024-04-23 14:56:34.346406217 +0000 UTC m=+0.923637978 container died 924634d0504fa9ad0e94a05243abc6a77736810676409f74d7fcaae1239d987d (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4-deactivate, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, ceph=True) 2024-04-23T14:56:35.010 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:34 smithi156 ceph-mon[77738]: Health check failed: Degraded data redundancy: 22/222 objects degraded (9.910%), 9 pgs degraded (PG_DEGRADED) 2024-04-23T14:56:35.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:34 smithi081 ceph-mon[90469]: Health check failed: Degraded data redundancy: 22/222 objects degraded (9.910%), 9 pgs degraded (PG_DEGRADED) 2024-04-23T14:56:35.286 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:35 smithi156 podman[92016]: 2024-04-23 14:56:35.009629964 +0000 UTC m=+0.646103734 container remove 924634d0504fa9ad0e94a05243abc6a77736810676409f74d7fcaae1239d987d (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-04-23T14:56:35.286 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:35 smithi156 systemd[1]: ceph-7a641bea-017e-11ef-bc93-c7b262605968@osd.4.service: Deactivated successfully. 2024-04-23T14:56:35.286 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:35 smithi156 systemd[1]: Stopped Ceph osd.4 for 7a641bea-017e-11ef-bc93-c7b262605968. 2024-04-23T14:56:35.286 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:35 smithi156 systemd[1]: ceph-7a641bea-017e-11ef-bc93-c7b262605968@osd.4.service: Consumed 1min 48.517s CPU time. 2024-04-23T14:56:35.704 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:35 smithi156 systemd[1]: Starting Ceph osd.4 for 7a641bea-017e-11ef-bc93-c7b262605968... 2024-04-23T14:56:35.967 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:35 smithi156 ceph-mon[77738]: pgmap v149: 65 pgs: 9 active+undersized+degraded, 5 peering, 2 stale+active+clean, 12 active+undersized, 37 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 22/222 objects degraded (9.910%) 2024-04-23T14:56:35.967 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:35 smithi156 podman[92120]: 2024-04-23 14:56:35.672592299 +0000 UTC m=+0.036695176 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T14:56:35.967 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:35 smithi156 podman[92120]: 2024-04-23 14:56:35.793972256 +0000 UTC m=+0.158075170 container create fd048df87c5e1c661fbbc115b8e044de89f51b0c5f2bda9796f043bd2062e925 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4-activate, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-04-23T14:56:36.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:35 smithi081 ceph-mon[90469]: pgmap v149: 65 pgs: 9 active+undersized+degraded, 5 peering, 2 stale+active+clean, 12 active+undersized, 37 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 22/222 objects degraded (9.910%) 2024-04-23T14:56:36.536 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:36 smithi156 podman[92120]: 2024-04-23 14:56:36.056054777 +0000 UTC m=+0.420157697 container init fd048df87c5e1c661fbbc115b8e044de89f51b0c5f2bda9796f043bd2062e925 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4-activate, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-04-23T14:56:36.537 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:36 smithi156 podman[92120]: 2024-04-23 14:56:36.06746603 +0000 UTC m=+0.431568950 container start fd048df87c5e1c661fbbc115b8e044de89f51b0c5f2bda9796f043bd2062e925 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4-activate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T14:56:36.537 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:36 smithi156 podman[92120]: 2024-04-23 14:56:36.138117976 +0000 UTC m=+0.502220866 container attach fd048df87c5e1c661fbbc115b8e044de89f51b0c5f2bda9796f043bd2062e925 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4-activate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-04-23T14:56:37.288 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:37 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4-activate[92134]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-23T14:56:37.288 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:37 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4-activate[92134]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-23T14:56:37.288 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:37 smithi156 bash[92120]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-23T14:56:37.288 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:37 smithi156 bash[92120]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-23T14:56:37.288 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:37 smithi156 bash[92120]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-23T14:56:37.288 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:37 smithi156 bash[92120]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-23T14:56:37.288 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:37 smithi156 bash[92120]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-23T14:56:37.288 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:37 smithi156 bash[92120]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-23T14:56:37.289 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:37 smithi156 bash[92120]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-04-23T14:56:37.289 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:37 smithi156 bash[92120]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-23T14:56:37.289 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:37 smithi156 bash[92120]: --> ceph-volume raw activate successful for osd ID: 4 2024-04-23T14:56:37.289 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:37 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4-activate[92134]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-23T14:56:37.289 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:37 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4-activate[92134]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-23T14:56:37.289 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:37 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4-activate[92134]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-23T14:56:37.289 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:37 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4-activate[92134]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-23T14:56:37.289 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:37 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4-activate[92134]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-04-23T14:56:37.289 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:37 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4-activate[92134]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-23T14:56:37.289 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:37 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4-activate[92134]: --> ceph-volume raw activate successful for osd ID: 4 2024-04-23T14:56:37.289 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:37 smithi156 podman[92120]: 2024-04-23 14:56:37.088785929 +0000 UTC m=+1.452888836 container died fd048df87c5e1c661fbbc115b8e044de89f51b0c5f2bda9796f043bd2062e925 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4-activate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd) 2024-04-23T14:56:37.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:37 smithi156 ceph-mon[77738]: pgmap v150: 65 pgs: 9 active+undersized+degraded, 5 peering, 2 stale+active+clean, 12 active+undersized, 37 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s; 22/222 objects degraded (9.910%) 2024-04-23T14:56:37.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:37 smithi081 ceph-mon[90469]: pgmap v150: 65 pgs: 9 active+undersized+degraded, 5 peering, 2 stale+active+clean, 12 active+undersized, 37 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s; 22/222 objects degraded (9.910%) 2024-04-23T14:56:38.228 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:37 smithi156 podman[92258]: 2024-04-23 14:56:37.866908533 +0000 UTC m=+0.759118442 container remove fd048df87c5e1c661fbbc115b8e044de89f51b0c5f2bda9796f043bd2062e925 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4-activate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-04-23T14:56:38.536 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:38 smithi156 podman[92316]: 2024-04-23 14:56:38.135482565 +0000 UTC m=+0.035227115 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T14:56:38.536 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:38 smithi156 podman[92316]: 2024-04-23 14:56:38.292553097 +0000 UTC m=+0.192297649 container create e0a1e784348c5c147b3a699d947e1ebd9c56fd90b4ccf565596bf73f1c2c7428 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD) 2024-04-23T14:56:39.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:38 smithi156 ceph-mon[77738]: pgmap v151: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 1 op/s; 35/222 objects degraded (15.766%) 2024-04-23T14:56:39.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:38 smithi156 ceph-mon[77738]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-04-23T14:56:39.037 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:38 smithi156 podman[92316]: 2024-04-23 14:56:38.538163698 +0000 UTC m=+0.437908274 container init e0a1e784348c5c147b3a699d947e1ebd9c56fd90b4ccf565596bf73f1c2c7428 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd) 2024-04-23T14:56:39.037 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:38 smithi156 podman[92316]: 2024-04-23 14:56:38.548896607 +0000 UTC m=+0.448641142 container start e0a1e784348c5c147b3a699d947e1ebd9c56fd90b4ccf565596bf73f1c2c7428 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416) 2024-04-23T14:56:39.037 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:38 smithi156 ceph-osd[92334]: -- 172.21.15.156:0/3423734211 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x558a01409ba0 con 0x558a013dac00 2024-04-23T14:56:39.037 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:38 smithi156 ceph-osd[92334]: -- 172.21.15.156:0/3423734211 <== mon.1 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558a01411680 con 0x558a013dac00 2024-04-23T14:56:39.037 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:38 smithi156 bash[92316]: e0a1e784348c5c147b3a699d947e1ebd9c56fd90b4ccf565596bf73f1c2c7428 2024-04-23T14:56:39.038 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:38 smithi156 systemd[1]: Started Ceph osd.4 for 7a641bea-017e-11ef-bc93-c7b262605968. 2024-04-23T14:56:39.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:38 smithi081 ceph-mon[90469]: pgmap v151: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 1 op/s; 35/222 objects degraded (15.766%) 2024-04-23T14:56:39.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:38 smithi081 ceph-mon[90469]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-04-23T14:56:39.536 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:39 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4[92330]: 2024-04-23T14:56:39.122+0000 7fdac35e97c0 -1 Falling back to public interface 2024-04-23T14:56:40.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:39 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:40.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:39 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:40.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:39 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:56:40.135 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:39 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:40.135 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:39 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:40.135 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:39 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:56:41.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:40 smithi081 ceph-mon[90469]: pgmap v152: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s; 35/222 objects degraded (15.766%) 2024-04-23T14:56:41.108 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:40 smithi156 ceph-mon[77738]: pgmap v152: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s; 35/222 objects degraded (15.766%) 2024-04-23T14:56:42.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:41 smithi081 ceph-mon[90469]: Health check update: Degraded data redundancy: 35/222 objects degraded (15.766%), 14 pgs degraded (PG_DEGRADED) 2024-04-23T14:56:42.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:41 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:42.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:41 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:56:42.282 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:41 smithi156 ceph-mon[77738]: Health check update: Degraded data redundancy: 35/222 objects degraded (15.766%), 14 pgs degraded (PG_DEGRADED) 2024-04-23T14:56:42.282 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:41 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:42.282 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:41 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:56:43.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:42 smithi081 ceph-mon[90469]: pgmap v153: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s; 35/222 objects degraded (15.766%) 2024-04-23T14:56:43.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:42 smithi156 ceph-mon[77738]: pgmap v153: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s; 35/222 objects degraded (15.766%) 2024-04-23T14:56:44.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:44 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:44.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:44 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:44.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:44 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:44.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:44 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:45.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:45 smithi156 ceph-mon[77738]: pgmap v154: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 35/222 objects degraded (15.766%) 2024-04-23T14:56:45.286 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:45 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4[92330]: 2024-04-23T14:56:44.999+0000 7fdac35e97c0 -1 osd.4 70 log_to_monitors true 2024-04-23T14:56:45.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:45 smithi081 ceph-mon[90469]: pgmap v154: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 35/222 objects degraded (15.766%) 2024-04-23T14:56:46.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:46 smithi156 ceph-mon[77738]: from='osd.4 [v2:172.21.15.156:6808/1123408224,v1:172.21.15.156:6809/1123408224]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-23T14:56:46.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:46 smithi156 ceph-mon[77738]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-23T14:56:46.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:46 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:46.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:46 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:46.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:46 smithi156 ceph-mon[77738]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-23T14:56:46.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:46 smithi156 ceph-mon[77738]: osdmap e73: 6 total, 5 up, 6 in 2024-04-23T14:56:46.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:46 smithi081 ceph-mon[90469]: from='osd.4 [v2:172.21.15.156:6808/1123408224,v1:172.21.15.156:6809/1123408224]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-23T14:56:46.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:46 smithi081 ceph-mon[90469]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-23T14:56:46.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:46 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:46.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:46 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:46.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:46 smithi081 ceph-mon[90469]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-23T14:56:46.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:46 smithi081 ceph-mon[90469]: osdmap e73: 6 total, 5 up, 6 in 2024-04-23T14:56:47.090 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 14:56:46 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4[92330]: 2024-04-23T14:56:46.927+0000 7fdaada00700 -1 osd.4 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T14:56:47.090 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:47 smithi156 ceph-mon[77738]: from='osd.4 [v2:172.21.15.156:6808/1123408224,v1:172.21.15.156:6809/1123408224]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-23T14:56:47.090 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:47 smithi156 ceph-mon[77738]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-23T14:56:47.090 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:47 smithi156 ceph-mon[77738]: pgmap v156: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 35/222 objects degraded (15.766%) 2024-04-23T14:56:47.090 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:47 smithi156 ceph-mon[77738]: from='osd.4 ' entity='osd.4' 2024-04-23T14:56:47.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:47 smithi081 ceph-mon[90469]: from='osd.4 [v2:172.21.15.156:6808/1123408224,v1:172.21.15.156:6809/1123408224]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-23T14:56:47.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:47 smithi081 ceph-mon[90469]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-23T14:56:47.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:47 smithi081 ceph-mon[90469]: pgmap v156: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 35/222 objects degraded (15.766%) 2024-04-23T14:56:47.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:47 smithi081 ceph-mon[90469]: from='osd.4 ' entity='osd.4' 2024-04-23T14:56:48.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:48 smithi156 ceph-mon[77738]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-23T14:56:48.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:48 smithi156 ceph-mon[77738]: osd.4 [v2:172.21.15.156:6808/1123408224,v1:172.21.15.156:6809/1123408224] boot 2024-04-23T14:56:48.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:48 smithi156 ceph-mon[77738]: osdmap e74: 6 total, 6 up, 6 in 2024-04-23T14:56:48.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:48 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T14:56:48.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:48 smithi081 ceph-mon[90469]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-23T14:56:48.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:48 smithi081 ceph-mon[90469]: osd.4 [v2:172.21.15.156:6808/1123408224,v1:172.21.15.156:6809/1123408224] boot 2024-04-23T14:56:48.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:48 smithi081 ceph-mon[90469]: osdmap e74: 6 total, 6 up, 6 in 2024-04-23T14:56:48.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:48 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T14:56:49.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:49 smithi081 ceph-mon[90469]: pgmap v158: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 35/222 objects degraded (15.766%) 2024-04-23T14:56:49.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:49 smithi081 ceph-mon[90469]: osdmap e75: 6 total, 6 up, 6 in 2024-04-23T14:56:49.422 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:49 smithi156 ceph-mon[77738]: pgmap v158: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 35/222 objects degraded (15.766%) 2024-04-23T14:56:49.422 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:49 smithi156 ceph-mon[77738]: osdmap e75: 6 total, 6 up, 6 in 2024-04-23T14:56:51.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:51 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:51.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:51 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:51.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:51 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:56:51.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:51 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:56:51.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:51 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:51.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:51 smithi156 ceph-mon[77738]: pgmap v160: 65 pgs: 8 peering, 5 active+undersized+degraded, 11 active+undersized, 41 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 1 op/s; 13/222 objects degraded (5.856%) 2024-04-23T14:56:51.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:51 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:56:51.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:51 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:56:51.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:51 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:56:51.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:51 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:56:51.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:51 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-23T14:56:51.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:51 smithi156 ceph-mon[77738]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-23T14:56:51.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:51 smithi156 ceph-mon[77738]: Upgrade: unsafe to stop osd(s) at this time (7 PGs are or would become offline) 2024-04-23T14:56:51.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:51 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:51.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:51 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:51.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:51 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:56:51.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:51 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:56:51.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:51 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:51.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:51 smithi081 ceph-mon[90469]: pgmap v160: 65 pgs: 8 peering, 5 active+undersized+degraded, 11 active+undersized, 41 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 1 op/s; 13/222 objects degraded (5.856%) 2024-04-23T14:56:51.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:51 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:56:51.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:51 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:56:51.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:51 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:56:51.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:51 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:56:51.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:51 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-23T14:56:51.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:51 smithi081 ceph-mon[90469]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-23T14:56:51.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:51 smithi081 ceph-mon[90469]: Upgrade: unsafe to stop osd(s) at this time (7 PGs are or would become offline) 2024-04-23T14:56:51.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:51.910+0000 7f721a600700 1 -- 172.21.15.81:0/2788304211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7214071ea0 msgr2=0x7f72140703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:51.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:51.910+0000 7f721a600700 1 --2- 172.21.15.81:0/2788304211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7214071ea0 0x7f72140703b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7204004940 tx=0x7f7204009e30 comp rx=0 tx=0).stop 2024-04-23T14:56:51.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:51.910+0000 7f721a600700 1 -- 172.21.15.81:0/2788304211 shutdown_connections 2024-04-23T14:56:51.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:51.910+0000 7f721a600700 1 --2- 172.21.15.81:0/2788304211 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72140708f0 0x7f7214070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:51.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:51.910+0000 7f721a600700 1 --2- 172.21.15.81:0/2788304211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7214071ea0 0x7f72140703b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:51.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:51.910+0000 7f721a600700 1 -- 172.21.15.81:0/2788304211 >> 172.21.15.81:0/2788304211 conn(0x7f72140f8570 msgr2=0x7f72140fa9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:51.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:51.910+0000 7f721a600700 1 -- 172.21.15.81:0/2788304211 shutdown_connections 2024-04-23T14:56:51.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:51.910+0000 7f721a600700 1 -- 172.21.15.81:0/2788304211 wait complete. 2024-04-23T14:56:51.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:51.911+0000 7f721a600700 1 Processor -- start 2024-04-23T14:56:51.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:51.911+0000 7f721a600700 1 -- start start 2024-04-23T14:56:51.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:51.911+0000 7f721a600700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72140708f0 0x7f721410fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:51.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:51.911+0000 7f721a600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7214071ea0 0x7f72141100a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:51.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:51.911+0000 7f721a600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72141106a0 con 0x7f7214071ea0 2024-04-23T14:56:51.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:51.911+0000 7f721a600700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7214110810 con 0x7f72140708f0 2024-04-23T14:56:51.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:51.912+0000 7f7212a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7214071ea0 0x7f72141100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:51.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:51.912+0000 7f7212a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7214071ea0 0x7f72141100a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56530/0 (socket says 172.21.15.81:56530) 2024-04-23T14:56:51.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:51.912+0000 7f7212a00700 1 -- 172.21.15.81:0/2363191631 learned_addr learned my addr 172.21.15.81:0/2363191631 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:56:51.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:51.912+0000 7f7213400700 1 --2- 172.21.15.81:0/2363191631 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72140708f0 0x7f721410fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:51.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:51.912+0000 7f7212a00700 1 -- 172.21.15.81:0/2363191631 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72140708f0 msgr2=0x7f721410fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:51.912+0000 7f7212a00700 1 --2- 172.21.15.81:0/2363191631 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72140708f0 0x7f721410fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:51.912+0000 7f7212a00700 1 -- 172.21.15.81:0/2363191631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7204005040 con 0x7f7214071ea0 2024-04-23T14:56:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:51.912+0000 7f7212a00700 1 --2- 172.21.15.81:0/2363191631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7214071ea0 0x7f72141100a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7200002a50 tx=0x7f72000046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:51.913+0000 7f720b400700 1 -- 172.21.15.81:0/2363191631 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7200007cc0 con 0x7f7214071ea0 2024-04-23T14:56:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:51.913+0000 7f720b400700 1 -- 172.21.15.81:0/2363191631 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f720000f040 con 0x7f7214071ea0 2024-04-23T14:56:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:51.913+0000 7f720b400700 1 -- 172.21.15.81:0/2363191631 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7200009640 con 0x7f7214071ea0 2024-04-23T14:56:51.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:51.913+0000 7f721a600700 1 -- 172.21.15.81:0/2363191631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7214115270 con 0x7f7214071ea0 2024-04-23T14:56:51.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:51.913+0000 7f721a600700 1 -- 172.21.15.81:0/2363191631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7214115830 con 0x7f7214071ea0 2024-04-23T14:56:51.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:51.914+0000 7f721a600700 1 -- 172.21.15.81:0/2363191631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f721404c710 con 0x7f7214071ea0 2024-04-23T14:56:51.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:51.915+0000 7f720b400700 1 -- 172.21.15.81:0/2363191631 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f72000097a0 con 0x7f7214071ea0 2024-04-23T14:56:51.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:51.916+0000 7f720b400700 1 --2- 172.21.15.81:0/2363191631 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f71f806ec50 0x7f71f8071100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:51.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:51.917+0000 7f720b400700 1 -- 172.21.15.81:0/2363191631 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f720008e6d0 con 0x7f7214071ea0 2024-04-23T14:56:51.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:51.917+0000 7f7213400700 1 --2- 172.21.15.81:0/2363191631 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f71f806ec50 0x7f71f8071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:51.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:51.917+0000 7f7213400700 1 --2- 172.21.15.81:0/2363191631 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f71f806ec50 0x7f71f8071100 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7204009fd0 tx=0x7f7204009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:51.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:51.921+0000 7f720b400700 1 -- 172.21.15.81:0/2363191631 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f720005af60 con 0x7f7214071ea0 2024-04-23T14:56:52.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.167+0000 7f721a600700 1 -- 172.21.15.81:0/2363191631 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7214103ea0 con 0x7f71f806ec50 2024-04-23T14:56:52.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.170+0000 7f720b400700 1 -- 172.21.15.81:0/2363191631 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f7214103ea0 con 0x7f71f806ec50 2024-04-23T14:56:52.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.173+0000 7f721a600700 1 -- 172.21.15.81:0/2363191631 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f71f806ec50 msgr2=0x7f71f8071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:52.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.173+0000 7f721a600700 1 --2- 172.21.15.81:0/2363191631 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f71f806ec50 0x7f71f8071100 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7204009fd0 tx=0x7f7204009e30 comp rx=0 tx=0).stop 2024-04-23T14:56:52.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.173+0000 7f721a600700 1 -- 172.21.15.81:0/2363191631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7214071ea0 msgr2=0x7f72141100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:52.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.173+0000 7f721a600700 1 --2- 172.21.15.81:0/2363191631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7214071ea0 0x7f72141100a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7200002a50 tx=0x7f72000046b0 comp rx=0 tx=0).stop 2024-04-23T14:56:52.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.173+0000 7f721a600700 1 -- 172.21.15.81:0/2363191631 shutdown_connections 2024-04-23T14:56:52.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.173+0000 7f721a600700 1 --2- 172.21.15.81:0/2363191631 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f71f806ec50 0x7f71f8071100 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:52.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.173+0000 7f721a600700 1 --2- 172.21.15.81:0/2363191631 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72140708f0 0x7f721410fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:52.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.174+0000 7f721a600700 1 --2- 172.21.15.81:0/2363191631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7214071ea0 0x7f72141100a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:52.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.174+0000 7f721a600700 1 -- 172.21.15.81:0/2363191631 >> 172.21.15.81:0/2363191631 conn(0x7f72140f8570 msgr2=0x7f72140f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:52.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.174+0000 7f721a600700 1 -- 172.21.15.81:0/2363191631 shutdown_connections 2024-04-23T14:56:52.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.174+0000 7f721a600700 1 -- 172.21.15.81:0/2363191631 wait complete. 2024-04-23T14:56:52.189 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-04-23T14:56:52.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.327+0000 7f118fe00700 1 -- 172.21.15.81:0/1439785130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1190103270 msgr2=0x7f1190103680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:52.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.327+0000 7f118fe00700 1 --2- 172.21.15.81:0/1439785130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1190103270 0x7f1190103680 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1180004940 tx=0x7f1180009e30 comp rx=0 tx=0).stop 2024-04-23T14:56:52.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.327+0000 7f118fe00700 1 -- 172.21.15.81:0/1439785130 shutdown_connections 2024-04-23T14:56:52.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.327+0000 7f118fe00700 1 --2- 172.21.15.81:0/1439785130 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1190104520 0x7f1190104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:52.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.327+0000 7f118fe00700 1 --2- 172.21.15.81:0/1439785130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1190103270 0x7f1190103680 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:52.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.327+0000 7f118fe00700 1 -- 172.21.15.81:0/1439785130 >> 172.21.15.81:0/1439785130 conn(0x7f1190072530 msgr2=0x7f1190074940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:52.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.327+0000 7f118fe00700 1 -- 172.21.15.81:0/1439785130 shutdown_connections 2024-04-23T14:56:52.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.327+0000 7f118fe00700 1 -- 172.21.15.81:0/1439785130 wait complete. 2024-04-23T14:56:52.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.328+0000 7f118fe00700 1 Processor -- start 2024-04-23T14:56:52.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.328+0000 7f118fe00700 1 -- start start 2024-04-23T14:56:52.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.328+0000 7f118fe00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1190103270 0x7f1190113f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:52.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.328+0000 7f118fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1190104520 0x7f1190114440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:52.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.328+0000 7f118fe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1190114a40 con 0x7f1190104520 2024-04-23T14:56:52.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.328+0000 7f118fe00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1190115180 con 0x7f1190103270 2024-04-23T14:56:52.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.329+0000 7f118e000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1190104520 0x7f1190114440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:52.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.329+0000 7f118e000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1190104520 0x7f1190114440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56540/0 (socket says 172.21.15.81:56540) 2024-04-23T14:56:52.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.329+0000 7f118e000700 1 -- 172.21.15.81:0/1575413895 learned_addr learned my addr 172.21.15.81:0/1575413895 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:56:52.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.329+0000 7f118ea00700 1 --2- 172.21.15.81:0/1575413895 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1190103270 0x7f1190113f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:52.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.329+0000 7f118e000700 1 -- 172.21.15.81:0/1575413895 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1190103270 msgr2=0x7f1190113f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:52.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.329+0000 7f118e000700 1 --2- 172.21.15.81:0/1575413895 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1190103270 0x7f1190113f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:52.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.329+0000 7f118e000700 1 -- 172.21.15.81:0/1575413895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1180005040 con 0x7f1190104520 2024-04-23T14:56:52.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.329+0000 7f118ea00700 1 --2- 172.21.15.81:0/1575413895 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1190103270 0x7f1190113f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:56:52.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.329+0000 7f118e000700 1 --2- 172.21.15.81:0/1575413895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1190104520 0x7f1190114440 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f117c002a50 tx=0x7f117c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:52.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.330+0000 7f1186a00700 1 -- 172.21.15.81:0/1575413895 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f117c007cc0 con 0x7f1190104520 2024-04-23T14:56:52.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.330+0000 7f1186a00700 1 -- 172.21.15.81:0/1575413895 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f117c00f040 con 0x7f1190104520 2024-04-23T14:56:52.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.330+0000 7f1186a00700 1 -- 172.21.15.81:0/1575413895 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f117c009640 con 0x7f1190104520 2024-04-23T14:56:52.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.330+0000 7f118fe00700 1 -- 172.21.15.81:0/1575413895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1190115460 con 0x7f1190104520 2024-04-23T14:56:52.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.330+0000 7f118fe00700 1 -- 172.21.15.81:0/1575413895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1190115a20 con 0x7f1190104520 2024-04-23T14:56:52.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.331+0000 7f118fe00700 1 -- 172.21.15.81:0/1575413895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11900760a0 con 0x7f1190104520 2024-04-23T14:56:52.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.332+0000 7f1186a00700 1 -- 172.21.15.81:0/1575413895 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f117c0097a0 con 0x7f1190104520 2024-04-23T14:56:52.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.333+0000 7f1186a00700 1 --2- 172.21.15.81:0/1575413895 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f117406ec00 0x7f11740710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:52.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.333+0000 7f1186a00700 1 -- 172.21.15.81:0/1575413895 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f117c08e600 con 0x7f1190104520 2024-04-23T14:56:52.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.333+0000 7f118ea00700 1 --2- 172.21.15.81:0/1575413895 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f117406ec00 0x7f11740710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:52.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.334+0000 7f118ea00700 1 --2- 172.21.15.81:0/1575413895 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f117406ec00 0x7f11740710b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f118000b3b0 tx=0x7f1180009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:52.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.337+0000 7f1186a00700 1 -- 172.21.15.81:0/1575413895 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f117c05af10 con 0x7f1190104520 2024-04-23T14:56:52.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:52 smithi081 ceph-mon[90469]: Health check update: Degraded data redundancy: 13/222 objects degraded (5.856%), 5 pgs degraded (PG_DEGRADED) 2024-04-23T14:56:52.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.586+0000 7f118fe00700 1 -- 172.21.15.81:0/1575413895 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1190115da0 con 0x7f117406ec00 2024-04-23T14:56:52.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.587+0000 7f1186a00700 1 -- 172.21.15.81:0/1575413895 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f1190115da0 con 0x7f117406ec00 2024-04-23T14:56:52.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.590+0000 7f118fe00700 1 -- 172.21.15.81:0/1575413895 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f117406ec00 msgr2=0x7f11740710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:52.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.590+0000 7f118fe00700 1 --2- 172.21.15.81:0/1575413895 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f117406ec00 0x7f11740710b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f118000b3b0 tx=0x7f1180009e30 comp rx=0 tx=0).stop 2024-04-23T14:56:52.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.590+0000 7f118fe00700 1 -- 172.21.15.81:0/1575413895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1190104520 msgr2=0x7f1190114440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:52.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.590+0000 7f118fe00700 1 --2- 172.21.15.81:0/1575413895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1190104520 0x7f1190114440 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f117c002a50 tx=0x7f117c0046b0 comp rx=0 tx=0).stop 2024-04-23T14:56:52.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.591+0000 7f118fe00700 1 -- 172.21.15.81:0/1575413895 shutdown_connections 2024-04-23T14:56:52.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.591+0000 7f118fe00700 1 --2- 172.21.15.81:0/1575413895 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f117406ec00 0x7f11740710b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:52.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.591+0000 7f118fe00700 1 --2- 172.21.15.81:0/1575413895 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1190103270 0x7f1190113f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:52.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.591+0000 7f118fe00700 1 --2- 172.21.15.81:0/1575413895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1190104520 0x7f1190114440 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:52.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.591+0000 7f118fe00700 1 -- 172.21.15.81:0/1575413895 >> 172.21.15.81:0/1575413895 conn(0x7f1190072530 msgr2=0x7f1190074ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:52.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.591+0000 7f118fe00700 1 -- 172.21.15.81:0/1575413895 shutdown_connections 2024-04-23T14:56:52.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.591+0000 7f118fe00700 1 -- 172.21.15.81:0/1575413895 wait complete. 2024-04-23T14:56:52.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.744+0000 7f733ca00700 1 -- 172.21.15.81:0/3119581024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7338103420 msgr2=0x7f7338103830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:52.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.744+0000 7f733ca00700 1 --2- 172.21.15.81:0/3119581024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7338103420 0x7f7338103830 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7328004940 tx=0x7f7328009e30 comp rx=0 tx=0).stop 2024-04-23T14:56:52.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.744+0000 7f733ca00700 1 -- 172.21.15.81:0/3119581024 shutdown_connections 2024-04-23T14:56:52.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.744+0000 7f733ca00700 1 --2- 172.21.15.81:0/3119581024 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73381046d0 0x7f7338104b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:52.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.744+0000 7f733ca00700 1 --2- 172.21.15.81:0/3119581024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7338103420 0x7f7338103830 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:52.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.744+0000 7f733ca00700 1 -- 172.21.15.81:0/3119581024 >> 172.21.15.81:0/3119581024 conn(0x7f7338072640 msgr2=0x7f7338074a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:52.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.744+0000 7f733ca00700 1 -- 172.21.15.81:0/3119581024 shutdown_connections 2024-04-23T14:56:52.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.744+0000 7f733ca00700 1 -- 172.21.15.81:0/3119581024 wait complete. 2024-04-23T14:56:52.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.745+0000 7f733ca00700 1 Processor -- start 2024-04-23T14:56:52.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.746+0000 7f733ca00700 1 -- start start 2024-04-23T14:56:52.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.746+0000 7f733ca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73381046d0 0x7f7338114100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:52.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.746+0000 7f733ca00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7338114640 0x7f7338119670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:52.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.746+0000 7f733ca00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7338114b00 con 0x7f73381046d0 2024-04-23T14:56:52.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.746+0000 7f733ca00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7338114c40 con 0x7f7338114640 2024-04-23T14:56:52.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.746+0000 7f7335e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73381046d0 0x7f7338114100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:52.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.746+0000 7f7335e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73381046d0 0x7f7338114100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56560/0 (socket says 172.21.15.81:56560) 2024-04-23T14:56:52.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.746+0000 7f7335e00700 1 -- 172.21.15.81:0/3047175903 learned_addr learned my addr 172.21.15.81:0/3047175903 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:56:52.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.747+0000 7f7335e00700 1 -- 172.21.15.81:0/3047175903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7338114640 msgr2=0x7f7338119670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:52.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.747+0000 7f7335e00700 1 --2- 172.21.15.81:0/3047175903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7338114640 0x7f7338119670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:52.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.747+0000 7f7335e00700 1 -- 172.21.15.81:0/3047175903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7328005040 con 0x7f73381046d0 2024-04-23T14:56:52.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.747+0000 7f7335e00700 1 --2- 172.21.15.81:0/3047175903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73381046d0 0x7f7338114100 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f732800b3b0 tx=0x7f7328009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:52.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.747+0000 7f732e000700 1 -- 172.21.15.81:0/3047175903 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f732800e040 con 0x7f73381046d0 2024-04-23T14:56:52.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.747+0000 7f732e000700 1 -- 172.21.15.81:0/3047175903 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f732800bbf0 con 0x7f73381046d0 2024-04-23T14:56:52.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.747+0000 7f733ca00700 1 -- 172.21.15.81:0/3047175903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7338119bb0 con 0x7f73381046d0 2024-04-23T14:56:52.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.747+0000 7f732e000700 1 -- 172.21.15.81:0/3047175903 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f732801c630 con 0x7f73381046d0 2024-04-23T14:56:52.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.747+0000 7f733ca00700 1 -- 172.21.15.81:0/3047175903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f733811a120 con 0x7f73381046d0 2024-04-23T14:56:52.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.748+0000 7f733ca00700 1 -- 172.21.15.81:0/3047175903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f733804c710 con 0x7f73381046d0 2024-04-23T14:56:52.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.749+0000 7f732e000700 1 -- 172.21.15.81:0/3047175903 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f732800bd60 con 0x7f73381046d0 2024-04-23T14:56:52.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.750+0000 7f732e000700 1 --2- 172.21.15.81:0/3047175903 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f731c06ec00 0x7f731c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:52.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.750+0000 7f732e000700 1 -- 172.21.15.81:0/3047175903 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f732808fb50 con 0x7f73381046d0 2024-04-23T14:56:52.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.751+0000 7f7335400700 1 --2- 172.21.15.81:0/3047175903 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f731c06ec00 0x7f731c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:52.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.751+0000 7f7335400700 1 --2- 172.21.15.81:0/3047175903 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f731c06ec00 0x7f731c0710b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7324004d00 tx=0x7f7324009ce0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:52.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.755+0000 7f732e000700 1 -- 172.21.15.81:0/3047175903 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f732805c500 con 0x7f73381046d0 2024-04-23T14:56:52.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:52 smithi156 ceph-mon[77738]: Health check update: Degraded data redundancy: 13/222 objects degraded (5.856%), 5 pgs degraded (PG_DEGRADED) 2024-04-23T14:56:52.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:52.991+0000 7f733ca00700 1 -- 172.21.15.81:0/3047175903 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7338108bc0 con 0x7f731c06ec00 2024-04-23T14:56:53.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.020+0000 7f732e000700 1 -- 172.21.15.81:0/3047175903 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f7338108bc0 con 0x7f731c06ec00 2024-04-23T14:56:53.021 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-23T14:56:53.021 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (7m) 78s ago 17m 14.2M - 0.25.0 c8568f914cd2 63876b2abc27 2024-04-23T14:56:53.021 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (3m) 78s ago 18m 6665k - 19.0.0-3126-gd44fddd9 76e77f280c74 b486fe2ef19b 2024-04-23T14:56:53.021 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi156 smithi156 running (2m) 10s ago 16m 6656k - 19.0.0-3126-gd44fddd9 76e77f280c74 5d9aa5ecf264 2024-04-23T14:56:53.021 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (6m) 78s ago 17m 74.0M - 9.4.7 954c08fa6188 fbad3cef0883 2024-04-23T14:56:53.021 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.vcoywg smithi081 running (10m) 78s ago 10m 147M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 2ca7601ab60f 2024-04-23T14:56:53.021 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.wydgcg smithi081 running (10m) 78s ago 10m 107M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 58eb1a961b61 2024-04-23T14:56:53.022 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.rhbtxt smithi156 running (10m) 10s ago 10m 14.3M - 17.2.7-884-g70d0cb4b cafd8ddac8fa db3cb5034381 2024-04-23T14:56:53.022 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.vynkxn smithi156 running (10m) 10s ago 10m 14.6M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 1c8f2219e7fd 2024-04-23T14:56:53.022 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.ldghvq smithi081 *:8443,9283,8765 running (6m) 78s ago 19m 505M - 19.0.0-3126-gd44fddd9 76e77f280c74 6bf23484a1c9 2024-04-23T14:56:53.022 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi156.ounwyj smithi156 *:8443,9283,8765 running (5m) 10s ago 16m 452M - 19.0.0-3126-gd44fddd9 76e77f280c74 a6c0dd9f89f2 2024-04-23T14:56:53.022 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (4m) 78s ago 19m 50.0M 2048M 19.0.0-3126-gd44fddd9 76e77f280c74 fbf9f9a59ac2 2024-04-23T14:56:53.022 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi156 smithi156 running (4m) 10s ago 16m 34.9M 2048M 19.0.0-3126-gd44fddd9 76e77f280c74 36409886998f 2024-04-23T14:56:53.022 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (7m) 78s ago 18m 7860k - 1.5.0 0da6a335fe13 197b27809010 2024-04-23T14:56:53.022 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi156 smithi156 *:9100 running (6m) 10s ago 16m 8292k - 1.5.0 0da6a335fe13 91a7c5e86d47 2024-04-23T14:56:53.022 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (2m) 78s ago 15m 99.5M 1557M 19.0.0-3126-gd44fddd9 76e77f280c74 24bc24b37de5 2024-04-23T14:56:53.022 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (117s) 78s ago 15m 105M 1557M 19.0.0-3126-gd44fddd9 76e77f280c74 18d0179b558a 2024-04-23T14:56:53.022 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (86s) 78s ago 14m 11.1M 1557M 19.0.0-3126-gd44fddd9 76e77f280c74 421a62ef6990 2024-04-23T14:56:53.022 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi156 running (56s) 10s ago 13m 110M 2581M 19.0.0-3126-gd44fddd9 76e77f280c74 9af3ca1ff69b 2024-04-23T14:56:53.022 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi156 running (14s) 10s ago 13m 11.1M 2581M 19.0.0-3126-gd44fddd9 76e77f280c74 e0a1e784348c 2024-04-23T14:56:53.023 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi156 running (12m) 10s ago 12m 237M 2581M 17.2.7-884-g70d0cb4b cafd8ddac8fa b754244bef18 2024-04-23T14:56:53.023 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (5m) 78s ago 17m 56.0M - 2.43.0 a07b618ecd1d 35558adb166d 2024-04-23T14:56:53.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.024+0000 7f733ca00700 1 -- 172.21.15.81:0/3047175903 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f731c06ec00 msgr2=0x7f731c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:53.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.024+0000 7f733ca00700 1 --2- 172.21.15.81:0/3047175903 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f731c06ec00 0x7f731c0710b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7324004d00 tx=0x7f7324009ce0 comp rx=0 tx=0).stop 2024-04-23T14:56:53.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.024+0000 7f733ca00700 1 -- 172.21.15.81:0/3047175903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73381046d0 msgr2=0x7f7338114100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:53.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.024+0000 7f733ca00700 1 --2- 172.21.15.81:0/3047175903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73381046d0 0x7f7338114100 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f732800b3b0 tx=0x7f7328009e30 comp rx=0 tx=0).stop 2024-04-23T14:56:53.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.024+0000 7f733ca00700 1 -- 172.21.15.81:0/3047175903 shutdown_connections 2024-04-23T14:56:53.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.024+0000 7f733ca00700 1 --2- 172.21.15.81:0/3047175903 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f731c06ec00 0x7f731c0710b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:53.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.024+0000 7f733ca00700 1 --2- 172.21.15.81:0/3047175903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73381046d0 0x7f7338114100 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:53.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.024+0000 7f733ca00700 1 --2- 172.21.15.81:0/3047175903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7338114640 0x7f7338119670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:53.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.024+0000 7f733ca00700 1 -- 172.21.15.81:0/3047175903 >> 172.21.15.81:0/3047175903 conn(0x7f7338072640 msgr2=0x7f7338073e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:53.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.024+0000 7f733ca00700 1 -- 172.21.15.81:0/3047175903 shutdown_connections 2024-04-23T14:56:53.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.024+0000 7f733ca00700 1 -- 172.21.15.81:0/3047175903 wait complete. 2024-04-23T14:56:53.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.166+0000 7f92d9000700 1 -- 172.21.15.81:0/1990618870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92d40fcef0 msgr2=0x7f92d40fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:53.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.166+0000 7f92d9000700 1 --2- 172.21.15.81:0/1990618870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92d40fcef0 0x7f92d40fd320 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f92c4004940 tx=0x7f92c4009e30 comp rx=0 tx=0).stop 2024-04-23T14:56:53.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.166+0000 7f92d9000700 1 -- 172.21.15.81:0/1990618870 shutdown_connections 2024-04-23T14:56:53.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.166+0000 7f92d9000700 1 --2- 172.21.15.81:0/1990618870 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92d40fe0e0 0x7f92d40fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:53.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.166+0000 7f92d9000700 1 --2- 172.21.15.81:0/1990618870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92d40fcef0 0x7f92d40fd320 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:53.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.166+0000 7f92d9000700 1 -- 172.21.15.81:0/1990618870 >> 172.21.15.81:0/1990618870 conn(0x7f92d40f8530 msgr2=0x7f92d40fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:53.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.166+0000 7f92d9000700 1 -- 172.21.15.81:0/1990618870 shutdown_connections 2024-04-23T14:56:53.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.166+0000 7f92d9000700 1 -- 172.21.15.81:0/1990618870 wait complete. 2024-04-23T14:56:53.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.167+0000 7f92d9000700 1 Processor -- start 2024-04-23T14:56:53.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.167+0000 7f92d9000700 1 -- start start 2024-04-23T14:56:53.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.167+0000 7f92d9000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92d40fcef0 0x7f92d410fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:53.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.167+0000 7f92d9000700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92d40fe0e0 0x7f92d4110270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:53.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.167+0000 7f92d9000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d4110870 con 0x7f92d40fcef0 2024-04-23T14:56:53.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.167+0000 7f92d9000700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d4110fb0 con 0x7f92d40fe0e0 2024-04-23T14:56:53.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.168+0000 7f92d1e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92d40fcef0 0x7f92d410fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:53.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.168+0000 7f92d1e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92d40fcef0 0x7f92d410fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56566/0 (socket says 172.21.15.81:56566) 2024-04-23T14:56:53.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.168+0000 7f92d1e00700 1 -- 172.21.15.81:0/2410877501 learned_addr learned my addr 172.21.15.81:0/2410877501 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:56:53.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.168+0000 7f92d1e00700 1 -- 172.21.15.81:0/2410877501 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92d40fe0e0 msgr2=0x7f92d4110270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:53.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.168+0000 7f92d1e00700 1 --2- 172.21.15.81:0/2410877501 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92d40fe0e0 0x7f92d4110270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:53.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.168+0000 7f92d1e00700 1 -- 172.21.15.81:0/2410877501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c4005040 con 0x7f92d40fcef0 2024-04-23T14:56:53.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.168+0000 7f92d1e00700 1 --2- 172.21.15.81:0/2410877501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92d40fcef0 0x7f92d410fd30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f92c400b3b0 tx=0x7f92c4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:53.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.169+0000 7f92ca000700 1 -- 172.21.15.81:0/2410877501 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92c400e040 con 0x7f92d40fcef0 2024-04-23T14:56:53.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.169+0000 7f92d9000700 1 -- 172.21.15.81:0/2410877501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92d4111230 con 0x7f92d40fcef0 2024-04-23T14:56:53.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.169+0000 7f92d9000700 1 -- 172.21.15.81:0/2410877501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92d41117f0 con 0x7f92d40fcef0 2024-04-23T14:56:53.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.169+0000 7f92ca000700 1 -- 172.21.15.81:0/2410877501 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f92c400bcc0 con 0x7f92d40fcef0 2024-04-23T14:56:53.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.169+0000 7f92ca000700 1 -- 172.21.15.81:0/2410877501 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92c401c630 con 0x7f92d40fcef0 2024-04-23T14:56:53.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.170+0000 7f92d9000700 1 -- 172.21.15.81:0/2410877501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92b40052e0 con 0x7f92d40fcef0 2024-04-23T14:56:53.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.172+0000 7f92ca000700 1 -- 172.21.15.81:0/2410877501 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f92c40139f0 con 0x7f92d40fcef0 2024-04-23T14:56:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.173+0000 7f92ca000700 1 --2- 172.21.15.81:0/2410877501 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f92b806ec00 0x7f92b80710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.173+0000 7f92ca000700 1 -- 172.21.15.81:0/2410877501 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f92c408f8b0 con 0x7f92d40fcef0 2024-04-23T14:56:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.173+0000 7f92d1400700 1 --2- 172.21.15.81:0/2410877501 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f92b806ec00 0x7f92b80710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:53.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.174+0000 7f92d1400700 1 --2- 172.21.15.81:0/2410877501 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f92b806ec00 0x7f92b80710b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f92c0004d00 tx=0x7f92c0009ce0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:53.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.176+0000 7f92ca000700 1 -- 172.21.15.81:0/2410877501 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f92c405c240 con 0x7f92d40fcef0 2024-04-23T14:56:53.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.472+0000 7f92d9000700 1 -- 172.21.15.81:0/2410877501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f92b4005860 con 0x7f92d40fcef0 2024-04-23T14:56:53.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.473+0000 7f92ca000700 1 -- 172.21.15.81:0/2410877501 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f92c405bdd0 con 0x7f92d40fcef0 2024-04-23T14:56:53.474 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:56:53.474 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-04-23T14:56:53.474 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T14:56:53.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:56:53.474 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-04-23T14:56:53.474 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T14:56:53.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:56:53.474 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-04-23T14:56:53.474 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 1, 2024-04-23T14:56:53.474 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 5 2024-04-23T14:56:53.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:56:53.474 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-04-23T14:56:53.475 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 4 2024-04-23T14:56:53.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:56:53.475 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-04-23T14:56:53.475 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 5, 2024-04-23T14:56:53.475 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 9 2024-04-23T14:56:53.475 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-23T14:56:53.475 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:56:53.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.476+0000 7f92d9000700 1 -- 172.21.15.81:0/2410877501 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f92b806ec00 msgr2=0x7f92b80710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:53.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.476+0000 7f92d9000700 1 --2- 172.21.15.81:0/2410877501 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f92b806ec00 0x7f92b80710b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f92c0004d00 tx=0x7f92c0009ce0 comp rx=0 tx=0).stop 2024-04-23T14:56:53.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.476+0000 7f92d9000700 1 -- 172.21.15.81:0/2410877501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92d40fcef0 msgr2=0x7f92d410fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:53.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.476+0000 7f92d9000700 1 --2- 172.21.15.81:0/2410877501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92d40fcef0 0x7f92d410fd30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f92c400b3b0 tx=0x7f92c4009e30 comp rx=0 tx=0).stop 2024-04-23T14:56:53.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.476+0000 7f92d9000700 1 -- 172.21.15.81:0/2410877501 shutdown_connections 2024-04-23T14:56:53.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.476+0000 7f92d9000700 1 --2- 172.21.15.81:0/2410877501 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f92b806ec00 0x7f92b80710b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:53.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.476+0000 7f92d9000700 1 --2- 172.21.15.81:0/2410877501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92d40fcef0 0x7f92d410fd30 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:53.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.476+0000 7f92d9000700 1 --2- 172.21.15.81:0/2410877501 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92d40fe0e0 0x7f92d4110270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:53.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.476+0000 7f92d9000700 1 -- 172.21.15.81:0/2410877501 >> 172.21.15.81:0/2410877501 conn(0x7f92d40f8530 msgr2=0x7f92d40f9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:53.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.477+0000 7f92d9000700 1 -- 172.21.15.81:0/2410877501 shutdown_connections 2024-04-23T14:56:53.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.477+0000 7f92d9000700 1 -- 172.21.15.81:0/2410877501 wait complete. 2024-04-23T14:56:53.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:53 smithi081 ceph-mon[90469]: from='client.34368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:56:53.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:53 smithi081 ceph-mon[90469]: pgmap v161: 65 pgs: 8 peering, 57 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 469 B/s rd, 1 op/s 2024-04-23T14:56:53.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:53 smithi081 ceph-mon[90469]: from='client.34372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:56:53.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.620+0000 7f0e57c00700 1 -- 172.21.15.81:0/2423053791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e500fff70 msgr2=0x7f0e50102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:53.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.621+0000 7f0e57c00700 1 --2- 172.21.15.81:0/2423053791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e500fff70 0x7f0e50102390 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0e38004940 tx=0x7f0e38009e30 comp rx=0 tx=0).stop 2024-04-23T14:56:53.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.621+0000 7f0e57c00700 1 -- 172.21.15.81:0/2423053791 shutdown_connections 2024-04-23T14:56:53.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.621+0000 7f0e57c00700 1 --2- 172.21.15.81:0/2423053791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e500fff70 0x7f0e50102390 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:53.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.621+0000 7f0e57c00700 1 --2- 172.21.15.81:0/2423053791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e500662f0 0x7f0e500ffa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:53.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.621+0000 7f0e57c00700 1 -- 172.21.15.81:0/2423053791 >> 172.21.15.81:0/2423053791 conn(0x7f0e500f74c0 msgr2=0x7f0e500f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:53.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.621+0000 7f0e57c00700 1 -- 172.21.15.81:0/2423053791 shutdown_connections 2024-04-23T14:56:53.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.621+0000 7f0e57c00700 1 -- 172.21.15.81:0/2423053791 wait complete. 2024-04-23T14:56:53.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.622+0000 7f0e57c00700 1 Processor -- start 2024-04-23T14:56:53.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.622+0000 7f0e57c00700 1 -- start start 2024-04-23T14:56:53.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.622+0000 7f0e57c00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e500662f0 0x7f0e5010da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:53.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.622+0000 7f0e57c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e500fff70 0x7f0e5010dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:53.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.622+0000 7f0e57c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5010e5a0 con 0x7f0e500fff70 2024-04-23T14:56:53.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.622+0000 7f0e57c00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5010edf0 con 0x7f0e500662f0 2024-04-23T14:56:53.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.622+0000 7f0e4fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e500fff70 0x7f0e5010dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:53.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.623+0000 7f0e4fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e500fff70 0x7f0e5010dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56582/0 (socket says 172.21.15.81:56582) 2024-04-23T14:56:53.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.623+0000 7f0e4fe00700 1 -- 172.21.15.81:0/2384505434 learned_addr learned my addr 172.21.15.81:0/2384505434 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:56:53.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.623+0000 7f0e55200700 1 --2- 172.21.15.81:0/2384505434 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e500662f0 0x7f0e5010da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:53.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.623+0000 7f0e4fe00700 1 -- 172.21.15.81:0/2384505434 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e500662f0 msgr2=0x7f0e5010da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:53.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.623+0000 7f0e4fe00700 1 --2- 172.21.15.81:0/2384505434 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e500662f0 0x7f0e5010da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:53.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.623+0000 7f0e4fe00700 1 -- 172.21.15.81:0/2384505434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e38005040 con 0x7f0e500fff70 2024-04-23T14:56:53.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.623+0000 7f0e4fe00700 1 --2- 172.21.15.81:0/2384505434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e500fff70 0x7f0e5010dfa0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0e3800b3b0 tx=0x7f0e38009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:53.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.624+0000 7f0e4cc00700 1 -- 172.21.15.81:0/2384505434 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e3800e040 con 0x7f0e500fff70 2024-04-23T14:56:53.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.624+0000 7f0e4cc00700 1 -- 172.21.15.81:0/2384505434 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0e38004290 con 0x7f0e500fff70 2024-04-23T14:56:53.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.624+0000 7f0e57c00700 1 -- 172.21.15.81:0/2384505434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e5010f070 con 0x7f0e500fff70 2024-04-23T14:56:53.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.624+0000 7f0e57c00700 1 -- 172.21.15.81:0/2384505434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e5010f5b0 con 0x7f0e500fff70 2024-04-23T14:56:53.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.624+0000 7f0e4cc00700 1 -- 172.21.15.81:0/2384505434 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e3801c630 con 0x7f0e500fff70 2024-04-23T14:56:53.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.625+0000 7f0e57c00700 1 -- 172.21.15.81:0/2384505434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e5005f5f0 con 0x7f0e500fff70 2024-04-23T14:56:53.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.626+0000 7f0e4cc00700 1 -- 172.21.15.81:0/2384505434 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f0e3800bbf0 con 0x7f0e500fff70 2024-04-23T14:56:53.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.627+0000 7f0e4cc00700 1 --2- 172.21.15.81:0/2384505434 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f0e3406ec10 0x7f0e340710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:53.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.627+0000 7f0e4cc00700 1 -- 172.21.15.81:0/2384505434 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f0e3808fc70 con 0x7f0e500fff70 2024-04-23T14:56:53.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.628+0000 7f0e55200700 1 --2- 172.21.15.81:0/2384505434 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f0e3406ec10 0x7f0e340710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:53.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.628+0000 7f0e55200700 1 --2- 172.21.15.81:0/2384505434 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f0e3406ec10 0x7f0e340710c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0e50066030 tx=0x7f0e48009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:53.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.632+0000 7f0e4cc00700 1 -- 172.21.15.81:0/2384505434 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f0e3805c620 con 0x7f0e500fff70 2024-04-23T14:56:53.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:53 smithi156 ceph-mon[77738]: from='client.34368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:56:53.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:53 smithi156 ceph-mon[77738]: pgmap v161: 65 pgs: 8 peering, 57 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 469 B/s rd, 1 op/s 2024-04-23T14:56:53.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:53 smithi156 ceph-mon[77738]: from='client.34372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:56:53.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.904+0000 7f0e57c00700 1 -- 172.21.15.81:0/2384505434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0e5004bed0 con 0x7f0e500fff70 2024-04-23T14:56:53.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.905+0000 7f0e4cc00700 1 -- 172.21.15.81:0/2384505434 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1907 (secure 0 0 0) 0x7f0e3805c1b0 con 0x7f0e500fff70 2024-04-23T14:56:53.906 INFO:teuthology.orchestra.run.smithi081.stdout:e18 2024-04-23T14:56:53.906 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-23T14:56:53.907 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:56:53.907 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-04-23T14:56:53.907 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:56:53.907 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-04-23T14:56:53.907 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-04-23T14:56:53.907 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 17 2024-04-23T14:56:53.907 INFO:teuthology.orchestra.run.smithi081.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-23T14:56:53.907 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-04-23T14:45:51.264703+0000 2024-04-23T14:56:53.907 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-04-23T14:46:12.782992+0000 2024-04-23T14:56:53.907 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-04-23T14:56:53.907 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-04-23T14:56:53.907 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-04-23T14:56:53.907 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-04-23T14:56:53.907 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-04-23T14:56:53.908 INFO:teuthology.orchestra.run.smithi081.stdout:max_xattr_size 65536 2024-04-23T14:56:53.908 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-04-23T14:56:53.908 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-04-23T14:56:53.908 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 47 2024-04-23T14:56:53.908 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:56:53.908 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 1 2024-04-23T14:56:53.908 INFO:teuthology.orchestra.run.smithi081.stdout:in 0 2024-04-23T14:56:53.908 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=14472} 2024-04-23T14:56:53.908 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-04-23T14:56:53.908 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-04-23T14:56:53.908 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-04-23T14:56:53.908 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-04-23T14:56:53.908 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-04-23T14:56:53.908 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-04-23T14:56:53.908 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-04-23T14:56:53.909 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-04-23T14:56:53.909 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-04-23T14:56:53.909 INFO:teuthology.orchestra.run.smithi081.stdout:qdb_cluster leader: 0 members: 2024-04-23T14:56:53.909 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.vcoywg{0:14472} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.81:6828/2563365650,v1:172.21.15.81:6829/2563365650] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:56:53.909 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.wydgcg{0:14482} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.81:6826/759909104,v1:172.21.15.81:6827/759909104] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:56:53.909 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:56:53.909 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:56:53.909 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-04-23T14:56:53.909 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:56:53.909 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.vynkxn{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.156:6826/1794690362,v1:172.21.15.156:6827/1794690362] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:56:53.909 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.rhbtxt{-1:24263} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.156:6824/3854041261,v1:172.21.15.156:6825/3854041261] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:56:53.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.908+0000 7f0e57c00700 1 -- 172.21.15.81:0/2384505434 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f0e3406ec10 msgr2=0x7f0e340710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:53.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.908+0000 7f0e57c00700 1 --2- 172.21.15.81:0/2384505434 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f0e3406ec10 0x7f0e340710c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0e50066030 tx=0x7f0e48009040 comp rx=0 tx=0).stop 2024-04-23T14:56:53.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.908+0000 7f0e57c00700 1 -- 172.21.15.81:0/2384505434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e500fff70 msgr2=0x7f0e5010dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:53.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.908+0000 7f0e57c00700 1 --2- 172.21.15.81:0/2384505434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e500fff70 0x7f0e5010dfa0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0e3800b3b0 tx=0x7f0e38009e30 comp rx=0 tx=0).stop 2024-04-23T14:56:53.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.908+0000 7f0e57c00700 1 -- 172.21.15.81:0/2384505434 shutdown_connections 2024-04-23T14:56:53.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.908+0000 7f0e57c00700 1 --2- 172.21.15.81:0/2384505434 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f0e3406ec10 0x7f0e340710c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:53.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.908+0000 7f0e57c00700 1 --2- 172.21.15.81:0/2384505434 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e500662f0 0x7f0e5010da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:53.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.908+0000 7f0e57c00700 1 --2- 172.21.15.81:0/2384505434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e500fff70 0x7f0e5010dfa0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:53.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.908+0000 7f0e57c00700 1 -- 172.21.15.81:0/2384505434 >> 172.21.15.81:0/2384505434 conn(0x7f0e500f74c0 msgr2=0x7f0e500f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:53.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.908+0000 7f0e57c00700 1 -- 172.21.15.81:0/2384505434 shutdown_connections 2024-04-23T14:56:53.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:53.908+0000 7f0e57c00700 1 -- 172.21.15.81:0/2384505434 wait complete. 2024-04-23T14:56:53.911 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 18 2024-04-23T14:56:54.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.061+0000 7f6dde600700 1 -- 172.21.15.81:0/3266254967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dd80fee90 msgr2=0x7f6dd80ff2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:54.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.061+0000 7f6dde600700 1 --2- 172.21.15.81:0/3266254967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dd80fee90 0x7f6dd80ff2a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc004940 tx=0x7f6dcc009e30 comp rx=0 tx=0).stop 2024-04-23T14:56:54.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.061+0000 7f6dde600700 1 -- 172.21.15.81:0/3266254967 shutdown_connections 2024-04-23T14:56:54.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.061+0000 7f6dde600700 1 --2- 172.21.15.81:0/3266254967 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6dd8100090 0x7f6dd8100500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:54.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.061+0000 7f6dde600700 1 --2- 172.21.15.81:0/3266254967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dd80fee90 0x7f6dd80ff2a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:54.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.061+0000 7f6dde600700 1 -- 172.21.15.81:0/3266254967 >> 172.21.15.81:0/3266254967 conn(0x7f6dd80fa5d0 msgr2=0x7f6dd80fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:54.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.061+0000 7f6dde600700 1 -- 172.21.15.81:0/3266254967 shutdown_connections 2024-04-23T14:56:54.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.061+0000 7f6dde600700 1 -- 172.21.15.81:0/3266254967 wait complete. 2024-04-23T14:56:54.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.062+0000 7f6dde600700 1 Processor -- start 2024-04-23T14:56:54.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.063+0000 7f6dde600700 1 -- start start 2024-04-23T14:56:54.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.063+0000 7f6dde600700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6dd80fee90 0x7f6dd810fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:54.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.063+0000 7f6dde600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dd8100090 0x7f6dd8110090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:54.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.063+0000 7f6dde600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd8110690 con 0x7f6dd8100090 2024-04-23T14:56:54.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.063+0000 7f6dde600700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd8110ee0 con 0x7f6dd80fee90 2024-04-23T14:56:54.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.063+0000 7f6dd7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dd8100090 0x7f6dd8110090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:54.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.063+0000 7f6dd7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dd8100090 0x7f6dd8110090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43358/0 (socket says 172.21.15.81:43358) 2024-04-23T14:56:54.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.063+0000 7f6dd7e00700 1 -- 172.21.15.81:0/3578395059 learned_addr learned my addr 172.21.15.81:0/3578395059 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:56:54.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.064+0000 7f6ddd200700 1 --2- 172.21.15.81:0/3578395059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6dd80fee90 0x7f6dd810fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:54.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.064+0000 7f6dd7e00700 1 -- 172.21.15.81:0/3578395059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6dd80fee90 msgr2=0x7f6dd810fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:54.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.064+0000 7f6dd7e00700 1 --2- 172.21.15.81:0/3578395059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6dd80fee90 0x7f6dd810fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:54.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.064+0000 7f6dd7e00700 1 -- 172.21.15.81:0/3578395059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dcc005040 con 0x7f6dd8100090 2024-04-23T14:56:54.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.064+0000 7f6dd7e00700 1 --2- 172.21.15.81:0/3578395059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dd8100090 0x7f6dd8110090 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4002a50 tx=0x7f6dc40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:54.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.064+0000 7f6dd4c00700 1 -- 172.21.15.81:0/3578395059 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6dc4007cc0 con 0x7f6dd8100090 2024-04-23T14:56:54.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.064+0000 7f6dd4c00700 1 -- 172.21.15.81:0/3578395059 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6dc400f040 con 0x7f6dd8100090 2024-04-23T14:56:54.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.064+0000 7f6dd4c00700 1 -- 172.21.15.81:0/3578395059 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6dc400db70 con 0x7f6dd8100090 2024-04-23T14:56:54.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.064+0000 7f6dde600700 1 -- 172.21.15.81:0/3578395059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd81111c0 con 0x7f6dd8100090 2024-04-23T14:56:54.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.065+0000 7f6dde600700 1 -- 172.21.15.81:0/3578395059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd8111700 con 0x7f6dd8100090 2024-04-23T14:56:54.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.066+0000 7f6dde600700 1 -- 172.21.15.81:0/3578395059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd805f5f0 con 0x7f6dd8100090 2024-04-23T14:56:54.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.067+0000 7f6dd4c00700 1 -- 172.21.15.81:0/3578395059 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f6dc400dd10 con 0x7f6dd8100090 2024-04-23T14:56:54.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.068+0000 7f6dd4c00700 1 --2- 172.21.15.81:0/3578395059 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6dc006ec10 0x7f6dc00710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:54.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.068+0000 7f6dd4c00700 1 -- 172.21.15.81:0/3578395059 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f6dc408def0 con 0x7f6dd8100090 2024-04-23T14:56:54.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.068+0000 7f6ddd200700 1 --2- 172.21.15.81:0/3578395059 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6dc006ec10 0x7f6dc00710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:54.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.069+0000 7f6ddd200700 1 --2- 172.21.15.81:0/3578395059 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6dc006ec10 0x7f6dc00710c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc00b3b0 tx=0x7f6dcc009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:54.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.072+0000 7f6dd4c00700 1 -- 172.21.15.81:0/3578395059 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f6dc405a800 con 0x7f6dd8100090 2024-04-23T14:56:54.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.306+0000 7f6dde600700 1 -- 172.21.15.81:0/3578395059 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6dd8111a80 con 0x7f6dc006ec10 2024-04-23T14:56:54.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.308+0000 7f6dd4c00700 1 -- 172.21.15.81:0/3578395059 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f6dd8111a80 con 0x7f6dc006ec10 2024-04-23T14:56:54.309 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:56:54.309 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd", 2024-04-23T14:56:54.309 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-04-23T14:56:54.309 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-23T14:56:54.309 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [ 2024-04-23T14:56:54.309 INFO:teuthology.orchestra.run.smithi081.stdout: "mon", 2024-04-23T14:56:54.309 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-04-23T14:56:54.309 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr" 2024-04-23T14:56:54.309 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-04-23T14:56:54.309 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "11/21 daemons upgraded", 2024-04-23T14:56:54.309 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "Currently upgrading osd daemons", 2024-04-23T14:56:54.309 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-04-23T14:56:54.309 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:56:54.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.310+0000 7f6dde600700 1 -- 172.21.15.81:0/3578395059 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6dc006ec10 msgr2=0x7f6dc00710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:54.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.310+0000 7f6dde600700 1 --2- 172.21.15.81:0/3578395059 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6dc006ec10 0x7f6dc00710c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc00b3b0 tx=0x7f6dcc009e30 comp rx=0 tx=0).stop 2024-04-23T14:56:54.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.310+0000 7f6dde600700 1 -- 172.21.15.81:0/3578395059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dd8100090 msgr2=0x7f6dd8110090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:54.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.310+0000 7f6dde600700 1 --2- 172.21.15.81:0/3578395059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dd8100090 0x7f6dd8110090 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4002a50 tx=0x7f6dc40046b0 comp rx=0 tx=0).stop 2024-04-23T14:56:54.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.311+0000 7f6dde600700 1 -- 172.21.15.81:0/3578395059 shutdown_connections 2024-04-23T14:56:54.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.311+0000 7f6dde600700 1 --2- 172.21.15.81:0/3578395059 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6dc006ec10 0x7f6dc00710c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:54.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.311+0000 7f6dde600700 1 --2- 172.21.15.81:0/3578395059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6dd80fee90 0x7f6dd810fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:54.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.311+0000 7f6dde600700 1 --2- 172.21.15.81:0/3578395059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dd8100090 0x7f6dd8110090 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:54.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.311+0000 7f6dde600700 1 -- 172.21.15.81:0/3578395059 >> 172.21.15.81:0/3578395059 conn(0x7f6dd80fa5d0 msgr2=0x7f6dd80fbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:54.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.311+0000 7f6dde600700 1 -- 172.21.15.81:0/3578395059 shutdown_connections 2024-04-23T14:56:54.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.311+0000 7f6dde600700 1 -- 172.21.15.81:0/3578395059 wait complete. 2024-04-23T14:56:54.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.461+0000 7f3eaca00700 1 -- 172.21.15.81:0/1470546922 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ea80fef00 msgr2=0x7f3ea80ff310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:54.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.461+0000 7f3eaca00700 1 --2- 172.21.15.81:0/1470546922 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ea80fef00 0x7f3ea80ff310 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3e98004940 tx=0x7f3e98009e30 comp rx=0 tx=0).stop 2024-04-23T14:56:54.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.461+0000 7f3eaca00700 1 -- 172.21.15.81:0/1470546922 shutdown_connections 2024-04-23T14:56:54.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.461+0000 7f3eaca00700 1 --2- 172.21.15.81:0/1470546922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ea8100070 0x7f3ea81004e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:54.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.461+0000 7f3eaca00700 1 --2- 172.21.15.81:0/1470546922 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ea80fef00 0x7f3ea80ff310 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:54.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.461+0000 7f3eaca00700 1 -- 172.21.15.81:0/1470546922 >> 172.21.15.81:0/1470546922 conn(0x7f3ea80fa790 msgr2=0x7f3ea80fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:54.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.461+0000 7f3eaca00700 1 -- 172.21.15.81:0/1470546922 shutdown_connections 2024-04-23T14:56:54.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.461+0000 7f3eaca00700 1 -- 172.21.15.81:0/1470546922 wait complete. 2024-04-23T14:56:54.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.462+0000 7f3eaca00700 1 Processor -- start 2024-04-23T14:56:54.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.462+0000 7f3eaca00700 1 -- start start 2024-04-23T14:56:54.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.463+0000 7f3eaca00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ea80fef00 0x7f3ea810fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:54.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.463+0000 7f3eaca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ea8100070 0x7f3ea810ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:54.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.463+0000 7f3eaca00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea8110540 con 0x7f3ea8100070 2024-04-23T14:56:54.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.463+0000 7f3eaca00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea8110d90 con 0x7f3ea80fef00 2024-04-23T14:56:54.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.463+0000 7f3ea5e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ea8100070 0x7f3ea810ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:54.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.463+0000 7f3ea5e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ea8100070 0x7f3ea810ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43376/0 (socket says 172.21.15.81:43376) 2024-04-23T14:56:54.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.463+0000 7f3ea5e00700 1 -- 172.21.15.81:0/573576697 learned_addr learned my addr 172.21.15.81:0/573576697 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:56:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.463+0000 7f3ea6800700 1 --2- 172.21.15.81:0/573576697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ea80fef00 0x7f3ea810fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.463+0000 7f3ea5e00700 1 -- 172.21.15.81:0/573576697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ea80fef00 msgr2=0x7f3ea810fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.463+0000 7f3ea5e00700 1 --2- 172.21.15.81:0/573576697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ea80fef00 0x7f3ea810fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.463+0000 7f3ea5e00700 1 -- 172.21.15.81:0/573576697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e94005040 con 0x7f3ea8100070 2024-04-23T14:56:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.464+0000 7f3ea5e00700 1 --2- 172.21.15.81:0/573576697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ea8100070 0x7f3ea810ff40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3e940096d0 tx=0x7f3e94009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.464+0000 7f3e9ea00700 1 -- 172.21.15.81:0/573576697 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e9400e840 con 0x7f3ea8100070 2024-04-23T14:56:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.464+0000 7f3e9ea00700 1 -- 172.21.15.81:0/573576697 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3e9400f040 con 0x7f3ea8100070 2024-04-23T14:56:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.464+0000 7f3eaca00700 1 -- 172.21.15.81:0/573576697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e98005040 con 0x7f3ea8100070 2024-04-23T14:56:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.464+0000 7f3e9ea00700 1 -- 172.21.15.81:0/573576697 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e94013e50 con 0x7f3ea8100070 2024-04-23T14:56:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.464+0000 7f3eaca00700 1 -- 172.21.15.81:0/573576697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ea8111420 con 0x7f3ea8100070 2024-04-23T14:56:54.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.466+0000 7f3eaca00700 1 -- 172.21.15.81:0/573576697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ea80fe290 con 0x7f3ea8100070 2024-04-23T14:56:54.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.467+0000 7f3e9ea00700 1 -- 172.21.15.81:0/573576697 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f3e9400e9a0 con 0x7f3ea8100070 2024-04-23T14:56:54.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.467+0000 7f3e9ea00700 1 --2- 172.21.15.81:0/573576697 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f3e8c06eba0 0x7f3e8c071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:56:54.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.468+0000 7f3e9ea00700 1 -- 172.21.15.81:0/573576697 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f3e9408e6c0 con 0x7f3ea8100070 2024-04-23T14:56:54.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.468+0000 7f3ea6800700 1 --2- 172.21.15.81:0/573576697 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f3e8c06eba0 0x7f3e8c071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:56:54.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.469+0000 7f3ea6800700 1 --2- 172.21.15.81:0/573576697 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f3e8c06eba0 0x7f3e8c071050 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3e980043d0 tx=0x7f3e98009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:56:54.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.472+0000 7f3e9ea00700 1 -- 172.21.15.81:0/573576697 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f3e9405aff0 con 0x7f3ea8100070 2024-04-23T14:56:54.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:54 smithi081 ceph-mon[90469]: from='client.34376 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:56:54.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:54 smithi081 ceph-mon[90469]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/222 objects degraded (5.856%), 5 pgs degraded) 2024-04-23T14:56:54.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:54 smithi081 ceph-mon[90469]: Cluster is now healthy 2024-04-23T14:56:54.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:54 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/2410877501' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:56:54.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:54 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/2384505434' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:56:54.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:54 smithi156 ceph-mon[77738]: from='client.34376 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:56:54.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:54 smithi156 ceph-mon[77738]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/222 objects degraded (5.856%), 5 pgs degraded) 2024-04-23T14:56:54.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:54 smithi156 ceph-mon[77738]: Cluster is now healthy 2024-04-23T14:56:54.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:54 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/2410877501' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:56:54.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:54 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/2384505434' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:56:54.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.786+0000 7f3eaca00700 1 -- 172.21.15.81:0/573576697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f3ea804bed0 con 0x7f3ea8100070 2024-04-23T14:56:54.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.787+0000 7f3e9ea00700 1 -- 172.21.15.81:0/573576697 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f3e9405ab80 con 0x7f3ea8100070 2024-04-23T14:56:54.787 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-04-23T14:56:54.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.789+0000 7f3eaca00700 1 -- 172.21.15.81:0/573576697 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f3e8c06eba0 msgr2=0x7f3e8c071050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:54.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.789+0000 7f3eaca00700 1 --2- 172.21.15.81:0/573576697 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f3e8c06eba0 0x7f3e8c071050 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3e980043d0 tx=0x7f3e98009e30 comp rx=0 tx=0).stop 2024-04-23T14:56:54.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.789+0000 7f3eaca00700 1 -- 172.21.15.81:0/573576697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ea8100070 msgr2=0x7f3ea810ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:56:54.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.789+0000 7f3eaca00700 1 --2- 172.21.15.81:0/573576697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ea8100070 0x7f3ea810ff40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3e940096d0 tx=0x7f3e94009e30 comp rx=0 tx=0).stop 2024-04-23T14:56:54.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.789+0000 7f3eaca00700 1 -- 172.21.15.81:0/573576697 shutdown_connections 2024-04-23T14:56:54.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.790+0000 7f3eaca00700 1 --2- 172.21.15.81:0/573576697 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f3e8c06eba0 0x7f3e8c071050 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:54.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.790+0000 7f3eaca00700 1 --2- 172.21.15.81:0/573576697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ea80fef00 0x7f3ea810fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:54.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.790+0000 7f3eaca00700 1 --2- 172.21.15.81:0/573576697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ea8100070 0x7f3ea810ff40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:56:54.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.790+0000 7f3eaca00700 1 -- 172.21.15.81:0/573576697 >> 172.21.15.81:0/573576697 conn(0x7f3ea80fa790 msgr2=0x7f3ea80fcd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:56:54.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.790+0000 7f3eaca00700 1 -- 172.21.15.81:0/573576697 shutdown_connections 2024-04-23T14:56:54.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:56:54.790+0000 7f3eaca00700 1 -- 172.21.15.81:0/573576697 wait complete. 2024-04-23T14:56:55.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:55 smithi081 ceph-mon[90469]: from='client.34388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:56:55.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:55 smithi081 ceph-mon[90469]: pgmap v162: 65 pgs: 65 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 2 op/s 2024-04-23T14:56:55.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:55 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/573576697' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:56:55.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:55 smithi156 ceph-mon[77738]: from='client.34388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:56:55.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:55 smithi156 ceph-mon[77738]: pgmap v162: 65 pgs: 65 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 2 op/s 2024-04-23T14:56:55.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:55 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/573576697' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:56:57.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:57 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:57.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:57 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:56:57.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:57 smithi081 ceph-mon[90469]: pgmap v163: 65 pgs: 65 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 949 B/s rd, 1 op/s 2024-04-23T14:56:58.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:57 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:56:58.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:57 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:56:58.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:57 smithi156 ceph-mon[77738]: pgmap v163: 65 pgs: 65 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 949 B/s rd, 1 op/s 2024-04-23T14:56:59.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:56:59 smithi081 ceph-mon[90469]: pgmap v164: 65 pgs: 65 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 818 B/s rd, 1 op/s 2024-04-23T14:56:59.839 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:56:59 smithi156 ceph-mon[77738]: pgmap v164: 65 pgs: 65 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 818 B/s rd, 1 op/s 2024-04-23T14:57:01.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:01 smithi081 ceph-mon[90469]: pgmap v165: 65 pgs: 65 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-23T14:57:02.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:01 smithi156 ceph-mon[77738]: pgmap v165: 65 pgs: 65 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-23T14:57:03.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:02 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:03.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:02 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:04.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:03 smithi156 ceph-mon[77738]: pgmap v166: 65 pgs: 65 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T14:57:04.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:03 smithi081 ceph-mon[90469]: pgmap v166: 65 pgs: 65 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T14:57:06.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:05 smithi156 ceph-mon[77738]: pgmap v167: 65 pgs: 65 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:57:06.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:05 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-23T14:57:06.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:05 smithi081 ceph-mon[90469]: pgmap v167: 65 pgs: 65 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:57:06.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:05 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-23T14:57:06.839 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:06 smithi156 ceph-mon[77738]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-23T14:57:06.839 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:06 smithi156 ceph-mon[77738]: Upgrade: osd.5 is safe to restart 2024-04-23T14:57:07.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:06 smithi081 ceph-mon[90469]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-23T14:57:07.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:06 smithi081 ceph-mon[90469]: Upgrade: osd.5 is safe to restart 2024-04-23T14:57:07.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:07 smithi081 ceph-mon[90469]: pgmap v168: 65 pgs: 65 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:57:08.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:07 smithi156 ceph-mon[77738]: pgmap v168: 65 pgs: 65 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:57:09.057 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:08 smithi156 ceph-mon[77738]: Upgrade: Updating osd.5 2024-04-23T14:57:09.058 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:08 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:09.058 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:08 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-23T14:57:09.058 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:08 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:57:09.058 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:08 smithi156 ceph-mon[77738]: Deploying daemon osd.5 on smithi156 2024-04-23T14:57:09.058 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:08 smithi156 ceph-mon[77738]: pgmap v169: 65 pgs: 65 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T14:57:09.330 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:08 smithi081 ceph-mon[90469]: Upgrade: Updating osd.5 2024-04-23T14:57:09.330 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:08 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:09.330 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:08 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-23T14:57:09.330 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:08 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:57:09.330 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:08 smithi081 ceph-mon[90469]: Deploying daemon osd.5 on smithi156 2024-04-23T14:57:09.330 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:08 smithi081 ceph-mon[90469]: pgmap v169: 65 pgs: 65 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T14:57:11.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:11 smithi156 ceph-mon[77738]: pgmap v170: 65 pgs: 65 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:57:11.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:11 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:57:12.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:11 smithi081 ceph-mon[90469]: pgmap v170: 65 pgs: 65 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:57:12.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:11 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:57:13.037 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:12 smithi156 systemd[1]: Stopping Ceph osd.5 for 7a641bea-017e-11ef-bc93-c7b262605968... 2024-04-23T14:57:13.538 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:13 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[51621]: 2024-04-23T14:57:13.043+0000 7fcc14e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T14:57:13.538 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:13 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[51621]: 2024-04-23T14:57:13.043+0000 7fcc14e00700 -1 osd.5 75 *** Got signal Terminated *** 2024-04-23T14:57:13.538 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:13 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[51621]: 2024-04-23T14:57:13.043+0000 7fcc14e00700 -1 osd.5 75 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-23T14:57:14.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:13 smithi156 ceph-mon[77738]: pgmap v171: 65 pgs: 65 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-04-23T14:57:14.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:13 smithi156 ceph-mon[77738]: osd.5 marked itself down and dead 2024-04-23T14:57:14.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:13 smithi081 ceph-mon[90469]: pgmap v171: 65 pgs: 65 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-04-23T14:57:14.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:13 smithi081 ceph-mon[90469]: osd.5 marked itself down and dead 2024-04-23T14:57:14.474 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:14 smithi156 podman[96729]: 2024-04-23 14:57:14.177210383 +0000 UTC m=+1.283612704 container died b754244bef18ccceaf19f50b0c5d3973331cefe7e3eafb7250e6c234df24ee89 (image=quay.ceph.io/ceph-ci/ceph@sha256:3890cd726bd5e73ae623dabdf4ed76dd5df81c936b8bd8d761026babda969466, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=quincy-70d0cb4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-04-23T14:57:14.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:14 smithi156 ceph-mon[77738]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-23T14:57:14.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:14 smithi156 ceph-mon[77738]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-04-23T14:57:14.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:14 smithi156 ceph-mon[77738]: osdmap e76: 6 total, 5 up, 6 in 2024-04-23T14:57:14.787 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:14 smithi156 podman[96729]: 2024-04-23 14:57:14.601733262 +0000 UTC m=+1.708135605 container cleanup b754244bef18ccceaf19f50b0c5d3973331cefe7e3eafb7250e6c234df24ee89 (image=quay.ceph.io/ceph-ci/ceph@sha256:3890cd726bd5e73ae623dabdf4ed76dd5df81c936b8bd8d761026babda969466, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, RELEASE=quincy-70d0cb4, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T14:57:14.787 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:14 smithi156 bash[96729]: ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5 2024-04-23T14:57:15.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:14 smithi081 ceph-mon[90469]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-23T14:57:15.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:14 smithi081 ceph-mon[90469]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-04-23T14:57:15.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:14 smithi081 ceph-mon[90469]: osdmap e76: 6 total, 5 up, 6 in 2024-04-23T14:57:15.286 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:14 smithi156 podman[96749]: 2024-04-23 14:57:14.922458553 +0000 UTC m=+0.732672333 container remove b754244bef18ccceaf19f50b0c5d3973331cefe7e3eafb7250e6c234df24ee89 (image=quay.ceph.io/ceph-ci/ceph@sha256:3890cd726bd5e73ae623dabdf4ed76dd5df81c936b8bd8d761026babda969466, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=quincy-70d0cb4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-23T14:57:15.928 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:15 smithi156 ceph-mon[77738]: pgmap v173: 65 pgs: 10 peering, 10 stale+active+clean, 45 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:57:15.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:15 smithi156 ceph-mon[77738]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-04-23T14:57:15.929 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:15 smithi156 ceph-mon[77738]: osdmap e77: 6 total, 5 up, 6 in 2024-04-23T14:57:15.929 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:15 smithi156 podman[96836]: 2024-04-23 14:57:15.624767768 +0000 UTC m=+0.035934819 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T14:57:15.929 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:15 smithi156 podman[96836]: 2024-04-23 14:57:15.77080372 +0000 UTC m=+0.181970820 container create 3cf220c99f7894c30714fd677fef98070bcc5b9536f359321c8e7f574721f196 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-04-23T14:57:16.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:15 smithi081 ceph-mon[90469]: pgmap v173: 65 pgs: 10 peering, 10 stale+active+clean, 45 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-23T14:57:16.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:15 smithi081 ceph-mon[90469]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-04-23T14:57:16.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:15 smithi081 ceph-mon[90469]: osdmap e77: 6 total, 5 up, 6 in 2024-04-23T14:57:16.286 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:16 smithi156 podman[96836]: 2024-04-23 14:57:16.032605243 +0000 UTC m=+0.443772356 container init 3cf220c99f7894c30714fd677fef98070bcc5b9536f359321c8e7f574721f196 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240416, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-04-23T14:57:16.286 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:16 smithi156 podman[96836]: 2024-04-23 14:57:16.045465272 +0000 UTC m=+0.456632362 container start 3cf220c99f7894c30714fd677fef98070bcc5b9536f359321c8e7f574721f196 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5-deactivate, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T14:57:16.286 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:16 smithi156 podman[96836]: 2024-04-23 14:57:16.148166045 +0000 UTC m=+0.559333155 container attach 3cf220c99f7894c30714fd677fef98070bcc5b9536f359321c8e7f574721f196 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, maintainer=Guillaume Abrioux ) 2024-04-23T14:57:16.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:16 smithi156 ceph-mon[77738]: Health check failed: Degraded data redundancy: 7/222 objects degraded (3.153%), 3 pgs degraded (PG_DEGRADED) 2024-04-23T14:57:16.786 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:16 smithi156 podman[96836]: 2024-04-23 14:57:16.495955871 +0000 UTC m=+0.907122943 container died 3cf220c99f7894c30714fd677fef98070bcc5b9536f359321c8e7f574721f196 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-04-23T14:57:17.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:16 smithi081 ceph-mon[90469]: Health check failed: Degraded data redundancy: 7/222 objects degraded (3.153%), 3 pgs degraded (PG_DEGRADED) 2024-04-23T14:57:17.537 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:17 smithi156 podman[96862]: 2024-04-23 14:57:17.251682629 +0000 UTC m=+0.737486189 container remove 3cf220c99f7894c30714fd677fef98070bcc5b9536f359321c8e7f574721f196 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-04-23T14:57:17.537 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:17 smithi156 systemd[1]: ceph-7a641bea-017e-11ef-bc93-c7b262605968@osd.5.service: Deactivated successfully. 2024-04-23T14:57:17.537 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:17 smithi156 systemd[1]: Stopped Ceph osd.5 for 7a641bea-017e-11ef-bc93-c7b262605968. 2024-04-23T14:57:17.537 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:17 smithi156 systemd[1]: ceph-7a641bea-017e-11ef-bc93-c7b262605968@osd.5.service: Consumed 1min 57.040s CPU time. 2024-04-23T14:57:17.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:17 smithi081 ceph-mon[90469]: pgmap v175: 65 pgs: 3 active+undersized+degraded, 10 peering, 6 stale+active+clean, 4 active+undersized, 42 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 7/222 objects degraded (3.153%) 2024-04-23T14:57:18.035 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:17 smithi156 systemd[1]: Starting Ceph osd.5 for 7a641bea-017e-11ef-bc93-c7b262605968... 2024-04-23T14:57:18.035 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:17 smithi156 ceph-mon[77738]: pgmap v175: 65 pgs: 3 active+undersized+degraded, 10 peering, 6 stale+active+clean, 4 active+undersized, 42 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 7/222 objects degraded (3.153%) 2024-04-23T14:57:18.286 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:18 smithi156 podman[96964]: 2024-04-23 14:57:17.940727393 +0000 UTC m=+0.037159248 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T14:57:18.286 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:18 smithi156 podman[96964]: 2024-04-23 14:57:18.07753514 +0000 UTC m=+0.173967032 container create 69060fb2d050a6d1fedefbf780c3086d86b8eb42fd9d3ec98f06d45525cad834 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5-activate, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd) 2024-04-23T14:57:18.786 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:18 smithi156 podman[96964]: 2024-04-23 14:57:18.389539458 +0000 UTC m=+0.485971357 container init 69060fb2d050a6d1fedefbf780c3086d86b8eb42fd9d3ec98f06d45525cad834 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5-activate, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-04-23T14:57:18.787 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:18 smithi156 podman[96964]: 2024-04-23 14:57:18.40079609 +0000 UTC m=+0.497227963 container start 69060fb2d050a6d1fedefbf780c3086d86b8eb42fd9d3ec98f06d45525cad834 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5-activate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-04-23T14:57:18.787 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:18 smithi156 podman[96964]: 2024-04-23 14:57:18.488479711 +0000 UTC m=+0.584911609 container attach 69060fb2d050a6d1fedefbf780c3086d86b8eb42fd9d3ec98f06d45525cad834 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5-activate, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-04-23T14:57:19.392 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:19 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5-activate[96978]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-23T14:57:19.392 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:19 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5-activate[96978]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-23T14:57:19.392 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:19 smithi156 bash[96964]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-23T14:57:19.392 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:19 smithi156 bash[96964]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-23T14:57:19.393 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:19 smithi156 bash[96964]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-23T14:57:19.393 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:19 smithi156 bash[96964]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-23T14:57:19.393 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:19 smithi156 bash[96964]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-23T14:57:19.393 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:19 smithi156 bash[96964]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-23T14:57:19.393 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:19 smithi156 bash[96964]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-04-23T14:57:19.393 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:19 smithi156 bash[96964]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-23T14:57:19.393 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:19 smithi156 bash[96964]: --> ceph-volume raw activate successful for osd ID: 5 2024-04-23T14:57:19.393 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:19 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5-activate[96978]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-23T14:57:19.393 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:19 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5-activate[96978]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-23T14:57:19.393 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:19 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5-activate[96978]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-23T14:57:19.393 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:19 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5-activate[96978]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-23T14:57:19.393 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:19 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5-activate[96978]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-04-23T14:57:19.393 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:19 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5-activate[96978]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-23T14:57:19.393 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:19 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5-activate[96978]: --> ceph-volume raw activate successful for osd ID: 5 2024-04-23T14:57:19.698 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:19 smithi156 podman[96964]: 2024-04-23 14:57:19.391437149 +0000 UTC m=+1.487869048 container died 69060fb2d050a6d1fedefbf780c3086d86b8eb42fd9d3ec98f06d45525cad834 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5-activate, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.build-date=20240416) 2024-04-23T14:57:20.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:19 smithi156 ceph-mon[77738]: pgmap v176: 65 pgs: 3 active+undersized+degraded, 10 peering, 4 stale+active+clean, 7 active+undersized, 41 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 7/222 objects degraded (3.153%) 2024-04-23T14:57:20.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:19 smithi081 ceph-mon[90469]: pgmap v176: 65 pgs: 3 active+undersized+degraded, 10 peering, 4 stale+active+clean, 7 active+undersized, 41 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 7/222 objects degraded (3.153%) 2024-04-23T14:57:20.512 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:20 smithi156 podman[97113]: 2024-04-23 14:57:20.150168548 +0000 UTC m=+0.737117333 container remove 69060fb2d050a6d1fedefbf780c3086d86b8eb42fd9d3ec98f06d45525cad834 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5-activate, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T14:57:20.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:20 smithi156 ceph-mon[77738]: pgmap v177: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-04-23T14:57:20.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:20 smithi156 ceph-mon[77738]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-04-23T14:57:20.786 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:20 smithi156 podman[97175]: 2024-04-23 14:57:20.417723521 +0000 UTC m=+0.035848749 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T14:57:20.787 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:20 smithi156 podman[97175]: 2024-04-23 14:57:20.52630878 +0000 UTC m=+0.144434023 container create 16b6ba5d9e3ebf14c2444771ef430e77a696375eb742c3a28b2f19f8ca3d40bf (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5, ceph=True, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-04-23T14:57:21.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:20 smithi081 ceph-mon[90469]: pgmap v177: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-04-23T14:57:21.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:20 smithi081 ceph-mon[90469]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-04-23T14:57:21.286 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:20 smithi156 podman[97175]: 2024-04-23 14:57:20.831261969 +0000 UTC m=+0.449387219 container init 16b6ba5d9e3ebf14c2444771ef430e77a696375eb742c3a28b2f19f8ca3d40bf (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.license=GPLv2) 2024-04-23T14:57:21.286 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:20 smithi156 podman[97175]: 2024-04-23 14:57:20.842544313 +0000 UTC m=+0.460669563 container start 16b6ba5d9e3ebf14c2444771ef430e77a696375eb742c3a28b2f19f8ca3d40bf (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-04-23T14:57:21.286 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:20 smithi156 ceph-osd[97194]: -- 172.21.15.156:0/488308107 <== mon.1 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d7f4097680 con 0x55d7f4061000 2024-04-23T14:57:21.286 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:20 smithi156 bash[97175]: 16b6ba5d9e3ebf14c2444771ef430e77a696375eb742c3a28b2f19f8ca3d40bf 2024-04-23T14:57:21.286 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:20 smithi156 systemd[1]: Started Ceph osd.5 for 7a641bea-017e-11ef-bc93-c7b262605968. 2024-04-23T14:57:21.786 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:21 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T14:57:21.408+0000 7fa02841f7c0 -1 Falling back to public interface 2024-04-23T14:57:22.407 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:22 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:22.407 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:22 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:22.408 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:22 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:57:22.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:22 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:22.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:22 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:22.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:22 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:57:23.439 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:23 smithi156 ceph-mon[77738]: pgmap v178: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-04-23T14:57:23.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:23 smithi081 ceph-mon[90469]: pgmap v178: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-04-23T14:57:24.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:24.955+0000 7f9fd9600700 1 -- 172.21.15.81:0/2044248358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd4103270 msgr2=0x7f9fd4103680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:24.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:24.955+0000 7f9fd9600700 1 --2- 172.21.15.81:0/2044248358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd4103270 0x7f9fd4103680 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4004940 tx=0x7f9fc4009e30 comp rx=0 tx=0).stop 2024-04-23T14:57:24.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:24.955+0000 7f9fd9600700 1 -- 172.21.15.81:0/2044248358 shutdown_connections 2024-04-23T14:57:24.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:24.955+0000 7f9fd9600700 1 --2- 172.21.15.81:0/2044248358 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fd4104520 0x7f9fd4104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:24.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:24.955+0000 7f9fd9600700 1 --2- 172.21.15.81:0/2044248358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd4103270 0x7f9fd4103680 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:24.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:24.955+0000 7f9fd9600700 1 -- 172.21.15.81:0/2044248358 >> 172.21.15.81:0/2044248358 conn(0x7f9fd4072530 msgr2=0x7f9fd4074940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:24.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:24.956+0000 7f9fd9600700 1 -- 172.21.15.81:0/2044248358 shutdown_connections 2024-04-23T14:57:24.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:24.956+0000 7f9fd9600700 1 -- 172.21.15.81:0/2044248358 wait complete. 2024-04-23T14:57:24.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:24.956+0000 7f9fd9600700 1 Processor -- start 2024-04-23T14:57:24.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:24.957+0000 7f9fd9600700 1 -- start start 2024-04-23T14:57:24.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:24.957+0000 7f9fd9600700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fd4103270 0x7f9fd4113f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:24.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:24.957+0000 7f9fd9600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd4104520 0x7f9fd4114440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:24.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:24.957+0000 7f9fd9600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd4114a40 con 0x7f9fd4104520 2024-04-23T14:57:24.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:24.957+0000 7f9fd9600700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd4115180 con 0x7f9fd4103270 2024-04-23T14:57:24.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:24.957+0000 7f9fd3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd4104520 0x7f9fd4114440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:24.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:24.957+0000 7f9fd3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd4104520 0x7f9fd4114440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44686/0 (socket says 172.21.15.81:44686) 2024-04-23T14:57:24.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:24.957+0000 7f9fd3400700 1 -- 172.21.15.81:0/1989518325 learned_addr learned my addr 172.21.15.81:0/1989518325 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:57:24.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:24.958+0000 7f9fd3e00700 1 --2- 172.21.15.81:0/1989518325 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fd4103270 0x7f9fd4113f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:24.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:24.958+0000 7f9fd3400700 1 -- 172.21.15.81:0/1989518325 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fd4103270 msgr2=0x7f9fd4113f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:24.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:24.958+0000 7f9fd3400700 1 --2- 172.21.15.81:0/1989518325 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fd4103270 0x7f9fd4113f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:24.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:24.958+0000 7f9fd3400700 1 -- 172.21.15.81:0/1989518325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc4005040 con 0x7f9fd4104520 2024-04-23T14:57:24.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:24.958+0000 7f9fd3e00700 1 --2- 172.21.15.81:0/1989518325 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fd4103270 0x7f9fd4113f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T14:57:24.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:24.958+0000 7f9fd3400700 1 --2- 172.21.15.81:0/1989518325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd4104520 0x7f9fd4114440 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9fc000c830 tx=0x7f9fc0004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:24.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:24.958+0000 7f9fcbe00700 1 -- 172.21.15.81:0/1989518325 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fc000a760 con 0x7f9fd4104520 2024-04-23T14:57:24.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:24.959+0000 7f9fd9600700 1 -- 172.21.15.81:0/1989518325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fd4115460 con 0x7f9fd4104520 2024-04-23T14:57:24.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:24.959+0000 7f9fcbe00700 1 -- 172.21.15.81:0/1989518325 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9fc000ad90 con 0x7f9fd4104520 2024-04-23T14:57:24.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:24.959+0000 7f9fcbe00700 1 -- 172.21.15.81:0/1989518325 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fc00113a0 con 0x7f9fd4104520 2024-04-23T14:57:24.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:24.959+0000 7f9fd9600700 1 -- 172.21.15.81:0/1989518325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fd4115a20 con 0x7f9fd4104520 2024-04-23T14:57:24.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:24.960+0000 7f9fd9600700 1 -- 172.21.15.81:0/1989518325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fd40760a0 con 0x7f9fd4104520 2024-04-23T14:57:24.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:24.961+0000 7f9fcbe00700 1 -- 172.21.15.81:0/1989518325 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f9fc0012400 con 0x7f9fd4104520 2024-04-23T14:57:24.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:24.962+0000 7f9fcbe00700 1 --2- 172.21.15.81:0/1989518325 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f9fb806ec00 0x7f9fb80710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:24.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:24.962+0000 7f9fcbe00700 1 -- 172.21.15.81:0/1989518325 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f9fc008e940 con 0x7f9fd4104520 2024-04-23T14:57:24.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:24.963+0000 7f9fd3e00700 1 --2- 172.21.15.81:0/1989518325 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f9fb806ec00 0x7f9fb80710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:24.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:24.963+0000 7f9fd3e00700 1 --2- 172.21.15.81:0/1989518325 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f9fb806ec00 0x7f9fb80710b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9fc400b020 tx=0x7f9fc4009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:24.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:24.973+0000 7f9fcbe00700 1 -- 172.21.15.81:0/1989518325 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f9fc005b250 con 0x7f9fd4104520 2024-04-23T14:57:25.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.215+0000 7f9fd9600700 1 -- 172.21.15.81:0/1989518325 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9fd4115db0 con 0x7f9fb806ec00 2024-04-23T14:57:25.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.217+0000 7f9fcbe00700 1 -- 172.21.15.81:0/1989518325 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f9fd4115db0 con 0x7f9fb806ec00 2024-04-23T14:57:25.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.220+0000 7f9fd9600700 1 -- 172.21.15.81:0/1989518325 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f9fb806ec00 msgr2=0x7f9fb80710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:25.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.220+0000 7f9fd9600700 1 --2- 172.21.15.81:0/1989518325 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f9fb806ec00 0x7f9fb80710b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9fc400b020 tx=0x7f9fc4009e30 comp rx=0 tx=0).stop 2024-04-23T14:57:25.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.220+0000 7f9fd9600700 1 -- 172.21.15.81:0/1989518325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd4104520 msgr2=0x7f9fd4114440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:25.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.220+0000 7f9fd9600700 1 --2- 172.21.15.81:0/1989518325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd4104520 0x7f9fd4114440 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9fc000c830 tx=0x7f9fc0004470 comp rx=0 tx=0).stop 2024-04-23T14:57:25.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.221+0000 7f9fd9600700 1 -- 172.21.15.81:0/1989518325 shutdown_connections 2024-04-23T14:57:25.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.221+0000 7f9fd9600700 1 --2- 172.21.15.81:0/1989518325 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f9fb806ec00 0x7f9fb80710b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:25.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.221+0000 7f9fd9600700 1 --2- 172.21.15.81:0/1989518325 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fd4103270 0x7f9fd4113f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:25.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.221+0000 7f9fd9600700 1 --2- 172.21.15.81:0/1989518325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd4104520 0x7f9fd4114440 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:25.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.221+0000 7f9fd9600700 1 -- 172.21.15.81:0/1989518325 >> 172.21.15.81:0/1989518325 conn(0x7f9fd4072530 msgr2=0x7f9fd4074ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:25.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.221+0000 7f9fd9600700 1 -- 172.21.15.81:0/1989518325 shutdown_connections 2024-04-23T14:57:25.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.221+0000 7f9fd9600700 1 -- 172.21.15.81:0/1989518325 wait complete. 2024-04-23T14:57:25.236 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-04-23T14:57:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.375+0000 7f33ebe00700 1 -- 172.21.15.81:0/3331356486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33e4071e40 msgr2=0x7f33e4070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.375+0000 7f33ebe00700 1 --2- 172.21.15.81:0/3331356486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33e4071e40 0x7f33e4070350 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f33d8004940 tx=0x7f33d8009e30 comp rx=0 tx=0).stop 2024-04-23T14:57:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.375+0000 7f33ebe00700 1 -- 172.21.15.81:0/3331356486 shutdown_connections 2024-04-23T14:57:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.375+0000 7f33ebe00700 1 --2- 172.21.15.81:0/3331356486 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33e4070890 0x7f33e4070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.375+0000 7f33ebe00700 1 --2- 172.21.15.81:0/3331356486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33e4071e40 0x7f33e4070350 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.375+0000 7f33ebe00700 1 -- 172.21.15.81:0/3331356486 >> 172.21.15.81:0/3331356486 conn(0x7f33e40f8540 msgr2=0x7f33e40fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.376+0000 7f33ebe00700 1 -- 172.21.15.81:0/3331356486 shutdown_connections 2024-04-23T14:57:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.376+0000 7f33ebe00700 1 -- 172.21.15.81:0/3331356486 wait complete. 2024-04-23T14:57:25.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.377+0000 7f33ebe00700 1 Processor -- start 2024-04-23T14:57:25.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.377+0000 7f33ebe00700 1 -- start start 2024-04-23T14:57:25.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.377+0000 7f33ebe00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33e4070890 0x7f33e410fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:25.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.377+0000 7f33ebe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33e4071e40 0x7f33e4110060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:25.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.377+0000 7f33ebe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e4110660 con 0x7f33e4071e40 2024-04-23T14:57:25.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.377+0000 7f33ebe00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e41107d0 con 0x7f33e4070890 2024-04-23T14:57:25.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.377+0000 7f33e8a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33e4071e40 0x7f33e4110060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:25.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.377+0000 7f33e8a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33e4071e40 0x7f33e4110060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44698/0 (socket says 172.21.15.81:44698) 2024-04-23T14:57:25.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.377+0000 7f33e8a00700 1 -- 172.21.15.81:0/1371995428 learned_addr learned my addr 172.21.15.81:0/1371995428 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:57:25.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.378+0000 7f33e9400700 1 --2- 172.21.15.81:0/1371995428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33e4070890 0x7f33e410fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:25.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.378+0000 7f33e8a00700 1 -- 172.21.15.81:0/1371995428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33e4070890 msgr2=0x7f33e410fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:25.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.378+0000 7f33e8a00700 1 --2- 172.21.15.81:0/1371995428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33e4070890 0x7f33e410fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:25.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.378+0000 7f33e8a00700 1 -- 172.21.15.81:0/1371995428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d8005040 con 0x7f33e4071e40 2024-04-23T14:57:25.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.378+0000 7f33e8a00700 1 --2- 172.21.15.81:0/1371995428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33e4071e40 0x7f33e4110060 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f33d000eb40 tx=0x7f33d000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:25.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.378+0000 7f33e1600700 1 -- 172.21.15.81:0/1371995428 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33d0007cc0 con 0x7f33e4071e40 2024-04-23T14:57:25.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.379+0000 7f33e1600700 1 -- 172.21.15.81:0/1371995428 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f33d000f040 con 0x7f33e4071e40 2024-04-23T14:57:25.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.379+0000 7f33ebe00700 1 -- 172.21.15.81:0/1371995428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e4115180 con 0x7f33e4071e40 2024-04-23T14:57:25.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.379+0000 7f33e1600700 1 -- 172.21.15.81:0/1371995428 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33d000ca10 con 0x7f33e4071e40 2024-04-23T14:57:25.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.379+0000 7f33ebe00700 1 -- 172.21.15.81:0/1371995428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e4115740 con 0x7f33e4071e40 2024-04-23T14:57:25.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.380+0000 7f33ebe00700 1 -- 172.21.15.81:0/1371995428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33e404c710 con 0x7f33e4071e40 2024-04-23T14:57:25.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.381+0000 7f33e1600700 1 -- 172.21.15.81:0/1371995428 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f33d000cb70 con 0x7f33e4071e40 2024-04-23T14:57:25.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.382+0000 7f33e1600700 1 --2- 172.21.15.81:0/1371995428 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f33cc06ec00 0x7f33cc0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:25.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.382+0000 7f33e1600700 1 -- 172.21.15.81:0/1371995428 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f33d008e3c0 con 0x7f33e4071e40 2024-04-23T14:57:25.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.383+0000 7f33e9400700 1 --2- 172.21.15.81:0/1371995428 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f33cc06ec00 0x7f33cc0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:25.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.383+0000 7f33e9400700 1 --2- 172.21.15.81:0/1371995428 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f33cc06ec00 0x7f33cc0710b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f33d8013870 tx=0x7f33d8009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:25.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.387+0000 7f33e1600700 1 -- 172.21.15.81:0/1371995428 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f33d005ad80 con 0x7f33e4071e40 2024-04-23T14:57:25.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.636+0000 7f33ebe00700 1 -- 172.21.15.81:0/1371995428 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f33e4103e30 con 0x7f33cc06ec00 2024-04-23T14:57:25.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.639+0000 7f33e1600700 1 -- 172.21.15.81:0/1371995428 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f33e4103e30 con 0x7f33cc06ec00 2024-04-23T14:57:25.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.642+0000 7f33ebe00700 1 -- 172.21.15.81:0/1371995428 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f33cc06ec00 msgr2=0x7f33cc0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:25.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.642+0000 7f33ebe00700 1 --2- 172.21.15.81:0/1371995428 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f33cc06ec00 0x7f33cc0710b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f33d8013870 tx=0x7f33d8009e30 comp rx=0 tx=0).stop 2024-04-23T14:57:25.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.642+0000 7f33ebe00700 1 -- 172.21.15.81:0/1371995428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33e4071e40 msgr2=0x7f33e4110060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:25.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.642+0000 7f33ebe00700 1 --2- 172.21.15.81:0/1371995428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33e4071e40 0x7f33e4110060 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f33d000eb40 tx=0x7f33d000b040 comp rx=0 tx=0).stop 2024-04-23T14:57:25.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.642+0000 7f33ebe00700 1 -- 172.21.15.81:0/1371995428 shutdown_connections 2024-04-23T14:57:25.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.642+0000 7f33ebe00700 1 --2- 172.21.15.81:0/1371995428 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f33cc06ec00 0x7f33cc0710b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:25.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.642+0000 7f33ebe00700 1 --2- 172.21.15.81:0/1371995428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33e4070890 0x7f33e410fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:25.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.642+0000 7f33ebe00700 1 --2- 172.21.15.81:0/1371995428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33e4071e40 0x7f33e4110060 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:25.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.642+0000 7f33ebe00700 1 -- 172.21.15.81:0/1371995428 >> 172.21.15.81:0/1371995428 conn(0x7f33e40f8540 msgr2=0x7f33e40f9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:25.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.642+0000 7f33ebe00700 1 -- 172.21.15.81:0/1371995428 shutdown_connections 2024-04-23T14:57:25.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.642+0000 7f33ebe00700 1 -- 172.21.15.81:0/1371995428 wait complete. 2024-04-23T14:57:25.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.783+0000 7fb89f000700 1 -- 172.21.15.81:0/3107844331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8981046b0 msgr2=0x7fb898104b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:25.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.783+0000 7fb89f000700 1 --2- 172.21.15.81:0/3107844331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8981046b0 0x7fb898104b20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb884004940 tx=0x7fb884009e30 comp rx=0 tx=0).stop 2024-04-23T14:57:25.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.783+0000 7fb89f000700 1 -- 172.21.15.81:0/3107844331 shutdown_connections 2024-04-23T14:57:25.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.783+0000 7fb89f000700 1 --2- 172.21.15.81:0/3107844331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8981046b0 0x7fb898104b20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:25.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.783+0000 7fb89f000700 1 --2- 172.21.15.81:0/3107844331 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb898103400 0x7fb898103810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:25.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.783+0000 7fb89f000700 1 -- 172.21.15.81:0/3107844331 >> 172.21.15.81:0/3107844331 conn(0x7fb898072590 msgr2=0x7fb8980749c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:25.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.783+0000 7fb89f000700 1 -- 172.21.15.81:0/3107844331 shutdown_connections 2024-04-23T14:57:25.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.783+0000 7fb89f000700 1 -- 172.21.15.81:0/3107844331 wait complete. 2024-04-23T14:57:25.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.784+0000 7fb89f000700 1 Processor -- start 2024-04-23T14:57:25.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.784+0000 7fb89f000700 1 -- start start 2024-04-23T14:57:25.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.785+0000 7fb89f000700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb898103400 0x7fb898114010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:25.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.785+0000 7fb89f000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8981046b0 0x7fb898114550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:25.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.785+0000 7fb89f000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb898114b50 con 0x7fb8981046b0 2024-04-23T14:57:25.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.785+0000 7fb89f000700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8981153a0 con 0x7fb898103400 2024-04-23T14:57:25.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.785+0000 7fb897400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8981046b0 0x7fb898114550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:25.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.785+0000 7fb897400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8981046b0 0x7fb898114550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44724/0 (socket says 172.21.15.81:44724) 2024-04-23T14:57:25.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.785+0000 7fb897400700 1 -- 172.21.15.81:0/3748655946 learned_addr learned my addr 172.21.15.81:0/3748655946 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:57:25.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.785+0000 7fb897e00700 1 --2- 172.21.15.81:0/3748655946 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb898103400 0x7fb898114010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:25.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.785+0000 7fb897400700 1 -- 172.21.15.81:0/3748655946 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb898103400 msgr2=0x7fb898114010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:25.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.785+0000 7fb897400700 1 --2- 172.21.15.81:0/3748655946 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb898103400 0x7fb898114010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:25.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.785+0000 7fb897400700 1 -- 172.21.15.81:0/3748655946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb884005040 con 0x7fb8981046b0 2024-04-23T14:57:25.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.786+0000 7fb897400700 1 --2- 172.21.15.81:0/3748655946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8981046b0 0x7fb898114550 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb884009150 tx=0x7fb884009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:25.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.786+0000 7fb88fe00700 1 -- 172.21.15.81:0/3748655946 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb88400e040 con 0x7fb8981046b0 2024-04-23T14:57:25.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.786+0000 7fb89f000700 1 -- 172.21.15.81:0/3748655946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb898115620 con 0x7fb8981046b0 2024-04-23T14:57:25.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.786+0000 7fb88fe00700 1 -- 172.21.15.81:0/3748655946 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb88400bbf0 con 0x7fb8981046b0 2024-04-23T14:57:25.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.786+0000 7fb89f000700 1 -- 172.21.15.81:0/3748655946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb898115b60 con 0x7fb8981046b0 2024-04-23T14:57:25.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.786+0000 7fb88fe00700 1 -- 172.21.15.81:0/3748655946 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8840255e0 con 0x7fb8981046b0 2024-04-23T14:57:25.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.787+0000 7fb89f000700 1 -- 172.21.15.81:0/3748655946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb89805f5f0 con 0x7fb8981046b0 2024-04-23T14:57:25.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.788+0000 7fb88fe00700 1 -- 172.21.15.81:0/3748655946 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fb88400bd60 con 0x7fb8981046b0 2024-04-23T14:57:25.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.789+0000 7fb88fe00700 1 --2- 172.21.15.81:0/3748655946 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fb87c06ec10 0x7fb87c0710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:25.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.789+0000 7fb88fe00700 1 -- 172.21.15.81:0/3748655946 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fb88408fc20 con 0x7fb8981046b0 2024-04-23T14:57:25.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.789+0000 7fb897e00700 1 --2- 172.21.15.81:0/3748655946 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fb87c06ec10 0x7fb87c0710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:25.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.790+0000 7fb897e00700 1 --2- 172.21.15.81:0/3748655946 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fb87c06ec10 0x7fb87c0710c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb888004f40 tx=0x7fb88800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:25.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:25.794+0000 7fb88fe00700 1 -- 172.21.15.81:0/3748655946 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fb88405c530 con 0x7fb8981046b0 2024-04-23T14:57:26.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.012+0000 7fb89f000700 1 -- 172.21.15.81:0/3748655946 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb898115ee0 con 0x7fb87c06ec10 2024-04-23T14:57:26.013 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:25 smithi081 ceph-mon[90469]: pgmap v179: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-04-23T14:57:26.013 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:25 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:26.013 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:25 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:26.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:25 smithi156 ceph-mon[77738]: pgmap v179: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-04-23T14:57:26.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:25 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:26.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:25 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:26.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.042+0000 7fb88fe00700 1 -- 172.21.15.81:0/3748655946 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fb898115ee0 con 0x7fb87c06ec10 2024-04-23T14:57:26.043 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-23T14:57:26.043 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (7m) 111s ago 18m 14.2M - 0.25.0 c8568f914cd2 63876b2abc27 2024-04-23T14:57:26.043 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (3m) 111s ago 18m 6665k - 19.0.0-3126-gd44fddd9 76e77f280c74 b486fe2ef19b 2024-04-23T14:57:26.043 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi156 smithi156 running (3m) 0s ago 17m 6656k - 19.0.0-3126-gd44fddd9 76e77f280c74 5d9aa5ecf264 2024-04-23T14:57:26.043 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (7m) 111s ago 18m 74.0M - 9.4.7 954c08fa6188 fbad3cef0883 2024-04-23T14:57:26.043 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.vcoywg smithi081 running (11m) 111s ago 11m 147M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 2ca7601ab60f 2024-04-23T14:57:26.043 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.wydgcg smithi081 running (11m) 111s ago 11m 107M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 58eb1a961b61 2024-04-23T14:57:26.043 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.rhbtxt smithi156 running (11m) 0s ago 11m 14.5M - 17.2.7-884-g70d0cb4b cafd8ddac8fa db3cb5034381 2024-04-23T14:57:26.043 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.vynkxn smithi156 running (11m) 0s ago 11m 14.8M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 1c8f2219e7fd 2024-04-23T14:57:26.043 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.ldghvq smithi081 *:8443,9283,8765 running (7m) 111s ago 20m 505M - 19.0.0-3126-gd44fddd9 76e77f280c74 6bf23484a1c9 2024-04-23T14:57:26.043 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi156.ounwyj smithi156 *:8443,9283,8765 running (5m) 0s ago 17m 452M - 19.0.0-3126-gd44fddd9 76e77f280c74 a6c0dd9f89f2 2024-04-23T14:57:26.044 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (5m) 111s ago 20m 50.0M 2048M 19.0.0-3126-gd44fddd9 76e77f280c74 fbf9f9a59ac2 2024-04-23T14:57:26.044 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi156 smithi156 running (4m) 0s ago 17m 35.9M 2048M 19.0.0-3126-gd44fddd9 76e77f280c74 36409886998f 2024-04-23T14:57:26.044 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (8m) 111s ago 18m 7860k - 1.5.0 0da6a335fe13 197b27809010 2024-04-23T14:57:26.044 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi156 smithi156 *:9100 running (7m) 0s ago 17m 8363k - 1.5.0 0da6a335fe13 91a7c5e86d47 2024-04-23T14:57:26.044 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (3m) 111s ago 16m 99.5M 1557M 19.0.0-3126-gd44fddd9 76e77f280c74 24bc24b37de5 2024-04-23T14:57:26.044 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (2m) 111s ago 15m 105M 1557M 19.0.0-3126-gd44fddd9 76e77f280c74 18d0179b558a 2024-04-23T14:57:26.044 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (119s) 111s ago 15m 11.1M 1557M 19.0.0-3126-gd44fddd9 76e77f280c74 421a62ef6990 2024-04-23T14:57:26.044 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi156 running (89s) 0s ago 14m 111M 2581M 19.0.0-3126-gd44fddd9 76e77f280c74 9af3ca1ff69b 2024-04-23T14:57:26.044 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi156 running (47s) 0s ago 13m 105M 2581M 19.0.0-3126-gd44fddd9 76e77f280c74 e0a1e784348c 2024-04-23T14:57:26.044 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi156 running (5s) 0s ago 13m 11.1M 2581M 19.0.0-3126-gd44fddd9 76e77f280c74 16b6ba5d9e3e 2024-04-23T14:57:26.044 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (5m) 111s ago 17m 56.0M - 2.43.0 a07b618ecd1d 35558adb166d 2024-04-23T14:57:26.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.045+0000 7fb89f000700 1 -- 172.21.15.81:0/3748655946 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fb87c06ec10 msgr2=0x7fb87c0710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:26.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.045+0000 7fb89f000700 1 --2- 172.21.15.81:0/3748655946 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fb87c06ec10 0x7fb87c0710c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb888004f40 tx=0x7fb88800b040 comp rx=0 tx=0).stop 2024-04-23T14:57:26.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.045+0000 7fb89f000700 1 -- 172.21.15.81:0/3748655946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8981046b0 msgr2=0x7fb898114550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:26.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.045+0000 7fb89f000700 1 --2- 172.21.15.81:0/3748655946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8981046b0 0x7fb898114550 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb884009150 tx=0x7fb884009e30 comp rx=0 tx=0).stop 2024-04-23T14:57:26.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.045+0000 7fb89f000700 1 -- 172.21.15.81:0/3748655946 shutdown_connections 2024-04-23T14:57:26.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.045+0000 7fb89f000700 1 --2- 172.21.15.81:0/3748655946 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fb87c06ec10 0x7fb87c0710c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:26.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.045+0000 7fb89f000700 1 --2- 172.21.15.81:0/3748655946 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb898103400 0x7fb898114010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:26.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.045+0000 7fb89f000700 1 --2- 172.21.15.81:0/3748655946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8981046b0 0x7fb898114550 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:26.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.045+0000 7fb89f000700 1 -- 172.21.15.81:0/3748655946 >> 172.21.15.81:0/3748655946 conn(0x7fb898072590 msgr2=0x7fb898073be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:26.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.045+0000 7fb89f000700 1 -- 172.21.15.81:0/3748655946 shutdown_connections 2024-04-23T14:57:26.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.045+0000 7fb89f000700 1 -- 172.21.15.81:0/3748655946 wait complete. 2024-04-23T14:57:26.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.187+0000 7f7f1d800700 1 -- 172.21.15.81:0/3344166220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f18103420 msgr2=0x7f7f18103830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:26.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.187+0000 7f7f1d800700 1 --2- 172.21.15.81:0/3344166220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f18103420 0x7f7f18103830 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7f08004940 tx=0x7f7f08009e30 comp rx=0 tx=0).stop 2024-04-23T14:57:26.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.187+0000 7f7f1d800700 1 -- 172.21.15.81:0/3344166220 shutdown_connections 2024-04-23T14:57:26.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.187+0000 7f7f1d800700 1 --2- 172.21.15.81:0/3344166220 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7f181046d0 0x7f7f18104b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:26.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.187+0000 7f7f1d800700 1 --2- 172.21.15.81:0/3344166220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f18103420 0x7f7f18103830 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:26.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.187+0000 7f7f1d800700 1 -- 172.21.15.81:0/3344166220 >> 172.21.15.81:0/3344166220 conn(0x7f7f18072640 msgr2=0x7f7f18074a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:26.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.187+0000 7f7f1d800700 1 -- 172.21.15.81:0/3344166220 shutdown_connections 2024-04-23T14:57:26.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.187+0000 7f7f1d800700 1 -- 172.21.15.81:0/3344166220 wait complete. 2024-04-23T14:57:26.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.188+0000 7f7f1d800700 1 Processor -- start 2024-04-23T14:57:26.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.188+0000 7f7f1d800700 1 -- start start 2024-04-23T14:57:26.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.189+0000 7f7f1d800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f18103420 0x7f7f18113ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:26.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.189+0000 7f7f1d800700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7f181046d0 0x7f7f18114420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:26.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.189+0000 7f7f1d800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f18114a20 con 0x7f7f18103420 2024-04-23T14:57:26.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.189+0000 7f7f1d800700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f18114b90 con 0x7f7f181046d0 2024-04-23T14:57:26.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.189+0000 7f7f16a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f18103420 0x7f7f18113ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:26.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.189+0000 7f7f16a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f18103420 0x7f7f18113ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44742/0 (socket says 172.21.15.81:44742) 2024-04-23T14:57:26.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.189+0000 7f7f16a00700 1 -- 172.21.15.81:0/3442876789 learned_addr learned my addr 172.21.15.81:0/3442876789 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:57:26.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.189+0000 7f7f16000700 1 --2- 172.21.15.81:0/3442876789 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7f181046d0 0x7f7f18114420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:26.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.189+0000 7f7f16a00700 1 -- 172.21.15.81:0/3442876789 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7f181046d0 msgr2=0x7f7f18114420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:26.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.189+0000 7f7f16a00700 1 --2- 172.21.15.81:0/3442876789 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7f181046d0 0x7f7f18114420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:26.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.189+0000 7f7f16a00700 1 -- 172.21.15.81:0/3442876789 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f08005040 con 0x7f7f18103420 2024-04-23T14:57:26.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.190+0000 7f7f16a00700 1 --2- 172.21.15.81:0/3442876789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f18103420 0x7f7f18113ee0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7f0800b0d0 tx=0x7f7f08009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:26.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.190+0000 7f7f0ea00700 1 -- 172.21.15.81:0/3442876789 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f0800e070 con 0x7f7f18103420 2024-04-23T14:57:26.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.190+0000 7f7f0ea00700 1 -- 172.21.15.81:0/3442876789 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7f0800b410 con 0x7f7f18103420 2024-04-23T14:57:26.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.190+0000 7f7f1d800700 1 -- 172.21.15.81:0/3442876789 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f18119590 con 0x7f7f18103420 2024-04-23T14:57:26.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.190+0000 7f7f0ea00700 1 -- 172.21.15.81:0/3442876789 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f080125e0 con 0x7f7f18103420 2024-04-23T14:57:26.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.190+0000 7f7f1d800700 1 -- 172.21.15.81:0/3442876789 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f18119b50 con 0x7f7f18103420 2024-04-23T14:57:26.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.191+0000 7f7f1d800700 1 -- 172.21.15.81:0/3442876789 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f1804c710 con 0x7f7f18103420 2024-04-23T14:57:26.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.192+0000 7f7f0ea00700 1 -- 172.21.15.81:0/3442876789 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f7f0800b580 con 0x7f7f18103420 2024-04-23T14:57:26.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.193+0000 7f7f0ea00700 1 --2- 172.21.15.81:0/3442876789 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f7efc06ec00 0x7f7efc0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:26.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.193+0000 7f7f0ea00700 1 -- 172.21.15.81:0/3442876789 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f7f0808f690 con 0x7f7f18103420 2024-04-23T14:57:26.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.193+0000 7f7f16000700 1 --2- 172.21.15.81:0/3442876789 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f7efc06ec00 0x7f7efc0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:26.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.194+0000 7f7f16000700 1 --2- 172.21.15.81:0/3442876789 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f7efc06ec00 0x7f7efc0710b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7f04009b80 tx=0x7f7f0400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:26.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.198+0000 7f7f0ea00700 1 -- 172.21.15.81:0/3442876789 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f7f0805bfa0 con 0x7f7f18103420 2024-04-23T14:57:26.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.509+0000 7f7f1d800700 1 -- 172.21.15.81:0/3442876789 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7f18119fd0 con 0x7f7f18103420 2024-04-23T14:57:26.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.510+0000 7f7f0ea00700 1 -- 172.21.15.81:0/3442876789 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+732 (secure 0 0 0) 0x7f7f0805bb30 con 0x7f7f18103420 2024-04-23T14:57:26.510 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:57:26.510 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-04-23T14:57:26.510 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T14:57:26.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:57:26.510 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-04-23T14:57:26.511 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T14:57:26.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:57:26.511 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-04-23T14:57:26.511 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 5 2024-04-23T14:57:26.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:57:26.511 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-04-23T14:57:26.511 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 4 2024-04-23T14:57:26.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:57:26.511 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-04-23T14:57:26.511 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 4, 2024-04-23T14:57:26.511 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 9 2024-04-23T14:57:26.511 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-23T14:57:26.511 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:57:26.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.512+0000 7f7f1d800700 1 -- 172.21.15.81:0/3442876789 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f7efc06ec00 msgr2=0x7f7efc0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:26.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.512+0000 7f7f1d800700 1 --2- 172.21.15.81:0/3442876789 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f7efc06ec00 0x7f7efc0710b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7f04009b80 tx=0x7f7f0400b040 comp rx=0 tx=0).stop 2024-04-23T14:57:26.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.513+0000 7f7f1d800700 1 -- 172.21.15.81:0/3442876789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f18103420 msgr2=0x7f7f18113ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:26.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.513+0000 7f7f1d800700 1 --2- 172.21.15.81:0/3442876789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f18103420 0x7f7f18113ee0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7f0800b0d0 tx=0x7f7f08009e30 comp rx=0 tx=0).stop 2024-04-23T14:57:26.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.513+0000 7f7f1d800700 1 -- 172.21.15.81:0/3442876789 shutdown_connections 2024-04-23T14:57:26.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.513+0000 7f7f1d800700 1 --2- 172.21.15.81:0/3442876789 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f7efc06ec00 0x7f7efc0710b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:26.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.513+0000 7f7f1d800700 1 --2- 172.21.15.81:0/3442876789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f18103420 0x7f7f18113ee0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:26.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.513+0000 7f7f1d800700 1 --2- 172.21.15.81:0/3442876789 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7f181046d0 0x7f7f18114420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:26.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.513+0000 7f7f1d800700 1 -- 172.21.15.81:0/3442876789 >> 172.21.15.81:0/3442876789 conn(0x7f7f18072640 msgr2=0x7f7f18073cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:26.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.513+0000 7f7f1d800700 1 -- 172.21.15.81:0/3442876789 shutdown_connections 2024-04-23T14:57:26.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.513+0000 7f7f1d800700 1 -- 172.21.15.81:0/3442876789 wait complete. 2024-04-23T14:57:26.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.667+0000 7fb2dbe00700 1 -- 172.21.15.81:0/3429908956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2dc103270 msgr2=0x7fb2dc103680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:26.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.667+0000 7fb2dbe00700 1 --2- 172.21.15.81:0/3429908956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2dc103270 0x7fb2dc103680 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc004940 tx=0x7fb2cc009e30 comp rx=0 tx=0).stop 2024-04-23T14:57:26.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.668+0000 7fb2dbe00700 1 -- 172.21.15.81:0/3429908956 shutdown_connections 2024-04-23T14:57:26.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.668+0000 7fb2dbe00700 1 --2- 172.21.15.81:0/3429908956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2dc104520 0x7fb2dc104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:26.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.668+0000 7fb2dbe00700 1 --2- 172.21.15.81:0/3429908956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2dc103270 0x7fb2dc103680 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.668+0000 7fb2dbe00700 1 -- 172.21.15.81:0/3429908956 >> 172.21.15.81:0/3429908956 conn(0x7fb2dc072530 msgr2=0x7fb2dc074940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.668+0000 7fb2dbe00700 1 -- 172.21.15.81:0/3429908956 shutdown_connections 2024-04-23T14:57:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.668+0000 7fb2dbe00700 1 -- 172.21.15.81:0/3429908956 wait complete. 2024-04-23T14:57:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.668+0000 7fb2dbe00700 1 Processor -- start 2024-04-23T14:57:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.669+0000 7fb2dbe00700 1 -- start start 2024-04-23T14:57:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.669+0000 7fb2dbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2dc103270 0x7fb2dc113e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.669+0000 7fb2dbe00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2dc104520 0x7fb2dc114360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.669+0000 7fb2dbe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2dc115100 con 0x7fb2dc103270 2024-04-23T14:57:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.669+0000 7fb2dbe00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2dc115270 con 0x7fb2dc104520 2024-04-23T14:57:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.669+0000 7fb2daa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2dc103270 0x7fb2dc113e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.669+0000 7fb2daa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2dc103270 0x7fb2dc113e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44760/0 (socket says 172.21.15.81:44760) 2024-04-23T14:57:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.669+0000 7fb2daa00700 1 -- 172.21.15.81:0/3716749117 learned_addr learned my addr 172.21.15.81:0/3716749117 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:57:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.669+0000 7fb2da000700 1 --2- 172.21.15.81:0/3716749117 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2dc104520 0x7fb2dc114360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.670+0000 7fb2daa00700 1 -- 172.21.15.81:0/3716749117 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2dc104520 msgr2=0x7fb2dc114360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.670+0000 7fb2daa00700 1 --2- 172.21.15.81:0/3716749117 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2dc104520 0x7fb2dc114360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.670+0000 7fb2daa00700 1 -- 172.21.15.81:0/3716749117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2cc005040 con 0x7fb2dc103270 2024-04-23T14:57:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.670+0000 7fb2daa00700 1 --2- 172.21.15.81:0/3716749117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2dc103270 0x7fb2dc113e20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc00b0d0 tx=0x7fb2cc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.670+0000 7fb2d2a00700 1 -- 172.21.15.81:0/3716749117 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2cc00e030 con 0x7fb2dc103270 2024-04-23T14:57:26.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.670+0000 7fb2d2a00700 1 -- 172.21.15.81:0/3716749117 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb2cc01c400 con 0x7fb2dc103270 2024-04-23T14:57:26.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.670+0000 7fb2d2a00700 1 -- 172.21.15.81:0/3716749117 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2cc00b630 con 0x7fb2dc103270 2024-04-23T14:57:26.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.670+0000 7fb2dbe00700 1 -- 172.21.15.81:0/3716749117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2dc1154f0 con 0x7fb2dc103270 2024-04-23T14:57:26.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.671+0000 7fb2dbe00700 1 -- 172.21.15.81:0/3716749117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2dc115ab0 con 0x7fb2dc103270 2024-04-23T14:57:26.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.672+0000 7fb2dbe00700 1 -- 172.21.15.81:0/3716749117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2dc10c570 con 0x7fb2dc103270 2024-04-23T14:57:26.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.673+0000 7fb2d2a00700 1 -- 172.21.15.81:0/3716749117 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fb2cc01c570 con 0x7fb2dc103270 2024-04-23T14:57:26.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.673+0000 7fb2d2a00700 1 --2- 172.21.15.81:0/3716749117 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fb2c006ec00 0x7fb2c00710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:26.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.674+0000 7fb2d2a00700 1 -- 172.21.15.81:0/3716749117 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fb2cc090080 con 0x7fb2dc103270 2024-04-23T14:57:26.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.674+0000 7fb2da000700 1 --2- 172.21.15.81:0/3716749117 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fb2c006ec00 0x7fb2c00710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:26.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.674+0000 7fb2da000700 1 --2- 172.21.15.81:0/3716749117 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fb2c006ec00 0x7fb2c00710b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc113bb0 tx=0x7fb2c800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:26.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.679+0000 7fb2d2a00700 1 -- 172.21.15.81:0/3716749117 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fb2cc058ee0 con 0x7fb2dc103270 2024-04-23T14:57:26.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:26 smithi081 ceph-mon[90469]: from='client.34398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:57:26.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:26 smithi081 ceph-mon[90469]: from='client.34402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:57:26.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:26 smithi081 ceph-mon[90469]: Health check update: Degraded data redundancy: 31/222 objects degraded (13.964%), 12 pgs degraded (PG_DEGRADED) 2024-04-23T14:57:26.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:26 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/3442876789' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:57:26.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:26 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:26.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:26 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:57:26.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:26 smithi081 ceph-mon[90469]: from='osd.5 [v2:172.21.15.156:6816/2022300921,v1:172.21.15.156:6817/2022300921]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-23T14:57:26.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:26 smithi081 ceph-mon[90469]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-23T14:57:26.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.950+0000 7fb2dbe00700 1 -- 172.21.15.81:0/3716749117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb2dc115ee0 con 0x7fb2dc103270 2024-04-23T14:57:26.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.951+0000 7fb2d2a00700 1 -- 172.21.15.81:0/3716749117 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1907 (secure 0 0 0) 0x7fb2cc01c820 con 0x7fb2dc103270 2024-04-23T14:57:26.953 INFO:teuthology.orchestra.run.smithi081.stdout:e18 2024-04-23T14:57:26.953 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-23T14:57:26.954 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:57:26.954 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-04-23T14:57:26.954 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:57:26.954 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-04-23T14:57:26.954 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-04-23T14:57:26.954 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 17 2024-04-23T14:57:26.954 INFO:teuthology.orchestra.run.smithi081.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-23T14:57:26.954 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-04-23T14:45:51.264703+0000 2024-04-23T14:57:26.954 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-04-23T14:46:12.782992+0000 2024-04-23T14:57:26.954 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-04-23T14:57:26.954 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-04-23T14:57:26.954 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-04-23T14:57:26.954 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-04-23T14:57:26.954 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-04-23T14:57:26.955 INFO:teuthology.orchestra.run.smithi081.stdout:max_xattr_size 65536 2024-04-23T14:57:26.955 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-04-23T14:57:26.955 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-04-23T14:57:26.955 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 47 2024-04-23T14:57:26.955 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:57:26.955 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 1 2024-04-23T14:57:26.955 INFO:teuthology.orchestra.run.smithi081.stdout:in 0 2024-04-23T14:57:26.955 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=14472} 2024-04-23T14:57:26.955 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-04-23T14:57:26.955 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-04-23T14:57:26.955 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-04-23T14:57:26.955 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-04-23T14:57:26.955 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-04-23T14:57:26.955 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-04-23T14:57:26.955 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-04-23T14:57:26.955 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-04-23T14:57:26.956 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-04-23T14:57:26.956 INFO:teuthology.orchestra.run.smithi081.stdout:qdb_cluster leader: 0 members: 2024-04-23T14:57:26.956 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.vcoywg{0:14472} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.81:6828/2563365650,v1:172.21.15.81:6829/2563365650] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:57:26.956 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.wydgcg{0:14482} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.81:6826/759909104,v1:172.21.15.81:6827/759909104] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:57:26.956 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:57:26.956 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:57:26.956 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-04-23T14:57:26.956 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:57:26.956 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.vynkxn{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.156:6826/1794690362,v1:172.21.15.156:6827/1794690362] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:57:26.956 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.rhbtxt{-1:24263} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.156:6824/3854041261,v1:172.21.15.156:6825/3854041261] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:57:26.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.953+0000 7fb2dbe00700 1 -- 172.21.15.81:0/3716749117 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fb2c006ec00 msgr2=0x7fb2c00710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:26.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.953+0000 7fb2dbe00700 1 --2- 172.21.15.81:0/3716749117 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fb2c006ec00 0x7fb2c00710b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc113bb0 tx=0x7fb2c800b040 comp rx=0 tx=0).stop 2024-04-23T14:57:26.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.953+0000 7fb2dbe00700 1 -- 172.21.15.81:0/3716749117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2dc103270 msgr2=0x7fb2dc113e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:26.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.953+0000 7fb2dbe00700 1 --2- 172.21.15.81:0/3716749117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2dc103270 0x7fb2dc113e20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc00b0d0 tx=0x7fb2cc009e30 comp rx=0 tx=0).stop 2024-04-23T14:57:26.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.953+0000 7fb2dbe00700 1 -- 172.21.15.81:0/3716749117 shutdown_connections 2024-04-23T14:57:26.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.953+0000 7fb2dbe00700 1 --2- 172.21.15.81:0/3716749117 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fb2c006ec00 0x7fb2c00710b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:26.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.953+0000 7fb2dbe00700 1 --2- 172.21.15.81:0/3716749117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2dc103270 0x7fb2dc113e20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:26.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.953+0000 7fb2dbe00700 1 --2- 172.21.15.81:0/3716749117 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2dc104520 0x7fb2dc114360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:26.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.954+0000 7fb2dbe00700 1 -- 172.21.15.81:0/3716749117 >> 172.21.15.81:0/3716749117 conn(0x7fb2dc072530 msgr2=0x7fb2dc074b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:26.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.954+0000 7fb2dbe00700 1 -- 172.21.15.81:0/3716749117 shutdown_connections 2024-04-23T14:57:26.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:26.954+0000 7fb2dbe00700 1 -- 172.21.15.81:0/3716749117 wait complete. 2024-04-23T14:57:26.958 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 18 2024-04-23T14:57:27.036 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:26 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T14:57:26.618+0000 7fa02841f7c0 -1 osd.5 75 log_to_monitors true 2024-04-23T14:57:27.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:26 smithi156 ceph-mon[77738]: from='client.34398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:57:27.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:26 smithi156 ceph-mon[77738]: from='client.34402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:57:27.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:26 smithi156 ceph-mon[77738]: Health check update: Degraded data redundancy: 31/222 objects degraded (13.964%), 12 pgs degraded (PG_DEGRADED) 2024-04-23T14:57:27.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:26 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/3442876789' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:57:27.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:26 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:27.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:26 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:57:27.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:26 smithi156 ceph-mon[77738]: from='osd.5 [v2:172.21.15.156:6816/2022300921,v1:172.21.15.156:6817/2022300921]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-23T14:57:27.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:26 smithi156 ceph-mon[77738]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-23T14:57:27.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.109+0000 7fc4aaa00700 1 -- 172.21.15.81:0/3924155372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a40ffd30 msgr2=0x7fc4a4102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:27.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.109+0000 7fc4aaa00700 1 --2- 172.21.15.81:0/3924155372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a40ffd30 0x7fc4a4102150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc490004940 tx=0x7fc490009e30 comp rx=0 tx=0).stop 2024-04-23T14:57:27.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.109+0000 7fc4aaa00700 1 -- 172.21.15.81:0/3924155372 shutdown_connections 2024-04-23T14:57:27.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.109+0000 7fc4aaa00700 1 --2- 172.21.15.81:0/3924155372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a40ffd30 0x7fc4a4102150 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:27.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.109+0000 7fc4aaa00700 1 --2- 172.21.15.81:0/3924155372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4a4066b80 0x7fc4a40ff7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:27.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.109+0000 7fc4aaa00700 1 -- 172.21.15.81:0/3924155372 >> 172.21.15.81:0/3924155372 conn(0x7fc4a40f7280 msgr2=0x7fc4a40f9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:27.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.109+0000 7fc4aaa00700 1 -- 172.21.15.81:0/3924155372 shutdown_connections 2024-04-23T14:57:27.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.109+0000 7fc4aaa00700 1 -- 172.21.15.81:0/3924155372 wait complete. 2024-04-23T14:57:27.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.110+0000 7fc4aaa00700 1 Processor -- start 2024-04-23T14:57:27.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.110+0000 7fc4aaa00700 1 -- start start 2024-04-23T14:57:27.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.110+0000 7fc4aaa00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4a4066b80 0x7fc4a410fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:27.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.111+0000 7fc4aaa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a40ffd30 0x7fc4a410ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:27.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.111+0000 7fc4aaa00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a4110590 con 0x7fc4a40ffd30 2024-04-23T14:57:27.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.111+0000 7fc4aaa00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a4110d90 con 0x7fc4a4066b80 2024-04-23T14:57:27.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.111+0000 7fc4a8c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a40ffd30 0x7fc4a410ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:27.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.111+0000 7fc4a8c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a40ffd30 0x7fc4a410ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44776/0 (socket says 172.21.15.81:44776) 2024-04-23T14:57:27.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.111+0000 7fc4a8c00700 1 -- 172.21.15.81:0/292415560 learned_addr learned my addr 172.21.15.81:0/292415560 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:57:27.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.111+0000 7fc4a9600700 1 --2- 172.21.15.81:0/292415560 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4a4066b80 0x7fc4a410fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:27.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.111+0000 7fc4a8c00700 1 -- 172.21.15.81:0/292415560 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4a4066b80 msgr2=0x7fc4a410fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:27.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.111+0000 7fc4a8c00700 1 --2- 172.21.15.81:0/292415560 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4a4066b80 0x7fc4a410fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:27.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.111+0000 7fc4a8c00700 1 -- 172.21.15.81:0/292415560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc490005040 con 0x7fc4a40ffd30 2024-04-23T14:57:27.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.112+0000 7fc4a8c00700 1 --2- 172.21.15.81:0/292415560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a40ffd30 0x7fc4a410ff90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc49000b3b0 tx=0x7fc490009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:27.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.112+0000 7fc4a1600700 1 -- 172.21.15.81:0/292415560 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc49000e040 con 0x7fc4a40ffd30 2024-04-23T14:57:27.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.112+0000 7fc4a1600700 1 -- 172.21.15.81:0/292415560 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc49000bbf0 con 0x7fc4a40ffd30 2024-04-23T14:57:27.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.112+0000 7fc4a1600700 1 -- 172.21.15.81:0/292415560 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc49001c630 con 0x7fc4a40ffd30 2024-04-23T14:57:27.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.112+0000 7fc4aaa00700 1 -- 172.21.15.81:0/292415560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4a4111010 con 0x7fc4a40ffd30 2024-04-23T14:57:27.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.112+0000 7fc4aaa00700 1 -- 172.21.15.81:0/292415560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a4111550 con 0x7fc4a40ffd30 2024-04-23T14:57:27.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.113+0000 7fc4aaa00700 1 -- 172.21.15.81:0/292415560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4a405f5f0 con 0x7fc4a40ffd30 2024-04-23T14:57:27.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.114+0000 7fc4a1600700 1 -- 172.21.15.81:0/292415560 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fc49000bd60 con 0x7fc4a40ffd30 2024-04-23T14:57:27.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.115+0000 7fc4a1600700 1 --2- 172.21.15.81:0/292415560 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc48c06ec00 0x7fc48c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:27.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.115+0000 7fc4a1600700 1 -- 172.21.15.81:0/292415560 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fc49008f400 con 0x7fc4a40ffd30 2024-04-23T14:57:27.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.115+0000 7fc4a9600700 1 --2- 172.21.15.81:0/292415560 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc48c06ec00 0x7fc48c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:27.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.116+0000 7fc4a9600700 1 --2- 172.21.15.81:0/292415560 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc48c06ec00 0x7fc48c0710b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc4a40668c0 tx=0x7fc49800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:27.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.120+0000 7fc4a1600700 1 -- 172.21.15.81:0/292415560 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fc49005bdb0 con 0x7fc4a40ffd30 2024-04-23T14:57:27.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.386+0000 7fc4aaa00700 1 -- 172.21.15.81:0/292415560 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc4a41118a0 con 0x7fc48c06ec00 2024-04-23T14:57:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.389+0000 7fc4a1600700 1 -- 172.21.15.81:0/292415560 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc4a41118a0 con 0x7fc48c06ec00 2024-04-23T14:57:27.389 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:57:27.389 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd", 2024-04-23T14:57:27.390 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-04-23T14:57:27.390 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-23T14:57:27.390 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [ 2024-04-23T14:57:27.390 INFO:teuthology.orchestra.run.smithi081.stdout: "mon", 2024-04-23T14:57:27.390 INFO:teuthology.orchestra.run.smithi081.stdout: "osd", 2024-04-23T14:57:27.390 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-04-23T14:57:27.390 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr" 2024-04-23T14:57:27.390 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-04-23T14:57:27.390 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "12/21 daemons upgraded", 2024-04-23T14:57:27.390 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "Currently upgrading osd daemons", 2024-04-23T14:57:27.390 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-04-23T14:57:27.390 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:57:27.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.392+0000 7fc4aaa00700 1 -- 172.21.15.81:0/292415560 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc48c06ec00 msgr2=0x7fc48c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:27.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.392+0000 7fc4aaa00700 1 --2- 172.21.15.81:0/292415560 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc48c06ec00 0x7fc48c0710b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc4a40668c0 tx=0x7fc49800b040 comp rx=0 tx=0).stop 2024-04-23T14:57:27.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.392+0000 7fc4aaa00700 1 -- 172.21.15.81:0/292415560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a40ffd30 msgr2=0x7fc4a410ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:27.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.392+0000 7fc4aaa00700 1 --2- 172.21.15.81:0/292415560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a40ffd30 0x7fc4a410ff90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc49000b3b0 tx=0x7fc490009e30 comp rx=0 tx=0).stop 2024-04-23T14:57:27.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.392+0000 7fc4aaa00700 1 -- 172.21.15.81:0/292415560 shutdown_connections 2024-04-23T14:57:27.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.392+0000 7fc4aaa00700 1 --2- 172.21.15.81:0/292415560 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc48c06ec00 0x7fc48c0710b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:27.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.392+0000 7fc4aaa00700 1 --2- 172.21.15.81:0/292415560 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4a4066b80 0x7fc4a410fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:27.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.392+0000 7fc4aaa00700 1 --2- 172.21.15.81:0/292415560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a40ffd30 0x7fc4a410ff90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:27.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.392+0000 7fc4aaa00700 1 -- 172.21.15.81:0/292415560 >> 172.21.15.81:0/292415560 conn(0x7fc4a40f7280 msgr2=0x7fc4a40fb890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:27.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.392+0000 7fc4aaa00700 1 -- 172.21.15.81:0/292415560 shutdown_connections 2024-04-23T14:57:27.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.393+0000 7fc4aaa00700 1 -- 172.21.15.81:0/292415560 wait complete. 2024-04-23T14:57:27.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.546+0000 7fbffe200700 1 -- 172.21.15.81:0/3969024473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbff80fe0e0 msgr2=0x7fbff80fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:27.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.546+0000 7fbffe200700 1 --2- 172.21.15.81:0/3969024473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbff80fe0e0 0x7fbff80fe550 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0004940 tx=0x7fbfe0009e30 comp rx=0 tx=0).stop 2024-04-23T14:57:27.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.547+0000 7fbffe200700 1 -- 172.21.15.81:0/3969024473 shutdown_connections 2024-04-23T14:57:27.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.547+0000 7fbffe200700 1 --2- 172.21.15.81:0/3969024473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbff80fe0e0 0x7fbff80fe550 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:27.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.547+0000 7fbffe200700 1 --2- 172.21.15.81:0/3969024473 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbff80fcef0 0x7fbff80fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:27.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.547+0000 7fbffe200700 1 -- 172.21.15.81:0/3969024473 >> 172.21.15.81:0/3969024473 conn(0x7fbff80f8530 msgr2=0x7fbff80fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:27.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.547+0000 7fbffe200700 1 -- 172.21.15.81:0/3969024473 shutdown_connections 2024-04-23T14:57:27.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.547+0000 7fbffe200700 1 -- 172.21.15.81:0/3969024473 wait complete. 2024-04-23T14:57:27.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.548+0000 7fbffe200700 1 Processor -- start 2024-04-23T14:57:27.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.548+0000 7fbffe200700 1 -- start start 2024-04-23T14:57:27.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.548+0000 7fbffe200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbff80fcef0 0x7fbff810d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:27.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.548+0000 7fbffe200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbff80fe0e0 0x7fbff810df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:27.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.548+0000 7fbffe200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff810e500 con 0x7fbff80fe0e0 2024-04-23T14:57:27.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.548+0000 7fbffe200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff810ed50 con 0x7fbff80fcef0 2024-04-23T14:57:27.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.548+0000 7fbfefe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbff80fe0e0 0x7fbff810df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:27.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.548+0000 7fbfefe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbff80fe0e0 0x7fbff810df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44788/0 (socket says 172.21.15.81:44788) 2024-04-23T14:57:27.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.548+0000 7fbfefe00700 1 -- 172.21.15.81:0/831198848 learned_addr learned my addr 172.21.15.81:0/831198848 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:57:27.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.549+0000 7fbff7400700 1 --2- 172.21.15.81:0/831198848 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbff80fcef0 0x7fbff810d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:27.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.549+0000 7fbfefe00700 1 -- 172.21.15.81:0/831198848 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbff80fcef0 msgr2=0x7fbff810d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:27.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.549+0000 7fbfefe00700 1 --2- 172.21.15.81:0/831198848 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbff80fcef0 0x7fbff810d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:27.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.549+0000 7fbfefe00700 1 -- 172.21.15.81:0/831198848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe0005040 con 0x7fbff80fe0e0 2024-04-23T14:57:27.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.549+0000 7fbfefe00700 1 --2- 172.21.15.81:0/831198848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbff80fe0e0 0x7fbff810df00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbfe000b0d0 tx=0x7fbfe0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:27.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.549+0000 7fbfef400700 1 -- 172.21.15.81:0/831198848 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfe000e070 con 0x7fbff80fe0e0 2024-04-23T14:57:27.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.549+0000 7fbfef400700 1 -- 172.21.15.81:0/831198848 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbfe001d460 con 0x7fbff80fe0e0 2024-04-23T14:57:27.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.549+0000 7fbffe200700 1 -- 172.21.15.81:0/831198848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbff810efd0 con 0x7fbff80fe0e0 2024-04-23T14:57:27.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.550+0000 7fbfef400700 1 -- 172.21.15.81:0/831198848 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfe000b610 con 0x7fbff80fe0e0 2024-04-23T14:57:27.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.550+0000 7fbffe200700 1 -- 172.21.15.81:0/831198848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff810f510 con 0x7fbff80fe0e0 2024-04-23T14:57:27.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.551+0000 7fbffe200700 1 -- 172.21.15.81:0/831198848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbff805f5f0 con 0x7fbff80fe0e0 2024-04-23T14:57:27.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.552+0000 7fbfef400700 1 -- 172.21.15.81:0/831198848 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fbfe001d5d0 con 0x7fbff80fe0e0 2024-04-23T14:57:27.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.553+0000 7fbfef400700 1 --2- 172.21.15.81:0/831198848 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fbfdc06ec10 0x7fbfdc0710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:27.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.553+0000 7fbfef400700 1 -- 172.21.15.81:0/831198848 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fbfe008f650 con 0x7fbff80fe0e0 2024-04-23T14:57:27.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.553+0000 7fbff7400700 1 --2- 172.21.15.81:0/831198848 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fbfdc06ec10 0x7fbfdc0710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:27.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.554+0000 7fbff7400700 1 --2- 172.21.15.81:0/831198848 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fbfdc06ec10 0x7fbfdc0710c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8009b80 tx=0x7fbfe800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:27.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.558+0000 7fbfef400700 1 -- 172.21.15.81:0/831198848 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fbfe005c150 con 0x7fbff80fe0e0 2024-04-23T14:57:27.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.878+0000 7fbffe200700 1 -- 172.21.15.81:0/831198848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fbff804bed0 con 0x7fbff80fe0e0 2024-04-23T14:57:27.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.878+0000 7fbfef400700 1 -- 172.21.15.81:0/831198848 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1179 (secure 0 0 0) 0x7fbfe005bce0 con 0x7fbff80fe0e0 2024-04-23T14:57:27.879 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_WARN 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Degraded data redundancy: 31/222 objects degraded (13.964%), 12 pgs degraded 2024-04-23T14:57:27.879 INFO:teuthology.orchestra.run.smithi081.stdout:[WRN] OSD_DOWN: 1 osds down 2024-04-23T14:57:27.879 INFO:teuthology.orchestra.run.smithi081.stdout: osd.5 (root=default,host=smithi156) is down 2024-04-23T14:57:27.879 INFO:teuthology.orchestra.run.smithi081.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-04-23T14:57:27.879 INFO:teuthology.orchestra.run.smithi081.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-04-23T14:57:27.879 INFO:teuthology.orchestra.run.smithi081.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 31/222 objects degraded (13.964%), 12 pgs degraded 2024-04-23T14:57:27.879 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.2 is active+undersized+degraded, acting [1,0] 2024-04-23T14:57:27.879 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.3 is active+undersized+degraded, acting [2,1] 2024-04-23T14:57:27.879 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.b is active+undersized+degraded, acting [3,4] 2024-04-23T14:57:27.880 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.f is active+undersized+degraded, acting [4,0] 2024-04-23T14:57:27.880 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.14 is active+undersized+degraded, acting [3,4] 2024-04-23T14:57:27.880 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.16 is active+undersized+degraded, acting [3,2] 2024-04-23T14:57:27.880 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.18 is active+undersized+degraded, acting [4,3] 2024-04-23T14:57:27.880 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.1a is active+undersized+degraded, acting [3,4] 2024-04-23T14:57:27.880 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.1b is active+undersized+degraded, acting [1,0] 2024-04-23T14:57:27.880 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.1c is active+undersized+degraded, acting [4,2] 2024-04-23T14:57:27.880 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.1d is active+undersized+degraded, acting [3,0] 2024-04-23T14:57:27.880 INFO:teuthology.orchestra.run.smithi081.stdout: pg 2.1e is active+undersized+degraded, acting [2,0] 2024-04-23T14:57:27.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.881+0000 7fbffe200700 1 -- 172.21.15.81:0/831198848 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fbfdc06ec10 msgr2=0x7fbfdc0710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:27.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.881+0000 7fbffe200700 1 --2- 172.21.15.81:0/831198848 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fbfdc06ec10 0x7fbfdc0710c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8009b80 tx=0x7fbfe800b040 comp rx=0 tx=0).stop 2024-04-23T14:57:27.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.881+0000 7fbffe200700 1 -- 172.21.15.81:0/831198848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbff80fe0e0 msgr2=0x7fbff810df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:27.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.881+0000 7fbffe200700 1 --2- 172.21.15.81:0/831198848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbff80fe0e0 0x7fbff810df00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbfe000b0d0 tx=0x7fbfe0009e30 comp rx=0 tx=0).stop 2024-04-23T14:57:27.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.881+0000 7fbffe200700 1 -- 172.21.15.81:0/831198848 shutdown_connections 2024-04-23T14:57:27.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.881+0000 7fbffe200700 1 --2- 172.21.15.81:0/831198848 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fbfdc06ec10 0x7fbfdc0710c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:27.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.881+0000 7fbffe200700 1 --2- 172.21.15.81:0/831198848 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbff80fcef0 0x7fbff810d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:27.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.881+0000 7fbffe200700 1 --2- 172.21.15.81:0/831198848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbff80fe0e0 0x7fbff810df00 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:27.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.882+0000 7fbffe200700 1 -- 172.21.15.81:0/831198848 >> 172.21.15.81:0/831198848 conn(0x7fbff80f8530 msgr2=0x7fbff80f9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:27.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.882+0000 7fbffe200700 1 -- 172.21.15.81:0/831198848 shutdown_connections 2024-04-23T14:57:27.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:27.882+0000 7fbffe200700 1 -- 172.21.15.81:0/831198848 wait complete. 2024-04-23T14:57:28.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:27 smithi156 ceph-mon[77738]: from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:57:28.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:27 smithi156 ceph-mon[77738]: pgmap v180: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-04-23T14:57:28.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:27 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/3716749117' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:57:28.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:27 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:28.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:27 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:28.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:27 smithi156 ceph-mon[77738]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-23T14:57:28.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:27 smithi156 ceph-mon[77738]: osdmap e78: 6 total, 5 up, 6 in 2024-04-23T14:57:28.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:27 smithi156 ceph-mon[77738]: from='osd.5 [v2:172.21.15.156:6816/2022300921,v1:172.21.15.156:6817/2022300921]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-23T14:57:28.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:27 smithi156 ceph-mon[77738]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-23T14:57:28.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:27 smithi081 ceph-mon[90469]: from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:57:28.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:27 smithi081 ceph-mon[90469]: pgmap v180: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-04-23T14:57:28.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:27 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/3716749117' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:57:28.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:27 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:28.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:27 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:28.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:27 smithi081 ceph-mon[90469]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-23T14:57:28.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:27 smithi081 ceph-mon[90469]: osdmap e78: 6 total, 5 up, 6 in 2024-04-23T14:57:28.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:27 smithi081 ceph-mon[90469]: from='osd.5 [v2:172.21.15.156:6816/2022300921,v1:172.21.15.156:6817/2022300921]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-23T14:57:28.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:27 smithi081 ceph-mon[90469]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-23T14:57:29.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:28 smithi156 ceph-mon[77738]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:57:29.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:28 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/831198848' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:57:29.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:28 smithi156 ceph-mon[77738]: from='osd.5 ' entity='osd.5' 2024-04-23T14:57:29.037 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 14:57:28 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T14:57:28.635+0000 7fa012800700 -1 osd.5 75 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T14:57:29.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:28 smithi081 ceph-mon[90469]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:57:29.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:28 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/831198848' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:57:29.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:28 smithi081 ceph-mon[90469]: from='osd.5 ' entity='osd.5' 2024-04-23T14:57:29.938 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:29 smithi156 ceph-mon[77738]: pgmap v182: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 197 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-04-23T14:57:29.938 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:29 smithi156 ceph-mon[77738]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-23T14:57:30.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:29 smithi081 ceph-mon[90469]: pgmap v182: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 197 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-04-23T14:57:30.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:29 smithi081 ceph-mon[90469]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-23T14:57:31.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:30 smithi156 ceph-mon[77738]: osd.5 [v2:172.21.15.156:6816/2022300921,v1:172.21.15.156:6817/2022300921] boot 2024-04-23T14:57:31.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:30 smithi156 ceph-mon[77738]: osdmap e79: 6 total, 6 up, 6 in 2024-04-23T14:57:31.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:30 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T14:57:31.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:30 smithi156 ceph-mon[77738]: osdmap e80: 6 total, 6 up, 6 in 2024-04-23T14:57:31.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:30 smithi081 ceph-mon[90469]: osd.5 [v2:172.21.15.156:6816/2022300921,v1:172.21.15.156:6817/2022300921] boot 2024-04-23T14:57:31.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:30 smithi081 ceph-mon[90469]: osdmap e79: 6 total, 6 up, 6 in 2024-04-23T14:57:31.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:30 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T14:57:31.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:30 smithi081 ceph-mon[90469]: osdmap e80: 6 total, 6 up, 6 in 2024-04-23T14:57:32.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:31 smithi156 ceph-mon[77738]: pgmap v184: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 197 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 31/222 objects degraded (13.964%) 2024-04-23T14:57:32.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:31 smithi081 ceph-mon[90469]: pgmap v184: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 197 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 31/222 objects degraded (13.964%) 2024-04-23T14:57:33.828 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:33.828 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:33.828 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:57:33.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:57:33.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:33.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:33 smithi081 ceph-mon[90469]: pgmap v186: 65 pgs: 10 active+undersized+degraded, 14 active+undersized, 41 active+clean; 197 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 28/222 objects degraded (12.613%) 2024-04-23T14:57:33.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:57:33.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:57:33.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:57:33.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:57:33.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:57:33.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:33.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-04-23T14:57:33.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-04-23T14:57:33.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-04-23T14:57:33.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-04-23T14:57:33.829 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-04-23T14:57:33.830 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-04-23T14:57:33.830 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-04-23T14:57:33.830 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-04-23T14:57:33.830 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-04-23T14:57:33.830 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-04-23T14:57:33.830 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-04-23T14:57:33.830 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-04-23T14:57:33.830 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-04-23T14:57:34.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:34.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:34.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:57:34.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:57:34.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:34.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:33 smithi156 ceph-mon[77738]: pgmap v186: 65 pgs: 10 active+undersized+degraded, 14 active+undersized, 41 active+clean; 197 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 28/222 objects degraded (12.613%) 2024-04-23T14:57:34.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:57:34.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:57:34.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:57:34.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:57:34.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:57:34.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:34.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-04-23T14:57:34.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-04-23T14:57:34.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-04-23T14:57:34.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-04-23T14:57:34.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-04-23T14:57:34.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-04-23T14:57:34.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-04-23T14:57:34.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-04-23T14:57:34.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-04-23T14:57:34.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-04-23T14:57:34.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-04-23T14:57:34.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-04-23T14:57:34.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-04-23T14:57:34.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:34 smithi081 ceph-mon[90469]: Upgrade: Setting container_image for all osd 2024-04-23T14:57:34.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:34 smithi081 ceph-mon[90469]: Upgrade: Setting require_osd_release to 19 squid 2024-04-23T14:57:34.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:34 smithi081 ceph-mon[90469]: Health check update: Degraded data redundancy: 28/222 objects degraded (12.613%), 10 pgs degraded (PG_DEGRADED) 2024-04-23T14:57:34.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:34 smithi081 ceph-mon[90469]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-04-23T14:57:34.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:34 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-04-23T14:57:34.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:34 smithi081 ceph-mon[90469]: osdmap e81: 6 total, 6 up, 6 in 2024-04-23T14:57:34.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:34 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:34.828 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:34 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-04-23T14:57:35.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:34 smithi156 ceph-mon[77738]: Upgrade: Setting container_image for all osd 2024-04-23T14:57:35.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:34 smithi156 ceph-mon[77738]: Upgrade: Setting require_osd_release to 19 squid 2024-04-23T14:57:35.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:34 smithi156 ceph-mon[77738]: Health check update: Degraded data redundancy: 28/222 objects degraded (12.613%), 10 pgs degraded (PG_DEGRADED) 2024-04-23T14:57:35.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:34 smithi156 ceph-mon[77738]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-04-23T14:57:35.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:34 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-04-23T14:57:35.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:34 smithi156 ceph-mon[77738]: osdmap e81: 6 total, 6 up, 6 in 2024-04-23T14:57:35.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:34 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:35.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:34 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-04-23T14:57:35.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:35 smithi081 ceph-mon[90469]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-04-23T14:57:35.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:35 smithi081 ceph-mon[90469]: osdmap e82: 6 total, 6 up, 6 in 2024-04-23T14:57:35.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:35 smithi081 ceph-mon[90469]: pgmap v189: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:57:35.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:35 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-04-23T14:57:35.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:35 smithi081 ceph-mon[90469]: fsmap cephfs:1 {0=cephfs.smithi081.vcoywg=up:active} 2 up:standby 2024-04-23T14:57:35.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:35 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:57:35.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:35 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:57:35.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:35 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:57:35.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:35 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:35.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:35 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:57:35.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:35 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:57:35.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:35 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:57:35.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:35 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:57:35.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:35 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:57:35.828 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:35 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi081.wydgcg"]}]: dispatch 2024-04-23T14:57:36.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:35 smithi156 ceph-mon[77738]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-04-23T14:57:36.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:35 smithi156 ceph-mon[77738]: osdmap e82: 6 total, 6 up, 6 in 2024-04-23T14:57:36.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:35 smithi156 ceph-mon[77738]: pgmap v189: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:57:36.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:35 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-04-23T14:57:36.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:35 smithi156 ceph-mon[77738]: fsmap cephfs:1 {0=cephfs.smithi081.vcoywg=up:active} 2 up:standby 2024-04-23T14:57:36.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:35 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:57:36.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:35 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:57:36.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:35 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:57:36.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:35 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:36.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:35 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:57:36.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:35 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:57:36.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:35 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:57:36.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:35 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:57:36.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:35 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:57:36.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:35 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi081.wydgcg"]}]: dispatch 2024-04-23T14:57:36.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:36 smithi081 ceph-mon[90469]: Upgrade: It appears safe to stop mds.cephfs.smithi081.wydgcg 2024-04-23T14:57:36.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:36 smithi081 ceph-mon[90469]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/222 objects degraded (12.613%), 10 pgs degraded) 2024-04-23T14:57:36.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:36 smithi081 ceph-mon[90469]: Cluster is now healthy 2024-04-23T14:57:36.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:36 smithi081 ceph-mon[90469]: mds.? [v2:172.21.15.81:6826/2886286299,v1:172.21.15.81:6827/2886286299] up:boot 2024-04-23T14:57:36.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:36 smithi081 ceph-mon[90469]: fsmap cephfs:1 {0=cephfs.smithi081.vcoywg=up:active} 3 up:standby 2024-04-23T14:57:36.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:36 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi081.wydgcg"}]: dispatch 2024-04-23T14:57:37.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:36 smithi156 ceph-mon[77738]: Upgrade: It appears safe to stop mds.cephfs.smithi081.wydgcg 2024-04-23T14:57:37.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:36 smithi156 ceph-mon[77738]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/222 objects degraded (12.613%), 10 pgs degraded) 2024-04-23T14:57:37.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:36 smithi156 ceph-mon[77738]: Cluster is now healthy 2024-04-23T14:57:37.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:36 smithi156 ceph-mon[77738]: mds.? [v2:172.21.15.81:6826/2886286299,v1:172.21.15.81:6827/2886286299] up:boot 2024-04-23T14:57:37.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:36 smithi156 ceph-mon[77738]: fsmap cephfs:1 {0=cephfs.smithi081.vcoywg=up:active} 3 up:standby 2024-04-23T14:57:37.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:36 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi081.wydgcg"}]: dispatch 2024-04-23T14:57:37.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:37 smithi081 ceph-mon[90469]: pgmap v190: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:57:38.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:37 smithi156 ceph-mon[77738]: pgmap v190: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:57:38.765 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:38 smithi081 ceph-mon[90469]: Upgrade: Updating mds.cephfs.smithi081.wydgcg 2024-04-23T14:57:38.765 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:38 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:38.765 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:38 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi081.wydgcg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:57:38.765 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:38 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:57:38.765 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:38 smithi081 ceph-mon[90469]: Deploying daemon mds.cephfs.smithi081.wydgcg on smithi081 2024-04-23T14:57:39.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:38 smithi156 ceph-mon[77738]: Upgrade: Updating mds.cephfs.smithi081.wydgcg 2024-04-23T14:57:39.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:38 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:39.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:38 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi081.wydgcg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:57:39.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:38 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:57:39.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:38 smithi156 ceph-mon[77738]: Deploying daemon mds.cephfs.smithi081.wydgcg on smithi081 2024-04-23T14:57:40.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:39 smithi156 ceph-mon[77738]: pgmap v191: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:57:40.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:39 smithi081 ceph-mon[90469]: pgmap v191: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:57:42.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:41 smithi156 ceph-mon[77738]: pgmap v192: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:57:42.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:41 smithi156 ceph-mon[77738]: osdmap e83: 6 total, 6 up, 6 in 2024-04-23T14:57:42.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:41 smithi156 ceph-mon[77738]: fsmap cephfs:1 {0=cephfs.smithi081.vcoywg=up:active} 2 up:standby 2024-04-23T14:57:42.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:41 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi081.wydgcg"}]: dispatch 2024-04-23T14:57:42.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:41 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:42.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:41 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:57:42.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:41 smithi081 ceph-mon[90469]: pgmap v192: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:57:42.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:41 smithi081 ceph-mon[90469]: osdmap e83: 6 total, 6 up, 6 in 2024-04-23T14:57:42.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:41 smithi081 ceph-mon[90469]: fsmap cephfs:1 {0=cephfs.smithi081.vcoywg=up:active} 2 up:standby 2024-04-23T14:57:42.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:41 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi081.wydgcg"}]: dispatch 2024-04-23T14:57:42.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:41 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:42.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:41 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:57:43.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:42 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:43.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:42 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:43.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:43 smithi081 ceph-mon[90469]: pgmap v194: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 127 B/s rd, 0 op/s 2024-04-23T14:57:44.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:43 smithi156 ceph-mon[77738]: pgmap v194: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 127 B/s rd, 0 op/s 2024-04-23T14:57:45.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:45 smithi081 ceph-mon[90469]: pgmap v195: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 102 B/s rd, 0 op/s 2024-04-23T14:57:45.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:45 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:45.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:45 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:46.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:45 smithi156 ceph-mon[77738]: pgmap v195: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 102 B/s rd, 0 op/s 2024-04-23T14:57:46.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:45 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:46.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:45 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:47.016 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:46 smithi081 ceph-mon[90469]: mds.? [v2:172.21.15.81:6826/3200953351,v1:172.21.15.81:6827/3200953351] up:boot 2024-04-23T14:57:47.016 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:46 smithi081 ceph-mon[90469]: fsmap cephfs:1 {0=cephfs.smithi081.vcoywg=up:active} 3 up:standby 2024-04-23T14:57:47.016 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:46 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi081.wydgcg"}]: dispatch 2024-04-23T14:57:47.016 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:46 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:57:47.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:46 smithi156 ceph-mon[77738]: mds.? [v2:172.21.15.81:6826/3200953351,v1:172.21.15.81:6827/3200953351] up:boot 2024-04-23T14:57:47.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:46 smithi156 ceph-mon[77738]: fsmap cephfs:1 {0=cephfs.smithi081.vcoywg=up:active} 3 up:standby 2024-04-23T14:57:47.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:46 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi081.wydgcg"}]: dispatch 2024-04-23T14:57:47.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:46 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:57:47.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:47 smithi081 ceph-mon[90469]: pgmap v196: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 102 B/s rd, 0 op/s 2024-04-23T14:57:48.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:47 smithi156 ceph-mon[77738]: pgmap v196: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 102 B/s rd, 0 op/s 2024-04-23T14:57:50.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:49 smithi156 ceph-mon[77738]: pgmap v197: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 102 B/s rd, 0 op/s 2024-04-23T14:57:50.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:49 smithi081 ceph-mon[90469]: pgmap v197: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 102 B/s rd, 0 op/s 2024-04-23T14:57:52.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:51 smithi156 ceph-mon[77738]: pgmap v198: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:57:52.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:51 smithi081 ceph-mon[90469]: pgmap v198: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:57:54.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:53 smithi156 ceph-mon[77738]: pgmap v199: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:57:54.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:53 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:54.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:53 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:54.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:53 smithi081 ceph-mon[90469]: pgmap v199: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:57:54.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:53 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:54.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:53 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:56.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:55 smithi156 ceph-mon[77738]: pgmap v200: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:57:56.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:55 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:56.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:55 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:56.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:55 smithi081 ceph-mon[90469]: pgmap v200: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:57:56.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:55 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:56.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:55 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:57:56.960 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:56 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:57:56.960 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:56 smithi081 ceph-mon[90469]: pgmap v201: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:57:57.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:56 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:57:57.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:56 smithi156 ceph-mon[77738]: pgmap v201: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:57:58.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.041+0000 7f179ee00700 1 -- 172.21.15.81:0/2830836102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17980fcef0 msgr2=0x7f17980fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:58.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.041+0000 7f179ee00700 1 --2- 172.21.15.81:0/2830836102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17980fcef0 0x7f17980fd320 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1788004940 tx=0x7f1788009e30 comp rx=0 tx=0).stop 2024-04-23T14:57:58.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.042+0000 7f179ee00700 1 -- 172.21.15.81:0/2830836102 shutdown_connections 2024-04-23T14:57:58.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.042+0000 7f179ee00700 1 --2- 172.21.15.81:0/2830836102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17980fe0e0 0x7f17980fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:58.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.042+0000 7f179ee00700 1 --2- 172.21.15.81:0/2830836102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17980fcef0 0x7f17980fd320 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:58.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.042+0000 7f179ee00700 1 -- 172.21.15.81:0/2830836102 >> 172.21.15.81:0/2830836102 conn(0x7f17980f8530 msgr2=0x7f17980fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:58.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.042+0000 7f179ee00700 1 -- 172.21.15.81:0/2830836102 shutdown_connections 2024-04-23T14:57:58.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.042+0000 7f179ee00700 1 -- 172.21.15.81:0/2830836102 wait complete. 2024-04-23T14:57:58.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.043+0000 7f179ee00700 1 Processor -- start 2024-04-23T14:57:58.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.043+0000 7f179ee00700 1 -- start start 2024-04-23T14:57:58.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.043+0000 7f179ee00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17980fcef0 0x7f179810fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:58.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.043+0000 7f179ee00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17980fe0e0 0x7f1798110180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:58.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.043+0000 7f179ee00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1798110810 con 0x7f17980fe0e0 2024-04-23T14:57:58.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.043+0000 7f179ee00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1798111000 con 0x7f17980fcef0 2024-04-23T14:57:58.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.044+0000 7f1797400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17980fe0e0 0x7f1798110180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:58.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.044+0000 7f1797400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17980fe0e0 0x7f1798110180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40544/0 (socket says 172.21.15.81:40544) 2024-04-23T14:57:58.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.044+0000 7f1797400700 1 -- 172.21.15.81:0/2957060772 learned_addr learned my addr 172.21.15.81:0/2957060772 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:57:58.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.044+0000 7f1797e00700 1 --2- 172.21.15.81:0/2957060772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17980fcef0 0x7f179810fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:58.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.044+0000 7f1797400700 1 -- 172.21.15.81:0/2957060772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17980fcef0 msgr2=0x7f179810fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:58.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.044+0000 7f1797400700 1 --2- 172.21.15.81:0/2957060772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17980fcef0 0x7f179810fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:58.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.044+0000 7f1797400700 1 -- 172.21.15.81:0/2957060772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1788005040 con 0x7f17980fe0e0 2024-04-23T14:57:58.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.045+0000 7f1797400700 1 --2- 172.21.15.81:0/2957060772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17980fe0e0 0x7f1798110180 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f178400b790 tx=0x7f1784009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:58.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.045+0000 7f178fe00700 1 -- 172.21.15.81:0/2957060772 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f178400f770 con 0x7f17980fe0e0 2024-04-23T14:57:58.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.045+0000 7f179ee00700 1 -- 172.21.15.81:0/2957060772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17981112e0 con 0x7f17980fe0e0 2024-04-23T14:57:58.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.045+0000 7f178fe00700 1 -- 172.21.15.81:0/2957060772 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f178400fda0 con 0x7f17980fe0e0 2024-04-23T14:57:58.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.045+0000 7f178fe00700 1 -- 172.21.15.81:0/2957060772 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f178400d310 con 0x7f17980fe0e0 2024-04-23T14:57:58.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.045+0000 7f179ee00700 1 -- 172.21.15.81:0/2957060772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17981118a0 con 0x7f17980fe0e0 2024-04-23T14:57:58.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.046+0000 7f179ee00700 1 -- 172.21.15.81:0/2957060772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1798101a70 con 0x7f17980fe0e0 2024-04-23T14:57:58.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.048+0000 7f178fe00700 1 -- 172.21.15.81:0/2957060772 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f1784010420 con 0x7f17980fe0e0 2024-04-23T14:57:58.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.049+0000 7f178fe00700 1 --2- 172.21.15.81:0/2957060772 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f177c06ec10 0x7f177c0710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:58.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.049+0000 7f178fe00700 1 -- 172.21.15.81:0/2957060772 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f178408e850 con 0x7f17980fe0e0 2024-04-23T14:57:58.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.049+0000 7f1797e00700 1 --2- 172.21.15.81:0/2957060772 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f177c06ec10 0x7f177c0710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:58.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.050+0000 7f1797e00700 1 --2- 172.21.15.81:0/2957060772 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f177c06ec10 0x7f177c0710c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f178800b3b0 tx=0x7f1788009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:58.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.057+0000 7f178fe00700 1 -- 172.21.15.81:0/2957060772 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f178405b1e0 con 0x7f17980fe0e0 2024-04-23T14:57:58.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.304+0000 7f179ee00700 1 -- 172.21.15.81:0/2957060772 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1798111b70 con 0x7f177c06ec10 2024-04-23T14:57:58.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.307+0000 7f178fe00700 1 -- 172.21.15.81:0/2957060772 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f1798111b70 con 0x7f177c06ec10 2024-04-23T14:57:58.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.310+0000 7f179ee00700 1 -- 172.21.15.81:0/2957060772 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f177c06ec10 msgr2=0x7f177c0710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:58.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.310+0000 7f179ee00700 1 --2- 172.21.15.81:0/2957060772 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f177c06ec10 0x7f177c0710c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f178800b3b0 tx=0x7f1788009e30 comp rx=0 tx=0).stop 2024-04-23T14:57:58.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.310+0000 7f179ee00700 1 -- 172.21.15.81:0/2957060772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17980fe0e0 msgr2=0x7f1798110180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:58.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.310+0000 7f179ee00700 1 --2- 172.21.15.81:0/2957060772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17980fe0e0 0x7f1798110180 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f178400b790 tx=0x7f1784009250 comp rx=0 tx=0).stop 2024-04-23T14:57:58.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.310+0000 7f179ee00700 1 -- 172.21.15.81:0/2957060772 shutdown_connections 2024-04-23T14:57:58.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.310+0000 7f179ee00700 1 --2- 172.21.15.81:0/2957060772 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f177c06ec10 0x7f177c0710c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:58.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.310+0000 7f179ee00700 1 --2- 172.21.15.81:0/2957060772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17980fcef0 0x7f179810fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:58.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.310+0000 7f179ee00700 1 --2- 172.21.15.81:0/2957060772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17980fe0e0 0x7f1798110180 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:58.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.310+0000 7f179ee00700 1 -- 172.21.15.81:0/2957060772 >> 172.21.15.81:0/2957060772 conn(0x7f17980f8530 msgr2=0x7f17980f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:58.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.310+0000 7f179ee00700 1 -- 172.21.15.81:0/2957060772 shutdown_connections 2024-04-23T14:57:58.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.310+0000 7f179ee00700 1 -- 172.21.15.81:0/2957060772 wait complete. 2024-04-23T14:57:58.327 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-04-23T14:57:58.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.458+0000 7f716a600700 1 -- 172.21.15.81:0/3040886726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71640fbb30 msgr2=0x7f71640fbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:58.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.458+0000 7f716a600700 1 --2- 172.21.15.81:0/3040886726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71640fbb30 0x7f71640fbf40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7158004940 tx=0x7f7158009e30 comp rx=0 tx=0).stop 2024-04-23T14:57:58.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.458+0000 7f716a600700 1 -- 172.21.15.81:0/3040886726 shutdown_connections 2024-04-23T14:57:58.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.458+0000 7f716a600700 1 --2- 172.21.15.81:0/3040886726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71640fcde0 0x7f71640fd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:58.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.458+0000 7f716a600700 1 --2- 172.21.15.81:0/3040886726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71640fbb30 0x7f71640fbf40 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:58.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.458+0000 7f716a600700 1 -- 172.21.15.81:0/3040886726 >> 172.21.15.81:0/3040886726 conn(0x7f71640f7290 msgr2=0x7f71640f96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:58.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.458+0000 7f716a600700 1 -- 172.21.15.81:0/3040886726 shutdown_connections 2024-04-23T14:57:58.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.458+0000 7f716a600700 1 -- 172.21.15.81:0/3040886726 wait complete. 2024-04-23T14:57:58.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.459+0000 7f716a600700 1 Processor -- start 2024-04-23T14:57:58.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.459+0000 7f716a600700 1 -- start start 2024-04-23T14:57:58.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.460+0000 7f716a600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71640fbb30 0x7f7164112940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:58.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.460+0000 7f716a600700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71640fcde0 0x7f7164114e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:58.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.460+0000 7f716a600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7164066c40 con 0x7f71640fbb30 2024-04-23T14:57:58.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.460+0000 7f716a600700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7164066d80 con 0x7f71640fcde0 2024-04-23T14:57:58.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.460+0000 7f7169200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71640fbb30 0x7f7164112940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:58.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.460+0000 7f7169200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71640fbb30 0x7f7164112940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40564/0 (socket says 172.21.15.81:40564) 2024-04-23T14:57:58.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.460+0000 7f7169200700 1 -- 172.21.15.81:0/51002507 learned_addr learned my addr 172.21.15.81:0/51002507 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:57:58.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.460+0000 7f7169200700 1 -- 172.21.15.81:0/51002507 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71640fcde0 msgr2=0x7f7164114e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:58.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.460+0000 7f7163e00700 1 --2- 172.21.15.81:0/51002507 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71640fcde0 0x7f7164114e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:58.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.460+0000 7f7169200700 1 --2- 172.21.15.81:0/51002507 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71640fcde0 0x7f7164114e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:58.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.460+0000 7f7169200700 1 -- 172.21.15.81:0/51002507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7158005040 con 0x7f71640fbb30 2024-04-23T14:57:58.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.461+0000 7f7169200700 1 --2- 172.21.15.81:0/51002507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71640fbb30 0x7f7164112940 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7158009150 tx=0x7f7158009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:58.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.461+0000 7f7160c00700 1 -- 172.21.15.81:0/51002507 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f715800e040 con 0x7f71640fbb30 2024-04-23T14:57:58.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.461+0000 7f7160c00700 1 -- 172.21.15.81:0/51002507 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f715800bcc0 con 0x7f71640fbb30 2024-04-23T14:57:58.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.461+0000 7f716a600700 1 -- 172.21.15.81:0/51002507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71641153d0 con 0x7f71640fbb30 2024-04-23T14:57:58.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.461+0000 7f7160c00700 1 -- 172.21.15.81:0/51002507 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f715801c630 con 0x7f71640fbb30 2024-04-23T14:57:58.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.461+0000 7f716a600700 1 -- 172.21.15.81:0/51002507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7164115850 con 0x7f71640fbb30 2024-04-23T14:57:58.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.462+0000 7f716a600700 1 -- 172.21.15.81:0/51002507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71640faf30 con 0x7f71640fbb30 2024-04-23T14:57:58.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.463+0000 7f7160c00700 1 -- 172.21.15.81:0/51002507 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f7158013420 con 0x7f71640fbb30 2024-04-23T14:57:58.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.464+0000 7f7160c00700 1 --2- 172.21.15.81:0/51002507 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f714c06ec00 0x7f714c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:58.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.464+0000 7f7160c00700 1 -- 172.21.15.81:0/51002507 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f715808f4c0 con 0x7f71640fbb30 2024-04-23T14:57:58.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.465+0000 7f7163e00700 1 --2- 172.21.15.81:0/51002507 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f714c06ec00 0x7f714c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:58.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.465+0000 7f7163e00700 1 --2- 172.21.15.81:0/51002507 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f714c06ec00 0x7f714c0710b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7150006fd0 tx=0x7f7150008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:58.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.470+0000 7f7160c00700 1 -- 172.21.15.81:0/51002507 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f7158058320 con 0x7f71640fbb30 2024-04-23T14:57:58.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.713+0000 7f716a600700 1 -- 172.21.15.81:0/51002507 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7164101080 con 0x7f714c06ec00 2024-04-23T14:57:58.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.715+0000 7f7160c00700 1 -- 172.21.15.81:0/51002507 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f7164101080 con 0x7f714c06ec00 2024-04-23T14:57:58.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.719+0000 7f716a600700 1 -- 172.21.15.81:0/51002507 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f714c06ec00 msgr2=0x7f714c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:58.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.719+0000 7f716a600700 1 --2- 172.21.15.81:0/51002507 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f714c06ec00 0x7f714c0710b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7150006fd0 tx=0x7f7150008040 comp rx=0 tx=0).stop 2024-04-23T14:57:58.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.719+0000 7f716a600700 1 -- 172.21.15.81:0/51002507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71640fbb30 msgr2=0x7f7164112940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:58.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.719+0000 7f716a600700 1 --2- 172.21.15.81:0/51002507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71640fbb30 0x7f7164112940 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7158009150 tx=0x7f7158009e30 comp rx=0 tx=0).stop 2024-04-23T14:57:58.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.719+0000 7f716a600700 1 -- 172.21.15.81:0/51002507 shutdown_connections 2024-04-23T14:57:58.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.719+0000 7f716a600700 1 --2- 172.21.15.81:0/51002507 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f714c06ec00 0x7f714c0710b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:58.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.719+0000 7f716a600700 1 --2- 172.21.15.81:0/51002507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71640fbb30 0x7f7164112940 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:58.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.719+0000 7f716a600700 1 --2- 172.21.15.81:0/51002507 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71640fcde0 0x7f7164114e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:58.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.719+0000 7f716a600700 1 -- 172.21.15.81:0/51002507 >> 172.21.15.81:0/51002507 conn(0x7f71640f7290 msgr2=0x7f71640f8890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:58.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.719+0000 7f716a600700 1 -- 172.21.15.81:0/51002507 shutdown_connections 2024-04-23T14:57:58.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.719+0000 7f716a600700 1 -- 172.21.15.81:0/51002507 wait complete. 2024-04-23T14:57:58.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.862+0000 7f0e99e00700 1 -- 172.21.15.81:0/2948104291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e94071e50 msgr2=0x7f0e94070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:58.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.862+0000 7f0e99e00700 1 --2- 172.21.15.81:0/2948104291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e94071e50 0x7f0e94070350 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0e84004940 tx=0x7f0e84009e30 comp rx=0 tx=0).stop 2024-04-23T14:57:58.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.862+0000 7f0e99e00700 1 -- 172.21.15.81:0/2948104291 shutdown_connections 2024-04-23T14:57:58.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.862+0000 7f0e99e00700 1 --2- 172.21.15.81:0/2948104291 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e94070890 0x7f0e94070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:58.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.862+0000 7f0e99e00700 1 --2- 172.21.15.81:0/2948104291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e94071e50 0x7f0e94070350 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:58.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.862+0000 7f0e99e00700 1 -- 172.21.15.81:0/2948104291 >> 172.21.15.81:0/2948104291 conn(0x7f0e940f8540 msgr2=0x7f0e940fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:58.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.862+0000 7f0e99e00700 1 -- 172.21.15.81:0/2948104291 shutdown_connections 2024-04-23T14:57:58.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.862+0000 7f0e99e00700 1 -- 172.21.15.81:0/2948104291 wait complete. 2024-04-23T14:57:58.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.863+0000 7f0e99e00700 1 Processor -- start 2024-04-23T14:57:58.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.863+0000 7f0e99e00700 1 -- start start 2024-04-23T14:57:58.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.864+0000 7f0e99e00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e94070890 0x7f0e9410fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:58.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.864+0000 7f0e99e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e94071e50 0x7f0e94110260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:58.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.864+0000 7f0e99e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e94110860 con 0x7f0e94071e50 2024-04-23T14:57:58.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.864+0000 7f0e99e00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e94110fa0 con 0x7f0e94070890 2024-04-23T14:57:58.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.864+0000 7f0e92000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e94071e50 0x7f0e94110260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:58.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.864+0000 7f0e92000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e94071e50 0x7f0e94110260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40574/0 (socket says 172.21.15.81:40574) 2024-04-23T14:57:58.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.864+0000 7f0e92000700 1 -- 172.21.15.81:0/1562344304 learned_addr learned my addr 172.21.15.81:0/1562344304 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:57:58.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.864+0000 7f0e92a00700 1 --2- 172.21.15.81:0/1562344304 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e94070890 0x7f0e9410fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:58.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.865+0000 7f0e92000700 1 -- 172.21.15.81:0/1562344304 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e94070890 msgr2=0x7f0e9410fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:58.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.865+0000 7f0e92000700 1 --2- 172.21.15.81:0/1562344304 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e94070890 0x7f0e9410fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:58.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.865+0000 7f0e92000700 1 -- 172.21.15.81:0/1562344304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e84005040 con 0x7f0e94071e50 2024-04-23T14:57:58.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.865+0000 7f0e92000700 1 --2- 172.21.15.81:0/1562344304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e94071e50 0x7f0e94110260 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0e8000c830 tx=0x7f0e80004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:58.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.865+0000 7f0e8aa00700 1 -- 172.21.15.81:0/1562344304 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e8000a760 con 0x7f0e94071e50 2024-04-23T14:57:58.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.866+0000 7f0e8aa00700 1 -- 172.21.15.81:0/1562344304 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0e8000ad90 con 0x7f0e94071e50 2024-04-23T14:57:58.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.866+0000 7f0e8aa00700 1 -- 172.21.15.81:0/1562344304 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e800113a0 con 0x7f0e94071e50 2024-04-23T14:57:58.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.866+0000 7f0e99e00700 1 -- 172.21.15.81:0/1562344304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e94111280 con 0x7f0e94071e50 2024-04-23T14:57:58.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.866+0000 7f0e99e00700 1 -- 172.21.15.81:0/1562344304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e941117f0 con 0x7f0e94071e50 2024-04-23T14:57:58.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.867+0000 7f0e99e00700 1 -- 172.21.15.81:0/1562344304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e9405f5f0 con 0x7f0e94071e50 2024-04-23T14:57:58.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.869+0000 7f0e8aa00700 1 -- 172.21.15.81:0/1562344304 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f0e80012400 con 0x7f0e94071e50 2024-04-23T14:57:58.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.870+0000 7f0e8aa00700 1 --2- 172.21.15.81:0/1562344304 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f0e7806ec10 0x7f0e780710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:58.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.870+0000 7f0e8aa00700 1 -- 172.21.15.81:0/1562344304 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f0e8008f3e0 con 0x7f0e94071e50 2024-04-23T14:57:58.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.870+0000 7f0e92a00700 1 --2- 172.21.15.81:0/1562344304 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f0e7806ec10 0x7f0e780710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:58.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.871+0000 7f0e92a00700 1 --2- 172.21.15.81:0/1562344304 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f0e7806ec10 0x7f0e780710c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0e8400b3b0 tx=0x7f0e84009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:58.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:58.875+0000 7f0e8aa00700 1 -- 172.21.15.81:0/1562344304 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f0e8005bd70 con 0x7f0e94071e50 2024-04-23T14:57:59.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.123+0000 7f0e99e00700 1 -- 172.21.15.81:0/1562344304 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e94111ca0 con 0x7f0e7806ec10 2024-04-23T14:57:59.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.135+0000 7f0e8aa00700 1 -- 172.21.15.81:0/1562344304 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f0e94111ca0 con 0x7f0e7806ec10 2024-04-23T14:57:59.136 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-23T14:57:59.136 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (8m) 6s ago 19m 14.5M - 0.25.0 c8568f914cd2 63876b2abc27 2024-04-23T14:57:59.136 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (4m) 6s ago 19m 6665k - 19.0.0-3126-gd44fddd9 76e77f280c74 b486fe2ef19b 2024-04-23T14:57:59.137 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi156 smithi156 running (4m) 33s ago 17m 6656k - 19.0.0-3126-gd44fddd9 76e77f280c74 5d9aa5ecf264 2024-04-23T14:57:59.137 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (8m) 6s ago 18m 73.8M - 9.4.7 954c08fa6188 fbad3cef0883 2024-04-23T14:57:59.137 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.vcoywg smithi081 running (11m) 6s ago 11m 147M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 2ca7601ab60f 2024-04-23T14:57:59.137 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.wydgcg smithi081 running (14s) 6s ago 12m 10.9M - 19.0.0-3126-gd44fddd9 76e77f280c74 e2a96404cc4f 2024-04-23T14:57:59.137 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.rhbtxt smithi156 running (11m) 33s ago 11m 14.5M - 17.2.7-884-g70d0cb4b cafd8ddac8fa db3cb5034381 2024-04-23T14:57:59.137 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.vynkxn smithi156 running (11m) 33s ago 11m 14.8M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 1c8f2219e7fd 2024-04-23T14:57:59.137 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.ldghvq smithi081 *:8443,9283,8765 running (7m) 6s ago 20m 510M - 19.0.0-3126-gd44fddd9 76e77f280c74 6bf23484a1c9 2024-04-23T14:57:59.137 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi156.ounwyj smithi156 *:8443,9283,8765 running (6m) 33s ago 17m 452M - 19.0.0-3126-gd44fddd9 76e77f280c74 a6c0dd9f89f2 2024-04-23T14:57:59.137 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (5m) 6s ago 20m 52.0M 2048M 19.0.0-3126-gd44fddd9 76e77f280c74 fbf9f9a59ac2 2024-04-23T14:57:59.137 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi156 smithi156 running (5m) 33s ago 17m 35.9M 2048M 19.0.0-3126-gd44fddd9 76e77f280c74 36409886998f 2024-04-23T14:57:59.137 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (8m) 6s ago 19m 7977k - 1.5.0 0da6a335fe13 197b27809010 2024-04-23T14:57:59.137 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi156 smithi156 *:9100 running (7m) 33s ago 17m 8363k - 1.5.0 0da6a335fe13 91a7c5e86d47 2024-04-23T14:57:59.137 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (3m) 6s ago 16m 104M 1557M 19.0.0-3126-gd44fddd9 76e77f280c74 24bc24b37de5 2024-04-23T14:57:59.137 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (3m) 6s ago 16m 108M 1557M 19.0.0-3126-gd44fddd9 76e77f280c74 18d0179b558a 2024-04-23T14:57:59.137 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (2m) 6s ago 15m 87.2M 1557M 19.0.0-3126-gd44fddd9 76e77f280c74 421a62ef6990 2024-04-23T14:57:59.138 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi156 running (2m) 33s ago 15m 111M 2581M 19.0.0-3126-gd44fddd9 76e77f280c74 9af3ca1ff69b 2024-04-23T14:57:59.138 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi156 running (80s) 33s ago 14m 105M 2581M 19.0.0-3126-gd44fddd9 76e77f280c74 e0a1e784348c 2024-04-23T14:57:59.138 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi156 running (38s) 33s ago 13m 11.1M 2581M 19.0.0-3126-gd44fddd9 76e77f280c74 16b6ba5d9e3e 2024-04-23T14:57:59.138 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (6m) 6s ago 18m 57.3M - 2.43.0 a07b618ecd1d 35558adb166d 2024-04-23T14:57:59.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.139+0000 7f0e99e00700 1 -- 172.21.15.81:0/1562344304 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f0e7806ec10 msgr2=0x7f0e780710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:59.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.139+0000 7f0e99e00700 1 --2- 172.21.15.81:0/1562344304 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f0e7806ec10 0x7f0e780710c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0e8400b3b0 tx=0x7f0e84009e30 comp rx=0 tx=0).stop 2024-04-23T14:57:59.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.139+0000 7f0e99e00700 1 -- 172.21.15.81:0/1562344304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e94071e50 msgr2=0x7f0e94110260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:59.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.139+0000 7f0e99e00700 1 --2- 172.21.15.81:0/1562344304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e94071e50 0x7f0e94110260 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0e8000c830 tx=0x7f0e80004470 comp rx=0 tx=0).stop 2024-04-23T14:57:59.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.139+0000 7f0e99e00700 1 -- 172.21.15.81:0/1562344304 shutdown_connections 2024-04-23T14:57:59.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.139+0000 7f0e99e00700 1 --2- 172.21.15.81:0/1562344304 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f0e7806ec10 0x7f0e780710c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:59.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.139+0000 7f0e99e00700 1 --2- 172.21.15.81:0/1562344304 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e94070890 0x7f0e9410fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:59.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.139+0000 7f0e99e00700 1 --2- 172.21.15.81:0/1562344304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e94071e50 0x7f0e94110260 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:59.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.139+0000 7f0e99e00700 1 -- 172.21.15.81:0/1562344304 >> 172.21.15.81:0/1562344304 conn(0x7f0e940f8540 msgr2=0x7f0e940f9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:59.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.139+0000 7f0e99e00700 1 -- 172.21.15.81:0/1562344304 shutdown_connections 2024-04-23T14:57:59.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.139+0000 7f0e99e00700 1 -- 172.21.15.81:0/1562344304 wait complete. 2024-04-23T14:57:59.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.284+0000 7fdcc3e00700 1 -- 172.21.15.81:0/1274079023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcc4066290 msgr2=0x7fdcc40ff860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:59.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.284+0000 7fdcc3e00700 1 --2- 172.21.15.81:0/1274079023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcc4066290 0x7fdcc40ff860 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4004940 tx=0x7fdcb4009e30 comp rx=0 tx=0).stop 2024-04-23T14:57:59.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.285+0000 7fdcc3e00700 1 -- 172.21.15.81:0/1274079023 shutdown_connections 2024-04-23T14:57:59.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.285+0000 7fdcc3e00700 1 --2- 172.21.15.81:0/1274079023 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdcc40ffda0 0x7fdcc4102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:59.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.285+0000 7fdcc3e00700 1 --2- 172.21.15.81:0/1274079023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcc4066290 0x7fdcc40ff860 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:59.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.285+0000 7fdcc3e00700 1 -- 172.21.15.81:0/1274079023 >> 172.21.15.81:0/1274079023 conn(0x7fdcc40f7270 msgr2=0x7fdcc40f96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:59.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.285+0000 7fdcc3e00700 1 -- 172.21.15.81:0/1274079023 shutdown_connections 2024-04-23T14:57:59.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.285+0000 7fdcc3e00700 1 -- 172.21.15.81:0/1274079023 wait complete. 2024-04-23T14:57:59.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.286+0000 7fdcc3e00700 1 Processor -- start 2024-04-23T14:57:59.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.286+0000 7fdcc3e00700 1 -- start start 2024-04-23T14:57:59.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.286+0000 7fdcc3e00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdcc4066290 0x7fdcc410fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:59.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.286+0000 7fdcc3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcc40ffda0 0x7fdcc4110010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:59.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.286+0000 7fdcc3e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc4110610 con 0x7fdcc40ffda0 2024-04-23T14:57:59.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.286+0000 7fdcc3e00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc4110e60 con 0x7fdcc4066290 2024-04-23T14:57:59.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.286+0000 7fdcc2000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcc40ffda0 0x7fdcc4110010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:59.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.286+0000 7fdcc2000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcc40ffda0 0x7fdcc4110010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40602/0 (socket says 172.21.15.81:40602) 2024-04-23T14:57:59.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.286+0000 7fdcc2000700 1 -- 172.21.15.81:0/2501040004 learned_addr learned my addr 172.21.15.81:0/2501040004 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:57:59.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.287+0000 7fdcc2a00700 1 --2- 172.21.15.81:0/2501040004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdcc4066290 0x7fdcc410fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:59.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.287+0000 7fdcc2000700 1 -- 172.21.15.81:0/2501040004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdcc4066290 msgr2=0x7fdcc410fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:59.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.287+0000 7fdcc2000700 1 --2- 172.21.15.81:0/2501040004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdcc4066290 0x7fdcc410fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:59.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.287+0000 7fdcc2000700 1 -- 172.21.15.81:0/2501040004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb4005040 con 0x7fdcc40ffda0 2024-04-23T14:57:59.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.287+0000 7fdcc2000700 1 --2- 172.21.15.81:0/2501040004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcc40ffda0 0x7fdcc4110010 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdcb000c830 tx=0x7fdcb0004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:59.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.288+0000 7fdcbaa00700 1 -- 172.21.15.81:0/2501040004 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdcb000a760 con 0x7fdcc40ffda0 2024-04-23T14:57:59.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.288+0000 7fdcbaa00700 1 -- 172.21.15.81:0/2501040004 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdcb000ad90 con 0x7fdcc40ffda0 2024-04-23T14:57:59.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.288+0000 7fdcc3e00700 1 -- 172.21.15.81:0/2501040004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc4111140 con 0x7fdcc40ffda0 2024-04-23T14:57:59.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.288+0000 7fdcbaa00700 1 -- 172.21.15.81:0/2501040004 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdcb00113a0 con 0x7fdcc40ffda0 2024-04-23T14:57:59.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.288+0000 7fdcc3e00700 1 -- 172.21.15.81:0/2501040004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc4111680 con 0x7fdcc40ffda0 2024-04-23T14:57:59.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.289+0000 7fdcc3e00700 1 -- 172.21.15.81:0/2501040004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcc40f8df0 con 0x7fdcc40ffda0 2024-04-23T14:57:59.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.291+0000 7fdcbaa00700 1 -- 172.21.15.81:0/2501040004 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fdcb0012400 con 0x7fdcc40ffda0 2024-04-23T14:57:59.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.292+0000 7fdcbaa00700 1 --2- 172.21.15.81:0/2501040004 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fdca806ec10 0x7fdca80710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:59.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.292+0000 7fdcbaa00700 1 -- 172.21.15.81:0/2501040004 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fdcb008e820 con 0x7fdcc40ffda0 2024-04-23T14:57:59.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.292+0000 7fdcc2a00700 1 --2- 172.21.15.81:0/2501040004 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fdca806ec10 0x7fdca80710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:59.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.293+0000 7fdcc2a00700 1 --2- 172.21.15.81:0/2501040004 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fdca806ec10 0x7fdca80710c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4009fd0 tx=0x7fdcb4009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:59.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.297+0000 7fdcbaa00700 1 -- 172.21.15.81:0/2501040004 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fdcb005b1f0 con 0x7fdcc40ffda0 2024-04-23T14:57:59.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.619+0000 7fdcc3e00700 1 -- 172.21.15.81:0/2501040004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdcc405f5f0 con 0x7fdcc40ffda0 2024-04-23T14:57:59.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.620+0000 7fdcbaa00700 1 -- 172.21.15.81:0/2501040004 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7fdcb005ad80 con 0x7fdcc40ffda0 2024-04-23T14:57:59.621 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:57:59.621 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-04-23T14:57:59.621 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T14:57:59.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:57:59.621 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-04-23T14:57:59.621 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T14:57:59.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:57:59.621 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-04-23T14:57:59.622 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 6 2024-04-23T14:57:59.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:57:59.622 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-04-23T14:57:59.622 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 3, 2024-04-23T14:57:59.622 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 1 2024-04-23T14:57:59.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:57:59.622 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-04-23T14:57:59.622 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 3, 2024-04-23T14:57:59.622 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 11 2024-04-23T14:57:59.622 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-23T14:57:59.622 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:57:59.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.622+0000 7fdcc3e00700 1 -- 172.21.15.81:0/2501040004 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fdca806ec10 msgr2=0x7fdca80710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:59.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.622+0000 7fdcc3e00700 1 --2- 172.21.15.81:0/2501040004 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fdca806ec10 0x7fdca80710c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4009fd0 tx=0x7fdcb4009e30 comp rx=0 tx=0).stop 2024-04-23T14:57:59.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.622+0000 7fdcc3e00700 1 -- 172.21.15.81:0/2501040004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcc40ffda0 msgr2=0x7fdcc4110010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:59.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.622+0000 7fdcc3e00700 1 --2- 172.21.15.81:0/2501040004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcc40ffda0 0x7fdcc4110010 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdcb000c830 tx=0x7fdcb0004470 comp rx=0 tx=0).stop 2024-04-23T14:57:59.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.623+0000 7fdcc3e00700 1 -- 172.21.15.81:0/2501040004 shutdown_connections 2024-04-23T14:57:59.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.623+0000 7fdcc3e00700 1 --2- 172.21.15.81:0/2501040004 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fdca806ec10 0x7fdca80710c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:59.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.623+0000 7fdcc3e00700 1 --2- 172.21.15.81:0/2501040004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdcc4066290 0x7fdcc410fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:59.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.623+0000 7fdcc3e00700 1 --2- 172.21.15.81:0/2501040004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcc40ffda0 0x7fdcc4110010 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:59.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.623+0000 7fdcc3e00700 1 -- 172.21.15.81:0/2501040004 >> 172.21.15.81:0/2501040004 conn(0x7fdcc40f7270 msgr2=0x7fdcc40fb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:59.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.623+0000 7fdcc3e00700 1 -- 172.21.15.81:0/2501040004 shutdown_connections 2024-04-23T14:57:59.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.624+0000 7fdcc3e00700 1 -- 172.21.15.81:0/2501040004 wait complete. 2024-04-23T14:57:59.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.780+0000 7fcddac00700 1 -- 172.21.15.81:0/1309929974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdd41002b0 msgr2=0x7fcdd4100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:57:59.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.780+0000 7fcddac00700 1 --2- 172.21.15.81:0/1309929974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdd41002b0 0x7fcdd4100720 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0004940 tx=0x7fcdc0009e30 comp rx=0 tx=0).stop 2024-04-23T14:57:59.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.781+0000 7fcddac00700 1 -- 172.21.15.81:0/1309929974 shutdown_connections 2024-04-23T14:57:59.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.781+0000 7fcddac00700 1 --2- 172.21.15.81:0/1309929974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdd41002b0 0x7fcdd4100720 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:59.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.781+0000 7fcddac00700 1 --2- 172.21.15.81:0/1309929974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcdd40ff000 0x7fcdd40ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:59.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.781+0000 7fcddac00700 1 -- 172.21.15.81:0/1309929974 >> 172.21.15.81:0/1309929974 conn(0x7fcdd40fa950 msgr2=0x7fcdd40fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:57:59.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.781+0000 7fcddac00700 1 -- 172.21.15.81:0/1309929974 shutdown_connections 2024-04-23T14:57:59.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.781+0000 7fcddac00700 1 -- 172.21.15.81:0/1309929974 wait complete. 2024-04-23T14:57:59.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.782+0000 7fcddac00700 1 Processor -- start 2024-04-23T14:57:59.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.782+0000 7fcddac00700 1 -- start start 2024-04-23T14:57:59.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.782+0000 7fcddac00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcdd40ff000 0x7fcdd406e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:59.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.782+0000 7fcddac00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdd41002b0 0x7fcdd406e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:59.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.782+0000 7fcddac00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd4070040 con 0x7fcdd41002b0 2024-04-23T14:57:59.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.782+0000 7fcddac00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd406ee80 con 0x7fcdd40ff000 2024-04-23T14:57:59.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.782+0000 7fcdd3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdd41002b0 0x7fcdd406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:59.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.782+0000 7fcdd3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdd41002b0 0x7fcdd406e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40612/0 (socket says 172.21.15.81:40612) 2024-04-23T14:57:59.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.782+0000 7fcdd3400700 1 -- 172.21.15.81:0/2650708461 learned_addr learned my addr 172.21.15.81:0/2650708461 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:57:59.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.783+0000 7fcdd3400700 1 -- 172.21.15.81:0/2650708461 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcdd40ff000 msgr2=0x7fcdd406e400 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-23T14:57:59.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.783+0000 7fcdd3400700 1 --2- 172.21.15.81:0/2650708461 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcdd40ff000 0x7fcdd406e400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:57:59.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.783+0000 7fcdd3400700 1 -- 172.21.15.81:0/2650708461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc0005040 con 0x7fcdd41002b0 2024-04-23T14:57:59.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.783+0000 7fcdd3400700 1 --2- 172.21.15.81:0/2650708461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdd41002b0 0x7fcdd406e940 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0009150 tx=0x7fcdc0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:59.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.783+0000 7fcdcbe00700 1 -- 172.21.15.81:0/2650708461 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdc000e040 con 0x7fcdd41002b0 2024-04-23T14:57:59.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.783+0000 7fcdcbe00700 1 -- 172.21.15.81:0/2650708461 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcdc000bbf0 con 0x7fcdd41002b0 2024-04-23T14:57:59.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.783+0000 7fcdcbe00700 1 -- 172.21.15.81:0/2650708461 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdc001c630 con 0x7fcdd41002b0 2024-04-23T14:57:59.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.784+0000 7fcddac00700 1 -- 172.21.15.81:0/2650708461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdd406f100 con 0x7fcdd41002b0 2024-04-23T14:57:59.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.784+0000 7fcddac00700 1 -- 172.21.15.81:0/2650708461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdd411e1f0 con 0x7fcdd41002b0 2024-04-23T14:57:59.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.785+0000 7fcddac00700 1 -- 172.21.15.81:0/2650708461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdd405f5f0 con 0x7fcdd41002b0 2024-04-23T14:57:59.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.786+0000 7fcdcbe00700 1 -- 172.21.15.81:0/2650708461 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fcdc000bd60 con 0x7fcdd41002b0 2024-04-23T14:57:59.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.787+0000 7fcdcbe00700 1 --2- 172.21.15.81:0/2650708461 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fcdb806ec10 0x7fcdb80710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:57:59.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.787+0000 7fcdcbe00700 1 -- 172.21.15.81:0/2650708461 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fcdc008fb00 con 0x7fcdd41002b0 2024-04-23T14:57:59.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.788+0000 7fcdd3e00700 1 --2- 172.21.15.81:0/2650708461 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fcdb806ec10 0x7fcdb80710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:57:59.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.788+0000 7fcdd3e00700 1 --2- 172.21.15.81:0/2650708461 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fcdb806ec10 0x7fcdb80710c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcdd406fcc0 tx=0x7fcdc4007d40 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:57:59.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:57:59.792+0000 7fcdcbe00700 1 -- 172.21.15.81:0/2650708461 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fcdc0058a20 con 0x7fcdd41002b0 2024-04-23T14:58:00.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:59 smithi156 ceph-mon[77738]: from='client.34434 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:58:00.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:59 smithi156 ceph-mon[77738]: pgmap v202: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:58:00.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:59 smithi156 ceph-mon[77738]: from='client.34438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:58:00.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:57:59 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/2501040004' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:58:00.038 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:59 smithi081 ceph-mon[90469]: from='client.34434 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:58:00.038 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:59 smithi081 ceph-mon[90469]: pgmap v202: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:58:00.038 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:59 smithi081 ceph-mon[90469]: from='client.34438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:58:00.038 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:57:59 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/2501040004' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:58:00.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.068+0000 7fcddac00700 1 -- 172.21.15.81:0/2650708461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcdd404bed0 con 0x7fcdd41002b0 2024-04-23T14:58:00.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.069+0000 7fcdcbe00700 1 -- 172.21.15.81:0/2650708461 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1891 (secure 0 0 0) 0x7fcdc005c0e0 con 0x7fcdd41002b0 2024-04-23T14:58:00.071 INFO:teuthology.orchestra.run.smithi081.stdout:e22 2024-04-23T14:58:00.071 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-23T14:58:00.071 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:58:00.071 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-04-23T14:58:00.071 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:58:00.071 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-04-23T14:58:00.072 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-04-23T14:58:00.072 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 19 2024-04-23T14:58:00.072 INFO:teuthology.orchestra.run.smithi081.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-23T14:58:00.072 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-04-23T14:45:51.264703+0000 2024-04-23T14:58:00.072 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-04-23T14:57:34.994720+0000 2024-04-23T14:58:00.072 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-04-23T14:58:00.072 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-04-23T14:58:00.072 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-04-23T14:58:00.072 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-04-23T14:58:00.072 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-04-23T14:58:00.072 INFO:teuthology.orchestra.run.smithi081.stdout:max_xattr_size 65536 2024-04-23T14:58:00.072 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-04-23T14:58:00.072 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-04-23T14:58:00.072 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 0 2024-04-23T14:58:00.072 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:58:00.072 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 1 2024-04-23T14:58:00.072 INFO:teuthology.orchestra.run.smithi081.stdout:in 0 2024-04-23T14:58:00.073 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=14472} 2024-04-23T14:58:00.073 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-04-23T14:58:00.073 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-04-23T14:58:00.073 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-04-23T14:58:00.073 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-04-23T14:58:00.073 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-04-23T14:58:00.073 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-04-23T14:58:00.073 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-04-23T14:58:00.073 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-04-23T14:58:00.073 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-04-23T14:58:00.073 INFO:teuthology.orchestra.run.smithi081.stdout:qdb_cluster leader: 14472 members: 14472 2024-04-23T14:58:00.073 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.vcoywg{0:14472} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.81:6828/2563365650,v1:172.21.15.81:6829/2563365650] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:58:00.073 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:58:00.073 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:58:00.073 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-04-23T14:58:00.073 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:58:00.074 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.vynkxn{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.156:6826/1794690362,v1:172.21.15.156:6827/1794690362] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:58:00.074 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.rhbtxt{-1:24263} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.156:6824/3854041261,v1:172.21.15.156:6825/3854041261] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:58:00.074 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.wydgcg{-1:34430} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.81:6826/3200953351,v1:172.21.15.81:6827/3200953351] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T14:58:00.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.072+0000 7fcddac00700 1 -- 172.21.15.81:0/2650708461 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fcdb806ec10 msgr2=0x7fcdb80710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:00.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.072+0000 7fcddac00700 1 --2- 172.21.15.81:0/2650708461 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fcdb806ec10 0x7fcdb80710c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcdd406fcc0 tx=0x7fcdc4007d40 comp rx=0 tx=0).stop 2024-04-23T14:58:00.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.072+0000 7fcddac00700 1 -- 172.21.15.81:0/2650708461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdd41002b0 msgr2=0x7fcdd406e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:00.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.072+0000 7fcddac00700 1 --2- 172.21.15.81:0/2650708461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdd41002b0 0x7fcdd406e940 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0009150 tx=0x7fcdc0009e30 comp rx=0 tx=0).stop 2024-04-23T14:58:00.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.072+0000 7fcddac00700 1 -- 172.21.15.81:0/2650708461 shutdown_connections 2024-04-23T14:58:00.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.072+0000 7fcddac00700 1 --2- 172.21.15.81:0/2650708461 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fcdb806ec10 0x7fcdb80710c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:00.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.072+0000 7fcddac00700 1 --2- 172.21.15.81:0/2650708461 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcdd40ff000 0x7fcdd406e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:00.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.072+0000 7fcddac00700 1 --2- 172.21.15.81:0/2650708461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdd41002b0 0x7fcdd406e940 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:00.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.072+0000 7fcddac00700 1 -- 172.21.15.81:0/2650708461 >> 172.21.15.81:0/2650708461 conn(0x7fcdd40fa950 msgr2=0x7fcdd40fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:00.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.073+0000 7fcddac00700 1 -- 172.21.15.81:0/2650708461 shutdown_connections 2024-04-23T14:58:00.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.073+0000 7fcddac00700 1 -- 172.21.15.81:0/2650708461 wait complete. 2024-04-23T14:58:00.075 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 22 2024-04-23T14:58:00.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.224+0000 7fcf75600700 1 -- 172.21.15.81:0/606910765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf70071f50 msgr2=0x7fcf70070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:00.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.224+0000 7fcf75600700 1 --2- 172.21.15.81:0/606910765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf70071f50 0x7fcf70070460 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcf60004940 tx=0x7fcf60009e30 comp rx=0 tx=0).stop 2024-04-23T14:58:00.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.224+0000 7fcf75600700 1 -- 172.21.15.81:0/606910765 shutdown_connections 2024-04-23T14:58:00.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.224+0000 7fcf75600700 1 --2- 172.21.15.81:0/606910765 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf700709a0 0x7fcf70070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:00.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.224+0000 7fcf75600700 1 --2- 172.21.15.81:0/606910765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf70071f50 0x7fcf70070460 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:00.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.224+0000 7fcf75600700 1 -- 172.21.15.81:0/606910765 >> 172.21.15.81:0/606910765 conn(0x7fcf700f8530 msgr2=0x7fcf700fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:00.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.224+0000 7fcf75600700 1 -- 172.21.15.81:0/606910765 shutdown_connections 2024-04-23T14:58:00.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.224+0000 7fcf75600700 1 -- 172.21.15.81:0/606910765 wait complete. 2024-04-23T14:58:00.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.225+0000 7fcf75600700 1 Processor -- start 2024-04-23T14:58:00.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.225+0000 7fcf75600700 1 -- start start 2024-04-23T14:58:00.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.225+0000 7fcf75600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf700709a0 0x7fcf70114090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:00.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.225+0000 7fcf75600700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf70071f50 0x7fcf701145d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:00.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.225+0000 7fcf75600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf70114bd0 con 0x7fcf700709a0 2024-04-23T14:58:00.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.225+0000 7fcf75600700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf70115420 con 0x7fcf70071f50 2024-04-23T14:58:00.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.226+0000 7fcf6ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf700709a0 0x7fcf70114090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:00.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.226+0000 7fcf6ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf700709a0 0x7fcf70114090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40632/0 (socket says 172.21.15.81:40632) 2024-04-23T14:58:00.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.226+0000 7fcf6ea00700 1 -- 172.21.15.81:0/1856806986 learned_addr learned my addr 172.21.15.81:0/1856806986 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:58:00.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.226+0000 7fcf6ea00700 1 -- 172.21.15.81:0/1856806986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf70071f50 msgr2=0x7fcf701145d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:00.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.226+0000 7fcf6ea00700 1 --2- 172.21.15.81:0/1856806986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf70071f50 0x7fcf701145d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:00.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.226+0000 7fcf6ea00700 1 -- 172.21.15.81:0/1856806986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf60005040 con 0x7fcf700709a0 2024-04-23T14:58:00.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.226+0000 7fcf6ea00700 1 --2- 172.21.15.81:0/1856806986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf700709a0 0x7fcf70114090 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcf6000b970 tx=0x7fcf60009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:00.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.227+0000 7fcf66a00700 1 -- 172.21.15.81:0/1856806986 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf6000e040 con 0x7fcf700709a0 2024-04-23T14:58:00.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.227+0000 7fcf66a00700 1 -- 172.21.15.81:0/1856806986 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcf60004290 con 0x7fcf700709a0 2024-04-23T14:58:00.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.227+0000 7fcf66a00700 1 -- 172.21.15.81:0/1856806986 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf6001c630 con 0x7fcf700709a0 2024-04-23T14:58:00.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.227+0000 7fcf75600700 1 -- 172.21.15.81:0/1856806986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf701156a0 con 0x7fcf700709a0 2024-04-23T14:58:00.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.227+0000 7fcf75600700 1 -- 172.21.15.81:0/1856806986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf70115be0 con 0x7fcf700709a0 2024-04-23T14:58:00.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.228+0000 7fcf75600700 1 -- 172.21.15.81:0/1856806986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf7005f5f0 con 0x7fcf700709a0 2024-04-23T14:58:00.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.229+0000 7fcf66a00700 1 -- 172.21.15.81:0/1856806986 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fcf6000bbf0 con 0x7fcf700709a0 2024-04-23T14:58:00.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.230+0000 7fcf66a00700 1 --2- 172.21.15.81:0/1856806986 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fcf5406ec10 0x7fcf540710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:00.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.230+0000 7fcf66a00700 1 -- 172.21.15.81:0/1856806986 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fcf6008fb70 con 0x7fcf700709a0 2024-04-23T14:58:00.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.231+0000 7fcf6e000700 1 --2- 172.21.15.81:0/1856806986 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fcf5406ec10 0x7fcf540710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:00.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.231+0000 7fcf6e000700 1 --2- 172.21.15.81:0/1856806986 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fcf5406ec10 0x7fcf540710c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c004b70 tx=0x7fcf5c007cc0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:00.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.235+0000 7fcf66a00700 1 -- 172.21.15.81:0/1856806986 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fcf6005c500 con 0x7fcf700709a0 2024-04-23T14:58:00.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.480+0000 7fcf75600700 1 -- 172.21.15.81:0/1856806986 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf70116020 con 0x7fcf5406ec10 2024-04-23T14:58:00.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.481+0000 7fcf66a00700 1 -- 172.21.15.81:0/1856806986 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fcf70116020 con 0x7fcf5406ec10 2024-04-23T14:58:00.483 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:58:00.483 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd", 2024-04-23T14:58:00.483 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-04-23T14:58:00.483 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-23T14:58:00.483 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [ 2024-04-23T14:58:00.483 INFO:teuthology.orchestra.run.smithi081.stdout: "mon", 2024-04-23T14:58:00.483 INFO:teuthology.orchestra.run.smithi081.stdout: "osd", 2024-04-23T14:58:00.483 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-04-23T14:58:00.483 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr" 2024-04-23T14:58:00.483 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-04-23T14:58:00.483 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "13/21 daemons upgraded", 2024-04-23T14:58:00.483 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "Currently upgrading mds daemons", 2024-04-23T14:58:00.483 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-04-23T14:58:00.483 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:58:00.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.484+0000 7fcf75600700 1 -- 172.21.15.81:0/1856806986 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fcf5406ec10 msgr2=0x7fcf540710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:00.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.484+0000 7fcf75600700 1 --2- 172.21.15.81:0/1856806986 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fcf5406ec10 0x7fcf540710c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c004b70 tx=0x7fcf5c007cc0 comp rx=0 tx=0).stop 2024-04-23T14:58:00.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.484+0000 7fcf75600700 1 -- 172.21.15.81:0/1856806986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf700709a0 msgr2=0x7fcf70114090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:00.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.484+0000 7fcf75600700 1 --2- 172.21.15.81:0/1856806986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf700709a0 0x7fcf70114090 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcf6000b970 tx=0x7fcf60009e30 comp rx=0 tx=0).stop 2024-04-23T14:58:00.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.484+0000 7fcf75600700 1 -- 172.21.15.81:0/1856806986 shutdown_connections 2024-04-23T14:58:00.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.485+0000 7fcf75600700 1 --2- 172.21.15.81:0/1856806986 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fcf5406ec10 0x7fcf540710c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:00.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.485+0000 7fcf75600700 1 --2- 172.21.15.81:0/1856806986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf700709a0 0x7fcf70114090 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:00.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.485+0000 7fcf75600700 1 --2- 172.21.15.81:0/1856806986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf70071f50 0x7fcf701145d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:00.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.485+0000 7fcf75600700 1 -- 172.21.15.81:0/1856806986 >> 172.21.15.81:0/1856806986 conn(0x7fcf700f8530 msgr2=0x7fcf700f9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:00.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.485+0000 7fcf75600700 1 -- 172.21.15.81:0/1856806986 shutdown_connections 2024-04-23T14:58:00.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.485+0000 7fcf75600700 1 -- 172.21.15.81:0/1856806986 wait complete. 2024-04-23T14:58:00.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.652+0000 7f6ccb200700 1 -- 172.21.15.81:0/268010222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cc40fcef0 msgr2=0x7f6cc40fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:00.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.652+0000 7f6ccb200700 1 --2- 172.21.15.81:0/268010222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cc40fcef0 0x7f6cc40fd320 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6cb4004940 tx=0x7f6cb4009e30 comp rx=0 tx=0).stop 2024-04-23T14:58:00.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.652+0000 7f6ccb200700 1 -- 172.21.15.81:0/268010222 shutdown_connections 2024-04-23T14:58:00.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.652+0000 7f6ccb200700 1 --2- 172.21.15.81:0/268010222 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6cc40fe0e0 0x7f6cc40fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:00.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.652+0000 7f6ccb200700 1 --2- 172.21.15.81:0/268010222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cc40fcef0 0x7f6cc40fd320 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:00.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.652+0000 7f6ccb200700 1 -- 172.21.15.81:0/268010222 >> 172.21.15.81:0/268010222 conn(0x7f6cc40f8530 msgr2=0x7f6cc40fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:00.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.652+0000 7f6ccb200700 1 -- 172.21.15.81:0/268010222 shutdown_connections 2024-04-23T14:58:00.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.652+0000 7f6ccb200700 1 -- 172.21.15.81:0/268010222 wait complete. 2024-04-23T14:58:00.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.653+0000 7f6ccb200700 1 Processor -- start 2024-04-23T14:58:00.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.653+0000 7f6ccb200700 1 -- start start 2024-04-23T14:58:00.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.653+0000 7f6ccb200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6cc40fcef0 0x7f6cc410da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:00.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.654+0000 7f6ccb200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cc40fe0e0 0x7f6cc410dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:00.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.654+0000 7f6ccb200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc410e5c0 con 0x7f6cc40fe0e0 2024-04-23T14:58:00.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.654+0000 7f6ccb200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc410ee10 con 0x7f6cc40fcef0 2024-04-23T14:58:00.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.654+0000 7f6cc3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cc40fe0e0 0x7f6cc410dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:00.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.654+0000 7f6cc3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cc40fe0e0 0x7f6cc410dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40662/0 (socket says 172.21.15.81:40662) 2024-04-23T14:58:00.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.654+0000 7f6cc3400700 1 -- 172.21.15.81:0/4100246359 learned_addr learned my addr 172.21.15.81:0/4100246359 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:58:00.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.654+0000 7f6cc3e00700 1 --2- 172.21.15.81:0/4100246359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6cc40fcef0 0x7f6cc410da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:00.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.654+0000 7f6cc3400700 1 -- 172.21.15.81:0/4100246359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6cc40fcef0 msgr2=0x7f6cc410da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:00.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.654+0000 7f6cc3400700 1 --2- 172.21.15.81:0/4100246359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6cc40fcef0 0x7f6cc410da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:00.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.654+0000 7f6cc3400700 1 -- 172.21.15.81:0/4100246359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb4005040 con 0x7f6cc40fe0e0 2024-04-23T14:58:00.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.654+0000 7f6cc3e00700 1 --2- 172.21.15.81:0/4100246359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6cc40fcef0 0x7f6cc410da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:58:00.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.655+0000 7f6cc3400700 1 --2- 172.21.15.81:0/4100246359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cc40fe0e0 0x7f6cc410dfc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6cb000c830 tx=0x7f6cb0004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:00.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.655+0000 7f6cbbe00700 1 -- 172.21.15.81:0/4100246359 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cb000a760 con 0x7f6cc40fe0e0 2024-04-23T14:58:00.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.655+0000 7f6cbbe00700 1 -- 172.21.15.81:0/4100246359 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6cb000ad90 con 0x7f6cc40fe0e0 2024-04-23T14:58:00.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.655+0000 7f6ccb200700 1 -- 172.21.15.81:0/4100246359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cc410f0f0 con 0x7f6cc40fe0e0 2024-04-23T14:58:00.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.655+0000 7f6cbbe00700 1 -- 172.21.15.81:0/4100246359 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cb00113a0 con 0x7f6cc40fe0e0 2024-04-23T14:58:00.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.655+0000 7f6ccb200700 1 -- 172.21.15.81:0/4100246359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cc410f630 con 0x7f6cc40fe0e0 2024-04-23T14:58:00.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.656+0000 7f6ccb200700 1 -- 172.21.15.81:0/4100246359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cc405f5f0 con 0x7f6cc40fe0e0 2024-04-23T14:58:00.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.658+0000 7f6cbbe00700 1 -- 172.21.15.81:0/4100246359 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f6cb0012400 con 0x7f6cc40fe0e0 2024-04-23T14:58:00.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.658+0000 7f6cbbe00700 1 --2- 172.21.15.81:0/4100246359 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6ca806ec10 0x7f6ca80710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:00.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.658+0000 7f6cbbe00700 1 -- 172.21.15.81:0/4100246359 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f6cb008e8a0 con 0x7f6cc40fe0e0 2024-04-23T14:58:00.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.659+0000 7f6cc3e00700 1 --2- 172.21.15.81:0/4100246359 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6ca806ec10 0x7f6ca80710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:00.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.659+0000 7f6cc3e00700 1 --2- 172.21.15.81:0/4100246359 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6ca806ec10 0x7f6ca80710c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6cb4004f90 tx=0x7f6cb4009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:00.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.665+0000 7f6cbbe00700 1 -- 172.21.15.81:0/4100246359 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f6cb005b250 con 0x7f6cc40fe0e0 2024-04-23T14:58:00.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:00 smithi081 ceph-mon[90469]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:58:00.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:00 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/2650708461' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:58:00.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:00 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:00.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:00 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:00.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:00 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:58:00.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:00 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:58:00.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:00 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:00.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:00 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:58:00.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:00 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:58:00.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:00 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:58:00.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:00 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:58:00.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:00 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:58:00.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:00 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi081.vcoywg"]}]: dispatch 2024-04-23T14:58:00.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.974+0000 7f6ccb200700 1 -- 172.21.15.81:0/4100246359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6cc404bed0 con 0x7f6cc40fe0e0 2024-04-23T14:58:00.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.975+0000 7f6cbbe00700 1 -- 172.21.15.81:0/4100246359 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f6cb005ade0 con 0x7f6cc40fe0e0 2024-04-23T14:58:00.976 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-04-23T14:58:00.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.977+0000 7f6ccb200700 1 -- 172.21.15.81:0/4100246359 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6ca806ec10 msgr2=0x7f6ca80710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:00.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.977+0000 7f6ccb200700 1 --2- 172.21.15.81:0/4100246359 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6ca806ec10 0x7f6ca80710c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6cb4004f90 tx=0x7f6cb4009e30 comp rx=0 tx=0).stop 2024-04-23T14:58:00.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.978+0000 7f6ccb200700 1 -- 172.21.15.81:0/4100246359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cc40fe0e0 msgr2=0x7f6cc410dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:00.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.978+0000 7f6ccb200700 1 --2- 172.21.15.81:0/4100246359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cc40fe0e0 0x7f6cc410dfc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6cb000c830 tx=0x7f6cb0004470 comp rx=0 tx=0).stop 2024-04-23T14:58:00.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.978+0000 7f6ccb200700 1 -- 172.21.15.81:0/4100246359 shutdown_connections 2024-04-23T14:58:00.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.978+0000 7f6ccb200700 1 --2- 172.21.15.81:0/4100246359 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6ca806ec10 0x7f6ca80710c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:00.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.978+0000 7f6ccb200700 1 --2- 172.21.15.81:0/4100246359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6cc40fcef0 0x7f6cc410da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:00.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.978+0000 7f6ccb200700 1 --2- 172.21.15.81:0/4100246359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cc40fe0e0 0x7f6cc410dfc0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:00.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.978+0000 7f6ccb200700 1 -- 172.21.15.81:0/4100246359 >> 172.21.15.81:0/4100246359 conn(0x7f6cc40f8530 msgr2=0x7f6cc40f9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:00.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.978+0000 7f6ccb200700 1 -- 172.21.15.81:0/4100246359 shutdown_connections 2024-04-23T14:58:00.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:00.978+0000 7f6ccb200700 1 -- 172.21.15.81:0/4100246359 wait complete. 2024-04-23T14:58:01.017 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:00 smithi156 ceph-mon[77738]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:58:01.017 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:00 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/2650708461' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:58:01.017 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:00 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:01.017 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:00 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:01.017 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:00 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:58:01.017 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:00 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:58:01.017 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:00 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:01.017 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:00 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:58:01.018 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:00 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:58:01.018 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:00 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:58:01.018 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:00 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:58:01.018 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:00 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:58:01.018 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:00 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi081.vcoywg"]}]: dispatch 2024-04-23T14:58:01.916 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:01 smithi081 ceph-mon[90469]: Detected new or changed devices on smithi081 2024-04-23T14:58:01.916 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:01 smithi081 ceph-mon[90469]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:58:01.916 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:01 smithi081 ceph-mon[90469]: Upgrade: It appears safe to stop mds.cephfs.smithi081.vcoywg 2024-04-23T14:58:01.916 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:01 smithi081 ceph-mon[90469]: pgmap v203: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:58:01.916 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:01 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/4100246359' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:58:01.916 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:01 smithi156 ceph-mon[77738]: Detected new or changed devices on smithi081 2024-04-23T14:58:01.916 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:01 smithi156 ceph-mon[77738]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:58:01.917 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:01 smithi156 ceph-mon[77738]: Upgrade: It appears safe to stop mds.cephfs.smithi081.vcoywg 2024-04-23T14:58:01.917 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:01 smithi156 ceph-mon[77738]: pgmap v203: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:58:01.917 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:01 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/4100246359' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:58:03.856 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:03 smithi081 ceph-mon[90469]: pgmap v204: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:58:03.856 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:03 smithi081 ceph-mon[90469]: Upgrade: Updating mds.cephfs.smithi081.vcoywg 2024-04-23T14:58:03.856 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:03 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:03.856 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:03 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi081.vcoywg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:58:03.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:03 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:58:03.857 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:03 smithi081 ceph-mon[90469]: Deploying daemon mds.cephfs.smithi081.vcoywg on smithi081 2024-04-23T14:58:04.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:03 smithi156 ceph-mon[77738]: pgmap v204: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:58:04.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:03 smithi156 ceph-mon[77738]: Upgrade: Updating mds.cephfs.smithi081.vcoywg 2024-04-23T14:58:04.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:03 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:04.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:03 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi081.vcoywg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:58:04.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:03 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:58:04.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:03 smithi156 ceph-mon[77738]: Deploying daemon mds.cephfs.smithi081.vcoywg on smithi081 2024-04-23T14:58:06.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:05 smithi156 ceph-mon[77738]: pgmap v205: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:58:06.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:05 smithi081 ceph-mon[90469]: pgmap v205: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:58:06.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:05 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi081[90465]: 2024-04-23T14:58:05.874+0000 7fb386a00700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-23T14:58:07.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:06 smithi156 ceph-mon[77738]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-23T14:58:07.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:06 smithi156 ceph-mon[77738]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-23T14:58:07.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:06 smithi156 ceph-mon[77738]: osdmap e84: 6 total, 6 up, 6 in 2024-04-23T14:58:07.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:06 smithi156 ceph-mon[77738]: Standby daemon mds.cephfs.smithi156.vynkxn assigned to filesystem cephfs as rank 0 2024-04-23T14:58:07.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:06 smithi156 ceph-mon[77738]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-23T14:58:07.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:06 smithi156 ceph-mon[77738]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-23T14:58:07.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:06 smithi156 ceph-mon[77738]: fsmap cephfs:1/1 {0=cephfs.smithi156.vynkxn=up:replay} 2 up:standby 2024-04-23T14:58:07.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:06 smithi081 ceph-mon[90469]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-23T14:58:07.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:06 smithi081 ceph-mon[90469]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-23T14:58:07.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:06 smithi081 ceph-mon[90469]: osdmap e84: 6 total, 6 up, 6 in 2024-04-23T14:58:07.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:06 smithi081 ceph-mon[90469]: Standby daemon mds.cephfs.smithi156.vynkxn assigned to filesystem cephfs as rank 0 2024-04-23T14:58:07.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:06 smithi081 ceph-mon[90469]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-23T14:58:07.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:06 smithi081 ceph-mon[90469]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-23T14:58:07.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:06 smithi081 ceph-mon[90469]: fsmap cephfs:1/1 {0=cephfs.smithi156.vynkxn=up:replay} 2 up:standby 2024-04-23T14:58:07.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:07 smithi081 ceph-mon[90469]: pgmap v207: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 102 B/s rd, 0 op/s 2024-04-23T14:58:07.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:07 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi081.vcoywg"}]: dispatch 2024-04-23T14:58:08.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:07 smithi156 ceph-mon[77738]: pgmap v207: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 102 B/s rd, 0 op/s 2024-04-23T14:58:08.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:07 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi081.vcoywg"}]: dispatch 2024-04-23T14:58:10.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:09 smithi156 ceph-mon[77738]: pgmap v208: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 0 op/s 2024-04-23T14:58:10.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:09 smithi081 ceph-mon[90469]: pgmap v208: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 0 op/s 2024-04-23T14:58:12.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:11 smithi156 ceph-mon[77738]: pgmap v209: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4 op/s 2024-04-23T14:58:12.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:11 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:12.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:11 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:58:12.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:11 smithi081 ceph-mon[90469]: pgmap v209: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4 op/s 2024-04-23T14:58:12.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:11 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:12.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:11 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:58:14.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:13 smithi156 ceph-mon[77738]: pgmap v210: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-04-23T14:58:14.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:13 smithi081 ceph-mon[90469]: pgmap v210: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-04-23T14:58:15.809 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:15 smithi081 ceph-mon[90469]: pgmap v211: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-04-23T14:58:15.809 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:15 smithi081 ceph-mon[90469]: mds.? [v2:172.21.15.156:6826/1794690362,v1:172.21.15.156:6827/1794690362] up:reconnect 2024-04-23T14:58:15.809 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:15 smithi081 ceph-mon[90469]: fsmap cephfs:1/1 {0=cephfs.smithi156.vynkxn=up:reconnect} 2 up:standby 2024-04-23T14:58:15.810 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:15 smithi081 ceph-mon[90469]: reconnect by client.14524 v1:192.168.0.1:0/2829014833 after 0.00899987 2024-04-23T14:58:15.810 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:15 smithi081 ceph-mon[90469]: reconnect by client.14530 v1:172.21.15.156:0/596389174 after 0.00999985 2024-04-23T14:58:15.810 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:15 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:15.810 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:15 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:15.810 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:15 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:58:16.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:15 smithi156 ceph-mon[77738]: pgmap v211: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-04-23T14:58:16.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:15 smithi156 ceph-mon[77738]: mds.? [v2:172.21.15.156:6826/1794690362,v1:172.21.15.156:6827/1794690362] up:reconnect 2024-04-23T14:58:16.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:15 smithi156 ceph-mon[77738]: fsmap cephfs:1/1 {0=cephfs.smithi156.vynkxn=up:reconnect} 2 up:standby 2024-04-23T14:58:16.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:15 smithi156 ceph-mon[77738]: reconnect by client.14524 v1:192.168.0.1:0/2829014833 after 0.00899987 2024-04-23T14:58:16.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:15 smithi156 ceph-mon[77738]: reconnect by client.14530 v1:172.21.15.156:0/596389174 after 0.00999985 2024-04-23T14:58:16.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:15 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:16.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:15 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:16.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:15 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:58:16.971 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:16 smithi156 ceph-mon[77738]: mds.? [v2:172.21.15.156:6826/1794690362,v1:172.21.15.156:6827/1794690362] up:rejoin 2024-04-23T14:58:16.972 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:16 smithi156 ceph-mon[77738]: mds.? [v2:172.21.15.81:6828/2598630159,v1:172.21.15.81:6829/2598630159] up:boot 2024-04-23T14:58:16.972 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:16 smithi156 ceph-mon[77738]: fsmap cephfs:1/1 {0=cephfs.smithi156.vynkxn=up:rejoin} 3 up:standby 2024-04-23T14:58:16.972 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:16 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi081.vcoywg"}]: dispatch 2024-04-23T14:58:16.972 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:16 smithi156 ceph-mon[77738]: daemon mds.cephfs.smithi156.vynkxn is now active in filesystem cephfs as rank 0 2024-04-23T14:58:17.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:16 smithi081 ceph-mon[90469]: mds.? [v2:172.21.15.156:6826/1794690362,v1:172.21.15.156:6827/1794690362] up:rejoin 2024-04-23T14:58:17.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:16 smithi081 ceph-mon[90469]: mds.? [v2:172.21.15.81:6828/2598630159,v1:172.21.15.81:6829/2598630159] up:boot 2024-04-23T14:58:17.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:16 smithi081 ceph-mon[90469]: fsmap cephfs:1/1 {0=cephfs.smithi156.vynkxn=up:rejoin} 3 up:standby 2024-04-23T14:58:17.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:16 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi081.vcoywg"}]: dispatch 2024-04-23T14:58:17.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:16 smithi081 ceph-mon[90469]: daemon mds.cephfs.smithi156.vynkxn is now active in filesystem cephfs as rank 0 2024-04-23T14:58:17.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:17 smithi156 ceph-mon[77738]: pgmap v212: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-04-23T14:58:17.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:17 smithi156 ceph-mon[77738]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-23T14:58:17.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:17 smithi156 ceph-mon[77738]: Cluster is now healthy 2024-04-23T14:58:17.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:17 smithi156 ceph-mon[77738]: mds.? [v2:172.21.15.156:6826/1794690362,v1:172.21.15.156:6827/1794690362] up:active 2024-04-23T14:58:17.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:17 smithi156 ceph-mon[77738]: fsmap cephfs:1 {0=cephfs.smithi156.vynkxn=up:active} 3 up:standby 2024-04-23T14:58:17.810 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:17 smithi081 ceph-mon[90469]: pgmap v212: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-04-23T14:58:17.810 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:17 smithi081 ceph-mon[90469]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-23T14:58:17.810 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:17 smithi081 ceph-mon[90469]: Cluster is now healthy 2024-04-23T14:58:17.810 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:17 smithi081 ceph-mon[90469]: mds.? [v2:172.21.15.156:6826/1794690362,v1:172.21.15.156:6827/1794690362] up:active 2024-04-23T14:58:17.810 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:17 smithi081 ceph-mon[90469]: fsmap cephfs:1 {0=cephfs.smithi156.vynkxn=up:active} 3 up:standby 2024-04-23T14:58:19.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:18 smithi081 ceph-mon[90469]: pgmap v213: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 85 B/s wr, 5 op/s 2024-04-23T14:58:19.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:18 smithi156 ceph-mon[77738]: pgmap v213: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 85 B/s wr, 5 op/s 2024-04-23T14:58:22.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:21 smithi156 ceph-mon[77738]: pgmap v214: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 426 B/s wr, 7 op/s 2024-04-23T14:58:22.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:21 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:22.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:21 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:22.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:21 smithi081 ceph-mon[90469]: pgmap v214: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 426 B/s wr, 7 op/s 2024-04-23T14:58:22.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:21 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:22.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:21 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:24.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:23 smithi156 ceph-mon[77738]: pgmap v215: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 6.8 MiB/s rd, 426 B/s wr, 5 op/s 2024-04-23T14:58:24.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:23 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:24.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:23 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:24.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:23 smithi081 ceph-mon[90469]: pgmap v215: 65 pgs: 65 active+clean; 197 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 6.8 MiB/s rd, 426 B/s wr, 5 op/s 2024-04-23T14:58:24.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:23 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:24.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:23 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:26.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:25 smithi156 ceph-mon[77738]: pgmap v216: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 6.5 MiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-04-23T14:58:26.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:25 smithi081 ceph-mon[90469]: pgmap v216: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 6.5 MiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-04-23T14:58:27.766 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:27 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:27.766 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:27 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:58:27.766 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:27 smithi081 ceph-mon[90469]: pgmap v217: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 345 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-04-23T14:58:27.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:27 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:27.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:27 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:58:27.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:27 smithi156 ceph-mon[77738]: pgmap v217: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 345 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-04-23T14:58:30.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:29 smithi156 ceph-mon[77738]: pgmap v218: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 345 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-04-23T14:58:30.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:29 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:30.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:29 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:30.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:29 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:58:30.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:29 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:58:30.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:29 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:30.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:29 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:58:30.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:29 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:58:30.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:29 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:58:30.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:29 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:58:30.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:29 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:58:30.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:29 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi156.rhbtxt"]}]: dispatch 2024-04-23T14:58:30.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:29 smithi081 ceph-mon[90469]: pgmap v218: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 345 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-04-23T14:58:30.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:29 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:30.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:29 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:30.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:29 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:58:30.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:29 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:58:30.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:29 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:30.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:29 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:58:30.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:29 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:58:30.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:29 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:58:30.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:29 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:58:30.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:29 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:58:30.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:29 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi156.rhbtxt"]}]: dispatch 2024-04-23T14:58:30.747 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:30 smithi156 ceph-mon[77738]: Upgrade: It appears safe to stop mds.cephfs.smithi156.rhbtxt 2024-04-23T14:58:31.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:30 smithi081 ceph-mon[90469]: Upgrade: It appears safe to stop mds.cephfs.smithi156.rhbtxt 2024-04-23T14:58:31.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.145+0000 7feb61800700 1 -- 172.21.15.81:0/2643094043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb5c1002b0 msgr2=0x7feb5c100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:31.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.145+0000 7feb61800700 1 --2- 172.21.15.81:0/2643094043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb5c1002b0 0x7feb5c100720 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7feb48004940 tx=0x7feb48009e30 comp rx=0 tx=0).stop 2024-04-23T14:58:31.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.145+0000 7feb61800700 1 -- 172.21.15.81:0/2643094043 shutdown_connections 2024-04-23T14:58:31.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.145+0000 7feb61800700 1 --2- 172.21.15.81:0/2643094043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb5c1002b0 0x7feb5c100720 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:31.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.145+0000 7feb61800700 1 --2- 172.21.15.81:0/2643094043 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb5c0ff000 0x7feb5c0ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:31.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.145+0000 7feb61800700 1 -- 172.21.15.81:0/2643094043 >> 172.21.15.81:0/2643094043 conn(0x7feb5c0fa790 msgr2=0x7feb5c0fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:31.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.145+0000 7feb61800700 1 -- 172.21.15.81:0/2643094043 shutdown_connections 2024-04-23T14:58:31.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.145+0000 7feb61800700 1 -- 172.21.15.81:0/2643094043 wait complete. 2024-04-23T14:58:31.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.146+0000 7feb61800700 1 Processor -- start 2024-04-23T14:58:31.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.146+0000 7feb61800700 1 -- start start 2024-04-23T14:58:31.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.147+0000 7feb61800700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb5c0ff000 0x7feb5c10fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:31.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.147+0000 7feb61800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb5c1002b0 0x7feb5c110070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:31.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.147+0000 7feb61800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5c110670 con 0x7feb5c1002b0 2024-04-23T14:58:31.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.147+0000 7feb61800700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5c1107e0 con 0x7feb5c0ff000 2024-04-23T14:58:31.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.147+0000 7feb5a000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb5c1002b0 0x7feb5c110070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:31.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.147+0000 7feb5a000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb5c1002b0 0x7feb5c110070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57276/0 (socket says 172.21.15.81:57276) 2024-04-23T14:58:31.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.147+0000 7feb5a000700 1 -- 172.21.15.81:0/3823166302 learned_addr learned my addr 172.21.15.81:0/3823166302 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:58:31.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.147+0000 7feb5aa00700 1 --2- 172.21.15.81:0/3823166302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb5c0ff000 0x7feb5c10fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:31.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.148+0000 7feb5a000700 1 -- 172.21.15.81:0/3823166302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb5c0ff000 msgr2=0x7feb5c10fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:31.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.148+0000 7feb5a000700 1 --2- 172.21.15.81:0/3823166302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb5c0ff000 0x7feb5c10fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:31.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.148+0000 7feb5a000700 1 -- 172.21.15.81:0/3823166302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb48005040 con 0x7feb5c1002b0 2024-04-23T14:58:31.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.148+0000 7feb5a000700 1 --2- 172.21.15.81:0/3823166302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb5c1002b0 0x7feb5c110070 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7feb48009150 tx=0x7feb48009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:31.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.148+0000 7feb52a00700 1 -- 172.21.15.81:0/3823166302 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb4800e040 con 0x7feb5c1002b0 2024-04-23T14:58:31.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.148+0000 7feb52a00700 1 -- 172.21.15.81:0/3823166302 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feb4800bbf0 con 0x7feb5c1002b0 2024-04-23T14:58:31.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.148+0000 7feb61800700 1 -- 172.21.15.81:0/3823166302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb5c1151e0 con 0x7feb5c1002b0 2024-04-23T14:58:31.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.148+0000 7feb52a00700 1 -- 172.21.15.81:0/3823166302 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb4801c630 con 0x7feb5c1002b0 2024-04-23T14:58:31.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.148+0000 7feb61800700 1 -- 172.21.15.81:0/3823166302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb5c1157a0 con 0x7feb5c1002b0 2024-04-23T14:58:31.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.150+0000 7feb61800700 1 -- 172.21.15.81:0/3823166302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb5c04c710 con 0x7feb5c1002b0 2024-04-23T14:58:31.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.151+0000 7feb52a00700 1 -- 172.21.15.81:0/3823166302 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7feb4800bd60 con 0x7feb5c1002b0 2024-04-23T14:58:31.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.151+0000 7feb52a00700 1 --2- 172.21.15.81:0/3823166302 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7feb4006ec00 0x7feb400710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:31.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.152+0000 7feb52a00700 1 -- 172.21.15.81:0/3823166302 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7feb4808fd50 con 0x7feb5c1002b0 2024-04-23T14:58:31.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.152+0000 7feb5aa00700 1 --2- 172.21.15.81:0/3823166302 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7feb4006ec00 0x7feb400710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:31.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.152+0000 7feb5aa00700 1 --2- 172.21.15.81:0/3823166302 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7feb4006ec00 0x7feb400710b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7feb4c004c40 tx=0x7feb4c009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:31.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.157+0000 7feb52a00700 1 -- 172.21.15.81:0/3823166302 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7feb4805c630 con 0x7feb5c1002b0 2024-04-23T14:58:31.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.406+0000 7feb61800700 1 -- 172.21.15.81:0/3823166302 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7feb5c04c710 con 0x7feb4006ec00 2024-04-23T14:58:31.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.409+0000 7feb52a00700 1 -- 172.21.15.81:0/3823166302 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7feb5c04c710 con 0x7feb4006ec00 2024-04-23T14:58:31.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.412+0000 7feb61800700 1 -- 172.21.15.81:0/3823166302 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7feb4006ec00 msgr2=0x7feb400710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:31.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.413+0000 7feb61800700 1 --2- 172.21.15.81:0/3823166302 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7feb4006ec00 0x7feb400710b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7feb4c004c40 tx=0x7feb4c009040 comp rx=0 tx=0).stop 2024-04-23T14:58:31.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.413+0000 7feb61800700 1 -- 172.21.15.81:0/3823166302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb5c1002b0 msgr2=0x7feb5c110070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:31.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.413+0000 7feb61800700 1 --2- 172.21.15.81:0/3823166302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb5c1002b0 0x7feb5c110070 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7feb48009150 tx=0x7feb48009e30 comp rx=0 tx=0).stop 2024-04-23T14:58:31.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.413+0000 7feb61800700 1 -- 172.21.15.81:0/3823166302 shutdown_connections 2024-04-23T14:58:31.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.413+0000 7feb61800700 1 --2- 172.21.15.81:0/3823166302 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7feb4006ec00 0x7feb400710b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:31.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.413+0000 7feb61800700 1 --2- 172.21.15.81:0/3823166302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb5c0ff000 0x7feb5c10fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:31.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.413+0000 7feb61800700 1 --2- 172.21.15.81:0/3823166302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb5c1002b0 0x7feb5c110070 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:31.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.413+0000 7feb61800700 1 -- 172.21.15.81:0/3823166302 >> 172.21.15.81:0/3823166302 conn(0x7feb5c0fa790 msgr2=0x7feb5c0fbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:31.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.413+0000 7feb61800700 1 -- 172.21.15.81:0/3823166302 shutdown_connections 2024-04-23T14:58:31.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.413+0000 7feb61800700 1 -- 172.21.15.81:0/3823166302 wait complete. 2024-04-23T14:58:31.429 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-04-23T14:58:31.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.569+0000 7f6100a00700 1 -- 172.21.15.81:0/2040398743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60fc071ea0 msgr2=0x7f60fc0703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:31.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.569+0000 7f6100a00700 1 --2- 172.21.15.81:0/2040398743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60fc071ea0 0x7f60fc0703b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f60ec004940 tx=0x7f60ec009e30 comp rx=0 tx=0).stop 2024-04-23T14:58:31.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.569+0000 7f6100a00700 1 -- 172.21.15.81:0/2040398743 shutdown_connections 2024-04-23T14:58:31.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.569+0000 7f6100a00700 1 --2- 172.21.15.81:0/2040398743 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60fc0708f0 0x7f60fc070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:31.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.569+0000 7f6100a00700 1 --2- 172.21.15.81:0/2040398743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60fc071ea0 0x7f60fc0703b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:31.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.569+0000 7f6100a00700 1 -- 172.21.15.81:0/2040398743 >> 172.21.15.81:0/2040398743 conn(0x7f60fc0f83d0 msgr2=0x7f60fc0fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:31.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.569+0000 7f6100a00700 1 -- 172.21.15.81:0/2040398743 shutdown_connections 2024-04-23T14:58:31.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.569+0000 7f6100a00700 1 -- 172.21.15.81:0/2040398743 wait complete. 2024-04-23T14:58:31.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.570+0000 7f6100a00700 1 Processor -- start 2024-04-23T14:58:31.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.570+0000 7f6100a00700 1 -- start start 2024-04-23T14:58:31.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.571+0000 7f6100a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60fc0708f0 0x7f60fc10fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:31.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.571+0000 7f6100a00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60fc071ea0 0x7f60fc10fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:31.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.571+0000 7f6100a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc110680 con 0x7f60fc0708f0 2024-04-23T14:58:31.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.571+0000 7f6100a00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc110e70 con 0x7f60fc071ea0 2024-04-23T14:58:31.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.571+0000 7f60fa800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60fc0708f0 0x7f60fc10fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:31.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.571+0000 7f60fa800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60fc0708f0 0x7f60fc10fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57294/0 (socket says 172.21.15.81:57294) 2024-04-23T14:58:31.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.571+0000 7f60fa800700 1 -- 172.21.15.81:0/642521215 learned_addr learned my addr 172.21.15.81:0/642521215 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:58:31.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.571+0000 7f60fa800700 1 -- 172.21.15.81:0/642521215 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60fc071ea0 msgr2=0x7f60fc10fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:31.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.571+0000 7f60fa800700 1 --2- 172.21.15.81:0/642521215 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60fc071ea0 0x7f60fc10fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:31.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.571+0000 7f60fa800700 1 -- 172.21.15.81:0/642521215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ec005040 con 0x7f60fc0708f0 2024-04-23T14:58:31.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.572+0000 7f60fa800700 1 --2- 172.21.15.81:0/642521215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60fc0708f0 0x7f60fc10fab0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f60ec00b970 tx=0x7f60ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:31.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.572+0000 7f60f3400700 1 -- 172.21.15.81:0/642521215 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60ec00e040 con 0x7f60fc0708f0 2024-04-23T14:58:31.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.572+0000 7f60f3400700 1 -- 172.21.15.81:0/642521215 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f60ec004290 con 0x7f60fc0708f0 2024-04-23T14:58:31.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.572+0000 7f60f3400700 1 -- 172.21.15.81:0/642521215 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60ec01c630 con 0x7f60fc0708f0 2024-04-23T14:58:31.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.572+0000 7f6100a00700 1 -- 172.21.15.81:0/642521215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60fc1110f0 con 0x7f60fc0708f0 2024-04-23T14:58:31.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.572+0000 7f6100a00700 1 -- 172.21.15.81:0/642521215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60fc1116b0 con 0x7f60fc0708f0 2024-04-23T14:58:31.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.573+0000 7f60ebe00700 1 -- 172.21.15.81:0/642521215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60fc05f5f0 con 0x7f60fc0708f0 2024-04-23T14:58:31.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.574+0000 7f60f3400700 1 -- 172.21.15.81:0/642521215 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f60ec00bbf0 con 0x7f60fc0708f0 2024-04-23T14:58:31.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.575+0000 7f60f3400700 1 --2- 172.21.15.81:0/642521215 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f60e006ec10 0x7f60e00710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:31.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.575+0000 7f60f3400700 1 -- 172.21.15.81:0/642521215 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f60ec08fba0 con 0x7f60fc0708f0 2024-04-23T14:58:31.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.576+0000 7f60f1e00700 1 --2- 172.21.15.81:0/642521215 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f60e006ec10 0x7f60e00710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:31.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.576+0000 7f60f1e00700 1 --2- 172.21.15.81:0/642521215 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f60e006ec10 0x7f60e00710c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f60e4006fd0 tx=0x7f60e4006db0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:31.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.581+0000 7f60f3400700 1 -- 172.21.15.81:0/642521215 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f60ec05c500 con 0x7f60fc0708f0 2024-04-23T14:58:31.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.832+0000 7f60ebe00700 1 -- 172.21.15.81:0/642521215 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f60fc107b40 con 0x7f60e006ec10 2024-04-23T14:58:31.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.834+0000 7f60f3400700 1 -- 172.21.15.81:0/642521215 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f60fc107b40 con 0x7f60e006ec10 2024-04-23T14:58:31.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.837+0000 7f60ebe00700 1 -- 172.21.15.81:0/642521215 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f60e006ec10 msgr2=0x7f60e00710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:31.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.837+0000 7f60ebe00700 1 --2- 172.21.15.81:0/642521215 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f60e006ec10 0x7f60e00710c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f60e4006fd0 tx=0x7f60e4006db0 comp rx=0 tx=0).stop 2024-04-23T14:58:31.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.837+0000 7f60ebe00700 1 -- 172.21.15.81:0/642521215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60fc0708f0 msgr2=0x7f60fc10fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:31.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.837+0000 7f60ebe00700 1 --2- 172.21.15.81:0/642521215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60fc0708f0 0x7f60fc10fab0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f60ec00b970 tx=0x7f60ec009e30 comp rx=0 tx=0).stop 2024-04-23T14:58:31.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.837+0000 7f60ebe00700 1 -- 172.21.15.81:0/642521215 shutdown_connections 2024-04-23T14:58:31.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.837+0000 7f60ebe00700 1 --2- 172.21.15.81:0/642521215 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f60e006ec10 0x7f60e00710c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:31.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.837+0000 7f60ebe00700 1 --2- 172.21.15.81:0/642521215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60fc0708f0 0x7f60fc10fab0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:31.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.837+0000 7f60ebe00700 1 --2- 172.21.15.81:0/642521215 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60fc071ea0 0x7f60fc10fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:31.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.837+0000 7f60ebe00700 1 -- 172.21.15.81:0/642521215 >> 172.21.15.81:0/642521215 conn(0x7f60fc0f83d0 msgr2=0x7f60fc0f9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:31.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.837+0000 7f60ebe00700 1 -- 172.21.15.81:0/642521215 shutdown_connections 2024-04-23T14:58:31.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.837+0000 7f60ebe00700 1 -- 172.21.15.81:0/642521215 wait complete. 2024-04-23T14:58:31.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.989+0000 7f529fe00700 1 -- 172.21.15.81:0/1842905146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52a00708f0 msgr2=0x7f52a0070d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:31.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.989+0000 7f529fe00700 1 --2- 172.21.15.81:0/1842905146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52a00708f0 0x7f52a0070d60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f528c004940 tx=0x7f528c009e30 comp rx=0 tx=0).stop 2024-04-23T14:58:31.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.989+0000 7f529fe00700 1 -- 172.21.15.81:0/1842905146 shutdown_connections 2024-04-23T14:58:31.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.989+0000 7f529fe00700 1 --2- 172.21.15.81:0/1842905146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52a00708f0 0x7f52a0070d60 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:31.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.989+0000 7f529fe00700 1 --2- 172.21.15.81:0/1842905146 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52a0071ea0 0x7f52a00703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:31.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.989+0000 7f529fe00700 1 -- 172.21.15.81:0/1842905146 >> 172.21.15.81:0/1842905146 conn(0x7f52a00f83d0 msgr2=0x7f52a00fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:31.990 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:31 smithi081 ceph-mon[90469]: pgmap v219: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 3.5 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-04-23T14:58:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.989+0000 7f529fe00700 1 -- 172.21.15.81:0/1842905146 shutdown_connections 2024-04-23T14:58:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.989+0000 7f529fe00700 1 -- 172.21.15.81:0/1842905146 wait complete. 2024-04-23T14:58:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.990+0000 7f529fe00700 1 Processor -- start 2024-04-23T14:58:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.990+0000 7f529fe00700 1 -- start start 2024-04-23T14:58:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.991+0000 7f529fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52a00708f0 0x7f52a010fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.991+0000 7f529fe00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52a0071ea0 0x7f52a010ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.991+0000 7f529fe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a01105d0 con 0x7f52a00708f0 2024-04-23T14:58:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.991+0000 7f529fe00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a0110e20 con 0x7f52a0071ea0 2024-04-23T14:58:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.991+0000 7f529ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52a00708f0 0x7f52a010fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:31.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.991+0000 7f529ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52a00708f0 0x7f52a010fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57300/0 (socket says 172.21.15.81:57300) 2024-04-23T14:58:31.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.991+0000 7f529ea00700 1 -- 172.21.15.81:0/3228390658 learned_addr learned my addr 172.21.15.81:0/3228390658 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:58:31.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.991+0000 7f529e000700 1 --2- 172.21.15.81:0/3228390658 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52a0071ea0 0x7f52a010ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:31.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.992+0000 7f529ea00700 1 -- 172.21.15.81:0/3228390658 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52a0071ea0 msgr2=0x7f52a010ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:31.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.992+0000 7f529ea00700 1 --2- 172.21.15.81:0/3228390658 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52a0071ea0 0x7f52a010ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:31.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.992+0000 7f529ea00700 1 -- 172.21.15.81:0/3228390658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f528c005040 con 0x7f52a00708f0 2024-04-23T14:58:31.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.992+0000 7f529ea00700 1 --2- 172.21.15.81:0/3228390658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52a00708f0 0x7f52a010fa90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5290002a80 tx=0x7f5290004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:31.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.992+0000 7f5296a00700 1 -- 172.21.15.81:0/3228390658 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5290007cc0 con 0x7f52a00708f0 2024-04-23T14:58:31.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.992+0000 7f5296a00700 1 -- 172.21.15.81:0/3228390658 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f529000f040 con 0x7f52a00708f0 2024-04-23T14:58:31.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.992+0000 7f529fe00700 1 -- 172.21.15.81:0/3228390658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52a0111100 con 0x7f52a00708f0 2024-04-23T14:58:31.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.992+0000 7f5296a00700 1 -- 172.21.15.81:0/3228390658 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f529000da30 con 0x7f52a00708f0 2024-04-23T14:58:31.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.992+0000 7f529fe00700 1 -- 172.21.15.81:0/3228390658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52a0111640 con 0x7f52a00708f0 2024-04-23T14:58:31.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.993+0000 7f529fe00700 1 -- 172.21.15.81:0/3228390658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52a005f5f0 con 0x7f52a00708f0 2024-04-23T14:58:31.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.995+0000 7f5296a00700 1 -- 172.21.15.81:0/3228390658 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f529000db90 con 0x7f52a00708f0 2024-04-23T14:58:31.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.996+0000 7f5296a00700 1 --2- 172.21.15.81:0/3228390658 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f528406ec10 0x7f52840710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:31.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.996+0000 7f5296a00700 1 -- 172.21.15.81:0/3228390658 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f529008e680 con 0x7f52a00708f0 2024-04-23T14:58:31.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.996+0000 7f529e000700 1 --2- 172.21.15.81:0/3228390658 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f528406ec10 0x7f52840710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:31.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:31.996+0000 7f529e000700 1 --2- 172.21.15.81:0/3228390658 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f528406ec10 0x7f52840710c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f528c00b3b0 tx=0x7f528c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:32.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.000+0000 7f5296a00700 1 -- 172.21.15.81:0/3228390658 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f529005aee0 con 0x7f52a00708f0 2024-04-23T14:58:32.035 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:31 smithi156 ceph-mon[77738]: pgmap v219: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 3.5 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-04-23T14:58:32.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.223+0000 7f529fe00700 1 -- 172.21.15.81:0/3228390658 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f52a0111a20 con 0x7f528406ec10 2024-04-23T14:58:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.253+0000 7f5296a00700 1 -- 172.21.15.81:0/3228390658 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f52a0111a20 con 0x7f528406ec10 2024-04-23T14:58:32.254 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-23T14:58:32.254 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (8m) 10s ago 19m 14.5M - 0.25.0 c8568f914cd2 63876b2abc27 2024-04-23T14:58:32.254 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (4m) 10s ago 19m 6665k - 19.0.0-3126-gd44fddd9 76e77f280c74 b486fe2ef19b 2024-04-23T14:58:32.254 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi156 smithi156 running (4m) 66s ago 18m 6656k - 19.0.0-3126-gd44fddd9 76e77f280c74 5d9aa5ecf264 2024-04-23T14:58:32.254 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (8m) 10s ago 19m 73.8M - 9.4.7 954c08fa6188 fbad3cef0883 2024-04-23T14:58:32.255 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.vcoywg smithi081 running (17s) 10s ago 12m 11.0M - 19.0.0-3126-gd44fddd9 76e77f280c74 87ab7708542f 2024-04-23T14:58:32.255 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.wydgcg smithi081 running (47s) 10s ago 12m 11.1M - 19.0.0-3126-gd44fddd9 76e77f280c74 e2a96404cc4f 2024-04-23T14:58:32.255 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.rhbtxt smithi156 running (12m) 66s ago 12m 14.5M - 17.2.7-884-g70d0cb4b cafd8ddac8fa db3cb5034381 2024-04-23T14:58:32.255 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.vynkxn smithi156 running (12m) 66s ago 12m 14.8M - 17.2.7-884-g70d0cb4b cafd8ddac8fa 1c8f2219e7fd 2024-04-23T14:58:32.255 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.ldghvq smithi081 *:8443,9283,8765 running (8m) 10s ago 21m 511M - 19.0.0-3126-gd44fddd9 76e77f280c74 6bf23484a1c9 2024-04-23T14:58:32.255 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi156.ounwyj smithi156 *:8443,9283,8765 running (6m) 66s ago 18m 452M - 19.0.0-3126-gd44fddd9 76e77f280c74 a6c0dd9f89f2 2024-04-23T14:58:32.255 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (6m) 10s ago 21m 53.0M 2048M 19.0.0-3126-gd44fddd9 76e77f280c74 fbf9f9a59ac2 2024-04-23T14:58:32.255 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi156 smithi156 running (5m) 66s ago 18m 35.9M 2048M 19.0.0-3126-gd44fddd9 76e77f280c74 36409886998f 2024-04-23T14:58:32.255 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (9m) 10s ago 19m 7940k - 1.5.0 0da6a335fe13 197b27809010 2024-04-23T14:58:32.255 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi156 smithi156 *:9100 running (8m) 66s ago 18m 8363k - 1.5.0 0da6a335fe13 91a7c5e86d47 2024-04-23T14:58:32.255 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (4m) 10s ago 17m 107M 1557M 19.0.0-3126-gd44fddd9 76e77f280c74 24bc24b37de5 2024-04-23T14:58:32.255 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (3m) 10s ago 16m 118M 1557M 19.0.0-3126-gd44fddd9 76e77f280c74 18d0179b558a 2024-04-23T14:58:32.255 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (3m) 10s ago 16m 95.2M 1557M 19.0.0-3126-gd44fddd9 76e77f280c74 421a62ef6990 2024-04-23T14:58:32.255 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi156 running (2m) 66s ago 15m 111M 2581M 19.0.0-3126-gd44fddd9 76e77f280c74 9af3ca1ff69b 2024-04-23T14:58:32.255 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi156 running (114s) 66s ago 15m 105M 2581M 19.0.0-3126-gd44fddd9 76e77f280c74 e0a1e784348c 2024-04-23T14:58:32.255 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi156 running (71s) 66s ago 14m 11.1M 2581M 19.0.0-3126-gd44fddd9 76e77f280c74 16b6ba5d9e3e 2024-04-23T14:58:32.256 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (6m) 10s ago 18m 58.1M - 2.43.0 a07b618ecd1d 35558adb166d 2024-04-23T14:58:32.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.257+0000 7f529fe00700 1 -- 172.21.15.81:0/3228390658 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f528406ec10 msgr2=0x7f52840710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:32.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.257+0000 7f529fe00700 1 --2- 172.21.15.81:0/3228390658 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f528406ec10 0x7f52840710c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f528c00b3b0 tx=0x7f528c009e30 comp rx=0 tx=0).stop 2024-04-23T14:58:32.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.257+0000 7f529fe00700 1 -- 172.21.15.81:0/3228390658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52a00708f0 msgr2=0x7f52a010fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:32.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.257+0000 7f529fe00700 1 --2- 172.21.15.81:0/3228390658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52a00708f0 0x7f52a010fa90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5290002a80 tx=0x7f5290004600 comp rx=0 tx=0).stop 2024-04-23T14:58:32.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.257+0000 7f529fe00700 1 -- 172.21.15.81:0/3228390658 shutdown_connections 2024-04-23T14:58:32.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.257+0000 7f529fe00700 1 --2- 172.21.15.81:0/3228390658 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f528406ec10 0x7f52840710c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:32.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.257+0000 7f529fe00700 1 --2- 172.21.15.81:0/3228390658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52a00708f0 0x7f52a010fa90 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:32.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.257+0000 7f529fe00700 1 --2- 172.21.15.81:0/3228390658 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52a0071ea0 0x7f52a010ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:32.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.257+0000 7f529fe00700 1 -- 172.21.15.81:0/3228390658 >> 172.21.15.81:0/3228390658 conn(0x7f52a00f83d0 msgr2=0x7f52a00f9ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:32.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.257+0000 7f529fe00700 1 -- 172.21.15.81:0/3228390658 shutdown_connections 2024-04-23T14:58:32.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.257+0000 7f529fe00700 1 -- 172.21.15.81:0/3228390658 wait complete. 2024-04-23T14:58:32.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.395+0000 7f24d3400700 1 -- 172.21.15.81:0/3581483022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24cc0fce80 msgr2=0x7f24cc0fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:32.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.395+0000 7f24d3400700 1 --2- 172.21.15.81:0/3581483022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24cc0fce80 0x7f24cc0fd290 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f24c0004940 tx=0x7f24c0009e30 comp rx=0 tx=0).stop 2024-04-23T14:58:32.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.395+0000 7f24d3400700 1 -- 172.21.15.81:0/3581483022 shutdown_connections 2024-04-23T14:58:32.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.395+0000 7f24d3400700 1 --2- 172.21.15.81:0/3581483022 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24cc0fdff0 0x7f24cc0fe460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:32.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.395+0000 7f24d3400700 1 --2- 172.21.15.81:0/3581483022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24cc0fce80 0x7f24cc0fd290 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:32.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.395+0000 7f24d3400700 1 -- 172.21.15.81:0/3581483022 >> 172.21.15.81:0/3581483022 conn(0x7f24cc0f8580 msgr2=0x7f24cc0fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:32.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.395+0000 7f24d3400700 1 -- 172.21.15.81:0/3581483022 shutdown_connections 2024-04-23T14:58:32.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.395+0000 7f24d3400700 1 -- 172.21.15.81:0/3581483022 wait complete. 2024-04-23T14:58:32.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.396+0000 7f24d3400700 1 Processor -- start 2024-04-23T14:58:32.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.396+0000 7f24d3400700 1 -- start start 2024-04-23T14:58:32.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.397+0000 7f24d3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24cc0fce80 0x7f24cc10fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:32.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.397+0000 7f24d3400700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24cc0fdff0 0x7f24cc110090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:32.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.397+0000 7f24d3400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc110690 con 0x7f24cc0fce80 2024-04-23T14:58:32.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.397+0000 7f24d3400700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc110800 con 0x7f24cc0fdff0 2024-04-23T14:58:32.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.397+0000 7f24d0a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24cc0fce80 0x7f24cc10fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:32.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.397+0000 7f24d0a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24cc0fce80 0x7f24cc10fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57318/0 (socket says 172.21.15.81:57318) 2024-04-23T14:58:32.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.397+0000 7f24d0a00700 1 -- 172.21.15.81:0/3092959383 learned_addr learned my addr 172.21.15.81:0/3092959383 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:58:32.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.397+0000 7f24d0a00700 1 -- 172.21.15.81:0/3092959383 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24cc0fdff0 msgr2=0x7f24cc110090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:32.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.397+0000 7f24d0a00700 1 --2- 172.21.15.81:0/3092959383 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24cc0fdff0 0x7f24cc110090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:32.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.397+0000 7f24d0a00700 1 -- 172.21.15.81:0/3092959383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c0005040 con 0x7f24cc0fce80 2024-04-23T14:58:32.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.398+0000 7f24d0a00700 1 --2- 172.21.15.81:0/3092959383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24cc0fce80 0x7f24cc10fb50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f24c000b3b0 tx=0x7f24c0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:32.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.398+0000 7f24c8c00700 1 -- 172.21.15.81:0/3092959383 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24c000e040 con 0x7f24cc0fce80 2024-04-23T14:58:32.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.398+0000 7f24c8c00700 1 -- 172.21.15.81:0/3092959383 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f24c0004290 con 0x7f24cc0fce80 2024-04-23T14:58:32.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.398+0000 7f24d3400700 1 -- 172.21.15.81:0/3092959383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24cc115200 con 0x7f24cc0fce80 2024-04-23T14:58:32.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.398+0000 7f24c8c00700 1 -- 172.21.15.81:0/3092959383 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24c001c630 con 0x7f24cc0fce80 2024-04-23T14:58:32.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.398+0000 7f24d3400700 1 -- 172.21.15.81:0/3092959383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24cc1157c0 con 0x7f24cc0fce80 2024-04-23T14:58:32.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.399+0000 7f24d3400700 1 -- 172.21.15.81:0/3092959383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24cc101980 con 0x7f24cc0fce80 2024-04-23T14:58:32.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.400+0000 7f24c8c00700 1 -- 172.21.15.81:0/3092959383 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f24c000bbf0 con 0x7f24cc0fce80 2024-04-23T14:58:32.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.401+0000 7f24c8c00700 1 --2- 172.21.15.81:0/3092959383 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f24b406ec00 0x7f24b40710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:32.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.401+0000 7f24c8c00700 1 -- 172.21.15.81:0/3092959383 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f24c008fc70 con 0x7f24cc0fce80 2024-04-23T14:58:32.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.401+0000 7f24cbe00700 1 --2- 172.21.15.81:0/3092959383 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f24b406ec00 0x7f24b40710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:32.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.402+0000 7f24cbe00700 1 --2- 172.21.15.81:0/3092959383 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f24b406ec00 0x7f24b40710b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f24b8004b70 tx=0x7f24b8007cc0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:32.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.406+0000 7f24c8c00700 1 -- 172.21.15.81:0/3092959383 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f24c0096080 con 0x7f24cc0fce80 2024-04-23T14:58:32.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.730+0000 7f24d3400700 1 -- 172.21.15.81:0/3092959383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f24cc02b3a0 con 0x7f24cc0fce80 2024-04-23T14:58:32.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.731+0000 7f24c8c00700 1 -- 172.21.15.81:0/3092959383 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7f24c005c5d0 con 0x7f24cc0fce80 2024-04-23T14:58:32.732 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:58:32.732 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-04-23T14:58:32.732 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T14:58:32.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:58:32.732 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-04-23T14:58:32.732 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T14:58:32.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:58:32.732 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-04-23T14:58:32.732 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 6 2024-04-23T14:58:32.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:58:32.732 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-04-23T14:58:32.733 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 2, 2024-04-23T14:58:32.733 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T14:58:32.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:58:32.733 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-04-23T14:58:32.733 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 17.2.7-884-g70d0cb4b (70d0cb4b9d576828afb0a05dcf8732894d343ece) quincy (stable)": 2, 2024-04-23T14:58:32.733 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 12 2024-04-23T14:58:32.733 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-23T14:58:32.733 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:58:32.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.734+0000 7f24d3400700 1 -- 172.21.15.81:0/3092959383 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f24b406ec00 msgr2=0x7f24b40710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:32.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.734+0000 7f24d3400700 1 --2- 172.21.15.81:0/3092959383 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f24b406ec00 0x7f24b40710b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f24b8004b70 tx=0x7f24b8007cc0 comp rx=0 tx=0).stop 2024-04-23T14:58:32.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.734+0000 7f24d3400700 1 -- 172.21.15.81:0/3092959383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24cc0fce80 msgr2=0x7f24cc10fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:32.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.734+0000 7f24d3400700 1 --2- 172.21.15.81:0/3092959383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24cc0fce80 0x7f24cc10fb50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f24c000b3b0 tx=0x7f24c0009e30 comp rx=0 tx=0).stop 2024-04-23T14:58:32.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.735+0000 7f24d3400700 1 -- 172.21.15.81:0/3092959383 shutdown_connections 2024-04-23T14:58:32.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.735+0000 7f24d3400700 1 --2- 172.21.15.81:0/3092959383 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f24b406ec00 0x7f24b40710b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:32.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.735+0000 7f24d3400700 1 --2- 172.21.15.81:0/3092959383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24cc0fce80 0x7f24cc10fb50 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:32.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.735+0000 7f24d3400700 1 --2- 172.21.15.81:0/3092959383 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24cc0fdff0 0x7f24cc110090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:32.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.735+0000 7f24d3400700 1 -- 172.21.15.81:0/3092959383 >> 172.21.15.81:0/3092959383 conn(0x7f24cc0f8580 msgr2=0x7f24cc0f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:32.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.735+0000 7f24d3400700 1 -- 172.21.15.81:0/3092959383 shutdown_connections 2024-04-23T14:58:32.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.735+0000 7f24d3400700 1 -- 172.21.15.81:0/3092959383 wait complete. 2024-04-23T14:58:32.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.880+0000 7f45acc00700 1 -- 172.21.15.81:0/1393182777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45a80fcff0 msgr2=0x7f45a80fd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:32.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.880+0000 7f45acc00700 1 --2- 172.21.15.81:0/1393182777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45a80fcff0 0x7f45a80fd460 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4594004940 tx=0x7f4594009e30 comp rx=0 tx=0).stop 2024-04-23T14:58:32.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.880+0000 7f45acc00700 1 -- 172.21.15.81:0/1393182777 shutdown_connections 2024-04-23T14:58:32.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.880+0000 7f45acc00700 1 --2- 172.21.15.81:0/1393182777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45a80fcff0 0x7f45a80fd460 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:32.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.880+0000 7f45acc00700 1 --2- 172.21.15.81:0/1393182777 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45a80fbd40 0x7f45a80fc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:32.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.880+0000 7f45acc00700 1 -- 172.21.15.81:0/1393182777 >> 172.21.15.81:0/1393182777 conn(0x7f45a80f74c0 msgr2=0x7f45a80f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:32.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.880+0000 7f45acc00700 1 -- 172.21.15.81:0/1393182777 shutdown_connections 2024-04-23T14:58:32.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.880+0000 7f45acc00700 1 -- 172.21.15.81:0/1393182777 wait complete. 2024-04-23T14:58:32.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.881+0000 7f45acc00700 1 Processor -- start 2024-04-23T14:58:32.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.881+0000 7f45acc00700 1 -- start start 2024-04-23T14:58:32.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.882+0000 7f45acc00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45a80fbd40 0x7f45a8105c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:32.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.882+0000 7f45acc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45a80fcff0 0x7f45a81040d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:32.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.882+0000 7f45acc00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a8104710 con 0x7f45a80fcff0 2024-04-23T14:58:32.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.882+0000 7f45acc00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a8104880 con 0x7f45a80fbd40 2024-04-23T14:58:32.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.882+0000 7f45a5400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45a80fcff0 0x7f45a81040d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:32.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.882+0000 7f45a5400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45a80fcff0 0x7f45a81040d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57332/0 (socket says 172.21.15.81:57332) 2024-04-23T14:58:32.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.882+0000 7f45a5400700 1 -- 172.21.15.81:0/3345831481 learned_addr learned my addr 172.21.15.81:0/3345831481 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:58:32.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.882+0000 7f45a5e00700 1 --2- 172.21.15.81:0/3345831481 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45a80fbd40 0x7f45a8105c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:32.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.882+0000 7f45a5400700 1 -- 172.21.15.81:0/3345831481 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45a80fbd40 msgr2=0x7f45a8105c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:32.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.882+0000 7f45a5400700 1 --2- 172.21.15.81:0/3345831481 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45a80fbd40 0x7f45a8105c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:32.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.882+0000 7f45a5400700 1 -- 172.21.15.81:0/3345831481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4594005040 con 0x7f45a80fcff0 2024-04-23T14:58:32.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.883+0000 7f45a5400700 1 --2- 172.21.15.81:0/3345831481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45a80fcff0 0x7f45a81040d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4594009150 tx=0x7f4594009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:32.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.883+0000 7f459e000700 1 -- 172.21.15.81:0/3345831481 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f459400e040 con 0x7f45a80fcff0 2024-04-23T14:58:32.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.883+0000 7f459e000700 1 -- 172.21.15.81:0/3345831481 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f459400bbf0 con 0x7f45a80fcff0 2024-04-23T14:58:32.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.883+0000 7f459e000700 1 -- 172.21.15.81:0/3345831481 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f459401c630 con 0x7f45a80fcff0 2024-04-23T14:58:32.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.883+0000 7f45acc00700 1 -- 172.21.15.81:0/3345831481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a8104b00 con 0x7f45a80fcff0 2024-04-23T14:58:32.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.883+0000 7f45acc00700 1 -- 172.21.15.81:0/3345831481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a8115a40 con 0x7f45a80fcff0 2024-04-23T14:58:32.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.884+0000 7f45acc00700 1 -- 172.21.15.81:0/3345831481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a805f5f0 con 0x7f45a80fcff0 2024-04-23T14:58:32.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.885+0000 7f459e000700 1 -- 172.21.15.81:0/3345831481 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f459400bd60 con 0x7f45a80fcff0 2024-04-23T14:58:32.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.886+0000 7f459e000700 1 --2- 172.21.15.81:0/3345831481 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f458c06ec10 0x7f458c0710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:32.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.886+0000 7f459e000700 1 -- 172.21.15.81:0/3345831481 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f459408fb50 con 0x7f45a80fcff0 2024-04-23T14:58:32.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.886+0000 7f45a5e00700 1 --2- 172.21.15.81:0/3345831481 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f458c06ec10 0x7f458c0710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:32.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.887+0000 7f45a5e00700 1 --2- 172.21.15.81:0/3345831481 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f458c06ec10 0x7f458c0710c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4598006fd0 tx=0x7f4598008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:32.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:32.891+0000 7f459e000700 1 -- 172.21.15.81:0/3345831481 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f4594058a40 con 0x7f45a80fcff0 2024-04-23T14:58:33.005 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:32 smithi156 ceph-mon[77738]: from='client.34466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:58:33.005 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:32 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:33.005 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:32 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi156.rhbtxt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:58:33.005 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:32 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:58:33.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:32 smithi081 ceph-mon[90469]: from='client.34466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:58:33.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:32 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:33.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:32 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi156.rhbtxt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:58:33.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:32 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:58:33.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.166+0000 7f45acc00700 1 -- 172.21.15.81:0/3345831481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f45a8115d70 con 0x7f45a80fcff0 2024-04-23T14:58:33.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.167+0000 7f459e000700 1 -- 172.21.15.81:0/3345831481 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) v1 ==== 76+0+1895 (secure 0 0 0) 0x7f459405c100 con 0x7f45a80fcff0 2024-04-23T14:58:33.168 INFO:teuthology.orchestra.run.smithi081.stdout:e27 2024-04-23T14:58:33.168 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-23T14:58:33.168 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:58:33.168 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-04-23T14:58:33.168 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:58:33.168 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-04-23T14:58:33.168 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-04-23T14:58:33.168 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 27 2024-04-23T14:58:33.168 INFO:teuthology.orchestra.run.smithi081.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-23T14:58:33.168 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-04-23T14:45:51.264703+0000 2024-04-23T14:58:33.168 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-04-23T14:58:16.744675+0000 2024-04-23T14:58:33.168 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-04-23T14:58:33.169 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-04-23T14:58:33.169 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-04-23T14:58:33.169 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-04-23T14:58:33.169 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-04-23T14:58:33.169 INFO:teuthology.orchestra.run.smithi081.stdout:max_xattr_size 65536 2024-04-23T14:58:33.169 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-04-23T14:58:33.169 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-04-23T14:58:33.169 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 84 2024-04-23T14:58:33.169 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:58:33.169 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 1 2024-04-23T14:58:33.169 INFO:teuthology.orchestra.run.smithi081.stdout:in 0 2024-04-23T14:58:33.169 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=24259} 2024-04-23T14:58:33.169 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-04-23T14:58:33.170 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-04-23T14:58:33.170 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-04-23T14:58:33.170 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-04-23T14:58:33.170 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-04-23T14:58:33.170 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-04-23T14:58:33.170 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-04-23T14:58:33.170 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-04-23T14:58:33.170 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-04-23T14:58:33.170 INFO:teuthology.orchestra.run.smithi081.stdout:qdb_cluster leader: 24259 members: 24259 2024-04-23T14:58:33.170 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.vynkxn{0:24259} state up:active seq 185 join_fscid=1 addr [v2:172.21.15.156:6826/1794690362,v1:172.21.15.156:6827/1794690362] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:58:33.170 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:58:33.170 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:58:33.170 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-04-23T14:58:33.170 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:58:33.170 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.rhbtxt{-1:24263} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.156:6824/3854041261,v1:172.21.15.156:6825/3854041261] compat {c=[1],r=[1],i=[7ff]}] 2024-04-23T14:58:33.171 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.wydgcg{-1:34430} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.81:6826/3200953351,v1:172.21.15.81:6827/3200953351] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T14:58:33.171 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.vcoywg{-1:34462} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.81:6828/2598630159,v1:172.21.15.81:6829/2598630159] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T14:58:33.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.170+0000 7f45acc00700 1 -- 172.21.15.81:0/3345831481 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f458c06ec10 msgr2=0x7f458c0710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:33.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.170+0000 7f45acc00700 1 --2- 172.21.15.81:0/3345831481 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f458c06ec10 0x7f458c0710c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4598006fd0 tx=0x7f4598008040 comp rx=0 tx=0).stop 2024-04-23T14:58:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.170+0000 7f45acc00700 1 -- 172.21.15.81:0/3345831481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45a80fcff0 msgr2=0x7f45a81040d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.170+0000 7f45acc00700 1 --2- 172.21.15.81:0/3345831481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45a80fcff0 0x7f45a81040d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4594009150 tx=0x7f4594009e30 comp rx=0 tx=0).stop 2024-04-23T14:58:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.170+0000 7f45acc00700 1 -- 172.21.15.81:0/3345831481 shutdown_connections 2024-04-23T14:58:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.170+0000 7f45acc00700 1 --2- 172.21.15.81:0/3345831481 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f458c06ec10 0x7f458c0710c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.170+0000 7f45acc00700 1 --2- 172.21.15.81:0/3345831481 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45a80fbd40 0x7f45a8105c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.170+0000 7f45acc00700 1 --2- 172.21.15.81:0/3345831481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45a80fcff0 0x7f45a81040d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.170+0000 7f45acc00700 1 -- 172.21.15.81:0/3345831481 >> 172.21.15.81:0/3345831481 conn(0x7f45a80f74c0 msgr2=0x7f45a80f8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.170+0000 7f45acc00700 1 -- 172.21.15.81:0/3345831481 shutdown_connections 2024-04-23T14:58:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.170+0000 7f45acc00700 1 -- 172.21.15.81:0/3345831481 wait complete. 2024-04-23T14:58:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 27 2024-04-23T14:58:33.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.319+0000 7fc307e00700 1 -- 172.21.15.81:0/1034506123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc300071ea0 msgr2=0x7fc3000703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:33.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.319+0000 7fc307e00700 1 --2- 172.21.15.81:0/1034506123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc300071ea0 0x7fc3000703b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4004940 tx=0x7fc2f4009e30 comp rx=0 tx=0).stop 2024-04-23T14:58:33.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.319+0000 7fc307e00700 1 -- 172.21.15.81:0/1034506123 shutdown_connections 2024-04-23T14:58:33.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.319+0000 7fc307e00700 1 --2- 172.21.15.81:0/1034506123 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3000708f0 0x7fc300070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:33.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.319+0000 7fc307e00700 1 --2- 172.21.15.81:0/1034506123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc300071ea0 0x7fc3000703b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:33.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.319+0000 7fc307e00700 1 -- 172.21.15.81:0/1034506123 >> 172.21.15.81:0/1034506123 conn(0x7fc3000f8530 msgr2=0x7fc3000fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:33.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.319+0000 7fc307e00700 1 -- 172.21.15.81:0/1034506123 shutdown_connections 2024-04-23T14:58:33.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.319+0000 7fc307e00700 1 -- 172.21.15.81:0/1034506123 wait complete. 2024-04-23T14:58:33.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.320+0000 7fc307e00700 1 Processor -- start 2024-04-23T14:58:33.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.320+0000 7fc307e00700 1 -- start start 2024-04-23T14:58:33.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.320+0000 7fc307e00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3000708f0 0x7fc30010fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:33.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.320+0000 7fc307e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc300071ea0 0x7fc300110250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:33.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.320+0000 7fc307e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc300110f60 con 0x7fc300071ea0 2024-04-23T14:58:33.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.320+0000 7fc307e00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3001110d0 con 0x7fc3000708f0 2024-04-23T14:58:33.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.320+0000 7fc304a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc300071ea0 0x7fc300110250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:33.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.321+0000 7fc304a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc300071ea0 0x7fc300110250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57352/0 (socket says 172.21.15.81:57352) 2024-04-23T14:58:33.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.321+0000 7fc304a00700 1 -- 172.21.15.81:0/3518398606 learned_addr learned my addr 172.21.15.81:0/3518398606 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:58:33.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.321+0000 7fc305400700 1 --2- 172.21.15.81:0/3518398606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3000708f0 0x7fc30010fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:33.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.321+0000 7fc304a00700 1 -- 172.21.15.81:0/3518398606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3000708f0 msgr2=0x7fc30010fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:33.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.321+0000 7fc304a00700 1 --2- 172.21.15.81:0/3518398606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3000708f0 0x7fc30010fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:33.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.321+0000 7fc304a00700 1 -- 172.21.15.81:0/3518398606 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f4005040 con 0x7fc300071ea0 2024-04-23T14:58:33.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.321+0000 7fc304a00700 1 --2- 172.21.15.81:0/3518398606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc300071ea0 0x7fc300110250 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec00b790 tx=0x7fc2ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:33.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.321+0000 7fc2fd600700 1 -- 172.21.15.81:0/3518398606 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2ec00f770 con 0x7fc300071ea0 2024-04-23T14:58:33.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.322+0000 7fc2fd600700 1 -- 172.21.15.81:0/3518398606 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc2ec00fda0 con 0x7fc300071ea0 2024-04-23T14:58:33.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.322+0000 7fc2fd600700 1 -- 172.21.15.81:0/3518398606 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2ec00d310 con 0x7fc300071ea0 2024-04-23T14:58:33.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.322+0000 7fc307e00700 1 -- 172.21.15.81:0/3518398606 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3001113b0 con 0x7fc300071ea0 2024-04-23T14:58:33.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.322+0000 7fc307e00700 1 -- 172.21.15.81:0/3518398606 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc300111970 con 0x7fc300071ea0 2024-04-23T14:58:33.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.323+0000 7fc307e00700 1 -- 172.21.15.81:0/3518398606 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc30005f5f0 con 0x7fc300071ea0 2024-04-23T14:58:33.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.324+0000 7fc2fd600700 1 -- 172.21.15.81:0/3518398606 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fc2ec010420 con 0x7fc300071ea0 2024-04-23T14:58:33.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.325+0000 7fc2fd600700 1 --2- 172.21.15.81:0/3518398606 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc2e806ec10 0x7fc2e80710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:33.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.325+0000 7fc2fd600700 1 -- 172.21.15.81:0/3518398606 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc2ec08e7b0 con 0x7fc300071ea0 2024-04-23T14:58:33.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.325+0000 7fc305400700 1 --2- 172.21.15.81:0/3518398606 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc2e806ec10 0x7fc2e80710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:33.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.326+0000 7fc305400700 1 --2- 172.21.15.81:0/3518398606 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc2e806ec10 0x7fc2e80710c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4009fd0 tx=0x7fc2f4009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:33.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.330+0000 7fc2fd600700 1 -- 172.21.15.81:0/3518398606 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fc2ec05b1d0 con 0x7fc300071ea0 2024-04-23T14:58:33.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.558+0000 7fc307e00700 1 -- 172.21.15.81:0/3518398606 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc300107b70 con 0x7fc2e806ec10 2024-04-23T14:58:33.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.560+0000 7fc2fd600700 1 -- 172.21.15.81:0/3518398606 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc300107b70 con 0x7fc2e806ec10 2024-04-23T14:58:33.561 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:58:33.561 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd", 2024-04-23T14:58:33.561 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-04-23T14:58:33.561 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-23T14:58:33.561 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [ 2024-04-23T14:58:33.561 INFO:teuthology.orchestra.run.smithi081.stdout: "mon", 2024-04-23T14:58:33.561 INFO:teuthology.orchestra.run.smithi081.stdout: "osd", 2024-04-23T14:58:33.561 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-04-23T14:58:33.561 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr" 2024-04-23T14:58:33.561 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-04-23T14:58:33.561 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "14/21 daemons upgraded", 2024-04-23T14:58:33.561 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "Currently upgrading mds daemons", 2024-04-23T14:58:33.562 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-04-23T14:58:33.562 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:58:33.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.563+0000 7fc307e00700 1 -- 172.21.15.81:0/3518398606 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc2e806ec10 msgr2=0x7fc2e80710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:33.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.563+0000 7fc307e00700 1 --2- 172.21.15.81:0/3518398606 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc2e806ec10 0x7fc2e80710c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4009fd0 tx=0x7fc2f4009e30 comp rx=0 tx=0).stop 2024-04-23T14:58:33.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.563+0000 7fc307e00700 1 -- 172.21.15.81:0/3518398606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc300071ea0 msgr2=0x7fc300110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:33.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.563+0000 7fc307e00700 1 --2- 172.21.15.81:0/3518398606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc300071ea0 0x7fc300110250 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec00b790 tx=0x7fc2ec009250 comp rx=0 tx=0).stop 2024-04-23T14:58:33.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.563+0000 7fc307e00700 1 -- 172.21.15.81:0/3518398606 shutdown_connections 2024-04-23T14:58:33.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.564+0000 7fc307e00700 1 --2- 172.21.15.81:0/3518398606 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc2e806ec10 0x7fc2e80710c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:33.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.564+0000 7fc307e00700 1 --2- 172.21.15.81:0/3518398606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3000708f0 0x7fc30010fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:33.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.564+0000 7fc307e00700 1 --2- 172.21.15.81:0/3518398606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc300071ea0 0x7fc300110250 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:33.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.564+0000 7fc307e00700 1 -- 172.21.15.81:0/3518398606 >> 172.21.15.81:0/3518398606 conn(0x7fc3000f8530 msgr2=0x7fc3000f9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:33.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.564+0000 7fc307e00700 1 -- 172.21.15.81:0/3518398606 shutdown_connections 2024-04-23T14:58:33.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.564+0000 7fc307e00700 1 -- 172.21.15.81:0/3518398606 wait complete. 2024-04-23T14:58:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.708+0000 7fcacfa00700 1 -- 172.21.15.81:0/2911663327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac8071f50 msgr2=0x7fcac8070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.708+0000 7fcacfa00700 1 --2- 172.21.15.81:0/2911663327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac8071f50 0x7fcac8070460 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcabc009ce0 tx=0x7fcabc004d10 comp rx=0 tx=0).stop 2024-04-23T14:58:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.708+0000 7fcacfa00700 1 -- 172.21.15.81:0/2911663327 shutdown_connections 2024-04-23T14:58:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.708+0000 7fcacfa00700 1 --2- 172.21.15.81:0/2911663327 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcac80709a0 0x7fcac8070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.708+0000 7fcacfa00700 1 --2- 172.21.15.81:0/2911663327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac8071f50 0x7fcac8070460 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.708+0000 7fcacfa00700 1 -- 172.21.15.81:0/2911663327 >> 172.21.15.81:0/2911663327 conn(0x7fcac80f8530 msgr2=0x7fcac80fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.708+0000 7fcacfa00700 1 -- 172.21.15.81:0/2911663327 shutdown_connections 2024-04-23T14:58:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.708+0000 7fcacfa00700 1 -- 172.21.15.81:0/2911663327 wait complete. 2024-04-23T14:58:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.709+0000 7fcacfa00700 1 Processor -- start 2024-04-23T14:58:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.709+0000 7fcacfa00700 1 -- start start 2024-04-23T14:58:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.709+0000 7fcacfa00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcac80709a0 0x7fcac810fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.709+0000 7fcacfa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac8071f50 0x7fcac81103e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.709+0000 7fcacfa00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac8111100 con 0x7fcac8071f50 2024-04-23T14:58:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.709+0000 7fcacfa00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac8111270 con 0x7fcac80709a0 2024-04-23T14:58:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.710+0000 7fcac7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac8071f50 0x7fcac81103e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.710+0000 7fcac7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac8071f50 0x7fcac81103e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57362/0 (socket says 172.21.15.81:57362) 2024-04-23T14:58:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.710+0000 7fcac7e00700 1 -- 172.21.15.81:0/1866263272 learned_addr learned my addr 172.21.15.81:0/1866263272 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:58:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.710+0000 7fcacd000700 1 --2- 172.21.15.81:0/1866263272 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcac80709a0 0x7fcac810fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.710+0000 7fcac7e00700 1 -- 172.21.15.81:0/1866263272 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcac80709a0 msgr2=0x7fcac810fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.710+0000 7fcac7e00700 1 --2- 172.21.15.81:0/1866263272 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcac80709a0 0x7fcac810fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.710+0000 7fcac7e00700 1 -- 172.21.15.81:0/1866263272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcabc009940 con 0x7fcac8071f50 2024-04-23T14:58:33.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.711+0000 7fcac7e00700 1 --2- 172.21.15.81:0/1866263272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac8071f50 0x7fcac81103e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcab400b790 tx=0x7fcab4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:33.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.711+0000 7fcac4c00700 1 -- 172.21.15.81:0/1866263272 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcab400f770 con 0x7fcac8071f50 2024-04-23T14:58:33.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.711+0000 7fcac4c00700 1 -- 172.21.15.81:0/1866263272 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcab400fda0 con 0x7fcac8071f50 2024-04-23T14:58:33.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.711+0000 7fcacfa00700 1 -- 172.21.15.81:0/1866263272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcac81114f0 con 0x7fcac8071f50 2024-04-23T14:58:33.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.711+0000 7fcac4c00700 1 -- 172.21.15.81:0/1866263272 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcab400d310 con 0x7fcac8071f50 2024-04-23T14:58:33.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.711+0000 7fcacfa00700 1 -- 172.21.15.81:0/1866263272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac8111ab0 con 0x7fcac8071f50 2024-04-23T14:58:33.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.712+0000 7fcacfa00700 1 -- 172.21.15.81:0/1866263272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcac81095a0 con 0x7fcac8071f50 2024-04-23T14:58:33.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.713+0000 7fcac4c00700 1 -- 172.21.15.81:0/1866263272 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fcab4010420 con 0x7fcac8071f50 2024-04-23T14:58:33.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.714+0000 7fcac4c00700 1 --2- 172.21.15.81:0/1866263272 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fcab006ec10 0x7fcab00710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:58:33.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.714+0000 7fcac4c00700 1 -- 172.21.15.81:0/1866263272 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fcab408e930 con 0x7fcac8071f50 2024-04-23T14:58:33.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.714+0000 7fcacd000700 1 --2- 172.21.15.81:0/1866263272 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fcab006ec10 0x7fcab00710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:58:33.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.715+0000 7fcacd000700 1 --2- 172.21.15.81:0/1866263272 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fcab006ec10 0x7fcab00710c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcabc009470 tx=0x7fcabc004d10 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:58:33.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:33.719+0000 7fcac4c00700 1 -- 172.21.15.81:0/1866263272 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fcab40576e0 con 0x7fcac8071f50 2024-04-23T14:58:33.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:33 smithi081 ceph-mon[90469]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:58:33.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:33 smithi081 ceph-mon[90469]: Upgrade: Updating mds.cephfs.smithi156.rhbtxt 2024-04-23T14:58:33.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:33 smithi081 ceph-mon[90469]: Deploying daemon mds.cephfs.smithi156.rhbtxt on smithi156 2024-04-23T14:58:33.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:33 smithi081 ceph-mon[90469]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:58:33.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:33 smithi081 ceph-mon[90469]: pgmap v220: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 4.3 KiB/s wr, 2 op/s 2024-04-23T14:58:33.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:33 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/3092959383' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:58:33.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:33 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/3345831481' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:58:34.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:34.032+0000 7fcacfa00700 1 -- 172.21.15.81:0/1866263272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fcac804bed0 con 0x7fcac8071f50 2024-04-23T14:58:34.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:34.033+0000 7fcac4c00700 1 -- 172.21.15.81:0/1866263272 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fcab405ada0 con 0x7fcac8071f50 2024-04-23T14:58:34.033 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-04-23T14:58:34.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:34.036+0000 7fcacfa00700 1 -- 172.21.15.81:0/1866263272 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fcab006ec10 msgr2=0x7fcab00710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:34.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:34.036+0000 7fcacfa00700 1 --2- 172.21.15.81:0/1866263272 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fcab006ec10 0x7fcab00710c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcabc009470 tx=0x7fcabc004d10 comp rx=0 tx=0).stop 2024-04-23T14:58:34.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:34.036+0000 7fcacfa00700 1 -- 172.21.15.81:0/1866263272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac8071f50 msgr2=0x7fcac81103e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:58:34.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:34.036+0000 7fcacfa00700 1 --2- 172.21.15.81:0/1866263272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac8071f50 0x7fcac81103e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcab400b790 tx=0x7fcab4009250 comp rx=0 tx=0).stop 2024-04-23T14:58:34.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:34.036+0000 7fcacfa00700 1 -- 172.21.15.81:0/1866263272 shutdown_connections 2024-04-23T14:58:34.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:34.036+0000 7fcacfa00700 1 --2- 172.21.15.81:0/1866263272 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fcab006ec10 0x7fcab00710c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:34.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:34.036+0000 7fcacfa00700 1 --2- 172.21.15.81:0/1866263272 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcac80709a0 0x7fcac810fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:34.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:34.036+0000 7fcacfa00700 1 --2- 172.21.15.81:0/1866263272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac8071f50 0x7fcac81103e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:58:34.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:34.036+0000 7fcacfa00700 1 -- 172.21.15.81:0/1866263272 >> 172.21.15.81:0/1866263272 conn(0x7fcac80f8530 msgr2=0x7fcac8102dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:58:34.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:34.036+0000 7fcacfa00700 1 -- 172.21.15.81:0/1866263272 shutdown_connections 2024-04-23T14:58:34.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:58:34.037+0000 7fcacfa00700 1 -- 172.21.15.81:0/1866263272 wait complete. 2024-04-23T14:58:34.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:33 smithi156 ceph-mon[77738]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:58:34.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:33 smithi156 ceph-mon[77738]: Upgrade: Updating mds.cephfs.smithi156.rhbtxt 2024-04-23T14:58:34.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:33 smithi156 ceph-mon[77738]: Deploying daemon mds.cephfs.smithi156.rhbtxt on smithi156 2024-04-23T14:58:34.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:33 smithi156 ceph-mon[77738]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:58:34.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:33 smithi156 ceph-mon[77738]: pgmap v220: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 4.3 KiB/s wr, 2 op/s 2024-04-23T14:58:34.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:33 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/3092959383' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:58:34.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:33 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/3345831481' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:58:34.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:34 smithi156 ceph-mon[77738]: from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:58:34.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:34 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/1866263272' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:58:35.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:34 smithi081 ceph-mon[90469]: from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:58:35.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:34 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/1866263272' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:58:36.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:35 smithi156 ceph-mon[77738]: pgmap v221: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 4.3 KiB/s wr, 2 op/s 2024-04-23T14:58:36.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:35 smithi081 ceph-mon[90469]: pgmap v221: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 4.3 KiB/s wr, 2 op/s 2024-04-23T14:58:37.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:36 smithi156 ceph-mon[77738]: osdmap e85: 6 total, 6 up, 6 in 2024-04-23T14:58:37.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:36 smithi156 ceph-mon[77738]: fsmap cephfs:1 {0=cephfs.smithi156.vynkxn=up:active} 2 up:standby 2024-04-23T14:58:37.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:36 smithi081 ceph-mon[90469]: osdmap e85: 6 total, 6 up, 6 in 2024-04-23T14:58:37.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:36 smithi081 ceph-mon[90469]: fsmap cephfs:1 {0=cephfs.smithi156.vynkxn=up:active} 2 up:standby 2024-04-23T14:58:37.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:37 smithi156 ceph-mon[77738]: pgmap v223: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:58:37.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:37 smithi081 ceph-mon[90469]: pgmap v223: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:58:39.970 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:39 smithi156 ceph-mon[77738]: pgmap v224: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:58:40.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:39 smithi081 ceph-mon[90469]: pgmap v224: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:58:41.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:41 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:41.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:41 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:41.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:41 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:58:41.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:41 smithi156 ceph-mon[77738]: pgmap v225: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:58:41.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:41 smithi156 ceph-mon[77738]: mds.? [v2:172.21.15.156:6824/3017230919,v1:172.21.15.156:6825/3017230919] up:boot 2024-04-23T14:58:41.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:41 smithi156 ceph-mon[77738]: fsmap cephfs:1 {0=cephfs.smithi156.vynkxn=up:active} 3 up:standby 2024-04-23T14:58:41.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:41 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi156.rhbtxt"}]: dispatch 2024-04-23T14:58:41.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:41 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:41.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:41 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:41.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:41 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:41.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:41 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:41.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:41 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:58:41.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:41 smithi081 ceph-mon[90469]: pgmap v225: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:58:41.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:41 smithi081 ceph-mon[90469]: mds.? [v2:172.21.15.156:6824/3017230919,v1:172.21.15.156:6825/3017230919] up:boot 2024-04-23T14:58:41.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:41 smithi081 ceph-mon[90469]: fsmap cephfs:1 {0=cephfs.smithi156.vynkxn=up:active} 3 up:standby 2024-04-23T14:58:41.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:41 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi156.rhbtxt"}]: dispatch 2024-04-23T14:58:41.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:41 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:41.577 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:41 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:42.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:42 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:58:42.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:42 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:58:43.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:43 smithi156 ceph-mon[77738]: pgmap v226: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:58:43.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:43 smithi081 ceph-mon[90469]: pgmap v226: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:58:45.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:45 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:45.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:45 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:45.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:45 smithi156 ceph-mon[77738]: pgmap v227: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:58:45.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:45 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:45.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:45 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:45.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:45 smithi081 ceph-mon[90469]: pgmap v227: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:58:47.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:47 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:47.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:47 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:47.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:47 smithi156 ceph-mon[77738]: pgmap v228: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:58:47.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:47 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:47.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:47 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:47.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:47 smithi081 ceph-mon[90469]: pgmap v228: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:58:49.956 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:49 smithi156 ceph-mon[77738]: pgmap v229: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:58:50.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:49 smithi081 ceph-mon[90469]: pgmap v229: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:58:52.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:51 smithi156 ceph-mon[77738]: pgmap v230: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:58:52.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:51 smithi081 ceph-mon[90469]: pgmap v230: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:58:52.960 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:52 smithi156 ceph-mon[77738]: Detected new or changed devices on smithi156 2024-04-23T14:58:52.960 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:52 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:52.960 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:52 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:52.960 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:52 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:58:52.960 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:52 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:58:52.961 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:52 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:52.961 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:52 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:58:52.961 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:52 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:58:52.961 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:52 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:58:52.961 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:52 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:58:52.961 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:52 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:58:52.961 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:52 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi156.vynkxn"]}]: dispatch 2024-04-23T14:58:53.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:52 smithi081 ceph-mon[90469]: Detected new or changed devices on smithi156 2024-04-23T14:58:53.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:52 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:53.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:52 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:53.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:52 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:58:53.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:52 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:58:53.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:52 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:53.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:52 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:58:53.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:52 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:58:53.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:52 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:58:53.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:52 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:58:53.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:52 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:58:53.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:52 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi156.vynkxn"]}]: dispatch 2024-04-23T14:58:53.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:53 smithi156 ceph-mon[77738]: Upgrade: It appears safe to stop mds.cephfs.smithi156.vynkxn 2024-04-23T14:58:53.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:53 smithi156 ceph-mon[77738]: pgmap v231: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:58:54.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:53 smithi081 ceph-mon[90469]: Upgrade: It appears safe to stop mds.cephfs.smithi156.vynkxn 2024-04-23T14:58:54.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:53 smithi081 ceph-mon[90469]: pgmap v231: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:58:55.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:55 smithi156 ceph-mon[77738]: Upgrade: Updating mds.cephfs.smithi156.vynkxn 2024-04-23T14:58:55.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:55 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:55.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:55 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi156.vynkxn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:58:55.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:55 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:58:55.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:55 smithi156 ceph-mon[77738]: Deploying daemon mds.cephfs.smithi156.vynkxn on smithi156 2024-04-23T14:58:55.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:55 smithi156 ceph-mon[77738]: pgmap v232: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:58:55.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:55 smithi081 ceph-mon[90469]: Upgrade: Updating mds.cephfs.smithi156.vynkxn 2024-04-23T14:58:55.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:55 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:58:55.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:55 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi156.vynkxn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T14:58:55.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:55 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:58:55.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:55 smithi081 ceph-mon[90469]: Deploying daemon mds.cephfs.smithi156.vynkxn on smithi156 2024-04-23T14:58:55.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:55 smithi081 ceph-mon[90469]: pgmap v232: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:58:57.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:57 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:58:57.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:57 smithi156 ceph-mon[77738]: pgmap v233: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:58:57.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:57 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:58:57.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:57 smithi081 ceph-mon[90469]: pgmap v233: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:58:57.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:57 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi081[90465]: 2024-04-23T14:58:57.638+0000 7fb386a00700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-23T14:58:58.650 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:58 smithi081 ceph-mon[90469]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-23T14:58:58.650 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:58 smithi081 ceph-mon[90469]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-23T14:58:58.650 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:58 smithi081 ceph-mon[90469]: osdmap e86: 6 total, 6 up, 6 in 2024-04-23T14:58:58.650 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:58 smithi081 ceph-mon[90469]: Standby daemon mds.cephfs.smithi081.wydgcg assigned to filesystem cephfs as rank 0 2024-04-23T14:58:58.650 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:58 smithi081 ceph-mon[90469]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-23T14:58:58.650 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:58 smithi081 ceph-mon[90469]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-23T14:58:58.650 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:58 smithi081 ceph-mon[90469]: fsmap cephfs:1/1 {0=cephfs.smithi081.wydgcg=up:replay} 2 up:standby 2024-04-23T14:58:58.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:58 smithi156 ceph-mon[77738]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-23T14:58:58.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:58 smithi156 ceph-mon[77738]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-23T14:58:58.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:58 smithi156 ceph-mon[77738]: osdmap e86: 6 total, 6 up, 6 in 2024-04-23T14:58:58.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:58 smithi156 ceph-mon[77738]: Standby daemon mds.cephfs.smithi081.wydgcg assigned to filesystem cephfs as rank 0 2024-04-23T14:58:58.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:58 smithi156 ceph-mon[77738]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-23T14:58:58.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:58 smithi156 ceph-mon[77738]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-23T14:58:58.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:58 smithi156 ceph-mon[77738]: fsmap cephfs:1/1 {0=cephfs.smithi081.wydgcg=up:replay} 2 up:standby 2024-04-23T14:58:59.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:58:59 smithi081 ceph-mon[90469]: pgmap v235: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:58:59.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:58:59 smithi156 ceph-mon[77738]: pgmap v235: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-23T14:59:02.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:01 smithi156 ceph-mon[77738]: pgmap v236: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 5.6 MiB/s rd, 2 op/s 2024-04-23T14:59:02.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:01 smithi081 ceph-mon[90469]: pgmap v236: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 5.6 MiB/s rd, 2 op/s 2024-04-23T14:59:03.971 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:03 smithi156 ceph-mon[77738]: pgmap v237: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 6.0 MiB/s rd, 2 op/s 2024-04-23T14:59:04.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:03 smithi081 ceph-mon[90469]: pgmap v237: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 6.0 MiB/s rd, 2 op/s 2024-04-23T14:59:04.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.194+0000 7f9024a00700 1 -- 172.21.15.81:0/1950357823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90200fcfa0 msgr2=0x7f90200fd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:04.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.194+0000 7f9024a00700 1 --2- 172.21.15.81:0/1950357823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90200fcfa0 0x7f90200fd410 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f900c004940 tx=0x7f900c009e30 comp rx=0 tx=0).stop 2024-04-23T14:59:04.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.195+0000 7f9024a00700 1 -- 172.21.15.81:0/1950357823 shutdown_connections 2024-04-23T14:59:04.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.195+0000 7f9024a00700 1 --2- 172.21.15.81:0/1950357823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90200fcfa0 0x7f90200fd410 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:04.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.195+0000 7f9024a00700 1 --2- 172.21.15.81:0/1950357823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90200fbcf0 0x7f90200fc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:04.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.195+0000 7f9024a00700 1 -- 172.21.15.81:0/1950357823 >> 172.21.15.81:0/1950357823 conn(0x7f90200f7450 msgr2=0x7f90200f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:04.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.195+0000 7f9024a00700 1 -- 172.21.15.81:0/1950357823 shutdown_connections 2024-04-23T14:59:04.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.195+0000 7f9024a00700 1 -- 172.21.15.81:0/1950357823 wait complete. 2024-04-23T14:59:04.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.196+0000 7f9024a00700 1 Processor -- start 2024-04-23T14:59:04.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.196+0000 7f9024a00700 1 -- start start 2024-04-23T14:59:04.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.196+0000 7f9024a00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90200fbcf0 0x7f90200ffc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:04.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.196+0000 7f9024a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90200fcfa0 0x7f90200fe2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:04.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.196+0000 7f9024a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9020100230 con 0x7f90200fcfa0 2024-04-23T14:59:04.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.196+0000 7f9024a00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90200fe820 con 0x7f90200fbcf0 2024-04-23T14:59:04.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.197+0000 7f901d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90200fcfa0 0x7f90200fe2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:04.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.197+0000 7f901d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90200fcfa0 0x7f90200fe2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39120/0 (socket says 172.21.15.81:39120) 2024-04-23T14:59:04.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.197+0000 7f901d400700 1 -- 172.21.15.81:0/1572619341 learned_addr learned my addr 172.21.15.81:0/1572619341 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:59:04.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.197+0000 7f901de00700 1 --2- 172.21.15.81:0/1572619341 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90200fbcf0 0x7f90200ffc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:04.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.197+0000 7f901d400700 1 -- 172.21.15.81:0/1572619341 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90200fbcf0 msgr2=0x7f90200ffc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:04.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.197+0000 7f901d400700 1 --2- 172.21.15.81:0/1572619341 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90200fbcf0 0x7f90200ffc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:04.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.197+0000 7f901d400700 1 -- 172.21.15.81:0/1572619341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f900c005040 con 0x7f90200fcfa0 2024-04-23T14:59:04.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.197+0000 7f901d400700 1 --2- 172.21.15.81:0/1572619341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90200fcfa0 0x7f90200fe2e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f900c009150 tx=0x7f900c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:04.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.198+0000 7f9016000700 1 -- 172.21.15.81:0/1572619341 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f900c00e040 con 0x7f90200fcfa0 2024-04-23T14:59:04.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.198+0000 7f9016000700 1 -- 172.21.15.81:0/1572619341 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f900c00bbf0 con 0x7f90200fcfa0 2024-04-23T14:59:04.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.198+0000 7f9016000700 1 -- 172.21.15.81:0/1572619341 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f900c01c630 con 0x7f90200fcfa0 2024-04-23T14:59:04.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.198+0000 7f9024a00700 1 -- 172.21.15.81:0/1572619341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90200fea70 con 0x7f90200fcfa0 2024-04-23T14:59:04.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.198+0000 7f9024a00700 1 -- 172.21.15.81:0/1572619341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90200ff030 con 0x7f90200fcfa0 2024-04-23T14:59:04.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.199+0000 7f9024a00700 1 -- 172.21.15.81:0/1572619341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f902004c710 con 0x7f90200fcfa0 2024-04-23T14:59:04.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.201+0000 7f9016000700 1 -- 172.21.15.81:0/1572619341 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f900c00bd60 con 0x7f90200fcfa0 2024-04-23T14:59:04.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.202+0000 7f9016000700 1 --2- 172.21.15.81:0/1572619341 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f900406ec00 0x7f90040710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:04.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.202+0000 7f9016000700 1 -- 172.21.15.81:0/1572619341 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f900c08fc90 con 0x7f90200fcfa0 2024-04-23T14:59:04.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.203+0000 7f901de00700 1 --2- 172.21.15.81:0/1572619341 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f900406ec00 0x7f90040710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:04.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.203+0000 7f901de00700 1 --2- 172.21.15.81:0/1572619341 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f900406ec00 0x7f90040710b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9010007fd0 tx=0x7f9010009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:04.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.208+0000 7f9016000700 1 -- 172.21.15.81:0/1572619341 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f900c05c570 con 0x7f90200fcfa0 2024-04-23T14:59:04.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.449+0000 7f9024a00700 1 -- 172.21.15.81:0/1572619341 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9020104990 con 0x7f900406ec00 2024-04-23T14:59:04.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.451+0000 7f9016000700 1 -- 172.21.15.81:0/1572619341 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f9010004db0 con 0x7f900406ec00 2024-04-23T14:59:04.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.454+0000 7f9024a00700 1 -- 172.21.15.81:0/1572619341 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f900406ec00 msgr2=0x7f90040710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:04.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.454+0000 7f9024a00700 1 --2- 172.21.15.81:0/1572619341 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f900406ec00 0x7f90040710b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9010007fd0 tx=0x7f9010009040 comp rx=0 tx=0).stop 2024-04-23T14:59:04.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.454+0000 7f9024a00700 1 -- 172.21.15.81:0/1572619341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90200fcfa0 msgr2=0x7f90200fe2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:04.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.454+0000 7f9024a00700 1 --2- 172.21.15.81:0/1572619341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90200fcfa0 0x7f90200fe2e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f900c009150 tx=0x7f900c009e30 comp rx=0 tx=0).stop 2024-04-23T14:59:04.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.454+0000 7f9024a00700 1 -- 172.21.15.81:0/1572619341 shutdown_connections 2024-04-23T14:59:04.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.454+0000 7f9024a00700 1 --2- 172.21.15.81:0/1572619341 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f900406ec00 0x7f90040710b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:04.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.454+0000 7f9024a00700 1 --2- 172.21.15.81:0/1572619341 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90200fbcf0 0x7f90200ffc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:04.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.454+0000 7f9024a00700 1 --2- 172.21.15.81:0/1572619341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90200fcfa0 0x7f90200fe2e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:04.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.454+0000 7f9024a00700 1 -- 172.21.15.81:0/1572619341 >> 172.21.15.81:0/1572619341 conn(0x7f90200f7450 msgr2=0x7f90200f8980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:04.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.454+0000 7f9024a00700 1 -- 172.21.15.81:0/1572619341 shutdown_connections 2024-04-23T14:59:04.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.454+0000 7f9024a00700 1 -- 172.21.15.81:0/1572619341 wait complete. 2024-04-23T14:59:04.469 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-04-23T14:59:04.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.597+0000 7fec7a800700 1 -- 172.21.15.81:0/889304246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec74066250 msgr2=0x7fec740ffad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:04.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.597+0000 7fec7a800700 1 --2- 172.21.15.81:0/889304246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec74066250 0x7fec740ffad0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fec64004940 tx=0x7fec64009e30 comp rx=0 tx=0).stop 2024-04-23T14:59:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.597+0000 7fec7a800700 1 -- 172.21.15.81:0/889304246 shutdown_connections 2024-04-23T14:59:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.597+0000 7fec7a800700 1 --2- 172.21.15.81:0/889304246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec74100010 0x7fec741023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.597+0000 7fec7a800700 1 --2- 172.21.15.81:0/889304246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec74066250 0x7fec740ffad0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.597+0000 7fec7a800700 1 -- 172.21.15.81:0/889304246 >> 172.21.15.81:0/889304246 conn(0x7fec740f74c0 msgr2=0x7fec740f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.597+0000 7fec7a800700 1 -- 172.21.15.81:0/889304246 shutdown_connections 2024-04-23T14:59:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.597+0000 7fec7a800700 1 -- 172.21.15.81:0/889304246 wait complete. 2024-04-23T14:59:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.598+0000 7fec7a800700 1 Processor -- start 2024-04-23T14:59:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.598+0000 7fec7a800700 1 -- start start 2024-04-23T14:59:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.598+0000 7fec7a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec74066250 0x7fec7410fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.598+0000 7fec7a800700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec74100010 0x7fec74110280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.598+0000 7fec7a800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec74110880 con 0x7fec74066250 2024-04-23T14:59:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.598+0000 7fec7a800700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec74110fc0 con 0x7fec74100010 2024-04-23T14:59:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.599+0000 7fec73400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec74066250 0x7fec7410fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.599+0000 7fec73400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec74066250 0x7fec7410fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39132/0 (socket says 172.21.15.81:39132) 2024-04-23T14:59:04.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.599+0000 7fec73400700 1 -- 172.21.15.81:0/3805744472 learned_addr learned my addr 172.21.15.81:0/3805744472 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:59:04.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.599+0000 7fec72a00700 1 --2- 172.21.15.81:0/3805744472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec74100010 0x7fec74110280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:04.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.599+0000 7fec73400700 1 -- 172.21.15.81:0/3805744472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec74100010 msgr2=0x7fec74110280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:04.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.599+0000 7fec73400700 1 --2- 172.21.15.81:0/3805744472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec74100010 0x7fec74110280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:04.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.599+0000 7fec73400700 1 -- 172.21.15.81:0/3805744472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec64005040 con 0x7fec74066250 2024-04-23T14:59:04.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.599+0000 7fec73400700 1 --2- 172.21.15.81:0/3805744472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec74066250 0x7fec7410fd40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fec6400b970 tx=0x7fec64009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:04.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.600+0000 7fec6b400700 1 -- 172.21.15.81:0/3805744472 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec6400e040 con 0x7fec74066250 2024-04-23T14:59:04.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.600+0000 7fec6b400700 1 -- 172.21.15.81:0/3805744472 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fec6400bbf0 con 0x7fec74066250 2024-04-23T14:59:04.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.600+0000 7fec7a800700 1 -- 172.21.15.81:0/3805744472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec74111240 con 0x7fec74066250 2024-04-23T14:59:04.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.600+0000 7fec7a800700 1 -- 172.21.15.81:0/3805744472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec74111800 con 0x7fec74066250 2024-04-23T14:59:04.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.600+0000 7fec6b400700 1 -- 172.21.15.81:0/3805744472 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec6401c630 con 0x7fec74066250 2024-04-23T14:59:04.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.601+0000 7fec7a800700 1 -- 172.21.15.81:0/3805744472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec740f8ff0 con 0x7fec74066250 2024-04-23T14:59:04.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.602+0000 7fec6b400700 1 -- 172.21.15.81:0/3805744472 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fec6400bd60 con 0x7fec74066250 2024-04-23T14:59:04.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.603+0000 7fec6b400700 1 --2- 172.21.15.81:0/3805744472 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fec5806ec10 0x7fec580710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:04.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.603+0000 7fec6b400700 1 -- 172.21.15.81:0/3805744472 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fec6408fd30 con 0x7fec74066250 2024-04-23T14:59:04.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.603+0000 7fec72a00700 1 --2- 172.21.15.81:0/3805744472 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fec5806ec10 0x7fec580710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.604+0000 7fec72a00700 1 --2- 172.21.15.81:0/3805744472 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fec5806ec10 0x7fec580710c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fec60004990 tx=0x7fec60009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:04.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.608+0000 7fec6b400700 1 -- 172.21.15.81:0/3805744472 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fec6405c590 con 0x7fec74066250 2024-04-23T14:59:04.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.858+0000 7fec7a800700 1 -- 172.21.15.81:0/3805744472 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fec741059d0 con 0x7fec5806ec10 2024-04-23T14:59:04.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.859+0000 7fec6b400700 1 -- 172.21.15.81:0/3805744472 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fec741059d0 con 0x7fec5806ec10 2024-04-23T14:59:04.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.862+0000 7fec7a800700 1 -- 172.21.15.81:0/3805744472 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fec5806ec10 msgr2=0x7fec580710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:04.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.862+0000 7fec7a800700 1 --2- 172.21.15.81:0/3805744472 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fec5806ec10 0x7fec580710c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fec60004990 tx=0x7fec60009ee0 comp rx=0 tx=0).stop 2024-04-23T14:59:04.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.862+0000 7fec7a800700 1 -- 172.21.15.81:0/3805744472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec74066250 msgr2=0x7fec7410fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:04.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.862+0000 7fec7a800700 1 --2- 172.21.15.81:0/3805744472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec74066250 0x7fec7410fd40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fec6400b970 tx=0x7fec64009e30 comp rx=0 tx=0).stop 2024-04-23T14:59:04.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.862+0000 7fec7a800700 1 -- 172.21.15.81:0/3805744472 shutdown_connections 2024-04-23T14:59:04.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.862+0000 7fec7a800700 1 --2- 172.21.15.81:0/3805744472 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fec5806ec10 0x7fec580710c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:04.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.862+0000 7fec7a800700 1 --2- 172.21.15.81:0/3805744472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec74066250 0x7fec7410fd40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:04.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.862+0000 7fec7a800700 1 --2- 172.21.15.81:0/3805744472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec74100010 0x7fec74110280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:04.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.862+0000 7fec7a800700 1 -- 172.21.15.81:0/3805744472 >> 172.21.15.81:0/3805744472 conn(0x7fec740f74c0 msgr2=0x7fec740fbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:04.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.863+0000 7fec7a800700 1 -- 172.21.15.81:0/3805744472 shutdown_connections 2024-04-23T14:59:04.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:04.863+0000 7fec7a800700 1 -- 172.21.15.81:0/3805744472 wait complete. 2024-04-23T14:59:05.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.009+0000 7fc9fd400700 1 -- 172.21.15.81:0/1637863664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9f80ffe00 msgr2=0x7fc9f81021e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:05.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.009+0000 7fc9fd400700 1 --2- 172.21.15.81:0/1637863664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9f80ffe00 0x7fc9f81021e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4004940 tx=0x7fc9e4009e30 comp rx=0 tx=0).stop 2024-04-23T14:59:05.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.009+0000 7fc9fd400700 1 -- 172.21.15.81:0/1637863664 shutdown_connections 2024-04-23T14:59:05.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.009+0000 7fc9fd400700 1 --2- 172.21.15.81:0/1637863664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9f80ffe00 0x7fc9f81021e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:05.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.009+0000 7fc9fd400700 1 --2- 172.21.15.81:0/1637863664 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9f8066230 0x7fc9f80ff8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:05.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.009+0000 7fc9fd400700 1 -- 172.21.15.81:0/1637863664 >> 172.21.15.81:0/1637863664 conn(0x7fc9f80f7270 msgr2=0x7fc9f80f96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:05.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.010+0000 7fc9fd400700 1 -- 172.21.15.81:0/1637863664 shutdown_connections 2024-04-23T14:59:05.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.010+0000 7fc9fd400700 1 -- 172.21.15.81:0/1637863664 wait complete. 2024-04-23T14:59:05.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.010+0000 7fc9fd400700 1 Processor -- start 2024-04-23T14:59:05.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.010+0000 7fc9fd400700 1 -- start start 2024-04-23T14:59:05.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.011+0000 7fc9fd400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9f8066230 0x7fc9f80fd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:05.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.011+0000 7fc9fd400700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9f80ffe00 0x7fc9f80fb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:05.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.011+0000 7fc9fd400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f80fbd70 con 0x7fc9f8066230 2024-04-23T14:59:05.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.011+0000 7fc9fd400700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f80fbee0 con 0x7fc9f80ffe00 2024-04-23T14:59:05.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.011+0000 7fc9f7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9f8066230 0x7fc9f80fd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:05.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.011+0000 7fc9f7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9f8066230 0x7fc9f80fd2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39138/0 (socket says 172.21.15.81:39138) 2024-04-23T14:59:05.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.011+0000 7fc9f7e00700 1 -- 172.21.15.81:0/4230077079 learned_addr learned my addr 172.21.15.81:0/4230077079 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:59:05.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.011+0000 7fc9f7400700 1 --2- 172.21.15.81:0/4230077079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9f80ffe00 0x7fc9f80fb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:05.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.012+0000 7fc9f7e00700 1 -- 172.21.15.81:0/4230077079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9f80ffe00 msgr2=0x7fc9f80fb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:05.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.012+0000 7fc9f7e00700 1 --2- 172.21.15.81:0/4230077079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9f80ffe00 0x7fc9f80fb7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:05.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.012+0000 7fc9f7e00700 1 -- 172.21.15.81:0/4230077079 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e4005040 con 0x7fc9f8066230 2024-04-23T14:59:05.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.012+0000 7fc9f7e00700 1 --2- 172.21.15.81:0/4230077079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9f8066230 0x7fc9f80fd2f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc9e800eb70 tx=0x7fc9e800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:05.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.012+0000 7fc9efe00700 1 -- 172.21.15.81:0/4230077079 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9e8007cc0 con 0x7fc9f8066230 2024-04-23T14:59:05.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.012+0000 7fc9efe00700 1 -- 172.21.15.81:0/4230077079 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc9e800f040 con 0x7fc9f8066230 2024-04-23T14:59:05.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.012+0000 7fc9fd400700 1 -- 172.21.15.81:0/4230077079 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9f80fc160 con 0x7fc9f8066230 2024-04-23T14:59:05.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.012+0000 7fc9efe00700 1 -- 172.21.15.81:0/4230077079 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9e800cb20 con 0x7fc9f8066230 2024-04-23T14:59:05.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.012+0000 7fc9fd400700 1 -- 172.21.15.81:0/4230077079 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9f8115830 con 0x7fc9f8066230 2024-04-23T14:59:05.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.013+0000 7fc9fd400700 1 -- 172.21.15.81:0/4230077079 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9f805f5f0 con 0x7fc9f8066230 2024-04-23T14:59:05.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.015+0000 7fc9efe00700 1 -- 172.21.15.81:0/4230077079 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fc9e800cc80 con 0x7fc9f8066230 2024-04-23T14:59:05.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.016+0000 7fc9efe00700 1 --2- 172.21.15.81:0/4230077079 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc9dc06ec10 0x7fc9dc0710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:05.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.016+0000 7fc9efe00700 1 -- 172.21.15.81:0/4230077079 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fc9e808e250 con 0x7fc9f8066230 2024-04-23T14:59:05.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.016+0000 7fc9f7400700 1 --2- 172.21.15.81:0/4230077079 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc9dc06ec10 0x7fc9dc0710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:05.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.017+0000 7fc9f7400700 1 --2- 172.21.15.81:0/4230077079 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc9dc06ec10 0x7fc9dc0710c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4013870 tx=0x7fc9e4009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:05.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.024+0000 7fc9efe00700 1 -- 172.21.15.81:0/4230077079 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fc9e80570d0 con 0x7fc9f8066230 2024-04-23T14:59:05.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.268+0000 7fc9fd400700 1 -- 172.21.15.81:0/4230077079 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9f80f8db0 con 0x7fc9dc06ec10 2024-04-23T14:59:05.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.283+0000 7fc9efe00700 1 -- 172.21.15.81:0/4230077079 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fc9f80f8db0 con 0x7fc9dc06ec10 2024-04-23T14:59:05.283 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-23T14:59:05.283 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (9m) 43s ago 20m 14.5M - 0.25.0 c8568f914cd2 63876b2abc27 2024-04-23T14:59:05.283 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (5m) 43s ago 20m 6665k - 19.0.0-3126-gd44fddd9 76e77f280c74 b486fe2ef19b 2024-04-23T14:59:05.283 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi156 smithi156 running (5m) 20s ago 19m 6656k - 19.0.0-3126-gd44fddd9 76e77f280c74 5d9aa5ecf264 2024-04-23T14:59:05.283 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (9m) 43s ago 19m 73.8M - 9.4.7 954c08fa6188 fbad3cef0883 2024-04-23T14:59:05.283 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.vcoywg smithi081 running (50s) 43s ago 13m 11.0M - 19.0.0-3126-gd44fddd9 76e77f280c74 87ab7708542f 2024-04-23T14:59:05.283 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.wydgcg smithi081 running (80s) 43s ago 13m 11.1M - 19.0.0-3126-gd44fddd9 76e77f280c74 e2a96404cc4f 2024-04-23T14:59:05.283 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.rhbtxt smithi156 running (25s) 20s ago 13m 11.0M - 19.0.0-3126-gd44fddd9 76e77f280c74 208d4416e1bf 2024-04-23T14:59:05.283 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.vynkxn smithi156 starting - - - - 2024-04-23T14:59:05.284 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.ldghvq smithi081 *:8443,9283,8765 running (8m) 43s ago 21m 511M - 19.0.0-3126-gd44fddd9 76e77f280c74 6bf23484a1c9 2024-04-23T14:59:05.284 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi156.ounwyj smithi156 *:8443,9283,8765 running (7m) 20s ago 18m 452M - 19.0.0-3126-gd44fddd9 76e77f280c74 a6c0dd9f89f2 2024-04-23T14:59:05.284 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (6m) 43s ago 21m 53.0M 2048M 19.0.0-3126-gd44fddd9 76e77f280c74 fbf9f9a59ac2 2024-04-23T14:59:05.284 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi156 smithi156 running (6m) 20s ago 18m 40.2M 2048M 19.0.0-3126-gd44fddd9 76e77f280c74 36409886998f 2024-04-23T14:59:05.284 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (9m) 43s ago 20m 7940k - 1.5.0 0da6a335fe13 197b27809010 2024-04-23T14:59:05.284 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi156 smithi156 *:9100 running (8m) 20s ago 18m 7994k - 1.5.0 0da6a335fe13 91a7c5e86d47 2024-04-23T14:59:05.284 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (4m) 43s ago 17m 107M 1557M 19.0.0-3126-gd44fddd9 76e77f280c74 24bc24b37de5 2024-04-23T14:59:05.284 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (4m) 43s ago 17m 118M 1557M 19.0.0-3126-gd44fddd9 76e77f280c74 18d0179b558a 2024-04-23T14:59:05.284 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (3m) 43s ago 16m 95.2M 1557M 19.0.0-3126-gd44fddd9 76e77f280c74 421a62ef6990 2024-04-23T14:59:05.284 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi156 running (3m) 20s ago 16m 122M 2581M 19.0.0-3126-gd44fddd9 76e77f280c74 9af3ca1ff69b 2024-04-23T14:59:05.284 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi156 running (2m) 20s ago 15m 109M 2581M 19.0.0-3126-gd44fddd9 76e77f280c74 e0a1e784348c 2024-04-23T14:59:05.284 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi156 running (104s) 20s ago 14m 104M 2581M 19.0.0-3126-gd44fddd9 76e77f280c74 16b6ba5d9e3e 2024-04-23T14:59:05.284 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (7m) 43s ago 19m 58.1M - 2.43.0 a07b618ecd1d 35558adb166d 2024-04-23T14:59:05.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.285+0000 7fc9fd400700 1 -- 172.21.15.81:0/4230077079 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc9dc06ec10 msgr2=0x7fc9dc0710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:05.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.285+0000 7fc9fd400700 1 --2- 172.21.15.81:0/4230077079 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc9dc06ec10 0x7fc9dc0710c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4013870 tx=0x7fc9e4009e30 comp rx=0 tx=0).stop 2024-04-23T14:59:05.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.285+0000 7fc9fd400700 1 -- 172.21.15.81:0/4230077079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9f8066230 msgr2=0x7fc9f80fd2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:05.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.285+0000 7fc9fd400700 1 --2- 172.21.15.81:0/4230077079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9f8066230 0x7fc9f80fd2f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc9e800eb70 tx=0x7fc9e800b040 comp rx=0 tx=0).stop 2024-04-23T14:59:05.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.286+0000 7fc9fd400700 1 -- 172.21.15.81:0/4230077079 shutdown_connections 2024-04-23T14:59:05.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.286+0000 7fc9fd400700 1 --2- 172.21.15.81:0/4230077079 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc9dc06ec10 0x7fc9dc0710c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:05.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.286+0000 7fc9fd400700 1 --2- 172.21.15.81:0/4230077079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9f8066230 0x7fc9f80fd2f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:05.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.286+0000 7fc9fd400700 1 --2- 172.21.15.81:0/4230077079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9f80ffe00 0x7fc9f80fb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:05.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.286+0000 7fc9fd400700 1 -- 172.21.15.81:0/4230077079 >> 172.21.15.81:0/4230077079 conn(0x7fc9f80f7270 msgr2=0x7fc9f80f7690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:05.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.286+0000 7fc9fd400700 1 -- 172.21.15.81:0/4230077079 shutdown_connections 2024-04-23T14:59:05.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.286+0000 7fc9fd400700 1 -- 172.21.15.81:0/4230077079 wait complete. 2024-04-23T14:59:05.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.425+0000 7f5593200700 1 -- 172.21.15.81:0/1969769611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f558c066290 msgr2=0x7f558c0ff860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:05.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.425+0000 7f5593200700 1 --2- 172.21.15.81:0/1969769611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f558c066290 0x7f558c0ff860 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5580004940 tx=0x7f5580009e30 comp rx=0 tx=0).stop 2024-04-23T14:59:05.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.425+0000 7f5593200700 1 -- 172.21.15.81:0/1969769611 shutdown_connections 2024-04-23T14:59:05.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.425+0000 7f5593200700 1 --2- 172.21.15.81:0/1969769611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f558c0ffda0 0x7f558c102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:05.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.425+0000 7f5593200700 1 --2- 172.21.15.81:0/1969769611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f558c066290 0x7f558c0ff860 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:05.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.425+0000 7f5593200700 1 -- 172.21.15.81:0/1969769611 >> 172.21.15.81:0/1969769611 conn(0x7f558c0f7270 msgr2=0x7f558c0f96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:05.426 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:05 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:05.426 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:05 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:05.426 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:05 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:59:05.426 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:05 smithi081 ceph-mon[90469]: from='client.34500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:59:05.426 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:05 smithi081 ceph-mon[90469]: pgmap v238: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-04-23T14:59:05.426 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:05 smithi081 ceph-mon[90469]: mds.? [v2:172.21.15.156:6826/4079938688,v1:172.21.15.156:6827/4079938688] up:boot 2024-04-23T14:59:05.426 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:05 smithi081 ceph-mon[90469]: fsmap cephfs:1/1 {0=cephfs.smithi081.wydgcg=up:replay} 3 up:standby 2024-04-23T14:59:05.427 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:05 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi156.vynkxn"}]: dispatch 2024-04-23T14:59:05.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.426+0000 7f5593200700 1 -- 172.21.15.81:0/1969769611 shutdown_connections 2024-04-23T14:59:05.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.426+0000 7f5593200700 1 -- 172.21.15.81:0/1969769611 wait complete. 2024-04-23T14:59:05.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.427+0000 7f5593200700 1 Processor -- start 2024-04-23T14:59:05.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.427+0000 7f5593200700 1 -- start start 2024-04-23T14:59:05.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.427+0000 7f5593200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f558c066290 0x7f558c10faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:05.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.427+0000 7f5593200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f558c0ffda0 0x7f558c10ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:05.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.427+0000 7f5593200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558c1105e0 con 0x7f558c0ffda0 2024-04-23T14:59:05.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.427+0000 7f5593200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558c110e30 con 0x7f558c066290 2024-04-23T14:59:05.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.428+0000 7f5591400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f558c0ffda0 0x7f558c10ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:05.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.428+0000 7f5591400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f558c0ffda0 0x7f558c10ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39152/0 (socket says 172.21.15.81:39152) 2024-04-23T14:59:05.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.428+0000 7f5591400700 1 -- 172.21.15.81:0/602160881 learned_addr learned my addr 172.21.15.81:0/602160881 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:59:05.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.428+0000 7f5591e00700 1 --2- 172.21.15.81:0/602160881 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f558c066290 0x7f558c10faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:05.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.428+0000 7f5591400700 1 -- 172.21.15.81:0/602160881 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f558c066290 msgr2=0x7f558c10faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:05.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.428+0000 7f5591400700 1 --2- 172.21.15.81:0/602160881 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f558c066290 0x7f558c10faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:05.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.428+0000 7f5591400700 1 -- 172.21.15.81:0/602160881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5580005040 con 0x7f558c0ffda0 2024-04-23T14:59:05.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.429+0000 7f5591400700 1 --2- 172.21.15.81:0/602160881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f558c0ffda0 0x7f558c10ffe0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f557c00c830 tx=0x7f557c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:05.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.429+0000 7f5586000700 1 -- 172.21.15.81:0/602160881 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f557c00a760 con 0x7f558c0ffda0 2024-04-23T14:59:05.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.429+0000 7f5586000700 1 -- 172.21.15.81:0/602160881 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f557c00ad90 con 0x7f558c0ffda0 2024-04-23T14:59:05.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.429+0000 7f5586000700 1 -- 172.21.15.81:0/602160881 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f557c0113a0 con 0x7f558c0ffda0 2024-04-23T14:59:05.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.429+0000 7f5593200700 1 -- 172.21.15.81:0/602160881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f558c111110 con 0x7f558c0ffda0 2024-04-23T14:59:05.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.429+0000 7f5593200700 1 -- 172.21.15.81:0/602160881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f558c111650 con 0x7f558c0ffda0 2024-04-23T14:59:05.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.431+0000 7f5593200700 1 -- 172.21.15.81:0/602160881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f558c05f5f0 con 0x7f558c0ffda0 2024-04-23T14:59:05.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.433+0000 7f5586000700 1 -- 172.21.15.81:0/602160881 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f557c012400 con 0x7f558c0ffda0 2024-04-23T14:59:05.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.434+0000 7f5586000700 1 --2- 172.21.15.81:0/602160881 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f557406ec10 0x7f55740710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:05.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.434+0000 7f5586000700 1 -- 172.21.15.81:0/602160881 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f557c08e910 con 0x7f558c0ffda0 2024-04-23T14:59:05.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.434+0000 7f5591e00700 1 --2- 172.21.15.81:0/602160881 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f557406ec10 0x7f55740710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:05.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.435+0000 7f5591e00700 1 --2- 172.21.15.81:0/602160881 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f557406ec10 0x7f55740710c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f558000b3b0 tx=0x7f5580009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:05.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.439+0000 7f5586000700 1 -- 172.21.15.81:0/602160881 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f557c05b1f0 con 0x7f558c0ffda0 2024-04-23T14:59:05.465 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:05 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:05.465 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:05 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:05.465 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:05 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:59:05.465 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:05 smithi156 ceph-mon[77738]: from='client.34500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:59:05.466 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:05 smithi156 ceph-mon[77738]: pgmap v238: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-04-23T14:59:05.466 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:05 smithi156 ceph-mon[77738]: mds.? [v2:172.21.15.156:6826/4079938688,v1:172.21.15.156:6827/4079938688] up:boot 2024-04-23T14:59:05.466 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:05 smithi156 ceph-mon[77738]: fsmap cephfs:1/1 {0=cephfs.smithi081.wydgcg=up:replay} 3 up:standby 2024-04-23T14:59:05.466 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:05 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi156.vynkxn"}]: dispatch 2024-04-23T14:59:05.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.745+0000 7f5593200700 1 -- 172.21.15.81:0/602160881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f558c1119c0 con 0x7f558c0ffda0 2024-04-23T14:59:05.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.746+0000 7f5586000700 1 -- 172.21.15.81:0/602160881 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f557c05ad80 con 0x7f558c0ffda0 2024-04-23T14:59:05.747 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:59:05.747 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-04-23T14:59:05.747 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T14:59:05.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:59:05.747 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-04-23T14:59:05.747 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T14:59:05.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:59:05.747 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-04-23T14:59:05.747 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 6 2024-04-23T14:59:05.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:59:05.747 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-04-23T14:59:05.747 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 4 2024-04-23T14:59:05.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:59:05.748 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-04-23T14:59:05.748 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 14 2024-04-23T14:59:05.748 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-23T14:59:05.748 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:59:05.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.750+0000 7f5593200700 1 -- 172.21.15.81:0/602160881 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f557406ec10 msgr2=0x7f55740710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:05.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.750+0000 7f5593200700 1 --2- 172.21.15.81:0/602160881 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f557406ec10 0x7f55740710c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f558000b3b0 tx=0x7f5580009e30 comp rx=0 tx=0).stop 2024-04-23T14:59:05.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.750+0000 7f5593200700 1 -- 172.21.15.81:0/602160881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f558c0ffda0 msgr2=0x7f558c10ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:05.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.750+0000 7f5593200700 1 --2- 172.21.15.81:0/602160881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f558c0ffda0 0x7f558c10ffe0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f557c00c830 tx=0x7f557c004470 comp rx=0 tx=0).stop 2024-04-23T14:59:05.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.750+0000 7f5593200700 1 -- 172.21.15.81:0/602160881 shutdown_connections 2024-04-23T14:59:05.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.750+0000 7f5593200700 1 --2- 172.21.15.81:0/602160881 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f557406ec10 0x7f55740710c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:05.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.750+0000 7f5593200700 1 --2- 172.21.15.81:0/602160881 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f558c066290 0x7f558c10faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:05.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.750+0000 7f5593200700 1 --2- 172.21.15.81:0/602160881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f558c0ffda0 0x7f558c10ffe0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:05.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.750+0000 7f5593200700 1 -- 172.21.15.81:0/602160881 >> 172.21.15.81:0/602160881 conn(0x7f558c0f7270 msgr2=0x7f558c0fb880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:05.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.750+0000 7f5593200700 1 -- 172.21.15.81:0/602160881 shutdown_connections 2024-04-23T14:59:05.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.750+0000 7f5593200700 1 -- 172.21.15.81:0/602160881 wait complete. 2024-04-23T14:59:05.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.895+0000 7f513c600700 1 -- 172.21.15.81:0/1924725805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51340ff020 msgr2=0x7f51340ff430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:05.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.895+0000 7f513c600700 1 --2- 172.21.15.81:0/1924725805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51340ff020 0x7f51340ff430 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5128004940 tx=0x7f5128009e30 comp rx=0 tx=0).stop 2024-04-23T14:59:05.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.895+0000 7f513c600700 1 -- 172.21.15.81:0/1924725805 shutdown_connections 2024-04-23T14:59:05.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.895+0000 7f513c600700 1 --2- 172.21.15.81:0/1924725805 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51341002d0 0x7f5134100740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:05.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.895+0000 7f513c600700 1 --2- 172.21.15.81:0/1924725805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51340ff020 0x7f51340ff430 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:05.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.895+0000 7f513c600700 1 -- 172.21.15.81:0/1924725805 >> 172.21.15.81:0/1924725805 conn(0x7f51340fa950 msgr2=0x7f51340fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:05.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.895+0000 7f513c600700 1 -- 172.21.15.81:0/1924725805 shutdown_connections 2024-04-23T14:59:05.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.895+0000 7f513c600700 1 -- 172.21.15.81:0/1924725805 wait complete. 2024-04-23T14:59:05.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.896+0000 7f513c600700 1 Processor -- start 2024-04-23T14:59:05.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.896+0000 7f513c600700 1 -- start start 2024-04-23T14:59:05.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.896+0000 7f513c600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51340ff020 0x7f513410fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:05.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.896+0000 7f513c600700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51341002d0 0x7f51341100a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:05.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.896+0000 7f513c600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51341106a0 con 0x7f51340ff020 2024-04-23T14:59:05.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.896+0000 7f513c600700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5134110810 con 0x7f51341002d0 2024-04-23T14:59:05.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.897+0000 7f5139c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51340ff020 0x7f513410fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:05.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.897+0000 7f5139c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51340ff020 0x7f513410fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39158/0 (socket says 172.21.15.81:39158) 2024-04-23T14:59:05.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.897+0000 7f5139c00700 1 -- 172.21.15.81:0/957015761 learned_addr learned my addr 172.21.15.81:0/957015761 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:59:05.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.897+0000 7f5139200700 1 --2- 172.21.15.81:0/957015761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51341002d0 0x7f51341100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:05.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.897+0000 7f5139c00700 1 -- 172.21.15.81:0/957015761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51341002d0 msgr2=0x7f51341100a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:05.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.897+0000 7f5139c00700 1 --2- 172.21.15.81:0/957015761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51341002d0 0x7f51341100a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:05.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.897+0000 7f5139c00700 1 -- 172.21.15.81:0/957015761 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5128005040 con 0x7f51340ff020 2024-04-23T14:59:05.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.897+0000 7f5139200700 1 --2- 172.21.15.81:0/957015761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51341002d0 0x7f51341100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:59:05.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.897+0000 7f5139c00700 1 --2- 172.21.15.81:0/957015761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51340ff020 0x7f513410fb60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f512800b3b0 tx=0x7f5128009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:05.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.898+0000 7f5131600700 1 -- 172.21.15.81:0/957015761 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f512800e040 con 0x7f51340ff020 2024-04-23T14:59:05.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.898+0000 7f5131600700 1 -- 172.21.15.81:0/957015761 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5128004290 con 0x7f51340ff020 2024-04-23T14:59:05.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.898+0000 7f513c600700 1 -- 172.21.15.81:0/957015761 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5134115210 con 0x7f51340ff020 2024-04-23T14:59:05.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.898+0000 7f5131600700 1 -- 172.21.15.81:0/957015761 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f512801c630 con 0x7f51340ff020 2024-04-23T14:59:05.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.898+0000 7f513c600700 1 -- 172.21.15.81:0/957015761 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51341157d0 con 0x7f51340ff020 2024-04-23T14:59:05.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.899+0000 7f513c600700 1 -- 172.21.15.81:0/957015761 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f513404c710 con 0x7f51340ff020 2024-04-23T14:59:05.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.900+0000 7f5131600700 1 -- 172.21.15.81:0/957015761 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f512800bbf0 con 0x7f51340ff020 2024-04-23T14:59:05.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.901+0000 7f5131600700 1 --2- 172.21.15.81:0/957015761 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f511c06ec00 0x7f511c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:05.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.901+0000 7f5131600700 1 -- 172.21.15.81:0/957015761 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f512808fc30 con 0x7f51340ff020 2024-04-23T14:59:05.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.901+0000 7f5139200700 1 --2- 172.21.15.81:0/957015761 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f511c06ec00 0x7f511c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:05.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.902+0000 7f5139200700 1 --2- 172.21.15.81:0/957015761 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f511c06ec00 0x7f511c0710b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5120007fd0 tx=0x7f5120009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:05.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:05.906+0000 7f5131600700 1 -- 172.21.15.81:0/957015761 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f512805c5d0 con 0x7f51340ff020 2024-04-23T14:59:06.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.160+0000 7f513c600700 1 -- 172.21.15.81:0/957015761 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5134107b10 con 0x7f51340ff020 2024-04-23T14:59:06.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.161+0000 7f5131600700 1 -- 172.21.15.81:0/957015761 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) v1 ==== 76+0+1930 (secure 0 0 0) 0x7f512805c160 con 0x7f51340ff020 2024-04-23T14:59:06.162 INFO:teuthology.orchestra.run.smithi081.stdout:e32 2024-04-23T14:59:06.162 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-23T14:59:06.162 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:59:06.162 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-04-23T14:59:06.162 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:59:06.162 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-04-23T14:59:06.162 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-04-23T14:59:06.162 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 31 2024-04-23T14:59:06.163 INFO:teuthology.orchestra.run.smithi081.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-23T14:59:06.163 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-04-23T14:45:51.264703+0000 2024-04-23T14:59:06.163 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-04-23T14:58:57.651339+0000 2024-04-23T14:59:06.163 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-04-23T14:59:06.163 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-04-23T14:59:06.163 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-04-23T14:59:06.163 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-04-23T14:59:06.163 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-04-23T14:59:06.163 INFO:teuthology.orchestra.run.smithi081.stdout:max_xattr_size 65536 2024-04-23T14:59:06.163 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-04-23T14:59:06.163 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-04-23T14:59:06.163 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 86 2024-04-23T14:59:06.163 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-23T14:59:06.163 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 1 2024-04-23T14:59:06.164 INFO:teuthology.orchestra.run.smithi081.stdout:in 0 2024-04-23T14:59:06.164 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=34430} 2024-04-23T14:59:06.164 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-04-23T14:59:06.164 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-04-23T14:59:06.164 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-04-23T14:59:06.164 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-04-23T14:59:06.164 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-04-23T14:59:06.164 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-04-23T14:59:06.164 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-04-23T14:59:06.164 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-04-23T14:59:06.164 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-04-23T14:59:06.164 INFO:teuthology.orchestra.run.smithi081.stdout:qdb_cluster leader: 0 members: 2024-04-23T14:59:06.164 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.wydgcg{0:34430} state up:replay seq 1 join_fscid=1 addr [v2:172.21.15.81:6826/3200953351,v1:172.21.15.81:6827/3200953351] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T14:59:06.164 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:59:06.164 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:59:06.164 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-04-23T14:59:06.165 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:59:06.165 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.vcoywg{-1:34462} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.81:6828/2598630159,v1:172.21.15.81:6829/2598630159] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T14:59:06.165 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.rhbtxt{-1:44273} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.156:6824/3017230919,v1:172.21.15.156:6825/3017230919] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T14:59:06.165 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.vynkxn{-1:44277} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.156:6826/4079938688,v1:172.21.15.156:6827/4079938688] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T14:59:06.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.165+0000 7f513c600700 1 -- 172.21.15.81:0/957015761 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f511c06ec00 msgr2=0x7f511c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:06.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.165+0000 7f513c600700 1 --2- 172.21.15.81:0/957015761 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f511c06ec00 0x7f511c0710b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5120007fd0 tx=0x7f5120009040 comp rx=0 tx=0).stop 2024-04-23T14:59:06.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.165+0000 7f513c600700 1 -- 172.21.15.81:0/957015761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51340ff020 msgr2=0x7f513410fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:06.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.165+0000 7f513c600700 1 --2- 172.21.15.81:0/957015761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51340ff020 0x7f513410fb60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f512800b3b0 tx=0x7f5128009e30 comp rx=0 tx=0).stop 2024-04-23T14:59:06.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.165+0000 7f513c600700 1 -- 172.21.15.81:0/957015761 shutdown_connections 2024-04-23T14:59:06.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.165+0000 7f513c600700 1 --2- 172.21.15.81:0/957015761 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f511c06ec00 0x7f511c0710b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:06.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.165+0000 7f513c600700 1 --2- 172.21.15.81:0/957015761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51340ff020 0x7f513410fb60 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:06.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.165+0000 7f513c600700 1 --2- 172.21.15.81:0/957015761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51341002d0 0x7f51341100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:06.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.165+0000 7f513c600700 1 -- 172.21.15.81:0/957015761 >> 172.21.15.81:0/957015761 conn(0x7f51340fa950 msgr2=0x7f51340fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:06.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.165+0000 7f513c600700 1 -- 172.21.15.81:0/957015761 shutdown_connections 2024-04-23T14:59:06.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.165+0000 7f513c600700 1 -- 172.21.15.81:0/957015761 wait complete. 2024-04-23T14:59:06.167 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 32 2024-04-23T14:59:06.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.315+0000 7fd113c00700 1 -- 172.21.15.81:0/2861363743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd10c0fce40 msgr2=0x7fd10c0fd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:06.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.315+0000 7fd113c00700 1 --2- 172.21.15.81:0/2861363743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd10c0fce40 0x7fd10c0fd250 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd100004940 tx=0x7fd100009e30 comp rx=0 tx=0).stop 2024-04-23T14:59:06.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.316+0000 7fd113c00700 1 -- 172.21.15.81:0/2861363743 shutdown_connections 2024-04-23T14:59:06.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.316+0000 7fd113c00700 1 --2- 172.21.15.81:0/2861363743 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd10c0fe040 0x7fd10c0fe4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:06.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.316+0000 7fd113c00700 1 --2- 172.21.15.81:0/2861363743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd10c0fce40 0x7fd10c0fd250 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:06.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.316+0000 7fd113c00700 1 -- 172.21.15.81:0/2861363743 >> 172.21.15.81:0/2861363743 conn(0x7fd10c0f8530 msgr2=0x7fd10c0fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:06.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.316+0000 7fd113c00700 1 -- 172.21.15.81:0/2861363743 shutdown_connections 2024-04-23T14:59:06.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.316+0000 7fd113c00700 1 -- 172.21.15.81:0/2861363743 wait complete. 2024-04-23T14:59:06.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.317+0000 7fd113c00700 1 Processor -- start 2024-04-23T14:59:06.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.317+0000 7fd113c00700 1 -- start start 2024-04-23T14:59:06.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.318+0000 7fd113c00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd10c0fce40 0x7fd10c10da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:06.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.318+0000 7fd113c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd10c0fe040 0x7fd10c10dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:06.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.318+0000 7fd113c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c10e5a0 con 0x7fd10c0fe040 2024-04-23T14:59:06.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.318+0000 7fd113c00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c10edf0 con 0x7fd10c0fce40 2024-04-23T14:59:06.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.318+0000 7fd10be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd10c0fe040 0x7fd10c10dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:06.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.318+0000 7fd10be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd10c0fe040 0x7fd10c10dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39170/0 (socket says 172.21.15.81:39170) 2024-04-23T14:59:06.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.318+0000 7fd10be00700 1 -- 172.21.15.81:0/3559376833 learned_addr learned my addr 172.21.15.81:0/3559376833 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:59:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.318+0000 7fd111200700 1 --2- 172.21.15.81:0/3559376833 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd10c0fce40 0x7fd10c10da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.319+0000 7fd10be00700 1 -- 172.21.15.81:0/3559376833 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd10c0fce40 msgr2=0x7fd10c10da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.319+0000 7fd10be00700 1 --2- 172.21.15.81:0/3559376833 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd10c0fce40 0x7fd10c10da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.319+0000 7fd10be00700 1 -- 172.21.15.81:0/3559376833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd100005040 con 0x7fd10c0fe040 2024-04-23T14:59:06.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.319+0000 7fd10be00700 1 --2- 172.21.15.81:0/3559376833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd10c0fe040 0x7fd10c10dfa0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd0f800c830 tx=0x7fd0f8004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:06.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.319+0000 7fd108c00700 1 -- 172.21.15.81:0/3559376833 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0f800a760 con 0x7fd10c0fe040 2024-04-23T14:59:06.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.319+0000 7fd108c00700 1 -- 172.21.15.81:0/3559376833 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd0f800ad90 con 0x7fd10c0fe040 2024-04-23T14:59:06.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.319+0000 7fd113c00700 1 -- 172.21.15.81:0/3559376833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd10c10f0d0 con 0x7fd10c0fe040 2024-04-23T14:59:06.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.319+0000 7fd108c00700 1 -- 172.21.15.81:0/3559376833 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0f80113a0 con 0x7fd10c0fe040 2024-04-23T14:59:06.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.319+0000 7fd113c00700 1 -- 172.21.15.81:0/3559376833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd10c10f610 con 0x7fd10c0fe040 2024-04-23T14:59:06.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.321+0000 7fd113c00700 1 -- 172.21.15.81:0/3559376833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd10c05f5f0 con 0x7fd10c0fe040 2024-04-23T14:59:06.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.322+0000 7fd108c00700 1 -- 172.21.15.81:0/3559376833 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fd0f8012400 con 0x7fd10c0fe040 2024-04-23T14:59:06.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.323+0000 7fd108c00700 1 --2- 172.21.15.81:0/3559376833 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fd0f406ec10 0x7fd0f40710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:06.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.323+0000 7fd108c00700 1 -- 172.21.15.81:0/3559376833 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fd0f808e9f0 con 0x7fd10c0fe040 2024-04-23T14:59:06.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.323+0000 7fd111200700 1 --2- 172.21.15.81:0/3559376833 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fd0f406ec10 0x7fd0f40710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:06.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.324+0000 7fd111200700 1 --2- 172.21.15.81:0/3559376833 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fd0f406ec10 0x7fd0f40710c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd10000b3b0 tx=0x7fd100009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:06.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.328+0000 7fd108c00700 1 -- 172.21.15.81:0/3559376833 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fd0f805b250 con 0x7fd10c0fe040 2024-04-23T14:59:06.535 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:06 smithi156 ceph-mon[77738]: from='client.34504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:59:06.535 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:06 smithi156 ceph-mon[77738]: from='client.34508 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:59:06.535 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:06 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/602160881' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:06.535 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:06 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/957015761' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:59:06.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.560+0000 7fd113c00700 1 -- 172.21.15.81:0/3559376833 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd10c10fa10 con 0x7fd0f406ec10 2024-04-23T14:59:06.560 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:06 smithi081 ceph-mon[90469]: from='client.34504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:59:06.560 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:06 smithi081 ceph-mon[90469]: from='client.34508 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:59:06.560 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:06 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/602160881' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:06.560 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:06 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/957015761' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:59:06.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.562+0000 7fd108c00700 1 -- 172.21.15.81:0/3559376833 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fd10c10fa10 con 0x7fd0f406ec10 2024-04-23T14:59:06.562 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:59:06.563 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd", 2024-04-23T14:59:06.563 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-04-23T14:59:06.563 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-23T14:59:06.563 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [ 2024-04-23T14:59:06.563 INFO:teuthology.orchestra.run.smithi081.stdout: "mon", 2024-04-23T14:59:06.563 INFO:teuthology.orchestra.run.smithi081.stdout: "osd", 2024-04-23T14:59:06.563 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-04-23T14:59:06.563 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr" 2024-04-23T14:59:06.563 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-04-23T14:59:06.563 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "15/21 daemons upgraded", 2024-04-23T14:59:06.563 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "Currently upgrading mds daemons", 2024-04-23T14:59:06.563 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-04-23T14:59:06.563 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:59:06.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.565+0000 7fd113c00700 1 -- 172.21.15.81:0/3559376833 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fd0f406ec10 msgr2=0x7fd0f40710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:06.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.565+0000 7fd113c00700 1 --2- 172.21.15.81:0/3559376833 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fd0f406ec10 0x7fd0f40710c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd10000b3b0 tx=0x7fd100009e30 comp rx=0 tx=0).stop 2024-04-23T14:59:06.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.565+0000 7fd113c00700 1 -- 172.21.15.81:0/3559376833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd10c0fe040 msgr2=0x7fd10c10dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:06.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.565+0000 7fd113c00700 1 --2- 172.21.15.81:0/3559376833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd10c0fe040 0x7fd10c10dfa0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd0f800c830 tx=0x7fd0f8004470 comp rx=0 tx=0).stop 2024-04-23T14:59:06.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.565+0000 7fd113c00700 1 -- 172.21.15.81:0/3559376833 shutdown_connections 2024-04-23T14:59:06.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.565+0000 7fd113c00700 1 --2- 172.21.15.81:0/3559376833 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fd0f406ec10 0x7fd0f40710c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:06.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.565+0000 7fd113c00700 1 --2- 172.21.15.81:0/3559376833 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd10c0fce40 0x7fd10c10da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:06.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.565+0000 7fd113c00700 1 --2- 172.21.15.81:0/3559376833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd10c0fe040 0x7fd10c10dfa0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:06.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.565+0000 7fd113c00700 1 -- 172.21.15.81:0/3559376833 >> 172.21.15.81:0/3559376833 conn(0x7fd10c0f8530 msgr2=0x7fd10c0f9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:06.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.565+0000 7fd113c00700 1 -- 172.21.15.81:0/3559376833 shutdown_connections 2024-04-23T14:59:06.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.565+0000 7fd113c00700 1 -- 172.21.15.81:0/3559376833 wait complete. 2024-04-23T14:59:06.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.707+0000 7f82a8800700 1 -- 172.21.15.81:0/2770389599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82a0066270 msgr2=0x7f82a0101eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:06.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.707+0000 7f82a8800700 1 --2- 172.21.15.81:0/2770389599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82a0066270 0x7f82a0101eb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8294004940 tx=0x7f8294009e30 comp rx=0 tx=0).stop 2024-04-23T14:59:06.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.707+0000 7f82a8800700 1 -- 172.21.15.81:0/2770389599 shutdown_connections 2024-04-23T14:59:06.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.707+0000 7f82a8800700 1 --2- 172.21.15.81:0/2770389599 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82a01023f0 0x7f82a01047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:06.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.707+0000 7f82a8800700 1 --2- 172.21.15.81:0/2770389599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82a0066270 0x7f82a0101eb0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:06.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.707+0000 7f82a8800700 1 -- 172.21.15.81:0/2770389599 >> 172.21.15.81:0/2770389599 conn(0x7f82a00f74c0 msgr2=0x7f82a00f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:06.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.707+0000 7f82a8800700 1 -- 172.21.15.81:0/2770389599 shutdown_connections 2024-04-23T14:59:06.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.708+0000 7f82a8800700 1 -- 172.21.15.81:0/2770389599 wait complete. 2024-04-23T14:59:06.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.708+0000 7f82a8800700 1 Processor -- start 2024-04-23T14:59:06.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.709+0000 7f82a8800700 1 -- start start 2024-04-23T14:59:06.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.709+0000 7f82a8800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82a0066270 0x7f82a010fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:06.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.709+0000 7f82a8800700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82a01023f0 0x7f82a01102c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:06.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.709+0000 7f82a8800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a0110fd0 con 0x7f82a0066270 2024-04-23T14:59:06.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.709+0000 7f82a8800700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a0111140 con 0x7f82a01023f0 2024-04-23T14:59:06.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.709+0000 7f82a5e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82a0066270 0x7f82a010fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:06.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.709+0000 7f82a5e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82a0066270 0x7f82a010fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39188/0 (socket says 172.21.15.81:39188) 2024-04-23T14:59:06.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.709+0000 7f82a5e00700 1 -- 172.21.15.81:0/1042102140 learned_addr learned my addr 172.21.15.81:0/1042102140 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:59:06.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.710+0000 7f82a5e00700 1 -- 172.21.15.81:0/1042102140 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82a01023f0 msgr2=0x7f82a01102c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:06.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.710+0000 7f82a5400700 1 --2- 172.21.15.81:0/1042102140 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82a01023f0 0x7f82a01102c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:06.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.710+0000 7f82a5e00700 1 --2- 172.21.15.81:0/1042102140 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82a01023f0 0x7f82a01102c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:06.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.710+0000 7f82a5e00700 1 -- 172.21.15.81:0/1042102140 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8294005040 con 0x7f82a0066270 2024-04-23T14:59:06.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.710+0000 7f82a5400700 1 --2- 172.21.15.81:0/1042102140 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82a01023f0 0x7f82a01102c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:59:06.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.710+0000 7f82a5e00700 1 --2- 172.21.15.81:0/1042102140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82a0066270 0x7f82a010fd80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8294000c00 tx=0x7f8294009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:06.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.710+0000 7f829a000700 1 -- 172.21.15.81:0/1042102140 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f829400e040 con 0x7f82a0066270 2024-04-23T14:59:06.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.710+0000 7f829a000700 1 -- 172.21.15.81:0/1042102140 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f829400bb90 con 0x7f82a0066270 2024-04-23T14:59:06.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.710+0000 7f82a8800700 1 -- 172.21.15.81:0/1042102140 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82a01113c0 con 0x7f82a0066270 2024-04-23T14:59:06.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.710+0000 7f829a000700 1 -- 172.21.15.81:0/1042102140 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f829401c630 con 0x7f82a0066270 2024-04-23T14:59:06.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.710+0000 7f82a8800700 1 -- 172.21.15.81:0/1042102140 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82a0111980 con 0x7f82a0066270 2024-04-23T14:59:06.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.711+0000 7f82a8800700 1 -- 172.21.15.81:0/1042102140 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82a005f5f0 con 0x7f82a0066270 2024-04-23T14:59:06.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.712+0000 7f829a000700 1 -- 172.21.15.81:0/1042102140 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f829400bd00 con 0x7f82a0066270 2024-04-23T14:59:06.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.713+0000 7f829a000700 1 --2- 172.21.15.81:0/1042102140 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f828806ec10 0x7f82880710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:06.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.713+0000 7f829a000700 1 -- 172.21.15.81:0/1042102140 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f829408f5a0 con 0x7f82a0066270 2024-04-23T14:59:06.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.713+0000 7f82a5400700 1 --2- 172.21.15.81:0/1042102140 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f828806ec10 0x7f82880710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:06.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.714+0000 7f82a5400700 1 --2- 172.21.15.81:0/1042102140 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f828806ec10 0x7f82880710c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8290006fd0 tx=0x7f8290008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:06.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:06.718+0000 7f829a000700 1 -- 172.21.15.81:0/1042102140 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f829405be00 con 0x7f82a0066270 2024-04-23T14:59:07.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:07.034+0000 7f82a8800700 1 -- 172.21.15.81:0/1042102140 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f82a004bed0 con 0x7f82a0066270 2024-04-23T14:59:07.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:07.035+0000 7f829a000700 1 -- 172.21.15.81:0/1042102140 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+107 (secure 0 0 0) 0x7f829405b990 con 0x7f82a0066270 2024-04-23T14:59:07.036 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_WARN 1 filesystem is degraded 2024-04-23T14:59:07.036 INFO:teuthology.orchestra.run.smithi081.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-04-23T14:59:07.036 INFO:teuthology.orchestra.run.smithi081.stdout: fs cephfs is degraded 2024-04-23T14:59:07.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:07.038+0000 7f82a8800700 1 -- 172.21.15.81:0/1042102140 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f828806ec10 msgr2=0x7f82880710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:07.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:07.038+0000 7f82a8800700 1 --2- 172.21.15.81:0/1042102140 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f828806ec10 0x7f82880710c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8290006fd0 tx=0x7f8290008040 comp rx=0 tx=0).stop 2024-04-23T14:59:07.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:07.038+0000 7f82a8800700 1 -- 172.21.15.81:0/1042102140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82a0066270 msgr2=0x7f82a010fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:07.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:07.038+0000 7f82a8800700 1 --2- 172.21.15.81:0/1042102140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82a0066270 0x7f82a010fd80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8294000c00 tx=0x7f8294009e30 comp rx=0 tx=0).stop 2024-04-23T14:59:07.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:07.038+0000 7f82a8800700 1 -- 172.21.15.81:0/1042102140 shutdown_connections 2024-04-23T14:59:07.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:07.038+0000 7f82a8800700 1 --2- 172.21.15.81:0/1042102140 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f828806ec10 0x7f82880710c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:07.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:07.038+0000 7f82a8800700 1 --2- 172.21.15.81:0/1042102140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82a0066270 0x7f82a010fd80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:07.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:07.038+0000 7f82a8800700 1 --2- 172.21.15.81:0/1042102140 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82a01023f0 0x7f82a01102c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:07.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:07.038+0000 7f82a8800700 1 -- 172.21.15.81:0/1042102140 >> 172.21.15.81:0/1042102140 conn(0x7f82a00f74c0 msgr2=0x7f82a00f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:07.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:07.039+0000 7f82a8800700 1 -- 172.21.15.81:0/1042102140 shutdown_connections 2024-04-23T14:59:07.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:07.039+0000 7f82a8800700 1 -- 172.21.15.81:0/1042102140 wait complete. 2024-04-23T14:59:07.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:07 smithi081 ceph-mon[90469]: mds.? [v2:172.21.15.81:6826/3200953351,v1:172.21.15.81:6827/3200953351] up:reconnect 2024-04-23T14:59:07.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:07 smithi081 ceph-mon[90469]: fsmap cephfs:1/1 {0=cephfs.smithi081.wydgcg=up:reconnect} 3 up:standby 2024-04-23T14:59:07.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:07 smithi081 ceph-mon[90469]: reconnect by client.14524 v1:192.168.0.1:0/2829014833 after 0.00899982 2024-04-23T14:59:07.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:07 smithi081 ceph-mon[90469]: reconnect by client.14530 v1:172.21.15.156:0/596389174 after 0.00899982 2024-04-23T14:59:07.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:07 smithi081 ceph-mon[90469]: from='client.34520 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:59:07.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:07 smithi081 ceph-mon[90469]: pgmap v239: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-04-23T14:59:07.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:07 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/1042102140' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:59:07.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:07 smithi156 ceph-mon[77738]: mds.? [v2:172.21.15.81:6826/3200953351,v1:172.21.15.81:6827/3200953351] up:reconnect 2024-04-23T14:59:07.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:07 smithi156 ceph-mon[77738]: fsmap cephfs:1/1 {0=cephfs.smithi081.wydgcg=up:reconnect} 3 up:standby 2024-04-23T14:59:07.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:07 smithi156 ceph-mon[77738]: reconnect by client.14524 v1:192.168.0.1:0/2829014833 after 0.00899982 2024-04-23T14:59:07.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:07 smithi156 ceph-mon[77738]: reconnect by client.14530 v1:172.21.15.156:0/596389174 after 0.00899982 2024-04-23T14:59:07.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:07 smithi156 ceph-mon[77738]: from='client.34520 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:59:07.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:07 smithi156 ceph-mon[77738]: pgmap v239: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-04-23T14:59:07.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:07 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/1042102140' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:59:08.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:08 smithi156 ceph-mon[77738]: mds.? [v2:172.21.15.81:6826/3200953351,v1:172.21.15.81:6827/3200953351] up:rejoin 2024-04-23T14:59:08.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:08 smithi156 ceph-mon[77738]: fsmap cephfs:1/1 {0=cephfs.smithi081.wydgcg=up:rejoin} 3 up:standby 2024-04-23T14:59:08.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:08 smithi156 ceph-mon[77738]: daemon mds.cephfs.smithi081.wydgcg is now active in filesystem cephfs as rank 0 2024-04-23T14:59:08.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:08 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:08.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:08 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:08.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:08 smithi081 ceph-mon[90469]: mds.? [v2:172.21.15.81:6826/3200953351,v1:172.21.15.81:6827/3200953351] up:rejoin 2024-04-23T14:59:08.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:08 smithi081 ceph-mon[90469]: fsmap cephfs:1/1 {0=cephfs.smithi081.wydgcg=up:rejoin} 3 up:standby 2024-04-23T14:59:08.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:08 smithi081 ceph-mon[90469]: daemon mds.cephfs.smithi081.wydgcg is now active in filesystem cephfs as rank 0 2024-04-23T14:59:08.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:08 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:08.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:08 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:09.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:09 smithi156 ceph-mon[77738]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-23T14:59:09.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:09 smithi156 ceph-mon[77738]: Cluster is now healthy 2024-04-23T14:59:09.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:09 smithi156 ceph-mon[77738]: mds.? [v2:172.21.15.81:6826/3200953351,v1:172.21.15.81:6827/3200953351] up:active 2024-04-23T14:59:09.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:09 smithi156 ceph-mon[77738]: fsmap cephfs:1 {0=cephfs.smithi081.wydgcg=up:active} 3 up:standby 2024-04-23T14:59:09.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:09 smithi156 ceph-mon[77738]: pgmap v240: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 93 B/s wr, 5 op/s 2024-04-23T14:59:09.574 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:09 smithi081 ceph-mon[90469]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-23T14:59:09.574 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:09 smithi081 ceph-mon[90469]: Cluster is now healthy 2024-04-23T14:59:09.574 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:09 smithi081 ceph-mon[90469]: mds.? [v2:172.21.15.81:6826/3200953351,v1:172.21.15.81:6827/3200953351] up:active 2024-04-23T14:59:09.574 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:09 smithi081 ceph-mon[90469]: fsmap cephfs:1 {0=cephfs.smithi081.wydgcg=up:active} 3 up:standby 2024-04-23T14:59:09.574 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:09 smithi081 ceph-mon[90469]: pgmap v240: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 93 B/s wr, 5 op/s 2024-04-23T14:59:11.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:11 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:11.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:11 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:11.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:11 smithi156 ceph-mon[77738]: pgmap v241: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 170 B/s wr, 7 op/s 2024-04-23T14:59:11.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:11 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:11.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:11 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:11.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:11 smithi081 ceph-mon[90469]: pgmap v241: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 170 B/s wr, 7 op/s 2024-04-23T14:59:12.040 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:12 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:59:12.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:12 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:59:13.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:13 smithi156 ceph-mon[77738]: pgmap v242: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 170 B/s wr, 6 op/s 2024-04-23T14:59:13.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:13 smithi081 ceph-mon[90469]: pgmap v242: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 170 B/s wr, 6 op/s 2024-04-23T14:59:15.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:15 smithi156 ceph-mon[77738]: pgmap v243: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4.4 KiB/s wr, 8 op/s 2024-04-23T14:59:15.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:15 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:15.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:15 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:15.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:15 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:59:15.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:15 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:59:15.787 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:15 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:16.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:15 smithi081 ceph-mon[90469]: pgmap v243: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4.4 KiB/s wr, 8 op/s 2024-04-23T14:59:16.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:15 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:16.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:15 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:16.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:15 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:59:16.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:15 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:59:16.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:15 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:17.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:16 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:59:17.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:16 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:17.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:16 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:17.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:16 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:17.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:16 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:17.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:16 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:17.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:16 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:17.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:16 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi081.vcoywg"}]: dispatch 2024-04-23T14:59:17.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:16 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi081.vcoywg"}]': finished 2024-04-23T14:59:17.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:16 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi081.wydgcg"}]: dispatch 2024-04-23T14:59:17.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:16 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi081.wydgcg"}]': finished 2024-04-23T14:59:17.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:16 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi156.rhbtxt"}]: dispatch 2024-04-23T14:59:17.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:16 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi156.rhbtxt"}]': finished 2024-04-23T14:59:17.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:16 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi156.vynkxn"}]: dispatch 2024-04-23T14:59:17.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:16 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi156.vynkxn"}]': finished 2024-04-23T14:59:17.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:16 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-04-23T14:59:17.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:16 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-04-23T14:59:17.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:16 smithi156 ceph-mon[77738]: fsmap cephfs:1 {0=cephfs.smithi081.wydgcg=up:active} 1 up:standby-replay 2 up:standby 2024-04-23T14:59:17.039 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:16 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:17.039 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:16 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:17.039 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:16 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:17.039 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:16 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:17.039 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:16 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:17.039 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:16 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:17.039 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:16 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:17.039 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:16 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:17.039 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:16 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:17.039 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:16 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:17.039 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:16 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:17.039 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:16 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:17.040 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:16 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:17.040 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:16 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:17.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:16 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:59:17.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:16 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:17.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:16 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:17.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:16 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:17.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:16 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:17.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:16 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:17.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:16 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:17.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:16 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi081.vcoywg"}]: dispatch 2024-04-23T14:59:17.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:16 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi081.vcoywg"}]': finished 2024-04-23T14:59:17.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:16 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi081.wydgcg"}]: dispatch 2024-04-23T14:59:17.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:16 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi081.wydgcg"}]': finished 2024-04-23T14:59:17.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:16 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi156.rhbtxt"}]: dispatch 2024-04-23T14:59:17.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:16 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi156.rhbtxt"}]': finished 2024-04-23T14:59:17.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:16 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi156.vynkxn"}]: dispatch 2024-04-23T14:59:17.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:16 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi156.vynkxn"}]': finished 2024-04-23T14:59:17.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:16 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-04-23T14:59:17.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:16 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-04-23T14:59:17.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:16 smithi081 ceph-mon[90469]: fsmap cephfs:1 {0=cephfs.smithi081.wydgcg=up:active} 1 up:standby-replay 2 up:standby 2024-04-23T14:59:17.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:16 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:17.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:16 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:17.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:16 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:17.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:16 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:17.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:16 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:17.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:16 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:17.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:16 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:17.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:16 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:17.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:16 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:17.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:16 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:17.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:16 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:17.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:16 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:17.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:16 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:17.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:16 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:18.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:17 smithi156 ceph-mon[77738]: Upgrade: Setting container_image for all mds 2024-04-23T14:59:18.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:17 smithi156 ceph-mon[77738]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-04-23T14:59:18.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:17 smithi156 ceph-mon[77738]: Upgrade: Setting container_image for all rgw 2024-04-23T14:59:18.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:17 smithi156 ceph-mon[77738]: Upgrade: Setting container_image for all rbd-mirror 2024-04-23T14:59:18.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:17 smithi156 ceph-mon[77738]: Upgrade: Setting container_image for all ceph-exporter 2024-04-23T14:59:18.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:17 smithi156 ceph-mon[77738]: Upgrade: Setting container_image for all iscsi 2024-04-23T14:59:18.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:17 smithi156 ceph-mon[77738]: Upgrade: Setting container_image for all nfs 2024-04-23T14:59:18.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:17 smithi156 ceph-mon[77738]: Upgrade: Setting container_image for all nvmeof 2024-04-23T14:59:18.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:17 smithi156 ceph-mon[77738]: pgmap v244: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-04-23T14:59:18.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:17 smithi081 ceph-mon[90469]: Upgrade: Setting container_image for all mds 2024-04-23T14:59:18.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:17 smithi081 ceph-mon[90469]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-04-23T14:59:18.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:17 smithi081 ceph-mon[90469]: Upgrade: Setting container_image for all rgw 2024-04-23T14:59:18.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:17 smithi081 ceph-mon[90469]: Upgrade: Setting container_image for all rbd-mirror 2024-04-23T14:59:18.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:17 smithi081 ceph-mon[90469]: Upgrade: Setting container_image for all ceph-exporter 2024-04-23T14:59:18.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:17 smithi081 ceph-mon[90469]: Upgrade: Setting container_image for all iscsi 2024-04-23T14:59:18.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:17 smithi081 ceph-mon[90469]: Upgrade: Setting container_image for all nfs 2024-04-23T14:59:18.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:17 smithi081 ceph-mon[90469]: Upgrade: Setting container_image for all nvmeof 2024-04-23T14:59:18.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:17 smithi081 ceph-mon[90469]: pgmap v244: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-04-23T14:59:19.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:19 smithi081 ceph-mon[90469]: pgmap v245: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-04-23T14:59:19.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:19 smithi081 ceph-mon[90469]: Upgrade: Updating node-exporter.smithi081 (1/2) 2024-04-23T14:59:19.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:19 smithi081 ceph-mon[90469]: Deploying daemon node-exporter.smithi081 on smithi081 2024-04-23T14:59:20.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:19 smithi156 ceph-mon[77738]: pgmap v245: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-04-23T14:59:20.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:19 smithi156 ceph-mon[77738]: Upgrade: Updating node-exporter.smithi081 (1/2) 2024-04-23T14:59:20.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:19 smithi156 ceph-mon[77738]: Deploying daemon node-exporter.smithi081 on smithi081 2024-04-23T14:59:22.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:21 smithi156 ceph-mon[77738]: pgmap v246: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 8.0 MiB/s rd, 4.3 KiB/s wr, 7 op/s 2024-04-23T14:59:22.063 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:21 smithi081 ceph-mon[90469]: pgmap v246: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 8.0 MiB/s rd, 4.3 KiB/s wr, 7 op/s 2024-04-23T14:59:23.953 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:23 smithi156 ceph-mon[77738]: pgmap v247: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 8.3 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-23T14:59:23.953 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:23 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:23.953 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:23 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:24.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:23 smithi081 ceph-mon[90469]: pgmap v247: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 8.3 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-23T14:59:24.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:23 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:24.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:23 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:26.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:25 smithi156 ceph-mon[77738]: pgmap v248: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-04-23T14:59:26.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:25 smithi081 ceph-mon[90469]: pgmap v248: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-04-23T14:59:26.757 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:26 smithi156 ceph-mon[77738]: Upgrade: Updating node-exporter.smithi156 (2/2) 2024-04-23T14:59:26.757 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:26 smithi156 ceph-mon[77738]: Deploying daemon node-exporter.smithi156 on smithi156 2024-04-23T14:59:26.757 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:26 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:59:27.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:26 smithi081 ceph-mon[90469]: Upgrade: Updating node-exporter.smithi156 (2/2) 2024-04-23T14:59:27.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:26 smithi081 ceph-mon[90469]: Deploying daemon node-exporter.smithi156 on smithi156 2024-04-23T14:59:27.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:26 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:59:27.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:27 smithi081 ceph-mon[90469]: pgmap v249: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4 op/s 2024-04-23T14:59:27.968 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:27 smithi156 ceph-mon[77738]: pgmap v249: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4 op/s 2024-04-23T14:59:29.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:29 smithi081 ceph-mon[90469]: pgmap v250: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-04-23T14:59:29.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:29 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:29.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:29 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:29.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:29 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:59:30.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:29 smithi156 ceph-mon[77738]: pgmap v250: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-04-23T14:59:30.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:29 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:30.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:29 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:30.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:29 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:59:32.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:31 smithi156 ceph-mon[77738]: pgmap v251: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4 op/s 2024-04-23T14:59:32.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:31 smithi081 ceph-mon[90469]: pgmap v251: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4 op/s 2024-04-23T14:59:33.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:33.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:33.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:33 smithi081 ceph-mon[90469]: pgmap v252: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 8.1 MiB/s rd, 2 op/s 2024-04-23T14:59:33.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:33.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:33.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:33 smithi156 ceph-mon[77738]: pgmap v252: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 8.1 MiB/s rd, 2 op/s 2024-04-23T14:59:35.683 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:35 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:35.683 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:35 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:35.683 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:35 smithi156 ceph-mon[77738]: pgmap v253: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 7.8 MiB/s rd, 3 op/s 2024-04-23T14:59:35.683 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:35 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:35.683 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:35 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:35.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:35 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:35.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:35 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:35.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:35 smithi081 ceph-mon[90469]: pgmap v253: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 7.8 MiB/s rd, 3 op/s 2024-04-23T14:59:35.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:35 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:35.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:35 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:37.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.200+0000 7fae36a00700 1 -- 172.21.15.81:0/842052158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae300fe0e0 msgr2=0x7fae300fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:37.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.200+0000 7fae36a00700 1 --2- 172.21.15.81:0/842052158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae300fe0e0 0x7fae300fe550 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fae1c004940 tx=0x7fae1c009e30 comp rx=0 tx=0).stop 2024-04-23T14:59:37.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.200+0000 7fae36a00700 1 -- 172.21.15.81:0/842052158 shutdown_connections 2024-04-23T14:59:37.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.200+0000 7fae36a00700 1 --2- 172.21.15.81:0/842052158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae300fe0e0 0x7fae300fe550 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:37.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.200+0000 7fae36a00700 1 --2- 172.21.15.81:0/842052158 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae300fcef0 0x7fae300fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:37.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.200+0000 7fae36a00700 1 -- 172.21.15.81:0/842052158 >> 172.21.15.81:0/842052158 conn(0x7fae300f8530 msgr2=0x7fae300fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:37.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.200+0000 7fae36a00700 1 -- 172.21.15.81:0/842052158 shutdown_connections 2024-04-23T14:59:37.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.200+0000 7fae36a00700 1 -- 172.21.15.81:0/842052158 wait complete. 2024-04-23T14:59:37.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.201+0000 7fae36a00700 1 Processor -- start 2024-04-23T14:59:37.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.201+0000 7fae36a00700 1 -- start start 2024-04-23T14:59:37.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.202+0000 7fae36a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae300fcef0 0x7fae30071df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:37.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.202+0000 7fae36a00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae300fe0e0 0x7fae30070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:37.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.202+0000 7fae36a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae30111700 con 0x7fae300fcef0 2024-04-23T14:59:37.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.202+0000 7fae36a00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae30111840 con 0x7fae300fe0e0 2024-04-23T14:59:37.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.202+0000 7fae2fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae300fcef0 0x7fae30071df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:37.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.202+0000 7fae2fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae300fcef0 0x7fae30071df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38736/0 (socket says 172.21.15.81:38736) 2024-04-23T14:59:37.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.202+0000 7fae2fe00700 1 -- 172.21.15.81:0/3997274035 learned_addr learned my addr 172.21.15.81:0/3997274035 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:59:37.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.202+0000 7fae2f400700 1 --2- 172.21.15.81:0/3997274035 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae300fe0e0 0x7fae30070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:37.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.203+0000 7fae2fe00700 1 -- 172.21.15.81:0/3997274035 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae300fe0e0 msgr2=0x7fae30070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:37.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.203+0000 7fae2fe00700 1 --2- 172.21.15.81:0/3997274035 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae300fe0e0 0x7fae30070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:37.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.203+0000 7fae2fe00700 1 -- 172.21.15.81:0/3997274035 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae1c005040 con 0x7fae300fcef0 2024-04-23T14:59:37.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.203+0000 7fae2fe00700 1 --2- 172.21.15.81:0/3997274035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae300fcef0 0x7fae30071df0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fae20002a80 tx=0x7fae20004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:37.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.203+0000 7fae27e00700 1 -- 172.21.15.81:0/3997274035 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae20007cc0 con 0x7fae300fcef0 2024-04-23T14:59:37.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.203+0000 7fae27e00700 1 -- 172.21.15.81:0/3997274035 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fae2000f040 con 0x7fae300fcef0 2024-04-23T14:59:37.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.203+0000 7fae36a00700 1 -- 172.21.15.81:0/3997274035 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae30070910 con 0x7fae300fcef0 2024-04-23T14:59:37.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.203+0000 7fae27e00700 1 -- 172.21.15.81:0/3997274035 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae2000da30 con 0x7fae300fcef0 2024-04-23T14:59:37.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.204+0000 7fae36a00700 1 -- 172.21.15.81:0/3997274035 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae30070ed0 con 0x7fae300fcef0 2024-04-23T14:59:37.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.205+0000 7fae36a00700 1 -- 172.21.15.81:0/3997274035 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae3005f5f0 con 0x7fae300fcef0 2024-04-23T14:59:37.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.206+0000 7fae27e00700 1 -- 172.21.15.81:0/3997274035 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fae2000db90 con 0x7fae300fcef0 2024-04-23T14:59:37.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.207+0000 7fae27e00700 1 --2- 172.21.15.81:0/3997274035 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fae1406ec10 0x7fae140710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:37.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.207+0000 7fae27e00700 1 -- 172.21.15.81:0/3997274035 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fae2008e600 con 0x7fae300fcef0 2024-04-23T14:59:37.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.207+0000 7fae2f400700 1 --2- 172.21.15.81:0/3997274035 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fae1406ec10 0x7fae140710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:37.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.208+0000 7fae2f400700 1 --2- 172.21.15.81:0/3997274035 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fae1406ec10 0x7fae140710c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fae300723d0 tx=0x7fae1c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:37.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.212+0000 7fae27e00700 1 -- 172.21.15.81:0/3997274035 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fae20057330 con 0x7fae300fcef0 2024-04-23T14:59:37.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.464+0000 7fae36a00700 1 -- 172.21.15.81:0/3997274035 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fae301024a0 con 0x7fae1406ec10 2024-04-23T14:59:37.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.466+0000 7fae27e00700 1 -- 172.21.15.81:0/3997274035 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7fae301024a0 con 0x7fae1406ec10 2024-04-23T14:59:37.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.469+0000 7fae36a00700 1 -- 172.21.15.81:0/3997274035 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fae1406ec10 msgr2=0x7fae140710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:37.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.469+0000 7fae36a00700 1 --2- 172.21.15.81:0/3997274035 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fae1406ec10 0x7fae140710c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fae300723d0 tx=0x7fae1c009e30 comp rx=0 tx=0).stop 2024-04-23T14:59:37.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.469+0000 7fae36a00700 1 -- 172.21.15.81:0/3997274035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae300fcef0 msgr2=0x7fae30071df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:37.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.469+0000 7fae36a00700 1 --2- 172.21.15.81:0/3997274035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae300fcef0 0x7fae30071df0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fae20002a80 tx=0x7fae20004600 comp rx=0 tx=0).stop 2024-04-23T14:59:37.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.469+0000 7fae36a00700 1 -- 172.21.15.81:0/3997274035 shutdown_connections 2024-04-23T14:59:37.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.469+0000 7fae36a00700 1 --2- 172.21.15.81:0/3997274035 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fae1406ec10 0x7fae140710c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:37.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.469+0000 7fae36a00700 1 --2- 172.21.15.81:0/3997274035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae300fcef0 0x7fae30071df0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:37.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.469+0000 7fae36a00700 1 --2- 172.21.15.81:0/3997274035 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae300fe0e0 0x7fae30070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:37.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.469+0000 7fae36a00700 1 -- 172.21.15.81:0/3997274035 >> 172.21.15.81:0/3997274035 conn(0x7fae300f8530 msgr2=0x7fae300f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:37.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.469+0000 7fae36a00700 1 -- 172.21.15.81:0/3997274035 shutdown_connections 2024-04-23T14:59:37.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.469+0000 7fae36a00700 1 -- 172.21.15.81:0/3997274035 wait complete. 2024-04-23T14:59:37.486 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-04-23T14:59:37.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.626+0000 7f6162000700 1 -- 172.21.15.81:0/285080651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f615c0fe0e0 msgr2=0x7f615c0fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:37.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.626+0000 7f6162000700 1 --2- 172.21.15.81:0/285080651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f615c0fe0e0 0x7f615c0fe550 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6148004940 tx=0x7f6148009e30 comp rx=0 tx=0).stop 2024-04-23T14:59:37.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.626+0000 7f6162000700 1 -- 172.21.15.81:0/285080651 shutdown_connections 2024-04-23T14:59:37.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.626+0000 7f6162000700 1 --2- 172.21.15.81:0/285080651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f615c0fe0e0 0x7f615c0fe550 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:37.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.626+0000 7f6162000700 1 --2- 172.21.15.81:0/285080651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f615c0fcef0 0x7f615c0fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:37.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.626+0000 7f6162000700 1 -- 172.21.15.81:0/285080651 >> 172.21.15.81:0/285080651 conn(0x7f615c0f8530 msgr2=0x7f615c0fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:37.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.627+0000 7f6162000700 1 -- 172.21.15.81:0/285080651 shutdown_connections 2024-04-23T14:59:37.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.627+0000 7f6162000700 1 -- 172.21.15.81:0/285080651 wait complete. 2024-04-23T14:59:37.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.627+0000 7f6162000700 1 Processor -- start 2024-04-23T14:59:37.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.628+0000 7f6162000700 1 -- start start 2024-04-23T14:59:37.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.628+0000 7f6162000700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f615c0fcef0 0x7f615c10da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:37.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.628+0000 7f6162000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f615c0fe0e0 0x7f615c10dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:37.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.628+0000 7f6162000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c10e5d0 con 0x7f615c0fe0e0 2024-04-23T14:59:37.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.628+0000 7f6162000700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c10edd0 con 0x7f615c0fcef0 2024-04-23T14:59:37.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.628+0000 7f615aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f615c0fe0e0 0x7f615c10dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:37.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.628+0000 7f615aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f615c0fe0e0 0x7f615c10dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38760/0 (socket says 172.21.15.81:38760) 2024-04-23T14:59:37.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.628+0000 7f615aa00700 1 -- 172.21.15.81:0/1372702006 learned_addr learned my addr 172.21.15.81:0/1372702006 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:59:37.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.628+0000 7f615b400700 1 --2- 172.21.15.81:0/1372702006 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f615c0fcef0 0x7f615c10da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:37.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.629+0000 7f615aa00700 1 -- 172.21.15.81:0/1372702006 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f615c0fcef0 msgr2=0x7f615c10da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:37.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.629+0000 7f615aa00700 1 --2- 172.21.15.81:0/1372702006 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f615c0fcef0 0x7f615c10da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:37.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.629+0000 7f615aa00700 1 -- 172.21.15.81:0/1372702006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6148005040 con 0x7f615c0fe0e0 2024-04-23T14:59:37.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.629+0000 7f615aa00700 1 --2- 172.21.15.81:0/1372702006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f615c0fe0e0 0x7f615c10dfd0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6148009150 tx=0x7f6148009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:37.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.629+0000 7f6153400700 1 -- 172.21.15.81:0/1372702006 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f614800e040 con 0x7f615c0fe0e0 2024-04-23T14:59:37.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.629+0000 7f6153400700 1 -- 172.21.15.81:0/1372702006 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f614800bcc0 con 0x7f615c0fe0e0 2024-04-23T14:59:37.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.629+0000 7f6153400700 1 -- 172.21.15.81:0/1372702006 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f614801c630 con 0x7f615c0fe0e0 2024-04-23T14:59:37.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.629+0000 7f6162000700 1 -- 172.21.15.81:0/1372702006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f615c10f050 con 0x7f615c0fe0e0 2024-04-23T14:59:37.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.630+0000 7f6162000700 1 -- 172.21.15.81:0/1372702006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f615c10f540 con 0x7f615c0fe0e0 2024-04-23T14:59:37.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.631+0000 7f6162000700 1 -- 172.21.15.81:0/1372702006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f615c05f5f0 con 0x7f615c0fe0e0 2024-04-23T14:59:37.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.632+0000 7f6153400700 1 -- 172.21.15.81:0/1372702006 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f6148013420 con 0x7f615c0fe0e0 2024-04-23T14:59:37.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.633+0000 7f6153400700 1 --2- 172.21.15.81:0/1372702006 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f614006ec00 0x7f61400710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:37.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.633+0000 7f6153400700 1 -- 172.21.15.81:0/1372702006 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f614808f570 con 0x7f615c0fe0e0 2024-04-23T14:59:37.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.633+0000 7f615b400700 1 --2- 172.21.15.81:0/1372702006 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f614006ec00 0x7f61400710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:37.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.634+0000 7f615b400700 1 --2- 172.21.15.81:0/1372702006 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f614006ec00 0x7f61400710b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f614c009fd0 tx=0x7f614c009f00 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:37.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.638+0000 7f6153400700 1 -- 172.21.15.81:0/1372702006 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f614805be50 con 0x7f615c0fe0e0 2024-04-23T14:59:37.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:37 smithi081 ceph-mon[90469]: pgmap v254: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 818 KiB/s rd, 1 op/s 2024-04-23T14:59:37.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:37 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:37.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:37 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:37.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.882+0000 7f6162000700 1 -- 172.21.15.81:0/1372702006 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f615c10f8e0 con 0x7f614006ec00 2024-04-23T14:59:37.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.883+0000 7f6153400700 1 -- 172.21.15.81:0/1372702006 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f615c10f8e0 con 0x7f614006ec00 2024-04-23T14:59:37.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.886+0000 7f6162000700 1 -- 172.21.15.81:0/1372702006 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f614006ec00 msgr2=0x7f61400710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:37.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.886+0000 7f6162000700 1 --2- 172.21.15.81:0/1372702006 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f614006ec00 0x7f61400710b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f614c009fd0 tx=0x7f614c009f00 comp rx=0 tx=0).stop 2024-04-23T14:59:37.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.886+0000 7f6162000700 1 -- 172.21.15.81:0/1372702006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f615c0fe0e0 msgr2=0x7f615c10dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:37.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.886+0000 7f6162000700 1 --2- 172.21.15.81:0/1372702006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f615c0fe0e0 0x7f615c10dfd0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6148009150 tx=0x7f6148009e30 comp rx=0 tx=0).stop 2024-04-23T14:59:37.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.886+0000 7f6162000700 1 -- 172.21.15.81:0/1372702006 shutdown_connections 2024-04-23T14:59:37.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.886+0000 7f6162000700 1 --2- 172.21.15.81:0/1372702006 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f614006ec00 0x7f61400710b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:37.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.886+0000 7f6162000700 1 --2- 172.21.15.81:0/1372702006 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f615c0fcef0 0x7f615c10da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:37.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.886+0000 7f6162000700 1 --2- 172.21.15.81:0/1372702006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f615c0fe0e0 0x7f615c10dfd0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:37.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.886+0000 7f6162000700 1 -- 172.21.15.81:0/1372702006 >> 172.21.15.81:0/1372702006 conn(0x7f615c0f8530 msgr2=0x7f615c0f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:37.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.886+0000 7f6162000700 1 -- 172.21.15.81:0/1372702006 shutdown_connections 2024-04-23T14:59:37.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:37.886+0000 7f6162000700 1 -- 172.21.15.81:0/1372702006 wait complete. 2024-04-23T14:59:38.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:37 smithi156 ceph-mon[77738]: pgmap v254: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 818 KiB/s rd, 1 op/s 2024-04-23T14:59:38.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:37 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:38.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:37 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:38.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.036+0000 7f733c800700 1 -- 172.21.15.81:0/754594788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73340fcef0 msgr2=0x7f73340fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:38.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.036+0000 7f733c800700 1 --2- 172.21.15.81:0/754594788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73340fcef0 0x7f73340fd320 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7328004940 tx=0x7f7328009e30 comp rx=0 tx=0).stop 2024-04-23T14:59:38.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.037+0000 7f733c800700 1 -- 172.21.15.81:0/754594788 shutdown_connections 2024-04-23T14:59:38.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.037+0000 7f733c800700 1 --2- 172.21.15.81:0/754594788 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73340fe0e0 0x7f73340fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:38.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.037+0000 7f733c800700 1 --2- 172.21.15.81:0/754594788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73340fcef0 0x7f73340fd320 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:38.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.037+0000 7f733c800700 1 -- 172.21.15.81:0/754594788 >> 172.21.15.81:0/754594788 conn(0x7f73340f8530 msgr2=0x7f73340fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:38.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.037+0000 7f733c800700 1 -- 172.21.15.81:0/754594788 shutdown_connections 2024-04-23T14:59:38.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.037+0000 7f733c800700 1 -- 172.21.15.81:0/754594788 wait complete. 2024-04-23T14:59:38.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.037+0000 7f733c800700 1 Processor -- start 2024-04-23T14:59:38.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.038+0000 7f733c800700 1 -- start start 2024-04-23T14:59:38.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.038+0000 7f733c800700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73340fcef0 0x7f7334071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:38.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.038+0000 7f733c800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73340fe0e0 0x7f7334070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:38.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.038+0000 7f733c800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73340708c0 con 0x7f73340fe0e0 2024-04-23T14:59:38.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.038+0000 7f733c800700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7334070a30 con 0x7f73340fcef0 2024-04-23T14:59:38.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.038+0000 7f7339400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73340fe0e0 0x7f7334070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:38.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.038+0000 7f7339400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73340fe0e0 0x7f7334070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38768/0 (socket says 172.21.15.81:38768) 2024-04-23T14:59:38.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.038+0000 7f7339400700 1 -- 172.21.15.81:0/3487933372 learned_addr learned my addr 172.21.15.81:0/3487933372 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:59:38.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.038+0000 7f7339e00700 1 --2- 172.21.15.81:0/3487933372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73340fcef0 0x7f7334071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:38.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.039+0000 7f7339400700 1 -- 172.21.15.81:0/3487933372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73340fcef0 msgr2=0x7f7334071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:38.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.039+0000 7f7339400700 1 --2- 172.21.15.81:0/3487933372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73340fcef0 0x7f7334071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:38.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.039+0000 7f7339400700 1 -- 172.21.15.81:0/3487933372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7328005040 con 0x7f73340fe0e0 2024-04-23T14:59:38.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.039+0000 7f7339400700 1 --2- 172.21.15.81:0/3487933372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73340fe0e0 0x7f7334070310 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f732400c830 tx=0x7f7324004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:38.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.039+0000 7f732e000700 1 -- 172.21.15.81:0/3487933372 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f732400a760 con 0x7f73340fe0e0 2024-04-23T14:59:38.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.039+0000 7f732e000700 1 -- 172.21.15.81:0/3487933372 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f732400ad90 con 0x7f73340fe0e0 2024-04-23T14:59:38.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.039+0000 7f732e000700 1 -- 172.21.15.81:0/3487933372 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73240113a0 con 0x7f73340fe0e0 2024-04-23T14:59:38.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.039+0000 7f733c800700 1 -- 172.21.15.81:0/3487933372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7334070d10 con 0x7f73340fe0e0 2024-04-23T14:59:38.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.039+0000 7f733c800700 1 -- 172.21.15.81:0/3487933372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7334115ab0 con 0x7f73340fe0e0 2024-04-23T14:59:38.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.040+0000 7f733c800700 1 -- 172.21.15.81:0/3487933372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f733405f5f0 con 0x7f73340fe0e0 2024-04-23T14:59:38.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.042+0000 7f732e000700 1 -- 172.21.15.81:0/3487933372 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f7324012400 con 0x7f73340fe0e0 2024-04-23T14:59:38.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.043+0000 7f732e000700 1 --2- 172.21.15.81:0/3487933372 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f731c06ece0 0x7f731c071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:38.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.043+0000 7f732e000700 1 -- 172.21.15.81:0/3487933372 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f732408e910 con 0x7f73340fe0e0 2024-04-23T14:59:38.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.043+0000 7f7339e00700 1 --2- 172.21.15.81:0/3487933372 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f731c06ece0 0x7f731c071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:38.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.044+0000 7f7339e00700 1 --2- 172.21.15.81:0/3487933372 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f731c06ece0 0x7f731c071190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7328000c00 tx=0x7f7328009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:38.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.048+0000 7f732e000700 1 -- 172.21.15.81:0/3487933372 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f73240576c0 con 0x7f73340fe0e0 2024-04-23T14:59:38.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.287+0000 7f733c800700 1 -- 172.21.15.81:0/3487933372 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7334102440 con 0x7f731c06ece0 2024-04-23T14:59:38.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.316+0000 7f732e000700 1 -- 172.21.15.81:0/3487933372 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f7334102440 con 0x7f731c06ece0 2024-04-23T14:59:38.317 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-23T14:59:38.317 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (9m) 2s ago 20m 14.7M - 0.25.0 c8568f914cd2 63876b2abc27 2024-04-23T14:59:38.317 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (5m) 2s ago 20m 6665k - 19.0.0-3126-gd44fddd9 76e77f280c74 b486fe2ef19b 2024-04-23T14:59:38.317 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi156 smithi156 running (5m) 5s ago 19m 6656k - 19.0.0-3126-gd44fddd9 76e77f280c74 5d9aa5ecf264 2024-04-23T14:59:38.317 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (9m) 2s ago 20m 73.9M - 9.4.7 954c08fa6188 fbad3cef0883 2024-04-23T14:59:38.318 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.vcoywg smithi081 running (83s) 2s ago 13m 84.8M - 19.0.0-3126-gd44fddd9 76e77f280c74 87ab7708542f 2024-04-23T14:59:38.318 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.wydgcg smithi081 running (113s) 2s ago 13m 85.2M - 19.0.0-3126-gd44fddd9 76e77f280c74 e2a96404cc4f 2024-04-23T14:59:38.318 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.rhbtxt smithi156 running (58s) 5s ago 13m 11.3M - 19.0.0-3126-gd44fddd9 76e77f280c74 208d4416e1bf 2024-04-23T14:59:38.318 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.vynkxn smithi156 running (34s) 5s ago 13m 11.1M - 19.0.0-3126-gd44fddd9 76e77f280c74 34368f26f4d2 2024-04-23T14:59:38.318 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.ldghvq smithi081 *:8443,9283,8765 running (9m) 2s ago 22m 513M - 19.0.0-3126-gd44fddd9 76e77f280c74 6bf23484a1c9 2024-04-23T14:59:38.318 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi156.ounwyj smithi156 *:8443,9283,8765 running (7m) 5s ago 19m 453M - 19.0.0-3126-gd44fddd9 76e77f280c74 a6c0dd9f89f2 2024-04-23T14:59:38.318 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (7m) 2s ago 22m 54.3M 2048M 19.0.0-3126-gd44fddd9 76e77f280c74 fbf9f9a59ac2 2024-04-23T14:59:38.318 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi156 smithi156 running (6m) 5s ago 19m 40.6M 2048M 19.0.0-3126-gd44fddd9 76e77f280c74 36409886998f 2024-04-23T14:59:38.318 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (16s) 2s ago 20m 2939k - 1.5.0 0da6a335fe13 a822ef7cd112 2024-04-23T14:59:38.318 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi156 smithi156 *:9100 running (10s) 5s ago 19m 2839k - 1.5.0 0da6a335fe13 b74c35e7cf10 2024-04-23T14:59:38.318 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (5m) 2s ago 18m 109M 1557M 19.0.0-3126-gd44fddd9 76e77f280c74 24bc24b37de5 2024-04-23T14:59:38.318 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (4m) 2s ago 17m 120M 1557M 19.0.0-3126-gd44fddd9 76e77f280c74 18d0179b558a 2024-04-23T14:59:38.318 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (4m) 2s ago 17m 97.7M 1557M 19.0.0-3126-gd44fddd9 76e77f280c74 421a62ef6990 2024-04-23T14:59:38.318 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi156 running (3m) 5s ago 16m 126M 2581M 19.0.0-3126-gd44fddd9 76e77f280c74 9af3ca1ff69b 2024-04-23T14:59:38.319 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi156 running (3m) 5s ago 16m 110M 2581M 19.0.0-3126-gd44fddd9 76e77f280c74 e0a1e784348c 2024-04-23T14:59:38.319 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi156 running (2m) 5s ago 15m 107M 2581M 19.0.0-3126-gd44fddd9 76e77f280c74 16b6ba5d9e3e 2024-04-23T14:59:38.319 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (8m) 2s ago 20m 58.4M - 2.43.0 a07b618ecd1d 35558adb166d 2024-04-23T14:59:38.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.318+0000 7f733c800700 1 -- 172.21.15.81:0/3487933372 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f731c06ece0 msgr2=0x7f731c071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:38.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.318+0000 7f733c800700 1 --2- 172.21.15.81:0/3487933372 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f731c06ece0 0x7f731c071190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7328000c00 tx=0x7f7328009e30 comp rx=0 tx=0).stop 2024-04-23T14:59:38.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.318+0000 7f733c800700 1 -- 172.21.15.81:0/3487933372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73340fe0e0 msgr2=0x7f7334070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:38.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.318+0000 7f733c800700 1 --2- 172.21.15.81:0/3487933372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73340fe0e0 0x7f7334070310 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f732400c830 tx=0x7f7324004470 comp rx=0 tx=0).stop 2024-04-23T14:59:38.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.319+0000 7f733c800700 1 -- 172.21.15.81:0/3487933372 shutdown_connections 2024-04-23T14:59:38.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.319+0000 7f733c800700 1 --2- 172.21.15.81:0/3487933372 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f731c06ece0 0x7f731c071190 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:38.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.319+0000 7f733c800700 1 --2- 172.21.15.81:0/3487933372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73340fcef0 0x7f7334071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:38.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.319+0000 7f733c800700 1 --2- 172.21.15.81:0/3487933372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73340fe0e0 0x7f7334070310 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:38.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.319+0000 7f733c800700 1 -- 172.21.15.81:0/3487933372 >> 172.21.15.81:0/3487933372 conn(0x7f73340f8530 msgr2=0x7f73340f9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:38.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.319+0000 7f733c800700 1 -- 172.21.15.81:0/3487933372 shutdown_connections 2024-04-23T14:59:38.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.319+0000 7f733c800700 1 -- 172.21.15.81:0/3487933372 wait complete. 2024-04-23T14:59:38.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.467+0000 7fd78ae00700 1 -- 172.21.15.81:0/2141692583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7840708f0 msgr2=0x7fd784070d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:38.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.467+0000 7fd78ae00700 1 --2- 172.21.15.81:0/2141692583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7840708f0 0x7fd784070d60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd770004940 tx=0x7fd770009e30 comp rx=0 tx=0).stop 2024-04-23T14:59:38.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.467+0000 7fd78ae00700 1 -- 172.21.15.81:0/2141692583 shutdown_connections 2024-04-23T14:59:38.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.467+0000 7fd78ae00700 1 --2- 172.21.15.81:0/2141692583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7840708f0 0x7fd784070d60 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:38.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.467+0000 7fd78ae00700 1 --2- 172.21.15.81:0/2141692583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd784071ea0 0x7fd7840703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:38.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.467+0000 7fd78ae00700 1 -- 172.21.15.81:0/2141692583 >> 172.21.15.81:0/2141692583 conn(0x7fd7840f8530 msgr2=0x7fd7840fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:38.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.467+0000 7fd78ae00700 1 -- 172.21.15.81:0/2141692583 shutdown_connections 2024-04-23T14:59:38.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.467+0000 7fd78ae00700 1 -- 172.21.15.81:0/2141692583 wait complete. 2024-04-23T14:59:38.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.468+0000 7fd78ae00700 1 Processor -- start 2024-04-23T14:59:38.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.468+0000 7fd78ae00700 1 -- start start 2024-04-23T14:59:38.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.469+0000 7fd78ae00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7840708f0 0x7fd784113fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:38.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.469+0000 7fd78ae00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd784071ea0 0x7fd7841144f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:38.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.469+0000 7fd78ae00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd784114af0 con 0x7fd7840708f0 2024-04-23T14:59:38.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.469+0000 7fd78ae00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd784115340 con 0x7fd784071ea0 2024-04-23T14:59:38.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.469+0000 7fd783e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7840708f0 0x7fd784113fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:38.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.469+0000 7fd783e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7840708f0 0x7fd784113fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38784/0 (socket says 172.21.15.81:38784) 2024-04-23T14:59:38.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.469+0000 7fd783e00700 1 -- 172.21.15.81:0/4147200427 learned_addr learned my addr 172.21.15.81:0/4147200427 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:59:38.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.469+0000 7fd783400700 1 --2- 172.21.15.81:0/4147200427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd784071ea0 0x7fd7841144f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:38.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.469+0000 7fd783e00700 1 -- 172.21.15.81:0/4147200427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd784071ea0 msgr2=0x7fd7841144f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:38.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.469+0000 7fd783e00700 1 --2- 172.21.15.81:0/4147200427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd784071ea0 0x7fd7841144f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:38.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.469+0000 7fd783e00700 1 -- 172.21.15.81:0/4147200427 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd770005040 con 0x7fd7840708f0 2024-04-23T14:59:38.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.470+0000 7fd783e00700 1 --2- 172.21.15.81:0/4147200427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7840708f0 0x7fd784113fb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd77400eb40 tx=0x7fd77400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:38.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.470+0000 7fd77be00700 1 -- 172.21.15.81:0/4147200427 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd774007cc0 con 0x7fd7840708f0 2024-04-23T14:59:38.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.470+0000 7fd77be00700 1 -- 172.21.15.81:0/4147200427 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd77400f040 con 0x7fd7840708f0 2024-04-23T14:59:38.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.470+0000 7fd78ae00700 1 -- 172.21.15.81:0/4147200427 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7841155c0 con 0x7fd7840708f0 2024-04-23T14:59:38.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.470+0000 7fd77be00700 1 -- 172.21.15.81:0/4147200427 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd77400caa0 con 0x7fd7840708f0 2024-04-23T14:59:38.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.470+0000 7fd78ae00700 1 -- 172.21.15.81:0/4147200427 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd784115b00 con 0x7fd7840708f0 2024-04-23T14:59:38.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.471+0000 7fd78ae00700 1 -- 172.21.15.81:0/4147200427 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd78405f5f0 con 0x7fd7840708f0 2024-04-23T14:59:38.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.473+0000 7fd77be00700 1 -- 172.21.15.81:0/4147200427 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fd77400cc00 con 0x7fd7840708f0 2024-04-23T14:59:38.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.475+0000 7fd77be00700 1 --2- 172.21.15.81:0/4147200427 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fd76806ec10 0x7fd7680710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:38.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.475+0000 7fd77be00700 1 -- 172.21.15.81:0/4147200427 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fd77408e430 con 0x7fd7840708f0 2024-04-23T14:59:38.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.475+0000 7fd783400700 1 --2- 172.21.15.81:0/4147200427 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fd76806ec10 0x7fd7680710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:38.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.476+0000 7fd783400700 1 --2- 172.21.15.81:0/4147200427 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fd76806ec10 0x7fd7680710c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd77000b0d0 tx=0x7fd770009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:38.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.480+0000 7fd77be00700 1 -- 172.21.15.81:0/4147200427 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fd77405ac90 con 0x7fd7840708f0 2024-04-23T14:59:38.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.799+0000 7fd78ae00700 1 -- 172.21.15.81:0/4147200427 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd784115e10 con 0x7fd7840708f0 2024-04-23T14:59:38.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.800+0000 7fd77be00700 1 -- 172.21.15.81:0/4147200427 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fd77405a820 con 0x7fd7840708f0 2024-04-23T14:59:38.801 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:59:38.801 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-04-23T14:59:38.801 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T14:59:38.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:59:38.802 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-04-23T14:59:38.802 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T14:59:38.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:59:38.802 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-04-23T14:59:38.802 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 6 2024-04-23T14:59:38.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:59:38.802 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-04-23T14:59:38.802 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 4 2024-04-23T14:59:38.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T14:59:38.802 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-04-23T14:59:38.802 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 14 2024-04-23T14:59:38.802 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-23T14:59:38.802 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:59:38.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.803+0000 7fd78ae00700 1 -- 172.21.15.81:0/4147200427 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fd76806ec10 msgr2=0x7fd7680710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:38.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.803+0000 7fd78ae00700 1 --2- 172.21.15.81:0/4147200427 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fd76806ec10 0x7fd7680710c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd77000b0d0 tx=0x7fd770009e30 comp rx=0 tx=0).stop 2024-04-23T14:59:38.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.803+0000 7fd78ae00700 1 -- 172.21.15.81:0/4147200427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7840708f0 msgr2=0x7fd784113fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:38.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.803+0000 7fd78ae00700 1 --2- 172.21.15.81:0/4147200427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7840708f0 0x7fd784113fb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd77400eb40 tx=0x7fd77400b040 comp rx=0 tx=0).stop 2024-04-23T14:59:38.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.803+0000 7fd78ae00700 1 -- 172.21.15.81:0/4147200427 shutdown_connections 2024-04-23T14:59:38.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.803+0000 7fd78ae00700 1 --2- 172.21.15.81:0/4147200427 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fd76806ec10 0x7fd7680710c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:38.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.803+0000 7fd78ae00700 1 --2- 172.21.15.81:0/4147200427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7840708f0 0x7fd784113fb0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:38.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.803+0000 7fd78ae00700 1 --2- 172.21.15.81:0/4147200427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd784071ea0 0x7fd7841144f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:38.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.803+0000 7fd78ae00700 1 -- 172.21.15.81:0/4147200427 >> 172.21.15.81:0/4147200427 conn(0x7fd7840f8530 msgr2=0x7fd7840f9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:38.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.803+0000 7fd78ae00700 1 -- 172.21.15.81:0/4147200427 shutdown_connections 2024-04-23T14:59:38.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.803+0000 7fd78ae00700 1 -- 172.21.15.81:0/4147200427 wait complete. 2024-04-23T14:59:38.893 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:38 smithi081 ceph-mon[90469]: from='client.34528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:59:38.951 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:38 smithi156 ceph-mon[77738]: from='client.34528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:59:38.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.952+0000 7f8684200700 1 -- 172.21.15.81:0/2375801193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f867c0ff020 msgr2=0x7f867c0ff430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:38.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.952+0000 7f8684200700 1 --2- 172.21.15.81:0/2375801193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f867c0ff020 0x7f867c0ff430 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8670004940 tx=0x7f8670009e30 comp rx=0 tx=0).stop 2024-04-23T14:59:38.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.953+0000 7f8684200700 1 -- 172.21.15.81:0/2375801193 shutdown_connections 2024-04-23T14:59:38.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.953+0000 7f8684200700 1 --2- 172.21.15.81:0/2375801193 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f867c1002d0 0x7f867c100740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:38.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.953+0000 7f8684200700 1 --2- 172.21.15.81:0/2375801193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f867c0ff020 0x7f867c0ff430 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:38.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.953+0000 7f8684200700 1 -- 172.21.15.81:0/2375801193 >> 172.21.15.81:0/2375801193 conn(0x7f867c0fa950 msgr2=0x7f867c0fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:38.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.953+0000 7f8684200700 1 -- 172.21.15.81:0/2375801193 shutdown_connections 2024-04-23T14:59:38.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.953+0000 7f8684200700 1 -- 172.21.15.81:0/2375801193 wait complete. 2024-04-23T14:59:38.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.954+0000 7f8684200700 1 Processor -- start 2024-04-23T14:59:38.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.954+0000 7f8684200700 1 -- start start 2024-04-23T14:59:38.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.954+0000 7f8684200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f867c0ff020 0x7f867c10fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:38.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.954+0000 7f8684200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f867c1002d0 0x7f867c1100a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:38.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.954+0000 7f8684200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c1106a0 con 0x7f867c0ff020 2024-04-23T14:59:38.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.954+0000 7f8684200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c110810 con 0x7f867c1002d0 2024-04-23T14:59:38.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.954+0000 7f8681800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f867c0ff020 0x7f867c10fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:38.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.954+0000 7f8681800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f867c0ff020 0x7f867c10fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38792/0 (socket says 172.21.15.81:38792) 2024-04-23T14:59:38.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.954+0000 7f8681800700 1 -- 172.21.15.81:0/1377167002 learned_addr learned my addr 172.21.15.81:0/1377167002 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:59:38.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.955+0000 7f8680e00700 1 --2- 172.21.15.81:0/1377167002 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f867c1002d0 0x7f867c1100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:38.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.955+0000 7f8681800700 1 -- 172.21.15.81:0/1377167002 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f867c1002d0 msgr2=0x7f867c1100a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:38.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.955+0000 7f8681800700 1 --2- 172.21.15.81:0/1377167002 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f867c1002d0 0x7f867c1100a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:38.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.955+0000 7f8681800700 1 -- 172.21.15.81:0/1377167002 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8670005040 con 0x7f867c0ff020 2024-04-23T14:59:38.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.955+0000 7f8681800700 1 --2- 172.21.15.81:0/1377167002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f867c0ff020 0x7f867c10fb60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8670009150 tx=0x7f8670009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:38.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.955+0000 7f8679600700 1 -- 172.21.15.81:0/1377167002 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f867000e040 con 0x7f867c0ff020 2024-04-23T14:59:38.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.955+0000 7f8679600700 1 -- 172.21.15.81:0/1377167002 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f867000bbf0 con 0x7f867c0ff020 2024-04-23T14:59:38.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.955+0000 7f8684200700 1 -- 172.21.15.81:0/1377167002 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f867c115210 con 0x7f867c0ff020 2024-04-23T14:59:38.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.955+0000 7f8679600700 1 -- 172.21.15.81:0/1377167002 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f867001c630 con 0x7f867c0ff020 2024-04-23T14:59:38.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.956+0000 7f8684200700 1 -- 172.21.15.81:0/1377167002 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f867c1157d0 con 0x7f867c0ff020 2024-04-23T14:59:38.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.957+0000 7f8684200700 1 -- 172.21.15.81:0/1377167002 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f867c04c710 con 0x7f867c0ff020 2024-04-23T14:59:38.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.958+0000 7f8679600700 1 -- 172.21.15.81:0/1377167002 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f867000bd60 con 0x7f867c0ff020 2024-04-23T14:59:38.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.959+0000 7f8679600700 1 --2- 172.21.15.81:0/1377167002 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f866406ec00 0x7f86640710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:38.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.959+0000 7f8679600700 1 -- 172.21.15.81:0/1377167002 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f867008fdd0 con 0x7f867c0ff020 2024-04-23T14:59:38.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.959+0000 7f8680e00700 1 --2- 172.21.15.81:0/1377167002 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f866406ec00 0x7f86640710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:38.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.960+0000 7f8680e00700 1 --2- 172.21.15.81:0/1377167002 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f866406ec00 0x7f86640710b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8668004990 tx=0x7f8668009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:38.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:38.963+0000 7f8679600700 1 -- 172.21.15.81:0/1377167002 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f867005c630 con 0x7f867c0ff020 2024-04-23T14:59:39.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.224+0000 7f8684200700 1 -- 172.21.15.81:0/1377167002 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f867c1159f0 con 0x7f867c0ff020 2024-04-23T14:59:39.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.225+0000 7f8679600700 1 -- 172.21.15.81:0/1377167002 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 36 v36) v1 ==== 76+0+1967 (secure 0 0 0) 0x7f867c1159f0 con 0x7f867c0ff020 2024-04-23T14:59:39.227 INFO:teuthology.orchestra.run.smithi081.stdout:e36 2024-04-23T14:59:39.228 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-23T14:59:39.228 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T14:59:39.228 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-04-23T14:59:39.228 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:59:39.228 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-04-23T14:59:39.228 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-04-23T14:59:39.228 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 36 2024-04-23T14:59:39.228 INFO:teuthology.orchestra.run.smithi081.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-23T14:59:39.228 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-04-23T14:45:51.264703+0000 2024-04-23T14:59:39.228 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-04-23T14:59:16.388200+0000 2024-04-23T14:59:39.228 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-04-23T14:59:39.228 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-04-23T14:59:39.228 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-04-23T14:59:39.228 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-04-23T14:59:39.229 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-04-23T14:59:39.229 INFO:teuthology.orchestra.run.smithi081.stdout:max_xattr_size 65536 2024-04-23T14:59:39.229 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-04-23T14:59:39.229 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-04-23T14:59:39.229 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 86 2024-04-23T14:59:39.229 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-23T14:59:39.229 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 1 2024-04-23T14:59:39.229 INFO:teuthology.orchestra.run.smithi081.stdout:in 0 2024-04-23T14:59:39.229 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=34430} 2024-04-23T14:59:39.229 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-04-23T14:59:39.229 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-04-23T14:59:39.229 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-04-23T14:59:39.229 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-04-23T14:59:39.229 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-04-23T14:59:39.229 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-04-23T14:59:39.230 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-04-23T14:59:39.230 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-04-23T14:59:39.230 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-04-23T14:59:39.230 INFO:teuthology.orchestra.run.smithi081.stdout:qdb_cluster leader: 34430 members: 34430 2024-04-23T14:59:39.230 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.wydgcg{0:34430} state up:active seq 24 join_fscid=1 addr [v2:172.21.15.81:6826/3200953351,v1:172.21.15.81:6827/3200953351] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T14:59:39.230 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.vcoywg{0:34462} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.81:6828/2598630159,v1:172.21.15.81:6829/2598630159] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T14:59:39.230 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:59:39.230 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:59:39.230 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-04-23T14:59:39.230 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T14:59:39.230 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.rhbtxt{-1:44273} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.156:6824/3017230919,v1:172.21.15.156:6825/3017230919] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T14:59:39.230 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.vynkxn{-1:44277} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.156:6826/4079938688,v1:172.21.15.156:6827/4079938688] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T14:59:39.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.229+0000 7f8684200700 1 -- 172.21.15.81:0/1377167002 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f866406ec00 msgr2=0x7f86640710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:39.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.229+0000 7f8684200700 1 --2- 172.21.15.81:0/1377167002 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f866406ec00 0x7f86640710b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8668004990 tx=0x7f8668009ee0 comp rx=0 tx=0).stop 2024-04-23T14:59:39.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.229+0000 7f8684200700 1 -- 172.21.15.81:0/1377167002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f867c0ff020 msgr2=0x7f867c10fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:39.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.229+0000 7f8684200700 1 --2- 172.21.15.81:0/1377167002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f867c0ff020 0x7f867c10fb60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8670009150 tx=0x7f8670009e30 comp rx=0 tx=0).stop 2024-04-23T14:59:39.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.229+0000 7f8684200700 1 -- 172.21.15.81:0/1377167002 shutdown_connections 2024-04-23T14:59:39.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.229+0000 7f8684200700 1 --2- 172.21.15.81:0/1377167002 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f866406ec00 0x7f86640710b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:39.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.229+0000 7f8684200700 1 --2- 172.21.15.81:0/1377167002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f867c0ff020 0x7f867c10fb60 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:39.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.229+0000 7f8684200700 1 --2- 172.21.15.81:0/1377167002 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f867c1002d0 0x7f867c1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:39.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.229+0000 7f8684200700 1 -- 172.21.15.81:0/1377167002 >> 172.21.15.81:0/1377167002 conn(0x7f867c0fa950 msgr2=0x7f867c0fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:39.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.229+0000 7f8684200700 1 -- 172.21.15.81:0/1377167002 shutdown_connections 2024-04-23T14:59:39.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.229+0000 7f8684200700 1 -- 172.21.15.81:0/1377167002 wait complete. 2024-04-23T14:59:39.232 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 36 2024-04-23T14:59:39.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.375+0000 7f4ccb600700 1 -- 172.21.15.81:0/1608396545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc40708f0 msgr2=0x7f4cc4070d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:39.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.375+0000 7f4ccb600700 1 --2- 172.21.15.81:0/1608396545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc40708f0 0x7f4cc4070d60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4cac004940 tx=0x7f4cac009e30 comp rx=0 tx=0).stop 2024-04-23T14:59:39.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.375+0000 7f4ccb600700 1 -- 172.21.15.81:0/1608396545 shutdown_connections 2024-04-23T14:59:39.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.375+0000 7f4ccb600700 1 --2- 172.21.15.81:0/1608396545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc40708f0 0x7f4cc4070d60 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:39.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.375+0000 7f4ccb600700 1 --2- 172.21.15.81:0/1608396545 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4cc4071ea0 0x7f4cc40703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:39.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.375+0000 7f4ccb600700 1 -- 172.21.15.81:0/1608396545 >> 172.21.15.81:0/1608396545 conn(0x7f4cc40f8570 msgr2=0x7f4cc40fa9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:39.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.375+0000 7f4ccb600700 1 -- 172.21.15.81:0/1608396545 shutdown_connections 2024-04-23T14:59:39.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.375+0000 7f4ccb600700 1 -- 172.21.15.81:0/1608396545 wait complete. 2024-04-23T14:59:39.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.376+0000 7f4ccb600700 1 Processor -- start 2024-04-23T14:59:39.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.376+0000 7f4ccb600700 1 -- start start 2024-04-23T14:59:39.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.376+0000 7f4ccb600700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4cc40708f0 0x7f4cc410fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:39.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.376+0000 7f4ccb600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc4071ea0 0x7f4cc41100b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:39.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.376+0000 7f4ccb600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc4110740 con 0x7f4cc4071ea0 2024-04-23T14:59:39.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.376+0000 7f4ccb600700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc41150e0 con 0x7f4cc40708f0 2024-04-23T14:59:39.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.377+0000 7f4cbbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc4071ea0 0x7f4cc41100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:39.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.377+0000 7f4cbbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc4071ea0 0x7f4cc41100b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38812/0 (socket says 172.21.15.81:38812) 2024-04-23T14:59:39.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.377+0000 7f4cbbe00700 1 -- 172.21.15.81:0/740078708 learned_addr learned my addr 172.21.15.81:0/740078708 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:59:39.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.377+0000 7f4cc8c00700 1 --2- 172.21.15.81:0/740078708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4cc40708f0 0x7f4cc410fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:39.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.377+0000 7f4cbbe00700 1 -- 172.21.15.81:0/740078708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4cc40708f0 msgr2=0x7f4cc410fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:39.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.377+0000 7f4cbbe00700 1 --2- 172.21.15.81:0/740078708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4cc40708f0 0x7f4cc410fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:39.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.377+0000 7f4cbbe00700 1 -- 172.21.15.81:0/740078708 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cac005040 con 0x7f4cc4071ea0 2024-04-23T14:59:39.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.377+0000 7f4cc8c00700 1 --2- 172.21.15.81:0/740078708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4cc40708f0 0x7f4cc410fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T14:59:39.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.378+0000 7f4cbbe00700 1 --2- 172.21.15.81:0/740078708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc4071ea0 0x7f4cc41100b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4cac00b3b0 tx=0x7f4cac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:39.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.378+0000 7f4cc1600700 1 -- 172.21.15.81:0/740078708 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cac00e040 con 0x7f4cc4071ea0 2024-04-23T14:59:39.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.378+0000 7f4cc1600700 1 -- 172.21.15.81:0/740078708 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4cac004290 con 0x7f4cc4071ea0 2024-04-23T14:59:39.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.378+0000 7f4cc1600700 1 -- 172.21.15.81:0/740078708 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cac01c630 con 0x7f4cc4071ea0 2024-04-23T14:59:39.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.378+0000 7f4ccb600700 1 -- 172.21.15.81:0/740078708 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cc41152e0 con 0x7f4cc4071ea0 2024-04-23T14:59:39.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.378+0000 7f4ccb600700 1 -- 172.21.15.81:0/740078708 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cc4115850 con 0x7f4cc4071ea0 2024-04-23T14:59:39.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.380+0000 7f4ccb600700 1 -- 172.21.15.81:0/740078708 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cc404c710 con 0x7f4cc4071ea0 2024-04-23T14:59:39.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.381+0000 7f4cc1600700 1 -- 172.21.15.81:0/740078708 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f4cac00bbf0 con 0x7f4cc4071ea0 2024-04-23T14:59:39.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.381+0000 7f4cc1600700 1 --2- 172.21.15.81:0/740078708 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f4ca406ec00 0x7f4ca40710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:39.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.382+0000 7f4cc1600700 1 -- 172.21.15.81:0/740078708 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f4cac08fa00 con 0x7f4cc4071ea0 2024-04-23T14:59:39.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.382+0000 7f4cc8c00700 1 --2- 172.21.15.81:0/740078708 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f4ca406ec00 0x7f4ca40710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:39.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.382+0000 7f4cc8c00700 1 --2- 172.21.15.81:0/740078708 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f4ca406ec00 0x7f4ca40710b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4006fd0 tx=0x7f4cb4008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:39.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.386+0000 7f4cc1600700 1 -- 172.21.15.81:0/740078708 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f4cac05c3a0 con 0x7f4cc4071ea0 2024-04-23T14:59:39.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.624+0000 7f4ccb600700 1 -- 172.21.15.81:0/740078708 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4cc4103de0 con 0x7f4ca406ec00 2024-04-23T14:59:39.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.626+0000 7f4cc1600700 1 -- 172.21.15.81:0/740078708 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f4cc4103de0 con 0x7f4ca406ec00 2024-04-23T14:59:39.627 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T14:59:39.627 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd", 2024-04-23T14:59:39.627 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-04-23T14:59:39.627 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-23T14:59:39.627 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [ 2024-04-23T14:59:39.627 INFO:teuthology.orchestra.run.smithi081.stdout: "mon", 2024-04-23T14:59:39.627 INFO:teuthology.orchestra.run.smithi081.stdout: "mds", 2024-04-23T14:59:39.627 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr", 2024-04-23T14:59:39.627 INFO:teuthology.orchestra.run.smithi081.stdout: "osd", 2024-04-23T14:59:39.627 INFO:teuthology.orchestra.run.smithi081.stdout: "crash" 2024-04-23T14:59:39.627 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-04-23T14:59:39.627 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "16/21 daemons upgraded", 2024-04-23T14:59:39.628 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "Currently upgrading node-exporter daemons", 2024-04-23T14:59:39.628 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-04-23T14:59:39.628 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T14:59:39.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.629+0000 7f4ccb600700 1 -- 172.21.15.81:0/740078708 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f4ca406ec00 msgr2=0x7f4ca40710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:39.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.629+0000 7f4ccb600700 1 --2- 172.21.15.81:0/740078708 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f4ca406ec00 0x7f4ca40710b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4006fd0 tx=0x7f4cb4008040 comp rx=0 tx=0).stop 2024-04-23T14:59:39.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.629+0000 7f4ccb600700 1 -- 172.21.15.81:0/740078708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc4071ea0 msgr2=0x7f4cc41100b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:39.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.629+0000 7f4ccb600700 1 --2- 172.21.15.81:0/740078708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc4071ea0 0x7f4cc41100b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4cac00b3b0 tx=0x7f4cac009e30 comp rx=0 tx=0).stop 2024-04-23T14:59:39.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.629+0000 7f4ccb600700 1 -- 172.21.15.81:0/740078708 shutdown_connections 2024-04-23T14:59:39.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.629+0000 7f4ccb600700 1 --2- 172.21.15.81:0/740078708 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f4ca406ec00 0x7f4ca40710b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:39.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.629+0000 7f4ccb600700 1 --2- 172.21.15.81:0/740078708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4cc40708f0 0x7f4cc410fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:39.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.629+0000 7f4ccb600700 1 --2- 172.21.15.81:0/740078708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc4071ea0 0x7f4cc41100b0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:39.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.629+0000 7f4ccb600700 1 -- 172.21.15.81:0/740078708 >> 172.21.15.81:0/740078708 conn(0x7f4cc40f8570 msgr2=0x7f4cc40f9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:39.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.630+0000 7f4ccb600700 1 -- 172.21.15.81:0/740078708 shutdown_connections 2024-04-23T14:59:39.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.630+0000 7f4ccb600700 1 -- 172.21.15.81:0/740078708 wait complete. 2024-04-23T14:59:39.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.773+0000 7fe8d0e00700 1 -- 172.21.15.81:0/980843061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8cc0fce40 msgr2=0x7fe8cc0fd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:39.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.773+0000 7fe8d0e00700 1 --2- 172.21.15.81:0/980843061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8cc0fce40 0x7fe8cc0fd250 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc004940 tx=0x7fe8bc009e30 comp rx=0 tx=0).stop 2024-04-23T14:59:39.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.773+0000 7fe8d0e00700 1 -- 172.21.15.81:0/980843061 shutdown_connections 2024-04-23T14:59:39.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.773+0000 7fe8d0e00700 1 --2- 172.21.15.81:0/980843061 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8cc0fe040 0x7fe8cc0fe4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:39.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.773+0000 7fe8d0e00700 1 --2- 172.21.15.81:0/980843061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8cc0fce40 0x7fe8cc0fd250 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:39.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.773+0000 7fe8d0e00700 1 -- 172.21.15.81:0/980843061 >> 172.21.15.81:0/980843061 conn(0x7fe8cc0f8530 msgr2=0x7fe8cc0fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:39.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.773+0000 7fe8d0e00700 1 -- 172.21.15.81:0/980843061 shutdown_connections 2024-04-23T14:59:39.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.773+0000 7fe8d0e00700 1 -- 172.21.15.81:0/980843061 wait complete. 2024-04-23T14:59:39.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.774+0000 7fe8d0e00700 1 Processor -- start 2024-04-23T14:59:39.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.774+0000 7fe8d0e00700 1 -- start start 2024-04-23T14:59:39.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.775+0000 7fe8d0e00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8cc0fce40 0x7fe8cc10fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:39.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.775+0000 7fe8d0e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8cc0fe040 0x7fe8cc110270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:39.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.775+0000 7fe8d0e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8cc110870 con 0x7fe8cc0fe040 2024-04-23T14:59:39.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.775+0000 7fe8d0e00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8cc110fb0 con 0x7fe8cc0fce40 2024-04-23T14:59:39.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.775+0000 7fe8c9400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8cc0fe040 0x7fe8cc110270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:39.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.775+0000 7fe8c9400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8cc0fe040 0x7fe8cc110270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38824/0 (socket says 172.21.15.81:38824) 2024-04-23T14:59:39.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.775+0000 7fe8c9400700 1 -- 172.21.15.81:0/3475609925 learned_addr learned my addr 172.21.15.81:0/3475609925 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T14:59:39.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.775+0000 7fe8c9e00700 1 --2- 172.21.15.81:0/3475609925 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8cc0fce40 0x7fe8cc10fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:39.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.775+0000 7fe8c9400700 1 -- 172.21.15.81:0/3475609925 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8cc0fce40 msgr2=0x7fe8cc10fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:39.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.775+0000 7fe8c9400700 1 --2- 172.21.15.81:0/3475609925 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8cc0fce40 0x7fe8cc10fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:39.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.775+0000 7fe8c9400700 1 -- 172.21.15.81:0/3475609925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8bc005040 con 0x7fe8cc0fe040 2024-04-23T14:59:39.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.776+0000 7fe8c9400700 1 --2- 172.21.15.81:0/3475609925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8cc0fe040 0x7fe8cc110270 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8002a50 tx=0x7fe8b80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:39.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.776+0000 7fe8c2000700 1 -- 172.21.15.81:0/3475609925 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8b8007cc0 con 0x7fe8cc0fe040 2024-04-23T14:59:39.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.776+0000 7fe8d0e00700 1 -- 172.21.15.81:0/3475609925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8cc111290 con 0x7fe8cc0fe040 2024-04-23T14:59:39.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.776+0000 7fe8c2000700 1 -- 172.21.15.81:0/3475609925 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe8b800f040 con 0x7fe8cc0fe040 2024-04-23T14:59:39.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.776+0000 7fe8c2000700 1 -- 172.21.15.81:0/3475609925 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8b800db70 con 0x7fe8cc0fe040 2024-04-23T14:59:39.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.776+0000 7fe8d0e00700 1 -- 172.21.15.81:0/3475609925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8cc111850 con 0x7fe8cc0fe040 2024-04-23T14:59:39.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.777+0000 7fe8d0e00700 1 -- 172.21.15.81:0/3475609925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8cc1019d0 con 0x7fe8cc0fe040 2024-04-23T14:59:39.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.778+0000 7fe8c2000700 1 -- 172.21.15.81:0/3475609925 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fe8b800dd10 con 0x7fe8cc0fe040 2024-04-23T14:59:39.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.779+0000 7fe8c2000700 1 --2- 172.21.15.81:0/3475609925 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fe8b006ec10 0x7fe8b00710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T14:59:39.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.779+0000 7fe8c2000700 1 -- 172.21.15.81:0/3475609925 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fe8b808e0a0 con 0x7fe8cc0fe040 2024-04-23T14:59:39.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.779+0000 7fe8c9e00700 1 --2- 172.21.15.81:0/3475609925 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fe8b006ec10 0x7fe8b00710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T14:59:39.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.780+0000 7fe8c9e00700 1 --2- 172.21.15.81:0/3475609925 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fe8b006ec10 0x7fe8b00710c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc00b970 tx=0x7fe8bc009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T14:59:39.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:39.788+0000 7fe8c2000700 1 -- 172.21.15.81:0/3475609925 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fe8b805a880 con 0x7fe8cc0fe040 2024-04-23T14:59:39.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:39 smithi081 ceph-mon[90469]: from='client.34532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:59:39.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:39 smithi081 ceph-mon[90469]: from='client.34536 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:59:39.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:39 smithi081 ceph-mon[90469]: pgmap v255: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 818 KiB/s rd, 1 op/s 2024-04-23T14:59:39.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:39 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/4147200427' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:39.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:39 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/1377167002' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:59:40.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:39 smithi156 ceph-mon[77738]: from='client.34532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:59:40.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:39 smithi156 ceph-mon[77738]: from='client.34536 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:59:40.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:39 smithi156 ceph-mon[77738]: pgmap v255: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 818 KiB/s rd, 1 op/s 2024-04-23T14:59:40.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:39 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/4147200427' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:40.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:39 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/1377167002' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T14:59:40.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:40.116+0000 7fe8d0e00700 1 -- 172.21.15.81:0/3475609925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe8cc05f5f0 con 0x7fe8cc0fe040 2024-04-23T14:59:40.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:40.116+0000 7fe8c2000700 1 -- 172.21.15.81:0/3475609925 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fe8b805a410 con 0x7fe8cc0fe040 2024-04-23T14:59:40.117 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-04-23T14:59:40.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:40.119+0000 7fe8d0e00700 1 -- 172.21.15.81:0/3475609925 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fe8b006ec10 msgr2=0x7fe8b00710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:40.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:40.119+0000 7fe8d0e00700 1 --2- 172.21.15.81:0/3475609925 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fe8b006ec10 0x7fe8b00710c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc00b970 tx=0x7fe8bc009e30 comp rx=0 tx=0).stop 2024-04-23T14:59:40.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:40.119+0000 7fe8d0e00700 1 -- 172.21.15.81:0/3475609925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8cc0fe040 msgr2=0x7fe8cc110270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T14:59:40.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:40.119+0000 7fe8d0e00700 1 --2- 172.21.15.81:0/3475609925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8cc0fe040 0x7fe8cc110270 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8002a50 tx=0x7fe8b80046b0 comp rx=0 tx=0).stop 2024-04-23T14:59:40.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:40.119+0000 7fe8d0e00700 1 -- 172.21.15.81:0/3475609925 shutdown_connections 2024-04-23T14:59:40.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:40.119+0000 7fe8d0e00700 1 --2- 172.21.15.81:0/3475609925 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fe8b006ec10 0x7fe8b00710c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:40.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:40.119+0000 7fe8d0e00700 1 --2- 172.21.15.81:0/3475609925 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8cc0fce40 0x7fe8cc10fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:40.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:40.119+0000 7fe8d0e00700 1 --2- 172.21.15.81:0/3475609925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8cc0fe040 0x7fe8cc110270 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T14:59:40.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:40.119+0000 7fe8d0e00700 1 -- 172.21.15.81:0/3475609925 >> 172.21.15.81:0/3475609925 conn(0x7fe8cc0f8530 msgr2=0x7fe8cc0f9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T14:59:40.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:40.119+0000 7fe8d0e00700 1 -- 172.21.15.81:0/3475609925 shutdown_connections 2024-04-23T14:59:40.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T14:59:40.120+0000 7fe8d0e00700 1 -- 172.21.15.81:0/3475609925 wait complete. 2024-04-23T14:59:41.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:40 smithi156 ceph-mon[77738]: from='client.34548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:59:41.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:40 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:41.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:40 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:41.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:40 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/3475609925' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:59:41.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:40 smithi081 ceph-mon[90469]: from='client.34548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T14:59:41.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:40 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:41.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:40 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:41.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:40 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/3475609925' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T14:59:42.034 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:41 smithi081 ceph-mon[90469]: pgmap v256: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-23T14:59:42.034 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:41 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:59:42.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:41 smithi156 ceph-mon[77738]: pgmap v256: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-23T14:59:42.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:41 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:59:43.905 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:43 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:43.905 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:43 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:43.905 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:43 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:59:43.905 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:43 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:59:43.905 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:43 smithi081 ceph-mon[90469]: pgmap v257: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:59:43.905 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:43 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:43.906 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:43 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:59:43.906 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:43 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:43.906 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:43 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:43.906 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:43 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:43.906 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:43 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:43.906 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:43 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:43.906 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:43 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:43.906 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:43 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:43.907 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:43 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:43.907 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:43 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:43.907 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:43 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:43.907 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:43 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:43.907 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:43 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:43.907 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:43 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:44.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:43 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:44.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:43 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:44.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:43 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T14:59:44.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:43 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T14:59:44.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:43 smithi156 ceph-mon[77738]: pgmap v257: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:59:44.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:43 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:44.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:43 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:59:44.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:43 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:44.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:43 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:44.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:43 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:44.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:43 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:44.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:43 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:44.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:43 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:44.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:43 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:44.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:43 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:44.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:43 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:44.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:43 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:44.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:43 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:44.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:43 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:44.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:43 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T14:59:46.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:45 smithi156 ceph-mon[77738]: pgmap v258: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:59:46.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:45 smithi081 ceph-mon[90469]: pgmap v258: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:59:46.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:46 smithi081 ceph-mon[90469]: Upgrade: Updating prometheus.smithi081 2024-04-23T14:59:46.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:46 smithi081 ceph-mon[90469]: Deploying daemon prometheus.smithi081 on smithi081 2024-04-23T14:59:47.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:46 smithi156 ceph-mon[77738]: Upgrade: Updating prometheus.smithi081 2024-04-23T14:59:47.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:46 smithi156 ceph-mon[77738]: Deploying daemon prometheus.smithi081 on smithi081 2024-04-23T14:59:47.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:47 smithi081 ceph-mon[90469]: pgmap v259: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:59:48.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:47 smithi156 ceph-mon[77738]: pgmap v259: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:59:49.959 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:49 smithi081 ceph-mon[90469]: pgmap v260: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T14:59:50.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:49 smithi156 ceph-mon[77738]: pgmap v260: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T14:59:52.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:51 smithi156 ceph-mon[77738]: pgmap v261: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:59:52.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:51 smithi081 ceph-mon[90469]: pgmap v261: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:59:54.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:53 smithi156 ceph-mon[77738]: pgmap v262: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T14:59:54.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:53 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:54.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:53 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:54.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:53 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:59:54.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:53 smithi081 ceph-mon[90469]: pgmap v262: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T14:59:54.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:53 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:54.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:53 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T14:59:54.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:53 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T14:59:56.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:55 smithi156 ceph-mon[77738]: pgmap v263: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:59:56.069 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:55 smithi081 ceph-mon[90469]: pgmap v263: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T14:59:57.031 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:56 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:59:57.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:56 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T14:59:58.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:57 smithi156 ceph-mon[77738]: pgmap v264: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T14:59:58.060 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:57 smithi081 ceph-mon[90469]: pgmap v264: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T15:00:00.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:59 smithi156 ceph-mon[77738]: pgmap v265: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:00:00.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:59 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:00.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 14:59:59 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:00.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:59 smithi081 ceph-mon[90469]: pgmap v265: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:00:00.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:59 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:00.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 14:59:59 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:01.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:00 smithi156 ceph-mon[77738]: overall HEALTH_OK 2024-04-23T15:00:01.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:00 smithi081 ceph-mon[90469]: overall HEALTH_OK 2024-04-23T15:00:02.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:01 smithi156 ceph-mon[77738]: pgmap v266: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:00:02.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:01 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:02.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:01 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:02.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:01 smithi081 ceph-mon[90469]: pgmap v266: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:00:02.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:01 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:02.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:01 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:04.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:03 smithi156 ceph-mon[77738]: pgmap v267: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:00:04.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:03 smithi081 ceph-mon[90469]: pgmap v267: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:00:06.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:05 smithi156 ceph-mon[77738]: pgmap v268: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:00:06.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:05 smithi081 ceph-mon[90469]: pgmap v268: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:00:08.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:07 smithi156 ceph-mon[77738]: pgmap v269: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T15:00:08.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:07 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:08.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:07 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:08.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:07 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:00:08.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:07 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:00:08.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:07 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:08.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:07 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-23T15:00:08.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:07 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:00:08.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:07 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:08.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:07 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:08.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:07 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:08.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:07 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:08.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:07 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:08.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:07 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:08.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:07 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:08.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:07 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:08.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:07 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:08.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:07 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:08.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:07 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:08.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:07 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:08.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:07 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:08.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:07 smithi081 ceph-mon[90469]: pgmap v269: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T15:00:08.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:07 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:08.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:07 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:08.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:07 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:00:08.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:07 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:00:08.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:07 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:08.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:07 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-23T15:00:08.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:07 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:00:08.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:07 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:08.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:07 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:08.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:07 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:08.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:07 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:08.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:07 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:08.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:07 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:08.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:07 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:08.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:07 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:08.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:07 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:08.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:07 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:08.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:07 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:08.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:07 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:08.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:07 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:09.055 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:08 smithi081 ceph-mon[90469]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-23T15:00:09.056 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:08 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:09.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:08 smithi156 ceph-mon[77738]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-23T15:00:09.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:08 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:10.075 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:09 smithi081 ceph-mon[90469]: pgmap v270: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:00:10.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:09 smithi156 ceph-mon[77738]: pgmap v270: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:00:10.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.290+0000 7fa9f2200700 1 -- 172.21.15.81:0/3206866593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9ec071ea0 msgr2=0x7fa9ec0703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:10.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.290+0000 7fa9f2200700 1 --2- 172.21.15.81:0/3206866593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9ec071ea0 0x7fa9ec0703b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0004940 tx=0x7fa9e0009e30 comp rx=0 tx=0).stop 2024-04-23T15:00:10.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.291+0000 7fa9f2200700 1 -- 172.21.15.81:0/3206866593 shutdown_connections 2024-04-23T15:00:10.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.291+0000 7fa9f2200700 1 --2- 172.21.15.81:0/3206866593 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9ec0708f0 0x7fa9ec070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:10.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.291+0000 7fa9f2200700 1 --2- 172.21.15.81:0/3206866593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9ec071ea0 0x7fa9ec0703b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:10.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.291+0000 7fa9f2200700 1 -- 172.21.15.81:0/3206866593 >> 172.21.15.81:0/3206866593 conn(0x7fa9ec0f83d0 msgr2=0x7fa9ec0fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:10.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.291+0000 7fa9f2200700 1 -- 172.21.15.81:0/3206866593 shutdown_connections 2024-04-23T15:00:10.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.291+0000 7fa9f2200700 1 -- 172.21.15.81:0/3206866593 wait complete. 2024-04-23T15:00:10.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.292+0000 7fa9f2200700 1 Processor -- start 2024-04-23T15:00:10.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.292+0000 7fa9f2200700 1 -- start start 2024-04-23T15:00:10.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.292+0000 7fa9f2200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9ec0708f0 0x7fa9ec10fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:10.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.292+0000 7fa9f2200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9ec071ea0 0x7fa9ec110040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:10.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.292+0000 7fa9f2200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ec110640 con 0x7fa9ec0708f0 2024-04-23T15:00:10.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.292+0000 7fa9f2200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ec110e90 con 0x7fa9ec071ea0 2024-04-23T15:00:10.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.293+0000 7fa9f0e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9ec0708f0 0x7fa9ec10fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:10.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.293+0000 7fa9f0e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9ec0708f0 0x7fa9ec10fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46950/0 (socket says 172.21.15.81:46950) 2024-04-23T15:00:10.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.293+0000 7fa9f0e00700 1 -- 172.21.15.81:0/233599832 learned_addr learned my addr 172.21.15.81:0/233599832 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:00:10.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.293+0000 7fa9f0e00700 1 -- 172.21.15.81:0/233599832 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9ec071ea0 msgr2=0x7fa9ec110040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:10.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.293+0000 7fa9f0e00700 1 --2- 172.21.15.81:0/233599832 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9ec071ea0 0x7fa9ec110040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:10.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.293+0000 7fa9f0e00700 1 -- 172.21.15.81:0/233599832 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e0005040 con 0x7fa9ec0708f0 2024-04-23T15:00:10.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.293+0000 7fa9f0e00700 1 --2- 172.21.15.81:0/233599832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9ec0708f0 0x7fa9ec10fb00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa9e000b970 tx=0x7fa9e0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:10.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.294+0000 7fa9e8c00700 1 -- 172.21.15.81:0/233599832 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9e000e040 con 0x7fa9ec0708f0 2024-04-23T15:00:10.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.294+0000 7fa9f2200700 1 -- 172.21.15.81:0/233599832 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9ec111110 con 0x7fa9ec0708f0 2024-04-23T15:00:10.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.294+0000 7fa9e8c00700 1 -- 172.21.15.81:0/233599832 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa9e000bbf0 con 0x7fa9ec0708f0 2024-04-23T15:00:10.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.294+0000 7fa9e8c00700 1 -- 172.21.15.81:0/233599832 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9e001c630 con 0x7fa9ec0708f0 2024-04-23T15:00:10.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.294+0000 7fa9f2200700 1 -- 172.21.15.81:0/233599832 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9ec111650 con 0x7fa9ec0708f0 2024-04-23T15:00:10.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.295+0000 7fa9f2200700 1 -- 172.21.15.81:0/233599832 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9ec05f5f0 con 0x7fa9ec0708f0 2024-04-23T15:00:10.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.296+0000 7fa9e8c00700 1 -- 172.21.15.81:0/233599832 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fa9e000bd60 con 0x7fa9ec0708f0 2024-04-23T15:00:10.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.297+0000 7fa9e8c00700 1 --2- 172.21.15.81:0/233599832 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa9d406ec10 0x7fa9d40710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:10.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.297+0000 7fa9e8c00700 1 -- 172.21.15.81:0/233599832 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fa9e008fbc0 con 0x7fa9ec0708f0 2024-04-23T15:00:10.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.298+0000 7fa9ebe00700 1 --2- 172.21.15.81:0/233599832 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa9d406ec10 0x7fa9d40710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:10.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.299+0000 7fa9ebe00700 1 --2- 172.21.15.81:0/233599832 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa9d406ec10 0x7fa9d40710c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8004b70 tx=0x7fa9d8007cc0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:10.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.303+0000 7fa9e8c00700 1 -- 172.21.15.81:0/233599832 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fa9e005c560 con 0x7fa9ec0708f0 2024-04-23T15:00:10.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.556+0000 7fa9f2200700 1 -- 172.21.15.81:0/233599832 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa9ec111a70 con 0x7fa9d406ec10 2024-04-23T15:00:10.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.558+0000 7fa9e8c00700 1 -- 172.21.15.81:0/233599832 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+440 (secure 0 0 0) 0x7fa9ec111a70 con 0x7fa9d406ec10 2024-04-23T15:00:10.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.561+0000 7fa9f2200700 1 -- 172.21.15.81:0/233599832 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa9d406ec10 msgr2=0x7fa9d40710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:10.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.561+0000 7fa9f2200700 1 --2- 172.21.15.81:0/233599832 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa9d406ec10 0x7fa9d40710c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8004b70 tx=0x7fa9d8007cc0 comp rx=0 tx=0).stop 2024-04-23T15:00:10.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.561+0000 7fa9f2200700 1 -- 172.21.15.81:0/233599832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9ec0708f0 msgr2=0x7fa9ec10fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:10.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.561+0000 7fa9f2200700 1 --2- 172.21.15.81:0/233599832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9ec0708f0 0x7fa9ec10fb00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa9e000b970 tx=0x7fa9e0009e30 comp rx=0 tx=0).stop 2024-04-23T15:00:10.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.561+0000 7fa9f2200700 1 -- 172.21.15.81:0/233599832 shutdown_connections 2024-04-23T15:00:10.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.561+0000 7fa9f2200700 1 --2- 172.21.15.81:0/233599832 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa9d406ec10 0x7fa9d40710c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:10.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.561+0000 7fa9f2200700 1 --2- 172.21.15.81:0/233599832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9ec0708f0 0x7fa9ec10fb00 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:10.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.561+0000 7fa9f2200700 1 --2- 172.21.15.81:0/233599832 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9ec071ea0 0x7fa9ec110040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:10.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.561+0000 7fa9f2200700 1 -- 172.21.15.81:0/233599832 >> 172.21.15.81:0/233599832 conn(0x7fa9ec0f83d0 msgr2=0x7fa9ec0f9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:10.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.561+0000 7fa9f2200700 1 -- 172.21.15.81:0/233599832 shutdown_connections 2024-04-23T15:00:10.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.562+0000 7fa9f2200700 1 -- 172.21.15.81:0/233599832 wait complete. 2024-04-23T15:00:10.577 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-04-23T15:00:10.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.709+0000 7f92d1800700 1 -- 172.21.15.81:0/4158370630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92cc0fe0e0 msgr2=0x7f92cc0fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:10.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.709+0000 7f92d1800700 1 --2- 172.21.15.81:0/4158370630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92cc0fe0e0 0x7f92cc0fe550 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f92b8004940 tx=0x7f92b8009e30 comp rx=0 tx=0).stop 2024-04-23T15:00:10.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.709+0000 7f92d1800700 1 -- 172.21.15.81:0/4158370630 shutdown_connections 2024-04-23T15:00:10.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.709+0000 7f92d1800700 1 --2- 172.21.15.81:0/4158370630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92cc0fe0e0 0x7f92cc0fe550 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:10.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.709+0000 7f92d1800700 1 --2- 172.21.15.81:0/4158370630 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92cc0fcef0 0x7f92cc0fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:10.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.709+0000 7f92d1800700 1 -- 172.21.15.81:0/4158370630 >> 172.21.15.81:0/4158370630 conn(0x7f92cc0f8530 msgr2=0x7f92cc0fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:10.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.709+0000 7f92d1800700 1 -- 172.21.15.81:0/4158370630 shutdown_connections 2024-04-23T15:00:10.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.709+0000 7f92d1800700 1 -- 172.21.15.81:0/4158370630 wait complete. 2024-04-23T15:00:10.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.710+0000 7f92d1800700 1 Processor -- start 2024-04-23T15:00:10.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.710+0000 7f92d1800700 1 -- start start 2024-04-23T15:00:10.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.711+0000 7f92d1800700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92cc0fcef0 0x7f92cc10fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:10.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.711+0000 7f92d1800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92cc0fe0e0 0x7f92cc110180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:10.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.711+0000 7f92d1800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc110780 con 0x7f92cc0fe0e0 2024-04-23T15:00:10.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.711+0000 7f92d1800700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc110fd0 con 0x7f92cc0fcef0 2024-04-23T15:00:10.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.711+0000 7f92ca000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92cc0fe0e0 0x7f92cc110180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:10.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.711+0000 7f92ca000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92cc0fe0e0 0x7f92cc110180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46982/0 (socket says 172.21.15.81:46982) 2024-04-23T15:00:10.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.711+0000 7f92ca000700 1 -- 172.21.15.81:0/3575757880 learned_addr learned my addr 172.21.15.81:0/3575757880 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:00:10.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.711+0000 7f92caa00700 1 --2- 172.21.15.81:0/3575757880 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92cc0fcef0 0x7f92cc10fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:10.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.711+0000 7f92ca000700 1 -- 172.21.15.81:0/3575757880 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92cc0fcef0 msgr2=0x7f92cc10fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:10.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.711+0000 7f92ca000700 1 --2- 172.21.15.81:0/3575757880 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92cc0fcef0 0x7f92cc10fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:10.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.711+0000 7f92ca000700 1 -- 172.21.15.81:0/3575757880 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b8005040 con 0x7f92cc0fe0e0 2024-04-23T15:00:10.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.712+0000 7f92ca000700 1 --2- 172.21.15.81:0/3575757880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92cc0fe0e0 0x7f92cc110180 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f92b8009150 tx=0x7f92b8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:10.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.712+0000 7f92c2a00700 1 -- 172.21.15.81:0/3575757880 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92b800e040 con 0x7f92cc0fe0e0 2024-04-23T15:00:10.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.712+0000 7f92c2a00700 1 -- 172.21.15.81:0/3575757880 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f92b800bbf0 con 0x7f92cc0fe0e0 2024-04-23T15:00:10.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.712+0000 7f92c2a00700 1 -- 172.21.15.81:0/3575757880 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92b801c630 con 0x7f92cc0fe0e0 2024-04-23T15:00:10.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.712+0000 7f92d1800700 1 -- 172.21.15.81:0/3575757880 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92cc111250 con 0x7f92cc0fe0e0 2024-04-23T15:00:10.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.713+0000 7f92d1800700 1 -- 172.21.15.81:0/3575757880 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92cc111790 con 0x7f92cc0fe0e0 2024-04-23T15:00:10.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.714+0000 7f92d1800700 1 -- 172.21.15.81:0/3575757880 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92cc101a70 con 0x7f92cc0fe0e0 2024-04-23T15:00:10.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.715+0000 7f92c2a00700 1 -- 172.21.15.81:0/3575757880 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f92b800bd60 con 0x7f92cc0fe0e0 2024-04-23T15:00:10.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.715+0000 7f92c2a00700 1 --2- 172.21.15.81:0/3575757880 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f92b006ec10 0x7f92b00710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:10.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.716+0000 7f92c2a00700 1 -- 172.21.15.81:0/3575757880 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f92b808fcd0 con 0x7f92cc0fe0e0 2024-04-23T15:00:10.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.716+0000 7f92caa00700 1 --2- 172.21.15.81:0/3575757880 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f92b006ec10 0x7f92b00710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:10.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.716+0000 7f92caa00700 1 --2- 172.21.15.81:0/3575757880 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f92b006ec10 0x7f92b00710c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f92bc007fd0 tx=0x7f92bc009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:10.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.721+0000 7f92c2a00700 1 -- 172.21.15.81:0/3575757880 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f92b805c5b0 con 0x7f92cc0fe0e0 2024-04-23T15:00:10.825 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:10 smithi081 ceph-mon[90469]: Upgrade: Updating alertmanager.smithi081 2024-04-23T15:00:10.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:10 smithi081 ceph-mon[90469]: Deploying daemon alertmanager.smithi081 on smithi081 2024-04-23T15:00:10.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:10 smithi081 ceph-mon[90469]: from='client.34556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T15:00:10.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:10 smithi081 ceph-mon[90469]: pgmap v271: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:00:10.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.969+0000 7f92d1800700 1 -- 172.21.15.81:0/3575757880 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f92cc111a00 con 0x7f92b006ec10 2024-04-23T15:00:10.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.971+0000 7f92c2a00700 1 -- 172.21.15.81:0/3575757880 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+440 (secure 0 0 0) 0x7f92cc111a00 con 0x7f92b006ec10 2024-04-23T15:00:10.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.973+0000 7f92d1800700 1 -- 172.21.15.81:0/3575757880 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f92b006ec10 msgr2=0x7f92b00710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:10.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.973+0000 7f92d1800700 1 --2- 172.21.15.81:0/3575757880 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f92b006ec10 0x7f92b00710c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f92bc007fd0 tx=0x7f92bc009040 comp rx=0 tx=0).stop 2024-04-23T15:00:10.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.973+0000 7f92d1800700 1 -- 172.21.15.81:0/3575757880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92cc0fe0e0 msgr2=0x7f92cc110180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:10.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.973+0000 7f92d1800700 1 --2- 172.21.15.81:0/3575757880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92cc0fe0e0 0x7f92cc110180 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f92b8009150 tx=0x7f92b8009e30 comp rx=0 tx=0).stop 2024-04-23T15:00:10.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.973+0000 7f92d1800700 1 -- 172.21.15.81:0/3575757880 shutdown_connections 2024-04-23T15:00:10.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.973+0000 7f92d1800700 1 --2- 172.21.15.81:0/3575757880 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f92b006ec10 0x7f92b00710c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:10.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.973+0000 7f92d1800700 1 --2- 172.21.15.81:0/3575757880 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92cc0fcef0 0x7f92cc10fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:10.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.973+0000 7f92d1800700 1 --2- 172.21.15.81:0/3575757880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92cc0fe0e0 0x7f92cc110180 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:10.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.973+0000 7f92d1800700 1 -- 172.21.15.81:0/3575757880 >> 172.21.15.81:0/3575757880 conn(0x7f92cc0f8530 msgr2=0x7f92cc0f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:10.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.974+0000 7f92d1800700 1 -- 172.21.15.81:0/3575757880 shutdown_connections 2024-04-23T15:00:10.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:10.974+0000 7f92d1800700 1 -- 172.21.15.81:0/3575757880 wait complete. 2024-04-23T15:00:11.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.115+0000 7f34b3e00700 1 -- 172.21.15.81:0/4127546742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34ac0fdff0 msgr2=0x7f34ac0fe460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:11.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.115+0000 7f34b3e00700 1 --2- 172.21.15.81:0/4127546742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34ac0fdff0 0x7f34ac0fe460 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f349c004940 tx=0x7f349c009e30 comp rx=0 tx=0).stop 2024-04-23T15:00:11.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.115+0000 7f34b3e00700 1 -- 172.21.15.81:0/4127546742 shutdown_connections 2024-04-23T15:00:11.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.115+0000 7f34b3e00700 1 --2- 172.21.15.81:0/4127546742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34ac0fdff0 0x7f34ac0fe460 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:11.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.115+0000 7f34b3e00700 1 --2- 172.21.15.81:0/4127546742 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34ac0fce80 0x7f34ac0fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:11.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.115+0000 7f34b3e00700 1 -- 172.21.15.81:0/4127546742 >> 172.21.15.81:0/4127546742 conn(0x7f34ac0f8580 msgr2=0x7f34ac0fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:11.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.115+0000 7f34b3e00700 1 -- 172.21.15.81:0/4127546742 shutdown_connections 2024-04-23T15:00:11.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.115+0000 7f34b3e00700 1 -- 172.21.15.81:0/4127546742 wait complete. 2024-04-23T15:00:11.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.116+0000 7f34b3e00700 1 Processor -- start 2024-04-23T15:00:11.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.116+0000 7f34b3e00700 1 -- start start 2024-04-23T15:00:11.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.117+0000 7f34b3e00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34ac0fce80 0x7f34ac10fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:11.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.117+0000 7f34b3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34ac0fdff0 0x7f34ac110090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:11.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.117+0000 7f34b3e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac110690 con 0x7f34ac0fdff0 2024-04-23T15:00:11.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.117+0000 7f34b3e00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac110800 con 0x7f34ac0fce80 2024-04-23T15:00:11.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.117+0000 7f34b0a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34ac0fdff0 0x7f34ac110090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:11.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.117+0000 7f34b0a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34ac0fdff0 0x7f34ac110090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46998/0 (socket says 172.21.15.81:46998) 2024-04-23T15:00:11.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.117+0000 7f34b0a00700 1 -- 172.21.15.81:0/3810247021 learned_addr learned my addr 172.21.15.81:0/3810247021 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:00:11.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.117+0000 7f34b0a00700 1 -- 172.21.15.81:0/3810247021 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34ac0fce80 msgr2=0x7f34ac10fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:11.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.117+0000 7f34b0a00700 1 --2- 172.21.15.81:0/3810247021 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34ac0fce80 0x7f34ac10fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:11.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.117+0000 7f34b0a00700 1 -- 172.21.15.81:0/3810247021 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349c005040 con 0x7f34ac0fdff0 2024-04-23T15:00:11.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.118+0000 7f34b0a00700 1 --2- 172.21.15.81:0/3810247021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34ac0fdff0 0x7f34ac110090 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f349c009150 tx=0x7f349c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:11.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.118+0000 7f34a9600700 1 -- 172.21.15.81:0/3810247021 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f349c00e040 con 0x7f34ac0fdff0 2024-04-23T15:00:11.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.118+0000 7f34b3e00700 1 -- 172.21.15.81:0/3810247021 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34ac115200 con 0x7f34ac0fdff0 2024-04-23T15:00:11.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.118+0000 7f34a9600700 1 -- 172.21.15.81:0/3810247021 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f349c00bbf0 con 0x7f34ac0fdff0 2024-04-23T15:00:11.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.118+0000 7f34b3e00700 1 -- 172.21.15.81:0/3810247021 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34ac1157c0 con 0x7f34ac0fdff0 2024-04-23T15:00:11.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.118+0000 7f34a9600700 1 -- 172.21.15.81:0/3810247021 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f349c0255e0 con 0x7f34ac0fdff0 2024-04-23T15:00:11.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.119+0000 7f34b3e00700 1 -- 172.21.15.81:0/3810247021 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34ac101980 con 0x7f34ac0fdff0 2024-04-23T15:00:11.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.120+0000 7f34a9600700 1 -- 172.21.15.81:0/3810247021 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f349c00bd60 con 0x7f34ac0fdff0 2024-04-23T15:00:11.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.121+0000 7f34a9600700 1 --2- 172.21.15.81:0/3810247021 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f349406ec00 0x7f34940710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:11.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.121+0000 7f34a9600700 1 -- 172.21.15.81:0/3810247021 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f349c08fd70 con 0x7f34ac0fdff0 2024-04-23T15:00:11.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.121+0000 7f34b1400700 1 --2- 172.21.15.81:0/3810247021 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f349406ec00 0x7f34940710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:11.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.122+0000 7f34b1400700 1 --2- 172.21.15.81:0/3810247021 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f349406ec00 0x7f34940710b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f34a0004d00 tx=0x7f34a0009ce0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:11.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.126+0000 7f34a9600700 1 -- 172.21.15.81:0/3810247021 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f349c05c5d0 con 0x7f34ac0fdff0 2024-04-23T15:00:11.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:10 smithi156 ceph-mon[77738]: Upgrade: Updating alertmanager.smithi081 2024-04-23T15:00:11.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:10 smithi156 ceph-mon[77738]: Deploying daemon alertmanager.smithi081 on smithi081 2024-04-23T15:00:11.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:10 smithi156 ceph-mon[77738]: from='client.34556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T15:00:11.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:10 smithi156 ceph-mon[77738]: pgmap v271: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:00:11.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.351+0000 7f34b3e00700 1 -- 172.21.15.81:0/3810247021 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f34ac02b340 con 0x7f349406ec00 2024-04-23T15:00:11.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.365+0000 7f34a9600700 1 -- 172.21.15.81:0/3810247021 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f34ac02b340 con 0x7f349406ec00 2024-04-23T15:00:11.365 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-23T15:00:11.365 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (10m) 11s ago 21m 14.5M - 0.25.0 c8568f914cd2 63876b2abc27 2024-04-23T15:00:11.365 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (6m) 11s ago 21m 6665k - 19.0.0-3126-gd44fddd9 76e77f280c74 b486fe2ef19b 2024-04-23T15:00:11.365 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi156 smithi156 running (6m) 38s ago 20m 6656k - 19.0.0-3126-gd44fddd9 76e77f280c74 5d9aa5ecf264 2024-04-23T15:00:11.365 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (10m) 11s ago 20m 74.5M - 9.4.7 954c08fa6188 fbad3cef0883 2024-04-23T15:00:11.365 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.vcoywg smithi081 running (116s) 11s ago 14m 84.6M - 19.0.0-3126-gd44fddd9 76e77f280c74 87ab7708542f 2024-04-23T15:00:11.366 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.wydgcg smithi081 running (2m) 11s ago 14m 85.2M - 19.0.0-3126-gd44fddd9 76e77f280c74 e2a96404cc4f 2024-04-23T15:00:11.366 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.rhbtxt smithi156 running (91s) 38s ago 14m 11.3M - 19.0.0-3126-gd44fddd9 76e77f280c74 208d4416e1bf 2024-04-23T15:00:11.366 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.vynkxn smithi156 running (67s) 38s ago 14m 11.1M - 19.0.0-3126-gd44fddd9 76e77f280c74 34368f26f4d2 2024-04-23T15:00:11.366 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.ldghvq smithi081 *:8443,9283,8765 running (9m) 11s ago 22m 515M - 19.0.0-3126-gd44fddd9 76e77f280c74 6bf23484a1c9 2024-04-23T15:00:11.366 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi156.ounwyj smithi156 *:8443,9283,8765 running (8m) 38s ago 20m 453M - 19.0.0-3126-gd44fddd9 76e77f280c74 a6c0dd9f89f2 2024-04-23T15:00:11.366 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (8m) 11s ago 23m 55.0M 2048M 19.0.0-3126-gd44fddd9 76e77f280c74 fbf9f9a59ac2 2024-04-23T15:00:11.366 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi156 smithi156 running (7m) 38s ago 19m 40.6M 2048M 19.0.0-3126-gd44fddd9 76e77f280c74 36409886998f 2024-04-23T15:00:11.366 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (49s) 11s ago 21m 6987k - 1.5.0 0da6a335fe13 a822ef7cd112 2024-04-23T15:00:11.366 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi156 smithi156 *:9100 running (43s) 38s ago 20m 2839k - 1.5.0 0da6a335fe13 b74c35e7cf10 2024-04-23T15:00:11.366 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (5m) 11s ago 19m 109M 1557M 19.0.0-3126-gd44fddd9 76e77f280c74 24bc24b37de5 2024-04-23T15:00:11.366 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (5m) 11s ago 18m 120M 1557M 19.0.0-3126-gd44fddd9 76e77f280c74 18d0179b558a 2024-04-23T15:00:11.366 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (4m) 11s ago 17m 97.8M 1557M 19.0.0-3126-gd44fddd9 76e77f280c74 421a62ef6990 2024-04-23T15:00:11.366 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi156 running (4m) 38s ago 17m 126M 2581M 19.0.0-3126-gd44fddd9 76e77f280c74 9af3ca1ff69b 2024-04-23T15:00:11.366 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi156 running (3m) 38s ago 16m 110M 2581M 19.0.0-3126-gd44fddd9 76e77f280c74 e0a1e784348c 2024-04-23T15:00:11.367 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi156 running (2m) 38s ago 16m 107M 2581M 19.0.0-3126-gd44fddd9 76e77f280c74 16b6ba5d9e3e 2024-04-23T15:00:11.367 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (18s) 11s ago 20m 40.5M - 2.43.0 a07b618ecd1d 03f612614f9d 2024-04-23T15:00:11.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.368+0000 7f34b3e00700 1 -- 172.21.15.81:0/3810247021 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f349406ec00 msgr2=0x7f34940710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:11.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.368+0000 7f34b3e00700 1 --2- 172.21.15.81:0/3810247021 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f349406ec00 0x7f34940710b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f34a0004d00 tx=0x7f34a0009ce0 comp rx=0 tx=0).stop 2024-04-23T15:00:11.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.368+0000 7f34b3e00700 1 -- 172.21.15.81:0/3810247021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34ac0fdff0 msgr2=0x7f34ac110090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:11.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.368+0000 7f34b3e00700 1 --2- 172.21.15.81:0/3810247021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34ac0fdff0 0x7f34ac110090 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f349c009150 tx=0x7f349c009e30 comp rx=0 tx=0).stop 2024-04-23T15:00:11.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.368+0000 7f34b3e00700 1 -- 172.21.15.81:0/3810247021 shutdown_connections 2024-04-23T15:00:11.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.368+0000 7f34b3e00700 1 --2- 172.21.15.81:0/3810247021 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f349406ec00 0x7f34940710b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:11.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.368+0000 7f34b3e00700 1 --2- 172.21.15.81:0/3810247021 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34ac0fce80 0x7f34ac10fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:11.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.368+0000 7f34b3e00700 1 --2- 172.21.15.81:0/3810247021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34ac0fdff0 0x7f34ac110090 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:11.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.368+0000 7f34b3e00700 1 -- 172.21.15.81:0/3810247021 >> 172.21.15.81:0/3810247021 conn(0x7f34ac0f8580 msgr2=0x7f34ac0f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:11.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.368+0000 7f34b3e00700 1 -- 172.21.15.81:0/3810247021 shutdown_connections 2024-04-23T15:00:11.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.368+0000 7f34b3e00700 1 -- 172.21.15.81:0/3810247021 wait complete. 2024-04-23T15:00:11.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.516+0000 7fa5c3800700 1 -- 172.21.15.81:0/1957114903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5bc0fe0e0 msgr2=0x7fa5bc0fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:11.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.516+0000 7fa5c3800700 1 --2- 172.21.15.81:0/1957114903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5bc0fe0e0 0x7fa5bc0fe550 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8004940 tx=0x7fa5a8009e30 comp rx=0 tx=0).stop 2024-04-23T15:00:11.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.516+0000 7fa5c3800700 1 -- 172.21.15.81:0/1957114903 shutdown_connections 2024-04-23T15:00:11.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.516+0000 7fa5c3800700 1 --2- 172.21.15.81:0/1957114903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5bc0fe0e0 0x7fa5bc0fe550 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:11.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.516+0000 7fa5c3800700 1 --2- 172.21.15.81:0/1957114903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5bc0fcef0 0x7fa5bc0fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:11.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.516+0000 7fa5c3800700 1 -- 172.21.15.81:0/1957114903 >> 172.21.15.81:0/1957114903 conn(0x7fa5bc0f8530 msgr2=0x7fa5bc0fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:11.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.516+0000 7fa5c3800700 1 -- 172.21.15.81:0/1957114903 shutdown_connections 2024-04-23T15:00:11.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.516+0000 7fa5c3800700 1 -- 172.21.15.81:0/1957114903 wait complete. 2024-04-23T15:00:11.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.517+0000 7fa5c3800700 1 Processor -- start 2024-04-23T15:00:11.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.517+0000 7fa5c3800700 1 -- start start 2024-04-23T15:00:11.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.518+0000 7fa5c3800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5bc0fcef0 0x7fa5bc10fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:11.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.518+0000 7fa5c3800700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5bc0fe0e0 0x7fa5bc110270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:11.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.518+0000 7fa5c3800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc110f80 con 0x7fa5bc0fcef0 2024-04-23T15:00:11.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.518+0000 7fa5c3800700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc1110f0 con 0x7fa5bc0fe0e0 2024-04-23T15:00:11.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.518+0000 7fa5c0e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5bc0fcef0 0x7fa5bc10fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:11.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.518+0000 7fa5c0e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5bc0fcef0 0x7fa5bc10fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47016/0 (socket says 172.21.15.81:47016) 2024-04-23T15:00:11.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.518+0000 7fa5c0e00700 1 -- 172.21.15.81:0/3312187862 learned_addr learned my addr 172.21.15.81:0/3312187862 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:00:11.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.518+0000 7fa5bbe00700 1 --2- 172.21.15.81:0/3312187862 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5bc0fe0e0 0x7fa5bc110270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:11.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.518+0000 7fa5c0e00700 1 -- 172.21.15.81:0/3312187862 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5bc0fe0e0 msgr2=0x7fa5bc110270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:11.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.518+0000 7fa5c0e00700 1 --2- 172.21.15.81:0/3312187862 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5bc0fe0e0 0x7fa5bc110270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:11.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.519+0000 7fa5c0e00700 1 -- 172.21.15.81:0/3312187862 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a8005040 con 0x7fa5bc0fcef0 2024-04-23T15:00:11.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.519+0000 7fa5bbe00700 1 --2- 172.21.15.81:0/3312187862 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5bc0fe0e0 0x7fa5bc110270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:00:11.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.519+0000 7fa5c0e00700 1 --2- 172.21.15.81:0/3312187862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5bc0fcef0 0x7fa5bc10fd30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa5b000b790 tx=0x7fa5b0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:11.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.519+0000 7fa5b8c00700 1 -- 172.21.15.81:0/3312187862 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5b000f6f0 con 0x7fa5bc0fcef0 2024-04-23T15:00:11.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.519+0000 7fa5b8c00700 1 -- 172.21.15.81:0/3312187862 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa5b000fd20 con 0x7fa5bc0fcef0 2024-04-23T15:00:11.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.519+0000 7fa5c3800700 1 -- 172.21.15.81:0/3312187862 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5bc1113d0 con 0x7fa5bc0fcef0 2024-04-23T15:00:11.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.519+0000 7fa5b8c00700 1 -- 172.21.15.81:0/3312187862 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5b00103a0 con 0x7fa5bc0fcef0 2024-04-23T15:00:11.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.519+0000 7fa5c3800700 1 -- 172.21.15.81:0/3312187862 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5bc111990 con 0x7fa5bc0fcef0 2024-04-23T15:00:11.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.520+0000 7fa5c3800700 1 -- 172.21.15.81:0/3312187862 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5bc101a70 con 0x7fa5bc0fcef0 2024-04-23T15:00:11.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.521+0000 7fa5b8c00700 1 -- 172.21.15.81:0/3312187862 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fa5b0011400 con 0x7fa5bc0fcef0 2024-04-23T15:00:11.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.522+0000 7fa5b8c00700 1 --2- 172.21.15.81:0/3312187862 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa5a406ec10 0x7fa5a40710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:11.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.522+0000 7fa5b8c00700 1 -- 172.21.15.81:0/3312187862 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fa5b008e820 con 0x7fa5bc0fcef0 2024-04-23T15:00:11.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.523+0000 7fa5bbe00700 1 --2- 172.21.15.81:0/3312187862 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa5a406ec10 0x7fa5a40710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:11.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.523+0000 7fa5bbe00700 1 --2- 172.21.15.81:0/3312187862 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa5a406ec10 0x7fa5a40710c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa5a800b7a0 tx=0x7fa5a8009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:11.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.527+0000 7fa5b8c00700 1 -- 172.21.15.81:0/3312187862 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fa5b005b000 con 0x7fa5bc0fcef0 2024-04-23T15:00:11.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.861+0000 7fa5c3800700 1 -- 172.21.15.81:0/3312187862 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa5bc105ae0 con 0x7fa5bc0fcef0 2024-04-23T15:00:11.862 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:11 smithi081 ceph-mon[90469]: from='client.34560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T15:00:11.862 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:11 smithi081 ceph-mon[90469]: from='client.34564 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T15:00:11.862 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:11 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T15:00:11.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.862+0000 7fa5b8c00700 1 -- 172.21.15.81:0/3312187862 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fa5b005ab90 con 0x7fa5bc0fcef0 2024-04-23T15:00:11.862 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T15:00:11.862 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-04-23T15:00:11.862 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T15:00:11.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T15:00:11.862 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-04-23T15:00:11.863 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T15:00:11.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T15:00:11.863 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-04-23T15:00:11.863 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 6 2024-04-23T15:00:11.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T15:00:11.863 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-04-23T15:00:11.863 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 4 2024-04-23T15:00:11.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T15:00:11.863 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-04-23T15:00:11.863 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 14 2024-04-23T15:00:11.863 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-23T15:00:11.863 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T15:00:11.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.864+0000 7fa5c3800700 1 -- 172.21.15.81:0/3312187862 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa5a406ec10 msgr2=0x7fa5a40710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:11.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.864+0000 7fa5c3800700 1 --2- 172.21.15.81:0/3312187862 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa5a406ec10 0x7fa5a40710c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa5a800b7a0 tx=0x7fa5a8009e30 comp rx=0 tx=0).stop 2024-04-23T15:00:11.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.864+0000 7fa5c3800700 1 -- 172.21.15.81:0/3312187862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5bc0fcef0 msgr2=0x7fa5bc10fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:11.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.864+0000 7fa5c3800700 1 --2- 172.21.15.81:0/3312187862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5bc0fcef0 0x7fa5bc10fd30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa5b000b790 tx=0x7fa5b0009220 comp rx=0 tx=0).stop 2024-04-23T15:00:11.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.865+0000 7fa5c3800700 1 -- 172.21.15.81:0/3312187862 shutdown_connections 2024-04-23T15:00:11.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.865+0000 7fa5c3800700 1 --2- 172.21.15.81:0/3312187862 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa5a406ec10 0x7fa5a40710c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:11.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.865+0000 7fa5c3800700 1 --2- 172.21.15.81:0/3312187862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5bc0fcef0 0x7fa5bc10fd30 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:11.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.865+0000 7fa5c3800700 1 --2- 172.21.15.81:0/3312187862 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5bc0fe0e0 0x7fa5bc110270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:11.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.865+0000 7fa5c3800700 1 -- 172.21.15.81:0/3312187862 >> 172.21.15.81:0/3312187862 conn(0x7fa5bc0f8530 msgr2=0x7fa5bc0f9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:11.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.865+0000 7fa5c3800700 1 -- 172.21.15.81:0/3312187862 shutdown_connections 2024-04-23T15:00:11.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:11.865+0000 7fa5c3800700 1 -- 172.21.15.81:0/3312187862 wait complete. 2024-04-23T15:00:12.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.011+0000 7fcdfee00700 1 -- 172.21.15.81:0/3293808924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdf8066290 msgr2=0x7fcdf80ff860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:12.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.011+0000 7fcdfee00700 1 --2- 172.21.15.81:0/3293808924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdf8066290 0x7fcdf80ff860 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fcdec004940 tx=0x7fcdec009e30 comp rx=0 tx=0).stop 2024-04-23T15:00:12.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.011+0000 7fcdfee00700 1 -- 172.21.15.81:0/3293808924 shutdown_connections 2024-04-23T15:00:12.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.011+0000 7fcdfee00700 1 --2- 172.21.15.81:0/3293808924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcdf80ffda0 0x7fcdf8102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:12.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.011+0000 7fcdfee00700 1 --2- 172.21.15.81:0/3293808924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdf8066290 0x7fcdf80ff860 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:12.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.011+0000 7fcdfee00700 1 -- 172.21.15.81:0/3293808924 >> 172.21.15.81:0/3293808924 conn(0x7fcdf80f7270 msgr2=0x7fcdf80f96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:12.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.012+0000 7fcdfee00700 1 -- 172.21.15.81:0/3293808924 shutdown_connections 2024-04-23T15:00:12.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.012+0000 7fcdfee00700 1 -- 172.21.15.81:0/3293808924 wait complete. 2024-04-23T15:00:12.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.013+0000 7fcdfee00700 1 Processor -- start 2024-04-23T15:00:12.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.013+0000 7fcdfee00700 1 -- start start 2024-04-23T15:00:12.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.013+0000 7fcdfee00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcdf8066290 0x7fcdf810d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:12.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.013+0000 7fcdfee00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdf80ffda0 0x7fcdf810ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:12.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.013+0000 7fcdfee00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf810e460 con 0x7fcdf80ffda0 2024-04-23T15:00:12.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.013+0000 7fcdfee00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf810ec50 con 0x7fcdf8066290 2024-04-23T15:00:12.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.013+0000 7fcdfd000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdf80ffda0 0x7fcdf810ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:12.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.014+0000 7fcdfd000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdf80ffda0 0x7fcdf810ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47030/0 (socket says 172.21.15.81:47030) 2024-04-23T15:00:12.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.014+0000 7fcdfd000700 1 -- 172.21.15.81:0/1624968818 learned_addr learned my addr 172.21.15.81:0/1624968818 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:00:12.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.014+0000 7fcdfda00700 1 --2- 172.21.15.81:0/1624968818 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcdf8066290 0x7fcdf810d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:12.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.014+0000 7fcdfd000700 1 -- 172.21.15.81:0/1624968818 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcdf8066290 msgr2=0x7fcdf810d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:12.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.014+0000 7fcdfd000700 1 --2- 172.21.15.81:0/1624968818 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcdf8066290 0x7fcdf810d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:12.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.014+0000 7fcdfd000700 1 -- 172.21.15.81:0/1624968818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdec005040 con 0x7fcdf80ffda0 2024-04-23T15:00:12.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.014+0000 7fcdfd000700 1 --2- 172.21.15.81:0/1624968818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdf80ffda0 0x7fcdf810ddd0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fcde400b790 tx=0x7fcde4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:12.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.015+0000 7fcdf5600700 1 -- 172.21.15.81:0/1624968818 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcde400f770 con 0x7fcdf80ffda0 2024-04-23T15:00:12.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.015+0000 7fcdf5600700 1 -- 172.21.15.81:0/1624968818 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcde400fda0 con 0x7fcdf80ffda0 2024-04-23T15:00:12.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.015+0000 7fcdfee00700 1 -- 172.21.15.81:0/1624968818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdf810ef30 con 0x7fcdf80ffda0 2024-04-23T15:00:12.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.015+0000 7fcdf5600700 1 -- 172.21.15.81:0/1624968818 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcde400d310 con 0x7fcdf80ffda0 2024-04-23T15:00:12.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.015+0000 7fcdfee00700 1 -- 172.21.15.81:0/1624968818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdf810f4f0 con 0x7fcdf80ffda0 2024-04-23T15:00:12.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.016+0000 7fcdfee00700 1 -- 172.21.15.81:0/1624968818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdf805f5f0 con 0x7fcdf80ffda0 2024-04-23T15:00:12.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.017+0000 7fcdf5600700 1 -- 172.21.15.81:0/1624968818 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fcde4010420 con 0x7fcdf80ffda0 2024-04-23T15:00:12.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.019+0000 7fcdf5600700 1 --2- 172.21.15.81:0/1624968818 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fcde006ec10 0x7fcde00710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:12.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.019+0000 7fcdf5600700 1 -- 172.21.15.81:0/1624968818 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fcde408e930 con 0x7fcdf80ffda0 2024-04-23T15:00:12.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.019+0000 7fcdfda00700 1 --2- 172.21.15.81:0/1624968818 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fcde006ec10 0x7fcde00710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:12.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.020+0000 7fcdfda00700 1 --2- 172.21.15.81:0/1624968818 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fcde006ec10 0x7fcde00710c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fcdec00b3b0 tx=0x7fcdec009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:12.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.023+0000 7fcdf5600700 1 -- 172.21.15.81:0/1624968818 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fcde405b230 con 0x7fcdf80ffda0 2024-04-23T15:00:12.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:11 smithi156 ceph-mon[77738]: from='client.34560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T15:00:12.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:11 smithi156 ceph-mon[77738]: from='client.34564 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T15:00:12.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:11 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T15:00:12.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.297+0000 7fcdfee00700 1 -- 172.21.15.81:0/1624968818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcdf810f770 con 0x7fcdf80ffda0 2024-04-23T15:00:12.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.298+0000 7fcdf5600700 1 -- 172.21.15.81:0/1624968818 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 36 v36) v1 ==== 76+0+1967 (secure 0 0 0) 0x7fcde405adc0 con 0x7fcdf80ffda0 2024-04-23T15:00:12.299 INFO:teuthology.orchestra.run.smithi081.stdout:e36 2024-04-23T15:00:12.299 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-23T15:00:12.299 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T15:00:12.299 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-04-23T15:00:12.299 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T15:00:12.299 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-04-23T15:00:12.299 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-04-23T15:00:12.299 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 36 2024-04-23T15:00:12.299 INFO:teuthology.orchestra.run.smithi081.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-23T15:00:12.300 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-04-23T14:45:51.264703+0000 2024-04-23T15:00:12.300 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-04-23T14:59:16.388200+0000 2024-04-23T15:00:12.300 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-04-23T15:00:12.300 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-04-23T15:00:12.300 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-04-23T15:00:12.300 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-04-23T15:00:12.300 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-04-23T15:00:12.300 INFO:teuthology.orchestra.run.smithi081.stdout:max_xattr_size 65536 2024-04-23T15:00:12.300 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-04-23T15:00:12.300 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-04-23T15:00:12.300 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 86 2024-04-23T15:00:12.300 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-23T15:00:12.300 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 1 2024-04-23T15:00:12.300 INFO:teuthology.orchestra.run.smithi081.stdout:in 0 2024-04-23T15:00:12.301 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=34430} 2024-04-23T15:00:12.301 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-04-23T15:00:12.301 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-04-23T15:00:12.301 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-04-23T15:00:12.301 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-04-23T15:00:12.301 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-04-23T15:00:12.301 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-04-23T15:00:12.301 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-04-23T15:00:12.301 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-04-23T15:00:12.301 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-04-23T15:00:12.301 INFO:teuthology.orchestra.run.smithi081.stdout:qdb_cluster leader: 34430 members: 34430 2024-04-23T15:00:12.301 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.wydgcg{0:34430} state up:active seq 24 join_fscid=1 addr [v2:172.21.15.81:6826/3200953351,v1:172.21.15.81:6827/3200953351] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T15:00:12.301 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.vcoywg{0:34462} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.81:6828/2598630159,v1:172.21.15.81:6829/2598630159] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T15:00:12.301 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T15:00:12.301 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T15:00:12.302 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-04-23T15:00:12.302 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T15:00:12.302 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.rhbtxt{-1:44273} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.156:6824/3017230919,v1:172.21.15.156:6825/3017230919] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T15:00:12.302 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.vynkxn{-1:44277} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.156:6826/4079938688,v1:172.21.15.156:6827/4079938688] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T15:00:12.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.301+0000 7fcdfee00700 1 -- 172.21.15.81:0/1624968818 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fcde006ec10 msgr2=0x7fcde00710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:12.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.301+0000 7fcdfee00700 1 --2- 172.21.15.81:0/1624968818 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fcde006ec10 0x7fcde00710c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fcdec00b3b0 tx=0x7fcdec009e30 comp rx=0 tx=0).stop 2024-04-23T15:00:12.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.301+0000 7fcdfee00700 1 -- 172.21.15.81:0/1624968818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdf80ffda0 msgr2=0x7fcdf810ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:12.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.301+0000 7fcdfee00700 1 --2- 172.21.15.81:0/1624968818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdf80ffda0 0x7fcdf810ddd0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fcde400b790 tx=0x7fcde4009250 comp rx=0 tx=0).stop 2024-04-23T15:00:12.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.301+0000 7fcdfee00700 1 -- 172.21.15.81:0/1624968818 shutdown_connections 2024-04-23T15:00:12.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.301+0000 7fcdfee00700 1 --2- 172.21.15.81:0/1624968818 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fcde006ec10 0x7fcde00710c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:12.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.301+0000 7fcdfee00700 1 --2- 172.21.15.81:0/1624968818 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcdf8066290 0x7fcdf810d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:12.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.301+0000 7fcdfee00700 1 --2- 172.21.15.81:0/1624968818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdf80ffda0 0x7fcdf810ddd0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:12.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.301+0000 7fcdfee00700 1 -- 172.21.15.81:0/1624968818 >> 172.21.15.81:0/1624968818 conn(0x7fcdf80f7270 msgr2=0x7fcdf80f7690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:12.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.302+0000 7fcdfee00700 1 -- 172.21.15.81:0/1624968818 shutdown_connections 2024-04-23T15:00:12.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.302+0000 7fcdfee00700 1 -- 172.21.15.81:0/1624968818 wait complete. 2024-04-23T15:00:12.303 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 36 2024-04-23T15:00:12.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.449+0000 7fe86be00700 1 -- 172.21.15.81:0/579751466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe86c0ffd40 msgr2=0x7fe86c102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:12.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.449+0000 7fe86be00700 1 --2- 172.21.15.81:0/579751466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe86c0ffd40 0x7fe86c102160 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe858004940 tx=0x7fe858009e30 comp rx=0 tx=0).stop 2024-04-23T15:00:12.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.449+0000 7fe86be00700 1 -- 172.21.15.81:0/579751466 shutdown_connections 2024-04-23T15:00:12.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.449+0000 7fe86be00700 1 --2- 172.21.15.81:0/579751466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe86c0ffd40 0x7fe86c102160 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:12.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.449+0000 7fe86be00700 1 --2- 172.21.15.81:0/579751466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe86c0662f0 0x7fe86c0ff800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:12.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.449+0000 7fe86be00700 1 -- 172.21.15.81:0/579751466 >> 172.21.15.81:0/579751466 conn(0x7fe86c0f7270 msgr2=0x7fe86c0f96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:12.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.449+0000 7fe86be00700 1 -- 172.21.15.81:0/579751466 shutdown_connections 2024-04-23T15:00:12.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.449+0000 7fe86be00700 1 -- 172.21.15.81:0/579751466 wait complete. 2024-04-23T15:00:12.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.450+0000 7fe86be00700 1 Processor -- start 2024-04-23T15:00:12.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.450+0000 7fe86be00700 1 -- start start 2024-04-23T15:00:12.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.450+0000 7fe86be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe86c0662f0 0x7fe86c0fd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:12.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.451+0000 7fe86be00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe86c0ffd40 0x7fe86c0fb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:12.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.451+0000 7fe86be00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe86c0fbcb0 con 0x7fe86c0662f0 2024-04-23T15:00:12.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.451+0000 7fe86be00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe86c0fbe20 con 0x7fe86c0ffd40 2024-04-23T15:00:12.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.451+0000 7fe86aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe86c0662f0 0x7fe86c0fd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:12.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.451+0000 7fe86aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe86c0662f0 0x7fe86c0fd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47060/0 (socket says 172.21.15.81:47060) 2024-04-23T15:00:12.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.451+0000 7fe86aa00700 1 -- 172.21.15.81:0/3610990195 learned_addr learned my addr 172.21.15.81:0/3610990195 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:00:12.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.451+0000 7fe86aa00700 1 -- 172.21.15.81:0/3610990195 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe86c0ffd40 msgr2=0x7fe86c0fb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:12.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.451+0000 7fe86aa00700 1 --2- 172.21.15.81:0/3610990195 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe86c0ffd40 0x7fe86c0fb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:12.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.451+0000 7fe86aa00700 1 -- 172.21.15.81:0/3610990195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe858005040 con 0x7fe86c0662f0 2024-04-23T15:00:12.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.452+0000 7fe86aa00700 1 --2- 172.21.15.81:0/3610990195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe86c0662f0 0x7fe86c0fd230 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe85c002a50 tx=0x7fe85c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:12.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.452+0000 7fe862a00700 1 -- 172.21.15.81:0/3610990195 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe85c007cc0 con 0x7fe86c0662f0 2024-04-23T15:00:12.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.452+0000 7fe862a00700 1 -- 172.21.15.81:0/3610990195 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe85c00f040 con 0x7fe86c0662f0 2024-04-23T15:00:12.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.452+0000 7fe86be00700 1 -- 172.21.15.81:0/3610990195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe86c0fc100 con 0x7fe86c0662f0 2024-04-23T15:00:12.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.452+0000 7fe862a00700 1 -- 172.21.15.81:0/3610990195 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe85c00daf0 con 0x7fe86c0662f0 2024-04-23T15:00:12.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.452+0000 7fe86be00700 1 -- 172.21.15.81:0/3610990195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe86c1158d0 con 0x7fe86c0662f0 2024-04-23T15:00:12.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.453+0000 7fe86be00700 1 -- 172.21.15.81:0/3610990195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe86c05f5f0 con 0x7fe86c0662f0 2024-04-23T15:00:12.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.454+0000 7fe862a00700 1 -- 172.21.15.81:0/3610990195 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fe85c009810 con 0x7fe86c0662f0 2024-04-23T15:00:12.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.455+0000 7fe862a00700 1 --2- 172.21.15.81:0/3610990195 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fe85006ec10 0x7fe8500710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:12.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.455+0000 7fe862a00700 1 -- 172.21.15.81:0/3610990195 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fe85c08e680 con 0x7fe86c0662f0 2024-04-23T15:00:12.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.455+0000 7fe86a000700 1 --2- 172.21.15.81:0/3610990195 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fe85006ec10 0x7fe8500710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:12.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.456+0000 7fe86a000700 1 --2- 172.21.15.81:0/3610990195 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fe85006ec10 0x7fe8500710c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe858004f90 tx=0x7fe858009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:12.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.460+0000 7fe862a00700 1 -- 172.21.15.81:0/3610990195 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fe85c0573d0 con 0x7fe86c0662f0 2024-04-23T15:00:12.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.708+0000 7fe86be00700 1 -- 172.21.15.81:0/3610990195 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe86c0f8db0 con 0x7fe85006ec10 2024-04-23T15:00:12.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.709+0000 7fe862a00700 1 -- 172.21.15.81:0/3610990195 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+440 (secure 0 0 0) 0x7fe86c0f8db0 con 0x7fe85006ec10 2024-04-23T15:00:12.710 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T15:00:12.710 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd", 2024-04-23T15:00:12.710 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-04-23T15:00:12.710 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-23T15:00:12.710 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [ 2024-04-23T15:00:12.710 INFO:teuthology.orchestra.run.smithi081.stdout: "mon", 2024-04-23T15:00:12.710 INFO:teuthology.orchestra.run.smithi081.stdout: "mds", 2024-04-23T15:00:12.710 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr", 2024-04-23T15:00:12.710 INFO:teuthology.orchestra.run.smithi081.stdout: "osd", 2024-04-23T15:00:12.710 INFO:teuthology.orchestra.run.smithi081.stdout: "crash" 2024-04-23T15:00:12.710 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-04-23T15:00:12.710 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "16/21 daemons upgraded", 2024-04-23T15:00:12.711 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "Currently upgrading alertmanager daemons", 2024-04-23T15:00:12.711 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-04-23T15:00:12.711 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T15:00:12.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.712+0000 7fe86be00700 1 -- 172.21.15.81:0/3610990195 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fe85006ec10 msgr2=0x7fe8500710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:12.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.712+0000 7fe86be00700 1 --2- 172.21.15.81:0/3610990195 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fe85006ec10 0x7fe8500710c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe858004f90 tx=0x7fe858009e30 comp rx=0 tx=0).stop 2024-04-23T15:00:12.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.712+0000 7fe86be00700 1 -- 172.21.15.81:0/3610990195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe86c0662f0 msgr2=0x7fe86c0fd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:12.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.712+0000 7fe86be00700 1 --2- 172.21.15.81:0/3610990195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe86c0662f0 0x7fe86c0fd230 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe85c002a50 tx=0x7fe85c004600 comp rx=0 tx=0).stop 2024-04-23T15:00:12.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.712+0000 7fe86be00700 1 -- 172.21.15.81:0/3610990195 shutdown_connections 2024-04-23T15:00:12.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.712+0000 7fe86be00700 1 --2- 172.21.15.81:0/3610990195 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fe85006ec10 0x7fe8500710c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:12.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.712+0000 7fe86be00700 1 --2- 172.21.15.81:0/3610990195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe86c0662f0 0x7fe86c0fd230 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:12.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.712+0000 7fe86be00700 1 --2- 172.21.15.81:0/3610990195 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe86c0ffd40 0x7fe86c0fb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:12.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.712+0000 7fe86be00700 1 -- 172.21.15.81:0/3610990195 >> 172.21.15.81:0/3610990195 conn(0x7fe86c0f7270 msgr2=0x7fe86c0f7690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:12.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.712+0000 7fe86be00700 1 -- 172.21.15.81:0/3610990195 shutdown_connections 2024-04-23T15:00:12.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.712+0000 7fe86be00700 1 -- 172.21.15.81:0/3610990195 wait complete. 2024-04-23T15:00:12.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.861+0000 7fcf3b400700 1 -- 172.21.15.81:0/4032517350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf340fcef0 msgr2=0x7fcf340fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:12.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.861+0000 7fcf3b400700 1 --2- 172.21.15.81:0/4032517350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf340fcef0 0x7fcf340fd320 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcf28004940 tx=0x7fcf28009e30 comp rx=0 tx=0).stop 2024-04-23T15:00:12.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.861+0000 7fcf3b400700 1 -- 172.21.15.81:0/4032517350 shutdown_connections 2024-04-23T15:00:12.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.861+0000 7fcf3b400700 1 --2- 172.21.15.81:0/4032517350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf340fe0e0 0x7fcf340fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:12.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.861+0000 7fcf3b400700 1 --2- 172.21.15.81:0/4032517350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf340fcef0 0x7fcf340fd320 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:12.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.861+0000 7fcf3b400700 1 -- 172.21.15.81:0/4032517350 >> 172.21.15.81:0/4032517350 conn(0x7fcf340f8530 msgr2=0x7fcf340fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:12.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.861+0000 7fcf3b400700 1 -- 172.21.15.81:0/4032517350 shutdown_connections 2024-04-23T15:00:12.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.861+0000 7fcf3b400700 1 -- 172.21.15.81:0/4032517350 wait complete. 2024-04-23T15:00:12.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.862+0000 7fcf3b400700 1 Processor -- start 2024-04-23T15:00:12.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.862+0000 7fcf3b400700 1 -- start start 2024-04-23T15:00:12.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.862+0000 7fcf3b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf340fcef0 0x7fcf3410fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:12.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.862+0000 7fcf3b400700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf340fe0e0 0x7fcf34110190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:12.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.862+0000 7fcf3b400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf34110820 con 0x7fcf340fcef0 2024-04-23T15:00:12.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.862+0000 7fcf3b400700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf34111010 con 0x7fcf340fe0e0 2024-04-23T15:00:12.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.862+0000 7fcf38a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf340fcef0 0x7fcf3410fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:12.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.863+0000 7fcf38a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf340fcef0 0x7fcf3410fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47076/0 (socket says 172.21.15.81:47076) 2024-04-23T15:00:12.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.863+0000 7fcf38a00700 1 -- 172.21.15.81:0/2511979797 learned_addr learned my addr 172.21.15.81:0/2511979797 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:00:12.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.863+0000 7fcf33e00700 1 --2- 172.21.15.81:0/2511979797 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf340fe0e0 0x7fcf34110190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:12.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.863+0000 7fcf38a00700 1 -- 172.21.15.81:0/2511979797 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf340fe0e0 msgr2=0x7fcf34110190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:12.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.863+0000 7fcf38a00700 1 --2- 172.21.15.81:0/2511979797 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf340fe0e0 0x7fcf34110190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:12.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.863+0000 7fcf38a00700 1 -- 172.21.15.81:0/2511979797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf28005040 con 0x7fcf340fcef0 2024-04-23T15:00:12.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.863+0000 7fcf33e00700 1 --2- 172.21.15.81:0/2511979797 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf340fe0e0 0x7fcf34110190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:00:12.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.863+0000 7fcf38a00700 1 --2- 172.21.15.81:0/2511979797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf340fcef0 0x7fcf3410fc50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcf2800b970 tx=0x7fcf28009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:12.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.864+0000 7fcf30c00700 1 -- 172.21.15.81:0/2511979797 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf2800e040 con 0x7fcf340fcef0 2024-04-23T15:00:12.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.864+0000 7fcf30c00700 1 -- 172.21.15.81:0/2511979797 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcf2800bbf0 con 0x7fcf340fcef0 2024-04-23T15:00:12.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.864+0000 7fcf3b400700 1 -- 172.21.15.81:0/2511979797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf34111290 con 0x7fcf340fcef0 2024-04-23T15:00:12.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.864+0000 7fcf3b400700 1 -- 172.21.15.81:0/2511979797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf34111850 con 0x7fcf340fcef0 2024-04-23T15:00:12.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.864+0000 7fcf30c00700 1 -- 172.21.15.81:0/2511979797 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf2801c630 con 0x7fcf340fcef0 2024-04-23T15:00:12.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.865+0000 7fcf3b400700 1 -- 172.21.15.81:0/2511979797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf140052e0 con 0x7fcf340fcef0 2024-04-23T15:00:12.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.866+0000 7fcf30c00700 1 -- 172.21.15.81:0/2511979797 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fcf2800bd60 con 0x7fcf340fcef0 2024-04-23T15:00:12.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.867+0000 7fcf30c00700 1 --2- 172.21.15.81:0/2511979797 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fcf1c06ecc0 0x7fcf1c071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:12.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.868+0000 7fcf30c00700 1 -- 172.21.15.81:0/2511979797 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fcf2808fba0 con 0x7fcf340fcef0 2024-04-23T15:00:12.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.868+0000 7fcf33e00700 1 --2- 172.21.15.81:0/2511979797 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fcf1c06ecc0 0x7fcf1c071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:12.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.868+0000 7fcf33e00700 1 --2- 172.21.15.81:0/2511979797 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fcf1c06ecc0 0x7fcf1c071170 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcf20006fd0 tx=0x7fcf20008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:12.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:12.872+0000 7fcf30c00700 1 -- 172.21.15.81:0/2511979797 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fcf2805c480 con 0x7fcf340fcef0 2024-04-23T15:00:13.028 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:12 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/3312187862' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:13.029 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:12 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/1624968818' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T15:00:13.029 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:12 smithi081 ceph-mon[90469]: pgmap v272: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:00:13.029 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:12 smithi081 ceph-mon[90469]: from='client.34576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T15:00:13.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:13.178+0000 7fcf3b400700 1 -- 172.21.15.81:0/2511979797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fcf14005590 con 0x7fcf340fcef0 2024-04-23T15:00:13.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:13.178+0000 7fcf30c00700 1 -- 172.21.15.81:0/2511979797 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fcf2805c010 con 0x7fcf340fcef0 2024-04-23T15:00:13.178 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-04-23T15:00:13.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:13.181+0000 7fcf3b400700 1 -- 172.21.15.81:0/2511979797 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fcf1c06ecc0 msgr2=0x7fcf1c071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:13.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:13.181+0000 7fcf3b400700 1 --2- 172.21.15.81:0/2511979797 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fcf1c06ecc0 0x7fcf1c071170 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcf20006fd0 tx=0x7fcf20008040 comp rx=0 tx=0).stop 2024-04-23T15:00:13.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:13.181+0000 7fcf3b400700 1 -- 172.21.15.81:0/2511979797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf340fcef0 msgr2=0x7fcf3410fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:13.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:13.181+0000 7fcf3b400700 1 --2- 172.21.15.81:0/2511979797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf340fcef0 0x7fcf3410fc50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcf2800b970 tx=0x7fcf28009e30 comp rx=0 tx=0).stop 2024-04-23T15:00:13.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:13.181+0000 7fcf3b400700 1 -- 172.21.15.81:0/2511979797 shutdown_connections 2024-04-23T15:00:13.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:13.181+0000 7fcf3b400700 1 --2- 172.21.15.81:0/2511979797 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fcf1c06ecc0 0x7fcf1c071170 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:13.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:13.181+0000 7fcf3b400700 1 --2- 172.21.15.81:0/2511979797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf340fcef0 0x7fcf3410fc50 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:13.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:13.181+0000 7fcf3b400700 1 --2- 172.21.15.81:0/2511979797 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf340fe0e0 0x7fcf34110190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:13.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:13.181+0000 7fcf3b400700 1 -- 172.21.15.81:0/2511979797 >> 172.21.15.81:0/2511979797 conn(0x7fcf340f8530 msgr2=0x7fcf340f9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:13.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:13.182+0000 7fcf3b400700 1 -- 172.21.15.81:0/2511979797 shutdown_connections 2024-04-23T15:00:13.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:13.182+0000 7fcf3b400700 1 -- 172.21.15.81:0/2511979797 wait complete. 2024-04-23T15:00:13.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:12 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/3312187862' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:13.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:12 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/1624968818' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T15:00:13.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:12 smithi156 ceph-mon[77738]: pgmap v272: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:00:13.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:12 smithi156 ceph-mon[77738]: from='client.34576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T15:00:14.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:13 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/2511979797' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T15:00:14.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:13 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/2511979797' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T15:00:15.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:14 smithi156 ceph-mon[77738]: pgmap v273: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:00:15.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:14 smithi081 ceph-mon[90469]: pgmap v273: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:00:17.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:17 smithi081 ceph-mon[90469]: pgmap v274: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T15:00:18.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:17 smithi156 ceph-mon[77738]: pgmap v274: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T15:00:19.473 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:19 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:19.473 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:19 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:19.473 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:19 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:00:19.473 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:19 smithi081 ceph-mon[90469]: pgmap v275: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:00:19.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:19 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:19.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:19 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:19.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:19 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:00:19.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:19 smithi156 ceph-mon[77738]: pgmap v275: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:00:21.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:21 smithi081 ceph-mon[90469]: pgmap v276: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:00:22.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:21 smithi156 ceph-mon[77738]: pgmap v276: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:00:23.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:23 smithi081 ceph-mon[90469]: pgmap v277: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:00:24.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:23 smithi156 ceph-mon[77738]: pgmap v277: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:00:25.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:25 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:25.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:25 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:25.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:25 smithi156 ceph-mon[77738]: pgmap v278: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:00:25.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:25 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:25.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:25 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:25.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:25 smithi081 ceph-mon[90469]: pgmap v278: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:00:27.712 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:27 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:27.712 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:27 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:27.712 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:27 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T15:00:27.712 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:27 smithi081 ceph-mon[90469]: pgmap v279: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T15:00:27.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:27 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:27.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:27 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:27.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:27 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T15:00:27.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:27 smithi156 ceph-mon[77738]: pgmap v279: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T15:00:29.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:29 smithi081 ceph-mon[90469]: pgmap v280: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:00:30.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:29 smithi156 ceph-mon[77738]: pgmap v280: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:00:32.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:31 smithi156 ceph-mon[77738]: pgmap v281: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:00:32.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:31 smithi081 ceph-mon[90469]: pgmap v281: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:00:33.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:33.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:33.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:00:33.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:00:33.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:33.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-23T15:00:33.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:33 smithi156 ceph-mon[77738]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-23T15:00:33.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:00:33.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:33.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:33.537 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:33.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:33.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:33.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:33.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:33.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:33.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:33.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:33.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:33.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:33 smithi156 ceph-mon[77738]: pgmap v282: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-04-23T15:00:33.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:33.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:33.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:33.538 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:33 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:33.560 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:33.560 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:33.560 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:00:33.560 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:00:33.560 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:33.560 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-23T15:00:33.560 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:33 smithi081 ceph-mon[90469]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-23T15:00:33.560 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:00:33.560 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:33.560 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:33.560 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:33.561 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:33.561 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:33.561 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:33.561 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:33.561 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:33.561 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:33.561 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:33.561 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:33.561 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:33 smithi081 ceph-mon[90469]: pgmap v282: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-04-23T15:00:33.561 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:33.561 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:33.561 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:33.561 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:33 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:36.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:35 smithi156 ceph-mon[77738]: pgmap v283: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:00:36.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:35 smithi081 ceph-mon[90469]: pgmap v283: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:00:37.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:36 smithi156 ceph-mon[77738]: Upgrade: Updating grafana.smithi081 2024-04-23T15:00:37.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:36 smithi156 ceph-mon[77738]: Deploying daemon grafana.smithi081 on smithi081 2024-04-23T15:00:37.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:36 smithi081 ceph-mon[90469]: Upgrade: Updating grafana.smithi081 2024-04-23T15:00:37.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:36 smithi081 ceph-mon[90469]: Deploying daemon grafana.smithi081 on smithi081 2024-04-23T15:00:37.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:37 smithi081 ceph-mon[90469]: pgmap v284: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-23T15:00:38.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:37 smithi156 ceph-mon[77738]: pgmap v284: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-23T15:00:40.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:39 smithi156 ceph-mon[77738]: pgmap v285: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-04-23T15:00:40.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:39 smithi081 ceph-mon[90469]: pgmap v285: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-04-23T15:00:42.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:41 smithi156 ceph-mon[77738]: pgmap v286: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:00:42.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:41 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T15:00:42.075 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:41 smithi081 ceph-mon[90469]: pgmap v286: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:00:42.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:41 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T15:00:43.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.370+0000 7f138b200700 1 -- 172.21.15.81:0/2120470830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f138c0ffda0 msgr2=0x7f138c102180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:43.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.370+0000 7f138b200700 1 --2- 172.21.15.81:0/2120470830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f138c0ffda0 0x7f138c102180 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1374004940 tx=0x7f1374009e30 comp rx=0 tx=0).stop 2024-04-23T15:00:43.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.370+0000 7f138b200700 1 -- 172.21.15.81:0/2120470830 shutdown_connections 2024-04-23T15:00:43.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.370+0000 7f138b200700 1 --2- 172.21.15.81:0/2120470830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f138c0ffda0 0x7f138c102180 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:43.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.370+0000 7f138b200700 1 --2- 172.21.15.81:0/2120470830 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f138c066290 0x7f138c0ff860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:43.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.370+0000 7f138b200700 1 -- 172.21.15.81:0/2120470830 >> 172.21.15.81:0/2120470830 conn(0x7f138c0f7270 msgr2=0x7f138c0f96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:43.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.370+0000 7f138b200700 1 -- 172.21.15.81:0/2120470830 shutdown_connections 2024-04-23T15:00:43.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.370+0000 7f138b200700 1 -- 172.21.15.81:0/2120470830 wait complete. 2024-04-23T15:00:43.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.371+0000 7f138b200700 1 Processor -- start 2024-04-23T15:00:43.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.371+0000 7f138b200700 1 -- start start 2024-04-23T15:00:43.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.372+0000 7f138b200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f138c066290 0x7f138c10faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:43.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.372+0000 7f138b200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f138c0ffda0 0x7f138c10ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:43.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.372+0000 7f138b200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138c1105e0 con 0x7f138c066290 2024-04-23T15:00:43.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.372+0000 7f138b200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138c110e30 con 0x7f138c0ffda0 2024-04-23T15:00:43.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.372+0000 7f1389e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f138c066290 0x7f138c10faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:43.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.372+0000 7f1389e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f138c066290 0x7f138c10faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33242/0 (socket says 172.21.15.81:33242) 2024-04-23T15:00:43.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.372+0000 7f1389e00700 1 -- 172.21.15.81:0/276692584 learned_addr learned my addr 172.21.15.81:0/276692584 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:00:43.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.372+0000 7f1383e00700 1 --2- 172.21.15.81:0/276692584 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f138c0ffda0 0x7f138c10ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:43.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.373+0000 7f1389e00700 1 -- 172.21.15.81:0/276692584 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f138c0ffda0 msgr2=0x7f138c10ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:43.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.373+0000 7f1389e00700 1 --2- 172.21.15.81:0/276692584 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f138c0ffda0 0x7f138c10ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:43.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.373+0000 7f1389e00700 1 -- 172.21.15.81:0/276692584 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1374005040 con 0x7f138c066290 2024-04-23T15:00:43.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.373+0000 7f1389e00700 1 --2- 172.21.15.81:0/276692584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f138c066290 0x7f138c10faa0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f137c00ca90 tx=0x7f137c007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:43.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.373+0000 7f1382000700 1 -- 172.21.15.81:0/276692584 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f137c00aa50 con 0x7f138c066290 2024-04-23T15:00:43.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.373+0000 7f1382000700 1 -- 172.21.15.81:0/276692584 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f137c00abb0 con 0x7f138c066290 2024-04-23T15:00:43.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.373+0000 7f1382000700 1 -- 172.21.15.81:0/276692584 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f137c0115e0 con 0x7f138c066290 2024-04-23T15:00:43.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.374+0000 7f138b200700 1 -- 172.21.15.81:0/276692584 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f138c111110 con 0x7f138c066290 2024-04-23T15:00:43.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.374+0000 7f138b200700 1 -- 172.21.15.81:0/276692584 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f138c111650 con 0x7f138c066290 2024-04-23T15:00:43.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.375+0000 7f138b200700 1 -- 172.21.15.81:0/276692584 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f138c05f5f0 con 0x7f138c066290 2024-04-23T15:00:43.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.376+0000 7f1382000700 1 -- 172.21.15.81:0/276692584 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f137c00ad20 con 0x7f138c066290 2024-04-23T15:00:43.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.377+0000 7f1382000700 1 --2- 172.21.15.81:0/276692584 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f137006ec10 0x7f13700710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:43.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.378+0000 7f1382000700 1 -- 172.21.15.81:0/276692584 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f137c08ef50 con 0x7f138c066290 2024-04-23T15:00:43.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.378+0000 7f1383e00700 1 --2- 172.21.15.81:0/276692584 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f137006ec10 0x7f13700710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:43.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.379+0000 7f1383e00700 1 --2- 172.21.15.81:0/276692584 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f137006ec10 0x7f13700710c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f137400b3b0 tx=0x7f1374009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:43.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.384+0000 7f1382000700 1 -- 172.21.15.81:0/276692584 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f137c0c3ff0 con 0x7f138c066290 2024-04-23T15:00:43.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.749+0000 7f138b200700 1 -- 172.21.15.81:0/276692584 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f138c111a30 con 0x7f137006ec10 2024-04-23T15:00:43.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.751+0000 7f1382000700 1 -- 172.21.15.81:0/276692584 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7f138c111a30 con 0x7f137006ec10 2024-04-23T15:00:43.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.753+0000 7f138b200700 1 -- 172.21.15.81:0/276692584 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f137006ec10 msgr2=0x7f13700710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:43.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.753+0000 7f138b200700 1 --2- 172.21.15.81:0/276692584 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f137006ec10 0x7f13700710c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f137400b3b0 tx=0x7f1374009e30 comp rx=0 tx=0).stop 2024-04-23T15:00:43.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.753+0000 7f138b200700 1 -- 172.21.15.81:0/276692584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f138c066290 msgr2=0x7f138c10faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:43.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.753+0000 7f138b200700 1 --2- 172.21.15.81:0/276692584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f138c066290 0x7f138c10faa0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f137c00ca90 tx=0x7f137c007f00 comp rx=0 tx=0).stop 2024-04-23T15:00:43.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.754+0000 7f138b200700 1 -- 172.21.15.81:0/276692584 shutdown_connections 2024-04-23T15:00:43.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.754+0000 7f138b200700 1 --2- 172.21.15.81:0/276692584 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f137006ec10 0x7f13700710c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:43.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.754+0000 7f138b200700 1 --2- 172.21.15.81:0/276692584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f138c066290 0x7f138c10faa0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:43.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.754+0000 7f138b200700 1 --2- 172.21.15.81:0/276692584 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f138c0ffda0 0x7f138c10ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:43.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.754+0000 7f138b200700 1 -- 172.21.15.81:0/276692584 >> 172.21.15.81:0/276692584 conn(0x7f138c0f7270 msgr2=0x7f138c0fb920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:43.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.754+0000 7f138b200700 1 -- 172.21.15.81:0/276692584 shutdown_connections 2024-04-23T15:00:43.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.754+0000 7f138b200700 1 -- 172.21.15.81:0/276692584 wait complete. 2024-04-23T15:00:43.770 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-04-23T15:00:43.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.912+0000 7f2f37400700 1 -- 172.21.15.81:0/3269600651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f301046d0 msgr2=0x7f2f30104b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:43.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.912+0000 7f2f37400700 1 --2- 172.21.15.81:0/3269600651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f301046d0 0x7f2f30104b40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c004940 tx=0x7f2f1c009e30 comp rx=0 tx=0).stop 2024-04-23T15:00:43.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.912+0000 7f2f37400700 1 -- 172.21.15.81:0/3269600651 shutdown_connections 2024-04-23T15:00:43.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.912+0000 7f2f37400700 1 --2- 172.21.15.81:0/3269600651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f301046d0 0x7f2f30104b40 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:43.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.912+0000 7f2f37400700 1 --2- 172.21.15.81:0/3269600651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f30103420 0x7f2f30103830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:43.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.912+0000 7f2f37400700 1 -- 172.21.15.81:0/3269600651 >> 172.21.15.81:0/3269600651 conn(0x7f2f30072640 msgr2=0x7f2f30074a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:43.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.912+0000 7f2f37400700 1 -- 172.21.15.81:0/3269600651 shutdown_connections 2024-04-23T15:00:43.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.912+0000 7f2f37400700 1 -- 172.21.15.81:0/3269600651 wait complete. 2024-04-23T15:00:43.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.913+0000 7f2f37400700 1 Processor -- start 2024-04-23T15:00:43.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.913+0000 7f2f37400700 1 -- start start 2024-04-23T15:00:43.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.914+0000 7f2f37400700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f30103420 0x7f2f30113f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:43.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.914+0000 7f2f37400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f301046d0 0x7f2f30114490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:43.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.914+0000 7f2f37400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f30114b20 con 0x7f2f301046d0 2024-04-23T15:00:43.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.914+0000 7f2f37400700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f301194c0 con 0x7f2f30103420 2024-04-23T15:00:43.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.914+0000 7f2f2fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f301046d0 0x7f2f30114490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:43.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.914+0000 7f2f2fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f301046d0 0x7f2f30114490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53266/0 (socket says 172.21.15.81:53266) 2024-04-23T15:00:43.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.914+0000 7f2f2fe00700 1 -- 172.21.15.81:0/602758980 learned_addr learned my addr 172.21.15.81:0/602758980 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:00:43.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.914+0000 7f2f34a00700 1 --2- 172.21.15.81:0/602758980 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f30103420 0x7f2f30113f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:43.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.914+0000 7f2f2fe00700 1 -- 172.21.15.81:0/602758980 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f30103420 msgr2=0x7f2f30113f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:43.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.914+0000 7f2f2fe00700 1 --2- 172.21.15.81:0/602758980 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f30103420 0x7f2f30113f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:43.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.914+0000 7f2f2fe00700 1 -- 172.21.15.81:0/602758980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f1c005040 con 0x7f2f301046d0 2024-04-23T15:00:43.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.915+0000 7f2f2fe00700 1 --2- 172.21.15.81:0/602758980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f301046d0 0x7f2f30114490 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c00b3b0 tx=0x7f2f1c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:43.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.915+0000 7f2f2cc00700 1 -- 172.21.15.81:0/602758980 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f1c00e040 con 0x7f2f301046d0 2024-04-23T15:00:43.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.915+0000 7f2f2cc00700 1 -- 172.21.15.81:0/602758980 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2f1c004290 con 0x7f2f301046d0 2024-04-23T15:00:43.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.915+0000 7f2f2cc00700 1 -- 172.21.15.81:0/602758980 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f1c01c630 con 0x7f2f301046d0 2024-04-23T15:00:43.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.915+0000 7f2f37400700 1 -- 172.21.15.81:0/602758980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f301196c0 con 0x7f2f301046d0 2024-04-23T15:00:43.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.915+0000 7f2f37400700 1 -- 172.21.15.81:0/602758980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f30119c30 con 0x7f2f301046d0 2024-04-23T15:00:43.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.916+0000 7f2f37400700 1 -- 172.21.15.81:0/602758980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f3004c710 con 0x7f2f301046d0 2024-04-23T15:00:43.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.918+0000 7f2f2cc00700 1 -- 172.21.15.81:0/602758980 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f2f1c00bbf0 con 0x7f2f301046d0 2024-04-23T15:00:43.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.919+0000 7f2f2cc00700 1 --2- 172.21.15.81:0/602758980 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f2f1806ec00 0x7f2f180710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:43.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.919+0000 7f2f2cc00700 1 -- 172.21.15.81:0/602758980 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f2f1c08fda0 con 0x7f2f301046d0 2024-04-23T15:00:43.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.919+0000 7f2f34a00700 1 --2- 172.21.15.81:0/602758980 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f2f1806ec00 0x7f2f180710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:43.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.920+0000 7f2f34a00700 1 --2- 172.21.15.81:0/602758980 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f2f1806ec00 0x7f2f180710b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2f24006fd0 tx=0x7f2f24008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:43.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:43.924+0000 7f2f2cc00700 1 -- 172.21.15.81:0/602758980 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f2f1c05c600 con 0x7f2f301046d0 2024-04-23T15:00:44.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:43 smithi156 ceph-mon[77738]: pgmap v287: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-04-23T15:00:44.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:43 smithi081 ceph-mon[90469]: pgmap v287: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-04-23T15:00:44.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.172+0000 7f2f37400700 1 -- 172.21.15.81:0/602758980 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f30108970 con 0x7f2f1806ec00 2024-04-23T15:00:44.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.174+0000 7f2f2cc00700 1 -- 172.21.15.81:0/602758980 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7f2f30108970 con 0x7f2f1806ec00 2024-04-23T15:00:44.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.177+0000 7f2f37400700 1 -- 172.21.15.81:0/602758980 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f2f1806ec00 msgr2=0x7f2f180710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:44.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.177+0000 7f2f37400700 1 --2- 172.21.15.81:0/602758980 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f2f1806ec00 0x7f2f180710b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2f24006fd0 tx=0x7f2f24008040 comp rx=0 tx=0).stop 2024-04-23T15:00:44.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.177+0000 7f2f37400700 1 -- 172.21.15.81:0/602758980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f301046d0 msgr2=0x7f2f30114490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:44.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.177+0000 7f2f37400700 1 --2- 172.21.15.81:0/602758980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f301046d0 0x7f2f30114490 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c00b3b0 tx=0x7f2f1c009e30 comp rx=0 tx=0).stop 2024-04-23T15:00:44.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.177+0000 7f2f37400700 1 -- 172.21.15.81:0/602758980 shutdown_connections 2024-04-23T15:00:44.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.177+0000 7f2f37400700 1 --2- 172.21.15.81:0/602758980 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f2f1806ec00 0x7f2f180710b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:44.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.177+0000 7f2f37400700 1 --2- 172.21.15.81:0/602758980 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f30103420 0x7f2f30113f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:44.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.177+0000 7f2f37400700 1 --2- 172.21.15.81:0/602758980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f301046d0 0x7f2f30114490 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:44.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.177+0000 7f2f37400700 1 -- 172.21.15.81:0/602758980 >> 172.21.15.81:0/602758980 conn(0x7f2f30072640 msgr2=0x7f2f30073ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:44.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.177+0000 7f2f37400700 1 -- 172.21.15.81:0/602758980 shutdown_connections 2024-04-23T15:00:44.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.177+0000 7f2f37400700 1 -- 172.21.15.81:0/602758980 wait complete. 2024-04-23T15:00:44.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.333+0000 7f7ab5a00700 1 -- 172.21.15.81:0/2581649769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ab01046d0 msgr2=0x7f7ab0104b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:44.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.333+0000 7f7ab5a00700 1 --2- 172.21.15.81:0/2581649769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ab01046d0 0x7f7ab0104b40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c004940 tx=0x7f7a9c009e30 comp rx=0 tx=0).stop 2024-04-23T15:00:44.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.333+0000 7f7ab5a00700 1 -- 172.21.15.81:0/2581649769 shutdown_connections 2024-04-23T15:00:44.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.333+0000 7f7ab5a00700 1 --2- 172.21.15.81:0/2581649769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ab01046d0 0x7f7ab0104b40 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:44.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.333+0000 7f7ab5a00700 1 --2- 172.21.15.81:0/2581649769 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ab0103420 0x7f7ab0103830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:44.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.333+0000 7f7ab5a00700 1 -- 172.21.15.81:0/2581649769 >> 172.21.15.81:0/2581649769 conn(0x7f7ab0072640 msgr2=0x7f7ab0074a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:44.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.333+0000 7f7ab5a00700 1 -- 172.21.15.81:0/2581649769 shutdown_connections 2024-04-23T15:00:44.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.333+0000 7f7ab5a00700 1 -- 172.21.15.81:0/2581649769 wait complete. 2024-04-23T15:00:44.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.334+0000 7f7ab5a00700 1 Processor -- start 2024-04-23T15:00:44.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.334+0000 7f7ab5a00700 1 -- start start 2024-04-23T15:00:44.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.334+0000 7f7ab5a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ab0103420 0x7f7ab0113f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:44.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.334+0000 7f7ab5a00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ab01046d0 0x7f7ab0114490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:44.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.334+0000 7f7ab5a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab0114a90 con 0x7f7ab0103420 2024-04-23T15:00:44.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.334+0000 7f7ab5a00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab0114c00 con 0x7f7ab01046d0 2024-04-23T15:00:44.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.335+0000 7f7aaea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ab0103420 0x7f7ab0113f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:44.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.335+0000 7f7aaea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ab0103420 0x7f7ab0113f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53276/0 (socket says 172.21.15.81:53276) 2024-04-23T15:00:44.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.335+0000 7f7aaea00700 1 -- 172.21.15.81:0/356263833 learned_addr learned my addr 172.21.15.81:0/356263833 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:00:44.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.335+0000 7f7aae000700 1 --2- 172.21.15.81:0/356263833 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ab01046d0 0x7f7ab0114490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:44.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.335+0000 7f7aaea00700 1 -- 172.21.15.81:0/356263833 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ab01046d0 msgr2=0x7f7ab0114490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:44.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.335+0000 7f7aaea00700 1 --2- 172.21.15.81:0/356263833 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ab01046d0 0x7f7ab0114490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:44.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.335+0000 7f7aaea00700 1 -- 172.21.15.81:0/356263833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a9c005040 con 0x7f7ab0103420 2024-04-23T15:00:44.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.335+0000 7f7aae000700 1 --2- 172.21.15.81:0/356263833 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ab01046d0 0x7f7ab0114490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:00:44.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.335+0000 7f7aaea00700 1 --2- 172.21.15.81:0/356263833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ab0103420 0x7f7ab0113f50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0002a50 tx=0x7f7aa00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:44.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.336+0000 7f7aa6a00700 1 -- 172.21.15.81:0/356263833 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7aa0007cc0 con 0x7f7ab0103420 2024-04-23T15:00:44.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.336+0000 7f7aa6a00700 1 -- 172.21.15.81:0/356263833 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7aa000f040 con 0x7f7ab0103420 2024-04-23T15:00:44.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.336+0000 7f7aa6a00700 1 -- 172.21.15.81:0/356263833 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7aa0009640 con 0x7f7ab0103420 2024-04-23T15:00:44.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.336+0000 7f7ab5a00700 1 -- 172.21.15.81:0/356263833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab0119660 con 0x7f7ab0103420 2024-04-23T15:00:44.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.336+0000 7f7ab5a00700 1 -- 172.21.15.81:0/356263833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab0119c20 con 0x7f7ab0103420 2024-04-23T15:00:44.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.337+0000 7f7ab5a00700 1 -- 172.21.15.81:0/356263833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab004c710 con 0x7f7ab0103420 2024-04-23T15:00:44.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.338+0000 7f7aa6a00700 1 -- 172.21.15.81:0/356263833 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f7aa00097c0 con 0x7f7ab0103420 2024-04-23T15:00:44.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.339+0000 7f7aa6a00700 1 --2- 172.21.15.81:0/356263833 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f7a9406ec00 0x7f7a940710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:44.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.340+0000 7f7aa6a00700 1 -- 172.21.15.81:0/356263833 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f7aa008e650 con 0x7f7ab0103420 2024-04-23T15:00:44.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.340+0000 7f7aae000700 1 --2- 172.21.15.81:0/356263833 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f7a9406ec00 0x7f7a940710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:44.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.341+0000 7f7aae000700 1 --2- 172.21.15.81:0/356263833 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f7a9406ec00 0x7f7a940710b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c00b7a0 tx=0x7f7a9c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:44.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.345+0000 7f7aa6a00700 1 -- 172.21.15.81:0/356263833 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f7aa005aeb0 con 0x7f7ab0103420 2024-04-23T15:00:44.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.584+0000 7f7ab5a00700 1 -- 172.21.15.81:0/356263833 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ab0108a10 con 0x7f7a9406ec00 2024-04-23T15:00:44.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.619+0000 7f7aa6a00700 1 -- 172.21.15.81:0/356263833 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f7ab0108a10 con 0x7f7a9406ec00 2024-04-23T15:00:44.619 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-23T15:00:44.619 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (27s) 20s ago 21m 13.7M - 0.25.0 c8568f914cd2 cb978e6344d1 2024-04-23T15:00:44.619 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (6m) 20s ago 22m 6665k - 19.0.0-3126-gd44fddd9 76e77f280c74 b486fe2ef19b 2024-04-23T15:00:44.619 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi156 smithi156 running (6m) 72s ago 20m 6656k - 19.0.0-3126-gd44fddd9 76e77f280c74 5d9aa5ecf264 2024-04-23T15:00:44.619 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (10m) 20s ago 21m 74.1M - 9.4.7 954c08fa6188 fbad3cef0883 2024-04-23T15:00:44.620 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.vcoywg smithi081 running (2m) 20s ago 14m 84.6M - 19.0.0-3126-gd44fddd9 76e77f280c74 87ab7708542f 2024-04-23T15:00:44.620 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.wydgcg smithi081 running (2m) 20s ago 14m 85.2M - 19.0.0-3126-gd44fddd9 76e77f280c74 e2a96404cc4f 2024-04-23T15:00:44.620 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.rhbtxt smithi156 running (2m) 72s ago 14m 11.3M - 19.0.0-3126-gd44fddd9 76e77f280c74 208d4416e1bf 2024-04-23T15:00:44.620 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.vynkxn smithi156 running (100s) 72s ago 14m 11.1M - 19.0.0-3126-gd44fddd9 76e77f280c74 34368f26f4d2 2024-04-23T15:00:44.620 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.ldghvq smithi081 *:8443,9283,8765 running (10m) 20s ago 23m 515M - 19.0.0-3126-gd44fddd9 76e77f280c74 6bf23484a1c9 2024-04-23T15:00:44.620 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi156.ounwyj smithi156 *:8443,9283,8765 running (9m) 72s ago 20m 453M - 19.0.0-3126-gd44fddd9 76e77f280c74 a6c0dd9f89f2 2024-04-23T15:00:44.620 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (8m) 20s ago 23m 56.1M 2048M 19.0.0-3126-gd44fddd9 76e77f280c74 fbf9f9a59ac2 2024-04-23T15:00:44.620 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi156 smithi156 running (7m) 72s ago 20m 40.6M 2048M 19.0.0-3126-gd44fddd9 76e77f280c74 36409886998f 2024-04-23T15:00:44.620 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (82s) 20s ago 21m 7541k - 1.5.0 0da6a335fe13 a822ef7cd112 2024-04-23T15:00:44.620 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi156 smithi156 *:9100 running (76s) 72s ago 20m 2839k - 1.5.0 0da6a335fe13 b74c35e7cf10 2024-04-23T15:00:44.620 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (6m) 20s ago 19m 110M 1557M 19.0.0-3126-gd44fddd9 76e77f280c74 24bc24b37de5 2024-04-23T15:00:44.620 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (5m) 20s ago 18m 120M 1557M 19.0.0-3126-gd44fddd9 76e77f280c74 18d0179b558a 2024-04-23T15:00:44.620 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (5m) 20s ago 18m 97.9M 1557M 19.0.0-3126-gd44fddd9 76e77f280c74 421a62ef6990 2024-04-23T15:00:44.620 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi156 running (4m) 72s ago 17m 126M 2581M 19.0.0-3126-gd44fddd9 76e77f280c74 9af3ca1ff69b 2024-04-23T15:00:44.620 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi156 running (4m) 72s ago 17m 110M 2581M 19.0.0-3126-gd44fddd9 76e77f280c74 e0a1e784348c 2024-04-23T15:00:44.620 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi156 running (3m) 72s ago 16m 107M 2581M 19.0.0-3126-gd44fddd9 76e77f280c74 16b6ba5d9e3e 2024-04-23T15:00:44.621 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (51s) 20s ago 21m 47.3M - 2.43.0 a07b618ecd1d 03f612614f9d 2024-04-23T15:00:44.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.623+0000 7f7ab5a00700 1 -- 172.21.15.81:0/356263833 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f7a9406ec00 msgr2=0x7f7a940710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:44.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.623+0000 7f7ab5a00700 1 --2- 172.21.15.81:0/356263833 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f7a9406ec00 0x7f7a940710b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c00b7a0 tx=0x7f7a9c009e30 comp rx=0 tx=0).stop 2024-04-23T15:00:44.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.623+0000 7f7ab5a00700 1 -- 172.21.15.81:0/356263833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ab0103420 msgr2=0x7f7ab0113f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:44.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.623+0000 7f7ab5a00700 1 --2- 172.21.15.81:0/356263833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ab0103420 0x7f7ab0113f50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0002a50 tx=0x7f7aa00046b0 comp rx=0 tx=0).stop 2024-04-23T15:00:44.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.623+0000 7f7ab5a00700 1 -- 172.21.15.81:0/356263833 shutdown_connections 2024-04-23T15:00:44.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.623+0000 7f7ab5a00700 1 --2- 172.21.15.81:0/356263833 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f7a9406ec00 0x7f7a940710b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:44.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.623+0000 7f7ab5a00700 1 --2- 172.21.15.81:0/356263833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ab0103420 0x7f7ab0113f50 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:44.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.623+0000 7f7ab5a00700 1 --2- 172.21.15.81:0/356263833 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ab01046d0 0x7f7ab0114490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:44.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.623+0000 7f7ab5a00700 1 -- 172.21.15.81:0/356263833 >> 172.21.15.81:0/356263833 conn(0x7f7ab0072640 msgr2=0x7f7ab0073d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:44.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.623+0000 7f7ab5a00700 1 -- 172.21.15.81:0/356263833 shutdown_connections 2024-04-23T15:00:44.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.623+0000 7f7ab5a00700 1 -- 172.21.15.81:0/356263833 wait complete. 2024-04-23T15:00:44.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.782+0000 7f1238200700 1 -- 172.21.15.81:0/961064601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12301002b0 msgr2=0x7f1230100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:44.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.782+0000 7f1238200700 1 --2- 172.21.15.81:0/961064601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12301002b0 0x7f1230100720 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f121c004940 tx=0x7f121c009e30 comp rx=0 tx=0).stop 2024-04-23T15:00:44.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.782+0000 7f1238200700 1 -- 172.21.15.81:0/961064601 shutdown_connections 2024-04-23T15:00:44.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.782+0000 7f1238200700 1 --2- 172.21.15.81:0/961064601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12301002b0 0x7f1230100720 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:44.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.782+0000 7f1238200700 1 --2- 172.21.15.81:0/961064601 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12300ff000 0x7f12300ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:44.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.782+0000 7f1238200700 1 -- 172.21.15.81:0/961064601 >> 172.21.15.81:0/961064601 conn(0x7f12300fa950 msgr2=0x7f12300fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:44.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.783+0000 7f1238200700 1 -- 172.21.15.81:0/961064601 shutdown_connections 2024-04-23T15:00:44.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.783+0000 7f1238200700 1 -- 172.21.15.81:0/961064601 wait complete. 2024-04-23T15:00:44.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.783+0000 7f1238200700 1 Processor -- start 2024-04-23T15:00:44.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.784+0000 7f1238200700 1 -- start start 2024-04-23T15:00:44.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.784+0000 7f1238200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12300ff000 0x7f123010fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:44.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.784+0000 7f1238200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12301002b0 0x7f1230110140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:44.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.784+0000 7f1238200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1230110740 con 0x7f12301002b0 2024-04-23T15:00:44.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.784+0000 7f1238200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1230110f90 con 0x7f12300ff000 2024-04-23T15:00:44.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.784+0000 7f1234e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12301002b0 0x7f1230110140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:44.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.784+0000 7f1234e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12301002b0 0x7f1230110140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53286/0 (socket says 172.21.15.81:53286) 2024-04-23T15:00:44.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.784+0000 7f1234e00700 1 -- 172.21.15.81:0/2971825770 learned_addr learned my addr 172.21.15.81:0/2971825770 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:00:44.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.785+0000 7f1235800700 1 --2- 172.21.15.81:0/2971825770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12300ff000 0x7f123010fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:44.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.785+0000 7f1234e00700 1 -- 172.21.15.81:0/2971825770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12300ff000 msgr2=0x7f123010fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:44.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.785+0000 7f1234e00700 1 --2- 172.21.15.81:0/2971825770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12300ff000 0x7f123010fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:44.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.785+0000 7f1234e00700 1 -- 172.21.15.81:0/2971825770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f121c005040 con 0x7f12301002b0 2024-04-23T15:00:44.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.785+0000 7f1235800700 1 --2- 172.21.15.81:0/2971825770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12300ff000 0x7f123010fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:00:44.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.785+0000 7f1234e00700 1 --2- 172.21.15.81:0/2971825770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12301002b0 0x7f1230110140 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f121c009150 tx=0x7f121c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:44.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.785+0000 7f122d600700 1 -- 172.21.15.81:0/2971825770 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f121c00e040 con 0x7f12301002b0 2024-04-23T15:00:44.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.785+0000 7f1238200700 1 -- 172.21.15.81:0/2971825770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1230111210 con 0x7f12301002b0 2024-04-23T15:00:44.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.785+0000 7f122d600700 1 -- 172.21.15.81:0/2971825770 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f121c00bbf0 con 0x7f12301002b0 2024-04-23T15:00:44.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.785+0000 7f122d600700 1 -- 172.21.15.81:0/2971825770 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f121c01c630 con 0x7f12301002b0 2024-04-23T15:00:44.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.785+0000 7f1238200700 1 -- 172.21.15.81:0/2971825770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1230111750 con 0x7f12301002b0 2024-04-23T15:00:44.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.787+0000 7f1238200700 1 -- 172.21.15.81:0/2971825770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f123005f5f0 con 0x7f12301002b0 2024-04-23T15:00:44.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.788+0000 7f122d600700 1 -- 172.21.15.81:0/2971825770 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f121c00bd60 con 0x7f12301002b0 2024-04-23T15:00:44.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.789+0000 7f122d600700 1 --2- 172.21.15.81:0/2971825770 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f121806ec10 0x7f12180710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:44.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.789+0000 7f122d600700 1 -- 172.21.15.81:0/2971825770 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f121c08fd30 con 0x7f12301002b0 2024-04-23T15:00:44.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.789+0000 7f1235800700 1 --2- 172.21.15.81:0/2971825770 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f121806ec10 0x7f12180710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:44.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.790+0000 7f1235800700 1 --2- 172.21.15.81:0/2971825770 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f121806ec10 0x7f12180710c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1224007fd0 tx=0x7f1224009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:44.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:44.793+0000 7f122d600700 1 -- 172.21.15.81:0/2971825770 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f121c05c590 con 0x7f12301002b0 2024-04-23T15:00:45.018 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:44 smithi081 ceph-mon[90469]: from='client.34584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T15:00:45.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:44 smithi156 ceph-mon[77738]: from='client.34584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T15:00:45.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.117+0000 7f1238200700 1 -- 172.21.15.81:0/2971825770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1230111af0 con 0x7f12301002b0 2024-04-23T15:00:45.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.118+0000 7f122d600700 1 -- 172.21.15.81:0/2971825770 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f121c05c120 con 0x7f12301002b0 2024-04-23T15:00:45.118 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T15:00:45.118 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-04-23T15:00:45.118 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T15:00:45.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T15:00:45.119 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-04-23T15:00:45.119 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T15:00:45.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T15:00:45.119 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-04-23T15:00:45.119 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 6 2024-04-23T15:00:45.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T15:00:45.119 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-04-23T15:00:45.119 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 4 2024-04-23T15:00:45.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T15:00:45.119 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-04-23T15:00:45.119 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 14 2024-04-23T15:00:45.119 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-23T15:00:45.119 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T15:00:45.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.121+0000 7f1238200700 1 -- 172.21.15.81:0/2971825770 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f121806ec10 msgr2=0x7f12180710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:45.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.121+0000 7f1238200700 1 --2- 172.21.15.81:0/2971825770 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f121806ec10 0x7f12180710c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1224007fd0 tx=0x7f1224009040 comp rx=0 tx=0).stop 2024-04-23T15:00:45.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.121+0000 7f1238200700 1 -- 172.21.15.81:0/2971825770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12301002b0 msgr2=0x7f1230110140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:45.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.121+0000 7f1238200700 1 --2- 172.21.15.81:0/2971825770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12301002b0 0x7f1230110140 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f121c009150 tx=0x7f121c009e30 comp rx=0 tx=0).stop 2024-04-23T15:00:45.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.121+0000 7f1238200700 1 -- 172.21.15.81:0/2971825770 shutdown_connections 2024-04-23T15:00:45.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.121+0000 7f1238200700 1 --2- 172.21.15.81:0/2971825770 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f121806ec10 0x7f12180710c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:45.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.121+0000 7f1238200700 1 --2- 172.21.15.81:0/2971825770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12300ff000 0x7f123010fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:45.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.121+0000 7f1238200700 1 --2- 172.21.15.81:0/2971825770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12301002b0 0x7f1230110140 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:45.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.121+0000 7f1238200700 1 -- 172.21.15.81:0/2971825770 >> 172.21.15.81:0/2971825770 conn(0x7f12300fa950 msgr2=0x7f12300fcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:45.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.121+0000 7f1238200700 1 -- 172.21.15.81:0/2971825770 shutdown_connections 2024-04-23T15:00:45.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.121+0000 7f1238200700 1 -- 172.21.15.81:0/2971825770 wait complete. 2024-04-23T15:00:45.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.280+0000 7fd148200700 1 -- 172.21.15.81:0/2089153023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1401046d0 msgr2=0x7fd140104b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:45.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.280+0000 7fd148200700 1 --2- 172.21.15.81:0/2089153023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1401046d0 0x7fd140104b40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd12c004940 tx=0x7fd12c009e30 comp rx=0 tx=0).stop 2024-04-23T15:00:45.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.280+0000 7fd148200700 1 -- 172.21.15.81:0/2089153023 shutdown_connections 2024-04-23T15:00:45.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.280+0000 7fd148200700 1 --2- 172.21.15.81:0/2089153023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1401046d0 0x7fd140104b40 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:45.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.280+0000 7fd148200700 1 --2- 172.21.15.81:0/2089153023 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd140103420 0x7fd140103830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:45.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.280+0000 7fd148200700 1 -- 172.21.15.81:0/2089153023 >> 172.21.15.81:0/2089153023 conn(0x7fd140072640 msgr2=0x7fd140074a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:45.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.281+0000 7fd148200700 1 -- 172.21.15.81:0/2089153023 shutdown_connections 2024-04-23T15:00:45.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.281+0000 7fd148200700 1 -- 172.21.15.81:0/2089153023 wait complete. 2024-04-23T15:00:45.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.281+0000 7fd148200700 1 Processor -- start 2024-04-23T15:00:45.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.282+0000 7fd148200700 1 -- start start 2024-04-23T15:00:45.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.282+0000 7fd148200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd140103420 0x7fd140113f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:45.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.282+0000 7fd148200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1401046d0 0x7fd140114490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:45.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.282+0000 7fd148200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd140114a90 con 0x7fd140103420 2024-04-23T15:00:45.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.282+0000 7fd148200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd140114c00 con 0x7fd1401046d0 2024-04-23T15:00:45.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.282+0000 7fd145800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd140103420 0x7fd140113f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:45.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.282+0000 7fd145800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd140103420 0x7fd140113f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53300/0 (socket says 172.21.15.81:53300) 2024-04-23T15:00:45.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.282+0000 7fd145800700 1 -- 172.21.15.81:0/3799769183 learned_addr learned my addr 172.21.15.81:0/3799769183 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:00:45.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.283+0000 7fd144e00700 1 --2- 172.21.15.81:0/3799769183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1401046d0 0x7fd140114490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:45.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.283+0000 7fd145800700 1 -- 172.21.15.81:0/3799769183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1401046d0 msgr2=0x7fd140114490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:45.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.283+0000 7fd145800700 1 --2- 172.21.15.81:0/3799769183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1401046d0 0x7fd140114490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:45.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.283+0000 7fd145800700 1 -- 172.21.15.81:0/3799769183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd12c005040 con 0x7fd140103420 2024-04-23T15:00:45.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.283+0000 7fd145800700 1 --2- 172.21.15.81:0/3799769183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd140103420 0x7fd140113f50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd13400c830 tx=0x7fd134004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:45.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.283+0000 7fd13d600700 1 -- 172.21.15.81:0/3799769183 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd13400a760 con 0x7fd140103420 2024-04-23T15:00:45.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.283+0000 7fd13d600700 1 -- 172.21.15.81:0/3799769183 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd13400ad90 con 0x7fd140103420 2024-04-23T15:00:45.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.283+0000 7fd148200700 1 -- 172.21.15.81:0/3799769183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd140119660 con 0x7fd140103420 2024-04-23T15:00:45.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.283+0000 7fd13d600700 1 -- 172.21.15.81:0/3799769183 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1340113a0 con 0x7fd140103420 2024-04-23T15:00:45.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.284+0000 7fd148200700 1 -- 172.21.15.81:0/3799769183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd140119c20 con 0x7fd140103420 2024-04-23T15:00:45.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.285+0000 7fd148200700 1 -- 172.21.15.81:0/3799769183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd14004c710 con 0x7fd140103420 2024-04-23T15:00:45.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.286+0000 7fd13d600700 1 -- 172.21.15.81:0/3799769183 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fd134012400 con 0x7fd140103420 2024-04-23T15:00:45.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.287+0000 7fd13d600700 1 --2- 172.21.15.81:0/3799769183 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fd12806ec00 0x7fd1280710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:45.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.287+0000 7fd13d600700 1 -- 172.21.15.81:0/3799769183 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fd13408e9f0 con 0x7fd140103420 2024-04-23T15:00:45.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.287+0000 7fd144e00700 1 --2- 172.21.15.81:0/3799769183 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fd12806ec00 0x7fd1280710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:45.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.288+0000 7fd144e00700 1 --2- 172.21.15.81:0/3799769183 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fd12806ec00 0x7fd1280710b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd12c004f90 tx=0x7fd12c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:45.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.292+0000 7fd13d600700 1 -- 172.21.15.81:0/3799769183 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fd13405b250 con 0x7fd140103420 2024-04-23T15:00:45.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.575+0000 7fd148200700 1 -- 172.21.15.81:0/3799769183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd14011a0c0 con 0x7fd140103420 2024-04-23T15:00:45.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.576+0000 7fd13d600700 1 -- 172.21.15.81:0/3799769183 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 36 v36) v1 ==== 76+0+1967 (secure 0 0 0) 0x7fd13405ade0 con 0x7fd140103420 2024-04-23T15:00:45.577 INFO:teuthology.orchestra.run.smithi081.stdout:e36 2024-04-23T15:00:45.577 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-23T15:00:45.577 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T15:00:45.577 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-04-23T15:00:45.578 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T15:00:45.578 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-04-23T15:00:45.578 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-04-23T15:00:45.578 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 36 2024-04-23T15:00:45.578 INFO:teuthology.orchestra.run.smithi081.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-23T15:00:45.578 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-04-23T14:45:51.264703+0000 2024-04-23T15:00:45.578 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-04-23T14:59:16.388200+0000 2024-04-23T15:00:45.578 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-04-23T15:00:45.578 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-04-23T15:00:45.578 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-04-23T15:00:45.578 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-04-23T15:00:45.578 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-04-23T15:00:45.578 INFO:teuthology.orchestra.run.smithi081.stdout:max_xattr_size 65536 2024-04-23T15:00:45.578 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-04-23T15:00:45.579 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-04-23T15:00:45.579 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 86 2024-04-23T15:00:45.579 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-23T15:00:45.579 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 1 2024-04-23T15:00:45.579 INFO:teuthology.orchestra.run.smithi081.stdout:in 0 2024-04-23T15:00:45.579 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=34430} 2024-04-23T15:00:45.579 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-04-23T15:00:45.579 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-04-23T15:00:45.579 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-04-23T15:00:45.579 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-04-23T15:00:45.579 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-04-23T15:00:45.579 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-04-23T15:00:45.579 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-04-23T15:00:45.580 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-04-23T15:00:45.580 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-04-23T15:00:45.580 INFO:teuthology.orchestra.run.smithi081.stdout:qdb_cluster leader: 34430 members: 34430 2024-04-23T15:00:45.580 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.wydgcg{0:34430} state up:active seq 24 join_fscid=1 addr [v2:172.21.15.81:6826/3200953351,v1:172.21.15.81:6827/3200953351] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T15:00:45.580 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.vcoywg{0:34462} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.81:6828/2598630159,v1:172.21.15.81:6829/2598630159] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T15:00:45.580 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T15:00:45.580 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T15:00:45.580 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-04-23T15:00:45.580 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T15:00:45.580 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.rhbtxt{-1:44273} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.156:6824/3017230919,v1:172.21.15.156:6825/3017230919] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T15:00:45.580 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.vynkxn{-1:44277} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.156:6826/4079938688,v1:172.21.15.156:6827/4079938688] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T15:00:45.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.579+0000 7fd148200700 1 -- 172.21.15.81:0/3799769183 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fd12806ec00 msgr2=0x7fd1280710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:45.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.579+0000 7fd148200700 1 --2- 172.21.15.81:0/3799769183 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fd12806ec00 0x7fd1280710b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd12c004f90 tx=0x7fd12c009e30 comp rx=0 tx=0).stop 2024-04-23T15:00:45.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.579+0000 7fd148200700 1 -- 172.21.15.81:0/3799769183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd140103420 msgr2=0x7fd140113f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:45.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.579+0000 7fd148200700 1 --2- 172.21.15.81:0/3799769183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd140103420 0x7fd140113f50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd13400c830 tx=0x7fd134004470 comp rx=0 tx=0).stop 2024-04-23T15:00:45.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.580+0000 7fd148200700 1 -- 172.21.15.81:0/3799769183 shutdown_connections 2024-04-23T15:00:45.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.580+0000 7fd148200700 1 --2- 172.21.15.81:0/3799769183 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fd12806ec00 0x7fd1280710b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:45.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.580+0000 7fd148200700 1 --2- 172.21.15.81:0/3799769183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd140103420 0x7fd140113f50 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:45.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.580+0000 7fd148200700 1 --2- 172.21.15.81:0/3799769183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1401046d0 0x7fd140114490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:45.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.580+0000 7fd148200700 1 -- 172.21.15.81:0/3799769183 >> 172.21.15.81:0/3799769183 conn(0x7fd140072640 msgr2=0x7fd140073d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:45.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.580+0000 7fd148200700 1 -- 172.21.15.81:0/3799769183 shutdown_connections 2024-04-23T15:00:45.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.580+0000 7fd148200700 1 -- 172.21.15.81:0/3799769183 wait complete. 2024-04-23T15:00:45.582 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 36 2024-04-23T15:00:45.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.729+0000 7f7e0cc00700 1 -- 172.21.15.81:0/9798736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e080fcc30 msgr2=0x7f7e080fd040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:45.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.729+0000 7f7e0cc00700 1 --2- 172.21.15.81:0/9798736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e080fcc30 0x7f7e080fd040 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7df8004940 tx=0x7f7df8009e30 comp rx=0 tx=0).stop 2024-04-23T15:00:45.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.729+0000 7f7e0cc00700 1 -- 172.21.15.81:0/9798736 shutdown_connections 2024-04-23T15:00:45.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.729+0000 7f7e0cc00700 1 --2- 172.21.15.81:0/9798736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e080fdee0 0x7f7e080fe350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:45.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.729+0000 7f7e0cc00700 1 --2- 172.21.15.81:0/9798736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e080fcc30 0x7f7e080fd040 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:45.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.729+0000 7f7e0cc00700 1 -- 172.21.15.81:0/9798736 >> 172.21.15.81:0/9798736 conn(0x7f7e080f8390 msgr2=0x7f7e080fa7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:45.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.729+0000 7f7e0cc00700 1 -- 172.21.15.81:0/9798736 shutdown_connections 2024-04-23T15:00:45.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.729+0000 7f7e0cc00700 1 -- 172.21.15.81:0/9798736 wait complete. 2024-04-23T15:00:45.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.730+0000 7f7e0cc00700 1 Processor -- start 2024-04-23T15:00:45.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.730+0000 7f7e0cc00700 1 -- start start 2024-04-23T15:00:45.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.731+0000 7f7e0cc00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e080fcc30 0x7f7e08071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:45.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.731+0000 7f7e0cc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e080fdee0 0x7f7e08070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:45.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.731+0000 7f7e0cc00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e080708c0 con 0x7f7e080fdee0 2024-04-23T15:00:45.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.731+0000 7f7e0cc00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e08070a30 con 0x7f7e080fcc30 2024-04-23T15:00:45.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.731+0000 7f7e06a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e080fdee0 0x7f7e08070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:45.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.731+0000 7f7e06a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e080fdee0 0x7f7e08070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53316/0 (socket says 172.21.15.81:53316) 2024-04-23T15:00:45.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.731+0000 7f7e06a00700 1 -- 172.21.15.81:0/583978484 learned_addr learned my addr 172.21.15.81:0/583978484 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:00:45.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.731+0000 7f7e07400700 1 --2- 172.21.15.81:0/583978484 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e080fcc30 0x7f7e08071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:45.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.731+0000 7f7e06a00700 1 -- 172.21.15.81:0/583978484 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e080fcc30 msgr2=0x7f7e08071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:45.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.731+0000 7f7e06a00700 1 --2- 172.21.15.81:0/583978484 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e080fcc30 0x7f7e08071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:45.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.731+0000 7f7e06a00700 1 -- 172.21.15.81:0/583978484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df8005040 con 0x7f7e080fdee0 2024-04-23T15:00:45.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.732+0000 7f7e06a00700 1 --2- 172.21.15.81:0/583978484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e080fdee0 0x7f7e08070310 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7df400c8c0 tx=0x7f7df40044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:45.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.732+0000 7f7dff400700 1 -- 172.21.15.81:0/583978484 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7df400a980 con 0x7f7e080fdee0 2024-04-23T15:00:45.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.732+0000 7f7dff400700 1 -- 172.21.15.81:0/583978484 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7df400ce60 con 0x7f7e080fdee0 2024-04-23T15:00:45.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.732+0000 7f7e0cc00700 1 -- 172.21.15.81:0/583978484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e08070d10 con 0x7f7e080fdee0 2024-04-23T15:00:45.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.732+0000 7f7dff400700 1 -- 172.21.15.81:0/583978484 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7df40115e0 con 0x7f7e080fdee0 2024-04-23T15:00:45.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.732+0000 7f7e0cc00700 1 -- 172.21.15.81:0/583978484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e08115890 con 0x7f7e080fdee0 2024-04-23T15:00:45.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.733+0000 7f7e0cc00700 1 -- 172.21.15.81:0/583978484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e0805f5f0 con 0x7f7e080fdee0 2024-04-23T15:00:45.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.734+0000 7f7dff400700 1 -- 172.21.15.81:0/583978484 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f7df4012400 con 0x7f7e080fdee0 2024-04-23T15:00:45.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.735+0000 7f7dff400700 1 --2- 172.21.15.81:0/583978484 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f7dec06ec10 0x7f7dec0710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:45.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.736+0000 7f7dff400700 1 -- 172.21.15.81:0/583978484 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f7df408e8d0 con 0x7f7e080fdee0 2024-04-23T15:00:45.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.736+0000 7f7e07400700 1 --2- 172.21.15.81:0/583978484 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f7dec06ec10 0x7f7dec0710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:45.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.736+0000 7f7e07400700 1 --2- 172.21.15.81:0/583978484 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f7dec06ec10 0x7f7dec0710c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7df800b970 tx=0x7f7df8009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:45.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.741+0000 7f7dff400700 1 -- 172.21.15.81:0/583978484 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f7df4057740 con 0x7f7e080fdee0 2024-04-23T15:00:45.897 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:45 smithi081 ceph-mon[90469]: from='client.34588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T15:00:45.897 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:45 smithi081 ceph-mon[90469]: from='client.34592 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T15:00:45.897 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:45 smithi081 ceph-mon[90469]: pgmap v288: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:00:45.897 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:45 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/2971825770' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:45.897 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:45 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/3799769183' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T15:00:45.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.990+0000 7f7e0cc00700 1 -- 172.21.15.81:0/583978484 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e08102200 con 0x7f7dec06ec10 2024-04-23T15:00:45.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.994+0000 7f7dff400700 1 -- 172.21.15.81:0/583978484 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7f7e08102200 con 0x7f7dec06ec10 2024-04-23T15:00:45.994 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T15:00:45.994 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd", 2024-04-23T15:00:45.994 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": true, 2024-04-23T15:00:45.994 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-23T15:00:45.994 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [ 2024-04-23T15:00:45.994 INFO:teuthology.orchestra.run.smithi081.stdout: "mon", 2024-04-23T15:00:45.994 INFO:teuthology.orchestra.run.smithi081.stdout: "mds", 2024-04-23T15:00:45.994 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr", 2024-04-23T15:00:45.994 INFO:teuthology.orchestra.run.smithi081.stdout: "osd", 2024-04-23T15:00:45.994 INFO:teuthology.orchestra.run.smithi081.stdout: "crash" 2024-04-23T15:00:45.994 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-04-23T15:00:45.995 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": "16/21 daemons upgraded", 2024-04-23T15:00:45.995 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "Currently upgrading grafana daemons", 2024-04-23T15:00:45.995 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-04-23T15:00:45.995 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T15:00:45.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.997+0000 7f7e0cc00700 1 -- 172.21.15.81:0/583978484 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f7dec06ec10 msgr2=0x7f7dec0710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:45.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.997+0000 7f7e0cc00700 1 --2- 172.21.15.81:0/583978484 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f7dec06ec10 0x7f7dec0710c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7df800b970 tx=0x7f7df8009e30 comp rx=0 tx=0).stop 2024-04-23T15:00:45.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.997+0000 7f7e0cc00700 1 -- 172.21.15.81:0/583978484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e080fdee0 msgr2=0x7f7e08070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:45.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.997+0000 7f7e0cc00700 1 --2- 172.21.15.81:0/583978484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e080fdee0 0x7f7e08070310 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7df400c8c0 tx=0x7f7df40044c0 comp rx=0 tx=0).stop 2024-04-23T15:00:45.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.997+0000 7f7e0cc00700 1 -- 172.21.15.81:0/583978484 shutdown_connections 2024-04-23T15:00:45.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.997+0000 7f7e0cc00700 1 --2- 172.21.15.81:0/583978484 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f7dec06ec10 0x7f7dec0710c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:45.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.997+0000 7f7e0cc00700 1 --2- 172.21.15.81:0/583978484 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e080fcc30 0x7f7e08071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:45.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.997+0000 7f7e0cc00700 1 --2- 172.21.15.81:0/583978484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e080fdee0 0x7f7e08070310 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:45.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.997+0000 7f7e0cc00700 1 -- 172.21.15.81:0/583978484 >> 172.21.15.81:0/583978484 conn(0x7f7e080f8390 msgr2=0x7f7e080f9ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:45.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.997+0000 7f7e0cc00700 1 -- 172.21.15.81:0/583978484 shutdown_connections 2024-04-23T15:00:45.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:45.997+0000 7f7e0cc00700 1 -- 172.21.15.81:0/583978484 wait complete. 2024-04-23T15:00:46.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:45 smithi156 ceph-mon[77738]: from='client.34588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T15:00:46.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:45 smithi156 ceph-mon[77738]: from='client.34592 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T15:00:46.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:45 smithi156 ceph-mon[77738]: pgmap v288: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:00:46.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:45 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/2971825770' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:00:46.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:45 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/3799769183' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T15:00:46.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.153+0000 7fa8cca00700 1 -- 172.21.15.81:0/2753829402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8c80fce40 msgr2=0x7fa8c80fd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:46.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.153+0000 7fa8cca00700 1 --2- 172.21.15.81:0/2753829402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8c80fce40 0x7fa8c80fd250 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8004940 tx=0x7fa8b8009e30 comp rx=0 tx=0).stop 2024-04-23T15:00:46.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.153+0000 7fa8cca00700 1 -- 172.21.15.81:0/2753829402 shutdown_connections 2024-04-23T15:00:46.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.153+0000 7fa8cca00700 1 --2- 172.21.15.81:0/2753829402 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa8c80fe040 0x7fa8c80fe4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:46.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.153+0000 7fa8cca00700 1 --2- 172.21.15.81:0/2753829402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8c80fce40 0x7fa8c80fd250 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:46.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.153+0000 7fa8cca00700 1 -- 172.21.15.81:0/2753829402 >> 172.21.15.81:0/2753829402 conn(0x7fa8c80f8530 msgr2=0x7fa8c80fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:46.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.154+0000 7fa8cca00700 1 -- 172.21.15.81:0/2753829402 shutdown_connections 2024-04-23T15:00:46.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.154+0000 7fa8cca00700 1 -- 172.21.15.81:0/2753829402 wait complete. 2024-04-23T15:00:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.154+0000 7fa8cca00700 1 Processor -- start 2024-04-23T15:00:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.155+0000 7fa8cca00700 1 -- start start 2024-04-23T15:00:46.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.155+0000 7fa8cca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8c80fce40 0x7fa8c810fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:46.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.155+0000 7fa8cca00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa8c80fe040 0x7fa8c8110170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:46.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.155+0000 7fa8cca00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c8110770 con 0x7fa8c80fce40 2024-04-23T15:00:46.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.155+0000 7fa8cca00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c8110fc0 con 0x7fa8c80fe040 2024-04-23T15:00:46.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.155+0000 7fa8c5e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8c80fce40 0x7fa8c810fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:46.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.155+0000 7fa8c5e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8c80fce40 0x7fa8c810fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53330/0 (socket says 172.21.15.81:53330) 2024-04-23T15:00:46.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.155+0000 7fa8c5e00700 1 -- 172.21.15.81:0/2164546524 learned_addr learned my addr 172.21.15.81:0/2164546524 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:00:46.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.156+0000 7fa8c5400700 1 --2- 172.21.15.81:0/2164546524 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa8c80fe040 0x7fa8c8110170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:46.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.156+0000 7fa8c5e00700 1 -- 172.21.15.81:0/2164546524 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa8c80fe040 msgr2=0x7fa8c8110170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:46.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.156+0000 7fa8c5e00700 1 --2- 172.21.15.81:0/2164546524 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa8c80fe040 0x7fa8c8110170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:46.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.156+0000 7fa8c5e00700 1 -- 172.21.15.81:0/2164546524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b8005040 con 0x7fa8c80fce40 2024-04-23T15:00:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.156+0000 7fa8c5e00700 1 --2- 172.21.15.81:0/2164546524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8c80fce40 0x7fa8c810fc30 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8000c00 tx=0x7fa8b8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.156+0000 7fa8be000700 1 -- 172.21.15.81:0/2164546524 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8b800e030 con 0x7fa8c80fce40 2024-04-23T15:00:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.156+0000 7fa8be000700 1 -- 172.21.15.81:0/2164546524 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa8b801c400 con 0x7fa8c80fce40 2024-04-23T15:00:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.156+0000 7fa8cca00700 1 -- 172.21.15.81:0/2164546524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8c8111240 con 0x7fa8c80fce40 2024-04-23T15:00:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.156+0000 7fa8be000700 1 -- 172.21.15.81:0/2164546524 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8b800b650 con 0x7fa8c80fce40 2024-04-23T15:00:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.157+0000 7fa8cca00700 1 -- 172.21.15.81:0/2164546524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c8111780 con 0x7fa8c80fce40 2024-04-23T15:00:46.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.158+0000 7fa8cca00700 1 -- 172.21.15.81:0/2164546524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8c81019d0 con 0x7fa8c80fce40 2024-04-23T15:00:46.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.159+0000 7fa8be000700 1 -- 172.21.15.81:0/2164546524 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fa8b801ca90 con 0x7fa8c80fce40 2024-04-23T15:00:46.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.160+0000 7fa8be000700 1 --2- 172.21.15.81:0/2164546524 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa8ac06ec00 0x7fa8ac0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:00:46.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.161+0000 7fa8be000700 1 -- 172.21.15.81:0/2164546524 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fa8b8090250 con 0x7fa8c80fce40 2024-04-23T15:00:46.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.161+0000 7fa8c5400700 1 --2- 172.21.15.81:0/2164546524 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa8ac06ec00 0x7fa8ac0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:00:46.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.161+0000 7fa8c5400700 1 --2- 172.21.15.81:0/2164546524 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa8ac06ec00 0x7fa8ac0710b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4004600 tx=0x7fa8b400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:00:46.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.165+0000 7fa8be000700 1 -- 172.21.15.81:0/2164546524 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fa8b805cb30 con 0x7fa8c80fce40 2024-04-23T15:00:46.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.470+0000 7fa8cca00700 1 -- 172.21.15.81:0/2164546524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa8c805f5f0 con 0x7fa8c80fce40 2024-04-23T15:00:46.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.471+0000 7fa8be000700 1 -- 172.21.15.81:0/2164546524 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fa8b805c6c0 con 0x7fa8c80fce40 2024-04-23T15:00:46.471 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-04-23T15:00:46.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.474+0000 7fa8cca00700 1 -- 172.21.15.81:0/2164546524 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa8ac06ec00 msgr2=0x7fa8ac0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:46.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.474+0000 7fa8cca00700 1 --2- 172.21.15.81:0/2164546524 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa8ac06ec00 0x7fa8ac0710b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4004600 tx=0x7fa8b400b040 comp rx=0 tx=0).stop 2024-04-23T15:00:46.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.474+0000 7fa8cca00700 1 -- 172.21.15.81:0/2164546524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8c80fce40 msgr2=0x7fa8c810fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:00:46.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.474+0000 7fa8cca00700 1 --2- 172.21.15.81:0/2164546524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8c80fce40 0x7fa8c810fc30 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8000c00 tx=0x7fa8b8009e30 comp rx=0 tx=0).stop 2024-04-23T15:00:46.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.474+0000 7fa8cca00700 1 -- 172.21.15.81:0/2164546524 shutdown_connections 2024-04-23T15:00:46.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.474+0000 7fa8cca00700 1 --2- 172.21.15.81:0/2164546524 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa8ac06ec00 0x7fa8ac0710b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:46.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.474+0000 7fa8cca00700 1 --2- 172.21.15.81:0/2164546524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8c80fce40 0x7fa8c810fc30 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:46.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.474+0000 7fa8cca00700 1 --2- 172.21.15.81:0/2164546524 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa8c80fe040 0x7fa8c8110170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:00:46.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.474+0000 7fa8cca00700 1 -- 172.21.15.81:0/2164546524 >> 172.21.15.81:0/2164546524 conn(0x7fa8c80f8530 msgr2=0x7fa8c80f9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:00:46.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.474+0000 7fa8cca00700 1 -- 172.21.15.81:0/2164546524 shutdown_connections 2024-04-23T15:00:46.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:00:46.474+0000 7fa8cca00700 1 -- 172.21.15.81:0/2164546524 wait complete. 2024-04-23T15:00:47.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:46 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/2164546524' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T15:00:47.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:46 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/2164546524' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T15:00:48.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:47 smithi156 ceph-mon[77738]: from='client.34604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T15:00:48.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:47 smithi156 ceph-mon[77738]: pgmap v289: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-23T15:00:48.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:47 smithi081 ceph-mon[90469]: from='client.34604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T15:00:48.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:47 smithi081 ceph-mon[90469]: pgmap v289: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-23T15:00:49.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:49 smithi081 ceph-mon[90469]: pgmap v290: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:00:50.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:49 smithi156 ceph-mon[77738]: pgmap v290: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:00:51.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:51 smithi081 ceph-mon[90469]: pgmap v291: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:00:51.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:51 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:51.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:51 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:51.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:51 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:00:52.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:51 smithi156 ceph-mon[77738]: pgmap v291: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:00:52.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:51 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:52.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:51 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:52.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:51 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:00:53.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:53 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:53.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:53 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:53.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:53 smithi156 ceph-mon[77738]: pgmap v292: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:00:53.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:53 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:53.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:53 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:53.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:53 smithi081 ceph-mon[90469]: pgmap v292: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:00:56.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:55 smithi156 ceph-mon[77738]: pgmap v293: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:00:56.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:55 smithi081 ceph-mon[90469]: pgmap v293: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:00:56.995 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:56 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T15:00:57.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:56 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T15:00:58.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:57 smithi156 ceph-mon[77738]: pgmap v294: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T15:00:58.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:57 smithi081 ceph-mon[90469]: pgmap v294: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T15:00:59.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:58 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:59.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:58 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:59.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:00:58 smithi156 ceph-mon[77738]: pgmap v295: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:00:59.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:58 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:59.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:58 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:00:59.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:00:58 smithi081 ceph-mon[90469]: pgmap v295: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:01:01.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:00 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:01:01.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:00 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:01:01.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:00 smithi156 ceph-mon[77738]: pgmap v296: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:01:01.300 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:00 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:01:01.300 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:00 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:01:01.300 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:00 smithi081 ceph-mon[90469]: pgmap v296: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:01:04.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:03 smithi156 ceph-mon[77738]: pgmap v297: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:01:04.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:03 smithi081 ceph-mon[90469]: pgmap v297: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:01:06.035 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:05 smithi156 ceph-mon[77738]: pgmap v298: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:01:06.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:05 smithi081 ceph-mon[90469]: pgmap v298: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:01:07.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:01:07.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:01:07.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:01:07.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:01:07.037 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:01:07.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-23T15:01:07.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:01:07.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:01:07.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:01:07.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:01:07.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:01:07.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:01:07.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:01:07.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:01:07.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:01:07.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:01:07.038 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:01:07.039 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:01:07.039 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:01:07.039 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:01:07.039 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:01:07.039 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:01:07.039 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:01:07.039 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:01:07.039 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:01:07.039 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:01:07.040 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-04-23T15:01:07.040 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-04-23T15:01:07.040 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-23T15:01:07.040 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-04-23T15:01:07.040 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-04-23T15:01:07.040 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-04-23T15:01:07.040 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-04-23T15:01:07.040 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-04-23T15:01:07.040 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-04-23T15:01:07.040 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-04-23T15:01:07.041 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-04-23T15:01:07.041 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-04-23T15:01:07.041 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-04-23T15:01:07.041 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-04-23T15:01:07.041 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-23T15:01:07.041 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-04-23T15:01:07.041 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-04-23T15:01:07.041 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-04-23T15:01:07.041 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-04-23T15:01:07.041 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-04-23T15:01:07.041 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-04-23T15:01:07.041 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-04-23T15:01:07.042 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-04-23T15:01:07.042 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-23T15:01:07.042 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-23T15:01:07.042 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-23T15:01:07.042 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-23T15:01:07.042 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-23T15:01:07.042 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-23T15:01:07.042 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-04-23T15:01:07.042 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-04-23T15:01:07.042 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:01:07.042 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:01:07.043 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:01:07.043 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:01:07.043 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:01:07.043 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:01:07.043 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:01:07.043 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:06 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:01:07.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:01:07.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:01:07.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:01:07.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:01:07.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:01:07.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-23T15:01:07.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:01:07.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:01:07.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:01:07.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:01:07.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:01:07.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:01:07.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:01:07.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:01:07.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:01:07.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:01:07.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:01:07.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:01:07.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:01:07.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:01:07.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:01:07.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:01:07.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:01:07.078 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:01:07.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:01:07.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:01:07.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-04-23T15:01:07.079 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-04-23T15:01:07.080 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-23T15:01:07.080 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-04-23T15:01:07.080 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-04-23T15:01:07.080 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-04-23T15:01:07.080 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-04-23T15:01:07.080 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-04-23T15:01:07.080 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-04-23T15:01:07.080 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-04-23T15:01:07.080 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-04-23T15:01:07.080 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-04-23T15:01:07.081 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-04-23T15:01:07.081 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-04-23T15:01:07.081 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-23T15:01:07.081 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-04-23T15:01:07.081 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-04-23T15:01:07.081 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-04-23T15:01:07.081 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-04-23T15:01:07.081 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-04-23T15:01:07.081 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-04-23T15:01:07.081 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-04-23T15:01:07.081 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-04-23T15:01:07.081 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-23T15:01:07.081 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-23T15:01:07.081 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-23T15:01:07.081 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-23T15:01:07.081 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-23T15:01:07.082 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-23T15:01:07.082 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-04-23T15:01:07.082 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-04-23T15:01:07.082 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:01:07.082 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:01:07.082 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:01:07.082 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:01:07.082 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:01:07.082 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:01:07.082 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:01:07.082 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:06 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:01:07.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:07 smithi081 ceph-mon[90469]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-23T15:01:07.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:07 smithi081 ceph-mon[90469]: Upgrade: Finalizing container_image settings 2024-04-23T15:01:07.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:07 smithi081 ceph-mon[90469]: Upgrade: Complete! 2024-04-23T15:01:07.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:07 smithi081 ceph-mon[90469]: pgmap v299: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T15:01:07.827 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:07 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:01:08.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:07 smithi156 ceph-mon[77738]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-23T15:01:08.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:07 smithi156 ceph-mon[77738]: Upgrade: Finalizing container_image settings 2024-04-23T15:01:08.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:07 smithi156 ceph-mon[77738]: Upgrade: Complete! 2024-04-23T15:01:08.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:07 smithi156 ceph-mon[77738]: pgmap v299: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T15:01:08.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:07 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:01:10.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:09 smithi156 ceph-mon[77738]: pgmap v300: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:01:10.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:09 smithi081 ceph-mon[90469]: pgmap v300: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:01:12.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:11 smithi156 ceph-mon[77738]: pgmap v301: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:01:12.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:11 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T15:01:12.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:11 smithi081 ceph-mon[90469]: pgmap v301: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:01:12.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:11 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T15:01:14.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:13 smithi156 ceph-mon[77738]: pgmap v302: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:01:14.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:13 smithi081 ceph-mon[90469]: pgmap v302: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:01:16.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:15 smithi156 ceph-mon[77738]: pgmap v303: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:01:16.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:15 smithi081 ceph-mon[90469]: pgmap v303: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:01:16.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.639+0000 7f4b67e00700 1 -- 172.21.15.81:0/2529658292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b68066b80 msgr2=0x7f4b680ff800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:16.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.639+0000 7f4b67e00700 1 --2- 172.21.15.81:0/2529658292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b68066b80 0x7f4b680ff800 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4b58004940 tx=0x7f4b58009e30 comp rx=0 tx=0).stop 2024-04-23T15:01:16.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.639+0000 7f4b67e00700 1 -- 172.21.15.81:0/2529658292 shutdown_connections 2024-04-23T15:01:16.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.639+0000 7f4b67e00700 1 --2- 172.21.15.81:0/2529658292 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b680ffd40 0x7f4b68102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:16.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.639+0000 7f4b67e00700 1 --2- 172.21.15.81:0/2529658292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b68066b80 0x7f4b680ff800 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:16.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.639+0000 7f4b67e00700 1 -- 172.21.15.81:0/2529658292 >> 172.21.15.81:0/2529658292 conn(0x7f4b680f7270 msgr2=0x7f4b680f96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:01:16.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.640+0000 7f4b67e00700 1 -- 172.21.15.81:0/2529658292 shutdown_connections 2024-04-23T15:01:16.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.640+0000 7f4b67e00700 1 -- 172.21.15.81:0/2529658292 wait complete. 2024-04-23T15:01:16.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.641+0000 7f4b67e00700 1 Processor -- start 2024-04-23T15:01:16.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.641+0000 7f4b67e00700 1 -- start start 2024-04-23T15:01:16.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.641+0000 7f4b67e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b68066b80 0x7f4b680fd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:16.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.641+0000 7f4b67e00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b680ffd40 0x7f4b680fb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:16.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.641+0000 7f4b67e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b680fbd20 con 0x7f4b68066b80 2024-04-23T15:01:16.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.641+0000 7f4b67e00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b680fbe60 con 0x7f4b680ffd40 2024-04-23T15:01:16.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.642+0000 7f4b66a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b68066b80 0x7f4b680fd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:16.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.642+0000 7f4b66a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b68066b80 0x7f4b680fd1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38586/0 (socket says 172.21.15.81:38586) 2024-04-23T15:01:16.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.642+0000 7f4b66a00700 1 -- 172.21.15.81:0/1080573996 learned_addr learned my addr 172.21.15.81:0/1080573996 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:01:16.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.642+0000 7f4b66a00700 1 -- 172.21.15.81:0/1080573996 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b680ffd40 msgr2=0x7f4b680fb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:16.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.642+0000 7f4b66000700 1 --2- 172.21.15.81:0/1080573996 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b680ffd40 0x7f4b680fb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:16.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.642+0000 7f4b66a00700 1 --2- 172.21.15.81:0/1080573996 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b680ffd40 0x7f4b680fb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:16.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.642+0000 7f4b66a00700 1 -- 172.21.15.81:0/1080573996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b58005040 con 0x7f4b68066b80 2024-04-23T15:01:16.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.643+0000 7f4b66a00700 1 --2- 172.21.15.81:0/1080573996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b68066b80 0x7f4b680fd1e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4b5800b3b0 tx=0x7f4b58009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:01:16.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.643+0000 7f4b5ea00700 1 -- 172.21.15.81:0/1080573996 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b5800e040 con 0x7f4b68066b80 2024-04-23T15:01:16.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.643+0000 7f4b5ea00700 1 -- 172.21.15.81:0/1080573996 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4b5800bcc0 con 0x7f4b68066b80 2024-04-23T15:01:16.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.643+0000 7f4b5ea00700 1 -- 172.21.15.81:0/1080573996 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b5801c630 con 0x7f4b68066b80 2024-04-23T15:01:16.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.643+0000 7f4b67e00700 1 -- 172.21.15.81:0/1080573996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b680fc0e0 con 0x7f4b68066b80 2024-04-23T15:01:16.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.643+0000 7f4b67e00700 1 -- 172.21.15.81:0/1080573996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b681158d0 con 0x7f4b68066b80 2024-04-23T15:01:16.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.644+0000 7f4b67e00700 1 -- 172.21.15.81:0/1080573996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b680faf10 con 0x7f4b68066b80 2024-04-23T15:01:16.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.645+0000 7f4b5ea00700 1 -- 172.21.15.81:0/1080573996 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f4b580139f0 con 0x7f4b68066b80 2024-04-23T15:01:16.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.647+0000 7f4b5ea00700 1 --2- 172.21.15.81:0/1080573996 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f4b4c06ec00 0x7f4b4c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:16.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.647+0000 7f4b5ea00700 1 -- 172.21.15.81:0/1080573996 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f4b5808f490 con 0x7f4b68066b80 2024-04-23T15:01:16.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.647+0000 7f4b66000700 1 --2- 172.21.15.81:0/1080573996 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f4b4c06ec00 0x7f4b4c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:16.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.648+0000 7f4b66000700 1 --2- 172.21.15.81:0/1080573996 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f4b4c06ec00 0x7f4b4c0710b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4b54006fd0 tx=0x7f4b54008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:01:16.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.652+0000 7f4b5ea00700 1 -- 172.21.15.81:0/1080573996 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f4b58058300 con 0x7f4b68066b80 2024-04-23T15:01:16.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.917+0000 7f4b67e00700 1 -- 172.21.15.81:0/1080573996 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b680f8db0 con 0x7f4b4c06ec00 2024-04-23T15:01:16.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.918+0000 7f4b5ea00700 1 -- 172.21.15.81:0/1080573996 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f4b680f8db0 con 0x7f4b4c06ec00 2024-04-23T15:01:16.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.921+0000 7f4b67e00700 1 -- 172.21.15.81:0/1080573996 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f4b4c06ec00 msgr2=0x7f4b4c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:16.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.921+0000 7f4b67e00700 1 --2- 172.21.15.81:0/1080573996 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f4b4c06ec00 0x7f4b4c0710b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4b54006fd0 tx=0x7f4b54008040 comp rx=0 tx=0).stop 2024-04-23T15:01:16.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.921+0000 7f4b67e00700 1 -- 172.21.15.81:0/1080573996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b68066b80 msgr2=0x7f4b680fd1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:16.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.921+0000 7f4b67e00700 1 --2- 172.21.15.81:0/1080573996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b68066b80 0x7f4b680fd1e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4b5800b3b0 tx=0x7f4b58009e30 comp rx=0 tx=0).stop 2024-04-23T15:01:16.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.921+0000 7f4b67e00700 1 -- 172.21.15.81:0/1080573996 shutdown_connections 2024-04-23T15:01:16.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.921+0000 7f4b67e00700 1 --2- 172.21.15.81:0/1080573996 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f4b4c06ec00 0x7f4b4c0710b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:16.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.921+0000 7f4b67e00700 1 --2- 172.21.15.81:0/1080573996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b68066b80 0x7f4b680fd1e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:16.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.921+0000 7f4b67e00700 1 --2- 172.21.15.81:0/1080573996 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b680ffd40 0x7f4b680fb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:16.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.921+0000 7f4b67e00700 1 -- 172.21.15.81:0/1080573996 >> 172.21.15.81:0/1080573996 conn(0x7f4b680f7270 msgr2=0x7f4b680f7690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:01:16.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.922+0000 7f4b67e00700 1 -- 172.21.15.81:0/1080573996 shutdown_connections 2024-04-23T15:01:16.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:16.922+0000 7f4b67e00700 1 -- 172.21.15.81:0/1080573996 wait complete. 2024-04-23T15:01:17.940 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -e sha1=d44fddd910b5e94da0f2357af4be37d7bd495ae0 -- bash -c 'ceph orch ps' 2024-04-23T15:01:18.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:17 smithi156 ceph-mon[77738]: pgmap v304: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T15:01:18.057 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:17 smithi081 ceph-mon[90469]: pgmap v304: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T15:01:18.460 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T15:01:19.065 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:18 smithi081 ceph-mon[90469]: from='client.34612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T15:01:19.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:18 smithi156 ceph-mon[77738]: from='client.34612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T15:01:20.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:19 smithi081 ceph-mon[90469]: pgmap v305: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:01:20.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:19 smithi156 ceph-mon[77738]: pgmap v305: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:01:20.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.699+0000 7fa2dac00700 1 -- 172.21.15.81:0/945907183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2d4102e20 msgr2=0x7fa2d41031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:20.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.699+0000 7fa2dac00700 1 --2- 172.21.15.81:0/945907183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2d4102e20 0x7fa2d41031f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4004940 tx=0x7fa2c4009e30 comp rx=0 tx=0).stop 2024-04-23T15:01:20.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.699+0000 7fa2dac00700 1 -- 172.21.15.81:0/945907183 shutdown_connections 2024-04-23T15:01:20.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.700+0000 7fa2dac00700 1 --2- 172.21.15.81:0/945907183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2d41037c0 0x7fa2d40fce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:20.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.700+0000 7fa2dac00700 1 --2- 172.21.15.81:0/945907183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2d4102e20 0x7fa2d41031f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:20.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.700+0000 7fa2dac00700 1 -- 172.21.15.81:0/945907183 >> 172.21.15.81:0/945907183 conn(0x7fa2d40f89d0 msgr2=0x7fa2d40fade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:01:20.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.700+0000 7fa2dac00700 1 -- 172.21.15.81:0/945907183 shutdown_connections 2024-04-23T15:01:20.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.700+0000 7fa2dac00700 1 -- 172.21.15.81:0/945907183 wait complete. 2024-04-23T15:01:20.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.701+0000 7fa2dac00700 1 Processor -- start 2024-04-23T15:01:20.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.701+0000 7fa2dac00700 1 -- start start 2024-04-23T15:01:20.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.701+0000 7fa2dac00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2d4102e20 0x7fa2d4113ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:20.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.701+0000 7fa2dac00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2d41037c0 0x7fa2d41140e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:20.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.701+0000 7fa2dac00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d41147c0 con 0x7fa2d4102e20 2024-04-23T15:01:20.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.701+0000 7fa2dac00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d410db40 con 0x7fa2d41037c0 2024-04-23T15:01:20.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.701+0000 7fa2d3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2d4102e20 0x7fa2d4113ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:20.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.702+0000 7fa2d3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2d4102e20 0x7fa2d4113ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38592/0 (socket says 172.21.15.81:38592) 2024-04-23T15:01:20.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.702+0000 7fa2d3e00700 1 -- 172.21.15.81:0/2145947437 learned_addr learned my addr 172.21.15.81:0/2145947437 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:01:20.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.702+0000 7fa2cb400700 1 --2- 172.21.15.81:0/2145947437 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2d41037c0 0x7fa2d41140e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:20.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.702+0000 7fa2d3e00700 1 -- 172.21.15.81:0/2145947437 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2d41037c0 msgr2=0x7fa2d41140e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:20.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.702+0000 7fa2d3e00700 1 --2- 172.21.15.81:0/2145947437 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2d41037c0 0x7fa2d41140e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:20.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.702+0000 7fa2d3e00700 1 -- 172.21.15.81:0/2145947437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c4005040 con 0x7fa2d4102e20 2024-04-23T15:01:20.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.702+0000 7fa2cb400700 1 --2- 172.21.15.81:0/2145947437 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2d41037c0 0x7fa2d41140e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:01:20.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.702+0000 7fa2d3e00700 1 --2- 172.21.15.81:0/2145947437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2d4102e20 0x7fa2d4113ba0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4009150 tx=0x7fa2c4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:01:20.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.702+0000 7fa2d0c00700 1 -- 172.21.15.81:0/2145947437 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2c400e040 con 0x7fa2d4102e20 2024-04-23T15:01:20.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.703+0000 7fa2d0c00700 1 -- 172.21.15.81:0/2145947437 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa2c4013420 con 0x7fa2d4102e20 2024-04-23T15:01:20.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.703+0000 7fa2d0c00700 1 -- 172.21.15.81:0/2145947437 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2c401c630 con 0x7fa2d4102e20 2024-04-23T15:01:20.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.703+0000 7fa2dac00700 1 -- 172.21.15.81:0/2145947437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d410ddc0 con 0x7fa2d4102e20 2024-04-23T15:01:20.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.703+0000 7fa2dac00700 1 -- 172.21.15.81:0/2145947437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d410e380 con 0x7fa2d4102e20 2024-04-23T15:01:20.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.704+0000 7fa2dac00700 1 -- 172.21.15.81:0/2145947437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d40fe570 con 0x7fa2d4102e20 2024-04-23T15:01:20.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.705+0000 7fa2d0c00700 1 -- 172.21.15.81:0/2145947437 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fa2c4013590 con 0x7fa2d4102e20 2024-04-23T15:01:20.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.706+0000 7fa2d0c00700 1 --2- 172.21.15.81:0/2145947437 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa2b406ec10 0x7fa2b40710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:20.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.706+0000 7fa2d0c00700 1 -- 172.21.15.81:0/2145947437 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fa2c408fb90 con 0x7fa2d4102e20 2024-04-23T15:01:20.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.706+0000 7fa2cb400700 1 --2- 172.21.15.81:0/2145947437 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa2b406ec10 0x7fa2b40710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:20.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.707+0000 7fa2cb400700 1 --2- 172.21.15.81:0/2145947437 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa2b406ec10 0x7fa2b40710c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc006fd0 tx=0x7fa2bc008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:01:20.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.711+0000 7fa2d0c00700 1 -- 172.21.15.81:0/2145947437 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fa2c4058960 con 0x7fa2d4102e20 2024-04-23T15:01:20.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.947+0000 7fa2dac00700 1 -- 172.21.15.81:0/2145947437 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2d404bed0 con 0x7fa2b406ec10 2024-04-23T15:01:20.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.980+0000 7fa2d0c00700 1 -- 172.21.15.81:0/2145947437 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fa2d404bed0 con 0x7fa2b406ec10 2024-04-23T15:01:20.981 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-23T15:01:20.982 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (63s) 23s ago 22m 13.8M - 0.25.0 c8568f914cd2 cb978e6344d1 2024-04-23T15:01:20.982 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (7m) 23s ago 22m 6665k - 19.0.0-3126-gd44fddd9 76e77f280c74 b486fe2ef19b 2024-04-23T15:01:20.982 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi156 smithi156 running (7m) 108s ago 21m 6656k - 19.0.0-3126-gd44fddd9 76e77f280c74 5d9aa5ecf264 2024-04-23T15:01:20.982 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (30s) 23s ago 22m 50.9M - 9.4.12 2bacad6d85d8 192d202029bc 2024-04-23T15:01:20.982 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.vcoywg smithi081 running (3m) 23s ago 15m 84.7M - 19.0.0-3126-gd44fddd9 76e77f280c74 87ab7708542f 2024-04-23T15:01:20.982 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.wydgcg smithi081 running (3m) 23s ago 15m 85.3M - 19.0.0-3126-gd44fddd9 76e77f280c74 e2a96404cc4f 2024-04-23T15:01:20.982 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.rhbtxt smithi156 running (2m) 108s ago 15m 11.3M - 19.0.0-3126-gd44fddd9 76e77f280c74 208d4416e1bf 2024-04-23T15:01:20.982 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.vynkxn smithi156 running (2m) 108s ago 15m 11.1M - 19.0.0-3126-gd44fddd9 76e77f280c74 34368f26f4d2 2024-04-23T15:01:20.982 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.ldghvq smithi081 *:8443,9283,8765 running (10m) 23s ago 24m 523M - 19.0.0-3126-gd44fddd9 76e77f280c74 6bf23484a1c9 2024-04-23T15:01:20.982 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi156.ounwyj smithi156 *:8443,9283,8765 running (9m) 108s ago 21m 453M - 19.0.0-3126-gd44fddd9 76e77f280c74 a6c0dd9f89f2 2024-04-23T15:01:20.982 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (9m) 23s ago 24m 56.8M 2048M 19.0.0-3126-gd44fddd9 76e77f280c74 fbf9f9a59ac2 2024-04-23T15:01:20.982 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi156 smithi156 running (8m) 108s ago 21m 40.6M 2048M 19.0.0-3126-gd44fddd9 76e77f280c74 36409886998f 2024-04-23T15:01:20.982 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (118s) 23s ago 22m 7830k - 1.5.0 0da6a335fe13 a822ef7cd112 2024-04-23T15:01:20.982 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi156 smithi156 *:9100 running (112s) 108s ago 21m 2839k - 1.5.0 0da6a335fe13 b74c35e7cf10 2024-04-23T15:01:20.983 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (6m) 23s ago 20m 110M 1557M 19.0.0-3126-gd44fddd9 76e77f280c74 24bc24b37de5 2024-04-23T15:01:20.983 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (6m) 23s ago 19m 121M 1557M 19.0.0-3126-gd44fddd9 76e77f280c74 18d0179b558a 2024-04-23T15:01:20.983 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (5m) 23s ago 18m 98.1M 1557M 19.0.0-3126-gd44fddd9 76e77f280c74 421a62ef6990 2024-04-23T15:01:20.983 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi156 running (5m) 108s ago 18m 126M 2581M 19.0.0-3126-gd44fddd9 76e77f280c74 9af3ca1ff69b 2024-04-23T15:01:20.983 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi156 running (4m) 108s ago 17m 110M 2581M 19.0.0-3126-gd44fddd9 76e77f280c74 e0a1e784348c 2024-04-23T15:01:20.983 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi156 running (4m) 108s ago 17m 107M 2581M 19.0.0-3126-gd44fddd9 76e77f280c74 16b6ba5d9e3e 2024-04-23T15:01:20.983 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (88s) 23s ago 21m 50.1M - 2.43.0 a07b618ecd1d 03f612614f9d 2024-04-23T15:01:20.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.983+0000 7fa2dac00700 1 -- 172.21.15.81:0/2145947437 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa2b406ec10 msgr2=0x7fa2b40710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:20.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.983+0000 7fa2dac00700 1 --2- 172.21.15.81:0/2145947437 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa2b406ec10 0x7fa2b40710c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc006fd0 tx=0x7fa2bc008040 comp rx=0 tx=0).stop 2024-04-23T15:01:20.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.983+0000 7fa2dac00700 1 -- 172.21.15.81:0/2145947437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2d4102e20 msgr2=0x7fa2d4113ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:20.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.983+0000 7fa2dac00700 1 --2- 172.21.15.81:0/2145947437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2d4102e20 0x7fa2d4113ba0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4009150 tx=0x7fa2c4009e30 comp rx=0 tx=0).stop 2024-04-23T15:01:20.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.983+0000 7fa2dac00700 1 -- 172.21.15.81:0/2145947437 shutdown_connections 2024-04-23T15:01:20.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.983+0000 7fa2dac00700 1 --2- 172.21.15.81:0/2145947437 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa2b406ec10 0x7fa2b40710c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:20.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.983+0000 7fa2dac00700 1 --2- 172.21.15.81:0/2145947437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2d4102e20 0x7fa2d4113ba0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:20.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.983+0000 7fa2dac00700 1 --2- 172.21.15.81:0/2145947437 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2d41037c0 0x7fa2d41140e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:20.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.983+0000 7fa2dac00700 1 -- 172.21.15.81:0/2145947437 >> 172.21.15.81:0/2145947437 conn(0x7fa2d40f89d0 msgr2=0x7fa2d40f9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:01:20.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.984+0000 7fa2dac00700 1 -- 172.21.15.81:0/2145947437 shutdown_connections 2024-04-23T15:01:20.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:20.984+0000 7fa2dac00700 1 -- 172.21.15.81:0/2145947437 wait complete. 2024-04-23T15:01:21.719 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -e sha1=d44fddd910b5e94da0f2357af4be37d7bd495ae0 -- bash -c 'ceph orch upgrade status' 2024-04-23T15:01:22.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:21 smithi081 ceph-mon[90469]: pgmap v306: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:01:22.196 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T15:01:22.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:21 smithi156 ceph-mon[77738]: pgmap v306: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:01:23.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:22 smithi081 ceph-mon[90469]: from='client.34616 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T15:01:23.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:22 smithi081 ceph-mon[90469]: pgmap v307: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-04-23T15:01:23.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:22 smithi156 ceph-mon[77738]: from='client.34616 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T15:01:23.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:22 smithi156 ceph-mon[77738]: pgmap v307: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-04-23T15:01:24.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.405+0000 7f3595a00700 1 -- 172.21.15.81:0/2865153698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3590102e20 msgr2=0x7f35901031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:24.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.405+0000 7f3595a00700 1 --2- 172.21.15.81:0/2865153698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3590102e20 0x7f35901031f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3580004940 tx=0x7f3580009e30 comp rx=0 tx=0).stop 2024-04-23T15:01:24.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.405+0000 7f3595a00700 1 -- 172.21.15.81:0/2865153698 shutdown_connections 2024-04-23T15:01:24.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.405+0000 7f3595a00700 1 --2- 172.21.15.81:0/2865153698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35901037c0 0x7f35900fce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:24.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.405+0000 7f3595a00700 1 --2- 172.21.15.81:0/2865153698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3590102e20 0x7f35901031f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:24.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.405+0000 7f3595a00700 1 -- 172.21.15.81:0/2865153698 >> 172.21.15.81:0/2865153698 conn(0x7f35900f89d0 msgr2=0x7f35900fade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:01:24.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.405+0000 7f3595a00700 1 -- 172.21.15.81:0/2865153698 shutdown_connections 2024-04-23T15:01:24.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.405+0000 7f3595a00700 1 -- 172.21.15.81:0/2865153698 wait complete. 2024-04-23T15:01:24.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.406+0000 7f3595a00700 1 Processor -- start 2024-04-23T15:01:24.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.406+0000 7f3595a00700 1 -- start start 2024-04-23T15:01:24.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.407+0000 7f3595a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3590102e20 0x7f3590113b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:24.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.407+0000 7f3595a00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35901037c0 0x7f35901140c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:24.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.407+0000 7f3595a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35901147a0 con 0x7f3590102e20 2024-04-23T15:01:24.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.407+0000 7f3595a00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359010db20 con 0x7f35901037c0 2024-04-23T15:01:24.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.407+0000 7f358ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3590102e20 0x7f3590113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:24.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.407+0000 7f358ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3590102e20 0x7f3590113b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36476/0 (socket says 172.21.15.81:36476) 2024-04-23T15:01:24.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.407+0000 7f358ea00700 1 -- 172.21.15.81:0/1201576610 learned_addr learned my addr 172.21.15.81:0/1201576610 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:01:24.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.407+0000 7f3586000700 1 --2- 172.21.15.81:0/1201576610 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35901037c0 0x7f35901140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:24.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.408+0000 7f358ea00700 1 -- 172.21.15.81:0/1201576610 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35901037c0 msgr2=0x7f35901140c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:24.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.408+0000 7f358ea00700 1 --2- 172.21.15.81:0/1201576610 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35901037c0 0x7f35901140c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:24.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.408+0000 7f358ea00700 1 -- 172.21.15.81:0/1201576610 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3580005040 con 0x7f3590102e20 2024-04-23T15:01:24.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.408+0000 7f3586000700 1 --2- 172.21.15.81:0/1201576610 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35901037c0 0x7f35901140c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:01:24.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.408+0000 7f358ea00700 1 --2- 172.21.15.81:0/1201576610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3590102e20 0x7f3590113b80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3580009180 tx=0x7f3580009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:01:24.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.408+0000 7f3587400700 1 -- 172.21.15.81:0/1201576610 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f358000e040 con 0x7f3590102e20 2024-04-23T15:01:24.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.408+0000 7f3587400700 1 -- 172.21.15.81:0/1201576610 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f358000bbc0 con 0x7f3590102e20 2024-04-23T15:01:24.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.408+0000 7f3587400700 1 -- 172.21.15.81:0/1201576610 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f358001c630 con 0x7f3590102e20 2024-04-23T15:01:24.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.408+0000 7f3595a00700 1 -- 172.21.15.81:0/1201576610 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f359010dda0 con 0x7f3590102e20 2024-04-23T15:01:24.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.408+0000 7f3595a00700 1 -- 172.21.15.81:0/1201576610 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f359010e360 con 0x7f3590102e20 2024-04-23T15:01:24.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.409+0000 7f3595a00700 1 -- 172.21.15.81:0/1201576610 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35900fe570 con 0x7f3590102e20 2024-04-23T15:01:24.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.411+0000 7f3587400700 1 -- 172.21.15.81:0/1201576610 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f358000bd30 con 0x7f3590102e20 2024-04-23T15:01:24.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.411+0000 7f3587400700 1 --2- 172.21.15.81:0/1201576610 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f357406ec10 0x7f35740710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:24.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.412+0000 7f3587400700 1 -- 172.21.15.81:0/1201576610 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f358008fcc0 con 0x7f3590102e20 2024-04-23T15:01:24.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.412+0000 7f3586000700 1 --2- 172.21.15.81:0/1201576610 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f357406ec10 0x7f35740710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:24.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.413+0000 7f3586000700 1 --2- 172.21.15.81:0/1201576610 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f357406ec10 0x7f35740710c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3578006fd0 tx=0x7f3578008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:01:24.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.417+0000 7f3587400700 1 -- 172.21.15.81:0/1201576610 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f3580095020 con 0x7f3590102e20 2024-04-23T15:01:24.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.663+0000 7f3595a00700 1 -- 172.21.15.81:0/1201576610 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f359004bf40 con 0x7f357406ec10 2024-04-23T15:01:24.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.665+0000 7f3587400700 1 -- 172.21.15.81:0/1201576610 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f359004bf40 con 0x7f357406ec10 2024-04-23T15:01:24.667 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T15:01:24.667 INFO:teuthology.orchestra.run.smithi081.stdout: "target_image": null, 2024-04-23T15:01:24.667 INFO:teuthology.orchestra.run.smithi081.stdout: "in_progress": false, 2024-04-23T15:01:24.667 INFO:teuthology.orchestra.run.smithi081.stdout: "which": "", 2024-04-23T15:01:24.667 INFO:teuthology.orchestra.run.smithi081.stdout: "services_complete": [], 2024-04-23T15:01:24.667 INFO:teuthology.orchestra.run.smithi081.stdout: "progress": null, 2024-04-23T15:01:24.667 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "", 2024-04-23T15:01:24.667 INFO:teuthology.orchestra.run.smithi081.stdout: "is_paused": false 2024-04-23T15:01:24.667 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T15:01:24.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.668+0000 7f3595a00700 1 -- 172.21.15.81:0/1201576610 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f357406ec10 msgr2=0x7f35740710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:24.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.668+0000 7f3595a00700 1 --2- 172.21.15.81:0/1201576610 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f357406ec10 0x7f35740710c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3578006fd0 tx=0x7f3578008040 comp rx=0 tx=0).stop 2024-04-23T15:01:24.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.669+0000 7f3595a00700 1 -- 172.21.15.81:0/1201576610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3590102e20 msgr2=0x7f3590113b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:24.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.669+0000 7f3595a00700 1 --2- 172.21.15.81:0/1201576610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3590102e20 0x7f3590113b80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3580009180 tx=0x7f3580009e30 comp rx=0 tx=0).stop 2024-04-23T15:01:24.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.669+0000 7f3595a00700 1 -- 172.21.15.81:0/1201576610 shutdown_connections 2024-04-23T15:01:24.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.669+0000 7f3595a00700 1 --2- 172.21.15.81:0/1201576610 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f357406ec10 0x7f35740710c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:24.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.669+0000 7f3595a00700 1 --2- 172.21.15.81:0/1201576610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3590102e20 0x7f3590113b80 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:24.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.669+0000 7f3595a00700 1 --2- 172.21.15.81:0/1201576610 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35901037c0 0x7f35901140c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:24.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.669+0000 7f3595a00700 1 -- 172.21.15.81:0/1201576610 >> 172.21.15.81:0/1201576610 conn(0x7f35900f89d0 msgr2=0x7f35900f9980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:01:24.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.669+0000 7f3595a00700 1 -- 172.21.15.81:0/1201576610 shutdown_connections 2024-04-23T15:01:24.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:24.669+0000 7f3595a00700 1 -- 172.21.15.81:0/1201576610 wait complete. 2024-04-23T15:01:25.510 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -e sha1=d44fddd910b5e94da0f2357af4be37d7bd495ae0 -- bash -c 'ceph health detail' 2024-04-23T15:01:25.988 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T15:01:26.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:25 smithi156 ceph-mon[77738]: pgmap v308: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:01:26.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:25 smithi156 ceph-mon[77738]: from='client.34620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T15:01:26.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:25 smithi081 ceph-mon[90469]: pgmap v308: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:01:26.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:25 smithi081 ceph-mon[90469]: from='client.34620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T15:01:26.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:26 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T15:01:27.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:26 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T15:01:28.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:27 smithi156 ceph-mon[77738]: pgmap v309: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T15:01:28.057 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:27 smithi081 ceph-mon[90469]: pgmap v309: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T15:01:28.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.220+0000 7f6bc5c00700 1 -- 172.21.15.81:0/131757657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc0103460 msgr2=0x7f6bc01038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:28.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.220+0000 7f6bc5c00700 1 --2- 172.21.15.81:0/131757657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc0103460 0x7f6bc01038d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6bac004940 tx=0x7f6bac009e30 comp rx=0 tx=0).stop 2024-04-23T15:01:28.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.220+0000 7f6bc5c00700 1 -- 172.21.15.81:0/131757657 shutdown_connections 2024-04-23T15:01:28.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.220+0000 7f6bc5c00700 1 --2- 172.21.15.81:0/131757657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc0103460 0x7f6bc01038d0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:28.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.220+0000 7f6bc5c00700 1 --2- 172.21.15.81:0/131757657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bc01094c0 0x7f6bc0109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:28.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.220+0000 7f6bc5c00700 1 -- 172.21.15.81:0/131757657 >> 172.21.15.81:0/131757657 conn(0x7f6bc0072c30 msgr2=0x7f6bc0075040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:01:28.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.220+0000 7f6bc5c00700 1 -- 172.21.15.81:0/131757657 shutdown_connections 2024-04-23T15:01:28.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.220+0000 7f6bc5c00700 1 -- 172.21.15.81:0/131757657 wait complete. 2024-04-23T15:01:28.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.221+0000 7f6bc5c00700 1 Processor -- start 2024-04-23T15:01:28.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.221+0000 7f6bc5c00700 1 -- start start 2024-04-23T15:01:28.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.222+0000 7f6bc5c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc0103460 0x7f6bc0119f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:28.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.222+0000 7f6bc5c00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bc01094c0 0x7f6bc011a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:28.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.222+0000 7f6bc5c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc011aaf0 con 0x7f6bc0103460 2024-04-23T15:01:28.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.222+0000 7f6bc5c00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc0114110 con 0x7f6bc01094c0 2024-04-23T15:01:28.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.222+0000 7f6bbea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc0103460 0x7f6bc0119f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:28.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.222+0000 7f6bbea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc0103460 0x7f6bc0119f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36498/0 (socket says 172.21.15.81:36498) 2024-04-23T15:01:28.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.222+0000 7f6bbea00700 1 -- 172.21.15.81:0/1197198799 learned_addr learned my addr 172.21.15.81:0/1197198799 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:01:28.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.222+0000 7f6bbea00700 1 -- 172.21.15.81:0/1197198799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bc01094c0 msgr2=0x7f6bc011a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:28.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.222+0000 7f6bbea00700 1 --2- 172.21.15.81:0/1197198799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bc01094c0 0x7f6bc011a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:28.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.222+0000 7f6bbea00700 1 -- 172.21.15.81:0/1197198799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bac005040 con 0x7f6bc0103460 2024-04-23T15:01:28.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.223+0000 7f6bbea00700 1 --2- 172.21.15.81:0/1197198799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc0103460 0x7f6bc0119f60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6bb000c8c0 tx=0x7f6bb00044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:01:28.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.223+0000 7f6bb6a00700 1 -- 172.21.15.81:0/1197198799 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bb000a980 con 0x7f6bc0103460 2024-04-23T15:01:28.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.223+0000 7f6bb6a00700 1 -- 172.21.15.81:0/1197198799 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6bb000ce60 con 0x7f6bc0103460 2024-04-23T15:01:28.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.223+0000 7f6bb6a00700 1 -- 172.21.15.81:0/1197198799 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bb00115e0 con 0x7f6bc0103460 2024-04-23T15:01:28.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.223+0000 7f6bc5c00700 1 -- 172.21.15.81:0/1197198799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc01143f0 con 0x7f6bc0103460 2024-04-23T15:01:28.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.223+0000 7f6bc5c00700 1 -- 172.21.15.81:0/1197198799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc01149b0 con 0x7f6bc0103460 2024-04-23T15:01:28.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.224+0000 7f6bc5c00700 1 -- 172.21.15.81:0/1197198799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc0104ba0 con 0x7f6bc0103460 2024-04-23T15:01:28.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.225+0000 7f6bb6a00700 1 -- 172.21.15.81:0/1197198799 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f6bb0012400 con 0x7f6bc0103460 2024-04-23T15:01:28.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.226+0000 7f6bb6a00700 1 --2- 172.21.15.81:0/1197198799 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6ba406ec00 0x7f6ba40710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:28.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.227+0000 7f6bb6a00700 1 -- 172.21.15.81:0/1197198799 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f6bb008e990 con 0x7f6bc0103460 2024-04-23T15:01:28.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.227+0000 7f6bbe000700 1 --2- 172.21.15.81:0/1197198799 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6ba406ec00 0x7f6ba40710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:28.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.227+0000 7f6bbe000700 1 --2- 172.21.15.81:0/1197198799 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6ba406ec00 0x7f6ba40710b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6bac004f90 tx=0x7f6bac009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:01:28.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.232+0000 7f6bb6a00700 1 -- 172.21.15.81:0/1197198799 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f6bb0057740 con 0x7f6bc0103460 2024-04-23T15:01:28.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.549+0000 7f6bc5c00700 1 -- 172.21.15.81:0/1197198799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6bc0110530 con 0x7f6bc0103460 2024-04-23T15:01:28.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.550+0000 7f6bb6a00700 1 -- 172.21.15.81:0/1197198799 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f6bb00126b0 con 0x7f6bc0103460 2024-04-23T15:01:28.551 INFO:teuthology.orchestra.run.smithi081.stdout:HEALTH_OK 2024-04-23T15:01:28.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.552+0000 7f6bc5c00700 1 -- 172.21.15.81:0/1197198799 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6ba406ec00 msgr2=0x7f6ba40710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:28.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.552+0000 7f6bc5c00700 1 --2- 172.21.15.81:0/1197198799 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6ba406ec00 0x7f6ba40710b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6bac004f90 tx=0x7f6bac009e30 comp rx=0 tx=0).stop 2024-04-23T15:01:28.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.552+0000 7f6bc5c00700 1 -- 172.21.15.81:0/1197198799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc0103460 msgr2=0x7f6bc0119f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:28.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.552+0000 7f6bc5c00700 1 --2- 172.21.15.81:0/1197198799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc0103460 0x7f6bc0119f60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6bb000c8c0 tx=0x7f6bb00044c0 comp rx=0 tx=0).stop 2024-04-23T15:01:28.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.553+0000 7f6bc5c00700 1 -- 172.21.15.81:0/1197198799 shutdown_connections 2024-04-23T15:01:28.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.553+0000 7f6bc5c00700 1 --2- 172.21.15.81:0/1197198799 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6ba406ec00 0x7f6ba40710b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:28.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.553+0000 7f6bc5c00700 1 --2- 172.21.15.81:0/1197198799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc0103460 0x7f6bc0119f60 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:28.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.553+0000 7f6bc5c00700 1 --2- 172.21.15.81:0/1197198799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bc01094c0 0x7f6bc011a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:28.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.553+0000 7f6bc5c00700 1 -- 172.21.15.81:0/1197198799 >> 172.21.15.81:0/1197198799 conn(0x7f6bc0072c30 msgr2=0x7f6bc0105c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:01:28.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.553+0000 7f6bc5c00700 1 -- 172.21.15.81:0/1197198799 shutdown_connections 2024-04-23T15:01:28.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:28.553+0000 7f6bc5c00700 1 -- 172.21.15.81:0/1197198799 wait complete. 2024-04-23T15:01:28.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:28 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/1197198799' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T15:01:29.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:28 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/1197198799' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-23T15:01:29.344 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -e sha1=d44fddd910b5e94da0f2357af4be37d7bd495ae0 -- bash -c 'ceph versions' 2024-04-23T15:01:29.824 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T15:01:30.010 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:29 smithi081 ceph-mon[90469]: pgmap v310: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-04-23T15:01:30.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:29 smithi156 ceph-mon[77738]: pgmap v310: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-04-23T15:01:32.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:31 smithi156 ceph-mon[77738]: pgmap v311: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:01:32.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.052+0000 7fbb9fe00700 1 -- 172.21.15.81:0/3324131818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbba0072e00 msgr2=0x7fbba010d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:32.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.052+0000 7fbb9fe00700 1 --2- 172.21.15.81:0/3324131818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbba0072e00 0x7fbba010d590 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbb88009ce0 tx=0x7fbb88004d10 comp rx=0 tx=0).stop 2024-04-23T15:01:32.054 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:31 smithi081 ceph-mon[90469]: pgmap v311: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:01:32.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.052+0000 7fbb9fe00700 1 -- 172.21.15.81:0/3324131818 shutdown_connections 2024-04-23T15:01:32.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.052+0000 7fbb9fe00700 1 --2- 172.21.15.81:0/3324131818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbba0072e00 0x7fbba010d590 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:32.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.052+0000 7fbb9fe00700 1 --2- 172.21.15.81:0/3324131818 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbba00724f0 0x7fbba00728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:32.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.052+0000 7fbb9fe00700 1 -- 172.21.15.81:0/3324131818 >> 172.21.15.81:0/3324131818 conn(0x7fbba00fab10 msgr2=0x7fbba00fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:01:32.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.052+0000 7fbb9fe00700 1 -- 172.21.15.81:0/3324131818 shutdown_connections 2024-04-23T15:01:32.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.052+0000 7fbb9fe00700 1 -- 172.21.15.81:0/3324131818 wait complete. 2024-04-23T15:01:32.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.053+0000 7fbb9fe00700 1 Processor -- start 2024-04-23T15:01:32.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.053+0000 7fbb9fe00700 1 -- start start 2024-04-23T15:01:32.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.054+0000 7fbb9fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbba00724f0 0x7fbba0119fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:32.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.054+0000 7fbb9fe00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbba0072e00 0x7fbba011a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:32.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.054+0000 7fbb9fe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba011ab70 con 0x7fbba00724f0 2024-04-23T15:01:32.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.054+0000 7fbb9fe00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba0113f40 con 0x7fbba0072e00 2024-04-23T15:01:32.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.054+0000 7fbb9ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbba00724f0 0x7fbba0119fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:32.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.054+0000 7fbb9ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbba00724f0 0x7fbba0119fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36504/0 (socket says 172.21.15.81:36504) 2024-04-23T15:01:32.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.054+0000 7fbb9ea00700 1 -- 172.21.15.81:0/149066068 learned_addr learned my addr 172.21.15.81:0/149066068 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:01:32.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.055+0000 7fbb96000700 1 --2- 172.21.15.81:0/149066068 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbba0072e00 0x7fbba011a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:32.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.055+0000 7fbb9ea00700 1 -- 172.21.15.81:0/149066068 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbba0072e00 msgr2=0x7fbba011a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:32.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.055+0000 7fbb9ea00700 1 --2- 172.21.15.81:0/149066068 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbba0072e00 0x7fbba011a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:32.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.055+0000 7fbb9ea00700 1 -- 172.21.15.81:0/149066068 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb88009940 con 0x7fbba00724f0 2024-04-23T15:01:32.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.055+0000 7fbb96000700 1 --2- 172.21.15.81:0/149066068 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbba0072e00 0x7fbba011a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:01:32.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.055+0000 7fbb9ea00700 1 --2- 172.21.15.81:0/149066068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbba00724f0 0x7fbba0119fe0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbb90002a50 tx=0x7fbb900046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:01:32.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.055+0000 7fbb97400700 1 -- 172.21.15.81:0/149066068 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb90007cc0 con 0x7fbba00724f0 2024-04-23T15:01:32.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.055+0000 7fbb97400700 1 -- 172.21.15.81:0/149066068 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbb9000f040 con 0x7fbba00724f0 2024-04-23T15:01:32.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.055+0000 7fbb9fe00700 1 -- 172.21.15.81:0/149066068 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbba0114220 con 0x7fbba00724f0 2024-04-23T15:01:32.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.055+0000 7fbb97400700 1 -- 172.21.15.81:0/149066068 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb90009640 con 0x7fbba00724f0 2024-04-23T15:01:32.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.055+0000 7fbb9fe00700 1 -- 172.21.15.81:0/149066068 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba0114760 con 0x7fbba00724f0 2024-04-23T15:01:32.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.056+0000 7fbb9fe00700 1 -- 172.21.15.81:0/149066068 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbba0073c30 con 0x7fbba00724f0 2024-04-23T15:01:32.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.058+0000 7fbb97400700 1 -- 172.21.15.81:0/149066068 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fbb900097a0 con 0x7fbba00724f0 2024-04-23T15:01:32.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.059+0000 7fbb97400700 1 --2- 172.21.15.81:0/149066068 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fbb8406ec10 0x7fbb840710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:01:32.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.059+0000 7fbb97400700 1 -- 172.21.15.81:0/149066068 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fbb9008e6b0 con 0x7fbba00724f0 2024-04-23T15:01:32.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.059+0000 7fbb96000700 1 --2- 172.21.15.81:0/149066068 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fbb8406ec10 0x7fbb840710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:01:32.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.060+0000 7fbb96000700 1 --2- 172.21.15.81:0/149066068 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fbb8406ec10 0x7fbb840710c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbb8800b740 tx=0x7fbb88004d10 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:01:32.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.064+0000 7fbb97400700 1 -- 172.21.15.81:0/149066068 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fbb9005af10 con 0x7fbba00724f0 2024-04-23T15:01:32.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.377+0000 7fbb9fe00700 1 -- 172.21.15.81:0/149066068 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbba004bf00 con 0x7fbba00724f0 2024-04-23T15:01:32.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.378+0000 7fbb97400700 1 -- 172.21.15.81:0/149066068 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fbb9005aaa0 con 0x7fbba00724f0 2024-04-23T15:01:32.379 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T15:01:32.379 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-04-23T15:01:32.380 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T15:01:32.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T15:01:32.380 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-04-23T15:01:32.380 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T15:01:32.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T15:01:32.380 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-04-23T15:01:32.380 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 6 2024-04-23T15:01:32.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T15:01:32.380 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-04-23T15:01:32.380 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 4 2024-04-23T15:01:32.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T15:01:32.380 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-04-23T15:01:32.380 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 14 2024-04-23T15:01:32.380 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-23T15:01:32.380 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T15:01:32.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.381+0000 7fbb9fe00700 1 -- 172.21.15.81:0/149066068 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fbb8406ec10 msgr2=0x7fbb840710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:32.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.381+0000 7fbb9fe00700 1 --2- 172.21.15.81:0/149066068 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fbb8406ec10 0x7fbb840710c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbb8800b740 tx=0x7fbb88004d10 comp rx=0 tx=0).stop 2024-04-23T15:01:32.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.381+0000 7fbb9fe00700 1 -- 172.21.15.81:0/149066068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbba00724f0 msgr2=0x7fbba0119fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:01:32.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.381+0000 7fbb9fe00700 1 --2- 172.21.15.81:0/149066068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbba00724f0 0x7fbba0119fe0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbb90002a50 tx=0x7fbb900046b0 comp rx=0 tx=0).stop 2024-04-23T15:01:32.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.381+0000 7fbb9fe00700 1 -- 172.21.15.81:0/149066068 shutdown_connections 2024-04-23T15:01:32.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.381+0000 7fbb9fe00700 1 --2- 172.21.15.81:0/149066068 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fbb8406ec10 0x7fbb840710c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:32.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.381+0000 7fbb9fe00700 1 --2- 172.21.15.81:0/149066068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbba00724f0 0x7fbba0119fe0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:32.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.381+0000 7fbb9fe00700 1 --2- 172.21.15.81:0/149066068 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbba0072e00 0x7fbba011a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:01:32.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.381+0000 7fbb9fe00700 1 -- 172.21.15.81:0/149066068 >> 172.21.15.81:0/149066068 conn(0x7fbba00fab10 msgr2=0x7fbba00fafa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:01:32.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.381+0000 7fbb9fe00700 1 -- 172.21.15.81:0/149066068 shutdown_connections 2024-04-23T15:01:32.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:01:32.381+0000 7fbb9fe00700 1 -- 172.21.15.81:0/149066068 wait complete. 2024-04-23T15:01:33.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:32 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/149066068' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:01:33.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:32 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/149066068' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:01:33.270 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -e sha1=d44fddd910b5e94da0f2357af4be37d7bd495ae0 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-04-23T15:01:33.732 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T15:01:34.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:33 smithi156 ceph-mon[77738]: pgmap v312: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-04-23T15:01:34.046 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:33 smithi081 ceph-mon[90469]: pgmap v312: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-04-23T15:01:35.793 INFO:teuthology.orchestra.run.smithi081.stdout:wait for servicemap items w/ changing names to refresh 2024-04-23T15:01:36.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:35 smithi156 ceph-mon[77738]: pgmap v313: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:01:36.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:35 smithi081 ceph-mon[90469]: pgmap v313: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:01:36.493 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -e sha1=d44fddd910b5e94da0f2357af4be37d7bd495ae0 -- bash -c 'sleep 60' 2024-04-23T15:01:36.963 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T15:01:38.027 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:37 smithi081 ceph-mon[90469]: pgmap v314: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-23T15:01:38.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:37 smithi156 ceph-mon[77738]: pgmap v314: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-23T15:01:40.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:39 smithi156 ceph-mon[77738]: pgmap v315: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-04-23T15:01:40.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:39 smithi081 ceph-mon[90469]: pgmap v315: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-04-23T15:01:42.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:41 smithi081 ceph-mon[90469]: pgmap v316: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:01:42.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:41 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T15:01:42.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:41 smithi156 ceph-mon[77738]: pgmap v316: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:01:42.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:41 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T15:01:44.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:43 smithi081 ceph-mon[90469]: pgmap v317: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:01:44.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:43 smithi156 ceph-mon[77738]: pgmap v317: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:01:46.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:45 smithi081 ceph-mon[90469]: pgmap v318: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:01:46.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:45 smithi156 ceph-mon[77738]: pgmap v318: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:01:47.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:46 smithi081 ceph-mon[90469]: pgmap v319: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T15:01:47.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:46 smithi156 ceph-mon[77738]: pgmap v319: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T15:01:50.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:49 smithi156 ceph-mon[77738]: pgmap v320: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:01:50.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:49 smithi081 ceph-mon[90469]: pgmap v320: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:01:52.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:51 smithi156 ceph-mon[77738]: pgmap v321: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:01:52.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:51 smithi081 ceph-mon[90469]: pgmap v321: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:01:54.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:53 smithi156 ceph-mon[77738]: pgmap v322: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-04-23T15:01:54.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:53 smithi081 ceph-mon[90469]: pgmap v322: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-04-23T15:01:56.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:55 smithi156 ceph-mon[77738]: pgmap v323: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:01:56.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:55 smithi081 ceph-mon[90469]: pgmap v323: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:01:57.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:56 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T15:01:57.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:56 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T15:01:57.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:57 smithi081 ceph-mon[90469]: pgmap v324: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-23T15:01:58.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:57 smithi156 ceph-mon[77738]: pgmap v324: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-23T15:02:00.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:01:59 smithi156 ceph-mon[77738]: pgmap v325: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:02:00.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:01:59 smithi081 ceph-mon[90469]: pgmap v325: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:02:02.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:01 smithi156 ceph-mon[77738]: pgmap v326: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:02:02.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:01 smithi081 ceph-mon[90469]: pgmap v326: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:02:04.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:03 smithi156 ceph-mon[77738]: pgmap v327: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-04-23T15:02:04.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:03 smithi081 ceph-mon[90469]: pgmap v327: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-04-23T15:02:06.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:05 smithi081 ceph-mon[90469]: pgmap v328: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:02:06.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:05 smithi156 ceph-mon[77738]: pgmap v328: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:02:08.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:07 smithi081 ceph-mon[90469]: pgmap v329: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-23T15:02:08.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:07 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:02:08.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:07 smithi156 ceph-mon[77738]: pgmap v329: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-23T15:02:08.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:07 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:02:09.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:08 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:02:09.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:08 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:02:09.077 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:08 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:02:09.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:08 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:02:09.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:08 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:02:09.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:08 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:02:09.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:09 smithi081 ceph-mon[90469]: pgmap v330: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-04-23T15:02:10.287 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:09 smithi156 ceph-mon[77738]: pgmap v330: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-04-23T15:02:12.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:11 smithi081 ceph-mon[90469]: pgmap v331: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:02:12.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:11 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T15:02:12.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:11 smithi156 ceph-mon[77738]: pgmap v331: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:02:12.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:11 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T15:02:13.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:12 smithi156 ceph-mon[77738]: pgmap v332: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-04-23T15:02:13.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:12 smithi081 ceph-mon[90469]: pgmap v332: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-04-23T15:02:16.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:15 smithi156 ceph-mon[77738]: pgmap v333: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:02:16.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:15 smithi081 ceph-mon[90469]: pgmap v333: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:02:17.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:17 smithi081 ceph-mon[90469]: pgmap v334: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-23T15:02:18.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:17 smithi156 ceph-mon[77738]: pgmap v334: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-23T15:02:20.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:19 smithi156 ceph-mon[77738]: pgmap v335: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-04-23T15:02:20.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:19 smithi081 ceph-mon[90469]: pgmap v335: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-04-23T15:02:22.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:21 smithi156 ceph-mon[77738]: pgmap v336: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:02:22.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:21 smithi081 ceph-mon[90469]: pgmap v336: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:02:24.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:23 smithi156 ceph-mon[77738]: pgmap v337: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-04-23T15:02:24.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:23 smithi081 ceph-mon[90469]: pgmap v337: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-04-23T15:02:26.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:25 smithi156 ceph-mon[77738]: pgmap v338: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:02:26.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:25 smithi081 ceph-mon[90469]: pgmap v338: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:02:27.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:26 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T15:02:27.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:26 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T15:02:28.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:27 smithi156 ceph-mon[77738]: pgmap v339: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-23T15:02:28.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:27 smithi081 ceph-mon[90469]: pgmap v339: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-23T15:02:30.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:29 smithi081 ceph-mon[90469]: pgmap v340: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-04-23T15:02:30.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:29 smithi156 ceph-mon[77738]: pgmap v340: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-04-23T15:02:32.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:31 smithi081 ceph-mon[90469]: pgmap v341: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:02:32.089 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:31 smithi156 ceph-mon[77738]: pgmap v341: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:02:34.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:33 smithi081 ceph-mon[90469]: pgmap v342: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-04-23T15:02:34.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:33 smithi156 ceph-mon[77738]: pgmap v342: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-04-23T15:02:36.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:35 smithi081 ceph-mon[90469]: pgmap v343: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:02:36.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:35 smithi156 ceph-mon[77738]: pgmap v343: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:02:38.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:37 smithi081 ceph-mon[90469]: pgmap v344: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-23T15:02:38.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:37 smithi156 ceph-mon[77738]: pgmap v344: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-23T15:02:39.075 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:38 smithi081 ceph-mon[90469]: pgmap v345: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-04-23T15:02:39.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:38 smithi156 ceph-mon[77738]: pgmap v345: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-04-23T15:02:39.896 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -e sha1=d44fddd910b5e94da0f2357af4be37d7bd495ae0 -- bash -c 'ceph orch ps' 2024-04-23T15:02:40.383 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T15:02:42.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:41 smithi156 ceph-mon[77738]: pgmap v346: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:02:42.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:41 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T15:02:42.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:41 smithi081 ceph-mon[90469]: pgmap v346: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:02:42.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:41 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T15:02:42.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.588+0000 7f8f83200700 1 -- 172.21.15.81:0/4154761429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f7c103460 msgr2=0x7f8f7c1038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:42.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.588+0000 7f8f83200700 1 --2- 172.21.15.81:0/4154761429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f7c103460 0x7f8f7c1038d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8f68004940 tx=0x7f8f68009e30 comp rx=0 tx=0).stop 2024-04-23T15:02:42.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.588+0000 7f8f83200700 1 -- 172.21.15.81:0/4154761429 shutdown_connections 2024-04-23T15:02:42.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.588+0000 7f8f83200700 1 --2- 172.21.15.81:0/4154761429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f7c103460 0x7f8f7c1038d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:42.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.588+0000 7f8f83200700 1 --2- 172.21.15.81:0/4154761429 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f7c1094c0 0x7f8f7c109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:42.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.588+0000 7f8f83200700 1 -- 172.21.15.81:0/4154761429 >> 172.21.15.81:0/4154761429 conn(0x7f8f7c072c30 msgr2=0x7f8f7c075040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:02:42.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.588+0000 7f8f83200700 1 -- 172.21.15.81:0/4154761429 shutdown_connections 2024-04-23T15:02:42.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.588+0000 7f8f83200700 1 -- 172.21.15.81:0/4154761429 wait complete. 2024-04-23T15:02:42.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.589+0000 7f8f83200700 1 Processor -- start 2024-04-23T15:02:42.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.590+0000 7f8f83200700 1 -- start start 2024-04-23T15:02:42.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.590+0000 7f8f83200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f7c103460 0x7f8f7c119f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:42.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.590+0000 7f8f83200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f7c1094c0 0x7f8f7c11a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:42.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.590+0000 7f8f83200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c11aaf0 con 0x7f8f7c103460 2024-04-23T15:02:42.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.590+0000 7f8f83200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c114110 con 0x7f8f7c1094c0 2024-04-23T15:02:42.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.591+0000 7f8f7be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f7c103460 0x7f8f7c119f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:42.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.591+0000 7f8f7be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f7c103460 0x7f8f7c119f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49396/0 (socket says 172.21.15.81:49396) 2024-04-23T15:02:42.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.591+0000 7f8f7be00700 1 -- 172.21.15.81:0/2948126884 learned_addr learned my addr 172.21.15.81:0/2948126884 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:02:42.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.591+0000 7f8f7b400700 1 --2- 172.21.15.81:0/2948126884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f7c1094c0 0x7f8f7c11a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:42.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.591+0000 7f8f7be00700 1 -- 172.21.15.81:0/2948126884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f7c1094c0 msgr2=0x7f8f7c11a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:42.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.591+0000 7f8f7be00700 1 --2- 172.21.15.81:0/2948126884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f7c1094c0 0x7f8f7c11a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:42.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.591+0000 7f8f7be00700 1 -- 172.21.15.81:0/2948126884 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f68005040 con 0x7f8f7c103460 2024-04-23T15:02:42.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.591+0000 7f8f7be00700 1 --2- 172.21.15.81:0/2948126884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f7c103460 0x7f8f7c119f60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c002a50 tx=0x7f8f6c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:02:42.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.592+0000 7f8f73e00700 1 -- 172.21.15.81:0/2948126884 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f6c007cc0 con 0x7f8f7c103460 2024-04-23T15:02:42.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.592+0000 7f8f73e00700 1 -- 172.21.15.81:0/2948126884 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8f6c00f040 con 0x7f8f7c103460 2024-04-23T15:02:42.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.592+0000 7f8f83200700 1 -- 172.21.15.81:0/2948126884 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f7c1143f0 con 0x7f8f7c103460 2024-04-23T15:02:42.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.592+0000 7f8f73e00700 1 -- 172.21.15.81:0/2948126884 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f6c009640 con 0x7f8f7c103460 2024-04-23T15:02:42.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.592+0000 7f8f83200700 1 -- 172.21.15.81:0/2948126884 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f7c1149b0 con 0x7f8f7c103460 2024-04-23T15:02:42.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.593+0000 7f8f83200700 1 -- 172.21.15.81:0/2948126884 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f7c104ba0 con 0x7f8f7c103460 2024-04-23T15:02:42.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.594+0000 7f8f73e00700 1 -- 172.21.15.81:0/2948126884 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f8f6c0097a0 con 0x7f8f7c103460 2024-04-23T15:02:42.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.596+0000 7f8f73e00700 1 --2- 172.21.15.81:0/2948126884 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f8f6006ec00 0x7f8f600710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:42.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.596+0000 7f8f73e00700 1 -- 172.21.15.81:0/2948126884 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f8f6c08e780 con 0x7f8f7c103460 2024-04-23T15:02:42.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.596+0000 7f8f7b400700 1 --2- 172.21.15.81:0/2948126884 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f8f6006ec00 0x7f8f600710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:42.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.597+0000 7f8f7b400700 1 --2- 172.21.15.81:0/2948126884 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f8f6006ec00 0x7f8f600710b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8f6800b020 tx=0x7f8f68009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:02:42.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.601+0000 7f8f73e00700 1 -- 172.21.15.81:0/2948126884 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f8f6c057430 con 0x7f8f7c103460 2024-04-23T15:02:42.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.840+0000 7f8f83200700 1 -- 172.21.15.81:0/2948126884 --> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f7c1155f0 con 0x7f8f6006ec00 2024-04-23T15:02:42.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.870+0000 7f8f73e00700 1 -- 172.21.15.81:0/2948126884 <== mgr.34102 v2:172.21.15.81:6800/2400558247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f8f7c1155f0 con 0x7f8f6006ec00 2024-04-23T15:02:42.871 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-23T15:02:42.871 INFO:teuthology.orchestra.run.smithi081.stdout:alertmanager.smithi081 smithi081 *:9093,9094 running (2m) 105s ago 23m 13.8M - 0.25.0 c8568f914cd2 cb978e6344d1 2024-04-23T15:02:42.871 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi081 smithi081 running (8m) 105s ago 24m 6665k - 19.0.0-3126-gd44fddd9 76e77f280c74 b486fe2ef19b 2024-04-23T15:02:42.871 INFO:teuthology.orchestra.run.smithi081.stdout:crash.smithi156 smithi156 running (8m) 3m ago 22m 6656k - 19.0.0-3126-gd44fddd9 76e77f280c74 5d9aa5ecf264 2024-04-23T15:02:42.871 INFO:teuthology.orchestra.run.smithi081.stdout:grafana.smithi081 smithi081 *:3000 running (111s) 105s ago 23m 50.9M - 9.4.12 2bacad6d85d8 192d202029bc 2024-04-23T15:02:42.871 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.vcoywg smithi081 running (4m) 105s ago 16m 84.7M - 19.0.0-3126-gd44fddd9 76e77f280c74 87ab7708542f 2024-04-23T15:02:42.871 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi081.wydgcg smithi081 running (4m) 105s ago 16m 85.3M - 19.0.0-3126-gd44fddd9 76e77f280c74 e2a96404cc4f 2024-04-23T15:02:42.871 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.rhbtxt smithi156 running (4m) 3m ago 16m 11.3M - 19.0.0-3126-gd44fddd9 76e77f280c74 208d4416e1bf 2024-04-23T15:02:42.871 INFO:teuthology.orchestra.run.smithi081.stdout:mds.cephfs.smithi156.vynkxn smithi156 running (3m) 3m ago 16m 11.1M - 19.0.0-3126-gd44fddd9 76e77f280c74 34368f26f4d2 2024-04-23T15:02:42.871 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi081.ldghvq smithi081 *:8443,9283,8765 running (12m) 105s ago 25m 523M - 19.0.0-3126-gd44fddd9 76e77f280c74 6bf23484a1c9 2024-04-23T15:02:42.871 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.smithi156.ounwyj smithi156 *:8443,9283,8765 running (11m) 3m ago 22m 453M - 19.0.0-3126-gd44fddd9 76e77f280c74 a6c0dd9f89f2 2024-04-23T15:02:42.871 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi081 smithi081 running (10m) 105s ago 25m 56.8M 2048M 19.0.0-3126-gd44fddd9 76e77f280c74 fbf9f9a59ac2 2024-04-23T15:02:42.871 INFO:teuthology.orchestra.run.smithi081.stdout:mon.smithi156 smithi156 running (9m) 3m ago 22m 40.6M 2048M 19.0.0-3126-gd44fddd9 76e77f280c74 36409886998f 2024-04-23T15:02:42.871 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi081 smithi081 *:9100 running (3m) 105s ago 23m 7830k - 1.5.0 0da6a335fe13 a822ef7cd112 2024-04-23T15:02:42.871 INFO:teuthology.orchestra.run.smithi081.stdout:node-exporter.smithi156 smithi156 *:9100 running (3m) 3m ago 22m 2839k - 1.5.0 0da6a335fe13 b74c35e7cf10 2024-04-23T15:02:42.872 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (8m) 105s ago 21m 110M 1557M 19.0.0-3126-gd44fddd9 76e77f280c74 24bc24b37de5 2024-04-23T15:02:42.872 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi081 running (7m) 105s ago 20m 121M 1557M 19.0.0-3126-gd44fddd9 76e77f280c74 18d0179b558a 2024-04-23T15:02:42.872 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi081 running (7m) 105s ago 20m 98.1M 1557M 19.0.0-3126-gd44fddd9 76e77f280c74 421a62ef6990 2024-04-23T15:02:42.872 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi156 running (6m) 3m ago 19m 126M 2581M 19.0.0-3126-gd44fddd9 76e77f280c74 9af3ca1ff69b 2024-04-23T15:02:42.872 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi156 running (6m) 3m ago 19m 110M 2581M 19.0.0-3126-gd44fddd9 76e77f280c74 e0a1e784348c 2024-04-23T15:02:42.872 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi156 running (5m) 3m ago 18m 107M 2581M 19.0.0-3126-gd44fddd9 76e77f280c74 16b6ba5d9e3e 2024-04-23T15:02:42.872 INFO:teuthology.orchestra.run.smithi081.stdout:prometheus.smithi081 smithi081 *:9095 running (2m) 105s ago 23m 50.1M - 2.43.0 a07b618ecd1d 03f612614f9d 2024-04-23T15:02:42.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.873+0000 7f8f83200700 1 -- 172.21.15.81:0/2948126884 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f8f6006ec00 msgr2=0x7f8f600710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:42.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.873+0000 7f8f83200700 1 --2- 172.21.15.81:0/2948126884 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f8f6006ec00 0x7f8f600710b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8f6800b020 tx=0x7f8f68009e30 comp rx=0 tx=0).stop 2024-04-23T15:02:42.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.873+0000 7f8f83200700 1 -- 172.21.15.81:0/2948126884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f7c103460 msgr2=0x7f8f7c119f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:42.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.873+0000 7f8f83200700 1 --2- 172.21.15.81:0/2948126884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f7c103460 0x7f8f7c119f60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c002a50 tx=0x7f8f6c0046b0 comp rx=0 tx=0).stop 2024-04-23T15:02:42.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.873+0000 7f8f83200700 1 -- 172.21.15.81:0/2948126884 shutdown_connections 2024-04-23T15:02:42.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.873+0000 7f8f83200700 1 --2- 172.21.15.81:0/2948126884 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f8f6006ec00 0x7f8f600710b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:42.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.873+0000 7f8f83200700 1 --2- 172.21.15.81:0/2948126884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f7c103460 0x7f8f7c119f60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:42.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.873+0000 7f8f83200700 1 --2- 172.21.15.81:0/2948126884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f7c1094c0 0x7f8f7c11a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:42.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.873+0000 7f8f83200700 1 -- 172.21.15.81:0/2948126884 >> 172.21.15.81:0/2948126884 conn(0x7f8f7c072c30 msgr2=0x7f8f7c105c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:02:42.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.874+0000 7f8f83200700 1 -- 172.21.15.81:0/2948126884 shutdown_connections 2024-04-23T15:02:42.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:42.874+0000 7f8f83200700 1 -- 172.21.15.81:0/2948126884 wait complete. 2024-04-23T15:02:43.749 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -e sha1=d44fddd910b5e94da0f2357af4be37d7bd495ae0 -- bash -c 'ceph versions' 2024-04-23T15:02:44.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:43 smithi156 ceph-mon[77738]: pgmap v347: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-04-23T15:02:44.075 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:43 smithi081 ceph-mon[90469]: pgmap v347: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-04-23T15:02:44.219 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T15:02:45.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:44 smithi156 ceph-mon[77738]: from='client.34632 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T15:02:45.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:44 smithi081 ceph-mon[90469]: from='client.34632 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T15:02:46.028 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:45 smithi081 ceph-mon[90469]: pgmap v348: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:02:46.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:45 smithi156 ceph-mon[77738]: pgmap v348: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:02:46.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.326+0000 7f3d05a00700 1 -- 172.21.15.81:0/2740594646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d00102cc0 msgr2=0x7f3d00103090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:46.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.326+0000 7f3d05a00700 1 --2- 172.21.15.81:0/2740594646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d00102cc0 0x7f3d00103090 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0004940 tx=0x7f3cf0009e30 comp rx=0 tx=0).stop 2024-04-23T15:02:46.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.326+0000 7f3d05a00700 1 -- 172.21.15.81:0/2740594646 shutdown_connections 2024-04-23T15:02:46.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.326+0000 7f3d05a00700 1 --2- 172.21.15.81:0/2740594646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d00065670 0x7f3d00065ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:46.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.326+0000 7f3d05a00700 1 --2- 172.21.15.81:0/2740594646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d00102cc0 0x7f3d00103090 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:46.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.326+0000 7f3d05a00700 1 -- 172.21.15.81:0/2740594646 >> 172.21.15.81:0/2740594646 conn(0x7f3d00071b70 msgr2=0x7f3d00071f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:02:46.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.326+0000 7f3d05a00700 1 -- 172.21.15.81:0/2740594646 shutdown_connections 2024-04-23T15:02:46.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.326+0000 7f3d05a00700 1 -- 172.21.15.81:0/2740594646 wait complete. 2024-04-23T15:02:46.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.327+0000 7f3d05a00700 1 Processor -- start 2024-04-23T15:02:46.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.327+0000 7f3d05a00700 1 -- start start 2024-04-23T15:02:46.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.327+0000 7f3d05a00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d00065670 0x7f3d00115c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:46.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.327+0000 7f3d05a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d00102cc0 0x7f3d00116190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:46.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.327+0000 7f3d05a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d001167e0 con 0x7f3d00102cc0 2024-04-23T15:02:46.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.327+0000 7f3d05a00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0010fc00 con 0x7f3d00065670 2024-04-23T15:02:46.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.328+0000 7f3cff400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d00102cc0 0x7f3d00116190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:46.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.328+0000 7f3cff400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d00102cc0 0x7f3d00116190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45162/0 (socket says 172.21.15.81:45162) 2024-04-23T15:02:46.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.328+0000 7f3cff400700 1 -- 172.21.15.81:0/2545099894 learned_addr learned my addr 172.21.15.81:0/2545099894 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:02:46.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.328+0000 7f3cffe00700 1 --2- 172.21.15.81:0/2545099894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d00065670 0x7f3d00115c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:46.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.328+0000 7f3cff400700 1 -- 172.21.15.81:0/2545099894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d00065670 msgr2=0x7f3d00115c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:46.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.328+0000 7f3cff400700 1 --2- 172.21.15.81:0/2545099894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d00065670 0x7f3d00115c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:46.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.328+0000 7f3cff400700 1 -- 172.21.15.81:0/2545099894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf0005040 con 0x7f3d00102cc0 2024-04-23T15:02:46.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.328+0000 7f3cffe00700 1 --2- 172.21.15.81:0/2545099894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d00065670 0x7f3d00115c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:02:46.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.329+0000 7f3cff400700 1 --2- 172.21.15.81:0/2545099894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d00102cc0 0x7f3d00116190 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3cec00c8c0 tx=0x7f3cec0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:02:46.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.329+0000 7f3cf7e00700 1 -- 172.21.15.81:0/2545099894 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cec00a980 con 0x7f3d00102cc0 2024-04-23T15:02:46.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.329+0000 7f3d05a00700 1 -- 172.21.15.81:0/2545099894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d0010fee0 con 0x7f3d00102cc0 2024-04-23T15:02:46.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.329+0000 7f3cf7e00700 1 -- 172.21.15.81:0/2545099894 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3cec00ce60 con 0x7f3d00102cc0 2024-04-23T15:02:46.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.329+0000 7f3cf7e00700 1 -- 172.21.15.81:0/2545099894 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cec0115e0 con 0x7f3d00102cc0 2024-04-23T15:02:46.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.329+0000 7f3d05a00700 1 -- 172.21.15.81:0/2545099894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d001104a0 con 0x7f3d00102cc0 2024-04-23T15:02:46.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.330+0000 7f3d05a00700 1 -- 172.21.15.81:0/2545099894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d00101690 con 0x7f3d00102cc0 2024-04-23T15:02:46.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.332+0000 7f3cf7e00700 1 -- 172.21.15.81:0/2545099894 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f3cec012400 con 0x7f3d00102cc0 2024-04-23T15:02:46.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.332+0000 7f3cf7e00700 1 --2- 172.21.15.81:0/2545099894 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f3ce406ec10 0x7f3ce40710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:46.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.333+0000 7f3cf7e00700 1 -- 172.21.15.81:0/2545099894 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f3cec08ea80 con 0x7f3d00102cc0 2024-04-23T15:02:46.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.333+0000 7f3cffe00700 1 --2- 172.21.15.81:0/2545099894 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f3ce406ec10 0x7f3ce40710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:46.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.333+0000 7f3cffe00700 1 --2- 172.21.15.81:0/2545099894 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f3ce406ec10 0x7f3ce40710c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3cf000b3b0 tx=0x7f3cf0009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:02:46.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.337+0000 7f3cf7e00700 1 -- 172.21.15.81:0/2545099894 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f3cec05b2e0 con 0x7f3d00102cc0 2024-04-23T15:02:46.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.654+0000 7f3d05a00700 1 -- 172.21.15.81:0/2545099894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3d001112a0 con 0x7f3d00102cc0 2024-04-23T15:02:46.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.656+0000 7f3cf7e00700 1 -- 172.21.15.81:0/2545099894 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f3cec0126b0 con 0x7f3d00102cc0 2024-04-23T15:02:46.656 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-23T15:02:46.656 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": { 2024-04-23T15:02:46.656 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T15:02:46.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T15:02:46.656 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": { 2024-04-23T15:02:46.656 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 2 2024-04-23T15:02:46.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T15:02:46.657 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": { 2024-04-23T15:02:46.657 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 6 2024-04-23T15:02:46.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T15:02:46.657 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-04-23T15:02:46.657 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 4 2024-04-23T15:02:46.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-23T15:02:46.657 INFO:teuthology.orchestra.run.smithi081.stdout: "overall": { 2024-04-23T15:02:46.657 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)": 14 2024-04-23T15:02:46.657 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-23T15:02:46.657 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-23T15:02:46.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.659+0000 7f3d05a00700 1 -- 172.21.15.81:0/2545099894 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f3ce406ec10 msgr2=0x7f3ce40710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:46.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.659+0000 7f3d05a00700 1 --2- 172.21.15.81:0/2545099894 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f3ce406ec10 0x7f3ce40710c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3cf000b3b0 tx=0x7f3cf0009e30 comp rx=0 tx=0).stop 2024-04-23T15:02:46.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.659+0000 7f3d05a00700 1 -- 172.21.15.81:0/2545099894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d00102cc0 msgr2=0x7f3d00116190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:46.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.659+0000 7f3d05a00700 1 --2- 172.21.15.81:0/2545099894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d00102cc0 0x7f3d00116190 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3cec00c8c0 tx=0x7f3cec0044c0 comp rx=0 tx=0).stop 2024-04-23T15:02:46.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.659+0000 7f3d05a00700 1 -- 172.21.15.81:0/2545099894 shutdown_connections 2024-04-23T15:02:46.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.659+0000 7f3d05a00700 1 --2- 172.21.15.81:0/2545099894 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f3ce406ec10 0x7f3ce40710c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:46.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.659+0000 7f3d05a00700 1 --2- 172.21.15.81:0/2545099894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d00065670 0x7f3d00115c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:46.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.659+0000 7f3d05a00700 1 --2- 172.21.15.81:0/2545099894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d00102cc0 0x7f3d00116190 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:46.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.659+0000 7f3d05a00700 1 -- 172.21.15.81:0/2545099894 >> 172.21.15.81:0/2545099894 conn(0x7f3d00071b70 msgr2=0x7f3d000fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:02:46.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.660+0000 7f3d05a00700 1 -- 172.21.15.81:0/2545099894 shutdown_connections 2024-04-23T15:02:46.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:46.660+0000 7f3d05a00700 1 -- 172.21.15.81:0/2545099894 wait complete. 2024-04-23T15:02:47.030 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:46 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/2545099894' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:02:47.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:46 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/2545099894' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:02:47.466 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -e sha1=d44fddd910b5e94da0f2357af4be37d7bd495ae0 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-04-23T15:02:47.951 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T15:02:48.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:47 smithi156 ceph-mon[77738]: pgmap v349: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-23T15:02:48.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:47 smithi081 ceph-mon[90469]: pgmap v349: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-23T15:02:50.014 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:49 smithi081 ceph-mon[90469]: pgmap v350: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:02:50.036 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:49 smithi156 ceph-mon[77738]: pgmap v350: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:02:50.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.179+0000 7f242d800700 1 -- 172.21.15.81:0/2506045087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2428070300 msgr2=0x7f24280706d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:50.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.179+0000 7f242d800700 1 --2- 172.21.15.81:0/2506045087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2428070300 0x7f24280706d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2418004970 tx=0x7f2418009e30 comp rx=0 tx=0).stop 2024-04-23T15:02:50.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.179+0000 7f242d800700 1 -- 172.21.15.81:0/2506045087 shutdown_connections 2024-04-23T15:02:50.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.179+0000 7f242d800700 1 --2- 172.21.15.81:0/2506045087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2428070c10 0x7f2428108fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:50.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.179+0000 7f242d800700 1 --2- 172.21.15.81:0/2506045087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2428070300 0x7f24280706d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:50.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.179+0000 7f242d800700 1 -- 172.21.15.81:0/2506045087 >> 172.21.15.81:0/2506045087 conn(0x7f24280f8790 msgr2=0x7f24280faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:02:50.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.180+0000 7f242d800700 1 -- 172.21.15.81:0/2506045087 shutdown_connections 2024-04-23T15:02:50.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.180+0000 7f242d800700 1 -- 172.21.15.81:0/2506045087 wait complete. 2024-04-23T15:02:50.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.180+0000 7f242d800700 1 Processor -- start 2024-04-23T15:02:50.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.181+0000 7f242d800700 1 -- start start 2024-04-23T15:02:50.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.181+0000 7f242d800700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2428070300 0x7f2428115b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:50.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.181+0000 7f242d800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2428070c10 0x7f24281160a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:50.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.181+0000 7f242d800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24281166f0 con 0x7f2428070c10 2024-04-23T15:02:50.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.181+0000 7f242d800700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f242810fae0 con 0x7f2428070300 2024-04-23T15:02:50.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.181+0000 7f2427400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2428070c10 0x7f24281160a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:50.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.181+0000 7f2427400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2428070c10 0x7f24281160a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45184/0 (socket says 172.21.15.81:45184) 2024-04-23T15:02:50.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.181+0000 7f2427400700 1 -- 172.21.15.81:0/806366770 learned_addr learned my addr 172.21.15.81:0/806366770 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:02:50.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.182+0000 7f2427e00700 1 --2- 172.21.15.81:0/806366770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2428070300 0x7f2428115b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:50.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.182+0000 7f2427400700 1 -- 172.21.15.81:0/806366770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2428070300 msgr2=0x7f2428115b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:50.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.182+0000 7f2427400700 1 --2- 172.21.15.81:0/806366770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2428070300 0x7f2428115b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:50.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.182+0000 7f2427400700 1 -- 172.21.15.81:0/806366770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2418005040 con 0x7f2428070c10 2024-04-23T15:02:50.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.182+0000 7f2427400700 1 --2- 172.21.15.81:0/806366770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2428070c10 0x7f24281160a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f241400c830 tx=0x7f2414004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:02:50.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.182+0000 7f241fe00700 1 -- 172.21.15.81:0/806366770 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f241400a760 con 0x7f2428070c10 2024-04-23T15:02:50.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.182+0000 7f241fe00700 1 -- 172.21.15.81:0/806366770 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f241400ad90 con 0x7f2428070c10 2024-04-23T15:02:50.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.182+0000 7f241fe00700 1 -- 172.21.15.81:0/806366770 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24140113a0 con 0x7f2428070c10 2024-04-23T15:02:50.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.182+0000 7f242d800700 1 -- 172.21.15.81:0/806366770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f242810fdc0 con 0x7f2428070c10 2024-04-23T15:02:50.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.183+0000 7f242d800700 1 -- 172.21.15.81:0/806366770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2428110300 con 0x7f2428070c10 2024-04-23T15:02:50.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.184+0000 7f242d800700 1 -- 172.21.15.81:0/806366770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2428071a40 con 0x7f2428070c10 2024-04-23T15:02:50.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.185+0000 7f241fe00700 1 -- 172.21.15.81:0/806366770 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f2414012400 con 0x7f2428070c10 2024-04-23T15:02:50.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.186+0000 7f241fe00700 1 --2- 172.21.15.81:0/806366770 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f240c06ec00 0x7f240c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:50.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.186+0000 7f241fe00700 1 -- 172.21.15.81:0/806366770 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f241408e910 con 0x7f2428070c10 2024-04-23T15:02:50.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.186+0000 7f2427e00700 1 --2- 172.21.15.81:0/806366770 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f240c06ec00 0x7f240c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:50.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.187+0000 7f2427e00700 1 --2- 172.21.15.81:0/806366770 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f240c06ec00 0x7f240c0710b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2418004ee0 tx=0x7f2418009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:02:50.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.192+0000 7f241fe00700 1 -- 172.21.15.81:0/806366770 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f241405b1f0 con 0x7f2428070c10 2024-04-23T15:02:50.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.510+0000 7f242d800700 1 -- 172.21.15.81:0/806366770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f24280fc3d0 con 0x7f2428070c10 2024-04-23T15:02:50.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.511+0000 7f241fe00700 1 -- 172.21.15.81:0/806366770 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f241405ad80 con 0x7f2428070c10 2024-04-23T15:02:50.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.514+0000 7f242d800700 1 -- 172.21.15.81:0/806366770 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f240c06ec00 msgr2=0x7f240c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:50.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.514+0000 7f242d800700 1 --2- 172.21.15.81:0/806366770 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f240c06ec00 0x7f240c0710b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2418004ee0 tx=0x7f2418009e30 comp rx=0 tx=0).stop 2024-04-23T15:02:50.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.514+0000 7f242d800700 1 -- 172.21.15.81:0/806366770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2428070c10 msgr2=0x7f24281160a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:50.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.514+0000 7f242d800700 1 --2- 172.21.15.81:0/806366770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2428070c10 0x7f24281160a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f241400c830 tx=0x7f2414004470 comp rx=0 tx=0).stop 2024-04-23T15:02:50.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.514+0000 7f242d800700 1 -- 172.21.15.81:0/806366770 shutdown_connections 2024-04-23T15:02:50.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.514+0000 7f242d800700 1 --2- 172.21.15.81:0/806366770 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f240c06ec00 0x7f240c0710b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:50.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.514+0000 7f242d800700 1 --2- 172.21.15.81:0/806366770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2428070300 0x7f2428115b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:50.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.514+0000 7f242d800700 1 --2- 172.21.15.81:0/806366770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2428070c10 0x7f24281160a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:50.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.514+0000 7f242d800700 1 -- 172.21.15.81:0/806366770 >> 172.21.15.81:0/806366770 conn(0x7f24280f8790 msgr2=0x7f24281057f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:02:50.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.515+0000 7f242d800700 1 -- 172.21.15.81:0/806366770 shutdown_connections 2024-04-23T15:02:50.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:50.515+0000 7f242d800700 1 -- 172.21.15.81:0/806366770 wait complete. 2024-04-23T15:02:50.541 INFO:teuthology.orchestra.run.smithi081.stdout:true 2024-04-23T15:02:51.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:50 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/806366770' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:02:51.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:50 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/806366770' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:02:51.346 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -e sha1=d44fddd910b5e94da0f2357af4be37d7bd495ae0 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-04-23T15:02:51.825 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T15:02:52.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:51 smithi081 ceph-mon[90469]: pgmap v351: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:02:52.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:51 smithi156 ceph-mon[77738]: pgmap v351: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:02:53.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:53.983+0000 7f70fda00700 1 -- 172.21.15.81:0/450580891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70f81094c0 msgr2=0x7f70f8109890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:53.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:53.983+0000 7f70fda00700 1 --2- 172.21.15.81:0/450580891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70f81094c0 0x7f70f8109890 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f70e8004940 tx=0x7f70e8009e30 comp rx=0 tx=0).stop 2024-04-23T15:02:53.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:53.983+0000 7f70fda00700 1 -- 172.21.15.81:0/450580891 shutdown_connections 2024-04-23T15:02:53.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:53.983+0000 7f70fda00700 1 --2- 172.21.15.81:0/450580891 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70f8103460 0x7f70f81038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:53.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:53.983+0000 7f70fda00700 1 --2- 172.21.15.81:0/450580891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70f81094c0 0x7f70f8109890 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:53.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:53.983+0000 7f70fda00700 1 -- 172.21.15.81:0/450580891 >> 172.21.15.81:0/450580891 conn(0x7f70f8072c30 msgr2=0x7f70f8075040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:02:53.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:53.983+0000 7f70fda00700 1 -- 172.21.15.81:0/450580891 shutdown_connections 2024-04-23T15:02:53.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:53.983+0000 7f70fda00700 1 -- 172.21.15.81:0/450580891 wait complete. 2024-04-23T15:02:53.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:53.984+0000 7f70fda00700 1 Processor -- start 2024-04-23T15:02:53.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:53.984+0000 7f70fda00700 1 -- start start 2024-04-23T15:02:53.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:53.984+0000 7f70fda00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70f8103460 0x7f70f8119f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:53.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:53.985+0000 7f70fda00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70f81094c0 0x7f70f811a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:53.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:53.985+0000 7f70fda00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f811ab70 con 0x7f70f8103460 2024-04-23T15:02:53.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:53.985+0000 7f70fda00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f81140c0 con 0x7f70f81094c0 2024-04-23T15:02:53.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:53.985+0000 7f70f6a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70f8103460 0x7f70f8119f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:53.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:53.985+0000 7f70f6a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70f8103460 0x7f70f8119f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53658/0 (socket says 172.21.15.81:53658) 2024-04-23T15:02:53.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:53.985+0000 7f70f6a00700 1 -- 172.21.15.81:0/1113539527 learned_addr learned my addr 172.21.15.81:0/1113539527 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:02:53.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:53.985+0000 7f70f6a00700 1 -- 172.21.15.81:0/1113539527 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70f81094c0 msgr2=0x7f70f811a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:53.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:53.985+0000 7f70f6a00700 1 --2- 172.21.15.81:0/1113539527 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70f81094c0 0x7f70f811a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:53.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:53.985+0000 7f70f6a00700 1 -- 172.21.15.81:0/1113539527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e8005040 con 0x7f70f8103460 2024-04-23T15:02:53.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:53.986+0000 7f70f6a00700 1 --2- 172.21.15.81:0/1113539527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70f8103460 0x7f70f8119f50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f70e8009180 tx=0x7f70e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:02:53.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:53.986+0000 7f70eea00700 1 -- 172.21.15.81:0/1113539527 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70e800e040 con 0x7f70f8103460 2024-04-23T15:02:53.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:53.986+0000 7f70eea00700 1 -- 172.21.15.81:0/1113539527 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f70e800bbc0 con 0x7f70f8103460 2024-04-23T15:02:53.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:53.986+0000 7f70fda00700 1 -- 172.21.15.81:0/1113539527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f81142e0 con 0x7f70f8103460 2024-04-23T15:02:53.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:53.986+0000 7f70eea00700 1 -- 172.21.15.81:0/1113539527 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70e801c630 con 0x7f70f8103460 2024-04-23T15:02:53.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:53.986+0000 7f70fda00700 1 -- 172.21.15.81:0/1113539527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f81148a0 con 0x7f70f8103460 2024-04-23T15:02:53.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:53.987+0000 7f70fda00700 1 -- 172.21.15.81:0/1113539527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70f8104ba0 con 0x7f70f8103460 2024-04-23T15:02:53.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:53.989+0000 7f70eea00700 1 -- 172.21.15.81:0/1113539527 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f70e800bd30 con 0x7f70f8103460 2024-04-23T15:02:53.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:53.990+0000 7f70eea00700 1 --2- 172.21.15.81:0/1113539527 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f70dc06ec00 0x7f70dc0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:53.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:53.990+0000 7f70eea00700 1 -- 172.21.15.81:0/1113539527 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f70e808fd60 con 0x7f70f8103460 2024-04-23T15:02:53.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:53.990+0000 7f70f6000700 1 --2- 172.21.15.81:0/1113539527 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f70dc06ec00 0x7f70dc0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:53.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:53.991+0000 7f70f6000700 1 --2- 172.21.15.81:0/1113539527 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f70dc06ec00 0x7f70dc0710b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f70e4006fd0 tx=0x7f70e4006db0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:02:53.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:53.995+0000 7f70eea00700 1 -- 172.21.15.81:0/1113539527 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f70e8094070 con 0x7f70f8103460 2024-04-23T15:02:54.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:53 smithi081 ceph-mon[90469]: pgmap v352: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:02:54.285 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:53 smithi156 ceph-mon[77738]: pgmap v352: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:02:54.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:54.312+0000 7f70fda00700 1 -- 172.21.15.81:0/1113539527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f70f804c710 con 0x7f70f8103460 2024-04-23T15:02:54.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:54.313+0000 7f70eea00700 1 -- 172.21.15.81:0/1113539527 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f70e805c5c0 con 0x7f70f8103460 2024-04-23T15:02:54.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:54.316+0000 7f70fda00700 1 -- 172.21.15.81:0/1113539527 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f70dc06ec00 msgr2=0x7f70dc0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:54.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:54.316+0000 7f70fda00700 1 --2- 172.21.15.81:0/1113539527 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f70dc06ec00 0x7f70dc0710b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f70e4006fd0 tx=0x7f70e4006db0 comp rx=0 tx=0).stop 2024-04-23T15:02:54.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:54.316+0000 7f70fda00700 1 -- 172.21.15.81:0/1113539527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70f8103460 msgr2=0x7f70f8119f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:54.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:54.316+0000 7f70fda00700 1 --2- 172.21.15.81:0/1113539527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70f8103460 0x7f70f8119f50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f70e8009180 tx=0x7f70e8009e30 comp rx=0 tx=0).stop 2024-04-23T15:02:54.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:54.316+0000 7f70fda00700 1 -- 172.21.15.81:0/1113539527 shutdown_connections 2024-04-23T15:02:54.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:54.316+0000 7f70fda00700 1 --2- 172.21.15.81:0/1113539527 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f70dc06ec00 0x7f70dc0710b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:54.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:54.316+0000 7f70fda00700 1 --2- 172.21.15.81:0/1113539527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70f8103460 0x7f70f8119f50 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:54.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:54.316+0000 7f70fda00700 1 --2- 172.21.15.81:0/1113539527 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70f81094c0 0x7f70f811a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:54.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:54.316+0000 7f70fda00700 1 -- 172.21.15.81:0/1113539527 >> 172.21.15.81:0/1113539527 conn(0x7f70f8072c30 msgr2=0x7f70f8105bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:02:54.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:54.316+0000 7f70fda00700 1 -- 172.21.15.81:0/1113539527 shutdown_connections 2024-04-23T15:02:54.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:54.317+0000 7f70fda00700 1 -- 172.21.15.81:0/1113539527 wait complete. 2024-04-23T15:02:54.333 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph version 19.0.0-3126-gd44fddd9 (d44fddd910b5e94da0f2357af4be37d7bd495ae0) squid (dev)" 2024-04-23T15:02:55.037 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:54 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/1113539527' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:02:55.101 DEBUG:teuthology.parallel:result is None 2024-04-23T15:02:55.102 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-23T15:02:55.115 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi081.front.sepia.ceph.com 2024-04-23T15:02:55.115 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a641bea-017e-11ef-bc93-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-23T15:02:55.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:54 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/1113539527' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-23T15:02:55.574 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/mon.smithi081/config 2024-04-23T15:02:56.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:55 smithi081 ceph-mon[90469]: pgmap v353: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:02:56.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:55 smithi156 ceph-mon[77738]: pgmap v353: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:02:57.284 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:56 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T15:02:57.284 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:56 smithi081 ceph-mon[90469]: pgmap v354: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T15:02:57.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:56 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T15:02:57.286 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:56 smithi156 ceph-mon[77738]: pgmap v354: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T15:02:57.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:57.797+0000 7f1899c00700 1 -- 172.21.15.81:0/1427149525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1894102cc0 msgr2=0x7f1894103090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:57.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:57.797+0000 7f1899c00700 1 --2- 172.21.15.81:0/1427149525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1894102cc0 0x7f1894103090 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1884004940 tx=0x7f1884009e30 comp rx=0 tx=0).stop 2024-04-23T15:02:57.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:57.797+0000 7f1899c00700 1 -- 172.21.15.81:0/1427149525 shutdown_connections 2024-04-23T15:02:57.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:57.797+0000 7f1899c00700 1 --2- 172.21.15.81:0/1427149525 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1894065670 0x7f1894065ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:57.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:57.797+0000 7f1899c00700 1 --2- 172.21.15.81:0/1427149525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1894102cc0 0x7f1894103090 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:57.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:57.797+0000 7f1899c00700 1 -- 172.21.15.81:0/1427149525 >> 172.21.15.81:0/1427149525 conn(0x7f1894071b70 msgr2=0x7f1894071f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:02:57.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:57.797+0000 7f1899c00700 1 -- 172.21.15.81:0/1427149525 shutdown_connections 2024-04-23T15:02:57.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:57.797+0000 7f1899c00700 1 -- 172.21.15.81:0/1427149525 wait complete. 2024-04-23T15:02:57.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:57.798+0000 7f1899c00700 1 Processor -- start 2024-04-23T15:02:57.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:57.798+0000 7f1899c00700 1 -- start start 2024-04-23T15:02:57.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:57.798+0000 7f1899c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1894065670 0x7f1894115c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:57.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:57.798+0000 7f1899c00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1894102cc0 0x7f1894116190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:57.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:57.798+0000 7f1899c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18941167e0 con 0x7f1894065670 2024-04-23T15:02:57.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:57.798+0000 7f1899c00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189410fc00 con 0x7f1894102cc0 2024-04-23T15:02:57.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:57.799+0000 7f1893e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1894065670 0x7f1894115c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:57.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:57.799+0000 7f1893e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1894065670 0x7f1894115c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53670/0 (socket says 172.21.15.81:53670) 2024-04-23T15:02:57.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:57.799+0000 7f1893e00700 1 -- 172.21.15.81:0/3941157429 learned_addr learned my addr 172.21.15.81:0/3941157429 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:02:57.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:57.799+0000 7f188b400700 1 --2- 172.21.15.81:0/3941157429 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1894102cc0 0x7f1894116190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:57.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:57.799+0000 7f1893e00700 1 -- 172.21.15.81:0/3941157429 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1894102cc0 msgr2=0x7f1894116190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:57.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:57.799+0000 7f1893e00700 1 --2- 172.21.15.81:0/3941157429 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1894102cc0 0x7f1894116190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:57.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:57.799+0000 7f1893e00700 1 -- 172.21.15.81:0/3941157429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1884005040 con 0x7f1894065670 2024-04-23T15:02:57.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:57.799+0000 7f1893e00700 1 --2- 172.21.15.81:0/3941157429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1894065670 0x7f1894115c50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1884009180 tx=0x7f1884009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:02:57.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:57.800+0000 7f1890c00700 1 -- 172.21.15.81:0/3941157429 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f188400e040 con 0x7f1894065670 2024-04-23T15:02:57.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:57.800+0000 7f1890c00700 1 -- 172.21.15.81:0/3941157429 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f188400bbc0 con 0x7f1894065670 2024-04-23T15:02:57.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:57.800+0000 7f1890c00700 1 -- 172.21.15.81:0/3941157429 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f188401c630 con 0x7f1894065670 2024-04-23T15:02:57.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:57.800+0000 7f1899c00700 1 -- 172.21.15.81:0/3941157429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f189410fe80 con 0x7f1894065670 2024-04-23T15:02:57.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:57.800+0000 7f1899c00700 1 -- 172.21.15.81:0/3941157429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1894110440 con 0x7f1894065670 2024-04-23T15:02:57.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:57.801+0000 7f1899c00700 1 -- 172.21.15.81:0/3941157429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1894101690 con 0x7f1894065670 2024-04-23T15:02:57.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:57.802+0000 7f1890c00700 1 -- 172.21.15.81:0/3941157429 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f188400bd30 con 0x7f1894065670 2024-04-23T15:02:57.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:57.803+0000 7f1890c00700 1 --2- 172.21.15.81:0/3941157429 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f187806ec10 0x7f18780710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:57.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:57.803+0000 7f1890c00700 1 -- 172.21.15.81:0/3941157429 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f188408fce0 con 0x7f1894065670 2024-04-23T15:02:57.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:57.803+0000 7f188b400700 1 --2- 172.21.15.81:0/3941157429 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f187806ec10 0x7f18780710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:57.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:57.804+0000 7f188b400700 1 --2- 172.21.15.81:0/3941157429 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f187806ec10 0x7f18780710c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f18941114f0 tx=0x7f187c00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:02:57.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:57.808+0000 7f1890c00700 1 -- 172.21.15.81:0/3941157429 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f188405c5c0 con 0x7f1894065670 2024-04-23T15:02:58.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:58.085+0000 7f1899c00700 1 -- 172.21.15.81:0/3941157429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1894109d60 con 0x7f1894065670 2024-04-23T15:02:58.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:58.086+0000 7f1890c00700 1 -- 172.21.15.81:0/3941157429 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 36 v36) v1 ==== 76+0+1967 (secure 0 0 0) 0x7f188405c150 con 0x7f1894065670 2024-04-23T15:02:58.087 INFO:teuthology.orchestra.run.smithi081.stdout:e36 2024-04-23T15:02:58.087 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-23T15:02:58.088 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-23T15:02:58.088 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-04-23T15:02:58.088 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T15:02:58.088 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-04-23T15:02:58.088 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-04-23T15:02:58.088 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 36 2024-04-23T15:02:58.088 INFO:teuthology.orchestra.run.smithi081.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-23T15:02:58.088 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-04-23T14:45:51.264703+0000 2024-04-23T15:02:58.088 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-04-23T14:59:16.388200+0000 2024-04-23T15:02:58.088 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-04-23T15:02:58.088 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-04-23T15:02:58.088 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 60 2024-04-23T15:02:58.088 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-04-23T15:02:58.088 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-04-23T15:02:58.089 INFO:teuthology.orchestra.run.smithi081.stdout:max_xattr_size 65536 2024-04-23T15:02:58.089 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-04-23T15:02:58.089 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-04-23T15:02:58.089 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 86 2024-04-23T15:02:58.089 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-23T15:02:58.089 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 1 2024-04-23T15:02:58.089 INFO:teuthology.orchestra.run.smithi081.stdout:in 0 2024-04-23T15:02:58.089 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=34430} 2024-04-23T15:02:58.089 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-04-23T15:02:58.089 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-04-23T15:02:58.089 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-04-23T15:02:58.089 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-04-23T15:02:58.089 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-04-23T15:02:58.089 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-04-23T15:02:58.089 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-04-23T15:02:58.090 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-04-23T15:02:58.090 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 1 2024-04-23T15:02:58.090 INFO:teuthology.orchestra.run.smithi081.stdout:qdb_cluster leader: 34430 members: 34430 2024-04-23T15:02:58.090 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.wydgcg{0:34430} state up:active seq 24 join_fscid=1 addr [v2:172.21.15.81:6826/3200953351,v1:172.21.15.81:6827/3200953351] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T15:02:58.090 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi081.vcoywg{0:34462} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.81:6828/2598630159,v1:172.21.15.81:6829/2598630159] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T15:02:58.090 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T15:02:58.090 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T15:02:58.090 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-04-23T15:02:58.090 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T15:02:58.090 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.rhbtxt{-1:44273} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.156:6824/3017230919,v1:172.21.15.156:6825/3017230919] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T15:02:58.090 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.cephfs.smithi156.vynkxn{-1:44277} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.156:6826/4079938688,v1:172.21.15.156:6827/4079938688] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T15:02:58.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:58.089+0000 7f1899c00700 1 -- 172.21.15.81:0/3941157429 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f187806ec10 msgr2=0x7f18780710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:58.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:58.089+0000 7f1899c00700 1 --2- 172.21.15.81:0/3941157429 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f187806ec10 0x7f18780710c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f18941114f0 tx=0x7f187c00b040 comp rx=0 tx=0).stop 2024-04-23T15:02:58.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:58.089+0000 7f1899c00700 1 -- 172.21.15.81:0/3941157429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1894065670 msgr2=0x7f1894115c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:58.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:58.089+0000 7f1899c00700 1 --2- 172.21.15.81:0/3941157429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1894065670 0x7f1894115c50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1884009180 tx=0x7f1884009e30 comp rx=0 tx=0).stop 2024-04-23T15:02:58.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:58.089+0000 7f1899c00700 1 -- 172.21.15.81:0/3941157429 shutdown_connections 2024-04-23T15:02:58.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:58.089+0000 7f1899c00700 1 --2- 172.21.15.81:0/3941157429 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f187806ec10 0x7f18780710c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:58.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:58.089+0000 7f1899c00700 1 --2- 172.21.15.81:0/3941157429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1894065670 0x7f1894115c50 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:58.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:58.089+0000 7f1899c00700 1 --2- 172.21.15.81:0/3941157429 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1894102cc0 0x7f1894116190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:58.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:58.089+0000 7f1899c00700 1 -- 172.21.15.81:0/3941157429 >> 172.21.15.81:0/3941157429 conn(0x7f1894071b70 msgr2=0x7f18940fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:02:58.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:58.090+0000 7f1899c00700 1 -- 172.21.15.81:0/3941157429 shutdown_connections 2024-04-23T15:02:58.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:58.090+0000 7f1899c00700 1 -- 172.21.15.81:0/3941157429 wait complete. 2024-04-23T15:02:58.092 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 36 2024-04-23T15:02:58.450 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:58 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/3941157429' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T15:02:58.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:58 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/3941157429' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T15:02:58.885 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-04-23T15:02:58.895 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T15:02:59.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.082+0000 7f7ecc400640 1 -- 172.21.15.81:0/3192667721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ec4104d60 msgr2=0x7f7ec40fe3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:59.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.082+0000 7f7ecc400640 1 --2- 172.21.15.81:0/3192667721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ec4104d60 0x7f7ec40fe3f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7eb00048d0 tx=0x7f7eb0009da0 comp rx=0 tx=0).stop 2024-04-23T15:02:59.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.083+0000 7f7ecc400640 1 -- 172.21.15.81:0/3192667721 shutdown_connections 2024-04-23T15:02:59.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.083+0000 7f7ecc400640 1 --2- 172.21.15.81:0/3192667721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ec4104d60 0x7f7ec40fe3f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:59.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.083+0000 7f7ecc400640 1 --2- 172.21.15.81:0/3192667721 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ec41043c0 0x7f7ec4104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:59.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.083+0000 7f7ecc400640 1 -- 172.21.15.81:0/3192667721 >> 172.21.15.81:0/3192667721 conn(0x7f7ec40f9fc0 msgr2=0x7f7ec40fc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:02:59.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.083+0000 7f7ecc400640 1 -- 172.21.15.81:0/3192667721 shutdown_connections 2024-04-23T15:02:59.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.083+0000 7f7ecc400640 1 -- 172.21.15.81:0/3192667721 wait complete. 2024-04-23T15:02:59.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.083+0000 7f7ecc400640 1 Processor -- start 2024-04-23T15:02:59.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.083+0000 7f7ecc400640 1 -- start start 2024-04-23T15:02:59.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.084+0000 7f7ecc400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ec41043c0 0x7f7ec4114f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:59.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.084+0000 7f7ecc400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ec4104d60 0x7f7ec4115480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:59.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.084+0000 7f7ecc400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec4115b10 con 0x7f7ec41043c0 2024-04-23T15:02:59.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.084+0000 7f7ecc400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec410f0d0 con 0x7f7ec4104d60 2024-04-23T15:02:59.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.084+0000 7f7ec9a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ec41043c0 0x7f7ec4114f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:59.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.084+0000 7f7ec9a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ec41043c0 0x7f7ec4114f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53682/0 (socket says 172.21.15.81:53682) 2024-04-23T15:02:59.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.084+0000 7f7ec9a00640 1 -- 172.21.15.81:0/3078648087 learned_addr learned my addr 172.21.15.81:0/3078648087 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:02:59.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.085+0000 7f7ec9000640 1 --2- 172.21.15.81:0/3078648087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ec4104d60 0x7f7ec4115480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:59.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.085+0000 7f7ec9a00640 1 -- 172.21.15.81:0/3078648087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ec4104d60 msgr2=0x7f7ec4115480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:59.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.085+0000 7f7ec9a00640 1 --2- 172.21.15.81:0/3078648087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ec4104d60 0x7f7ec4115480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:59.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.085+0000 7f7ec9a00640 1 -- 172.21.15.81:0/3078648087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb0005040 con 0x7f7ec41043c0 2024-04-23T15:02:59.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.085+0000 7f7ec9a00640 1 --2- 172.21.15.81:0/3078648087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ec41043c0 0x7f7ec4114f40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7eb800b790 tx=0x7f7eb80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:02:59.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.085+0000 7f7ec1600640 1 -- 172.21.15.81:0/3078648087 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7eb800c700 con 0x7f7ec41043c0 2024-04-23T15:02:59.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.085+0000 7f7ecc400640 1 -- 172.21.15.81:0/3078648087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec410f3b0 con 0x7f7ec41043c0 2024-04-23T15:02:59.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.085+0000 7f7ec1600640 1 -- 172.21.15.81:0/3078648087 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7eb800cd30 con 0x7f7ec41043c0 2024-04-23T15:02:59.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.085+0000 7f7ec1600640 1 -- 172.21.15.81:0/3078648087 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7eb8013370 con 0x7f7ec41043c0 2024-04-23T15:02:59.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.085+0000 7f7ecc400640 1 -- 172.21.15.81:0/3078648087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec410f8d0 con 0x7f7ec41043c0 2024-04-23T15:02:59.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.087+0000 7f7ecc400640 1 -- 172.21.15.81:0/3078648087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ec40ffb30 con 0x7f7ec41043c0 2024-04-23T15:02:59.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.088+0000 7f7ec1600640 1 -- 172.21.15.81:0/3078648087 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f7eb8012070 con 0x7f7ec41043c0 2024-04-23T15:02:59.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.089+0000 7f7ec1600640 1 --2- 172.21.15.81:0/3078648087 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f7eac06eb70 0x7f7eac071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:59.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.089+0000 7f7ec1600640 1 -- 172.21.15.81:0/3078648087 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f7eb808e5f0 con 0x7f7ec41043c0 2024-04-23T15:02:59.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.089+0000 7f7ec9000640 1 --2- 172.21.15.81:0/3078648087 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f7eac06eb70 0x7f7eac071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:59.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.090+0000 7f7ec9000640 1 --2- 172.21.15.81:0/3078648087 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f7eac06eb70 0x7f7eac071020 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0000c00 tx=0x7f7eb0009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:02:59.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.093+0000 7f7ec1600640 1 -- 172.21.15.81:0/3078648087 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f7eb80572a0 con 0x7f7ec41043c0 2024-04-23T15:02:59.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.288+0000 7f7ecc400640 1 -- 172.21.15.81:0/3078648087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ec4064380 con 0x7f7ec41043c0 2024-04-23T15:02:59.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.291+0000 7f7ec1600640 1 -- 172.21.15.81:0/3078648087 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+16784 (secure 0 0 0) 0x7f7eb805a960 con 0x7f7ec41043c0 2024-04-23T15:02:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T15:02:59.293 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":86,"fsid":"7a641bea-017e-11ef-bc93-c7b262605968","created":"2024-04-23T14:37:06.214022+0000","modified":"2024-04-23T14:58:57.639326+0000","last_up_change":"2024-04-23T14:57:29.638719+0000","last_in_change":"2024-04-23T14:43:50.423631+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T14:42:32.718276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-23T14:45:50.013431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-23T14:45:50.800862+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c084af11-7048-409a-9932-9ede242d3abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":50,"up_from":54,"up_thru":79,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":754768728},{"type":"v1","addr":"172.21.15.81:6803","nonce":754768728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":754768728},{"type":"v1","addr":"172.21.15.81:6805","nonce":754768728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":754768728},{"type":"v1","addr":"172.21.15.81:6809","nonce":754768728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":754768728},{"type":"v1","addr":"172.21.15.81:6807","nonce":754768728}]},"public_addr":"172.21.15.81:6803/754768728","cluster_addr":"172.21.15.81:6805/754768728","heartbeat_back_addr":"172.21.15.81:6809/754768728","heartbeat_front_addr":"172.21.15.81:6807/754768728","state":["exists","up"]},{"osd":1,"uuid":"0b642368-c907-404e-9f69-32f059f5426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":55,"up_from":59,"up_thru":79,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3551141175},{"type":"v1","addr":"172.21.15.81:6811","nonce":3551141175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3551141175},{"type":"v1","addr":"172.21.15.81:6813","nonce":3551141175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3551141175},{"type":"v1","addr":"172.21.15.81:6817","nonce":3551141175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3551141175},{"type":"v1","addr":"172.21.15.81:6815","nonce":3551141175}]},"public_addr":"172.21.15.81:6811/3551141175","cluster_addr":"172.21.15.81:6813/3551141175","heartbeat_back_addr":"172.21.15.81:6817/3551141175","heartbeat_front_addr":"172.21.15.81:6815/3551141175","state":["exists","up"]},{"osd":2,"uuid":"cde59edc-3e7d-4d53-ba08-a67ec2250898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":60,"up_from":64,"up_thru":79,"down_at":61,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3628575897},{"type":"v1","addr":"172.21.15.81:6819","nonce":3628575897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3628575897},{"type":"v1","addr":"172.21.15.81:6821","nonce":3628575897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3628575897},{"type":"v1","addr":"172.21.15.81:6825","nonce":3628575897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3628575897},{"type":"v1","addr":"172.21.15.81:6823","nonce":3628575897}]},"public_addr":"172.21.15.81:6819/3628575897","cluster_addr":"172.21.15.81:6821/3628575897","heartbeat_back_addr":"172.21.15.81:6825/3628575897","heartbeat_front_addr":"172.21.15.81:6823/3628575897","state":["exists","up"]},{"osd":3,"uuid":"722814fb-aeb5-4765-8440-05563f47c8ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":65,"up_from":69,"up_thru":79,"down_at":66,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":3882389280},{"type":"v1","addr":"172.21.15.156:6801","nonce":3882389280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":3882389280},{"type":"v1","addr":"172.21.15.156:6803","nonce":3882389280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":3882389280},{"type":"v1","addr":"172.21.15.156:6807","nonce":3882389280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":3882389280},{"type":"v1","addr":"172.21.15.156:6805","nonce":3882389280}]},"public_addr":"172.21.15.156:6801/3882389280","cluster_addr":"172.21.15.156:6803/3882389280","heartbeat_back_addr":"172.21.15.156:6807/3882389280","heartbeat_front_addr":"172.21.15.156:6805/3882389280","state":["exists","up"]},{"osd":4,"uuid":"2f660c6e-38d1-4982-9cba-46242bf2de6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":70,"up_from":74,"up_thru":79,"down_at":71,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":1123408224},{"type":"v1","addr":"172.21.15.156:6809","nonce":1123408224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":1123408224},{"type":"v1","addr":"172.21.15.156:6811","nonce":1123408224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":1123408224},{"type":"v1","addr":"172.21.15.156:6815","nonce":1123408224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":1123408224},{"type":"v1","addr":"172.21.15.156:6813","nonce":1123408224}]},"public_addr":"172.21.15.156:6809/1123408224","cluster_addr":"172.21.15.156:6811/1123408224","heartbeat_back_addr":"172.21.15.156:6815/1123408224","heartbeat_front_addr":"172.21.15.156:6813/1123408224","state":["exists","up"]},{"osd":5,"uuid":"82590b0d-f1e5-4491-b341-8db75ce2ea50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":75,"up_from":79,"up_thru":79,"down_at":76,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":2022300921},{"type":"v1","addr":"172.21.15.156:6817","nonce":2022300921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":2022300921},{"type":"v1","addr":"172.21.15.156:6819","nonce":2022300921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":2022300921},{"type":"v1","addr":"172.21.15.156:6823","nonce":2022300921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":2022300921},{"type":"v1","addr":"172.21.15.156:6821","nonce":2022300921}]},"public_addr":"172.21.15.156:6817/2022300921","cluster_addr":"172.21.15.156:6819/2022300921","heartbeat_back_addr":"172.21.15.156:6823/2022300921","heartbeat_front_addr":"172.21.15.156:6821/2022300921","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:16.189027+0000","dead_epoch":50},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:52.737106+0000","dead_epoch":55},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:42:29.838157+0000","dead_epoch":60},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:03.041762+0000","dead_epoch":65},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:37.248449+0000","dead_epoch":70},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:12.266170+0000","dead_epoch":75}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.156:6827/1794690362":"2024-04-24T14:58:57.639279+0000","172.21.15.81:6828/2563365650":"2024-04-24T14:58:05.875418+0000","172.21.15.81:6800/2072638798":"2024-04-24T14:38:16.825251+0000","172.21.15.81:0/4290566211":"2024-04-24T14:39:42.006227+0000","172.21.15.156:0/857010754":"2024-04-24T14:50:55.422683+0000","172.21.15.156:6829/100981835":"2024-04-24T14:50:55.422683+0000","172.21.15.81:0/1248767795":"2024-04-24T14:48:47.697101+0000","172.21.15.81:0/4004069135":"2024-04-24T14:37:38.176351+0000","172.21.15.81:0/3883051436":"2024-04-24T14:39:42.006227+0000","172.21.15.81:0/4052641920":"2024-04-24T14:52:26.432602+0000","172.21.15.81:0/3215003917":"2024-04-24T14:48:47.697101+0000","172.21.15.156:6826/1794690362":"2024-04-24T14:58:57.639279+0000","172.21.15.81:0/2253455652":"2024-04-24T14:37:38.176351+0000","172.21.15.81:0/1308908574":"2024-04-24T14:39:42.006227+0000","172.21.15.81:6800/1053506915":"2024-04-24T14:48:47.697101+0000","172.21.15.81:6801/2072638798":"2024-04-24T14:38:16.825251+0000","172.21.15.156:0/4195008831":"2024-04-24T14:50:55.422683+0000","172.21.15.81:6826/2500326945":"2024-04-24T14:46:09.390974+0000","172.21.15.156:6828/100981835":"2024-04-24T14:50:55.422683+0000","172.21.15.81:6827/2500326945":"2024-04-24T14:46:09.390974+0000","172.21.15.81:6801/1053506915":"2024-04-24T14:48:47.697101+0000","172.21.15.81:6800/3624015234":"2024-04-24T14:39:42.006227+0000","172.21.15.81:0/4040210849":"2024-04-24T14:52:26.432602+0000","172.21.15.81:0/2921033786":"2024-04-24T14:48:47.697101+0000","172.21.15.81:0/3010656646":"2024-04-24T14:37:38.176351+0000","172.21.15.156:0/3679467655":"2024-04-24T14:50:55.422683+0000","172.21.15.81:0/644202147":"2024-04-24T14:38:16.825251+0000","172.21.15.81:0/3173386887":"2024-04-24T14:38:16.825251+0000","172.21.15.81:6800/1764050360":"2024-04-24T14:37:38.176351+0000","172.21.15.81:6801/1880997914":"2024-04-24T14:52:26.432602+0000","172.21.15.81:0/71326574":"2024-04-24T14:52:26.432602+0000","172.21.15.81:6829/2563365650":"2024-04-24T14:58:05.875418+0000","172.21.15.81:6801/3624015234":"2024-04-24T14:39:42.006227+0000","172.21.15.81:6801/1764050360":"2024-04-24T14:37:38.176351+0000","172.21.15.81:0/652570605":"2024-04-24T14:38:16.825251+0000","172.21.15.81:6800/1880997914":"2024-04-24T14:52:26.432602+0000","172.21.15.81:0/1758342948":"2024-04-24T14:52:26.432602+0000","172.21.15.81:0/3287016492":"2024-04-24T14:52:26.432602+0000","172.21.15.81:0/934339506":"2024-04-24T14:48:47.697101+0000","172.21.15.156:0/1820858846":"2024-04-24T14:50:55.422683+0000","172.21.15.81:0/2623320468":"2024-04-24T14:52:26.432602+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T15:02:59.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.293+0000 7f7ecc400640 1 -- 172.21.15.81:0/3078648087 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f7eac06eb70 msgr2=0x7f7eac071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:59.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.293+0000 7f7ecc400640 1 --2- 172.21.15.81:0/3078648087 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f7eac06eb70 0x7f7eac071020 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0000c00 tx=0x7f7eb0009da0 comp rx=0 tx=0).stop 2024-04-23T15:02:59.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.293+0000 7f7ecc400640 1 -- 172.21.15.81:0/3078648087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ec41043c0 msgr2=0x7f7ec4114f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:59.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.293+0000 7f7ecc400640 1 --2- 172.21.15.81:0/3078648087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ec41043c0 0x7f7ec4114f40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7eb800b790 tx=0x7f7eb80091d0 comp rx=0 tx=0).stop 2024-04-23T15:02:59.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.294+0000 7f7ecc400640 1 -- 172.21.15.81:0/3078648087 shutdown_connections 2024-04-23T15:02:59.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.294+0000 7f7ecc400640 1 --2- 172.21.15.81:0/3078648087 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f7eac06eb70 0x7f7eac071020 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:59.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.294+0000 7f7ecc400640 1 --2- 172.21.15.81:0/3078648087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ec4104d60 0x7f7ec4115480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:59.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.294+0000 7f7ecc400640 1 --2- 172.21.15.81:0/3078648087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ec41043c0 0x7f7ec4114f40 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:59.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.294+0000 7f7ecc400640 1 -- 172.21.15.81:0/3078648087 >> 172.21.15.81:0/3078648087 conn(0x7f7ec40f9fc0 msgr2=0x7f7ec40faf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:02:59.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.294+0000 7f7ecc400640 1 -- 172.21.15.81:0/3078648087 shutdown_connections 2024-04-23T15:02:59.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.294+0000 7f7ecc400640 1 -- 172.21.15.81:0/3078648087 wait complete. 2024-04-23T15:02:59.311 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T14:42:32.718276+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-23T14:45:50.013431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-23T14:45:50.800862+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-23T15:02:59.311 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T15:02:59.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.495+0000 7f91b3e00640 1 -- 172.21.15.81:0/2717756785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91b4064cf0 msgr2=0x7f91b4108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:59.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.495+0000 7f91b3e00640 1 --2- 172.21.15.81:0/2717756785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91b4064cf0 0x7f91b4108570 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f919c004900 tx=0x7f919c009da0 comp rx=0 tx=0).stop 2024-04-23T15:02:59.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.495+0000 7f91b3e00640 1 -- 172.21.15.81:0/2717756785 shutdown_connections 2024-04-23T15:02:59.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.495+0000 7f91b3e00640 1 --2- 172.21.15.81:0/2717756785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91b4064cf0 0x7f91b4108570 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:59.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.495+0000 7f91b3e00640 1 --2- 172.21.15.81:0/2717756785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91b40643e0 0x7f91b40647b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:59.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.495+0000 7f91b3e00640 1 -- 172.21.15.81:0/2717756785 >> 172.21.15.81:0/2717756785 conn(0x7f91b4071df0 msgr2=0x7f91b40721f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:02:59.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.495+0000 7f91b3e00640 1 -- 172.21.15.81:0/2717756785 shutdown_connections 2024-04-23T15:02:59.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.495+0000 7f91b3e00640 1 -- 172.21.15.81:0/2717756785 wait complete. 2024-04-23T15:02:59.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.496+0000 7f91b3e00640 1 Processor -- start 2024-04-23T15:02:59.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.496+0000 7f91b3e00640 1 -- start start 2024-04-23T15:02:59.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.497+0000 7f91b3e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91b40643e0 0x7f91b4114d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:59.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.497+0000 7f91b3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91b4064cf0 0x7f91b4115240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:59.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.497+0000 7f91b3e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b4115840 con 0x7f91b4064cf0 2024-04-23T15:02:59.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.497+0000 7f91b3e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b410ee90 con 0x7f91b40643e0 2024-04-23T15:02:59.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.497+0000 7f91abe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91b4064cf0 0x7f91b4115240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:59.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.497+0000 7f91abe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91b4064cf0 0x7f91b4115240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53694/0 (socket says 172.21.15.81:53694) 2024-04-23T15:02:59.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.497+0000 7f91abe00640 1 -- 172.21.15.81:0/2336413882 learned_addr learned my addr 172.21.15.81:0/2336413882 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:02:59.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.497+0000 7f91abe00640 1 -- 172.21.15.81:0/2336413882 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91b40643e0 msgr2=0x7f91b4114d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:59.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.497+0000 7f91abe00640 1 --2- 172.21.15.81:0/2336413882 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91b40643e0 0x7f91b4114d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:59.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.497+0000 7f91abe00640 1 -- 172.21.15.81:0/2336413882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f919c005040 con 0x7f91b4064cf0 2024-04-23T15:02:59.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.498+0000 7f91abe00640 1 --2- 172.21.15.81:0/2336413882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91b4064cf0 0x7f91b4115240 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f919c02be50 tx=0x7f919c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:02:59.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.498+0000 7f91aaa00640 1 -- 172.21.15.81:0/2336413882 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f919c0094c0 con 0x7f91b4064cf0 2024-04-23T15:02:59.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.498+0000 7f91aaa00640 1 -- 172.21.15.81:0/2336413882 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f919c03d920 con 0x7f91b4064cf0 2024-04-23T15:02:59.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.498+0000 7f91b3e00640 1 -- 172.21.15.81:0/2336413882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91b410f110 con 0x7f91b4064cf0 2024-04-23T15:02:59.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.498+0000 7f91aaa00640 1 -- 172.21.15.81:0/2336413882 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f919c03b870 con 0x7f91b4064cf0 2024-04-23T15:02:59.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.498+0000 7f91b3e00640 1 -- 172.21.15.81:0/2336413882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b410f6b0 con 0x7f91b4064cf0 2024-04-23T15:02:59.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.499+0000 7f91b3e00640 1 -- 172.21.15.81:0/2336413882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91b40fb590 con 0x7f91b4064cf0 2024-04-23T15:02:59.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.500+0000 7f91aaa00640 1 -- 172.21.15.81:0/2336413882 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f919c03da90 con 0x7f91b4064cf0 2024-04-23T15:02:59.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.501+0000 7f91aaa00640 1 --2- 172.21.15.81:0/2336413882 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f919806eb80 0x7f9198071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:59.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.501+0000 7f91aaa00640 1 -- 172.21.15.81:0/2336413882 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f919c0b1630 con 0x7f91b4064cf0 2024-04-23T15:02:59.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.501+0000 7f91b2a00640 1 --2- 172.21.15.81:0/2336413882 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f919806eb80 0x7f9198071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:59.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.502+0000 7f91b2a00640 1 --2- 172.21.15.81:0/2336413882 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f919806eb80 0x7f9198071030 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f91a4004a50 tx=0x7f91a4007ba0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:02:59.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.506+0000 7f91aaa00640 1 -- 172.21.15.81:0/2336413882 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f919c07a360 con 0x7f91b4064cf0 2024-04-23T15:02:59.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:02:59 smithi156 ceph-mon[77738]: pgmap v355: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:02:59.575 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:02:59 smithi081 ceph-mon[90469]: pgmap v355: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:02:59.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.712+0000 7f91b3e00640 1 -- 172.21.15.81:0/2336413882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f91b410b320 con 0x7f91b4064cf0 2024-04-23T15:02:59.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.713+0000 7f91aaa00640 1 -- 172.21.15.81:0/2336413882 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f919c07da20 con 0x7f91b4064cf0 2024-04-23T15:02:59.714 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-04-23T15:02:59.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.717+0000 7f91b3e00640 1 -- 172.21.15.81:0/2336413882 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f919806eb80 msgr2=0x7f9198071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:59.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.717+0000 7f91b3e00640 1 --2- 172.21.15.81:0/2336413882 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f919806eb80 0x7f9198071030 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f91a4004a50 tx=0x7f91a4007ba0 comp rx=0 tx=0).stop 2024-04-23T15:02:59.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.717+0000 7f91b3e00640 1 -- 172.21.15.81:0/2336413882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91b4064cf0 msgr2=0x7f91b4115240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:59.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.717+0000 7f91b3e00640 1 --2- 172.21.15.81:0/2336413882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91b4064cf0 0x7f91b4115240 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f919c02be50 tx=0x7f919c009da0 comp rx=0 tx=0).stop 2024-04-23T15:02:59.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.718+0000 7f91b3e00640 1 -- 172.21.15.81:0/2336413882 shutdown_connections 2024-04-23T15:02:59.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.718+0000 7f91b3e00640 1 --2- 172.21.15.81:0/2336413882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91b4064cf0 0x7f91b4115240 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:59.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.718+0000 7f91b3e00640 1 --2- 172.21.15.81:0/2336413882 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f919806eb80 0x7f9198071030 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:59.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.718+0000 7f91b3e00640 1 --2- 172.21.15.81:0/2336413882 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91b40643e0 0x7f91b4114d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:59.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.718+0000 7f91b3e00640 1 -- 172.21.15.81:0/2336413882 >> 172.21.15.81:0/2336413882 conn(0x7f91b4071df0 msgr2=0x7f91b40f8820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:02:59.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.718+0000 7f91b3e00640 1 -- 172.21.15.81:0/2336413882 shutdown_connections 2024-04-23T15:02:59.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.718+0000 7f91b3e00640 1 -- 172.21.15.81:0/2336413882 wait complete. 2024-04-23T15:02:59.737 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-23T15:02:59.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.909+0000 7f89f9a00640 1 -- 172.21.15.81:0/947468591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89f4070180 msgr2=0x7f89f4108360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:59.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.909+0000 7f89f9a00640 1 --2- 172.21.15.81:0/947468591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89f4070180 0x7f89f4108360 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f89dc0048d0 tx=0x7f89dc009da0 comp rx=0 tx=0).stop 2024-04-23T15:02:59.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.909+0000 7f89f9a00640 1 -- 172.21.15.81:0/947468591 shutdown_connections 2024-04-23T15:02:59.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.909+0000 7f89f9a00640 1 --2- 172.21.15.81:0/947468591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89f4070180 0x7f89f4108360 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:59.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.909+0000 7f89f9a00640 1 --2- 172.21.15.81:0/947468591 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89f406f870 0x7f89f406fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:59.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.909+0000 7f89f9a00640 1 -- 172.21.15.81:0/947468591 >> 172.21.15.81:0/947468591 conn(0x7f89f40f7be0 msgr2=0x7f89f40f9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:02:59.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.910+0000 7f89f9a00640 1 -- 172.21.15.81:0/947468591 shutdown_connections 2024-04-23T15:02:59.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.910+0000 7f89f9a00640 1 -- 172.21.15.81:0/947468591 wait complete. 2024-04-23T15:02:59.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.910+0000 7f89f9a00640 1 Processor -- start 2024-04-23T15:02:59.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.910+0000 7f89f9a00640 1 -- start start 2024-04-23T15:02:59.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.911+0000 7f89f9a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89f406f870 0x7f89f4114e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:59.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.911+0000 7f89f9a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89f4070180 0x7f89f41153d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:59.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.911+0000 7f89f9a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f4115a60 con 0x7f89f4070180 2024-04-23T15:02:59.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.911+0000 7f89f9a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f410f020 con 0x7f89f406f870 2024-04-23T15:02:59.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.911+0000 7f89eb400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89f4070180 0x7f89f41153d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:59.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.911+0000 7f89eb400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89f4070180 0x7f89f41153d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53716/0 (socket says 172.21.15.81:53716) 2024-04-23T15:02:59.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.911+0000 7f89eb400640 1 -- 172.21.15.81:0/3662346957 learned_addr learned my addr 172.21.15.81:0/3662346957 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:02:59.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.911+0000 7f89eb400640 1 -- 172.21.15.81:0/3662346957 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89f406f870 msgr2=0x7f89f4114e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:02:59.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.911+0000 7f89eb400640 1 --2- 172.21.15.81:0/3662346957 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89f406f870 0x7f89f4114e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:02:59.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.911+0000 7f89eb400640 1 -- 172.21.15.81:0/3662346957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89dc005040 con 0x7f89f4070180 2024-04-23T15:02:59.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.912+0000 7f89eb400640 1 --2- 172.21.15.81:0/3662346957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89f4070180 0x7f89f41153d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f89dc0047f0 tx=0x7f89dc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:02:59.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.912+0000 7f89f0c00640 1 -- 172.21.15.81:0/3662346957 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89dc0094c0 con 0x7f89f4070180 2024-04-23T15:02:59.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.912+0000 7f89f0c00640 1 -- 172.21.15.81:0/3662346957 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f89dc0315f0 con 0x7f89f4070180 2024-04-23T15:02:59.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.912+0000 7f89f0c00640 1 -- 172.21.15.81:0/3662346957 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89dc0435f0 con 0x7f89f4070180 2024-04-23T15:02:59.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.912+0000 7f89f9a00640 1 -- 172.21.15.81:0/3662346957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f410f2a0 con 0x7f89f4070180 2024-04-23T15:02:59.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.912+0000 7f89f9a00640 1 -- 172.21.15.81:0/3662346957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f410f760 con 0x7f89f4070180 2024-04-23T15:02:59.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.913+0000 7f89f9a00640 1 -- 172.21.15.81:0/3662346957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f4070fb0 con 0x7f89f4070180 2024-04-23T15:02:59.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.914+0000 7f89f0c00640 1 -- 172.21.15.81:0/3662346957 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f89dc02f070 con 0x7f89f4070180 2024-04-23T15:02:59.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.915+0000 7f89f0c00640 1 --2- 172.21.15.81:0/3662346957 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f89d806eb80 0x7f89d8071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:02:59.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.915+0000 7f89f0c00640 1 -- 172.21.15.81:0/3662346957 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f89dc0b06f0 con 0x7f89f4070180 2024-04-23T15:02:59.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.915+0000 7f89f3e00640 1 --2- 172.21.15.81:0/3662346957 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f89d806eb80 0x7f89d8071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:02:59.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.916+0000 7f89f3e00640 1 --2- 172.21.15.81:0/3662346957 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f89d806eb80 0x7f89d8071030 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f89e400acf0 tx=0x7f89e4009370 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:02:59.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:02:59.920+0000 7f89f0c00640 1 -- 172.21.15.81:0/3662346957 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f89dc079420 con 0x7f89f4070180 2024-04-23T15:03:00.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.118+0000 7f89f9a00640 1 -- 172.21.15.81:0/3662346957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f89f404bcc0 con 0x7f89f4070180 2024-04-23T15:03:00.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.119+0000 7f89f0c00640 1 -- 172.21.15.81:0/3662346957 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v86) v1 ==== 107+0+11 (secure 0 0 0) 0x7f89dc07cae0 con 0x7f89f4070180 2024-04-23T15:03:00.120 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-04-23T15:03:00.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.122+0000 7f89f9a00640 1 -- 172.21.15.81:0/3662346957 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f89d806eb80 msgr2=0x7f89d8071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:00.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.122+0000 7f89f9a00640 1 --2- 172.21.15.81:0/3662346957 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f89d806eb80 0x7f89d8071030 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f89e400acf0 tx=0x7f89e4009370 comp rx=0 tx=0).stop 2024-04-23T15:03:00.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.122+0000 7f89f9a00640 1 -- 172.21.15.81:0/3662346957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89f4070180 msgr2=0x7f89f41153d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:00.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.122+0000 7f89f9a00640 1 --2- 172.21.15.81:0/3662346957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89f4070180 0x7f89f41153d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f89dc0047f0 tx=0x7f89dc009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:00.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.122+0000 7f89f9a00640 1 -- 172.21.15.81:0/3662346957 shutdown_connections 2024-04-23T15:03:00.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.122+0000 7f89f9a00640 1 --2- 172.21.15.81:0/3662346957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89f4070180 0x7f89f41153d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:00.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.122+0000 7f89f9a00640 1 --2- 172.21.15.81:0/3662346957 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f89d806eb80 0x7f89d8071030 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:00.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.122+0000 7f89f9a00640 1 --2- 172.21.15.81:0/3662346957 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89f406f870 0x7f89f4114e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:00.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.122+0000 7f89f9a00640 1 -- 172.21.15.81:0/3662346957 >> 172.21.15.81:0/3662346957 conn(0x7f89f40f7be0 msgr2=0x7f89f40f8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:00.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.123+0000 7f89f9a00640 1 -- 172.21.15.81:0/3662346957 shutdown_connections 2024-04-23T15:03:00.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.123+0000 7f89f9a00640 1 -- 172.21.15.81:0/3662346957 wait complete. 2024-04-23T15:03:00.141 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-23T15:03:00.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.341+0000 7f3845600640 1 -- 172.21.15.81:0/1980661148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3840104410 msgr2=0x7f38401047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:00.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.341+0000 7f3845600640 1 --2- 172.21.15.81:0/1980661148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3840104410 0x7f38401047e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3830009c50 tx=0x7f3830004d10 comp rx=0 tx=0).stop 2024-04-23T15:03:00.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.342+0000 7f3845600640 1 -- 172.21.15.81:0/1980661148 shutdown_connections 2024-04-23T15:03:00.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.342+0000 7f3845600640 1 --2- 172.21.15.81:0/1980661148 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3840104db0 0x7f38400fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:00.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.342+0000 7f3845600640 1 --2- 172.21.15.81:0/1980661148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3840104410 0x7f38401047e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:00.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.342+0000 7f3845600640 1 -- 172.21.15.81:0/1980661148 >> 172.21.15.81:0/1980661148 conn(0x7f38400fa020 msgr2=0x7f38400fc430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:00.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.342+0000 7f3845600640 1 -- 172.21.15.81:0/1980661148 shutdown_connections 2024-04-23T15:03:00.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.342+0000 7f3845600640 1 -- 172.21.15.81:0/1980661148 wait complete. 2024-04-23T15:03:00.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.343+0000 7f3845600640 1 Processor -- start 2024-04-23T15:03:00.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.343+0000 7f3845600640 1 -- start start 2024-04-23T15:03:00.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.343+0000 7f3845600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3840104410 0x7f3840114f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:00.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.343+0000 7f3845600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3840104db0 0x7f3840115470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:00.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.343+0000 7f3845600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3840115a70 con 0x7f3840104db0 2024-04-23T15:03:00.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.343+0000 7f3845600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384010f0c0 con 0x7f3840104410 2024-04-23T15:03:00.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.343+0000 7f3836000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3840104db0 0x7f3840115470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:00.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.344+0000 7f3836000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3840104db0 0x7f3840115470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53724/0 (socket says 172.21.15.81:53724) 2024-04-23T15:03:00.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.344+0000 7f3836000640 1 -- 172.21.15.81:0/2872626969 learned_addr learned my addr 172.21.15.81:0/2872626969 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:03:00.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.344+0000 7f383ea00640 1 --2- 172.21.15.81:0/2872626969 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3840104410 0x7f3840114f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:00.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.344+0000 7f3836000640 1 -- 172.21.15.81:0/2872626969 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3840104410 msgr2=0x7f3840114f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:00.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.344+0000 7f3836000640 1 --2- 172.21.15.81:0/2872626969 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3840104410 0x7f3840114f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:00.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.344+0000 7f3836000640 1 -- 172.21.15.81:0/2872626969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38300098b0 con 0x7f3840104db0 2024-04-23T15:03:00.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.344+0000 7f3836000640 1 --2- 172.21.15.81:0/2872626969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3840104db0 0x7f3840115470 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f382800c790 tx=0x7f38280043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:00.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.345+0000 7f3837400640 1 -- 172.21.15.81:0/2872626969 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f382800a820 con 0x7f3840104db0 2024-04-23T15:03:00.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.345+0000 7f3837400640 1 -- 172.21.15.81:0/2872626969 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f382800ae50 con 0x7f3840104db0 2024-04-23T15:03:00.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.345+0000 7f3845600640 1 -- 172.21.15.81:0/2872626969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f384010f3a0 con 0x7f3840104db0 2024-04-23T15:03:00.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.345+0000 7f3837400640 1 -- 172.21.15.81:0/2872626969 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38280115e0 con 0x7f3840104db0 2024-04-23T15:03:00.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.345+0000 7f3845600640 1 -- 172.21.15.81:0/2872626969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f384010f940 con 0x7f3840104db0 2024-04-23T15:03:00.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.346+0000 7f3845600640 1 -- 172.21.15.81:0/2872626969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38400ffb80 con 0x7f3840104db0 2024-04-23T15:03:00.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.347+0000 7f3837400640 1 -- 172.21.15.81:0/2872626969 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f3828012400 con 0x7f3840104db0 2024-04-23T15:03:00.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.348+0000 7f3837400640 1 --2- 172.21.15.81:0/2872626969 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f382406eb70 0x7f3824071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:00.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.348+0000 7f3837400640 1 -- 172.21.15.81:0/2872626969 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f382808eab0 con 0x7f3840104db0 2024-04-23T15:03:00.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.348+0000 7f383ea00640 1 --2- 172.21.15.81:0/2872626969 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f382406eb70 0x7f3824071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:00.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.349+0000 7f383ea00640 1 --2- 172.21.15.81:0/2872626969 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f382406eb70 0x7f3824071020 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3830004a30 tx=0x7f3830037040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:00.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.352+0000 7f3837400640 1 -- 172.21.15.81:0/2872626969 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f3828090e60 con 0x7f3840104db0 2024-04-23T15:03:00.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:00 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/3078648087' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T15:03:00.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:00 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/2336413882' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T15:03:00.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:00 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/3662346957' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-23T15:03:00.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:00 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/3078648087' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T15:03:00.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:00 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/2336413882' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T15:03:00.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:00 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/3662346957' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-23T15:03:00.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.581+0000 7f3845600640 1 -- 172.21.15.81:0/2872626969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f384010b570 con 0x7f3840104db0 2024-04-23T15:03:00.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.582+0000 7f3837400640 1 -- 172.21.15.81:0/2872626969 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v86) v1 ==== 107+0+11 (secure 0 0 0) 0x7f38280577e0 con 0x7f3840104db0 2024-04-23T15:03:00.583 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-04-23T15:03:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.585+0000 7f3845600640 1 -- 172.21.15.81:0/2872626969 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f382406eb70 msgr2=0x7f3824071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.585+0000 7f3845600640 1 --2- 172.21.15.81:0/2872626969 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f382406eb70 0x7f3824071020 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3830004a30 tx=0x7f3830037040 comp rx=0 tx=0).stop 2024-04-23T15:03:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.585+0000 7f3845600640 1 -- 172.21.15.81:0/2872626969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3840104db0 msgr2=0x7f3840115470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.585+0000 7f3845600640 1 --2- 172.21.15.81:0/2872626969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3840104db0 0x7f3840115470 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f382800c790 tx=0x7f38280043c0 comp rx=0 tx=0).stop 2024-04-23T15:03:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.585+0000 7f3845600640 1 -- 172.21.15.81:0/2872626969 shutdown_connections 2024-04-23T15:03:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.585+0000 7f3845600640 1 --2- 172.21.15.81:0/2872626969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3840104db0 0x7f3840115470 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.585+0000 7f3845600640 1 --2- 172.21.15.81:0/2872626969 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f382406eb70 0x7f3824071020 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.585+0000 7f3845600640 1 --2- 172.21.15.81:0/2872626969 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3840104410 0x7f3840114f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.585+0000 7f3845600640 1 -- 172.21.15.81:0/2872626969 >> 172.21.15.81:0/2872626969 conn(0x7f38400fa020 msgr2=0x7f38400faed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.585+0000 7f3845600640 1 -- 172.21.15.81:0/2872626969 shutdown_connections 2024-04-23T15:03:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.585+0000 7f3845600640 1 -- 172.21.15.81:0/2872626969 wait complete. 2024-04-23T15:03:00.603 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T15:03:00.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.796+0000 7f5035800640 1 -- 172.21.15.81:0/676995305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5030104400 msgr2=0x7f50301047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:00.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.796+0000 7f5035800640 1 --2- 172.21.15.81:0/676995305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5030104400 0x7f50301047d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f50200048d0 tx=0x7f5020009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:00.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.796+0000 7f5035800640 1 -- 172.21.15.81:0/676995305 shutdown_connections 2024-04-23T15:03:00.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.796+0000 7f5035800640 1 --2- 172.21.15.81:0/676995305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5030104da0 0x7f50300fe430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:00.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.796+0000 7f5035800640 1 --2- 172.21.15.81:0/676995305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5030104400 0x7f50301047d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:00.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.796+0000 7f5035800640 1 -- 172.21.15.81:0/676995305 >> 172.21.15.81:0/676995305 conn(0x7f50300f9ff0 msgr2=0x7f50300fc400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:00.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.796+0000 7f5035800640 1 -- 172.21.15.81:0/676995305 shutdown_connections 2024-04-23T15:03:00.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.796+0000 7f5035800640 1 -- 172.21.15.81:0/676995305 wait complete. 2024-04-23T15:03:00.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.797+0000 7f5035800640 1 Processor -- start 2024-04-23T15:03:00.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.797+0000 7f5035800640 1 -- start start 2024-04-23T15:03:00.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.798+0000 7f5035800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5030104400 0x7f5030114ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:00.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.798+0000 7f5035800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5030104da0 0x7f5030115420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:00.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.798+0000 7f5035800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5030115a20 con 0x7f5030104400 2024-04-23T15:03:00.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.798+0000 7f5035800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503010f070 con 0x7f5030104da0 2024-04-23T15:03:00.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.798+0000 7f502ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5030104400 0x7f5030114ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:00.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.798+0000 7f502ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5030104400 0x7f5030114ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53740/0 (socket says 172.21.15.81:53740) 2024-04-23T15:03:00.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.798+0000 7f502ea00640 1 -- 172.21.15.81:0/102733791 learned_addr learned my addr 172.21.15.81:0/102733791 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:03:00.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.798+0000 7f502e000640 1 --2- 172.21.15.81:0/102733791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5030104da0 0x7f5030115420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:00.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.798+0000 7f502ea00640 1 -- 172.21.15.81:0/102733791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5030104da0 msgr2=0x7f5030115420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:00.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.798+0000 7f502ea00640 1 --2- 172.21.15.81:0/102733791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5030104da0 0x7f5030115420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:00.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.798+0000 7f502ea00640 1 -- 172.21.15.81:0/102733791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5020005040 con 0x7f5030104400 2024-04-23T15:03:00.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.799+0000 7f502ea00640 1 --2- 172.21.15.81:0/102733791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5030104400 0x7f5030114ee0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5020034040 tx=0x7f5020009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:00.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.799+0000 7f5026a00640 1 -- 172.21.15.81:0/102733791 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50200092b0 con 0x7f5030104400 2024-04-23T15:03:00.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.799+0000 7f5026a00640 1 -- 172.21.15.81:0/102733791 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f502003b400 con 0x7f5030104400 2024-04-23T15:03:00.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.799+0000 7f5026a00640 1 -- 172.21.15.81:0/102733791 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50200435d0 con 0x7f5030104400 2024-04-23T15:03:00.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.799+0000 7f5035800640 1 -- 172.21.15.81:0/102733791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f503010f2f0 con 0x7f5030104400 2024-04-23T15:03:00.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.799+0000 7f5035800640 1 -- 172.21.15.81:0/102733791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f503010f7b0 con 0x7f5030104400 2024-04-23T15:03:00.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.801+0000 7f5035800640 1 -- 172.21.15.81:0/102733791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50300ffb70 con 0x7f5030104400 2024-04-23T15:03:00.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.801+0000 7f5026a00640 1 -- 172.21.15.81:0/102733791 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f502002f070 con 0x7f5030104400 2024-04-23T15:03:00.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.803+0000 7f5026a00640 1 --2- 172.21.15.81:0/102733791 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f501406ec40 0x7f50140710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:00.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.803+0000 7f5026a00640 1 -- 172.21.15.81:0/102733791 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f50200b0620 con 0x7f5030104400 2024-04-23T15:03:00.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.803+0000 7f502e000640 1 --2- 172.21.15.81:0/102733791 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f501406ec40 0x7f50140710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:00.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.804+0000 7f502e000640 1 --2- 172.21.15.81:0/102733791 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f501406ec40 0x7f50140710f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f50301107a0 tx=0x7f501800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:00.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:00.808+0000 7f5026a00640 1 -- 172.21.15.81:0/102733791 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f5020079350 con 0x7f5030104400 2024-04-23T15:03:01.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.051+0000 7f5035800640 1 -- 172.21.15.81:0/102733791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f503010b560 con 0x7f5030104400 2024-04-23T15:03:01.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.052+0000 7f5026a00640 1 -- 172.21.15.81:0/102733791 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+5221 (secure 0 0 0) 0x7f502007ca10 con 0x7f5030104400 2024-04-23T15:03:01.053 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T15:03:01.053 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44273,"name":"cephfs.smithi156.rhbtxt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6825/3017230919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3017230919},{"type":"v1","addr":"172.21.15.156:6825","nonce":3017230919}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44277,"name":"cephfs.smithi156.vynkxn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6827/4079938688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":4079938688},{"type":"v1","addr":"172.21.15.156:6827","nonce":4079938688}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":36,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T14:45:51.264703+0000","modified":"2024-04-23T14:59:16.388200+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34430":{"gid":34430,"name":"cephfs.smithi081.wydgcg","rank":0,"incarnation":31,"state":"up:active","state_seq":24,"addr":"172.21.15.81:6827/3200953351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3200953351},{"type":"v1","addr":"172.21.15.81:6827","nonce":3200953351}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34462":{"gid":34462,"name":"cephfs.smithi081.vcoywg","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6829/2598630159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2598630159},{"type":"v1","addr":"172.21.15.81:6829","nonce":2598630159}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34430,"qdb_cluster":[34430]},"id":1}]} 2024-04-23T15:03:01.053 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 36 2024-04-23T15:03:01.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.055+0000 7f5035800640 1 -- 172.21.15.81:0/102733791 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f501406ec40 msgr2=0x7f50140710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:01.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.055+0000 7f5035800640 1 --2- 172.21.15.81:0/102733791 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f501406ec40 0x7f50140710f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f50301107a0 tx=0x7f501800b040 comp rx=0 tx=0).stop 2024-04-23T15:03:01.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.055+0000 7f5035800640 1 -- 172.21.15.81:0/102733791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5030104400 msgr2=0x7f5030114ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:01.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.055+0000 7f5035800640 1 --2- 172.21.15.81:0/102733791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5030104400 0x7f5030114ee0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5020034040 tx=0x7f5020009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:01.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.055+0000 7f5035800640 1 -- 172.21.15.81:0/102733791 shutdown_connections 2024-04-23T15:03:01.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.055+0000 7f5035800640 1 --2- 172.21.15.81:0/102733791 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f501406ec40 0x7f50140710f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:01.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.055+0000 7f5035800640 1 --2- 172.21.15.81:0/102733791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5030104da0 0x7f5030115420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:01.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.055+0000 7f5035800640 1 --2- 172.21.15.81:0/102733791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5030104400 0x7f5030114ee0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:01.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.055+0000 7f5035800640 1 -- 172.21.15.81:0/102733791 >> 172.21.15.81:0/102733791 conn(0x7f50300f9ff0 msgr2=0x7f50300faf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:01.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.055+0000 7f5035800640 1 -- 172.21.15.81:0/102733791 shutdown_connections 2024-04-23T15:03:01.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.055+0000 7f5035800640 1 -- 172.21.15.81:0/102733791 wait complete. 2024-04-23T15:03:01.073 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 17, 'max_mds': 1, 'flags': 50} 2024-04-23T15:03:01.074 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 18 2024-04-23T15:03:01.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.266+0000 7fbe26a00640 1 -- 172.21.15.81:0/429129431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe20104d90 msgr2=0x7fbe200fe420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:01.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.266+0000 7fbe26a00640 1 --2- 172.21.15.81:0/429129431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe20104d90 0x7fbe200fe420 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0048d0 tx=0x7fbe0c009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:01.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.266+0000 7fbe26a00640 1 -- 172.21.15.81:0/429129431 shutdown_connections 2024-04-23T15:03:01.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.266+0000 7fbe26a00640 1 --2- 172.21.15.81:0/429129431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe20104d90 0x7fbe200fe420 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:01.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.266+0000 7fbe26a00640 1 --2- 172.21.15.81:0/429129431 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe201043f0 0x7fbe201047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:01.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.266+0000 7fbe26a00640 1 -- 172.21.15.81:0/429129431 >> 172.21.15.81:0/429129431 conn(0x7fbe200f9fc0 msgr2=0x7fbe200fc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:01.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.266+0000 7fbe26a00640 1 -- 172.21.15.81:0/429129431 shutdown_connections 2024-04-23T15:03:01.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.266+0000 7fbe26a00640 1 -- 172.21.15.81:0/429129431 wait complete. 2024-04-23T15:03:01.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.267+0000 7fbe26a00640 1 Processor -- start 2024-04-23T15:03:01.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.267+0000 7fbe26a00640 1 -- start start 2024-04-23T15:03:01.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.268+0000 7fbe26a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe201043f0 0x7fbe20114ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:01.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.268+0000 7fbe26a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe20104d90 0x7fbe20115410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:01.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.268+0000 7fbe26a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe20115a10 con 0x7fbe201043f0 2024-04-23T15:03:01.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.268+0000 7fbe26a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2010f060 con 0x7fbe20104d90 2024-04-23T15:03:01.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.268+0000 7fbe1fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe201043f0 0x7fbe20114ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:01.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.268+0000 7fbe1fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe201043f0 0x7fbe20114ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53746/0 (socket says 172.21.15.81:53746) 2024-04-23T15:03:01.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.268+0000 7fbe1fe00640 1 -- 172.21.15.81:0/2778084874 learned_addr learned my addr 172.21.15.81:0/2778084874 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:03:01.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.268+0000 7fbe1fe00640 1 -- 172.21.15.81:0/2778084874 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe20104d90 msgr2=0x7fbe20115410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:01.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.268+0000 7fbe1fe00640 1 --2- 172.21.15.81:0/2778084874 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe20104d90 0x7fbe20115410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:01.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.268+0000 7fbe1fe00640 1 -- 172.21.15.81:0/2778084874 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0c005040 con 0x7fbe201043f0 2024-04-23T15:03:01.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.269+0000 7fbe1fe00640 1 --2- 172.21.15.81:0/2778084874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe201043f0 0x7fbe20114ed0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fbe1000c790 tx=0x7fbe100043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:01.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.269+0000 7fbe17e00640 1 -- 172.21.15.81:0/2778084874 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe1000a820 con 0x7fbe201043f0 2024-04-23T15:03:01.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.269+0000 7fbe17e00640 1 -- 172.21.15.81:0/2778084874 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbe1000ae50 con 0x7fbe201043f0 2024-04-23T15:03:01.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.269+0000 7fbe17e00640 1 -- 172.21.15.81:0/2778084874 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe100115e0 con 0x7fbe201043f0 2024-04-23T15:03:01.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.269+0000 7fbe26a00640 1 -- 172.21.15.81:0/2778084874 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe2010f340 con 0x7fbe201043f0 2024-04-23T15:03:01.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.269+0000 7fbe26a00640 1 -- 172.21.15.81:0/2778084874 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe2010f860 con 0x7fbe201043f0 2024-04-23T15:03:01.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.270+0000 7fbe26a00640 1 -- 172.21.15.81:0/2778084874 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe200ffb60 con 0x7fbe201043f0 2024-04-23T15:03:01.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.271+0000 7fbe17e00640 1 -- 172.21.15.81:0/2778084874 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fbe10012400 con 0x7fbe201043f0 2024-04-23T15:03:01.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.272+0000 7fbe17e00640 1 --2- 172.21.15.81:0/2778084874 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fbe0406eb70 0x7fbe04071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:01.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.272+0000 7fbe17e00640 1 -- 172.21.15.81:0/2778084874 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fbe1008ead0 con 0x7fbe201043f0 2024-04-23T15:03:01.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.272+0000 7fbe1f400640 1 --2- 172.21.15.81:0/2778084874 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fbe0406eb70 0x7fbe04071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:01.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.273+0000 7fbe1f400640 1 --2- 172.21.15.81:0/2778084874 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fbe0406eb70 0x7fbe04071020 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c02bda0 tx=0x7fbe0c009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:01.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.276+0000 7fbe17e00640 1 -- 172.21.15.81:0/2778084874 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fbe100578a0 con 0x7fbe201043f0 2024-04-23T15:03:01.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:01 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/2872626969' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-23T15:03:01.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:01 smithi081 ceph-mon[90469]: pgmap v356: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:03:01.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:01 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/102733791' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T15:03:01.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.515+0000 7fbe26a00640 1 -- 172.21.15.81:0/2778084874 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7fbe20064380 con 0x7fbe201043f0 2024-04-23T15:03:01.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.517+0000 7fbe17e00640 1 -- 172.21.15.81:0/2778084874 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v36) v1 ==== 107+0+4868 (secure 0 0 0) 0x7fbe10057030 con 0x7fbe201043f0 2024-04-23T15:03:01.518 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T15:03:01.518 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24259,"name":"cephfs.smithi156.vynkxn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.156:6827/1794690362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1794690362},{"type":"v1","addr":"172.21.15.156:6827","nonce":1794690362}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":24263,"name":"cephfs.smithi156.rhbtxt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6825/3854041261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3854041261},{"type":"v1","addr":"172.21.15.156:6825","nonce":3854041261}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":17,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T14:45:51.264703+0000","modified":"2024-04-23T14:46:12.782992+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14472":{"gid":14472,"name":"cephfs.smithi081.vcoywg","rank":0,"incarnation":13,"state":"up:active","state_seq":5,"addr":"172.21.15.81:6829/2563365650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2563365650},{"type":"v1","addr":"172.21.15.81:6829","nonce":2563365650}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14482":{"gid":14482,"name":"cephfs.smithi081.wydgcg","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6827/759909104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":759909104},{"type":"v1","addr":"172.21.15.81:6827","nonce":759909104}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-23T15:03:01.519 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 18 2024-04-23T15:03:01.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.520+0000 7fbe26a00640 1 -- 172.21.15.81:0/2778084874 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fbe0406eb70 msgr2=0x7fbe04071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:01.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.520+0000 7fbe26a00640 1 --2- 172.21.15.81:0/2778084874 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fbe0406eb70 0x7fbe04071020 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c02bda0 tx=0x7fbe0c009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:01.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.520+0000 7fbe26a00640 1 -- 172.21.15.81:0/2778084874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe201043f0 msgr2=0x7fbe20114ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:01.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.520+0000 7fbe26a00640 1 --2- 172.21.15.81:0/2778084874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe201043f0 0x7fbe20114ed0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fbe1000c790 tx=0x7fbe100043c0 comp rx=0 tx=0).stop 2024-04-23T15:03:01.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.520+0000 7fbe26a00640 1 -- 172.21.15.81:0/2778084874 shutdown_connections 2024-04-23T15:03:01.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.520+0000 7fbe26a00640 1 --2- 172.21.15.81:0/2778084874 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fbe0406eb70 0x7fbe04071020 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:01.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.520+0000 7fbe26a00640 1 --2- 172.21.15.81:0/2778084874 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe20104d90 0x7fbe20115410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:01.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.520+0000 7fbe26a00640 1 --2- 172.21.15.81:0/2778084874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe201043f0 0x7fbe20114ed0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:01.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.520+0000 7fbe26a00640 1 -- 172.21.15.81:0/2778084874 >> 172.21.15.81:0/2778084874 conn(0x7fbe200f9fc0 msgr2=0x7fbe200faf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:01.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.521+0000 7fbe26a00640 1 -- 172.21.15.81:0/2778084874 shutdown_connections 2024-04-23T15:03:01.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.521+0000 7fbe26a00640 1 -- 172.21.15.81:0/2778084874 wait complete. 2024-04-23T15:03:01.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:01 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/2872626969' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-23T15:03:01.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:01 smithi156 ceph-mon[77738]: pgmap v356: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:03:01.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:01 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/102733791' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T15:03:01.540 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 19 2024-04-23T15:03:01.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.738+0000 7fc8a5e00640 1 -- 172.21.15.81:0/3660013472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8a0104bd0 msgr2=0x7fc8a00fe260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:01.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.738+0000 7fc8a5e00640 1 --2- 172.21.15.81:0/3660013472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8a0104bd0 0x7fc8a00fe260 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc8940048d0 tx=0x7fc894009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:01.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.739+0000 7fc8a5e00640 1 -- 172.21.15.81:0/3660013472 shutdown_connections 2024-04-23T15:03:01.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.739+0000 7fc8a5e00640 1 --2- 172.21.15.81:0/3660013472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8a0104bd0 0x7fc8a00fe260 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:01.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.739+0000 7fc8a5e00640 1 --2- 172.21.15.81:0/3660013472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8a0104230 0x7fc8a0104600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:01.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.739+0000 7fc8a5e00640 1 -- 172.21.15.81:0/3660013472 >> 172.21.15.81:0/3660013472 conn(0x7fc8a00f9fc0 msgr2=0x7fc8a00fc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:01.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.739+0000 7fc8a5e00640 1 -- 172.21.15.81:0/3660013472 shutdown_connections 2024-04-23T15:03:01.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.739+0000 7fc8a5e00640 1 -- 172.21.15.81:0/3660013472 wait complete. 2024-04-23T15:03:01.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.739+0000 7fc8a5e00640 1 Processor -- start 2024-04-23T15:03:01.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.740+0000 7fc8a5e00640 1 -- start start 2024-04-23T15:03:01.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.740+0000 7fc8a5e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8a0104230 0x7fc8a0114dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:01.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.740+0000 7fc8a5e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8a0104bd0 0x7fc8a0115300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:01.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.740+0000 7fc8a5e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a0115990 con 0x7fc8a0104230 2024-04-23T15:03:01.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.740+0000 7fc8a5e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a010ef50 con 0x7fc8a0104bd0 2024-04-23T15:03:01.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.740+0000 7fc8a4a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8a0104230 0x7fc8a0114dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:01.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.740+0000 7fc8a4a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8a0104230 0x7fc8a0114dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53762/0 (socket says 172.21.15.81:53762) 2024-04-23T15:03:01.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.740+0000 7fc8a4a00640 1 -- 172.21.15.81:0/3182369455 learned_addr learned my addr 172.21.15.81:0/3182369455 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:03:01.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.741+0000 7fc89fe00640 1 --2- 172.21.15.81:0/3182369455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8a0104bd0 0x7fc8a0115300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:01.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.741+0000 7fc8a4a00640 1 -- 172.21.15.81:0/3182369455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8a0104bd0 msgr2=0x7fc8a0115300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:01.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.741+0000 7fc8a4a00640 1 --2- 172.21.15.81:0/3182369455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8a0104bd0 0x7fc8a0115300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:01.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.741+0000 7fc8a4a00640 1 -- 172.21.15.81:0/3182369455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc894005040 con 0x7fc8a0104230 2024-04-23T15:03:01.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.741+0000 7fc8a4a00640 1 --2- 172.21.15.81:0/3182369455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8a0104230 0x7fc8a0114dc0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc89000b790 tx=0x7fc8900091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:01.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.741+0000 7fc89cc00640 1 -- 172.21.15.81:0/3182369455 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc89000c700 con 0x7fc8a0104230 2024-04-23T15:03:01.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.741+0000 7fc89cc00640 1 -- 172.21.15.81:0/3182369455 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc89000cd30 con 0x7fc8a0104230 2024-04-23T15:03:01.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.741+0000 7fc8a5e00640 1 -- 172.21.15.81:0/3182369455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8a010f230 con 0x7fc8a0104230 2024-04-23T15:03:01.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.741+0000 7fc89cc00640 1 -- 172.21.15.81:0/3182369455 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc890013370 con 0x7fc8a0104230 2024-04-23T15:03:01.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.741+0000 7fc8a5e00640 1 -- 172.21.15.81:0/3182369455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a010f750 con 0x7fc8a0104230 2024-04-23T15:03:01.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.742+0000 7fc8a5e00640 1 -- 172.21.15.81:0/3182369455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8a00ff9a0 con 0x7fc8a0104230 2024-04-23T15:03:01.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.744+0000 7fc89cc00640 1 -- 172.21.15.81:0/3182369455 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fc890012070 con 0x7fc8a0104230 2024-04-23T15:03:01.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.744+0000 7fc89cc00640 1 --2- 172.21.15.81:0/3182369455 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc88806eb70 0x7fc888071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:01.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.745+0000 7fc89cc00640 1 -- 172.21.15.81:0/3182369455 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fc89008e5b0 con 0x7fc8a0104230 2024-04-23T15:03:01.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.745+0000 7fc89fe00640 1 --2- 172.21.15.81:0/3182369455 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc88806eb70 0x7fc888071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:01.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.745+0000 7fc89fe00640 1 --2- 172.21.15.81:0/3182369455 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc88806eb70 0x7fc888071020 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc894000c00 tx=0x7fc894009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:01.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:01.750+0000 7fc89cc00640 1 -- 172.21.15.81:0/3182369455 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fc8900572a0 con 0x7fc8a0104230 2024-04-23T15:03:02.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.039+0000 7fc8a5e00640 1 -- 172.21.15.81:0/3182369455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7fc8a01104c0 con 0x7fc8a0104230 2024-04-23T15:03:02.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.040+0000 7fc89cc00640 1 -- 172.21.15.81:0/3182369455 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v36) v1 ==== 107+0+4094 (secure 0 0 0) 0x7fc89005a960 con 0x7fc8a0104230 2024-04-23T15:03:02.041 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T15:03:02.041 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24259,"name":"cephfs.smithi156.vynkxn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.156:6827/1794690362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1794690362},{"type":"v1","addr":"172.21.15.156:6827","nonce":1794690362}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":24263,"name":"cephfs.smithi156.rhbtxt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6825/3854041261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3854041261},{"type":"v1","addr":"172.21.15.156:6825","nonce":3854041261}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T14:45:51.264703+0000","modified":"2024-04-23T14:57:34.994720+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14472":{"gid":14472,"name":"cephfs.smithi081.vcoywg","rank":0,"incarnation":13,"state":"up:active","state_seq":5,"addr":"172.21.15.81:6829/2563365650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2563365650},{"type":"v1","addr":"172.21.15.81:6829","nonce":2563365650}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14472,"qdb_cluster":[14472]},"id":1}]} 2024-04-23T15:03:02.041 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 19 2024-04-23T15:03:02.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.042+0000 7fc8a5e00640 1 -- 172.21.15.81:0/3182369455 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc88806eb70 msgr2=0x7fc888071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:02.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.042+0000 7fc8a5e00640 1 --2- 172.21.15.81:0/3182369455 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc88806eb70 0x7fc888071020 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc894000c00 tx=0x7fc894009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:02.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.042+0000 7fc8a5e00640 1 -- 172.21.15.81:0/3182369455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8a0104230 msgr2=0x7fc8a0114dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:02.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.042+0000 7fc8a5e00640 1 --2- 172.21.15.81:0/3182369455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8a0104230 0x7fc8a0114dc0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc89000b790 tx=0x7fc8900091d0 comp rx=0 tx=0).stop 2024-04-23T15:03:02.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.043+0000 7fc8a5e00640 1 -- 172.21.15.81:0/3182369455 shutdown_connections 2024-04-23T15:03:02.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.043+0000 7fc8a5e00640 1 --2- 172.21.15.81:0/3182369455 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc88806eb70 0x7fc888071020 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:02.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.043+0000 7fc8a5e00640 1 --2- 172.21.15.81:0/3182369455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8a0104bd0 0x7fc8a0115300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:02.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.043+0000 7fc8a5e00640 1 --2- 172.21.15.81:0/3182369455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8a0104230 0x7fc8a0114dc0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:02.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.043+0000 7fc8a5e00640 1 -- 172.21.15.81:0/3182369455 >> 172.21.15.81:0/3182369455 conn(0x7fc8a00f9fc0 msgr2=0x7fc8a00fbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:02.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.043+0000 7fc8a5e00640 1 -- 172.21.15.81:0/3182369455 shutdown_connections 2024-04-23T15:03:02.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.043+0000 7fc8a5e00640 1 -- 172.21.15.81:0/3182369455 wait complete. 2024-04-23T15:03:02.061 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 19 2024-04-23T15:03:02.061 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 20 2024-04-23T15:03:02.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.246+0000 7fa9d4200640 1 -- 172.21.15.81:0/253641111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9cc102840 msgr2=0x7fa9cc102cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:02.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.246+0000 7fa9d4200640 1 --2- 172.21.15.81:0/253641111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9cc102840 0x7fa9cc102cb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa9b80048d0 tx=0x7fa9b8009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:02.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.246+0000 7fa9d4200640 1 -- 172.21.15.81:0/253641111 shutdown_connections 2024-04-23T15:03:02.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.246+0000 7fa9d4200640 1 --2- 172.21.15.81:0/253641111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9cc102840 0x7fa9cc102cb0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:02.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.246+0000 7fa9d4200640 1 --2- 172.21.15.81:0/253641111 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9cc108860 0x7fa9cc108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:02.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.246+0000 7fa9d4200640 1 -- 172.21.15.81:0/253641111 >> 172.21.15.81:0/253641111 conn(0x7fa9cc072050 msgr2=0x7fa9cc074460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:02.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.246+0000 7fa9d4200640 1 -- 172.21.15.81:0/253641111 shutdown_connections 2024-04-23T15:03:02.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.246+0000 7fa9d4200640 1 -- 172.21.15.81:0/253641111 wait complete. 2024-04-23T15:03:02.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.246+0000 7fa9d4200640 1 Processor -- start 2024-04-23T15:03:02.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.247+0000 7fa9d4200640 1 -- start start 2024-04-23T15:03:02.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.247+0000 7fa9d4200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9cc102840 0x7fa9cc1193d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:02.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.247+0000 7fa9d4200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9cc108860 0x7fa9cc119910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:02.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.247+0000 7fa9d4200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9cc119fa0 con 0x7fa9cc108860 2024-04-23T15:03:02.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.247+0000 7fa9d4200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9cc113560 con 0x7fa9cc102840 2024-04-23T15:03:02.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.247+0000 7fa9d0e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9cc108860 0x7fa9cc119910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:02.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.247+0000 7fa9d0e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9cc108860 0x7fa9cc119910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53780/0 (socket says 172.21.15.81:53780) 2024-04-23T15:03:02.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.247+0000 7fa9d0e00640 1 -- 172.21.15.81:0/1906644526 learned_addr learned my addr 172.21.15.81:0/1906644526 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:03:02.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.248+0000 7fa9d0e00640 1 -- 172.21.15.81:0/1906644526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9cc102840 msgr2=0x7fa9cc1193d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:02.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.248+0000 7fa9d0e00640 1 --2- 172.21.15.81:0/1906644526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9cc102840 0x7fa9cc1193d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:02.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.248+0000 7fa9d0e00640 1 -- 172.21.15.81:0/1906644526 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b8005040 con 0x7fa9cc108860 2024-04-23T15:03:02.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.248+0000 7fa9d0e00640 1 --2- 172.21.15.81:0/1906644526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9cc108860 0x7fa9cc119910 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8004930 tx=0x7fa9b8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:02.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.248+0000 7fa9c9600640 1 -- 172.21.15.81:0/1906644526 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9b80094c0 con 0x7fa9cc108860 2024-04-23T15:03:02.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.248+0000 7fa9c9600640 1 -- 172.21.15.81:0/1906644526 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa9b8032e50 con 0x7fa9cc108860 2024-04-23T15:03:02.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.248+0000 7fa9c9600640 1 -- 172.21.15.81:0/1906644526 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9b80433b0 con 0x7fa9cc108860 2024-04-23T15:03:02.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.248+0000 7fa9d4200640 1 -- 172.21.15.81:0/1906644526 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9cc1137e0 con 0x7fa9cc108860 2024-04-23T15:03:02.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.248+0000 7fa9d4200640 1 -- 172.21.15.81:0/1906644526 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9cc113ca0 con 0x7fa9cc108860 2024-04-23T15:03:02.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.249+0000 7fa9d4200640 1 -- 172.21.15.81:0/1906644526 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9cc103f80 con 0x7fa9cc108860 2024-04-23T15:03:02.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.250+0000 7fa9c9600640 1 -- 172.21.15.81:0/1906644526 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fa9b802f070 con 0x7fa9cc108860 2024-04-23T15:03:02.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.251+0000 7fa9c9600640 1 --2- 172.21.15.81:0/1906644526 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa9b406eb70 0x7fa9b4071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:02.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.251+0000 7fa9c9600640 1 -- 172.21.15.81:0/1906644526 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fa9b80b07d0 con 0x7fa9cc108860 2024-04-23T15:03:02.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.251+0000 7fa9d1800640 1 --2- 172.21.15.81:0/1906644526 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa9b406eb70 0x7fa9b4071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:02.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.252+0000 7fa9d1800640 1 --2- 172.21.15.81:0/1906644526 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa9b406eb70 0x7fa9b4071020 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa9c00097e0 tx=0x7fa9c0006d20 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:02.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.256+0000 7fa9c9600640 1 -- 172.21.15.81:0/1906644526 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fa9b8079480 con 0x7fa9cc108860 2024-04-23T15:03:02.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:02 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/2778084874' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-04-23T15:03:02.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:02 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/3182369455' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-04-23T15:03:02.437 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:02 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/2778084874' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-04-23T15:03:02.438 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:02 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/3182369455' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-04-23T15:03:02.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.498+0000 7fa9d4200640 1 -- 172.21.15.81:0/1906644526 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7fa9cc10f9c0 con 0x7fa9cc108860 2024-04-23T15:03:02.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.500+0000 7fa9c9600640 1 -- 172.21.15.81:0/1906644526 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v36) v1 ==== 107+0+4873 (secure 0 0 0) 0x7fa9b807cb40 con 0x7fa9cc108860 2024-04-23T15:03:02.501 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T15:03:02.501 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24259,"name":"cephfs.smithi156.vynkxn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.156:6827/1794690362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1794690362},{"type":"v1","addr":"172.21.15.156:6827","nonce":1794690362}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":24263,"name":"cephfs.smithi156.rhbtxt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6825/3854041261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3854041261},{"type":"v1","addr":"172.21.15.156:6825","nonce":3854041261}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34426,"name":"cephfs.smithi081.wydgcg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6827/2886286299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2886286299},{"type":"v1","addr":"172.21.15.81:6827","nonce":2886286299}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T14:45:51.264703+0000","modified":"2024-04-23T14:57:34.994720+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14472":{"gid":14472,"name":"cephfs.smithi081.vcoywg","rank":0,"incarnation":13,"state":"up:active","state_seq":5,"addr":"172.21.15.81:6829/2563365650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2563365650},{"type":"v1","addr":"172.21.15.81:6829","nonce":2563365650}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14472,"qdb_cluster":[14472]},"id":1}]} 2024-04-23T15:03:02.501 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 20 2024-04-23T15:03:02.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.503+0000 7fa9d4200640 1 -- 172.21.15.81:0/1906644526 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa9b406eb70 msgr2=0x7fa9b4071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:02.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.503+0000 7fa9d4200640 1 --2- 172.21.15.81:0/1906644526 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa9b406eb70 0x7fa9b4071020 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa9c00097e0 tx=0x7fa9c0006d20 comp rx=0 tx=0).stop 2024-04-23T15:03:02.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.503+0000 7fa9d4200640 1 -- 172.21.15.81:0/1906644526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9cc108860 msgr2=0x7fa9cc119910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:02.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.503+0000 7fa9d4200640 1 --2- 172.21.15.81:0/1906644526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9cc108860 0x7fa9cc119910 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8004930 tx=0x7fa9b8009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:02.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.503+0000 7fa9d4200640 1 -- 172.21.15.81:0/1906644526 shutdown_connections 2024-04-23T15:03:02.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.503+0000 7fa9d4200640 1 --2- 172.21.15.81:0/1906644526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9cc108860 0x7fa9cc119910 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:02.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.503+0000 7fa9d4200640 1 --2- 172.21.15.81:0/1906644526 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fa9b406eb70 0x7fa9b4071020 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:02.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.503+0000 7fa9d4200640 1 --2- 172.21.15.81:0/1906644526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9cc102840 0x7fa9cc1193d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:02.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.503+0000 7fa9d4200640 1 -- 172.21.15.81:0/1906644526 >> 172.21.15.81:0/1906644526 conn(0x7fa9cc072050 msgr2=0x7fa9cc10b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:02.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.503+0000 7fa9d4200640 1 -- 172.21.15.81:0/1906644526 shutdown_connections 2024-04-23T15:03:02.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.503+0000 7fa9d4200640 1 -- 172.21.15.81:0/1906644526 wait complete. 2024-04-23T15:03:02.522 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 20 2024-04-23T15:03:02.522 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 21 2024-04-23T15:03:02.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.709+0000 7f12d2e00640 1 -- 172.21.15.81:0/459247154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12cc104230 msgr2=0x7f12cc104600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:02.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.709+0000 7f12d2e00640 1 --2- 172.21.15.81:0/459247154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12cc104230 0x7f12cc104600 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f12c00048d0 tx=0x7f12c0009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:02.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.709+0000 7f12d2e00640 1 -- 172.21.15.81:0/459247154 shutdown_connections 2024-04-23T15:03:02.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.709+0000 7f12d2e00640 1 --2- 172.21.15.81:0/459247154 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12cc104bd0 0x7f12cc0fe260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:02.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.709+0000 7f12d2e00640 1 --2- 172.21.15.81:0/459247154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12cc104230 0x7f12cc104600 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:02.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.709+0000 7f12d2e00640 1 -- 172.21.15.81:0/459247154 >> 172.21.15.81:0/459247154 conn(0x7f12cc0f9fc0 msgr2=0x7f12cc0fc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:02.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.709+0000 7f12d2e00640 1 -- 172.21.15.81:0/459247154 shutdown_connections 2024-04-23T15:03:02.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.710+0000 7f12d2e00640 1 -- 172.21.15.81:0/459247154 wait complete. 2024-04-23T15:03:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.710+0000 7f12d2e00640 1 Processor -- start 2024-04-23T15:03:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.711+0000 7f12d2e00640 1 -- start start 2024-04-23T15:03:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.711+0000 7f12d2e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12cc104230 0x7f12cc0719e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.711+0000 7f12d2e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12cc104bd0 0x7f12cc071f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.711+0000 7f12d2e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12cc0758f0 con 0x7f12cc104bd0 2024-04-23T15:03:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.711+0000 7f12d2e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12cc075a60 con 0x7f12cc104230 2024-04-23T15:03:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.711+0000 7f12d1000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12cc104bd0 0x7f12cc071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.711+0000 7f12d1000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12cc104bd0 0x7f12cc071f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53806/0 (socket says 172.21.15.81:53806) 2024-04-23T15:03:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.711+0000 7f12d1000640 1 -- 172.21.15.81:0/2120200801 learned_addr learned my addr 172.21.15.81:0/2120200801 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:03:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.712+0000 7f12d1a00640 1 --2- 172.21.15.81:0/2120200801 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12cc104230 0x7f12cc0719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.712+0000 7f12d1000640 1 -- 172.21.15.81:0/2120200801 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12cc104230 msgr2=0x7f12cc0719e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.712+0000 7f12d1000640 1 --2- 172.21.15.81:0/2120200801 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12cc104230 0x7f12cc0719e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.712+0000 7f12d1000640 1 -- 172.21.15.81:0/2120200801 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c0005040 con 0x7f12cc104bd0 2024-04-23T15:03:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.712+0000 7f12d1a00640 1 --2- 172.21.15.81:0/2120200801 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12cc104230 0x7f12cc0719e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:03:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.712+0000 7f12d1000640 1 --2- 172.21.15.81:0/2120200801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12cc104bd0 0x7f12cc071f20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f12bc00c790 tx=0x7f12bc0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:02.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.712+0000 7f12c9600640 1 -- 172.21.15.81:0/2120200801 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12bc00a820 con 0x7f12cc104bd0 2024-04-23T15:03:02.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.712+0000 7f12c9600640 1 -- 172.21.15.81:0/2120200801 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f12bc00ae50 con 0x7f12cc104bd0 2024-04-23T15:03:02.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.712+0000 7f12c9600640 1 -- 172.21.15.81:0/2120200801 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12bc0115e0 con 0x7f12cc104bd0 2024-04-23T15:03:02.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.712+0000 7f12d2e00640 1 -- 172.21.15.81:0/2120200801 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12cc0724c0 con 0x7f12cc104bd0 2024-04-23T15:03:02.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.713+0000 7f12d2e00640 1 -- 172.21.15.81:0/2120200801 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12cc11d600 con 0x7f12cc104bd0 2024-04-23T15:03:02.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.714+0000 7f12d2e00640 1 -- 172.21.15.81:0/2120200801 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12cc0ff9a0 con 0x7f12cc104bd0 2024-04-23T15:03:02.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.715+0000 7f12c9600640 1 -- 172.21.15.81:0/2120200801 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f12bc012400 con 0x7f12cc104bd0 2024-04-23T15:03:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.716+0000 7f12c9600640 1 --2- 172.21.15.81:0/2120200801 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f12b406eb70 0x7f12b4071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.716+0000 7f12c9600640 1 -- 172.21.15.81:0/2120200801 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f12bc08e980 con 0x7f12cc104bd0 2024-04-23T15:03:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.716+0000 7f12d1a00640 1 --2- 172.21.15.81:0/2120200801 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f12b406eb70 0x7f12b4071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.717+0000 7f12d1a00640 1 --2- 172.21.15.81:0/2120200801 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f12b406eb70 0x7f12b4071020 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f12c0000c00 tx=0x7f12c0009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:02.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.721+0000 7f12c9600640 1 -- 172.21.15.81:0/2120200801 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f12bc0577f0 con 0x7f12cc104bd0 2024-04-23T15:03:02.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.963+0000 7f12d2e00640 1 -- 172.21.15.81:0/2120200801 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7f12cc11d8a0 con 0x7f12cc104bd0 2024-04-23T15:03:02.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.964+0000 7f12c9600640 1 -- 172.21.15.81:0/2120200801 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v36) v1 ==== 107+0+4094 (secure 0 0 0) 0x7f12bc05aeb0 con 0x7f12cc104bd0 2024-04-23T15:03:02.965 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T15:03:02.965 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24259,"name":"cephfs.smithi156.vynkxn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.156:6827/1794690362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1794690362},{"type":"v1","addr":"172.21.15.156:6827","nonce":1794690362}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":24263,"name":"cephfs.smithi156.rhbtxt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6825/3854041261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3854041261},{"type":"v1","addr":"172.21.15.156:6825","nonce":3854041261}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T14:45:51.264703+0000","modified":"2024-04-23T14:57:34.994720+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14472":{"gid":14472,"name":"cephfs.smithi081.vcoywg","rank":0,"incarnation":13,"state":"up:active","state_seq":5,"addr":"172.21.15.81:6829/2563365650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2563365650},{"type":"v1","addr":"172.21.15.81:6829","nonce":2563365650}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14472,"qdb_cluster":[14472]},"id":1}]} 2024-04-23T15:03:02.965 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 21 2024-04-23T15:03:02.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.967+0000 7f12d2e00640 1 -- 172.21.15.81:0/2120200801 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f12b406eb70 msgr2=0x7f12b4071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:02.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.967+0000 7f12d2e00640 1 --2- 172.21.15.81:0/2120200801 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f12b406eb70 0x7f12b4071020 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f12c0000c00 tx=0x7f12c0009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:02.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.967+0000 7f12d2e00640 1 -- 172.21.15.81:0/2120200801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12cc104bd0 msgr2=0x7f12cc071f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:02.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.967+0000 7f12d2e00640 1 --2- 172.21.15.81:0/2120200801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12cc104bd0 0x7f12cc071f20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f12bc00c790 tx=0x7f12bc0043c0 comp rx=0 tx=0).stop 2024-04-23T15:03:02.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.967+0000 7f12d2e00640 1 -- 172.21.15.81:0/2120200801 shutdown_connections 2024-04-23T15:03:02.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.967+0000 7f12d2e00640 1 --2- 172.21.15.81:0/2120200801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12cc104bd0 0x7f12cc071f20 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:02.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.967+0000 7f12d2e00640 1 --2- 172.21.15.81:0/2120200801 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f12b406eb70 0x7f12b4071020 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:02.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.967+0000 7f12d2e00640 1 --2- 172.21.15.81:0/2120200801 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12cc104230 0x7f12cc0719e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:02.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.967+0000 7f12d2e00640 1 -- 172.21.15.81:0/2120200801 >> 172.21.15.81:0/2120200801 conn(0x7f12cc0f9fc0 msgr2=0x7f12cc0fbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:02.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.967+0000 7f12d2e00640 1 -- 172.21.15.81:0/2120200801 shutdown_connections 2024-04-23T15:03:02.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:02.967+0000 7f12d2e00640 1 -- 172.21.15.81:0/2120200801 wait complete. 2024-04-23T15:03:02.985 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 21 2024-04-23T15:03:02.985 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 22 2024-04-23T15:03:03.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.172+0000 7fbf26c00640 1 -- 172.21.15.81:0/2976437250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf201043f0 msgr2=0x7fbf201047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:03.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.172+0000 7fbf26c00640 1 --2- 172.21.15.81:0/2976437250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf201043f0 0x7fbf201047c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbf100048d0 tx=0x7fbf10009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:03.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.173+0000 7fbf26c00640 1 -- 172.21.15.81:0/2976437250 shutdown_connections 2024-04-23T15:03:03.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.173+0000 7fbf26c00640 1 --2- 172.21.15.81:0/2976437250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf20104d90 0x7fbf200fe420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:03.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.173+0000 7fbf26c00640 1 --2- 172.21.15.81:0/2976437250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf201043f0 0x7fbf201047c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:03.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.173+0000 7fbf26c00640 1 -- 172.21.15.81:0/2976437250 >> 172.21.15.81:0/2976437250 conn(0x7fbf200f9fc0 msgr2=0x7fbf200fc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:03.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.173+0000 7fbf26c00640 1 -- 172.21.15.81:0/2976437250 shutdown_connections 2024-04-23T15:03:03.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.173+0000 7fbf26c00640 1 -- 172.21.15.81:0/2976437250 wait complete. 2024-04-23T15:03:03.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.174+0000 7fbf26c00640 1 Processor -- start 2024-04-23T15:03:03.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.174+0000 7fbf26c00640 1 -- start start 2024-04-23T15:03:03.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.174+0000 7fbf26c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf201043f0 0x7fbf20114f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:03.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.174+0000 7fbf26c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf20104d90 0x7fbf201154b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:03.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.174+0000 7fbf26c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf20115ab0 con 0x7fbf20104d90 2024-04-23T15:03:03.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.174+0000 7fbf26c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2010f100 con 0x7fbf201043f0 2024-04-23T15:03:03.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.174+0000 7fbf17e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf20104d90 0x7fbf201154b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:03.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.174+0000 7fbf17e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf20104d90 0x7fbf201154b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53828/0 (socket says 172.21.15.81:53828) 2024-04-23T15:03:03.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.175+0000 7fbf17e00640 1 -- 172.21.15.81:0/407728786 learned_addr learned my addr 172.21.15.81:0/407728786 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:03:03.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.175+0000 7fbf1fe00640 1 --2- 172.21.15.81:0/407728786 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf201043f0 0x7fbf20114f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:03.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.175+0000 7fbf17e00640 1 -- 172.21.15.81:0/407728786 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf201043f0 msgr2=0x7fbf20114f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:03.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.175+0000 7fbf17e00640 1 --2- 172.21.15.81:0/407728786 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf201043f0 0x7fbf20114f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:03.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.175+0000 7fbf17e00640 1 -- 172.21.15.81:0/407728786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf10005040 con 0x7fbf20104d90 2024-04-23T15:03:03.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.175+0000 7fbf17e00640 1 --2- 172.21.15.81:0/407728786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf20104d90 0x7fbf201154b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbf0800c790 tx=0x7fbf080043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:03.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.177+0000 7fbf1cc00640 1 -- 172.21.15.81:0/407728786 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf0800a820 con 0x7fbf20104d90 2024-04-23T15:03:03.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.177+0000 7fbf1cc00640 1 -- 172.21.15.81:0/407728786 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbf0800ae50 con 0x7fbf20104d90 2024-04-23T15:03:03.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.177+0000 7fbf1cc00640 1 -- 172.21.15.81:0/407728786 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf080115e0 con 0x7fbf20104d90 2024-04-23T15:03:03.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.177+0000 7fbf26c00640 1 -- 172.21.15.81:0/407728786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf2010f3e0 con 0x7fbf20104d90 2024-04-23T15:03:03.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.177+0000 7fbf26c00640 1 -- 172.21.15.81:0/407728786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf2010f900 con 0x7fbf20104d90 2024-04-23T15:03:03.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.178+0000 7fbf26c00640 1 -- 172.21.15.81:0/407728786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf200ffb60 con 0x7fbf20104d90 2024-04-23T15:03:03.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.179+0000 7fbf1cc00640 1 -- 172.21.15.81:0/407728786 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fbf08012400 con 0x7fbf20104d90 2024-04-23T15:03:03.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.180+0000 7fbf1cc00640 1 --2- 172.21.15.81:0/407728786 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fbf0406eb70 0x7fbf04071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:03.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.180+0000 7fbf1cc00640 1 -- 172.21.15.81:0/407728786 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fbf0808ea40 con 0x7fbf20104d90 2024-04-23T15:03:03.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.181+0000 7fbf1fe00640 1 --2- 172.21.15.81:0/407728786 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fbf0406eb70 0x7fbf04071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:03.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.181+0000 7fbf1fe00640 1 --2- 172.21.15.81:0/407728786 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fbf0406eb70 0x7fbf04071020 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbf10031870 tx=0x7fbf10009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:03.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.185+0000 7fbf1cc00640 1 -- 172.21.15.81:0/407728786 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fbf080577f0 con 0x7fbf20104d90 2024-04-23T15:03:03.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:03 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/1906644526' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-04-23T15:03:03.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:03 smithi081 ceph-mon[90469]: pgmap v357: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:03:03.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:03 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/2120200801' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-04-23T15:03:03.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.429+0000 7fbf26c00640 1 -- 172.21.15.81:0/407728786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7fbf2010b580 con 0x7fbf20104d90 2024-04-23T15:03:03.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.430+0000 7fbf1cc00640 1 -- 172.21.15.81:0/407728786 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v36) v1 ==== 107+0+4941 (secure 0 0 0) 0x7fbf0805aeb0 con 0x7fbf20104d90 2024-04-23T15:03:03.431 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T15:03:03.431 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24259,"name":"cephfs.smithi156.vynkxn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.156:6827/1794690362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1794690362},{"type":"v1","addr":"172.21.15.156:6827","nonce":1794690362}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":24263,"name":"cephfs.smithi156.rhbtxt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6825/3854041261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3854041261},{"type":"v1","addr":"172.21.15.156:6825","nonce":3854041261}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34430,"name":"cephfs.smithi081.wydgcg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6827/3200953351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3200953351},{"type":"v1","addr":"172.21.15.81:6827","nonce":3200953351}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T14:45:51.264703+0000","modified":"2024-04-23T14:57:34.994720+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14472":{"gid":14472,"name":"cephfs.smithi081.vcoywg","rank":0,"incarnation":13,"state":"up:active","state_seq":5,"addr":"172.21.15.81:6829/2563365650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2563365650},{"type":"v1","addr":"172.21.15.81:6829","nonce":2563365650}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14472,"qdb_cluster":[14472]},"id":1}]} 2024-04-23T15:03:03.431 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 22 2024-04-23T15:03:03.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.433+0000 7fbf26c00640 1 -- 172.21.15.81:0/407728786 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fbf0406eb70 msgr2=0x7fbf04071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:03.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.433+0000 7fbf26c00640 1 --2- 172.21.15.81:0/407728786 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fbf0406eb70 0x7fbf04071020 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbf10031870 tx=0x7fbf10009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:03.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.433+0000 7fbf26c00640 1 -- 172.21.15.81:0/407728786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf20104d90 msgr2=0x7fbf201154b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:03.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.433+0000 7fbf26c00640 1 --2- 172.21.15.81:0/407728786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf20104d90 0x7fbf201154b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbf0800c790 tx=0x7fbf080043c0 comp rx=0 tx=0).stop 2024-04-23T15:03:03.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.433+0000 7fbf26c00640 1 -- 172.21.15.81:0/407728786 shutdown_connections 2024-04-23T15:03:03.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.433+0000 7fbf26c00640 1 --2- 172.21.15.81:0/407728786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf20104d90 0x7fbf201154b0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:03.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.433+0000 7fbf26c00640 1 --2- 172.21.15.81:0/407728786 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fbf0406eb70 0x7fbf04071020 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:03.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.433+0000 7fbf26c00640 1 --2- 172.21.15.81:0/407728786 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf201043f0 0x7fbf20114f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:03.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.433+0000 7fbf26c00640 1 -- 172.21.15.81:0/407728786 >> 172.21.15.81:0/407728786 conn(0x7fbf200f9fc0 msgr2=0x7fbf200faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:03.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.433+0000 7fbf26c00640 1 -- 172.21.15.81:0/407728786 shutdown_connections 2024-04-23T15:03:03.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.433+0000 7fbf26c00640 1 -- 172.21.15.81:0/407728786 wait complete. 2024-04-23T15:03:03.450 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 22 2024-04-23T15:03:03.450 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 23 2024-04-23T15:03:03.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:03 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/1906644526' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-04-23T15:03:03.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:03 smithi156 ceph-mon[77738]: pgmap v357: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:03:03.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:03 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/2120200801' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-04-23T15:03:03.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.636+0000 7f89e2800640 1 -- 172.21.15.81:0/2805527618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89dc104230 msgr2=0x7f89dc104600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:03.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.636+0000 7f89e2800640 1 --2- 172.21.15.81:0/2805527618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89dc104230 0x7f89dc104600 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f89c80048d0 tx=0x7f89c8009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:03.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.636+0000 7f89e2800640 1 -- 172.21.15.81:0/2805527618 shutdown_connections 2024-04-23T15:03:03.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.636+0000 7f89e2800640 1 --2- 172.21.15.81:0/2805527618 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89dc104bd0 0x7f89dc0fe260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:03.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.636+0000 7f89e2800640 1 --2- 172.21.15.81:0/2805527618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89dc104230 0x7f89dc104600 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:03.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.636+0000 7f89e2800640 1 -- 172.21.15.81:0/2805527618 >> 172.21.15.81:0/2805527618 conn(0x7f89dc0f9fc0 msgr2=0x7f89dc0fc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:03.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.636+0000 7f89e2800640 1 -- 172.21.15.81:0/2805527618 shutdown_connections 2024-04-23T15:03:03.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.636+0000 7f89e2800640 1 -- 172.21.15.81:0/2805527618 wait complete. 2024-04-23T15:03:03.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.637+0000 7f89e2800640 1 Processor -- start 2024-04-23T15:03:03.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.637+0000 7f89e2800640 1 -- start start 2024-04-23T15:03:03.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.638+0000 7f89e2800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89dc104230 0x7f89dc114d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:03.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.638+0000 7f89e2800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89dc104bd0 0x7f89dc1152b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:03.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.638+0000 7f89e2800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc115940 con 0x7f89dc104bd0 2024-04-23T15:03:03.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.638+0000 7f89e2800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc10ef00 con 0x7f89dc104230 2024-04-23T15:03:03.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.638+0000 7f89e0a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89dc104bd0 0x7f89dc1152b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:03.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.638+0000 7f89e0a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89dc104bd0 0x7f89dc1152b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53850/0 (socket says 172.21.15.81:53850) 2024-04-23T15:03:03.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.638+0000 7f89e0a00640 1 -- 172.21.15.81:0/461158076 learned_addr learned my addr 172.21.15.81:0/461158076 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:03:03.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.638+0000 7f89e0a00640 1 -- 172.21.15.81:0/461158076 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89dc104230 msgr2=0x7f89dc114d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:03.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.638+0000 7f89e0a00640 1 --2- 172.21.15.81:0/461158076 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89dc104230 0x7f89dc114d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:03.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.638+0000 7f89e0a00640 1 -- 172.21.15.81:0/461158076 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c8005040 con 0x7f89dc104bd0 2024-04-23T15:03:03.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.639+0000 7f89e0a00640 1 --2- 172.21.15.81:0/461158076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89dc104bd0 0x7f89dc1152b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f89d000b790 tx=0x7f89d00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:03.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.639+0000 7f89d9600640 1 -- 172.21.15.81:0/461158076 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89d000c700 con 0x7f89dc104bd0 2024-04-23T15:03:03.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.639+0000 7f89d9600640 1 -- 172.21.15.81:0/461158076 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f89d000cd30 con 0x7f89dc104bd0 2024-04-23T15:03:03.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.639+0000 7f89e2800640 1 -- 172.21.15.81:0/461158076 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89dc10f1e0 con 0x7f89dc104bd0 2024-04-23T15:03:03.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.639+0000 7f89d9600640 1 -- 172.21.15.81:0/461158076 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89d0013370 con 0x7f89dc104bd0 2024-04-23T15:03:03.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.639+0000 7f89e2800640 1 -- 172.21.15.81:0/461158076 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89dc10f700 con 0x7f89dc104bd0 2024-04-23T15:03:03.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.640+0000 7f89e2800640 1 -- 172.21.15.81:0/461158076 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89dc0ff9a0 con 0x7f89dc104bd0 2024-04-23T15:03:03.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.641+0000 7f89d9600640 1 -- 172.21.15.81:0/461158076 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f89d0012070 con 0x7f89dc104bd0 2024-04-23T15:03:03.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.642+0000 7f89d9600640 1 --2- 172.21.15.81:0/461158076 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f89c406eb70 0x7f89c4071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:03.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.642+0000 7f89d9600640 1 -- 172.21.15.81:0/461158076 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f89d008e550 con 0x7f89dc104bd0 2024-04-23T15:03:03.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.643+0000 7f89e1400640 1 --2- 172.21.15.81:0/461158076 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f89c406eb70 0x7f89c4071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:03.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.643+0000 7f89e1400640 1 --2- 172.21.15.81:0/461158076 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f89c406eb70 0x7f89c4071020 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f89c8003080 tx=0x7f89c8009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:03.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.647+0000 7f89d9600640 1 -- 172.21.15.81:0/461158076 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f89d00572a0 con 0x7f89dc104bd0 2024-04-23T15:03:03.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.873+0000 7f89e2800640 1 -- 172.21.15.81:0/461158076 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f89dc04bcc0 con 0x7f89dc104bd0 2024-04-23T15:03:03.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.875+0000 7f89d9600640 1 -- 172.21.15.81:0/461158076 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v36) v1 ==== 107+0+4143 (secure 0 0 0) 0x7f89d005a960 con 0x7f89dc104bd0 2024-04-23T15:03:03.876 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T15:03:03.876 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24259,"name":"cephfs.smithi156.vynkxn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.156:6827/1794690362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1794690362},{"type":"v1","addr":"172.21.15.156:6827","nonce":1794690362}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":24263,"name":"cephfs.smithi156.rhbtxt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6825/3854041261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3854041261},{"type":"v1","addr":"172.21.15.156:6825","nonce":3854041261}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34430,"name":"cephfs.smithi081.wydgcg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6827/3200953351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3200953351},{"type":"v1","addr":"172.21.15.81:6827","nonce":3200953351}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T14:45:51.264703+0000","modified":"2024-04-23T14:58:05.875738+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-23T15:03:03.876 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 23 2024-04-23T15:03:03.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.877+0000 7f89e2800640 1 -- 172.21.15.81:0/461158076 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f89c406eb70 msgr2=0x7f89c4071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:03.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.877+0000 7f89e2800640 1 --2- 172.21.15.81:0/461158076 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f89c406eb70 0x7f89c4071020 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f89c8003080 tx=0x7f89c8009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:03.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.877+0000 7f89e2800640 1 -- 172.21.15.81:0/461158076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89dc104bd0 msgr2=0x7f89dc1152b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:03.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.877+0000 7f89e2800640 1 --2- 172.21.15.81:0/461158076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89dc104bd0 0x7f89dc1152b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f89d000b790 tx=0x7f89d00091d0 comp rx=0 tx=0).stop 2024-04-23T15:03:03.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.877+0000 7f89e2800640 1 -- 172.21.15.81:0/461158076 shutdown_connections 2024-04-23T15:03:03.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.877+0000 7f89e2800640 1 --2- 172.21.15.81:0/461158076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89dc104bd0 0x7f89dc1152b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:03.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.878+0000 7f89e2800640 1 --2- 172.21.15.81:0/461158076 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f89c406eb70 0x7f89c4071020 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:03.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.878+0000 7f89e2800640 1 --2- 172.21.15.81:0/461158076 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89dc104230 0x7f89dc114d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:03.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.878+0000 7f89e2800640 1 -- 172.21.15.81:0/461158076 >> 172.21.15.81:0/461158076 conn(0x7f89dc0f9fc0 msgr2=0x7f89dc0fbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:03.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.878+0000 7f89e2800640 1 -- 172.21.15.81:0/461158076 shutdown_connections 2024-04-23T15:03:03.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:03.878+0000 7f89e2800640 1 -- 172.21.15.81:0/461158076 wait complete. 2024-04-23T15:03:03.896 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 23 2024-04-23T15:03:03.896 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 24 2024-04-23T15:03:04.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.087+0000 7f6d5fe00640 1 -- 172.21.15.81:0/466852034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d601075a0 msgr2=0x7f6d60107970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:04.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.087+0000 7f6d5fe00640 1 --2- 172.21.15.81:0/466852034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d601075a0 0x7f6d60107970 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6d500048d0 tx=0x7f6d50009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:04.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.087+0000 7f6d5fe00640 1 -- 172.21.15.81:0/466852034 shutdown_connections 2024-04-23T15:03:04.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.087+0000 7f6d5fe00640 1 --2- 172.21.15.81:0/466852034 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d60102670 0x7f6d60102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:04.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.087+0000 7f6d5fe00640 1 --2- 172.21.15.81:0/466852034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d601075a0 0x7f6d60107970 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:04.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.087+0000 7f6d5fe00640 1 -- 172.21.15.81:0/466852034 >> 172.21.15.81:0/466852034 conn(0x7f6d60071e60 msgr2=0x7f6d60074270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:04.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.087+0000 7f6d5fe00640 1 -- 172.21.15.81:0/466852034 shutdown_connections 2024-04-23T15:03:04.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.087+0000 7f6d5fe00640 1 -- 172.21.15.81:0/466852034 wait complete. 2024-04-23T15:03:04.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.088+0000 7f6d5fe00640 1 Processor -- start 2024-04-23T15:03:04.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.088+0000 7f6d5fe00640 1 -- start start 2024-04-23T15:03:04.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.088+0000 7f6d5fe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d60102670 0x7f6d601191d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:04.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.088+0000 7f6d5fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d601075a0 0x7f6d60119710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:04.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.088+0000 7f6d5fe00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d60119da0 con 0x7f6d601075a0 2024-04-23T15:03:04.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.088+0000 7f6d5fe00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d60113360 con 0x7f6d60102670 2024-04-23T15:03:04.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.089+0000 7f6d5e000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d601075a0 0x7f6d60119710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:04.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.089+0000 7f6d5e000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d601075a0 0x7f6d60119710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44914/0 (socket says 172.21.15.81:44914) 2024-04-23T15:03:04.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.089+0000 7f6d5e000640 1 -- 172.21.15.81:0/3892037703 learned_addr learned my addr 172.21.15.81:0/3892037703 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:03:04.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.089+0000 7f6d5ea00640 1 --2- 172.21.15.81:0/3892037703 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d60102670 0x7f6d601191d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:04.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.089+0000 7f6d5e000640 1 -- 172.21.15.81:0/3892037703 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d60102670 msgr2=0x7f6d601191d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:04.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.089+0000 7f6d5e000640 1 --2- 172.21.15.81:0/3892037703 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d60102670 0x7f6d601191d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:04.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.089+0000 7f6d5e000640 1 -- 172.21.15.81:0/3892037703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d50005040 con 0x7f6d601075a0 2024-04-23T15:03:04.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.089+0000 7f6d5e000640 1 --2- 172.21.15.81:0/3892037703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d601075a0 0x7f6d60119710 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c00b790 tx=0x7f6d4c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:04.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.090+0000 7f6d56a00640 1 -- 172.21.15.81:0/3892037703 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d4c00c700 con 0x7f6d601075a0 2024-04-23T15:03:04.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.090+0000 7f6d56a00640 1 -- 172.21.15.81:0/3892037703 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6d4c00cd30 con 0x7f6d601075a0 2024-04-23T15:03:04.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.090+0000 7f6d56a00640 1 -- 172.21.15.81:0/3892037703 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d4c013370 con 0x7f6d601075a0 2024-04-23T15:03:04.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.090+0000 7f6d5fe00640 1 -- 172.21.15.81:0/3892037703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d60113640 con 0x7f6d601075a0 2024-04-23T15:03:04.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.090+0000 7f6d5fe00640 1 -- 172.21.15.81:0/3892037703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d60113b60 con 0x7f6d601075a0 2024-04-23T15:03:04.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.091+0000 7f6d5fe00640 1 -- 172.21.15.81:0/3892037703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d60103d60 con 0x7f6d601075a0 2024-04-23T15:03:04.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.092+0000 7f6d56a00640 1 -- 172.21.15.81:0/3892037703 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f6d4c012070 con 0x7f6d601075a0 2024-04-23T15:03:04.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.093+0000 7f6d56a00640 1 --2- 172.21.15.81:0/3892037703 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6d4406eb70 0x7f6d44071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:04.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.094+0000 7f6d56a00640 1 -- 172.21.15.81:0/3892037703 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f6d4c08e500 con 0x7f6d601075a0 2024-04-23T15:03:04.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.094+0000 7f6d5ea00640 1 --2- 172.21.15.81:0/3892037703 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6d4406eb70 0x7f6d44071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:04.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.095+0000 7f6d5ea00640 1 --2- 172.21.15.81:0/3892037703 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6d4406eb70 0x7f6d44071020 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6d500047f0 tx=0x7f6d50009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:04.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.098+0000 7f6d56a00640 1 -- 172.21.15.81:0/3892037703 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f6d4c057230 con 0x7f6d601075a0 2024-04-23T15:03:04.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.343+0000 7f6d5fe00640 1 -- 172.21.15.81:0/3892037703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7f6d6010f840 con 0x7f6d601075a0 2024-04-23T15:03:04.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.344+0000 7f6d56a00640 1 -- 172.21.15.81:0/3892037703 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v36) v1 ==== 107+0+4154 (secure 0 0 0) 0x7f6d4c05a8f0 con 0x7f6d601075a0 2024-04-23T15:03:04.345 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T15:03:04.345 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24263,"name":"cephfs.smithi156.rhbtxt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6825/3854041261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3854041261},{"type":"v1","addr":"172.21.15.156:6825","nonce":3854041261}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34430,"name":"cephfs.smithi081.wydgcg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6827/3200953351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3200953351},{"type":"v1","addr":"172.21.15.81:6827","nonce":3200953351}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T14:45:51.264703+0000","modified":"2024-04-23T14:58:05.883284+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24259":{"gid":24259,"name":"cephfs.smithi156.vynkxn","rank":0,"incarnation":24,"state":"up:replay","state_seq":2,"addr":"172.21.15.156:6827/1794690362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1794690362},{"type":"v1","addr":"172.21.15.156:6827","nonce":1794690362}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-23T15:03:04.345 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 24 2024-04-23T15:03:04.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.346+0000 7f6d5fe00640 1 -- 172.21.15.81:0/3892037703 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6d4406eb70 msgr2=0x7f6d44071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:04.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.346+0000 7f6d5fe00640 1 --2- 172.21.15.81:0/3892037703 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6d4406eb70 0x7f6d44071020 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6d500047f0 tx=0x7f6d50009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:04.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.346+0000 7f6d5fe00640 1 -- 172.21.15.81:0/3892037703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d601075a0 msgr2=0x7f6d60119710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:04.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.346+0000 7f6d5fe00640 1 --2- 172.21.15.81:0/3892037703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d601075a0 0x7f6d60119710 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c00b790 tx=0x7f6d4c0091d0 comp rx=0 tx=0).stop 2024-04-23T15:03:04.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.346+0000 7f6d5fe00640 1 -- 172.21.15.81:0/3892037703 shutdown_connections 2024-04-23T15:03:04.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.346+0000 7f6d5fe00640 1 --2- 172.21.15.81:0/3892037703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d601075a0 0x7f6d60119710 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:04.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.346+0000 7f6d5fe00640 1 --2- 172.21.15.81:0/3892037703 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6d4406eb70 0x7f6d44071020 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:04.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.346+0000 7f6d5fe00640 1 --2- 172.21.15.81:0/3892037703 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d60102670 0x7f6d601191d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:04.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.346+0000 7f6d5fe00640 1 -- 172.21.15.81:0/3892037703 >> 172.21.15.81:0/3892037703 conn(0x7f6d60071e60 msgr2=0x7f6d60104d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:04.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.347+0000 7f6d5fe00640 1 -- 172.21.15.81:0/3892037703 shutdown_connections 2024-04-23T15:03:04.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.347+0000 7f6d5fe00640 1 -- 172.21.15.81:0/3892037703 wait complete. 2024-04-23T15:03:04.365 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 24 2024-04-23T15:03:04.365 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 25 2024-04-23T15:03:04.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:04 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/407728786' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-04-23T15:03:04.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:04 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/461158076' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-04-23T15:03:04.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.554+0000 7f0b85200640 1 -- 172.21.15.81:0/1343145737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b801075a0 msgr2=0x7f0b80107970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:04.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.554+0000 7f0b85200640 1 --2- 172.21.15.81:0/1343145737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b801075a0 0x7f0b80107970 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0b700048d0 tx=0x7f0b70009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:04.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.554+0000 7f0b85200640 1 -- 172.21.15.81:0/1343145737 shutdown_connections 2024-04-23T15:03:04.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.554+0000 7f0b85200640 1 --2- 172.21.15.81:0/1343145737 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b80102670 0x7f0b80102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:04.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.554+0000 7f0b85200640 1 --2- 172.21.15.81:0/1343145737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b801075a0 0x7f0b80107970 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:04.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.554+0000 7f0b85200640 1 -- 172.21.15.81:0/1343145737 >> 172.21.15.81:0/1343145737 conn(0x7f0b80071e60 msgr2=0x7f0b80074270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:04.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.554+0000 7f0b85200640 1 -- 172.21.15.81:0/1343145737 shutdown_connections 2024-04-23T15:03:04.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.554+0000 7f0b85200640 1 -- 172.21.15.81:0/1343145737 wait complete. 2024-04-23T15:03:04.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.555+0000 7f0b85200640 1 Processor -- start 2024-04-23T15:03:04.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.555+0000 7f0b85200640 1 -- start start 2024-04-23T15:03:04.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.555+0000 7f0b85200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b80102670 0x7f0b80119150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:04.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.555+0000 7f0b85200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b801075a0 0x7f0b80119690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:04.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.555+0000 7f0b85200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b80119c90 con 0x7f0b80102670 2024-04-23T15:03:04.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.555+0000 7f0b85200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b801132e0 con 0x7f0b801075a0 2024-04-23T15:03:04.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.555+0000 7f0b7f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b80102670 0x7f0b80119150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:04.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.556+0000 7f0b7f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b80102670 0x7f0b80119150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44918/0 (socket says 172.21.15.81:44918) 2024-04-23T15:03:04.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.556+0000 7f0b7f400640 1 -- 172.21.15.81:0/1824415602 learned_addr learned my addr 172.21.15.81:0/1824415602 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:03:04.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.556+0000 7f0b7f400640 1 -- 172.21.15.81:0/1824415602 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b801075a0 msgr2=0x7f0b80119690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:04.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.556+0000 7f0b7f400640 1 --2- 172.21.15.81:0/1824415602 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b801075a0 0x7f0b80119690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:04.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.556+0000 7f0b7f400640 1 -- 172.21.15.81:0/1824415602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b70005040 con 0x7f0b80102670 2024-04-23T15:03:04.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.556+0000 7f0b7f400640 1 --2- 172.21.15.81:0/1824415602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b80102670 0x7f0b80119150 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0b7002be70 tx=0x7f0b70009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:04.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.557+0000 7f0b77400640 1 -- 172.21.15.81:0/1824415602 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b700094c0 con 0x7f0b80102670 2024-04-23T15:03:04.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.557+0000 7f0b85200640 1 -- 172.21.15.81:0/1824415602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b80113560 con 0x7f0b80102670 2024-04-23T15:03:04.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.557+0000 7f0b85200640 1 -- 172.21.15.81:0/1824415602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b80113a20 con 0x7f0b80102670 2024-04-23T15:03:04.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.557+0000 7f0b77400640 1 -- 172.21.15.81:0/1824415602 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0b70009620 con 0x7f0b80102670 2024-04-23T15:03:04.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.557+0000 7f0b77400640 1 -- 172.21.15.81:0/1824415602 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b700433b0 con 0x7f0b80102670 2024-04-23T15:03:04.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.558+0000 7f0b85200640 1 -- 172.21.15.81:0/1824415602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b5c005210 con 0x7f0b80102670 2024-04-23T15:03:04.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.559+0000 7f0b77400640 1 -- 172.21.15.81:0/1824415602 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f0b7002f070 con 0x7f0b80102670 2024-04-23T15:03:04.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.560+0000 7f0b77400640 1 --2- 172.21.15.81:0/1824415602 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f0b6406eb70 0x7f0b64071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:04.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.560+0000 7f0b77400640 1 -- 172.21.15.81:0/1824415602 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f0b700b0840 con 0x7f0b80102670 2024-04-23T15:03:04.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.560+0000 7f0b7ea00640 1 --2- 172.21.15.81:0/1824415602 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f0b6406eb70 0x7f0b64071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:04.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.561+0000 7f0b7ea00640 1 --2- 172.21.15.81:0/1824415602 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f0b6406eb70 0x7f0b64071020 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0b80114a10 tx=0x7f0b68007c30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:04.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.565+0000 7f0b77400640 1 -- 172.21.15.81:0/1824415602 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f0b700794d0 con 0x7f0b80102670 2024-04-23T15:03:04.575 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:04 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/407728786' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-04-23T15:03:04.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:04 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/461158076' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-04-23T15:03:04.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.810+0000 7f0b85200640 1 -- 172.21.15.81:0/1824415602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f0b5c005790 con 0x7f0b80102670 2024-04-23T15:03:04.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.811+0000 7f0b77400640 1 -- 172.21.15.81:0/1824415602 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v36) v1 ==== 107+0+4159 (secure 0 0 0) 0x7f0b7007cb90 con 0x7f0b80102670 2024-04-23T15:03:04.812 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T15:03:04.813 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24263,"name":"cephfs.smithi156.rhbtxt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6825/3854041261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3854041261},{"type":"v1","addr":"172.21.15.156:6825","nonce":3854041261}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34430,"name":"cephfs.smithi081.wydgcg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6827/3200953351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3200953351},{"type":"v1","addr":"172.21.15.81:6827","nonce":3200953351}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T14:45:51.264703+0000","modified":"2024-04-23T14:58:14.032905+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24259":{"gid":24259,"name":"cephfs.smithi156.vynkxn","rank":0,"incarnation":24,"state":"up:reconnect","state_seq":183,"addr":"172.21.15.156:6827/1794690362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1794690362},{"type":"v1","addr":"172.21.15.156:6827","nonce":1794690362}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-23T15:03:04.813 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 25 2024-04-23T15:03:04.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.814+0000 7f0b85200640 1 -- 172.21.15.81:0/1824415602 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f0b6406eb70 msgr2=0x7f0b64071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:04.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.814+0000 7f0b85200640 1 --2- 172.21.15.81:0/1824415602 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f0b6406eb70 0x7f0b64071020 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0b80114a10 tx=0x7f0b68007c30 comp rx=0 tx=0).stop 2024-04-23T15:03:04.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.814+0000 7f0b85200640 1 -- 172.21.15.81:0/1824415602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b80102670 msgr2=0x7f0b80119150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:04.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.814+0000 7f0b85200640 1 --2- 172.21.15.81:0/1824415602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b80102670 0x7f0b80119150 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0b7002be70 tx=0x7f0b70009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:04.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.814+0000 7f0b85200640 1 -- 172.21.15.81:0/1824415602 shutdown_connections 2024-04-23T15:03:04.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.814+0000 7f0b85200640 1 --2- 172.21.15.81:0/1824415602 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f0b6406eb70 0x7f0b64071020 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:04.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.814+0000 7f0b85200640 1 --2- 172.21.15.81:0/1824415602 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b801075a0 0x7f0b80119690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:04.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.814+0000 7f0b85200640 1 --2- 172.21.15.81:0/1824415602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b80102670 0x7f0b80119150 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:04.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.814+0000 7f0b85200640 1 -- 172.21.15.81:0/1824415602 >> 172.21.15.81:0/1824415602 conn(0x7f0b80071e60 msgr2=0x7f0b80104d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:04.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.815+0000 7f0b85200640 1 -- 172.21.15.81:0/1824415602 shutdown_connections 2024-04-23T15:03:04.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:04.815+0000 7f0b85200640 1 -- 172.21.15.81:0/1824415602 wait complete. 2024-04-23T15:03:04.835 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 25 2024-04-23T15:03:04.835 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 26 2024-04-23T15:03:05.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.026+0000 7f420a800640 1 -- 172.21.15.81:0/1495463793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4204102670 msgr2=0x7f4204102ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:05.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.026+0000 7f420a800640 1 --2- 172.21.15.81:0/1495463793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4204102670 0x7f4204102ae0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f41f40048d0 tx=0x7f41f4009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:05.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.026+0000 7f420a800640 1 -- 172.21.15.81:0/1495463793 shutdown_connections 2024-04-23T15:03:05.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.026+0000 7f420a800640 1 --2- 172.21.15.81:0/1495463793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4204102670 0x7f4204102ae0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:05.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.026+0000 7f420a800640 1 --2- 172.21.15.81:0/1495463793 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42041075a0 0x7f4204107970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:05.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.026+0000 7f420a800640 1 -- 172.21.15.81:0/1495463793 >> 172.21.15.81:0/1495463793 conn(0x7f4204071e60 msgr2=0x7f4204074270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:05.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.026+0000 7f420a800640 1 -- 172.21.15.81:0/1495463793 shutdown_connections 2024-04-23T15:03:05.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.026+0000 7f420a800640 1 -- 172.21.15.81:0/1495463793 wait complete. 2024-04-23T15:03:05.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.027+0000 7f420a800640 1 Processor -- start 2024-04-23T15:03:05.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.027+0000 7f420a800640 1 -- start start 2024-04-23T15:03:05.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.027+0000 7f420a800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4204102670 0x7f4204119060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:05.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.027+0000 7f420a800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42041075a0 0x7f42041195a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:05.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.027+0000 7f420a800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4204119ba0 con 0x7f4204102670 2024-04-23T15:03:05.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.027+0000 7f420a800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4204119d10 con 0x7f42041075a0 2024-04-23T15:03:05.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.028+0000 7f4209400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4204102670 0x7f4204119060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:05.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.028+0000 7f4209400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4204102670 0x7f4204119060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44946/0 (socket says 172.21.15.81:44946) 2024-04-23T15:03:05.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.028+0000 7f4209400640 1 -- 172.21.15.81:0/3499455248 learned_addr learned my addr 172.21.15.81:0/3499455248 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:03:05.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.028+0000 7f4209400640 1 -- 172.21.15.81:0/3499455248 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42041075a0 msgr2=0x7f42041195a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:05.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.028+0000 7f4209400640 1 --2- 172.21.15.81:0/3499455248 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42041075a0 0x7f42041195a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:05.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.028+0000 7f4209400640 1 -- 172.21.15.81:0/3499455248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f4005040 con 0x7f4204102670 2024-04-23T15:03:05.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.028+0000 7f4209400640 1 --2- 172.21.15.81:0/3499455248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4204102670 0x7f4204119060 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f41f8002840 tx=0x7f41f8004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:05.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.028+0000 7f4201600640 1 -- 172.21.15.81:0/3499455248 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41f8007c30 con 0x7f4204102670 2024-04-23T15:03:05.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.029+0000 7f4201600640 1 -- 172.21.15.81:0/3499455248 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f41f800f040 con 0x7f4204102670 2024-04-23T15:03:05.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.029+0000 7f420a800640 1 -- 172.21.15.81:0/3499455248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4204113460 con 0x7f4204102670 2024-04-23T15:03:05.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.029+0000 7f4201600640 1 -- 172.21.15.81:0/3499455248 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41f8009570 con 0x7f4204102670 2024-04-23T15:03:05.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.029+0000 7f420a800640 1 -- 172.21.15.81:0/3499455248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4204113980 con 0x7f4204102670 2024-04-23T15:03:05.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.030+0000 7f420a800640 1 -- 172.21.15.81:0/3499455248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4204103d60 con 0x7f4204102670 2024-04-23T15:03:05.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.031+0000 7f4201600640 1 -- 172.21.15.81:0/3499455248 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f41f800dc80 con 0x7f4204102670 2024-04-23T15:03:05.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.032+0000 7f4201600640 1 --2- 172.21.15.81:0/3499455248 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f41ec06eb70 0x7f41ec071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:05.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.032+0000 7f4201600640 1 -- 172.21.15.81:0/3499455248 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f41f808e830 con 0x7f4204102670 2024-04-23T15:03:05.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.032+0000 7f4208a00640 1 --2- 172.21.15.81:0/3499455248 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f41ec06eb70 0x7f41ec071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:05.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.033+0000 7f4208a00640 1 --2- 172.21.15.81:0/3499455248 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f41ec06eb70 0x7f41ec071020 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f41f4003080 tx=0x7f41f4009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:05.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.037+0000 7f4201600640 1 -- 172.21.15.81:0/3499455248 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f41f8057560 con 0x7f4204102670 2024-04-23T15:03:05.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.265+0000 7f420a800640 1 -- 172.21.15.81:0/3499455248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7f420404bcc0 con 0x7f4204102670 2024-04-23T15:03:05.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.266+0000 7f4201600640 1 -- 172.21.15.81:0/3499455248 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v36) v1 ==== 107+0+5003 (secure 0 0 0) 0x7f41f805ac20 con 0x7f4204102670 2024-04-23T15:03:05.267 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T15:03:05.268 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24263,"name":"cephfs.smithi156.rhbtxt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6825/3854041261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3854041261},{"type":"v1","addr":"172.21.15.156:6825","nonce":3854041261}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34430,"name":"cephfs.smithi081.wydgcg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6827/3200953351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3200953351},{"type":"v1","addr":"172.21.15.81:6827","nonce":3200953351}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":34462,"name":"cephfs.smithi081.vcoywg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6829/2598630159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2598630159},{"type":"v1","addr":"172.21.15.81:6829","nonce":2598630159}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T14:45:51.264703+0000","modified":"2024-04-23T14:58:14.743238+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24259":{"gid":24259,"name":"cephfs.smithi156.vynkxn","rank":0,"incarnation":24,"state":"up:rejoin","state_seq":184,"addr":"172.21.15.156:6827/1794690362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1794690362},{"type":"v1","addr":"172.21.15.156:6827","nonce":1794690362}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-23T15:03:05.268 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 26 2024-04-23T15:03:05.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.269+0000 7f420a800640 1 -- 172.21.15.81:0/3499455248 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f41ec06eb70 msgr2=0x7f41ec071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:05.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.269+0000 7f420a800640 1 --2- 172.21.15.81:0/3499455248 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f41ec06eb70 0x7f41ec071020 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f41f4003080 tx=0x7f41f4009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:05.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.269+0000 7f420a800640 1 -- 172.21.15.81:0/3499455248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4204102670 msgr2=0x7f4204119060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:05.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.269+0000 7f420a800640 1 --2- 172.21.15.81:0/3499455248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4204102670 0x7f4204119060 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f41f8002840 tx=0x7f41f8004570 comp rx=0 tx=0).stop 2024-04-23T15:03:05.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.269+0000 7f420a800640 1 -- 172.21.15.81:0/3499455248 shutdown_connections 2024-04-23T15:03:05.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.269+0000 7f420a800640 1 --2- 172.21.15.81:0/3499455248 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f41ec06eb70 0x7f41ec071020 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:05.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.269+0000 7f420a800640 1 --2- 172.21.15.81:0/3499455248 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42041075a0 0x7f42041195a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:05.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.269+0000 7f420a800640 1 --2- 172.21.15.81:0/3499455248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4204102670 0x7f4204119060 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:05.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.269+0000 7f420a800640 1 -- 172.21.15.81:0/3499455248 >> 172.21.15.81:0/3499455248 conn(0x7f4204071e60 msgr2=0x7f4204104cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:05.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.269+0000 7f420a800640 1 -- 172.21.15.81:0/3499455248 shutdown_connections 2024-04-23T15:03:05.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.270+0000 7f420a800640 1 -- 172.21.15.81:0/3499455248 wait complete. 2024-04-23T15:03:05.287 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 26 2024-04-23T15:03:05.288 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 27 2024-04-23T15:03:05.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.479+0000 7f6dcb800640 1 -- 172.21.15.81:0/1312766797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dc4104da0 msgr2=0x7f6dc40fe430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:05.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.479+0000 7f6dcb800640 1 --2- 172.21.15.81:0/1312766797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dc4104da0 0x7f6dc40fe430 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6db00048d0 tx=0x7f6db0009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:05.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.479+0000 7f6dcb800640 1 -- 172.21.15.81:0/1312766797 shutdown_connections 2024-04-23T15:03:05.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.479+0000 7f6dcb800640 1 --2- 172.21.15.81:0/1312766797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dc4104da0 0x7f6dc40fe430 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:05.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.479+0000 7f6dcb800640 1 --2- 172.21.15.81:0/1312766797 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6dc4104400 0x7f6dc41047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:05.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.479+0000 7f6dcb800640 1 -- 172.21.15.81:0/1312766797 >> 172.21.15.81:0/1312766797 conn(0x7f6dc40f9ff0 msgr2=0x7f6dc40fc400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:05.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.479+0000 7f6dcb800640 1 -- 172.21.15.81:0/1312766797 shutdown_connections 2024-04-23T15:03:05.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.479+0000 7f6dcb800640 1 -- 172.21.15.81:0/1312766797 wait complete. 2024-04-23T15:03:05.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.480+0000 7f6dcb800640 1 Processor -- start 2024-04-23T15:03:05.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.480+0000 7f6dcb800640 1 -- start start 2024-04-23T15:03:05.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.481+0000 7f6dcb800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6dc4104400 0x7f6dc4114f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:05.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.481+0000 7f6dcb800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dc4104da0 0x7f6dc4115450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:05.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.481+0000 7f6dcb800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc4115a50 con 0x7f6dc4104da0 2024-04-23T15:03:05.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.481+0000 7f6dcb800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc410f0a0 con 0x7f6dc4104400 2024-04-23T15:03:05.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.481+0000 7f6dc3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dc4104da0 0x7f6dc4115450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:05.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.481+0000 7f6dc3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dc4104da0 0x7f6dc4115450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44960/0 (socket says 172.21.15.81:44960) 2024-04-23T15:03:05.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.481+0000 7f6dc3e00640 1 -- 172.21.15.81:0/1795511440 learned_addr learned my addr 172.21.15.81:0/1795511440 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:03:05.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.481+0000 7f6dc3e00640 1 -- 172.21.15.81:0/1795511440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6dc4104400 msgr2=0x7f6dc4114f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:05.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.481+0000 7f6dc3e00640 1 --2- 172.21.15.81:0/1795511440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6dc4104400 0x7f6dc4114f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:05.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.481+0000 7f6dc3e00640 1 -- 172.21.15.81:0/1795511440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db0005040 con 0x7f6dc4104da0 2024-04-23T15:03:05.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.481+0000 7f6dc3e00640 1 --2- 172.21.15.81:0/1795511440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dc4104da0 0x7f6dc4115450 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6db0004930 tx=0x7f6db0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:05.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.482+0000 7f6dc0c00640 1 -- 172.21.15.81:0/1795511440 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6db00094c0 con 0x7f6dc4104da0 2024-04-23T15:03:05.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.482+0000 7f6dc0c00640 1 -- 172.21.15.81:0/1795511440 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6db0032e50 con 0x7f6dc4104da0 2024-04-23T15:03:05.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.482+0000 7f6dc0c00640 1 -- 172.21.15.81:0/1795511440 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6db00433b0 con 0x7f6dc4104da0 2024-04-23T15:03:05.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.482+0000 7f6dcb800640 1 -- 172.21.15.81:0/1795511440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dc410f320 con 0x7f6dc4104da0 2024-04-23T15:03:05.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.482+0000 7f6dcb800640 1 -- 172.21.15.81:0/1795511440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dc410f7e0 con 0x7f6dc4104da0 2024-04-23T15:03:05.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.483+0000 7f6dcb800640 1 -- 172.21.15.81:0/1795511440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dc40ffb70 con 0x7f6dc4104da0 2024-04-23T15:03:05.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.484+0000 7f6dc0c00640 1 -- 172.21.15.81:0/1795511440 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f6db002f070 con 0x7f6dc4104da0 2024-04-23T15:03:05.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.485+0000 7f6dc0c00640 1 --2- 172.21.15.81:0/1795511440 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6dac06eb70 0x7f6dac071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:05.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.485+0000 7f6dc0c00640 1 -- 172.21.15.81:0/1795511440 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f6db00b0860 con 0x7f6dc4104da0 2024-04-23T15:03:05.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.485+0000 7f6dc8e00640 1 --2- 172.21.15.81:0/1795511440 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6dac06eb70 0x7f6dac071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:05.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.486+0000 7f6dc8e00640 1 --2- 172.21.15.81:0/1795511440 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6dac06eb70 0x7f6dac071020 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6db8004c80 tx=0x7f6db8009c50 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:05.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.490+0000 7f6dc0c00640 1 -- 172.21.15.81:0/1795511440 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f6db0079510 con 0x7f6dc4104da0 2024-04-23T15:03:05.535 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:05 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/3892037703' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-04-23T15:03:05.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:05 smithi156 ceph-mon[77738]: pgmap v358: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:03:05.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:05 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/1824415602' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-04-23T15:03:05.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:05 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/3892037703' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-04-23T15:03:05.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:05 smithi081 ceph-mon[90469]: pgmap v358: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:03:05.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:05 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/1824415602' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-04-23T15:03:05.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.729+0000 7f6dcb800640 1 -- 172.21.15.81:0/1795511440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f6dc410b560 con 0x7f6dc4104da0 2024-04-23T15:03:05.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.730+0000 7f6dc0c00640 1 -- 172.21.15.81:0/1795511440 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v36) v1 ==== 107+0+5012 (secure 0 0 0) 0x7f6db007cbd0 con 0x7f6dc4104da0 2024-04-23T15:03:05.731 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T15:03:05.731 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24263,"name":"cephfs.smithi156.rhbtxt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6825/3854041261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3854041261},{"type":"v1","addr":"172.21.15.156:6825","nonce":3854041261}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34430,"name":"cephfs.smithi081.wydgcg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6827/3200953351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3200953351},{"type":"v1","addr":"172.21.15.81:6827","nonce":3200953351}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":34462,"name":"cephfs.smithi081.vcoywg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6829/2598630159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2598630159},{"type":"v1","addr":"172.21.15.81:6829","nonce":2598630159}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T14:45:51.264703+0000","modified":"2024-04-23T14:58:16.744675+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24259":{"gid":24259,"name":"cephfs.smithi156.vynkxn","rank":0,"incarnation":24,"state":"up:active","state_seq":185,"addr":"172.21.15.156:6827/1794690362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1794690362},{"type":"v1","addr":"172.21.15.156:6827","nonce":1794690362}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24259,"qdb_cluster":[24259]},"id":1}]} 2024-04-23T15:03:05.732 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 27 2024-04-23T15:03:05.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.733+0000 7f6dcb800640 1 -- 172.21.15.81:0/1795511440 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6dac06eb70 msgr2=0x7f6dac071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:05.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.733+0000 7f6dcb800640 1 --2- 172.21.15.81:0/1795511440 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6dac06eb70 0x7f6dac071020 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6db8004c80 tx=0x7f6db8009c50 comp rx=0 tx=0).stop 2024-04-23T15:03:05.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.733+0000 7f6dcb800640 1 -- 172.21.15.81:0/1795511440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dc4104da0 msgr2=0x7f6dc4115450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:05.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.733+0000 7f6dcb800640 1 --2- 172.21.15.81:0/1795511440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dc4104da0 0x7f6dc4115450 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6db0004930 tx=0x7f6db0009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:05.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.733+0000 7f6dcb800640 1 -- 172.21.15.81:0/1795511440 shutdown_connections 2024-04-23T15:03:05.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.733+0000 7f6dcb800640 1 --2- 172.21.15.81:0/1795511440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dc4104da0 0x7f6dc4115450 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:05.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.733+0000 7f6dcb800640 1 --2- 172.21.15.81:0/1795511440 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6dac06eb70 0x7f6dac071020 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:05.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.733+0000 7f6dcb800640 1 --2- 172.21.15.81:0/1795511440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6dc4104400 0x7f6dc4114f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:05.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.733+0000 7f6dcb800640 1 -- 172.21.15.81:0/1795511440 >> 172.21.15.81:0/1795511440 conn(0x7f6dc40f9ff0 msgr2=0x7f6dc40faf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:05.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.733+0000 7f6dcb800640 1 -- 172.21.15.81:0/1795511440 shutdown_connections 2024-04-23T15:03:05.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.733+0000 7f6dcb800640 1 -- 172.21.15.81:0/1795511440 wait complete. 2024-04-23T15:03:05.752 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 27 2024-04-23T15:03:05.752 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 28 2024-04-23T15:03:05.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.947+0000 7f9309a00640 1 -- 172.21.15.81:0/2833587691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9304072310 msgr2=0x7f930410cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:05.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.947+0000 7f9309a00640 1 --2- 172.21.15.81:0/2833587691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9304072310 0x7f930410cb90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f92ec0048d0 tx=0x7f92ec009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:05.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.947+0000 7f9309a00640 1 -- 172.21.15.81:0/2833587691 shutdown_connections 2024-04-23T15:03:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.947+0000 7f9309a00640 1 --2- 172.21.15.81:0/2833587691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9304072310 0x7f930410cb90 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.947+0000 7f9309a00640 1 --2- 172.21.15.81:0/2833587691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9304071a00 0x7f9304071dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.947+0000 7f9309a00640 1 -- 172.21.15.81:0/2833587691 >> 172.21.15.81:0/2833587691 conn(0x7f93040f9ff0 msgr2=0x7f93040fc400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.947+0000 7f9309a00640 1 -- 172.21.15.81:0/2833587691 shutdown_connections 2024-04-23T15:03:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.947+0000 7f9309a00640 1 -- 172.21.15.81:0/2833587691 wait complete. 2024-04-23T15:03:05.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.948+0000 7f9309a00640 1 Processor -- start 2024-04-23T15:03:05.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.948+0000 7f9309a00640 1 -- start start 2024-04-23T15:03:05.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.949+0000 7f9309a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9304071a00 0x7f9304119370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:05.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.949+0000 7f9309a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9304072310 0x7f93041198b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:05.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.949+0000 7f9309a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9304119f40 con 0x7f9304071a00 2024-04-23T15:03:05.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.949+0000 7f9309a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9304113500 con 0x7f9304072310 2024-04-23T15:03:05.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.949+0000 7f9302a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9304071a00 0x7f9304119370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:05.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.949+0000 7f9302a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9304071a00 0x7f9304119370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44980/0 (socket says 172.21.15.81:44980) 2024-04-23T15:03:05.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.949+0000 7f9302a00640 1 -- 172.21.15.81:0/1915244935 learned_addr learned my addr 172.21.15.81:0/1915244935 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:03:05.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.949+0000 7f9302a00640 1 -- 172.21.15.81:0/1915244935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9304072310 msgr2=0x7f93041198b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:05.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.949+0000 7f9302a00640 1 --2- 172.21.15.81:0/1915244935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9304072310 0x7f93041198b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:05.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.949+0000 7f9302a00640 1 -- 172.21.15.81:0/1915244935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ec005040 con 0x7f9304071a00 2024-04-23T15:03:05.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.950+0000 7f9302a00640 1 --2- 172.21.15.81:0/1915244935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9304071a00 0x7f9304119370 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f92f400b790 tx=0x7f92f40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:05.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.950+0000 7f92faa00640 1 -- 172.21.15.81:0/1915244935 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92f400c700 con 0x7f9304071a00 2024-04-23T15:03:05.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.950+0000 7f92faa00640 1 -- 172.21.15.81:0/1915244935 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f92f400cd30 con 0x7f9304071a00 2024-04-23T15:03:05.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.950+0000 7f92faa00640 1 -- 172.21.15.81:0/1915244935 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92f4013370 con 0x7f9304071a00 2024-04-23T15:03:05.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.950+0000 7f9309a00640 1 -- 172.21.15.81:0/1915244935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93041137e0 con 0x7f9304071a00 2024-04-23T15:03:05.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.950+0000 7f9309a00640 1 -- 172.21.15.81:0/1915244935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9304113d00 con 0x7f9304071a00 2024-04-23T15:03:05.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.951+0000 7f9309a00640 1 -- 172.21.15.81:0/1915244935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9304073140 con 0x7f9304071a00 2024-04-23T15:03:05.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.952+0000 7f92faa00640 1 -- 172.21.15.81:0/1915244935 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f92f4012070 con 0x7f9304071a00 2024-04-23T15:03:05.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.954+0000 7f92faa00640 1 --2- 172.21.15.81:0/1915244935 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f92e806eb70 0x7f92e8071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:05.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.954+0000 7f92faa00640 1 -- 172.21.15.81:0/1915244935 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f92f408e5f0 con 0x7f9304071a00 2024-04-23T15:03:05.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.954+0000 7f92fbe00640 1 --2- 172.21.15.81:0/1915244935 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f92e806eb70 0x7f92e8071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:05.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.955+0000 7f92fbe00640 1 --2- 172.21.15.81:0/1915244935 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f92e806eb70 0x7f92e8071020 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f92ec02bda0 tx=0x7f92ec009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:05.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:05.959+0000 7f92faa00640 1 -- 172.21.15.81:0/1915244935 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f92f40572a0 con 0x7f9304071a00 2024-04-23T15:03:06.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.202+0000 7f9309a00640 1 -- 172.21.15.81:0/1915244935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7f930410fa30 con 0x7f9304071a00 2024-04-23T15:03:06.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.208+0000 7f92faa00640 1 -- 172.21.15.81:0/1915244935 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v36) v1 ==== 107+0+4230 (secure 0 0 0) 0x7f92f405a960 con 0x7f9304071a00 2024-04-23T15:03:06.209 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T15:03:06.209 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34430,"name":"cephfs.smithi081.wydgcg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6827/3200953351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3200953351},{"type":"v1","addr":"172.21.15.81:6827","nonce":3200953351}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":34462,"name":"cephfs.smithi081.vcoywg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6829/2598630159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2598630159},{"type":"v1","addr":"172.21.15.81:6829","nonce":2598630159}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T14:45:51.264703+0000","modified":"2024-04-23T14:58:16.744675+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24259":{"gid":24259,"name":"cephfs.smithi156.vynkxn","rank":0,"incarnation":24,"state":"up:active","state_seq":185,"addr":"172.21.15.156:6827/1794690362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1794690362},{"type":"v1","addr":"172.21.15.156:6827","nonce":1794690362}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24259,"qdb_cluster":[24259]},"id":1}]} 2024-04-23T15:03:06.209 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 28 2024-04-23T15:03:06.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.210+0000 7f9309a00640 1 -- 172.21.15.81:0/1915244935 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f92e806eb70 msgr2=0x7f92e8071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:06.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.210+0000 7f9309a00640 1 --2- 172.21.15.81:0/1915244935 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f92e806eb70 0x7f92e8071020 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f92ec02bda0 tx=0x7f92ec009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.210+0000 7f9309a00640 1 -- 172.21.15.81:0/1915244935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9304071a00 msgr2=0x7f9304119370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:06.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.210+0000 7f9309a00640 1 --2- 172.21.15.81:0/1915244935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9304071a00 0x7f9304119370 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f92f400b790 tx=0x7f92f40091d0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.211+0000 7f9309a00640 1 -- 172.21.15.81:0/1915244935 shutdown_connections 2024-04-23T15:03:06.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.211+0000 7f9309a00640 1 --2- 172.21.15.81:0/1915244935 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f92e806eb70 0x7f92e8071020 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.211+0000 7f9309a00640 1 --2- 172.21.15.81:0/1915244935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9304072310 0x7f93041198b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.211+0000 7f9309a00640 1 --2- 172.21.15.81:0/1915244935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9304071a00 0x7f9304119370 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.211+0000 7f9309a00640 1 -- 172.21.15.81:0/1915244935 >> 172.21.15.81:0/1915244935 conn(0x7f93040f9ff0 msgr2=0x7f93040fac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:06.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.211+0000 7f9309a00640 1 -- 172.21.15.81:0/1915244935 shutdown_connections 2024-04-23T15:03:06.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.211+0000 7f9309a00640 1 -- 172.21.15.81:0/1915244935 wait complete. 2024-04-23T15:03:06.228 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 28 2024-04-23T15:03:06.228 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 29 2024-04-23T15:03:06.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.425+0000 7fc4ed400640 1 -- 172.21.15.81:0/3902287228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4e8064c90 msgr2=0x7fc4e81087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:06.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.425+0000 7fc4ed400640 1 --2- 172.21.15.81:0/3902287228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4e8064c90 0x7fc4e81087b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8009c50 tx=0x7fc4d8004d10 comp rx=0 tx=0).stop 2024-04-23T15:03:06.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.425+0000 7fc4ed400640 1 -- 172.21.15.81:0/3902287228 shutdown_connections 2024-04-23T15:03:06.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.425+0000 7fc4ed400640 1 --2- 172.21.15.81:0/3902287228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4e8064c90 0x7fc4e81087b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.425+0000 7fc4ed400640 1 --2- 172.21.15.81:0/3902287228 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4e8064380 0x7fc4e8064750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.425+0000 7fc4ed400640 1 -- 172.21.15.81:0/3902287228 >> 172.21.15.81:0/3902287228 conn(0x7fc4e80711c0 msgr2=0x7fc4e80715c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:06.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.425+0000 7fc4ed400640 1 -- 172.21.15.81:0/3902287228 shutdown_connections 2024-04-23T15:03:06.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.425+0000 7fc4ed400640 1 -- 172.21.15.81:0/3902287228 wait complete. 2024-04-23T15:03:06.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.426+0000 7fc4ed400640 1 Processor -- start 2024-04-23T15:03:06.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.426+0000 7fc4ed400640 1 -- start start 2024-04-23T15:03:06.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.427+0000 7fc4ed400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4e8064380 0x7fc4e8114fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:06.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.427+0000 7fc4ed400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4e8064c90 0x7fc4e8115500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:06.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.427+0000 7fc4ed400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e8115b90 con 0x7fc4e8064c90 2024-04-23T15:03:06.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.427+0000 7fc4ed400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e810f150 con 0x7fc4e8064380 2024-04-23T15:03:06.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.427+0000 7fc4e5e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4e8064c90 0x7fc4e8115500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:06.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.427+0000 7fc4e5e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4e8064c90 0x7fc4e8115500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45008/0 (socket says 172.21.15.81:45008) 2024-04-23T15:03:06.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.427+0000 7fc4e5e00640 1 -- 172.21.15.81:0/259454536 learned_addr learned my addr 172.21.15.81:0/259454536 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:03:06.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.427+0000 7fc4e6800640 1 --2- 172.21.15.81:0/259454536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4e8064380 0x7fc4e8114fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:06.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.427+0000 7fc4e5e00640 1 -- 172.21.15.81:0/259454536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4e8064380 msgr2=0x7fc4e8114fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:06.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.427+0000 7fc4e5e00640 1 --2- 172.21.15.81:0/259454536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4e8064380 0x7fc4e8114fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.427+0000 7fc4e5e00640 1 -- 172.21.15.81:0/259454536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d80098b0 con 0x7fc4e8064c90 2024-04-23T15:03:06.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.428+0000 7fc4e5e00640 1 --2- 172.21.15.81:0/259454536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4e8064c90 0x7fc4e8115500 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc4d802c1f0 tx=0x7fc4d8004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:06.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.428+0000 7fc4dea00640 1 -- 172.21.15.81:0/259454536 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4d803a070 con 0x7fc4e8064c90 2024-04-23T15:03:06.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.428+0000 7fc4dea00640 1 -- 172.21.15.81:0/259454536 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc4d8009740 con 0x7fc4e8064c90 2024-04-23T15:03:06.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.428+0000 7fc4dea00640 1 -- 172.21.15.81:0/259454536 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4d803eb40 con 0x7fc4e8064c90 2024-04-23T15:03:06.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.428+0000 7fc4ed400640 1 -- 172.21.15.81:0/259454536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4e810f3d0 con 0x7fc4e8064c90 2024-04-23T15:03:06.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.428+0000 7fc4ed400640 1 -- 172.21.15.81:0/259454536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4e810f8f0 con 0x7fc4e8064c90 2024-04-23T15:03:06.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.429+0000 7fc4ed400640 1 -- 172.21.15.81:0/259454536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4e80fb720 con 0x7fc4e8064c90 2024-04-23T15:03:06.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.430+0000 7fc4dea00640 1 -- 172.21.15.81:0/259454536 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fc4d8032070 con 0x7fc4e8064c90 2024-04-23T15:03:06.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.431+0000 7fc4dea00640 1 --2- 172.21.15.81:0/259454536 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc4cc06eb70 0x7fc4cc071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:06.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.431+0000 7fc4dea00640 1 -- 172.21.15.81:0/259454536 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fc4d80b0c60 con 0x7fc4e8064c90 2024-04-23T15:03:06.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.432+0000 7fc4e6800640 1 --2- 172.21.15.81:0/259454536 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc4cc06eb70 0x7fc4cc071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:06.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.432+0000 7fc4e6800640 1 --2- 172.21.15.81:0/259454536 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc4cc06eb70 0x7fc4cc071020 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc4d000a900 tx=0x7fc4d0008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:06.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.436+0000 7fc4dea00640 1 -- 172.21.15.81:0/259454536 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fc4d8079ae0 con 0x7fc4e8064c90 2024-04-23T15:03:06.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:06 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/3499455248' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-04-23T15:03:06.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:06 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/1795511440' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-04-23T15:03:06.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:06 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/3499455248' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-04-23T15:03:06.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:06 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/1795511440' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-04-23T15:03:06.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.674+0000 7fc4ed400640 1 -- 172.21.15.81:0/259454536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7fc4e8063f30 con 0x7fc4e8064c90 2024-04-23T15:03:06.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.675+0000 7fc4dea00640 1 -- 172.21.15.81:0/259454536 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v36) v1 ==== 107+0+5080 (secure 0 0 0) 0x7fc4d807d1a0 con 0x7fc4e8064c90 2024-04-23T15:03:06.676 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T15:03:06.676 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34430,"name":"cephfs.smithi081.wydgcg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6827/3200953351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3200953351},{"type":"v1","addr":"172.21.15.81:6827","nonce":3200953351}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":34462,"name":"cephfs.smithi081.vcoywg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6829/2598630159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2598630159},{"type":"v1","addr":"172.21.15.81:6829","nonce":2598630159}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44273,"name":"cephfs.smithi156.rhbtxt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6825/3017230919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3017230919},{"type":"v1","addr":"172.21.15.156:6825","nonce":3017230919}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T14:45:51.264703+0000","modified":"2024-04-23T14:58:16.744675+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24259":{"gid":24259,"name":"cephfs.smithi156.vynkxn","rank":0,"incarnation":24,"state":"up:active","state_seq":185,"addr":"172.21.15.156:6827/1794690362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1794690362},{"type":"v1","addr":"172.21.15.156:6827","nonce":1794690362}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24259,"qdb_cluster":[24259]},"id":1}]} 2024-04-23T15:03:06.676 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 29 2024-04-23T15:03:06.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.678+0000 7fc4ed400640 1 -- 172.21.15.81:0/259454536 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc4cc06eb70 msgr2=0x7fc4cc071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:06.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.678+0000 7fc4ed400640 1 --2- 172.21.15.81:0/259454536 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc4cc06eb70 0x7fc4cc071020 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc4d000a900 tx=0x7fc4d0008040 comp rx=0 tx=0).stop 2024-04-23T15:03:06.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.678+0000 7fc4ed400640 1 -- 172.21.15.81:0/259454536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4e8064c90 msgr2=0x7fc4e8115500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:06.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.678+0000 7fc4ed400640 1 --2- 172.21.15.81:0/259454536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4e8064c90 0x7fc4e8115500 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc4d802c1f0 tx=0x7fc4d8004d10 comp rx=0 tx=0).stop 2024-04-23T15:03:06.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.678+0000 7fc4ed400640 1 -- 172.21.15.81:0/259454536 shutdown_connections 2024-04-23T15:03:06.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.678+0000 7fc4ed400640 1 --2- 172.21.15.81:0/259454536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4e8064c90 0x7fc4e8115500 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.678+0000 7fc4ed400640 1 --2- 172.21.15.81:0/259454536 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fc4cc06eb70 0x7fc4cc071020 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.678+0000 7fc4ed400640 1 --2- 172.21.15.81:0/259454536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4e8064380 0x7fc4e8114fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.678+0000 7fc4ed400640 1 -- 172.21.15.81:0/259454536 >> 172.21.15.81:0/259454536 conn(0x7fc4e80711c0 msgr2=0x7fc4e80f9130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:06.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.678+0000 7fc4ed400640 1 -- 172.21.15.81:0/259454536 shutdown_connections 2024-04-23T15:03:06.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.678+0000 7fc4ed400640 1 -- 172.21.15.81:0/259454536 wait complete. 2024-04-23T15:03:06.698 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 29 2024-04-23T15:03:06.698 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 30 2024-04-23T15:03:06.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.880+0000 7efdc4e00640 1 -- 172.21.15.81:0/1228857679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdc0102320 msgr2=0x7efdc01026f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:06.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.880+0000 7efdc4e00640 1 --2- 172.21.15.81:0/1228857679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdc0102320 0x7efdc01026f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7efdb00048d0 tx=0x7efdb0009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.880+0000 7efdc4e00640 1 -- 172.21.15.81:0/1228857679 shutdown_connections 2024-04-23T15:03:06.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.880+0000 7efdc4e00640 1 --2- 172.21.15.81:0/1228857679 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efdc00fa920 0x7efdc00fad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.880+0000 7efdc4e00640 1 --2- 172.21.15.81:0/1228857679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdc0102320 0x7efdc01026f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.880+0000 7efdc4e00640 1 -- 172.21.15.81:0/1228857679 >> 172.21.15.81:0/1228857679 conn(0x7efdc00708f0 msgr2=0x7efdc0070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:06.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.880+0000 7efdc4e00640 1 -- 172.21.15.81:0/1228857679 shutdown_connections 2024-04-23T15:03:06.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.881+0000 7efdc4e00640 1 -- 172.21.15.81:0/1228857679 wait complete. 2024-04-23T15:03:06.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.881+0000 7efdc4e00640 1 Processor -- start 2024-04-23T15:03:06.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.881+0000 7efdc4e00640 1 -- start start 2024-04-23T15:03:06.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.882+0000 7efdc4e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdc00fa920 0x7efdc0115070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:06.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.882+0000 7efdc4e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efdc0102320 0x7efdc01155b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:06.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.882+0000 7efdc4e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc0115bb0 con 0x7efdc00fa920 2024-04-23T15:03:06.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.882+0000 7efdc4e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc010f200 con 0x7efdc0102320 2024-04-23T15:03:06.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.882+0000 7efdbf400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdc00fa920 0x7efdc0115070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:06.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.882+0000 7efdbf400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdc00fa920 0x7efdc0115070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45024/0 (socket says 172.21.15.81:45024) 2024-04-23T15:03:06.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.882+0000 7efdbf400640 1 -- 172.21.15.81:0/4212128280 learned_addr learned my addr 172.21.15.81:0/4212128280 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:03:06.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.882+0000 7efdbf400640 1 -- 172.21.15.81:0/4212128280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efdc0102320 msgr2=0x7efdc01155b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:06.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.882+0000 7efdbf400640 1 --2- 172.21.15.81:0/4212128280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efdc0102320 0x7efdc01155b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:06.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.882+0000 7efdbf400640 1 -- 172.21.15.81:0/4212128280 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb0005040 con 0x7efdc00fa920 2024-04-23T15:03:06.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.882+0000 7efdbf400640 1 --2- 172.21.15.81:0/4212128280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdc00fa920 0x7efdc0115070 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7efdb0031720 tx=0x7efdb0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:06.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.883+0000 7efdb7400640 1 -- 172.21.15.81:0/4212128280 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdb00094c0 con 0x7efdc00fa920 2024-04-23T15:03:06.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.883+0000 7efdb7400640 1 -- 172.21.15.81:0/4212128280 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efdb0032e50 con 0x7efdc00fa920 2024-04-23T15:03:06.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.883+0000 7efdc4e00640 1 -- 172.21.15.81:0/4212128280 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc010f480 con 0x7efdc00fa920 2024-04-23T15:03:06.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.883+0000 7efdb7400640 1 -- 172.21.15.81:0/4212128280 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdb003b640 con 0x7efdc00fa920 2024-04-23T15:03:06.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.883+0000 7efdc4e00640 1 -- 172.21.15.81:0/4212128280 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdc010f9a0 con 0x7efdc00fa920 2024-04-23T15:03:06.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.884+0000 7efdc4e00640 1 -- 172.21.15.81:0/4212128280 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdc0065360 con 0x7efdc00fa920 2024-04-23T15:03:06.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.885+0000 7efdb7400640 1 -- 172.21.15.81:0/4212128280 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7efdb002f070 con 0x7efdc00fa920 2024-04-23T15:03:06.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.886+0000 7efdb7400640 1 --2- 172.21.15.81:0/4212128280 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7efda406eb70 0x7efda4071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:06.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.886+0000 7efdb7400640 1 -- 172.21.15.81:0/4212128280 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7efdb00b0eb0 con 0x7efdc00fa920 2024-04-23T15:03:06.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.886+0000 7efdbea00640 1 --2- 172.21.15.81:0/4212128280 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7efda406eb70 0x7efda4071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:06.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.887+0000 7efdbea00640 1 --2- 172.21.15.81:0/4212128280 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7efda406eb70 0x7efda4071020 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efdc0110930 tx=0x7efda8007cb0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:06.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:06.891+0000 7efdb7400640 1 -- 172.21.15.81:0/4212128280 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7efdb0079b60 con 0x7efdc00fa920 2024-04-23T15:03:07.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.130+0000 7efdc4e00640 1 -- 172.21.15.81:0/4212128280 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7efdc0109500 con 0x7efdc00fa920 2024-04-23T15:03:07.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.132+0000 7efdb7400640 1 -- 172.21.15.81:0/4212128280 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v36) v1 ==== 107+0+4276 (secure 0 0 0) 0x7efdb007d220 con 0x7efdc00fa920 2024-04-23T15:03:07.133 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T15:03:07.133 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34430,"name":"cephfs.smithi081.wydgcg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6827/3200953351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3200953351},{"type":"v1","addr":"172.21.15.81:6827","nonce":3200953351}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":34462,"name":"cephfs.smithi081.vcoywg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6829/2598630159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2598630159},{"type":"v1","addr":"172.21.15.81:6829","nonce":2598630159}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44273,"name":"cephfs.smithi156.rhbtxt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6825/3017230919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3017230919},{"type":"v1","addr":"172.21.15.156:6825","nonce":3017230919}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T14:45:51.264703+0000","modified":"2024-04-23T14:58:57.639818+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-23T15:03:07.133 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 30 2024-04-23T15:03:07.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.135+0000 7efdc4e00640 1 -- 172.21.15.81:0/4212128280 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7efda406eb70 msgr2=0x7efda4071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:07.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.135+0000 7efdc4e00640 1 --2- 172.21.15.81:0/4212128280 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7efda406eb70 0x7efda4071020 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efdc0110930 tx=0x7efda8007cb0 comp rx=0 tx=0).stop 2024-04-23T15:03:07.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.135+0000 7efdc4e00640 1 -- 172.21.15.81:0/4212128280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdc00fa920 msgr2=0x7efdc0115070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:07.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.135+0000 7efdc4e00640 1 --2- 172.21.15.81:0/4212128280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdc00fa920 0x7efdc0115070 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7efdb0031720 tx=0x7efdb0009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:07.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.135+0000 7efdc4e00640 1 -- 172.21.15.81:0/4212128280 shutdown_connections 2024-04-23T15:03:07.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.135+0000 7efdc4e00640 1 --2- 172.21.15.81:0/4212128280 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7efda406eb70 0x7efda4071020 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:07.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.135+0000 7efdc4e00640 1 --2- 172.21.15.81:0/4212128280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efdc0102320 0x7efdc01155b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:07.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.135+0000 7efdc4e00640 1 --2- 172.21.15.81:0/4212128280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdc00fa920 0x7efdc0115070 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:07.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.135+0000 7efdc4e00640 1 -- 172.21.15.81:0/4212128280 >> 172.21.15.81:0/4212128280 conn(0x7efdc00708f0 msgr2=0x7efdc00f9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:07.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.135+0000 7efdc4e00640 1 -- 172.21.15.81:0/4212128280 shutdown_connections 2024-04-23T15:03:07.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.135+0000 7efdc4e00640 1 -- 172.21.15.81:0/4212128280 wait complete. 2024-04-23T15:03:07.153 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 30 2024-04-23T15:03:07.154 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 31 2024-04-23T15:03:07.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.354+0000 7fbc6fe00640 1 -- 172.21.15.81:0/3449643031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc70104bd0 msgr2=0x7fbc700fe260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:07.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.354+0000 7fbc6fe00640 1 --2- 172.21.15.81:0/3449643031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc70104bd0 0x7fbc700fe260 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fbc580048d0 tx=0x7fbc58009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:07.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.354+0000 7fbc6fe00640 1 -- 172.21.15.81:0/3449643031 shutdown_connections 2024-04-23T15:03:07.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.354+0000 7fbc6fe00640 1 --2- 172.21.15.81:0/3449643031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc70104bd0 0x7fbc700fe260 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:07.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.354+0000 7fbc6fe00640 1 --2- 172.21.15.81:0/3449643031 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc70104230 0x7fbc70104600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:07.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.354+0000 7fbc6fe00640 1 -- 172.21.15.81:0/3449643031 >> 172.21.15.81:0/3449643031 conn(0x7fbc700f9fc0 msgr2=0x7fbc700fc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:07.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.354+0000 7fbc6fe00640 1 -- 172.21.15.81:0/3449643031 shutdown_connections 2024-04-23T15:03:07.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.354+0000 7fbc6fe00640 1 -- 172.21.15.81:0/3449643031 wait complete. 2024-04-23T15:03:07.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.355+0000 7fbc6fe00640 1 Processor -- start 2024-04-23T15:03:07.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.355+0000 7fbc6fe00640 1 -- start start 2024-04-23T15:03:07.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.355+0000 7fbc6fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc70104230 0x7fbc70114dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:07.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.355+0000 7fbc6fe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc70104bd0 0x7fbc70115300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:07.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.355+0000 7fbc6fe00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc70115990 con 0x7fbc70104230 2024-04-23T15:03:07.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.355+0000 7fbc6fe00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7010ef50 con 0x7fbc70104bd0 2024-04-23T15:03:07.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.355+0000 7fbc6ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc70104230 0x7fbc70114dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:07.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.355+0000 7fbc6ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc70104230 0x7fbc70114dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45038/0 (socket says 172.21.15.81:45038) 2024-04-23T15:03:07.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.355+0000 7fbc6ea00640 1 -- 172.21.15.81:0/827630224 learned_addr learned my addr 172.21.15.81:0/827630224 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:03:07.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.356+0000 7fbc6ea00640 1 -- 172.21.15.81:0/827630224 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc70104bd0 msgr2=0x7fbc70115300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:07.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.356+0000 7fbc6ea00640 1 --2- 172.21.15.81:0/827630224 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc70104bd0 0x7fbc70115300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:07.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.356+0000 7fbc6ea00640 1 -- 172.21.15.81:0/827630224 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc58005040 con 0x7fbc70104230 2024-04-23T15:03:07.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.356+0000 7fbc6ea00640 1 --2- 172.21.15.81:0/827630224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc70104230 0x7fbc70114dc0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fbc6000bbb0 tx=0x7fbc60009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:07.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.356+0000 7fbc67400640 1 -- 172.21.15.81:0/827630224 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc6000c9c0 con 0x7fbc70104230 2024-04-23T15:03:07.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.356+0000 7fbc67400640 1 -- 172.21.15.81:0/827630224 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbc600092e0 con 0x7fbc70104230 2024-04-23T15:03:07.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.356+0000 7fbc67400640 1 -- 172.21.15.81:0/827630224 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc60007640 con 0x7fbc70104230 2024-04-23T15:03:07.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.356+0000 7fbc6fe00640 1 -- 172.21.15.81:0/827630224 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc7010f230 con 0x7fbc70104230 2024-04-23T15:03:07.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.357+0000 7fbc6fe00640 1 -- 172.21.15.81:0/827630224 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc7010f750 con 0x7fbc70104230 2024-04-23T15:03:07.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.358+0000 7fbc6fe00640 1 -- 172.21.15.81:0/827630224 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc700ff9a0 con 0x7fbc70104230 2024-04-23T15:03:07.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.359+0000 7fbc67400640 1 -- 172.21.15.81:0/827630224 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fbc60012070 con 0x7fbc70104230 2024-04-23T15:03:07.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.360+0000 7fbc67400640 1 --2- 172.21.15.81:0/827630224 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fbc5406eb70 0x7fbc54071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:07.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.360+0000 7fbc67400640 1 -- 172.21.15.81:0/827630224 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fbc6008e8c0 con 0x7fbc70104230 2024-04-23T15:03:07.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.360+0000 7fbc66000640 1 --2- 172.21.15.81:0/827630224 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fbc5406eb70 0x7fbc54071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:07.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.361+0000 7fbc66000640 1 --2- 172.21.15.81:0/827630224 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fbc5406eb70 0x7fbc54071020 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbc5802bda0 tx=0x7fbc58009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:07.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.365+0000 7fbc67400640 1 -- 172.21.15.81:0/827630224 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fbc60057690 con 0x7fbc70104230 2024-04-23T15:03:07.513 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:07 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/1915244935' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-04-23T15:03:07.513 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:07 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/259454536' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-04-23T15:03:07.514 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:07 smithi081 ceph-mon[90469]: pgmap v359: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T15:03:07.514 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:07 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/4212128280' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-04-23T15:03:07.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:07 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/1915244935' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-04-23T15:03:07.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:07 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/259454536' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-04-23T15:03:07.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:07 smithi156 ceph-mon[77738]: pgmap v359: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-23T15:03:07.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:07 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/4212128280' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-04-23T15:03:07.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.609+0000 7fbc6fe00640 1 -- 172.21.15.81:0/827630224 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7fbc7010b480 con 0x7fbc70104230 2024-04-23T15:03:07.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.610+0000 7fbc67400640 1 -- 172.21.15.81:0/827630224 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v36) v1 ==== 107+0+4355 (secure 0 0 0) 0x7fbc6005ad50 con 0x7fbc70104230 2024-04-23T15:03:07.611 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T15:03:07.611 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34462,"name":"cephfs.smithi081.vcoywg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6829/2598630159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2598630159},{"type":"v1","addr":"172.21.15.81:6829","nonce":2598630159}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44273,"name":"cephfs.smithi156.rhbtxt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6825/3017230919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3017230919},{"type":"v1","addr":"172.21.15.156:6825","nonce":3017230919}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T14:45:51.264703+0000","modified":"2024-04-23T14:58:57.651339+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34430":{"gid":34430,"name":"cephfs.smithi081.wydgcg","rank":0,"incarnation":31,"state":"up:replay","state_seq":1,"addr":"172.21.15.81:6827/3200953351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3200953351},{"type":"v1","addr":"172.21.15.81:6827","nonce":3200953351}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-23T15:03:07.611 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 31 2024-04-23T15:03:07.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.612+0000 7fbc6fe00640 1 -- 172.21.15.81:0/827630224 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fbc5406eb70 msgr2=0x7fbc54071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:07.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.612+0000 7fbc6fe00640 1 --2- 172.21.15.81:0/827630224 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fbc5406eb70 0x7fbc54071020 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbc5802bda0 tx=0x7fbc58009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:07.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.612+0000 7fbc6fe00640 1 -- 172.21.15.81:0/827630224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc70104230 msgr2=0x7fbc70114dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:07.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.612+0000 7fbc6fe00640 1 --2- 172.21.15.81:0/827630224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc70104230 0x7fbc70114dc0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fbc6000bbb0 tx=0x7fbc60009840 comp rx=0 tx=0).stop 2024-04-23T15:03:07.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.612+0000 7fbc6fe00640 1 -- 172.21.15.81:0/827630224 shutdown_connections 2024-04-23T15:03:07.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.612+0000 7fbc6fe00640 1 --2- 172.21.15.81:0/827630224 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fbc5406eb70 0x7fbc54071020 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:07.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.612+0000 7fbc6fe00640 1 --2- 172.21.15.81:0/827630224 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc70104bd0 0x7fbc70115300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:07.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.612+0000 7fbc6fe00640 1 --2- 172.21.15.81:0/827630224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc70104230 0x7fbc70114dc0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:07.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.612+0000 7fbc6fe00640 1 -- 172.21.15.81:0/827630224 >> 172.21.15.81:0/827630224 conn(0x7fbc700f9fc0 msgr2=0x7fbc700fbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:07.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.613+0000 7fbc6fe00640 1 -- 172.21.15.81:0/827630224 shutdown_connections 2024-04-23T15:03:07.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.613+0000 7fbc6fe00640 1 -- 172.21.15.81:0/827630224 wait complete. 2024-04-23T15:03:07.632 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 31 2024-04-23T15:03:07.632 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 32 2024-04-23T15:03:07.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.837+0000 7fca52400640 1 -- 172.21.15.81:0/3465507012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca4c0fb8e0 msgr2=0x7fca4c108640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:07.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.837+0000 7fca52400640 1 --2- 172.21.15.81:0/3465507012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca4c0fb8e0 0x7fca4c108640 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fca380048d0 tx=0x7fca38009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:07.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.837+0000 7fca52400640 1 -- 172.21.15.81:0/3465507012 shutdown_connections 2024-04-23T15:03:07.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.837+0000 7fca52400640 1 --2- 172.21.15.81:0/3465507012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca4c0fb8e0 0x7fca4c108640 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:07.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.837+0000 7fca52400640 1 --2- 172.21.15.81:0/3465507012 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca4c0fafd0 0x7fca4c0fb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:07.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.837+0000 7fca52400640 1 -- 172.21.15.81:0/3465507012 >> 172.21.15.81:0/3465507012 conn(0x7fca4c0f6ce0 msgr2=0x7fca4c0f90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:07.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.837+0000 7fca52400640 1 -- 172.21.15.81:0/3465507012 shutdown_connections 2024-04-23T15:03:07.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.837+0000 7fca52400640 1 -- 172.21.15.81:0/3465507012 wait complete. 2024-04-23T15:03:07.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.838+0000 7fca52400640 1 Processor -- start 2024-04-23T15:03:07.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.838+0000 7fca52400640 1 -- start start 2024-04-23T15:03:07.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.838+0000 7fca52400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca4c0fafd0 0x7fca4c114e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:07.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.838+0000 7fca52400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca4c0fb8e0 0x7fca4c1153a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:07.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.838+0000 7fca52400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4c115a30 con 0x7fca4c0fb8e0 2024-04-23T15:03:07.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.838+0000 7fca52400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4c10eff0 con 0x7fca4c0fafd0 2024-04-23T15:03:07.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.838+0000 7fca4aa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca4c0fb8e0 0x7fca4c1153a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:07.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.838+0000 7fca4aa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca4c0fb8e0 0x7fca4c1153a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45062/0 (socket says 172.21.15.81:45062) 2024-04-23T15:03:07.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.838+0000 7fca4aa00640 1 -- 172.21.15.81:0/2848775149 learned_addr learned my addr 172.21.15.81:0/2848775149 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:03:07.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.839+0000 7fca4aa00640 1 -- 172.21.15.81:0/2848775149 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca4c0fafd0 msgr2=0x7fca4c114e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:07.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.839+0000 7fca4aa00640 1 --2- 172.21.15.81:0/2848775149 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca4c0fafd0 0x7fca4c114e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:07.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.839+0000 7fca4aa00640 1 -- 172.21.15.81:0/2848775149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca38005040 con 0x7fca4c0fb8e0 2024-04-23T15:03:07.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.839+0000 7fca4aa00640 1 --2- 172.21.15.81:0/2848775149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca4c0fb8e0 0x7fca4c1153a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fca380048a0 tx=0x7fca38009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:07.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.839+0000 7fca43400640 1 -- 172.21.15.81:0/2848775149 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca380094c0 con 0x7fca4c0fb8e0 2024-04-23T15:03:07.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.839+0000 7fca43400640 1 -- 172.21.15.81:0/2848775149 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fca3803d920 con 0x7fca4c0fb8e0 2024-04-23T15:03:07.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.839+0000 7fca43400640 1 -- 172.21.15.81:0/2848775149 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca3803b8e0 con 0x7fca4c0fb8e0 2024-04-23T15:03:07.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.839+0000 7fca52400640 1 -- 172.21.15.81:0/2848775149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca4c10f2d0 con 0x7fca4c0fb8e0 2024-04-23T15:03:07.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.840+0000 7fca52400640 1 -- 172.21.15.81:0/2848775149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca4c10f7f0 con 0x7fca4c0fb8e0 2024-04-23T15:03:07.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.841+0000 7fca52400640 1 -- 172.21.15.81:0/2848775149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca4c065ff0 con 0x7fca4c0fb8e0 2024-04-23T15:03:07.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.842+0000 7fca43400640 1 -- 172.21.15.81:0/2848775149 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fca3803d450 con 0x7fca4c0fb8e0 2024-04-23T15:03:07.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.844+0000 7fca43400640 1 --2- 172.21.15.81:0/2848775149 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fca3006eb70 0x7fca30071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:07.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.844+0000 7fca43400640 1 -- 172.21.15.81:0/2848775149 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fca380b16b0 con 0x7fca4c0fb8e0 2024-04-23T15:03:07.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.844+0000 7fca4b400640 1 --2- 172.21.15.81:0/2848775149 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fca3006eb70 0x7fca30071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:07.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.845+0000 7fca4b400640 1 --2- 172.21.15.81:0/2848775149 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fca3006eb70 0x7fca30071020 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fca3c0097e0 tx=0x7fca3c006d10 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:07.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:07.848+0000 7fca43400640 1 -- 172.21.15.81:0/2848775149 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fca3807a360 con 0x7fca4c0fb8e0 2024-04-23T15:03:08.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.087+0000 7fca52400640 1 -- 172.21.15.81:0/2848775149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7fca4c064380 con 0x7fca4c0fb8e0 2024-04-23T15:03:08.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.089+0000 7fca43400640 1 -- 172.21.15.81:0/2848775149 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v36) v1 ==== 107+0+5205 (secure 0 0 0) 0x7fca3807da20 con 0x7fca4c0fb8e0 2024-04-23T15:03:08.090 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T15:03:08.090 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34462,"name":"cephfs.smithi081.vcoywg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6829/2598630159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2598630159},{"type":"v1","addr":"172.21.15.81:6829","nonce":2598630159}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44273,"name":"cephfs.smithi156.rhbtxt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6825/3017230919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3017230919},{"type":"v1","addr":"172.21.15.156:6825","nonce":3017230919}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44277,"name":"cephfs.smithi156.vynkxn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6827/4079938688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":4079938688},{"type":"v1","addr":"172.21.15.156:6827","nonce":4079938688}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T14:45:51.264703+0000","modified":"2024-04-23T14:58:57.651339+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34430":{"gid":34430,"name":"cephfs.smithi081.wydgcg","rank":0,"incarnation":31,"state":"up:replay","state_seq":1,"addr":"172.21.15.81:6827/3200953351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3200953351},{"type":"v1","addr":"172.21.15.81:6827","nonce":3200953351}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-23T15:03:08.090 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 32 2024-04-23T15:03:08.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.091+0000 7fca52400640 1 -- 172.21.15.81:0/2848775149 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fca3006eb70 msgr2=0x7fca30071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:08.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.091+0000 7fca52400640 1 --2- 172.21.15.81:0/2848775149 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fca3006eb70 0x7fca30071020 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fca3c0097e0 tx=0x7fca3c006d10 comp rx=0 tx=0).stop 2024-04-23T15:03:08.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.092+0000 7fca52400640 1 -- 172.21.15.81:0/2848775149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca4c0fb8e0 msgr2=0x7fca4c1153a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:08.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.092+0000 7fca52400640 1 --2- 172.21.15.81:0/2848775149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca4c0fb8e0 0x7fca4c1153a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fca380048a0 tx=0x7fca38009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:08.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.092+0000 7fca52400640 1 -- 172.21.15.81:0/2848775149 shutdown_connections 2024-04-23T15:03:08.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.092+0000 7fca52400640 1 --2- 172.21.15.81:0/2848775149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca4c0fb8e0 0x7fca4c1153a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:08.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.092+0000 7fca52400640 1 --2- 172.21.15.81:0/2848775149 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fca3006eb70 0x7fca30071020 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:08.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.092+0000 7fca52400640 1 --2- 172.21.15.81:0/2848775149 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca4c0fafd0 0x7fca4c114e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:08.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.092+0000 7fca52400640 1 -- 172.21.15.81:0/2848775149 >> 172.21.15.81:0/2848775149 conn(0x7fca4c0f6ce0 msgr2=0x7fca4c0f70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:08.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.092+0000 7fca52400640 1 -- 172.21.15.81:0/2848775149 shutdown_connections 2024-04-23T15:03:08.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.092+0000 7fca52400640 1 -- 172.21.15.81:0/2848775149 wait complete. 2024-04-23T15:03:08.110 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 32 2024-04-23T15:03:08.110 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 33 2024-04-23T15:03:08.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.308+0000 7f1d8e000640 1 -- 172.21.15.81:0/1270797419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d88104400 msgr2=0x7f1d881047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:08.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.308+0000 7f1d8e000640 1 --2- 172.21.15.81:0/1270797419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d88104400 0x7f1d881047d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1d780048d0 tx=0x7f1d78009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:08.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.309+0000 7f1d8e000640 1 -- 172.21.15.81:0/1270797419 shutdown_connections 2024-04-23T15:03:08.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.309+0000 7f1d8e000640 1 --2- 172.21.15.81:0/1270797419 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d88104da0 0x7f1d880fe430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:08.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.309+0000 7f1d8e000640 1 --2- 172.21.15.81:0/1270797419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d88104400 0x7f1d881047d0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:08.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.309+0000 7f1d8e000640 1 -- 172.21.15.81:0/1270797419 >> 172.21.15.81:0/1270797419 conn(0x7f1d880f9ff0 msgr2=0x7f1d880fc400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:08.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.309+0000 7f1d8e000640 1 -- 172.21.15.81:0/1270797419 shutdown_connections 2024-04-23T15:03:08.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.309+0000 7f1d8e000640 1 -- 172.21.15.81:0/1270797419 wait complete. 2024-04-23T15:03:08.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.310+0000 7f1d8e000640 1 Processor -- start 2024-04-23T15:03:08.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.310+0000 7f1d8e000640 1 -- start start 2024-04-23T15:03:08.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.310+0000 7f1d8e000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d88104400 0x7f1d88114f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:08.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.310+0000 7f1d8e000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d88104da0 0x7f1d88115490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:08.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.310+0000 7f1d8e000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d88115b20 con 0x7f1d88104400 2024-04-23T15:03:08.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.310+0000 7f1d8e000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8810f0e0 con 0x7f1d88104da0 2024-04-23T15:03:08.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.311+0000 7f1d87400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d88104400 0x7f1d88114f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:08.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.311+0000 7f1d87400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d88104400 0x7f1d88114f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45068/0 (socket says 172.21.15.81:45068) 2024-04-23T15:03:08.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.311+0000 7f1d87400640 1 -- 172.21.15.81:0/74177235 learned_addr learned my addr 172.21.15.81:0/74177235 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:03:08.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.311+0000 7f1d87400640 1 -- 172.21.15.81:0/74177235 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d88104da0 msgr2=0x7f1d88115490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:08.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.311+0000 7f1d87400640 1 --2- 172.21.15.81:0/74177235 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d88104da0 0x7f1d88115490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:08.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.311+0000 7f1d87400640 1 -- 172.21.15.81:0/74177235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d78005040 con 0x7f1d88104400 2024-04-23T15:03:08.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.311+0000 7f1d87400640 1 --2- 172.21.15.81:0/74177235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d88104400 0x7f1d88114f50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1d78004930 tx=0x7f1d78009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:08.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.312+0000 7f1d7f400640 1 -- 172.21.15.81:0/74177235 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d780094c0 con 0x7f1d88104400 2024-04-23T15:03:08.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.312+0000 7f1d7f400640 1 -- 172.21.15.81:0/74177235 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1d78032e50 con 0x7f1d88104400 2024-04-23T15:03:08.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.312+0000 7f1d8e000640 1 -- 172.21.15.81:0/74177235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d8810f360 con 0x7f1d88104400 2024-04-23T15:03:08.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.312+0000 7f1d7f400640 1 -- 172.21.15.81:0/74177235 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d780433b0 con 0x7f1d88104400 2024-04-23T15:03:08.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.312+0000 7f1d8e000640 1 -- 172.21.15.81:0/74177235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d8810f820 con 0x7f1d88104400 2024-04-23T15:03:08.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.313+0000 7f1d8e000640 1 -- 172.21.15.81:0/74177235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d880ffb70 con 0x7f1d88104400 2024-04-23T15:03:08.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.314+0000 7f1d7f400640 1 -- 172.21.15.81:0/74177235 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f1d7802f070 con 0x7f1d88104400 2024-04-23T15:03:08.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.315+0000 7f1d7f400640 1 --2- 172.21.15.81:0/74177235 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f1d6c06eb70 0x7f1d6c071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:08.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.315+0000 7f1d7f400640 1 -- 172.21.15.81:0/74177235 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f1d780b0950 con 0x7f1d88104400 2024-04-23T15:03:08.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.315+0000 7f1d86a00640 1 --2- 172.21.15.81:0/74177235 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f1d6c06eb70 0x7f1d6c071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:08.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.316+0000 7f1d86a00640 1 --2- 172.21.15.81:0/74177235 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f1d6c06eb70 0x7f1d6c071020 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1d88110810 tx=0x7f1d74006d20 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:08.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.319+0000 7f1d7f400640 1 -- 172.21.15.81:0/74177235 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f1d78079600 con 0x7f1d88104400 2024-04-23T15:03:08.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:08 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/827630224' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-04-23T15:03:08.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:08 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/2848775149' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-04-23T15:03:08.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.559+0000 7f1d8e000640 1 -- 172.21.15.81:0/74177235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7f1d88063f30 con 0x7f1d88104400 2024-04-23T15:03:08.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.561+0000 7f1d7f400640 1 -- 172.21.15.81:0/74177235 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v36) v1 ==== 107+0+5209 (secure 0 0 0) 0x7f1d7807ccc0 con 0x7f1d88104400 2024-04-23T15:03:08.562 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T15:03:08.562 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34462,"name":"cephfs.smithi081.vcoywg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6829/2598630159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2598630159},{"type":"v1","addr":"172.21.15.81:6829","nonce":2598630159}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44273,"name":"cephfs.smithi156.rhbtxt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6825/3017230919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3017230919},{"type":"v1","addr":"172.21.15.156:6825","nonce":3017230919}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44277,"name":"cephfs.smithi156.vynkxn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6827/4079938688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":4079938688},{"type":"v1","addr":"172.21.15.156:6827","nonce":4079938688}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T14:45:51.264703+0000","modified":"2024-04-23T14:59:05.738007+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34430":{"gid":34430,"name":"cephfs.smithi081.wydgcg","rank":0,"incarnation":31,"state":"up:reconnect","state_seq":22,"addr":"172.21.15.81:6827/3200953351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3200953351},{"type":"v1","addr":"172.21.15.81:6827","nonce":3200953351}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-23T15:03:08.562 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 33 2024-04-23T15:03:08.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.563+0000 7f1d8e000640 1 -- 172.21.15.81:0/74177235 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f1d6c06eb70 msgr2=0x7f1d6c071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:08.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.563+0000 7f1d8e000640 1 --2- 172.21.15.81:0/74177235 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f1d6c06eb70 0x7f1d6c071020 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1d88110810 tx=0x7f1d74006d20 comp rx=0 tx=0).stop 2024-04-23T15:03:08.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.563+0000 7f1d8e000640 1 -- 172.21.15.81:0/74177235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d88104400 msgr2=0x7f1d88114f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:08.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.563+0000 7f1d8e000640 1 --2- 172.21.15.81:0/74177235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d88104400 0x7f1d88114f50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1d78004930 tx=0x7f1d78009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:08.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.564+0000 7f1d8e000640 1 -- 172.21.15.81:0/74177235 shutdown_connections 2024-04-23T15:03:08.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.564+0000 7f1d8e000640 1 --2- 172.21.15.81:0/74177235 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f1d6c06eb70 0x7f1d6c071020 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:08.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.564+0000 7f1d8e000640 1 --2- 172.21.15.81:0/74177235 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d88104da0 0x7f1d88115490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:08.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.564+0000 7f1d8e000640 1 --2- 172.21.15.81:0/74177235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d88104400 0x7f1d88114f50 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:08.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.564+0000 7f1d8e000640 1 -- 172.21.15.81:0/74177235 >> 172.21.15.81:0/74177235 conn(0x7f1d880f9ff0 msgr2=0x7f1d880faf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:08.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.564+0000 7f1d8e000640 1 -- 172.21.15.81:0/74177235 shutdown_connections 2024-04-23T15:03:08.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.564+0000 7f1d8e000640 1 -- 172.21.15.81:0/74177235 wait complete. 2024-04-23T15:03:08.575 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:08 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/827630224' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-04-23T15:03:08.575 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:08 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/2848775149' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-04-23T15:03:08.581 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 33 2024-04-23T15:03:08.582 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 34 2024-04-23T15:03:08.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.774+0000 7f4e94e00640 1 -- 172.21.15.81:0/401403285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e90102990 msgr2=0x7f4e900fc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:08.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.774+0000 7f4e94e00640 1 --2- 172.21.15.81:0/401403285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e90102990 0x7f4e900fc020 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c0048d0 tx=0x7f4e7c009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:08.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.774+0000 7f4e94e00640 1 -- 172.21.15.81:0/401403285 shutdown_connections 2024-04-23T15:03:08.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.774+0000 7f4e94e00640 1 --2- 172.21.15.81:0/401403285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e90102990 0x7f4e900fc020 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:08.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.774+0000 7f4e94e00640 1 --2- 172.21.15.81:0/401403285 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e90101ff0 0x7f4e901023c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:08.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.774+0000 7f4e94e00640 1 -- 172.21.15.81:0/401403285 >> 172.21.15.81:0/401403285 conn(0x7f4e900f7ba0 msgr2=0x7f4e900f9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:08.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.775+0000 7f4e94e00640 1 -- 172.21.15.81:0/401403285 shutdown_connections 2024-04-23T15:03:08.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.775+0000 7f4e94e00640 1 -- 172.21.15.81:0/401403285 wait complete. 2024-04-23T15:03:08.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.775+0000 7f4e94e00640 1 Processor -- start 2024-04-23T15:03:08.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.775+0000 7f4e94e00640 1 -- start start 2024-04-23T15:03:08.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.776+0000 7f4e94e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e90101ff0 0x7f4e90114da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:08.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.776+0000 7f4e94e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e90102990 0x7f4e901152e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:08.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.776+0000 7f4e94e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e901158e0 con 0x7f4e90101ff0 2024-04-23T15:03:08.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.776+0000 7f4e94e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9010ef30 con 0x7f4e90102990 2024-04-23T15:03:08.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.776+0000 7f4e8f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e90101ff0 0x7f4e90114da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:08.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.776+0000 7f4e8f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e90101ff0 0x7f4e90114da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45098/0 (socket says 172.21.15.81:45098) 2024-04-23T15:03:08.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.776+0000 7f4e8f400640 1 -- 172.21.15.81:0/1582619059 learned_addr learned my addr 172.21.15.81:0/1582619059 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:03:08.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.776+0000 7f4e8f400640 1 -- 172.21.15.81:0/1582619059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e90102990 msgr2=0x7f4e901152e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:08.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.776+0000 7f4e8f400640 1 --2- 172.21.15.81:0/1582619059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e90102990 0x7f4e901152e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:08.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.776+0000 7f4e8f400640 1 -- 172.21.15.81:0/1582619059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e7c005040 con 0x7f4e90101ff0 2024-04-23T15:03:08.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.777+0000 7f4e8f400640 1 --2- 172.21.15.81:0/1582619059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e90101ff0 0x7f4e90114da0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4e80002a50 tx=0x7f4e80004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:08.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.777+0000 7f4e87400640 1 -- 172.21.15.81:0/1582619059 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e80007c30 con 0x7f4e90101ff0 2024-04-23T15:03:08.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.777+0000 7f4e87400640 1 -- 172.21.15.81:0/1582619059 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4e8000f040 con 0x7f4e90101ff0 2024-04-23T15:03:08.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.777+0000 7f4e94e00640 1 -- 172.21.15.81:0/1582619059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e9010f210 con 0x7f4e90101ff0 2024-04-23T15:03:08.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.777+0000 7f4e87400640 1 -- 172.21.15.81:0/1582619059 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e8000db50 con 0x7f4e90101ff0 2024-04-23T15:03:08.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.777+0000 7f4e94e00640 1 -- 172.21.15.81:0/1582619059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e9010f730 con 0x7f4e90101ff0 2024-04-23T15:03:08.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.778+0000 7f4e94e00640 1 -- 172.21.15.81:0/1582619059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e900fd760 con 0x7f4e90101ff0 2024-04-23T15:03:08.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.779+0000 7f4e87400640 1 -- 172.21.15.81:0/1582619059 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f4e8000dcf0 con 0x7f4e90101ff0 2024-04-23T15:03:08.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.780+0000 7f4e87400640 1 --2- 172.21.15.81:0/1582619059 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f4e7406eb70 0x7f4e74071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:08.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.780+0000 7f4e87400640 1 -- 172.21.15.81:0/1582619059 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f4e8008e1e0 con 0x7f4e90101ff0 2024-04-23T15:03:08.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.781+0000 7f4e8ea00640 1 --2- 172.21.15.81:0/1582619059 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f4e7406eb70 0x7f4e74071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:08.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.781+0000 7f4e8ea00640 1 --2- 172.21.15.81:0/1582619059 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f4e7406eb70 0x7f4e74071020 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c02bda0 tx=0x7f4e7c009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:08.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:08.785+0000 7f4e87400640 1 -- 172.21.15.81:0/1582619059 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f4e80056f10 con 0x7f4e90101ff0 2024-04-23T15:03:09.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.017+0000 7f4e94e00640 1 -- 172.21.15.81:0/1582619059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7f4e9010f9a0 con 0x7f4e90101ff0 2024-04-23T15:03:09.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.018+0000 7f4e87400640 1 -- 172.21.15.81:0/1582619059 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v36) v1 ==== 107+0+5206 (secure 0 0 0) 0x7f4e8005a5d0 con 0x7f4e90101ff0 2024-04-23T15:03:09.019 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T15:03:09.019 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34462,"name":"cephfs.smithi081.vcoywg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6829/2598630159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2598630159},{"type":"v1","addr":"172.21.15.81:6829","nonce":2598630159}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44273,"name":"cephfs.smithi156.rhbtxt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6825/3017230919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3017230919},{"type":"v1","addr":"172.21.15.156:6825","nonce":3017230919}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44277,"name":"cephfs.smithi156.vynkxn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6827/4079938688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":4079938688},{"type":"v1","addr":"172.21.15.156:6827","nonce":4079938688}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T14:45:51.264703+0000","modified":"2024-04-23T14:59:06.191870+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34430":{"gid":34430,"name":"cephfs.smithi081.wydgcg","rank":0,"incarnation":31,"state":"up:rejoin","state_seq":23,"addr":"172.21.15.81:6827/3200953351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3200953351},{"type":"v1","addr":"172.21.15.81:6827","nonce":3200953351}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-23T15:03:09.019 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 34 2024-04-23T15:03:09.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.020+0000 7f4e94e00640 1 -- 172.21.15.81:0/1582619059 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f4e7406eb70 msgr2=0x7f4e74071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:09.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.020+0000 7f4e94e00640 1 --2- 172.21.15.81:0/1582619059 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f4e7406eb70 0x7f4e74071020 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c02bda0 tx=0x7f4e7c009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:09.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.020+0000 7f4e94e00640 1 -- 172.21.15.81:0/1582619059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e90101ff0 msgr2=0x7f4e90114da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:09.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.020+0000 7f4e94e00640 1 --2- 172.21.15.81:0/1582619059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e90101ff0 0x7f4e90114da0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4e80002a50 tx=0x7f4e80004600 comp rx=0 tx=0).stop 2024-04-23T15:03:09.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.020+0000 7f4e94e00640 1 -- 172.21.15.81:0/1582619059 shutdown_connections 2024-04-23T15:03:09.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.020+0000 7f4e94e00640 1 --2- 172.21.15.81:0/1582619059 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f4e7406eb70 0x7f4e74071020 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:09.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.020+0000 7f4e94e00640 1 --2- 172.21.15.81:0/1582619059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e90102990 0x7f4e901152e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:09.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.020+0000 7f4e94e00640 1 --2- 172.21.15.81:0/1582619059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e90101ff0 0x7f4e90114da0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:09.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.020+0000 7f4e94e00640 1 -- 172.21.15.81:0/1582619059 >> 172.21.15.81:0/1582619059 conn(0x7f4e900f7ba0 msgr2=0x7f4e900711e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:09.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.021+0000 7f4e94e00640 1 -- 172.21.15.81:0/1582619059 shutdown_connections 2024-04-23T15:03:09.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.021+0000 7f4e94e00640 1 -- 172.21.15.81:0/1582619059 wait complete. 2024-04-23T15:03:09.039 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 34 2024-04-23T15:03:09.039 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 35 2024-04-23T15:03:09.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.225+0000 7fb422200640 1 -- 172.21.15.81:0/177596513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb41c102bc0 msgr2=0x7fb41c0fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:09.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.225+0000 7fb422200640 1 --2- 172.21.15.81:0/177596513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb41c102bc0 0x7fb41c0fc250 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb4080048d0 tx=0x7fb408009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:09.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.225+0000 7fb422200640 1 -- 172.21.15.81:0/177596513 shutdown_connections 2024-04-23T15:03:09.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.225+0000 7fb422200640 1 --2- 172.21.15.81:0/177596513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb41c102bc0 0x7fb41c0fc250 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:09.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.225+0000 7fb422200640 1 --2- 172.21.15.81:0/177596513 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb41c102220 0x7fb41c1025f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:09.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.225+0000 7fb422200640 1 -- 172.21.15.81:0/177596513 >> 172.21.15.81:0/177596513 conn(0x7fb41c0f7e10 msgr2=0x7fb41c0fa220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:09.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.225+0000 7fb422200640 1 -- 172.21.15.81:0/177596513 shutdown_connections 2024-04-23T15:03:09.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.226+0000 7fb422200640 1 -- 172.21.15.81:0/177596513 wait complete. 2024-04-23T15:03:09.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.226+0000 7fb422200640 1 Processor -- start 2024-04-23T15:03:09.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.226+0000 7fb422200640 1 -- start start 2024-04-23T15:03:09.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.227+0000 7fb422200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb41c102220 0x7fb41c114e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:09.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.227+0000 7fb422200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb41c102bc0 0x7fb41c115390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:09.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.227+0000 7fb422200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41c115990 con 0x7fb41c102bc0 2024-04-23T15:03:09.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.227+0000 7fb422200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41c10efe0 con 0x7fb41c102220 2024-04-23T15:03:09.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.227+0000 7fb41aa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb41c102bc0 0x7fb41c115390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:09.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.227+0000 7fb41aa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb41c102bc0 0x7fb41c115390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45126/0 (socket says 172.21.15.81:45126) 2024-04-23T15:03:09.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.227+0000 7fb41aa00640 1 -- 172.21.15.81:0/1343533438 learned_addr learned my addr 172.21.15.81:0/1343533438 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:03:09.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.227+0000 7fb41aa00640 1 -- 172.21.15.81:0/1343533438 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb41c102220 msgr2=0x7fb41c114e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:09.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.227+0000 7fb41b400640 1 --2- 172.21.15.81:0/1343533438 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb41c102220 0x7fb41c114e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:09.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.227+0000 7fb41aa00640 1 --2- 172.21.15.81:0/1343533438 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb41c102220 0x7fb41c114e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:09.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.227+0000 7fb41aa00640 1 -- 172.21.15.81:0/1343533438 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb408005040 con 0x7fb41c102bc0 2024-04-23T15:03:09.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.228+0000 7fb41aa00640 1 --2- 172.21.15.81:0/1343533438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb41c102bc0 0x7fb41c115390 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb4080047f0 tx=0x7fb408009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:09.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.228+0000 7fb413400640 1 -- 172.21.15.81:0/1343533438 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4080094c0 con 0x7fb41c102bc0 2024-04-23T15:03:09.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.228+0000 7fb413400640 1 -- 172.21.15.81:0/1343533438 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb408032e50 con 0x7fb41c102bc0 2024-04-23T15:03:09.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.228+0000 7fb413400640 1 -- 172.21.15.81:0/1343533438 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4080433b0 con 0x7fb41c102bc0 2024-04-23T15:03:09.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.228+0000 7fb422200640 1 -- 172.21.15.81:0/1343533438 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb41c10f260 con 0x7fb41c102bc0 2024-04-23T15:03:09.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.228+0000 7fb422200640 1 -- 172.21.15.81:0/1343533438 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb41c10f720 con 0x7fb41c102bc0 2024-04-23T15:03:09.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.230+0000 7fb422200640 1 -- 172.21.15.81:0/1343533438 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb41c0fd990 con 0x7fb41c102bc0 2024-04-23T15:03:09.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.230+0000 7fb413400640 1 -- 172.21.15.81:0/1343533438 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fb40802f070 con 0x7fb41c102bc0 2024-04-23T15:03:09.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.231+0000 7fb413400640 1 --2- 172.21.15.81:0/1343533438 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fb40006eb70 0x7fb400071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:09.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.232+0000 7fb413400640 1 -- 172.21.15.81:0/1343533438 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fb4080b0810 con 0x7fb41c102bc0 2024-04-23T15:03:09.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.232+0000 7fb41b400640 1 --2- 172.21.15.81:0/1343533438 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fb40006eb70 0x7fb400071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:09.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.232+0000 7fb41b400640 1 --2- 172.21.15.81:0/1343533438 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fb40006eb70 0x7fb400071020 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb40c004ce0 tx=0x7fb40c00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:09.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.236+0000 7fb413400640 1 -- 172.21.15.81:0/1343533438 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fb4080794c0 con 0x7fb41c102bc0 2024-04-23T15:03:09.325 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:09 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/74177235' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-04-23T15:03:09.325 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:09 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:03:09.325 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:09 smithi081 ceph-mon[90469]: pgmap v360: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:03:09.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:09 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/1582619059' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-04-23T15:03:09.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.492+0000 7fb422200640 1 -- 172.21.15.81:0/1343533438 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7fb41c109380 con 0x7fb41c102bc0 2024-04-23T15:03:09.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.493+0000 7fb413400640 1 -- 172.21.15.81:0/1343533438 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v36) v1 ==== 107+0+5215 (secure 0 0 0) 0x7fb40807cb80 con 0x7fb41c102bc0 2024-04-23T15:03:09.495 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T15:03:09.495 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34462,"name":"cephfs.smithi081.vcoywg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6829/2598630159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2598630159},{"type":"v1","addr":"172.21.15.81:6829","nonce":2598630159}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44273,"name":"cephfs.smithi156.rhbtxt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6825/3017230919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3017230919},{"type":"v1","addr":"172.21.15.156:6825","nonce":3017230919}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44277,"name":"cephfs.smithi156.vynkxn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6827/4079938688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":4079938688},{"type":"v1","addr":"172.21.15.156:6827","nonce":4079938688}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T14:45:51.264703+0000","modified":"2024-04-23T14:59:08.193706+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34430":{"gid":34430,"name":"cephfs.smithi081.wydgcg","rank":0,"incarnation":31,"state":"up:active","state_seq":24,"addr":"172.21.15.81:6827/3200953351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3200953351},{"type":"v1","addr":"172.21.15.81:6827","nonce":3200953351}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34430,"qdb_cluster":[34430]},"id":1}]} 2024-04-23T15:03:09.495 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 35 2024-04-23T15:03:09.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.496+0000 7fb422200640 1 -- 172.21.15.81:0/1343533438 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fb40006eb70 msgr2=0x7fb400071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:09.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.496+0000 7fb422200640 1 --2- 172.21.15.81:0/1343533438 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fb40006eb70 0x7fb400071020 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb40c004ce0 tx=0x7fb40c00b040 comp rx=0 tx=0).stop 2024-04-23T15:03:09.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.496+0000 7fb422200640 1 -- 172.21.15.81:0/1343533438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb41c102bc0 msgr2=0x7fb41c115390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:09.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.496+0000 7fb422200640 1 --2- 172.21.15.81:0/1343533438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb41c102bc0 0x7fb41c115390 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb4080047f0 tx=0x7fb408009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:09.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.496+0000 7fb422200640 1 -- 172.21.15.81:0/1343533438 shutdown_connections 2024-04-23T15:03:09.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.496+0000 7fb422200640 1 --2- 172.21.15.81:0/1343533438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb41c102bc0 0x7fb41c115390 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:09.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.496+0000 7fb422200640 1 --2- 172.21.15.81:0/1343533438 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fb40006eb70 0x7fb400071020 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:09.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.496+0000 7fb422200640 1 --2- 172.21.15.81:0/1343533438 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb41c102220 0x7fb41c114e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:09.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.496+0000 7fb422200640 1 -- 172.21.15.81:0/1343533438 >> 172.21.15.81:0/1343533438 conn(0x7fb41c0f7e10 msgr2=0x7fb41c06ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:09.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.496+0000 7fb422200640 1 -- 172.21.15.81:0/1343533438 shutdown_connections 2024-04-23T15:03:09.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.496+0000 7fb422200640 1 -- 172.21.15.81:0/1343533438 wait complete. 2024-04-23T15:03:09.513 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 35 2024-04-23T15:03:09.514 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-23T15:03:09.524 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-23T15:03:09.524 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-23T15:03:09.524 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-23T15:03:09.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:09 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/74177235' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-04-23T15:03:09.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:09 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T15:03:09.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:09 smithi156 ceph-mon[77738]: pgmap v360: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-23T15:03:09.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:09 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/1582619059' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-04-23T15:03:09.576 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-23T15:03:09.576 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-23T15:03:09.661 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T15:03:09.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.893+0000 7f5f1f200640 1 -- 172.21.15.81:0/2706638431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f200643b0 msgr2=0x7f5f20064800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:09.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.893+0000 7f5f1f200640 1 --2- 172.21.15.81:0/2706638431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f200643b0 0x7f5f20064800 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c0048d0 tx=0x7f5f0c009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:09.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.894+0000 7f5f1f200640 1 -- 172.21.15.81:0/2706638431 shutdown_connections 2024-04-23T15:03:09.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.894+0000 7f5f1f200640 1 --2- 172.21.15.81:0/2706638431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f200643b0 0x7f5f20064800 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:09.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.894+0000 7f5f1f200640 1 --2- 172.21.15.81:0/2706638431 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f20102020 0x7f5f201023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:09.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.894+0000 7f5f1f200640 1 -- 172.21.15.81:0/2706638431 >> 172.21.15.81:0/2706638431 conn(0x7f5f20070f20 msgr2=0x7f5f20071320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:09.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.894+0000 7f5f1f200640 1 -- 172.21.15.81:0/2706638431 shutdown_connections 2024-04-23T15:03:09.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.894+0000 7f5f1f200640 1 -- 172.21.15.81:0/2706638431 wait complete. 2024-04-23T15:03:09.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.895+0000 7f5f1f200640 1 Processor -- start 2024-04-23T15:03:09.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.895+0000 7f5f1f200640 1 -- start start 2024-04-23T15:03:09.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.895+0000 7f5f1f200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f200643b0 0x7f5f20114cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:09.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.895+0000 7f5f1f200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f20102020 0x7f5f20115200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:09.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.895+0000 7f5f1f200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f20115800 con 0x7f5f200643b0 2024-04-23T15:03:09.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.895+0000 7f5f1f200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2010ee50 con 0x7f5f20102020 2024-04-23T15:03:09.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.895+0000 7f5f1de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f200643b0 0x7f5f20114cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:09.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.895+0000 7f5f1de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f200643b0 0x7f5f20114cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45136/0 (socket says 172.21.15.81:45136) 2024-04-23T15:03:09.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.895+0000 7f5f1de00640 1 -- 172.21.15.81:0/3026997749 learned_addr learned my addr 172.21.15.81:0/3026997749 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:03:09.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.896+0000 7f5f1d400640 1 --2- 172.21.15.81:0/3026997749 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f20102020 0x7f5f20115200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:09.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.896+0000 7f5f1de00640 1 -- 172.21.15.81:0/3026997749 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f20102020 msgr2=0x7f5f20115200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:09.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.896+0000 7f5f1de00640 1 --2- 172.21.15.81:0/3026997749 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f20102020 0x7f5f20115200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:09.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.896+0000 7f5f1de00640 1 -- 172.21.15.81:0/3026997749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0c005040 con 0x7f5f200643b0 2024-04-23T15:03:09.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.896+0000 7f5f1de00640 1 --2- 172.21.15.81:0/3026997749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f200643b0 0x7f5f20114cc0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5f1000c810 tx=0x7f5f100043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:09.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.896+0000 7f5f16000640 1 -- 172.21.15.81:0/3026997749 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f1000a7a0 con 0x7f5f200643b0 2024-04-23T15:03:09.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.896+0000 7f5f1f200640 1 -- 172.21.15.81:0/3026997749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f2010f130 con 0x7f5f200643b0 2024-04-23T15:03:09.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.896+0000 7f5f16000640 1 -- 172.21.15.81:0/3026997749 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5f1000add0 con 0x7f5f200643b0 2024-04-23T15:03:09.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.896+0000 7f5f16000640 1 -- 172.21.15.81:0/3026997749 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f100115c0 con 0x7f5f200643b0 2024-04-23T15:03:09.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.897+0000 7f5f1f200640 1 -- 172.21.15.81:0/3026997749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f2010f620 con 0x7f5f200643b0 2024-04-23T15:03:09.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.898+0000 7f5f1f200640 1 -- 172.21.15.81:0/3026997749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f200fd720 con 0x7f5f200643b0 2024-04-23T15:03:09.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.899+0000 7f5f16000640 1 -- 172.21.15.81:0/3026997749 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f5f10012420 con 0x7f5f200643b0 2024-04-23T15:03:09.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.900+0000 7f5f16000640 1 --2- 172.21.15.81:0/3026997749 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f5f0406eb80 0x7f5f04071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:09.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.900+0000 7f5f16000640 1 -- 172.21.15.81:0/3026997749 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f5f1008eea0 con 0x7f5f200643b0 2024-04-23T15:03:09.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.900+0000 7f5f1d400640 1 --2- 172.21.15.81:0/3026997749 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f5f0406eb80 0x7f5f04071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:09.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.901+0000 7f5f1d400640 1 --2- 172.21.15.81:0/3026997749 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f5f0406eb80 0x7f5f04071030 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c0048a0 tx=0x7f5f0c009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:09.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:09.907+0000 7f5f16000640 1 -- 172.21.15.81:0/3026997749 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f5f10057b50 con 0x7f5f200643b0 2024-04-23T15:03:10.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.111+0000 7f5f1f200640 1 -- 172.21.15.81:0/3026997749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f201103c0 con 0x7f5f200643b0 2024-04-23T15:03:10.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.114+0000 7f5f16000640 1 -- 172.21.15.81:0/3026997749 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+16784 (secure 0 0 0) 0x7f5f1005b210 con 0x7f5f200643b0 2024-04-23T15:03:10.115 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T15:03:10.116 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":86,"fsid":"7a641bea-017e-11ef-bc93-c7b262605968","created":"2024-04-23T14:37:06.214022+0000","modified":"2024-04-23T14:58:57.639326+0000","last_up_change":"2024-04-23T14:57:29.638719+0000","last_in_change":"2024-04-23T14:43:50.423631+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T14:42:32.718276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-23T14:45:50.013431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-23T14:45:50.800862+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c084af11-7048-409a-9932-9ede242d3abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":50,"up_from":54,"up_thru":79,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":754768728},{"type":"v1","addr":"172.21.15.81:6803","nonce":754768728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":754768728},{"type":"v1","addr":"172.21.15.81:6805","nonce":754768728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":754768728},{"type":"v1","addr":"172.21.15.81:6809","nonce":754768728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":754768728},{"type":"v1","addr":"172.21.15.81:6807","nonce":754768728}]},"public_addr":"172.21.15.81:6803/754768728","cluster_addr":"172.21.15.81:6805/754768728","heartbeat_back_addr":"172.21.15.81:6809/754768728","heartbeat_front_addr":"172.21.15.81:6807/754768728","state":["exists","up"]},{"osd":1,"uuid":"0b642368-c907-404e-9f69-32f059f5426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":55,"up_from":59,"up_thru":79,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3551141175},{"type":"v1","addr":"172.21.15.81:6811","nonce":3551141175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3551141175},{"type":"v1","addr":"172.21.15.81:6813","nonce":3551141175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3551141175},{"type":"v1","addr":"172.21.15.81:6817","nonce":3551141175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3551141175},{"type":"v1","addr":"172.21.15.81:6815","nonce":3551141175}]},"public_addr":"172.21.15.81:6811/3551141175","cluster_addr":"172.21.15.81:6813/3551141175","heartbeat_back_addr":"172.21.15.81:6817/3551141175","heartbeat_front_addr":"172.21.15.81:6815/3551141175","state":["exists","up"]},{"osd":2,"uuid":"cde59edc-3e7d-4d53-ba08-a67ec2250898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":60,"up_from":64,"up_thru":79,"down_at":61,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3628575897},{"type":"v1","addr":"172.21.15.81:6819","nonce":3628575897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3628575897},{"type":"v1","addr":"172.21.15.81:6821","nonce":3628575897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3628575897},{"type":"v1","addr":"172.21.15.81:6825","nonce":3628575897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3628575897},{"type":"v1","addr":"172.21.15.81:6823","nonce":3628575897}]},"public_addr":"172.21.15.81:6819/3628575897","cluster_addr":"172.21.15.81:6821/3628575897","heartbeat_back_addr":"172.21.15.81:6825/3628575897","heartbeat_front_addr":"172.21.15.81:6823/3628575897","state":["exists","up"]},{"osd":3,"uuid":"722814fb-aeb5-4765-8440-05563f47c8ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":65,"up_from":69,"up_thru":79,"down_at":66,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":3882389280},{"type":"v1","addr":"172.21.15.156:6801","nonce":3882389280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":3882389280},{"type":"v1","addr":"172.21.15.156:6803","nonce":3882389280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":3882389280},{"type":"v1","addr":"172.21.15.156:6807","nonce":3882389280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":3882389280},{"type":"v1","addr":"172.21.15.156:6805","nonce":3882389280}]},"public_addr":"172.21.15.156:6801/3882389280","cluster_addr":"172.21.15.156:6803/3882389280","heartbeat_back_addr":"172.21.15.156:6807/3882389280","heartbeat_front_addr":"172.21.15.156:6805/3882389280","state":["exists","up"]},{"osd":4,"uuid":"2f660c6e-38d1-4982-9cba-46242bf2de6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":70,"up_from":74,"up_thru":79,"down_at":71,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":1123408224},{"type":"v1","addr":"172.21.15.156:6809","nonce":1123408224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":1123408224},{"type":"v1","addr":"172.21.15.156:6811","nonce":1123408224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":1123408224},{"type":"v1","addr":"172.21.15.156:6815","nonce":1123408224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":1123408224},{"type":"v1","addr":"172.21.15.156:6813","nonce":1123408224}]},"public_addr":"172.21.15.156:6809/1123408224","cluster_addr":"172.21.15.156:6811/1123408224","heartbeat_back_addr":"172.21.15.156:6815/1123408224","heartbeat_front_addr":"172.21.15.156:6813/1123408224","state":["exists","up"]},{"osd":5,"uuid":"82590b0d-f1e5-4491-b341-8db75ce2ea50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":75,"up_from":79,"up_thru":79,"down_at":76,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":2022300921},{"type":"v1","addr":"172.21.15.156:6817","nonce":2022300921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":2022300921},{"type":"v1","addr":"172.21.15.156:6819","nonce":2022300921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":2022300921},{"type":"v1","addr":"172.21.15.156:6823","nonce":2022300921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":2022300921},{"type":"v1","addr":"172.21.15.156:6821","nonce":2022300921}]},"public_addr":"172.21.15.156:6817/2022300921","cluster_addr":"172.21.15.156:6819/2022300921","heartbeat_back_addr":"172.21.15.156:6823/2022300921","heartbeat_front_addr":"172.21.15.156:6821/2022300921","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:16.189027+0000","dead_epoch":50},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:52.737106+0000","dead_epoch":55},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:42:29.838157+0000","dead_epoch":60},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:03.041762+0000","dead_epoch":65},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:37.248449+0000","dead_epoch":70},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:12.266170+0000","dead_epoch":75}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.156:6827/1794690362":"2024-04-24T14:58:57.639279+0000","172.21.15.81:6828/2563365650":"2024-04-24T14:58:05.875418+0000","172.21.15.81:6800/2072638798":"2024-04-24T14:38:16.825251+0000","172.21.15.81:0/4290566211":"2024-04-24T14:39:42.006227+0000","172.21.15.156:0/857010754":"2024-04-24T14:50:55.422683+0000","172.21.15.156:6829/100981835":"2024-04-24T14:50:55.422683+0000","172.21.15.81:0/1248767795":"2024-04-24T14:48:47.697101+0000","172.21.15.81:0/4004069135":"2024-04-24T14:37:38.176351+0000","172.21.15.81:0/3883051436":"2024-04-24T14:39:42.006227+0000","172.21.15.81:0/4052641920":"2024-04-24T14:52:26.432602+0000","172.21.15.81:0/3215003917":"2024-04-24T14:48:47.697101+0000","172.21.15.156:6826/1794690362":"2024-04-24T14:58:57.639279+0000","172.21.15.81:0/2253455652":"2024-04-24T14:37:38.176351+0000","172.21.15.81:0/1308908574":"2024-04-24T14:39:42.006227+0000","172.21.15.81:6800/1053506915":"2024-04-24T14:48:47.697101+0000","172.21.15.81:6801/2072638798":"2024-04-24T14:38:16.825251+0000","172.21.15.156:0/4195008831":"2024-04-24T14:50:55.422683+0000","172.21.15.81:6826/2500326945":"2024-04-24T14:46:09.390974+0000","172.21.15.156:6828/100981835":"2024-04-24T14:50:55.422683+0000","172.21.15.81:6827/2500326945":"2024-04-24T14:46:09.390974+0000","172.21.15.81:6801/1053506915":"2024-04-24T14:48:47.697101+0000","172.21.15.81:6800/3624015234":"2024-04-24T14:39:42.006227+0000","172.21.15.81:0/4040210849":"2024-04-24T14:52:26.432602+0000","172.21.15.81:0/2921033786":"2024-04-24T14:48:47.697101+0000","172.21.15.81:0/3010656646":"2024-04-24T14:37:38.176351+0000","172.21.15.156:0/3679467655":"2024-04-24T14:50:55.422683+0000","172.21.15.81:0/644202147":"2024-04-24T14:38:16.825251+0000","172.21.15.81:0/3173386887":"2024-04-24T14:38:16.825251+0000","172.21.15.81:6800/1764050360":"2024-04-24T14:37:38.176351+0000","172.21.15.81:6801/1880997914":"2024-04-24T14:52:26.432602+0000","172.21.15.81:0/71326574":"2024-04-24T14:52:26.432602+0000","172.21.15.81:6829/2563365650":"2024-04-24T14:58:05.875418+0000","172.21.15.81:6801/3624015234":"2024-04-24T14:39:42.006227+0000","172.21.15.81:6801/1764050360":"2024-04-24T14:37:38.176351+0000","172.21.15.81:0/652570605":"2024-04-24T14:38:16.825251+0000","172.21.15.81:6800/1880997914":"2024-04-24T14:52:26.432602+0000","172.21.15.81:0/1758342948":"2024-04-24T14:52:26.432602+0000","172.21.15.81:0/3287016492":"2024-04-24T14:52:26.432602+0000","172.21.15.81:0/934339506":"2024-04-24T14:48:47.697101+0000","172.21.15.156:0/1820858846":"2024-04-24T14:50:55.422683+0000","172.21.15.81:0/2623320468":"2024-04-24T14:52:26.432602+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T15:03:10.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.117+0000 7f5f1f200640 1 -- 172.21.15.81:0/3026997749 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f5f0406eb80 msgr2=0x7f5f04071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:10.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.117+0000 7f5f1f200640 1 --2- 172.21.15.81:0/3026997749 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f5f0406eb80 0x7f5f04071030 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c0048a0 tx=0x7f5f0c009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:10.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.117+0000 7f5f1f200640 1 -- 172.21.15.81:0/3026997749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f200643b0 msgr2=0x7f5f20114cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:10.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.117+0000 7f5f1f200640 1 --2- 172.21.15.81:0/3026997749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f200643b0 0x7f5f20114cc0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5f1000c810 tx=0x7f5f100043c0 comp rx=0 tx=0).stop 2024-04-23T15:03:10.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.117+0000 7f5f1f200640 1 -- 172.21.15.81:0/3026997749 shutdown_connections 2024-04-23T15:03:10.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.117+0000 7f5f1f200640 1 --2- 172.21.15.81:0/3026997749 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f5f0406eb80 0x7f5f04071030 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:10.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.117+0000 7f5f1f200640 1 --2- 172.21.15.81:0/3026997749 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f20102020 0x7f5f20115200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:10.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.117+0000 7f5f1f200640 1 --2- 172.21.15.81:0/3026997749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f200643b0 0x7f5f20114cc0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:10.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.117+0000 7f5f1f200640 1 -- 172.21.15.81:0/3026997749 >> 172.21.15.81:0/3026997749 conn(0x7f5f20070f20 msgr2=0x7f5f200fc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:10.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.117+0000 7f5f1f200640 1 -- 172.21.15.81:0/3026997749 shutdown_connections 2024-04-23T15:03:10.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.118+0000 7f5f1f200640 1 -- 172.21.15.81:0/3026997749 wait complete. 2024-04-23T15:03:10.140 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T14:42:32.718276+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-23T14:45:50.013431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-23T14:45:50.800862+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-23T15:03:10.141 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T15:03:10.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.336+0000 7f88c3c00640 1 -- 172.21.15.81:0/3825076885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88bc1043d0 msgr2=0x7f88bc1047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:10.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.336+0000 7f88c3c00640 1 --2- 172.21.15.81:0/3825076885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88bc1043d0 0x7f88bc1047a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f88b00048d0 tx=0x7f88b0009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:10.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.336+0000 7f88c3c00640 1 -- 172.21.15.81:0/3825076885 shutdown_connections 2024-04-23T15:03:10.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.336+0000 7f88c3c00640 1 --2- 172.21.15.81:0/3825076885 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88bc104d70 0x7f88bc0fe400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:10.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.336+0000 7f88c3c00640 1 --2- 172.21.15.81:0/3825076885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88bc1043d0 0x7f88bc1047a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:10.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.337+0000 7f88c3c00640 1 -- 172.21.15.81:0/3825076885 >> 172.21.15.81:0/3825076885 conn(0x7f88bc0f9fc0 msgr2=0x7f88bc0fc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:10.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.337+0000 7f88c3c00640 1 -- 172.21.15.81:0/3825076885 shutdown_connections 2024-04-23T15:03:10.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.337+0000 7f88c3c00640 1 -- 172.21.15.81:0/3825076885 wait complete. 2024-04-23T15:03:10.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.337+0000 7f88c3c00640 1 Processor -- start 2024-04-23T15:03:10.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.338+0000 7f88c3c00640 1 -- start start 2024-04-23T15:03:10.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.338+0000 7f88c3c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88bc1043d0 0x7f88bc114f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:10.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.338+0000 7f88c3c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88bc104d70 0x7f88bc1154d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:10.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.338+0000 7f88c3c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88bc115b60 con 0x7f88bc1043d0 2024-04-23T15:03:10.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.338+0000 7f88c3c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88bc10f120 con 0x7f88bc104d70 2024-04-23T15:03:10.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.338+0000 7f88c1200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88bc1043d0 0x7f88bc114f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:10.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.338+0000 7f88c1200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88bc1043d0 0x7f88bc114f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45152/0 (socket says 172.21.15.81:45152) 2024-04-23T15:03:10.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.338+0000 7f88c1200640 1 -- 172.21.15.81:0/2536661474 learned_addr learned my addr 172.21.15.81:0/2536661474 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:03:10.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.339+0000 7f88bbe00640 1 --2- 172.21.15.81:0/2536661474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88bc104d70 0x7f88bc1154d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:10.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.339+0000 7f88c1200640 1 -- 172.21.15.81:0/2536661474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88bc104d70 msgr2=0x7f88bc1154d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:10.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.339+0000 7f88c1200640 1 --2- 172.21.15.81:0/2536661474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88bc104d70 0x7f88bc1154d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:10.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.339+0000 7f88c1200640 1 -- 172.21.15.81:0/2536661474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b0005040 con 0x7f88bc1043d0 2024-04-23T15:03:10.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.339+0000 7f88c1200640 1 --2- 172.21.15.81:0/2536661474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88bc1043d0 0x7f88bc114f90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f88b0004930 tx=0x7f88b0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:10.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.339+0000 7f88b8c00640 1 -- 172.21.15.81:0/2536661474 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88b00094c0 con 0x7f88bc1043d0 2024-04-23T15:03:10.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.339+0000 7f88c3c00640 1 -- 172.21.15.81:0/2536661474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88bc10f3a0 con 0x7f88bc1043d0 2024-04-23T15:03:10.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.339+0000 7f88b8c00640 1 -- 172.21.15.81:0/2536661474 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f88b0032e50 con 0x7f88bc1043d0 2024-04-23T15:03:10.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.339+0000 7f88b8c00640 1 -- 172.21.15.81:0/2536661474 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88b00433b0 con 0x7f88bc1043d0 2024-04-23T15:03:10.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.340+0000 7f88c3c00640 1 -- 172.21.15.81:0/2536661474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88bc10f860 con 0x7f88bc1043d0 2024-04-23T15:03:10.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.341+0000 7f88c3c00640 1 -- 172.21.15.81:0/2536661474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88bc0ffb40 con 0x7f88bc1043d0 2024-04-23T15:03:10.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.341+0000 7f88b8c00640 1 -- 172.21.15.81:0/2536661474 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f88b002f070 con 0x7f88bc1043d0 2024-04-23T15:03:10.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.342+0000 7f88b8c00640 1 --2- 172.21.15.81:0/2536661474 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f88a406eb70 0x7f88a4071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:10.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.343+0000 7f88b8c00640 1 -- 172.21.15.81:0/2536661474 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f88b00b0880 con 0x7f88bc1043d0 2024-04-23T15:03:10.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.343+0000 7f88bbe00640 1 --2- 172.21.15.81:0/2536661474 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f88a406eb70 0x7f88a4071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:10.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.343+0000 7f88bbe00640 1 --2- 172.21.15.81:0/2536661474 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f88a406eb70 0x7f88a4071020 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f88ac006fd0 tx=0x7f88ac008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:10.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.347+0000 7f88b8c00640 1 -- 172.21.15.81:0/2536661474 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f88b00795d0 con 0x7f88bc1043d0 2024-04-23T15:03:10.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:10 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/1343533438' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-04-23T15:03:10.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:10 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:03:10.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:10 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:03:10.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:10 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:03:10.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:10 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/3026997749' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T15:03:10.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.544+0000 7f88c3c00640 1 -- 172.21.15.81:0/2536661474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f88bc110600 con 0x7f88bc1043d0 2024-04-23T15:03:10.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.545+0000 7f88b8c00640 1 -- 172.21.15.81:0/2536661474 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f88b007cc90 con 0x7f88bc1043d0 2024-04-23T15:03:10.545 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-04-23T15:03:10.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.548+0000 7f88c3c00640 1 -- 172.21.15.81:0/2536661474 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f88a406eb70 msgr2=0x7f88a4071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:10.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.548+0000 7f88c3c00640 1 --2- 172.21.15.81:0/2536661474 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f88a406eb70 0x7f88a4071020 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f88ac006fd0 tx=0x7f88ac008040 comp rx=0 tx=0).stop 2024-04-23T15:03:10.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.548+0000 7f88c3c00640 1 -- 172.21.15.81:0/2536661474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88bc1043d0 msgr2=0x7f88bc114f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:10.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.548+0000 7f88c3c00640 1 --2- 172.21.15.81:0/2536661474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88bc1043d0 0x7f88bc114f90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f88b0004930 tx=0x7f88b0009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:10.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.548+0000 7f88c3c00640 1 -- 172.21.15.81:0/2536661474 shutdown_connections 2024-04-23T15:03:10.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.548+0000 7f88c3c00640 1 --2- 172.21.15.81:0/2536661474 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f88a406eb70 0x7f88a4071020 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:10.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.548+0000 7f88c3c00640 1 --2- 172.21.15.81:0/2536661474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88bc104d70 0x7f88bc1154d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:10.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.548+0000 7f88c3c00640 1 --2- 172.21.15.81:0/2536661474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88bc1043d0 0x7f88bc114f90 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:10.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.548+0000 7f88c3c00640 1 -- 172.21.15.81:0/2536661474 >> 172.21.15.81:0/2536661474 conn(0x7f88bc0f9fc0 msgr2=0x7f88bc0faf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:10.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.548+0000 7f88c3c00640 1 -- 172.21.15.81:0/2536661474 shutdown_connections 2024-04-23T15:03:10.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.548+0000 7f88c3c00640 1 -- 172.21.15.81:0/2536661474 wait complete. 2024-04-23T15:03:10.566 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:10 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/1343533438' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-04-23T15:03:10.566 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:10 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T15:03:10.566 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:10 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T15:03:10.566 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:10 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' 2024-04-23T15:03:10.566 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:10 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/3026997749' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T15:03:10.568 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-23T15:03:10.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.761+0000 7f533fe00640 1 -- 172.21.15.81:0/2176231727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53400fd9e0 msgr2=0x7f5340106020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:10.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.761+0000 7f533fe00640 1 --2- 172.21.15.81:0/2176231727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53400fd9e0 0x7f5340106020 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f53280048d0 tx=0x7f5328009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:10.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.761+0000 7f533fe00640 1 -- 172.21.15.81:0/2176231727 shutdown_connections 2024-04-23T15:03:10.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.761+0000 7f533fe00640 1 --2- 172.21.15.81:0/2176231727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53400fd9e0 0x7f5340106020 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:10.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.761+0000 7f533fe00640 1 --2- 172.21.15.81:0/2176231727 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f53400fd040 0x7f53400fd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:10.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.761+0000 7f533fe00640 1 -- 172.21.15.81:0/2176231727 >> 172.21.15.81:0/2176231727 conn(0x7f53400f6ad0 msgr2=0x7f53400f8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:10.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.761+0000 7f533fe00640 1 -- 172.21.15.81:0/2176231727 shutdown_connections 2024-04-23T15:03:10.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.761+0000 7f533fe00640 1 -- 172.21.15.81:0/2176231727 wait complete. 2024-04-23T15:03:10.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.762+0000 7f533fe00640 1 Processor -- start 2024-04-23T15:03:10.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.762+0000 7f533fe00640 1 -- start start 2024-04-23T15:03:10.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.762+0000 7f533fe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f53400fd040 0x7f5340112c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:10.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.762+0000 7f533fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53400fd9e0 0x7f5340113160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:10.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.762+0000 7f533fe00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53401137f0 con 0x7f53400fd9e0 2024-04-23T15:03:10.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.762+0000 7f533fe00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534010cdb0 con 0x7f53400fd040 2024-04-23T15:03:10.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.763+0000 7f5337e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53400fd9e0 0x7f5340113160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:10.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.763+0000 7f5337e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53400fd9e0 0x7f5340113160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45182/0 (socket says 172.21.15.81:45182) 2024-04-23T15:03:10.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.763+0000 7f5337e00640 1 -- 172.21.15.81:0/648678420 learned_addr learned my addr 172.21.15.81:0/648678420 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:03:10.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.763+0000 7f533ea00640 1 --2- 172.21.15.81:0/648678420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f53400fd040 0x7f5340112c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:10.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.763+0000 7f5337e00640 1 -- 172.21.15.81:0/648678420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f53400fd040 msgr2=0x7f5340112c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:10.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.763+0000 7f5337e00640 1 --2- 172.21.15.81:0/648678420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f53400fd040 0x7f5340112c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:10.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.763+0000 7f5337e00640 1 -- 172.21.15.81:0/648678420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5328005040 con 0x7f53400fd9e0 2024-04-23T15:03:10.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.763+0000 7f533ea00640 1 --2- 172.21.15.81:0/648678420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f53400fd040 0x7f5340112c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:03:10.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.763+0000 7f5337e00640 1 --2- 172.21.15.81:0/648678420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53400fd9e0 0x7f5340113160 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5328004930 tx=0x7f5328009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:10.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.764+0000 7f5336a00640 1 -- 172.21.15.81:0/648678420 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53280094c0 con 0x7f53400fd9e0 2024-04-23T15:03:10.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.764+0000 7f5336a00640 1 -- 172.21.15.81:0/648678420 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5328032e50 con 0x7f53400fd9e0 2024-04-23T15:03:10.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.764+0000 7f533fe00640 1 -- 172.21.15.81:0/648678420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f534010d030 con 0x7f53400fd9e0 2024-04-23T15:03:10.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.764+0000 7f5336a00640 1 -- 172.21.15.81:0/648678420 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53280433b0 con 0x7f53400fd9e0 2024-04-23T15:03:10.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.764+0000 7f533fe00640 1 -- 172.21.15.81:0/648678420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f534010d4f0 con 0x7f53400fd9e0 2024-04-23T15:03:10.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.765+0000 7f533fe00640 1 -- 172.21.15.81:0/648678420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5340065e80 con 0x7f53400fd9e0 2024-04-23T15:03:10.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.766+0000 7f5336a00640 1 -- 172.21.15.81:0/648678420 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f532802f070 con 0x7f53400fd9e0 2024-04-23T15:03:10.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.767+0000 7f5336a00640 1 --2- 172.21.15.81:0/648678420 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f532006eb70 0x7f5320071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:10.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.767+0000 7f5336a00640 1 -- 172.21.15.81:0/648678420 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f53280b08d0 con 0x7f53400fd9e0 2024-04-23T15:03:10.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.767+0000 7f533ea00640 1 --2- 172.21.15.81:0/648678420 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f532006eb70 0x7f5320071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:10.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.768+0000 7f533ea00640 1 --2- 172.21.15.81:0/648678420 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f532006eb70 0x7f5320071020 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5330006fd0 tx=0x7f5330008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:10.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.772+0000 7f5336a00640 1 -- 172.21.15.81:0/648678420 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f5328079580 con 0x7f53400fd9e0 2024-04-23T15:03:10.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.976+0000 7f533fe00640 1 -- 172.21.15.81:0/648678420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f5340109250 con 0x7f53400fd9e0 2024-04-23T15:03:10.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.977+0000 7f5336a00640 1 -- 172.21.15.81:0/648678420 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v86) v1 ==== 107+0+11 (secure 0 0 0) 0x7f532807cc40 con 0x7f53400fd9e0 2024-04-23T15:03:10.977 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-04-23T15:03:10.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.979+0000 7f533fe00640 1 -- 172.21.15.81:0/648678420 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f532006eb70 msgr2=0x7f5320071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:10.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.979+0000 7f533fe00640 1 --2- 172.21.15.81:0/648678420 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f532006eb70 0x7f5320071020 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5330006fd0 tx=0x7f5330008040 comp rx=0 tx=0).stop 2024-04-23T15:03:10.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.979+0000 7f533fe00640 1 -- 172.21.15.81:0/648678420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53400fd9e0 msgr2=0x7f5340113160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:10.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.979+0000 7f533fe00640 1 --2- 172.21.15.81:0/648678420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53400fd9e0 0x7f5340113160 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5328004930 tx=0x7f5328009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:10.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.979+0000 7f533fe00640 1 -- 172.21.15.81:0/648678420 shutdown_connections 2024-04-23T15:03:10.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.979+0000 7f533fe00640 1 --2- 172.21.15.81:0/648678420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53400fd9e0 0x7f5340113160 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:10.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.979+0000 7f533fe00640 1 --2- 172.21.15.81:0/648678420 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f532006eb70 0x7f5320071020 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:10.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.979+0000 7f533fe00640 1 --2- 172.21.15.81:0/648678420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f53400fd040 0x7f5340112c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:10.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.979+0000 7f533fe00640 1 -- 172.21.15.81:0/648678420 >> 172.21.15.81:0/648678420 conn(0x7f53400f6ad0 msgr2=0x7f53400f7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:10.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.979+0000 7f533fe00640 1 -- 172.21.15.81:0/648678420 shutdown_connections 2024-04-23T15:03:10.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:10.979+0000 7f533fe00640 1 -- 172.21.15.81:0/648678420 wait complete. 2024-04-23T15:03:10.999 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-23T15:03:11.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.183+0000 7fb819c00640 1 -- 172.21.15.81:0/2913241444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8141042e0 msgr2=0x7fb8141046b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:11.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.183+0000 7fb819c00640 1 --2- 172.21.15.81:0/2913241444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8141042e0 0x7fb8141046b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb8040048d0 tx=0x7fb804009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:11.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.184+0000 7fb819c00640 1 -- 172.21.15.81:0/2913241444 shutdown_connections 2024-04-23T15:03:11.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.184+0000 7fb819c00640 1 --2- 172.21.15.81:0/2913241444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb814104c80 0x7fb8140fe310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:11.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.184+0000 7fb819c00640 1 --2- 172.21.15.81:0/2913241444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8141042e0 0x7fb8141046b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:11.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.184+0000 7fb819c00640 1 -- 172.21.15.81:0/2913241444 >> 172.21.15.81:0/2913241444 conn(0x7fb8140f9fc0 msgr2=0x7fb8140fc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:11.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.184+0000 7fb819c00640 1 -- 172.21.15.81:0/2913241444 shutdown_connections 2024-04-23T15:03:11.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.184+0000 7fb819c00640 1 -- 172.21.15.81:0/2913241444 wait complete. 2024-04-23T15:03:11.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.184+0000 7fb819c00640 1 Processor -- start 2024-04-23T15:03:11.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.185+0000 7fb819c00640 1 -- start start 2024-04-23T15:03:11.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.185+0000 7fb819c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8141042e0 0x7fb814114d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:11.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.185+0000 7fb819c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb814104c80 0x7fb814115250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:11.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.185+0000 7fb819c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb814115850 con 0x7fb814104c80 2024-04-23T15:03:11.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.185+0000 7fb819c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81410eef0 con 0x7fb8141042e0 2024-04-23T15:03:11.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.185+0000 7fb813400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb814104c80 0x7fb814115250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:11.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.185+0000 7fb813400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb814104c80 0x7fb814115250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45204/0 (socket says 172.21.15.81:45204) 2024-04-23T15:03:11.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.185+0000 7fb813400640 1 -- 172.21.15.81:0/3942476538 learned_addr learned my addr 172.21.15.81:0/3942476538 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:03:11.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.186+0000 7fb813e00640 1 --2- 172.21.15.81:0/3942476538 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8141042e0 0x7fb814114d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:11.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.186+0000 7fb813400640 1 -- 172.21.15.81:0/3942476538 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8141042e0 msgr2=0x7fb814114d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:11.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.186+0000 7fb813400640 1 --2- 172.21.15.81:0/3942476538 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8141042e0 0x7fb814114d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:11.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.186+0000 7fb813400640 1 -- 172.21.15.81:0/3942476538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb804005040 con 0x7fb814104c80 2024-04-23T15:03:11.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.186+0000 7fb813e00640 1 --2- 172.21.15.81:0/3942476538 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8141042e0 0x7fb814114d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:03:11.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.186+0000 7fb813400640 1 --2- 172.21.15.81:0/3942476538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb814104c80 0x7fb814115250 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb80000c810 tx=0x7fb8000043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:11.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.186+0000 7fb80be00640 1 -- 172.21.15.81:0/3942476538 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb80000a820 con 0x7fb814104c80 2024-04-23T15:03:11.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.186+0000 7fb80be00640 1 -- 172.21.15.81:0/3942476538 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb80000ae50 con 0x7fb814104c80 2024-04-23T15:03:11.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.186+0000 7fb80be00640 1 -- 172.21.15.81:0/3942476538 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8000115c0 con 0x7fb814104c80 2024-04-23T15:03:11.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.186+0000 7fb819c00640 1 -- 172.21.15.81:0/3942476538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb81410f1d0 con 0x7fb814104c80 2024-04-23T15:03:11.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.186+0000 7fb819c00640 1 -- 172.21.15.81:0/3942476538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb81410f6f0 con 0x7fb814104c80 2024-04-23T15:03:11.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.187+0000 7fb819c00640 1 -- 172.21.15.81:0/3942476538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8140ffa50 con 0x7fb814104c80 2024-04-23T15:03:11.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.189+0000 7fb80be00640 1 -- 172.21.15.81:0/3942476538 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fb80000a980 con 0x7fb814104c80 2024-04-23T15:03:11.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.190+0000 7fb80be00640 1 --2- 172.21.15.81:0/3942476538 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fb7f806eb80 0x7fb7f8071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:11.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.190+0000 7fb80be00640 1 -- 172.21.15.81:0/3942476538 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fb80008ee70 con 0x7fb814104c80 2024-04-23T15:03:11.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.190+0000 7fb813e00640 1 --2- 172.21.15.81:0/3942476538 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fb7f806eb80 0x7fb7f8071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:11.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.191+0000 7fb813e00640 1 --2- 172.21.15.81:0/3942476538 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fb7f806eb80 0x7fb7f8071030 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb804000c00 tx=0x7fb804009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:11.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.194+0000 7fb80be00640 1 -- 172.21.15.81:0/3942476538 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fb800057ba0 con 0x7fb814104c80 2024-04-23T15:03:11.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:11 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/2536661474' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T15:03:11.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:11 smithi081 ceph-mon[90469]: pgmap v361: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:03:11.327 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:11 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/648678420' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-23T15:03:11.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.396+0000 7fb819c00640 1 -- 172.21.15.81:0/3942476538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fb8141103b0 con 0x7fb814104c80 2024-04-23T15:03:11.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.397+0000 7fb80be00640 1 -- 172.21.15.81:0/3942476538 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v86) v1 ==== 107+0+11 (secure 0 0 0) 0x7fb80005b260 con 0x7fb814104c80 2024-04-23T15:03:11.398 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-04-23T15:03:11.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.399+0000 7fb819c00640 1 -- 172.21.15.81:0/3942476538 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fb7f806eb80 msgr2=0x7fb7f8071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:11.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.399+0000 7fb819c00640 1 --2- 172.21.15.81:0/3942476538 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fb7f806eb80 0x7fb7f8071030 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb804000c00 tx=0x7fb804009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:11.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.399+0000 7fb819c00640 1 -- 172.21.15.81:0/3942476538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb814104c80 msgr2=0x7fb814115250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:11.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.399+0000 7fb819c00640 1 --2- 172.21.15.81:0/3942476538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb814104c80 0x7fb814115250 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb80000c810 tx=0x7fb8000043c0 comp rx=0 tx=0).stop 2024-04-23T15:03:11.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.399+0000 7fb819c00640 1 -- 172.21.15.81:0/3942476538 shutdown_connections 2024-04-23T15:03:11.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.399+0000 7fb819c00640 1 --2- 172.21.15.81:0/3942476538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb814104c80 0x7fb814115250 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:11.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.399+0000 7fb819c00640 1 --2- 172.21.15.81:0/3942476538 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fb7f806eb80 0x7fb7f8071030 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:11.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.399+0000 7fb819c00640 1 --2- 172.21.15.81:0/3942476538 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8141042e0 0x7fb814114d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:11.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.399+0000 7fb819c00640 1 -- 172.21.15.81:0/3942476538 >> 172.21.15.81:0/3942476538 conn(0x7fb8140f9fc0 msgr2=0x7fb8140fcc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:11.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.399+0000 7fb819c00640 1 -- 172.21.15.81:0/3942476538 shutdown_connections 2024-04-23T15:03:11.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.400+0000 7fb819c00640 1 -- 172.21.15.81:0/3942476538 wait complete. 2024-04-23T15:03:11.418 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-23T15:03:11.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:11 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/2536661474' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T15:03:11.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:11 smithi156 ceph-mon[77738]: pgmap v361: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-23T15:03:11.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:11 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/648678420' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-23T15:03:11.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.614+0000 7ff10b200640 1 -- 172.21.15.81:0/2236025168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff10c1086a0 msgr2=0x7ff10c108a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:11.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.614+0000 7ff10b200640 1 --2- 172.21.15.81:0/2236025168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff10c1086a0 0x7ff10c108a70 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc009c50 tx=0x7ff0fc004d10 comp rx=0 tx=0).stop 2024-04-23T15:03:11.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.614+0000 7ff10b200640 1 -- 172.21.15.81:0/2236025168 shutdown_connections 2024-04-23T15:03:11.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.614+0000 7ff10b200640 1 --2- 172.21.15.81:0/2236025168 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff10c1026d0 0x7ff10c102b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:11.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.614+0000 7ff10b200640 1 --2- 172.21.15.81:0/2236025168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff10c1086a0 0x7ff10c108a70 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:11.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.614+0000 7ff10b200640 1 -- 172.21.15.81:0/2236025168 >> 172.21.15.81:0/2236025168 conn(0x7ff10c071e70 msgr2=0x7ff10c074280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:11.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.614+0000 7ff10b200640 1 -- 172.21.15.81:0/2236025168 shutdown_connections 2024-04-23T15:03:11.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.614+0000 7ff10b200640 1 -- 172.21.15.81:0/2236025168 wait complete. 2024-04-23T15:03:11.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.615+0000 7ff10b200640 1 Processor -- start 2024-04-23T15:03:11.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.615+0000 7ff10b200640 1 -- start start 2024-04-23T15:03:11.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.616+0000 7ff10b200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff10c1026d0 0x7ff10c119150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:11.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.616+0000 7ff10b200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff10c1086a0 0x7ff10c119690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:11.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.616+0000 7ff10b200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c119c90 con 0x7ff10c1026d0 2024-04-23T15:03:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.616+0000 7ff10b200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c1132e0 con 0x7ff10c1086a0 2024-04-23T15:03:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.616+0000 7ff109e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff10c1026d0 0x7ff10c119150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.616+0000 7ff109e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff10c1026d0 0x7ff10c119150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45230/0 (socket says 172.21.15.81:45230) 2024-04-23T15:03:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.616+0000 7ff109e00640 1 -- 172.21.15.81:0/410566140 learned_addr learned my addr 172.21.15.81:0/410566140 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:03:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.616+0000 7ff109e00640 1 -- 172.21.15.81:0/410566140 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff10c1086a0 msgr2=0x7ff10c119690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.616+0000 7ff109e00640 1 --2- 172.21.15.81:0/410566140 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff10c1086a0 0x7ff10c119690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.616+0000 7ff109e00640 1 -- 172.21.15.81:0/410566140 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0fc0098b0 con 0x7ff10c1026d0 2024-04-23T15:03:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.617+0000 7ff109e00640 1 --2- 172.21.15.81:0/410566140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff10c1026d0 0x7ff10c119150 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc02c1f0 tx=0x7ff0fc004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:11.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.617+0000 7ff102a00640 1 -- 172.21.15.81:0/410566140 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0fc03a070 con 0x7ff10c1026d0 2024-04-23T15:03:11.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.617+0000 7ff102a00640 1 -- 172.21.15.81:0/410566140 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff0fc009740 con 0x7ff10c1026d0 2024-04-23T15:03:11.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.617+0000 7ff102a00640 1 -- 172.21.15.81:0/410566140 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0fc03eb40 con 0x7ff10c1026d0 2024-04-23T15:03:11.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.617+0000 7ff10b200640 1 -- 172.21.15.81:0/410566140 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff10c113560 con 0x7ff10c1026d0 2024-04-23T15:03:11.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.617+0000 7ff10b200640 1 -- 172.21.15.81:0/410566140 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff10c113ab0 con 0x7ff10c1026d0 2024-04-23T15:03:11.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.618+0000 7ff10b200640 1 -- 172.21.15.81:0/410566140 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff10c103dc0 con 0x7ff10c1026d0 2024-04-23T15:03:11.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.619+0000 7ff102a00640 1 -- 172.21.15.81:0/410566140 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7ff0fc032070 con 0x7ff10c1026d0 2024-04-23T15:03:11.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.620+0000 7ff102a00640 1 --2- 172.21.15.81:0/410566140 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7ff0f006eb80 0x7ff0f0071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:11.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.620+0000 7ff102a00640 1 -- 172.21.15.81:0/410566140 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7ff0fc0b0e60 con 0x7ff10c1026d0 2024-04-23T15:03:11.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.621+0000 7ff101400640 1 --2- 172.21.15.81:0/410566140 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7ff0f006eb80 0x7ff0f0071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:11.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.621+0000 7ff101400640 1 --2- 172.21.15.81:0/410566140 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7ff0f006eb80 0x7ff0f0071030 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff10c114a10 tx=0x7ff0f4007cb0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:11.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.626+0000 7ff102a00640 1 -- 172.21.15.81:0/410566140 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7ff0fc079c00 con 0x7ff10c1026d0 2024-04-23T15:03:11.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.843+0000 7ff10b200640 1 -- 172.21.15.81:0/410566140 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff10c1147c0 con 0x7ff10c1026d0 2024-04-23T15:03:11.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.844+0000 7ff102a00640 1 -- 172.21.15.81:0/410566140 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v86) v1 ==== 81+0+2432 (secure 0 0 0) 0x7ff0fc07d2c0 con 0x7ff10c1026d0 2024-04-23T15:03:11.846 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.156:6827/1794690362 2024-04-24T14:58:57.639279+0000 2024-04-23T15:03:11.846 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6828/2563365650 2024-04-24T14:58:05.875418+0000 2024-04-23T15:03:11.846 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6800/2072638798 2024-04-24T14:38:16.825251+0000 2024-04-23T15:03:11.846 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/4290566211 2024-04-24T14:39:42.006227+0000 2024-04-23T15:03:11.846 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.156:0/857010754 2024-04-24T14:50:55.422683+0000 2024-04-23T15:03:11.846 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.156:6829/100981835 2024-04-24T14:50:55.422683+0000 2024-04-23T15:03:11.846 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/1248767795 2024-04-24T14:48:47.697101+0000 2024-04-23T15:03:11.846 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/4004069135 2024-04-24T14:37:38.176351+0000 2024-04-23T15:03:11.846 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/3883051436 2024-04-24T14:39:42.006227+0000 2024-04-23T15:03:11.846 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/4052641920 2024-04-24T14:52:26.432602+0000 2024-04-23T15:03:11.846 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/3215003917 2024-04-24T14:48:47.697101+0000 2024-04-23T15:03:11.846 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.156:6826/1794690362 2024-04-24T14:58:57.639279+0000 2024-04-23T15:03:11.846 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/2253455652 2024-04-24T14:37:38.176351+0000 2024-04-23T15:03:11.847 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/1308908574 2024-04-24T14:39:42.006227+0000 2024-04-23T15:03:11.847 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6800/1053506915 2024-04-24T14:48:47.697101+0000 2024-04-23T15:03:11.847 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6801/2072638798 2024-04-24T14:38:16.825251+0000 2024-04-23T15:03:11.847 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.156:0/4195008831 2024-04-24T14:50:55.422683+0000 2024-04-23T15:03:11.847 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6826/2500326945 2024-04-24T14:46:09.390974+0000 2024-04-23T15:03:11.847 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.156:6828/100981835 2024-04-24T14:50:55.422683+0000 2024-04-23T15:03:11.847 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6827/2500326945 2024-04-24T14:46:09.390974+0000 2024-04-23T15:03:11.847 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6801/1053506915 2024-04-24T14:48:47.697101+0000 2024-04-23T15:03:11.847 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6800/3624015234 2024-04-24T14:39:42.006227+0000 2024-04-23T15:03:11.847 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/4040210849 2024-04-24T14:52:26.432602+0000 2024-04-23T15:03:11.847 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/2921033786 2024-04-24T14:48:47.697101+0000 2024-04-23T15:03:11.847 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/3010656646 2024-04-24T14:37:38.176351+0000 2024-04-23T15:03:11.847 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.156:0/3679467655 2024-04-24T14:50:55.422683+0000 2024-04-23T15:03:11.847 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/644202147 2024-04-24T14:38:16.825251+0000 2024-04-23T15:03:11.847 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/3173386887 2024-04-24T14:38:16.825251+0000 2024-04-23T15:03:11.848 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6800/1764050360 2024-04-24T14:37:38.176351+0000 2024-04-23T15:03:11.848 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6801/1880997914 2024-04-24T14:52:26.432602+0000 2024-04-23T15:03:11.848 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/71326574 2024-04-24T14:52:26.432602+0000 2024-04-23T15:03:11.848 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6829/2563365650 2024-04-24T14:58:05.875418+0000 2024-04-23T15:03:11.848 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6801/3624015234 2024-04-24T14:39:42.006227+0000 2024-04-23T15:03:11.848 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6801/1764050360 2024-04-24T14:37:38.176351+0000 2024-04-23T15:03:11.848 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/652570605 2024-04-24T14:38:16.825251+0000 2024-04-23T15:03:11.848 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6800/1880997914 2024-04-24T14:52:26.432602+0000 2024-04-23T15:03:11.848 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/1758342948 2024-04-24T14:52:26.432602+0000 2024-04-23T15:03:11.848 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/3287016492 2024-04-24T14:52:26.432602+0000 2024-04-23T15:03:11.848 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/934339506 2024-04-24T14:48:47.697101+0000 2024-04-23T15:03:11.848 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.156:0/1820858846 2024-04-24T14:50:55.422683+0000 2024-04-23T15:03:11.848 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/2623320468 2024-04-24T14:52:26.432602+0000 2024-04-23T15:03:11.849 INFO:teuthology.orchestra.run.smithi081.stderr:listed 41 entries 2024-04-23T15:03:11.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.847+0000 7ff10b200640 1 -- 172.21.15.81:0/410566140 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7ff0f006eb80 msgr2=0x7ff0f0071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:11.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.847+0000 7ff10b200640 1 --2- 172.21.15.81:0/410566140 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7ff0f006eb80 0x7ff0f0071030 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff10c114a10 tx=0x7ff0f4007cb0 comp rx=0 tx=0).stop 2024-04-23T15:03:11.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.847+0000 7ff10b200640 1 -- 172.21.15.81:0/410566140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff10c1026d0 msgr2=0x7ff10c119150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:11.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.847+0000 7ff10b200640 1 --2- 172.21.15.81:0/410566140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff10c1026d0 0x7ff10c119150 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc02c1f0 tx=0x7ff0fc004d10 comp rx=0 tx=0).stop 2024-04-23T15:03:11.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.848+0000 7ff10b200640 1 -- 172.21.15.81:0/410566140 shutdown_connections 2024-04-23T15:03:11.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.848+0000 7ff10b200640 1 --2- 172.21.15.81:0/410566140 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7ff0f006eb80 0x7ff0f0071030 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:11.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.848+0000 7ff10b200640 1 --2- 172.21.15.81:0/410566140 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff10c1086a0 0x7ff10c119690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:11.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.848+0000 7ff10b200640 1 --2- 172.21.15.81:0/410566140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff10c1026d0 0x7ff10c119150 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:11.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.848+0000 7ff10b200640 1 -- 172.21.15.81:0/410566140 >> 172.21.15.81:0/410566140 conn(0x7ff10c071e70 msgr2=0x7ff10c073dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:11.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.848+0000 7ff10b200640 1 -- 172.21.15.81:0/410566140 shutdown_connections 2024-04-23T15:03:11.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:11.848+0000 7ff10b200640 1 -- 172.21.15.81:0/410566140 wait complete. 2024-04-23T15:03:11.867 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-23T15:03:11.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T15:03:11.867 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-23T15:03:11.948 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-04-23T15:03:11.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T15:03:11.948 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-23T15:03:12.028 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-04-23T15:03:12.028 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-23T15:03:12.088 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-04-23T15:03:12.088 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-23T15:03:12.140 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T15:03:12.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.342+0000 7f85c6e00640 1 -- 172.21.15.81:0/3275143174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85c01041f0 msgr2=0x7f85c01045c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:12.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.342+0000 7f85c6e00640 1 --2- 172.21.15.81:0/3275143174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85c01041f0 0x7f85c01045c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f85b40048d0 tx=0x7f85b4009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:12.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.342+0000 7f85c6e00640 1 -- 172.21.15.81:0/3275143174 shutdown_connections 2024-04-23T15:03:12.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.342+0000 7f85c6e00640 1 --2- 172.21.15.81:0/3275143174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f85c0104b90 0x7f85c00fe220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:12.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.342+0000 7f85c6e00640 1 --2- 172.21.15.81:0/3275143174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85c01041f0 0x7f85c01045c0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:12.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.342+0000 7f85c6e00640 1 -- 172.21.15.81:0/3275143174 >> 172.21.15.81:0/3275143174 conn(0x7f85c00f9fc0 msgr2=0x7f85c00fc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:12.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.342+0000 7f85c6e00640 1 -- 172.21.15.81:0/3275143174 shutdown_connections 2024-04-23T15:03:12.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.342+0000 7f85c6e00640 1 -- 172.21.15.81:0/3275143174 wait complete. 2024-04-23T15:03:12.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.343+0000 7f85c6e00640 1 Processor -- start 2024-04-23T15:03:12.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.343+0000 7f85c6e00640 1 -- start start 2024-04-23T15:03:12.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.343+0000 7f85c6e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f85c01041f0 0x7f85c0114c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:12.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.343+0000 7f85c6e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85c0104b90 0x7f85c01151d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:12.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.343+0000 7f85c6e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c01157d0 con 0x7f85c0104b90 2024-04-23T15:03:12.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.343+0000 7f85c6e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c010ee20 con 0x7f85c01041f0 2024-04-23T15:03:12.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.343+0000 7f85c5000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85c0104b90 0x7f85c01151d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:12.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.343+0000 7f85c5000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85c0104b90 0x7f85c01151d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45252/0 (socket says 172.21.15.81:45252) 2024-04-23T15:03:12.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.343+0000 7f85c5000640 1 -- 172.21.15.81:0/4109156762 learned_addr learned my addr 172.21.15.81:0/4109156762 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:03:12.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.344+0000 7f85c5a00640 1 --2- 172.21.15.81:0/4109156762 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f85c01041f0 0x7f85c0114c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:12.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.344+0000 7f85c5000640 1 -- 172.21.15.81:0/4109156762 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f85c01041f0 msgr2=0x7f85c0114c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:12.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.344+0000 7f85c5000640 1 --2- 172.21.15.81:0/4109156762 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f85c01041f0 0x7f85c0114c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:12.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.344+0000 7f85c5000640 1 -- 172.21.15.81:0/4109156762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b4005040 con 0x7f85c0104b90 2024-04-23T15:03:12.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.344+0000 7f85c5000640 1 --2- 172.21.15.81:0/4109156762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85c0104b90 0x7f85c01151d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f85b000c830 tx=0x7f85b0004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:12.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.344+0000 7f85bd600640 1 -- 172.21.15.81:0/4109156762 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85b000a850 con 0x7f85c0104b90 2024-04-23T15:03:12.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.344+0000 7f85bd600640 1 -- 172.21.15.81:0/4109156762 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f85b000ae80 con 0x7f85c0104b90 2024-04-23T15:03:12.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.344+0000 7f85bd600640 1 -- 172.21.15.81:0/4109156762 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85b0012ea0 con 0x7f85c0104b90 2024-04-23T15:03:12.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.344+0000 7f85c6e00640 1 -- 172.21.15.81:0/4109156762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c010f100 con 0x7f85c0104b90 2024-04-23T15:03:12.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.344+0000 7f85c6e00640 1 -- 172.21.15.81:0/4109156762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c010f620 con 0x7f85c0104b90 2024-04-23T15:03:12.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.346+0000 7f85c6e00640 1 -- 172.21.15.81:0/4109156762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c00ff960 con 0x7f85c0104b90 2024-04-23T15:03:12.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.347+0000 7f85bd600640 1 -- 172.21.15.81:0/4109156762 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f85b0012400 con 0x7f85c0104b90 2024-04-23T15:03:12.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.347+0000 7f85bd600640 1 --2- 172.21.15.81:0/4109156762 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f85a806eb80 0x7f85a8071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:12.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.348+0000 7f85bd600640 1 -- 172.21.15.81:0/4109156762 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f85b008eb20 con 0x7f85c0104b90 2024-04-23T15:03:12.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.348+0000 7f85c5a00640 1 --2- 172.21.15.81:0/4109156762 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f85a806eb80 0x7f85a8071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:12.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.349+0000 7f85c5a00640 1 --2- 172.21.15.81:0/4109156762 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f85a806eb80 0x7f85a8071030 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f85b4031870 tx=0x7f85b4009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:12.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.353+0000 7f85bd600640 1 -- 172.21.15.81:0/4109156762 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f85b00578d0 con 0x7f85c0104b90 2024-04-23T15:03:12.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:12 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/3942476538' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-23T15:03:12.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:12 smithi156 ceph-mon[77738]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T15:03:12.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:12 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/410566140' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-23T15:03:12.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.554+0000 7f85c6e00640 1 -- 172.21.15.81:0/4109156762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85c010b330 con 0x7f85c0104b90 2024-04-23T15:03:12.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.558+0000 7f85bd600640 1 -- 172.21.15.81:0/4109156762 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+16784 (secure 0 0 0) 0x7f85b00126b0 con 0x7f85c0104b90 2024-04-23T15:03:12.559 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-23T15:03:12.559 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":86,"fsid":"7a641bea-017e-11ef-bc93-c7b262605968","created":"2024-04-23T14:37:06.214022+0000","modified":"2024-04-23T14:58:57.639326+0000","last_up_change":"2024-04-23T14:57:29.638719+0000","last_in_change":"2024-04-23T14:43:50.423631+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T14:42:32.718276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-23T14:45:50.013431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-23T14:45:50.800862+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c084af11-7048-409a-9932-9ede242d3abc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":50,"up_from":54,"up_thru":79,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":754768728},{"type":"v1","addr":"172.21.15.81:6803","nonce":754768728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":754768728},{"type":"v1","addr":"172.21.15.81:6805","nonce":754768728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":754768728},{"type":"v1","addr":"172.21.15.81:6809","nonce":754768728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":754768728},{"type":"v1","addr":"172.21.15.81:6807","nonce":754768728}]},"public_addr":"172.21.15.81:6803/754768728","cluster_addr":"172.21.15.81:6805/754768728","heartbeat_back_addr":"172.21.15.81:6809/754768728","heartbeat_front_addr":"172.21.15.81:6807/754768728","state":["exists","up"]},{"osd":1,"uuid":"0b642368-c907-404e-9f69-32f059f5426e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":55,"up_from":59,"up_thru":79,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3551141175},{"type":"v1","addr":"172.21.15.81:6811","nonce":3551141175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3551141175},{"type":"v1","addr":"172.21.15.81:6813","nonce":3551141175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3551141175},{"type":"v1","addr":"172.21.15.81:6817","nonce":3551141175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3551141175},{"type":"v1","addr":"172.21.15.81:6815","nonce":3551141175}]},"public_addr":"172.21.15.81:6811/3551141175","cluster_addr":"172.21.15.81:6813/3551141175","heartbeat_back_addr":"172.21.15.81:6817/3551141175","heartbeat_front_addr":"172.21.15.81:6815/3551141175","state":["exists","up"]},{"osd":2,"uuid":"cde59edc-3e7d-4d53-ba08-a67ec2250898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":60,"up_from":64,"up_thru":79,"down_at":61,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3628575897},{"type":"v1","addr":"172.21.15.81:6819","nonce":3628575897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3628575897},{"type":"v1","addr":"172.21.15.81:6821","nonce":3628575897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3628575897},{"type":"v1","addr":"172.21.15.81:6825","nonce":3628575897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3628575897},{"type":"v1","addr":"172.21.15.81:6823","nonce":3628575897}]},"public_addr":"172.21.15.81:6819/3628575897","cluster_addr":"172.21.15.81:6821/3628575897","heartbeat_back_addr":"172.21.15.81:6825/3628575897","heartbeat_front_addr":"172.21.15.81:6823/3628575897","state":["exists","up"]},{"osd":3,"uuid":"722814fb-aeb5-4765-8440-05563f47c8ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":65,"up_from":69,"up_thru":79,"down_at":66,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":3882389280},{"type":"v1","addr":"172.21.15.156:6801","nonce":3882389280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":3882389280},{"type":"v1","addr":"172.21.15.156:6803","nonce":3882389280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":3882389280},{"type":"v1","addr":"172.21.15.156:6807","nonce":3882389280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":3882389280},{"type":"v1","addr":"172.21.15.156:6805","nonce":3882389280}]},"public_addr":"172.21.15.156:6801/3882389280","cluster_addr":"172.21.15.156:6803/3882389280","heartbeat_back_addr":"172.21.15.156:6807/3882389280","heartbeat_front_addr":"172.21.15.156:6805/3882389280","state":["exists","up"]},{"osd":4,"uuid":"2f660c6e-38d1-4982-9cba-46242bf2de6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":70,"up_from":74,"up_thru":79,"down_at":71,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":1123408224},{"type":"v1","addr":"172.21.15.156:6809","nonce":1123408224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":1123408224},{"type":"v1","addr":"172.21.15.156:6811","nonce":1123408224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":1123408224},{"type":"v1","addr":"172.21.15.156:6815","nonce":1123408224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":1123408224},{"type":"v1","addr":"172.21.15.156:6813","nonce":1123408224}]},"public_addr":"172.21.15.156:6809/1123408224","cluster_addr":"172.21.15.156:6811/1123408224","heartbeat_back_addr":"172.21.15.156:6815/1123408224","heartbeat_front_addr":"172.21.15.156:6813/1123408224","state":["exists","up"]},{"osd":5,"uuid":"82590b0d-f1e5-4491-b341-8db75ce2ea50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":75,"up_from":79,"up_thru":79,"down_at":76,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":2022300921},{"type":"v1","addr":"172.21.15.156:6817","nonce":2022300921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":2022300921},{"type":"v1","addr":"172.21.15.156:6819","nonce":2022300921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":2022300921},{"type":"v1","addr":"172.21.15.156:6823","nonce":2022300921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":2022300921},{"type":"v1","addr":"172.21.15.156:6821","nonce":2022300921}]},"public_addr":"172.21.15.156:6817/2022300921","cluster_addr":"172.21.15.156:6819/2022300921","heartbeat_back_addr":"172.21.15.156:6823/2022300921","heartbeat_front_addr":"172.21.15.156:6821/2022300921","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:16.189027+0000","dead_epoch":50},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:41:52.737106+0000","dead_epoch":55},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:42:29.838157+0000","dead_epoch":60},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:03.041762+0000","dead_epoch":65},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:43:37.248449+0000","dead_epoch":70},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T14:44:12.266170+0000","dead_epoch":75}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.156:6827/1794690362":"2024-04-24T14:58:57.639279+0000","172.21.15.81:6828/2563365650":"2024-04-24T14:58:05.875418+0000","172.21.15.81:6800/2072638798":"2024-04-24T14:38:16.825251+0000","172.21.15.81:0/4290566211":"2024-04-24T14:39:42.006227+0000","172.21.15.156:0/857010754":"2024-04-24T14:50:55.422683+0000","172.21.15.156:6829/100981835":"2024-04-24T14:50:55.422683+0000","172.21.15.81:0/1248767795":"2024-04-24T14:48:47.697101+0000","172.21.15.81:0/4004069135":"2024-04-24T14:37:38.176351+0000","172.21.15.81:0/3883051436":"2024-04-24T14:39:42.006227+0000","172.21.15.81:0/4052641920":"2024-04-24T14:52:26.432602+0000","172.21.15.81:0/3215003917":"2024-04-24T14:48:47.697101+0000","172.21.15.156:6826/1794690362":"2024-04-24T14:58:57.639279+0000","172.21.15.81:0/2253455652":"2024-04-24T14:37:38.176351+0000","172.21.15.81:0/1308908574":"2024-04-24T14:39:42.006227+0000","172.21.15.81:6800/1053506915":"2024-04-24T14:48:47.697101+0000","172.21.15.81:6801/2072638798":"2024-04-24T14:38:16.825251+0000","172.21.15.156:0/4195008831":"2024-04-24T14:50:55.422683+0000","172.21.15.81:6826/2500326945":"2024-04-24T14:46:09.390974+0000","172.21.15.156:6828/100981835":"2024-04-24T14:50:55.422683+0000","172.21.15.81:6827/2500326945":"2024-04-24T14:46:09.390974+0000","172.21.15.81:6801/1053506915":"2024-04-24T14:48:47.697101+0000","172.21.15.81:6800/3624015234":"2024-04-24T14:39:42.006227+0000","172.21.15.81:0/4040210849":"2024-04-24T14:52:26.432602+0000","172.21.15.81:0/2921033786":"2024-04-24T14:48:47.697101+0000","172.21.15.81:0/3010656646":"2024-04-24T14:37:38.176351+0000","172.21.15.156:0/3679467655":"2024-04-24T14:50:55.422683+0000","172.21.15.81:0/644202147":"2024-04-24T14:38:16.825251+0000","172.21.15.81:0/3173386887":"2024-04-24T14:38:16.825251+0000","172.21.15.81:6800/1764050360":"2024-04-24T14:37:38.176351+0000","172.21.15.81:6801/1880997914":"2024-04-24T14:52:26.432602+0000","172.21.15.81:0/71326574":"2024-04-24T14:52:26.432602+0000","172.21.15.81:6829/2563365650":"2024-04-24T14:58:05.875418+0000","172.21.15.81:6801/3624015234":"2024-04-24T14:39:42.006227+0000","172.21.15.81:6801/1764050360":"2024-04-24T14:37:38.176351+0000","172.21.15.81:0/652570605":"2024-04-24T14:38:16.825251+0000","172.21.15.81:6800/1880997914":"2024-04-24T14:52:26.432602+0000","172.21.15.81:0/1758342948":"2024-04-24T14:52:26.432602+0000","172.21.15.81:0/3287016492":"2024-04-24T14:52:26.432602+0000","172.21.15.81:0/934339506":"2024-04-24T14:48:47.697101+0000","172.21.15.156:0/1820858846":"2024-04-24T14:50:55.422683+0000","172.21.15.81:0/2623320468":"2024-04-24T14:52:26.432602+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T15:03:12.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.560+0000 7f85c6e00640 1 -- 172.21.15.81:0/4109156762 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f85a806eb80 msgr2=0x7f85a8071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:12.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.560+0000 7f85c6e00640 1 --2- 172.21.15.81:0/4109156762 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f85a806eb80 0x7f85a8071030 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f85b4031870 tx=0x7f85b4009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:12.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.560+0000 7f85c6e00640 1 -- 172.21.15.81:0/4109156762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85c0104b90 msgr2=0x7f85c01151d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:12.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.560+0000 7f85c6e00640 1 --2- 172.21.15.81:0/4109156762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85c0104b90 0x7f85c01151d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f85b000c830 tx=0x7f85b0004430 comp rx=0 tx=0).stop 2024-04-23T15:03:12.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.561+0000 7f85c6e00640 1 -- 172.21.15.81:0/4109156762 shutdown_connections 2024-04-23T15:03:12.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.561+0000 7f85c6e00640 1 --2- 172.21.15.81:0/4109156762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85c0104b90 0x7f85c01151d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:12.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.561+0000 7f85c6e00640 1 --2- 172.21.15.81:0/4109156762 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f85a806eb80 0x7f85a8071030 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:12.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.561+0000 7f85c6e00640 1 --2- 172.21.15.81:0/4109156762 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f85c01041f0 0x7f85c0114c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:12.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.561+0000 7f85c6e00640 1 -- 172.21.15.81:0/4109156762 >> 172.21.15.81:0/4109156762 conn(0x7f85c00f9fc0 msgr2=0x7f85c00fbe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:12.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.561+0000 7f85c6e00640 1 -- 172.21.15.81:0/4109156762 shutdown_connections 2024-04-23T15:03:12.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.561+0000 7f85c6e00640 1 -- 172.21.15.81:0/4109156762 wait complete. 2024-04-23T15:03:12.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:12 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/3942476538' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-23T15:03:12.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:12 smithi081 ceph-mon[90469]: from='mgr.34102 172.21.15.81:0/2031824167' entity='mgr.smithi081.ldghvq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-23T15:03:12.576 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:12 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/410566140' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-23T15:03:12.581 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T14:42:32.718276+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-23T14:45:50.013431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-23T14:45:50.800862+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-23T15:03:12.581 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T15:03:12.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.775+0000 7fb548e00640 1 -- 172.21.15.81:0/1346422540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb544071a00 msgr2=0x7fb544071dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:12.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.775+0000 7fb548e00640 1 --2- 172.21.15.81:0/1346422540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb544071a00 0x7fb544071dd0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb5340048d0 tx=0x7fb534009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:12.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.775+0000 7fb548e00640 1 -- 172.21.15.81:0/1346422540 shutdown_connections 2024-04-23T15:03:12.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.775+0000 7fb548e00640 1 --2- 172.21.15.81:0/1346422540 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb544072310 0x7fb54410cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:12.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.775+0000 7fb548e00640 1 --2- 172.21.15.81:0/1346422540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb544071a00 0x7fb544071dd0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:12.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.775+0000 7fb548e00640 1 -- 172.21.15.81:0/1346422540 >> 172.21.15.81:0/1346422540 conn(0x7fb5440f9fc0 msgr2=0x7fb5440fc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:12.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.775+0000 7fb548e00640 1 -- 172.21.15.81:0/1346422540 shutdown_connections 2024-04-23T15:03:12.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.775+0000 7fb548e00640 1 -- 172.21.15.81:0/1346422540 wait complete. 2024-04-23T15:03:12.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.776+0000 7fb548e00640 1 Processor -- start 2024-04-23T15:03:12.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.776+0000 7fb548e00640 1 -- start start 2024-04-23T15:03:12.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.777+0000 7fb548e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb544071a00 0x7fb5441192f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:12.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.777+0000 7fb548e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb544072310 0x7fb544119830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:12.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.777+0000 7fb548e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb544119e30 con 0x7fb544072310 2024-04-23T15:03:12.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.777+0000 7fb548e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb544113480 con 0x7fb544071a00 2024-04-23T15:03:12.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.777+0000 7fb53be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb544072310 0x7fb544119830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:12.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.777+0000 7fb53be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb544072310 0x7fb544119830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45256/0 (socket says 172.21.15.81:45256) 2024-04-23T15:03:12.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.777+0000 7fb53be00640 1 -- 172.21.15.81:0/3893978812 learned_addr learned my addr 172.21.15.81:0/3893978812 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:03:12.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.777+0000 7fb53be00640 1 -- 172.21.15.81:0/3893978812 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb544071a00 msgr2=0x7fb5441192f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:12.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.777+0000 7fb53be00640 1 --2- 172.21.15.81:0/3893978812 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb544071a00 0x7fb5441192f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:12.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.777+0000 7fb53be00640 1 -- 172.21.15.81:0/3893978812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb534005040 con 0x7fb544072310 2024-04-23T15:03:12.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.778+0000 7fb53be00640 1 --2- 172.21.15.81:0/3893978812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb544072310 0x7fb544119830 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb52c00c830 tx=0x7fb52c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:12.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.778+0000 7fb53a000640 1 -- 172.21.15.81:0/3893978812 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb52c00a850 con 0x7fb544072310 2024-04-23T15:03:12.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.778+0000 7fb53a000640 1 -- 172.21.15.81:0/3893978812 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb52c00ae80 con 0x7fb544072310 2024-04-23T15:03:12.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.778+0000 7fb53a000640 1 -- 172.21.15.81:0/3893978812 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb52c012ea0 con 0x7fb544072310 2024-04-23T15:03:12.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.778+0000 7fb548e00640 1 -- 172.21.15.81:0/3893978812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb544113760 con 0x7fb544072310 2024-04-23T15:03:12.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.778+0000 7fb548e00640 1 -- 172.21.15.81:0/3893978812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb544113c80 con 0x7fb544072310 2024-04-23T15:03:12.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.779+0000 7fb548e00640 1 -- 172.21.15.81:0/3893978812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb544073140 con 0x7fb544072310 2024-04-23T15:03:12.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.780+0000 7fb53a000640 1 -- 172.21.15.81:0/3893978812 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fb52c012400 con 0x7fb544072310 2024-04-23T15:03:12.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.782+0000 7fb53a000640 1 --2- 172.21.15.81:0/3893978812 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fb52806eb70 0x7fb528071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:12.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.782+0000 7fb53a000640 1 -- 172.21.15.81:0/3893978812 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fb52c08ea60 con 0x7fb544072310 2024-04-23T15:03:12.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.782+0000 7fb541e00640 1 --2- 172.21.15.81:0/3893978812 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fb52806eb70 0x7fb528071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:12.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.783+0000 7fb541e00640 1 --2- 172.21.15.81:0/3893978812 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fb52806eb70 0x7fb528071020 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb5340043d0 tx=0x7fb534009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:12.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.786+0000 7fb53a000640 1 -- 172.21.15.81:0/3893978812 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fb52c0578d0 con 0x7fb544072310 2024-04-23T15:03:12.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.990+0000 7fb548e00640 1 -- 172.21.15.81:0/3893978812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb54404bcc0 con 0x7fb544072310 2024-04-23T15:03:12.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.990+0000 7fb53a000640 1 -- 172.21.15.81:0/3893978812 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb52c0126b0 con 0x7fb544072310 2024-04-23T15:03:12.991 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-04-23T15:03:12.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.993+0000 7fb548e00640 1 -- 172.21.15.81:0/3893978812 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fb52806eb70 msgr2=0x7fb528071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:12.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.993+0000 7fb548e00640 1 --2- 172.21.15.81:0/3893978812 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fb52806eb70 0x7fb528071020 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb5340043d0 tx=0x7fb534009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:12.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.993+0000 7fb548e00640 1 -- 172.21.15.81:0/3893978812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb544072310 msgr2=0x7fb544119830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:12.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.993+0000 7fb548e00640 1 --2- 172.21.15.81:0/3893978812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb544072310 0x7fb544119830 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb52c00c830 tx=0x7fb52c004430 comp rx=0 tx=0).stop 2024-04-23T15:03:12.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.993+0000 7fb548e00640 1 -- 172.21.15.81:0/3893978812 shutdown_connections 2024-04-23T15:03:12.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.993+0000 7fb548e00640 1 --2- 172.21.15.81:0/3893978812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb544072310 0x7fb544119830 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:12.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.993+0000 7fb548e00640 1 --2- 172.21.15.81:0/3893978812 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7fb52806eb70 0x7fb528071020 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:12.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.993+0000 7fb548e00640 1 --2- 172.21.15.81:0/3893978812 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb544071a00 0x7fb5441192f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:12.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.993+0000 7fb548e00640 1 -- 172.21.15.81:0/3893978812 >> 172.21.15.81:0/3893978812 conn(0x7fb5440f9fc0 msgr2=0x7fb544106b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:12.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.993+0000 7fb548e00640 1 -- 172.21.15.81:0/3893978812 shutdown_connections 2024-04-23T15:03:12.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:12.993+0000 7fb548e00640 1 -- 172.21.15.81:0/3893978812 wait complete. 2024-04-23T15:03:13.012 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-23T15:03:13.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.207+0000 7effb3200640 1 -- 172.21.15.81:0/974238809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effb4102030 msgr2=0x7effb4102400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:13.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.207+0000 7effb3200640 1 --2- 172.21.15.81:0/974238809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effb4102030 0x7effb4102400 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7effa40048d0 tx=0x7effa4009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:13.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.207+0000 7effb3200640 1 -- 172.21.15.81:0/974238809 shutdown_connections 2024-04-23T15:03:13.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.207+0000 7effb3200640 1 --2- 172.21.15.81:0/974238809 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7effb41029d0 0x7effb40fc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:13.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.207+0000 7effb3200640 1 --2- 172.21.15.81:0/974238809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effb4102030 0x7effb4102400 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:13.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.207+0000 7effb3200640 1 -- 172.21.15.81:0/974238809 >> 172.21.15.81:0/974238809 conn(0x7effb40f7c20 msgr2=0x7effb40fa030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:13.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.207+0000 7effb3200640 1 -- 172.21.15.81:0/974238809 shutdown_connections 2024-04-23T15:03:13.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.207+0000 7effb3200640 1 -- 172.21.15.81:0/974238809 wait complete. 2024-04-23T15:03:13.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.208+0000 7effb3200640 1 Processor -- start 2024-04-23T15:03:13.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.208+0000 7effb3200640 1 -- start start 2024-04-23T15:03:13.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.209+0000 7effb3200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effb4102030 0x7effb4114d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:13.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.209+0000 7effb3200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7effb41029d0 0x7effb4115260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:13.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.209+0000 7effb3200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb4115860 con 0x7effb4102030 2024-04-23T15:03:13.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.209+0000 7effb3200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb410eeb0 con 0x7effb41029d0 2024-04-23T15:03:13.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.209+0000 7effb1e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effb4102030 0x7effb4114d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:13.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.209+0000 7effb1e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effb4102030 0x7effb4114d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45270/0 (socket says 172.21.15.81:45270) 2024-04-23T15:03:13.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.209+0000 7effb1e00640 1 -- 172.21.15.81:0/3512678749 learned_addr learned my addr 172.21.15.81:0/3512678749 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:03:13.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.209+0000 7effb1e00640 1 -- 172.21.15.81:0/3512678749 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7effb41029d0 msgr2=0x7effb4115260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:13.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.209+0000 7effb1e00640 1 --2- 172.21.15.81:0/3512678749 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7effb41029d0 0x7effb4115260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:13.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.209+0000 7effb1e00640 1 -- 172.21.15.81:0/3512678749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa4005040 con 0x7effb4102030 2024-04-23T15:03:13.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.210+0000 7effb1e00640 1 --2- 172.21.15.81:0/3512678749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effb4102030 0x7effb4114d20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7effa40047f0 tx=0x7effa4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:13.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.210+0000 7effaa000640 1 -- 172.21.15.81:0/3512678749 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effa40094c0 con 0x7effb4102030 2024-04-23T15:03:13.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.210+0000 7effaa000640 1 -- 172.21.15.81:0/3512678749 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7effa4032e50 con 0x7effb4102030 2024-04-23T15:03:13.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.210+0000 7effaa000640 1 -- 172.21.15.81:0/3512678749 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effa40435f0 con 0x7effb4102030 2024-04-23T15:03:13.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.210+0000 7effb3200640 1 -- 172.21.15.81:0/3512678749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb410f130 con 0x7effb4102030 2024-04-23T15:03:13.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.210+0000 7effb3200640 1 -- 172.21.15.81:0/3512678749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb410f5f0 con 0x7effb4102030 2024-04-23T15:03:13.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.211+0000 7effb3200640 1 -- 172.21.15.81:0/3512678749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb40fd7a0 con 0x7effb4102030 2024-04-23T15:03:13.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.212+0000 7effaa000640 1 -- 172.21.15.81:0/3512678749 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7effa402f070 con 0x7effb4102030 2024-04-23T15:03:13.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.214+0000 7effaa000640 1 --2- 172.21.15.81:0/3512678749 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7eff9806eb80 0x7eff98071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:13.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.214+0000 7effaa000640 1 -- 172.21.15.81:0/3512678749 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7effa40b0780 con 0x7effb4102030 2024-04-23T15:03:13.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.214+0000 7effb1400640 1 --2- 172.21.15.81:0/3512678749 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7eff9806eb80 0x7eff98071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:13.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.215+0000 7effb1400640 1 --2- 172.21.15.81:0/3512678749 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7eff9806eb80 0x7eff98071030 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7effb41105e0 tx=0x7eff9c007aa0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:13.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.219+0000 7effaa000640 1 -- 172.21.15.81:0/3512678749 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7effa40794d0 con 0x7effb4102030 2024-04-23T15:03:13.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:13 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/4109156762' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T15:03:13.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:13 smithi081 ceph-mon[90469]: pgmap v362: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 938 B/s rd, 85 B/s wr, 2 op/s 2024-04-23T15:03:13.326 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:13 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/3893978812' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T15:03:13.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.418+0000 7effb3200640 1 -- 172.21.15.81:0/3512678749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7effb4109170 con 0x7effb4102030 2024-04-23T15:03:13.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.418+0000 7effaa000640 1 -- 172.21.15.81:0/3512678749 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v86) v1 ==== 107+0+11 (secure 0 0 0) 0x7effa407cb90 con 0x7effb4102030 2024-04-23T15:03:13.419 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-04-23T15:03:13.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.421+0000 7effb3200640 1 -- 172.21.15.81:0/3512678749 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7eff9806eb80 msgr2=0x7eff98071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:13.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.421+0000 7effb3200640 1 --2- 172.21.15.81:0/3512678749 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7eff9806eb80 0x7eff98071030 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7effb41105e0 tx=0x7eff9c007aa0 comp rx=0 tx=0).stop 2024-04-23T15:03:13.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.421+0000 7effb3200640 1 -- 172.21.15.81:0/3512678749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effb4102030 msgr2=0x7effb4114d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:13.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.421+0000 7effb3200640 1 --2- 172.21.15.81:0/3512678749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effb4102030 0x7effb4114d20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7effa40047f0 tx=0x7effa4009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:13.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.421+0000 7effb3200640 1 -- 172.21.15.81:0/3512678749 shutdown_connections 2024-04-23T15:03:13.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.421+0000 7effb3200640 1 --2- 172.21.15.81:0/3512678749 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7eff9806eb80 0x7eff98071030 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:13.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.421+0000 7effb3200640 1 --2- 172.21.15.81:0/3512678749 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7effb41029d0 0x7effb4115260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:13.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.421+0000 7effb3200640 1 --2- 172.21.15.81:0/3512678749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effb4102030 0x7effb4114d20 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:13.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.421+0000 7effb3200640 1 -- 172.21.15.81:0/3512678749 >> 172.21.15.81:0/3512678749 conn(0x7effb40f7c20 msgr2=0x7effb4071000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:13.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.421+0000 7effb3200640 1 -- 172.21.15.81:0/3512678749 shutdown_connections 2024-04-23T15:03:13.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.421+0000 7effb3200640 1 -- 172.21.15.81:0/3512678749 wait complete. 2024-04-23T15:03:13.439 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-23T15:03:13.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:13 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/4109156762' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T15:03:13.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:13 smithi156 ceph-mon[77738]: pgmap v362: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 938 B/s rd, 85 B/s wr, 2 op/s 2024-04-23T15:03:13.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:13 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/3893978812' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T15:03:13.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.634+0000 7f303b000640 1 -- 172.21.15.81:0/2795591901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30341086a0 msgr2=0x7f3034108a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:13.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.634+0000 7f303b000640 1 --2- 172.21.15.81:0/2795591901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30341086a0 0x7f3034108a70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f30280048d0 tx=0x7f3028009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:13.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.634+0000 7f303b000640 1 -- 172.21.15.81:0/2795591901 shutdown_connections 2024-04-23T15:03:13.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.634+0000 7f303b000640 1 --2- 172.21.15.81:0/2795591901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30341026d0 0x7f3034102b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:13.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.634+0000 7f303b000640 1 --2- 172.21.15.81:0/2795591901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30341086a0 0x7f3034108a70 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:13.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.634+0000 7f303b000640 1 -- 172.21.15.81:0/2795591901 >> 172.21.15.81:0/2795591901 conn(0x7f3034071e70 msgr2=0x7f3034074280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:13.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.634+0000 7f303b000640 1 -- 172.21.15.81:0/2795591901 shutdown_connections 2024-04-23T15:03:13.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.634+0000 7f303b000640 1 -- 172.21.15.81:0/2795591901 wait complete. 2024-04-23T15:03:13.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.635+0000 7f303b000640 1 Processor -- start 2024-04-23T15:03:13.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.635+0000 7f303b000640 1 -- start start 2024-04-23T15:03:13.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.635+0000 7f303b000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30341026d0 0x7f3034119150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:13.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.635+0000 7f303b000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30341086a0 0x7f3034119690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:13.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.635+0000 7f303b000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3034119c90 con 0x7f30341026d0 2024-04-23T15:03:13.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.635+0000 7f303b000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30341132e0 con 0x7f30341086a0 2024-04-23T15:03:13.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.635+0000 7f3039c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30341026d0 0x7f3034119150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:13.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.635+0000 7f3039c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30341026d0 0x7f3034119150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45284/0 (socket says 172.21.15.81:45284) 2024-04-23T15:03:13.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.635+0000 7f3039c00640 1 -- 172.21.15.81:0/4276166678 learned_addr learned my addr 172.21.15.81:0/4276166678 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:03:13.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.636+0000 7f3039200640 1 --2- 172.21.15.81:0/4276166678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30341086a0 0x7f3034119690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:13.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.636+0000 7f3039c00640 1 -- 172.21.15.81:0/4276166678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30341086a0 msgr2=0x7f3034119690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:13.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.636+0000 7f3039c00640 1 --2- 172.21.15.81:0/4276166678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30341086a0 0x7f3034119690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:13.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.636+0000 7f3039c00640 1 -- 172.21.15.81:0/4276166678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3028005040 con 0x7f30341026d0 2024-04-23T15:03:13.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.636+0000 7f3039200640 1 --2- 172.21.15.81:0/4276166678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30341086a0 0x7f3034119690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T15:03:13.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.636+0000 7f3039c00640 1 --2- 172.21.15.81:0/4276166678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30341026d0 0x7f3034119150 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3028034040 tx=0x7f3028009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:13.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.636+0000 7f3031600640 1 -- 172.21.15.81:0/4276166678 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30280092b0 con 0x7f30341026d0 2024-04-23T15:03:13.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.636+0000 7f3031600640 1 -- 172.21.15.81:0/4276166678 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f302803b400 con 0x7f30341026d0 2024-04-23T15:03:13.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.637+0000 7f303b000640 1 -- 172.21.15.81:0/4276166678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3034113560 con 0x7f30341026d0 2024-04-23T15:03:13.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.637+0000 7f3031600640 1 -- 172.21.15.81:0/4276166678 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30280435d0 con 0x7f30341026d0 2024-04-23T15:03:13.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.637+0000 7f303b000640 1 -- 172.21.15.81:0/4276166678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3034113a20 con 0x7f30341026d0 2024-04-23T15:03:13.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.638+0000 7f303b000640 1 -- 172.21.15.81:0/4276166678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3034103dc0 con 0x7f30341026d0 2024-04-23T15:03:13.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.639+0000 7f3031600640 1 -- 172.21.15.81:0/4276166678 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f302802f070 con 0x7f30341026d0 2024-04-23T15:03:13.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.640+0000 7f3031600640 1 --2- 172.21.15.81:0/4276166678 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f301c06eb70 0x7f301c071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:13.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.640+0000 7f3031600640 1 -- 172.21.15.81:0/4276166678 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f30280b0710 con 0x7f30341026d0 2024-04-23T15:03:13.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.640+0000 7f3039200640 1 --2- 172.21.15.81:0/4276166678 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f301c06eb70 0x7f301c071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:13.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.640+0000 7f3039200640 1 --2- 172.21.15.81:0/4276166678 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f301c06eb70 0x7f301c071020 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3034114a10 tx=0x7f302400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:13.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.644+0000 7f3031600640 1 -- 172.21.15.81:0/4276166678 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f30280793c0 con 0x7f30341026d0 2024-04-23T15:03:13.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.845+0000 7f303b000640 1 -- 172.21.15.81:0/4276166678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f30341147c0 con 0x7f30341026d0 2024-04-23T15:03:13.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.846+0000 7f3031600640 1 -- 172.21.15.81:0/4276166678 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v86) v1 ==== 107+0+11 (secure 0 0 0) 0x7f302807ca80 con 0x7f30341026d0 2024-04-23T15:03:13.846 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-04-23T15:03:13.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.849+0000 7f303b000640 1 -- 172.21.15.81:0/4276166678 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f301c06eb70 msgr2=0x7f301c071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:13.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.849+0000 7f303b000640 1 --2- 172.21.15.81:0/4276166678 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f301c06eb70 0x7f301c071020 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3034114a10 tx=0x7f302400b040 comp rx=0 tx=0).stop 2024-04-23T15:03:13.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.849+0000 7f303b000640 1 -- 172.21.15.81:0/4276166678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30341026d0 msgr2=0x7f3034119150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:13.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.849+0000 7f303b000640 1 --2- 172.21.15.81:0/4276166678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30341026d0 0x7f3034119150 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3028034040 tx=0x7f3028009da0 comp rx=0 tx=0).stop 2024-04-23T15:03:13.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.849+0000 7f303b000640 1 -- 172.21.15.81:0/4276166678 shutdown_connections 2024-04-23T15:03:13.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.849+0000 7f303b000640 1 --2- 172.21.15.81:0/4276166678 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f301c06eb70 0x7f301c071020 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:13.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.849+0000 7f303b000640 1 --2- 172.21.15.81:0/4276166678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30341086a0 0x7f3034119690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:13.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.849+0000 7f303b000640 1 --2- 172.21.15.81:0/4276166678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30341026d0 0x7f3034119150 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:13.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.849+0000 7f303b000640 1 -- 172.21.15.81:0/4276166678 >> 172.21.15.81:0/4276166678 conn(0x7f3034071e70 msgr2=0x7f3034073dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:13.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.849+0000 7f303b000640 1 -- 172.21.15.81:0/4276166678 shutdown_connections 2024-04-23T15:03:13.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:13.849+0000 7f303b000640 1 -- 172.21.15.81:0/4276166678 wait complete. 2024-04-23T15:03:13.867 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-23T15:03:14.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.061+0000 7f6ce4a00640 1 -- 172.21.15.81:0/2733114312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ce0071a00 msgr2=0x7f6ce0071dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:14.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.061+0000 7f6ce4a00640 1 --2- 172.21.15.81:0/2733114312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ce0071a00 0x7f6ce0071dd0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0009c50 tx=0x7f6cd0004d10 comp rx=0 tx=0).stop 2024-04-23T15:03:14.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.061+0000 7f6ce4a00640 1 -- 172.21.15.81:0/2733114312 shutdown_connections 2024-04-23T15:03:14.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.061+0000 7f6ce4a00640 1 --2- 172.21.15.81:0/2733114312 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ce0072310 0x7f6ce010cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:14.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.061+0000 7f6ce4a00640 1 --2- 172.21.15.81:0/2733114312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ce0071a00 0x7f6ce0071dd0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:14.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.061+0000 7f6ce4a00640 1 -- 172.21.15.81:0/2733114312 >> 172.21.15.81:0/2733114312 conn(0x7f6ce00f9fc0 msgr2=0x7f6ce00fc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:14.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.061+0000 7f6ce4a00640 1 -- 172.21.15.81:0/2733114312 shutdown_connections 2024-04-23T15:03:14.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.061+0000 7f6ce4a00640 1 -- 172.21.15.81:0/2733114312 wait complete. 2024-04-23T15:03:14.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.062+0000 7f6ce4a00640 1 Processor -- start 2024-04-23T15:03:14.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.062+0000 7f6ce4a00640 1 -- start start 2024-04-23T15:03:14.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.063+0000 7f6ce4a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ce0072310 0x7f6ce0119410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:14.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.063+0000 7f6ce4a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ce0119950 0x7f6ce0113630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:14.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.063+0000 7f6ce4a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce0119eb0 con 0x7f6ce0072310 2024-04-23T15:03:14.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.063+0000 7f6ce4a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce011a020 con 0x7f6ce0119950 2024-04-23T15:03:14.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.063+0000 7f6cdde00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ce0072310 0x7f6ce0119410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:14.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.063+0000 7f6cdde00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ce0072310 0x7f6ce0119410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60206/0 (socket says 172.21.15.81:60206) 2024-04-23T15:03:14.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.063+0000 7f6cdde00640 1 -- 172.21.15.81:0/3598027099 learned_addr learned my addr 172.21.15.81:0/3598027099 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-23T15:03:14.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.063+0000 7f6cdde00640 1 -- 172.21.15.81:0/3598027099 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ce0119950 msgr2=0x7f6ce0113630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:14.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.063+0000 7f6cdde00640 1 --2- 172.21.15.81:0/3598027099 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ce0119950 0x7f6ce0113630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:14.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.063+0000 7f6cdde00640 1 -- 172.21.15.81:0/3598027099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd00098b0 con 0x7f6ce0072310 2024-04-23T15:03:14.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.064+0000 7f6cdde00640 1 --2- 172.21.15.81:0/3598027099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ce0072310 0x7f6ce0119410 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6cd002c1f0 tx=0x7f6cd0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:14.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.064+0000 7f6cd6a00640 1 -- 172.21.15.81:0/3598027099 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cd003a070 con 0x7f6ce0072310 2024-04-23T15:03:14.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.064+0000 7f6cd6a00640 1 -- 172.21.15.81:0/3598027099 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6cd0009710 con 0x7f6ce0072310 2024-04-23T15:03:14.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.064+0000 7f6cd6a00640 1 -- 172.21.15.81:0/3598027099 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cd003e960 con 0x7f6ce0072310 2024-04-23T15:03:14.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.064+0000 7f6ce4a00640 1 -- 172.21.15.81:0/3598027099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce0113bd0 con 0x7f6ce0072310 2024-04-23T15:03:14.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.064+0000 7f6ce4a00640 1 -- 172.21.15.81:0/3598027099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce01140d0 con 0x7f6ce0072310 2024-04-23T15:03:14.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.065+0000 7f6ce4a00640 1 -- 172.21.15.81:0/3598027099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce0073140 con 0x7f6ce0072310 2024-04-23T15:03:14.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.066+0000 7f6cd6a00640 1 -- 172.21.15.81:0/3598027099 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f6cd0032070 con 0x7f6ce0072310 2024-04-23T15:03:14.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.067+0000 7f6cd6a00640 1 --2- 172.21.15.81:0/3598027099 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6cc406eb80 0x7f6cc4071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T15:03:14.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.068+0000 7f6cd6a00640 1 -- 172.21.15.81:0/3598027099 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f6cd00b0fe0 con 0x7f6ce0072310 2024-04-23T15:03:14.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.068+0000 7f6cd5400640 1 --2- 172.21.15.81:0/3598027099 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6cc406eb80 0x7f6cc4071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T15:03:14.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.069+0000 7f6cd5400640 1 --2- 172.21.15.81:0/3598027099 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6cc406eb80 0x7f6cc4071030 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8004c80 tx=0x7f6cc8009c50 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T15:03:14.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.073+0000 7f6cd6a00640 1 -- 172.21.15.81:0/3598027099 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f6cd0079cd0 con 0x7f6ce0072310 2024-04-23T15:03:14.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.284+0000 7f6ce4a00640 1 -- 172.21.15.81:0/3598027099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6ce004bcc0 con 0x7f6ce0072310 2024-04-23T15:03:14.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.286+0000 7f6cd6a00640 1 -- 172.21.15.81:0/3598027099 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v86) v1 ==== 81+0+2432 (secure 0 0 0) 0x7f6cd007d390 con 0x7f6ce0072310 2024-04-23T15:03:14.286 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.156:6827/1794690362 2024-04-24T14:58:57.639279+0000 2024-04-23T15:03:14.286 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6828/2563365650 2024-04-24T14:58:05.875418+0000 2024-04-23T15:03:14.286 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6800/2072638798 2024-04-24T14:38:16.825251+0000 2024-04-23T15:03:14.286 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/4290566211 2024-04-24T14:39:42.006227+0000 2024-04-23T15:03:14.286 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.156:0/857010754 2024-04-24T14:50:55.422683+0000 2024-04-23T15:03:14.286 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.156:6829/100981835 2024-04-24T14:50:55.422683+0000 2024-04-23T15:03:14.286 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/1248767795 2024-04-24T14:48:47.697101+0000 2024-04-23T15:03:14.286 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/4004069135 2024-04-24T14:37:38.176351+0000 2024-04-23T15:03:14.286 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/3883051436 2024-04-24T14:39:42.006227+0000 2024-04-23T15:03:14.286 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/4052641920 2024-04-24T14:52:26.432602+0000 2024-04-23T15:03:14.286 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/3215003917 2024-04-24T14:48:47.697101+0000 2024-04-23T15:03:14.287 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.156:6826/1794690362 2024-04-24T14:58:57.639279+0000 2024-04-23T15:03:14.287 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/2253455652 2024-04-24T14:37:38.176351+0000 2024-04-23T15:03:14.287 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/1308908574 2024-04-24T14:39:42.006227+0000 2024-04-23T15:03:14.287 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6800/1053506915 2024-04-24T14:48:47.697101+0000 2024-04-23T15:03:14.287 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6801/2072638798 2024-04-24T14:38:16.825251+0000 2024-04-23T15:03:14.287 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.156:0/4195008831 2024-04-24T14:50:55.422683+0000 2024-04-23T15:03:14.287 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6826/2500326945 2024-04-24T14:46:09.390974+0000 2024-04-23T15:03:14.287 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.156:6828/100981835 2024-04-24T14:50:55.422683+0000 2024-04-23T15:03:14.287 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6827/2500326945 2024-04-24T14:46:09.390974+0000 2024-04-23T15:03:14.287 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6801/1053506915 2024-04-24T14:48:47.697101+0000 2024-04-23T15:03:14.287 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6800/3624015234 2024-04-24T14:39:42.006227+0000 2024-04-23T15:03:14.287 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/4040210849 2024-04-24T14:52:26.432602+0000 2024-04-23T15:03:14.287 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/2921033786 2024-04-24T14:48:47.697101+0000 2024-04-23T15:03:14.288 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/3010656646 2024-04-24T14:37:38.176351+0000 2024-04-23T15:03:14.288 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.156:0/3679467655 2024-04-24T14:50:55.422683+0000 2024-04-23T15:03:14.288 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/644202147 2024-04-24T14:38:16.825251+0000 2024-04-23T15:03:14.288 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/3173386887 2024-04-24T14:38:16.825251+0000 2024-04-23T15:03:14.288 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6800/1764050360 2024-04-24T14:37:38.176351+0000 2024-04-23T15:03:14.288 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6801/1880997914 2024-04-24T14:52:26.432602+0000 2024-04-23T15:03:14.288 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/71326574 2024-04-24T14:52:26.432602+0000 2024-04-23T15:03:14.288 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6829/2563365650 2024-04-24T14:58:05.875418+0000 2024-04-23T15:03:14.288 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6801/3624015234 2024-04-24T14:39:42.006227+0000 2024-04-23T15:03:14.288 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6801/1764050360 2024-04-24T14:37:38.176351+0000 2024-04-23T15:03:14.288 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/652570605 2024-04-24T14:38:16.825251+0000 2024-04-23T15:03:14.288 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6800/1880997914 2024-04-24T14:52:26.432602+0000 2024-04-23T15:03:14.288 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/1758342948 2024-04-24T14:52:26.432602+0000 2024-04-23T15:03:14.288 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/3287016492 2024-04-24T14:52:26.432602+0000 2024-04-23T15:03:14.288 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/934339506 2024-04-24T14:48:47.697101+0000 2024-04-23T15:03:14.289 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.156:0/1820858846 2024-04-24T14:50:55.422683+0000 2024-04-23T15:03:14.289 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/2623320468 2024-04-24T14:52:26.432602+0000 2024-04-23T15:03:14.289 INFO:teuthology.orchestra.run.smithi081.stderr:listed 41 entries 2024-04-23T15:03:14.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.288+0000 7f6ce4a00640 1 -- 172.21.15.81:0/3598027099 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6cc406eb80 msgr2=0x7f6cc4071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:14.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.288+0000 7f6ce4a00640 1 --2- 172.21.15.81:0/3598027099 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6cc406eb80 0x7f6cc4071030 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8004c80 tx=0x7f6cc8009c50 comp rx=0 tx=0).stop 2024-04-23T15:03:14.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.288+0000 7f6ce4a00640 1 -- 172.21.15.81:0/3598027099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ce0072310 msgr2=0x7f6ce0119410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T15:03:14.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.288+0000 7f6ce4a00640 1 --2- 172.21.15.81:0/3598027099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ce0072310 0x7f6ce0119410 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6cd002c1f0 tx=0x7f6cd0004d10 comp rx=0 tx=0).stop 2024-04-23T15:03:14.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.289+0000 7f6ce4a00640 1 -- 172.21.15.81:0/3598027099 shutdown_connections 2024-04-23T15:03:14.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.289+0000 7f6ce4a00640 1 --2- 172.21.15.81:0/3598027099 >> [v2:172.21.15.81:6800/2400558247,v1:172.21.15.81:6801/2400558247] conn(0x7f6cc406eb80 0x7f6cc4071030 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:14.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.289+0000 7f6ce4a00640 1 --2- 172.21.15.81:0/3598027099 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ce0119950 0x7f6ce0113630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:14.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.289+0000 7f6ce4a00640 1 --2- 172.21.15.81:0/3598027099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ce0072310 0x7f6ce0119410 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T15:03:14.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.289+0000 7f6ce4a00640 1 -- 172.21.15.81:0/3598027099 >> 172.21.15.81:0/3598027099 conn(0x7f6ce00f9fc0 msgr2=0x7f6ce00fb6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T15:03:14.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.289+0000 7f6ce4a00640 1 -- 172.21.15.81:0/3598027099 shutdown_connections 2024-04-23T15:03:14.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-23T15:03:14.289+0000 7f6ce4a00640 1 -- 172.21.15.81:0/3598027099 wait complete. 2024-04-23T15:03:14.307 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-23T15:03:14.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T15:03:14.307 DEBUG:teuthology.orchestra.run.smithi156:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-04-23T15:03:14.406 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi156.front.sepia.ceph.com 2024-04-23T15:03:14.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T15:03:14.406 DEBUG:teuthology.orchestra.run.smithi156:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-23T15:03:14.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T15:03:14.480 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-04-23T15:03:14.535 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:14 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/3512678749' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-23T15:03:14.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:14 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/4276166678' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-23T15:03:14.537 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-23T15:03:14.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T15:03:14.538 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-23T15:03:14.575 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:14 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/3512678749' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-23T15:03:14.575 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:14 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/4276166678' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-23T15:03:14.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T15:03:14.624 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2024-04-23T15:03:14.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T15:03:14.783 DEBUG:teuthology.orchestra.run.smithi156:> ip netns list 2024-04-23T15:03:14.840 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-23T15:03:14.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T15:03:14.841 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-23T15:03:14.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T15:03:14.918 DEBUG:teuthology.orchestra.run.smithi156:> sudo ip link delete ceph-brx 2024-04-23T15:03:15.013 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-04-23T15:03:15.024 INFO:tasks.cephadm:Teardown begin 2024-04-23T15:03:15.024 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-23T15:03:15.118 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-23T15:03:15.192 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-04-23T15:03:15.192 DEBUG:teuthology.orchestra.run.smithi081:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-23T15:03:15.248 DEBUG:teuthology.orchestra.run.smithi156:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-23T15:03:15.305 INFO:tasks.cephadm:Stopping all daemons... 2024-04-23T15:03:15.305 INFO:tasks.cephadm.mon.smithi081:Stopping mon.smithi081... 2024-04-23T15:03:15.305 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-7a641bea-017e-11ef-bc93-c7b262605968@mon.smithi081 2024-04-23T15:03:15.375 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:15 smithi081 ceph-mon[90469]: from='client.? 172.21.15.81:0/3598027099' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-23T15:03:15.375 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:15 smithi081 ceph-mon[90469]: pgmap v363: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-23T15:03:15.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:15 smithi156 ceph-mon[77738]: from='client.? 172.21.15.81:0/3598027099' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-23T15:03:15.536 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:15 smithi156 ceph-mon[77738]: pgmap v363: 65 pgs: 65 active+clean; 197 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-23T15:03:15.826 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:15 smithi081 systemd[1]: Stopping Ceph mon.smithi081 for 7a641bea-017e-11ef-bc93-c7b262605968... 2024-04-23T15:03:16.190 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:15 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi081[90465]: 2024-04-23T15:03:15.876+0000 7fb38d800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi081 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T15:03:16.190 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:15 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi081[90465]: 2024-04-23T15:03:15.876+0000 7fb38d800700 -1 mon.smithi081@0(leader) e3 *** Got Signal Terminated *** 2024-04-23T15:03:16.190 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:15 smithi081 podman[145316]: 2024-04-23 15:03:15.958214086 +0000 UTC m=+0.243078969 container died fbf9f9a59ac21faf47d8e5ff49a2189f8c339d10a5367facae413f9eb37ebccc (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi081, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-04-23T15:03:16.762 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:16 smithi081 podman[145316]: 2024-04-23 15:03:16.493877616 +0000 UTC m=+0.778742537 container cleanup fbf9f9a59ac21faf47d8e5ff49a2189f8c339d10a5367facae413f9eb37ebccc (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi081, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-04-23T15:03:16.763 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:16 smithi081 bash[145316]: ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi081 2024-04-23T15:03:17.076 INFO:journalctl@ceph.mon.smithi081.smithi081.stdout:Apr 23 15:03:16 smithi081 podman[145341]: 2024-04-23 15:03:16.762195286 +0000 UTC m=+0.788821716 container remove fbf9f9a59ac21faf47d8e5ff49a2189f8c339d10a5367facae413f9eb37ebccc (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi081, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-04-23T15:03:17.256 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7a641bea-017e-11ef-bc93-c7b262605968@mon.smithi081.service' 2024-04-23T15:03:17.365 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T15:03:17.365 INFO:tasks.cephadm.mon.smithi081:Stopped mon.smithi081 2024-04-23T15:03:17.365 INFO:tasks.cephadm.mon.smithi156:Stopping mon.smithi156... 2024-04-23T15:03:17.366 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ceph-7a641bea-017e-11ef-bc93-c7b262605968@mon.smithi156 2024-04-23T15:03:17.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:17 smithi156 systemd[1]: Stopping Ceph mon.smithi156 for 7a641bea-017e-11ef-bc93-c7b262605968... 2024-04-23T15:03:18.164 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:17 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi156[77734]: 2024-04-23T15:03:17.836+0000 7feae3600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi156 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T15:03:18.164 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:17 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi156[77734]: 2024-04-23T15:03:17.836+0000 7feae3600700 -1 mon.smithi156@1(peon) e3 *** Got Signal Terminated *** 2024-04-23T15:03:18.164 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:17 smithi156 podman[113640]: 2024-04-23 15:03:17.888458205 +0000 UTC m=+0.181536287 container died 36409886998fdb911fa0eb143466f7e0fc276a32a810577dde9966c1130fc767 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi156, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T15:03:18.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:18 smithi156 podman[113640]: 2024-04-23 15:03:18.423021105 +0000 UTC m=+0.716099183 container cleanup 36409886998fdb911fa0eb143466f7e0fc276a32a810577dde9966c1130fc767 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi156, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True) 2024-04-23T15:03:18.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:18 smithi156 bash[113640]: ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi156 2024-04-23T15:03:18.786 INFO:journalctl@ceph.mon.smithi156.smithi156.stdout:Apr 23 15:03:18 smithi156 podman[113654]: 2024-04-23 15:03:18.658037828 +0000 UTC m=+0.755992290 container remove 36409886998fdb911fa0eb143466f7e0fc276a32a810577dde9966c1130fc767 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-mon-smithi156, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-04-23T15:03:19.153 DEBUG:teuthology.orchestra.run.smithi156:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7a641bea-017e-11ef-bc93-c7b262605968@mon.smithi156.service' 2024-04-23T15:03:19.280 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T15:03:19.280 INFO:tasks.cephadm.mon.smithi156:Stopped mon.smithi156 2024-04-23T15:03:19.281 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-04-23T15:03:19.281 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-7a641bea-017e-11ef-bc93-c7b262605968@osd.0 2024-04-23T15:03:19.826 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 15:03:19 smithi081 systemd[1]: Stopping Ceph osd.0 for 7a641bea-017e-11ef-bc93-c7b262605968... 2024-04-23T15:03:20.326 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 15:03:19 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0[99430]: 2024-04-23T15:03:19.839+0000 7fe192800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T15:03:20.326 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 15:03:19 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0[99430]: 2024-04-23T15:03:19.839+0000 7fe192800700 -1 osd.0 86 *** Got signal Terminated *** 2024-04-23T15:03:20.326 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 15:03:19 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0[99430]: 2024-04-23T15:03:19.839+0000 7fe192800700 -1 osd.0 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-23T15:03:25.522 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 15:03:25 smithi081 podman[145457]: 2024-04-23 15:03:25.208987537 +0000 UTC m=+5.515790956 container died 24bc24b37de5a0bf1ee9d1f48ca12f7e252c1859cd58426d85d5f24d200a24b6 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-04-23T15:03:25.826 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 15:03:25 smithi081 podman[145457]: 2024-04-23 15:03:25.748953942 +0000 UTC m=+6.055757351 container cleanup 24bc24b37de5a0bf1ee9d1f48ca12f7e252c1859cd58426d85d5f24d200a24b6 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-04-23T15:03:25.826 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 15:03:25 smithi081 bash[145457]: ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0 2024-04-23T15:03:26.326 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 15:03:26 smithi081 podman[145475]: 2024-04-23 15:03:26.050769643 +0000 UTC m=+0.822022928 container remove 24bc24b37de5a0bf1ee9d1f48ca12f7e252c1859cd58426d85d5f24d200a24b6 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-04-23T15:03:27.160 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 15:03:26 smithi081 podman[145565]: 2024-04-23 15:03:26.759295202 +0000 UTC m=+0.033296525 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T15:03:27.160 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 15:03:26 smithi081 podman[145565]: 2024-04-23 15:03:26.85989249 +0000 UTC m=+0.133893850 container create 3309c8ffa3396bf08ccb553a7a9f982ae82bd66ac5028f4cf40f50a83dbcd641 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-04-23T15:03:27.160 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 15:03:27 smithi081 podman[145565]: 2024-04-23 15:03:27.158780657 +0000 UTC m=+0.432782064 container init 3309c8ffa3396bf08ccb553a7a9f982ae82bd66ac5028f4cf40f50a83dbcd641 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-04-23T15:03:27.512 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 15:03:27 smithi081 podman[145565]: 2024-04-23 15:03:27.172050177 +0000 UTC m=+0.446051509 container start 3309c8ffa3396bf08ccb553a7a9f982ae82bd66ac5028f4cf40f50a83dbcd641 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416) 2024-04-23T15:03:27.513 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 15:03:27 smithi081 podman[145565]: 2024-04-23 15:03:27.262639971 +0000 UTC m=+0.536641310 container attach 3309c8ffa3396bf08ccb553a7a9f982ae82bd66ac5028f4cf40f50a83dbcd641 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0-deactivate, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD) 2024-04-23T15:03:27.826 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 15:03:27 smithi081 podman[145565]: 2024-04-23 15:03:27.627371955 +0000 UTC m=+0.901373321 container died 3309c8ffa3396bf08ccb553a7a9f982ae82bd66ac5028f4cf40f50a83dbcd641 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-04-23T15:03:28.460 INFO:journalctl@ceph.osd.0.smithi081.stdout:Apr 23 15:03:28 smithi081 podman[145593]: 2024-04-23 15:03:28.44231108 +0000 UTC m=+0.799385728 container remove 3309c8ffa3396bf08ccb553a7a9f982ae82bd66ac5028f4cf40f50a83dbcd641 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux ) 2024-04-23T15:03:28.497 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7a641bea-017e-11ef-bc93-c7b262605968@osd.0.service' 2024-04-23T15:03:28.613 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T15:03:28.613 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-04-23T15:03:28.613 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-04-23T15:03:28.613 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-7a641bea-017e-11ef-bc93-c7b262605968@osd.1 2024-04-23T15:03:29.076 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 15:03:28 smithi081 systemd[1]: Stopping Ceph osd.1 for 7a641bea-017e-11ef-bc93-c7b262605968... 2024-04-23T15:03:29.576 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 15:03:29 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1[104781]: 2024-04-23T15:03:29.250+0000 7f0118c00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T15:03:29.576 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 15:03:29 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1[104781]: 2024-04-23T15:03:29.250+0000 7f0118c00700 -1 osd.1 86 *** Got signal Terminated *** 2024-04-23T15:03:29.576 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 15:03:29 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1[104781]: 2024-04-23T15:03:29.250+0000 7f0118c00700 -1 osd.1 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-23T15:03:35.021 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 15:03:34 smithi081 podman[145672]: 2024-04-23 15:03:34.715863374 +0000 UTC m=+5.633649326 container died 18d0179b558a936a2053a174f7f2c87381e7309eab798b4f3e7e6f6aae9ed7a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-04-23T15:03:35.326 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 15:03:35 smithi081 podman[145672]: 2024-04-23 15:03:35.153784254 +0000 UTC m=+6.071570243 container cleanup 18d0179b558a936a2053a174f7f2c87381e7309eab798b4f3e7e6f6aae9ed7a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5) 2024-04-23T15:03:35.326 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 15:03:35 smithi081 bash[145672]: ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1 2024-04-23T15:03:35.826 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 15:03:35 smithi081 podman[145693]: 2024-04-23 15:03:35.4467461 +0000 UTC m=+0.720124941 container remove 18d0179b558a936a2053a174f7f2c87381e7309eab798b4f3e7e6f6aae9ed7a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0) 2024-04-23T15:03:36.576 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 15:03:36 smithi081 podman[145781]: 2024-04-23 15:03:36.215534578 +0000 UTC m=+0.034808541 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T15:03:36.576 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 15:03:36 smithi081 podman[145781]: 2024-04-23 15:03:36.32266369 +0000 UTC m=+0.141937675 container create 8b8182e1600e37b487a6f6681be2e23d54e52adbb3b327c2a35324e180a60f19 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1-deactivate, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-04-23T15:03:37.076 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 15:03:36 smithi081 podman[145781]: 2024-04-23 15:03:36.626758622 +0000 UTC m=+0.446032617 container init 8b8182e1600e37b487a6f6681be2e23d54e52adbb3b327c2a35324e180a60f19 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-04-23T15:03:37.076 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 15:03:36 smithi081 podman[145781]: 2024-04-23 15:03:36.640748894 +0000 UTC m=+0.460022906 container start 8b8182e1600e37b487a6f6681be2e23d54e52adbb3b327c2a35324e180a60f19 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416) 2024-04-23T15:03:37.076 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 15:03:36 smithi081 podman[145781]: 2024-04-23 15:03:36.741823731 +0000 UTC m=+0.561097723 container attach 8b8182e1600e37b487a6f6681be2e23d54e52adbb3b327c2a35324e180a60f19 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T15:03:37.496 INFO:journalctl@ceph.osd.1.smithi081.stdout:Apr 23 15:03:37 smithi081 podman[145781]: 2024-04-23 15:03:37.109889843 +0000 UTC m=+0.929163875 container died 8b8182e1600e37b487a6f6681be2e23d54e52adbb3b327c2a35324e180a60f19 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, ceph=True) 2024-04-23T15:03:37.879 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7a641bea-017e-11ef-bc93-c7b262605968@osd.1.service' 2024-04-23T15:03:37.995 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T15:03:37.995 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-04-23T15:03:37.995 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-04-23T15:03:37.995 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-7a641bea-017e-11ef-bc93-c7b262605968@osd.2 2024-04-23T15:03:38.576 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 15:03:38 smithi081 systemd[1]: Stopping Ceph osd.2 for 7a641bea-017e-11ef-bc93-c7b262605968... 2024-04-23T15:03:39.076 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 15:03:38 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2[110122]: 2024-04-23T15:03:38.656+0000 7f0600600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T15:03:39.076 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 15:03:38 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2[110122]: 2024-04-23T15:03:38.656+0000 7f0600600700 -1 osd.2 86 *** Got signal Terminated *** 2024-04-23T15:03:39.077 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 15:03:38 smithi081 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2[110122]: 2024-04-23T15:03:38.656+0000 7f0600600700 -1 osd.2 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-23T15:03:44.326 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 15:03:44 smithi081 podman[145886]: 2024-04-23 15:03:44.038878848 +0000 UTC m=+5.563633410 container died 421a62ef6990c9b7af50f06793137cbc88f2e5400468a6d857eb2f43a2803b6e (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True) 2024-04-23T15:03:44.700 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 15:03:44 smithi081 podman[145886]: 2024-04-23 15:03:44.465002439 +0000 UTC m=+5.989757021 container cleanup 421a62ef6990c9b7af50f06793137cbc88f2e5400468a6d857eb2f43a2803b6e (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, io.buildah.version=1.33.5) 2024-04-23T15:03:44.700 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 15:03:44 smithi081 bash[145886]: ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2 2024-04-23T15:03:45.076 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 15:03:44 smithi081 podman[145903]: 2024-04-23 15:03:44.69930824 +0000 UTC m=+0.640117841 container remove 421a62ef6990c9b7af50f06793137cbc88f2e5400468a6d857eb2f43a2803b6e (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-04-23T15:03:45.826 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 15:03:45 smithi081 podman[145991]: 2024-04-23 15:03:45.44009368 +0000 UTC m=+0.036853414 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T15:03:45.826 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 15:03:45 smithi081 podman[145991]: 2024-04-23 15:03:45.550237904 +0000 UTC m=+0.146997668 container create b41dd03b592d85cb9d22f6401ed688b018c7ecfe8329f99ffd7e5c8943cb06b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2-deactivate, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS) 2024-04-23T15:03:46.326 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 15:03:45 smithi081 podman[145991]: 2024-04-23 15:03:45.879545344 +0000 UTC m=+0.476305115 container init b41dd03b592d85cb9d22f6401ed688b018c7ecfe8329f99ffd7e5c8943cb06b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T15:03:46.326 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 15:03:45 smithi081 podman[145991]: 2024-04-23 15:03:45.890827084 +0000 UTC m=+0.487586832 container start b41dd03b592d85cb9d22f6401ed688b018c7ecfe8329f99ffd7e5c8943cb06b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416) 2024-04-23T15:03:46.326 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 15:03:45 smithi081 podman[145991]: 2024-04-23 15:03:45.978216442 +0000 UTC m=+0.574976262 container attach b41dd03b592d85cb9d22f6401ed688b018c7ecfe8329f99ffd7e5c8943cb06b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-04-23T15:03:46.623 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 15:03:46 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4[92330]: 2024-04-23T15:03:46.316+0000 7fdaaf800700 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:24.397360+0000 front 2024-04-23T15:03:24.397317+0000 (oldest deadline 2024-04-23T15:03:46.096822+0000) 2024-04-23T15:03:46.738 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 23 15:03:46 smithi081 podman[145991]: 2024-04-23 15:03:46.343226484 +0000 UTC m=+0.939986255 container died b41dd03b592d85cb9d22f6401ed688b018c7ecfe8329f99ffd7e5c8943cb06b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd) 2024-04-23T15:03:47.036 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:03:46 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:03:46.623+0000 7fa014600700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:23.718132+0000 front 2024-04-23T15:03:23.717861+0000 (oldest deadline 2024-04-23T15:03:46.017393+0000) 2024-04-23T15:03:47.083 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7a641bea-017e-11ef-bc93-c7b262605968@osd.2.service' 2024-04-23T15:03:47.195 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T15:03:47.195 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-04-23T15:03:47.196 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-04-23T15:03:47.196 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ceph-7a641bea-017e-11ef-bc93-c7b262605968@osd.3 2024-04-23T15:03:47.536 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 15:03:47 smithi156 systemd[1]: Stopping Ceph osd.3 for 7a641bea-017e-11ef-bc93-c7b262605968... 2024-04-23T15:03:47.536 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 15:03:47 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4[92330]: 2024-04-23T15:03:47.366+0000 7fdaaf800700 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:24.397360+0000 front 2024-04-23T15:03:24.397317+0000 (oldest deadline 2024-04-23T15:03:46.096822+0000) 2024-04-23T15:03:47.942 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:03:47 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:03:47.620+0000 7fa014600700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:23.718132+0000 front 2024-04-23T15:03:23.717861+0000 (oldest deadline 2024-04-23T15:03:46.017393+0000) 2024-04-23T15:03:47.942 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 15:03:47 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3[87079]: 2024-04-23T15:03:47.718+0000 7f4561e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T15:03:47.942 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 15:03:47 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3[87079]: 2024-04-23T15:03:47.718+0000 7f4561e00700 -1 osd.3 86 *** Got signal Terminated *** 2024-04-23T15:03:47.942 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 15:03:47 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3[87079]: 2024-04-23T15:03:47.718+0000 7f4561e00700 -1 osd.3 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-23T15:03:47.942 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 15:03:47 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3[87079]: 2024-04-23T15:03:47.812+0000 7f4558600700 -1 osd.3 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:23.380632+0000 front 2024-04-23T15:03:23.380390+0000 (oldest deadline 2024-04-23T15:03:47.479891+0000) 2024-04-23T15:03:48.786 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 15:03:48 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4[92330]: 2024-04-23T15:03:48.384+0000 7fdaaf800700 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:24.397360+0000 front 2024-04-23T15:03:24.397317+0000 (oldest deadline 2024-04-23T15:03:46.096822+0000) 2024-04-23T15:03:48.786 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:03:48 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:03:48.579+0000 7fa014600700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:23.718132+0000 front 2024-04-23T15:03:23.717861+0000 (oldest deadline 2024-04-23T15:03:46.017393+0000) 2024-04-23T15:03:49.287 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 15:03:48 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3[87079]: 2024-04-23T15:03:48.857+0000 7f4558600700 -1 osd.3 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:23.380632+0000 front 2024-04-23T15:03:23.380390+0000 (oldest deadline 2024-04-23T15:03:47.479891+0000) 2024-04-23T15:03:49.591 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 15:03:49 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4[92330]: 2024-04-23T15:03:49.334+0000 7fdaaf800700 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:24.397360+0000 front 2024-04-23T15:03:24.397317+0000 (oldest deadline 2024-04-23T15:03:46.096822+0000) 2024-04-23T15:03:49.870 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:03:49 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:03:49.590+0000 7fa014600700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:23.718132+0000 front 2024-04-23T15:03:23.717861+0000 (oldest deadline 2024-04-23T15:03:46.017393+0000) 2024-04-23T15:03:50.286 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 15:03:49 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3[87079]: 2024-04-23T15:03:49.869+0000 7f4558600700 -1 osd.3 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:23.380632+0000 front 2024-04-23T15:03:23.380390+0000 (oldest deadline 2024-04-23T15:03:47.479891+0000) 2024-04-23T15:03:50.786 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 15:03:50 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4[92330]: 2024-04-23T15:03:50.320+0000 7fdaaf800700 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:24.397360+0000 front 2024-04-23T15:03:24.397317+0000 (oldest deadline 2024-04-23T15:03:46.096822+0000) 2024-04-23T15:03:50.786 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:03:50 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:03:50.543+0000 7fa014600700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:23.718132+0000 front 2024-04-23T15:03:23.717861+0000 (oldest deadline 2024-04-23T15:03:46.017393+0000) 2024-04-23T15:03:51.286 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 15:03:50 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3[87079]: 2024-04-23T15:03:50.886+0000 7f4558600700 -1 osd.3 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:23.380632+0000 front 2024-04-23T15:03:23.380390+0000 (oldest deadline 2024-04-23T15:03:47.479891+0000) 2024-04-23T15:03:51.786 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 15:03:51 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4[92330]: 2024-04-23T15:03:51.285+0000 7fdaaf800700 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:24.397360+0000 front 2024-04-23T15:03:24.397317+0000 (oldest deadline 2024-04-23T15:03:46.096822+0000) 2024-04-23T15:03:51.786 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:03:51 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:03:51.504+0000 7fa014600700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:23.718132+0000 front 2024-04-23T15:03:23.717861+0000 (oldest deadline 2024-04-23T15:03:46.017393+0000) 2024-04-23T15:03:52.280 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 15:03:51 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3[87079]: 2024-04-23T15:03:51.853+0000 7f4558600700 -1 osd.3 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:23.380632+0000 front 2024-04-23T15:03:23.380390+0000 (oldest deadline 2024-04-23T15:03:47.479891+0000) 2024-04-23T15:03:52.536 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 15:03:52 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4[92330]: 2024-04-23T15:03:52.279+0000 7fdaaf800700 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:24.397360+0000 front 2024-04-23T15:03:24.397317+0000 (oldest deadline 2024-04-23T15:03:46.096822+0000) 2024-04-23T15:03:53.036 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:03:52 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:03:52.542+0000 7fa014600700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:23.718132+0000 front 2024-04-23T15:03:23.717861+0000 (oldest deadline 2024-04-23T15:03:46.017393+0000) 2024-04-23T15:03:53.536 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 15:03:53 smithi156 podman[113763]: 2024-04-23 15:03:53.212198065 +0000 UTC m=+5.657486727 container died 9af3ca1ff69b02c8cb529438bdd86766712138dc040189b4e5c566520240de80 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T15:03:53.536 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 15:03:53 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4[92330]: 2024-04-23T15:03:53.278+0000 7fdaaf800700 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:24.397360+0000 front 2024-04-23T15:03:24.397317+0000 (oldest deadline 2024-04-23T15:03:46.096822+0000) 2024-04-23T15:03:53.819 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 15:03:53 smithi156 podman[113763]: 2024-04-23 15:03:53.791939599 +0000 UTC m=+6.237228211 container cleanup 9af3ca1ff69b02c8cb529438bdd86766712138dc040189b4e5c566520240de80 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T15:03:53.819 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 15:03:53 smithi156 bash[113763]: ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3 2024-04-23T15:03:53.819 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:03:53 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:03:53.563+0000 7fa014600700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:23.718132+0000 front 2024-04-23T15:03:23.717861+0000 (oldest deadline 2024-04-23T15:03:46.017393+0000) 2024-04-23T15:03:54.241 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 15:03:54 smithi156 podman[113794]: 2024-04-23 15:03:54.018988804 +0000 UTC m=+0.793634311 container remove 9af3ca1ff69b02c8cb529438bdd86766712138dc040189b4e5c566520240de80 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True) 2024-04-23T15:03:54.533 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 15:03:54 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4[92330]: 2024-04-23T15:03:54.240+0000 7fdaaf800700 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:24.397360+0000 front 2024-04-23T15:03:24.397317+0000 (oldest deadline 2024-04-23T15:03:46.096822+0000) 2024-04-23T15:03:54.786 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:03:54 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:03:54.533+0000 7fa014600700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:23.718132+0000 front 2024-04-23T15:03:23.717861+0000 (oldest deadline 2024-04-23T15:03:46.017393+0000) 2024-04-23T15:03:55.114 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 15:03:54 smithi156 podman[113882]: 2024-04-23 15:03:54.740151227 +0000 UTC m=+0.035179355 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T15:03:55.115 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 15:03:54 smithi156 podman[113882]: 2024-04-23 15:03:54.844641666 +0000 UTC m=+0.139669796 container create 74b86e892df7cd41fde7445fa2bcb61e683d3edf0e4f4c1dfa3e0c1310127261 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3-deactivate, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-04-23T15:03:55.115 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 15:03:55 smithi156 podman[113882]: 2024-04-23 15:03:55.113600747 +0000 UTC m=+0.408628931 container init 74b86e892df7cd41fde7445fa2bcb61e683d3edf0e4f4c1dfa3e0c1310127261 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3-deactivate, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-04-23T15:03:55.536 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 15:03:55 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4[92330]: 2024-04-23T15:03:55.217+0000 7fdaaf800700 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:24.397360+0000 front 2024-04-23T15:03:24.397317+0000 (oldest deadline 2024-04-23T15:03:46.096822+0000) 2024-04-23T15:03:55.536 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 15:03:55 smithi156 podman[113882]: 2024-04-23 15:03:55.126518259 +0000 UTC m=+0.421546386 container start 74b86e892df7cd41fde7445fa2bcb61e683d3edf0e4f4c1dfa3e0c1310127261 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_BRANCH=HEAD) 2024-04-23T15:03:55.536 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 15:03:55 smithi156 podman[113882]: 2024-04-23 15:03:55.188708725 +0000 UTC m=+0.483736909 container attach 74b86e892df7cd41fde7445fa2bcb61e683d3edf0e4f4c1dfa3e0c1310127261 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-04-23T15:03:55.929 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:03:55 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:03:55.541+0000 7fa014600700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:23.718132+0000 front 2024-04-23T15:03:23.717861+0000 (oldest deadline 2024-04-23T15:03:46.017393+0000) 2024-04-23T15:03:55.929 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 15:03:55 smithi156 podman[113882]: 2024-04-23 15:03:55.581043052 +0000 UTC m=+0.876071171 container died 74b86e892df7cd41fde7445fa2bcb61e683d3edf0e4f4c1dfa3e0c1310127261 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, io.buildah.version=1.33.5) 2024-04-23T15:03:56.466 DEBUG:teuthology.orchestra.run.smithi156:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7a641bea-017e-11ef-bc93-c7b262605968@osd.3.service' 2024-04-23T15:03:56.528 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 15:03:56 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4[92330]: 2024-04-23T15:03:56.245+0000 7fdaaf800700 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:24.397360+0000 front 2024-04-23T15:03:24.397317+0000 (oldest deadline 2024-04-23T15:03:46.096822+0000) 2024-04-23T15:03:56.529 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 15:03:56 smithi156 podman[113908]: 2024-04-23 15:03:56.425997197 +0000 UTC m=+0.827787052 container remove 74b86e892df7cd41fde7445fa2bcb61e683d3edf0e4f4c1dfa3e0c1310127261 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-3-deactivate, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd) 2024-04-23T15:03:56.529 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 15:03:56 smithi156 systemd[1]: ceph-7a641bea-017e-11ef-bc93-c7b262605968@osd.3.service: Deactivated successfully. 2024-04-23T15:03:56.529 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 15:03:56 smithi156 systemd[1]: Stopped Ceph osd.3 for 7a641bea-017e-11ef-bc93-c7b262605968. 2024-04-23T15:03:56.529 INFO:journalctl@ceph.osd.3.smithi156.stdout:Apr 23 15:03:56 smithi156 systemd[1]: ceph-7a641bea-017e-11ef-bc93-c7b262605968@osd.3.service: Consumed 19.508s CPU time. 2024-04-23T15:03:56.577 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T15:03:56.577 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-04-23T15:03:56.577 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-04-23T15:03:56.577 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ceph-7a641bea-017e-11ef-bc93-c7b262605968@osd.4 2024-04-23T15:03:56.786 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 15:03:56 smithi156 systemd[1]: Stopping Ceph osd.4 for 7a641bea-017e-11ef-bc93-c7b262605968... 2024-04-23T15:03:56.786 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:03:56 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:03:56.528+0000 7fa014600700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:23.718132+0000 front 2024-04-23T15:03:23.717861+0000 (oldest deadline 2024-04-23T15:03:46.017393+0000) 2024-04-23T15:03:57.536 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 15:03:57 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4[92330]: 2024-04-23T15:03:57.185+0000 7fdab9000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T15:03:57.536 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 15:03:57 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4[92330]: 2024-04-23T15:03:57.185+0000 7fdab9000700 -1 osd.4 86 *** Got signal Terminated *** 2024-04-23T15:03:57.536 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 15:03:57 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4[92330]: 2024-04-23T15:03:57.185+0000 7fdab9000700 -1 osd.4 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-23T15:03:57.536 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 15:03:57 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4[92330]: 2024-04-23T15:03:57.196+0000 7fdaaf800700 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:24.397360+0000 front 2024-04-23T15:03:24.397317+0000 (oldest deadline 2024-04-23T15:03:46.096822+0000) 2024-04-23T15:03:58.036 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:03:57 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:03:57.573+0000 7fa014600700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:23.718132+0000 front 2024-04-23T15:03:23.717861+0000 (oldest deadline 2024-04-23T15:03:46.017393+0000) 2024-04-23T15:03:58.536 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 15:03:58 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4[92330]: 2024-04-23T15:03:58.201+0000 7fdaaf800700 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:24.397360+0000 front 2024-04-23T15:03:24.397317+0000 (oldest deadline 2024-04-23T15:03:46.096822+0000) 2024-04-23T15:03:58.536 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 15:03:58 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4[92330]: 2024-04-23T15:03:58.201+0000 7fdaaf800700 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.1 since back 2024-04-23T15:03:31.899205+0000 front 2024-04-23T15:03:31.899080+0000 (oldest deadline 2024-04-23T15:03:57.198666+0000) 2024-04-23T15:03:58.946 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:03:58 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:03:58.592+0000 7fa014600700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:23.718132+0000 front 2024-04-23T15:03:23.717861+0000 (oldest deadline 2024-04-23T15:03:46.017393+0000) 2024-04-23T15:03:59.536 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 15:03:59 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4[92330]: 2024-04-23T15:03:59.218+0000 7fdaaf800700 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:24.397360+0000 front 2024-04-23T15:03:24.397317+0000 (oldest deadline 2024-04-23T15:03:46.096822+0000) 2024-04-23T15:03:59.536 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 15:03:59 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4[92330]: 2024-04-23T15:03:59.218+0000 7fdaaf800700 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.1 since back 2024-04-23T15:03:31.899205+0000 front 2024-04-23T15:03:31.899080+0000 (oldest deadline 2024-04-23T15:03:57.198666+0000) 2024-04-23T15:04:00.036 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:03:59 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:03:59.602+0000 7fa014600700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:23.718132+0000 front 2024-04-23T15:03:23.717861+0000 (oldest deadline 2024-04-23T15:03:46.017393+0000) 2024-04-23T15:04:00.036 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:03:59 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:03:59.602+0000 7fa014600700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.1 since back 2024-04-23T15:03:33.620018+0000 front 2024-04-23T15:03:33.620050+0000 (oldest deadline 2024-04-23T15:03:59.519321+0000) 2024-04-23T15:04:00.535 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 15:04:00 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4[92330]: 2024-04-23T15:04:00.174+0000 7fdaaf800700 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:24.397360+0000 front 2024-04-23T15:03:24.397317+0000 (oldest deadline 2024-04-23T15:03:46.096822+0000) 2024-04-23T15:04:00.536 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 15:04:00 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4[92330]: 2024-04-23T15:04:00.174+0000 7fdaaf800700 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.1 since back 2024-04-23T15:03:31.899205+0000 front 2024-04-23T15:03:31.899080+0000 (oldest deadline 2024-04-23T15:03:57.198666+0000) 2024-04-23T15:04:01.036 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:04:00 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:04:00.590+0000 7fa014600700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:23.718132+0000 front 2024-04-23T15:03:23.717861+0000 (oldest deadline 2024-04-23T15:03:46.017393+0000) 2024-04-23T15:04:01.036 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:04:00 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:04:00.590+0000 7fa014600700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.1 since back 2024-04-23T15:03:33.620018+0000 front 2024-04-23T15:03:33.620050+0000 (oldest deadline 2024-04-23T15:03:59.519321+0000) 2024-04-23T15:04:01.536 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 15:04:01 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4[92330]: 2024-04-23T15:04:01.201+0000 7fdaaf800700 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:24.397360+0000 front 2024-04-23T15:03:24.397317+0000 (oldest deadline 2024-04-23T15:03:46.096822+0000) 2024-04-23T15:04:01.536 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 15:04:01 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4[92330]: 2024-04-23T15:04:01.201+0000 7fdaaf800700 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.1 since back 2024-04-23T15:03:31.899205+0000 front 2024-04-23T15:03:31.899080+0000 (oldest deadline 2024-04-23T15:03:57.198666+0000) 2024-04-23T15:04:02.036 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:04:01 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:04:01.580+0000 7fa014600700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:23.718132+0000 front 2024-04-23T15:03:23.717861+0000 (oldest deadline 2024-04-23T15:03:46.017393+0000) 2024-04-23T15:04:02.036 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:04:01 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:04:01.580+0000 7fa014600700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.1 since back 2024-04-23T15:03:33.620018+0000 front 2024-04-23T15:03:33.620050+0000 (oldest deadline 2024-04-23T15:03:59.519321+0000) 2024-04-23T15:04:03.036 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 15:04:02 smithi156 podman[113986]: 2024-04-23 15:04:02.751866009 +0000 UTC m=+5.699617353 container died e0a1e784348c5c147b3a699d947e1ebd9c56fd90b4ccf565596bf73f1c2c7428 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-04-23T15:04:03.036 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:04:02 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:04:02.554+0000 7fa014600700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:23.718132+0000 front 2024-04-23T15:03:23.717861+0000 (oldest deadline 2024-04-23T15:03:46.017393+0000) 2024-04-23T15:04:03.036 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:04:02 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:04:02.554+0000 7fa014600700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.1 since back 2024-04-23T15:03:33.620018+0000 front 2024-04-23T15:03:33.620050+0000 (oldest deadline 2024-04-23T15:03:59.519321+0000) 2024-04-23T15:04:03.481 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 15:04:03 smithi156 podman[113986]: 2024-04-23 15:04:03.287305221 +0000 UTC m=+6.235056617 container cleanup e0a1e784348c5c147b3a699d947e1ebd9c56fd90b4ccf565596bf73f1c2c7428 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-23T15:04:03.481 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 15:04:03 smithi156 bash[113986]: ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4 2024-04-23T15:04:03.785 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 15:04:03 smithi156 podman[114007]: 2024-04-23 15:04:03.480294751 +0000 UTC m=+0.717535047 container remove e0a1e784348c5c147b3a699d947e1ebd9c56fd90b4ccf565596bf73f1c2c7428 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0) 2024-04-23T15:04:03.786 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:04:03 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:04:03.562+0000 7fa014600700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:23.718132+0000 front 2024-04-23T15:03:23.717861+0000 (oldest deadline 2024-04-23T15:03:46.017393+0000) 2024-04-23T15:04:03.786 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:04:03 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:04:03.562+0000 7fa014600700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.1 since back 2024-04-23T15:03:33.620018+0000 front 2024-04-23T15:03:33.620050+0000 (oldest deadline 2024-04-23T15:03:59.519321+0000) 2024-04-23T15:04:04.662 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:04:04 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:04:04.559+0000 7fa014600700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:23.718132+0000 front 2024-04-23T15:03:23.717861+0000 (oldest deadline 2024-04-23T15:03:46.017393+0000) 2024-04-23T15:04:04.662 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:04:04 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:04:04.559+0000 7fa014600700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.1 since back 2024-04-23T15:03:33.620018+0000 front 2024-04-23T15:03:33.620050+0000 (oldest deadline 2024-04-23T15:03:59.519321+0000) 2024-04-23T15:04:04.662 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 15:04:04 smithi156 podman[114093]: 2024-04-23 15:04:04.253819036 +0000 UTC m=+0.036167991 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T15:04:04.662 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 15:04:04 smithi156 podman[114093]: 2024-04-23 15:04:04.355934794 +0000 UTC m=+0.138283750 container create c60b696131a5417573ced2bbaf9ae3a9c89c704f9842c676b5624b501142f15b (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.vendor=CentOS, ceph=True) 2024-04-23T15:04:04.662 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 15:04:04 smithi156 podman[114093]: 2024-04-23 15:04:04.659695584 +0000 UTC m=+0.442044577 container init c60b696131a5417573ced2bbaf9ae3a9c89c704f9842c676b5624b501142f15b (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2) 2024-04-23T15:04:05.036 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 15:04:04 smithi156 podman[114093]: 2024-04-23 15:04:04.6722313 +0000 UTC m=+0.454580269 container start c60b696131a5417573ced2bbaf9ae3a9c89c704f9842c676b5624b501142f15b (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4-deactivate, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-04-23T15:04:05.036 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 15:04:04 smithi156 podman[114093]: 2024-04-23 15:04:04.77516006 +0000 UTC m=+0.557509096 container attach c60b696131a5417573ced2bbaf9ae3a9c89c704f9842c676b5624b501142f15b (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_CLEAN=True, org.label-schema.build-date=20240416) 2024-04-23T15:04:05.515 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 23 15:04:05 smithi156 podman[114093]: 2024-04-23 15:04:05.117394044 +0000 UTC m=+0.899743028 container died c60b696131a5417573ced2bbaf9ae3a9c89c704f9842c676b5624b501142f15b (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-23T15:04:05.786 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:04:05 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:04:05.607+0000 7fa014600700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:23.718132+0000 front 2024-04-23T15:03:23.717861+0000 (oldest deadline 2024-04-23T15:03:46.017393+0000) 2024-04-23T15:04:05.786 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:04:05 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:04:05.607+0000 7fa014600700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.1 since back 2024-04-23T15:03:33.620018+0000 front 2024-04-23T15:03:33.620050+0000 (oldest deadline 2024-04-23T15:03:59.519321+0000) 2024-04-23T15:04:05.898 DEBUG:teuthology.orchestra.run.smithi156:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7a641bea-017e-11ef-bc93-c7b262605968@osd.4.service' 2024-04-23T15:04:06.003 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T15:04:06.003 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-04-23T15:04:06.003 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-04-23T15:04:06.004 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ceph-7a641bea-017e-11ef-bc93-c7b262605968@osd.5 2024-04-23T15:04:06.536 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:04:06 smithi156 systemd[1]: Stopping Ceph osd.5 for 7a641bea-017e-11ef-bc93-c7b262605968... 2024-04-23T15:04:07.036 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:04:06 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:04:06.630+0000 7fa01de00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T15:04:07.036 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:04:06 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:04:06.630+0000 7fa01de00700 -1 osd.5 86 *** Got signal Terminated *** 2024-04-23T15:04:07.036 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:04:06 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:04:06.630+0000 7fa01de00700 -1 osd.5 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-23T15:04:07.036 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:04:06 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:04:06.630+0000 7fa014600700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:23.718132+0000 front 2024-04-23T15:03:23.717861+0000 (oldest deadline 2024-04-23T15:03:46.017393+0000) 2024-04-23T15:04:07.036 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:04:06 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:04:06.630+0000 7fa014600700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.1 since back 2024-04-23T15:03:33.620018+0000 front 2024-04-23T15:03:33.620050+0000 (oldest deadline 2024-04-23T15:03:59.519321+0000) 2024-04-23T15:04:08.036 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:04:07 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:04:07.666+0000 7fa014600700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:23.718132+0000 front 2024-04-23T15:03:23.717861+0000 (oldest deadline 2024-04-23T15:03:46.017393+0000) 2024-04-23T15:04:08.036 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:04:07 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:04:07.666+0000 7fa014600700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.1 since back 2024-04-23T15:03:33.620018+0000 front 2024-04-23T15:03:33.620050+0000 (oldest deadline 2024-04-23T15:03:59.519321+0000) 2024-04-23T15:04:09.036 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:04:08 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:04:08.674+0000 7fa014600700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:23.718132+0000 front 2024-04-23T15:03:23.717861+0000 (oldest deadline 2024-04-23T15:03:46.017393+0000) 2024-04-23T15:04:09.036 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:04:08 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:04:08.674+0000 7fa014600700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.1 since back 2024-04-23T15:03:33.620018+0000 front 2024-04-23T15:03:33.620050+0000 (oldest deadline 2024-04-23T15:03:59.519321+0000) 2024-04-23T15:04:09.036 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:04:08 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:04:08.674+0000 7fa014600700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6822 osd.2 since back 2024-04-23T15:03:43.020618+0000 front 2024-04-23T15:03:43.020729+0000 (oldest deadline 2024-04-23T15:04:08.320308+0000) 2024-04-23T15:04:10.036 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:04:09 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:04:09.721+0000 7fa014600700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:23.718132+0000 front 2024-04-23T15:03:23.717861+0000 (oldest deadline 2024-04-23T15:03:46.017393+0000) 2024-04-23T15:04:10.036 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:04:09 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:04:09.721+0000 7fa014600700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.1 since back 2024-04-23T15:03:33.620018+0000 front 2024-04-23T15:03:33.620050+0000 (oldest deadline 2024-04-23T15:03:59.519321+0000) 2024-04-23T15:04:10.036 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:04:09 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:04:09.721+0000 7fa014600700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6822 osd.2 since back 2024-04-23T15:03:43.020618+0000 front 2024-04-23T15:03:43.020729+0000 (oldest deadline 2024-04-23T15:04:08.320308+0000) 2024-04-23T15:04:11.036 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:04:10 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:04:10.728+0000 7fa014600700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-04-23T15:03:23.718132+0000 front 2024-04-23T15:03:23.717861+0000 (oldest deadline 2024-04-23T15:03:46.017393+0000) 2024-04-23T15:04:11.036 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:04:10 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:04:10.728+0000 7fa014600700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.1 since back 2024-04-23T15:03:33.620018+0000 front 2024-04-23T15:03:33.620050+0000 (oldest deadline 2024-04-23T15:03:59.519321+0000) 2024-04-23T15:04:11.036 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:04:10 smithi156 ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5[97190]: 2024-04-23T15:04:10.728+0000 7fa014600700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6822 osd.2 since back 2024-04-23T15:03:43.020618+0000 front 2024-04-23T15:03:43.020729+0000 (oldest deadline 2024-04-23T15:04:08.320308+0000) 2024-04-23T15:04:12.403 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:04:12 smithi156 podman[114199]: 2024-04-23 15:04:12.105938741 +0000 UTC m=+5.635691258 container died 16b6ba5d9e3ebf14c2444771ef430e77a696375eb742c3a28b2f19f8ca3d40bf (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-04-23T15:04:12.786 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:04:12 smithi156 podman[114199]: 2024-04-23 15:04:12.614378358 +0000 UTC m=+6.144130891 container cleanup 16b6ba5d9e3ebf14c2444771ef430e77a696375eb742c3a28b2f19f8ca3d40bf (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, ceph=True) 2024-04-23T15:04:12.786 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:04:12 smithi156 bash[114199]: ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5 2024-04-23T15:04:13.286 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:04:12 smithi156 podman[114218]: 2024-04-23 15:04:12.932552157 +0000 UTC m=+0.809102583 container remove 16b6ba5d9e3ebf14c2444771ef430e77a696375eb742c3a28b2f19f8ca3d40bf (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0) 2024-04-23T15:04:14.080 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:04:13 smithi156 podman[114306]: 2024-04-23 15:04:13.732268527 +0000 UTC m=+0.037255624 image pull 76e77f280c74312ca1add9b6019a4a921a516f91795d85bae00a0c8ca9b1c62e quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd 2024-04-23T15:04:14.080 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:04:13 smithi156 podman[114306]: 2024-04-23 15:04:13.917172081 +0000 UTC m=+0.222159212 container create d3fb1483f90e15611adb39351d9096661febf306e4ab1509a3c344a0d3536a40 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd) 2024-04-23T15:04:14.536 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:04:14 smithi156 podman[114306]: 2024-04-23 15:04:14.17871768 +0000 UTC m=+0.483704837 container init d3fb1483f90e15611adb39351d9096661febf306e4ab1509a3c344a0d3536a40 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-04-23T15:04:14.536 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:04:14 smithi156 podman[114306]: 2024-04-23 15:04:14.190976192 +0000 UTC m=+0.495963349 container start d3fb1483f90e15611adb39351d9096661febf306e4ab1509a3c344a0d3536a40 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T15:04:14.536 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:04:14 smithi156 podman[114306]: 2024-04-23 15:04:14.260867444 +0000 UTC m=+0.565854545 container attach d3fb1483f90e15611adb39351d9096661febf306e4ab1509a3c344a0d3536a40 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-04-23T15:04:14.995 INFO:journalctl@ceph.osd.5.smithi156.stdout:Apr 23 15:04:14 smithi156 podman[114306]: 2024-04-23 15:04:14.642662638 +0000 UTC m=+0.947649829 container died d3fb1483f90e15611adb39351d9096661febf306e4ab1509a3c344a0d3536a40 (image=quay.ceph.io/ceph-ci/ceph@sha256:af2350ee15fec7863cae8207e1de3b5c3baf4b211768c50629a9f2fdb9a2f3cd, name=ceph-7a641bea-017e-11ef-bc93-c7b262605968-osd-5-deactivate, RELEASE=wip-rishabh-testing-20240416.193735-3-d44fddd, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-04-23T15:04:15.439 DEBUG:teuthology.orchestra.run.smithi156:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7a641bea-017e-11ef-bc93-c7b262605968@osd.5.service' 2024-04-23T15:04:15.551 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T15:04:15.552 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-04-23T15:04:15.552 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7a641bea-017e-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-23T15:04:46.113 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7a641bea-017e-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-23T15:05:02.413 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-23T15:05:02.507 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-23T15:05:02.597 INFO:tasks.cephadm:Archiving crash dumps... 2024-04-23T15:05:02.599 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-04-23_14:04:26-fs-wip-rishabh-testing-20240416.193735-3-testing-default-smithi/7669570/remote/smithi081/crash 2024-04-23T15:05:02.599 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/crash -- . 2024-04-23T15:05:02.685 INFO:teuthology.orchestra.run.smithi081.stderr:tar: /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-23T15:05:02.685 INFO:teuthology.orchestra.run.smithi081.stderr:tar: Error is not recoverable: exiting now 2024-04-23T15:05:02.689 DEBUG:teuthology.misc:Transferring archived files from smithi156:/var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-04-23_14:04:26-fs-wip-rishabh-testing-20240416.193735-3-testing-default-smithi/7669570/remote/smithi156/crash 2024-04-23T15:05:02.690 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar c -f - -C /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/crash -- . 2024-04-23T15:05:02.775 INFO:teuthology.orchestra.run.smithi156.stderr:tar: /var/lib/ceph/7a641bea-017e-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-23T15:05:02.775 INFO:teuthology.orchestra.run.smithi156.stderr:tar: Error is not recoverable: exiting now 2024-04-23T15:05:02.778 INFO:tasks.cephadm:Checking cluster log for badness... 2024-04-23T15:05:02.779 DEBUG:teuthology.orchestra.run.smithi081:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-04-23T15:05:02.884 INFO:tasks.cephadm:Compressing logs... 2024-04-23T15:05:02.884 DEBUG:teuthology.orchestra.run.smithi081:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-23T15:05:02.888 DEBUG:teuthology.orchestra.run.smithi156:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-23T15:05:02.948 INFO:teuthology.orchestra.run.smithi081.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose: No such file or directory -- 2024-04-23T15:05:02.948 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/cephadm.log 2024-04-23T15:05:02.948 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi081.wydgcg.log 2024-04-23T15:05:02.950 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph.log 2024-04-23T15:05:02.951 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi081.wydgcg.log: gzip -5 --verbose -- /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-osd.2.log 2024-04-23T15:05:02.952 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-mgr.smithi081.ldghvq.log 2024-04-23T15:05:02.953 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-23T15:05:02.955 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-mgr.smithi081.ldghvq.log: gzip -5 --verbose -- /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-osd.1.log 2024-04-23T15:05:02.956 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph.audit.log: 87.7% -- replaced with /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-23T15:05:02.957 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-osd.0.log 2024-04-23T15:05:02.960 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-osd.1.log: /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-mon.smithi081.log 2024-04-23T15:05:02.962 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-mon.smithi081.log: 91.0% -- replaced with /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-23T15:05:02.963 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-23T15:05:02.964 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-23T15:05:02.967 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph.cephadm.log: 85.2% -- replaced with /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-23T15:05:02.971 INFO:teuthology.orchestra.run.smithi156.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-04-23T15:05:02.971 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-23T15:05:02.972 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph.log 2024-04-23T15:05:02.973 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi156.rhbtxt.log 2024-04-23T15:05:02.974 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi081.vcoywg.log 2024-04-23T15:05:02.975 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-23T15:05:02.976 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi156.rhbtxt.log: gzip -5 --verbose -- /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-osd.5.log 2024-04-23T15:05:02.976 INFO:teuthology.orchestra.run.smithi156.stderr: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-23T15:05:02.977 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-osd.3.log 2024-04-23T15:05:02.977 INFO:teuthology.orchestra.run.smithi156.stderr: 87.7% -- replaced with /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-23T15:05:02.979 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-mgr.smithi156.ounwyj.log 2024-04-23T15:05:02.980 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-osd.4.log 2024-04-23T15:05:02.982 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-mgr.smithi156.ounwyj.log: gzip -5 --verbose -- /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-23T15:05:02.982 INFO:teuthology.orchestra.run.smithi156.stderr: 91.2% -- replaced with /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-23T15:05:02.983 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi156.vynkxn.log 2024-04-23T15:05:02.984 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi081.vcoywg.log: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-23T15:05:02.985 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-23T15:05:02.985 INFO:teuthology.orchestra.run.smithi156.stderr: 92.3% -- replaced with /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi156.rhbtxt.log.gz 2024-04-23T15:05:02.985 INFO:teuthology.orchestra.run.smithi156.stderr: 85.0% -- replaced with /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-23T15:05:02.986 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi156.vynkxn.log: gzip -5 --verbose -- /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-mon.smithi156.log 2024-04-23T15:05:02.998 INFO:teuthology.orchestra.run.smithi081.stderr: 90.9% -- replaced with /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-23T15:05:03.004 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-volume.log: /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-mon.smithi156.log: 91.0% -- replaced with /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-23T15:05:03.067 INFO:teuthology.orchestra.run.smithi156.stderr: 89.6% -- replaced with /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-mgr.smithi156.ounwyj.log.gz 2024-04-23T15:05:03.387 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-mgr.smithi081.ldghvq.log.gz 2024-04-23T15:05:03.482 INFO:teuthology.orchestra.run.smithi156.stderr: 92.5% -- replaced with /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-mon.smithi156.log.gz 2024-04-23T15:05:04.246 INFO:teuthology.orchestra.run.smithi081.stderr: 90.4% -- replaced with /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-mon.smithi081.log.gz 2024-04-23T15:05:07.723 INFO:teuthology.orchestra.run.smithi156.stderr: 93.4% -- replaced with /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-osd.4.log.gz 2024-04-23T15:05:08.605 INFO:teuthology.orchestra.run.smithi156.stderr: 94.8% -- replaced with /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi156.vynkxn.log.gz 2024-04-23T15:05:09.028 INFO:teuthology.orchestra.run.smithi156.stderr: 93.5% -- replaced with /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-osd.5.log.gz 2024-04-23T15:05:09.138 INFO:teuthology.orchestra.run.smithi081.stderr: 93.4% -- replaced with /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-osd.0.log.gz 2024-04-23T15:05:09.495 INFO:teuthology.orchestra.run.smithi081.stderr: 93.5% -- replaced with /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-osd.1.log.gz 2024-04-23T15:05:09.775 INFO:teuthology.orchestra.run.smithi081.stderr: 93.5% -- replaced with /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-osd.2.log.gz 2024-04-23T15:05:10.176 INFO:teuthology.orchestra.run.smithi156.stderr: 93.4% -- replaced with /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-osd.3.log.gz 2024-04-23T15:05:10.179 INFO:teuthology.orchestra.run.smithi156.stderr: 2024-04-23T15:05:10.180 INFO:teuthology.orchestra.run.smithi156.stderr:real 0m7.237s 2024-04-23T15:05:10.180 INFO:teuthology.orchestra.run.smithi156.stderr:user 0m22.401s 2024-04-23T15:05:10.180 INFO:teuthology.orchestra.run.smithi156.stderr:sys 0m1.914s 2024-04-23T15:05:19.111 INFO:teuthology.orchestra.run.smithi081.stderr: 94.9% -- replaced with /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi081.wydgcg.log.gz 2024-04-23T15:06:38.408 INFO:teuthology.orchestra.run.smithi081.stderr: 92.6% -- replaced with /var/log/ceph/7a641bea-017e-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi081.vcoywg.log.gz 2024-04-23T15:06:38.412 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-04-23T15:06:38.412 INFO:teuthology.orchestra.run.smithi081.stderr:real 1m35.491s 2024-04-23T15:06:38.412 INFO:teuthology.orchestra.run.smithi081.stderr:user 2m2.994s 2024-04-23T15:06:38.412 INFO:teuthology.orchestra.run.smithi081.stderr:sys 0m9.201s 2024-04-23T15:06:38.413 INFO:tasks.cephadm:Archiving logs... 2024-04-23T15:06:38.414 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-23_14:04:26-fs-wip-rishabh-testing-20240416.193735-3-testing-default-smithi/7669570/remote/smithi081/log 2024-04-23T15:06:38.415 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-23T15:06:57.691 DEBUG:teuthology.misc:Transferring archived files from smithi156:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-23_14:04:26-fs-wip-rishabh-testing-20240416.193735-3-testing-default-smithi/7669570/remote/smithi156/log 2024-04-23T15:06:57.692 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-23T15:07:00.917 INFO:tasks.cephadm:Removing cluster... 2024-04-23T15:07:00.917 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7a641bea-017e-11ef-bc93-c7b262605968 --force 2024-04-23T15:07:02.368 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7a641bea-017e-11ef-bc93-c7b262605968 --force 2024-04-23T15:07:03.432 INFO:tasks.cephadm:Removing cephadm ... 2024-04-23T15:07:03.433 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-23T15:07:03.490 DEBUG:teuthology.orchestra.run.smithi156:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-23T15:07:03.546 INFO:tasks.cephadm:Teardown complete 2024-04-23T15:07:03.547 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-23T15:07:03.558 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-23T15:07:03.559 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-23T15:07:03.566 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-23T15:07:03.702 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-23T15:07:03.713 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-23T15:07:03.713 DEBUG:teuthology.orchestra.run.smithi081:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T15:07:03.721 DEBUG:teuthology.orchestra.run.smithi156:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T15:07:03.768 INFO:teuthology.orchestra.run.smithi081.stderr:bash: line 1: ntpq: command not found 2024-04-23T15:07:03.774 INFO:teuthology.orchestra.run.smithi156.stderr:bash: line 1: ntpq: command not found 2024-04-23T15:07:03.778 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-23T15:07:03.778 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2024-04-23T15:07:03.779 INFO:teuthology.orchestra.run.smithi081.stdout:^- hv01.front.sepia.ceph.com 2 7 377 41 +869us[ +869us] +/- 592ms 2024-04-23T15:07:03.779 INFO:teuthology.orchestra.run.smithi081.stdout:^* hv02.front.sepia.ceph.com 3 6 377 44 -572us[ -569us] +/- 57ms 2024-04-23T15:07:03.779 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 39 +741us[ +741us] +/- 69ms 2024-04-23T15:07:03.779 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T15:07:03.785 INFO:teuthology.orchestra.run.smithi156.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-23T15:07:03.785 INFO:teuthology.orchestra.run.smithi156.stdout:=============================================================================== 2024-04-23T15:07:03.785 INFO:teuthology.orchestra.run.smithi156.stdout:^- hv01.front.sepia.ceph.com 2 6 377 43 +833us[ +859us] +/- 592ms 2024-04-23T15:07:03.785 INFO:teuthology.orchestra.run.smithi156.stdout:^* hv02.front.sepia.ceph.com 3 6 377 41 -570us[ -544us] +/- 57ms 2024-04-23T15:07:03.785 INFO:teuthology.orchestra.run.smithi156.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 41 +706us[ +706us] +/- 69ms 2024-04-23T15:07:03.785 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T15:07:03.786 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-23T15:07:03.797 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-23T15:07:03.798 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-23T15:07:03.809 DEBUG:teuthology.orchestra.run.smithi081:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-23T15:07:04.026 DEBUG:teuthology.orchestra.run.smithi156:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-23T15:07:04.230 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-23T15:07:04.325 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T15:07:04.326 DEBUG:teuthology.orchestra.run.smithi156:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-23T15:07:04.419 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T15:07:04.420 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-23T15:07:04.432 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-23T15:07:04.444 INFO:teuthology.task.internal:Duration was 2504.597385 seconds 2024-04-23T15:07:04.444 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-23T15:07:04.456 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-23T15:07:04.456 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-23T15:07:04.464 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-23T15:07:04.589 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-23T15:07:04.600 INFO:teuthology.orchestra.run.smithi156.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-23T15:07:04.915 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-23T15:07:04.915 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi081.front.sepia.ceph.com 2024-04-23T15:07:04.916 DEBUG:teuthology.orchestra.run.smithi081:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-23T15:07:04.976 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi156.front.sepia.ceph.com 2024-04-23T15:07:04.976 DEBUG:teuthology.orchestra.run.smithi156:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-23T15:07:05.047 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-23T15:07:05.047 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-23T15:07:05.052 DEBUG:teuthology.orchestra.run.smithi156:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-23T15:07:05.133 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-23T15:07:05.134 DEBUG:teuthology.orchestra.run.smithi081:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-23T15:07:05.139 DEBUG:teuthology.orchestra.run.smithi156:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-23T15:07:05.900 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-23T15:07:05.912 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-23T15:07:05.912 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-23T15:07:05.989 DEBUG:teuthology.orchestra.run.smithi156:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-23T15:07:06.079 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-23T15:07:06.092 DEBUG:teuthology.orchestra.run.smithi081:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-23T15:07:06.099 DEBUG:teuthology.orchestra.run.smithi156:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-23T15:07:06.190 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = core 2024-04-23T15:07:06.200 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern = core 2024-04-23T15:07:06.241 DEBUG:teuthology.orchestra.run.smithi081:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-23T15:07:06.292 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T15:07:06.292 DEBUG:teuthology.orchestra.run.smithi156:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-23T15:07:06.348 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T15:07:06.348 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-23T15:07:06.360 INFO:teuthology.task.internal:Transferring archived files... 2024-04-23T15:07:06.361 DEBUG:teuthology.misc:Transferring archived files from smithi081:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-23_14:04:26-fs-wip-rishabh-testing-20240416.193735-3-testing-default-smithi/7669570/remote/smithi081 2024-04-23T15:07:06.361 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-23T15:07:06.476 DEBUG:teuthology.misc:Transferring archived files from smithi156:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-23_14:04:26-fs-wip-rishabh-testing-20240416.193735-3-testing-default-smithi/7669570/remote/smithi156 2024-04-23T15:07:06.476 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-23T15:07:06.578 INFO:teuthology.task.internal:Removing archive directory... 2024-04-23T15:07:06.578 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-23T15:07:06.586 DEBUG:teuthology.orchestra.run.smithi156:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-23T15:07:06.641 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-23T15:07:06.655 INFO:teuthology.task.internal:Not uploading archives. 2024-04-23T15:07:06.655 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-23T15:07:06.667 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-23T15:07:06.667 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-23T15:07:06.673 DEBUG:teuthology.orchestra.run.smithi156:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-23T15:07:06.723 INFO:teuthology.orchestra.run.smithi081.stdout: 393251 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 23 15:07 /home/ubuntu/cephtest 2024-04-23T15:07:06.728 INFO:teuthology.orchestra.run.smithi156.stdout: 393949 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 23 15:07 /home/ubuntu/cephtest 2024-04-23T15:07:06.731 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-23T15:07:06.743 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-23T15:07:06.771 INFO:teuthology.run:Summary data: description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2504.597385406494 flavor: default host.a-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 host.b-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 owner: scheduled_rishabh@teuthology success: true 2024-04-23T15:07:06.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-23T15:07:06.851 INFO:teuthology.run:pass